2024-06-02T23:37:10.243 INFO:root:teuthology version: 0.0.1.dev303+g861a8dc 2024-06-02T23:37:10.244 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/fsstress}} --verbose --archive /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738688 --owner scheduled_teuthology@teuthology --name teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi -- /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738688/orig.config.yaml 2024-06-02T23:37:10.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-02T23:37:10.385 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738688 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/fsstress}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7738688' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - slow metadata IO - SLOW_OPS - slow request sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: dfcc4b3c2c55532c4c04fa47551c9df1dffdf746 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 2064 sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba sleep_before_teardown: 0 subset: 125/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: dfcc4b3c2c55532c4c04fa47551c9df1dffdf746 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi049.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMr3rs6M63h9h7ycfKm9VeIJSBAtQqprokxXkDriZpUiPBB1Lm0wrlwCtkZwrBoZHsmU63SdDFqEwetVEIUBNLY= smithi057.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJAPdV4geuBMry5C+Ujh9ghzbdQly1FwwMWnH5TjFXISNCNJ8R/ibss2O8ThVZjYSDkVFBsdYJ0Y2znK2Lh/8Lk= smithi107.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMI7eWLC0cXeOqqqEHF4Zgd+EbJGByE4WCilBxPYz86BMwVN9SdpxDAu7VQNbQ5fGDBjpO0yuntk4fDGHrbAzWg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 861a8dcf7aa816a26e13f039336f7ed0a9aec0fa timestamp: 2024-06-02_21:24:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-06-02T23:37:10.385 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa; will attempt to use it 2024-06-02T23:37:10.386 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks 2024-06-02T23:37:10.386 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-06-02T23:37:10.387 INFO:teuthology.task.internal:Checking packages... 2024-06-02T23:37:10.408 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3d89accfe3201286f000e065a1faea2a88c7a6ba' 2024-06-02T23:37:10.408 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-06-02T23:37:10.408 INFO:teuthology.packaging:ref: None 2024-06-02T23:37:10.408 INFO:teuthology.packaging:tag: None 2024-06-02T23:37:10.408 INFO:teuthology.packaging:branch: squid 2024-06-02T23:37:10.408 INFO:teuthology.packaging:sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T23:37:10.408 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-06-02T23:37:10.699 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2952.gdfcc4b3c 2024-06-02T23:37:10.701 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-06-02T23:37:10.709 INFO:teuthology.task.internal:no buildpackages task found 2024-06-02T23:37:10.709 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-06-02T23:37:10.732 INFO:teuthology.task.internal:Saving configuration 2024-06-02T23:37:10.757 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-06-02T23:37:10.776 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-06-02T23:37:10.803 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738688', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-02 23:31:16.878014', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMr3rs6M63h9h7ycfKm9VeIJSBAtQqprokxXkDriZpUiPBB1Lm0wrlwCtkZwrBoZHsmU63SdDFqEwetVEIUBNLY='} 2024-06-02T23:37:10.827 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738688', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-02 23:31:16.879495', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJAPdV4geuBMry5C+Ujh9ghzbdQly1FwwMWnH5TjFXISNCNJ8R/ibss2O8ThVZjYSDkVFBsdYJ0Y2znK2Lh/8Lk='} 2024-06-02T23:37:10.849 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738688', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-02 23:31:16.876250', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMI7eWLC0cXeOqqqEHF4Zgd+EbJGByE4WCilBxPYz86BMwVN9SdpxDAu7VQNbQ5fGDBjpO0yuntk4fDGHrbAzWg='} 2024-06-02T23:37:10.849 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-06-02T23:37:10.861 INFO:teuthology.task.internal:roles: ubuntu@smithi049.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-06-02T23:37:10.861 INFO:teuthology.task.internal:roles: ubuntu@smithi057.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-06-02T23:37:10.861 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-06-02T23:37:10.861 INFO:teuthology.run_tasks:Running task console_log... 2024-06-02T23:37:10.960 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f45ec8c95a0>, signals=[15]) 2024-06-02T23:37:10.960 INFO:teuthology.run_tasks:Running task internal.connect... 2024-06-02T23:37:10.971 INFO:teuthology.task.internal:Opening connections... 2024-06-02T23:37:10.971 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi049.front.sepia.ceph.com 2024-06-02T23:37:10.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T23:37:11.051 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi057.front.sepia.ceph.com 2024-06-02T23:37:11.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T23:37:11.130 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi107.front.sepia.ceph.com 2024-06-02T23:37:11.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T23:37:11.208 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-06-02T23:37:11.223 DEBUG:teuthology.orchestra.run.smithi049:> uname -m 2024-06-02T23:37:11.242 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64 2024-06-02T23:37:11.242 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2024-06-02T23:37:11.300 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream" 2024-06-02T23:37:11.301 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="9" 2024-06-02T23:37:11.301 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos" 2024-06-02T23:37:11.301 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora" 2024-06-02T23:37:11.301 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="9" 2024-06-02T23:37:11.301 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el9" 2024-06-02T23:37:11.301 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-02T23:37:11.301 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2024-06-02T23:37:11.301 INFO:teuthology.orchestra.run.smithi049.stdout:LOGO="fedora-logo-icon" 2024-06-02T23:37:11.301 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-02T23:37:11.302 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/" 2024-06-02T23:37:11.302 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-02T23:37:11.302 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-02T23:37:11.302 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-02T23:37:11.303 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2024-06-02T23:37:11.321 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2024-06-02T23:37:11.340 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2024-06-02T23:37:11.341 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2024-06-02T23:37:11.399 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="CentOS Stream" 2024-06-02T23:37:11.399 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="9" 2024-06-02T23:37:11.400 INFO:teuthology.orchestra.run.smithi057.stdout:ID="centos" 2024-06-02T23:37:11.400 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="rhel fedora" 2024-06-02T23:37:11.400 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="9" 2024-06-02T23:37:11.400 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el9" 2024-06-02T23:37:11.400 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-02T23:37:11.400 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2024-06-02T23:37:11.401 INFO:teuthology.orchestra.run.smithi057.stdout:LOGO="fedora-logo-icon" 2024-06-02T23:37:11.401 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-02T23:37:11.401 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://centos.org/" 2024-06-02T23:37:11.401 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-02T23:37:11.402 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-02T23:37:11.402 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-02T23:37:11.402 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2024-06-02T23:37:11.430 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2024-06-02T23:37:11.451 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2024-06-02T23:37:11.451 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-06-02T23:37:11.510 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2024-06-02T23:37:11.510 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9" 2024-06-02T23:37:11.511 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2024-06-02T23:37:11.511 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2024-06-02T23:37:11.511 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9" 2024-06-02T23:37:11.511 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9" 2024-06-02T23:37:11.511 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-02T23:37:11.511 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2024-06-02T23:37:11.511 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon" 2024-06-02T23:37:11.511 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-02T23:37:11.511 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2024-06-02T23:37:11.511 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-02T23:37:11.511 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-02T23:37:11.512 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-02T23:37:11.512 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-06-02T23:37:11.529 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-06-02T23:37:11.542 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-06-02T23:37:11.553 INFO:teuthology.task.internal:Checking for old test directory... 2024-06-02T23:37:11.554 DEBUG:teuthology.orchestra.run.smithi049:> test '!' -e /home/ubuntu/cephtest 2024-06-02T23:37:11.556 DEBUG:teuthology.orchestra.run.smithi057:> test '!' -e /home/ubuntu/cephtest 2024-06-02T23:37:11.558 DEBUG:teuthology.orchestra.run.smithi107:> test '!' -e /home/ubuntu/cephtest 2024-06-02T23:37:11.575 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-06-02T23:37:11.583 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-06-02T23:37:11.583 DEBUG:teuthology.orchestra.run.smithi049:> test -z $(ls -A /var/lib/ceph) 2024-06-02T23:37:11.614 DEBUG:teuthology.orchestra.run.smithi057:> test -z $(ls -A /var/lib/ceph) 2024-06-02T23:37:11.616 DEBUG:teuthology.orchestra.run.smithi107:> test -z $(ls -A /var/lib/ceph) 2024-06-02T23:37:11.690 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-06-02T23:37:11.767 INFO:teuthology.run_tasks:Running task kernel... 2024-06-02T23:37:11.784 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-06-02T23:37:11.784 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-06-02T23:37:11.784 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-06-02T23:37:11.784 DEBUG:teuthology.orchestra.run.smithi049:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-02T23:37:11.802 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T23:37:11.802 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2024-06-02T23:37:11.859 INFO:teuthology.orchestra.run.smithi049.stdout:5.14.0-437.el9.x86_64 2024-06-02T23:37:11.860 INFO:teuthology.task.kernel:Running kernel on smithi049: 5.14.0-437.el9.x86_64 2024-06-02T23:37:11.860 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum install -y kernel 2024-06-02T23:37:14.580 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - BaseOS 7.2 MB/s | 8.1 MB 00:01 2024-06-02T23:37:16.390 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - AppStream 28 MB/s | 19 MB 00:00 2024-06-02T23:37:20.449 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - CRB 18 MB/s | 6.2 MB 00:00 2024-06-02T23:37:22.168 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 17 kB 00:00 2024-06-02T23:37:23.564 INFO:teuthology.orchestra.run.smithi049.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-06-02T23:37:28.886 INFO:teuthology.orchestra.run.smithi049.stdout:lab-extras 45 kB/s | 1.7 kB 00:00 2024-06-02T23:37:30.959 INFO:teuthology.orchestra.run.smithi049.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-06-02T23:37:30.959 INFO:teuthology.orchestra.run.smithi049.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-06-02T23:37:31.046 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-06-02T23:37:31.059 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-06-02T23:37:31.059 INFO:teuthology.orchestra.run.smithi049.stdout: Package Architecture Version Repository Size 2024-06-02T23:37:31.059 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-06-02T23:37:31.059 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-06-02T23:37:31.059 INFO:teuthology.orchestra.run.smithi049.stdout: kernel x86_64 5.14.0-452.el9 baseos 893 k 2024-06-02T23:37:31.059 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2024-06-02T23:37:31.060 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-core x86_64 5.14.0-452.el9 baseos 16 M 2024-06-02T23:37:31.060 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-modules x86_64 5.14.0-452.el9 baseos 35 M 2024-06-02T23:37:31.060 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-modules-core x86_64 5.14.0-452.el9 baseos 29 M 2024-06-02T23:37:31.060 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:37:31.060 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-06-02T23:37:31.060 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-06-02T23:37:31.060 INFO:teuthology.orchestra.run.smithi049.stdout:Install 4 Packages 2024-06-02T23:37:31.060 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:37:31.061 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 80 M 2024-06-02T23:37:31.061 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 124 M 2024-06-02T23:37:31.061 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-06-02T23:37:31.312 INFO:teuthology.orchestra.run.smithi049.stdout:(1/4): kernel-5.14.0-452.el9.x86_64.rpm 7.3 MB/s | 893 kB 00:00 2024-06-02T23:37:32.063 INFO:teuthology.orchestra.run.smithi049.stdout:(2/4): kernel-core-5.14.0-452.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-06-02T23:37:32.479 INFO:teuthology.orchestra.run.smithi049.stdout:(3/4): kernel-modules-core-5.14.0-452.el9.x86_6 25 MB/s | 29 MB 00:01 2024-06-02T23:37:32.880 INFO:teuthology.orchestra.run.smithi049.stdout:(4/4): kernel-modules-5.14.0-452.el9.x86_64.rpm 20 MB/s | 35 MB 00:01 2024-06-02T23:37:32.880 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:37:32.880 INFO:teuthology.orchestra.run.smithi049.stdout:Total 44 MB/s | 80 MB 00:01 2024-06-02T23:37:33.607 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-06-02T23:37:34.002 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-06-02T23:37:34.002 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-06-02T23:37:34.963 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-06-02T23:37:34.963 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-06-02T23:37:37.512 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-06-02T23:37:38.194 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : kernel-modules-core-5.14.0-452.el9.x86_64 1/4 2024-06-02T23:37:38.289 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-02T23:37:41.095 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-02T23:37:41.253 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-02T23:37:46.340 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-02T23:37:46.392 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : kernel-5.14.0-452.el9.x86_64 4/4 2024-06-02T23:37:51.513 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-02T23:38:22.498 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 4/4 2024-06-02T23:38:22.540 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 4/4 2024-06-02T23:38:22.885 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-5.14.0-452.el9.x86_64 4/4 2024-06-02T23:38:22.885 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : kernel-5.14.0-452.el9.x86_64 1/4 2024-06-02T23:38:22.885 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-02T23:38:22.885 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-02T23:38:23.726 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-02T23:38:23.726 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:38:23.726 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-06-02T23:38:23.726 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-5.14.0-452.el9.x86_64 2024-06-02T23:38:23.727 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-core-5.14.0-452.el9.x86_64 2024-06-02T23:38:23.727 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-modules-5.14.0-452.el9.x86_64 2024-06-02T23:38:23.727 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-modules-core-5.14.0-452.el9.x86_64 2024-06-02T23:38:23.727 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:38:23.727 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-06-02T23:38:24.086 DEBUG:teuthology.orchestra.run.smithi049:> rpm -q kernel | sort -rV | head -n 1 2024-06-02T23:38:24.167 INFO:teuthology.orchestra.run.smithi049.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-02T23:38:24.168 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-02T23:38:24.168 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-452.el9.x86_64 2024-06-02T23:38:24.168 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-06-02T23:38:24.168 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-06-02T23:38:24.168 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-06-02T23:38:24.168 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi049.front.sepia.ceph.com, path=None, version=distro) 2024-06-02T23:38:24.168 DEBUG:teuthology.orchestra.run.smithi049:> rpm -q kernel | sort -rV | head -n 1 2024-06-02T23:38:24.221 INFO:teuthology.orchestra.run.smithi049.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-02T23:38:24.222 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-02T23:38:24.222 DEBUG:teuthology.orchestra.run.smithi049:> sudo rpm -qi grub2-tools 2024-06-02T23:38:24.254 INFO:teuthology.orchestra.run.smithi049.stdout:Name : grub2-tools 2024-06-02T23:38:24.254 INFO:teuthology.orchestra.run.smithi049.stdout:Epoch : 1 2024-06-02T23:38:24.254 INFO:teuthology.orchestra.run.smithi049.stdout:Version : 2.06 2024-06-02T23:38:24.254 INFO:teuthology.orchestra.run.smithi049.stdout:Release : 68.el9 2024-06-02T23:38:24.254 INFO:teuthology.orchestra.run.smithi049.stdout:Architecture: x86_64 2024-06-02T23:38:24.254 INFO:teuthology.orchestra.run.smithi049.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-06-02T23:38:24.255 INFO:teuthology.orchestra.run.smithi049.stdout:Group : Unspecified 2024-06-02T23:38:24.255 INFO:teuthology.orchestra.run.smithi049.stdout:Size : 8264254 2024-06-02T23:38:24.255 INFO:teuthology.orchestra.run.smithi049.stdout:License : GPLv3+ 2024-06-02T23:38:24.255 INFO:teuthology.orchestra.run.smithi049.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-06-02T23:38:24.255 INFO:teuthology.orchestra.run.smithi049.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-06-02T23:38:24.255 INFO:teuthology.orchestra.run.smithi049.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-06-02T23:38:24.255 INFO:teuthology.orchestra.run.smithi049.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-06-02T23:38:24.255 INFO:teuthology.orchestra.run.smithi049.stdout:Packager : builder@centos.org 2024-06-02T23:38:24.255 INFO:teuthology.orchestra.run.smithi049.stdout:Vendor : CentOS 2024-06-02T23:38:24.255 INFO:teuthology.orchestra.run.smithi049.stdout:URL : http://www.gnu.org/software/grub/ 2024-06-02T23:38:24.255 INFO:teuthology.orchestra.run.smithi049.stdout:Summary : Support tools for GRUB. 2024-06-02T23:38:24.255 INFO:teuthology.orchestra.run.smithi049.stdout:Description : 2024-06-02T23:38:24.255 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:38:24.255 INFO:teuthology.orchestra.run.smithi049.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-06-02T23:38:24.255 INFO:teuthology.orchestra.run.smithi049.stdout:customizable bootloader with modular architecture. It supports a rich 2024-06-02T23:38:24.256 INFO:teuthology.orchestra.run.smithi049.stdout:variety of kernel formats, file systems, computer architectures and 2024-06-02T23:38:24.256 INFO:teuthology.orchestra.run.smithi049.stdout:hardware devices. 2024-06-02T23:38:24.256 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:38:24.256 INFO:teuthology.orchestra.run.smithi049.stdout:This subpackage provides tools for support of all platforms. 2024-06-02T23:38:24.257 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-06-02T23:38:24.257 INFO:teuthology.task.kernel:Updating grub on smithi049 to boot 5.14.0-452.el9.x86_64 2024-06-02T23:38:24.257 DEBUG:teuthology.orchestra.run.smithi049:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-06-02T23:38:24.884 INFO:teuthology.orchestra.run.smithi049.stderr:Generating grub configuration file ... 2024-06-02T23:38:26.368 INFO:teuthology.orchestra.run.smithi049.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-06-02T23:38:26.400 INFO:teuthology.orchestra.run.smithi049.stderr:done 2024-06-02T23:38:26.402 DEBUG:teuthology.orchestra.run.smithi049:> mktemp 2024-06-02T23:38:26.417 INFO:teuthology.orchestra.run.smithi049.stdout:/tmp/tmp.hcVriRd9Hb 2024-06-02T23:38:26.418 DEBUG:teuthology.orchestra.run.smithi049:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.hcVriRd9Hb 2024-06-02T23:38:26.483 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0666 /tmp/tmp.hcVriRd9Hb 2024-06-02T23:38:26.625 DEBUG:teuthology.orchestra.remote:smithi049:/tmp/tmp.hcVriRd9Hb is 6KB 2024-06-02T23:38:26.673 DEBUG:teuthology.orchestra.run.smithi049:> rm -fr /tmp/tmp.hcVriRd9Hb 2024-06-02T23:38:26.688 DEBUG:teuthology.orchestra.run.smithi049:> sudo /bin/ls /boot/loader/entries || true 2024-06-02T23:38:26.750 INFO:teuthology.orchestra.run.smithi049.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-06-02T23:38:26.750 INFO:teuthology.orchestra.run.smithi049.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-06-02T23:38:26.750 INFO:teuthology.orchestra.run.smithi049.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-06-02T23:38:26.750 INFO:teuthology.orchestra.run.smithi049.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64.conf 2024-06-02T23:38:26.751 DEBUG:teuthology.orchestra.run.smithi049:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64 2024-06-02T23:38:26.901 DEBUG:teuthology.orchestra.run.smithi049:> sudo shutdown -r now 2024-06-02T23:38:56.904 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-06-02T23:38:56.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-06-02T23:38:56.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T23:39:15.362 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-06-02T23:39:24.363 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-06-02T23:39:24.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T23:39:27.422 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-06-02T23:39:39.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-06-02T23:39:39.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T23:39:42.494 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-06-02T23:39:57.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-06-02T23:39:57.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T23:40:57.499 DEBUG:teuthology.orchestra.remote:timed out 2024-06-02T23:41:15.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-06-02T23:41:15.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T23:41:15.781 DEBUG:teuthology.orchestra.run.smithi049:> true 2024-06-02T23:41:16.161 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-06-02T23:41:16.161 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-452.el9.x86_64"... 2024-06-02T23:41:16.161 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2024-06-02T23:41:16.178 INFO:teuthology.orchestra.run.smithi049.stdout:5.14.0-452.el9.x86_64 2024-06-02T23:41:16.178 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-452.el9.x86_64 vs 5.14.0-452.el9.x86_64 2024-06-02T23:41:16.178 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-06-02T23:41:16.178 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-06-02T23:41:17.179 DEBUG:teuthology.parallel:result is None 2024-06-02T23:41:17.179 INFO:teuthology.run_tasks:Running task internal.base... 2024-06-02T23:41:17.188 INFO:teuthology.task.internal:Creating test directory... 2024-06-02T23:41:17.188 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-02T23:41:17.191 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-02T23:41:17.194 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-02T23:41:17.212 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-06-02T23:41:17.219 INFO:teuthology.run_tasks:Running task internal.archive... 2024-06-02T23:41:17.229 INFO:teuthology.task.internal:Creating archive directory... 2024-06-02T23:41:17.229 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-02T23:41:17.250 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-02T23:41:17.253 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-02T23:41:17.296 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-06-02T23:41:17.302 INFO:teuthology.task.internal:Enabling coredump saving... 2024-06-02T23:41:17.302 DEBUG:teuthology.orchestra.run.smithi057:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-02T23:41:17.345 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T23:41:17.346 DEBUG:teuthology.orchestra.run.smithi107:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-02T23:41:17.362 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T23:41:17.362 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-02T23:41:17.365 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-02T23:41:17.391 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-02T23:41:17.427 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T23:41:17.435 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T23:41:17.441 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T23:41:17.445 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T23:41:17.455 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T23:41:17.477 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T23:41:17.478 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-06-02T23:41:17.485 INFO:teuthology.task.internal:Configuring sudo... 2024-06-02T23:41:17.485 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-02T23:41:17.488 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-02T23:41:17.490 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-02T23:41:17.525 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-06-02T23:41:17.534 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-06-02T23:41:17.534 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-02T23:41:17.557 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-02T23:41:17.559 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-02T23:41:17.582 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T23:41:17.656 DEBUG:teuthology.orchestra.run.smithi049:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T23:41:17.703 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T23:41:17.787 DEBUG:teuthology.orchestra.run.smithi049:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T23:41:17.829 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-06-02T23:41:17.829 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-02T23:41:17.896 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T23:41:17.943 DEBUG:teuthology.orchestra.run.smithi057:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T23:41:17.994 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T23:41:18.079 DEBUG:teuthology.orchestra.run.smithi057:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T23:41:18.120 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-06-02T23:41:18.121 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-02T23:41:18.187 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T23:41:18.232 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T23:41:18.292 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T23:41:18.377 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T23:41:18.420 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-06-02T23:41:18.420 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-02T23:41:18.488 DEBUG:teuthology.orchestra.run.smithi049:> sudo service rsyslog restart 2024-06-02T23:41:18.491 DEBUG:teuthology.orchestra.run.smithi057:> sudo service rsyslog restart 2024-06-02T23:41:18.494 DEBUG:teuthology.orchestra.run.smithi107:> sudo service rsyslog restart 2024-06-02T23:41:18.532 INFO:teuthology.orchestra.run.smithi057.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T23:41:18.534 INFO:teuthology.orchestra.run.smithi049.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T23:41:18.577 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T23:41:19.010 INFO:teuthology.run_tasks:Running task internal.timer... 2024-06-02T23:41:19.021 INFO:teuthology.task.internal:Starting timer... 2024-06-02T23:41:19.021 INFO:teuthology.run_tasks:Running task pcp... 2024-06-02T23:41:19.035 INFO:teuthology.run_tasks:Running task selinux... 2024-06-02T23:41:19.044 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-06-02T23:41:19.044 DEBUG:teuthology.orchestra.run.smithi049:> sudo service auditd rotate 2024-06-02T23:41:19.102 INFO:teuthology.orchestra.run.smithi049.stdout:Rotating logs: 2024-06-02T23:41:19.104 DEBUG:teuthology.orchestra.run.smithi057:> sudo service auditd rotate 2024-06-02T23:41:19.174 INFO:teuthology.orchestra.run.smithi057.stdout:Rotating logs: 2024-06-02T23:41:19.176 DEBUG:teuthology.orchestra.run.smithi107:> sudo service auditd rotate 2024-06-02T23:41:19.221 INFO:teuthology.orchestra.run.smithi107.stdout:Rotating logs: 2024-06-02T23:41:19.223 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-06-02T23:41:19.224 DEBUG:teuthology.orchestra.run.smithi049:> /usr/sbin/getenforce 2024-06-02T23:41:19.248 INFO:teuthology.orchestra.run.smithi049.stdout:Permissive 2024-06-02T23:41:19.248 DEBUG:teuthology.orchestra.run.smithi057:> /usr/sbin/getenforce 2024-06-02T23:41:19.270 INFO:teuthology.orchestra.run.smithi057.stdout:Permissive 2024-06-02T23:41:19.271 DEBUG:teuthology.orchestra.run.smithi107:> /usr/sbin/getenforce 2024-06-02T23:41:19.291 INFO:teuthology.orchestra.run.smithi107.stdout:Permissive 2024-06-02T23:41:19.291 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi049.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi057.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi107.front.sepia.ceph.com': 'permissive'} 2024-06-02T23:41:19.291 DEBUG:teuthology.orchestra.run.smithi049:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-02T23:41:19.321 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T23:41:19.322 DEBUG:teuthology.orchestra.run.smithi057:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-02T23:41:19.350 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T23:41:19.350 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-02T23:41:19.376 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T23:41:19.377 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-06-02T23:41:19.377 DEBUG:teuthology.orchestra.run.smithi049:> sudo /usr/sbin/setenforce permissive 2024-06-02T23:41:19.406 DEBUG:teuthology.orchestra.run.smithi057:> sudo /usr/sbin/setenforce permissive 2024-06-02T23:41:19.432 DEBUG:teuthology.orchestra.run.smithi107:> sudo /usr/sbin/setenforce permissive 2024-06-02T23:41:19.456 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-06-02T23:41:19.466 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-06-02T23:41:19.469 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-06-02T23:41:19.619 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-06-02T23:41:19.629 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-06-02T23:41:19.630 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi049.front.sepia.ceph.com,smithi057.front.sepia.ceph.com,smithi107.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-06-02T23:45:57.297 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi049.front.sepia.ceph.com'), Remote(name='ubuntu@smithi057.front.sepia.ceph.com'), Remote(name='ubuntu@smithi107.front.sepia.ceph.com')] 2024-06-02T23:45:57.298 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-06-02T23:45:57.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T23:45:57.379 DEBUG:teuthology.orchestra.run.smithi049:> true 2024-06-02T23:45:57.459 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-06-02T23:45:57.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-06-02T23:45:57.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T23:45:57.548 DEBUG:teuthology.orchestra.run.smithi057:> true 2024-06-02T23:45:57.630 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-06-02T23:45:57.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-06-02T23:45:57.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T23:45:57.706 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-06-02T23:45:57.797 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-06-02T23:45:57.798 INFO:teuthology.run_tasks:Running task clock... 2024-06-02T23:45:57.813 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-06-02T23:45:57.813 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-02T23:45:57.814 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T23:45:57.817 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-02T23:45:57.817 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T23:45:57.820 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-02T23:45:57.821 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T23:45:57.846 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-02T23:45:57.853 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-02T23:45:57.861 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-02T23:45:57.865 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-02T23:45:57.868 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-02T23:45:57.879 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-02T23:45:57.886 INFO:teuthology.orchestra.run.smithi049.stderr:sudo: ntpd: command not found 2024-06-02T23:45:57.894 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: ntpd: command not found 2024-06-02T23:45:57.898 INFO:teuthology.orchestra.run.smithi049.stdout:506 Cannot talk to daemon 2024-06-02T23:45:57.902 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: ntpd: command not found 2024-06-02T23:45:57.906 INFO:teuthology.orchestra.run.smithi057.stdout:506 Cannot talk to daemon 2024-06-02T23:45:57.913 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-02T23:45:57.913 INFO:teuthology.orchestra.run.smithi107.stdout:506 Cannot talk to daemon 2024-06-02T23:45:57.920 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-02T23:45:57.926 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-02T23:45:57.927 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-02T23:45:57.934 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-02T23:45:57.939 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-02T23:45:57.985 INFO:teuthology.orchestra.run.smithi049.stderr:bash: line 1: ntpq: command not found 2024-06-02T23:45:57.988 INFO:teuthology.orchestra.run.smithi049.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T23:45:57.988 INFO:teuthology.orchestra.run.smithi049.stdout:=============================================================================== 2024-06-02T23:45:57.988 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:45:57.988 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:45:57.988 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:45:57.989 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:45:57.997 INFO:teuthology.orchestra.run.smithi057.stderr:bash: line 1: ntpq: command not found 2024-06-02T23:45:57.998 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2024-06-02T23:45:58.001 INFO:teuthology.orchestra.run.smithi057.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T23:45:58.001 INFO:teuthology.orchestra.run.smithi057.stdout:=============================================================================== 2024-06-02T23:45:58.002 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:45:58.002 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:45:58.002 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:45:58.003 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:45:58.004 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T23:45:58.004 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2024-06-02T23:45:58.004 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:45:58.004 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:45:58.004 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:45:58.004 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:45:58.005 INFO:teuthology.run_tasks:Running task install... 2024-06-02T23:45:58.013 DEBUG:teuthology.task.install:project ceph 2024-06-02T23:45:58.013 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'}} 2024-06-02T23:45:58.013 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'} 2024-06-02T23:45:58.013 INFO:teuthology.task.install:Using flavor: default 2024-06-02T23:45:58.018 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-06-02T23:45:58.019 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-06-02T23:45:58.019 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'tag': None, 'wait_for_package': False} 2024-06-02T23:45:58.020 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T23:45:58.021 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'tag': None, 'wait_for_package': False} 2024-06-02T23:45:58.022 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T23:45:58.022 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'tag': None, 'wait_for_package': False} 2024-06-02T23:45:58.023 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T23:45:58.182 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/ 2024-06-02T23:45:58.182 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2946.g3d89accf 2024-06-02T23:45:58.188 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/ 2024-06-02T23:45:58.188 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2946.g3d89accf 2024-06-02T23:45:58.245 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/ 2024-06-02T23:45:58.245 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2946.g3d89accf 2024-06-02T23:45:58.293 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-02T23:45:58.293 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-06-02T23:45:58.293 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-02T23:45:58.317 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-02T23:45:58.318 DEBUG:teuthology.orchestra.run.smithi107:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d89accfe3201286f000e065a1faea2a88c7a6ba/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-02T23:45:58.360 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-02T23:45:58.360 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-06-02T23:45:58.360 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-02T23:45:58.364 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-02T23:45:58.364 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-06-02T23:45:58.365 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-02T23:45:58.385 DEBUG:teuthology.orchestra.run.smithi107:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-02T23:45:58.392 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-02T23:45:58.392 DEBUG:teuthology.orchestra.run.smithi049:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d89accfe3201286f000e065a1faea2a88c7a6ba/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-02T23:45:58.394 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-02T23:45:58.394 DEBUG:teuthology.orchestra.run.smithi057:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d89accfe3201286f000e065a1faea2a88c7a6ba/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-02T23:45:58.458 DEBUG:teuthology.orchestra.run.smithi107:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-02T23:45:58.459 DEBUG:teuthology.orchestra.run.smithi049:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-02T23:45:58.461 DEBUG:teuthology.orchestra.run.smithi057:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-02T23:45:58.521 INFO:teuthology.orchestra.run.smithi107.stdout:check_obsoletes = 1 2024-06-02T23:45:58.523 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum clean all 2024-06-02T23:45:58.535 DEBUG:teuthology.orchestra.run.smithi049:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-02T23:45:58.538 DEBUG:teuthology.orchestra.run.smithi057:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-02T23:45:58.600 INFO:teuthology.orchestra.run.smithi049.stdout:check_obsoletes = 1 2024-06-02T23:45:58.602 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum clean all 2024-06-02T23:45:58.602 INFO:teuthology.orchestra.run.smithi057.stdout:check_obsoletes = 1 2024-06-02T23:45:58.604 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum clean all 2024-06-02T23:45:58.747 INFO:teuthology.orchestra.run.smithi107.stdout:45 files removed 2024-06-02T23:45:58.773 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-02T23:45:58.839 INFO:teuthology.orchestra.run.smithi049.stdout:45 files removed 2024-06-02T23:45:58.840 INFO:teuthology.orchestra.run.smithi057.stdout:45 files removed 2024-06-02T23:45:58.866 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-02T23:45:58.867 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-02T23:45:59.512 INFO:teuthology.orchestra.run.smithi107.stdout:ceph packages for x86_64 174 kB/s | 83 kB 00:00 2024-06-02T23:45:59.540 INFO:teuthology.orchestra.run.smithi057.stdout:ceph packages for x86_64 209 kB/s | 83 kB 00:00 2024-06-02T23:45:59.576 INFO:teuthology.orchestra.run.smithi049.stdout:ceph packages for x86_64 199 kB/s | 83 kB 00:00 2024-06-02T23:45:59.905 INFO:teuthology.orchestra.run.smithi107.stdout:ceph noarch packages 33 kB/s | 11 kB 00:00 2024-06-02T23:45:59.916 INFO:teuthology.orchestra.run.smithi057.stdout:ceph noarch packages 35 kB/s | 11 kB 00:00 2024-06-02T23:45:59.927 INFO:teuthology.orchestra.run.smithi049.stdout:ceph noarch packages 39 kB/s | 11 kB 00:00 2024-06-02T23:46:00.308 INFO:teuthology.orchestra.run.smithi057.stdout:ceph source packages 5.3 kB/s | 1.9 kB 00:00 2024-06-02T23:46:00.311 INFO:teuthology.orchestra.run.smithi049.stdout:ceph source packages 5.6 kB/s | 1.9 kB 00:00 2024-06-02T23:46:00.313 INFO:teuthology.orchestra.run.smithi107.stdout:ceph source packages 5.1 kB/s | 1.9 kB 00:00 2024-06-02T23:46:00.991 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.1 MB 00:00 2024-06-02T23:46:01.447 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - BaseOS 7.4 MB/s | 8.1 MB 00:01 2024-06-02T23:46:02.734 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - AppStream 32 MB/s | 19 MB 00:00 2024-06-02T23:46:03.315 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - AppStream 24 MB/s | 19 MB 00:00 2024-06-02T23:46:04.794 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - BaseOS 1.8 MB/s | 8.1 MB 00:04 2024-06-02T23:46:06.554 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - AppStream 32 MB/s | 19 MB 00:00 2024-06-02T23:46:06.868 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.2 MB 00:00 2024-06-02T23:46:07.540 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - CRB 9.5 MB/s | 6.2 MB 00:00 2024-06-02T23:46:08.335 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 17 kB 00:00 2024-06-02T23:46:08.891 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - Extras packages 91 kB/s | 17 kB 00:00 2024-06-02T23:46:10.001 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 22 MB/s | 21 MB 00:00 2024-06-02T23:46:10.729 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.2 MB 00:00 2024-06-02T23:46:12.239 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 17 kB 00:00 2024-06-02T23:46:13.478 INFO:teuthology.orchestra.run.smithi057.stdout:Extra Packages for Enterprise Linux 4.2 MB/s | 21 MB 00:05 2024-06-02T23:46:13.760 INFO:teuthology.orchestra.run.smithi049.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-06-02T23:46:15.176 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-06-02T23:46:17.460 INFO:teuthology.orchestra.run.smithi107.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-02T23:46:17.461 INFO:teuthology.orchestra.run.smithi107.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-02T23:46:17.472 INFO:teuthology.orchestra.run.smithi107.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-06-02T23:46:17.472 INFO:teuthology.orchestra.run.smithi107.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-06-02T23:46:17.473 INFO:teuthology.orchestra.run.smithi107.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-06-02T23:46:17.474 INFO:teuthology.orchestra.run.smithi107.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-06-02T23:46:17.476 INFO:teuthology.orchestra.run.smithi107.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-06-02T23:46:17.478 INFO:teuthology.orchestra.run.smithi107.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-06-02T23:46:17.479 INFO:teuthology.orchestra.run.smithi107.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-06-02T23:46:17.543 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-06-02T23:46:17.564 INFO:teuthology.orchestra.run.smithi107.stdout:======================================================================================= 2024-06-02T23:46:17.564 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-06-02T23:46:17.564 INFO:teuthology.orchestra.run.smithi107.stdout:======================================================================================= 2024-06-02T23:46:17.564 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-06-02T23:46:17.564 INFO:teuthology.orchestra.run.smithi107.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-02T23:46:17.565 INFO:teuthology.orchestra.run.smithi107.stdout: ceph x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 6.6 k 2024-06-02T23:46:17.565 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.4 M 2024-06-02T23:46:17.565 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 890 k 2024-06-02T23:46:17.565 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 145 k 2024-06-02T23:46:17.565 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 1.5 M 2024-06-02T23:46:17.565 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 142 k 2024-06-02T23:46:17.565 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 3.5 M 2024-06-02T23:46:17.565 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 7.4 M 2024-06-02T23:46:17.565 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 49 k 2024-06-02T23:46:17.565 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 10 M 2024-06-02T23:46:17.565 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 48 M 2024-06-02T23:46:17.565 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-volume noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 264 k 2024-06-02T23:46:17.565 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 763 k 2024-06-02T23:46:17.566 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 221 k 2024-06-02T23:46:17.566 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-shell x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 27 k 2024-06-02T23:46:17.566 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-top noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 18 k 2024-06-02T23:46:17.566 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-02T23:46:17.566 INFO:teuthology.orchestra.run.smithi107.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-02T23:46:17.566 INFO:teuthology.orchestra.run.smithi107.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-02T23:46:17.566 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 32 k 2024-06-02T23:46:17.566 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 747 k 2024-06-02T23:46:17.566 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 127 k 2024-06-02T23:46:17.566 INFO:teuthology.orchestra.run.smithi107.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-02T23:46:17.566 INFO:teuthology.orchestra.run.smithi107.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-02T23:46:17.567 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-06-02T23:46:17.567 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-06-02T23:46:17.567 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-06-02T23:46:17.567 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-06-02T23:46:17.567 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 162 k 2024-06-02T23:46:17.567 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 321 k 2024-06-02T23:46:17.567 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 300 k 2024-06-02T23:46:17.567 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 99 k 2024-06-02T23:46:17.567 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 85 k 2024-06-02T23:46:17.567 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-02T23:46:17.567 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 171 k 2024-06-02T23:46:17.567 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-06-02T23:46:17.567 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrading: 2024-06-02T23:46:17.568 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-06-02T23:46:17.568 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-06-02T23:46:17.568 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-06-02T23:46:17.568 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-06-02T23:46:17.568 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-02T23:46:17.568 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-02T23:46:17.568 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-02T23:46:17.568 INFO:teuthology.orchestra.run.smithi107.stdout: librados2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.4 M 2024-06-02T23:46:17.568 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-02T23:46:17.568 INFO:teuthology.orchestra.run.smithi107.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-06-02T23:46:17.568 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-06-02T23:46:17.569 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-06-02T23:46:17.569 INFO:teuthology.orchestra.run.smithi107.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-02T23:46:17.569 INFO:teuthology.orchestra.run.smithi107.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-02T23:46:17.569 INFO:teuthology.orchestra.run.smithi107.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-02T23:46:17.569 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 21 M 2024-06-02T23:46:17.569 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 32 k 2024-06-02T23:46:17.569 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 2.4 M 2024-06-02T23:46:17.569 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 249 k 2024-06-02T23:46:17.569 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 4.7 M 2024-06-02T23:46:17.569 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 17 M 2024-06-02T23:46:17.569 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 16 k 2024-06-02T23:46:17.569 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 25 k 2024-06-02T23:46:17.570 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-02T23:46:17.570 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-02T23:46:17.570 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-02T23:46:17.570 INFO:teuthology.orchestra.run.smithi107.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-02T23:46:17.570 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-02T23:46:17.570 INFO:teuthology.orchestra.run.smithi107.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-02T23:46:17.570 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-02T23:46:17.570 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-02T23:46:17.570 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 163 k 2024-06-02T23:46:17.570 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-02T23:46:17.570 INFO:teuthology.orchestra.run.smithi107.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-02T23:46:17.571 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-02T23:46:17.571 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-02T23:46:17.571 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-02T23:46:17.571 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 501 k 2024-06-02T23:46:17.571 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-02T23:46:17.571 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.3 M 2024-06-02T23:46:17.571 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-02T23:46:17.571 INFO:teuthology.orchestra.run.smithi107.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-02T23:46:17.571 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-02T23:46:17.571 INFO:teuthology.orchestra.run.smithi107.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-02T23:46:17.571 INFO:teuthology.orchestra.run.smithi107.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-02T23:46:17.571 INFO:teuthology.orchestra.run.smithi107.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-02T23:46:17.571 INFO:teuthology.orchestra.run.smithi107.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-02T23:46:17.572 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-02T23:46:17.572 INFO:teuthology.orchestra.run.smithi107.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-02T23:46:17.572 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-06-02T23:46:17.572 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-02T23:46:17.572 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-02T23:46:17.572 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-02T23:46:17.572 INFO:teuthology.orchestra.run.smithi107.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-06-02T23:46:17.572 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-02T23:46:17.572 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-02T23:46:17.573 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-02T23:46:17.573 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 45 k 2024-06-02T23:46:17.573 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 135 k 2024-06-02T23:46:17.573 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-02T23:46:17.573 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-02T23:46:17.573 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-02T23:46:17.573 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-02T23:46:17.573 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-06-02T23:46:17.573 INFO:teuthology.orchestra.run.smithi107.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-06-02T23:46:17.573 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-02T23:46:17.573 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-02T23:46:17.573 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-06-02T23:46:17.574 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-02T23:46:17.574 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-02T23:46:17.574 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-02T23:46:17.574 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-02T23:46:17.574 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-02T23:46:17.574 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-02T23:46:17.574 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-02T23:46:17.574 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-02T23:46:17.574 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-02T23:46:17.574 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-02T23:46:17.574 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-02T23:46:17.574 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-02T23:46:17.575 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-02T23:46:17.575 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-02T23:46:17.575 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-02T23:46:17.575 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-02T23:46:17.575 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-02T23:46:17.575 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-02T23:46:17.575 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-02T23:46:17.575 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-02T23:46:17.575 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-02T23:46:17.575 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-02T23:46:17.575 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-02T23:46:17.575 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-02T23:46:17.575 INFO:teuthology.orchestra.run.smithi107.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-02T23:46:17.576 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-02T23:46:17.576 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-02T23:46:17.576 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-02T23:46:17.576 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-02T23:46:17.576 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-06-02T23:46:17.576 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-02T23:46:17.576 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-02T23:46:17.576 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-02T23:46:17.576 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-02T23:46:17.576 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-02T23:46:17.576 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-02T23:46:17.576 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-02T23:46:17.576 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-02T23:46:17.577 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-02T23:46:17.577 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-02T23:46:17.577 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-02T23:46:17.577 INFO:teuthology.orchestra.run.smithi107.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-06-02T23:46:17.577 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-02T23:46:17.577 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-02T23:46:17.577 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-02T23:46:17.577 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-02T23:46:17.577 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-02T23:46:17.577 INFO:teuthology.orchestra.run.smithi107.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-02T23:46:17.577 INFO:teuthology.orchestra.run.smithi107.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-02T23:46:17.577 INFO:teuthology.orchestra.run.smithi107.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-06-02T23:46:17.577 INFO:teuthology.orchestra.run.smithi107.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-02T23:46:17.577 INFO:teuthology.orchestra.run.smithi107.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-06-02T23:46:17.578 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-02T23:46:17.578 INFO:teuthology.orchestra.run.smithi107.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-02T23:46:17.578 INFO:teuthology.orchestra.run.smithi107.stdout:Installing weak dependencies: 2024-06-02T23:46:17.578 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-02T23:46:17.578 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-06-02T23:46:17.578 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-06-02T23:46:17.578 INFO:teuthology.orchestra.run.smithi107.stdout:======================================================================================= 2024-06-02T23:46:17.578 INFO:teuthology.orchestra.run.smithi107.stdout:Install 148 Packages 2024-06-02T23:46:17.578 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrade 11 Packages 2024-06-02T23:46:17.578 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-06-02T23:46:17.579 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 225 M 2024-06-02T23:46:17.579 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-06-02T23:46:18.119 INFO:teuthology.orchestra.run.smithi107.stdout:(1/159): ceph-19.0.0-2946.g3d89accf.el9.x86_64. 27 kB/s | 6.6 kB 00:00 2024-06-02T23:46:18.469 INFO:teuthology.orchestra.run.smithi107.stdout:(2/159): ceph-base-19.0.0-2946.g3d89accf.el9.x8 9.0 MB/s | 5.4 MB 00:00 2024-06-02T23:46:18.527 INFO:teuthology.orchestra.run.smithi107.stdout:(3/159): ceph-immutable-object-cache-19.0.0-294 2.4 MB/s | 145 kB 00:00 2024-06-02T23:46:18.744 INFO:teuthology.orchestra.run.smithi107.stdout:(4/159): ceph-mds-19.0.0-2946.g3d89accf.el9.x86 11 MB/s | 2.4 MB 00:00 2024-06-02T23:46:18.895 INFO:teuthology.orchestra.run.smithi107.stdout:(5/159): ceph-mgr-19.0.0-2946.g3d89accf.el9.x86 10 MB/s | 1.5 MB 00:00 2024-06-02T23:46:18.928 INFO:teuthology.orchestra.run.smithi057.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-06-02T23:46:19.011 INFO:teuthology.orchestra.run.smithi107.stdout:(6/159): ceph-fuse-19.0.0-2946.g3d89accf.el9.x8 997 kB/s | 890 kB 00:00 2024-06-02T23:46:19.190 INFO:teuthology.orchestra.run.smithi049.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-06-02T23:46:19.245 INFO:teuthology.orchestra.run.smithi107.stdout:(7/159): ceph-mon-19.0.0-2946.g3d89accf.el9.x86 13 MB/s | 4.7 MB 00:00 2024-06-02T23:46:20.020 INFO:teuthology.orchestra.run.smithi107.stdout:(8/159): ceph-common-19.0.0-2946.g3d89accf.el9. 9.8 MB/s | 21 MB 00:02 2024-06-02T23:46:20.137 INFO:teuthology.orchestra.run.smithi107.stdout:(9/159): ceph-radosgw-19.0.0-2946.g3d89accf.el9 11 MB/s | 10 MB 00:00 2024-06-02T23:46:20.162 INFO:teuthology.orchestra.run.smithi107.stdout:(10/159): ceph-selinux-19.0.0-2946.g3d89accf.el 177 kB/s | 25 kB 00:00 2024-06-02T23:46:20.230 INFO:teuthology.orchestra.run.smithi107.stdout:(11/159): cephfs-mirror-19.0.0-2946.g3d89accf.e 3.2 MB/s | 221 kB 00:00 2024-06-02T23:46:20.305 INFO:teuthology.orchestra.run.smithi107.stdout:(12/159): cephfs-shell-19.0.0-2946.g3d89accf.el 361 kB/s | 27 kB 00:00 2024-06-02T23:46:20.380 INFO:teuthology.orchestra.run.smithi107.stdout:(13/159): libcephfs-devel-19.0.0-2946.g3d89accf 424 kB/s | 32 kB 00:00 2024-06-02T23:46:20.530 INFO:teuthology.orchestra.run.smithi107.stdout:(14/159): libcephfs2-19.0.0-2946.g3d89accf.el9. 4.9 MB/s | 747 kB 00:00 2024-06-02T23:46:20.606 INFO:teuthology.orchestra.run.smithi107.stdout:(15/159): libcephsqlite-19.0.0-2946.g3d89accf.e 2.1 MB/s | 163 kB 00:00 2024-06-02T23:46:20.681 INFO:teuthology.orchestra.run.smithi107.stdout:(16/159): librados-devel-19.0.0-2946.g3d89accf. 1.7 MB/s | 127 kB 00:00 2024-06-02T23:46:20.773 INFO:teuthology.orchestra.run.smithi107.stdout:(17/159): libradosstriper1-19.0.0-2946.g3d89acc 5.3 MB/s | 501 kB 00:00 2024-06-02T23:46:21.323 INFO:teuthology.orchestra.run.smithi057.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-02T23:46:21.323 INFO:teuthology.orchestra.run.smithi057.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-02T23:46:21.335 INFO:teuthology.orchestra.run.smithi057.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-06-02T23:46:21.336 INFO:teuthology.orchestra.run.smithi057.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-06-02T23:46:21.336 INFO:teuthology.orchestra.run.smithi057.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-06-02T23:46:21.337 INFO:teuthology.orchestra.run.smithi057.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-06-02T23:46:21.339 INFO:teuthology.orchestra.run.smithi057.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-06-02T23:46:21.341 INFO:teuthology.orchestra.run.smithi057.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-06-02T23:46:21.342 INFO:teuthology.orchestra.run.smithi057.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-06-02T23:46:21.398 INFO:teuthology.orchestra.run.smithi107.stdout:(18/159): librgw2-19.0.0-2946.g3d89accf.el9.x86 8.5 MB/s | 5.3 MB 00:00 2024-06-02T23:46:21.409 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-06-02T23:46:21.429 INFO:teuthology.orchestra.run.smithi057.stdout:======================================================================================= 2024-06-02T23:46:21.429 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2024-06-02T23:46:21.429 INFO:teuthology.orchestra.run.smithi057.stdout:======================================================================================= 2024-06-02T23:46:21.429 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-06-02T23:46:21.429 INFO:teuthology.orchestra.run.smithi057.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-02T23:46:21.430 INFO:teuthology.orchestra.run.smithi057.stdout: ceph x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 6.6 k 2024-06-02T23:46:21.430 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.4 M 2024-06-02T23:46:21.430 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 890 k 2024-06-02T23:46:21.430 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 145 k 2024-06-02T23:46:21.430 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 1.5 M 2024-06-02T23:46:21.430 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 142 k 2024-06-02T23:46:21.430 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 3.5 M 2024-06-02T23:46:21.430 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 7.4 M 2024-06-02T23:46:21.430 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-rook noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 49 k 2024-06-02T23:46:21.430 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-radosgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 10 M 2024-06-02T23:46:21.431 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-test x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 48 M 2024-06-02T23:46:21.431 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-volume noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 264 k 2024-06-02T23:46:21.431 INFO:teuthology.orchestra.run.smithi057.stdout: cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 763 k 2024-06-02T23:46:21.431 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 221 k 2024-06-02T23:46:21.431 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-shell x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 27 k 2024-06-02T23:46:21.431 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-top noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 18 k 2024-06-02T23:46:21.431 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-02T23:46:21.431 INFO:teuthology.orchestra.run.smithi057.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-02T23:46:21.431 INFO:teuthology.orchestra.run.smithi057.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-02T23:46:21.431 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 32 k 2024-06-02T23:46:21.431 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 747 k 2024-06-02T23:46:21.431 INFO:teuthology.orchestra.run.smithi057.stdout: librados-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 127 k 2024-06-02T23:46:21.431 INFO:teuthology.orchestra.run.smithi057.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-02T23:46:21.431 INFO:teuthology.orchestra.run.smithi057.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-02T23:46:21.432 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-06-02T23:46:21.432 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-06-02T23:46:21.432 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-06-02T23:46:21.432 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-06-02T23:46:21.432 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cephfs x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 162 k 2024-06-02T23:46:21.432 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 321 k 2024-06-02T23:46:21.432 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 300 k 2024-06-02T23:46:21.432 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 99 k 2024-06-02T23:46:21.432 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 85 k 2024-06-02T23:46:21.432 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-02T23:46:21.432 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-nbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 171 k 2024-06-02T23:46:21.432 INFO:teuthology.orchestra.run.smithi057.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-06-02T23:46:21.432 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrading: 2024-06-02T23:46:21.432 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-06-02T23:46:21.433 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-06-02T23:46:21.433 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-06-02T23:46:21.433 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-06-02T23:46:21.433 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-02T23:46:21.433 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-02T23:46:21.433 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-02T23:46:21.433 INFO:teuthology.orchestra.run.smithi057.stdout: librados2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.4 M 2024-06-02T23:46:21.433 INFO:teuthology.orchestra.run.smithi057.stdout: librbd1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-02T23:46:21.433 INFO:teuthology.orchestra.run.smithi057.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-06-02T23:46:21.433 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-06-02T23:46:21.433 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-06-02T23:46:21.433 INFO:teuthology.orchestra.run.smithi057.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-02T23:46:21.434 INFO:teuthology.orchestra.run.smithi057.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-02T23:46:21.434 INFO:teuthology.orchestra.run.smithi057.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-02T23:46:21.434 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 21 M 2024-06-02T23:46:21.434 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 32 k 2024-06-02T23:46:21.434 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mds x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 2.4 M 2024-06-02T23:46:21.434 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 249 k 2024-06-02T23:46:21.435 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 4.7 M 2024-06-02T23:46:21.435 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-osd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 17 M 2024-06-02T23:46:21.435 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 16 k 2024-06-02T23:46:21.435 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-selinux x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 25 k 2024-06-02T23:46:21.435 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-02T23:46:21.435 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-02T23:46:21.435 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-02T23:46:21.436 INFO:teuthology.orchestra.run.smithi057.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-02T23:46:21.436 INFO:teuthology.orchestra.run.smithi057.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-02T23:46:21.436 INFO:teuthology.orchestra.run.smithi057.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-02T23:46:21.436 INFO:teuthology.orchestra.run.smithi057.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-02T23:46:21.436 INFO:teuthology.orchestra.run.smithi057.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-02T23:46:21.436 INFO:teuthology.orchestra.run.smithi057.stdout: libcephsqlite x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 163 k 2024-06-02T23:46:21.436 INFO:teuthology.orchestra.run.smithi057.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-02T23:46:21.436 INFO:teuthology.orchestra.run.smithi057.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-02T23:46:21.436 INFO:teuthology.orchestra.run.smithi057.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-02T23:46:21.436 INFO:teuthology.orchestra.run.smithi057.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-02T23:46:21.437 INFO:teuthology.orchestra.run.smithi057.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-02T23:46:21.437 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 501 k 2024-06-02T23:46:21.437 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-02T23:46:21.437 INFO:teuthology.orchestra.run.smithi057.stdout: librgw2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.3 M 2024-06-02T23:46:21.437 INFO:teuthology.orchestra.run.smithi057.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-02T23:46:21.437 INFO:teuthology.orchestra.run.smithi057.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-02T23:46:21.437 INFO:teuthology.orchestra.run.smithi057.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-02T23:46:21.437 INFO:teuthology.orchestra.run.smithi057.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-02T23:46:21.437 INFO:teuthology.orchestra.run.smithi057.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-02T23:46:21.437 INFO:teuthology.orchestra.run.smithi057.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-02T23:46:21.437 INFO:teuthology.orchestra.run.smithi057.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-02T23:46:21.438 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-02T23:46:21.438 INFO:teuthology.orchestra.run.smithi057.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-02T23:46:21.438 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-06-02T23:46:21.438 INFO:teuthology.orchestra.run.smithi057.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-02T23:46:21.438 INFO:teuthology.orchestra.run.smithi057.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-02T23:46:21.438 INFO:teuthology.orchestra.run.smithi057.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-02T23:46:21.438 INFO:teuthology.orchestra.run.smithi057.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-06-02T23:46:21.438 INFO:teuthology.orchestra.run.smithi057.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-02T23:46:21.438 INFO:teuthology.orchestra.run.smithi057.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-02T23:46:21.438 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-02T23:46:21.438 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 45 k 2024-06-02T23:46:21.438 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 135 k 2024-06-02T23:46:21.439 INFO:teuthology.orchestra.run.smithi057.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-02T23:46:21.439 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-02T23:46:21.439 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-02T23:46:21.439 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-02T23:46:21.439 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-06-02T23:46:21.439 INFO:teuthology.orchestra.run.smithi057.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-06-02T23:46:21.439 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-02T23:46:21.439 INFO:teuthology.orchestra.run.smithi057.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-02T23:46:21.439 INFO:teuthology.orchestra.run.smithi057.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-06-02T23:46:21.439 INFO:teuthology.orchestra.run.smithi057.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-02T23:46:21.439 INFO:teuthology.orchestra.run.smithi057.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-02T23:46:21.439 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-02T23:46:21.439 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-02T23:46:21.439 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-02T23:46:21.440 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-02T23:46:21.440 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-02T23:46:21.440 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-02T23:46:21.440 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-02T23:46:21.440 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-02T23:46:21.440 INFO:teuthology.orchestra.run.smithi057.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-02T23:46:21.440 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-02T23:46:21.440 INFO:teuthology.orchestra.run.smithi057.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-02T23:46:21.440 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-02T23:46:21.440 INFO:teuthology.orchestra.run.smithi057.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-02T23:46:21.440 INFO:teuthology.orchestra.run.smithi057.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-02T23:46:21.440 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-02T23:46:21.440 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-02T23:46:21.440 INFO:teuthology.orchestra.run.smithi057.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-02T23:46:21.441 INFO:teuthology.orchestra.run.smithi057.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-02T23:46:21.441 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-02T23:46:21.441 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-02T23:46:21.441 INFO:teuthology.orchestra.run.smithi057.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-02T23:46:21.441 INFO:teuthology.orchestra.run.smithi057.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-02T23:46:21.441 INFO:teuthology.orchestra.run.smithi057.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-02T23:46:21.441 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-02T23:46:21.441 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-02T23:46:21.441 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-02T23:46:21.441 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-02T23:46:21.441 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-06-02T23:46:21.441 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-02T23:46:21.442 INFO:teuthology.orchestra.run.smithi057.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-02T23:46:21.442 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-02T23:46:21.442 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-02T23:46:21.442 INFO:teuthology.orchestra.run.smithi057.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-02T23:46:21.442 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-02T23:46:21.442 INFO:teuthology.orchestra.run.smithi057.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-02T23:46:21.442 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-02T23:46:21.442 INFO:teuthology.orchestra.run.smithi057.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-02T23:46:21.442 INFO:teuthology.orchestra.run.smithi057.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-02T23:46:21.442 INFO:teuthology.orchestra.run.smithi057.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-02T23:46:21.442 INFO:teuthology.orchestra.run.smithi057.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-06-02T23:46:21.443 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-02T23:46:21.443 INFO:teuthology.orchestra.run.smithi057.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-02T23:46:21.443 INFO:teuthology.orchestra.run.smithi057.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-02T23:46:21.443 INFO:teuthology.orchestra.run.smithi057.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-02T23:46:21.443 INFO:teuthology.orchestra.run.smithi057.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-02T23:46:21.443 INFO:teuthology.orchestra.run.smithi057.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-02T23:46:21.443 INFO:teuthology.orchestra.run.smithi057.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-02T23:46:21.443 INFO:teuthology.orchestra.run.smithi057.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-06-02T23:46:21.443 INFO:teuthology.orchestra.run.smithi057.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-02T23:46:21.443 INFO:teuthology.orchestra.run.smithi057.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-06-02T23:46:21.443 INFO:teuthology.orchestra.run.smithi057.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-02T23:46:21.443 INFO:teuthology.orchestra.run.smithi057.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-02T23:46:21.443 INFO:teuthology.orchestra.run.smithi057.stdout:Installing weak dependencies: 2024-06-02T23:46:21.443 INFO:teuthology.orchestra.run.smithi057.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-02T23:46:21.444 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-06-02T23:46:21.444 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-06-02T23:46:21.444 INFO:teuthology.orchestra.run.smithi057.stdout:======================================================================================= 2024-06-02T23:46:21.444 INFO:teuthology.orchestra.run.smithi057.stdout:Install 148 Packages 2024-06-02T23:46:21.444 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrade 11 Packages 2024-06-02T23:46:21.444 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-06-02T23:46:21.444 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 225 M 2024-06-02T23:46:21.445 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-06-02T23:46:21.490 INFO:teuthology.orchestra.run.smithi107.stdout:(19/159): python3-ceph-argparse-19.0.0-2946.g3d 493 kB/s | 45 kB 00:00 2024-06-02T23:46:21.574 INFO:teuthology.orchestra.run.smithi107.stdout:(20/159): python3-ceph-common-19.0.0-2946.g3d89 1.6 MB/s | 135 kB 00:00 2024-06-02T23:46:21.657 INFO:teuthology.orchestra.run.smithi107.stdout:(21/159): python3-cephfs-19.0.0-2946.g3d89accf. 1.9 MB/s | 162 kB 00:00 2024-06-02T23:46:21.668 INFO:teuthology.orchestra.run.smithi049.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-02T23:46:21.669 INFO:teuthology.orchestra.run.smithi049.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-02T23:46:21.681 INFO:teuthology.orchestra.run.smithi049.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-06-02T23:46:21.682 INFO:teuthology.orchestra.run.smithi049.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-06-02T23:46:21.682 INFO:teuthology.orchestra.run.smithi049.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-06-02T23:46:21.683 INFO:teuthology.orchestra.run.smithi049.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-06-02T23:46:21.685 INFO:teuthology.orchestra.run.smithi049.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-06-02T23:46:21.688 INFO:teuthology.orchestra.run.smithi049.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-06-02T23:46:21.688 INFO:teuthology.orchestra.run.smithi049.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-06-02T23:46:21.741 INFO:teuthology.orchestra.run.smithi107.stdout:(22/159): python3-rados-19.0.0-2946.g3d89accf.e 3.8 MB/s | 321 kB 00:00 2024-06-02T23:46:21.757 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-06-02T23:46:21.774 INFO:teuthology.orchestra.run.smithi049.stdout:======================================================================================= 2024-06-02T23:46:21.774 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2024-06-02T23:46:21.775 INFO:teuthology.orchestra.run.smithi049.stdout:======================================================================================= 2024-06-02T23:46:21.775 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-06-02T23:46:21.775 INFO:teuthology.orchestra.run.smithi049.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-02T23:46:21.775 INFO:teuthology.orchestra.run.smithi049.stdout: ceph x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 6.6 k 2024-06-02T23:46:21.775 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-base x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.4 M 2024-06-02T23:46:21.776 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 890 k 2024-06-02T23:46:21.776 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 145 k 2024-06-02T23:46:21.776 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 1.5 M 2024-06-02T23:46:21.776 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 142 k 2024-06-02T23:46:21.776 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 3.5 M 2024-06-02T23:46:21.776 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 7.4 M 2024-06-02T23:46:21.777 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-rook noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 49 k 2024-06-02T23:46:21.777 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-radosgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 10 M 2024-06-02T23:46:21.777 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-test x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 48 M 2024-06-02T23:46:21.777 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-volume noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 264 k 2024-06-02T23:46:21.777 INFO:teuthology.orchestra.run.smithi049.stdout: cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 763 k 2024-06-02T23:46:21.777 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 221 k 2024-06-02T23:46:21.778 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-shell x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 27 k 2024-06-02T23:46:21.778 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-top noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 18 k 2024-06-02T23:46:21.778 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-02T23:46:21.778 INFO:teuthology.orchestra.run.smithi049.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-02T23:46:21.779 INFO:teuthology.orchestra.run.smithi049.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-02T23:46:21.779 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 32 k 2024-06-02T23:46:21.779 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 747 k 2024-06-02T23:46:21.779 INFO:teuthology.orchestra.run.smithi049.stdout: librados-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 127 k 2024-06-02T23:46:21.780 INFO:teuthology.orchestra.run.smithi049.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-02T23:46:21.780 INFO:teuthology.orchestra.run.smithi049.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-02T23:46:21.780 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-06-02T23:46:21.780 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-06-02T23:46:21.780 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-06-02T23:46:21.780 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-06-02T23:46:21.780 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cephfs x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 162 k 2024-06-02T23:46:21.780 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rados x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 321 k 2024-06-02T23:46:21.780 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 300 k 2024-06-02T23:46:21.780 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 99 k 2024-06-02T23:46:21.781 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 85 k 2024-06-02T23:46:21.781 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-02T23:46:21.781 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-nbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 171 k 2024-06-02T23:46:21.781 INFO:teuthology.orchestra.run.smithi049.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-06-02T23:46:21.781 INFO:teuthology.orchestra.run.smithi049.stdout:Upgrading: 2024-06-02T23:46:21.781 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-06-02T23:46:21.781 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-06-02T23:46:21.781 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-06-02T23:46:21.781 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-06-02T23:46:21.781 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-02T23:46:21.781 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-02T23:46:21.781 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-02T23:46:21.781 INFO:teuthology.orchestra.run.smithi049.stdout: librados2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.4 M 2024-06-02T23:46:21.782 INFO:teuthology.orchestra.run.smithi049.stdout: librbd1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-02T23:46:21.782 INFO:teuthology.orchestra.run.smithi049.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-06-02T23:46:21.782 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-06-02T23:46:21.782 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2024-06-02T23:46:21.782 INFO:teuthology.orchestra.run.smithi049.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-02T23:46:21.782 INFO:teuthology.orchestra.run.smithi049.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-02T23:46:21.782 INFO:teuthology.orchestra.run.smithi049.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-02T23:46:21.782 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 21 M 2024-06-02T23:46:21.782 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 32 k 2024-06-02T23:46:21.783 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mds x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 2.4 M 2024-06-02T23:46:21.783 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 249 k 2024-06-02T23:46:21.783 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mon x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 4.7 M 2024-06-02T23:46:21.783 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-osd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 17 M 2024-06-02T23:46:21.783 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 16 k 2024-06-02T23:46:21.783 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-selinux x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 25 k 2024-06-02T23:46:21.783 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-02T23:46:21.783 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-02T23:46:21.783 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-02T23:46:21.784 INFO:teuthology.orchestra.run.smithi049.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-02T23:46:21.784 INFO:teuthology.orchestra.run.smithi049.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-02T23:46:21.784 INFO:teuthology.orchestra.run.smithi049.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-02T23:46:21.784 INFO:teuthology.orchestra.run.smithi049.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-02T23:46:21.784 INFO:teuthology.orchestra.run.smithi049.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-02T23:46:21.784 INFO:teuthology.orchestra.run.smithi049.stdout: libcephsqlite x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 163 k 2024-06-02T23:46:21.784 INFO:teuthology.orchestra.run.smithi049.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-02T23:46:21.784 INFO:teuthology.orchestra.run.smithi049.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-02T23:46:21.784 INFO:teuthology.orchestra.run.smithi049.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-02T23:46:21.785 INFO:teuthology.orchestra.run.smithi049.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-02T23:46:21.785 INFO:teuthology.orchestra.run.smithi049.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-02T23:46:21.785 INFO:teuthology.orchestra.run.smithi049.stdout: libradosstriper1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 501 k 2024-06-02T23:46:21.785 INFO:teuthology.orchestra.run.smithi049.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-02T23:46:21.785 INFO:teuthology.orchestra.run.smithi049.stdout: librgw2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.3 M 2024-06-02T23:46:21.785 INFO:teuthology.orchestra.run.smithi049.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-02T23:46:21.785 INFO:teuthology.orchestra.run.smithi049.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-02T23:46:21.785 INFO:teuthology.orchestra.run.smithi049.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-02T23:46:21.785 INFO:teuthology.orchestra.run.smithi049.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-02T23:46:21.785 INFO:teuthology.orchestra.run.smithi049.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-02T23:46:21.785 INFO:teuthology.orchestra.run.smithi049.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-02T23:46:21.785 INFO:teuthology.orchestra.run.smithi049.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-02T23:46:21.786 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-02T23:46:21.786 INFO:teuthology.orchestra.run.smithi049.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-02T23:46:21.786 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-06-02T23:46:21.786 INFO:teuthology.orchestra.run.smithi049.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-02T23:46:21.786 INFO:teuthology.orchestra.run.smithi049.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-02T23:46:21.786 INFO:teuthology.orchestra.run.smithi049.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-02T23:46:21.786 INFO:teuthology.orchestra.run.smithi049.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-06-02T23:46:21.786 INFO:teuthology.orchestra.run.smithi049.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-02T23:46:21.786 INFO:teuthology.orchestra.run.smithi049.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-02T23:46:21.786 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-02T23:46:21.786 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-argparse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 45 k 2024-06-02T23:46:21.786 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 135 k 2024-06-02T23:46:21.787 INFO:teuthology.orchestra.run.smithi049.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-02T23:46:21.787 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-02T23:46:21.787 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-02T23:46:21.787 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-02T23:46:21.787 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-06-02T23:46:21.787 INFO:teuthology.orchestra.run.smithi049.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-06-02T23:46:21.787 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-02T23:46:21.787 INFO:teuthology.orchestra.run.smithi049.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-02T23:46:21.787 INFO:teuthology.orchestra.run.smithi049.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-06-02T23:46:21.787 INFO:teuthology.orchestra.run.smithi049.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-02T23:46:21.787 INFO:teuthology.orchestra.run.smithi049.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-02T23:46:21.787 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-02T23:46:21.787 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-02T23:46:21.787 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-02T23:46:21.788 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-02T23:46:21.788 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-02T23:46:21.788 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-02T23:46:21.788 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-02T23:46:21.788 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-02T23:46:21.788 INFO:teuthology.orchestra.run.smithi049.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-02T23:46:21.788 INFO:teuthology.orchestra.run.smithi049.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-02T23:46:21.788 INFO:teuthology.orchestra.run.smithi049.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-02T23:46:21.788 INFO:teuthology.orchestra.run.smithi049.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-02T23:46:21.788 INFO:teuthology.orchestra.run.smithi049.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-02T23:46:21.789 INFO:teuthology.orchestra.run.smithi049.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-02T23:46:21.789 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-02T23:46:21.789 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-02T23:46:21.789 INFO:teuthology.orchestra.run.smithi049.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-02T23:46:21.789 INFO:teuthology.orchestra.run.smithi049.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-02T23:46:21.789 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-02T23:46:21.789 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-02T23:46:21.789 INFO:teuthology.orchestra.run.smithi049.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-02T23:46:21.789 INFO:teuthology.orchestra.run.smithi049.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-02T23:46:21.789 INFO:teuthology.orchestra.run.smithi049.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-02T23:46:21.789 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-02T23:46:21.789 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-02T23:46:21.789 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-02T23:46:21.790 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-02T23:46:21.790 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-06-02T23:46:21.790 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-02T23:46:21.790 INFO:teuthology.orchestra.run.smithi049.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-02T23:46:21.790 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-02T23:46:21.790 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-02T23:46:21.790 INFO:teuthology.orchestra.run.smithi049.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-02T23:46:21.790 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-02T23:46:21.790 INFO:teuthology.orchestra.run.smithi049.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-02T23:46:21.791 INFO:teuthology.orchestra.run.smithi049.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-02T23:46:21.791 INFO:teuthology.orchestra.run.smithi049.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-02T23:46:21.791 INFO:teuthology.orchestra.run.smithi049.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-02T23:46:21.791 INFO:teuthology.orchestra.run.smithi049.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-02T23:46:21.791 INFO:teuthology.orchestra.run.smithi049.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-06-02T23:46:21.791 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-02T23:46:21.791 INFO:teuthology.orchestra.run.smithi049.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-02T23:46:21.791 INFO:teuthology.orchestra.run.smithi049.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-02T23:46:21.791 INFO:teuthology.orchestra.run.smithi049.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-02T23:46:21.791 INFO:teuthology.orchestra.run.smithi049.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-02T23:46:21.791 INFO:teuthology.orchestra.run.smithi049.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-02T23:46:21.791 INFO:teuthology.orchestra.run.smithi049.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-02T23:46:21.792 INFO:teuthology.orchestra.run.smithi049.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-06-02T23:46:21.792 INFO:teuthology.orchestra.run.smithi049.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-02T23:46:21.792 INFO:teuthology.orchestra.run.smithi049.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-06-02T23:46:21.792 INFO:teuthology.orchestra.run.smithi049.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-02T23:46:21.792 INFO:teuthology.orchestra.run.smithi049.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-02T23:46:21.792 INFO:teuthology.orchestra.run.smithi049.stdout:Installing weak dependencies: 2024-06-02T23:46:21.792 INFO:teuthology.orchestra.run.smithi049.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-02T23:46:21.792 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:46:21.792 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-06-02T23:46:21.792 INFO:teuthology.orchestra.run.smithi049.stdout:======================================================================================= 2024-06-02T23:46:21.792 INFO:teuthology.orchestra.run.smithi049.stdout:Install 148 Packages 2024-06-02T23:46:21.792 INFO:teuthology.orchestra.run.smithi049.stdout:Upgrade 11 Packages 2024-06-02T23:46:21.793 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:46:21.793 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 225 M 2024-06-02T23:46:21.793 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-06-02T23:46:21.825 INFO:teuthology.orchestra.run.smithi107.stdout:(23/159): python3-rbd-19.0.0-2946.g3d89accf.el9 3.5 MB/s | 300 kB 00:00 2024-06-02T23:46:21.900 INFO:teuthology.orchestra.run.smithi107.stdout:(24/159): python3-rgw-19.0.0-2946.g3d89accf.el9 1.3 MB/s | 99 kB 00:00 2024-06-02T23:46:21.975 INFO:teuthology.orchestra.run.smithi107.stdout:(25/159): rbd-fuse-19.0.0-2946.g3d89accf.el9.x8 1.1 MB/s | 85 kB 00:00 2024-06-02T23:46:22.480 INFO:teuthology.orchestra.run.smithi057.stdout:(1/159): ceph-19.0.0-2946.g3d89accf.el9.x86_64. 27 kB/s | 6.6 kB 00:00 2024-06-02T23:46:22.591 INFO:teuthology.orchestra.run.smithi049.stdout:(1/159): ceph-19.0.0-2946.g3d89accf.el9.x86_64. 31 kB/s | 6.6 kB 00:00 2024-06-02T23:46:22.709 INFO:teuthology.orchestra.run.smithi107.stdout:(26/159): ceph-test-19.0.0-2946.g3d89accf.el9.x 19 MB/s | 48 MB 00:02 2024-06-02T23:46:22.759 INFO:teuthology.orchestra.run.smithi107.stdout:(27/159): rbd-mirror-19.0.0-2946.g3d89accf.el9. 3.9 MB/s | 3.1 MB 00:00 2024-06-02T23:46:22.809 INFO:teuthology.orchestra.run.smithi107.stdout:(28/159): rbd-nbd-19.0.0-2946.g3d89accf.el9.x86 1.7 MB/s | 171 kB 00:00 2024-06-02T23:46:22.909 INFO:teuthology.orchestra.run.smithi107.stdout:(29/159): ceph-mgr-cephadm-19.0.0-2946.g3d89acc 1.4 MB/s | 142 kB 00:00 2024-06-02T23:46:23.080 INFO:teuthology.orchestra.run.smithi057.stdout:(2/159): ceph-fuse-19.0.0-2946.g3d89accf.el9.x8 1.4 MB/s | 890 kB 00:00 2024-06-02T23:46:23.155 INFO:teuthology.orchestra.run.smithi057.stdout:(3/159): ceph-base-19.0.0-2946.g3d89accf.el9.x8 5.8 MB/s | 5.4 MB 00:00 2024-06-02T23:46:23.180 INFO:teuthology.orchestra.run.smithi057.stdout:(4/159): ceph-immutable-object-cache-19.0.0-294 1.4 MB/s | 145 kB 00:00 2024-06-02T23:46:23.327 INFO:teuthology.orchestra.run.smithi107.stdout:(30/159): ceph-grafana-dashboards-19.0.0-2946.g 56 kB/s | 32 kB 00:00 2024-06-02T23:46:23.497 INFO:teuthology.orchestra.run.smithi057.stdout:(5/159): ceph-mds-19.0.0-2946.g3d89accf.el9.x86 6.9 MB/s | 2.4 MB 00:00 2024-06-02T23:46:23.560 INFO:teuthology.orchestra.run.smithi107.stdout:(31/159): ceph-mgr-dashboard-19.0.0-2946.g3d89a 5.4 MB/s | 3.5 MB 00:00 2024-06-02T23:46:23.652 INFO:teuthology.orchestra.run.smithi107.stdout:(32/159): ceph-mgr-modules-core-19.0.0-2946.g3d 2.7 MB/s | 249 kB 00:00 2024-06-02T23:46:23.744 INFO:teuthology.orchestra.run.smithi107.stdout:(33/159): ceph-mgr-rook-19.0.0-2946.g3d89accf.e 537 kB/s | 49 kB 00:00 2024-06-02T23:46:23.836 INFO:teuthology.orchestra.run.smithi107.stdout:(34/159): ceph-prometheus-alerts-19.0.0-2946.g3 180 kB/s | 16 kB 00:00 2024-06-02T23:46:23.875 INFO:teuthology.orchestra.run.smithi049.stdout:(2/159): ceph-fuse-19.0.0-2946.g3d89accf.el9.x8 693 kB/s | 890 kB 00:01 2024-06-02T23:46:23.936 INFO:teuthology.orchestra.run.smithi107.stdout:(35/159): ceph-volume-19.0.0-2946.g3d89accf.el9 2.6 MB/s | 264 kB 00:00 2024-06-02T23:46:23.956 INFO:teuthology.orchestra.run.smithi057.stdout:(6/159): ceph-mgr-19.0.0-2946.g3d89accf.el9.x86 1.9 MB/s | 1.5 MB 00:00 2024-06-02T23:46:24.159 INFO:teuthology.orchestra.run.smithi049.stdout:(3/159): ceph-immutable-object-cache-19.0.0-294 510 kB/s | 145 kB 00:00 2024-06-02T23:46:24.178 INFO:teuthology.orchestra.run.smithi107.stdout:(36/159): cephadm-19.0.0-2946.g3d89accf.el9.noa 3.1 MB/s | 763 kB 00:00 2024-06-02T23:46:24.245 INFO:teuthology.orchestra.run.smithi107.stdout:(37/159): cephfs-top-19.0.0-2946.g3d89accf.el9. 273 kB/s | 18 kB 00:00 2024-06-02T23:46:24.281 INFO:teuthology.orchestra.run.smithi057.stdout:(7/159): ceph-mon-19.0.0-2946.g3d89accf.el9.x86 6.0 MB/s | 4.7 MB 00:00 2024-06-02T23:46:24.387 INFO:teuthology.orchestra.run.smithi107.stdout:(38/159): fuse-2.9.9-15.el9.x86_64.rpm 568 kB/s | 80 kB 00:00 2024-06-02T23:46:24.562 INFO:teuthology.orchestra.run.smithi107.stdout:(39/159): libgfortran-11.4.1-3.el9.x86_64.rpm 4.5 MB/s | 803 kB 00:00 2024-06-02T23:46:24.621 INFO:teuthology.orchestra.run.smithi107.stdout:(40/159): libquadmath-11.4.1-3.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2024-06-02T23:46:24.680 INFO:teuthology.orchestra.run.smithi107.stdout:(41/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-06-02T23:46:24.872 INFO:teuthology.orchestra.run.smithi107.stdout:(42/159): python3-cryptography-36.0.1-4.el9.x86 6.4 MB/s | 1.2 MB 00:00 2024-06-02T23:46:24.930 INFO:teuthology.orchestra.run.smithi107.stdout:(43/159): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-06-02T23:46:24.989 INFO:teuthology.orchestra.run.smithi107.stdout:(44/159): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-06-02T23:46:25.047 INFO:teuthology.orchestra.run.smithi107.stdout:(45/159): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-06-02T23:46:25.106 INFO:teuthology.orchestra.run.smithi107.stdout:(46/159): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-06-02T23:46:25.249 INFO:teuthology.orchestra.run.smithi107.stdout:(47/159): ceph-mgr-diskprediction-local-19.0.0- 3.8 MB/s | 7.4 MB 00:01 2024-06-02T23:46:25.307 INFO:teuthology.orchestra.run.smithi107.stdout:(48/159): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2024-06-02T23:46:25.349 INFO:teuthology.orchestra.run.smithi107.stdout:(49/159): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-06-02T23:46:25.383 INFO:teuthology.orchestra.run.smithi107.stdout:(50/159): elfutils-libelf-devel-0.191-4.el9.x86 649 kB/s | 22 kB 00:00 2024-06-02T23:46:25.418 INFO:teuthology.orchestra.run.smithi107.stdout:(51/159): bison-3.7.4-5.el9.x86_64.rpm 5.5 MB/s | 943 kB 00:00 2024-06-02T23:46:25.467 INFO:teuthology.orchestra.run.smithi107.stdout:(52/159): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-06-02T23:46:25.483 INFO:teuthology.orchestra.run.smithi107.stdout:(53/159): flexiblas-3.0.4-8.el9.x86_64.rpm 487 kB/s | 33 kB 00:00 2024-06-02T23:46:25.517 INFO:teuthology.orchestra.run.smithi107.stdout:(54/159): flexiblas-openblas-openmp-3.0.4-8.el9 551 kB/s | 18 kB 00:00 2024-06-02T23:46:25.567 INFO:teuthology.orchestra.run.smithi107.stdout:(55/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 30 MB/s | 3.0 MB 00:00 2024-06-02T23:46:25.584 INFO:teuthology.orchestra.run.smithi107.stdout:(56/159): libaio-devel-0.3.111-13.el9.x86_64.rp 166 kB/s | 11 kB 00:00 2024-06-02T23:46:25.609 INFO:teuthology.orchestra.run.smithi107.stdout:(57/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 160 kB 00:00 2024-06-02T23:46:25.635 INFO:teuthology.orchestra.run.smithi107.stdout:(58/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 901 kB/s | 45 kB 00:00 2024-06-02T23:46:25.669 INFO:teuthology.orchestra.run.smithi107.stdout:(59/159): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-06-02T23:46:25.694 INFO:teuthology.orchestra.run.smithi107.stdout:(60/159): libtool-2.4.6-45.el9.x86_64.rpm 9.7 MB/s | 582 kB 00:00 2024-06-02T23:46:25.719 INFO:teuthology.orchestra.run.smithi107.stdout:(61/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 507 kB/s | 25 kB 00:00 2024-06-02T23:46:25.744 INFO:teuthology.orchestra.run.smithi107.stdout:(62/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-06-02T23:46:25.764 INFO:teuthology.orchestra.run.smithi057.stdout:(8/159): ceph-common-19.0.0-2946.g3d89accf.el9. 5.9 MB/s | 21 MB 00:03 2024-06-02T23:46:25.769 INFO:teuthology.orchestra.run.smithi107.stdout:(63/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-06-02T23:46:25.795 INFO:teuthology.orchestra.run.smithi107.stdout:(64/159): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-06-02T23:46:25.800 INFO:teuthology.orchestra.run.smithi049.stdout:(4/159): ceph-base-19.0.0-2946.g3d89accf.el9.x8 1.6 MB/s | 5.4 MB 00:03 2024-06-02T23:46:25.820 INFO:teuthology.orchestra.run.smithi107.stdout:(65/159): openblas-0.3.21-2.el9.x86_64.rpm 701 kB/s | 35 kB 00:00 2024-06-02T23:46:25.823 INFO:teuthology.orchestra.run.smithi057.stdout:(9/159): ceph-selinux-19.0.0-2946.g3d89accf.el9 433 kB/s | 25 kB 00:00 2024-06-02T23:46:25.921 INFO:teuthology.orchestra.run.smithi107.stdout:(66/159): openblas-openmp-0.3.21-2.el9.x86_64.r 38 MB/s | 4.7 MB 00:00 2024-06-02T23:46:25.957 INFO:teuthology.orchestra.run.smithi057.stdout:(10/159): ceph-radosgw-19.0.0-2946.g3d89accf.el 6.1 MB/s | 10 MB 00:01 2024-06-02T23:46:25.988 INFO:teuthology.orchestra.run.smithi107.stdout:(67/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 27 MB/s | 4.4 MB 00:00 2024-06-02T23:46:26.038 INFO:teuthology.orchestra.run.smithi107.stdout:(68/159): postgresql-13.14-1.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-06-02T23:46:26.048 INFO:teuthology.orchestra.run.smithi057.stdout:(11/159): cephfs-mirror-19.0.0-2946.g3d89accf.e 2.4 MB/s | 221 kB 00:00 2024-06-02T23:46:26.051 INFO:teuthology.orchestra.run.smithi049.stdout:(5/159): ceph-mds-19.0.0-2946.g3d89accf.el9.x86 1.2 MB/s | 2.4 MB 00:01 2024-06-02T23:46:26.080 INFO:teuthology.orchestra.run.smithi107.stdout:(69/159): postgresql-contrib-13.14-1.el9.x86_64 9.7 MB/s | 911 kB 00:00 2024-06-02T23:46:26.105 INFO:teuthology.orchestra.run.smithi107.stdout:(70/159): postgresql-private-libs-13.14-1.el9.x 1.9 MB/s | 133 kB 00:00 2024-06-02T23:46:26.107 INFO:teuthology.orchestra.run.smithi057.stdout:(12/159): cephfs-shell-19.0.0-2946.g3d89accf.el 465 kB/s | 27 kB 00:00 2024-06-02T23:46:26.155 INFO:teuthology.orchestra.run.smithi107.stdout:(71/159): protobuf-3.14.0-13.el9.x86_64.rpm 20 MB/s | 1.0 MB 00:00 2024-06-02T23:46:26.174 INFO:teuthology.orchestra.run.smithi057.stdout:(13/159): libcephfs-devel-19.0.0-2946.g3d89accf 477 kB/s | 32 kB 00:00 2024-06-02T23:46:26.231 INFO:teuthology.orchestra.run.smithi107.stdout:(72/159): postgresql-server-13.14-1.el9.x86_64. 38 MB/s | 5.8 MB 00:00 2024-06-02T23:46:26.256 INFO:teuthology.orchestra.run.smithi107.stdout:(73/159): python3-attrs-20.3.0-7.el9.noarch.rpm 875 kB/s | 87 kB 00:00 2024-06-02T23:46:26.298 INFO:teuthology.orchestra.run.smithi107.stdout:(74/159): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-06-02T23:46:26.308 INFO:teuthology.orchestra.run.smithi057.stdout:(14/159): libcephfs2-19.0.0-2946.g3d89accf.el9. 5.5 MB/s | 747 kB 00:00 2024-06-02T23:46:26.334 INFO:teuthology.orchestra.run.smithi049.stdout:(6/159): ceph-common-19.0.0-2946.g3d89accf.el9. 5.3 MB/s | 21 MB 00:03 2024-06-02T23:46:26.381 INFO:teuthology.orchestra.run.smithi107.stdout:(75/159): python3-babel-2.9.1-2.el9.noarch.rpm 40 MB/s | 6.0 MB 00:00 2024-06-02T23:46:26.399 INFO:teuthology.orchestra.run.smithi057.stdout:(15/159): libcephsqlite-19.0.0-2946.g3d89accf.e 1.7 MB/s | 163 kB 00:00 2024-06-02T23:46:26.406 INFO:teuthology.orchestra.run.smithi107.stdout:(76/159): python3-devel-3.9.18-3.el9.x86_64.rpm 2.2 MB/s | 244 kB 00:00 2024-06-02T23:46:26.432 INFO:teuthology.orchestra.run.smithi107.stdout:(77/159): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-06-02T23:46:26.458 INFO:teuthology.orchestra.run.smithi107.stdout:(78/159): python3-jsonpatch-1.21-16.el9.noarch. 506 kB/s | 26 kB 00:00 2024-06-02T23:46:26.483 INFO:teuthology.orchestra.run.smithi107.stdout:(79/159): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-06-02T23:46:26.483 INFO:teuthology.orchestra.run.smithi057.stdout:(16/159): librados-devel-19.0.0-2946.g3d89accf. 1.5 MB/s | 127 kB 00:00 2024-06-02T23:46:26.508 INFO:teuthology.orchestra.run.smithi107.stdout:(80/159): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-06-02T23:46:26.509 INFO:teuthology.orchestra.run.smithi049.stdout:(7/159): ceph-mgr-19.0.0-2946.g3d89accf.el9.x86 2.1 MB/s | 1.5 MB 00:00 2024-06-02T23:46:26.533 INFO:teuthology.orchestra.run.smithi107.stdout:(81/159): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-06-02T23:46:26.576 INFO:teuthology.orchestra.run.smithi107.stdout:(82/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.9 MB/s | 250 kB 00:00 2024-06-02T23:46:26.625 INFO:teuthology.orchestra.run.smithi057.stdout:(17/159): libradosstriper1-19.0.0-2946.g3d89acc 3.5 MB/s | 501 kB 00:00 2024-06-02T23:46:26.651 INFO:teuthology.orchestra.run.smithi107.stdout:(83/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 5.1 MB 00:00 2024-06-02T23:46:26.676 INFO:teuthology.orchestra.run.smithi107.stdout:(84/159): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-06-02T23:46:26.701 INFO:teuthology.orchestra.run.smithi107.stdout:(85/159): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-06-02T23:46:26.718 INFO:teuthology.orchestra.run.smithi107.stdout:(86/159): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-06-02T23:46:26.743 INFO:teuthology.orchestra.run.smithi107.stdout:(87/159): python3-protobuf-3.14.0-13.el9.noarch 6.3 MB/s | 269 kB 00:00 2024-06-02T23:46:26.769 INFO:teuthology.orchestra.run.smithi107.stdout:(88/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-06-02T23:46:26.802 INFO:teuthology.orchestra.run.smithi107.stdout:(89/159): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-06-02T23:46:26.819 INFO:teuthology.orchestra.run.smithi107.stdout:(90/159): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-06-02T23:46:26.836 INFO:teuthology.orchestra.run.smithi107.stdout:(91/159): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-06-02T23:46:26.878 INFO:teuthology.orchestra.run.smithi107.stdout:(92/159): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-06-02T23:46:26.920 INFO:teuthology.orchestra.run.smithi107.stdout:(93/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-06-02T23:46:26.962 INFO:teuthology.orchestra.run.smithi107.stdout:(94/159): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 221 kB 00:00 2024-06-02T23:46:27.004 INFO:teuthology.orchestra.run.smithi107.stdout:(95/159): qatlib-service-24.02.0-1.el9.x86_64.r 865 kB/s | 36 kB 00:00 2024-06-02T23:46:27.171 INFO:teuthology.orchestra.run.smithi107.stdout:(96/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 46 MB/s | 16 MB 00:00 2024-06-02T23:46:27.196 INFO:teuthology.orchestra.run.smithi107.stdout:(97/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 247 kB/s | 47 kB 00:00 2024-06-02T23:46:27.222 INFO:teuthology.orchestra.run.smithi107.stdout:(98/159): socat-1.7.4.1-5.el9.x86_64.rpm 6.0 MB/s | 305 kB 00:00 2024-06-02T23:46:27.247 INFO:teuthology.orchestra.run.smithi107.stdout:(99/159): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-06-02T23:46:27.273 INFO:teuthology.orchestra.run.smithi107.stdout:(100/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.8 MB/s | 94 kB 00:00 2024-06-02T23:46:27.298 INFO:teuthology.orchestra.run.smithi107.stdout:(101/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-06-02T23:46:27.323 INFO:teuthology.orchestra.run.smithi107.stdout:(102/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-06-02T23:46:27.406 INFO:teuthology.orchestra.run.smithi107.stdout:(103/159): lua-devel-5.4.4-4.el9.x86_64.rpm 206 kB/s | 22 kB 00:00 2024-06-02T23:46:27.508 INFO:teuthology.orchestra.run.smithi057.stdout:(18/159): librgw2-19.0.0-2946.g3d89accf.el9.x86 6.0 MB/s | 5.3 MB 00:00 2024-06-02T23:46:27.540 INFO:teuthology.orchestra.run.smithi107.stdout:(104/159): protobuf-compiler-3.14.0-13.el9.x86_ 3.9 MB/s | 863 kB 00:00 2024-06-02T23:46:27.584 INFO:teuthology.orchestra.run.smithi057.stdout:(19/159): python3-ceph-argparse-19.0.0-2946.g3d 603 kB/s | 45 kB 00:00 2024-06-02T23:46:27.667 INFO:teuthology.orchestra.run.smithi057.stdout:(20/159): python3-ceph-common-19.0.0-2946.g3d89 1.6 MB/s | 135 kB 00:00 2024-06-02T23:46:27.751 INFO:teuthology.orchestra.run.smithi057.stdout:(21/159): python3-cephfs-19.0.0-2946.g3d89accf. 1.9 MB/s | 162 kB 00:00 2024-06-02T23:46:27.843 INFO:teuthology.orchestra.run.smithi057.stdout:(22/159): python3-rados-19.0.0-2946.g3d89accf.e 3.4 MB/s | 321 kB 00:00 2024-06-02T23:46:27.935 INFO:teuthology.orchestra.run.smithi057.stdout:(23/159): python3-rbd-19.0.0-2946.g3d89accf.el9 3.2 MB/s | 300 kB 00:00 2024-06-02T23:46:27.990 INFO:teuthology.orchestra.run.smithi107.stdout:(105/159): abseil-cpp-20211102.0-3.el9.x86_64.r 939 kB/s | 548 kB 00:00 2024-06-02T23:46:28.018 INFO:teuthology.orchestra.run.smithi057.stdout:(24/159): python3-rgw-19.0.0-2946.g3d89accf.el9 1.2 MB/s | 99 kB 00:00 2024-06-02T23:46:28.057 INFO:teuthology.orchestra.run.smithi107.stdout:(106/159): gperftools-libs-2.9.1-2.el9.x86_64.r 597 kB/s | 309 kB 00:00 2024-06-02T23:46:28.083 INFO:teuthology.orchestra.run.smithi107.stdout:(107/159): grpc-data-1.46.7-10.el9.noarch.rpm 211 kB/s | 19 kB 00:00 2024-06-02T23:46:28.102 INFO:teuthology.orchestra.run.smithi057.stdout:(25/159): rbd-fuse-19.0.0-2946.g3d89accf.el9.x8 1.0 MB/s | 85 kB 00:00 2024-06-02T23:46:28.174 INFO:teuthology.orchestra.run.smithi107.stdout:(108/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 284 kB/s | 26 kB 00:00 2024-06-02T23:46:28.275 INFO:teuthology.orchestra.run.smithi107.stdout:(109/159): liboath-2.6.7-2.el9.x86_64.rpm 486 kB/s | 49 kB 00:00 2024-06-02T23:46:28.375 INFO:teuthology.orchestra.run.smithi107.stdout:(110/159): libunwind-1.6.2-1.el9.x86_64.rpm 674 kB/s | 67 kB 00:00 2024-06-02T23:46:28.484 INFO:teuthology.orchestra.run.smithi107.stdout:(111/159): libarrow-9.0.0-11.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-06-02T23:46:28.576 INFO:teuthology.orchestra.run.smithi107.stdout:(112/159): luarocks-3.9.2-5.el9.noarch.rpm 756 kB/s | 151 kB 00:00 2024-06-02T23:46:28.609 INFO:teuthology.orchestra.run.smithi107.stdout:(113/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-06-02T23:46:28.653 INFO:teuthology.orchestra.run.smithi057.stdout:(26/159): rbd-mirror-19.0.0-2946.g3d89accf.el9. 5.6 MB/s | 3.1 MB 00:00 2024-06-02T23:46:28.702 INFO:teuthology.orchestra.run.smithi107.stdout:(114/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 475 kB/s | 43 kB 00:00 2024-06-02T23:46:28.735 INFO:teuthology.orchestra.run.smithi107.stdout:(115/159): python3-asyncssh-2.13.2-5.el9.noarch 3.4 MB/s | 548 kB 00:00 2024-06-02T23:46:28.744 INFO:teuthology.orchestra.run.smithi057.stdout:(27/159): rbd-nbd-19.0.0-2946.g3d89accf.el9.x86 1.8 MB/s | 171 kB 00:00 2024-06-02T23:46:28.794 INFO:teuthology.orchestra.run.smithi107.stdout:(116/159): python3-cachetools-4.2.4-1.el9.noarc 350 kB/s | 32 kB 00:00 2024-06-02T23:46:28.943 INFO:teuthology.orchestra.run.smithi057.stdout:(28/159): ceph-grafana-dashboards-19.0.0-2946.g 380 kB/s | 32 kB 00:00 2024-06-02T23:46:28.943 INFO:teuthology.orchestra.run.smithi057.stdout:(29/159): ceph-mgr-cephadm-19.0.0-2946.g3d89acc 1.7 MB/s | 142 kB 00:00 2024-06-02T23:46:28.943 INFO:teuthology.orchestra.run.smithi107.stdout:(117/159): python3-certifi-2021.10.8-2.el9.noar 149 kB/s | 15 kB 00:00 2024-06-02T23:46:28.944 INFO:teuthology.orchestra.run.smithi107.stdout:(118/159): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2024-06-02T23:46:28.961 INFO:teuthology.orchestra.run.smithi107.stdout:(119/159): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2024-06-02T23:46:28.986 INFO:teuthology.orchestra.run.smithi107.stdout:(120/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.0 MB/s | 303 kB 00:00 2024-06-02T23:46:29.070 INFO:teuthology.orchestra.run.smithi107.stdout:(121/159): python3-google-auth-2.29.0-1.el9.noa 1.9 MB/s | 206 kB 00:00 2024-06-02T23:46:29.101 INFO:teuthology.orchestra.run.smithi049.stdout:(8/159): ceph-osd-19.0.0-2946.g3d89accf.el9.x86 6.1 MB/s | 17 MB 00:02 2024-06-02T23:46:29.121 INFO:teuthology.orchestra.run.smithi107.stdout:(122/159): python3-grpcio-1.46.7-10.el9.x86_64. 15 MB/s | 2.0 MB 00:00 2024-06-02T23:46:29.171 INFO:teuthology.orchestra.run.smithi107.stdout:(123/159): python3-grpcio-tools-1.46.7-10.el9.x 1.4 MB/s | 144 kB 00:00 2024-06-02T23:46:29.177 INFO:teuthology.orchestra.run.smithi049.stdout:(9/159): ceph-mon-19.0.0-2946.g3d89accf.el9.x86 1.5 MB/s | 4.7 MB 00:03 2024-06-02T23:46:29.202 INFO:teuthology.orchestra.run.smithi049.stdout:(10/159): ceph-selinux-19.0.0-2946.g3d89accf.el 252 kB/s | 25 kB 00:00 2024-06-02T23:46:29.212 INFO:teuthology.orchestra.run.smithi107.stdout:(124/159): python3-jaraco-8.2.1-3.el9.noarch.rp 116 kB/s | 11 kB 00:00 2024-06-02T23:46:29.280 INFO:teuthology.orchestra.run.smithi107.stdout:(125/159): python3-jaraco-classes-3.2.1-5.el9.n 163 kB/s | 18 kB 00:00 2024-06-02T23:46:29.286 INFO:teuthology.orchestra.run.smithi049.stdout:(11/159): cephfs-mirror-19.0.0-2946.g3d89accf.e 2.6 MB/s | 221 kB 00:00 2024-06-02T23:46:29.305 INFO:teuthology.orchestra.run.smithi107.stdout:(126/159): python3-jaraco-collections-3.0.0-8.e 252 kB/s | 23 kB 00:00 2024-06-02T23:46:29.353 INFO:teuthology.orchestra.run.smithi049.stdout:(12/159): cephfs-shell-19.0.0-2946.g3d89accf.el 406 kB/s | 27 kB 00:00 2024-06-02T23:46:29.380 INFO:teuthology.orchestra.run.smithi107.stdout:(127/159): python3-jaraco-functools-3.5.0-2.el9 194 kB/s | 19 kB 00:00 2024-06-02T23:46:29.406 INFO:teuthology.orchestra.run.smithi107.stdout:(128/159): python3-jaraco-text-3.2.0-6.el9.noar 196 kB/s | 20 kB 00:00 2024-06-02T23:46:29.428 INFO:teuthology.orchestra.run.smithi049.stdout:(13/159): libcephfs-devel-19.0.0-2946.g3d89accf 424 kB/s | 32 kB 00:00 2024-06-02T23:46:29.429 INFO:teuthology.orchestra.run.smithi057.stdout:(30/159): ceph-mgr-dashboard-19.0.0-2946.g3d89a 6.8 MB/s | 3.5 MB 00:00 2024-06-02T23:46:29.497 INFO:teuthology.orchestra.run.smithi107.stdout:(129/159): python3-logutils-0.3.5-21.el9.noarch 506 kB/s | 46 kB 00:00 2024-06-02T23:46:29.564 INFO:teuthology.orchestra.run.smithi107.stdout:(130/159): python3-kubernetes-26.1.0-2.el9.noar 5.6 MB/s | 1.0 MB 00:00 2024-06-02T23:46:29.590 INFO:teuthology.orchestra.run.smithi107.stdout:(131/159): python3-more-itertools-8.12.0-2.el9. 857 kB/s | 79 kB 00:00 2024-06-02T23:46:29.611 INFO:teuthology.orchestra.run.smithi049.stdout:(14/159): libcephfs2-19.0.0-2946.g3d89accf.el9. 4.0 MB/s | 747 kB 00:00 2024-06-02T23:46:29.657 INFO:teuthology.orchestra.run.smithi107.stdout:(132/159): python3-natsort-7.1.1-5.el9.noarch.r 628 kB/s | 58 kB 00:00 2024-06-02T23:46:29.687 INFO:teuthology.orchestra.run.smithi049.stdout:(15/159): libcephsqlite-19.0.0-2946.g3d89accf.e 2.1 MB/s | 163 kB 00:00 2024-06-02T23:46:29.690 INFO:teuthology.orchestra.run.smithi107.stdout:(133/159): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2024-06-02T23:46:29.757 INFO:teuthology.orchestra.run.smithi107.stdout:(134/159): python3-portend-3.1.0-2.el9.noarch.r 163 kB/s | 16 kB 00:00 2024-06-02T23:46:29.762 INFO:teuthology.orchestra.run.smithi049.stdout:(16/159): librados-devel-19.0.0-2946.g3d89accf. 1.7 MB/s | 127 kB 00:00 2024-06-02T23:46:29.783 INFO:teuthology.orchestra.run.smithi107.stdout:(135/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 976 kB/s | 90 kB 00:00 2024-06-02T23:46:29.858 INFO:teuthology.orchestra.run.smithi107.stdout:(136/159): python3-pyperclip-1.8.2-2.el9.noarch 281 kB/s | 28 kB 00:00 2024-06-02T23:46:29.875 INFO:teuthology.orchestra.run.smithi107.stdout:(137/159): python3-repoze-lru-0.7-16.el9.noarch 335 kB/s | 31 kB 00:00 2024-06-02T23:46:29.912 INFO:teuthology.orchestra.run.smithi049.stdout:(17/159): libradosstriper1-19.0.0-2946.g3d89acc 3.3 MB/s | 501 kB 00:00 2024-06-02T23:46:29.958 INFO:teuthology.orchestra.run.smithi107.stdout:(138/159): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-06-02T23:46:29.976 INFO:teuthology.orchestra.run.smithi107.stdout:(139/159): python3-rsa-4.9-2.el9.noarch.rpm 589 kB/s | 59 kB 00:00 2024-06-02T23:46:30.042 INFO:teuthology.orchestra.run.smithi107.stdout:(140/159): python3-tempora-5.0.0-2.el9.noarch.r 428 kB/s | 36 kB 00:00 2024-06-02T23:46:30.068 INFO:teuthology.orchestra.run.smithi107.stdout:(141/159): python3-typing-extensions-4.4.0-2.el 556 kB/s | 51 kB 00:00 2024-06-02T23:46:30.143 INFO:teuthology.orchestra.run.smithi107.stdout:(142/159): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-06-02T23:46:30.168 INFO:teuthology.orchestra.run.smithi107.stdout:(143/159): python3-websocket-client-1.2.3-2.el9 893 kB/s | 90 kB 00:00 2024-06-02T23:46:30.252 INFO:teuthology.orchestra.run.smithi107.stdout:(144/159): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-06-02T23:46:30.277 INFO:teuthology.orchestra.run.smithi107.stdout:(145/159): python3-zc-lockfile-2.0-10.el9.noarc 184 kB/s | 20 kB 00:00 2024-06-02T23:46:30.352 INFO:teuthology.orchestra.run.smithi107.stdout:(146/159): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-06-02T23:46:30.403 INFO:teuthology.orchestra.run.smithi107.stdout:(147/159): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-06-02T23:46:30.611 INFO:teuthology.orchestra.run.smithi107.stdout:(148/159): ceph-osd-19.0.0-2946.g3d89accf.el9.x 1.4 MB/s | 17 MB 00:11 2024-06-02T23:46:30.671 INFO:teuthology.orchestra.run.smithi049.stdout:(18/159): librgw2-19.0.0-2946.g3d89accf.el9.x86 7.0 MB/s | 5.3 MB 00:00 2024-06-02T23:46:30.729 INFO:teuthology.orchestra.run.smithi049.stdout:(19/159): python3-ceph-argparse-19.0.0-2946.g3d 776 kB/s | 45 kB 00:00 2024-06-02T23:46:30.771 INFO:teuthology.orchestra.run.smithi057.stdout:(31/159): ceph-test-19.0.0-2946.g3d89accf.el9.x 9.8 MB/s | 48 MB 00:04 2024-06-02T23:46:30.788 INFO:teuthology.orchestra.run.smithi049.stdout:(20/159): python3-ceph-common-19.0.0-2946.g3d89 2.3 MB/s | 135 kB 00:00 2024-06-02T23:46:30.855 INFO:teuthology.orchestra.run.smithi049.stdout:(21/159): python3-cephfs-19.0.0-2946.g3d89accf. 2.4 MB/s | 162 kB 00:00 2024-06-02T23:46:30.863 INFO:teuthology.orchestra.run.smithi057.stdout:(32/159): ceph-mgr-diskprediction-local-19.0.0- 5.2 MB/s | 7.4 MB 00:01 2024-06-02T23:46:30.888 INFO:teuthology.orchestra.run.smithi057.stdout:(33/159): ceph-mgr-modules-core-19.0.0-2946.g3d 2.1 MB/s | 249 kB 00:00 2024-06-02T23:46:30.903 INFO:teuthology.orchestra.run.smithi107.stdout:(149/159): librados2-19.0.0-2946.g3d89accf.el9. 6.2 MB/s | 3.4 MB 00:00 2024-06-02T23:46:30.930 INFO:teuthology.orchestra.run.smithi057.stdout:(34/159): ceph-mgr-rook-19.0.0-2946.g3d89accf.e 740 kB/s | 49 kB 00:00 2024-06-02T23:46:30.955 INFO:teuthology.orchestra.run.smithi057.stdout:(35/159): ceph-prometheus-alerts-19.0.0-2946.g3 245 kB/s | 16 kB 00:00 2024-06-02T23:46:30.964 INFO:teuthology.orchestra.run.smithi049.stdout:(22/159): ceph-radosgw-19.0.0-2946.g3d89accf.el 2.3 MB/s | 10 MB 00:04 2024-06-02T23:46:30.989 INFO:teuthology.orchestra.run.smithi049.stdout:(23/159): python3-rados-19.0.0-2946.g3d89accf.e 2.4 MB/s | 321 kB 00:00 2024-06-02T23:46:31.012 INFO:teuthology.orchestra.run.smithi107.stdout:(150/159): NetworkManager-1.47.91-1.el9.x86_64. 5.8 MB/s | 2.3 MB 00:00 2024-06-02T23:46:31.039 INFO:teuthology.orchestra.run.smithi049.stdout:(24/159): python3-rgw-19.0.0-2946.g3d89accf.el9 1.9 MB/s | 99 kB 00:00 2024-06-02T23:46:31.047 INFO:teuthology.orchestra.run.smithi057.stdout:(36/159): ceph-volume-19.0.0-2946.g3d89accf.el9 2.2 MB/s | 264 kB 00:00 2024-06-02T23:46:31.073 INFO:teuthology.orchestra.run.smithi049.stdout:(25/159): python3-rbd-19.0.0-2946.g3d89accf.el9 2.7 MB/s | 300 kB 00:00 2024-06-02T23:46:31.079 INFO:teuthology.orchestra.run.smithi107.stdout:(151/159): librbd1-19.0.0-2946.g3d89accf.el9.x8 4.6 MB/s | 3.1 MB 00:00 2024-06-02T23:46:31.080 INFO:teuthology.orchestra.run.smithi057.stdout:(37/159): cephadm-19.0.0-2946.g3d89accf.el9.noa 6.0 MB/s | 763 kB 00:00 2024-06-02T23:46:31.089 INFO:teuthology.orchestra.run.smithi049.stdout:(26/159): rbd-fuse-19.0.0-2946.g3d89accf.el9.x8 1.7 MB/s | 85 kB 00:00 2024-06-02T23:46:31.104 INFO:teuthology.orchestra.run.smithi107.stdout:(152/159): NetworkManager-team-1.47.91-1.el9.x8 451 kB/s | 41 kB 00:00 2024-06-02T23:46:31.106 INFO:teuthology.orchestra.run.smithi057.stdout:(38/159): cephfs-top-19.0.0-2946.g3d89accf.el9. 312 kB/s | 18 kB 00:00 2024-06-02T23:46:31.140 INFO:teuthology.orchestra.run.smithi049.stdout:(27/159): rbd-nbd-19.0.0-2946.g3d89accf.el9.x86 3.3 MB/s | 171 kB 00:00 2024-06-02T23:46:31.154 INFO:teuthology.orchestra.run.smithi107.stdout:(153/159): elfutils-debuginfod-client-0.191-4.e 736 kB/s | 37 kB 00:00 2024-06-02T23:46:31.190 INFO:teuthology.orchestra.run.smithi049.stdout:(28/159): ceph-grafana-dashboards-19.0.0-2946.g 634 kB/s | 32 kB 00:00 2024-06-02T23:46:31.213 INFO:teuthology.orchestra.run.smithi107.stdout:(154/159): elfutils-libelf-0.191-4.el9.x86_64.r 3.5 MB/s | 207 kB 00:00 2024-06-02T23:46:31.240 INFO:teuthology.orchestra.run.smithi049.stdout:(29/159): ceph-mgr-cephadm-19.0.0-2946.g3d89acc 2.8 MB/s | 142 kB 00:00 2024-06-02T23:46:31.272 INFO:teuthology.orchestra.run.smithi107.stdout:(155/159): elfutils-libs-0.191-4.el9.x86_64.rpm 4.3 MB/s | 260 kB 00:00 2024-06-02T23:46:31.273 INFO:teuthology.orchestra.run.smithi057.stdout:(39/159): ceph-osd-19.0.0-2946.g3d89accf.el9.x8 2.3 MB/s | 17 MB 00:07 2024-06-02T23:46:31.298 INFO:teuthology.orchestra.run.smithi057.stdout:(40/159): fuse-2.9.9-15.el9.x86_64.rpm 370 kB/s | 80 kB 00:00 2024-06-02T23:46:31.313 INFO:teuthology.orchestra.run.smithi107.stdout:(156/159): NetworkManager-libnm-1.47.91-1.el9.x 4.4 MB/s | 1.8 MB 00:00 2024-06-02T23:46:31.339 INFO:teuthology.orchestra.run.smithi107.stdout:(157/159): NetworkManager-tui-1.47.91-1.el9.x86 956 kB/s | 248 kB 00:00 2024-06-02T23:46:31.406 INFO:teuthology.orchestra.run.smithi057.stdout:(41/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-06-02T23:46:31.432 INFO:teuthology.orchestra.run.smithi057.stdout:(42/159): libquadmath-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 195 kB 00:00 2024-06-02T23:46:31.439 INFO:teuthology.orchestra.run.smithi107.stdout:(158/159): openssl-3.2.1-1.el9.x86_64.rpm 8.1 MB/s | 1.3 MB 00:00 2024-06-02T23:46:31.482 INFO:teuthology.orchestra.run.smithi057.stdout:(43/159): libgfortran-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 803 kB 00:00 2024-06-02T23:46:31.508 INFO:teuthology.orchestra.run.smithi057.stdout:(44/159): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-06-02T23:46:31.533 INFO:teuthology.orchestra.run.smithi049.stdout:(30/159): ceph-mgr-dashboard-19.0.0-2946.g3d89a 12 MB/s | 3.5 MB 00:00 2024-06-02T23:46:31.533 INFO:teuthology.orchestra.run.smithi057.stdout:(45/159): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-06-02T23:46:31.558 INFO:teuthology.orchestra.run.smithi057.stdout:(46/159): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-06-02T23:46:31.581 INFO:teuthology.orchestra.run.smithi107.stdout:(159/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 9.0 MB/s | 2.4 MB 00:00 2024-06-02T23:46:31.585 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:46:31.585 INFO:teuthology.orchestra.run.smithi107.stdout:Total 16 MB/s | 225 MB 00:14 2024-06-02T23:46:31.600 INFO:teuthology.orchestra.run.smithi057.stdout:(47/159): python3-cryptography-36.0.1-4.el9.x86 6.4 MB/s | 1.2 MB 00:00 2024-06-02T23:46:31.642 INFO:teuthology.orchestra.run.smithi057.stdout:(48/159): python3-urllib3-1.26.5-5.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-06-02T23:46:31.833 INFO:teuthology.orchestra.run.smithi049.stdout:(31/159): rbd-mirror-19.0.0-2946.g3d89accf.el9. 4.1 MB/s | 3.1 MB 00:00 2024-06-02T23:46:31.942 INFO:teuthology.orchestra.run.smithi049.stdout:(32/159): ceph-mgr-modules-core-19.0.0-2946.g3d 2.2 MB/s | 249 kB 00:00 2024-06-02T23:46:32.000 INFO:teuthology.orchestra.run.smithi049.stdout:(33/159): ceph-mgr-rook-19.0.0-2946.g3d89accf.e 844 kB/s | 49 kB 00:00 2024-06-02T23:46:32.051 INFO:teuthology.orchestra.run.smithi049.stdout:(34/159): ceph-prometheus-alerts-19.0.0-2946.g3 329 kB/s | 16 kB 00:00 2024-06-02T23:46:32.059 INFO:teuthology.orchestra.run.smithi057.stdout:(49/159): boost-program-options-1.75.0-8.el9.x8 256 kB/s | 107 kB 00:00 2024-06-02T23:46:32.134 INFO:teuthology.orchestra.run.smithi049.stdout:(35/159): ceph-mgr-diskprediction-local-19.0.0- 12 MB/s | 7.4 MB 00:00 2024-06-02T23:46:32.185 INFO:teuthology.orchestra.run.smithi049.stdout:(36/159): ceph-volume-19.0.0-2946.g3d89accf.el9 1.9 MB/s | 264 kB 00:00 2024-06-02T23:46:32.243 INFO:teuthology.orchestra.run.smithi049.stdout:(37/159): cephadm-19.0.0-2946.g3d89accf.el9.noa 6.9 MB/s | 763 kB 00:00 2024-06-02T23:46:32.268 INFO:teuthology.orchestra.run.smithi049.stdout:(38/159): cephfs-top-19.0.0-2946.g3d89accf.el9. 218 kB/s | 18 kB 00:00 2024-06-02T23:46:32.334 INFO:teuthology.orchestra.run.smithi057.stdout:(50/159): elfutils-libelf-devel-0.191-4.el9.x86 79 kB/s | 22 kB 00:00 2024-06-02T23:46:32.410 INFO:teuthology.orchestra.run.smithi049.stdout:(39/159): fuse-2.9.9-15.el9.x86_64.rpm 481 kB/s | 80 kB 00:00 2024-06-02T23:46:32.511 INFO:teuthology.orchestra.run.smithi049.stdout:(40/159): libquadmath-11.4.1-3.el9.x86_64.rpm 1.9 MB/s | 195 kB 00:00 2024-06-02T23:46:32.544 INFO:teuthology.orchestra.run.smithi049.stdout:(41/159): libgfortran-11.4.1-3.el9.x86_64.rpm 2.8 MB/s | 803 kB 00:00 2024-06-02T23:46:32.570 INFO:teuthology.orchestra.run.smithi049.stdout:(42/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-06-02T23:46:32.628 INFO:teuthology.orchestra.run.smithi049.stdout:(43/159): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-06-02T23:46:32.687 INFO:teuthology.orchestra.run.smithi049.stdout:(44/159): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-06-02T23:46:32.754 INFO:teuthology.orchestra.run.smithi049.stdout:(45/159): python3-cryptography-36.0.1-4.el9.x86 5.9 MB/s | 1.2 MB 00:00 2024-06-02T23:46:32.778 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-06-02T23:46:32.779 INFO:teuthology.orchestra.run.smithi049.stdout:(46/159): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-06-02T23:46:32.821 INFO:teuthology.orchestra.run.smithi049.stdout:(47/159): python3-urllib3-1.26.5-5.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-06-02T23:46:32.933 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-06-02T23:46:32.933 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-06-02T23:46:32.972 INFO:teuthology.orchestra.run.smithi049.stdout:(48/159): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 689 kB 00:00 2024-06-02T23:46:33.009 INFO:teuthology.orchestra.run.smithi057.stdout:(51/159): automake-1.16.2-8.el9.noarch.rpm 475 kB/s | 689 kB 00:01 2024-06-02T23:46:33.030 INFO:teuthology.orchestra.run.smithi049.stdout:(49/159): bison-3.7.4-5.el9.x86_64.rpm 4.4 MB/s | 943 kB 00:00 2024-06-02T23:46:33.056 INFO:teuthology.orchestra.run.smithi049.stdout:(50/159): boost-program-options-1.75.0-8.el9.x8 1.3 MB/s | 107 kB 00:00 2024-06-02T23:46:33.081 INFO:teuthology.orchestra.run.smithi049.stdout:(51/159): elfutils-libelf-devel-0.191-4.el9.x86 432 kB/s | 22 kB 00:00 2024-06-02T23:46:33.106 INFO:teuthology.orchestra.run.smithi049.stdout:(52/159): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-06-02T23:46:33.139 INFO:teuthology.orchestra.run.smithi049.stdout:(53/159): flexiblas-3.0.4-8.el9.x86_64.rpm 560 kB/s | 33 kB 00:00 2024-06-02T23:46:33.276 INFO:teuthology.orchestra.run.smithi057.stdout:(52/159): flexiblas-3.0.4-8.el9.x86_64.rpm 123 kB/s | 33 kB 00:00 2024-06-02T23:46:33.310 INFO:teuthology.orchestra.run.smithi057.stdout:(53/159): flex-2.6.4-9.el9.x86_64.rpm 321 kB/s | 313 kB 00:00 2024-06-02T23:46:33.419 INFO:teuthology.orchestra.run.smithi057.stdout:(54/159): bison-3.7.4-5.el9.x86_64.rpm 519 kB/s | 943 kB 00:01 2024-06-02T23:46:33.602 INFO:teuthology.orchestra.run.smithi057.stdout:(55/159): libaio-devel-0.3.111-13.el9.x86_64.rp 61 kB/s | 11 kB 00:00 2024-06-02T23:46:33.628 INFO:teuthology.orchestra.run.smithi057.stdout:(56/159): flexiblas-openblas-openmp-3.0.4-8.el9 57 kB/s | 18 kB 00:00 2024-06-02T23:46:33.831 INFO:teuthology.orchestra.run.smithi049.stdout:(54/159): flexiblas-openblas-openmp-3.0.4-8.el9 26 kB/s | 18 kB 00:00 2024-06-02T23:46:33.969 INFO:teuthology.orchestra.run.smithi057.stdout:(57/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 132 kB/s | 45 kB 00:00 2024-06-02T23:46:34.224 INFO:teuthology.orchestra.run.smithi049.stdout:(55/159): libaio-devel-0.3.111-13.el9.x86_64.rp 28 kB/s | 11 kB 00:00 2024-06-02T23:46:34.270 INFO:teuthology.orchestra.run.smithi057.stdout:(58/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 240 kB/s | 160 kB 00:00 2024-06-02T23:46:34.541 INFO:teuthology.orchestra.run.smithi049.stdout:(56/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.1 MB/s | 3.0 MB 00:01 2024-06-02T23:46:34.566 INFO:teuthology.orchestra.run.smithi049.stdout:(57/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 468 kB/s | 160 kB 00:00 2024-06-02T23:46:34.683 INFO:teuthology.orchestra.run.smithi049.stdout:(58/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 319 kB/s | 45 kB 00:00 2024-06-02T23:46:34.725 INFO:teuthology.orchestra.run.smithi049.stdout:(59/159): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-06-02T23:46:34.725 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-06-02T23:46:34.726 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-06-02T23:46:34.875 INFO:teuthology.orchestra.run.smithi049.stdout:(60/159): libtool-2.4.6-45.el9.x86_64.rpm 3.0 MB/s | 582 kB 00:00 2024-06-02T23:46:34.892 INFO:teuthology.orchestra.run.smithi049.stdout:(61/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 152 kB/s | 25 kB 00:00 2024-06-02T23:46:34.984 INFO:teuthology.orchestra.run.smithi049.stdout:(62/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 438 kB/s | 47 kB 00:00 2024-06-02T23:46:35.018 INFO:teuthology.orchestra.run.smithi049.stdout:(63/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-06-02T23:46:35.043 INFO:teuthology.orchestra.run.smithi049.stdout:(64/159): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-06-02T23:46:35.060 INFO:teuthology.orchestra.run.smithi049.stdout:(65/159): openblas-0.3.21-2.el9.x86_64.rpm 840 kB/s | 35 kB 00:00 2024-06-02T23:46:35.194 INFO:teuthology.orchestra.run.smithi049.stdout:(66/159): openblas-openmp-0.3.21-2.el9.x86_64.r 32 MB/s | 4.7 MB 00:00 2024-06-02T23:46:35.261 INFO:teuthology.orchestra.run.smithi049.stdout:(67/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2024-06-02T23:46:35.311 INFO:teuthology.orchestra.run.smithi049.stdout:(68/159): postgresql-13.14-1.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-06-02T23:46:35.345 INFO:teuthology.orchestra.run.smithi049.stdout:(69/159): postgresql-contrib-13.14-1.el9.x86_64 11 MB/s | 911 kB 00:00 2024-06-02T23:46:35.370 INFO:teuthology.orchestra.run.smithi049.stdout:(70/159): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-06-02T23:46:35.512 INFO:teuthology.orchestra.run.smithi057.stdout:(59/159): librdkafka-1.6.1-102.el9.x86_64.rpm 430 kB/s | 662 kB 00:01 2024-06-02T23:46:35.562 INFO:teuthology.orchestra.run.smithi049.stdout:(71/159): protobuf-3.14.0-13.el9.x86_64.rpm 5.3 MB/s | 1.0 MB 00:00 2024-06-02T23:46:35.612 INFO:teuthology.orchestra.run.smithi049.stdout:(72/159): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-06-02T23:46:35.687 INFO:teuthology.orchestra.run.smithi049.stdout:(73/159): postgresql-server-13.14-1.el9.x86_64. 17 MB/s | 5.8 MB 00:00 2024-06-02T23:46:35.729 INFO:teuthology.orchestra.run.smithi057.stdout:(60/159): libtool-2.4.6-45.el9.x86_64.rpm 399 kB/s | 582 kB 00:01 2024-06-02T23:46:35.771 INFO:teuthology.orchestra.run.smithi057.stdout:(61/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 98 kB/s | 25 kB 00:00 2024-06-02T23:46:35.829 INFO:teuthology.orchestra.run.smithi049.stdout:(74/159): python3-colorama-0.4.6-3.el9.noarch.r 432 kB/s | 61 kB 00:00 2024-06-02T23:46:35.938 INFO:teuthology.orchestra.run.smithi049.stdout:(75/159): python3-devel-3.9.18-3.el9.x86_64.rpm 2.2 MB/s | 244 kB 00:00 2024-06-02T23:46:36.022 INFO:teuthology.orchestra.run.smithi049.stdout:(76/159): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-06-02T23:46:36.047 INFO:teuthology.orchestra.run.smithi049.stdout:(77/159): python3-jinja2-2.11.3-6.el9.noarch.rp 2.2 MB/s | 248 kB 00:00 2024-06-02T23:46:36.071 INFO:teuthology.orchestra.run.smithi057.stdout:(62/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 139 kB/s | 47 kB 00:00 2024-06-02T23:46:36.072 INFO:teuthology.orchestra.run.smithi049.stdout:(78/159): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-06-02T23:46:36.098 INFO:teuthology.orchestra.run.smithi049.stdout:(79/159): python3-jsonpointer-2.0-4.el9.noarch. 380 kB/s | 19 kB 00:00 2024-06-02T23:46:36.123 INFO:teuthology.orchestra.run.smithi049.stdout:(80/159): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-06-02T23:46:36.148 INFO:teuthology.orchestra.run.smithi049.stdout:(81/159): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-06-02T23:46:36.215 INFO:teuthology.orchestra.run.smithi049.stdout:(82/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-06-02T23:46:36.316 INFO:teuthology.orchestra.run.smithi049.stdout:(83/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 26 MB/s | 5.1 MB 00:00 2024-06-02T23:46:36.341 INFO:teuthology.orchestra.run.smithi049.stdout:(84/159): python3-oauthlib-3.1.1-5.el9.noarch.r 1.7 MB/s | 222 kB 00:00 2024-06-02T23:46:36.366 INFO:teuthology.orchestra.run.smithi049.stdout:(85/159): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-06-02T23:46:36.391 INFO:teuthology.orchestra.run.smithi049.stdout:(86/159): python3-prettytable-0.7.2-27.el9.noar 843 kB/s | 42 kB 00:00 2024-06-02T23:46:36.417 INFO:teuthology.orchestra.run.smithi049.stdout:(87/159): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-06-02T23:46:36.442 INFO:teuthology.orchestra.run.smithi049.stdout:(88/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-06-02T23:46:36.467 INFO:teuthology.orchestra.run.smithi049.stdout:(89/159): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-06-02T23:46:36.494 INFO:teuthology.orchestra.run.smithi049.stdout:(90/159): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-06-02T23:46:36.518 INFO:teuthology.orchestra.run.smithi049.stdout:(91/159): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-06-02T23:46:36.529 INFO:teuthology.orchestra.run.smithi057.stdout:(63/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 941 kB/s | 3.0 MB 00:03 2024-06-02T23:46:36.602 INFO:teuthology.orchestra.run.smithi049.stdout:(92/159): python3-toml-0.10.2-6.el9.noarch.rpm 502 kB/s | 42 kB 00:00 2024-06-02T23:46:36.638 INFO:teuthology.orchestra.run.smithi057.stdout:(64/159): lua-5.4.4-4.el9.x86_64.rpm 332 kB/s | 188 kB 00:00 2024-06-02T23:46:36.652 INFO:teuthology.orchestra.run.smithi049.stdout:(93/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 883 kB/s | 44 kB 00:00 2024-06-02T23:46:36.663 INFO:teuthology.orchestra.run.smithi057.stdout:(65/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 328 kB/s | 292 kB 00:00 2024-06-02T23:46:36.702 INFO:teuthology.orchestra.run.smithi049.stdout:(94/159): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-06-02T23:46:36.753 INFO:teuthology.orchestra.run.smithi049.stdout:(95/159): qatlib-service-24.02.0-1.el9.x86_64.r 721 kB/s | 36 kB 00:00 2024-06-02T23:46:36.797 INFO:teuthology.orchestra.run.smithi057.stdout:(66/159): openblas-0.3.21-2.el9.x86_64.rpm 132 kB/s | 35 kB 00:00 2024-06-02T23:46:36.803 INFO:teuthology.orchestra.run.smithi049.stdout:(96/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 955 kB/s | 47 kB 00:00 2024-06-02T23:46:36.987 INFO:teuthology.orchestra.run.smithi049.stdout:(97/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-06-02T23:46:37.012 INFO:teuthology.orchestra.run.smithi049.stdout:(98/159): socat-1.7.4.1-5.el9.x86_64.rpm 1.4 MB/s | 305 kB 00:00 2024-06-02T23:46:37.029 INFO:teuthology.orchestra.run.smithi049.stdout:(99/159): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-06-02T23:46:37.071 INFO:teuthology.orchestra.run.smithi049.stdout:(100/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.6 MB/s | 94 kB 00:00 2024-06-02T23:46:37.088 INFO:teuthology.orchestra.run.smithi049.stdout:(101/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-06-02T23:46:37.113 INFO:teuthology.orchestra.run.smithi049.stdout:(102/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.0 MB/s | 45 kB 00:00 2024-06-02T23:46:37.172 INFO:teuthology.orchestra.run.smithi049.stdout:(103/159): lua-devel-5.4.4-4.el9.x86_64.rpm 266 kB/s | 22 kB 00:00 2024-06-02T23:46:37.389 INFO:teuthology.orchestra.run.smithi049.stdout:(104/159): protobuf-compiler-3.14.0-13.el9.x86_ 3.1 MB/s | 863 kB 00:00 2024-06-02T23:46:37.722 INFO:teuthology.orchestra.run.smithi049.stdout:(105/159): abseil-cpp-20211102.0-3.el9.x86_64.r 996 kB/s | 548 kB 00:00 2024-06-02T23:46:37.822 INFO:teuthology.orchestra.run.smithi049.stdout:(106/159): grpc-data-1.46.7-10.el9.noarch.rpm 195 kB/s | 19 kB 00:00 2024-06-02T23:46:37.923 INFO:teuthology.orchestra.run.smithi049.stdout:(107/159): gperftools-libs-2.9.1-2.el9.x86_64.r 579 kB/s | 309 kB 00:00 2024-06-02T23:46:38.348 INFO:teuthology.orchestra.run.smithi049.stdout:(108/159): ceph-test-19.0.0-2946.g3d89accf.el9. 5.3 MB/s | 48 MB 00:09 2024-06-02T23:46:38.373 INFO:teuthology.orchestra.run.smithi049.stdout:(109/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 58 kB/s | 26 kB 00:00 2024-06-02T23:46:38.482 INFO:teuthology.orchestra.run.smithi049.stdout:(110/159): libunwind-1.6.2-1.el9.x86_64.rpm 622 kB/s | 67 kB 00:00 2024-06-02T23:46:38.616 INFO:teuthology.orchestra.run.smithi049.stdout:(111/159): luarocks-3.9.2-5.el9.noarch.rpm 1.1 MB/s | 151 kB 00:00 2024-06-02T23:46:38.699 INFO:teuthology.orchestra.run.smithi049.stdout:(112/159): libarrow-9.0.0-11.el9.x86_64.rpm 5.0 MB/s | 4.4 MB 00:00 2024-06-02T23:46:38.725 INFO:teuthology.orchestra.run.smithi049.stdout:(113/159): liboath-2.6.7-2.el9.x86_64.rpm 129 kB/s | 49 kB 00:00 2024-06-02T23:46:38.833 INFO:teuthology.orchestra.run.smithi049.stdout:(114/159): python3-asyncssh-2.13.2-5.el9.noarch 4.0 MB/s | 548 kB 00:00 2024-06-02T23:46:38.875 INFO:teuthology.orchestra.run.smithi049.stdout:(115/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.2 MB/s | 839 kB 00:00 2024-06-02T23:46:38.926 INFO:teuthology.orchestra.run.smithi049.stdout:(116/159): python3-cachetools-4.2.4-1.el9.noarc 350 kB/s | 32 kB 00:00 2024-06-02T23:46:38.959 INFO:teuthology.orchestra.run.smithi049.stdout:(117/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 186 kB/s | 43 kB 00:00 2024-06-02T23:46:38.984 INFO:teuthology.orchestra.run.smithi049.stdout:(118/159): python3-certifi-2021.10.8-2.el9.noar 138 kB/s | 15 kB 00:00 2024-06-02T23:46:39.035 INFO:teuthology.orchestra.run.smithi049.stdout:(119/159): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2024-06-02T23:46:39.077 INFO:teuthology.orchestra.run.smithi049.stdout:(120/159): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-06-02T23:46:39.143 INFO:teuthology.orchestra.run.smithi049.stdout:(121/159): python3-google-auth-2.29.0-1.el9.noa 1.9 MB/s | 206 kB 00:00 2024-06-02T23:46:39.244 INFO:teuthology.orchestra.run.smithi049.stdout:(122/159): python3-grpcio-tools-1.46.7-10.el9.x 1.4 MB/s | 144 kB 00:00 2024-06-02T23:46:39.269 INFO:teuthology.orchestra.run.smithi049.stdout:(123/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.0 MB/s | 303 kB 00:00 2024-06-02T23:46:39.319 INFO:teuthology.orchestra.run.smithi049.stdout:(124/159): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-06-02T23:46:39.330 INFO:teuthology.orchestra.run.smithi057.stdout:(67/159): postgresql-13.14-1.el9.x86_64.rpm 642 kB/s | 1.6 MB 00:02 2024-06-02T23:46:39.345 INFO:teuthology.orchestra.run.smithi049.stdout:(125/159): python3-jaraco-8.2.1-3.el9.noarch.rp 106 kB/s | 11 kB 00:00 2024-06-02T23:46:39.370 INFO:teuthology.orchestra.run.smithi049.stdout:(126/159): python3-jaraco-classes-3.2.1-5.el9.n 176 kB/s | 18 kB 00:00 2024-06-02T23:46:39.412 INFO:teuthology.orchestra.run.smithi049.stdout:(127/159): python3-jaraco-collections-3.0.0-8.e 251 kB/s | 23 kB 00:00 2024-06-02T23:46:39.437 INFO:teuthology.orchestra.run.smithi049.stdout:(128/159): python3-jaraco-functools-3.5.0-2.el9 211 kB/s | 19 kB 00:00 2024-06-02T23:46:39.463 INFO:teuthology.orchestra.run.smithi049.stdout:(129/159): python3-jaraco-text-3.2.0-6.el9.noar 213 kB/s | 20 kB 00:00 2024-06-02T23:46:39.596 INFO:teuthology.orchestra.run.smithi049.stdout:(130/159): python3-logutils-0.3.5-21.el9.noarch 292 kB/s | 46 kB 00:00 2024-06-02T23:46:39.622 INFO:teuthology.orchestra.run.smithi049.stdout:(131/159): python3-more-itertools-8.12.0-2.el9. 497 kB/s | 79 kB 00:00 2024-06-02T23:46:39.655 INFO:teuthology.orchestra.run.smithi049.stdout:(132/159): python3-kubernetes-26.1.0-2.el9.noar 4.2 MB/s | 1.0 MB 00:00 2024-06-02T23:46:39.689 INFO:teuthology.orchestra.run.smithi049.stdout:(133/159): python3-natsort-7.1.1-5.el9.noarch.r 625 kB/s | 58 kB 00:00 2024-06-02T23:46:39.747 INFO:teuthology.orchestra.run.smithi049.stdout:(134/159): python3-portend-3.1.0-2.el9.noarch.r 179 kB/s | 16 kB 00:00 2024-06-02T23:46:39.755 INFO:teuthology.orchestra.run.smithi057.stdout:(68/159): openblas-openmp-0.3.21-2.el9.x86_64.r 1.5 MB/s | 4.7 MB 00:03 2024-06-02T23:46:39.773 INFO:teuthology.orchestra.run.smithi049.stdout:(135/159): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-06-02T23:46:39.798 INFO:teuthology.orchestra.run.smithi049.stdout:(136/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 826 kB/s | 90 kB 00:00 2024-06-02T23:46:39.840 INFO:teuthology.orchestra.run.smithi049.stdout:(137/159): python3-pyperclip-1.8.2-2.el9.noarch 306 kB/s | 28 kB 00:00 2024-06-02T23:46:39.874 INFO:teuthology.orchestra.run.smithi049.stdout:(138/159): python3-repoze-lru-0.7-16.el9.noarch 306 kB/s | 31 kB 00:00 2024-06-02T23:46:39.924 INFO:teuthology.orchestra.run.smithi049.stdout:(139/159): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-06-02T23:46:39.941 INFO:teuthology.orchestra.run.smithi049.stdout:(140/159): python3-rsa-4.9-2.el9.noarch.rpm 586 kB/s | 59 kB 00:00 2024-06-02T23:46:39.967 INFO:teuthology.orchestra.run.smithi049.stdout:(141/159): python3-tempora-5.0.0-2.el9.noarch.r 386 kB/s | 36 kB 00:00 2024-06-02T23:46:40.008 INFO:teuthology.orchestra.run.smithi049.stdout:(142/159): python3-typing-extensions-4.4.0-2.el 607 kB/s | 51 kB 00:00 2024-06-02T23:46:40.050 INFO:teuthology.orchestra.run.smithi049.stdout:(143/159): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-06-02T23:46:40.075 INFO:teuthology.orchestra.run.smithi049.stdout:(144/159): python3-websocket-client-1.2.3-2.el9 824 kB/s | 90 kB 00:00 2024-06-02T23:46:40.109 INFO:teuthology.orchestra.run.smithi049.stdout:(145/159): python3-werkzeug-2.0.3-3.el9.1.noarc 4.2 MB/s | 427 kB 00:00 2024-06-02T23:46:40.143 INFO:teuthology.orchestra.run.smithi049.stdout:(146/159): python3-zc-lockfile-2.0-10.el9.noarc 216 kB/s | 20 kB 00:00 2024-06-02T23:46:40.201 INFO:teuthology.orchestra.run.smithi049.stdout:(147/159): re2-20211101-3.el9.x86_64.rpm 1.5 MB/s | 192 kB 00:00 2024-06-02T23:46:40.243 INFO:teuthology.orchestra.run.smithi049.stdout:(148/159): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-06-02T23:46:40.264 INFO:teuthology.orchestra.run.smithi057.stdout:(69/159): postgresql-private-libs-13.14-1.el9.x 262 kB/s | 133 kB 00:00 2024-06-02T23:46:40.594 INFO:teuthology.orchestra.run.smithi049.stdout:(149/159): librados2-19.0.0-2946.g3d89accf.el9. 7.5 MB/s | 3.4 MB 00:00 2024-06-02T23:46:40.597 INFO:teuthology.orchestra.run.smithi057.stdout:(70/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 1.1 MB/s | 4.4 MB 00:03 2024-06-02T23:46:40.686 INFO:teuthology.orchestra.run.smithi049.stdout:(150/159): NetworkManager-1.47.91-1.el9.x86_64. 5.2 MB/s | 2.3 MB 00:00 2024-06-02T23:46:40.761 INFO:teuthology.orchestra.run.smithi049.stdout:(151/159): NetworkManager-team-1.47.91-1.el9.x8 553 kB/s | 41 kB 00:00 2024-06-02T23:46:40.820 INFO:teuthology.orchestra.run.smithi049.stdout:(152/159): NetworkManager-tui-1.47.91-1.el9.x86 4.2 MB/s | 248 kB 00:00 2024-06-02T23:46:40.886 INFO:teuthology.orchestra.run.smithi049.stdout:(153/159): elfutils-debuginfod-client-0.191-4.e 551 kB/s | 37 kB 00:00 2024-06-02T23:46:40.924 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-06-02T23:46:40.970 INFO:teuthology.orchestra.run.smithi049.stdout:(154/159): NetworkManager-libnm-1.47.91-1.el9.x 4.8 MB/s | 1.8 MB 00:00 2024-06-02T23:46:40.976 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-06-02T23:46:40.995 INFO:teuthology.orchestra.run.smithi049.stdout:(155/159): elfutils-libelf-0.191-4.el9.x86_64.r 1.9 MB/s | 207 kB 00:00 2024-06-02T23:46:41.023 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-06-02T23:46:41.029 INFO:teuthology.orchestra.run.smithi049.stdout:(156/159): elfutils-libs-0.191-4.el9.x86_64.rpm 4.3 MB/s | 260 kB 00:00 2024-06-02T23:46:41.099 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-06-02T23:46:41.121 INFO:teuthology.orchestra.run.smithi049.stdout:(157/159): librbd1-19.0.0-2946.g3d89accf.el9.x8 3.4 MB/s | 3.1 MB 00:00 2024-06-02T23:46:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-06-02T23:46:41.155 INFO:teuthology.orchestra.run.smithi049.stdout:(158/159): openssl-3.2.1-1.el9.x86_64.rpm 8.5 MB/s | 1.3 MB 00:00 2024-06-02T23:46:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-06-02T23:46:41.173 INFO:teuthology.orchestra.run.smithi057.stdout:(71/159): postgresql-contrib-13.14-1.el9.x86_64 495 kB/s | 911 kB 00:01 2024-06-02T23:46:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-06-02T23:46:41.346 INFO:teuthology.orchestra.run.smithi049.stdout:(159/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 7.6 MB/s | 2.4 MB 00:00 2024-06-02T23:46:41.349 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:46:41.349 INFO:teuthology.orchestra.run.smithi049.stdout:Total 12 MB/s | 225 MB 00:19 2024-06-02T23:46:41.523 INFO:teuthology.orchestra.run.smithi057.stdout:(72/159): python3-attrs-20.3.0-7.el9.noarch.rpm 250 kB/s | 87 kB 00:00 2024-06-02T23:46:41.528 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-06-02T23:46:41.637 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-02T23:46:41.759 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-02T23:46:41.779 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-02T23:46:41.863 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-02T23:46:41.884 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-02T23:46:41.916 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-06-02T23:46:42.094 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-06-02T23:46:42.140 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-06-02T23:46:42.168 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-02T23:46:42.272 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-02T23:46:42.294 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-02T23:46:42.357 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-02T23:46:42.379 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-02T23:46:42.397 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-02T23:46:42.564 INFO:teuthology.orchestra.run.smithi057.stdout:(73/159): protobuf-3.14.0-13.el9.x86_64.rpm 525 kB/s | 1.0 MB 00:01 2024-06-02T23:46:42.579 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-02T23:46:42.629 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-06-02T23:46:42.703 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-02T23:46:42.803 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-06-02T23:46:42.804 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-06-02T23:46:42.868 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-02T23:46:42.906 INFO:teuthology.orchestra.run.smithi057.stdout:(74/159): python3-colorama-0.4.6-3.el9.noarch.r 179 kB/s | 61 kB 00:00 2024-06-02T23:46:42.928 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-02T23:46:43.025 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T23:46:43.096 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T23:46:43.313 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T23:46:43.431 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-06-02T23:46:43.579 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-06-02T23:46:43.620 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/170 2024-06-02T23:46:43.671 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/170 2024-06-02T23:46:43.748 INFO:teuthology.orchestra.run.smithi057.stdout:(75/159): python3-devel-3.9.18-3.el9.x86_64.rpm 290 kB/s | 244 kB 00:00 2024-06-02T23:46:43.776 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/170 2024-06-02T23:46:43.818 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/170 2024-06-02T23:46:43.877 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-06-02T23:46:43.914 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-06-02T23:46:43.940 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-06-02T23:46:44.009 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-06-02T23:46:44.062 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-06-02T23:46:44.093 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-06-02T23:46:44.145 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-06-02T23:46:44.215 INFO:teuthology.orchestra.run.smithi057.stdout:(76/159): postgresql-server-13.14-1.el9.x86_64. 1.5 MB/s | 5.8 MB 00:03 2024-06-02T23:46:44.221 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-06-02T23:46:44.255 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 34/170 2024-06-02T23:46:44.298 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 35/170 2024-06-02T23:46:44.328 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 36/170 2024-06-02T23:46:44.390 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-06-02T23:46:44.451 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-06-02T23:46:44.482 INFO:teuthology.orchestra.run.smithi057.stdout:(77/159): python3-jsonpatch-1.21-16.el9.noarch. 96 kB/s | 26 kB 00:00 2024-06-02T23:46:44.526 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-06-02T23:46:44.549 INFO:teuthology.orchestra.run.smithi057.stdout:(78/159): python3-jinja2-2.11.3-6.el9.noarch.rp 310 kB/s | 248 kB 00:00 2024-06-02T23:46:44.662 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-06-02T23:46:44.720 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-06-02T23:46:44.750 INFO:teuthology.orchestra.run.smithi057.stdout:(79/159): python3-jsonpointer-2.0-4.el9.noarch. 72 kB/s | 19 kB 00:00 2024-06-02T23:46:44.984 INFO:teuthology.orchestra.run.smithi057.stdout:(80/159): python3-babel-2.9.1-2.el9.noarch.rpm 1.7 MB/s | 6.0 MB 00:03 2024-06-02T23:46:45.010 INFO:teuthology.orchestra.run.smithi057.stdout:(81/159): python3-mako-1.1.4-6.el9.noarch.rpm 375 kB/s | 172 kB 00:00 2024-06-02T23:46:45.025 INFO:teuthology.orchestra.run.smithi057.stdout:(82/159): python3-markupsafe-1.1.1-12.el9.x86_6 126 kB/s | 35 kB 00:00 2024-06-02T23:46:45.222 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-06-02T23:46:45.223 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-06-02T23:46:45.259 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-06-02T23:46:45.341 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-06-02T23:46:45.369 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-06-02T23:46:45.405 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-06-02T23:46:45.454 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-06-02T23:46:45.492 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 47/170 2024-06-02T23:46:45.534 INFO:teuthology.orchestra.run.smithi057.stdout:(83/159): python3-oauthlib-3.1.1-5.el9.noarch.r 437 kB/s | 222 kB 00:00 2024-06-02T23:46:45.534 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-06-02T23:46:45.687 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-06-02T23:46:45.746 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-06-02T23:46:45.801 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-06-02T23:46:45.817 INFO:teuthology.orchestra.run.smithi057.stdout:(84/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 310 kB/s | 250 kB 00:00 2024-06-02T23:46:45.876 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-06-02T23:46:45.906 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-06-02T23:46:45.943 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-06-02T23:46:45.951 INFO:teuthology.orchestra.run.smithi057.stdout:(85/159): python3-packaging-20.9-5.el9.noarch.r 185 kB/s | 77 kB 00:00 2024-06-02T23:46:45.990 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-06-02T23:46:46.025 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-06-02T23:46:46.060 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-06-02T23:46:46.102 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-06-02T23:46:46.160 INFO:teuthology.orchestra.run.smithi057.stdout:(86/159): python3-prettytable-0.7.2-27.el9.noar 123 kB/s | 42 kB 00:00 2024-06-02T23:46:46.240 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-06-02T23:46:46.451 INFO:teuthology.orchestra.run.smithi057.stdout:(87/159): python3-protobuf-3.14.0-13.el9.noarch 538 kB/s | 269 kB 00:00 2024-06-02T23:46:46.480 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-06-02T23:46:46.555 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-06-02T23:46:46.652 INFO:teuthology.orchestra.run.smithi057.stdout:(88/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 323 kB/s | 159 kB 00:00 2024-06-02T23:46:46.654 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-06-02T23:46:46.687 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-06-02T23:46:46.728 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-06-02T23:46:46.753 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-06-02T23:46:46.777 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-06-02T23:46:46.845 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-06-02T23:46:46.960 INFO:teuthology.orchestra.run.smithi057.stdout:(89/159): python3-pyasn1-modules-0.4.8-6.el9.no 548 kB/s | 279 kB 00:00 2024-06-02T23:46:46.970 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-06-02T23:46:46.994 INFO:teuthology.orchestra.run.smithi057.stdout:(90/159): python3-pytz-2021.1-5.el9.noarch.rpm 149 kB/s | 51 kB 00:00 2024-06-02T23:46:47.001 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-06-02T23:46:47.029 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-06-02T23:46:47.071 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-06-02T23:46:47.110 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-06-02T23:46:47.142 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-06-02T23:46:47.172 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-06-02T23:46:47.206 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-06-02T23:46:47.240 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-06-02T23:46:47.281 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-06-02T23:46:47.307 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-06-02T23:46:47.311 INFO:teuthology.orchestra.run.smithi057.stdout:(91/159): python3-requests-oauthlib-1.3.0-12.el 153 kB/s | 54 kB 00:00 2024-06-02T23:46:47.387 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-06-02T23:46:47.429 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-06-02T23:46:47.461 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-06-02T23:46:47.508 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-06-02T23:46:47.578 INFO:teuthology.orchestra.run.smithi057.stdout:(92/159): python3-toml-0.10.2-6.el9.noarch.rpm 156 kB/s | 42 kB 00:00 2024-06-02T23:46:47.607 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-06-02T23:46:47.653 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-06-02T23:46:47.911 INFO:teuthology.orchestra.run.smithi057.stdout:(93/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 132 kB/s | 44 kB 00:00 2024-06-02T23:46:48.398 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-06-02T23:46:48.442 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-06-02T23:46:48.476 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-06-02T23:46:48.495 INFO:teuthology.orchestra.run.smithi057.stdout:(94/159): qatlib-24.02.0-1.el9.x86_64.rpm 378 kB/s | 221 kB 00:00 2024-06-02T23:46:48.578 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-06-02T23:46:48.603 INFO:teuthology.orchestra.run.smithi057.stdout:(95/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.4 MB/s | 5.1 MB 00:03 2024-06-02T23:46:48.631 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-06-02T23:46:48.676 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-06-02T23:46:48.765 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-06-02T23:46:48.795 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-06-02T23:46:48.795 INFO:teuthology.orchestra.run.smithi057.stdout:(96/159): qatlib-service-24.02.0-1.el9.x86_64.r 120 kB/s | 36 kB 00:00 2024-06-02T23:46:48.937 INFO:teuthology.orchestra.run.smithi057.stdout:(97/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 142 kB/s | 47 kB 00:00 2024-06-02T23:46:48.971 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-06-02T23:46:49.001 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-06-02T23:46:49.079 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-06-02T23:46:49.279 INFO:teuthology.orchestra.run.smithi057.stdout:(98/159): uuid-1.6.2-55.el9.x86_64.rpm 169 kB/s | 58 kB 00:00 2024-06-02T23:46:49.305 INFO:teuthology.orchestra.run.smithi057.stdout:(99/159): socat-1.7.4.1-5.el9.x86_64.rpm 599 kB/s | 305 kB 00:00 2024-06-02T23:46:49.646 INFO:teuthology.orchestra.run.smithi057.stdout:(100/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 186 kB/s | 64 kB 00:00 2024-06-02T23:46:49.697 INFO:teuthology.orchestra.run.smithi057.stdout:(101/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 225 kB/s | 94 kB 00:00 2024-06-02T23:46:49.738 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-06-02T23:46:49.764 INFO:teuthology.orchestra.run.smithi057.stdout:(102/159): lua-devel-5.4.4-4.el9.x86_64.rpm 335 kB/s | 22 kB 00:00 2024-06-02T23:46:49.850 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-06-02T23:46:49.872 INFO:teuthology.orchestra.run.smithi057.stdout:(103/159): protobuf-compiler-3.14.0-13.el9.x86_ 7.8 MB/s | 863 kB 00:00 2024-06-02T23:46:49.989 INFO:teuthology.orchestra.run.smithi057.stdout:(104/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 131 kB/s | 45 kB 00:00 2024-06-02T23:46:50.139 INFO:teuthology.orchestra.run.smithi057.stdout:(105/159): abseil-cpp-20211102.0-3.el9.x86_64.r 2.0 MB/s | 548 kB 00:00 2024-06-02T23:46:50.190 INFO:teuthology.orchestra.run.smithi057.stdout:(106/159): grpc-data-1.46.7-10.el9.noarch.rpm 389 kB/s | 19 kB 00:00 2024-06-02T23:46:50.223 INFO:teuthology.orchestra.run.smithi057.stdout:(107/159): gperftools-libs-2.9.1-2.el9.x86_64.r 1.3 MB/s | 309 kB 00:00 2024-06-02T23:46:50.273 INFO:teuthology.orchestra.run.smithi057.stdout:(108/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 520 kB/s | 26 kB 00:00 2024-06-02T23:46:50.708 INFO:teuthology.orchestra.run.smithi057.stdout:(109/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 4.4 MB/s | 16 MB 00:03 2024-06-02T23:46:50.782 INFO:teuthology.orchestra.run.smithi057.stdout:(110/159): liboath-2.6.7-2.el9.x86_64.rpm 96 kB/s | 49 kB 00:00 2024-06-02T23:46:50.850 INFO:teuthology.orchestra.run.smithi057.stdout:(111/159): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-06-02T23:46:50.933 INFO:teuthology.orchestra.run.smithi057.stdout:(112/159): libarrow-9.0.0-11.el9.x86_64.rpm 5.9 MB/s | 4.4 MB 00:00 2024-06-02T23:46:50.959 INFO:teuthology.orchestra.run.smithi057.stdout:(113/159): libunwind-1.6.2-1.el9.x86_64.rpm 269 kB/s | 67 kB 00:00 2024-06-02T23:46:50.992 INFO:teuthology.orchestra.run.smithi057.stdout:(114/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.8 MB/s | 839 kB 00:00 2024-06-02T23:46:51.018 INFO:teuthology.orchestra.run.smithi057.stdout:(115/159): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-06-02T23:46:51.043 INFO:teuthology.orchestra.run.smithi057.stdout:(116/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 519 kB/s | 43 kB 00:00 2024-06-02T23:46:51.085 INFO:teuthology.orchestra.run.smithi057.stdout:(117/159): python3-cachetools-4.2.4-1.el9.noarc 349 kB/s | 32 kB 00:00 2024-06-02T23:46:51.090 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-06-02T23:46:51.102 INFO:teuthology.orchestra.run.smithi057.stdout:(118/159): python3-certifi-2021.10.8-2.el9.noar 179 kB/s | 15 kB 00:00 2024-06-02T23:46:51.160 INFO:teuthology.orchestra.run.smithi057.stdout:(119/159): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-06-02T23:46:51.170 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-06-02T23:46:51.185 INFO:teuthology.orchestra.run.smithi057.stdout:(120/159): python3-cheroot-8.6.0-4.el9.noarch.r 1.2 MB/s | 172 kB 00:00 2024-06-02T23:46:51.198 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-06-02T23:46:51.211 INFO:teuthology.orchestra.run.smithi057.stdout:(121/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-06-02T23:46:51.231 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-06-02T23:46:51.237 INFO:teuthology.orchestra.run.smithi057.stdout:(122/159): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-06-02T23:46:51.270 INFO:teuthology.orchestra.run.smithi057.stdout:(123/159): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-06-02T23:46:51.295 INFO:teuthology.orchestra.run.smithi057.stdout:(124/159): python3-jaraco-8.2.1-3.el9.noarch.rp 182 kB/s | 11 kB 00:00 2024-06-02T23:46:51.345 INFO:teuthology.orchestra.run.smithi057.stdout:(125/159): python3-jaraco-classes-3.2.1-5.el9.n 235 kB/s | 18 kB 00:00 2024-06-02T23:46:51.371 INFO:teuthology.orchestra.run.smithi057.stdout:(126/159): python3-jaraco-collections-3.0.0-8.e 307 kB/s | 23 kB 00:00 2024-06-02T23:46:51.421 INFO:teuthology.orchestra.run.smithi057.stdout:(127/159): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-06-02T23:46:51.446 INFO:teuthology.orchestra.run.smithi057.stdout:(128/159): python3-jaraco-functools-3.5.0-2.el9 193 kB/s | 19 kB 00:00 2024-06-02T23:46:51.471 INFO:teuthology.orchestra.run.smithi057.stdout:(129/159): python3-jaraco-text-3.2.0-6.el9.noar 196 kB/s | 20 kB 00:00 2024-06-02T23:46:51.505 INFO:teuthology.orchestra.run.smithi057.stdout:(130/159): python3-kubernetes-26.1.0-2.el9.noar 12 MB/s | 1.0 MB 00:00 2024-06-02T23:46:51.530 INFO:teuthology.orchestra.run.smithi057.stdout:(131/159): python3-logutils-0.3.5-21.el9.noarch 794 kB/s | 46 kB 00:00 2024-06-02T23:46:51.542 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-06-02T23:46:51.555 INFO:teuthology.orchestra.run.smithi057.stdout:(132/159): python3-more-itertools-8.12.0-2.el9. 945 kB/s | 79 kB 00:00 2024-06-02T23:46:51.580 INFO:teuthology.orchestra.run.smithi057.stdout:(133/159): python3-natsort-7.1.1-5.el9.noarch.r 766 kB/s | 58 kB 00:00 2024-06-02T23:46:51.586 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-02T23:46:51.606 INFO:teuthology.orchestra.run.smithi057.stdout:(134/159): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-06-02T23:46:51.631 INFO:teuthology.orchestra.run.smithi057.stdout:(135/159): python3-portend-3.1.0-2.el9.noarch.r 217 kB/s | 16 kB 00:00 2024-06-02T23:46:51.657 INFO:teuthology.orchestra.run.smithi057.stdout:(136/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-06-02T23:46:51.676 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-02T23:46:51.682 INFO:teuthology.orchestra.run.smithi057.stdout:(137/159): python3-pyperclip-1.8.2-2.el9.noarch 374 kB/s | 28 kB 00:00 2024-06-02T23:46:51.707 INFO:teuthology.orchestra.run.smithi057.stdout:(138/159): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-06-02T23:46:51.707 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 104/170 2024-06-02T23:46:51.722 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-06-02T23:46:51.732 INFO:teuthology.orchestra.run.smithi057.stdout:(139/159): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-06-02T23:46:51.743 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-06-02T23:46:51.757 INFO:teuthology.orchestra.run.smithi057.stdout:(140/159): python3-rsa-4.9-2.el9.noarch.rpm 783 kB/s | 59 kB 00:00 2024-06-02T23:46:51.783 INFO:teuthology.orchestra.run.smithi057.stdout:(141/159): python3-tempora-5.0.0-2.el9.noarch.r 475 kB/s | 36 kB 00:00 2024-06-02T23:46:51.808 INFO:teuthology.orchestra.run.smithi057.stdout:(142/159): python3-typing-extensions-4.4.0-2.el 674 kB/s | 51 kB 00:00 2024-06-02T23:46:51.827 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-06-02T23:46:51.833 INFO:teuthology.orchestra.run.smithi057.stdout:(143/159): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-06-02T23:46:51.850 INFO:teuthology.orchestra.run.smithi057.stdout:(144/159): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-06-02T23:46:51.865 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-06-02T23:46:51.884 INFO:teuthology.orchestra.run.smithi057.stdout:(145/159): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-06-02T23:46:51.909 INFO:teuthology.orchestra.run.smithi057.stdout:(146/159): python3-zc-lockfile-2.0-10.el9.noarc 264 kB/s | 20 kB 00:00 2024-06-02T23:46:51.934 INFO:teuthology.orchestra.run.smithi057.stdout:(147/159): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-06-02T23:46:51.935 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-06-02T23:46:51.969 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-06-02T23:46:51.976 INFO:teuthology.orchestra.run.smithi057.stdout:(148/159): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-06-02T23:46:51.994 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-06-02T23:46:52.046 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-06-02T23:46:52.214 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-06-02T23:46:52.238 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-02T23:46:52.293 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-02T23:46:52.315 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 108/170 2024-06-02T23:46:52.467 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-06-02T23:46:52.520 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-02T23:46:52.535 INFO:teuthology.orchestra.run.smithi057.stdout:(149/159): NetworkManager-1.47.91-1.el9.x86_64. 4.1 MB/s | 2.3 MB 00:00 2024-06-02T23:46:52.644 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-02T23:46:52.671 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-02T23:46:52.756 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-02T23:46:52.784 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-02T23:46:52.819 INFO:teuthology.orchestra.run.smithi057.stdout:(150/159): NetworkManager-libnm-1.47.91-1.el9.x 6.4 MB/s | 1.8 MB 00:00 2024-06-02T23:46:52.832 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-06-02T23:46:52.861 INFO:teuthology.orchestra.run.smithi057.stdout:(151/159): NetworkManager-team-1.47.91-1.el9.x8 997 kB/s | 41 kB 00:00 2024-06-02T23:46:52.911 INFO:teuthology.orchestra.run.smithi057.stdout:(152/159): NetworkManager-tui-1.47.91-1.el9.x86 4.8 MB/s | 248 kB 00:00 2024-06-02T23:46:52.995 INFO:teuthology.orchestra.run.smithi057.stdout:(153/159): elfutils-debuginfod-client-0.191-4.e 441 kB/s | 37 kB 00:00 2024-06-02T23:46:53.041 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-06-02T23:46:53.045 INFO:teuthology.orchestra.run.smithi057.stdout:(154/159): librbd1-19.0.0-2946.g3d89accf.el9.x8 2.8 MB/s | 3.1 MB 00:01 2024-06-02T23:46:53.070 INFO:teuthology.orchestra.run.smithi057.stdout:(155/159): elfutils-libelf-0.191-4.el9.x86_64.r 2.7 MB/s | 207 kB 00:00 2024-06-02T23:46:53.098 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-06-02T23:46:53.127 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-02T23:46:53.162 INFO:teuthology.orchestra.run.smithi057.stdout:(156/159): openssl-3.2.1-1.el9.x86_64.rpm 15 MB/s | 1.3 MB 00:00 2024-06-02T23:46:53.187 INFO:teuthology.orchestra.run.smithi057.stdout:(157/159): elfutils-libs-0.191-4.el9.x86_64.rpm 1.8 MB/s | 260 kB 00:00 2024-06-02T23:46:53.241 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-02T23:46:53.269 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-02T23:46:53.287 INFO:teuthology.orchestra.run.smithi057.stdout:(158/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 19 MB/s | 2.4 MB 00:00 2024-06-02T23:46:53.332 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-02T23:46:53.354 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-02T23:46:53.381 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-02T23:46:53.513 INFO:teuthology.orchestra.run.smithi057.stdout:(159/159): librados2-19.0.0-2946.g3d89accf.el9. 2.1 MB/s | 3.4 MB 00:01 2024-06-02T23:46:53.515 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:46:53.516 INFO:teuthology.orchestra.run.smithi057.stdout:Total 7.0 MB/s | 225 MB 00:32 2024-06-02T23:46:53.573 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-02T23:46:53.732 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-02T23:46:53.877 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-02T23:46:53.920 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-02T23:46:54.031 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T23:46:54.113 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T23:46:54.313 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T23:46:54.431 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-06-02T23:46:54.526 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-06-02T23:46:54.568 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/170 2024-06-02T23:46:54.612 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/170 2024-06-02T23:46:54.613 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-02T23:46:54.644 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-02T23:46:54.696 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/170 2024-06-02T23:46:54.737 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/170 2024-06-02T23:46:54.765 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-06-02T23:46:54.780 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-06-02T23:46:54.813 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-06-02T23:46:54.848 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-06-02T23:46:54.920 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-06-02T23:46:54.943 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-06-02T23:46:54.943 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-06-02T23:46:54.981 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-06-02T23:46:55.010 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-06-02T23:46:55.053 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-06-02T23:46:55.132 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-06-02T23:46:55.172 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 34/170 2024-06-02T23:46:55.184 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-02T23:46:55.217 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 35/170 2024-06-02T23:46:55.231 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-02T23:46:55.244 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 36/170 2024-06-02T23:46:55.318 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-06-02T23:46:55.331 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-02T23:46:55.331 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-02T23:46:55.332 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-02T23:46:55.332 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-06-02T23:46:55.365 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-02T23:46:55.368 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-06-02T23:46:55.445 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-06-02T23:46:55.589 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-06-02T23:46:55.654 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-06-02T23:46:56.209 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-06-02T23:46:56.294 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-06-02T23:46:56.337 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-06-02T23:46:56.374 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-06-02T23:46:56.438 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-06-02T23:46:56.477 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 47/170 2024-06-02T23:46:56.519 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-06-02T23:46:56.690 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-06-02T23:46:56.738 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-06-02T23:46:56.794 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-06-02T23:46:56.867 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-06-02T23:46:56.868 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-06-02T23:46:56.868 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-06-02T23:46:56.905 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-06-02T23:46:56.942 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-06-02T23:46:56.989 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-06-02T23:46:57.024 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-06-02T23:46:57.068 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-06-02T23:46:57.110 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-06-02T23:46:57.253 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-06-02T23:46:57.295 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-06-02T23:46:57.337 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-06-02T23:46:57.436 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-06-02T23:46:57.470 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-06-02T23:46:57.512 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-06-02T23:46:57.544 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-06-02T23:46:57.568 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-06-02T23:46:57.655 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-06-02T23:46:57.784 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-06-02T23:46:57.818 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-06-02T23:46:57.846 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-06-02T23:46:57.880 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-06-02T23:46:57.920 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-06-02T23:46:57.977 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-06-02T23:46:58.006 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-06-02T23:46:58.040 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-06-02T23:46:58.074 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-06-02T23:46:58.116 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-06-02T23:46:58.150 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-06-02T23:46:58.240 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-06-02T23:46:58.299 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-06-02T23:46:58.336 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-06-02T23:46:58.384 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-06-02T23:46:58.495 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-06-02T23:46:58.549 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-06-02T23:46:59.310 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-06-02T23:46:59.362 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-06-02T23:46:59.396 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-06-02T23:46:59.498 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-06-02T23:46:59.551 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-06-02T23:46:59.596 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-06-02T23:46:59.703 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-06-02T23:46:59.740 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-06-02T23:46:59.923 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-06-02T23:46:59.946 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-06-02T23:47:00.036 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-06-02T23:47:00.718 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-06-02T23:47:00.839 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-06-02T23:47:02.172 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-06-02T23:47:02.249 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-06-02T23:47:02.277 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-06-02T23:47:02.310 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-06-02T23:47:02.648 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-06-02T23:47:02.690 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-02T23:47:02.781 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-02T23:47:02.811 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 104/170 2024-06-02T23:47:02.850 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-06-02T23:47:03.300 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-06-02T23:47:03.337 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-06-02T23:47:03.383 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-02T23:47:03.384 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-06-02T23:47:03.423 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-06-02T23:47:03.456 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-02T23:47:03.476 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-06-02T23:47:03.486 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 108/170 2024-06-02T23:47:03.510 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-06-02T23:47:03.535 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-06-02T23:47:03.579 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-06-02T23:47:03.926 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-06-02T23:47:04.044 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-02T23:47:04.152 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-02T23:47:04.178 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-02T23:47:04.255 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-02T23:47:04.283 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-02T23:47:04.316 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-06-02T23:47:04.522 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-06-02T23:47:04.581 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-06-02T23:47:04.609 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-02T23:47:04.714 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-02T23:47:04.743 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-02T23:47:04.789 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-02T23:47:04.811 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-02T23:47:04.835 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-02T23:47:04.986 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-02T23:47:05.113 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-02T23:47:05.277 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-02T23:47:05.337 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-02T23:47:05.443 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T23:47:05.521 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T23:47:05.730 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T23:47:05.826 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-02T23:47:05.840 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-06-02T23:47:05.865 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-02T23:47:05.936 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-06-02T23:47:05.969 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/170 2024-06-02T23:47:06.022 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/170 2024-06-02T23:47:06.097 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/170 2024-06-02T23:47:06.137 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/170 2024-06-02T23:47:06.206 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-06-02T23:47:06.238 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-06-02T23:47:06.266 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-06-02T23:47:06.330 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-06-02T23:47:06.381 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-06-02T23:47:06.410 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-06-02T23:47:06.446 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-06-02T23:47:06.448 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-02T23:47:06.486 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-02T23:47:06.525 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-06-02T23:47:06.557 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 34/170 2024-06-02T23:47:06.587 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-02T23:47:06.588 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-02T23:47:06.588 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-02T23:47:06.588 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:47:06.600 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 35/170 2024-06-02T23:47:06.620 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-02T23:47:06.629 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 36/170 2024-06-02T23:47:06.704 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-06-02T23:47:06.753 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-06-02T23:47:06.781 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-02T23:47:06.781 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /sys 2024-06-02T23:47:06.781 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /proc 2024-06-02T23:47:06.781 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /mnt 2024-06-02T23:47:06.781 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /var/tmp 2024-06-02T23:47:06.782 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /home 2024-06-02T23:47:06.782 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /root 2024-06-02T23:47:06.782 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /tmp 2024-06-02T23:47:06.782 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-06-02T23:47:06.832 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-06-02T23:47:06.946 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-02T23:47:06.962 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-02T23:47:06.962 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:47:06.962 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-02T23:47:06.962 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-06-02T23:47:06.979 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-06-02T23:47:07.040 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-06-02T23:47:07.609 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-06-02T23:47:07.696 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-06-02T23:47:07.730 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-06-02T23:47:07.766 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-06-02T23:47:07.824 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-06-02T23:47:07.862 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 47/170 2024-06-02T23:47:07.905 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-06-02T23:47:08.060 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-06-02T23:47:08.132 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-06-02T23:47:08.189 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-06-02T23:47:08.262 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-06-02T23:47:08.299 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-06-02T23:47:08.336 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-06-02T23:47:08.384 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-06-02T23:47:08.421 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-06-02T23:47:08.459 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-02T23:47:08.463 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-06-02T23:47:08.485 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-02T23:47:08.485 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:47:08.485 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-02T23:47:08.485 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-02T23:47:08.485 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-02T23:47:08.485 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-06-02T23:47:08.505 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-06-02T23:47:08.650 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-06-02T23:47:08.690 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-06-02T23:47:08.709 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-02T23:47:08.732 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-06-02T23:47:08.732 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-02T23:47:08.732 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:47:08.732 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-02T23:47:08.733 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-02T23:47:08.733 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-02T23:47:08.733 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-06-02T23:47:08.830 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-06-02T23:47:08.872 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-06-02T23:47:08.913 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-06-02T23:47:08.946 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-06-02T23:47:08.971 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-06-02T23:47:09.050 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-06-02T23:47:09.177 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-02T23:47:09.179 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-06-02T23:47:09.199 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-02T23:47:09.199 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:47:09.199 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-02T23:47:09.199 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-02T23:47:09.199 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-02T23:47:09.199 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-06-02T23:47:09.212 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-06-02T23:47:09.240 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-06-02T23:47:09.275 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-06-02T23:47:09.299 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-06-02T23:47:09.314 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-06-02T23:47:09.355 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-06-02T23:47:09.356 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-06-02T23:47:09.384 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-06-02T23:47:09.411 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-06-02T23:47:09.419 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-06-02T23:47:09.452 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-06-02T23:47:09.494 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-06-02T23:47:09.528 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-06-02T23:47:09.598 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-06-02T23:47:09.619 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-06-02T23:47:09.645 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-06-02T23:47:09.667 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-06-02T23:47:09.698 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-06-02T23:47:09.723 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-06-02T23:47:09.746 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-06-02T23:47:09.811 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-06-02T23:47:09.858 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-06-02T23:47:09.910 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-06-02T23:47:09.961 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-06-02T23:47:10.012 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-06-02T23:47:10.044 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-06-02T23:47:10.080 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-06-02T23:47:10.533 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-02T23:47:10.562 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-02T23:47:10.593 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 128/170 2024-06-02T23:47:10.656 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 129/170 2024-06-02T23:47:10.685 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-02T23:47:10.691 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-06-02T23:47:10.739 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-06-02T23:47:10.773 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-06-02T23:47:10.879 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-06-02T23:47:10.929 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-06-02T23:47:10.974 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-06-02T23:47:11.066 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-06-02T23:47:11.117 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-06-02T23:47:11.302 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-06-02T23:47:11.331 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-06-02T23:47:11.412 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-06-02T23:47:11.717 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-02T23:47:11.754 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-02T23:47:12.114 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-06-02T23:47:12.235 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-06-02T23:47:12.720 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-02T23:47:12.754 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-02T23:47:12.858 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-02T23:47:13.017 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 133/170 2024-06-02T23:47:13.056 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-02T23:47:13.080 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-02T23:47:13.080 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:47:13.080 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-02T23:47:13.080 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-02T23:47:13.080 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-02T23:47:13.080 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-06-02T23:47:13.132 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-02T23:47:13.143 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-02T23:47:13.241 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 136/170 2024-06-02T23:47:13.289 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 137/170 2024-06-02T23:47:13.557 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-06-02T23:47:13.645 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-06-02T23:47:13.673 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-06-02T23:47:13.706 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-06-02T23:47:14.034 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-06-02T23:47:14.077 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-02T23:47:14.170 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-02T23:47:14.187 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-06-02T23:47:14.199 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 104/170 2024-06-02T23:47:14.227 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-02T23:47:14.236 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-06-02T23:47:14.249 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-02T23:47:14.250 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:47:14.250 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-02T23:47:14.250 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-02T23:47:14.250 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-02T23:47:14.250 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-06-02T23:47:14.294 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-02T23:47:14.316 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-02T23:47:14.316 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:47:14.316 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-02T23:47:14.316 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-06-02T23:47:14.362 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-02T23:47:14.384 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-02T23:47:14.384 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:47:14.384 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-06-02T23:47:14.384 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-02T23:47:14.384 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-02T23:47:14.385 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-06-02T23:47:14.687 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-02T23:47:14.709 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-02T23:47:14.710 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:47:14.710 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-02T23:47:14.710 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-02T23:47:14.710 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-02T23:47:14.710 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-06-02T23:47:14.733 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-06-02T23:47:14.764 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-02T23:47:14.836 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-02T23:47:14.866 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 108/170 2024-06-02T23:47:17.189 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-02T23:47:17.221 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-02T23:47:17.792 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-02T23:47:17.841 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-02T23:47:17.924 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-02T23:47:17.924 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-02T23:47:17.925 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-02T23:47:17.925 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-06-02T23:47:17.959 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-02T23:47:18.666 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-02T23:47:18.666 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /sys 2024-06-02T23:47:18.666 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /proc 2024-06-02T23:47:18.666 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /mnt 2024-06-02T23:47:18.666 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /var/tmp 2024-06-02T23:47:18.666 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /home 2024-06-02T23:47:18.666 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /root 2024-06-02T23:47:18.666 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /tmp 2024-06-02T23:47:18.666 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:47:18.839 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-02T23:47:18.856 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-02T23:47:18.856 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:47:18.856 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-02T23:47:18.856 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:47:19.207 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 143/170 2024-06-02T23:47:19.249 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 144/170 2024-06-02T23:47:19.290 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 145/170 2024-06-02T23:47:19.322 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-06-02T23:47:19.349 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-06-02T23:47:19.546 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 148/170 2024-06-02T23:47:19.587 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-06-02T23:47:19.619 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 150/170 2024-06-02T23:47:19.660 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-06-02T23:47:19.690 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 152/170 2024-06-02T23:47:19.728 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 153/170 2024-06-02T23:47:20.363 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T23:47:20.394 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-02T23:47:20.401 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T23:47:20.421 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T23:47:20.422 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-02T23:47:20.422 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:47:20.422 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-02T23:47:20.423 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-02T23:47:20.423 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-02T23:47:20.423 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:47:20.653 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-02T23:47:20.678 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-02T23:47:20.678 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:47:20.678 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-02T23:47:20.678 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-02T23:47:20.678 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-02T23:47:20.678 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:47:21.154 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-02T23:47:21.178 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-02T23:47:21.178 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:47:21.178 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-02T23:47:21.178 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-02T23:47:21.178 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-02T23:47:21.179 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:47:21.251 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 155/170 2024-06-02T23:47:21.292 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-06-02T23:47:21.340 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-06-02T23:47:21.350 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-06-02T23:47:21.381 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-06-02T23:47:21.415 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-06-02T23:47:21.465 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-06-02T23:47:21.494 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-06-02T23:47:21.518 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-02T23:47:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-06-02T23:47:21.571 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-06-02T23:47:21.571 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-02T23:47:21.607 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-06-02T23:47:21.654 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-06-02T23:47:21.663 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-02T23:47:21.696 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-06-02T23:47:21.696 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-02T23:47:21.735 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-06-02T23:47:21.781 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-02T23:47:21.806 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-06-02T23:47:21.811 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T23:47:21.811 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T23:47:21.823 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-06-02T23:47:21.973 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-06-02T23:47:21.991 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T23:47:21.992 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-02T23:47:22.020 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-06-02T23:47:22.058 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-06-02T23:47:22.067 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-02T23:47:22.085 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-06-02T23:47:22.100 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-06-02T23:47:22.166 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-02T23:47:22.516 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-02T23:47:22.543 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-02T23:47:22.574 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 128/170 2024-06-02T23:47:22.640 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 129/170 2024-06-02T23:47:22.665 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-02T23:47:23.754 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-02T23:47:23.784 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-02T23:47:24.802 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-02T23:47:24.826 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-02T23:47:24.937 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-02T23:47:25.112 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 133/170 2024-06-02T23:47:25.145 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-02T23:47:25.169 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-02T23:47:25.169 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:47:25.169 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-02T23:47:25.169 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-02T23:47:25.170 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-02T23:47:25.170 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:47:25.220 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-02T23:47:25.232 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-02T23:47:25.333 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 136/170 2024-06-02T23:47:25.393 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 137/170 2024-06-02T23:47:26.344 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-06-02T23:47:26.373 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-02T23:47:26.398 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-02T23:47:26.398 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:47:26.398 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-02T23:47:26.398 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-02T23:47:26.398 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-02T23:47:26.399 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:47:26.448 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-02T23:47:26.473 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-02T23:47:26.473 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:47:26.473 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-02T23:47:26.473 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:47:26.524 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-02T23:47:26.549 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-02T23:47:26.549 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:47:26.549 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-06-02T23:47:26.549 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-02T23:47:26.549 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-02T23:47:26.549 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:47:26.866 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-02T23:47:26.891 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-02T23:47:26.891 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:47:26.891 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-02T23:47:26.891 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-02T23:47:26.892 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-02T23:47:26.892 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:47:27.755 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-02T23:47:27.755 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 1/170 2024-06-02T23:47:27.755 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2/170 2024-06-02T23:47:27.755 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 3/170 2024-06-02T23:47:27.755 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 4/170 2024-06-02T23:47:27.755 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 5/170 2024-06-02T23:47:27.756 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 6/170 2024-06-02T23:47:27.756 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 7/170 2024-06-02T23:47:27.756 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-02T23:47:27.756 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-02T23:47:27.756 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-02T23:47:27.756 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 11/170 2024-06-02T23:47:27.756 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 12/170 2024-06-02T23:47:27.756 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 13/170 2024-06-02T23:47:27.756 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-02T23:47:27.756 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 15/170 2024-06-02T23:47:27.756 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 16/170 2024-06-02T23:47:27.756 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 17/170 2024-06-02T23:47:27.756 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 18/170 2024-06-02T23:47:27.757 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 19/170 2024-06-02T23:47:27.757 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 20/170 2024-06-02T23:47:27.757 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 21/170 2024-06-02T23:47:27.757 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 22/170 2024-06-02T23:47:27.757 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 23/170 2024-06-02T23:47:27.757 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 24/170 2024-06-02T23:47:27.757 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 25/170 2024-06-02T23:47:27.757 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 26/170 2024-06-02T23:47:27.757 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 27/170 2024-06-02T23:47:27.757 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 28/170 2024-06-02T23:47:27.769 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 29/170 2024-06-02T23:47:27.770 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 30/170 2024-06-02T23:47:27.770 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 31/170 2024-06-02T23:47:27.770 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 32/170 2024-06-02T23:47:27.770 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 33/170 2024-06-02T23:47:27.770 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 34/170 2024-06-02T23:47:27.770 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 35/170 2024-06-02T23:47:27.770 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 36/170 2024-06-02T23:47:27.770 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 37/170 2024-06-02T23:47:27.770 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 38/170 2024-06-02T23:47:27.770 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 39/170 2024-06-02T23:47:27.770 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-06-02T23:47:27.771 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-06-02T23:47:27.771 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-06-02T23:47:27.771 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-06-02T23:47:27.771 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-06-02T23:47:27.771 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-06-02T23:47:27.771 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-06-02T23:47:27.771 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-06-02T23:47:27.771 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-06-02T23:47:27.771 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-06-02T23:47:27.771 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-06-02T23:47:27.771 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-06-02T23:47:27.771 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-06-02T23:47:27.771 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-06-02T23:47:27.771 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-06-02T23:47:27.772 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-06-02T23:47:27.772 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-06-02T23:47:27.772 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-06-02T23:47:27.772 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-06-02T23:47:27.772 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-06-02T23:47:27.772 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-06-02T23:47:27.772 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-06-02T23:47:27.772 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-06-02T23:47:27.772 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-06-02T23:47:27.772 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-06-02T23:47:27.772 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-06-02T23:47:27.772 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-06-02T23:47:27.773 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-06-02T23:47:27.773 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-06-02T23:47:27.773 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-06-02T23:47:27.773 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-06-02T23:47:27.773 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-06-02T23:47:27.773 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-06-02T23:47:27.773 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-06-02T23:47:27.773 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-06-02T23:47:27.773 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-06-02T23:47:27.773 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-06-02T23:47:27.773 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-06-02T23:47:27.773 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-06-02T23:47:27.773 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-06-02T23:47:27.773 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-06-02T23:47:27.774 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-06-02T23:47:27.774 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-06-02T23:47:27.774 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-06-02T23:47:27.774 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-06-02T23:47:27.774 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-06-02T23:47:27.774 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-06-02T23:47:27.774 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-06-02T23:47:27.774 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-06-02T23:47:27.774 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-06-02T23:47:27.774 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-06-02T23:47:27.774 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-06-02T23:47:27.774 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-06-02T23:47:27.774 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-06-02T23:47:27.774 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-06-02T23:47:27.775 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-06-02T23:47:27.775 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-06-02T23:47:27.775 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-06-02T23:47:27.775 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-06-02T23:47:27.775 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-06-02T23:47:27.775 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-06-02T23:47:27.775 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-06-02T23:47:27.775 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-06-02T23:47:27.775 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-06-02T23:47:27.775 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-06-02T23:47:27.775 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-06-02T23:47:27.775 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-06-02T23:47:27.775 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-06-02T23:47:27.776 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-06-02T23:47:27.776 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-06-02T23:47:27.776 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-06-02T23:47:27.776 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-06-02T23:47:27.776 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-06-02T23:47:27.776 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-06-02T23:47:27.776 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-06-02T23:47:27.776 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-06-02T23:47:27.776 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-06-02T23:47:27.776 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-06-02T23:47:27.776 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-06-02T23:47:27.776 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-06-02T23:47:27.776 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-06-02T23:47:27.777 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-06-02T23:47:27.777 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-06-02T23:47:27.777 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-06-02T23:47:27.777 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-06-02T23:47:27.777 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-06-02T23:47:27.777 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-06-02T23:47:27.777 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-06-02T23:47:27.777 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-06-02T23:47:27.777 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-06-02T23:47:27.777 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-06-02T23:47:27.777 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-06-02T23:47:27.777 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-06-02T23:47:27.777 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-06-02T23:47:27.777 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-06-02T23:47:27.778 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-06-02T23:47:27.778 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-06-02T23:47:27.778 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-06-02T23:47:27.778 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-06-02T23:47:27.778 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-06-02T23:47:27.778 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-06-02T23:47:27.778 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-06-02T23:47:27.778 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-06-02T23:47:27.778 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-06-02T23:47:27.778 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-06-02T23:47:27.778 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-06-02T23:47:27.778 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-06-02T23:47:27.778 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-06-02T23:47:27.778 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-06-02T23:47:27.779 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 149/170 2024-06-02T23:47:27.779 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-06-02T23:47:27.779 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 151/170 2024-06-02T23:47:27.779 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-06-02T23:47:27.779 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/170 2024-06-02T23:47:27.779 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-06-02T23:47:27.779 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/170 2024-06-02T23:47:27.779 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-06-02T23:47:27.779 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/170 2024-06-02T23:47:27.779 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-06-02T23:47:27.779 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/170 2024-06-02T23:47:27.779 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-02T23:47:27.779 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-06-02T23:47:27.780 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-06-02T23:47:27.780 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-06-02T23:47:27.780 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-06-02T23:47:27.780 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-06-02T23:47:27.780 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-06-02T23:47:27.780 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-06-02T23:47:27.780 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-06-02T23:47:27.780 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-06-02T23:47:29.853 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-02T23:47:29.854 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /sys 2024-06-02T23:47:29.854 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /proc 2024-06-02T23:47:29.854 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /mnt 2024-06-02T23:47:29.854 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /var/tmp 2024-06-02T23:47:29.854 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /home 2024-06-02T23:47:29.854 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /root 2024-06-02T23:47:29.854 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /tmp 2024-06-02T23:47:29.854 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-06-02T23:47:30.069 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-02T23:47:30.089 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-02T23:47:30.089 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:47:30.089 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-02T23:47:30.089 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-06-02T23:47:30.589 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-06-02T23:47:30.590 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-06-02T23:47:30.590 INFO:teuthology.orchestra.run.smithi107.stdout:Upgraded: 2024-06-02T23:47:30.590 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-06-02T23:47:30.590 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-06-02T23:47:30.591 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-06-02T23:47:30.591 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-06-02T23:47:30.591 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-02T23:47:30.592 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-02T23:47:30.592 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-02T23:47:30.592 INFO:teuthology.orchestra.run.smithi107.stdout: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:30.592 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:30.592 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-06-02T23:47:30.593 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-06-02T23:47:30.593 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-06-02T23:47:30.593 INFO:teuthology.orchestra.run.smithi107.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-02T23:47:30.593 INFO:teuthology.orchestra.run.smithi107.stdout: automake-1.16.2-8.el9.noarch 2024-06-02T23:47:30.593 INFO:teuthology.orchestra.run.smithi107.stdout: bison-3.7.4-5.el9.x86_64 2024-06-02T23:47:30.593 INFO:teuthology.orchestra.run.smithi107.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-02T23:47:30.594 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:30.594 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:30.594 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:30.594 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:30.595 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:47:30.595 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:30.595 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:30.595 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:30.595 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:47:30.596 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:47:30.596 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:47:30.596 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:47:30.596 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:47:30.596 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:30.596 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:30.597 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:47:30.597 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:30.597 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:30.597 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:30.597 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:47:30.597 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:47:30.598 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:30.598 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:30.598 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:47:30.598 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-02T23:47:30.598 INFO:teuthology.orchestra.run.smithi107.stdout: flex-2.6.4-9.el9.x86_64 2024-06-02T23:47:30.599 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-02T23:47:30.599 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-02T23:47:30.599 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-02T23:47:30.599 INFO:teuthology.orchestra.run.smithi107.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-02T23:47:30.599 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-02T23:47:30.599 INFO:teuthology.orchestra.run.smithi107.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-02T23:47:30.600 INFO:teuthology.orchestra.run.smithi107.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-02T23:47:30.600 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-02T23:47:30.600 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-02T23:47:30.600 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:30.600 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:30.600 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:30.600 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-02T23:47:30.600 INFO:teuthology.orchestra.run.smithi107.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-02T23:47:30.601 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-02T23:47:30.601 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-02T23:47:30.601 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-02T23:47:30.601 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:30.601 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:30.602 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-02T23:47:30.602 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:30.602 INFO:teuthology.orchestra.run.smithi107.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-02T23:47:30.602 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-02T23:47:30.602 INFO:teuthology.orchestra.run.smithi107.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-02T23:47:30.602 INFO:teuthology.orchestra.run.smithi107.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-02T23:47:30.602 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-02T23:47:30.602 INFO:teuthology.orchestra.run.smithi107.stdout: lua-5.4.4-4.el9.x86_64 2024-06-02T23:47:30.603 INFO:teuthology.orchestra.run.smithi107.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-02T23:47:30.603 INFO:teuthology.orchestra.run.smithi107.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-02T23:47:30.603 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-02T23:47:30.603 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-02T23:47:30.603 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-06-02T23:47:30.603 INFO:teuthology.orchestra.run.smithi107.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-02T23:47:30.603 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-13.14-1.el9.x86_64 2024-06-02T23:47:30.603 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-06-02T23:47:30.604 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-06-02T23:47:30.604 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-server-13.14-1.el9.x86_64 2024-06-02T23:47:30.604 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-02T23:47:30.604 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-02T23:47:30.604 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-02T23:47:30.604 INFO:teuthology.orchestra.run.smithi107.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-06-02T23:47:30.604 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-02T23:47:30.605 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-02T23:47:30.605 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-02T23:47:30.605 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:30.605 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:30.605 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:30.605 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-02T23:47:30.605 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-02T23:47:30.605 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-02T23:47:30.605 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-02T23:47:30.605 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-06-02T23:47:30.606 INFO:teuthology.orchestra.run.smithi107.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-06-02T23:47:30.606 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-02T23:47:30.606 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-02T23:47:30.606 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-06-02T23:47:30.606 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-02T23:47:30.606 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-02T23:47:30.606 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-02T23:47:30.607 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-02T23:47:30.607 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-02T23:47:30.607 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-02T23:47:30.607 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-02T23:47:30.607 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-02T23:47:30.607 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-02T23:47:30.607 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-02T23:47:30.607 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-02T23:47:30.607 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-02T23:47:30.607 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-02T23:47:30.607 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-02T23:47:30.607 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-02T23:47:30.607 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-02T23:47:30.607 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-02T23:47:30.608 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-02T23:47:30.608 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-02T23:47:30.608 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-02T23:47:30.608 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-02T23:47:30.608 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply-3.11-14.el9.noarch 2024-06-02T23:47:30.608 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-02T23:47:30.608 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-02T23:47:30.608 INFO:teuthology.orchestra.run.smithi107.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-02T23:47:30.608 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-02T23:47:30.608 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-02T23:47:30.608 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-02T23:47:30.608 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-02T23:47:30.608 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-06-02T23:47:30.609 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-02T23:47:30.609 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:30.609 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:30.609 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-02T23:47:30.609 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-02T23:47:30.609 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-02T23:47:30.609 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:30.609 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-02T23:47:30.609 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-02T23:47:30.609 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-02T23:47:30.609 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-02T23:47:30.609 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-02T23:47:30.609 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-02T23:47:30.609 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-02T23:47:30.610 INFO:teuthology.orchestra.run.smithi107.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-06-02T23:47:30.610 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-02T23:47:30.610 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-02T23:47:30.610 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-02T23:47:30.610 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-02T23:47:30.610 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-02T23:47:30.610 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-02T23:47:30.610 INFO:teuthology.orchestra.run.smithi107.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-02T23:47:30.610 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:30.610 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:30.610 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:30.610 INFO:teuthology.orchestra.run.smithi107.stdout: re2-1:20211101-3.el9.x86_64 2024-06-02T23:47:30.610 INFO:teuthology.orchestra.run.smithi107.stdout: socat-1.7.4.1-5.el9.x86_64 2024-06-02T23:47:30.611 INFO:teuthology.orchestra.run.smithi107.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-02T23:47:30.611 INFO:teuthology.orchestra.run.smithi107.stdout: uuid-1.6.2-55.el9.x86_64 2024-06-02T23:47:30.611 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-06-02T23:47:30.611 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-02T23:47:30.611 INFO:teuthology.orchestra.run.smithi107.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-02T23:47:30.611 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-06-02T23:47:30.611 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-06-02T23:47:31.065 DEBUG:teuthology.parallel:result is None 2024-06-02T23:47:31.622 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-02T23:47:31.891 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-02T23:47:31.891 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:47:31.891 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-02T23:47:31.891 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-02T23:47:31.892 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-02T23:47:31.892 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-06-02T23:47:31.892 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-02T23:47:31.892 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 143/170 2024-06-02T23:47:31.892 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 144/170 2024-06-02T23:47:31.892 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 145/170 2024-06-02T23:47:31.892 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-06-02T23:47:31.892 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-06-02T23:47:31.906 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-02T23:47:31.906 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:47:31.907 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-02T23:47:31.907 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-02T23:47:31.907 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-02T23:47:31.907 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-06-02T23:47:32.005 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 148/170 2024-06-02T23:47:32.049 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-06-02T23:47:32.082 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 150/170 2024-06-02T23:47:32.122 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-06-02T23:47:32.151 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 152/170 2024-06-02T23:47:32.189 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 153/170 2024-06-02T23:47:32.364 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-02T23:47:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-02T23:47:32.389 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:47:32.389 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-02T23:47:32.389 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-02T23:47:32.389 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-02T23:47:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-06-02T23:47:32.504 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-06-02T23:47:32.562 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-06-02T23:47:32.626 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-06-02T23:47:32.825 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-06-02T23:47:32.853 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T23:47:32.891 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-06-02T23:47:32.903 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T23:47:32.925 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T23:47:32.973 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-06-02T23:47:33.071 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-06-02T23:47:33.215 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-06-02T23:47:33.274 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-06-02T23:47:33.306 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-06-02T23:47:33.333 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-06-02T23:47:33.780 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-02T23:47:33.806 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-02T23:47:33.825 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 155/170 2024-06-02T23:47:33.839 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 128/170 2024-06-02T23:47:33.904 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 129/170 2024-06-02T23:47:33.916 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-06-02T23:47:33.929 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-02T23:47:33.959 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-06-02T23:47:34.061 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-06-02T23:47:34.095 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-06-02T23:47:34.119 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-02T23:47:34.145 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-06-02T23:47:34.171 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-06-02T23:47:34.171 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-02T23:47:34.247 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-02T23:47:34.280 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-06-02T23:47:34.281 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-02T23:47:34.365 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-02T23:47:34.390 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-06-02T23:47:34.396 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T23:47:34.396 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T23:47:34.583 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T23:47:34.583 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-02T23:47:34.668 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-02T23:47:34.692 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-06-02T23:47:34.761 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-02T23:47:35.024 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-02T23:47:35.064 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-02T23:47:36.085 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-02T23:47:36.114 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-02T23:47:36.223 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-02T23:47:36.393 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 133/170 2024-06-02T23:47:36.416 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-02T23:47:36.440 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-02T23:47:36.441 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:47:36.441 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-02T23:47:36.441 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-02T23:47:36.441 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-02T23:47:36.441 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-06-02T23:47:36.483 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-02T23:47:36.495 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-02T23:47:36.597 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 136/170 2024-06-02T23:47:36.665 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 137/170 2024-06-02T23:47:37.613 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-06-02T23:47:37.652 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-02T23:47:37.676 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-02T23:47:37.677 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:47:37.677 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-02T23:47:37.677 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-02T23:47:37.677 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-02T23:47:37.677 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-06-02T23:47:37.720 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-02T23:47:37.743 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-02T23:47:37.743 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:47:37.743 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-02T23:47:37.743 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-06-02T23:47:37.795 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-02T23:47:37.819 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-02T23:47:37.820 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:47:37.820 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-06-02T23:47:37.820 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-02T23:47:37.820 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-02T23:47:37.820 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-06-02T23:47:38.137 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-02T23:47:38.161 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-02T23:47:38.161 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:47:38.161 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-02T23:47:38.161 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-02T23:47:38.162 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-02T23:47:38.162 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-06-02T23:47:40.198 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-02T23:47:40.198 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 1/170 2024-06-02T23:47:40.198 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2/170 2024-06-02T23:47:40.198 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 3/170 2024-06-02T23:47:40.198 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 4/170 2024-06-02T23:47:40.198 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 5/170 2024-06-02T23:47:40.199 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 6/170 2024-06-02T23:47:40.199 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 7/170 2024-06-02T23:47:40.199 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-02T23:47:40.199 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-02T23:47:40.199 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-02T23:47:40.199 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 11/170 2024-06-02T23:47:40.199 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 12/170 2024-06-02T23:47:40.199 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 13/170 2024-06-02T23:47:40.199 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-02T23:47:40.199 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 15/170 2024-06-02T23:47:40.199 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 16/170 2024-06-02T23:47:40.199 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 17/170 2024-06-02T23:47:40.199 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 18/170 2024-06-02T23:47:40.200 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 19/170 2024-06-02T23:47:40.200 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 20/170 2024-06-02T23:47:40.200 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 21/170 2024-06-02T23:47:40.200 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 22/170 2024-06-02T23:47:40.200 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 23/170 2024-06-02T23:47:40.200 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 24/170 2024-06-02T23:47:40.200 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 25/170 2024-06-02T23:47:40.200 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 26/170 2024-06-02T23:47:40.200 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 27/170 2024-06-02T23:47:40.200 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 28/170 2024-06-02T23:47:40.200 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 29/170 2024-06-02T23:47:40.213 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 30/170 2024-06-02T23:47:40.213 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 31/170 2024-06-02T23:47:40.213 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 32/170 2024-06-02T23:47:40.213 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 33/170 2024-06-02T23:47:40.214 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 34/170 2024-06-02T23:47:40.214 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 35/170 2024-06-02T23:47:40.214 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 36/170 2024-06-02T23:47:40.214 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 37/170 2024-06-02T23:47:40.214 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 38/170 2024-06-02T23:47:40.214 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 39/170 2024-06-02T23:47:40.214 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-06-02T23:47:40.214 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-06-02T23:47:40.214 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-06-02T23:47:40.215 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-06-02T23:47:40.215 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-06-02T23:47:40.215 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-06-02T23:47:40.215 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-06-02T23:47:40.215 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-06-02T23:47:40.215 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-06-02T23:47:40.215 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-06-02T23:47:40.215 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-06-02T23:47:40.215 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-06-02T23:47:40.215 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-06-02T23:47:40.216 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-06-02T23:47:40.216 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-06-02T23:47:40.216 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-06-02T23:47:40.216 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-06-02T23:47:40.216 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-06-02T23:47:40.216 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-06-02T23:47:40.216 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-06-02T23:47:40.216 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-06-02T23:47:40.216 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-06-02T23:47:40.216 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-06-02T23:47:40.216 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-06-02T23:47:40.216 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-06-02T23:47:40.216 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-06-02T23:47:40.216 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-06-02T23:47:40.217 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-06-02T23:47:40.217 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-06-02T23:47:40.217 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-06-02T23:47:40.217 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-06-02T23:47:40.217 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-06-02T23:47:40.217 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-06-02T23:47:40.217 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-06-02T23:47:40.217 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-06-02T23:47:40.217 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-06-02T23:47:40.217 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-06-02T23:47:40.217 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-06-02T23:47:40.217 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-06-02T23:47:40.217 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-06-02T23:47:40.218 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-06-02T23:47:40.218 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-06-02T23:47:40.218 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-06-02T23:47:40.218 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-06-02T23:47:40.218 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-06-02T23:47:40.218 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-06-02T23:47:40.218 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-06-02T23:47:40.218 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-06-02T23:47:40.218 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-06-02T23:47:40.218 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-06-02T23:47:40.218 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-06-02T23:47:40.218 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-06-02T23:47:40.218 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-06-02T23:47:40.218 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-06-02T23:47:40.219 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-06-02T23:47:40.219 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-06-02T23:47:40.219 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-06-02T23:47:40.219 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-06-02T23:47:40.219 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-06-02T23:47:40.219 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-06-02T23:47:40.219 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-06-02T23:47:40.219 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-06-02T23:47:40.219 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-06-02T23:47:40.219 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-06-02T23:47:40.219 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-06-02T23:47:40.219 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-06-02T23:47:40.219 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-06-02T23:47:40.219 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-06-02T23:47:40.220 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-06-02T23:47:40.220 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-06-02T23:47:40.220 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-06-02T23:47:40.220 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-06-02T23:47:40.220 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-06-02T23:47:40.220 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-06-02T23:47:40.220 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-06-02T23:47:40.220 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-06-02T23:47:40.220 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-06-02T23:47:40.220 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-06-02T23:47:40.220 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-06-02T23:47:40.220 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-06-02T23:47:40.220 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-06-02T23:47:40.221 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-06-02T23:47:40.221 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-06-02T23:47:40.221 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-06-02T23:47:40.221 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-06-02T23:47:40.221 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-06-02T23:47:40.221 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-06-02T23:47:40.221 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-06-02T23:47:40.221 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-06-02T23:47:40.221 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-06-02T23:47:40.221 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-06-02T23:47:40.221 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-06-02T23:47:40.221 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-06-02T23:47:40.221 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-06-02T23:47:40.221 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-06-02T23:47:40.222 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-06-02T23:47:40.222 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-06-02T23:47:40.222 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-06-02T23:47:40.222 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-06-02T23:47:40.222 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-06-02T23:47:40.222 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-06-02T23:47:40.222 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-06-02T23:47:40.222 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-06-02T23:47:40.222 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-06-02T23:47:40.222 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-06-02T23:47:40.222 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-06-02T23:47:40.222 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-06-02T23:47:40.223 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-06-02T23:47:40.223 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-06-02T23:47:40.223 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 149/170 2024-06-02T23:47:40.223 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-06-02T23:47:40.223 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 151/170 2024-06-02T23:47:40.223 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-06-02T23:47:40.223 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/170 2024-06-02T23:47:40.223 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-06-02T23:47:40.223 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/170 2024-06-02T23:47:40.223 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-06-02T23:47:40.223 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/170 2024-06-02T23:47:40.223 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-06-02T23:47:40.223 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/170 2024-06-02T23:47:40.223 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-02T23:47:40.224 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-06-02T23:47:40.224 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-06-02T23:47:40.224 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-06-02T23:47:40.224 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-06-02T23:47:40.224 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-06-02T23:47:40.224 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-06-02T23:47:40.224 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-06-02T23:47:40.224 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-06-02T23:47:40.224 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-06-02T23:47:42.949 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 143/170 2024-06-02T23:47:42.991 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 144/170 2024-06-02T23:47:43.034 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 145/170 2024-06-02T23:47:43.063 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-06-02T23:47:43.091 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-06-02T23:47:43.224 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-06-02T23:47:43.224 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:47:43.224 INFO:teuthology.orchestra.run.smithi049.stdout:Upgraded: 2024-06-02T23:47:43.224 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-06-02T23:47:43.224 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-06-02T23:47:43.224 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-06-02T23:47:43.224 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-06-02T23:47:43.224 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-02T23:47:43.225 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-02T23:47:43.225 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-02T23:47:43.225 INFO:teuthology.orchestra.run.smithi049.stdout: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:43.225 INFO:teuthology.orchestra.run.smithi049.stdout: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:43.225 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-06-02T23:47:43.225 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-06-02T23:47:43.225 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-06-02T23:47:43.225 INFO:teuthology.orchestra.run.smithi049.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-02T23:47:43.225 INFO:teuthology.orchestra.run.smithi049.stdout: automake-1.16.2-8.el9.noarch 2024-06-02T23:47:43.225 INFO:teuthology.orchestra.run.smithi049.stdout: bison-3.7.4-5.el9.x86_64 2024-06-02T23:47:43.225 INFO:teuthology.orchestra.run.smithi049.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-02T23:47:43.225 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:43.225 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:43.225 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:43.226 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:43.226 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:47:43.226 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-immutable-object-cache-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:43.226 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:43.226 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:43.226 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:47:43.226 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:47:43.226 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:47:43.226 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:47:43.226 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:47:43.226 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:43.226 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:43.226 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:47:43.227 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:43.227 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:43.227 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:43.227 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:47:43.227 INFO:teuthology.orchestra.run.smithi049.stdout: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:47:43.227 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:43.227 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:43.227 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:47:43.227 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-02T23:47:43.227 INFO:teuthology.orchestra.run.smithi049.stdout: flex-2.6.4-9.el9.x86_64 2024-06-02T23:47:43.227 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-02T23:47:43.227 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-02T23:47:43.227 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-02T23:47:43.228 INFO:teuthology.orchestra.run.smithi049.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-02T23:47:43.228 INFO:teuthology.orchestra.run.smithi049.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-02T23:47:43.228 INFO:teuthology.orchestra.run.smithi049.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-02T23:47:43.228 INFO:teuthology.orchestra.run.smithi049.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-02T23:47:43.228 INFO:teuthology.orchestra.run.smithi049.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-02T23:47:43.228 INFO:teuthology.orchestra.run.smithi049.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-02T23:47:43.228 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:43.228 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:43.228 INFO:teuthology.orchestra.run.smithi049.stdout: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:43.228 INFO:teuthology.orchestra.run.smithi049.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-02T23:47:43.228 INFO:teuthology.orchestra.run.smithi049.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-02T23:47:43.228 INFO:teuthology.orchestra.run.smithi049.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-02T23:47:43.228 INFO:teuthology.orchestra.run.smithi049.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-02T23:47:43.229 INFO:teuthology.orchestra.run.smithi049.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-02T23:47:43.229 INFO:teuthology.orchestra.run.smithi049.stdout: librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:43.229 INFO:teuthology.orchestra.run.smithi049.stdout: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:43.229 INFO:teuthology.orchestra.run.smithi049.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-02T23:47:43.229 INFO:teuthology.orchestra.run.smithi049.stdout: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:43.229 INFO:teuthology.orchestra.run.smithi049.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-02T23:47:43.229 INFO:teuthology.orchestra.run.smithi049.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-02T23:47:43.229 INFO:teuthology.orchestra.run.smithi049.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-02T23:47:43.229 INFO:teuthology.orchestra.run.smithi049.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-02T23:47:43.229 INFO:teuthology.orchestra.run.smithi049.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-02T23:47:43.229 INFO:teuthology.orchestra.run.smithi049.stdout: lua-5.4.4-4.el9.x86_64 2024-06-02T23:47:43.229 INFO:teuthology.orchestra.run.smithi049.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-02T23:47:43.229 INFO:teuthology.orchestra.run.smithi049.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-02T23:47:43.229 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-02T23:47:43.230 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-02T23:47:43.230 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-06-02T23:47:43.230 INFO:teuthology.orchestra.run.smithi049.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-02T23:47:43.230 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-13.14-1.el9.x86_64 2024-06-02T23:47:43.230 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-06-02T23:47:43.230 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-06-02T23:47:43.230 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-server-13.14-1.el9.x86_64 2024-06-02T23:47:43.230 INFO:teuthology.orchestra.run.smithi049.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-02T23:47:43.230 INFO:teuthology.orchestra.run.smithi049.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-02T23:47:43.230 INFO:teuthology.orchestra.run.smithi049.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-02T23:47:43.230 INFO:teuthology.orchestra.run.smithi049.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-06-02T23:47:43.230 INFO:teuthology.orchestra.run.smithi049.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-02T23:47:43.230 INFO:teuthology.orchestra.run.smithi049.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-02T23:47:43.231 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-02T23:47:43.231 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:43.231 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:43.231 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:43.231 INFO:teuthology.orchestra.run.smithi049.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-02T23:47:43.231 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-02T23:47:43.231 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-02T23:47:43.231 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-02T23:47:43.231 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-06-02T23:47:43.231 INFO:teuthology.orchestra.run.smithi049.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-06-02T23:47:43.231 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-02T23:47:43.231 INFO:teuthology.orchestra.run.smithi049.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-02T23:47:43.231 INFO:teuthology.orchestra.run.smithi049.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-06-02T23:47:43.231 INFO:teuthology.orchestra.run.smithi049.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-02T23:47:43.232 INFO:teuthology.orchestra.run.smithi049.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-02T23:47:43.232 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-02T23:47:43.232 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-02T23:47:43.232 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-02T23:47:43.232 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-02T23:47:43.232 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-02T23:47:43.232 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-02T23:47:43.232 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-02T23:47:43.232 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-02T23:47:43.232 INFO:teuthology.orchestra.run.smithi049.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-02T23:47:43.232 INFO:teuthology.orchestra.run.smithi049.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-02T23:47:43.232 INFO:teuthology.orchestra.run.smithi049.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-02T23:47:43.232 INFO:teuthology.orchestra.run.smithi049.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-02T23:47:43.232 INFO:teuthology.orchestra.run.smithi049.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-02T23:47:43.233 INFO:teuthology.orchestra.run.smithi049.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-02T23:47:43.233 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-02T23:47:43.233 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-02T23:47:43.233 INFO:teuthology.orchestra.run.smithi049.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-02T23:47:43.233 INFO:teuthology.orchestra.run.smithi049.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-02T23:47:43.233 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-02T23:47:43.233 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ply-3.11-14.el9.noarch 2024-06-02T23:47:43.233 INFO:teuthology.orchestra.run.smithi049.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-02T23:47:43.233 INFO:teuthology.orchestra.run.smithi049.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-02T23:47:43.233 INFO:teuthology.orchestra.run.smithi049.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-02T23:47:43.233 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-02T23:47:43.233 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-02T23:47:43.233 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-02T23:47:43.233 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-02T23:47:43.233 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-06-02T23:47:43.234 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-02T23:47:43.234 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:43.234 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:43.234 INFO:teuthology.orchestra.run.smithi049.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-02T23:47:43.234 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-02T23:47:43.234 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-02T23:47:43.234 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:43.234 INFO:teuthology.orchestra.run.smithi049.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-02T23:47:43.234 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-02T23:47:43.234 INFO:teuthology.orchestra.run.smithi049.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-02T23:47:43.234 INFO:teuthology.orchestra.run.smithi049.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-02T23:47:43.235 INFO:teuthology.orchestra.run.smithi049.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-02T23:47:43.235 INFO:teuthology.orchestra.run.smithi049.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-02T23:47:43.235 INFO:teuthology.orchestra.run.smithi049.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-02T23:47:43.235 INFO:teuthology.orchestra.run.smithi049.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-06-02T23:47:43.235 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-02T23:47:43.235 INFO:teuthology.orchestra.run.smithi049.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-02T23:47:43.235 INFO:teuthology.orchestra.run.smithi049.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-02T23:47:43.235 INFO:teuthology.orchestra.run.smithi049.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-02T23:47:43.235 INFO:teuthology.orchestra.run.smithi049.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-02T23:47:43.235 INFO:teuthology.orchestra.run.smithi049.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-02T23:47:43.236 INFO:teuthology.orchestra.run.smithi049.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-02T23:47:43.236 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:43.236 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:43.236 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:43.236 INFO:teuthology.orchestra.run.smithi049.stdout: re2-1:20211101-3.el9.x86_64 2024-06-02T23:47:43.236 INFO:teuthology.orchestra.run.smithi049.stdout: socat-1.7.4.1-5.el9.x86_64 2024-06-02T23:47:43.236 INFO:teuthology.orchestra.run.smithi049.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-02T23:47:43.236 INFO:teuthology.orchestra.run.smithi049.stdout: uuid-1.6.2-55.el9.x86_64 2024-06-02T23:47:43.236 INFO:teuthology.orchestra.run.smithi049.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-06-02T23:47:43.236 INFO:teuthology.orchestra.run.smithi049.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-02T23:47:43.237 INFO:teuthology.orchestra.run.smithi049.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-02T23:47:43.237 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:47:43.237 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-06-02T23:47:43.296 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 148/170 2024-06-02T23:47:43.336 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-06-02T23:47:43.369 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 150/170 2024-06-02T23:47:43.409 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-06-02T23:47:43.439 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 152/170 2024-06-02T23:47:43.485 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 153/170 2024-06-02T23:47:43.739 DEBUG:teuthology.parallel:result is None 2024-06-02T23:47:44.128 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T23:47:44.173 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T23:47:44.195 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T23:47:45.124 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 155/170 2024-06-02T23:47:45.219 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-06-02T23:47:45.262 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-06-02T23:47:45.357 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-06-02T23:47:45.389 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-06-02T23:47:45.422 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-02T23:47:45.448 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-06-02T23:47:45.474 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-06-02T23:47:45.474 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-02T23:47:45.559 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-02T23:47:45.592 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-06-02T23:47:45.592 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-02T23:47:45.676 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-02T23:47:45.701 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-06-02T23:47:45.706 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T23:47:45.706 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T23:47:45.894 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T23:47:45.895 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-02T23:47:45.979 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-02T23:47:46.012 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-06-02T23:47:46.078 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-02T23:47:51.482 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-02T23:47:51.482 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 1/170 2024-06-02T23:47:51.482 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2/170 2024-06-02T23:47:51.482 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 3/170 2024-06-02T23:47:51.482 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 4/170 2024-06-02T23:47:51.482 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 5/170 2024-06-02T23:47:51.482 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 6/170 2024-06-02T23:47:51.483 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 7/170 2024-06-02T23:47:51.483 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-02T23:47:51.483 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-02T23:47:51.483 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-02T23:47:51.483 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 11/170 2024-06-02T23:47:51.483 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 12/170 2024-06-02T23:47:51.483 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 13/170 2024-06-02T23:47:51.483 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-02T23:47:51.483 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 15/170 2024-06-02T23:47:51.483 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 16/170 2024-06-02T23:47:51.483 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 17/170 2024-06-02T23:47:51.483 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 18/170 2024-06-02T23:47:51.483 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 19/170 2024-06-02T23:47:51.484 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 20/170 2024-06-02T23:47:51.484 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 21/170 2024-06-02T23:47:51.484 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 22/170 2024-06-02T23:47:51.484 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 23/170 2024-06-02T23:47:51.484 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 24/170 2024-06-02T23:47:51.484 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 25/170 2024-06-02T23:47:51.484 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 26/170 2024-06-02T23:47:51.484 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 27/170 2024-06-02T23:47:51.484 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 28/170 2024-06-02T23:47:51.484 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 29/170 2024-06-02T23:47:51.484 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 30/170 2024-06-02T23:47:51.484 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 31/170 2024-06-02T23:47:51.484 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 32/170 2024-06-02T23:47:51.485 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 33/170 2024-06-02T23:47:51.496 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 34/170 2024-06-02T23:47:51.496 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 35/170 2024-06-02T23:47:51.496 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 36/170 2024-06-02T23:47:51.496 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 37/170 2024-06-02T23:47:51.496 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 38/170 2024-06-02T23:47:51.496 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 39/170 2024-06-02T23:47:51.497 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-06-02T23:47:51.497 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-06-02T23:47:51.497 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-06-02T23:47:51.497 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-06-02T23:47:51.497 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-06-02T23:47:51.497 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-06-02T23:47:51.497 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-06-02T23:47:51.497 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-06-02T23:47:51.497 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-06-02T23:47:51.497 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-06-02T23:47:51.497 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-06-02T23:47:51.497 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-06-02T23:47:51.497 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-06-02T23:47:51.497 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-06-02T23:47:51.497 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-06-02T23:47:51.498 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-06-02T23:47:51.498 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-06-02T23:47:51.498 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-06-02T23:47:51.498 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-06-02T23:47:51.498 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-06-02T23:47:51.498 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-06-02T23:47:51.498 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-06-02T23:47:51.498 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-06-02T23:47:51.498 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-06-02T23:47:51.498 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-06-02T23:47:51.498 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-06-02T23:47:51.498 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-06-02T23:47:51.498 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-06-02T23:47:51.499 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-06-02T23:47:51.499 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-06-02T23:47:51.499 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-06-02T23:47:51.499 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-06-02T23:47:51.499 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-06-02T23:47:51.499 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-06-02T23:47:51.499 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-06-02T23:47:51.499 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-06-02T23:47:51.499 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-06-02T23:47:51.499 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-06-02T23:47:51.499 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-06-02T23:47:51.499 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-06-02T23:47:51.499 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-06-02T23:47:51.499 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-06-02T23:47:51.500 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-06-02T23:47:51.500 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-06-02T23:47:51.500 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-06-02T23:47:51.500 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-06-02T23:47:51.500 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-06-02T23:47:51.500 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-06-02T23:47:51.500 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-06-02T23:47:51.500 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-06-02T23:47:51.500 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-06-02T23:47:51.500 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-06-02T23:47:51.500 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-06-02T23:47:51.500 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-06-02T23:47:51.500 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-06-02T23:47:51.500 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-06-02T23:47:51.501 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-06-02T23:47:51.501 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-06-02T23:47:51.501 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-06-02T23:47:51.501 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-06-02T23:47:51.501 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-06-02T23:47:51.501 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-06-02T23:47:51.501 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-06-02T23:47:51.501 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-06-02T23:47:51.501 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-06-02T23:47:51.501 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-06-02T23:47:51.501 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-06-02T23:47:51.501 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-06-02T23:47:51.501 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-06-02T23:47:51.501 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-06-02T23:47:51.501 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-06-02T23:47:51.502 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-06-02T23:47:51.502 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-06-02T23:47:51.502 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-06-02T23:47:51.502 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-06-02T23:47:51.502 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-06-02T23:47:51.502 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-06-02T23:47:51.502 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-06-02T23:47:51.502 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-06-02T23:47:51.502 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-06-02T23:47:51.502 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-06-02T23:47:51.502 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-06-02T23:47:51.502 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-06-02T23:47:51.502 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-06-02T23:47:51.502 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-06-02T23:47:51.503 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-06-02T23:47:51.503 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-06-02T23:47:51.503 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-06-02T23:47:51.503 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-06-02T23:47:51.503 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-06-02T23:47:51.503 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-06-02T23:47:51.503 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-06-02T23:47:51.503 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-06-02T23:47:51.503 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-06-02T23:47:51.503 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-06-02T23:47:51.503 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-06-02T23:47:51.503 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-06-02T23:47:51.503 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-06-02T23:47:51.503 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-06-02T23:47:51.503 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-06-02T23:47:51.504 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-06-02T23:47:51.504 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-06-02T23:47:51.504 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-06-02T23:47:51.504 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-06-02T23:47:51.504 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-06-02T23:47:51.504 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-06-02T23:47:51.504 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-06-02T23:47:51.504 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-06-02T23:47:51.504 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-06-02T23:47:51.504 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 149/170 2024-06-02T23:47:51.504 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-06-02T23:47:51.504 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 151/170 2024-06-02T23:47:51.504 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-06-02T23:47:51.504 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/170 2024-06-02T23:47:51.505 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-06-02T23:47:51.505 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/170 2024-06-02T23:47:51.505 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-06-02T23:47:51.505 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/170 2024-06-02T23:47:51.505 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-06-02T23:47:51.505 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/170 2024-06-02T23:47:51.505 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-02T23:47:51.505 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-06-02T23:47:51.505 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-06-02T23:47:51.505 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-06-02T23:47:51.505 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-06-02T23:47:51.505 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-06-02T23:47:51.505 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-06-02T23:47:51.505 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-06-02T23:47:51.505 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-06-02T23:47:51.505 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-06-02T23:47:54.287 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-06-02T23:47:54.287 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-06-02T23:47:54.287 INFO:teuthology.orchestra.run.smithi057.stdout:Upgraded: 2024-06-02T23:47:54.287 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-06-02T23:47:54.287 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-06-02T23:47:54.287 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-06-02T23:47:54.287 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-06-02T23:47:54.287 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-02T23:47:54.287 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-02T23:47:54.287 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-02T23:47:54.287 INFO:teuthology.orchestra.run.smithi057.stdout: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:54.287 INFO:teuthology.orchestra.run.smithi057.stdout: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:54.288 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-06-02T23:47:54.288 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-06-02T23:47:54.288 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-06-02T23:47:54.288 INFO:teuthology.orchestra.run.smithi057.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-02T23:47:54.288 INFO:teuthology.orchestra.run.smithi057.stdout: automake-1.16.2-8.el9.noarch 2024-06-02T23:47:54.288 INFO:teuthology.orchestra.run.smithi057.stdout: bison-3.7.4-5.el9.x86_64 2024-06-02T23:47:54.288 INFO:teuthology.orchestra.run.smithi057.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-02T23:47:54.288 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:54.288 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:54.288 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:54.288 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:54.288 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:47:54.288 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-immutable-object-cache-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:54.289 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:54.289 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:54.289 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:47:54.289 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:47:54.289 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:47:54.289 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:47:54.289 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:47:54.289 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:54.289 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:54.289 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:47:54.289 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:54.289 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:54.289 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:54.289 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:47:54.290 INFO:teuthology.orchestra.run.smithi057.stdout: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:47:54.290 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:54.290 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:54.290 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:47:54.290 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-02T23:47:54.290 INFO:teuthology.orchestra.run.smithi057.stdout: flex-2.6.4-9.el9.x86_64 2024-06-02T23:47:54.290 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-02T23:47:54.290 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-02T23:47:54.290 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-02T23:47:54.290 INFO:teuthology.orchestra.run.smithi057.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-02T23:47:54.290 INFO:teuthology.orchestra.run.smithi057.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-02T23:47:54.290 INFO:teuthology.orchestra.run.smithi057.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-02T23:47:54.290 INFO:teuthology.orchestra.run.smithi057.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-02T23:47:54.290 INFO:teuthology.orchestra.run.smithi057.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-02T23:47:54.290 INFO:teuthology.orchestra.run.smithi057.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-02T23:47:54.291 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:54.291 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:54.291 INFO:teuthology.orchestra.run.smithi057.stdout: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:54.291 INFO:teuthology.orchestra.run.smithi057.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-02T23:47:54.291 INFO:teuthology.orchestra.run.smithi057.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-02T23:47:54.291 INFO:teuthology.orchestra.run.smithi057.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-02T23:47:54.291 INFO:teuthology.orchestra.run.smithi057.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-02T23:47:54.291 INFO:teuthology.orchestra.run.smithi057.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-02T23:47:54.291 INFO:teuthology.orchestra.run.smithi057.stdout: librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:54.291 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:54.291 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-02T23:47:54.291 INFO:teuthology.orchestra.run.smithi057.stdout: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:54.291 INFO:teuthology.orchestra.run.smithi057.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-02T23:47:54.291 INFO:teuthology.orchestra.run.smithi057.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-02T23:47:54.291 INFO:teuthology.orchestra.run.smithi057.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-02T23:47:54.292 INFO:teuthology.orchestra.run.smithi057.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-02T23:47:54.292 INFO:teuthology.orchestra.run.smithi057.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-02T23:47:54.292 INFO:teuthology.orchestra.run.smithi057.stdout: lua-5.4.4-4.el9.x86_64 2024-06-02T23:47:54.292 INFO:teuthology.orchestra.run.smithi057.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-02T23:47:54.292 INFO:teuthology.orchestra.run.smithi057.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-02T23:47:54.292 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-02T23:47:54.292 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-02T23:47:54.292 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-06-02T23:47:54.292 INFO:teuthology.orchestra.run.smithi057.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-02T23:47:54.292 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-13.14-1.el9.x86_64 2024-06-02T23:47:54.292 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-06-02T23:47:54.292 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-06-02T23:47:54.292 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-server-13.14-1.el9.x86_64 2024-06-02T23:47:54.292 INFO:teuthology.orchestra.run.smithi057.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-02T23:47:54.293 INFO:teuthology.orchestra.run.smithi057.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-02T23:47:54.293 INFO:teuthology.orchestra.run.smithi057.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-02T23:47:54.293 INFO:teuthology.orchestra.run.smithi057.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-06-02T23:47:54.293 INFO:teuthology.orchestra.run.smithi057.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-02T23:47:54.293 INFO:teuthology.orchestra.run.smithi057.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-02T23:47:54.293 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-02T23:47:54.293 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:54.293 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:54.293 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:54.293 INFO:teuthology.orchestra.run.smithi057.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-02T23:47:54.293 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-02T23:47:54.293 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-02T23:47:54.293 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-02T23:47:54.293 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-06-02T23:47:54.293 INFO:teuthology.orchestra.run.smithi057.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-06-02T23:47:54.293 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-02T23:47:54.294 INFO:teuthology.orchestra.run.smithi057.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-02T23:47:54.294 INFO:teuthology.orchestra.run.smithi057.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-06-02T23:47:54.294 INFO:teuthology.orchestra.run.smithi057.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-02T23:47:54.294 INFO:teuthology.orchestra.run.smithi057.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-02T23:47:54.294 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-02T23:47:54.294 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-02T23:47:54.294 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-02T23:47:54.294 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-02T23:47:54.295 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-02T23:47:54.295 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-02T23:47:54.295 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-02T23:47:54.295 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-02T23:47:54.295 INFO:teuthology.orchestra.run.smithi057.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-02T23:47:54.295 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-02T23:47:54.295 INFO:teuthology.orchestra.run.smithi057.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-02T23:47:54.295 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-02T23:47:54.295 INFO:teuthology.orchestra.run.smithi057.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-02T23:47:54.295 INFO:teuthology.orchestra.run.smithi057.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-02T23:47:54.295 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-02T23:47:54.295 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-02T23:47:54.295 INFO:teuthology.orchestra.run.smithi057.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-02T23:47:54.295 INFO:teuthology.orchestra.run.smithi057.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-02T23:47:54.295 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-02T23:47:54.296 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ply-3.11-14.el9.noarch 2024-06-02T23:47:54.296 INFO:teuthology.orchestra.run.smithi057.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-02T23:47:54.296 INFO:teuthology.orchestra.run.smithi057.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-02T23:47:54.296 INFO:teuthology.orchestra.run.smithi057.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-02T23:47:54.296 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-02T23:47:54.296 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-02T23:47:54.296 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-02T23:47:54.296 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-02T23:47:54.296 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-06-02T23:47:54.296 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-02T23:47:54.296 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:54.296 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:54.296 INFO:teuthology.orchestra.run.smithi057.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-02T23:47:54.296 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-02T23:47:54.296 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-02T23:47:54.296 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:54.297 INFO:teuthology.orchestra.run.smithi057.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-02T23:47:54.297 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-02T23:47:54.297 INFO:teuthology.orchestra.run.smithi057.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-02T23:47:54.297 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-02T23:47:54.297 INFO:teuthology.orchestra.run.smithi057.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-02T23:47:54.297 INFO:teuthology.orchestra.run.smithi057.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-02T23:47:54.297 INFO:teuthology.orchestra.run.smithi057.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-02T23:47:54.297 INFO:teuthology.orchestra.run.smithi057.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-06-02T23:47:54.297 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-02T23:47:54.297 INFO:teuthology.orchestra.run.smithi057.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-02T23:47:54.297 INFO:teuthology.orchestra.run.smithi057.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-02T23:47:54.297 INFO:teuthology.orchestra.run.smithi057.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-02T23:47:54.297 INFO:teuthology.orchestra.run.smithi057.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-02T23:47:54.297 INFO:teuthology.orchestra.run.smithi057.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-02T23:47:54.297 INFO:teuthology.orchestra.run.smithi057.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-02T23:47:54.297 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:54.298 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:54.298 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:47:54.298 INFO:teuthology.orchestra.run.smithi057.stdout: re2-1:20211101-3.el9.x86_64 2024-06-02T23:47:54.298 INFO:teuthology.orchestra.run.smithi057.stdout: socat-1.7.4.1-5.el9.x86_64 2024-06-02T23:47:54.298 INFO:teuthology.orchestra.run.smithi057.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-02T23:47:54.298 INFO:teuthology.orchestra.run.smithi057.stdout: uuid-1.6.2-55.el9.x86_64 2024-06-02T23:47:54.298 INFO:teuthology.orchestra.run.smithi057.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-06-02T23:47:54.298 INFO:teuthology.orchestra.run.smithi057.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-02T23:47:54.298 INFO:teuthology.orchestra.run.smithi057.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-02T23:47:54.299 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-06-02T23:47:54.299 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-06-02T23:47:54.692 DEBUG:teuthology.parallel:result is None 2024-06-02T23:47:54.692 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T23:47:54.834 DEBUG:teuthology.orchestra.run.smithi049:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-02T23:47:54.861 INFO:teuthology.orchestra.run.smithi049.stdout:19.0.0-2946.g3d89accf.el9 2024-06-02T23:47:54.861 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2946.g3d89accf.el9 2024-06-02T23:47:54.861 INFO:teuthology.task.install:The correct ceph version 19.0.0-2946.g3d89accf is installed. 2024-06-02T23:47:54.863 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T23:47:55.001 DEBUG:teuthology.orchestra.run.smithi057:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-02T23:47:55.023 INFO:teuthology.orchestra.run.smithi057.stdout:19.0.0-2946.g3d89accf.el9 2024-06-02T23:47:55.023 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2946.g3d89accf.el9 2024-06-02T23:47:55.023 INFO:teuthology.task.install:The correct ceph version 19.0.0-2946.g3d89accf is installed. 2024-06-02T23:47:55.025 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T23:47:55.236 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-02T23:47:55.261 INFO:teuthology.orchestra.run.smithi107.stdout:19.0.0-2946.g3d89accf.el9 2024-06-02T23:47:55.261 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2946.g3d89accf.el9 2024-06-02T23:47:55.262 INFO:teuthology.task.install:The correct ceph version 19.0.0-2946.g3d89accf is installed. 2024-06-02T23:47:55.266 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-06-02T23:47:55.266 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-06-02T23:47:55.266 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-02T23:47:55.299 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-06-02T23:47:55.299 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-02T23:47:55.328 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-06-02T23:47:55.328 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-02T23:47:55.358 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-06-02T23:47:55.359 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-06-02T23:47:55.359 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/daemon-helper 2024-06-02T23:47:55.389 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-02T23:47:55.459 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-06-02T23:47:55.459 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/daemon-helper 2024-06-02T23:47:55.485 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-02T23:47:55.552 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-06-02T23:47:55.552 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/daemon-helper 2024-06-02T23:47:55.581 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-02T23:47:55.648 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-06-02T23:47:55.648 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-06-02T23:47:55.648 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-02T23:47:55.681 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-02T23:47:55.751 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-06-02T23:47:55.751 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-02T23:47:55.779 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-02T23:47:55.848 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-06-02T23:47:55.848 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-02T23:47:55.872 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-02T23:47:55.935 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-06-02T23:47:55.935 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-06-02T23:47:55.935 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/stdin-killer 2024-06-02T23:47:55.961 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-02T23:47:56.027 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-06-02T23:47:56.027 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/stdin-killer 2024-06-02T23:47:56.056 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-02T23:47:56.125 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-06-02T23:47:56.125 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/stdin-killer 2024-06-02T23:47:56.150 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-02T23:47:56.214 INFO:teuthology.run_tasks:Running task cephadm... 2024-06-02T23:47:56.297 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-06-02T23:47:56.297 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T23:47:56.298 INFO:tasks.cephadm:Cluster fsid is 890dd222-213a-11ef-bc9b-c7b262605968 2024-06-02T23:47:56.298 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-06-02T23:47:56.298 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.49', 'mon.b': '172.21.15.57', 'mon.c': '172.21.15.107'} 2024-06-02T23:47:56.298 INFO:tasks.cephadm:First mon is mon.a on smithi049 2024-06-02T23:47:56.298 INFO:tasks.cephadm:First mgr is x 2024-06-02T23:47:56.298 INFO:tasks.cephadm:Normalizing hostnames... 2024-06-02T23:47:56.298 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname $(hostname -s) 2024-06-02T23:47:56.325 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname $(hostname -s) 2024-06-02T23:47:56.355 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname $(hostname -s) 2024-06-02T23:47:56.378 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-06-02T23:47:56.379 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T23:47:56.591 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/55273/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-2946-g3d89accf', 'node_name': '172.21.2.14+braggi14', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-2946.g3d89accf'}, 'url': 'https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-05-30 17:04:17.570799', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-06-02T23:47:56.729 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref squid, sha1 3d89accfe3201286f000e065a1faea2a88c7a6ba from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T23:47:56.730 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/x86_64/flavors/default/cephadm 2024-06-02T23:47:56.731 DEBUG:teuthology.orchestra.run.smithi049:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-06-02T23:47:57.157 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r--. 1 ubuntu ubuntu 781907 Jun 2 23:47 /home/ubuntu/cephtest/cephadm 2024-06-02T23:47:57.157 DEBUG:teuthology.orchestra.run.smithi057:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-06-02T23:47:57.580 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r--. 1 ubuntu ubuntu 781907 Jun 2 23:47 /home/ubuntu/cephtest/cephadm 2024-06-02T23:47:57.580 DEBUG:teuthology.orchestra.run.smithi107:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-06-02T23:47:58.030 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r--. 1 ubuntu ubuntu 781907 Jun 2 23:47 /home/ubuntu/cephtest/cephadm 2024-06-02T23:47:58.030 DEBUG:teuthology.orchestra.run.smithi049:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-06-02T23:47:58.051 DEBUG:teuthology.orchestra.run.smithi057:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-06-02T23:47:58.070 DEBUG:teuthology.orchestra.run.smithi107:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-06-02T23:47:58.104 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba on all hosts... 2024-06-02T23:47:58.105 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba pull 2024-06-02T23:47:58.107 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba pull 2024-06-02T23:47:58.113 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba pull 2024-06-02T23:47:58.902 INFO:teuthology.orchestra.run.smithi057.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba... 2024-06-02T23:47:58.917 INFO:teuthology.orchestra.run.smithi107.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba... 2024-06-02T23:47:59.031 INFO:teuthology.orchestra.run.smithi049.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba... 2024-06-02T23:48:33.087 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-02T23:48:33.087 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-02T23:48:33.087 INFO:teuthology.orchestra.run.smithi049.stdout: "image_id": "b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1", 2024-06-02T23:48:33.088 INFO:teuthology.orchestra.run.smithi049.stdout: "repo_digests": [ 2024-06-02T23:48:33.088 INFO:teuthology.orchestra.run.smithi049.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9" 2024-06-02T23:48:33.088 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-06-02T23:48:33.088 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-02T23:48:40.969 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-06-02T23:48:40.969 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-02T23:48:40.969 INFO:teuthology.orchestra.run.smithi057.stdout: "image_id": "b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1", 2024-06-02T23:48:40.969 INFO:teuthology.orchestra.run.smithi057.stdout: "repo_digests": [ 2024-06-02T23:48:40.969 INFO:teuthology.orchestra.run.smithi057.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9" 2024-06-02T23:48:40.970 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-06-02T23:48:40.970 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-06-02T23:48:43.899 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-06-02T23:48:43.899 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-02T23:48:43.899 INFO:teuthology.orchestra.run.smithi107.stdout: "image_id": "b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1", 2024-06-02T23:48:43.899 INFO:teuthology.orchestra.run.smithi107.stdout: "repo_digests": [ 2024-06-02T23:48:43.900 INFO:teuthology.orchestra.run.smithi107.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9" 2024-06-02T23:48:43.900 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-06-02T23:48:43.900 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-06-02T23:48:43.925 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /etc/ceph 2024-06-02T23:48:43.959 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /etc/ceph 2024-06-02T23:48:43.992 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /etc/ceph 2024-06-02T23:48:44.020 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 777 /etc/ceph 2024-06-02T23:48:44.050 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 777 /etc/ceph 2024-06-02T23:48:44.078 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 777 /etc/ceph 2024-06-02T23:48:44.102 INFO:tasks.cephadm:Writing seed config... 2024-06-02T23:48:44.103 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-06-02T23:48:44.103 INFO:tasks.cephadm: override: [client] debug client = 20 2024-06-02T23:48:44.103 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-06-02T23:48:44.103 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-06-02T23:48:44.104 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-06-02T23:48:44.104 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-06-02T23:48:44.104 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-06-02T23:48:44.104 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-06-02T23:48:44.104 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-06-02T23:48:44.104 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-06-02T23:48:44.104 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-06-02T23:48:44.104 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-06-02T23:48:44.104 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-06-02T23:48:44.104 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-06-02T23:48:44.104 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-06-02T23:48:44.104 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-06-02T23:48:44.104 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-06-02T23:48:44.104 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-06-02T23:48:44.104 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-06-02T23:48:44.105 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-06-02T23:48:44.105 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-06-02T23:48:44.105 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-06-02T23:48:44.105 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-06-02T23:48:44.105 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-06-02T23:48:44.105 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-06-02T23:48:44.105 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-06-02T23:48:44.105 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-06-02T23:48:44.105 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-06-02T23:48:44.105 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-06-02T23:48:44.105 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-06-02T23:48:44.105 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-06-02T23:48:44.105 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-06-02T23:48:44.105 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-06-02T23:48:44.105 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-06-02T23:48:44.106 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-06-02T23:48:44.106 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-06-02T23:48:44.106 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-06-02T23:48:44.106 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-06-02T23:48:44.106 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-06-02T23:48:44.106 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-06-02T23:48:44.106 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-06-02T23:48:44.106 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-06-02T23:48:44.106 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-06-02T23:48:44.106 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-06-02T23:48:44.106 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-06-02T23:48:44.106 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-06-02T23:48:44.106 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-06-02T23:48:44.107 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-06-02T23:48:44.107 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-06-02T23:48:44.126 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 890dd222-213a-11ef-bc9b-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-06-02T23:48:44.126 DEBUG:teuthology.orchestra.run.smithi049:mon.a> sudo journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mon.a.service 2024-06-02T23:48:44.169 DEBUG:teuthology.orchestra.run.smithi049:mgr.x> sudo journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mgr.x.service 2024-06-02T23:48:44.211 INFO:tasks.cephadm:Bootstrapping... 2024-06-02T23:48:44.212 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba -v bootstrap --fsid 890dd222-213a-11ef-bc9b-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.49 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-06-02T23:48:44.415 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:48:44.416 INFO:teuthology.orchestra.run.smithi049.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba', '-v', 'bootstrap', '--fsid', '890dd222-213a-11ef-bc9b-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.49', '--skip-admin-label'] 2024-06-02T23:48:44.416 INFO:teuthology.orchestra.run.smithi049.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-06-02T23:48:44.416 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying podman|docker is present... 2024-06-02T23:48:44.442 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stdout 5.0.2 2024-06-02T23:48:44.442 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying lvm2 is present... 2024-06-02T23:48:44.442 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying time synchronization is in place... 2024-06-02T23:48:44.449 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-06-02T23:48:44.449 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-06-02T23:48:44.455 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-06-02T23:48:44.455 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout inactive 2024-06-02T23:48:44.462 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout enabled 2024-06-02T23:48:44.468 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout active 2024-06-02T23:48:44.469 INFO:teuthology.orchestra.run.smithi049.stdout:Unit chronyd.service is enabled and running 2024-06-02T23:48:44.469 INFO:teuthology.orchestra.run.smithi049.stdout:Repeating the final host check... 2024-06-02T23:48:44.493 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stdout 5.0.2 2024-06-02T23:48:44.493 INFO:teuthology.orchestra.run.smithi049.stdout:podman (/bin/podman) version 5.0.2 is present 2024-06-02T23:48:44.493 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl is present 2024-06-02T23:48:44.493 INFO:teuthology.orchestra.run.smithi049.stdout:lvcreate is present 2024-06-02T23:48:44.499 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-06-02T23:48:44.500 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-06-02T23:48:44.506 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-06-02T23:48:44.506 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout inactive 2024-06-02T23:48:44.513 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout enabled 2024-06-02T23:48:44.519 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout active 2024-06-02T23:48:44.519 INFO:teuthology.orchestra.run.smithi049.stdout:Unit chronyd.service is enabled and running 2024-06-02T23:48:44.519 INFO:teuthology.orchestra.run.smithi049.stdout:Host looks OK 2024-06-02T23:48:44.519 INFO:teuthology.orchestra.run.smithi049.stdout:Cluster fsid: 890dd222-213a-11ef-bc9b-c7b262605968 2024-06-02T23:48:44.520 INFO:teuthology.orchestra.run.smithi049.stdout:Acquiring lock 140075888551296 on /run/cephadm/890dd222-213a-11ef-bc9b-c7b262605968.lock 2024-06-02T23:48:44.520 INFO:teuthology.orchestra.run.smithi049.stdout:Lock 140075888551296 acquired on /run/cephadm/890dd222-213a-11ef-bc9b-c7b262605968.lock 2024-06-02T23:48:44.520 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying IP 172.21.15.49 port 3300 ... 2024-06-02T23:48:44.520 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying IP 172.21.15.49 port 6789 ... 2024-06-02T23:48:44.520 INFO:teuthology.orchestra.run.smithi049.stdout:Base mon IP(s) is [172.21.15.49:3300, 172.21.15.49:6789], mon addrv is [v2:172.21.15.49:3300,v1:172.21.15.49:6789] 2024-06-02T23:48:44.524 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.49 metric 100 2024-06-02T23:48:44.524 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.49 metric 100 2024-06-02T23:48:44.527 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-06-02T23:48:44.527 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-06-02T23:48:44.527 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-06-02T23:48:44.529 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-06-02T23:48:44.529 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-06-02T23:48:44.529 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-06-02T23:48:44.530 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-06-02T23:48:44.530 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1566/64 scope link noprefixroute 2024-06-02T23:48:44.530 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-06-02T23:48:44.530 INFO:teuthology.orchestra.run.smithi049.stdout:Mon IP `172.21.15.49` is in CIDR network `172.21.0.0/20` 2024-06-02T23:48:44.530 INFO:teuthology.orchestra.run.smithi049.stdout:Mon IP `172.21.15.49` is in CIDR network `172.21.0.0/20` 2024-06-02T23:48:44.530 INFO:teuthology.orchestra.run.smithi049.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-06-02T23:48:44.531 INFO:teuthology.orchestra.run.smithi049.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-06-02T23:48:44.532 INFO:teuthology.orchestra.run.smithi049.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba... 2024-06-02T23:48:45.014 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stdout b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 2024-06-02T23:48:45.014 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba... 2024-06-02T23:48:45.014 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stderr Getting image source signatures 2024-06-02T23:48:45.014 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stderr Copying blob sha256:53b2d4191269e9d20972bfa652565296fad6514cf6a3d99f19db644875f67876 2024-06-02T23:48:45.014 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stderr Copying blob sha256:3ca969c7b6d79946c6f10490fffc00028babe7df67f50ed53c7bc209325e0612 2024-06-02T23:48:45.014 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stderr Copying config sha256:b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 2024-06-02T23:48:45.014 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stderr Writing manifest to image destination 2024-06-02T23:48:46.069 INFO:teuthology.orchestra.run.smithi049.stdout:ceph: stdout ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc) 2024-06-02T23:48:46.069 INFO:teuthology.orchestra.run.smithi049.stdout:Ceph version: ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc) 2024-06-02T23:48:46.069 INFO:teuthology.orchestra.run.smithi049.stdout:Extracting ceph user uid/gid from container image... 2024-06-02T23:48:47.048 INFO:teuthology.orchestra.run.smithi049.stdout:stat: stdout 167 167 2024-06-02T23:48:47.048 INFO:teuthology.orchestra.run.smithi049.stdout:Creating initial keys... 2024-06-02T23:48:48.004 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-authtool: stdout AQDfBF1mSi75GBAASGtWU3V3NdESaiMfFHg4Gg== 2024-06-02T23:48:49.026 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-authtool: stdout AQDgBF1mXxxSFBAAi9aCNZssMxa4Xpu+jqxN/Q== 2024-06-02T23:48:50.081 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-authtool: stdout AQDhBF1mZrEmFxAAlhtq9S9s/p34P/KHjjw1ew== 2024-06-02T23:48:50.082 INFO:teuthology.orchestra.run.smithi049.stdout:Creating initial monmap... 2024-06-02T23:48:50.947 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-06-02T23:48:50.947 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-06-02T23:48:50.947 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 890dd222-213a-11ef-bc9b-c7b262605968 2024-06-02T23:48:50.947 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-06-02T23:48:50.947 INFO:teuthology.orchestra.run.smithi049.stdout:monmaptool for a [v2:172.21.15.49:3300,v1:172.21.15.49:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-06-02T23:48:50.947 INFO:teuthology.orchestra.run.smithi049.stdout:setting min_mon_release = quincy 2024-06-02T23:48:50.947 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/monmaptool: set fsid to 890dd222-213a-11ef-bc9b-c7b262605968 2024-06-02T23:48:50.947 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-06-02T23:48:50.947 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:48:50.947 INFO:teuthology.orchestra.run.smithi049.stdout:Creating mon... 2024-06-02T23:48:51.894 INFO:teuthology.orchestra.run.smithi049.stdout:create mon.a on 2024-06-02T23:48:52.120 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-06-02T23:48:52.269 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-06-02T23:48:52.458 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-890dd222-213a-11ef-bc9b-c7b262605968.target → /etc/systemd/system/ceph-890dd222-213a-11ef-bc9b-c7b262605968.target. 2024-06-02T23:48:52.458 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-890dd222-213a-11ef-bc9b-c7b262605968.target → /etc/systemd/system/ceph-890dd222-213a-11ef-bc9b-c7b262605968.target. 2024-06-02T23:48:52.689 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-890dd222-213a-11ef-bc9b-c7b262605968@mon.a 2024-06-02T23:48:52.690 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Failed to reset failed state of unit ceph-890dd222-213a-11ef-bc9b-c7b262605968@mon.a.service: Unit ceph-890dd222-213a-11ef-bc9b-c7b262605968@mon.a.service not loaded. 2024-06-02T23:48:52.849 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-890dd222-213a-11ef-bc9b-c7b262605968.target.wants/ceph-890dd222-213a-11ef-bc9b-c7b262605968@mon.a.service → /etc/systemd/system/ceph-890dd222-213a-11ef-bc9b-c7b262605968@.service. 2024-06-02T23:48:53.376 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-02T23:48:53.377 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout disabled 2024-06-02T23:48:53.384 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-02T23:48:53.384 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout inactive 2024-06-02T23:48:53.384 INFO:teuthology.orchestra.run.smithi049.stdout:firewalld.service is not enabled 2024-06-02T23:48:53.384 INFO:teuthology.orchestra.run.smithi049.stdout:Not possible to enable service . firewalld.service is not available 2024-06-02T23:48:53.385 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for mon to start... 2024-06-02T23:48:53.385 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for mon... 2024-06-02T23:48:54.519 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout cluster: 2024-06-02T23:48:54.519 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout id: 890dd222-213a-11ef-bc9b-c7b262605968 2024-06-02T23:48:54.519 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-06-02T23:48:54.519 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-06-02T23:48:54.519 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout services: 2024-06-02T23:48:54.519 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.586981s) 2024-06-02T23:48:54.519 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-06-02T23:48:54.519 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-06-02T23:48:54.520 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-06-02T23:48:54.520 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout data: 2024-06-02T23:48:54.520 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-06-02T23:48:54.520 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-06-02T23:48:54.520 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-06-02T23:48:54.520 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout pgs: 2024-06-02T23:48:54.520 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-06-02T23:48:54.520 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.827+0000 7fabbd4e6700 1 Processor -- start 2024-06-02T23:48:54.520 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.827+0000 7fabbd4e6700 1 -- start start 2024-06-02T23:48:54.520 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.827+0000 7fabbd4e6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabb81089d0 0x7fabb810adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:48:54.520 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.827+0000 7fabbd4e6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fabb807bde0 con 0x7fabb81089d0 2024-06-02T23:48:54.521 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.827+0000 7fabb6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabb81089d0 0x7fabb810adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:48:54.521 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.827+0000 7fabb6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabb81089d0 0x7fabb810adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58344/0 (socket says 172.21.15.49:58344) 2024-06-02T23:48:54.521 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.827+0000 7fabb6ffd700 1 -- 172.21.15.49:0/3676419691 learned_addr learned my addr 172.21.15.49:0/3676419691 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:48:54.521 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.828+0000 7fabb6ffd700 1 -- 172.21.15.49:0/3676419691 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb810b300 con 0x7fabb81089d0 2024-06-02T23:48:54.521 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.828+0000 7fabb6ffd700 1 --2- 172.21.15.49:0/3676419691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabb81089d0 0x7fabb810adc0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7faba80098a0 tx=0x7faba8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c9579be20b8dbf server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:48:54.521 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.828+0000 7fabb5ffb700 1 -- 172.21.15.49:0/3676419691 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faba8004160 con 0x7fabb81089d0 2024-06-02T23:48:54.521 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.828+0000 7fabb5ffb700 1 -- 172.21.15.49:0/3676419691 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faba8004300 con 0x7fabb81089d0 2024-06-02T23:48:54.521 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.828+0000 7fabb5ffb700 1 -- 172.21.15.49:0/3676419691 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faba80036a0 con 0x7fabb81089d0 2024-06-02T23:48:54.521 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.829+0000 7fabbd4e6700 1 -- 172.21.15.49:0/3676419691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabb81089d0 msgr2=0x7fabb810adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:48:54.521 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.829+0000 7fabbd4e6700 1 --2- 172.21.15.49:0/3676419691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabb81089d0 0x7fabb810adc0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7faba80098a0 tx=0x7faba8009bb0 comp rx=0 tx=0).stop 2024-06-02T23:48:54.522 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.829+0000 7fabbd4e6700 1 -- 172.21.15.49:0/3676419691 shutdown_connections 2024-06-02T23:48:54.522 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.829+0000 7fabbd4e6700 1 --2- 172.21.15.49:0/3676419691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabb81089d0 0x7fabb810adc0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:48:54.522 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.829+0000 7fabbd4e6700 1 -- 172.21.15.49:0/3676419691 >> 172.21.15.49:0/3676419691 conn(0x7fabb81023e0 msgr2=0x7fabb8104800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:48:54.522 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.829+0000 7fabbd4e6700 1 -- 172.21.15.49:0/3676419691 shutdown_connections 2024-06-02T23:48:54.522 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.829+0000 7fabbd4e6700 1 -- 172.21.15.49:0/3676419691 wait complete. 2024-06-02T23:48:54.522 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.829+0000 7fabbd4e6700 1 Processor -- start 2024-06-02T23:48:54.522 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.830+0000 7fabbd4e6700 1 -- start start 2024-06-02T23:48:54.522 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.830+0000 7fabbd4e6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabb81089d0 0x7fabb8108250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:48:54.522 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.830+0000 7fabbd4e6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fabb810b770 con 0x7fabb81089d0 2024-06-02T23:48:54.522 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.830+0000 7fabb6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabb81089d0 0x7fabb8108250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:48:54.523 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.830+0000 7fabb6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabb81089d0 0x7fabb8108250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58354/0 (socket says 172.21.15.49:58354) 2024-06-02T23:48:54.523 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.830+0000 7fabb6ffd700 1 -- 172.21.15.49:0/1355081210 learned_addr learned my addr 172.21.15.49:0/1355081210 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:48:54.523 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.830+0000 7fabb6ffd700 1 -- 172.21.15.49:0/1355081210 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb8108790 con 0x7fabb81089d0 2024-06-02T23:48:54.523 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.830+0000 7fabb6ffd700 1 --2- 172.21.15.49:0/1355081210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabb81089d0 0x7fabb8108250 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7faba8000c00 tx=0x7faba8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:48:54.523 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.830+0000 7fab9ffff700 1 -- 172.21.15.49:0/1355081210 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faba8003db0 con 0x7fabb81089d0 2024-06-02T23:48:54.523 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.830+0000 7fab9ffff700 1 -- 172.21.15.49:0/1355081210 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faba8011630 con 0x7fabb81089d0 2024-06-02T23:48:54.523 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.830+0000 7fab9ffff700 1 -- 172.21.15.49:0/1355081210 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faba8011950 con 0x7fabb81089d0 2024-06-02T23:48:54.523 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.830+0000 7fabbd4e6700 1 -- 172.21.15.49:0/1355081210 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabb8106980 con 0x7fabb81089d0 2024-06-02T23:48:54.523 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.831+0000 7fabbd4e6700 1 -- 172.21.15.49:0/1355081210 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabb8106e00 con 0x7fabb81089d0 2024-06-02T23:48:54.523 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.831+0000 7fab9ffff700 1 -- 172.21.15.49:0/1355081210 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faba8011af0 con 0x7fabb81089d0 2024-06-02T23:48:54.523 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.831+0000 7fab9ffff700 1 -- 172.21.15.49:0/1355081210 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7faba801c450 con 0x7fabb81089d0 2024-06-02T23:48:54.524 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.832+0000 7fabbd4e6700 1 -- 172.21.15.49:0/1355081210 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabb8063af0 con 0x7fabb81089d0 2024-06-02T23:48:54.524 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.834+0000 7fab9ffff700 1 -- 172.21.15.49:0/1355081210 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7faba8032020 con 0x7fabb81089d0 2024-06-02T23:48:54.524 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.909+0000 7fabbd4e6700 1 -- 172.21.15.49:0/1355081210 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fabb8194c80 con 0x7fabb81089d0 2024-06-02T23:48:54.524 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.909+0000 7fab9ffff700 1 -- 172.21.15.49:0/1355081210 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7faba8004260 con 0x7fabb81089d0 2024-06-02T23:48:54.524 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.910+0000 7fabbd4e6700 1 -- 172.21.15.49:0/1355081210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabb81089d0 msgr2=0x7fabb8108250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:48:54.524 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.910+0000 7fabbd4e6700 1 --2- 172.21.15.49:0/1355081210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabb81089d0 0x7fabb8108250 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7faba8000c00 tx=0x7faba8004750 comp rx=0 tx=0).stop 2024-06-02T23:48:54.524 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.910+0000 7fabbd4e6700 1 -- 172.21.15.49:0/1355081210 shutdown_connections 2024-06-02T23:48:54.524 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.910+0000 7fabbd4e6700 1 --2- 172.21.15.49:0/1355081210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabb81089d0 0x7fabb8108250 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:48:54.524 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.910+0000 7fabbd4e6700 1 -- 172.21.15.49:0/1355081210 >> 172.21.15.49:0/1355081210 conn(0x7fabb81023e0 msgr2=0x7fabb8104710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:48:54.525 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.910+0000 7fabbd4e6700 1 -- 172.21.15.49:0/1355081210 shutdown_connections 2024-06-02T23:48:54.525 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:53.910+0000 7fabbd4e6700 1 -- 172.21.15.49:0/1355081210 wait complete. 2024-06-02T23:48:54.525 INFO:teuthology.orchestra.run.smithi049.stdout:mon is available 2024-06-02T23:48:54.525 INFO:teuthology.orchestra.run.smithi049.stdout:Assimilating anything we can from ceph.conf... 2024-06-02T23:48:55.608 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-06-02T23:48:55.609 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout [global] 2024-06-02T23:48:55.609 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout fsid = 890dd222-213a-11ef-bc9b-c7b262605968 2024-06-02T23:48:55.609 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.49:3300,v1:172.21.15.49:6789] 2024-06-02T23:48:55.609 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-06-02T23:48:55.609 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-06-02T23:48:55.609 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-06-02T23:48:55.609 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-06-02T23:48:55.609 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-06-02T23:48:55.609 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout [mgr] 2024-06-02T23:48:55.609 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-06-02T23:48:55.609 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-06-02T23:48:55.610 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout [osd] 2024-06-02T23:48:55.610 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-06-02T23:48:55.610 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-06-02T23:48:55.610 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-06-02T23:48:55.610 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-06-02T23:48:55.610 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-06-02T23:48:55.610 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.964+0000 7fc8204e3700 1 Processor -- start 2024-06-02T23:48:55.610 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.964+0000 7fc8204e3700 1 -- start start 2024-06-02T23:48:55.610 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.964+0000 7fc8204e3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc81807dd90 0x7fc81807c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:48:55.610 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.964+0000 7fc8204e3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc81807c7d0 con 0x7fc81807dd90 2024-06-02T23:48:55.610 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.965+0000 7fc81e27f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc81807dd90 0x7fc81807c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:48:55.610 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.965+0000 7fc81e27f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc81807dd90 0x7fc81807c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58362/0 (socket says 172.21.15.49:58362) 2024-06-02T23:48:55.610 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.965+0000 7fc81e27f700 1 -- 172.21.15.49:0/1150230195 learned_addr learned my addr 172.21.15.49:0/1150230195 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:48:55.611 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.965+0000 7fc81e27f700 1 -- 172.21.15.49:0/1150230195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc81807c950 con 0x7fc81807dd90 2024-06-02T23:48:55.611 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.965+0000 7fc81e27f700 1 --2- 172.21.15.49:0/1150230195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc81807dd90 0x7fc81807c290 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fc8140098a0 tx=0x7fc814009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ed141567cf8954 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:48:55.611 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.965+0000 7fc81d27d700 1 -- 172.21.15.49:0/1150230195 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc814004160 con 0x7fc81807dd90 2024-06-02T23:48:55.611 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.965+0000 7fc81d27d700 1 -- 172.21.15.49:0/1150230195 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc814004300 con 0x7fc81807dd90 2024-06-02T23:48:55.611 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.965+0000 7fc81d27d700 1 -- 172.21.15.49:0/1150230195 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8140036a0 con 0x7fc81807dd90 2024-06-02T23:48:55.611 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.966+0000 7fc8204e3700 1 -- 172.21.15.49:0/1150230195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc81807dd90 msgr2=0x7fc81807c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:48:55.611 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.966+0000 7fc8204e3700 1 --2- 172.21.15.49:0/1150230195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc81807dd90 0x7fc81807c290 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fc8140098a0 tx=0x7fc814009bb0 comp rx=0 tx=0).stop 2024-06-02T23:48:55.611 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.966+0000 7fc8204e3700 1 -- 172.21.15.49:0/1150230195 shutdown_connections 2024-06-02T23:48:55.611 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.966+0000 7fc8204e3700 1 --2- 172.21.15.49:0/1150230195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc81807dd90 0x7fc81807c290 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:48:55.611 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.966+0000 7fc8204e3700 1 -- 172.21.15.49:0/1150230195 >> 172.21.15.49:0/1150230195 conn(0x7fc818103550 msgr2=0x7fc818105990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:48:55.611 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.966+0000 7fc8204e3700 1 -- 172.21.15.49:0/1150230195 shutdown_connections 2024-06-02T23:48:55.611 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.966+0000 7fc8204e3700 1 -- 172.21.15.49:0/1150230195 wait complete. 2024-06-02T23:48:55.611 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.967+0000 7fc8204e3700 1 Processor -- start 2024-06-02T23:48:55.612 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.967+0000 7fc8204e3700 1 -- start start 2024-06-02T23:48:55.612 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.967+0000 7fc8204e3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc81807dd90 0x7fc81819d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:48:55.612 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.967+0000 7fc8204e3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc81807ce80 con 0x7fc81807dd90 2024-06-02T23:48:55.612 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.967+0000 7fc81e27f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc81807dd90 0x7fc81819d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:48:55.612 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.967+0000 7fc81e27f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc81807dd90 0x7fc81819d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58364/0 (socket says 172.21.15.49:58364) 2024-06-02T23:48:55.612 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.967+0000 7fc81e27f700 1 -- 172.21.15.49:0/1722697738 learned_addr learned my addr 172.21.15.49:0/1722697738 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:48:55.612 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.967+0000 7fc81e27f700 1 -- 172.21.15.49:0/1722697738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc81819dd40 con 0x7fc81807dd90 2024-06-02T23:48:55.612 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.967+0000 7fc81e27f700 1 --2- 172.21.15.49:0/1722697738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc81807dd90 0x7fc81819d800 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc814000c00 tx=0x7fc814004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:48:55.612 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.967+0000 7fc80f7fe700 1 -- 172.21.15.49:0/1722697738 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc814003db0 con 0x7fc81807dd90 2024-06-02T23:48:55.612 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.967+0000 7fc80f7fe700 1 -- 172.21.15.49:0/1722697738 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc814011630 con 0x7fc81807dd90 2024-06-02T23:48:55.612 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.967+0000 7fc8204e3700 1 -- 172.21.15.49:0/1722697738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc81819dfd0 con 0x7fc81807dd90 2024-06-02T23:48:55.612 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.967+0000 7fc80f7fe700 1 -- 172.21.15.49:0/1722697738 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc814011950 con 0x7fc81807dd90 2024-06-02T23:48:55.612 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.968+0000 7fc8204e3700 1 -- 172.21.15.49:0/1722697738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8181a0cc0 con 0x7fc81807dd90 2024-06-02T23:48:55.612 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.968+0000 7fc80f7fe700 1 -- 172.21.15.49:0/1722697738 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc814011af0 con 0x7fc81807dd90 2024-06-02T23:48:55.613 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.968+0000 7fc80f7fe700 1 -- 172.21.15.49:0/1722697738 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc81401c450 con 0x7fc81807dd90 2024-06-02T23:48:55.613 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.968+0000 7fc8204e3700 1 -- 172.21.15.49:0/1722697738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc818063af0 con 0x7fc81807dd90 2024-06-02T23:48:55.613 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:54.971+0000 7fc80f7fe700 1 -- 172.21.15.49:0/1722697738 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fc814032020 con 0x7fc81807dd90 2024-06-02T23:48:55.613 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:55.040+0000 7fc8204e3700 1 -- 172.21.15.49:0/1722697738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fc81802df10 con 0x7fc81807dd90 2024-06-02T23:48:55.613 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:55.043+0000 7fc80f7fe700 1 -- 172.21.15.49:0/1722697738 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7fc814004260 con 0x7fc81807dd90 2024-06-02T23:48:55.613 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:55.044+0000 7fc80f7fe700 1 -- 172.21.15.49:0/1722697738 <== mon.0 v2:172.21.15.49:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc81401cb60 con 0x7fc81807dd90 2024-06-02T23:48:55.613 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:55.045+0000 7fc8204e3700 1 -- 172.21.15.49:0/1722697738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc81807dd90 msgr2=0x7fc81819d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:48:55.613 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:55.045+0000 7fc8204e3700 1 --2- 172.21.15.49:0/1722697738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc81807dd90 0x7fc81819d800 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc814000c00 tx=0x7fc814004750 comp rx=0 tx=0).stop 2024-06-02T23:48:55.613 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:55.045+0000 7fc8204e3700 1 -- 172.21.15.49:0/1722697738 shutdown_connections 2024-06-02T23:48:55.613 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:55.045+0000 7fc8204e3700 1 --2- 172.21.15.49:0/1722697738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc81807dd90 0x7fc81819d800 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:48:55.613 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:55.045+0000 7fc8204e3700 1 -- 172.21.15.49:0/1722697738 >> 172.21.15.49:0/1722697738 conn(0x7fc818103550 msgr2=0x7fc8181058b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:48:55.613 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:55.045+0000 7fc8204e3700 1 -- 172.21.15.49:0/1722697738 shutdown_connections 2024-06-02T23:48:55.613 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:55.045+0000 7fc8204e3700 1 -- 172.21.15.49:0/1722697738 wait complete. 2024-06-02T23:48:55.613 INFO:teuthology.orchestra.run.smithi049.stdout:Generating new minimal ceph.conf... 2024-06-02T23:48:58.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:48:58 smithi049 ceph-mon[31921]: from='client.? 172.21.15.49:0/3191077162' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:49:04.782 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.287+0000 7f294ea75700 1 Processor -- start 2024-06-02T23:49:04.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.287+0000 7f294ea75700 1 -- start start 2024-06-02T23:49:04.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.287+0000 7f294ea75700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f294807dd30 0x7f294807c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:04.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.287+0000 7f294ea75700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f294807c770 con 0x7f294807dd30 2024-06-02T23:49:04.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.287+0000 7f294c811700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f294807dd30 0x7f294807c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:04.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.288+0000 7f294c811700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f294807dd30 0x7f294807c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58374/0 (socket says 172.21.15.49:58374) 2024-06-02T23:49:04.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.288+0000 7f294c811700 1 -- 172.21.15.49:0/3305737861 learned_addr learned my addr 172.21.15.49:0/3305737861 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:04.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.288+0000 7f294c811700 1 -- 172.21.15.49:0/3305737861 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f294807c8f0 con 0x7f294807dd30 2024-06-02T23:49:04.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.288+0000 7f294c811700 1 --2- 172.21.15.49:0/3305737861 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f294807dd30 0x7f294807c230 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f293c0098a0 tx=0x7f293c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=364e2e6b345b2894 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:04.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.288+0000 7f29477fe700 1 -- 172.21.15.49:0/3305737861 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f293c004160 con 0x7f294807dd30 2024-06-02T23:49:04.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.288+0000 7f29477fe700 1 -- 172.21.15.49:0/3305737861 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f293c004300 con 0x7f294807dd30 2024-06-02T23:49:04.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.288+0000 7f29477fe700 1 -- 172.21.15.49:0/3305737861 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f293c011b50 con 0x7f294807dd30 2024-06-02T23:49:04.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.289+0000 7f294ea75700 1 -- 172.21.15.49:0/3305737861 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f294807dd30 msgr2=0x7f294807c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:04.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.289+0000 7f294ea75700 1 --2- 172.21.15.49:0/3305737861 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f294807dd30 0x7f294807c230 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f293c0098a0 tx=0x7f293c009bb0 comp rx=0 tx=0).stop 2024-06-02T23:49:04.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.289+0000 7f294ea75700 1 -- 172.21.15.49:0/3305737861 shutdown_connections 2024-06-02T23:49:04.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.289+0000 7f294ea75700 1 --2- 172.21.15.49:0/3305737861 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f294807dd30 0x7f294807c230 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:04.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.289+0000 7f294ea75700 1 -- 172.21.15.49:0/3305737861 >> 172.21.15.49:0/3305737861 conn(0x7f2948103550 msgr2=0x7f2948105990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:04.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.289+0000 7f294ea75700 1 -- 172.21.15.49:0/3305737861 shutdown_connections 2024-06-02T23:49:04.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.289+0000 7f294ea75700 1 -- 172.21.15.49:0/3305737861 wait complete. 2024-06-02T23:49:04.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.290+0000 7f294ea75700 1 Processor -- start 2024-06-02T23:49:04.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.290+0000 7f294ea75700 1 -- start start 2024-06-02T23:49:04.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.290+0000 7f294ea75700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f294807dd30 0x7f294819e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:04.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.290+0000 7f294ea75700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f294810e540 con 0x7f294807dd30 2024-06-02T23:49:04.785 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.290+0000 7f294c811700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f294807dd30 0x7f294819e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:04.785 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.290+0000 7f294c811700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f294807dd30 0x7f294819e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58378/0 (socket says 172.21.15.49:58378) 2024-06-02T23:49:04.785 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.290+0000 7f294c811700 1 -- 172.21.15.49:0/3191077162 learned_addr learned my addr 172.21.15.49:0/3191077162 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:04.785 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.290+0000 7f294c811700 1 -- 172.21.15.49:0/3191077162 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f294819e5b0 con 0x7f294807dd30 2024-06-02T23:49:04.785 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.290+0000 7f294c811700 1 --2- 172.21.15.49:0/3191077162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f294807dd30 0x7f294819e070 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f293c011670 tx=0x7f293c011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:04.785 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.291+0000 7f2945ffb700 1 -- 172.21.15.49:0/3191077162 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f293c0039c0 con 0x7f294807dd30 2024-06-02T23:49:04.785 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.291+0000 7f2945ffb700 1 -- 172.21.15.49:0/3191077162 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f293c011e50 con 0x7f294807dd30 2024-06-02T23:49:04.785 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.291+0000 7f294ea75700 1 -- 172.21.15.49:0/3191077162 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f294819e840 con 0x7f294807dd30 2024-06-02T23:49:04.785 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.291+0000 7f2945ffb700 1 -- 172.21.15.49:0/3191077162 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f293c01a5c0 con 0x7f294807dd30 2024-06-02T23:49:04.785 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.291+0000 7f294ea75700 1 -- 172.21.15.49:0/3191077162 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29481a1530 con 0x7f294807dd30 2024-06-02T23:49:04.785 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.291+0000 7f2945ffb700 1 -- 172.21.15.49:0/3191077162 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f293c01ac50 con 0x7f294807dd30 2024-06-02T23:49:04.785 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.291+0000 7f2945ffb700 1 -- 172.21.15.49:0/3191077162 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f293c019700 con 0x7f294807dd30 2024-06-02T23:49:04.785 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.292+0000 7f294ea75700 1 -- 172.21.15.49:0/3191077162 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2948063af0 con 0x7f294807dd30 2024-06-02T23:49:04.785 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.294+0000 7f2945ffb700 1 -- 172.21.15.49:0/3191077162 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f293c003b60 con 0x7f294807dd30 2024-06-02T23:49:04.786 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.368+0000 7f294ea75700 1 -- 172.21.15.49:0/3191077162 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f29481a1700 con 0x7f294807dd30 2024-06-02T23:49:04.786 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.368+0000 7f2945ffb700 1 -- 172.21.15.49:0/3191077162 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f293c0199a0 con 0x7f294807dd30 2024-06-02T23:49:04.786 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.369+0000 7f294ea75700 1 -- 172.21.15.49:0/3191077162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f294807dd30 msgr2=0x7f294819e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:04.786 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.369+0000 7f294ea75700 1 --2- 172.21.15.49:0/3191077162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f294807dd30 0x7f294819e070 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f293c011670 tx=0x7f293c011b60 comp rx=0 tx=0).stop 2024-06-02T23:49:04.786 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.369+0000 7f294ea75700 1 -- 172.21.15.49:0/3191077162 shutdown_connections 2024-06-02T23:49:04.786 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.369+0000 7f294ea75700 1 --2- 172.21.15.49:0/3191077162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f294807dd30 0x7f294819e070 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:04.786 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.369+0000 7f294ea75700 1 -- 172.21.15.49:0/3191077162 >> 172.21.15.49:0/3191077162 conn(0x7f2948103550 msgr2=0x7f2948104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:04.786 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.369+0000 7f294ea75700 1 -- 172.21.15.49:0/3191077162 shutdown_connections 2024-06-02T23:49:04.786 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:48:58.369+0000 7f294ea75700 1 -- 172.21.15.49:0/3191077162 wait complete. 2024-06-02T23:49:04.786 INFO:teuthology.orchestra.run.smithi049.stdout:Restarting the monitor... 2024-06-02T23:49:05.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:04 smithi049 systemd[1]: Stopping Ceph mon.a for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-02T23:49:06.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:05 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mon-a[31916]: 2024-06-02T23:49:05.794+0000 7f54d8097700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T23:49:06.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:05 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mon-a[31916]: 2024-06-02T23:49:05.794+0000 7f54d8097700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-06-02T23:49:06.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:05 smithi049 podman[32178]: 2024-06-02 23:49:05.977903268 +0000 UTC m=+1.019762513 container died 387e77d7a6c65d19615a11c8152c11255b0e3948b8d26a9fa94e6b0ef52d0fde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-06-02T23:49:06.877 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:06 smithi049 podman[32178]: 2024-06-02 23:49:06.592864955 +0000 UTC m=+1.634724180 container cleanup 387e77d7a6c65d19615a11c8152c11255b0e3948b8d26a9fa94e6b0ef52d0fde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-06-02T23:49:06.877 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:06 smithi049 bash[32178]: ceph-890dd222-213a-11ef-bc9b-c7b262605968-mon-a 2024-06-02T23:49:06.877 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:06 smithi049 podman[32190]: 2024-06-02 23:49:06.760205995 +0000 UTC m=+0.775434455 container remove 387e77d7a6c65d19615a11c8152c11255b0e3948b8d26a9fa94e6b0ef52d0fde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T23:49:07.200 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:06 smithi049 systemd[1]: ceph-890dd222-213a-11ef-bc9b-c7b262605968@mon.a.service: Deactivated successfully. 2024-06-02T23:49:07.200 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:06 smithi049 systemd[1]: Stopped Ceph mon.a for 890dd222-213a-11ef-bc9b-c7b262605968. 2024-06-02T23:49:07.200 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:06 smithi049 systemd[1]: Starting Ceph mon.a for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-02T23:49:07.200 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 podman[32282]: 2024-06-02 23:49:07.094484043 +0000 UTC m=+0.100775299 container create d07abbb94eed76190c8896b6ca38899045fa47084bce252b24974e6e3c7ea979 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-02T23:49:07.200 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 podman[32282]: 2024-06-02 23:49:07.011250061 +0000 UTC m=+0.017541336 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T23:49:07.375 INFO:teuthology.orchestra.run.smithi049.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-06-02T23:49:07.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 podman[32282]: 2024-06-02 23:49:07.296717219 +0000 UTC m=+0.303008482 container init d07abbb94eed76190c8896b6ca38899045fa47084bce252b24974e6e3c7ea979 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mon-a, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T23:49:07.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 podman[32282]: 2024-06-02 23:49:07.299841811 +0000 UTC m=+0.306133076 container start d07abbb94eed76190c8896b6ca38899045fa47084bce252b24974e6e3c7ea979 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mon-a, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-06-02T23:49:07.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: set uid:gid to 167:167 (ceph:ceph) 2024-06-02T23:49:07.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc), process ceph-mon, pid 2 2024-06-02T23:49:07.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: pidfile_write: ignore empty --pid-file 2024-06-02T23:49:07.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: load: jerasure load: lrc 2024-06-02T23:49:07.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: RocksDB version: 7.9.2 2024-06-02T23:49:07.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Git sha 0 2024-06-02T23:49:07.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Compile date 2024-05-30 15:42:47 2024-06-02T23:49:07.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: DB SUMMARY 2024-06-02T23:49:07.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: DB Session ID: D8ESR0CNPHSLY2IPCL1S 2024-06-02T23:49:07.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: CURRENT file: CURRENT 2024-06-02T23:49:07.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: IDENTITY file: IDENTITY 2024-06-02T23:49:07.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-06-02T23:49:07.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-06-02T23:49:07.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105108 ; 2024-06-02T23:49:07.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.error_if_exists: 0 2024-06-02T23:49:07.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.create_if_missing: 0 2024-06-02T23:49:07.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.paranoid_checks: 1 2024-06-02T23:49:07.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.flush_verify_memtable_count: 1 2024-06-02T23:49:07.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-06-02T23:49:07.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-06-02T23:49:07.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.env: 0x557d7b495c60 2024-06-02T23:49:07.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.fs: PosixFileSystem 2024-06-02T23:49:07.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.info_log: 0x557d7cf95b20 2024-06-02T23:49:07.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.max_file_opening_threads: 16 2024-06-02T23:49:07.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.statistics: (nil) 2024-06-02T23:49:07.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.use_fsync: 0 2024-06-02T23:49:07.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.max_log_file_size: 0 2024-06-02T23:49:07.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-06-02T23:49:07.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.log_file_time_to_roll: 0 2024-06-02T23:49:07.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.keep_log_file_num: 1000 2024-06-02T23:49:07.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.recycle_log_file_num: 0 2024-06-02T23:49:07.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.allow_fallocate: 1 2024-06-02T23:49:07.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.allow_mmap_reads: 0 2024-06-02T23:49:07.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.allow_mmap_writes: 0 2024-06-02T23:49:07.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.use_direct_reads: 0 2024-06-02T23:49:07.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-06-02T23:49:07.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.create_missing_column_families: 0 2024-06-02T23:49:07.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.db_log_dir: 2024-06-02T23:49:07.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.wal_dir: 2024-06-02T23:49:07.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.table_cache_numshardbits: 6 2024-06-02T23:49:07.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.WAL_ttl_seconds: 0 2024-06-02T23:49:07.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.WAL_size_limit_MB: 0 2024-06-02T23:49:07.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-06-02T23:49:07.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-06-02T23:49:07.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.is_fd_close_on_exec: 1 2024-06-02T23:49:07.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.advise_random_on_open: 1 2024-06-02T23:49:07.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.db_write_buffer_size: 0 2024-06-02T23:49:07.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.write_buffer_manager: 0x557d7cf661e0 2024-06-02T23:49:07.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-06-02T23:49:07.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-06-02T23:49:07.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.use_adaptive_mutex: 0 2024-06-02T23:49:07.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.rate_limiter: (nil) 2024-06-02T23:49:07.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-06-02T23:49:07.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.wal_recovery_mode: 2 2024-06-02T23:49:07.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.enable_thread_tracking: 0 2024-06-02T23:49:07.466 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.enable_pipelined_write: 0 2024-06-02T23:49:07.466 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.unordered_write: 0 2024-06-02T23:49:07.466 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-06-02T23:49:07.466 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-06-02T23:49:07.466 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-06-02T23:49:07.466 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-06-02T23:49:07.466 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.row_cache: None 2024-06-02T23:49:07.466 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.wal_filter: None 2024-06-02T23:49:07.466 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-06-02T23:49:07.467 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.allow_ingest_behind: 0 2024-06-02T23:49:07.467 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.two_write_queues: 0 2024-06-02T23:49:07.468 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.manual_wal_flush: 0 2024-06-02T23:49:07.468 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.wal_compression: 0 2024-06-02T23:49:07.468 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.atomic_flush: 0 2024-06-02T23:49:07.468 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-06-02T23:49:07.468 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.persist_stats_to_disk: 0 2024-06-02T23:49:07.468 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.write_dbid_to_manifest: 0 2024-06-02T23:49:07.468 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.log_readahead_size: 0 2024-06-02T23:49:07.468 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-06-02T23:49:07.468 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.best_efforts_recovery: 0 2024-06-02T23:49:07.468 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-06-02T23:49:07.468 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-06-02T23:49:07.468 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.allow_data_in_errors: 0 2024-06-02T23:49:07.468 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.db_host_id: __hostname__ 2024-06-02T23:49:07.469 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.enforce_single_del_contracts: true 2024-06-02T23:49:07.469 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.max_background_jobs: 2 2024-06-02T23:49:07.469 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.max_background_compactions: -1 2024-06-02T23:49:07.469 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.max_subcompactions: 1 2024-06-02T23:49:07.469 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-06-02T23:49:07.469 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-06-02T23:49:07.469 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.delayed_write_rate : 16777216 2024-06-02T23:49:07.469 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.max_total_wal_size: 0 2024-06-02T23:49:07.469 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-06-02T23:49:07.469 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.stats_dump_period_sec: 600 2024-06-02T23:49:07.469 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.stats_persist_period_sec: 600 2024-06-02T23:49:07.469 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-06-02T23:49:07.469 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.max_open_files: -1 2024-06-02T23:49:07.469 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.bytes_per_sync: 0 2024-06-02T23:49:07.469 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.wal_bytes_per_sync: 0 2024-06-02T23:49:07.470 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.strict_bytes_per_sync: 0 2024-06-02T23:49:07.470 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.compaction_readahead_size: 0 2024-06-02T23:49:07.470 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.max_background_flushes: -1 2024-06-02T23:49:07.470 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Compression algorithms supported: 2024-06-02T23:49:07.470 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-06-02T23:49:07.470 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: kZSTD supported: 0 2024-06-02T23:49:07.470 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: kXpressCompression supported: 0 2024-06-02T23:49:07.470 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: kLZ4HCCompression supported: 1 2024-06-02T23:49:07.470 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: kZlibCompression supported: 1 2024-06-02T23:49:07.470 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: kSnappyCompression supported: 1 2024-06-02T23:49:07.470 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: kLZ4Compression supported: 1 2024-06-02T23:49:07.470 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: kBZip2Compression supported: 0 2024-06-02T23:49:07.470 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Fast CRC32 supported: Supported on x86 2024-06-02T23:49:07.471 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: DMutex implementation: pthread_mutex_t 2024-06-02T23:49:07.471 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-06-02T23:49:07.471 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-06-02T23:49:07.471 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-06-02T23:49:07.471 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.merge_operator: 2024-06-02T23:49:07.471 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.compaction_filter: None 2024-06-02T23:49:07.471 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.compaction_filter_factory: None 2024-06-02T23:49:07.471 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.sst_partitioner_factory: None 2024-06-02T23:49:07.471 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.memtable_factory: SkipListFactory 2024-06-02T23:49:07.471 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.table_factory: BlockBasedTable 2024-06-02T23:49:07.471 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557d7cf95c40) 2024-06-02T23:49:07.471 INFO:journalctl@ceph.mon.a.smithi049.stdout: cache_index_and_filter_blocks: 1 2024-06-02T23:49:07.471 INFO:journalctl@ceph.mon.a.smithi049.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-06-02T23:49:07.471 INFO:journalctl@ceph.mon.a.smithi049.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-06-02T23:49:07.472 INFO:journalctl@ceph.mon.a.smithi049.stdout: pin_top_level_index_and_filter: 1 2024-06-02T23:49:07.472 INFO:journalctl@ceph.mon.a.smithi049.stdout: index_type: 0 2024-06-02T23:49:07.472 INFO:journalctl@ceph.mon.a.smithi049.stdout: data_block_index_type: 0 2024-06-02T23:49:07.472 INFO:journalctl@ceph.mon.a.smithi049.stdout: index_shortening: 1 2024-06-02T23:49:07.472 INFO:journalctl@ceph.mon.a.smithi049.stdout: data_block_hash_table_util_ratio: 0.750000 2024-06-02T23:49:07.472 INFO:journalctl@ceph.mon.a.smithi049.stdout: checksum: 4 2024-06-02T23:49:07.472 INFO:journalctl@ceph.mon.a.smithi049.stdout: no_block_cache: 0 2024-06-02T23:49:07.472 INFO:journalctl@ceph.mon.a.smithi049.stdout: block_cache: 0x557d7cf97090 2024-06-02T23:49:07.472 INFO:journalctl@ceph.mon.a.smithi049.stdout: block_cache_name: BinnedLRUCache 2024-06-02T23:49:07.472 INFO:journalctl@ceph.mon.a.smithi049.stdout: block_cache_options: 2024-06-02T23:49:07.472 INFO:journalctl@ceph.mon.a.smithi049.stdout: capacity : 536870912 2024-06-02T23:49:07.472 INFO:journalctl@ceph.mon.a.smithi049.stdout: num_shard_bits : 4 2024-06-02T23:49:07.472 INFO:journalctl@ceph.mon.a.smithi049.stdout: strict_capacity_limit : 0 2024-06-02T23:49:07.472 INFO:journalctl@ceph.mon.a.smithi049.stdout: high_pri_pool_ratio: 0.000 2024-06-02T23:49:07.473 INFO:journalctl@ceph.mon.a.smithi049.stdout: block_cache_compressed: (nil) 2024-06-02T23:49:07.473 INFO:journalctl@ceph.mon.a.smithi049.stdout: persistent_cache: (nil) 2024-06-02T23:49:07.473 INFO:journalctl@ceph.mon.a.smithi049.stdout: block_size: 4096 2024-06-02T23:49:07.473 INFO:journalctl@ceph.mon.a.smithi049.stdout: block_size_deviation: 10 2024-06-02T23:49:07.473 INFO:journalctl@ceph.mon.a.smithi049.stdout: block_restart_interval: 16 2024-06-02T23:49:07.473 INFO:journalctl@ceph.mon.a.smithi049.stdout: index_block_restart_interval: 1 2024-06-02T23:49:07.473 INFO:journalctl@ceph.mon.a.smithi049.stdout: metadata_block_size: 4096 2024-06-02T23:49:07.473 INFO:journalctl@ceph.mon.a.smithi049.stdout: partition_filters: 0 2024-06-02T23:49:07.473 INFO:journalctl@ceph.mon.a.smithi049.stdout: use_delta_encoding: 1 2024-06-02T23:49:07.473 INFO:journalctl@ceph.mon.a.smithi049.stdout: filter_policy: bloomfilter 2024-06-02T23:49:07.473 INFO:journalctl@ceph.mon.a.smithi049.stdout: whole_key_filtering: 1 2024-06-02T23:49:07.473 INFO:journalctl@ceph.mon.a.smithi049.stdout: verify_compression: 0 2024-06-02T23:49:07.473 INFO:journalctl@ceph.mon.a.smithi049.stdout: read_amp_bytes_per_bit: 0 2024-06-02T23:49:07.473 INFO:journalctl@ceph.mon.a.smithi049.stdout: format_version: 5 2024-06-02T23:49:07.473 INFO:journalctl@ceph.mon.a.smithi049.stdout: enable_index_compression: 1 2024-06-02T23:49:07.474 INFO:journalctl@ceph.mon.a.smithi049.stdout: block_align: 0 2024-06-02T23:49:07.474 INFO:journalctl@ceph.mon.a.smithi049.stdout: max_auto_readahead_size: 262144 2024-06-02T23:49:07.474 INFO:journalctl@ceph.mon.a.smithi049.stdout: prepopulate_block_cache: 0 2024-06-02T23:49:07.474 INFO:journalctl@ceph.mon.a.smithi049.stdout: initial_auto_readahead_size: 8192 2024-06-02T23:49:07.474 INFO:journalctl@ceph.mon.a.smithi049.stdout: num_file_reads_for_auto_readahead: 2 2024-06-02T23:49:07.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.write_buffer_size: 33554432 2024-06-02T23:49:07.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.max_write_buffer_number: 2 2024-06-02T23:49:07.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.compression: NoCompression 2024-06-02T23:49:07.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.bottommost_compression: Disabled 2024-06-02T23:49:07.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.prefix_extractor: nullptr 2024-06-02T23:49:07.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-06-02T23:49:07.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.num_levels: 7 2024-06-02T23:49:07.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-06-02T23:49:07.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-06-02T23:49:07.475 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-06-02T23:49:07.475 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-06-02T23:49:07.475 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-06-02T23:49:07.475 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-06-02T23:49:07.475 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-06-02T23:49:07.475 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-06-02T23:49:07.475 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-06-02T23:49:07.475 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-06-02T23:49:07.475 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-06-02T23:49:07.475 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-06-02T23:49:07.475 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.compression_opts.window_bits: -14 2024-06-02T23:49:07.475 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.compression_opts.level: 32767 2024-06-02T23:49:07.475 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.compression_opts.strategy: 0 2024-06-02T23:49:07.475 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-06-02T23:49:07.476 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-06-02T23:49:07.476 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-06-02T23:49:07.476 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-06-02T23:49:07.476 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.compression_opts.enabled: false 2024-06-02T23:49:07.476 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-06-02T23:49:07.476 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-06-02T23:49:07.476 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-06-02T23:49:07.476 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-06-02T23:49:07.476 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.target_file_size_base: 67108864 2024-06-02T23:49:07.476 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.target_file_size_multiplier: 1 2024-06-02T23:49:07.476 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-06-02T23:49:07.476 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-06-02T23:49:07.476 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-06-02T23:49:07.477 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-06-02T23:49:07.477 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-06-02T23:49:07.477 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-06-02T23:49:07.477 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-06-02T23:49:07.477 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-06-02T23:49:07.477 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-06-02T23:49:07.477 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-06-02T23:49:07.477 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-06-02T23:49:07.477 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-06-02T23:49:07.477 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-06-02T23:49:07.477 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.arena_block_size: 1048576 2024-06-02T23:49:07.477 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-06-02T23:49:07.477 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-06-02T23:49:07.477 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.disable_auto_compactions: 0 2024-06-02T23:49:07.478 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-06-02T23:49:07.478 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-06-02T23:49:07.478 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-06-02T23:49:07.478 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-06-02T23:49:07.478 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-06-02T23:49:07.478 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-06-02T23:49:07.478 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-06-02T23:49:07.478 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-06-02T23:49:07.478 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-06-02T23:49:07.478 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-06-02T23:49:07.478 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.table_properties_collectors: 2024-06-02T23:49:07.478 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.inplace_update_support: 0 2024-06-02T23:49:07.478 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.inplace_update_num_locks: 10000 2024-06-02T23:49:07.478 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-06-02T23:49:07.478 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-06-02T23:49:07.479 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.memtable_huge_page_size: 0 2024-06-02T23:49:07.479 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.bloom_locality: 0 2024-06-02T23:49:07.479 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.max_successive_merges: 0 2024-06-02T23:49:07.479 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.optimize_filters_for_hits: 0 2024-06-02T23:49:07.479 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.paranoid_file_checks: 0 2024-06-02T23:49:07.479 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.force_consistency_checks: 1 2024-06-02T23:49:07.479 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.report_bg_io_stats: 0 2024-06-02T23:49:07.479 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.ttl: 2592000 2024-06-02T23:49:07.479 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.periodic_compaction_seconds: 0 2024-06-02T23:49:07.479 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-06-02T23:49:07.479 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-06-02T23:49:07.479 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.enable_blob_files: false 2024-06-02T23:49:07.479 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.min_blob_size: 0 2024-06-02T23:49:07.479 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.blob_file_size: 268435456 2024-06-02T23:49:07.480 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.blob_compression_type: NoCompression 2024-06-02T23:49:07.480 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.enable_blob_garbage_collection: false 2024-06-02T23:49:07.480 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-06-02T23:49:07.480 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-06-02T23:49:07.480 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-06-02T23:49:07.480 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.blob_file_starting_level: 0 2024-06-02T23:49:07.480 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-06-02T23:49:07.480 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-06-02T23:49:07.480 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-06-02T23:49:07.480 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 08435e99-f160-4aee-a09a-f7d0e56c66fe 2024-06-02T23:49:07.480 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717372147328862, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-06-02T23:49:07.480 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-06-02T23:49:07.480 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717372147329973, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100171, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 328, "table_properties": {"data_size": 98082, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14272, "raw_average_key_size": 49, "raw_value_size": 90351, "raw_average_value_size": 314, "num_data_blocks": 12, "num_entries": 287, "num_filter_entries": 287, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1717372147, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "08435e99-f160-4aee-a09a-f7d0e56c66fe", "db_session_id": "D8ESR0CNPHSLY2IPCL1S", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-06-02T23:49:07.480 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717372147330057, "job": 1, "event": "recovery_finished"} 2024-06-02T23:49:07.481 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-06-02T23:49:07.481 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-06-02T23:49:07.481 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x557d7d086000 2024-06-02T23:49:07.481 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: DB pointer 0x557d7d070000 2024-06-02T23:49:07.481 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-06-02T23:49:07.481 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-06-02T23:49:07.481 INFO:journalctl@ceph.mon.a.smithi049.stdout: ** DB Stats ** 2024-06-02T23:49:07.481 INFO:journalctl@ceph.mon.a.smithi049.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-02T23:49:07.481 INFO:journalctl@ceph.mon.a.smithi049.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-06-02T23:49:07.481 INFO:journalctl@ceph.mon.a.smithi049.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-02T23:49:07.481 INFO:journalctl@ceph.mon.a.smithi049.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-02T23:49:07.481 INFO:journalctl@ceph.mon.a.smithi049.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-06-02T23:49:07.481 INFO:journalctl@ceph.mon.a.smithi049.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-02T23:49:07.481 INFO:journalctl@ceph.mon.a.smithi049.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-02T23:49:07.482 INFO:journalctl@ceph.mon.a.smithi049.stdout: 2024-06-02T23:49:07.482 INFO:journalctl@ceph.mon.a.smithi049.stdout: ** Compaction Stats [default] ** 2024-06-02T23:49:07.482 INFO:journalctl@ceph.mon.a.smithi049.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-02T23:49:07.482 INFO:journalctl@ceph.mon.a.smithi049.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-06-02T23:49:07.482 INFO:journalctl@ceph.mon.a.smithi049.stdout: L0 2/0 99.66 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-02T23:49:07.482 INFO:journalctl@ceph.mon.a.smithi049.stdout: Sum 2/0 99.66 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-02T23:49:07.482 INFO:journalctl@ceph.mon.a.smithi049.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-02T23:49:07.482 INFO:journalctl@ceph.mon.a.smithi049.stdout: 2024-06-02T23:49:07.482 INFO:journalctl@ceph.mon.a.smithi049.stdout: ** Compaction Stats [default] ** 2024-06-02T23:49:07.482 INFO:journalctl@ceph.mon.a.smithi049.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-02T23:49:07.482 INFO:journalctl@ceph.mon.a.smithi049.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-02T23:49:07.482 INFO:journalctl@ceph.mon.a.smithi049.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 135.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-02T23:49:07.482 INFO:journalctl@ceph.mon.a.smithi049.stdout: 2024-06-02T23:49:07.482 INFO:journalctl@ceph.mon.a.smithi049.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-06-02T23:49:07.483 INFO:journalctl@ceph.mon.a.smithi049.stdout: 2024-06-02T23:49:07.483 INFO:journalctl@ceph.mon.a.smithi049.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-02T23:49:07.483 INFO:journalctl@ceph.mon.a.smithi049.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-06-02T23:49:07.483 INFO:journalctl@ceph.mon.a.smithi049.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-02T23:49:07.483 INFO:journalctl@ceph.mon.a.smithi049.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-02T23:49:07.483 INFO:journalctl@ceph.mon.a.smithi049.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-02T23:49:07.483 INFO:journalctl@ceph.mon.a.smithi049.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-02T23:49:07.483 INFO:journalctl@ceph.mon.a.smithi049.stdout: Cumulative compaction: 0.00 GB write, 29.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-02T23:49:07.483 INFO:journalctl@ceph.mon.a.smithi049.stdout: Interval compaction: 0.00 GB write, 29.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-02T23:49:07.483 INFO:journalctl@ceph.mon.a.smithi049.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-02T23:49:07.483 INFO:journalctl@ceph.mon.a.smithi049.stdout: Block cache BinnedLRUCache@0x557d7cf97090#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-06-02T23:49:07.483 INFO:journalctl@ceph.mon.a.smithi049.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-06-02T23:49:07.483 INFO:journalctl@ceph.mon.a.smithi049.stdout: 2024-06-02T23:49:07.483 INFO:journalctl@ceph.mon.a.smithi049.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-02T23:49:07.484 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: starting mon.a rank 0 at public addrs [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] at bind addrs [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 890dd222-213a-11ef-bc9b-c7b262605968 2024-06-02T23:49:07.484 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: mon.a@-1(???) e1 preinit fsid 890dd222-213a-11ef-bc9b-c7b262605968 2024-06-02T23:49:07.484 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: mon.a@-1(???).mds e1 new map 2024-06-02T23:49:07.484 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: mon.a@-1(???).mds e1 print_map 2024-06-02T23:49:07.484 INFO:journalctl@ceph.mon.a.smithi049.stdout: e1 2024-06-02T23:49:07.484 INFO:journalctl@ceph.mon.a.smithi049.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T23:49:07.484 INFO:journalctl@ceph.mon.a.smithi049.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-02T23:49:07.484 INFO:journalctl@ceph.mon.a.smithi049.stdout: legacy client fscid: -1 2024-06-02T23:49:07.484 INFO:journalctl@ceph.mon.a.smithi049.stdout: 2024-06-02T23:49:07.484 INFO:journalctl@ceph.mon.a.smithi049.stdout: No filesystems configured 2024-06-02T23:49:07.484 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-06-02T23:49:07.484 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T23:49:07.484 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T23:49:07.485 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T23:49:07.485 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-06-02T23:49:07.485 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 bash[32282]: d07abbb94eed76190c8896b6ca38899045fa47084bce252b24974e6e3c7ea979 2024-06-02T23:49:07.485 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 systemd[1]: Started Ceph mon.a for 890dd222-213a-11ef-bc9b-c7b262605968. 2024-06-02T23:49:07.485 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: mon.a is new leader, mons a in quorum (ranks 0) 2024-06-02T23:49:07.485 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: monmap epoch 1 2024-06-02T23:49:07.485 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: fsid 890dd222-213a-11ef-bc9b-c7b262605968 2024-06-02T23:49:07.485 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: last_changed 2024-06-02T23:48:50.407497+0000 2024-06-02T23:49:07.485 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: created 2024-06-02T23:48:50.407497+0000 2024-06-02T23:49:07.485 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: min_mon_release 19 (squid) 2024-06-02T23:49:07.485 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: election_strategy: 1 2024-06-02T23:49:07.485 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: 0: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.a 2024-06-02T23:49:07.485 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: fsmap 2024-06-02T23:49:07.485 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: osdmap e1: 0 total, 0 up, 0 in 2024-06-02T23:49:07.486 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:07 smithi049 ceph-mon[32302]: mgrmap e1: no daemons active 2024-06-02T23:49:08.511 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.839+0000 7fd5460b7700 1 Processor -- start 2024-06-02T23:49:08.511 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.839+0000 7fd5460b7700 1 -- start start 2024-06-02T23:49:08.511 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.839+0000 7fd5460b7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd54007dd50 0x7fd54007c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:08.511 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.839+0000 7fd5460b7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd54007c790 con 0x7fd54007dd50 2024-06-02T23:49:08.511 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.839+0000 7fd53f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd54007dd50 0x7fd54007c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:08.511 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.839+0000 7fd53f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd54007dd50 0x7fd54007c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53464/0 (socket says 172.21.15.49:53464) 2024-06-02T23:49:08.511 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.839+0000 7fd53f7fe700 1 -- 172.21.15.49:0/803412150 learned_addr learned my addr 172.21.15.49:0/803412150 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:08.511 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.840+0000 7fd53f7fe700 1 -- 172.21.15.49:0/803412150 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd54007c910 con 0x7fd54007dd50 2024-06-02T23:49:08.511 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.840+0000 7fd53f7fe700 1 --2- 172.21.15.49:0/803412150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd54007dd50 0x7fd54007c250 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd5300098a0 tx=0x7fd530009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4db1f7c48774aba server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:08.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.840+0000 7fd53e7fc700 1 -- 172.21.15.49:0/803412150 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd530004160 con 0x7fd54007dd50 2024-06-02T23:49:08.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.840+0000 7fd53e7fc700 1 -- 172.21.15.49:0/803412150 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd530004300 con 0x7fd54007dd50 2024-06-02T23:49:08.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.840+0000 7fd53e7fc700 1 -- 172.21.15.49:0/803412150 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd530011b50 con 0x7fd54007dd50 2024-06-02T23:49:08.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.841+0000 7fd5460b7700 1 -- 172.21.15.49:0/803412150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd54007dd50 msgr2=0x7fd54007c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:08.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.841+0000 7fd5460b7700 1 --2- 172.21.15.49:0/803412150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd54007dd50 0x7fd54007c250 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd5300098a0 tx=0x7fd530009bb0 comp rx=0 tx=0).stop 2024-06-02T23:49:08.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.841+0000 7fd5460b7700 1 -- 172.21.15.49:0/803412150 shutdown_connections 2024-06-02T23:49:08.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.841+0000 7fd5460b7700 1 --2- 172.21.15.49:0/803412150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd54007dd50 0x7fd54007c250 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:08.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.841+0000 7fd5460b7700 1 -- 172.21.15.49:0/803412150 >> 172.21.15.49:0/803412150 conn(0x7fd540103550 msgr2=0x7fd540105990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:08.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.841+0000 7fd5460b7700 1 -- 172.21.15.49:0/803412150 shutdown_connections 2024-06-02T23:49:08.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.841+0000 7fd5460b7700 1 -- 172.21.15.49:0/803412150 wait complete. 2024-06-02T23:49:08.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.841+0000 7fd5460b7700 1 Processor -- start 2024-06-02T23:49:08.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.842+0000 7fd5460b7700 1 -- start start 2024-06-02T23:49:08.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.842+0000 7fd5460b7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd54007dd50 0x7fd54019e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:08.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.842+0000 7fd5460b7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd54010e520 con 0x7fd54007dd50 2024-06-02T23:49:08.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.842+0000 7fd53f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd54007dd50 0x7fd54019e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:08.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.842+0000 7fd53f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd54007dd50 0x7fd54019e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53468/0 (socket says 172.21.15.49:53468) 2024-06-02T23:49:08.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.842+0000 7fd53f7fe700 1 -- 172.21.15.49:0/1573884816 learned_addr learned my addr 172.21.15.49:0/1573884816 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:08.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.842+0000 7fd53f7fe700 1 -- 172.21.15.49:0/1573884816 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd54019e5b0 con 0x7fd54007dd50 2024-06-02T23:49:08.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.842+0000 7fd53f7fe700 1 --2- 172.21.15.49:0/1573884816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd54007dd50 0x7fd54019e070 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd530011670 tx=0x7fd530011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:08.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.842+0000 7fd53cff9700 1 -- 172.21.15.49:0/1573884816 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5300039c0 con 0x7fd54007dd50 2024-06-02T23:49:08.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.842+0000 7fd53cff9700 1 -- 172.21.15.49:0/1573884816 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd530011e50 con 0x7fd54007dd50 2024-06-02T23:49:08.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.842+0000 7fd5460b7700 1 -- 172.21.15.49:0/1573884816 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd54019e840 con 0x7fd54007dd50 2024-06-02T23:49:08.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.843+0000 7fd53cff9700 1 -- 172.21.15.49:0/1573884816 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd53001a5c0 con 0x7fd54007dd50 2024-06-02T23:49:08.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.843+0000 7fd5460b7700 1 -- 172.21.15.49:0/1573884816 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5401a1530 con 0x7fd54007dd50 2024-06-02T23:49:08.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.843+0000 7fd53cff9700 1 -- 172.21.15.49:0/1573884816 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd53001ac50 con 0x7fd54007dd50 2024-06-02T23:49:08.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.843+0000 7fd53cff9700 1 -- 172.21.15.49:0/1573884816 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd530019700 con 0x7fd54007dd50 2024-06-02T23:49:08.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.844+0000 7fd5460b7700 1 -- 172.21.15.49:0/1573884816 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd540063af0 con 0x7fd54007dd50 2024-06-02T23:49:08.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.846+0000 7fd53cff9700 1 -- 172.21.15.49:0/1573884816 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fd530003b60 con 0x7fd54007dd50 2024-06-02T23:49:08.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.916+0000 7fd5460b7700 1 -- 172.21.15.49:0/1573884816 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fd5401a1700 con 0x7fd54007dd50 2024-06-02T23:49:08.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.918+0000 7fd53cff9700 1 -- 172.21.15.49:0/1573884816 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fd530019900 con 0x7fd54007dd50 2024-06-02T23:49:08.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.919+0000 7fd5460b7700 1 -- 172.21.15.49:0/1573884816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd54007dd50 msgr2=0x7fd54019e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:08.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.919+0000 7fd5460b7700 1 --2- 172.21.15.49:0/1573884816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd54007dd50 0x7fd54019e070 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd530011670 tx=0x7fd530011b60 comp rx=0 tx=0).stop 2024-06-02T23:49:08.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.919+0000 7fd5460b7700 1 -- 172.21.15.49:0/1573884816 shutdown_connections 2024-06-02T23:49:08.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.919+0000 7fd5460b7700 1 --2- 172.21.15.49:0/1573884816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd54007dd50 0x7fd54019e070 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:08.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.919+0000 7fd5460b7700 1 -- 172.21.15.49:0/1573884816 >> 172.21.15.49:0/1573884816 conn(0x7fd540103550 msgr2=0x7fd540104090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:08.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.919+0000 7fd5460b7700 1 -- 172.21.15.49:0/1573884816 shutdown_connections 2024-06-02T23:49:08.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:07.919+0000 7fd5460b7700 1 -- 172.21.15.49:0/1573884816 wait complete. 2024-06-02T23:49:08.514 INFO:teuthology.orchestra.run.smithi049.stdout:Wrote config to /etc/ceph/ceph.conf 2024-06-02T23:49:08.536 INFO:teuthology.orchestra.run.smithi049.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-06-02T23:49:08.536 INFO:teuthology.orchestra.run.smithi049.stdout:Creating mgr... 2024-06-02T23:49:08.536 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying port 0.0.0.0:9283 ... 2024-06-02T23:49:08.537 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying port 0.0.0.0:8765 ... 2024-06-02T23:49:08.797 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-890dd222-213a-11ef-bc9b-c7b262605968@mgr.x 2024-06-02T23:49:08.797 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Failed to reset failed state of unit ceph-890dd222-213a-11ef-bc9b-c7b262605968@mgr.x.service: Unit ceph-890dd222-213a-11ef-bc9b-c7b262605968@mgr.x.service not loaded. 2024-06-02T23:49:08.951 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-890dd222-213a-11ef-bc9b-c7b262605968.target.wants/ceph-890dd222-213a-11ef-bc9b-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-890dd222-213a-11ef-bc9b-c7b262605968@.service. 2024-06-02T23:49:09.188 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:08 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/1573884816' entity='client.admin' 2024-06-02T23:49:09.189 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:08 smithi049 systemd[1]: Starting Ceph mgr.x for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-02T23:49:09.458 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:09 smithi049 podman[32514]: 2024-06-02 23:49:09.189050567 +0000 UTC m=+0.113802261 container create 196f847adf9e78f6f06029e260a61fd268a33ee84c49c4277e9f228b0daa2cbf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-02T23:49:09.459 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:09 smithi049 podman[32514]: 2024-06-02 23:49:09.092777472 +0000 UTC m=+0.017529167 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T23:49:09.459 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:09 smithi049 podman[32514]: 2024-06-02 23:49:09.383144967 +0000 UTC m=+0.307896671 container init 196f847adf9e78f6f06029e260a61fd268a33ee84c49c4277e9f228b0daa2cbf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-02T23:49:09.459 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:09 smithi049 podman[32514]: 2024-06-02 23:49:09.386223837 +0000 UTC m=+0.310975532 container start 196f847adf9e78f6f06029e260a61fd268a33ee84c49c4277e9f228b0daa2cbf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-06-02T23:49:09.459 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:09 smithi049 bash[32514]: 196f847adf9e78f6f06029e260a61fd268a33ee84c49c4277e9f228b0daa2cbf 2024-06-02T23:49:09.472 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-02T23:49:09.472 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout disabled 2024-06-02T23:49:09.480 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-02T23:49:09.481 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout inactive 2024-06-02T23:49:09.481 INFO:teuthology.orchestra.run.smithi049.stdout:firewalld.service is not enabled 2024-06-02T23:49:09.481 INFO:teuthology.orchestra.run.smithi049.stdout:Not possible to enable service . firewalld.service is not available 2024-06-02T23:49:09.489 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-02T23:49:09.489 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout disabled 2024-06-02T23:49:09.498 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-02T23:49:09.498 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout inactive 2024-06-02T23:49:09.498 INFO:teuthology.orchestra.run.smithi049.stdout:firewalld.service is not enabled 2024-06-02T23:49:09.498 INFO:teuthology.orchestra.run.smithi049.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-06-02T23:49:09.498 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for mgr to start... 2024-06-02T23:49:09.499 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for mgr... 2024-06-02T23:49:09.711 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:09 smithi049 systemd[1]: Started Ceph mgr.x for 890dd222-213a-11ef-bc9b-c7b262605968. 2024-06-02T23:49:09.711 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:09 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:09.547+0000 7f99b9ca3200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-02T23:49:10.030 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:09 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:09.748+0000 7f99b9ca3200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-02T23:49:10.030 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:09 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:09.856+0000 7f99b9ca3200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-02T23:49:10.283 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:10 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/2917880636' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-02T23:49:10.283 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:10 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:10.192+0000 7f99b9ca3200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-02T23:49:10.527 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-06-02T23:49:10.527 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2024-06-02T23:49:10.527 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsid": "890dd222-213a-11ef-bc9b-c7b262605968", 2024-06-02T23:49:10.527 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "health": { 2024-06-02T23:49:10.527 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-02T23:49:10.527 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-02T23:49:10.528 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-02T23:49:10.528 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:49:10.528 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-02T23:49:10.528 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-02T23:49:10.528 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 0 2024-06-02T23:49:10.528 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-06-02T23:49:10.528 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-02T23:49:10.528 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "a" 2024-06-02T23:49:10.528 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-06-02T23:49:10.528 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-06-02T23:49:10.528 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-02T23:49:10.528 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T23:49:10.528 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-06-02T23:49:10.528 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-02T23:49:10.529 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:49:10.529 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-02T23:49:10.529 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T23:49:10.529 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-02T23:49:10.529 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-02T23:49:10.529 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-02T23:49:10.536 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-02T23:49:10.536 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-02T23:49:10.536 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-02T23:49:10.536 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:49:10.536 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-02T23:49:10.536 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-02T23:49:10.537 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-02T23:49:10.537 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-02T23:49:10.537 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-02T23:49:10.537 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-02T23:49:10.537 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-02T23:49:10.537 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-02T23:49:10.537 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-02T23:49:10.537 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:49:10.537 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-02T23:49:10.537 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T23:49:10.537 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-02T23:49:10.537 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-02T23:49:10.537 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:49:10.537 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-02T23:49:10.538 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "available": false, 2024-06-02T23:49:10.538 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-02T23:49:10.538 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-02T23:49:10.538 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-02T23:49:10.538 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-02T23:49:10.538 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "restful" 2024-06-02T23:49:10.538 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-06-02T23:49:10.538 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T23:49:10.538 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:49:10.538 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-02T23:49:10.538 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T23:49:10.538 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modified": "2024-06-02T23:48:53.324009+0000", 2024-06-02T23:49:10.538 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T23:49:10.538 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:49:10.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-02T23:49:10.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2024-06-02T23:49:10.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.948+0000 7ff12473f700 1 Processor -- start 2024-06-02T23:49:10.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.948+0000 7ff12473f700 1 -- start start 2024-06-02T23:49:10.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.949+0000 7ff12473f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff11c1089e0 0x7ff11c10add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:10.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.949+0000 7ff12473f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff11c07bdc0 con 0x7ff11c1089e0 2024-06-02T23:49:10.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.949+0000 7ff1224db700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff11c1089e0 0x7ff11c10add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:10.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.949+0000 7ff1224db700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff11c1089e0 0x7ff11c10add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53476/0 (socket says 172.21.15.49:53476) 2024-06-02T23:49:10.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.949+0000 7ff1224db700 1 -- 172.21.15.49:0/4189952358 learned_addr learned my addr 172.21.15.49:0/4189952358 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:10.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.949+0000 7ff1224db700 1 -- 172.21.15.49:0/4189952358 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff11c10b310 con 0x7ff11c1089e0 2024-06-02T23:49:10.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.949+0000 7ff1224db700 1 --2- 172.21.15.49:0/4189952358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff11c1089e0 0x7ff11c10add0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff1180098a0 tx=0x7ff118009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7b138e5495aac74 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:10.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.950+0000 7ff1214d9700 1 -- 172.21.15.49:0/4189952358 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff118004160 con 0x7ff11c1089e0 2024-06-02T23:49:10.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.950+0000 7ff1214d9700 1 -- 172.21.15.49:0/4189952358 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff118004300 con 0x7ff11c1089e0 2024-06-02T23:49:10.539 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.950+0000 7ff1214d9700 1 -- 172.21.15.49:0/4189952358 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff118011b50 con 0x7ff11c1089e0 2024-06-02T23:49:10.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.950+0000 7ff12473f700 1 -- 172.21.15.49:0/4189952358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff11c1089e0 msgr2=0x7ff11c10add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:10.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.950+0000 7ff12473f700 1 --2- 172.21.15.49:0/4189952358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff11c1089e0 0x7ff11c10add0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff1180098a0 tx=0x7ff118009bb0 comp rx=0 tx=0).stop 2024-06-02T23:49:10.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.950+0000 7ff12473f700 1 -- 172.21.15.49:0/4189952358 shutdown_connections 2024-06-02T23:49:10.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.950+0000 7ff12473f700 1 --2- 172.21.15.49:0/4189952358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff11c1089e0 0x7ff11c10add0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:10.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.950+0000 7ff12473f700 1 -- 172.21.15.49:0/4189952358 >> 172.21.15.49:0/4189952358 conn(0x7ff11c1023f0 msgr2=0x7ff11c104810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:10.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.950+0000 7ff12473f700 1 -- 172.21.15.49:0/4189952358 shutdown_connections 2024-06-02T23:49:10.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.950+0000 7ff12473f700 1 -- 172.21.15.49:0/4189952358 wait complete. 2024-06-02T23:49:10.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.951+0000 7ff12473f700 1 Processor -- start 2024-06-02T23:49:10.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.951+0000 7ff12473f700 1 -- start start 2024-06-02T23:49:10.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.951+0000 7ff12473f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff11c1089e0 0x7ff11c19be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:10.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.951+0000 7ff12473f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff11c10c2e0 con 0x7ff11c1089e0 2024-06-02T23:49:10.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.951+0000 7ff1224db700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff11c1089e0 0x7ff11c19be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:10.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.951+0000 7ff1224db700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff11c1089e0 0x7ff11c19be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53486/0 (socket says 172.21.15.49:53486) 2024-06-02T23:49:10.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.951+0000 7ff1224db700 1 -- 172.21.15.49:0/2917880636 learned_addr learned my addr 172.21.15.49:0/2917880636 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:10.540 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.952+0000 7ff1224db700 1 -- 172.21.15.49:0/2917880636 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff11c19c3c0 con 0x7ff11c1089e0 2024-06-02T23:49:10.541 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.952+0000 7ff1224db700 1 --2- 172.21.15.49:0/2917880636 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff11c1089e0 0x7ff11c19be80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff118011b60 tx=0x7ff118011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:10.541 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.952+0000 7ff1137fe700 1 -- 172.21.15.49:0/2917880636 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff118003b20 con 0x7ff11c1089e0 2024-06-02T23:49:10.541 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.952+0000 7ff1137fe700 1 -- 172.21.15.49:0/2917880636 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff118003cc0 con 0x7ff11c1089e0 2024-06-02T23:49:10.541 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.952+0000 7ff12473f700 1 -- 172.21.15.49:0/2917880636 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff11c19c650 con 0x7ff11c1089e0 2024-06-02T23:49:10.541 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.952+0000 7ff1137fe700 1 -- 172.21.15.49:0/2917880636 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff118024840 con 0x7ff11c1089e0 2024-06-02T23:49:10.541 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.952+0000 7ff12473f700 1 -- 172.21.15.49:0/2917880636 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff11c19f340 con 0x7ff11c1089e0 2024-06-02T23:49:10.541 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.952+0000 7ff1137fe700 1 -- 172.21.15.49:0/2917880636 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff118022020 con 0x7ff11c1089e0 2024-06-02T23:49:10.541 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.952+0000 7ff1137fe700 1 -- 172.21.15.49:0/2917880636 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff118011e00 con 0x7ff11c1089e0 2024-06-02T23:49:10.541 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.953+0000 7ff12473f700 1 -- 172.21.15.49:0/2917880636 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff11c063af0 con 0x7ff11c1089e0 2024-06-02T23:49:10.541 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:09.955+0000 7ff1137fe700 1 -- 172.21.15.49:0/2917880636 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7ff118043dd0 con 0x7ff11c1089e0 2024-06-02T23:49:10.541 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:10.029+0000 7ff12473f700 1 -- 172.21.15.49:0/2917880636 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7ff11c19f890 con 0x7ff11c1089e0 2024-06-02T23:49:10.541 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:10.030+0000 7ff1137fe700 1 -- 172.21.15.49:0/2917880636 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7ff118032020 con 0x7ff11c1089e0 2024-06-02T23:49:10.541 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:10.031+0000 7ff12473f700 1 -- 172.21.15.49:0/2917880636 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff11c1089e0 msgr2=0x7ff11c19be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:10.542 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:10.031+0000 7ff12473f700 1 --2- 172.21.15.49:0/2917880636 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff11c1089e0 0x7ff11c19be80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff118011b60 tx=0x7ff118011c40 comp rx=0 tx=0).stop 2024-06-02T23:49:10.542 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:10.031+0000 7ff12473f700 1 -- 172.21.15.49:0/2917880636 shutdown_connections 2024-06-02T23:49:10.542 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:10.031+0000 7ff12473f700 1 --2- 172.21.15.49:0/2917880636 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff11c1089e0 0x7ff11c19be80 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:10.542 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:10.031+0000 7ff12473f700 1 -- 172.21.15.49:0/2917880636 >> 172.21.15.49:0/2917880636 conn(0x7ff11c1023f0 msgr2=0x7ff11c102ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:10.542 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:10.031+0000 7ff12473f700 1 -- 172.21.15.49:0/2917880636 shutdown_connections 2024-06-02T23:49:10.542 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:10.031+0000 7ff12473f700 1 -- 172.21.15.49:0/2917880636 wait complete. 2024-06-02T23:49:10.542 INFO:teuthology.orchestra.run.smithi049.stdout:mgr not available, waiting (1/15)... 2024-06-02T23:49:10.711 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:10 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:10.282+0000 7f99b9ca3200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-02T23:49:11.908 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:11 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:11.554+0000 7f99b9ca3200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-02T23:49:11.908 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:11 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:11.730+0000 7f99b9ca3200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-02T23:49:11.908 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:11 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:11.907+0000 7f99b9ca3200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-02T23:49:12.461 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:12 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:12.207+0000 7f99b9ca3200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-02T23:49:12.461 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:12 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:12.303+0000 7f99b9ca3200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-02T23:49:12.781 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:12 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:12.514+0000 7f99b9ca3200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-02T23:49:12.782 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:12 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:12.723+0000 7f99b9ca3200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-02T23:49:13.368 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:13 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/1751368152' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-02T23:49:13.645 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:13 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:13.368+0000 7f99b9ca3200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-02T23:49:13.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-06-02T23:49:13.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2024-06-02T23:49:13.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsid": "890dd222-213a-11ef-bc9b-c7b262605968", 2024-06-02T23:49:13.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "health": { 2024-06-02T23:49:13.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-02T23:49:13.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-02T23:49:13.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-02T23:49:13.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:49:13.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-02T23:49:13.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-02T23:49:13.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 0 2024-06-02T23:49:13.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-06-02T23:49:13.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-02T23:49:13.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "a" 2024-06-02T23:49:13.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-06-02T23:49:13.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-06-02T23:49:13.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-02T23:49:13.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T23:49:13.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-06-02T23:49:13.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-02T23:49:13.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:49:13.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-02T23:49:13.660 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T23:49:13.660 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-02T23:49:13.660 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-02T23:49:13.660 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-02T23:49:13.660 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-02T23:49:13.660 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-02T23:49:13.660 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-02T23:49:13.660 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:49:13.660 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-02T23:49:13.660 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-02T23:49:13.660 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-02T23:49:13.660 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-02T23:49:13.660 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-02T23:49:13.660 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-02T23:49:13.660 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-02T23:49:13.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-02T23:49:13.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-02T23:49:13.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:49:13.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-02T23:49:13.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T23:49:13.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-02T23:49:13.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-02T23:49:13.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:49:13.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-02T23:49:13.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "available": false, 2024-06-02T23:49:13.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-02T23:49:13.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-02T23:49:13.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-02T23:49:13.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-02T23:49:13.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "restful" 2024-06-02T23:49:13.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-06-02T23:49:13.662 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T23:49:13.662 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:49:13.662 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-02T23:49:13.662 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T23:49:13.662 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modified": "2024-06-02T23:48:53.324009+0000", 2024-06-02T23:49:13.662 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T23:49:13.662 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:49:13.662 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-02T23:49:13.662 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2024-06-02T23:49:13.662 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.985+0000 7f8f526eb700 1 Processor -- start 2024-06-02T23:49:13.662 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.985+0000 7f8f526eb700 1 -- start start 2024-06-02T23:49:13.662 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.986+0000 7f8f526eb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f4c106e10 0x7f8f4c107230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:13.662 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.986+0000 7f8f526eb700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4c107770 con 0x7f8f4c106e10 2024-06-02T23:49:13.662 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.986+0000 7f8f4bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f4c106e10 0x7f8f4c107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:13.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.986+0000 7f8f4bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f4c106e10 0x7f8f4c107230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49316/0 (socket says 172.21.15.49:49316) 2024-06-02T23:49:13.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.986+0000 7f8f4bfff700 1 -- 172.21.15.49:0/343000728 learned_addr learned my addr 172.21.15.49:0/343000728 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:13.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.986+0000 7f8f4bfff700 1 -- 172.21.15.49:0/343000728 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f4c107f70 con 0x7f8f4c106e10 2024-06-02T23:49:13.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.986+0000 7f8f4bfff700 1 --2- 172.21.15.49:0/343000728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f4c106e10 0x7f8f4c107230 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c0098a0 tx=0x7f8f3c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b975941ac81542 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:13.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.986+0000 7f8f4affd700 1 -- 172.21.15.49:0/343000728 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f3c004160 con 0x7f8f4c106e10 2024-06-02T23:49:13.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.986+0000 7f8f4affd700 1 -- 172.21.15.49:0/343000728 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8f3c004300 con 0x7f8f4c106e10 2024-06-02T23:49:13.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.987+0000 7f8f4affd700 1 -- 172.21.15.49:0/343000728 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f3c011b50 con 0x7f8f4c106e10 2024-06-02T23:49:13.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.987+0000 7f8f526eb700 1 -- 172.21.15.49:0/343000728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f4c106e10 msgr2=0x7f8f4c107230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:13.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.987+0000 7f8f526eb700 1 --2- 172.21.15.49:0/343000728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f4c106e10 0x7f8f4c107230 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c0098a0 tx=0x7f8f3c009bb0 comp rx=0 tx=0).stop 2024-06-02T23:49:13.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.987+0000 7f8f526eb700 1 -- 172.21.15.49:0/343000728 shutdown_connections 2024-06-02T23:49:13.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.987+0000 7f8f526eb700 1 --2- 172.21.15.49:0/343000728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f4c106e10 0x7f8f4c107230 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:13.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.987+0000 7f8f526eb700 1 -- 172.21.15.49:0/343000728 >> 172.21.15.49:0/343000728 conn(0x7f8f4c1023f0 msgr2=0x7f8f4c104810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:13.663 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.987+0000 7f8f526eb700 1 -- 172.21.15.49:0/343000728 shutdown_connections 2024-06-02T23:49:13.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.987+0000 7f8f526eb700 1 -- 172.21.15.49:0/343000728 wait complete. 2024-06-02T23:49:13.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.988+0000 7f8f526eb700 1 Processor -- start 2024-06-02T23:49:13.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.988+0000 7f8f526eb700 1 -- start start 2024-06-02T23:49:13.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.988+0000 7f8f526eb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f4c106e10 0x7f8f4c19e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:13.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.988+0000 7f8f526eb700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4c07af40 con 0x7f8f4c106e10 2024-06-02T23:49:13.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.988+0000 7f8f4bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f4c106e10 0x7f8f4c19e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:13.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.988+0000 7f8f4bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f4c106e10 0x7f8f4c19e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49330/0 (socket says 172.21.15.49:49330) 2024-06-02T23:49:13.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.988+0000 7f8f4bfff700 1 -- 172.21.15.49:0/1751368152 learned_addr learned my addr 172.21.15.49:0/1751368152 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:13.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.989+0000 7f8f4bfff700 1 -- 172.21.15.49:0/1751368152 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f4c19e5e0 con 0x7f8f4c106e10 2024-06-02T23:49:13.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.989+0000 7f8f4bfff700 1 --2- 172.21.15.49:0/1751368152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f4c106e10 0x7f8f4c19e0a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c011670 tx=0x7f8f3c011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:13.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.989+0000 7f8f497fa700 1 -- 172.21.15.49:0/1751368152 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f3c0039c0 con 0x7f8f4c106e10 2024-06-02T23:49:13.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.989+0000 7f8f497fa700 1 -- 172.21.15.49:0/1751368152 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8f3c011e50 con 0x7f8f4c106e10 2024-06-02T23:49:13.664 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.989+0000 7f8f526eb700 1 -- 172.21.15.49:0/1751368152 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f4c19e870 con 0x7f8f4c106e10 2024-06-02T23:49:13.665 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.989+0000 7f8f497fa700 1 -- 172.21.15.49:0/1751368152 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f3c01a5c0 con 0x7f8f4c106e10 2024-06-02T23:49:13.665 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.989+0000 7f8f497fa700 1 -- 172.21.15.49:0/1751368152 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8f3c01ac50 con 0x7f8f4c106e10 2024-06-02T23:49:13.665 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.989+0000 7f8f526eb700 1 -- 172.21.15.49:0/1751368152 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f4c1a1560 con 0x7f8f4c106e10 2024-06-02T23:49:13.665 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.990+0000 7f8f497fa700 1 -- 172.21.15.49:0/1751368152 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8f3c0199e0 con 0x7f8f4c106e10 2024-06-02T23:49:13.665 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.990+0000 7f8f526eb700 1 -- 172.21.15.49:0/1751368152 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f4c063af0 con 0x7f8f4c106e10 2024-06-02T23:49:13.665 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:12.992+0000 7f8f497fa700 1 -- 172.21.15.49:0/1751368152 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f8f3c033080 con 0x7f8f4c106e10 2024-06-02T23:49:13.665 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:13.066+0000 7f8f526eb700 1 -- 172.21.15.49:0/1751368152 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f8f4c02df10 con 0x7f8f4c106e10 2024-06-02T23:49:13.665 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:13.067+0000 7f8f497fa700 1 -- 172.21.15.49:0/1751368152 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f8f3c003b60 con 0x7f8f4c106e10 2024-06-02T23:49:13.665 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:13.068+0000 7f8f526eb700 1 -- 172.21.15.49:0/1751368152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f4c106e10 msgr2=0x7f8f4c19e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:13.665 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:13.068+0000 7f8f526eb700 1 --2- 172.21.15.49:0/1751368152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f4c106e10 0x7f8f4c19e0a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c011670 tx=0x7f8f3c011b60 comp rx=0 tx=0).stop 2024-06-02T23:49:13.665 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:13.068+0000 7f8f526eb700 1 -- 172.21.15.49:0/1751368152 shutdown_connections 2024-06-02T23:49:13.665 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:13.068+0000 7f8f526eb700 1 --2- 172.21.15.49:0/1751368152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f4c106e10 0x7f8f4c19e0a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:13.665 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:13.068+0000 7f8f526eb700 1 -- 172.21.15.49:0/1751368152 >> 172.21.15.49:0/1751368152 conn(0x7f8f4c1023f0 msgr2=0x7f8f4c194be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:13.665 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:13.068+0000 7f8f526eb700 1 -- 172.21.15.49:0/1751368152 shutdown_connections 2024-06-02T23:49:13.665 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:13.068+0000 7f8f526eb700 1 -- 172.21.15.49:0/1751368152 wait complete. 2024-06-02T23:49:13.665 INFO:teuthology.orchestra.run.smithi049.stdout:mgr not available, waiting (2/15)... 2024-06-02T23:49:13.909 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:13 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:13.808+0000 7f99b9ca3200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-02T23:49:13.910 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:13 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:13.909+0000 7f99b9ca3200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-02T23:49:14.210 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:14 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:14.117+0000 7f99b9ca3200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-02T23:49:14.961 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:14 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:14.668+0000 7f99b9ca3200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-02T23:49:14.961 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:14 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:14.764+0000 7f99b9ca3200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-02T23:49:15.383 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:15 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:15.023+0000 7f99b9ca3200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-02T23:49:15.383 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:15 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:15.163+0000 7f99b9ca3200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-02T23:49:15.383 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:15 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:15.261+0000 7f99b9ca3200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-02T23:49:15.383 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:15 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:15.382+0000 7f99b9ca3200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-02T23:49:15.960 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:15 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:15.698+0000 7f99b9ca3200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-02T23:49:16.356 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:16 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/2145325098' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-02T23:49:16.710 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:16 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:16.355+0000 7f99b9ca3200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-02T23:49:16.711 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:16 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:16.583+0000 7f99b9ca3200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-02T23:49:16.722 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-06-02T23:49:16.722 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2024-06-02T23:49:16.722 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsid": "890dd222-213a-11ef-bc9b-c7b262605968", 2024-06-02T23:49:16.722 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "health": { 2024-06-02T23:49:16.722 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-02T23:49:16.722 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-02T23:49:16.723 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-02T23:49:16.723 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:49:16.723 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-02T23:49:16.723 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-02T23:49:16.723 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 0 2024-06-02T23:49:16.723 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-06-02T23:49:16.723 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-02T23:49:16.723 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "a" 2024-06-02T23:49:16.723 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-06-02T23:49:16.723 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-06-02T23:49:16.723 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-02T23:49:16.723 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T23:49:16.723 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-06-02T23:49:16.723 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-02T23:49:16.724 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:49:16.724 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-02T23:49:16.724 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T23:49:16.724 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-02T23:49:16.724 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-02T23:49:16.724 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-02T23:49:16.732 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-02T23:49:16.732 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-02T23:49:16.732 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-02T23:49:16.732 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:49:16.733 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-02T23:49:16.733 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-02T23:49:16.733 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-02T23:49:16.733 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-02T23:49:16.733 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-02T23:49:16.733 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-02T23:49:16.733 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-02T23:49:16.733 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-02T23:49:16.733 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-02T23:49:16.733 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:49:16.733 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-02T23:49:16.733 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T23:49:16.733 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-02T23:49:16.733 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-02T23:49:16.734 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:49:16.734 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-02T23:49:16.734 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "available": false, 2024-06-02T23:49:16.734 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-02T23:49:16.734 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-02T23:49:16.734 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-02T23:49:16.734 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-02T23:49:16.734 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "restful" 2024-06-02T23:49:16.735 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-06-02T23:49:16.735 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T23:49:16.735 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:49:16.735 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-02T23:49:16.735 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T23:49:16.735 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modified": "2024-06-02T23:48:53.324009+0000", 2024-06-02T23:49:16.735 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T23:49:16.735 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:49:16.735 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-02T23:49:16.735 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2024-06-02T23:49:16.735 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.091+0000 7f6a3b1f8700 1 Processor -- start 2024-06-02T23:49:16.735 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.091+0000 7f6a3b1f8700 1 -- start start 2024-06-02T23:49:16.735 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.091+0000 7f6a3b1f8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a341061e0 0x7f6a34106600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:16.735 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.091+0000 7f6a3b1f8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6a34106bd0 con 0x7f6a341061e0 2024-06-02T23:49:16.735 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.091+0000 7f6a38f94700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a341061e0 0x7f6a34106600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:16.736 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.091+0000 7f6a38f94700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a341061e0 0x7f6a34106600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49332/0 (socket says 172.21.15.49:49332) 2024-06-02T23:49:16.736 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.091+0000 7f6a38f94700 1 -- 172.21.15.49:0/41878556 learned_addr learned my addr 172.21.15.49:0/41878556 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:16.736 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.092+0000 7f6a38f94700 1 -- 172.21.15.49:0/41878556 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a34109170 con 0x7f6a341061e0 2024-06-02T23:49:16.736 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.092+0000 7f6a38f94700 1 --2- 172.21.15.49:0/41878556 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a341061e0 0x7f6a34106600 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6a280098a0 tx=0x7f6a28009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36b78deb3eaf4400 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:16.736 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.092+0000 7f6a337fe700 1 -- 172.21.15.49:0/41878556 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a28004160 con 0x7f6a341061e0 2024-06-02T23:49:16.736 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.092+0000 7f6a337fe700 1 -- 172.21.15.49:0/41878556 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6a28004300 con 0x7f6a341061e0 2024-06-02T23:49:16.736 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.092+0000 7f6a337fe700 1 -- 172.21.15.49:0/41878556 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a28011b50 con 0x7f6a341061e0 2024-06-02T23:49:16.736 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.093+0000 7f6a3b1f8700 1 -- 172.21.15.49:0/41878556 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a341061e0 msgr2=0x7f6a34106600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:16.736 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.093+0000 7f6a3b1f8700 1 --2- 172.21.15.49:0/41878556 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a341061e0 0x7f6a34106600 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6a280098a0 tx=0x7f6a28009bb0 comp rx=0 tx=0).stop 2024-06-02T23:49:16.736 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.093+0000 7f6a3b1f8700 1 -- 172.21.15.49:0/41878556 shutdown_connections 2024-06-02T23:49:16.736 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.093+0000 7f6a3b1f8700 1 --2- 172.21.15.49:0/41878556 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a341061e0 0x7f6a34106600 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:16.736 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.093+0000 7f6a3b1f8700 1 -- 172.21.15.49:0/41878556 >> 172.21.15.49:0/41878556 conn(0x7f6a34101b90 msgr2=0x7f6a34103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:16.736 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.093+0000 7f6a3b1f8700 1 -- 172.21.15.49:0/41878556 shutdown_connections 2024-06-02T23:49:16.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.093+0000 7f6a3b1f8700 1 -- 172.21.15.49:0/41878556 wait complete. 2024-06-02T23:49:16.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.093+0000 7f6a3b1f8700 1 Processor -- start 2024-06-02T23:49:16.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.093+0000 7f6a3b1f8700 1 -- start start 2024-06-02T23:49:16.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.094+0000 7f6a3b1f8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a341061e0 0x7f6a3419bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:16.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.094+0000 7f6a3b1f8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3410c520 con 0x7f6a341061e0 2024-06-02T23:49:16.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.094+0000 7f6a38f94700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a341061e0 0x7f6a3419bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:16.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.094+0000 7f6a38f94700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a341061e0 0x7f6a3419bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49338/0 (socket says 172.21.15.49:49338) 2024-06-02T23:49:16.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.094+0000 7f6a38f94700 1 -- 172.21.15.49:0/2145325098 learned_addr learned my addr 172.21.15.49:0/2145325098 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:16.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.094+0000 7f6a38f94700 1 -- 172.21.15.49:0/2145325098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a3419c3e0 con 0x7f6a341061e0 2024-06-02T23:49:16.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.094+0000 7f6a38f94700 1 --2- 172.21.15.49:0/2145325098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a341061e0 0x7f6a3419bea0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6a28000c00 tx=0x7f6a28011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:16.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.094+0000 7f6a31ffb700 1 -- 172.21.15.49:0/2145325098 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a28003b20 con 0x7f6a341061e0 2024-06-02T23:49:16.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.094+0000 7f6a31ffb700 1 -- 172.21.15.49:0/2145325098 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6a28003cc0 con 0x7f6a341061e0 2024-06-02T23:49:16.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.094+0000 7f6a3b1f8700 1 -- 172.21.15.49:0/2145325098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a3419c670 con 0x7f6a341061e0 2024-06-02T23:49:16.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.094+0000 7f6a31ffb700 1 -- 172.21.15.49:0/2145325098 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a28024910 con 0x7f6a341061e0 2024-06-02T23:49:16.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.095+0000 7f6a3b1f8700 1 -- 172.21.15.49:0/2145325098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a3419f360 con 0x7f6a341061e0 2024-06-02T23:49:16.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.095+0000 7f6a31ffb700 1 -- 172.21.15.49:0/2145325098 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6a28022020 con 0x7f6a341061e0 2024-06-02T23:49:16.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.095+0000 7f6a31ffb700 1 -- 172.21.15.49:0/2145325098 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6a28011e00 con 0x7f6a341061e0 2024-06-02T23:49:16.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.096+0000 7f6a3b1f8700 1 -- 172.21.15.49:0/2145325098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a34063af0 con 0x7f6a341061e0 2024-06-02T23:49:16.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.098+0000 7f6a31ffb700 1 -- 172.21.15.49:0/2145325098 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f6a2801acd0 con 0x7f6a341061e0 2024-06-02T23:49:16.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.171+0000 7f6a3b1f8700 1 -- 172.21.15.49:0/2145325098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f6a3419f530 con 0x7f6a341061e0 2024-06-02T23:49:16.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.171+0000 7f6a31ffb700 1 -- 172.21.15.49:0/2145325098 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f6a28032030 con 0x7f6a341061e0 2024-06-02T23:49:16.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.172+0000 7f6a3b1f8700 1 -- 172.21.15.49:0/2145325098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a341061e0 msgr2=0x7f6a3419bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:16.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.172+0000 7f6a3b1f8700 1 --2- 172.21.15.49:0/2145325098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a341061e0 0x7f6a3419bea0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6a28000c00 tx=0x7f6a28011c10 comp rx=0 tx=0).stop 2024-06-02T23:49:16.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.172+0000 7f6a3b1f8700 1 -- 172.21.15.49:0/2145325098 shutdown_connections 2024-06-02T23:49:16.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.172+0000 7f6a3b1f8700 1 --2- 172.21.15.49:0/2145325098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a341061e0 0x7f6a3419bea0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:16.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.172+0000 7f6a3b1f8700 1 -- 172.21.15.49:0/2145325098 >> 172.21.15.49:0/2145325098 conn(0x7f6a34101b90 msgr2=0x7f6a34102630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:16.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.173+0000 7f6a3b1f8700 1 -- 172.21.15.49:0/2145325098 shutdown_connections 2024-06-02T23:49:16.739 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:16.173+0000 7f6a3b1f8700 1 -- 172.21.15.49:0/2145325098 wait complete. 2024-06-02T23:49:16.739 INFO:teuthology.orchestra.run.smithi049.stdout:mgr not available, waiting (3/15)... 2024-06-02T23:49:17.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:17 smithi049 ceph-mon[32302]: Activating manager daemon x 2024-06-02T23:49:17.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:17 smithi049 ceph-mon[32302]: mgrmap e2: x(active, starting, since 0.00341174s) 2024-06-02T23:49:17.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:17 smithi049 ceph-mon[32302]: from='mgr.14100 172.21.15.49:0/505056779' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-02T23:49:17.712 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:17 smithi049 ceph-mon[32302]: from='mgr.14100 172.21.15.49:0/505056779' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-02T23:49:17.712 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:17 smithi049 ceph-mon[32302]: from='mgr.14100 172.21.15.49:0/505056779' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-02T23:49:17.712 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:17 smithi049 ceph-mon[32302]: from='mgr.14100 172.21.15.49:0/505056779' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T23:49:17.712 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:17 smithi049 ceph-mon[32302]: from='mgr.14100 172.21.15.49:0/505056779' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-02T23:49:17.712 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:17 smithi049 ceph-mon[32302]: Manager daemon x is now available 2024-06-02T23:49:17.712 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:17 smithi049 ceph-mon[32302]: from='mgr.14100 172.21.15.49:0/505056779' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-02T23:49:17.712 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:17 smithi049 ceph-mon[32302]: from='mgr.14100 172.21.15.49:0/505056779' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-02T23:49:17.713 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:17 smithi049 ceph-mon[32302]: from='mgr.14100 172.21.15.49:0/505056779' entity='mgr.x' 2024-06-02T23:49:17.713 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:17 smithi049 ceph-mon[32302]: from='mgr.14100 172.21.15.49:0/505056779' entity='mgr.x' 2024-06-02T23:49:17.713 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:17 smithi049 ceph-mon[32302]: from='mgr.14100 172.21.15.49:0/505056779' entity='mgr.x' 2024-06-02T23:49:18.854 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:18 smithi049 ceph-mon[32302]: mgrmap e3: x(active, since 1.00733s) 2024-06-02T23:49:19.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:19 smithi049 ceph-mon[32302]: mgrmap e4: x(active, since 2s) 2024-06-02T23:49:19.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:19 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/38611551' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-02T23:49:19.969 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-06-02T23:49:19.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2024-06-02T23:49:19.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsid": "890dd222-213a-11ef-bc9b-c7b262605968", 2024-06-02T23:49:19.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "health": { 2024-06-02T23:49:19.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-02T23:49:19.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-02T23:49:19.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-02T23:49:19.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:49:19.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-02T23:49:19.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-02T23:49:19.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 0 2024-06-02T23:49:19.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-06-02T23:49:19.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-02T23:49:19.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "a" 2024-06-02T23:49:19.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-06-02T23:49:19.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-06-02T23:49:19.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-02T23:49:19.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T23:49:19.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-06-02T23:49:19.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-02T23:49:19.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:49:19.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-02T23:49:19.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T23:49:19.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-02T23:49:19.972 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-02T23:49:19.972 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-02T23:49:19.972 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-02T23:49:19.972 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-02T23:49:19.972 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-02T23:49:19.972 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:49:19.972 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-02T23:49:19.972 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-02T23:49:19.972 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-02T23:49:19.972 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-02T23:49:19.972 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-02T23:49:19.972 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-02T23:49:19.972 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-02T23:49:19.972 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-02T23:49:19.973 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-02T23:49:19.973 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:49:19.973 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-02T23:49:19.973 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T23:49:19.973 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-02T23:49:19.973 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-02T23:49:19.973 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:49:19.973 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-02T23:49:19.973 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "available": true, 2024-06-02T23:49:19.973 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-02T23:49:19.973 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-02T23:49:19.973 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-02T23:49:19.973 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-02T23:49:19.973 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "restful" 2024-06-02T23:49:19.974 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-06-02T23:49:19.974 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T23:49:19.974 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:49:19.974 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-02T23:49:19.974 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T23:49:19.974 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modified": "2024-06-02T23:48:53.324009+0000", 2024-06-02T23:49:19.974 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T23:49:19.974 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-06-02T23:49:19.974 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-02T23:49:19.974 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2024-06-02T23:49:19.974 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.126+0000 7f75e212d700 1 Processor -- start 2024-06-02T23:49:19.974 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.127+0000 7f75e212d700 1 -- start start 2024-06-02T23:49:19.974 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.127+0000 7f75e212d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75dc107fb0 0x7f75dc1083d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:19.974 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.127+0000 7f75e212d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f75dc108910 con 0x7f75dc107fb0 2024-06-02T23:49:19.975 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.127+0000 7f75db7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75dc107fb0 0x7f75dc1083d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:19.975 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.127+0000 7f75db7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75dc107fb0 0x7f75dc1083d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49422/0 (socket says 172.21.15.49:49422) 2024-06-02T23:49:19.975 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.127+0000 7f75db7fe700 1 -- 172.21.15.49:0/934297826 learned_addr learned my addr 172.21.15.49:0/934297826 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:19.975 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.127+0000 7f75db7fe700 1 -- 172.21.15.49:0/934297826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75dc109070 con 0x7f75dc107fb0 2024-06-02T23:49:19.975 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.128+0000 7f75db7fe700 1 --2- 172.21.15.49:0/934297826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75dc107fb0 0x7f75dc1083d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f75cc0098a0 tx=0x7f75cc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d31c0b62600e0eb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:19.975 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.128+0000 7f75da7fc700 1 -- 172.21.15.49:0/934297826 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75cc004160 con 0x7f75dc107fb0 2024-06-02T23:49:19.975 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.128+0000 7f75da7fc700 1 -- 172.21.15.49:0/934297826 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f75cc004300 con 0x7f75dc107fb0 2024-06-02T23:49:19.975 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.128+0000 7f75da7fc700 1 -- 172.21.15.49:0/934297826 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75cc011b50 con 0x7f75dc107fb0 2024-06-02T23:49:19.975 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.128+0000 7f75e212d700 1 -- 172.21.15.49:0/934297826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75dc107fb0 msgr2=0x7f75dc1083d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:19.975 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.128+0000 7f75e212d700 1 --2- 172.21.15.49:0/934297826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75dc107fb0 0x7f75dc1083d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f75cc0098a0 tx=0x7f75cc009bb0 comp rx=0 tx=0).stop 2024-06-02T23:49:19.975 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.128+0000 7f75e212d700 1 -- 172.21.15.49:0/934297826 shutdown_connections 2024-06-02T23:49:19.975 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.129+0000 7f75e212d700 1 --2- 172.21.15.49:0/934297826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75dc107fb0 0x7f75dc1083d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:19.975 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.129+0000 7f75e212d700 1 -- 172.21.15.49:0/934297826 >> 172.21.15.49:0/934297826 conn(0x7f75dc103550 msgr2=0x7f75dc105990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:19.976 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.129+0000 7f75e212d700 1 -- 172.21.15.49:0/934297826 shutdown_connections 2024-06-02T23:49:19.976 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.129+0000 7f75e212d700 1 -- 172.21.15.49:0/934297826 wait complete. 2024-06-02T23:49:19.976 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.129+0000 7f75e212d700 1 Processor -- start 2024-06-02T23:49:19.976 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.129+0000 7f75e212d700 1 -- start start 2024-06-02T23:49:19.976 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.130+0000 7f75e212d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75dc107fb0 0x7f75dc19e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:19.976 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.130+0000 7f75e212d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f75dc07c050 con 0x7f75dc107fb0 2024-06-02T23:49:19.976 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.130+0000 7f75db7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75dc107fb0 0x7f75dc19e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:19.976 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.130+0000 7f75db7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75dc107fb0 0x7f75dc19e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49426/0 (socket says 172.21.15.49:49426) 2024-06-02T23:49:19.976 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.130+0000 7f75db7fe700 1 -- 172.21.15.49:0/38611551 learned_addr learned my addr 172.21.15.49:0/38611551 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:19.976 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.130+0000 7f75db7fe700 1 -- 172.21.15.49:0/38611551 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75dc19e5a0 con 0x7f75dc107fb0 2024-06-02T23:49:19.976 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.130+0000 7f75db7fe700 1 --2- 172.21.15.49:0/38611551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75dc107fb0 0x7f75dc19e060 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f75cc011670 tx=0x7f75cc011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:19.976 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.130+0000 7f75d8ff9700 1 -- 172.21.15.49:0/38611551 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75cc0039c0 con 0x7f75dc107fb0 2024-06-02T23:49:19.976 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.130+0000 7f75e212d700 1 -- 172.21.15.49:0/38611551 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75dc19e830 con 0x7f75dc107fb0 2024-06-02T23:49:19.976 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.130+0000 7f75d8ff9700 1 -- 172.21.15.49:0/38611551 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f75cc011e50 con 0x7f75dc107fb0 2024-06-02T23:49:19.977 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.130+0000 7f75d8ff9700 1 -- 172.21.15.49:0/38611551 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75cc01a5c0 con 0x7f75dc107fb0 2024-06-02T23:49:19.977 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.130+0000 7f75e212d700 1 -- 172.21.15.49:0/38611551 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75dc1a1520 con 0x7f75dc107fb0 2024-06-02T23:49:19.977 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.131+0000 7f75d8ff9700 1 -- 172.21.15.49:0/38611551 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f75cc01a8c0 con 0x7f75dc107fb0 2024-06-02T23:49:19.977 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.131+0000 7f75d8ff9700 1 --2- 172.21.15.49:0/38611551 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7f75c8038fb0 0x7f75c803b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:19.977 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.132+0000 7f75d8ff9700 1 -- 172.21.15.49:0/38611551 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f75cc04d520 con 0x7f75dc107fb0 2024-06-02T23:49:19.977 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.132+0000 7f75daffd700 1 --2- 172.21.15.49:0/38611551 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7f75c8038fb0 0x7f75c803b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:19.977 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.132+0000 7f75e212d700 1 -- 172.21.15.49:0/38611551 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75dc063af0 con 0x7f75dc107fb0 2024-06-02T23:49:19.977 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.132+0000 7f75daffd700 1 --2- 172.21.15.49:0/38611551 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7f75c8038fb0 0x7f75c803b470 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f75c4006fd0 tx=0x7f75c4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:19.977 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.137+0000 7f75d8ff9700 1 -- 172.21.15.49:0/38611551 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f75cc019c70 con 0x7f75dc107fb0 2024-06-02T23:49:19.977 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.427+0000 7f75e212d700 1 -- 172.21.15.49:0/38611551 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f75dc02de90 con 0x7f75dc107fb0 2024-06-02T23:49:19.977 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.428+0000 7f75d8ff9700 1 -- 172.21.15.49:0/38611551 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f75cc02cc00 con 0x7f75dc107fb0 2024-06-02T23:49:19.977 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.431+0000 7f75e212d700 1 -- 172.21.15.49:0/38611551 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7f75c8038fb0 msgr2=0x7f75c803b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:19.977 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.431+0000 7f75e212d700 1 --2- 172.21.15.49:0/38611551 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7f75c8038fb0 0x7f75c803b470 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f75c4006fd0 tx=0x7f75c4006e40 comp rx=0 tx=0).stop 2024-06-02T23:49:19.978 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.431+0000 7f75e212d700 1 -- 172.21.15.49:0/38611551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75dc107fb0 msgr2=0x7f75dc19e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:19.978 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.431+0000 7f75e212d700 1 --2- 172.21.15.49:0/38611551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75dc107fb0 0x7f75dc19e060 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f75cc011670 tx=0x7f75cc011b60 comp rx=0 tx=0).stop 2024-06-02T23:49:19.978 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.431+0000 7f75e212d700 1 -- 172.21.15.49:0/38611551 shutdown_connections 2024-06-02T23:49:19.978 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.431+0000 7f75e212d700 1 --2- 172.21.15.49:0/38611551 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7f75c8038fb0 0x7f75c803b470 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:19.978 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.431+0000 7f75e212d700 1 --2- 172.21.15.49:0/38611551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75dc107fb0 0x7f75dc19e060 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:19.978 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.431+0000 7f75e212d700 1 -- 172.21.15.49:0/38611551 >> 172.21.15.49:0/38611551 conn(0x7f75dc103550 msgr2=0x7f75dc105990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:19.979 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.431+0000 7f75e212d700 1 -- 172.21.15.49:0/38611551 shutdown_connections 2024-06-02T23:49:19.979 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:19.431+0000 7f75e212d700 1 -- 172.21.15.49:0/38611551 wait complete. 2024-06-02T23:49:19.979 INFO:teuthology.orchestra.run.smithi049.stdout:mgr is available 2024-06-02T23:49:20.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:20 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3791506614' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-06-02T23:49:21.149 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-06-02T23:49:21.150 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout [global] 2024-06-02T23:49:21.150 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout fsid = 890dd222-213a-11ef-bc9b-c7b262605968 2024-06-02T23:49:21.150 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-06-02T23:49:21.150 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-06-02T23:49:21.150 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-06-02T23:49:21.150 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-06-02T23:49:21.150 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-06-02T23:49:21.150 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout [mgr] 2024-06-02T23:49:21.150 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-06-02T23:49:21.150 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-06-02T23:49:21.150 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout [osd] 2024-06-02T23:49:21.150 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-06-02T23:49:21.151 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-06-02T23:49:21.151 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-06-02T23:49:21.151 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-06-02T23:49:21.151 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-06-02T23:49:21.151 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.399+0000 7fc767943700 1 Processor -- start 2024-06-02T23:49:21.151 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.399+0000 7fc767943700 1 -- start start 2024-06-02T23:49:21.151 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.399+0000 7fc767943700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc760107fb0 0x7fc7601083d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:21.151 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.399+0000 7fc767943700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc760108910 con 0x7fc760107fb0 2024-06-02T23:49:21.151 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.399+0000 7fc7656df700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc760107fb0 0x7fc7601083d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:21.151 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.399+0000 7fc7656df700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc760107fb0 0x7fc7601083d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49438/0 (socket says 172.21.15.49:49438) 2024-06-02T23:49:21.151 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.399+0000 7fc7656df700 1 -- 172.21.15.49:0/771029444 learned_addr learned my addr 172.21.15.49:0/771029444 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:21.151 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.400+0000 7fc7656df700 1 -- 172.21.15.49:0/771029444 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc760109070 con 0x7fc760107fb0 2024-06-02T23:49:21.151 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.400+0000 7fc7656df700 1 --2- 172.21.15.49:0/771029444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc760107fb0 0x7fc7601083d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc75c0098a0 tx=0x7fc75c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1647d871b4873f76 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:21.151 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.400+0000 7fc757fff700 1 -- 172.21.15.49:0/771029444 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc75c004160 con 0x7fc760107fb0 2024-06-02T23:49:21.152 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.400+0000 7fc757fff700 1 -- 172.21.15.49:0/771029444 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc75c004300 con 0x7fc760107fb0 2024-06-02T23:49:21.152 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.400+0000 7fc757fff700 1 -- 172.21.15.49:0/771029444 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc75c011b50 con 0x7fc760107fb0 2024-06-02T23:49:21.152 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.401+0000 7fc767943700 1 -- 172.21.15.49:0/771029444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc760107fb0 msgr2=0x7fc7601083d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:21.152 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.401+0000 7fc767943700 1 --2- 172.21.15.49:0/771029444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc760107fb0 0x7fc7601083d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc75c0098a0 tx=0x7fc75c009bb0 comp rx=0 tx=0).stop 2024-06-02T23:49:21.152 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.401+0000 7fc767943700 1 -- 172.21.15.49:0/771029444 shutdown_connections 2024-06-02T23:49:21.152 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.401+0000 7fc767943700 1 --2- 172.21.15.49:0/771029444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc760107fb0 0x7fc7601083d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:21.152 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.401+0000 7fc767943700 1 -- 172.21.15.49:0/771029444 >> 172.21.15.49:0/771029444 conn(0x7fc760103550 msgr2=0x7fc760105990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:21.152 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.401+0000 7fc767943700 1 -- 172.21.15.49:0/771029444 shutdown_connections 2024-06-02T23:49:21.152 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.401+0000 7fc767943700 1 -- 172.21.15.49:0/771029444 wait complete. 2024-06-02T23:49:21.152 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.401+0000 7fc767943700 1 Processor -- start 2024-06-02T23:49:21.152 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.401+0000 7fc767943700 1 -- start start 2024-06-02T23:49:21.152 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.402+0000 7fc767943700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc760107fb0 0x7fc76019be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:21.152 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.402+0000 7fc767943700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc76010c4b0 con 0x7fc760107fb0 2024-06-02T23:49:21.153 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.402+0000 7fc7656df700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc760107fb0 0x7fc76019be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:21.153 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.402+0000 7fc7656df700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc760107fb0 0x7fc76019be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49448/0 (socket says 172.21.15.49:49448) 2024-06-02T23:49:21.153 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.402+0000 7fc7656df700 1 -- 172.21.15.49:0/3791506614 learned_addr learned my addr 172.21.15.49:0/3791506614 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:21.153 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.402+0000 7fc7656df700 1 -- 172.21.15.49:0/3791506614 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc76019c3d0 con 0x7fc760107fb0 2024-06-02T23:49:21.153 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.402+0000 7fc7656df700 1 --2- 172.21.15.49:0/3791506614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc760107fb0 0x7fc76019be90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc75c011b60 tx=0x7fc75c011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:21.153 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.402+0000 7fc7567fc700 1 -- 172.21.15.49:0/3791506614 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc75c003b20 con 0x7fc760107fb0 2024-06-02T23:49:21.153 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.402+0000 7fc7567fc700 1 -- 172.21.15.49:0/3791506614 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc75c003cc0 con 0x7fc760107fb0 2024-06-02T23:49:21.153 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.402+0000 7fc767943700 1 -- 172.21.15.49:0/3791506614 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc76019c660 con 0x7fc760107fb0 2024-06-02T23:49:21.153 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.402+0000 7fc7567fc700 1 -- 172.21.15.49:0/3791506614 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc75c024840 con 0x7fc760107fb0 2024-06-02T23:49:21.153 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.402+0000 7fc767943700 1 -- 172.21.15.49:0/3791506614 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc76019f350 con 0x7fc760107fb0 2024-06-02T23:49:21.153 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.403+0000 7fc7567fc700 1 -- 172.21.15.49:0/3791506614 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fc75c022020 con 0x7fc760107fb0 2024-06-02T23:49:21.154 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.404+0000 7fc767943700 1 -- 172.21.15.49:0/3791506614 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc760063af0 con 0x7fc760107fb0 2024-06-02T23:49:21.154 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.404+0000 7fc7567fc700 1 --2- 172.21.15.49:0/3791506614 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7fc74c039050 0x7fc74c03b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:21.154 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.404+0000 7fc7567fc700 1 -- 172.21.15.49:0/3791506614 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc75c011e00 con 0x7fc760107fb0 2024-06-02T23:49:21.154 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.404+0000 7fc764ede700 1 --2- 172.21.15.49:0/3791506614 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7fc74c039050 0x7fc74c03b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:21.154 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.404+0000 7fc764ede700 1 --2- 172.21.15.49:0/3791506614 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7fc74c039050 0x7fc74c03b510 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc750006fd0 tx=0x7fc750006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:21.154 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.409+0000 7fc7567fc700 1 -- 172.21.15.49:0/3791506614 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc75c04cc60 con 0x7fc760107fb0 2024-06-02T23:49:21.154 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.612+0000 7fc767943700 1 -- 172.21.15.49:0/3791506614 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fc76019f520 con 0x7fc760107fb0 2024-06-02T23:49:21.154 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.613+0000 7fc7567fc700 1 -- 172.21.15.49:0/3791506614 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+373 (secure 0 0 0) 0x7fc76019f520 con 0x7fc760107fb0 2024-06-02T23:49:21.154 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.616+0000 7fc767943700 1 -- 172.21.15.49:0/3791506614 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7fc74c039050 msgr2=0x7fc74c03b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:21.154 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.616+0000 7fc767943700 1 --2- 172.21.15.49:0/3791506614 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7fc74c039050 0x7fc74c03b510 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc750006fd0 tx=0x7fc750006e40 comp rx=0 tx=0).stop 2024-06-02T23:49:21.154 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.616+0000 7fc767943700 1 -- 172.21.15.49:0/3791506614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc760107fb0 msgr2=0x7fc76019be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:21.154 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.616+0000 7fc767943700 1 --2- 172.21.15.49:0/3791506614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc760107fb0 0x7fc76019be90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc75c011b60 tx=0x7fc75c011c40 comp rx=0 tx=0).stop 2024-06-02T23:49:21.155 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.616+0000 7fc767943700 1 -- 172.21.15.49:0/3791506614 shutdown_connections 2024-06-02T23:49:21.155 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.616+0000 7fc767943700 1 --2- 172.21.15.49:0/3791506614 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7fc74c039050 0x7fc74c03b510 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:21.155 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.616+0000 7fc767943700 1 --2- 172.21.15.49:0/3791506614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc760107fb0 0x7fc76019be90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:21.155 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.616+0000 7fc767943700 1 -- 172.21.15.49:0/3791506614 >> 172.21.15.49:0/3791506614 conn(0x7fc760103550 msgr2=0x7fc760104060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:21.155 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.616+0000 7fc767943700 1 -- 172.21.15.49:0/3791506614 shutdown_connections 2024-06-02T23:49:21.155 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:20.616+0000 7fc767943700 1 -- 172.21.15.49:0/3791506614 wait complete. 2024-06-02T23:49:21.155 INFO:teuthology.orchestra.run.smithi049.stdout:Enabling cephadm module... 2024-06-02T23:49:22.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:21 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/2876245819' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-06-02T23:49:22.211 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:21 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: ignoring --setuser ceph since I am not root 2024-06-02T23:49:22.211 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:21 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: ignoring --setgroup ceph since I am not root 2024-06-02T23:49:22.211 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:22 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:22.088+0000 7f3db6630200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-02T23:49:22.490 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.588+0000 7fa361775700 1 Processor -- start 2024-06-02T23:49:22.491 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.588+0000 7fa361775700 1 -- start start 2024-06-02T23:49:22.491 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.588+0000 7fa361775700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa35c108a00 0x7fa35c10adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:22.491 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:22 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:22.285+0000 7f3db6630200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-02T23:49:22.491 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:22 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:22.391+0000 7f3db6630200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-02T23:49:22.496 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.588+0000 7fa361775700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa35c075db0 con 0x7fa35c108a00 2024-06-02T23:49:22.496 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.589+0000 7fa35affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa35c108a00 0x7fa35c10adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:22.496 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.589+0000 7fa35affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa35c108a00 0x7fa35c10adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49460/0 (socket says 172.21.15.49:49460) 2024-06-02T23:49:22.496 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.589+0000 7fa35affd700 1 -- 172.21.15.49:0/8503365 learned_addr learned my addr 172.21.15.49:0/8503365 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:22.496 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.589+0000 7fa35affd700 1 -- 172.21.15.49:0/8503365 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa35c10b330 con 0x7fa35c108a00 2024-06-02T23:49:22.496 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.589+0000 7fa35affd700 1 --2- 172.21.15.49:0/8503365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa35c108a00 0x7fa35c10adf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa34c0098a0 tx=0x7fa34c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=844283adc49e2bdc server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:22.496 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.589+0000 7fa35a7fc700 1 -- 172.21.15.49:0/8503365 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa34c004160 con 0x7fa35c108a00 2024-06-02T23:49:22.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.589+0000 7fa35a7fc700 1 -- 172.21.15.49:0/8503365 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa34c004300 con 0x7fa35c108a00 2024-06-02T23:49:22.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.589+0000 7fa35a7fc700 1 -- 172.21.15.49:0/8503365 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa34c011b50 con 0x7fa35c108a00 2024-06-02T23:49:22.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.590+0000 7fa361775700 1 -- 172.21.15.49:0/8503365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa35c108a00 msgr2=0x7fa35c10adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:22.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.590+0000 7fa361775700 1 --2- 172.21.15.49:0/8503365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa35c108a00 0x7fa35c10adf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa34c0098a0 tx=0x7fa34c009bb0 comp rx=0 tx=0).stop 2024-06-02T23:49:22.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.590+0000 7fa361775700 1 -- 172.21.15.49:0/8503365 shutdown_connections 2024-06-02T23:49:22.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.590+0000 7fa361775700 1 --2- 172.21.15.49:0/8503365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa35c108a00 0x7fa35c10adf0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:22.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.590+0000 7fa361775700 1 -- 172.21.15.49:0/8503365 >> 172.21.15.49:0/8503365 conn(0x7fa35c102410 msgr2=0x7fa35c104830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:22.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.590+0000 7fa361775700 1 -- 172.21.15.49:0/8503365 shutdown_connections 2024-06-02T23:49:22.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.590+0000 7fa361775700 1 -- 172.21.15.49:0/8503365 wait complete. 2024-06-02T23:49:22.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.591+0000 7fa361775700 1 Processor -- start 2024-06-02T23:49:22.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.591+0000 7fa361775700 1 -- start start 2024-06-02T23:49:22.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.591+0000 7fa361775700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa35c108a00 0x7fa35c19bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:22.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.591+0000 7fa361775700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa35c10c350 con 0x7fa35c108a00 2024-06-02T23:49:22.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.591+0000 7fa35affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa35c108a00 0x7fa35c19bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:22.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.591+0000 7fa35affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa35c108a00 0x7fa35c19bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49468/0 (socket says 172.21.15.49:49468) 2024-06-02T23:49:22.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.591+0000 7fa35affd700 1 -- 172.21.15.49:0/2876245819 learned_addr learned my addr 172.21.15.49:0/2876245819 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:22.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.591+0000 7fa35affd700 1 -- 172.21.15.49:0/2876245819 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa35c19c3e0 con 0x7fa35c108a00 2024-06-02T23:49:22.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.591+0000 7fa35affd700 1 --2- 172.21.15.49:0/2876245819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa35c108a00 0x7fa35c19bea0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa34c011670 tx=0x7fa34c011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:22.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.592+0000 7fa358ff9700 1 -- 172.21.15.49:0/2876245819 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa34c0039c0 con 0x7fa35c108a00 2024-06-02T23:49:22.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.592+0000 7fa358ff9700 1 -- 172.21.15.49:0/2876245819 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa34c011e50 con 0x7fa35c108a00 2024-06-02T23:49:22.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.592+0000 7fa361775700 1 -- 172.21.15.49:0/2876245819 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa35c19c670 con 0x7fa35c108a00 2024-06-02T23:49:22.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.592+0000 7fa358ff9700 1 -- 172.21.15.49:0/2876245819 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa34c01a5c0 con 0x7fa35c108a00 2024-06-02T23:49:22.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.592+0000 7fa361775700 1 -- 172.21.15.49:0/2876245819 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa35c19f360 con 0x7fa35c108a00 2024-06-02T23:49:22.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.593+0000 7fa358ff9700 1 -- 172.21.15.49:0/2876245819 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fa34c01a870 con 0x7fa35c108a00 2024-06-02T23:49:22.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.593+0000 7fa361775700 1 -- 172.21.15.49:0/2876245819 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa35c063af0 con 0x7fa35c108a00 2024-06-02T23:49:22.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.593+0000 7fa358ff9700 1 --2- 172.21.15.49:0/2876245819 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7fa348039000 0x7fa34803b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:22.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.593+0000 7fa358ff9700 1 -- 172.21.15.49:0/2876245819 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa34c04d490 con 0x7fa35c108a00 2024-06-02T23:49:22.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.593+0000 7fa3527fc700 1 --2- 172.21.15.49:0/2876245819 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7fa348039000 0x7fa34803b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:22.499 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.593+0000 7fa3527fc700 1 --2- 172.21.15.49:0/2876245819 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7fa348039000 0x7fa34803b4c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa344006fd0 tx=0x7fa344006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:22.499 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.598+0000 7fa358ff9700 1 -- 172.21.15.49:0/2876245819 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa34c019c70 con 0x7fa35c108a00 2024-06-02T23:49:22.499 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.863+0000 7fa361775700 1 -- 172.21.15.49:0/2876245819 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fa35c19f530 con 0x7fa35c108a00 2024-06-02T23:49:22.499 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.914+0000 7fa358ff9700 1 -- 172.21.15.49:0/2876245819 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fa35c19f530 con 0x7fa35c108a00 2024-06-02T23:49:22.499 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.916+0000 7fa358ff9700 1 -- 172.21.15.49:0/2876245819 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fa34c02d910 con 0x7fa35c108a00 2024-06-02T23:49:22.499 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.917+0000 7fa361775700 1 -- 172.21.15.49:0/2876245819 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7fa348039000 msgr2=0x7fa34803b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:22.499 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.917+0000 7fa361775700 1 --2- 172.21.15.49:0/2876245819 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7fa348039000 0x7fa34803b4c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa344006fd0 tx=0x7fa344006e40 comp rx=0 tx=0).stop 2024-06-02T23:49:22.499 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.917+0000 7fa361775700 1 -- 172.21.15.49:0/2876245819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa35c108a00 msgr2=0x7fa35c19bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:22.499 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.917+0000 7fa361775700 1 --2- 172.21.15.49:0/2876245819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa35c108a00 0x7fa35c19bea0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa34c011670 tx=0x7fa34c011b60 comp rx=0 tx=0).stop 2024-06-02T23:49:22.499 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.917+0000 7fa361775700 1 -- 172.21.15.49:0/2876245819 shutdown_connections 2024-06-02T23:49:22.499 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.917+0000 7fa361775700 1 --2- 172.21.15.49:0/2876245819 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7fa348039000 0x7fa34803b4c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:22.499 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.917+0000 7fa361775700 1 --2- 172.21.15.49:0/2876245819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa35c108a00 0x7fa35c19bea0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:22.499 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.917+0000 7fa361775700 1 -- 172.21.15.49:0/2876245819 >> 172.21.15.49:0/2876245819 conn(0x7fa35c102410 msgr2=0x7fa35c102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:22.499 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.917+0000 7fa361775700 1 -- 172.21.15.49:0/2876245819 shutdown_connections 2024-06-02T23:49:22.500 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:21.917+0000 7fa361775700 1 -- 172.21.15.49:0/2876245819 wait complete. 2024-06-02T23:49:22.745 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:22 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:22.718+0000 7f3db6630200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-02T23:49:23.149 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:22 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/2876245819' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-06-02T23:49:23.150 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:22 smithi049 ceph-mon[32302]: mgrmap e5: x(active, since 5s) 2024-06-02T23:49:23.150 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:22 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:22.810+0000 7f3db6630200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-02T23:49:23.715 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2024-06-02T23:49:23.715 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-06-02T23:49:23.715 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "available": true, 2024-06-02T23:49:23.715 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-06-02T23:49:23.715 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-06-02T23:49:23.715 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2024-06-02T23:49:23.715 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.942+0000 7f8b80a23700 1 Processor -- start 2024-06-02T23:49:23.716 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.942+0000 7f8b80a23700 1 -- start start 2024-06-02T23:49:23.716 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.943+0000 7f8b80a23700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b7c106200 0x7f8b7c106620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:23.716 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.943+0000 7f8b80a23700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7c106bf0 con 0x7f8b7c106200 2024-06-02T23:49:23.716 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.943+0000 7f8b7a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b7c106200 0x7f8b7c106620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:23.716 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.943+0000 7f8b7a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b7c106200 0x7f8b7c106620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59610/0 (socket says 172.21.15.49:59610) 2024-06-02T23:49:23.716 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.943+0000 7f8b7a59c700 1 -- 172.21.15.49:0/1270956068 learned_addr learned my addr 172.21.15.49:0/1270956068 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:23.716 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.943+0000 7f8b7a59c700 1 -- 172.21.15.49:0/1270956068 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b7c109190 con 0x7f8b7c106200 2024-06-02T23:49:23.716 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.943+0000 7f8b7a59c700 1 --2- 172.21.15.49:0/1270956068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b7c106200 0x7f8b7c106620 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0098a0 tx=0x7f8b6c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d414cae071d6f06d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:23.716 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.943+0000 7f8b7959a700 1 -- 172.21.15.49:0/1270956068 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b6c004160 con 0x7f8b7c106200 2024-06-02T23:49:23.716 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.944+0000 7f8b7959a700 1 -- 172.21.15.49:0/1270956068 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8b6c004300 con 0x7f8b7c106200 2024-06-02T23:49:23.716 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.944+0000 7f8b7959a700 1 -- 172.21.15.49:0/1270956068 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b6c011b50 con 0x7f8b7c106200 2024-06-02T23:49:23.716 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.944+0000 7f8b80a23700 1 -- 172.21.15.49:0/1270956068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b7c106200 msgr2=0x7f8b7c106620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:23.716 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.944+0000 7f8b80a23700 1 --2- 172.21.15.49:0/1270956068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b7c106200 0x7f8b7c106620 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0098a0 tx=0x7f8b6c009bb0 comp rx=0 tx=0).stop 2024-06-02T23:49:23.716 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.944+0000 7f8b80a23700 1 -- 172.21.15.49:0/1270956068 shutdown_connections 2024-06-02T23:49:23.716 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.944+0000 7f8b80a23700 1 --2- 172.21.15.49:0/1270956068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b7c106200 0x7f8b7c106620 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:23.717 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.944+0000 7f8b80a23700 1 -- 172.21.15.49:0/1270956068 >> 172.21.15.49:0/1270956068 conn(0x7f8b7c101bd0 msgr2=0x7f8b7c103ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:23.717 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.944+0000 7f8b80a23700 1 -- 172.21.15.49:0/1270956068 shutdown_connections 2024-06-02T23:49:23.717 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.944+0000 7f8b80a23700 1 -- 172.21.15.49:0/1270956068 wait complete. 2024-06-02T23:49:23.717 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.945+0000 7f8b80a23700 1 Processor -- start 2024-06-02T23:49:23.717 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.945+0000 7f8b80a23700 1 -- start start 2024-06-02T23:49:23.717 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.945+0000 7f8b80a23700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b7c106200 0x7f8b7c19be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:23.717 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.945+0000 7f8b80a23700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7c10c540 con 0x7f8b7c106200 2024-06-02T23:49:23.717 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.945+0000 7f8b7a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b7c106200 0x7f8b7c19be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:23.717 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.945+0000 7f8b7a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b7c106200 0x7f8b7c19be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59616/0 (socket says 172.21.15.49:59616) 2024-06-02T23:49:23.717 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.945+0000 7f8b7a59c700 1 -- 172.21.15.49:0/3061641573 learned_addr learned my addr 172.21.15.49:0/3061641573 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:23.717 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.946+0000 7f8b7a59c700 1 -- 172.21.15.49:0/3061641573 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b7c19c3d0 con 0x7f8b7c106200 2024-06-02T23:49:23.718 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.946+0000 7f8b7a59c700 1 --2- 172.21.15.49:0/3061641573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b7c106200 0x7f8b7c19be90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c011670 tx=0x7f8b6c011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:23.718 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.946+0000 7f8b6b7fe700 1 -- 172.21.15.49:0/3061641573 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b6c0039c0 con 0x7f8b7c106200 2024-06-02T23:49:23.718 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.946+0000 7f8b6b7fe700 1 -- 172.21.15.49:0/3061641573 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8b6c011e50 con 0x7f8b7c106200 2024-06-02T23:49:23.718 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.946+0000 7f8b80a23700 1 -- 172.21.15.49:0/3061641573 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b7c19c660 con 0x7f8b7c106200 2024-06-02T23:49:23.718 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.946+0000 7f8b6b7fe700 1 -- 172.21.15.49:0/3061641573 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b6c01a5c0 con 0x7f8b7c106200 2024-06-02T23:49:23.718 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.946+0000 7f8b80a23700 1 -- 172.21.15.49:0/3061641573 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b7c19f350 con 0x7f8b7c106200 2024-06-02T23:49:23.718 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.947+0000 7f8b6b7fe700 1 -- 172.21.15.49:0/3061641573 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f8b6c01a870 con 0x7f8b7c106200 2024-06-02T23:49:23.718 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.947+0000 7f8b80a23700 1 -- 172.21.15.49:0/3061641573 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b7c063af0 con 0x7f8b7c106200 2024-06-02T23:49:23.718 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.948+0000 7f8b6b7fe700 1 --2- 172.21.15.49:0/3061641573 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7f8b64039050 0x7f8b6403b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:23.718 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.948+0000 7f8b6b7fe700 1 -- 172.21.15.49:0/3061641573 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8b6c04d490 con 0x7f8b7c106200 2024-06-02T23:49:23.718 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.948+0000 7f8b79d9b700 1 -- 172.21.15.49:0/3061641573 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7f8b64039050 msgr2=0x7f8b6403b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/549058216 2024-06-02T23:49:23.719 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.948+0000 7f8b79d9b700 1 --2- 172.21.15.49:0/3061641573 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7f8b64039050 0x7f8b6403b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T23:49:23.719 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:22.953+0000 7f8b6b7fe700 1 -- 172.21.15.49:0/3061641573 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8b6c019c70 con 0x7f8b7c106200 2024-06-02T23:49:23.719 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:23.149+0000 7f8b79d9b700 1 -- 172.21.15.49:0/3061641573 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7f8b64039050 msgr2=0x7f8b6403b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/549058216 2024-06-02T23:49:23.719 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:23.149+0000 7f8b79d9b700 1 --2- 172.21.15.49:0/3061641573 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7f8b64039050 0x7f8b6403b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-02T23:49:23.719 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:23.243+0000 7f8b80a23700 1 -- 172.21.15.49:0/3061641573 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f8b7c19f520 con 0x7f8b7c106200 2024-06-02T23:49:23.719 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:23.244+0000 7f8b6b7fe700 1 -- 172.21.15.49:0/3061641573 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f8b7c19f520 con 0x7f8b7c106200 2024-06-02T23:49:23.719 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:23.248+0000 7f8b80a23700 1 -- 172.21.15.49:0/3061641573 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7f8b64039050 msgr2=0x7f8b6403b510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T23:49:23.719 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:23.248+0000 7f8b80a23700 1 --2- 172.21.15.49:0/3061641573 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7f8b64039050 0x7f8b6403b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:23.719 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:23.249+0000 7f8b80a23700 1 -- 172.21.15.49:0/3061641573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b7c106200 msgr2=0x7f8b7c19be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:23.719 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:23.249+0000 7f8b80a23700 1 --2- 172.21.15.49:0/3061641573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b7c106200 0x7f8b7c19be90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c011670 tx=0x7f8b6c011b60 comp rx=0 tx=0).stop 2024-06-02T23:49:23.719 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:23.249+0000 7f8b80a23700 1 -- 172.21.15.49:0/3061641573 shutdown_connections 2024-06-02T23:49:23.720 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:23.249+0000 7f8b80a23700 1 --2- 172.21.15.49:0/3061641573 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7f8b64039050 0x7f8b6403b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:23.720 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:23.249+0000 7f8b80a23700 1 --2- 172.21.15.49:0/3061641573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b7c106200 0x7f8b7c19be90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:23.720 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:23.249+0000 7f8b80a23700 1 -- 172.21.15.49:0/3061641573 >> 172.21.15.49:0/3061641573 conn(0x7f8b7c101bd0 msgr2=0x7f8b7c102670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:23.720 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:23.250+0000 7f8b80a23700 1 -- 172.21.15.49:0/3061641573 shutdown_connections 2024-06-02T23:49:23.720 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:23.250+0000 7f8b80a23700 1 -- 172.21.15.49:0/3061641573 wait complete. 2024-06-02T23:49:23.720 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for the mgr to restart... 2024-06-02T23:49:23.720 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for mgr epoch 5... 2024-06-02T23:49:24.097 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:24 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:24.086+0000 7f3db6630200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-02T23:49:24.098 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:23 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3061641573' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-06-02T23:49:24.407 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:24 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:24.268+0000 7f3db6630200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-02T23:49:24.710 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:24 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:24.444+0000 7f3db6630200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-02T23:49:25.052 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:24 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:24.745+0000 7f3db6630200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-02T23:49:25.052 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:24 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:24.841+0000 7f3db6630200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-02T23:49:25.053 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:25 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:25.051+0000 7f3db6630200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-02T23:49:25.460 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:25 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:25.252+0000 7f3db6630200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-02T23:49:26.210 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:25 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:25.881+0000 7f3db6630200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-02T23:49:26.629 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:26 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:26.320+0000 7f3db6630200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-02T23:49:26.629 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:26 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:26.421+0000 7f3db6630200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-02T23:49:26.629 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:26 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:26.629+0000 7f3db6630200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-02T23:49:27.461 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:27 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:27.173+0000 7f3db6630200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-02T23:49:27.461 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:27 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:27.268+0000 7f3db6630200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-02T23:49:27.881 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:27 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:27.522+0000 7f3db6630200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-02T23:49:27.881 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:27 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:27.662+0000 7f3db6630200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-02T23:49:27.881 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:27 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:27.760+0000 7f3db6630200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-02T23:49:27.881 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:27 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:27.881+0000 7f3db6630200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-02T23:49:28.460 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:28 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:28.191+0000 7f3db6630200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-02T23:49:29.093 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:28 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:28.816+0000 7f3db6630200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-02T23:49:29.093 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:29 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:29.041+0000 7f3db6630200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-02T23:49:29.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:29 smithi049 ceph-mon[32302]: Active manager daemon x restarted 2024-06-02T23:49:29.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:29 smithi049 ceph-mon[32302]: Activating manager daemon x 2024-06-02T23:49:29.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:29 smithi049 ceph-mon[32302]: osdmap e2: 0 total, 0 up, 0 in 2024-06-02T23:49:29.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:29 smithi049 ceph-mon[32302]: mgrmap e6: x(active, starting, since 0.00340321s) 2024-06-02T23:49:29.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:29 smithi049 ceph-mon[32302]: from='mgr.14120 172.21.15.49:0/2158042131' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T23:49:29.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:29 smithi049 ceph-mon[32302]: from='mgr.14120 172.21.15.49:0/2158042131' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-02T23:49:29.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:29 smithi049 ceph-mon[32302]: from='mgr.14120 172.21.15.49:0/2158042131' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-02T23:49:29.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:29 smithi049 ceph-mon[32302]: from='mgr.14120 172.21.15.49:0/2158042131' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-02T23:49:29.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:29 smithi049 ceph-mon[32302]: from='mgr.14120 172.21.15.49:0/2158042131' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-02T23:49:29.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:29 smithi049 ceph-mon[32302]: Manager daemon x is now available 2024-06-02T23:49:29.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:29 smithi049 ceph-mon[32302]: from='mgr.14120 172.21.15.49:0/2158042131' entity='mgr.x' 2024-06-02T23:49:29.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:29 smithi049 ceph-mon[32302]: from='mgr.14120 172.21.15.49:0/2158042131' entity='mgr.x' 2024-06-02T23:49:29.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:29 smithi049 ceph-mon[32302]: from='mgr.14120 172.21.15.49:0/2158042131' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:49:29.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:29 smithi049 ceph-mon[32302]: from='mgr.14120 172.21.15.49:0/2158042131' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:49:29.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:29 smithi049 ceph-mon[32302]: from='mgr.14120 172.21.15.49:0/2158042131' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-02T23:49:30.350 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:30 smithi049 ceph-mon[32302]: Found migration_current of "None". Setting to last migration. 2024-06-02T23:49:30.351 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:30 smithi049 ceph-mon[32302]: from='mgr.14120 172.21.15.49:0/2158042131' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-02T23:49:30.351 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:30 smithi049 ceph-mon[32302]: from='mgr.14120 172.21.15.49:0/2158042131' entity='mgr.x' 2024-06-02T23:49:30.351 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:30 smithi049 ceph-mon[32302]: from='mgr.14120 172.21.15.49:0/2158042131' entity='mgr.x' 2024-06-02T23:49:30.351 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:30 smithi049 ceph-mon[32302]: [02/Jun/2024:23:49:29] ENGINE Bus STARTING 2024-06-02T23:49:30.351 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:30 smithi049 ceph-mon[32302]: [02/Jun/2024:23:49:29] ENGINE Serving on https://172.21.15.49:7150 2024-06-02T23:49:30.351 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:30 smithi049 ceph-mon[32302]: mgrmap e7: x(active, since 1.00614s) 2024-06-02T23:49:30.351 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:30 smithi049 ceph-mon[32302]: from='mgr.14120 172.21.15.49:0/2158042131' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:49:30.628 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2024-06-02T23:49:30.628 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-06-02T23:49:30.628 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "initialized": true 2024-06-02T23:49:30.628 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2024-06-02T23:49:30.628 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.200+0000 7f5b7944c700 1 Processor -- start 2024-06-02T23:49:30.628 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.200+0000 7f5b7944c700 1 -- start start 2024-06-02T23:49:30.628 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.201+0000 7f5b7944c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b74106df0 0x7f5b74107210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:30.628 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.201+0000 7f5b7944c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5b741077e0 con 0x7f5b74106df0 2024-06-02T23:49:30.628 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.201+0000 7f5b72ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b74106df0 0x7f5b74107210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:30.628 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.201+0000 7f5b72ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b74106df0 0x7f5b74107210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59628/0 (socket says 172.21.15.49:59628) 2024-06-02T23:49:30.629 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.201+0000 7f5b72ffd700 1 -- 172.21.15.49:0/2676358271 learned_addr learned my addr 172.21.15.49:0/2676358271 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:30.629 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.201+0000 7f5b72ffd700 1 -- 172.21.15.49:0/2676358271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b74107ff0 con 0x7f5b74106df0 2024-06-02T23:49:30.629 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.201+0000 7f5b72ffd700 1 --2- 172.21.15.49:0/2676358271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b74106df0 0x7f5b74107210 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5b640098a0 tx=0x7f5b64009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf59d316e6ff2ed4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:30.629 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.202+0000 7f5b71ffb700 1 -- 172.21.15.49:0/2676358271 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b64004160 con 0x7f5b74106df0 2024-06-02T23:49:30.629 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.202+0000 7f5b71ffb700 1 -- 172.21.15.49:0/2676358271 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5b6400dcc0 con 0x7f5b74106df0 2024-06-02T23:49:30.629 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.202+0000 7f5b71ffb700 1 -- 172.21.15.49:0/2676358271 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b64003d10 con 0x7f5b74106df0 2024-06-02T23:49:30.629 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.202+0000 7f5b7944c700 1 -- 172.21.15.49:0/2676358271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b74106df0 msgr2=0x7f5b74107210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:30.629 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.202+0000 7f5b7944c700 1 --2- 172.21.15.49:0/2676358271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b74106df0 0x7f5b74107210 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5b640098a0 tx=0x7f5b64009bb0 comp rx=0 tx=0).stop 2024-06-02T23:49:30.629 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.203+0000 7f5b7944c700 1 -- 172.21.15.49:0/2676358271 shutdown_connections 2024-06-02T23:49:30.629 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.203+0000 7f5b7944c700 1 --2- 172.21.15.49:0/2676358271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b74106df0 0x7f5b74107210 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:30.629 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.203+0000 7f5b7944c700 1 -- 172.21.15.49:0/2676358271 >> 172.21.15.49:0/2676358271 conn(0x7f5b741023b0 msgr2=0x7f5b741047d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:30.629 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.203+0000 7f5b7944c700 1 -- 172.21.15.49:0/2676358271 shutdown_connections 2024-06-02T23:49:30.629 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.203+0000 7f5b7944c700 1 -- 172.21.15.49:0/2676358271 wait complete. 2024-06-02T23:49:30.630 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.203+0000 7f5b7944c700 1 Processor -- start 2024-06-02T23:49:30.630 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.204+0000 7f5b7944c700 1 -- start start 2024-06-02T23:49:30.630 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.204+0000 7f5b7944c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b74106df0 0x7f5b7419e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:30.630 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.204+0000 7f5b7944c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7407af40 con 0x7f5b74106df0 2024-06-02T23:49:30.630 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.204+0000 7f5b72ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b74106df0 0x7f5b7419e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:30.630 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.204+0000 7f5b72ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b74106df0 0x7f5b7419e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59634/0 (socket says 172.21.15.49:59634) 2024-06-02T23:49:30.630 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.204+0000 7f5b72ffd700 1 -- 172.21.15.49:0/2865209677 learned_addr learned my addr 172.21.15.49:0/2865209677 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:30.630 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.204+0000 7f5b72ffd700 1 -- 172.21.15.49:0/2865209677 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b7419e610 con 0x7f5b74106df0 2024-06-02T23:49:30.630 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.204+0000 7f5b72ffd700 1 --2- 172.21.15.49:0/2865209677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b74106df0 0x7f5b7419e0d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5b64009fb0 tx=0x7f5b64010b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:30.630 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.204+0000 7f5b5bfff700 1 -- 172.21.15.49:0/2865209677 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b64003b40 con 0x7f5b74106df0 2024-06-02T23:49:30.630 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.204+0000 7f5b7944c700 1 -- 172.21.15.49:0/2865209677 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b7419e8a0 con 0x7f5b74106df0 2024-06-02T23:49:30.630 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.205+0000 7f5b7944c700 1 -- 172.21.15.49:0/2865209677 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b741a1590 con 0x7f5b74106df0 2024-06-02T23:49:30.630 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.205+0000 7f5b5bfff700 1 -- 172.21.15.49:0/2865209677 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5b640041a0 con 0x7f5b74106df0 2024-06-02T23:49:30.631 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.205+0000 7f5b5bfff700 1 -- 172.21.15.49:0/2865209677 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b64021ab0 con 0x7f5b74106df0 2024-06-02T23:49:30.631 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.206+0000 7f5b5bfff700 1 -- 172.21.15.49:0/2865209677 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f5b6402a3f0 con 0x7f5b74106df0 2024-06-02T23:49:30.631 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.206+0000 7f5b5bfff700 1 --2- 172.21.15.49:0/2865209677 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7f5b5c039050 0x7f5b5c03b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:30.631 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.206+0000 7f5b5bfff700 1 -- 172.21.15.49:0/2865209677 --> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f5b5c03bc20 con 0x7f5b5c039050 2024-06-02T23:49:30.631 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.206+0000 7f5b5bfff700 1 -- 172.21.15.49:0/2865209677 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5b6404d250 con 0x7f5b74106df0 2024-06-02T23:49:30.631 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.206+0000 7f5b727fc700 1 -- 172.21.15.49:0/2865209677 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7f5b5c039050 msgr2=0x7f5b5c03b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/549058216 2024-06-02T23:49:30.631 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.206+0000 7f5b727fc700 1 --2- 172.21.15.49:0/2865209677 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7f5b5c039050 0x7f5b5c03b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T23:49:30.631 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.407+0000 7f5b727fc700 1 -- 172.21.15.49:0/2865209677 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7f5b5c039050 msgr2=0x7f5b5c03b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/549058216 2024-06-02T23:49:30.631 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.407+0000 7f5b727fc700 1 --2- 172.21.15.49:0/2865209677 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7f5b5c039050 0x7f5b5c03b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-02T23:49:30.631 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.808+0000 7f5b727fc700 1 -- 172.21.15.49:0/2865209677 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7f5b5c039050 msgr2=0x7f5b5c03b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/549058216 2024-06-02T23:49:30.631 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:24.808+0000 7f5b727fc700 1 --2- 172.21.15.49:0/2865209677 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7f5b5c039050 0x7f5b5c03b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-06-02T23:49:30.631 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:25.609+0000 7f5b727fc700 1 -- 172.21.15.49:0/2865209677 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7f5b5c039050 msgr2=0x7f5b5c03b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/549058216 2024-06-02T23:49:30.631 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:25.609+0000 7f5b727fc700 1 --2- 172.21.15.49:0/2865209677 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7f5b5c039050 0x7f5b5c03b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-06-02T23:49:30.632 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:27.211+0000 7f5b727fc700 1 -- 172.21.15.49:0/2865209677 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7f5b5c039050 msgr2=0x7f5b5c03b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/549058216 2024-06-02T23:49:30.632 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:27.211+0000 7f5b727fc700 1 --2- 172.21.15.49:0/2865209677 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7f5b5c039050 0x7f5b5c03b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-06-02T23:49:30.632 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:29.044+0000 7f5b5bfff700 1 -- 172.21.15.49:0/2865209677 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7f5b64004350 con 0x7f5b74106df0 2024-06-02T23:49:30.632 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:29.044+0000 7f5b5bfff700 1 -- 172.21.15.49:0/2865209677 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7f5b5c039050 msgr2=0x7f5b5c03b510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T23:49:30.632 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:29.044+0000 7f5b5bfff700 1 --2- 172.21.15.49:0/2865209677 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7f5b5c039050 0x7f5b5c03b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:30.632 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:30.046+0000 7f5b5bfff700 1 -- 172.21.15.49:0/2865209677 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f5b6404f500 con 0x7f5b74106df0 2024-06-02T23:49:30.632 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:30.046+0000 7f5b5bfff700 1 --2- 172.21.15.49:0/2865209677 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f5b5c03c980 0x7f5b5c03ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:30.632 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:30.046+0000 7f5b5bfff700 1 -- 172.21.15.49:0/2865209677 --> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f5b6402be50 con 0x7f5b5c03c980 2024-06-02T23:49:30.632 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:30.046+0000 7f5b727fc700 1 --2- 172.21.15.49:0/2865209677 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f5b5c03c980 0x7f5b5c03ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:30.632 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:30.047+0000 7f5b727fc700 1 --2- 172.21.15.49:0/2865209677 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f5b5c03c980 0x7f5b5c03ed70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5b68003a10 tx=0x7f5b680092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:30.632 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:30.048+0000 7f5b5bfff700 1 -- 172.21.15.49:0/2865209677 <== mgr.14120 v2:172.21.15.49:6800/1206062338 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7f5b6402be50 con 0x7f5b5c03c980 2024-06-02T23:49:30.632 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:30.055+0000 7f5b7944c700 1 -- 172.21.15.49:0/2865209677 --> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f5b60002600 con 0x7f5b5c03c980 2024-06-02T23:49:30.632 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:30.055+0000 7f5b5bfff700 1 -- 172.21.15.49:0/2865209677 <== mgr.14120 v2:172.21.15.49:6800/1206062338 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f5b60002600 con 0x7f5b5c03c980 2024-06-02T23:49:30.632 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:30.055+0000 7f5b7944c700 1 -- 172.21.15.49:0/2865209677 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f5b5c03c980 msgr2=0x7f5b5c03ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:30.633 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:30.055+0000 7f5b7944c700 1 --2- 172.21.15.49:0/2865209677 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f5b5c03c980 0x7f5b5c03ed70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5b68003a10 tx=0x7f5b680092b0 comp rx=0 tx=0).stop 2024-06-02T23:49:30.633 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:30.055+0000 7f5b7944c700 1 -- 172.21.15.49:0/2865209677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b74106df0 msgr2=0x7f5b7419e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:30.633 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:30.055+0000 7f5b7944c700 1 --2- 172.21.15.49:0/2865209677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b74106df0 0x7f5b7419e0d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5b64009fb0 tx=0x7f5b64010b10 comp rx=0 tx=0).stop 2024-06-02T23:49:30.633 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:30.055+0000 7f5b7944c700 1 -- 172.21.15.49:0/2865209677 shutdown_connections 2024-06-02T23:49:30.633 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:30.055+0000 7f5b7944c700 1 --2- 172.21.15.49:0/2865209677 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f5b5c03c980 0x7f5b5c03ed70 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:30.633 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:30.055+0000 7f5b7944c700 1 --2- 172.21.15.49:0/2865209677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b74106df0 0x7f5b7419e0d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:30.633 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:30.055+0000 7f5b7944c700 1 --2- 172.21.15.49:0/2865209677 >> [v2:172.21.15.49:6800/549058216,v1:172.21.15.49:6801/549058216] conn(0x7f5b5c039050 0x7f5b5c03b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:30.633 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:30.055+0000 7f5b7944c700 1 -- 172.21.15.49:0/2865209677 >> 172.21.15.49:0/2865209677 conn(0x7f5b741023b0 msgr2=0x7f5b74194bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:30.633 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:30.055+0000 7f5b7944c700 1 -- 172.21.15.49:0/2865209677 shutdown_connections 2024-06-02T23:49:30.633 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:30.056+0000 7f5b7944c700 1 -- 172.21.15.49:0/2865209677 wait complete. 2024-06-02T23:49:30.633 INFO:teuthology.orchestra.run.smithi049.stdout:mgr epoch 5 is available 2024-06-02T23:49:30.633 INFO:teuthology.orchestra.run.smithi049.stdout:Setting orchestrator backend to cephadm... 2024-06-02T23:49:31.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:31 smithi049 ceph-mon[32302]: [02/Jun/2024:23:49:30] ENGINE Serving on http://172.21.15.49:8765 2024-06-02T23:49:31.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:31 smithi049 ceph-mon[32302]: [02/Jun/2024:23:49:30] ENGINE Bus STARTED 2024-06-02T23:49:31.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:31 smithi049 ceph-mon[32302]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-06-02T23:49:31.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:31 smithi049 ceph-mon[32302]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-06-02T23:49:31.814 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.070+0000 7f1bcea34700 1 Processor -- start 2024-06-02T23:49:31.814 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.070+0000 7f1bcea34700 1 -- start start 2024-06-02T23:49:31.814 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.070+0000 7f1bcea34700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bc8106e10 0x7f1bc8107230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:31.814 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.070+0000 7f1bcea34700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc8107770 con 0x7f1bc8106e10 2024-06-02T23:49:31.814 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.070+0000 7f1bc7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bc8106e10 0x7f1bc8107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:31.814 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.070+0000 7f1bc7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bc8106e10 0x7f1bc8107230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59692/0 (socket says 172.21.15.49:59692) 2024-06-02T23:49:31.815 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.070+0000 7f1bc7fff700 1 -- 172.21.15.49:0/4273224668 learned_addr learned my addr 172.21.15.49:0/4273224668 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:31.815 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.070+0000 7f1bc7fff700 1 -- 172.21.15.49:0/4273224668 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc8107f70 con 0x7f1bc8106e10 2024-06-02T23:49:31.815 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.071+0000 7f1bc7fff700 1 --2- 172.21.15.49:0/4273224668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bc8106e10 0x7f1bc8107230 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80098a0 tx=0x7f1bb8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd279af731cad88 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:31.815 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.071+0000 7f1bc6ffd700 1 -- 172.21.15.49:0/4273224668 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb8004160 con 0x7f1bc8106e10 2024-06-02T23:49:31.815 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.071+0000 7f1bc6ffd700 1 -- 172.21.15.49:0/4273224668 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1bb8004300 con 0x7f1bc8106e10 2024-06-02T23:49:31.815 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.071+0000 7f1bc6ffd700 1 -- 172.21.15.49:0/4273224668 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb8011b50 con 0x7f1bc8106e10 2024-06-02T23:49:31.815 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.071+0000 7f1bcea34700 1 -- 172.21.15.49:0/4273224668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bc8106e10 msgr2=0x7f1bc8107230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:31.815 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.071+0000 7f1bcea34700 1 --2- 172.21.15.49:0/4273224668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bc8106e10 0x7f1bc8107230 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80098a0 tx=0x7f1bb8009bb0 comp rx=0 tx=0).stop 2024-06-02T23:49:31.815 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.071+0000 7f1bcea34700 1 -- 172.21.15.49:0/4273224668 shutdown_connections 2024-06-02T23:49:31.815 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.071+0000 7f1bcea34700 1 --2- 172.21.15.49:0/4273224668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bc8106e10 0x7f1bc8107230 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:31.815 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.071+0000 7f1bcea34700 1 -- 172.21.15.49:0/4273224668 >> 172.21.15.49:0/4273224668 conn(0x7f1bc81023f0 msgr2=0x7f1bc8104810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:31.815 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.071+0000 7f1bcea34700 1 -- 172.21.15.49:0/4273224668 shutdown_connections 2024-06-02T23:49:31.815 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.071+0000 7f1bcea34700 1 -- 172.21.15.49:0/4273224668 wait complete. 2024-06-02T23:49:31.816 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.072+0000 7f1bcea34700 1 Processor -- start 2024-06-02T23:49:31.816 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.072+0000 7f1bcea34700 1 -- start start 2024-06-02T23:49:31.816 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.072+0000 7f1bcea34700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bc8106e10 0x7f1bc819bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:31.816 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.072+0000 7f1bcea34700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc810b3b0 con 0x7f1bc8106e10 2024-06-02T23:49:31.816 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.073+0000 7f1bc7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bc8106e10 0x7f1bc819bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:31.816 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.073+0000 7f1bc7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bc8106e10 0x7f1bc819bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59698/0 (socket says 172.21.15.49:59698) 2024-06-02T23:49:31.816 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.073+0000 7f1bc7fff700 1 -- 172.21.15.49:0/1593055048 learned_addr learned my addr 172.21.15.49:0/1593055048 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:31.816 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.073+0000 7f1bc7fff700 1 -- 172.21.15.49:0/1593055048 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc819c3e0 con 0x7f1bc8106e10 2024-06-02T23:49:31.816 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.073+0000 7f1bc7fff700 1 --2- 172.21.15.49:0/1593055048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bc8106e10 0x7f1bc819bea0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8011b60 tx=0x7f1bb8011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:31.816 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.073+0000 7f1bc57fa700 1 -- 172.21.15.49:0/1593055048 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb8003b20 con 0x7f1bc8106e10 2024-06-02T23:49:31.816 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.073+0000 7f1bcea34700 1 -- 172.21.15.49:0/1593055048 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bc819c670 con 0x7f1bc8106e10 2024-06-02T23:49:31.816 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.073+0000 7f1bc57fa700 1 -- 172.21.15.49:0/1593055048 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1bb8003cc0 con 0x7f1bc8106e10 2024-06-02T23:49:31.816 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.073+0000 7f1bc57fa700 1 -- 172.21.15.49:0/1593055048 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb8024840 con 0x7f1bc8106e10 2024-06-02T23:49:31.816 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.073+0000 7f1bcea34700 1 -- 172.21.15.49:0/1593055048 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bc819f360 con 0x7f1bc8106e10 2024-06-02T23:49:31.817 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.074+0000 7f1bc57fa700 1 -- 172.21.15.49:0/1593055048 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f1bb8022020 con 0x7f1bc8106e10 2024-06-02T23:49:31.817 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.074+0000 7f1bcea34700 1 -- 172.21.15.49:0/1593055048 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bc8063af0 con 0x7f1bc8106e10 2024-06-02T23:49:31.817 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.074+0000 7f1bc57fa700 1 --2- 172.21.15.49:0/1593055048 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f1bb0038f30 0x7f1bb003b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:31.817 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.074+0000 7f1bc57fa700 1 -- 172.21.15.49:0/1593055048 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1bb8011e00 con 0x7f1bc8106e10 2024-06-02T23:49:31.817 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.074+0000 7f1bc77fe700 1 --2- 172.21.15.49:0/1593055048 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f1bb0038f30 0x7f1bb003b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:31.817 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.075+0000 7f1bc77fe700 1 --2- 172.21.15.49:0/1593055048 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f1bb0038f30 0x7f1bb003b3f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc006fd0 tx=0x7f1bbc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:31.817 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.080+0000 7f1bc57fa700 1 -- 172.21.15.49:0/1593055048 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1bb8019c70 con 0x7f1bc8106e10 2024-06-02T23:49:31.817 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.097+0000 7f1bc57fa700 1 -- 172.21.15.49:0/1593055048 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f1bb802d910 con 0x7f1bc8106e10 2024-06-02T23:49:31.817 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.307+0000 7f1bcea34700 1 -- 172.21.15.49:0/1593055048 --> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f1bc80008d0 con 0x7f1bb0038f30 2024-06-02T23:49:31.817 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.312+0000 7f1bc57fa700 1 -- 172.21.15.49:0/1593055048 <== mgr.14120 v2:172.21.15.49:6800/1206062338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1bc80008d0 con 0x7f1bb0038f30 2024-06-02T23:49:31.817 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.314+0000 7f1bcea34700 1 -- 172.21.15.49:0/1593055048 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f1bb0038f30 msgr2=0x7f1bb003b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:31.817 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.314+0000 7f1bcea34700 1 --2- 172.21.15.49:0/1593055048 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f1bb0038f30 0x7f1bb003b3f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc006fd0 tx=0x7f1bbc006e40 comp rx=0 tx=0).stop 2024-06-02T23:49:31.818 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.314+0000 7f1bcea34700 1 -- 172.21.15.49:0/1593055048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bc8106e10 msgr2=0x7f1bc819bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:31.818 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.314+0000 7f1bcea34700 1 --2- 172.21.15.49:0/1593055048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bc8106e10 0x7f1bc819bea0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8011b60 tx=0x7f1bb8011c40 comp rx=0 tx=0).stop 2024-06-02T23:49:31.818 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.314+0000 7f1bcea34700 1 -- 172.21.15.49:0/1593055048 shutdown_connections 2024-06-02T23:49:31.818 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.314+0000 7f1bcea34700 1 --2- 172.21.15.49:0/1593055048 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f1bb0038f30 0x7f1bb003b3f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:31.818 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.314+0000 7f1bcea34700 1 --2- 172.21.15.49:0/1593055048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1bc8106e10 0x7f1bc819bea0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:31.818 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.314+0000 7f1bcea34700 1 -- 172.21.15.49:0/1593055048 >> 172.21.15.49:0/1593055048 conn(0x7f1bc81023f0 msgr2=0x7f1bc8103220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:31.818 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.314+0000 7f1bcea34700 1 -- 172.21.15.49:0/1593055048 shutdown_connections 2024-06-02T23:49:31.818 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:31.314+0000 7f1bcea34700 1 -- 172.21.15.49:0/1593055048 wait complete. 2024-06-02T23:49:32.450 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:32 smithi049 ceph-mon[32302]: mgrmap e8: x(active, since 2s) 2024-06-02T23:49:32.450 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:32 smithi049 ceph-mon[32302]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:49:32.450 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:32 smithi049 ceph-mon[32302]: from='mgr.14120 172.21.15.49:0/2158042131' entity='mgr.x' 2024-06-02T23:49:32.450 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:32 smithi049 ceph-mon[32302]: from='mgr.14120 172.21.15.49:0/2158042131' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:49:32.999 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout value unchanged 2024-06-02T23:49:33.000 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.232+0000 7f27b351e700 1 Processor -- start 2024-06-02T23:49:33.000 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.232+0000 7f27b351e700 1 -- start start 2024-06-02T23:49:33.000 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.232+0000 7f27b351e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27ac108a00 0x7f27ac10adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:33.000 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.232+0000 7f27b351e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f27ac07bde0 con 0x7f27ac108a00 2024-06-02T23:49:33.000 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.233+0000 7f27b12ba700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27ac108a00 0x7f27ac10adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:33.000 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.233+0000 7f27b12ba700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27ac108a00 0x7f27ac10adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59710/0 (socket says 172.21.15.49:59710) 2024-06-02T23:49:33.001 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.233+0000 7f27b12ba700 1 -- 172.21.15.49:0/1137411530 learned_addr learned my addr 172.21.15.49:0/1137411530 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:33.001 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.233+0000 7f27b12ba700 1 -- 172.21.15.49:0/1137411530 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27ac10b330 con 0x7f27ac108a00 2024-06-02T23:49:33.001 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.233+0000 7f27b12ba700 1 --2- 172.21.15.49:0/1137411530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27ac108a00 0x7f27ac10adf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f279c009e80 tx=0x7f279c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ad1f6849222c2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:33.001 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.233+0000 7f27abfff700 1 -- 172.21.15.49:0/1137411530 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f279c017070 con 0x7f27ac108a00 2024-06-02T23:49:33.001 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.233+0000 7f27abfff700 1 -- 172.21.15.49:0/1137411530 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f279c00b8c0 con 0x7f27ac108a00 2024-06-02T23:49:33.001 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.233+0000 7f27abfff700 1 -- 172.21.15.49:0/1137411530 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f279c0045c0 con 0x7f27ac108a00 2024-06-02T23:49:33.001 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.234+0000 7f27b351e700 1 -- 172.21.15.49:0/1137411530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27ac108a00 msgr2=0x7f27ac10adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:33.001 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.234+0000 7f27b351e700 1 --2- 172.21.15.49:0/1137411530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27ac108a00 0x7f27ac10adf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f279c009e80 tx=0x7f279c00b330 comp rx=0 tx=0).stop 2024-06-02T23:49:33.002 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.234+0000 7f27b351e700 1 -- 172.21.15.49:0/1137411530 shutdown_connections 2024-06-02T23:49:33.002 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.234+0000 7f27b351e700 1 --2- 172.21.15.49:0/1137411530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27ac108a00 0x7f27ac10adf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:33.002 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.234+0000 7f27b351e700 1 -- 172.21.15.49:0/1137411530 >> 172.21.15.49:0/1137411530 conn(0x7f27ac102470 msgr2=0x7f27ac104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:33.002 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.234+0000 7f27b351e700 1 -- 172.21.15.49:0/1137411530 shutdown_connections 2024-06-02T23:49:33.002 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.234+0000 7f27b351e700 1 -- 172.21.15.49:0/1137411530 wait complete. 2024-06-02T23:49:33.003 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.235+0000 7f27b351e700 1 Processor -- start 2024-06-02T23:49:33.003 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.235+0000 7f27b351e700 1 -- start start 2024-06-02T23:49:33.003 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.235+0000 7f27b351e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27ac108a00 0x7f27ac108280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:33.003 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.235+0000 7f27b351e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f27ac10c350 con 0x7f27ac108a00 2024-06-02T23:49:33.003 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.235+0000 7f27b12ba700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27ac108a00 0x7f27ac108280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:33.003 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.235+0000 7f27b12ba700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27ac108a00 0x7f27ac108280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59714/0 (socket says 172.21.15.49:59714) 2024-06-02T23:49:33.003 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.235+0000 7f27b12ba700 1 -- 172.21.15.49:0/1390152230 learned_addr learned my addr 172.21.15.49:0/1390152230 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:33.003 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.235+0000 7f27b12ba700 1 -- 172.21.15.49:0/1390152230 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27ac1087c0 con 0x7f27ac108a00 2024-06-02T23:49:33.003 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.235+0000 7f27b12ba700 1 --2- 172.21.15.49:0/1390152230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27ac108a00 0x7f27ac108280 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f279c004350 tx=0x7f279c00bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:33.003 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.235+0000 7f27aa7fc700 1 -- 172.21.15.49:0/1390152230 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f279c020020 con 0x7f27ac108a00 2024-06-02T23:49:33.003 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.235+0000 7f27aa7fc700 1 -- 172.21.15.49:0/1390152230 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f279c003c10 con 0x7f27ac108a00 2024-06-02T23:49:33.003 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.236+0000 7f27aa7fc700 1 -- 172.21.15.49:0/1390152230 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f279c017040 con 0x7f27ac108a00 2024-06-02T23:49:33.004 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.236+0000 7f27b351e700 1 -- 172.21.15.49:0/1390152230 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27ac1069b0 con 0x7f27ac108a00 2024-06-02T23:49:33.004 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.236+0000 7f27b351e700 1 -- 172.21.15.49:0/1390152230 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27ac106ef0 con 0x7f27ac108a00 2024-06-02T23:49:33.004 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.236+0000 7f27aa7fc700 1 -- 172.21.15.49:0/1390152230 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f279c023020 con 0x7f27ac108a00 2024-06-02T23:49:33.004 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.236+0000 7f27b351e700 1 -- 172.21.15.49:0/1390152230 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27ac063af0 con 0x7f27ac108a00 2024-06-02T23:49:33.004 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.237+0000 7f27aa7fc700 1 --2- 172.21.15.49:0/1390152230 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f27940390a0 0x7f279403b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:33.004 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.237+0000 7f27aa7fc700 1 -- 172.21.15.49:0/1390152230 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f279c00f050 con 0x7f27ac108a00 2024-06-02T23:49:33.004 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.237+0000 7f27b0ab9700 1 --2- 172.21.15.49:0/1390152230 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f27940390a0 0x7f279403b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:33.004 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.237+0000 7f27b0ab9700 1 --2- 172.21.15.49:0/1390152230 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f27940390a0 0x7f279403b560 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f27a0006fd0 tx=0x7f27a0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:33.004 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.242+0000 7f27aa7fc700 1 -- 172.21.15.49:0/1390152230 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f279c02a020 con 0x7f27ac108a00 2024-06-02T23:49:33.004 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.450+0000 7f27b351e700 1 -- 172.21.15.49:0/1390152230 --> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f27ac103620 con 0x7f27940390a0 2024-06-02T23:49:33.004 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.451+0000 7f27aa7fc700 1 -- 172.21.15.49:0/1390152230 <== mgr.14120 v2:172.21.15.49:6800/1206062338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f27ac103620 con 0x7f27940390a0 2024-06-02T23:49:33.004 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.454+0000 7f27b351e700 1 -- 172.21.15.49:0/1390152230 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f27940390a0 msgr2=0x7f279403b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:33.004 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.454+0000 7f27b351e700 1 --2- 172.21.15.49:0/1390152230 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f27940390a0 0x7f279403b560 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f27a0006fd0 tx=0x7f27a0006e40 comp rx=0 tx=0).stop 2024-06-02T23:49:33.005 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.454+0000 7f27b351e700 1 -- 172.21.15.49:0/1390152230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27ac108a00 msgr2=0x7f27ac108280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:33.005 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.454+0000 7f27b351e700 1 --2- 172.21.15.49:0/1390152230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27ac108a00 0x7f27ac108280 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f279c004350 tx=0x7f279c00bd50 comp rx=0 tx=0).stop 2024-06-02T23:49:33.005 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.454+0000 7f27b351e700 1 -- 172.21.15.49:0/1390152230 shutdown_connections 2024-06-02T23:49:33.005 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.454+0000 7f27b351e700 1 --2- 172.21.15.49:0/1390152230 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f27940390a0 0x7f279403b560 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:33.005 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.454+0000 7f27b351e700 1 --2- 172.21.15.49:0/1390152230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27ac108a00 0x7f27ac108280 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:33.005 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.454+0000 7f27b351e700 1 -- 172.21.15.49:0/1390152230 >> 172.21.15.49:0/1390152230 conn(0x7f27ac102470 msgr2=0x7f27ac102f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:33.005 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.454+0000 7f27b351e700 1 -- 172.21.15.49:0/1390152230 shutdown_connections 2024-06-02T23:49:33.005 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:32.454+0000 7f27b351e700 1 -- 172.21.15.49:0/1390152230 wait complete. 2024-06-02T23:49:33.005 INFO:teuthology.orchestra.run.smithi049.stdout:Generating ssh key... 2024-06-02T23:49:33.390 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:33 smithi049 ceph-mon[32302]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:49:34.052 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:33 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: Generating public/private rsa key pair. 2024-06-02T23:49:34.052 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:33 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: Your identification has been saved in /tmp/tmpq5kyx0da/key. 2024-06-02T23:49:34.053 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:33 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: Your public key has been saved in /tmp/tmpq5kyx0da/key.pub. 2024-06-02T23:49:34.053 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:33 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: The key fingerprint is: 2024-06-02T23:49:34.053 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:33 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: SHA256:BzXw8aZZvKAItXxVVuVOPFIsbOQYebWbzvHvLnQprYw ceph-890dd222-213a-11ef-bc9b-c7b262605968 2024-06-02T23:49:34.053 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:33 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: The key's randomart image is: 2024-06-02T23:49:34.053 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:33 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: +---[RSA 3072]----+ 2024-06-02T23:49:34.053 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:33 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: | . ..=o*o++.| 2024-06-02T23:49:34.053 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:33 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: | o . + B+=.+.| 2024-06-02T23:49:34.053 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:33 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: | . o o o.Bo.o+| 2024-06-02T23:49:34.053 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:33 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: | . o o * ..o+| 2024-06-02T23:49:34.053 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:33 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: | . S + . .+o| 2024-06-02T23:49:34.053 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:33 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: | . .+o+| 2024-06-02T23:49:34.053 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:33 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: | o.o+.| 2024-06-02T23:49:34.053 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:33 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: | E o. .| 2024-06-02T23:49:34.053 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:33 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: | ++| 2024-06-02T23:49:34.054 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:33 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: +----[SHA256]-----+ 2024-06-02T23:49:34.335 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.418+0000 7f2ec0fa4700 1 Processor -- start 2024-06-02T23:49:34.336 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.418+0000 7f2ec0fa4700 1 -- start start 2024-06-02T23:49:34.336 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.418+0000 7f2ec0fa4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ebc108990 0x7f2ebc10ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:34.336 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.418+0000 7f2ec0fa4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2ebc07be20 con 0x7f2ebc108990 2024-06-02T23:49:34.336 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.418+0000 7f2eba59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ebc108990 0x7f2ebc10ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:34.336 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.419+0000 7f2eba59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ebc108990 0x7f2ebc10ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48440/0 (socket says 172.21.15.49:48440) 2024-06-02T23:49:34.336 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.419+0000 7f2eba59c700 1 -- 172.21.15.49:0/1601594694 learned_addr learned my addr 172.21.15.49:0/1601594694 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:34.336 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.419+0000 7f2eba59c700 1 -- 172.21.15.49:0/1601594694 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ebc10b2c0 con 0x7f2ebc108990 2024-06-02T23:49:34.336 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.419+0000 7f2eba59c700 1 --2- 172.21.15.49:0/1601594694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ebc108990 0x7f2ebc10ad80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0098a0 tx=0x7f2eac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2700ec5ebf65b75 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:34.336 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.419+0000 7f2eb959a700 1 -- 172.21.15.49:0/1601594694 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2eac004160 con 0x7f2ebc108990 2024-06-02T23:49:34.336 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.419+0000 7f2eb959a700 1 -- 172.21.15.49:0/1601594694 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2eac004300 con 0x7f2ebc108990 2024-06-02T23:49:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.419+0000 7f2eb959a700 1 -- 172.21.15.49:0/1601594694 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2eac011b50 con 0x7f2ebc108990 2024-06-02T23:49:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.420+0000 7f2ec0fa4700 1 -- 172.21.15.49:0/1601594694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ebc108990 msgr2=0x7f2ebc10ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.420+0000 7f2ec0fa4700 1 --2- 172.21.15.49:0/1601594694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ebc108990 0x7f2ebc10ad80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0098a0 tx=0x7f2eac009bb0 comp rx=0 tx=0).stop 2024-06-02T23:49:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.420+0000 7f2ec0fa4700 1 -- 172.21.15.49:0/1601594694 shutdown_connections 2024-06-02T23:49:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.420+0000 7f2ec0fa4700 1 --2- 172.21.15.49:0/1601594694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ebc108990 0x7f2ebc10ad80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.420+0000 7f2ec0fa4700 1 -- 172.21.15.49:0/1601594694 >> 172.21.15.49:0/1601594694 conn(0x7f2ebc1023e0 msgr2=0x7f2ebc104800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.420+0000 7f2ec0fa4700 1 -- 172.21.15.49:0/1601594694 shutdown_connections 2024-06-02T23:49:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.420+0000 7f2ec0fa4700 1 -- 172.21.15.49:0/1601594694 wait complete. 2024-06-02T23:49:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.421+0000 7f2ec0fa4700 1 Processor -- start 2024-06-02T23:49:34.337 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.421+0000 7f2ec0fa4700 1 -- start start 2024-06-02T23:49:34.338 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.421+0000 7f2ec0fa4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ebc108990 0x7f2ebc19bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:34.338 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.421+0000 7f2ec0fa4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2ebc10c2f0 con 0x7f2ebc108990 2024-06-02T23:49:34.338 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.421+0000 7f2eba59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ebc108990 0x7f2ebc19bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:34.338 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.421+0000 7f2eba59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ebc108990 0x7f2ebc19bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48452/0 (socket says 172.21.15.49:48452) 2024-06-02T23:49:34.338 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.421+0000 7f2eba59c700 1 -- 172.21.15.49:0/2662753418 learned_addr learned my addr 172.21.15.49:0/2662753418 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:34.338 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.421+0000 7f2eba59c700 1 -- 172.21.15.49:0/2662753418 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ebc19c430 con 0x7f2ebc108990 2024-06-02T23:49:34.338 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.421+0000 7f2eba59c700 1 --2- 172.21.15.49:0/2662753418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ebc108990 0x7f2ebc19bef0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2eac011b60 tx=0x7f2eac011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:34.339 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.422+0000 7f2eab7fe700 1 -- 172.21.15.49:0/2662753418 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2eac003b20 con 0x7f2ebc108990 2024-06-02T23:49:34.339 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.422+0000 7f2eab7fe700 1 -- 172.21.15.49:0/2662753418 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2eac003cc0 con 0x7f2ebc108990 2024-06-02T23:49:34.339 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.422+0000 7f2ec0fa4700 1 -- 172.21.15.49:0/2662753418 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ebc19c6c0 con 0x7f2ebc108990 2024-06-02T23:49:34.339 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.422+0000 7f2eab7fe700 1 -- 172.21.15.49:0/2662753418 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2eac024840 con 0x7f2ebc108990 2024-06-02T23:49:34.339 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.422+0000 7f2ec0fa4700 1 -- 172.21.15.49:0/2662753418 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ebc19f3b0 con 0x7f2ebc108990 2024-06-02T23:49:34.339 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.422+0000 7f2eab7fe700 1 -- 172.21.15.49:0/2662753418 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f2eac022020 con 0x7f2ebc108990 2024-06-02T23:49:34.339 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.423+0000 7f2ec0fa4700 1 -- 172.21.15.49:0/2662753418 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ebc063af0 con 0x7f2ebc108990 2024-06-02T23:49:34.339 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.423+0000 7f2eab7fe700 1 --2- 172.21.15.49:0/2662753418 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f2ea4039050 0x7f2ea403b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:34.339 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.423+0000 7f2eab7fe700 1 -- 172.21.15.49:0/2662753418 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2eac011e00 con 0x7f2ebc108990 2024-06-02T23:49:34.339 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.423+0000 7f2eb9d9b700 1 --2- 172.21.15.49:0/2662753418 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f2ea4039050 0x7f2ea403b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:34.339 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.423+0000 7f2eb9d9b700 1 --2- 172.21.15.49:0/2662753418 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f2ea4039050 0x7f2ea403b510 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0006fd0 tx=0x7f2eb0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:34.339 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.428+0000 7f2eab7fe700 1 -- 172.21.15.49:0/2662753418 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2eac024b10 con 0x7f2ebc108990 2024-06-02T23:49:34.339 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.636+0000 7f2ec0fa4700 1 -- 172.21.15.49:0/2662753418 --> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f2ebc103650 con 0x7f2ea4039050 2024-06-02T23:49:34.340 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.736+0000 7f2eab7fe700 1 -- 172.21.15.49:0/2662753418 <== mgr.14120 v2:172.21.15.49:6800/1206062338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2ebc103650 con 0x7f2ea4039050 2024-06-02T23:49:34.340 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.738+0000 7f2ec0fa4700 1 -- 172.21.15.49:0/2662753418 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f2ea4039050 msgr2=0x7f2ea403b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:34.340 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.738+0000 7f2ec0fa4700 1 --2- 172.21.15.49:0/2662753418 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f2ea4039050 0x7f2ea403b510 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0006fd0 tx=0x7f2eb0006e40 comp rx=0 tx=0).stop 2024-06-02T23:49:34.340 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.738+0000 7f2ec0fa4700 1 -- 172.21.15.49:0/2662753418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ebc108990 msgr2=0x7f2ebc19bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:34.340 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.738+0000 7f2ec0fa4700 1 --2- 172.21.15.49:0/2662753418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ebc108990 0x7f2ebc19bef0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2eac011b60 tx=0x7f2eac011c40 comp rx=0 tx=0).stop 2024-06-02T23:49:34.340 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.738+0000 7f2ec0fa4700 1 -- 172.21.15.49:0/2662753418 shutdown_connections 2024-06-02T23:49:34.340 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.738+0000 7f2ec0fa4700 1 --2- 172.21.15.49:0/2662753418 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f2ea4039050 0x7f2ea403b510 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:34.340 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.738+0000 7f2ec0fa4700 1 --2- 172.21.15.49:0/2662753418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ebc108990 0x7f2ebc19bef0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:34.340 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.738+0000 7f2ec0fa4700 1 -- 172.21.15.49:0/2662753418 >> 172.21.15.49:0/2662753418 conn(0x7f2ebc1023e0 msgr2=0x7f2ebc102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:34.340 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.738+0000 7f2ec0fa4700 1 -- 172.21.15.49:0/2662753418 shutdown_connections 2024-06-02T23:49:34.340 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:33.738+0000 7f2ec0fa4700 1 -- 172.21.15.49:0/2662753418 wait complete. 2024-06-02T23:49:34.948 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:34 smithi049 ceph-mon[32302]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:49:34.948 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:34 smithi049 ceph-mon[32302]: Generating ssh key... 2024-06-02T23:49:34.948 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:34 smithi049 ceph-mon[32302]: from='mgr.14120 172.21.15.49:0/2158042131' entity='mgr.x' 2024-06-02T23:49:34.948 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:34 smithi049 ceph-mon[32302]: from='mgr.14120 172.21.15.49:0/2158042131' entity='mgr.x' 2024-06-02T23:49:35.457 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsBt7Z7KnDxagUcsVKs/AUOc8uVWN47z8RI+OypUYLvNWZ5FNSTIqWAWJfvIsdOiX/45gNrRwAfuA7ofnJZAkAzXkK+cnAsd08jFQ0nszKtqEazHSQ4hkRepD8vV1HLOuyTxlgEDSsrXmEBlgz9hCc2d9LPFCIhOeLKJR5QX+oasiCkaGVqL8NPWlT25ZFBM6uzuAhRbAgLzPfWH1b/+gV34VPoSAxEFi/Kz7gu+8VNaSpQkuf9zGeIxlY1L3rAWo2Q3OjLwjEB8beMIiySqPGJdTmgyiroziIQm0xZ0de0BK1Z9UjAaryKssaf7Th1td722lU2L48q8S42SbWmdt6Nm0t5hPPlVTbDgM1lNerHFPkSjqoT9xfejxrKv9ekr09VqHyEsWplQ3NGpD860tFcqVnnBD/KMDoL3DAfYZrAhksCbHiATEZ84CYGBoePSgkOpdHmG8dRJbE4aHliP4ldvZjPmgifJkKTl6JbbQvnmY5xiUJrX/la/iGT3RYixk= ceph-890dd222-213a-11ef-bc9b-c7b262605968 2024-06-02T23:49:35.511 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.728+0000 7f7c17d0d700 1 Processor -- start 2024-06-02T23:49:35.511 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.728+0000 7f7c17d0d700 1 -- start start 2024-06-02T23:49:35.511 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.728+0000 7f7c17d0d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c10106e60 0x7f7c10107280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:35.511 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.729+0000 7f7c17d0d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7c101077c0 con 0x7f7c10106e60 2024-06-02T23:49:35.511 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.729+0000 7f7c15aa9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c10106e60 0x7f7c10107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:35.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.729+0000 7f7c15aa9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c10106e60 0x7f7c10107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48468/0 (socket says 172.21.15.49:48468) 2024-06-02T23:49:35.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.729+0000 7f7c15aa9700 1 -- 172.21.15.49:0/3001980713 learned_addr learned my addr 172.21.15.49:0/3001980713 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:35.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.729+0000 7f7c15aa9700 1 -- 172.21.15.49:0/3001980713 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c10107fc0 con 0x7f7c10106e60 2024-06-02T23:49:35.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.729+0000 7f7c15aa9700 1 --2- 172.21.15.49:0/3001980713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c10106e60 0x7f7c10107280 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c0098a0 tx=0x7f7c0c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f4a773426a9116 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:35.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.729+0000 7f7c14aa7700 1 -- 172.21.15.49:0/3001980713 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c0c004160 con 0x7f7c10106e60 2024-06-02T23:49:35.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.729+0000 7f7c14aa7700 1 -- 172.21.15.49:0/3001980713 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7c0c004300 con 0x7f7c10106e60 2024-06-02T23:49:35.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.729+0000 7f7c14aa7700 1 -- 172.21.15.49:0/3001980713 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c0c011b50 con 0x7f7c10106e60 2024-06-02T23:49:35.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.730+0000 7f7c17d0d700 1 -- 172.21.15.49:0/3001980713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c10106e60 msgr2=0x7f7c10107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:35.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.730+0000 7f7c17d0d700 1 --2- 172.21.15.49:0/3001980713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c10106e60 0x7f7c10107280 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c0098a0 tx=0x7f7c0c009bb0 comp rx=0 tx=0).stop 2024-06-02T23:49:35.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.730+0000 7f7c17d0d700 1 -- 172.21.15.49:0/3001980713 shutdown_connections 2024-06-02T23:49:35.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.730+0000 7f7c17d0d700 1 --2- 172.21.15.49:0/3001980713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c10106e60 0x7f7c10107280 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:35.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.730+0000 7f7c17d0d700 1 -- 172.21.15.49:0/3001980713 >> 172.21.15.49:0/3001980713 conn(0x7f7c10102460 msgr2=0x7f7c10104880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:35.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.730+0000 7f7c17d0d700 1 -- 172.21.15.49:0/3001980713 shutdown_connections 2024-06-02T23:49:35.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.730+0000 7f7c17d0d700 1 -- 172.21.15.49:0/3001980713 wait complete. 2024-06-02T23:49:35.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.731+0000 7f7c17d0d700 1 Processor -- start 2024-06-02T23:49:35.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.731+0000 7f7c17d0d700 1 -- start start 2024-06-02T23:49:35.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.731+0000 7f7c17d0d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c10106e60 0x7f7c1019bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:35.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.731+0000 7f7c17d0d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7c1010b400 con 0x7f7c10106e60 2024-06-02T23:49:35.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.731+0000 7f7c15aa9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c10106e60 0x7f7c1019bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:35.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.731+0000 7f7c15aa9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c10106e60 0x7f7c1019bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48470/0 (socket says 172.21.15.49:48470) 2024-06-02T23:49:35.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.731+0000 7f7c15aa9700 1 -- 172.21.15.49:0/211645436 learned_addr learned my addr 172.21.15.49:0/211645436 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:35.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.731+0000 7f7c15aa9700 1 -- 172.21.15.49:0/211645436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c1019c460 con 0x7f7c10106e60 2024-06-02T23:49:35.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.732+0000 7f7c15aa9700 1 --2- 172.21.15.49:0/211645436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c10106e60 0x7f7c1019bf20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c011b60 tx=0x7f7c0c011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:35.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.734+0000 7f7c06ffd700 1 -- 172.21.15.49:0/211645436 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c0c003b20 con 0x7f7c10106e60 2024-06-02T23:49:35.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.734+0000 7f7c17d0d700 1 -- 172.21.15.49:0/211645436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c1019c6f0 con 0x7f7c10106e60 2024-06-02T23:49:35.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.734+0000 7f7c17d0d700 1 -- 172.21.15.49:0/211645436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c1019f3e0 con 0x7f7c10106e60 2024-06-02T23:49:35.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.734+0000 7f7c06ffd700 1 -- 172.21.15.49:0/211645436 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7c0c004300 con 0x7f7c10106e60 2024-06-02T23:49:35.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.734+0000 7f7c06ffd700 1 -- 172.21.15.49:0/211645436 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c0c0245a0 con 0x7f7c10106e60 2024-06-02T23:49:35.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.735+0000 7f7c06ffd700 1 -- 172.21.15.49:0/211645436 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f7c0c022020 con 0x7f7c10106e60 2024-06-02T23:49:35.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.735+0000 7f7c17d0d700 1 -- 172.21.15.49:0/211645436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bf4005360 con 0x7f7c10106e60 2024-06-02T23:49:35.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.735+0000 7f7c06ffd700 1 --2- 172.21.15.49:0/211645436 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f7bfc039050 0x7f7bfc03b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:35.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.735+0000 7f7c06ffd700 1 -- 172.21.15.49:0/211645436 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7c0c011e00 con 0x7f7c10106e60 2024-06-02T23:49:35.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.735+0000 7f7c152a8700 1 --2- 172.21.15.49:0/211645436 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f7bfc039050 0x7f7bfc03b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:35.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.736+0000 7f7c152a8700 1 --2- 172.21.15.49:0/211645436 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f7bfc039050 0x7f7bfc03b510 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7c00006fd0 tx=0x7f7c00006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:35.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.740+0000 7f7c06ffd700 1 -- 172.21.15.49:0/211645436 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7c0c02a2a0 con 0x7f7c10106e60 2024-06-02T23:49:35.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.948+0000 7f7c17d0d700 1 -- 172.21.15.49:0/211645436 --> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f7bf4000bf0 con 0x7f7bfc039050 2024-06-02T23:49:35.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.949+0000 7f7c06ffd700 1 -- 172.21.15.49:0/211645436 <== mgr.14120 v2:172.21.15.49:6800/1206062338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f7bf4000bf0 con 0x7f7bfc039050 2024-06-02T23:49:35.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.951+0000 7f7c17d0d700 1 -- 172.21.15.49:0/211645436 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f7bfc039050 msgr2=0x7f7bfc03b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:35.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.951+0000 7f7c17d0d700 1 --2- 172.21.15.49:0/211645436 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f7bfc039050 0x7f7bfc03b510 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7c00006fd0 tx=0x7f7c00006e40 comp rx=0 tx=0).stop 2024-06-02T23:49:35.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.951+0000 7f7c17d0d700 1 -- 172.21.15.49:0/211645436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c10106e60 msgr2=0x7f7c1019bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:35.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.951+0000 7f7c17d0d700 1 --2- 172.21.15.49:0/211645436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c10106e60 0x7f7c1019bf20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c011b60 tx=0x7f7c0c011c40 comp rx=0 tx=0).stop 2024-06-02T23:49:35.515 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.951+0000 7f7c17d0d700 1 -- 172.21.15.49:0/211645436 shutdown_connections 2024-06-02T23:49:35.515 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.951+0000 7f7c17d0d700 1 --2- 172.21.15.49:0/211645436 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f7bfc039050 0x7f7bfc03b510 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:35.515 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.951+0000 7f7c17d0d700 1 --2- 172.21.15.49:0/211645436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c10106e60 0x7f7c1019bf20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:35.515 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.951+0000 7f7c17d0d700 1 -- 172.21.15.49:0/211645436 >> 172.21.15.49:0/211645436 conn(0x7f7c10102460 msgr2=0x7f7c101032f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:35.515 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.951+0000 7f7c17d0d700 1 -- 172.21.15.49:0/211645436 shutdown_connections 2024-06-02T23:49:35.515 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:34.951+0000 7f7c17d0d700 1 -- 172.21.15.49:0/211645436 wait complete. 2024-06-02T23:49:35.515 INFO:teuthology.orchestra.run.smithi049.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-06-02T23:49:35.515 INFO:teuthology.orchestra.run.smithi049.stdout:Adding key to root@localhost authorized_keys... 2024-06-02T23:49:35.515 INFO:teuthology.orchestra.run.smithi049.stdout:Adding host smithi049... 2024-06-02T23:49:36.087 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:35 smithi049 ceph-mon[32302]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:49:37.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:37 smithi049 ceph-mon[32302]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi049", "addr": "172.21.15.49", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:49:37.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:37 smithi049 ceph-mon[32302]: Deploying cephadm binary to smithi049 2024-06-02T23:49:40.950 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout Added host 'smithi049' with addr '172.21.15.49' 2024-06-02T23:49:40.950 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.861+0000 7f9d6d45c700 1 Processor -- start 2024-06-02T23:49:40.950 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.861+0000 7f9d6d45c700 1 -- start start 2024-06-02T23:49:40.950 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.861+0000 7f9d6d45c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d68107ef0 0x7f9d68108310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:40.950 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.861+0000 7f9d6d45c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9d68108850 con 0x7f9d68107ef0 2024-06-02T23:49:40.950 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.861+0000 7f9d66ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d68107ef0 0x7f9d68108310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:40.950 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.861+0000 7f9d66ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d68107ef0 0x7f9d68108310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48474/0 (socket says 172.21.15.49:48474) 2024-06-02T23:49:40.951 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.861+0000 7f9d66ffd700 1 -- 172.21.15.49:0/1359255188 learned_addr learned my addr 172.21.15.49:0/1359255188 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:40.951 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.861+0000 7f9d66ffd700 1 -- 172.21.15.49:0/1359255188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d68109090 con 0x7f9d68107ef0 2024-06-02T23:49:40.951 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.862+0000 7f9d66ffd700 1 --2- 172.21.15.49:0/1359255188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d68107ef0 0x7f9d68108310 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9d580098a0 tx=0x7f9d58009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e95ef6e60dced200 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:40.951 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.862+0000 7f9d65ffb700 1 -- 172.21.15.49:0/1359255188 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d58004160 con 0x7f9d68107ef0 2024-06-02T23:49:40.951 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.862+0000 7f9d65ffb700 1 -- 172.21.15.49:0/1359255188 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9d58004300 con 0x7f9d68107ef0 2024-06-02T23:49:40.951 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.862+0000 7f9d65ffb700 1 -- 172.21.15.49:0/1359255188 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d58011b50 con 0x7f9d68107ef0 2024-06-02T23:49:40.951 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.862+0000 7f9d6d45c700 1 -- 172.21.15.49:0/1359255188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d68107ef0 msgr2=0x7f9d68108310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:40.951 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.863+0000 7f9d6d45c700 1 --2- 172.21.15.49:0/1359255188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d68107ef0 0x7f9d68108310 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9d580098a0 tx=0x7f9d58009bb0 comp rx=0 tx=0).stop 2024-06-02T23:49:40.951 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.863+0000 7f9d6d45c700 1 -- 172.21.15.49:0/1359255188 shutdown_connections 2024-06-02T23:49:40.951 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.863+0000 7f9d6d45c700 1 --2- 172.21.15.49:0/1359255188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d68107ef0 0x7f9d68108310 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:40.951 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.863+0000 7f9d6d45c700 1 -- 172.21.15.49:0/1359255188 >> 172.21.15.49:0/1359255188 conn(0x7f9d68103540 msgr2=0x7f9d68105960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:40.951 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.863+0000 7f9d6d45c700 1 -- 172.21.15.49:0/1359255188 shutdown_connections 2024-06-02T23:49:40.951 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.863+0000 7f9d6d45c700 1 -- 172.21.15.49:0/1359255188 wait complete. 2024-06-02T23:49:40.952 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.863+0000 7f9d6d45c700 1 Processor -- start 2024-06-02T23:49:40.952 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.863+0000 7f9d6d45c700 1 -- start start 2024-06-02T23:49:40.952 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.864+0000 7f9d6d45c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d68107ef0 0x7f9d6819bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:40.952 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.864+0000 7f9d6d45c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6810c350 con 0x7f9d68107ef0 2024-06-02T23:49:40.952 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.864+0000 7f9d66ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d68107ef0 0x7f9d6819bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:40.952 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.864+0000 7f9d66ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d68107ef0 0x7f9d6819bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48490/0 (socket says 172.21.15.49:48490) 2024-06-02T23:49:40.952 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.864+0000 7f9d66ffd700 1 -- 172.21.15.49:0/2162933714 learned_addr learned my addr 172.21.15.49:0/2162933714 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:40.952 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.864+0000 7f9d66ffd700 1 -- 172.21.15.49:0/2162933714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d6819c460 con 0x7f9d68107ef0 2024-06-02T23:49:40.952 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.864+0000 7f9d66ffd700 1 --2- 172.21.15.49:0/2162933714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d68107ef0 0x7f9d6819bf20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9d58009fb0 tx=0x7f9d58011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:40.952 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.864+0000 7f9d4ffff700 1 -- 172.21.15.49:0/2162933714 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d580038b0 con 0x7f9d68107ef0 2024-06-02T23:49:40.952 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.864+0000 7f9d4ffff700 1 -- 172.21.15.49:0/2162933714 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9d58011e50 con 0x7f9d68107ef0 2024-06-02T23:49:40.952 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.864+0000 7f9d6d45c700 1 -- 172.21.15.49:0/2162933714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d6819c6f0 con 0x7f9d68107ef0 2024-06-02T23:49:40.952 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.864+0000 7f9d4ffff700 1 -- 172.21.15.49:0/2162933714 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d58019550 con 0x7f9d68107ef0 2024-06-02T23:49:40.953 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.865+0000 7f9d6d45c700 1 -- 172.21.15.49:0/2162933714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d6819f3e0 con 0x7f9d68107ef0 2024-06-02T23:49:40.953 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.865+0000 7f9d4ffff700 1 -- 172.21.15.49:0/2162933714 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f9d58019850 con 0x7f9d68107ef0 2024-06-02T23:49:40.953 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.866+0000 7f9d6d45c700 1 -- 172.21.15.49:0/2162933714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d6810c4d0 con 0x7f9d68107ef0 2024-06-02T23:49:40.953 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.866+0000 7f9d4ffff700 1 --2- 172.21.15.49:0/2162933714 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f9d50039000 0x7f9d5003b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:40.953 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.866+0000 7f9d4ffff700 1 -- 172.21.15.49:0/2162933714 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f9d5804d2b0 con 0x7f9d68107ef0 2024-06-02T23:49:40.953 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.866+0000 7f9d667fc700 1 --2- 172.21.15.49:0/2162933714 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f9d50039000 0x7f9d5003b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:40.953 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.866+0000 7f9d667fc700 1 --2- 172.21.15.49:0/2162933714 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f9d50039000 0x7f9d5003b4c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c006fd0 tx=0x7f9d5c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:40.953 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:35.875+0000 7f9d4ffff700 1 -- 172.21.15.49:0/2162933714 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9d58020240 con 0x7f9d68107ef0 2024-06-02T23:49:40.953 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:36.087+0000 7f9d6d45c700 1 -- 172.21.15.49:0/2162933714 --> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi049", "addr": "172.21.15.49", "target": ["mon-mgr", ""]}) -- 0x7f9d68104790 con 0x7f9d50039000 2024-06-02T23:49:40.953 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:40.354+0000 7f9d4ffff700 1 -- 172.21.15.49:0/2162933714 <== mgr.14120 v2:172.21.15.49:6800/1206062338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f9d68104790 con 0x7f9d50039000 2024-06-02T23:49:40.953 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:40.357+0000 7f9d6d45c700 1 -- 172.21.15.49:0/2162933714 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f9d50039000 msgr2=0x7f9d5003b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:40.953 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:40.357+0000 7f9d6d45c700 1 --2- 172.21.15.49:0/2162933714 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f9d50039000 0x7f9d5003b4c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c006fd0 tx=0x7f9d5c006e40 comp rx=0 tx=0).stop 2024-06-02T23:49:40.953 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:40.357+0000 7f9d6d45c700 1 -- 172.21.15.49:0/2162933714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d68107ef0 msgr2=0x7f9d6819bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:40.954 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:40.357+0000 7f9d6d45c700 1 --2- 172.21.15.49:0/2162933714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d68107ef0 0x7f9d6819bf20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9d58009fb0 tx=0x7f9d58011bf0 comp rx=0 tx=0).stop 2024-06-02T23:49:40.954 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:40.357+0000 7f9d6d45c700 1 -- 172.21.15.49:0/2162933714 shutdown_connections 2024-06-02T23:49:40.954 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:40.357+0000 7f9d6d45c700 1 --2- 172.21.15.49:0/2162933714 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f9d50039000 0x7f9d5003b4c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:40.954 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:40.357+0000 7f9d6d45c700 1 --2- 172.21.15.49:0/2162933714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d68107ef0 0x7f9d6819bf20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:40.954 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:40.357+0000 7f9d6d45c700 1 -- 172.21.15.49:0/2162933714 >> 172.21.15.49:0/2162933714 conn(0x7f9d68103540 msgr2=0x7f9d68104080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:40.954 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:40.358+0000 7f9d6d45c700 1 -- 172.21.15.49:0/2162933714 shutdown_connections 2024-06-02T23:49:40.954 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:40.358+0000 7f9d6d45c700 1 -- 172.21.15.49:0/2162933714 wait complete. 2024-06-02T23:49:40.954 INFO:teuthology.orchestra.run.smithi049.stdout:Deploying unmanaged mon service... 2024-06-02T23:49:41.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:41 smithi049 ceph-mon[32302]: from='mgr.14120 172.21.15.49:0/2158042131' entity='mgr.x' 2024-06-02T23:49:41.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:41 smithi049 ceph-mon[32302]: Added host smithi049 2024-06-02T23:49:41.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:41 smithi049 ceph-mon[32302]: from='mgr.14120 172.21.15.49:0/2158042131' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:49:42.327 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-06-02T23:49:42.327 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.470+0000 7f06528be700 1 Processor -- start 2024-06-02T23:49:42.327 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.470+0000 7f06528be700 1 -- start start 2024-06-02T23:49:42.327 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.471+0000 7f06528be700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f064c108a00 0x7f064c10adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:42.327 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.471+0000 7f06528be700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f064c075db0 con 0x7f064c108a00 2024-06-02T23:49:42.327 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.471+0000 7f064bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f064c108a00 0x7f064c10adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:42.327 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.471+0000 7f064bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f064c108a00 0x7f064c10adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48498/0 (socket says 172.21.15.49:48498) 2024-06-02T23:49:42.327 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.471+0000 7f064bfff700 1 -- 172.21.15.49:0/3227796181 learned_addr learned my addr 172.21.15.49:0/3227796181 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:42.327 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.471+0000 7f064bfff700 1 -- 172.21.15.49:0/3227796181 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f064c10b330 con 0x7f064c108a00 2024-06-02T23:49:42.328 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.471+0000 7f064bfff700 1 --2- 172.21.15.49:0/3227796181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f064c108a00 0x7f064c10adf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f063c0098a0 tx=0x7f063c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551434a06ec6b5c3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:42.328 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.471+0000 7f064affd700 1 -- 172.21.15.49:0/3227796181 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f063c004160 con 0x7f064c108a00 2024-06-02T23:49:42.328 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.472+0000 7f064affd700 1 -- 172.21.15.49:0/3227796181 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f063c004300 con 0x7f064c108a00 2024-06-02T23:49:42.328 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.472+0000 7f064affd700 1 -- 172.21.15.49:0/3227796181 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f063c011b50 con 0x7f064c108a00 2024-06-02T23:49:42.328 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.472+0000 7f06528be700 1 -- 172.21.15.49:0/3227796181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f064c108a00 msgr2=0x7f064c10adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:42.328 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.472+0000 7f06528be700 1 --2- 172.21.15.49:0/3227796181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f064c108a00 0x7f064c10adf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f063c0098a0 tx=0x7f063c009bb0 comp rx=0 tx=0).stop 2024-06-02T23:49:42.328 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.472+0000 7f06528be700 1 -- 172.21.15.49:0/3227796181 shutdown_connections 2024-06-02T23:49:42.328 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.472+0000 7f06528be700 1 --2- 172.21.15.49:0/3227796181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f064c108a00 0x7f064c10adf0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:42.328 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.472+0000 7f06528be700 1 -- 172.21.15.49:0/3227796181 >> 172.21.15.49:0/3227796181 conn(0x7f064c102410 msgr2=0x7f064c104830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:42.328 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.472+0000 7f06528be700 1 -- 172.21.15.49:0/3227796181 shutdown_connections 2024-06-02T23:49:42.328 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.472+0000 7f06528be700 1 -- 172.21.15.49:0/3227796181 wait complete. 2024-06-02T23:49:42.328 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.473+0000 7f06528be700 1 Processor -- start 2024-06-02T23:49:42.328 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.473+0000 7f06528be700 1 -- start start 2024-06-02T23:49:42.328 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.473+0000 7f06528be700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f064c108a00 0x7f064c108280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:42.329 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.473+0000 7f06528be700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f064c10c350 con 0x7f064c108a00 2024-06-02T23:49:42.329 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.473+0000 7f064bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f064c108a00 0x7f064c108280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:42.329 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.473+0000 7f064bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f064c108a00 0x7f064c108280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48504/0 (socket says 172.21.15.49:48504) 2024-06-02T23:49:42.329 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.473+0000 7f064bfff700 1 -- 172.21.15.49:0/2795983982 learned_addr learned my addr 172.21.15.49:0/2795983982 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:42.329 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.473+0000 7f064bfff700 1 -- 172.21.15.49:0/2795983982 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f064c1087c0 con 0x7f064c108a00 2024-06-02T23:49:42.329 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.474+0000 7f064bfff700 1 --2- 172.21.15.49:0/2795983982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f064c108a00 0x7f064c108280 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f063c011670 tx=0x7f063c011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:42.329 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.474+0000 7f06497fa700 1 -- 172.21.15.49:0/2795983982 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f063c0039c0 con 0x7f064c108a00 2024-06-02T23:49:42.329 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.474+0000 7f06497fa700 1 -- 172.21.15.49:0/2795983982 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f063c011e50 con 0x7f064c108a00 2024-06-02T23:49:42.329 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.474+0000 7f06497fa700 1 -- 172.21.15.49:0/2795983982 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f063c01a5c0 con 0x7f064c108a00 2024-06-02T23:49:42.329 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.474+0000 7f06528be700 1 -- 172.21.15.49:0/2795983982 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f064c1069b0 con 0x7f064c108a00 2024-06-02T23:49:42.329 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.474+0000 7f06528be700 1 -- 172.21.15.49:0/2795983982 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f064c106ef0 con 0x7f064c108a00 2024-06-02T23:49:42.329 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.475+0000 7f06497fa700 1 -- 172.21.15.49:0/2795983982 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f063c024430 con 0x7f064c108a00 2024-06-02T23:49:42.329 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.475+0000 7f06528be700 1 -- 172.21.15.49:0/2795983982 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f064c063af0 con 0x7f064c108a00 2024-06-02T23:49:42.329 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.475+0000 7f06497fa700 1 --2- 172.21.15.49:0/2795983982 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f0634039050 0x7f063403b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:42.329 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.475+0000 7f06497fa700 1 -- 172.21.15.49:0/2795983982 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f063c04d510 con 0x7f064c108a00 2024-06-02T23:49:42.330 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.475+0000 7f064b7fe700 1 --2- 172.21.15.49:0/2795983982 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f0634039050 0x7f063403b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:42.330 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.475+0000 7f064b7fe700 1 --2- 172.21.15.49:0/2795983982 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f0634039050 0x7f063403b510 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0640006fd0 tx=0x7f0640006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:42.330 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.480+0000 7f06497fa700 1 -- 172.21.15.49:0/2795983982 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f063c02d910 con 0x7f064c108a00 2024-06-02T23:49:42.330 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.710+0000 7f06528be700 1 -- 172.21.15.49:0/2795983982 --> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f064c107740 con 0x7f0634039050 2024-06-02T23:49:42.330 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.715+0000 7f06497fa700 1 -- 172.21.15.49:0/2795983982 <== mgr.14120 v2:172.21.15.49:6800/1206062338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f064c107740 con 0x7f0634039050 2024-06-02T23:49:42.330 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.717+0000 7f06528be700 1 -- 172.21.15.49:0/2795983982 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f0634039050 msgr2=0x7f063403b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:42.330 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.717+0000 7f06528be700 1 --2- 172.21.15.49:0/2795983982 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f0634039050 0x7f063403b510 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0640006fd0 tx=0x7f0640006e40 comp rx=0 tx=0).stop 2024-06-02T23:49:42.330 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.717+0000 7f06528be700 1 -- 172.21.15.49:0/2795983982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f064c108a00 msgr2=0x7f064c108280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:42.330 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.717+0000 7f06528be700 1 --2- 172.21.15.49:0/2795983982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f064c108a00 0x7f064c108280 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f063c011670 tx=0x7f063c011b60 comp rx=0 tx=0).stop 2024-06-02T23:49:42.331 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.717+0000 7f06528be700 1 -- 172.21.15.49:0/2795983982 shutdown_connections 2024-06-02T23:49:42.331 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.717+0000 7f06528be700 1 --2- 172.21.15.49:0/2795983982 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f0634039050 0x7f063403b510 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:42.331 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.717+0000 7f06528be700 1 --2- 172.21.15.49:0/2795983982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f064c108a00 0x7f064c108280 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:42.331 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.717+0000 7f06528be700 1 -- 172.21.15.49:0/2795983982 >> 172.21.15.49:0/2795983982 conn(0x7f064c102410 msgr2=0x7f064c102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:42.331 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.718+0000 7f06528be700 1 -- 172.21.15.49:0/2795983982 shutdown_connections 2024-06-02T23:49:42.331 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:41.718+0000 7f06528be700 1 -- 172.21.15.49:0/2795983982 wait complete. 2024-06-02T23:49:42.331 INFO:teuthology.orchestra.run.smithi049.stdout:Deploying unmanaged mgr service... 2024-06-02T23:49:42.889 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:42 smithi049 ceph-mon[32302]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:49:42.889 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:42 smithi049 ceph-mon[32302]: Saving service mon spec with placement count:5 2024-06-02T23:49:42.889 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:42 smithi049 ceph-mon[32302]: from='mgr.14120 172.21.15.49:0/2158042131' entity='mgr.x' 2024-06-02T23:49:43.609 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-06-02T23:49:43.609 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.755+0000 7fcc71739700 1 Processor -- start 2024-06-02T23:49:43.610 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.755+0000 7fcc71739700 1 -- start start 2024-06-02T23:49:43.610 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.756+0000 7fcc71739700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc6c1083c0 0x7fcc6c1087e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:43.610 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.756+0000 7fcc71739700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6c108db0 con 0x7fcc6c1083c0 2024-06-02T23:49:43.610 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.756+0000 7fcc6affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc6c1083c0 0x7fcc6c1087e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:43.610 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.756+0000 7fcc6affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc6c1083c0 0x7fcc6c1087e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48508/0 (socket says 172.21.15.49:48508) 2024-06-02T23:49:43.610 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.756+0000 7fcc6affd700 1 -- 172.21.15.49:0/3110604951 learned_addr learned my addr 172.21.15.49:0/3110604951 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:43.610 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.756+0000 7fcc6affd700 1 -- 172.21.15.49:0/3110604951 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc6c107020 con 0x7fcc6c1083c0 2024-06-02T23:49:43.610 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.756+0000 7fcc6affd700 1 --2- 172.21.15.49:0/3110604951 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc6c1083c0 0x7fcc6c1087e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c0098a0 tx=0x7fcc5c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e085350f10cf60f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:43.610 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.756+0000 7fcc6a7fc700 1 -- 172.21.15.49:0/3110604951 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc5c004160 con 0x7fcc6c1083c0 2024-06-02T23:49:43.610 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.756+0000 7fcc6a7fc700 1 -- 172.21.15.49:0/3110604951 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcc5c004300 con 0x7fcc6c1083c0 2024-06-02T23:49:43.610 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.756+0000 7fcc6a7fc700 1 -- 172.21.15.49:0/3110604951 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc5c011b50 con 0x7fcc6c1083c0 2024-06-02T23:49:43.610 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.757+0000 7fcc71739700 1 -- 172.21.15.49:0/3110604951 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc6c1083c0 msgr2=0x7fcc6c1087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:43.610 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.757+0000 7fcc71739700 1 --2- 172.21.15.49:0/3110604951 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc6c1083c0 0x7fcc6c1087e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c0098a0 tx=0x7fcc5c009bb0 comp rx=0 tx=0).stop 2024-06-02T23:49:43.611 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.757+0000 7fcc71739700 1 -- 172.21.15.49:0/3110604951 shutdown_connections 2024-06-02T23:49:43.611 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.757+0000 7fcc71739700 1 --2- 172.21.15.49:0/3110604951 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc6c1083c0 0x7fcc6c1087e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:43.611 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.757+0000 7fcc71739700 1 -- 172.21.15.49:0/3110604951 >> 172.21.15.49:0/3110604951 conn(0x7fcc6c101bd0 msgr2=0x7fcc6c103ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:43.611 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.757+0000 7fcc71739700 1 -- 172.21.15.49:0/3110604951 shutdown_connections 2024-06-02T23:49:43.611 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.757+0000 7fcc71739700 1 -- 172.21.15.49:0/3110604951 wait complete. 2024-06-02T23:49:43.611 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.758+0000 7fcc71739700 1 Processor -- start 2024-06-02T23:49:43.611 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.758+0000 7fcc71739700 1 -- start start 2024-06-02T23:49:43.611 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.758+0000 7fcc71739700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc6c1083c0 0x7fcc6c19beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:43.611 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.758+0000 7fcc71739700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6c10b3e0 con 0x7fcc6c1083c0 2024-06-02T23:49:43.611 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.758+0000 7fcc6affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc6c1083c0 0x7fcc6c19beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:43.611 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.758+0000 7fcc6affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc6c1083c0 0x7fcc6c19beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48516/0 (socket says 172.21.15.49:48516) 2024-06-02T23:49:43.611 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.758+0000 7fcc6affd700 1 -- 172.21.15.49:0/3529058741 learned_addr learned my addr 172.21.15.49:0/3529058741 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:43.611 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.759+0000 7fcc6affd700 1 -- 172.21.15.49:0/3529058741 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc6c19c3f0 con 0x7fcc6c1083c0 2024-06-02T23:49:43.611 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.759+0000 7fcc6affd700 1 --2- 172.21.15.49:0/3529058741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc6c1083c0 0x7fcc6c19beb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c011670 tx=0x7fcc5c011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:43.611 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.759+0000 7fcc68ff9700 1 -- 172.21.15.49:0/3529058741 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc5c0039c0 con 0x7fcc6c1083c0 2024-06-02T23:49:43.612 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.759+0000 7fcc71739700 1 -- 172.21.15.49:0/3529058741 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc6c19c680 con 0x7fcc6c1083c0 2024-06-02T23:49:43.612 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.759+0000 7fcc68ff9700 1 -- 172.21.15.49:0/3529058741 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcc5c011e50 con 0x7fcc6c1083c0 2024-06-02T23:49:43.612 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.759+0000 7fcc71739700 1 -- 172.21.15.49:0/3529058741 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc6c19f370 con 0x7fcc6c1083c0 2024-06-02T23:49:43.612 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.759+0000 7fcc68ff9700 1 -- 172.21.15.49:0/3529058741 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc5c004300 con 0x7fcc6c1083c0 2024-06-02T23:49:43.612 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.760+0000 7fcc68ff9700 1 -- 172.21.15.49:0/3529058741 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fcc5c01a430 con 0x7fcc6c1083c0 2024-06-02T23:49:43.612 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.760+0000 7fcc71739700 1 -- 172.21.15.49:0/3529058741 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc6c063af0 con 0x7fcc6c1083c0 2024-06-02T23:49:43.612 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.760+0000 7fcc68ff9700 1 --2- 172.21.15.49:0/3529058741 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7fcc580391a0 0x7fcc5803b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:43.612 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.760+0000 7fcc68ff9700 1 -- 172.21.15.49:0/3529058741 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fcc5c04d350 con 0x7fcc6c1083c0 2024-06-02T23:49:43.612 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.760+0000 7fcc627fc700 1 --2- 172.21.15.49:0/3529058741 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7fcc580391a0 0x7fcc5803b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:43.612 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.761+0000 7fcc627fc700 1 --2- 172.21.15.49:0/3529058741 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7fcc580391a0 0x7fcc5803b660 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcc54006fd0 tx=0x7fcc54006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:43.612 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.765+0000 7fcc68ff9700 1 -- 172.21.15.49:0/3529058741 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fcc5c00b7e0 con 0x7fcc6c1083c0 2024-06-02T23:49:43.612 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.990+0000 7fcc71739700 1 -- 172.21.15.49:0/3529058741 --> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fcc6c0008d0 con 0x7fcc580391a0 2024-06-02T23:49:43.612 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.995+0000 7fcc68ff9700 1 -- 172.21.15.49:0/3529058741 <== mgr.14120 v2:172.21.15.49:6800/1206062338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fcc6c0008d0 con 0x7fcc580391a0 2024-06-02T23:49:43.613 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.997+0000 7fcc71739700 1 -- 172.21.15.49:0/3529058741 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7fcc580391a0 msgr2=0x7fcc5803b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:43.613 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.997+0000 7fcc71739700 1 --2- 172.21.15.49:0/3529058741 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7fcc580391a0 0x7fcc5803b660 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcc54006fd0 tx=0x7fcc54006e40 comp rx=0 tx=0).stop 2024-06-02T23:49:43.613 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.997+0000 7fcc71739700 1 -- 172.21.15.49:0/3529058741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc6c1083c0 msgr2=0x7fcc6c19beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:43.613 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.997+0000 7fcc71739700 1 --2- 172.21.15.49:0/3529058741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc6c1083c0 0x7fcc6c19beb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c011670 tx=0x7fcc5c011b60 comp rx=0 tx=0).stop 2024-06-02T23:49:43.613 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.998+0000 7fcc71739700 1 -- 172.21.15.49:0/3529058741 shutdown_connections 2024-06-02T23:49:43.613 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.998+0000 7fcc71739700 1 --2- 172.21.15.49:0/3529058741 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7fcc580391a0 0x7fcc5803b660 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:43.613 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.998+0000 7fcc71739700 1 --2- 172.21.15.49:0/3529058741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc6c1083c0 0x7fcc6c19beb0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:43.613 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.998+0000 7fcc71739700 1 -- 172.21.15.49:0/3529058741 >> 172.21.15.49:0/3529058741 conn(0x7fcc6c101bd0 msgr2=0x7fcc6c102a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:43.613 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.998+0000 7fcc71739700 1 -- 172.21.15.49:0/3529058741 shutdown_connections 2024-06-02T23:49:43.613 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:42.998+0000 7fcc71739700 1 -- 172.21.15.49:0/3529058741 wait complete. 2024-06-02T23:49:44.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:43 smithi049 ceph-mon[32302]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:49:44.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:43 smithi049 ceph-mon[32302]: Saving service mgr spec with placement count:2 2024-06-02T23:49:44.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:43 smithi049 ceph-mon[32302]: from='mgr.14120 172.21.15.49:0/2158042131' entity='mgr.x' 2024-06-02T23:49:44.876 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.008+0000 7f40d8e84700 1 Processor -- start 2024-06-02T23:49:44.876 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.008+0000 7f40d8e84700 1 -- start start 2024-06-02T23:49:44.876 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.009+0000 7f40d8e84700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40d4106e20 0x7f40d4107240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:44.876 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.009+0000 7f40d8e84700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f40d4107780 con 0x7f40d4106e20 2024-06-02T23:49:44.877 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.009+0000 7f40d259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40d4106e20 0x7f40d4107240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:44.877 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.009+0000 7f40d259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40d4106e20 0x7f40d4107240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36564/0 (socket says 172.21.15.49:36564) 2024-06-02T23:49:44.877 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.009+0000 7f40d259c700 1 -- 172.21.15.49:0/2039316581 learned_addr learned my addr 172.21.15.49:0/2039316581 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:44.877 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.009+0000 7f40d259c700 1 -- 172.21.15.49:0/2039316581 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40d4107f80 con 0x7f40d4106e20 2024-06-02T23:49:44.877 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.009+0000 7f40d259c700 1 --2- 172.21.15.49:0/2039316581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40d4106e20 0x7f40d4107240 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f40c40098a0 tx=0x7f40c4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53ed5ad6b8549f0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:44.877 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.009+0000 7f40d159a700 1 -- 172.21.15.49:0/2039316581 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c4004160 con 0x7f40d4106e20 2024-06-02T23:49:44.877 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.010+0000 7f40d159a700 1 -- 172.21.15.49:0/2039316581 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f40c4004300 con 0x7f40d4106e20 2024-06-02T23:49:44.877 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.010+0000 7f40d159a700 1 -- 172.21.15.49:0/2039316581 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c4011b50 con 0x7f40d4106e20 2024-06-02T23:49:44.877 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.010+0000 7f40d8e84700 1 -- 172.21.15.49:0/2039316581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40d4106e20 msgr2=0x7f40d4107240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:44.877 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.010+0000 7f40d8e84700 1 --2- 172.21.15.49:0/2039316581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40d4106e20 0x7f40d4107240 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f40c40098a0 tx=0x7f40c4009bb0 comp rx=0 tx=0).stop 2024-06-02T23:49:44.877 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.010+0000 7f40d8e84700 1 -- 172.21.15.49:0/2039316581 shutdown_connections 2024-06-02T23:49:44.877 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.010+0000 7f40d8e84700 1 --2- 172.21.15.49:0/2039316581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40d4106e20 0x7f40d4107240 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:44.877 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.010+0000 7f40d8e84700 1 -- 172.21.15.49:0/2039316581 >> 172.21.15.49:0/2039316581 conn(0x7f40d41023e0 msgr2=0x7f40d4104800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:44.878 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.010+0000 7f40d8e84700 1 -- 172.21.15.49:0/2039316581 shutdown_connections 2024-06-02T23:49:44.878 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.010+0000 7f40d8e84700 1 -- 172.21.15.49:0/2039316581 wait complete. 2024-06-02T23:49:44.878 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.011+0000 7f40d8e84700 1 Processor -- start 2024-06-02T23:49:44.878 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.011+0000 7f40d8e84700 1 -- start start 2024-06-02T23:49:44.878 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.011+0000 7f40d8e84700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40d4106e20 0x7f40d419be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:44.878 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.011+0000 7f40d8e84700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f40d410b3c0 con 0x7f40d4106e20 2024-06-02T23:49:44.878 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.011+0000 7f40d259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40d4106e20 0x7f40d419be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:44.878 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.011+0000 7f40d259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40d4106e20 0x7f40d419be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36570/0 (socket says 172.21.15.49:36570) 2024-06-02T23:49:44.878 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.011+0000 7f40d259c700 1 -- 172.21.15.49:0/1429588600 learned_addr learned my addr 172.21.15.49:0/1429588600 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:44.878 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.012+0000 7f40d259c700 1 -- 172.21.15.49:0/1429588600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40d419c3d0 con 0x7f40d4106e20 2024-06-02T23:49:44.878 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.012+0000 7f40d259c700 1 --2- 172.21.15.49:0/1429588600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40d4106e20 0x7f40d419be90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f40c4011670 tx=0x7f40c4011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:44.878 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.012+0000 7f40cb7fe700 1 -- 172.21.15.49:0/1429588600 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c40039c0 con 0x7f40d4106e20 2024-06-02T23:49:44.878 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.012+0000 7f40d8e84700 1 -- 172.21.15.49:0/1429588600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40d419c660 con 0x7f40d4106e20 2024-06-02T23:49:44.879 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.012+0000 7f40cb7fe700 1 -- 172.21.15.49:0/1429588600 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f40c4011e50 con 0x7f40d4106e20 2024-06-02T23:49:44.879 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.012+0000 7f40cb7fe700 1 -- 172.21.15.49:0/1429588600 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c401a5c0 con 0x7f40d4106e20 2024-06-02T23:49:44.879 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.012+0000 7f40d8e84700 1 -- 172.21.15.49:0/1429588600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40d419f350 con 0x7f40d4106e20 2024-06-02T23:49:44.879 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.013+0000 7f40cb7fe700 1 -- 172.21.15.49:0/1429588600 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f40c401a870 con 0x7f40d4106e20 2024-06-02T23:49:44.879 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.013+0000 7f40d8e84700 1 -- 172.21.15.49:0/1429588600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40d4063af0 con 0x7f40d4106e20 2024-06-02T23:49:44.879 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.013+0000 7f40cb7fe700 1 --2- 172.21.15.49:0/1429588600 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f40c0039050 0x7f40c003b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:44.879 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.013+0000 7f40cb7fe700 1 -- 172.21.15.49:0/1429588600 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f40c404d570 con 0x7f40d4106e20 2024-06-02T23:49:44.879 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.013+0000 7f40d1d9b700 1 --2- 172.21.15.49:0/1429588600 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f40c0039050 0x7f40c003b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:44.879 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.014+0000 7f40d1d9b700 1 --2- 172.21.15.49:0/1429588600 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f40c0039050 0x7f40c003b510 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f40bc006fd0 tx=0x7f40bc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:44.879 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.018+0000 7f40cb7fe700 1 -- 172.21.15.49:0/1429588600 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f40c4019c70 con 0x7f40d4106e20 2024-06-02T23:49:44.879 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.226+0000 7f40d8e84700 1 -- 172.21.15.49:0/1429588600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f40d419f9a0 con 0x7f40d4106e20 2024-06-02T23:49:44.879 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.228+0000 7f40cb7fe700 1 -- 172.21.15.49:0/1429588600 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v6)=0 v6) ==== 142+0+0 (secure 0 0 0) 0x7f40c402cc00 con 0x7f40d4106e20 2024-06-02T23:49:44.879 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.230+0000 7f40d8e84700 1 -- 172.21.15.49:0/1429588600 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f40c0039050 msgr2=0x7f40c003b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:44.879 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.230+0000 7f40d8e84700 1 --2- 172.21.15.49:0/1429588600 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f40c0039050 0x7f40c003b510 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f40bc006fd0 tx=0x7f40bc006e40 comp rx=0 tx=0).stop 2024-06-02T23:49:44.880 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.230+0000 7f40d8e84700 1 -- 172.21.15.49:0/1429588600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40d4106e20 msgr2=0x7f40d419be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:44.880 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.230+0000 7f40d8e84700 1 --2- 172.21.15.49:0/1429588600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40d4106e20 0x7f40d419be90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f40c4011670 tx=0x7f40c4011b60 comp rx=0 tx=0).stop 2024-06-02T23:49:44.880 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.231+0000 7f40d8e84700 1 -- 172.21.15.49:0/1429588600 shutdown_connections 2024-06-02T23:49:44.880 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.231+0000 7f40d8e84700 1 --2- 172.21.15.49:0/1429588600 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f40c0039050 0x7f40c003b510 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:44.880 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.231+0000 7f40d8e84700 1 --2- 172.21.15.49:0/1429588600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40d4106e20 0x7f40d419be90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:44.880 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.231+0000 7f40d8e84700 1 -- 172.21.15.49:0/1429588600 >> 172.21.15.49:0/1429588600 conn(0x7f40d41023e0 msgr2=0x7f40d4102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:44.880 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.231+0000 7f40d8e84700 1 -- 172.21.15.49:0/1429588600 shutdown_connections 2024-06-02T23:49:44.880 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:44.231+0000 7f40d8e84700 1 -- 172.21.15.49:0/1429588600 wait complete. 2024-06-02T23:49:45.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:45 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/1429588600' entity='client.admin' 2024-06-02T23:49:45.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:45 smithi049 ceph-mon[32302]: from='mgr.14120 172.21.15.49:0/2158042131' entity='mgr.x' 2024-06-02T23:49:45.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:45 smithi049 ceph-mon[32302]: from='mgr.14120 172.21.15.49:0/2158042131' entity='mgr.x' 2024-06-02T23:49:46.335 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.363+0000 7fcf6c571700 1 Processor -- start 2024-06-02T23:49:46.335 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.363+0000 7fcf6c571700 1 -- start start 2024-06-02T23:49:46.335 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.363+0000 7fcf6c571700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf641089e0 0x7fcf6410add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:46.335 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.363+0000 7fcf6c571700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcf64075dd0 con 0x7fcf641089e0 2024-06-02T23:49:46.335 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.364+0000 7fcf6a30d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf641089e0 0x7fcf6410add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:46.336 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.364+0000 7fcf6a30d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf641089e0 0x7fcf6410add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36582/0 (socket says 172.21.15.49:36582) 2024-06-02T23:49:46.336 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.364+0000 7fcf6a30d700 1 -- 172.21.15.49:0/615452526 learned_addr learned my addr 172.21.15.49:0/615452526 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:46.336 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.364+0000 7fcf6a30d700 1 -- 172.21.15.49:0/615452526 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf6410b310 con 0x7fcf641089e0 2024-06-02T23:49:46.336 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.364+0000 7fcf6a30d700 1 --2- 172.21.15.49:0/615452526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf641089e0 0x7fcf6410add0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcf600098a0 tx=0x7fcf60009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e2b5e3269be794a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:46.336 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.364+0000 7fcf6930b700 1 -- 172.21.15.49:0/615452526 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf60004160 con 0x7fcf641089e0 2024-06-02T23:49:46.336 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.364+0000 7fcf6930b700 1 -- 172.21.15.49:0/615452526 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf60004300 con 0x7fcf641089e0 2024-06-02T23:49:46.336 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.364+0000 7fcf6930b700 1 -- 172.21.15.49:0/615452526 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf60011b20 con 0x7fcf641089e0 2024-06-02T23:49:46.336 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.365+0000 7fcf6c571700 1 -- 172.21.15.49:0/615452526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf641089e0 msgr2=0x7fcf6410add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:46.336 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.365+0000 7fcf6c571700 1 --2- 172.21.15.49:0/615452526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf641089e0 0x7fcf6410add0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcf600098a0 tx=0x7fcf60009bb0 comp rx=0 tx=0).stop 2024-06-02T23:49:46.336 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.365+0000 7fcf6c571700 1 -- 172.21.15.49:0/615452526 shutdown_connections 2024-06-02T23:49:46.336 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.365+0000 7fcf6c571700 1 --2- 172.21.15.49:0/615452526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf641089e0 0x7fcf6410add0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:46.336 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.365+0000 7fcf6c571700 1 -- 172.21.15.49:0/615452526 >> 172.21.15.49:0/615452526 conn(0x7fcf64102410 msgr2=0x7fcf64104830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:46.337 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.365+0000 7fcf6c571700 1 -- 172.21.15.49:0/615452526 shutdown_connections 2024-06-02T23:49:46.337 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.365+0000 7fcf6c571700 1 -- 172.21.15.49:0/615452526 wait complete. 2024-06-02T23:49:46.337 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.366+0000 7fcf6c571700 1 Processor -- start 2024-06-02T23:49:46.337 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.366+0000 7fcf6c571700 1 -- start start 2024-06-02T23:49:46.337 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.366+0000 7fcf6c571700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf641089e0 0x7fcf6419be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:46.337 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.366+0000 7fcf6c571700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6410c310 con 0x7fcf641089e0 2024-06-02T23:49:46.337 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.366+0000 7fcf6a30d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf641089e0 0x7fcf6419be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:46.337 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.366+0000 7fcf6a30d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf641089e0 0x7fcf6419be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36584/0 (socket says 172.21.15.49:36584) 2024-06-02T23:49:46.338 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.366+0000 7fcf6a30d700 1 -- 172.21.15.49:0/914721638 learned_addr learned my addr 172.21.15.49:0/914721638 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:46.338 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.366+0000 7fcf6a30d700 1 -- 172.21.15.49:0/914721638 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf6419c340 con 0x7fcf641089e0 2024-06-02T23:49:46.338 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.367+0000 7fcf6a30d700 1 --2- 172.21.15.49:0/914721638 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf641089e0 0x7fcf6419be00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcf600117e0 tx=0x7fcf60011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:46.338 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.367+0000 7fcf577fe700 1 -- 172.21.15.49:0/914721638 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf60003bf0 con 0x7fcf641089e0 2024-06-02T23:49:46.338 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.367+0000 7fcf577fe700 1 -- 172.21.15.49:0/914721638 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf6001a910 con 0x7fcf641089e0 2024-06-02T23:49:46.338 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.367+0000 7fcf6c571700 1 -- 172.21.15.49:0/914721638 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf6419c630 con 0x7fcf641089e0 2024-06-02T23:49:46.338 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.367+0000 7fcf577fe700 1 -- 172.21.15.49:0/914721638 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf60024970 con 0x7fcf641089e0 2024-06-02T23:49:46.338 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.367+0000 7fcf6c571700 1 -- 172.21.15.49:0/914721638 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf6419f2c0 con 0x7fcf641089e0 2024-06-02T23:49:46.338 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.368+0000 7fcf6c571700 1 -- 172.21.15.49:0/914721638 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf64063af0 con 0x7fcf641089e0 2024-06-02T23:49:46.338 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.368+0000 7fcf577fe700 1 -- 172.21.15.49:0/914721638 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fcf60022020 con 0x7fcf641089e0 2024-06-02T23:49:46.338 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.368+0000 7fcf577fe700 1 --2- 172.21.15.49:0/914721638 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7fcf50039050 0x7fcf5003b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:46.339 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.368+0000 7fcf577fe700 1 -- 172.21.15.49:0/914721638 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fcf6004d480 con 0x7fcf641089e0 2024-06-02T23:49:46.339 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.368+0000 7fcf69b0c700 1 --2- 172.21.15.49:0/914721638 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7fcf50039050 0x7fcf5003b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:46.339 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.369+0000 7fcf69b0c700 1 --2- 172.21.15.49:0/914721638 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7fcf50039050 0x7fcf5003b510 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcf58006fd0 tx=0x7fcf58006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:46.339 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.378+0000 7fcf577fe700 1 -- 172.21.15.49:0/914721638 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fcf60011e20 con 0x7fcf641089e0 2024-06-02T23:49:46.339 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.596+0000 7fcf6c571700 1 -- 172.21.15.49:0/914721638 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fcf6419f5e0 con 0x7fcf641089e0 2024-06-02T23:49:46.339 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.598+0000 7fcf577fe700 1 -- 172.21.15.49:0/914721638 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fcf60019c70 con 0x7fcf641089e0 2024-06-02T23:49:46.339 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.601+0000 7fcf6c571700 1 -- 172.21.15.49:0/914721638 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7fcf50039050 msgr2=0x7fcf5003b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:46.339 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.601+0000 7fcf6c571700 1 --2- 172.21.15.49:0/914721638 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7fcf50039050 0x7fcf5003b510 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcf58006fd0 tx=0x7fcf58006e40 comp rx=0 tx=0).stop 2024-06-02T23:49:46.339 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.601+0000 7fcf6c571700 1 -- 172.21.15.49:0/914721638 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf641089e0 msgr2=0x7fcf6419be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:46.340 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.601+0000 7fcf6c571700 1 --2- 172.21.15.49:0/914721638 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf641089e0 0x7fcf6419be00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcf600117e0 tx=0x7fcf60011c10 comp rx=0 tx=0).stop 2024-06-02T23:49:46.340 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.601+0000 7fcf6c571700 1 -- 172.21.15.49:0/914721638 shutdown_connections 2024-06-02T23:49:46.340 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.601+0000 7fcf6c571700 1 --2- 172.21.15.49:0/914721638 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7fcf50039050 0x7fcf5003b510 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:46.340 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.601+0000 7fcf6c571700 1 --2- 172.21.15.49:0/914721638 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf641089e0 0x7fcf6419be00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:46.340 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.601+0000 7fcf6c571700 1 -- 172.21.15.49:0/914721638 >> 172.21.15.49:0/914721638 conn(0x7fcf64102410 msgr2=0x7fcf64102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:46.340 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.601+0000 7fcf6c571700 1 -- 172.21.15.49:0/914721638 shutdown_connections 2024-06-02T23:49:46.340 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:45.601+0000 7fcf6c571700 1 -- 172.21.15.49:0/914721638 wait complete. 2024-06-02T23:49:46.340 INFO:teuthology.orchestra.run.smithi049.stdout:Enabling the dashboard module... 2024-06-02T23:49:46.960 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:46 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/914721638' entity='client.admin' 2024-06-02T23:49:48.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:47 smithi049 ceph-mon[32302]: from='mgr.14120 172.21.15.49:0/2158042131' entity='mgr.x' 2024-06-02T23:49:48.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:47 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/2860452691' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-06-02T23:49:48.211 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:48 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: ignoring --setuser ceph since I am not root 2024-06-02T23:49:48.211 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:48 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: ignoring --setgroup ceph since I am not root 2024-06-02T23:49:48.211 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:48 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:48.143+0000 7f04356a5200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-02T23:49:48.578 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:48 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:48.345+0000 7f04356a5200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-02T23:49:48.578 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:48 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:48.452+0000 7f04356a5200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-02T23:49:48.584 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.255+0000 7fe91f73b700 1 Processor -- start 2024-06-02T23:49:48.585 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.256+0000 7fe91f73b700 1 -- start start 2024-06-02T23:49:48.585 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.256+0000 7fe91f73b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe918108980 0x7fe91810ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:48.585 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.256+0000 7fe91f73b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe91807be20 con 0x7fe918108980 2024-06-02T23:49:48.585 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.256+0000 7fe91d4d7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe918108980 0x7fe91810ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:48.585 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.256+0000 7fe91d4d7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe918108980 0x7fe91810ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36592/0 (socket says 172.21.15.49:36592) 2024-06-02T23:49:48.585 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.256+0000 7fe91d4d7700 1 -- 172.21.15.49:0/789814660 learned_addr learned my addr 172.21.15.49:0/789814660 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:48.585 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.256+0000 7fe91d4d7700 1 -- 172.21.15.49:0/789814660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe91810b2b0 con 0x7fe918108980 2024-06-02T23:49:48.585 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.256+0000 7fe91d4d7700 1 --2- 172.21.15.49:0/789814660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe918108980 0x7fe91810ad70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe90c0098a0 tx=0x7fe90c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e324430536ee4ec server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:48.585 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.257+0000 7fe90bfff700 1 -- 172.21.15.49:0/789814660 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe90c004160 con 0x7fe918108980 2024-06-02T23:49:48.585 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.257+0000 7fe90bfff700 1 -- 172.21.15.49:0/789814660 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe90c004300 con 0x7fe918108980 2024-06-02T23:49:48.585 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.257+0000 7fe90bfff700 1 -- 172.21.15.49:0/789814660 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe90c011b20 con 0x7fe918108980 2024-06-02T23:49:48.585 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.257+0000 7fe91f73b700 1 -- 172.21.15.49:0/789814660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe918108980 msgr2=0x7fe91810ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:48.586 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.257+0000 7fe91f73b700 1 --2- 172.21.15.49:0/789814660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe918108980 0x7fe91810ad70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe90c0098a0 tx=0x7fe90c009bb0 comp rx=0 tx=0).stop 2024-06-02T23:49:48.586 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.257+0000 7fe91f73b700 1 -- 172.21.15.49:0/789814660 shutdown_connections 2024-06-02T23:49:48.586 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.257+0000 7fe91f73b700 1 --2- 172.21.15.49:0/789814660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe918108980 0x7fe91810ad70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:48.586 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.257+0000 7fe91f73b700 1 -- 172.21.15.49:0/789814660 >> 172.21.15.49:0/789814660 conn(0x7fe9181023f0 msgr2=0x7fe918104810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:48.586 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.258+0000 7fe91f73b700 1 -- 172.21.15.49:0/789814660 shutdown_connections 2024-06-02T23:49:48.586 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.258+0000 7fe91f73b700 1 -- 172.21.15.49:0/789814660 wait complete. 2024-06-02T23:49:48.586 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.258+0000 7fe91f73b700 1 Processor -- start 2024-06-02T23:49:48.586 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.258+0000 7fe91f73b700 1 -- start start 2024-06-02T23:49:48.586 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.258+0000 7fe91f73b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe918108980 0x7fe91819e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:48.586 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.258+0000 7fe91f73b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe91810c320 con 0x7fe918108980 2024-06-02T23:49:48.586 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.259+0000 7fe91d4d7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe918108980 0x7fe91819e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:48.586 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.259+0000 7fe91d4d7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe918108980 0x7fe91819e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36598/0 (socket says 172.21.15.49:36598) 2024-06-02T23:49:48.586 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.259+0000 7fe91d4d7700 1 -- 172.21.15.49:0/2860452691 learned_addr learned my addr 172.21.15.49:0/2860452691 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:48.587 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.259+0000 7fe91d4d7700 1 -- 172.21.15.49:0/2860452691 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe91819e550 con 0x7fe918108980 2024-06-02T23:49:48.587 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.259+0000 7fe91d4d7700 1 --2- 172.21.15.49:0/2860452691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe918108980 0x7fe91819e010 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe90c0117e0 tx=0x7fe90c011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:48.587 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.259+0000 7fe90a7fc700 1 -- 172.21.15.49:0/2860452691 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe90c003bf0 con 0x7fe918108980 2024-06-02T23:49:48.587 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.259+0000 7fe90a7fc700 1 -- 172.21.15.49:0/2860452691 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe90c01a910 con 0x7fe918108980 2024-06-02T23:49:48.587 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.259+0000 7fe90a7fc700 1 -- 172.21.15.49:0/2860452691 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe90c024970 con 0x7fe918108980 2024-06-02T23:49:48.587 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.259+0000 7fe91f73b700 1 -- 172.21.15.49:0/2860452691 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe91819e7e0 con 0x7fe918108980 2024-06-02T23:49:48.587 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.259+0000 7fe91f73b700 1 -- 172.21.15.49:0/2860452691 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe91819eb80 con 0x7fe918108980 2024-06-02T23:49:48.587 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.260+0000 7fe91f73b700 1 -- 172.21.15.49:0/2860452691 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe918063af0 con 0x7fe918108980 2024-06-02T23:49:48.587 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.260+0000 7fe90a7fc700 1 -- 172.21.15.49:0/2860452691 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fe90c022020 con 0x7fe918108980 2024-06-02T23:49:48.587 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.261+0000 7fe90a7fc700 1 --2- 172.21.15.49:0/2860452691 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7fe904039050 0x7fe90403b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:48.587 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.261+0000 7fe90a7fc700 1 -- 172.21.15.49:0/2860452691 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe90c04d4a0 con 0x7fe918108980 2024-06-02T23:49:48.587 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.261+0000 7fe91ccd6700 1 --2- 172.21.15.49:0/2860452691 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7fe904039050 0x7fe90403b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:48.587 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.261+0000 7fe91ccd6700 1 --2- 172.21.15.49:0/2860452691 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7fe904039050 0x7fe90403b510 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe914006fd0 tx=0x7fe914006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:48.587 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.266+0000 7fe90a7fc700 1 -- 172.21.15.49:0/2860452691 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe90c011e20 con 0x7fe918108980 2024-06-02T23:49:48.588 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.536+0000 7fe91f73b700 1 -- 172.21.15.49:0/2860452691 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fe9181a16b0 con 0x7fe918108980 2024-06-02T23:49:48.588 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.955+0000 7fe90a7fc700 1 -- 172.21.15.49:0/2860452691 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fe90c00ba30 con 0x7fe918108980 2024-06-02T23:49:48.588 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.957+0000 7fe90a7fc700 1 -- 172.21.15.49:0/2860452691 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fe90c02d910 con 0x7fe918108980 2024-06-02T23:49:48.588 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.959+0000 7fe91f73b700 1 -- 172.21.15.49:0/2860452691 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7fe904039050 msgr2=0x7fe90403b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:48.588 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.959+0000 7fe91f73b700 1 --2- 172.21.15.49:0/2860452691 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7fe904039050 0x7fe90403b510 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe914006fd0 tx=0x7fe914006e40 comp rx=0 tx=0).stop 2024-06-02T23:49:48.588 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.959+0000 7fe91f73b700 1 -- 172.21.15.49:0/2860452691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe918108980 msgr2=0x7fe91819e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:48.588 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.959+0000 7fe91f73b700 1 --2- 172.21.15.49:0/2860452691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe918108980 0x7fe91819e010 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe90c0117e0 tx=0x7fe90c011c10 comp rx=0 tx=0).stop 2024-06-02T23:49:48.588 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.959+0000 7fe91f73b700 1 -- 172.21.15.49:0/2860452691 shutdown_connections 2024-06-02T23:49:48.588 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.959+0000 7fe91f73b700 1 --2- 172.21.15.49:0/2860452691 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7fe904039050 0x7fe90403b510 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:48.588 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.959+0000 7fe91f73b700 1 --2- 172.21.15.49:0/2860452691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe918108980 0x7fe91819e010 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:48.588 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.959+0000 7fe91f73b700 1 -- 172.21.15.49:0/2860452691 >> 172.21.15.49:0/2860452691 conn(0x7fe9181023f0 msgr2=0x7fe918102d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:48.588 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.959+0000 7fe91f73b700 1 -- 172.21.15.49:0/2860452691 shutdown_connections 2024-06-02T23:49:48.588 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:47.959+0000 7fe91f73b700 1 -- 172.21.15.49:0/2860452691 wait complete. 2024-06-02T23:49:48.864 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:48 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:48.779+0000 7f04356a5200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-02T23:49:49.179 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:48 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:48.874+0000 7f04356a5200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-02T23:49:49.179 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:48 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/2860452691' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-06-02T23:49:49.179 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:48 smithi049 ceph-mon[32302]: mgrmap e9: x(active, since 18s) 2024-06-02T23:49:49.859 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2024-06-02T23:49:49.859 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-06-02T23:49:49.859 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "available": true, 2024-06-02T23:49:49.859 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-06-02T23:49:49.859 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-06-02T23:49:49.859 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2024-06-02T23:49:49.860 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.970+0000 7effd5b5a700 1 Processor -- start 2024-06-02T23:49:49.860 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.970+0000 7effd5b5a700 1 -- start start 2024-06-02T23:49:49.860 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.971+0000 7effd5b5a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd0108980 0x7effd010ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:49.860 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.971+0000 7effd5b5a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7effd007be20 con 0x7effd0108980 2024-06-02T23:49:49.860 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.971+0000 7effcf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd0108980 0x7effd010ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:49.860 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.971+0000 7effcf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd0108980 0x7effd010ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36626/0 (socket says 172.21.15.49:36626) 2024-06-02T23:49:49.860 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.971+0000 7effcf7fe700 1 -- 172.21.15.49:0/568528688 learned_addr learned my addr 172.21.15.49:0/568528688 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:49.860 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.971+0000 7effcf7fe700 1 -- 172.21.15.49:0/568528688 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd010b2b0 con 0x7effd0108980 2024-06-02T23:49:49.860 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.971+0000 7effcf7fe700 1 --2- 172.21.15.49:0/568528688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd0108980 0x7effd010ad70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7effc00098a0 tx=0x7effc0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5751531ddb4845e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:49.860 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.972+0000 7effce7fc700 1 -- 172.21.15.49:0/568528688 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effc0004160 con 0x7effd0108980 2024-06-02T23:49:49.860 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.972+0000 7effce7fc700 1 -- 172.21.15.49:0/568528688 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effc0004300 con 0x7effd0108980 2024-06-02T23:49:49.860 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.972+0000 7effce7fc700 1 -- 172.21.15.49:0/568528688 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effc0011b20 con 0x7effd0108980 2024-06-02T23:49:49.860 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.973+0000 7effd5b5a700 1 -- 172.21.15.49:0/568528688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd0108980 msgr2=0x7effd010ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:49.861 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.973+0000 7effd5b5a700 1 --2- 172.21.15.49:0/568528688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd0108980 0x7effd010ad70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7effc00098a0 tx=0x7effc0009bb0 comp rx=0 tx=0).stop 2024-06-02T23:49:49.861 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.973+0000 7effd5b5a700 1 -- 172.21.15.49:0/568528688 shutdown_connections 2024-06-02T23:49:49.861 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.973+0000 7effd5b5a700 1 --2- 172.21.15.49:0/568528688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd0108980 0x7effd010ad70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:49.861 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.973+0000 7effd5b5a700 1 -- 172.21.15.49:0/568528688 >> 172.21.15.49:0/568528688 conn(0x7effd01023f0 msgr2=0x7effd0104810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:49.861 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.973+0000 7effd5b5a700 1 -- 172.21.15.49:0/568528688 shutdown_connections 2024-06-02T23:49:49.861 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.973+0000 7effd5b5a700 1 -- 172.21.15.49:0/568528688 wait complete. 2024-06-02T23:49:49.861 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.974+0000 7effd5b5a700 1 Processor -- start 2024-06-02T23:49:49.861 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.974+0000 7effd5b5a700 1 -- start start 2024-06-02T23:49:49.861 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.974+0000 7effd5b5a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd0108980 0x7effd0108200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:49.861 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.974+0000 7effd5b5a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7effd010c320 con 0x7effd0108980 2024-06-02T23:49:49.861 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.974+0000 7effcf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd0108980 0x7effd0108200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:49.861 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.974+0000 7effcf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd0108980 0x7effd0108200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36638/0 (socket says 172.21.15.49:36638) 2024-06-02T23:49:49.861 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.974+0000 7effcf7fe700 1 -- 172.21.15.49:0/1921750940 learned_addr learned my addr 172.21.15.49:0/1921750940 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:49.861 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.975+0000 7effcf7fe700 1 -- 172.21.15.49:0/1921750940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd0108740 con 0x7effd0108980 2024-06-02T23:49:49.862 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.975+0000 7effcf7fe700 1 --2- 172.21.15.49:0/1921750940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd0108980 0x7effd0108200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7effc00117e0 tx=0x7effc0011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:49.862 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.975+0000 7effccff9700 1 -- 172.21.15.49:0/1921750940 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effc0003ba0 con 0x7effd0108980 2024-06-02T23:49:49.862 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.975+0000 7effccff9700 1 -- 172.21.15.49:0/1921750940 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effc001a910 con 0x7effd0108980 2024-06-02T23:49:49.862 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.975+0000 7effccff9700 1 -- 172.21.15.49:0/1921750940 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effc00248f0 con 0x7effd0108980 2024-06-02T23:49:49.862 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.975+0000 7effd5b5a700 1 -- 172.21.15.49:0/1921750940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effd0106930 con 0x7effd0108980 2024-06-02T23:49:49.862 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.975+0000 7effd5b5a700 1 -- 172.21.15.49:0/1921750940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effd0106df0 con 0x7effd0108980 2024-06-02T23:49:49.862 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.976+0000 7effd5b5a700 1 -- 172.21.15.49:0/1921750940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effd0063af0 con 0x7effd0108980 2024-06-02T23:49:49.862 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.976+0000 7effccff9700 1 -- 172.21.15.49:0/1921750940 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7effc0022020 con 0x7effd0108980 2024-06-02T23:49:49.862 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.977+0000 7effccff9700 1 --2- 172.21.15.49:0/1921750940 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7effb8039100 0x7effb803b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:49.862 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.977+0000 7effccff9700 1 -- 172.21.15.49:0/1921750940 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7effc004d660 con 0x7effd0108980 2024-06-02T23:49:49.862 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.977+0000 7effceffd700 1 -- 172.21.15.49:0/1921750940 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7effb8039100 msgr2=0x7effb803b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/1206062338 2024-06-02T23:49:49.862 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.977+0000 7effceffd700 1 --2- 172.21.15.49:0/1921750940 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7effb8039100 0x7effb803b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T23:49:49.863 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:48.982+0000 7effccff9700 1 -- 172.21.15.49:0/1921750940 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7effc001ab30 con 0x7effd0108980 2024-06-02T23:49:49.863 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:49.178+0000 7effceffd700 1 -- 172.21.15.49:0/1921750940 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7effb8039100 msgr2=0x7effb803b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/1206062338 2024-06-02T23:49:49.863 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:49.178+0000 7effceffd700 1 --2- 172.21.15.49:0/1921750940 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7effb8039100 0x7effb803b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-02T23:49:49.863 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:49.248+0000 7effd5b5a700 1 -- 172.21.15.49:0/1921750940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7effd01070e0 con 0x7effd0108980 2024-06-02T23:49:49.863 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:49.249+0000 7effccff9700 1 -- 172.21.15.49:0/1921750940 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7effd01070e0 con 0x7effd0108980 2024-06-02T23:49:49.863 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:49.251+0000 7effd5b5a700 1 -- 172.21.15.49:0/1921750940 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7effb8039100 msgr2=0x7effb803b5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T23:49:49.863 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:49.251+0000 7effd5b5a700 1 --2- 172.21.15.49:0/1921750940 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7effb8039100 0x7effb803b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:49.863 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:49.251+0000 7effd5b5a700 1 -- 172.21.15.49:0/1921750940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd0108980 msgr2=0x7effd0108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:49.863 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:49.251+0000 7effd5b5a700 1 --2- 172.21.15.49:0/1921750940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd0108980 0x7effd0108200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7effc00117e0 tx=0x7effc0011ba0 comp rx=0 tx=0).stop 2024-06-02T23:49:49.863 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:49.251+0000 7effd5b5a700 1 -- 172.21.15.49:0/1921750940 shutdown_connections 2024-06-02T23:49:49.863 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:49.251+0000 7effd5b5a700 1 --2- 172.21.15.49:0/1921750940 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7effb8039100 0x7effb803b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:49.863 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:49.251+0000 7effd5b5a700 1 --2- 172.21.15.49:0/1921750940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd0108980 0x7effd0108200 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:49.863 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:49.251+0000 7effd5b5a700 1 -- 172.21.15.49:0/1921750940 >> 172.21.15.49:0/1921750940 conn(0x7effd01023f0 msgr2=0x7effd0102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:49.863 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:49.251+0000 7effd5b5a700 1 -- 172.21.15.49:0/1921750940 shutdown_connections 2024-06-02T23:49:49.864 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:49.251+0000 7effd5b5a700 1 -- 172.21.15.49:0/1921750940 wait complete. 2024-06-02T23:49:49.864 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for the mgr to restart... 2024-06-02T23:49:49.864 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for mgr epoch 9... 2024-06-02T23:49:50.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:49 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/1921750940' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-06-02T23:49:50.211 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:50 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:50.155+0000 7f04356a5200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-02T23:49:50.516 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:50 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:50.337+0000 7f04356a5200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-02T23:49:50.516 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:50 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:50.515+0000 7f04356a5200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-02T23:49:51.126 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:50 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:50.817+0000 7f04356a5200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-02T23:49:51.126 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:50 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:50.914+0000 7f04356a5200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-02T23:49:51.126 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:51 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:51.125+0000 7f04356a5200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-02T23:49:51.460 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:51 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:51.328+0000 7f04356a5200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-02T23:49:52.404 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:51 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:51.960+0000 7f04356a5200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-02T23:49:52.710 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:52 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:52.403+0000 7f04356a5200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-02T23:49:52.711 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:52 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:52.505+0000 7f04356a5200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-02T23:49:53.211 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:52 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:52.714+0000 7f04356a5200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-02T23:49:53.619 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:53 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:53.262+0000 7f04356a5200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-02T23:49:53.619 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:53 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:53.359+0000 7f04356a5200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-02T23:49:53.961 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:53 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:53.618+0000 7f04356a5200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-02T23:49:53.961 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:53 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:53.758+0000 7f04356a5200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-02T23:49:53.961 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:53 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:53.857+0000 7f04356a5200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-02T23:49:54.291 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:53 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:53.979+0000 7f04356a5200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-02T23:49:54.291 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:54 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:54.290+0000 7f04356a5200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-02T23:49:55.202 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:54 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:54.920+0000 7f04356a5200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-02T23:49:55.202 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:49:55 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:49:55.148+0000 7f04356a5200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-02T23:49:55.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:55 smithi049 ceph-mon[32302]: Active manager daemon x restarted 2024-06-02T23:49:55.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:55 smithi049 ceph-mon[32302]: Activating manager daemon x 2024-06-02T23:49:55.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:55 smithi049 ceph-mon[32302]: osdmap e3: 0 total, 0 up, 0 in 2024-06-02T23:49:55.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:55 smithi049 ceph-mon[32302]: mgrmap e10: x(active, starting, since 0.00350746s) 2024-06-02T23:49:55.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:55 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T23:49:55.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:55 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-02T23:49:55.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:55 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-02T23:49:55.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:55 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-02T23:49:55.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:55 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-02T23:49:55.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:55 smithi049 ceph-mon[32302]: Manager daemon x is now available 2024-06-02T23:49:55.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:55 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:49:56.413 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-02T23:49:56.413 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-02T23:49:56.413 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:56 smithi049 ceph-mon[32302]: [02/Jun/2024:23:49:55] ENGINE Bus STARTING 2024-06-02T23:49:56.413 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:56 smithi049 ceph-mon[32302]: [02/Jun/2024:23:49:55] ENGINE Serving on https://172.21.15.49:7150 2024-06-02T23:49:56.413 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:56 smithi049 ceph-mon[32302]: mgrmap e11: x(active, since 1.00613s) 2024-06-02T23:49:57.062 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2024-06-02T23:49:57.062 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-06-02T23:49:57.062 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "initialized": true 2024-06-02T23:49:57.062 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2024-06-02T23:49:57.062 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.275+0000 7f402d46b700 1 Processor -- start 2024-06-02T23:49:57.062 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.275+0000 7f402d46b700 1 -- start start 2024-06-02T23:49:57.062 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.275+0000 7f402d46b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4028108a00 0x7f402810adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:57.062 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.275+0000 7f402d46b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f402807bde0 con 0x7f4028108a00 2024-06-02T23:49:57.062 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.275+0000 7f4026ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4028108a00 0x7f402810adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:57.062 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.275+0000 7f4026ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4028108a00 0x7f402810adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36646/0 (socket says 172.21.15.49:36646) 2024-06-02T23:49:57.062 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.275+0000 7f4026ffd700 1 -- 172.21.15.49:0/1819113194 learned_addr learned my addr 172.21.15.49:0/1819113194 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:57.063 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.276+0000 7f4026ffd700 1 -- 172.21.15.49:0/1819113194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f402810b330 con 0x7f4028108a00 2024-06-02T23:49:57.063 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.276+0000 7f4026ffd700 1 --2- 172.21.15.49:0/1819113194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4028108a00 0x7f402810adf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f40180098a0 tx=0x7f4018009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=163d479fc95decb7 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:57.063 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.276+0000 7f4025ffb700 1 -- 172.21.15.49:0/1819113194 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4018004160 con 0x7f4028108a00 2024-06-02T23:49:57.063 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.276+0000 7f4025ffb700 1 -- 172.21.15.49:0/1819113194 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4018004300 con 0x7f4028108a00 2024-06-02T23:49:57.063 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.276+0000 7f4025ffb700 1 -- 172.21.15.49:0/1819113194 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4018011b20 con 0x7f4028108a00 2024-06-02T23:49:57.063 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.277+0000 7f402d46b700 1 -- 172.21.15.49:0/1819113194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4028108a00 msgr2=0x7f402810adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:57.063 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.277+0000 7f402d46b700 1 --2- 172.21.15.49:0/1819113194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4028108a00 0x7f402810adf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f40180098a0 tx=0x7f4018009bb0 comp rx=0 tx=0).stop 2024-06-02T23:49:57.063 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.277+0000 7f402d46b700 1 -- 172.21.15.49:0/1819113194 shutdown_connections 2024-06-02T23:49:57.063 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.277+0000 7f402d46b700 1 --2- 172.21.15.49:0/1819113194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4028108a00 0x7f402810adf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:57.063 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.277+0000 7f402d46b700 1 -- 172.21.15.49:0/1819113194 >> 172.21.15.49:0/1819113194 conn(0x7f4028102430 msgr2=0x7f4028104850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:57.063 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.277+0000 7f402d46b700 1 -- 172.21.15.49:0/1819113194 shutdown_connections 2024-06-02T23:49:57.063 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.277+0000 7f402d46b700 1 -- 172.21.15.49:0/1819113194 wait complete. 2024-06-02T23:49:57.063 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.277+0000 7f402d46b700 1 Processor -- start 2024-06-02T23:49:57.064 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.278+0000 7f402d46b700 1 -- start start 2024-06-02T23:49:57.064 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.278+0000 7f402d46b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4028108a00 0x7f402819e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:57.064 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.278+0000 7f402d46b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f402810c390 con 0x7f4028108a00 2024-06-02T23:49:57.064 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.278+0000 7f4026ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4028108a00 0x7f402819e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:57.064 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.278+0000 7f4026ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4028108a00 0x7f402819e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36660/0 (socket says 172.21.15.49:36660) 2024-06-02T23:49:57.064 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.278+0000 7f4026ffd700 1 -- 172.21.15.49:0/804533726 learned_addr learned my addr 172.21.15.49:0/804533726 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:57.064 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.278+0000 7f4026ffd700 1 -- 172.21.15.49:0/804533726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f402819e5a0 con 0x7f4028108a00 2024-06-02T23:49:57.064 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.279+0000 7f4026ffd700 1 --2- 172.21.15.49:0/804533726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4028108a00 0x7f402819e060 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f40180117e0 tx=0x7f4018011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:57.064 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.279+0000 7f400ffff700 1 -- 172.21.15.49:0/804533726 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4018003bf0 con 0x7f4028108a00 2024-06-02T23:49:57.064 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.279+0000 7f402d46b700 1 -- 172.21.15.49:0/804533726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f402819e830 con 0x7f4028108a00 2024-06-02T23:49:57.064 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.279+0000 7f400ffff700 1 -- 172.21.15.49:0/804533726 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f401801a910 con 0x7f4028108a00 2024-06-02T23:49:57.064 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.279+0000 7f400ffff700 1 -- 172.21.15.49:0/804533726 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4018024970 con 0x7f4028108a00 2024-06-02T23:49:57.064 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.279+0000 7f402d46b700 1 -- 172.21.15.49:0/804533726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f402819ec90 con 0x7f4028108a00 2024-06-02T23:49:57.065 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.280+0000 7f400ffff700 1 -- 172.21.15.49:0/804533726 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f4018022020 con 0x7f4028108a00 2024-06-02T23:49:57.065 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.280+0000 7f400ffff700 1 --2- 172.21.15.49:0/804533726 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f4010039050 0x7f401003b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:57.065 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.280+0000 7f400ffff700 1 -- 172.21.15.49:0/804533726 --> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f401003bc20 con 0x7f4010039050 2024-06-02T23:49:57.065 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.280+0000 7f400ffff700 1 -- 172.21.15.49:0/804533726 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f401804d550 con 0x7f4028108a00 2024-06-02T23:49:57.065 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.280+0000 7f40267fc700 1 -- 172.21.15.49:0/804533726 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f4010039050 msgr2=0x7f401003b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/1206062338 2024-06-02T23:49:57.065 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.280+0000 7f40267fc700 1 --2- 172.21.15.49:0/804533726 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f4010039050 0x7f401003b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T23:49:57.065 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.481+0000 7f40267fc700 1 -- 172.21.15.49:0/804533726 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f4010039050 msgr2=0x7f401003b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/1206062338 2024-06-02T23:49:57.065 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.481+0000 7f40267fc700 1 --2- 172.21.15.49:0/804533726 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f4010039050 0x7f401003b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-02T23:49:57.065 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.882+0000 7f40267fc700 1 -- 172.21.15.49:0/804533726 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f4010039050 msgr2=0x7f401003b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/1206062338 2024-06-02T23:49:57.065 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:50.882+0000 7f40267fc700 1 --2- 172.21.15.49:0/804533726 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f4010039050 0x7f401003b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-06-02T23:49:57.065 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:51.683+0000 7f40267fc700 1 -- 172.21.15.49:0/804533726 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f4010039050 msgr2=0x7f401003b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/1206062338 2024-06-02T23:49:57.065 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:51.683+0000 7f40267fc700 1 --2- 172.21.15.49:0/804533726 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f4010039050 0x7f401003b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-06-02T23:49:57.065 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:53.284+0000 7f40267fc700 1 -- 172.21.15.49:0/804533726 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f4010039050 msgr2=0x7f401003b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/1206062338 2024-06-02T23:49:57.065 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:53.284+0000 7f40267fc700 1 --2- 172.21.15.49:0/804533726 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f4010039050 0x7f401003b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-06-02T23:49:57.066 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:55.152+0000 7f400ffff700 1 -- 172.21.15.49:0/804533726 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7f401801a430 con 0x7f4028108a00 2024-06-02T23:49:57.066 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:55.152+0000 7f400ffff700 1 -- 172.21.15.49:0/804533726 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f4010039050 msgr2=0x7f401003b510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T23:49:57.066 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:55.152+0000 7f400ffff700 1 --2- 172.21.15.49:0/804533726 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f4010039050 0x7f401003b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:57.066 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:56.154+0000 7f400ffff700 1 -- 172.21.15.49:0/804533726 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f401804f880 con 0x7f4028108a00 2024-06-02T23:49:57.066 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:56.154+0000 7f400ffff700 1 --2- 172.21.15.49:0/804533726 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f401003cb10 0x7f401003ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:57.066 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:56.154+0000 7f400ffff700 1 -- 172.21.15.49:0/804533726 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4018023ec0 con 0x7f401003cb10 2024-06-02T23:49:57.066 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:56.154+0000 7f40267fc700 1 --2- 172.21.15.49:0/804533726 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f401003cb10 0x7f401003ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:57.066 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:56.155+0000 7f40267fc700 1 --2- 172.21.15.49:0/804533726 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f401003cb10 0x7f401003ef00 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f401c003a10 tx=0x7f401c0092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:57.066 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:56.155+0000 7f400ffff700 1 -- 172.21.15.49:0/804533726 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7f4018023ec0 con 0x7f401003cb10 2024-06-02T23:49:57.066 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:56.163+0000 7f402d46b700 1 -- 172.21.15.49:0/804533726 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f4028063af0 con 0x7f401003cb10 2024-06-02T23:49:57.066 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:56.163+0000 7f400ffff700 1 -- 172.21.15.49:0/804533726 <== mgr.14152 v2:172.21.15.49:6800/2948657177 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f4028063af0 con 0x7f401003cb10 2024-06-02T23:49:57.066 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:56.163+0000 7f402d46b700 1 -- 172.21.15.49:0/804533726 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f401003cb10 msgr2=0x7f401003ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:57.066 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:56.163+0000 7f402d46b700 1 --2- 172.21.15.49:0/804533726 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f401003cb10 0x7f401003ef00 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f401c003a10 tx=0x7f401c0092b0 comp rx=0 tx=0).stop 2024-06-02T23:49:57.066 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:56.163+0000 7f402d46b700 1 -- 172.21.15.49:0/804533726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4028108a00 msgr2=0x7f402819e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:57.067 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:56.163+0000 7f402d46b700 1 --2- 172.21.15.49:0/804533726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4028108a00 0x7f402819e060 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f40180117e0 tx=0x7f4018011c10 comp rx=0 tx=0).stop 2024-06-02T23:49:57.067 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:56.163+0000 7f402d46b700 1 -- 172.21.15.49:0/804533726 shutdown_connections 2024-06-02T23:49:57.067 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:56.163+0000 7f402d46b700 1 --2- 172.21.15.49:0/804533726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4028108a00 0x7f402819e060 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:57.067 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:56.163+0000 7f402d46b700 1 --2- 172.21.15.49:0/804533726 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f401003cb10 0x7f401003ef00 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:57.067 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:56.163+0000 7f402d46b700 1 --2- 172.21.15.49:0/804533726 >> [v2:172.21.15.49:6800/1206062338,v1:172.21.15.49:6801/1206062338] conn(0x7f4010039050 0x7f401003b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:57.067 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:56.163+0000 7f402d46b700 1 -- 172.21.15.49:0/804533726 >> 172.21.15.49:0/804533726 conn(0x7f4028102430 msgr2=0x7f4028102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:57.067 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:56.164+0000 7f402d46b700 1 -- 172.21.15.49:0/804533726 shutdown_connections 2024-06-02T23:49:57.067 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:56.164+0000 7f402d46b700 1 -- 172.21.15.49:0/804533726 wait complete. 2024-06-02T23:49:57.067 INFO:teuthology.orchestra.run.smithi049.stdout:mgr epoch 9 is available 2024-06-02T23:49:57.067 INFO:teuthology.orchestra.run.smithi049.stdout:Generating a dashboard self-signed certificate... 2024-06-02T23:49:57.809 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:57 smithi049 ceph-mon[32302]: [02/Jun/2024:23:49:56] ENGINE Serving on http://172.21.15.49:8765 2024-06-02T23:49:57.809 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:57 smithi049 ceph-mon[32302]: [02/Jun/2024:23:49:56] ENGINE Bus STARTED 2024-06-02T23:49:57.809 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:57 smithi049 ceph-mon[32302]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-06-02T23:49:57.809 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:57 smithi049 ceph-mon[32302]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-06-02T23:49:57.809 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:57 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:49:58.408 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-06-02T23:49:58.408 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.519+0000 7efcd71f1700 1 Processor -- start 2024-06-02T23:49:58.408 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.519+0000 7efcd71f1700 1 -- start start 2024-06-02T23:49:58.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.519+0000 7efcd71f1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd0106e50 0x7efcd0107270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:58.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.519+0000 7efcd71f1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7efcd01077b0 con 0x7efcd0106e50 2024-06-02T23:49:58.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.519+0000 7efcd4f8d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd0106e50 0x7efcd0107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:58.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.519+0000 7efcd4f8d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd0106e50 0x7efcd0107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50864/0 (socket says 172.21.15.49:50864) 2024-06-02T23:49:58.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.519+0000 7efcd4f8d700 1 -- 172.21.15.49:0/1906545686 learned_addr learned my addr 172.21.15.49:0/1906545686 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:58.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.520+0000 7efcd4f8d700 1 -- 172.21.15.49:0/1906545686 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd0107fb0 con 0x7efcd0106e50 2024-06-02T23:49:58.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.520+0000 7efcd4f8d700 1 --2- 172.21.15.49:0/1906545686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd0106e50 0x7efcd0107270 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efcc40098a0 tx=0x7efcc4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2503917886795f99 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:58.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.520+0000 7efccf7fe700 1 -- 172.21.15.49:0/1906545686 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcc4004160 con 0x7efcd0106e50 2024-06-02T23:49:58.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.520+0000 7efccf7fe700 1 -- 172.21.15.49:0/1906545686 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcc4004300 con 0x7efcd0106e50 2024-06-02T23:49:58.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.520+0000 7efccf7fe700 1 -- 172.21.15.49:0/1906545686 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcc4011b20 con 0x7efcd0106e50 2024-06-02T23:49:58.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.521+0000 7efcd71f1700 1 -- 172.21.15.49:0/1906545686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd0106e50 msgr2=0x7efcd0107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:58.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.521+0000 7efcd71f1700 1 --2- 172.21.15.49:0/1906545686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd0106e50 0x7efcd0107270 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efcc40098a0 tx=0x7efcc4009bb0 comp rx=0 tx=0).stop 2024-06-02T23:49:58.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.521+0000 7efcd71f1700 1 -- 172.21.15.49:0/1906545686 shutdown_connections 2024-06-02T23:49:58.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.521+0000 7efcd71f1700 1 --2- 172.21.15.49:0/1906545686 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd0106e50 0x7efcd0107270 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:58.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.521+0000 7efcd71f1700 1 -- 172.21.15.49:0/1906545686 >> 172.21.15.49:0/1906545686 conn(0x7efcd0102410 msgr2=0x7efcd0104830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:58.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.521+0000 7efcd71f1700 1 -- 172.21.15.49:0/1906545686 shutdown_connections 2024-06-02T23:49:58.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.521+0000 7efcd71f1700 1 -- 172.21.15.49:0/1906545686 wait complete. 2024-06-02T23:49:58.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.521+0000 7efcd71f1700 1 Processor -- start 2024-06-02T23:49:58.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.522+0000 7efcd71f1700 1 -- start start 2024-06-02T23:49:58.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.522+0000 7efcd71f1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd0106e50 0x7efcd0104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:58.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.522+0000 7efcd71f1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7efcd010b3f0 con 0x7efcd0106e50 2024-06-02T23:49:58.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.522+0000 7efcd4f8d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd0106e50 0x7efcd0104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:58.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.522+0000 7efcd4f8d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd0106e50 0x7efcd0104780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50878/0 (socket says 172.21.15.49:50878) 2024-06-02T23:49:58.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.522+0000 7efcd4f8d700 1 -- 172.21.15.49:0/3803421482 learned_addr learned my addr 172.21.15.49:0/3803421482 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:49:58.411 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.522+0000 7efcd4f8d700 1 -- 172.21.15.49:0/3803421482 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd0104cc0 con 0x7efcd0106e50 2024-06-02T23:49:58.411 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.522+0000 7efcd4f8d700 1 --2- 172.21.15.49:0/3803421482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd0106e50 0x7efcd0104780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efcc40117e0 tx=0x7efcc4011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:58.411 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.522+0000 7efccdffb700 1 -- 172.21.15.49:0/3803421482 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcc4003bf0 con 0x7efcd0106e50 2024-06-02T23:49:58.411 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.522+0000 7efccdffb700 1 -- 172.21.15.49:0/3803421482 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcc401a910 con 0x7efcd0106e50 2024-06-02T23:49:58.411 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.522+0000 7efcd71f1700 1 -- 172.21.15.49:0/3803421482 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcd0102eb0 con 0x7efcd0106e50 2024-06-02T23:49:58.411 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.523+0000 7efccdffb700 1 -- 172.21.15.49:0/3803421482 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcc4024970 con 0x7efcd0106e50 2024-06-02T23:49:58.411 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.523+0000 7efcd71f1700 1 -- 172.21.15.49:0/3803421482 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcd0103370 con 0x7efcd0106e50 2024-06-02T23:49:58.411 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.524+0000 7efccdffb700 1 -- 172.21.15.49:0/3803421482 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7efcc4022020 con 0x7efcd0106e50 2024-06-02T23:49:58.411 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.524+0000 7efcd71f1700 1 -- 172.21.15.49:0/3803421482 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcd0063af0 con 0x7efcd0106e50 2024-06-02T23:49:58.411 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.524+0000 7efccdffb700 1 --2- 172.21.15.49:0/3803421482 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7efcc0038f40 0x7efcc003b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:49:58.411 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.524+0000 7efccdffb700 1 -- 172.21.15.49:0/3803421482 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7efcc404d330 con 0x7efcd0106e50 2024-06-02T23:49:58.411 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.524+0000 7efccffff700 1 --2- 172.21.15.49:0/3803421482 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7efcc0038f40 0x7efcc003b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:49:58.411 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.524+0000 7efccffff700 1 --2- 172.21.15.49:0/3803421482 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7efcc0038f40 0x7efcc003b400 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efcbc006fd0 tx=0x7efcbc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:49:58.412 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.529+0000 7efccdffb700 1 -- 172.21.15.49:0/3803421482 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7efcc4011e20 con 0x7efcd0106e50 2024-06-02T23:49:58.412 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.744+0000 7efcd71f1700 1 -- 172.21.15.49:0/3803421482 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7efcd01956e0 con 0x7efcc0038f40 2024-06-02T23:49:58.412 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.763+0000 7efccdffb700 1 -- 172.21.15.49:0/3803421482 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7efcc402d910 con 0x7efcd0106e50 2024-06-02T23:49:58.412 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.808+0000 7efccdffb700 1 -- 172.21.15.49:0/3803421482 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7efcd01956e0 con 0x7efcc0038f40 2024-06-02T23:49:58.412 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.811+0000 7efcd71f1700 1 -- 172.21.15.49:0/3803421482 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7efcc0038f40 msgr2=0x7efcc003b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:58.412 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.811+0000 7efcd71f1700 1 --2- 172.21.15.49:0/3803421482 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7efcc0038f40 0x7efcc003b400 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efcbc006fd0 tx=0x7efcbc006e40 comp rx=0 tx=0).stop 2024-06-02T23:49:58.412 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.811+0000 7efcd71f1700 1 -- 172.21.15.49:0/3803421482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd0106e50 msgr2=0x7efcd0104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:49:58.412 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.811+0000 7efcd71f1700 1 --2- 172.21.15.49:0/3803421482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd0106e50 0x7efcd0104780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efcc40117e0 tx=0x7efcc4011c10 comp rx=0 tx=0).stop 2024-06-02T23:49:58.412 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.811+0000 7efcd71f1700 1 -- 172.21.15.49:0/3803421482 shutdown_connections 2024-06-02T23:49:58.412 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.811+0000 7efcd71f1700 1 --2- 172.21.15.49:0/3803421482 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7efcc0038f40 0x7efcc003b400 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:58.412 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.811+0000 7efcd71f1700 1 --2- 172.21.15.49:0/3803421482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd0106e50 0x7efcd0104780 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:49:58.412 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.811+0000 7efcd71f1700 1 -- 172.21.15.49:0/3803421482 >> 172.21.15.49:0/3803421482 conn(0x7efcd0102410 msgr2=0x7efcd01929a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:49:58.412 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.811+0000 7efcd71f1700 1 -- 172.21.15.49:0/3803421482 shutdown_connections 2024-06-02T23:49:58.413 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:57.811+0000 7efcd71f1700 1 -- 172.21.15.49:0/3803421482 wait complete. 2024-06-02T23:49:58.413 INFO:teuthology.orchestra.run.smithi049.stdout:Creating initial admin user... 2024-06-02T23:49:58.837 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:58 smithi049 ceph-mon[32302]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:49:58.837 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:58 smithi049 ceph-mon[32302]: mgrmap e12: x(active, since 2s) 2024-06-02T23:49:58.837 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:58 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:49:58.837 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:58 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:49:58.837 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:49:58 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:00.464 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$0Q3E9/NK/6tX6zrq9DbmtObtfXqZmYsdXRMHWQfiCwyOHzk/6rFUO", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1717372199, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-06-02T23:50:00.464 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.851+0000 7fa6124c0700 1 Processor -- start 2024-06-02T23:50:00.464 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.852+0000 7fa6124c0700 1 -- start start 2024-06-02T23:50:00.464 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.852+0000 7fa6124c0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa60c107fb0 0x7fa60c1083d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:00.464 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.852+0000 7fa6124c0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c108910 con 0x7fa60c107fb0 2024-06-02T23:50:00.464 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.852+0000 7fa60bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa60c107fb0 0x7fa60c1083d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:00.464 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.852+0000 7fa60bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa60c107fb0 0x7fa60c1083d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50888/0 (socket says 172.21.15.49:50888) 2024-06-02T23:50:00.464 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.852+0000 7fa60bfff700 1 -- 172.21.15.49:0/1635161899 learned_addr learned my addr 172.21.15.49:0/1635161899 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:50:00.464 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.852+0000 7fa60bfff700 1 -- 172.21.15.49:0/1635161899 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60c109070 con 0x7fa60c107fb0 2024-06-02T23:50:00.465 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.853+0000 7fa60bfff700 1 --2- 172.21.15.49:0/1635161899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa60c107fb0 0x7fa60c1083d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc0098a0 tx=0x7fa5fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c796a00f45754e8d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:00.465 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.853+0000 7fa60affd700 1 -- 172.21.15.49:0/1635161899 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5fc004160 con 0x7fa60c107fb0 2024-06-02T23:50:00.465 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.853+0000 7fa60affd700 1 -- 172.21.15.49:0/1635161899 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5fc004300 con 0x7fa60c107fb0 2024-06-02T23:50:00.465 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.853+0000 7fa60affd700 1 -- 172.21.15.49:0/1635161899 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5fc011b20 con 0x7fa60c107fb0 2024-06-02T23:50:00.465 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.853+0000 7fa6124c0700 1 -- 172.21.15.49:0/1635161899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa60c107fb0 msgr2=0x7fa60c1083d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:00.465 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.853+0000 7fa6124c0700 1 --2- 172.21.15.49:0/1635161899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa60c107fb0 0x7fa60c1083d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc0098a0 tx=0x7fa5fc009bb0 comp rx=0 tx=0).stop 2024-06-02T23:50:00.465 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.853+0000 7fa6124c0700 1 -- 172.21.15.49:0/1635161899 shutdown_connections 2024-06-02T23:50:00.465 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.853+0000 7fa6124c0700 1 --2- 172.21.15.49:0/1635161899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa60c107fb0 0x7fa60c1083d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:00.465 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.853+0000 7fa6124c0700 1 -- 172.21.15.49:0/1635161899 >> 172.21.15.49:0/1635161899 conn(0x7fa60c103550 msgr2=0x7fa60c105990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:50:00.465 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.853+0000 7fa6124c0700 1 -- 172.21.15.49:0/1635161899 shutdown_connections 2024-06-02T23:50:00.465 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.853+0000 7fa6124c0700 1 -- 172.21.15.49:0/1635161899 wait complete. 2024-06-02T23:50:00.466 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.854+0000 7fa6124c0700 1 Processor -- start 2024-06-02T23:50:00.466 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.854+0000 7fa6124c0700 1 -- start start 2024-06-02T23:50:00.466 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.854+0000 7fa6124c0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa60c107fb0 0x7fa60c19bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:00.466 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.854+0000 7fa6124c0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c10c4b0 con 0x7fa60c107fb0 2024-06-02T23:50:00.466 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.854+0000 7fa60bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa60c107fb0 0x7fa60c19bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:00.466 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.854+0000 7fa60bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa60c107fb0 0x7fa60c19bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50900/0 (socket says 172.21.15.49:50900) 2024-06-02T23:50:00.466 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.854+0000 7fa60bfff700 1 -- 172.21.15.49:0/575786362 learned_addr learned my addr 172.21.15.49:0/575786362 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:50:00.466 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.855+0000 7fa60bfff700 1 -- 172.21.15.49:0/575786362 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60c19c330 con 0x7fa60c107fb0 2024-06-02T23:50:00.466 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.855+0000 7fa60bfff700 1 --2- 172.21.15.49:0/575786362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa60c107fb0 0x7fa60c19bdf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc0117e0 tx=0x7fa5fc011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:00.467 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.855+0000 7fa6097fa700 1 -- 172.21.15.49:0/575786362 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5fc003bf0 con 0x7fa60c107fb0 2024-06-02T23:50:00.467 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.855+0000 7fa6124c0700 1 -- 172.21.15.49:0/575786362 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa60c19c5c0 con 0x7fa60c107fb0 2024-06-02T23:50:00.467 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.855+0000 7fa6097fa700 1 -- 172.21.15.49:0/575786362 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5fc01a910 con 0x7fa60c107fb0 2024-06-02T23:50:00.467 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.855+0000 7fa6097fa700 1 -- 172.21.15.49:0/575786362 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5fc024970 con 0x7fa60c107fb0 2024-06-02T23:50:00.467 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.855+0000 7fa6124c0700 1 -- 172.21.15.49:0/575786362 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa60c19ca20 con 0x7fa60c107fb0 2024-06-02T23:50:00.467 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.856+0000 7fa6097fa700 1 -- 172.21.15.49:0/575786362 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fa5fc022020 con 0x7fa60c107fb0 2024-06-02T23:50:00.467 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.856+0000 7fa6097fa700 1 --2- 172.21.15.49:0/575786362 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa5f4039050 0x7fa5f403b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:00.467 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.856+0000 7fa6097fa700 1 -- 172.21.15.49:0/575786362 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa5fc04e510 con 0x7fa60c107fb0 2024-06-02T23:50:00.467 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.856+0000 7fa6124c0700 1 -- 172.21.15.49:0/575786362 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa60c063af0 con 0x7fa60c107fb0 2024-06-02T23:50:00.467 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.856+0000 7fa60b7fe700 1 --2- 172.21.15.49:0/575786362 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa5f4039050 0x7fa5f403b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:00.467 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.857+0000 7fa60b7fe700 1 --2- 172.21.15.49:0/575786362 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa5f4039050 0x7fa5f403b510 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa600006fd0 tx=0x7fa600006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:00.468 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:58.862+0000 7fa6097fa700 1 -- 172.21.15.49:0/575786362 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa5fc011e20 con 0x7fa60c107fb0 2024-06-02T23:50:00.468 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:59.095+0000 7fa6124c0700 1 -- 172.21.15.49:0/575786362 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fa60c19f430 con 0x7fa5f4039050 2024-06-02T23:50:00.468 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:59.343+0000 7fa6097fa700 1 -- 172.21.15.49:0/575786362 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fa60c19f430 con 0x7fa5f4039050 2024-06-02T23:50:00.468 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:59.345+0000 7fa6124c0700 1 -- 172.21.15.49:0/575786362 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa5f4039050 msgr2=0x7fa5f403b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:00.468 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:59.345+0000 7fa6124c0700 1 --2- 172.21.15.49:0/575786362 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa5f4039050 0x7fa5f403b510 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa600006fd0 tx=0x7fa600006e40 comp rx=0 tx=0).stop 2024-06-02T23:50:00.468 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:59.345+0000 7fa6124c0700 1 -- 172.21.15.49:0/575786362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa60c107fb0 msgr2=0x7fa60c19bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:00.468 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:59.345+0000 7fa6124c0700 1 --2- 172.21.15.49:0/575786362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa60c107fb0 0x7fa60c19bdf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc0117e0 tx=0x7fa5fc011c10 comp rx=0 tx=0).stop 2024-06-02T23:50:00.468 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:59.345+0000 7fa6124c0700 1 -- 172.21.15.49:0/575786362 shutdown_connections 2024-06-02T23:50:00.468 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:59.345+0000 7fa6124c0700 1 --2- 172.21.15.49:0/575786362 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa5f4039050 0x7fa5f403b510 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:00.468 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:59.345+0000 7fa6124c0700 1 --2- 172.21.15.49:0/575786362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa60c107fb0 0x7fa60c19bdf0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:00.468 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:59.345+0000 7fa6124c0700 1 -- 172.21.15.49:0/575786362 >> 172.21.15.49:0/575786362 conn(0x7fa60c103550 msgr2=0x7fa60c103eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:50:00.469 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:59.346+0000 7fa6124c0700 1 -- 172.21.15.49:0/575786362 shutdown_connections 2024-06-02T23:50:00.469 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:49:59.346+0000 7fa6124c0700 1 -- 172.21.15.49:0/575786362 wait complete. 2024-06-02T23:50:00.469 INFO:teuthology.orchestra.run.smithi049.stdout:Fetching dashboard port number... 2024-06-02T23:50:00.684 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:00 smithi049 ceph-mon[32302]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:50:00.684 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:00 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:01.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:01 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/2092619844' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-06-02T23:50:01.773 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 8443 2024-06-02T23:50:01.773 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.920+0000 7f00be974700 1 Processor -- start 2024-06-02T23:50:01.773 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.920+0000 7f00be974700 1 -- start start 2024-06-02T23:50:01.773 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.920+0000 7f00be974700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00b81061f0 0x7f00b8106610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:01.773 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.920+0000 7f00be974700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f00b8106be0 con 0x7f00b81061f0 2024-06-02T23:50:01.773 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.920+0000 7f00b7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00b81061f0 0x7f00b8106610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:01.773 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.920+0000 7f00b7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00b81061f0 0x7f00b8106610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50908/0 (socket says 172.21.15.49:50908) 2024-06-02T23:50:01.773 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.920+0000 7f00b7fff700 1 -- 172.21.15.49:0/196889534 learned_addr learned my addr 172.21.15.49:0/196889534 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:50:01.773 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.921+0000 7f00b7fff700 1 -- 172.21.15.49:0/196889534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b8109180 con 0x7f00b81061f0 2024-06-02T23:50:01.774 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.921+0000 7f00b7fff700 1 --2- 172.21.15.49:0/196889534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00b81061f0 0x7f00b8106610 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f00a80098a0 tx=0x7f00a8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c2e33adc9cd58db server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:01.774 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.921+0000 7f00b6ffd700 1 -- 172.21.15.49:0/196889534 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00a8004160 con 0x7f00b81061f0 2024-06-02T23:50:01.774 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.921+0000 7f00b6ffd700 1 -- 172.21.15.49:0/196889534 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00a8004300 con 0x7f00b81061f0 2024-06-02T23:50:01.774 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.921+0000 7f00b6ffd700 1 -- 172.21.15.49:0/196889534 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00a8011b20 con 0x7f00b81061f0 2024-06-02T23:50:01.774 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.922+0000 7f00be974700 1 -- 172.21.15.49:0/196889534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00b81061f0 msgr2=0x7f00b8106610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:01.774 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.922+0000 7f00be974700 1 --2- 172.21.15.49:0/196889534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00b81061f0 0x7f00b8106610 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f00a80098a0 tx=0x7f00a8009bb0 comp rx=0 tx=0).stop 2024-06-02T23:50:01.774 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.922+0000 7f00be974700 1 -- 172.21.15.49:0/196889534 shutdown_connections 2024-06-02T23:50:01.774 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.922+0000 7f00be974700 1 --2- 172.21.15.49:0/196889534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00b81061f0 0x7f00b8106610 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:01.774 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.922+0000 7f00be974700 1 -- 172.21.15.49:0/196889534 >> 172.21.15.49:0/196889534 conn(0x7f00b8101bc0 msgr2=0x7f00b8103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:50:01.774 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.922+0000 7f00be974700 1 -- 172.21.15.49:0/196889534 shutdown_connections 2024-06-02T23:50:01.774 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.922+0000 7f00be974700 1 -- 172.21.15.49:0/196889534 wait complete. 2024-06-02T23:50:01.775 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.922+0000 7f00be974700 1 Processor -- start 2024-06-02T23:50:01.775 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.922+0000 7f00be974700 1 -- start start 2024-06-02T23:50:01.775 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.923+0000 7f00be974700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00b81061f0 0x7f00b819be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:01.775 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.923+0000 7f00be974700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f00b810c530 con 0x7f00b81061f0 2024-06-02T23:50:01.775 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.923+0000 7f00b7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00b81061f0 0x7f00b819be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:01.775 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.923+0000 7f00b7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00b81061f0 0x7f00b819be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50914/0 (socket says 172.21.15.49:50914) 2024-06-02T23:50:01.775 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.923+0000 7f00b7fff700 1 -- 172.21.15.49:0/2092619844 learned_addr learned my addr 172.21.15.49:0/2092619844 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:50:01.775 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.923+0000 7f00b7fff700 1 -- 172.21.15.49:0/2092619844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b819c380 con 0x7f00b81061f0 2024-06-02T23:50:01.775 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.923+0000 7f00b7fff700 1 --2- 172.21.15.49:0/2092619844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00b81061f0 0x7f00b819be40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f00a80117e0 tx=0x7f00a8011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:01.775 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.924+0000 7f00b57fa700 1 -- 172.21.15.49:0/2092619844 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00a8003bf0 con 0x7f00b81061f0 2024-06-02T23:50:01.776 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.924+0000 7f00b57fa700 1 -- 172.21.15.49:0/2092619844 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00a801a910 con 0x7f00b81061f0 2024-06-02T23:50:01.776 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.924+0000 7f00be974700 1 -- 172.21.15.49:0/2092619844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00b819c610 con 0x7f00b81061f0 2024-06-02T23:50:01.776 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.924+0000 7f00b57fa700 1 -- 172.21.15.49:0/2092619844 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00a8024970 con 0x7f00b81061f0 2024-06-02T23:50:01.776 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.924+0000 7f00be974700 1 -- 172.21.15.49:0/2092619844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00b819ca70 con 0x7f00b81061f0 2024-06-02T23:50:01.776 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.924+0000 7f00b57fa700 1 -- 172.21.15.49:0/2092619844 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f00a8022020 con 0x7f00b81061f0 2024-06-02T23:50:01.776 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.925+0000 7f00be974700 1 -- 172.21.15.49:0/2092619844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00b8063af0 con 0x7f00b81061f0 2024-06-02T23:50:01.776 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.925+0000 7f00b57fa700 1 --2- 172.21.15.49:0/2092619844 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f00a00390a0 0x7f00a003b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:01.776 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.925+0000 7f00b57fa700 1 -- 172.21.15.49:0/2092619844 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f00a804da70 con 0x7f00b81061f0 2024-06-02T23:50:01.776 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.925+0000 7f00b77fe700 1 --2- 172.21.15.49:0/2092619844 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f00a00390a0 0x7f00a003b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:01.776 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.925+0000 7f00b77fe700 1 --2- 172.21.15.49:0/2092619844 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f00a00390a0 0x7f00a003b560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f00ac006fd0 tx=0x7f00ac006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:01.776 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:00.930+0000 7f00b57fa700 1 -- 172.21.15.49:0/2092619844 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f00a802cdf0 con 0x7f00b81061f0 2024-06-02T23:50:01.776 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:01.136+0000 7f00be974700 1 -- 172.21.15.49:0/2092619844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f00b819f440 con 0x7f00b81061f0 2024-06-02T23:50:01.776 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:01.136+0000 7f00b57fa700 1 -- 172.21.15.49:0/2092619844 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f00a800b5a0 con 0x7f00b81061f0 2024-06-02T23:50:01.777 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:01.139+0000 7f00be974700 1 -- 172.21.15.49:0/2092619844 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f00a00390a0 msgr2=0x7f00a003b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:01.777 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:01.139+0000 7f00be974700 1 --2- 172.21.15.49:0/2092619844 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f00a00390a0 0x7f00a003b560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f00ac006fd0 tx=0x7f00ac006e40 comp rx=0 tx=0).stop 2024-06-02T23:50:01.777 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:01.139+0000 7f00be974700 1 -- 172.21.15.49:0/2092619844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00b81061f0 msgr2=0x7f00b819be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:01.777 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:01.139+0000 7f00be974700 1 --2- 172.21.15.49:0/2092619844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00b81061f0 0x7f00b819be40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f00a80117e0 tx=0x7f00a8011ba0 comp rx=0 tx=0).stop 2024-06-02T23:50:01.777 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:01.139+0000 7f00be974700 1 -- 172.21.15.49:0/2092619844 shutdown_connections 2024-06-02T23:50:01.777 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:01.139+0000 7f00be974700 1 --2- 172.21.15.49:0/2092619844 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f00a00390a0 0x7f00a003b560 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:01.777 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:01.139+0000 7f00be974700 1 --2- 172.21.15.49:0/2092619844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00b81061f0 0x7f00b819be40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:01.777 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:01.139+0000 7f00be974700 1 -- 172.21.15.49:0/2092619844 >> 172.21.15.49:0/2092619844 conn(0x7f00b8101bc0 msgr2=0x7f00b8102610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:50:01.777 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:01.139+0000 7f00be974700 1 -- 172.21.15.49:0/2092619844 shutdown_connections 2024-06-02T23:50:01.777 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:01.139+0000 7f00be974700 1 -- 172.21.15.49:0/2092619844 wait complete. 2024-06-02T23:50:01.782 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-02T23:50:01.783 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout disabled 2024-06-02T23:50:01.791 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-02T23:50:01.791 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout inactive 2024-06-02T23:50:01.791 INFO:teuthology.orchestra.run.smithi049.stdout:firewalld.service is not enabled 2024-06-02T23:50:01.791 INFO:teuthology.orchestra.run.smithi049.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-06-02T23:50:01.793 INFO:teuthology.orchestra.run.smithi049.stdout:Ceph Dashboard is now available at: 2024-06-02T23:50:01.793 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:50:01.793 INFO:teuthology.orchestra.run.smithi049.stdout: URL: https://smithi049.front.sepia.ceph.com:8443/ 2024-06-02T23:50:01.793 INFO:teuthology.orchestra.run.smithi049.stdout: User: admin 2024-06-02T23:50:01.793 INFO:teuthology.orchestra.run.smithi049.stdout: Password: n1gix7zzpu 2024-06-02T23:50:01.793 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:50:01.794 INFO:teuthology.orchestra.run.smithi049.stdout:Saving cluster configuration to /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/config directory 2024-06-02T23:50:01.794 INFO:teuthology.orchestra.run.smithi049.stdout:Enabling autotune for osd_memory_target 2024-06-02T23:50:02.425 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:02 smithi049 ceph-mon[32302]: mgrmap e13: x(active, since 6s) 2024-06-02T23:50:02.967 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.211+0000 7f4a4fcad700 1 Processor -- start 2024-06-02T23:50:02.967 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.211+0000 7f4a4fcad700 1 -- start start 2024-06-02T23:50:02.967 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.211+0000 7f4a4fcad700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a48105c40 0x7f4a48106060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:02.967 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.211+0000 7f4a4fcad700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4a481065a0 con 0x7f4a48105c40 2024-06-02T23:50:02.968 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.211+0000 7f4a4da49700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a48105c40 0x7f4a48106060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:02.968 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.211+0000 7f4a4da49700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a48105c40 0x7f4a48106060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50918/0 (socket says 172.21.15.49:50918) 2024-06-02T23:50:02.968 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.211+0000 7f4a4da49700 1 -- 172.21.15.49:0/2078274154 learned_addr learned my addr 172.21.15.49:0/2078274154 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:50:02.968 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.212+0000 7f4a4da49700 1 -- 172.21.15.49:0/2078274154 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a48106720 con 0x7f4a48105c40 2024-06-02T23:50:02.968 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.212+0000 7f4a4da49700 1 --2- 172.21.15.49:0/2078274154 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a48105c40 0x7f4a48106060 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4a440098a0 tx=0x7f4a44009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e704b85631b509f6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:02.968 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.212+0000 7f4a4ca47700 1 -- 172.21.15.49:0/2078274154 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a44004160 con 0x7f4a48105c40 2024-06-02T23:50:02.968 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.212+0000 7f4a4ca47700 1 -- 172.21.15.49:0/2078274154 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a44004300 con 0x7f4a48105c40 2024-06-02T23:50:02.968 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.212+0000 7f4a4ca47700 1 -- 172.21.15.49:0/2078274154 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a44011b20 con 0x7f4a48105c40 2024-06-02T23:50:02.968 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.212+0000 7f4a4fcad700 1 -- 172.21.15.49:0/2078274154 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a48105c40 msgr2=0x7f4a48106060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:02.968 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.212+0000 7f4a4fcad700 1 --2- 172.21.15.49:0/2078274154 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a48105c40 0x7f4a48106060 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4a440098a0 tx=0x7f4a44009bb0 comp rx=0 tx=0).stop 2024-06-02T23:50:02.968 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.212+0000 7f4a4fcad700 1 -- 172.21.15.49:0/2078274154 shutdown_connections 2024-06-02T23:50:02.968 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.212+0000 7f4a4fcad700 1 --2- 172.21.15.49:0/2078274154 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a48105c40 0x7f4a48106060 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:02.968 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.212+0000 7f4a4fcad700 1 -- 172.21.15.49:0/2078274154 >> 172.21.15.49:0/2078274154 conn(0x7f4a481016e0 msgr2=0x7f4a48103b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:50:02.969 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.213+0000 7f4a4fcad700 1 -- 172.21.15.49:0/2078274154 shutdown_connections 2024-06-02T23:50:02.969 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.213+0000 7f4a4fcad700 1 -- 172.21.15.49:0/2078274154 wait complete. 2024-06-02T23:50:02.969 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.213+0000 7f4a4fcad700 1 Processor -- start 2024-06-02T23:50:02.969 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.213+0000 7f4a4fcad700 1 -- start start 2024-06-02T23:50:02.969 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.213+0000 7f4a4fcad700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a48105c40 0x7f4a4819be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:02.969 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.213+0000 7f4a4fcad700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4a4810c310 con 0x7f4a48105c40 2024-06-02T23:50:02.969 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.214+0000 7f4a4da49700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a48105c40 0x7f4a4819be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:02.969 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.214+0000 7f4a4da49700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a48105c40 0x7f4a4819be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50920/0 (socket says 172.21.15.49:50920) 2024-06-02T23:50:02.969 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.214+0000 7f4a4da49700 1 -- 172.21.15.49:0/1331836242 learned_addr learned my addr 172.21.15.49:0/1331836242 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:50:02.969 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.214+0000 7f4a4da49700 1 -- 172.21.15.49:0/1331836242 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a4819c390 con 0x7f4a48105c40 2024-06-02T23:50:02.969 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.214+0000 7f4a4da49700 1 --2- 172.21.15.49:0/1331836242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a48105c40 0x7f4a4819be50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4a440117e0 tx=0x7f4a44011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:02.969 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.214+0000 7f4a3effd700 1 -- 172.21.15.49:0/1331836242 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a44003bf0 con 0x7f4a48105c40 2024-06-02T23:50:02.969 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.214+0000 7f4a3effd700 1 -- 172.21.15.49:0/1331836242 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a4401a910 con 0x7f4a48105c40 2024-06-02T23:50:02.969 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.214+0000 7f4a4fcad700 1 -- 172.21.15.49:0/1331836242 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a4819c620 con 0x7f4a48105c40 2024-06-02T23:50:02.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.214+0000 7f4a3effd700 1 -- 172.21.15.49:0/1331836242 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a44024970 con 0x7f4a48105c40 2024-06-02T23:50:02.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.214+0000 7f4a4fcad700 1 -- 172.21.15.49:0/1331836242 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a4819ca80 con 0x7f4a48105c40 2024-06-02T23:50:02.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.215+0000 7f4a3effd700 1 -- 172.21.15.49:0/1331836242 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f4a44022020 con 0x7f4a48105c40 2024-06-02T23:50:02.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.215+0000 7f4a4fcad700 1 -- 172.21.15.49:0/1331836242 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a48063af0 con 0x7f4a48105c40 2024-06-02T23:50:02.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.215+0000 7f4a3effd700 1 --2- 172.21.15.49:0/1331836242 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f4a34039150 0x7f4a3403b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:02.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.215+0000 7f4a3effd700 1 -- 172.21.15.49:0/1331836242 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f4a4404d720 con 0x7f4a48105c40 2024-06-02T23:50:02.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.216+0000 7f4a4d248700 1 --2- 172.21.15.49:0/1331836242 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f4a34039150 0x7f4a3403b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:02.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.216+0000 7f4a4d248700 1 --2- 172.21.15.49:0/1331836242 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f4a34039150 0x7f4a3403b610 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4a38006fd0 tx=0x7f4a38006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:02.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.220+0000 7f4a3effd700 1 -- 172.21.15.49:0/1331836242 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4a44011e20 con 0x7f4a48105c40 2024-06-02T23:50:02.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.424+0000 7f4a4fcad700 1 -- 172.21.15.49:0/1331836242 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7f4a4819f510 con 0x7f4a48105c40 2024-06-02T23:50:02.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.425+0000 7f4a3effd700 1 -- 172.21.15.49:0/1331836242 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7f4a4400bc70 con 0x7f4a48105c40 2024-06-02T23:50:02.970 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.427+0000 7f4a4fcad700 1 -- 172.21.15.49:0/1331836242 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f4a34039150 msgr2=0x7f4a3403b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:02.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.427+0000 7f4a4fcad700 1 --2- 172.21.15.49:0/1331836242 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f4a34039150 0x7f4a3403b610 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4a38006fd0 tx=0x7f4a38006e40 comp rx=0 tx=0).stop 2024-06-02T23:50:02.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.427+0000 7f4a4fcad700 1 -- 172.21.15.49:0/1331836242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a48105c40 msgr2=0x7f4a4819be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:02.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.427+0000 7f4a4fcad700 1 --2- 172.21.15.49:0/1331836242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a48105c40 0x7f4a4819be50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4a440117e0 tx=0x7f4a44011c10 comp rx=0 tx=0).stop 2024-06-02T23:50:02.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.427+0000 7f4a4fcad700 1 -- 172.21.15.49:0/1331836242 shutdown_connections 2024-06-02T23:50:02.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.427+0000 7f4a4fcad700 1 --2- 172.21.15.49:0/1331836242 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f4a34039150 0x7f4a3403b610 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:02.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.427+0000 7f4a4fcad700 1 --2- 172.21.15.49:0/1331836242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a48105c40 0x7f4a4819be50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:02.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.427+0000 7f4a4fcad700 1 -- 172.21.15.49:0/1331836242 >> 172.21.15.49:0/1331836242 conn(0x7f4a481016e0 msgr2=0x7f4a481021d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:50:02.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.427+0000 7f4a4fcad700 1 -- 172.21.15.49:0/1331836242 shutdown_connections 2024-06-02T23:50:02.971 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:02.427+0000 7f4a4fcad700 1 -- 172.21.15.49:0/1331836242 wait complete. 2024-06-02T23:50:04.298 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.429+0000 7f9e3dac8700 1 Processor -- start 2024-06-02T23:50:04.298 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.429+0000 7f9e3dac8700 1 -- start start 2024-06-02T23:50:04.298 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.430+0000 7f9e3dac8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e38107fb0 0x7f9e381083d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:04.298 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.430+0000 7f9e3dac8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9e38108910 con 0x7f9e38107fb0 2024-06-02T23:50:04.299 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.430+0000 7f9e377fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e38107fb0 0x7f9e381083d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:04.299 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.430+0000 7f9e377fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e38107fb0 0x7f9e381083d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52176/0 (socket says 172.21.15.49:52176) 2024-06-02T23:50:04.299 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.430+0000 7f9e377fe700 1 -- 172.21.15.49:0/1760003655 learned_addr learned my addr 172.21.15.49:0/1760003655 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:50:04.299 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.430+0000 7f9e377fe700 1 -- 172.21.15.49:0/1760003655 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e38109070 con 0x7f9e38107fb0 2024-06-02T23:50:04.299 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.430+0000 7f9e377fe700 1 --2- 172.21.15.49:0/1760003655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e38107fb0 0x7f9e381083d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9e280098a0 tx=0x7f9e28009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ceee7569d858a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:04.299 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.431+0000 7f9e36ffd700 1 -- 172.21.15.49:0/1760003655 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e28004160 con 0x7f9e38107fb0 2024-06-02T23:50:04.299 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.431+0000 7f9e36ffd700 1 -- 172.21.15.49:0/1760003655 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e28004300 con 0x7f9e38107fb0 2024-06-02T23:50:04.299 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.431+0000 7f9e36ffd700 1 -- 172.21.15.49:0/1760003655 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e28011b20 con 0x7f9e38107fb0 2024-06-02T23:50:04.299 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.431+0000 7f9e3dac8700 1 -- 172.21.15.49:0/1760003655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e38107fb0 msgr2=0x7f9e381083d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:04.299 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.431+0000 7f9e3dac8700 1 --2- 172.21.15.49:0/1760003655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e38107fb0 0x7f9e381083d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9e280098a0 tx=0x7f9e28009bb0 comp rx=0 tx=0).stop 2024-06-02T23:50:04.299 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.431+0000 7f9e3dac8700 1 -- 172.21.15.49:0/1760003655 shutdown_connections 2024-06-02T23:50:04.299 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.431+0000 7f9e3dac8700 1 --2- 172.21.15.49:0/1760003655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e38107fb0 0x7f9e381083d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:04.299 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.431+0000 7f9e3dac8700 1 -- 172.21.15.49:0/1760003655 >> 172.21.15.49:0/1760003655 conn(0x7f9e38103550 msgr2=0x7f9e38105990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:50:04.299 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.431+0000 7f9e3dac8700 1 -- 172.21.15.49:0/1760003655 shutdown_connections 2024-06-02T23:50:04.300 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.431+0000 7f9e3dac8700 1 -- 172.21.15.49:0/1760003655 wait complete. 2024-06-02T23:50:04.300 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.432+0000 7f9e3dac8700 1 Processor -- start 2024-06-02T23:50:04.300 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.432+0000 7f9e3dac8700 1 -- start start 2024-06-02T23:50:04.300 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.432+0000 7f9e3dac8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e38107fb0 0x7f9e3819be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:04.300 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.432+0000 7f9e3dac8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9e3810c4b0 con 0x7f9e38107fb0 2024-06-02T23:50:04.300 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.433+0000 7f9e377fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e38107fb0 0x7f9e3819be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:04.300 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.433+0000 7f9e377fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e38107fb0 0x7f9e3819be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52190/0 (socket says 172.21.15.49:52190) 2024-06-02T23:50:04.300 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.433+0000 7f9e377fe700 1 -- 172.21.15.49:0/2624733104 learned_addr learned my addr 172.21.15.49:0/2624733104 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:50:04.300 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.433+0000 7f9e377fe700 1 -- 172.21.15.49:0/2624733104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e3819c380 con 0x7f9e38107fb0 2024-06-02T23:50:04.300 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.433+0000 7f9e377fe700 1 --2- 172.21.15.49:0/2624733104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e38107fb0 0x7f9e3819be40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9e280117e0 tx=0x7f9e28011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:04.300 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.433+0000 7f9e357fa700 1 -- 172.21.15.49:0/2624733104 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e28003bf0 con 0x7f9e38107fb0 2024-06-02T23:50:04.300 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.433+0000 7f9e3dac8700 1 -- 172.21.15.49:0/2624733104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e3819c610 con 0x7f9e38107fb0 2024-06-02T23:50:04.300 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.433+0000 7f9e357fa700 1 -- 172.21.15.49:0/2624733104 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e2801a910 con 0x7f9e38107fb0 2024-06-02T23:50:04.301 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.433+0000 7f9e357fa700 1 -- 172.21.15.49:0/2624733104 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e28024970 con 0x7f9e38107fb0 2024-06-02T23:50:04.301 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.433+0000 7f9e3dac8700 1 -- 172.21.15.49:0/2624733104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e3819ca70 con 0x7f9e38107fb0 2024-06-02T23:50:04.301 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.434+0000 7f9e357fa700 1 -- 172.21.15.49:0/2624733104 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f9e28022020 con 0x7f9e38107fb0 2024-06-02T23:50:04.301 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.435+0000 7f9e3dac8700 1 -- 172.21.15.49:0/2624733104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e38063af0 con 0x7f9e38107fb0 2024-06-02T23:50:04.301 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.435+0000 7f9e357fa700 1 --2- 172.21.15.49:0/2624733104 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9e240390f0 0x7f9e2403b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:04.301 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.435+0000 7f9e357fa700 1 -- 172.21.15.49:0/2624733104 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9e2804d720 con 0x7f9e38107fb0 2024-06-02T23:50:04.301 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.435+0000 7f9e2effd700 1 --2- 172.21.15.49:0/2624733104 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9e240390f0 0x7f9e2403b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:04.301 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.435+0000 7f9e2effd700 1 --2- 172.21.15.49:0/2624733104 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9e240390f0 0x7f9e2403b5b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9e20006fd0 tx=0x7f9e20006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:04.301 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.440+0000 7f9e357fa700 1 -- 172.21.15.49:0/2624733104 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9e28011e20 con 0x7f9e38107fb0 2024-06-02T23:50:04.301 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.762+0000 7f9e3dac8700 1 -- 172.21.15.49:0/2624733104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f9e3819f3f0 con 0x7f9e38107fb0 2024-06-02T23:50:04.301 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.764+0000 7f9e357fa700 1 -- 172.21.15.49:0/2624733104 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) ==== 153+0+0 (secure 0 0 0) 0x7f9e2800ba30 con 0x7f9e38107fb0 2024-06-02T23:50:04.301 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.766+0000 7f9e3dac8700 1 -- 172.21.15.49:0/2624733104 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9e240390f0 msgr2=0x7f9e2403b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:04.301 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.766+0000 7f9e3dac8700 1 --2- 172.21.15.49:0/2624733104 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9e240390f0 0x7f9e2403b5b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9e20006fd0 tx=0x7f9e20006e40 comp rx=0 tx=0).stop 2024-06-02T23:50:04.302 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.766+0000 7f9e3dac8700 1 -- 172.21.15.49:0/2624733104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e38107fb0 msgr2=0x7f9e3819be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:04.302 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.766+0000 7f9e3dac8700 1 --2- 172.21.15.49:0/2624733104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e38107fb0 0x7f9e3819be40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9e280117e0 tx=0x7f9e28011c10 comp rx=0 tx=0).stop 2024-06-02T23:50:04.302 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.767+0000 7f9e3dac8700 1 -- 172.21.15.49:0/2624733104 shutdown_connections 2024-06-02T23:50:04.302 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.767+0000 7f9e3dac8700 1 --2- 172.21.15.49:0/2624733104 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9e240390f0 0x7f9e2403b5b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:04.302 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.767+0000 7f9e3dac8700 1 --2- 172.21.15.49:0/2624733104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e38107fb0 0x7f9e3819be40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:04.302 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.767+0000 7f9e3dac8700 1 -- 172.21.15.49:0/2624733104 >> 172.21.15.49:0/2624733104 conn(0x7f9e38103550 msgr2=0x7f9e38103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:50:04.302 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.767+0000 7f9e3dac8700 1 -- 172.21.15.49:0/2624733104 shutdown_connections 2024-06-02T23:50:04.302 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-06-02T23:50:03.767+0000 7f9e3dac8700 1 -- 172.21.15.49:0/2624733104 wait complete. 2024-06-02T23:50:04.302 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-06-02T23:50:04.302 INFO:teuthology.orchestra.run.smithi049.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-06-02T23:50:04.302 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:50:04.302 INFO:teuthology.orchestra.run.smithi049.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-06-02T23:50:04.302 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:50:04.302 INFO:teuthology.orchestra.run.smithi049.stdout:Or, if you are only running a single cluster on this host: 2024-06-02T23:50:04.303 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:50:04.303 INFO:teuthology.orchestra.run.smithi049.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-06-02T23:50:04.303 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:50:04.303 INFO:teuthology.orchestra.run.smithi049.stdout:Please consider enabling telemetry to help improve Ceph: 2024-06-02T23:50:04.303 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:50:04.303 INFO:teuthology.orchestra.run.smithi049.stdout: ceph telemetry on 2024-06-02T23:50:04.303 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:50:04.303 INFO:teuthology.orchestra.run.smithi049.stdout:For more information see: 2024-06-02T23:50:04.303 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:50:04.303 INFO:teuthology.orchestra.run.smithi049.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-06-02T23:50:04.303 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:50:04.303 INFO:teuthology.orchestra.run.smithi049.stdout:Bootstrap complete. 2024-06-02T23:50:04.342 INFO:tasks.cephadm:Fetching config... 2024-06-02T23:50:04.343 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-06-02T23:50:04.343 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-06-02T23:50:04.359 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-06-02T23:50:04.359 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-06-02T23:50:04.360 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-06-02T23:50:04.415 INFO:tasks.cephadm:Fetching mon keyring... 2024-06-02T23:50:04.415 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-06-02T23:50:04.415 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/keyring of=/dev/stdout 2024-06-02T23:50:04.481 INFO:tasks.cephadm:Fetching pub ssh key... 2024-06-02T23:50:04.481 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-06-02T23:50:04.481 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-06-02T23:50:04.537 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-06-02T23:50:04.538 DEBUG:teuthology.orchestra.run.smithi049:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsBt7Z7KnDxagUcsVKs/AUOc8uVWN47z8RI+OypUYLvNWZ5FNSTIqWAWJfvIsdOiX/45gNrRwAfuA7ofnJZAkAzXkK+cnAsd08jFQ0nszKtqEazHSQ4hkRepD8vV1HLOuyTxlgEDSsrXmEBlgz9hCc2d9LPFCIhOeLKJR5QX+oasiCkaGVqL8NPWlT25ZFBM6uzuAhRbAgLzPfWH1b/+gV34VPoSAxEFi/Kz7gu+8VNaSpQkuf9zGeIxlY1L3rAWo2Q3OjLwjEB8beMIiySqPGJdTmgyiroziIQm0xZ0de0BK1Z9UjAaryKssaf7Th1td722lU2L48q8S42SbWmdt6Nm0t5hPPlVTbDgM1lNerHFPkSjqoT9xfejxrKv9ekr09VqHyEsWplQ3NGpD860tFcqVnnBD/KMDoL3DAfYZrAhksCbHiATEZ84CYGBoePSgkOpdHmG8dRJbE4aHliP4ldvZjPmgifJkKTl6JbbQvnmY5xiUJrX/la/iGT3RYixk= ceph-890dd222-213a-11ef-bc9b-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-06-02T23:50:04.621 INFO:teuthology.orchestra.run.smithi049.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsBt7Z7KnDxagUcsVKs/AUOc8uVWN47z8RI+OypUYLvNWZ5FNSTIqWAWJfvIsdOiX/45gNrRwAfuA7ofnJZAkAzXkK+cnAsd08jFQ0nszKtqEazHSQ4hkRepD8vV1HLOuyTxlgEDSsrXmEBlgz9hCc2d9LPFCIhOeLKJR5QX+oasiCkaGVqL8NPWlT25ZFBM6uzuAhRbAgLzPfWH1b/+gV34VPoSAxEFi/Kz7gu+8VNaSpQkuf9zGeIxlY1L3rAWo2Q3OjLwjEB8beMIiySqPGJdTmgyiroziIQm0xZ0de0BK1Z9UjAaryKssaf7Th1td722lU2L48q8S42SbWmdt6Nm0t5hPPlVTbDgM1lNerHFPkSjqoT9xfejxrKv9ekr09VqHyEsWplQ3NGpD860tFcqVnnBD/KMDoL3DAfYZrAhksCbHiATEZ84CYGBoePSgkOpdHmG8dRJbE4aHliP4ldvZjPmgifJkKTl6JbbQvnmY5xiUJrX/la/iGT3RYixk= ceph-890dd222-213a-11ef-bc9b-c7b262605968 2024-06-02T23:50:04.634 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsBt7Z7KnDxagUcsVKs/AUOc8uVWN47z8RI+OypUYLvNWZ5FNSTIqWAWJfvIsdOiX/45gNrRwAfuA7ofnJZAkAzXkK+cnAsd08jFQ0nszKtqEazHSQ4hkRepD8vV1HLOuyTxlgEDSsrXmEBlgz9hCc2d9LPFCIhOeLKJR5QX+oasiCkaGVqL8NPWlT25ZFBM6uzuAhRbAgLzPfWH1b/+gV34VPoSAxEFi/Kz7gu+8VNaSpQkuf9zGeIxlY1L3rAWo2Q3OjLwjEB8beMIiySqPGJdTmgyiroziIQm0xZ0de0BK1Z9UjAaryKssaf7Th1td722lU2L48q8S42SbWmdt6Nm0t5hPPlVTbDgM1lNerHFPkSjqoT9xfejxrKv9ekr09VqHyEsWplQ3NGpD860tFcqVnnBD/KMDoL3DAfYZrAhksCbHiATEZ84CYGBoePSgkOpdHmG8dRJbE4aHliP4ldvZjPmgifJkKTl6JbbQvnmY5xiUJrX/la/iGT3RYixk= ceph-890dd222-213a-11ef-bc9b-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-06-02T23:50:04.684 INFO:teuthology.orchestra.run.smithi057.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsBt7Z7KnDxagUcsVKs/AUOc8uVWN47z8RI+OypUYLvNWZ5FNSTIqWAWJfvIsdOiX/45gNrRwAfuA7ofnJZAkAzXkK+cnAsd08jFQ0nszKtqEazHSQ4hkRepD8vV1HLOuyTxlgEDSsrXmEBlgz9hCc2d9LPFCIhOeLKJR5QX+oasiCkaGVqL8NPWlT25ZFBM6uzuAhRbAgLzPfWH1b/+gV34VPoSAxEFi/Kz7gu+8VNaSpQkuf9zGeIxlY1L3rAWo2Q3OjLwjEB8beMIiySqPGJdTmgyiroziIQm0xZ0de0BK1Z9UjAaryKssaf7Th1td722lU2L48q8S42SbWmdt6Nm0t5hPPlVTbDgM1lNerHFPkSjqoT9xfejxrKv9ekr09VqHyEsWplQ3NGpD860tFcqVnnBD/KMDoL3DAfYZrAhksCbHiATEZ84CYGBoePSgkOpdHmG8dRJbE4aHliP4ldvZjPmgifJkKTl6JbbQvnmY5xiUJrX/la/iGT3RYixk= ceph-890dd222-213a-11ef-bc9b-c7b262605968 2024-06-02T23:50:04.697 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsBt7Z7KnDxagUcsVKs/AUOc8uVWN47z8RI+OypUYLvNWZ5FNSTIqWAWJfvIsdOiX/45gNrRwAfuA7ofnJZAkAzXkK+cnAsd08jFQ0nszKtqEazHSQ4hkRepD8vV1HLOuyTxlgEDSsrXmEBlgz9hCc2d9LPFCIhOeLKJR5QX+oasiCkaGVqL8NPWlT25ZFBM6uzuAhRbAgLzPfWH1b/+gV34VPoSAxEFi/Kz7gu+8VNaSpQkuf9zGeIxlY1L3rAWo2Q3OjLwjEB8beMIiySqPGJdTmgyiroziIQm0xZ0de0BK1Z9UjAaryKssaf7Th1td722lU2L48q8S42SbWmdt6Nm0t5hPPlVTbDgM1lNerHFPkSjqoT9xfejxrKv9ekr09VqHyEsWplQ3NGpD860tFcqVnnBD/KMDoL3DAfYZrAhksCbHiATEZ84CYGBoePSgkOpdHmG8dRJbE4aHliP4ldvZjPmgifJkKTl6JbbQvnmY5xiUJrX/la/iGT3RYixk= ceph-890dd222-213a-11ef-bc9b-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-06-02T23:50:04.744 INFO:teuthology.orchestra.run.smithi107.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsBt7Z7KnDxagUcsVKs/AUOc8uVWN47z8RI+OypUYLvNWZ5FNSTIqWAWJfvIsdOiX/45gNrRwAfuA7ofnJZAkAzXkK+cnAsd08jFQ0nszKtqEazHSQ4hkRepD8vV1HLOuyTxlgEDSsrXmEBlgz9hCc2d9LPFCIhOeLKJR5QX+oasiCkaGVqL8NPWlT25ZFBM6uzuAhRbAgLzPfWH1b/+gV34VPoSAxEFi/Kz7gu+8VNaSpQkuf9zGeIxlY1L3rAWo2Q3OjLwjEB8beMIiySqPGJdTmgyiroziIQm0xZ0de0BK1Z9UjAaryKssaf7Th1td722lU2L48q8S42SbWmdt6Nm0t5hPPlVTbDgM1lNerHFPkSjqoT9xfejxrKv9ekr09VqHyEsWplQ3NGpD860tFcqVnnBD/KMDoL3DAfYZrAhksCbHiATEZ84CYGBoePSgkOpdHmG8dRJbE4aHliP4ldvZjPmgifJkKTl6JbbQvnmY5xiUJrX/la/iGT3RYixk= ceph-890dd222-213a-11ef-bc9b-c7b262605968 2024-06-02T23:50:04.755 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-06-02T23:50:04.960 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:04 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/2624733104' entity='client.admin' 2024-06-02T23:50:05.001 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:50:07.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.068+0000 7f364b64f700 1 -- 172.21.15.49:0/143208235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36441029d0 msgr2=0x7f3644104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:07.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.068+0000 7f364b64f700 1 --2- 172.21.15.49:0/143208235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36441029d0 0x7f3644104dc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3640009910 tx=0x7f3640009c20 comp rx=0 tx=0).stop 2024-06-02T23:50:07.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.068+0000 7f364b64f700 1 -- 172.21.15.49:0/143208235 shutdown_connections 2024-06-02T23:50:07.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.068+0000 7f364b64f700 1 --2- 172.21.15.49:0/143208235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36441029d0 0x7f3644104dc0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:07.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.068+0000 7f364b64f700 1 -- 172.21.15.49:0/143208235 >> 172.21.15.49:0/143208235 conn(0x7f36440fc3a0 msgr2=0x7f36440fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:50:07.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.068+0000 7f364b64f700 1 -- 172.21.15.49:0/143208235 shutdown_connections 2024-06-02T23:50:07.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.068+0000 7f364b64f700 1 -- 172.21.15.49:0/143208235 wait complete. 2024-06-02T23:50:07.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.068+0000 7f364b64f700 1 Processor -- start 2024-06-02T23:50:07.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.068+0000 7f364b64f700 1 -- start start 2024-06-02T23:50:07.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.069+0000 7f364b64f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36441029d0 0x7f3644102250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:07.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.069+0000 7f364b64f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3644107f70 con 0x7f36441029d0 2024-06-02T23:50:07.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.069+0000 7f36493eb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36441029d0 0x7f3644102250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:07.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.069+0000 7f36493eb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36441029d0 0x7f3644102250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52212/0 (socket says 172.21.15.49:52212) 2024-06-02T23:50:07.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.069+0000 7f36493eb700 1 -- 172.21.15.49:0/3753176796 learned_addr learned my addr 172.21.15.49:0/3753176796 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:50:07.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.069+0000 7f36493eb700 1 -- 172.21.15.49:0/3753176796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3644102790 con 0x7f36441029d0 2024-06-02T23:50:07.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.069+0000 7f36493eb700 1 --2- 172.21.15.49:0/3753176796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36441029d0 0x7f3644102250 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3640004fa0 tx=0x7f3640005080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:07.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.069+0000 7f363a7fc700 1 -- 172.21.15.49:0/3753176796 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3640027070 con 0x7f36441029d0 2024-06-02T23:50:07.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.069+0000 7f363a7fc700 1 -- 172.21.15.49:0/3753176796 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f364000be40 con 0x7f36441029d0 2024-06-02T23:50:07.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.069+0000 7f364b64f700 1 -- 172.21.15.49:0/3753176796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3644100980 con 0x7f36441029d0 2024-06-02T23:50:07.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.069+0000 7f363a7fc700 1 -- 172.21.15.49:0/3753176796 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f364000f460 con 0x7f36441029d0 2024-06-02T23:50:07.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.069+0000 7f364b64f700 1 -- 172.21.15.49:0/3753176796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3644100ec0 con 0x7f36441029d0 2024-06-02T23:50:07.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.070+0000 7f363a7fc700 1 -- 172.21.15.49:0/3753176796 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f364002a070 con 0x7f36441029d0 2024-06-02T23:50:07.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.070+0000 7f364b64f700 1 -- 172.21.15.49:0/3753176796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36441086f0 con 0x7f36441029d0 2024-06-02T23:50:07.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.071+0000 7f363a7fc700 1 --2- 172.21.15.49:0/3753176796 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3630039150 0x7f363003b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:07.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.071+0000 7f363a7fc700 1 -- 172.21.15.49:0/3753176796 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f364001e030 con 0x7f36441029d0 2024-06-02T23:50:07.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.071+0000 7f3648bea700 1 --2- 172.21.15.49:0/3753176796 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3630039150 0x7f363003b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:07.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.071+0000 7f3648bea700 1 --2- 172.21.15.49:0/3753176796 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3630039150 0x7f363003b610 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3634006fd0 tx=0x7f3634006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:07.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.075+0000 7f363a7fc700 1 -- 172.21.15.49:0/3753176796 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3640013070 con 0x7f36441029d0 2024-06-02T23:50:07.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.282+0000 7f364b64f700 1 -- 172.21.15.49:0/3753176796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f3644190ab0 con 0x7f36441029d0 2024-06-02T23:50:07.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.284+0000 7f363a7fc700 1 -- 172.21.15.49:0/3753176796 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f3640013c60 con 0x7f36441029d0 2024-06-02T23:50:07.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.286+0000 7f364b64f700 1 -- 172.21.15.49:0/3753176796 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3630039150 msgr2=0x7f363003b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:07.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.286+0000 7f364b64f700 1 --2- 172.21.15.49:0/3753176796 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3630039150 0x7f363003b610 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3634006fd0 tx=0x7f3634006e40 comp rx=0 tx=0).stop 2024-06-02T23:50:07.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.286+0000 7f364b64f700 1 -- 172.21.15.49:0/3753176796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36441029d0 msgr2=0x7f3644102250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:07.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.286+0000 7f364b64f700 1 --2- 172.21.15.49:0/3753176796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36441029d0 0x7f3644102250 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3640004fa0 tx=0x7f3640005080 comp rx=0 tx=0).stop 2024-06-02T23:50:07.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.287+0000 7f364b64f700 1 -- 172.21.15.49:0/3753176796 shutdown_connections 2024-06-02T23:50:07.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.287+0000 7f364b64f700 1 --2- 172.21.15.49:0/3753176796 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3630039150 0x7f363003b610 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:07.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.287+0000 7f364b64f700 1 --2- 172.21.15.49:0/3753176796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36441029d0 0x7f3644102250 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:07.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.287+0000 7f364b64f700 1 -- 172.21.15.49:0/3753176796 >> 172.21.15.49:0/3753176796 conn(0x7f36440fc3a0 msgr2=0x7f36440fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:50:07.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.287+0000 7f364b64f700 1 -- 172.21.15.49:0/3753176796 shutdown_connections 2024-06-02T23:50:07.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:07.287+0000 7f364b64f700 1 -- 172.21.15.49:0/3753176796 wait complete. 2024-06-02T23:50:07.853 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:07 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:07.854 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:07 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:07.854 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:07 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi049", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:50:07.854 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:07 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:07.854 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:07 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:50:07.854 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:07 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:07.854 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:07 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3753176796' entity='client.admin' 2024-06-02T23:50:07.854 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:07 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:50:07.854 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:07 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:07.880 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-06-02T23:50:07.880 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-06-02T23:50:08.122 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:50:09.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.749+0000 7f1943b97700 1 -- 172.21.15.49:0/2561173866 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f193c103560 msgr2=0x7f193c103980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:09.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.749+0000 7f1943b97700 1 --2- 172.21.15.49:0/2561173866 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f193c103560 0x7f193c103980 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1938009910 tx=0x7f1938009c20 comp rx=0 tx=0).stop 2024-06-02T23:50:09.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.749+0000 7f1943b97700 1 -- 172.21.15.49:0/2561173866 shutdown_connections 2024-06-02T23:50:09.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.749+0000 7f1943b97700 1 --2- 172.21.15.49:0/2561173866 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f193c103560 0x7f193c103980 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:09.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.749+0000 7f1943b97700 1 -- 172.21.15.49:0/2561173866 >> 172.21.15.49:0/2561173866 conn(0x7f193c0fd4e0 msgr2=0x7f193c0ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:50:09.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.749+0000 7f1943b97700 1 -- 172.21.15.49:0/2561173866 shutdown_connections 2024-06-02T23:50:09.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.749+0000 7f1943b97700 1 -- 172.21.15.49:0/2561173866 wait complete. 2024-06-02T23:50:09.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.750+0000 7f1943b97700 1 Processor -- start 2024-06-02T23:50:09.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.750+0000 7f1943b97700 1 -- start start 2024-06-02T23:50:09.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.750+0000 7f1943b97700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f193c103560 0x7f193c076150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:09.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.750+0000 7f1943b97700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f193c108030 con 0x7f193c103560 2024-06-02T23:50:09.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.750+0000 7f1941933700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f193c103560 0x7f193c076150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:09.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.750+0000 7f1941933700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f193c103560 0x7f193c076150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52232/0 (socket says 172.21.15.49:52232) 2024-06-02T23:50:09.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.750+0000 7f1941933700 1 -- 172.21.15.49:0/1466295242 learned_addr learned my addr 172.21.15.49:0/1466295242 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:50:09.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.750+0000 7f1941933700 1 -- 172.21.15.49:0/1466295242 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f193c076690 con 0x7f193c103560 2024-06-02T23:50:09.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.750+0000 7f1941933700 1 --2- 172.21.15.49:0/1466295242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f193c103560 0x7f193c076150 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1938004fa0 tx=0x7f1938005080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:09.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.751+0000 7f1932ffd700 1 -- 172.21.15.49:0/1466295242 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1938027070 con 0x7f193c103560 2024-06-02T23:50:09.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.751+0000 7f1943b97700 1 -- 172.21.15.49:0/1466295242 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f193c074880 con 0x7f193c103560 2024-06-02T23:50:09.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.751+0000 7f1932ffd700 1 -- 172.21.15.49:0/1466295242 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f193800be40 con 0x7f193c103560 2024-06-02T23:50:09.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.751+0000 7f1932ffd700 1 -- 172.21.15.49:0/1466295242 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f193800f460 con 0x7f193c103560 2024-06-02T23:50:09.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.751+0000 7f1943b97700 1 -- 172.21.15.49:0/1466295242 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f193c074dc0 con 0x7f193c103560 2024-06-02T23:50:09.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.752+0000 7f1932ffd700 1 -- 172.21.15.49:0/1466295242 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f193802a070 con 0x7f193c103560 2024-06-02T23:50:09.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.751+0000 7f1943b97700 1 -- 172.21.15.49:0/1466295242 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f193c1087b0 con 0x7f193c103560 2024-06-02T23:50:09.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.752+0000 7f1932ffd700 1 --2- 172.21.15.49:0/1466295242 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f19280390f0 0x7f192803b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:09.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.752+0000 7f1932ffd700 1 -- 172.21.15.49:0/1466295242 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f193801e030 con 0x7f193c103560 2024-06-02T23:50:09.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.752+0000 7f1941132700 1 --2- 172.21.15.49:0/1466295242 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f19280390f0 0x7f192803b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:09.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.752+0000 7f1941132700 1 --2- 172.21.15.49:0/1466295242 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f19280390f0 0x7f192803b5b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f192c006fd0 tx=0x7f192c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:09.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.757+0000 7f1932ffd700 1 -- 172.21.15.49:0/1466295242 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1938013070 con 0x7f193c103560 2024-06-02T23:50:09.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.967+0000 7f1943b97700 1 -- 172.21.15.49:0/1466295242 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f193c1909a0 con 0x7f19280390f0 2024-06-02T23:50:09.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.970+0000 7f1932ffd700 1 -- 172.21.15.49:0/1466295242 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f193c1909a0 con 0x7f19280390f0 2024-06-02T23:50:09.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.972+0000 7f1943b97700 1 -- 172.21.15.49:0/1466295242 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f19280390f0 msgr2=0x7f192803b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:09.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.972+0000 7f1943b97700 1 --2- 172.21.15.49:0/1466295242 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f19280390f0 0x7f192803b5b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f192c006fd0 tx=0x7f192c006e40 comp rx=0 tx=0).stop 2024-06-02T23:50:09.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.972+0000 7f1943b97700 1 -- 172.21.15.49:0/1466295242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f193c103560 msgr2=0x7f193c076150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:09.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.972+0000 7f1943b97700 1 --2- 172.21.15.49:0/1466295242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f193c103560 0x7f193c076150 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1938004fa0 tx=0x7f1938005080 comp rx=0 tx=0).stop 2024-06-02T23:50:09.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.973+0000 7f1943b97700 1 -- 172.21.15.49:0/1466295242 shutdown_connections 2024-06-02T23:50:09.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.973+0000 7f1943b97700 1 --2- 172.21.15.49:0/1466295242 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f19280390f0 0x7f192803b5b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:09.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.973+0000 7f1943b97700 1 --2- 172.21.15.49:0/1466295242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f193c103560 0x7f193c076150 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:09.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.973+0000 7f1943b97700 1 -- 172.21.15.49:0/1466295242 >> 172.21.15.49:0/1466295242 conn(0x7f193c0fd4e0 msgr2=0x7f193c0fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:50:09.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.973+0000 7f1943b97700 1 -- 172.21.15.49:0/1466295242 shutdown_connections 2024-06-02T23:50:09.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:09.973+0000 7f1943b97700 1 -- 172.21.15.49:0/1466295242 wait complete. 2024-06-02T23:50:10.643 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi057 2024-06-02T23:50:10.643 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-06-02T23:50:10.643 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/etc/ceph/ceph.conf 2024-06-02T23:50:10.662 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-06-02T23:50:10.662 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-02T23:50:10.721 INFO:tasks.cephadm:Adding host smithi057 to orchestrator... 2024-06-02T23:50:10.721 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph orch host add smithi057 2024-06-02T23:50:10.973 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:50:11.305 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:10 smithi049 ceph-mon[32302]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:50:11.305 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:11.305 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:50:11.306 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:50:11.306 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:50:12.100 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:11 smithi049 ceph-mon[32302]: Updating smithi049:/etc/ceph/ceph.conf 2024-06-02T23:50:12.101 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:11 smithi049 ceph-mon[32302]: Updating smithi049:/var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:50:12.101 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:11 smithi049 ceph-mon[32302]: Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-06-02T23:50:12.101 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:11 smithi049 ceph-mon[32302]: Updating smithi049:/var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T23:50:12.101 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:11 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:12.101 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:11 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:12.101 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:11 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:12.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:12.613+0000 7f2f3642d700 1 -- 172.21.15.49:0/1197518460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f30103060 msgr2=0x7f2f30103440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:12.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:12.613+0000 7f2f3642d700 1 --2- 172.21.15.49:0/1197518460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f30103060 0x7f2f30103440 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2f20009910 tx=0x7f2f20009c20 comp rx=0 tx=0).stop 2024-06-02T23:50:12.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:12.613+0000 7f2f3642d700 1 -- 172.21.15.49:0/1197518460 shutdown_connections 2024-06-02T23:50:12.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:12.613+0000 7f2f3642d700 1 --2- 172.21.15.49:0/1197518460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f30103060 0x7f2f30103440 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:12.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:12.613+0000 7f2f3642d700 1 -- 172.21.15.49:0/1197518460 >> 172.21.15.49:0/1197518460 conn(0x7f2f300fc8b0 msgr2=0x7f2f300fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:50:12.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:12.613+0000 7f2f3642d700 1 -- 172.21.15.49:0/1197518460 shutdown_connections 2024-06-02T23:50:12.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:12.613+0000 7f2f3642d700 1 -- 172.21.15.49:0/1197518460 wait complete. 2024-06-02T23:50:12.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:12.613+0000 7f2f3642d700 1 Processor -- start 2024-06-02T23:50:12.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:12.613+0000 7f2f3642d700 1 -- start start 2024-06-02T23:50:12.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:12.614+0000 7f2f3642d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f30103060 0x7f2f3019d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:12.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:12.614+0000 7f2f3642d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2f3010c550 con 0x7f2f30103060 2024-06-02T23:50:12.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:12.614+0000 7f2f2ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f30103060 0x7f2f3019d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:12.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:12.614+0000 7f2f2ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f30103060 0x7f2f3019d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52242/0 (socket says 172.21.15.49:52242) 2024-06-02T23:50:12.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:12.614+0000 7f2f2ffff700 1 -- 172.21.15.49:0/2725517704 learned_addr learned my addr 172.21.15.49:0/2725517704 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:50:12.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:12.614+0000 7f2f2ffff700 1 -- 172.21.15.49:0/2725517704 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f3019dc30 con 0x7f2f30103060 2024-06-02T23:50:12.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:12.614+0000 7f2f2ffff700 1 --2- 172.21.15.49:0/2725517704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f30103060 0x7f2f3019d6f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2f20006010 tx=0x7f2f20005050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:12.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:12.615+0000 7f2f2d7fa700 1 -- 172.21.15.49:0/2725517704 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f20026070 con 0x7f2f30103060 2024-06-02T23:50:12.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:12.615+0000 7f2f3642d700 1 -- 172.21.15.49:0/2725517704 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f3019dec0 con 0x7f2f30103060 2024-06-02T23:50:12.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:12.615+0000 7f2f3642d700 1 -- 172.21.15.49:0/2725517704 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f301978b0 con 0x7f2f30103060 2024-06-02T23:50:12.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:12.615+0000 7f2f2d7fa700 1 -- 172.21.15.49:0/2725517704 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f2000bc30 con 0x7f2f30103060 2024-06-02T23:50:12.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:12.615+0000 7f2f2d7fa700 1 -- 172.21.15.49:0/2725517704 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f20003ab0 con 0x7f2f30103060 2024-06-02T23:50:12.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:12.616+0000 7f2f3642d700 1 -- 172.21.15.49:0/2725517704 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f1c005330 con 0x7f2f30103060 2024-06-02T23:50:12.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:12.616+0000 7f2f2d7fa700 1 -- 172.21.15.49:0/2725517704 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f2f20029070 con 0x7f2f30103060 2024-06-02T23:50:12.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:12.616+0000 7f2f2d7fa700 1 --2- 172.21.15.49:0/2725517704 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f2f18039150 0x7f2f1803b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:12.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:12.616+0000 7f2f2d7fa700 1 -- 172.21.15.49:0/2725517704 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2f2001e070 con 0x7f2f30103060 2024-06-02T23:50:12.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:12.616+0000 7f2f2f7fe700 1 --2- 172.21.15.49:0/2725517704 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f2f18039150 0x7f2f1803b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:12.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:12.617+0000 7f2f2f7fe700 1 --2- 172.21.15.49:0/2725517704 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f2f18039150 0x7f2f1803b610 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2f24006fd0 tx=0x7f2f24006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:12.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:12.621+0000 7f2f2d7fa700 1 -- 172.21.15.49:0/2725517704 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2f20013070 con 0x7f2f30103060 2024-06-02T23:50:12.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:12.828+0000 7f2f3642d700 1 -- 172.21.15.49:0/2725517704 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi057", "target": ["mon-mgr", ""]}) -- 0x7f2f1c000bc0 con 0x7f2f18039150 2024-06-02T23:50:13.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:13 smithi049 ceph-mon[32302]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi057", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:50:14.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:14 smithi049 ceph-mon[32302]: Deploying cephadm binary to smithi057 2024-06-02T23:50:16.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:16 smithi049 ceph-mon[32302]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:17.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:17.091+0000 7f2f2d7fa700 1 -- 172.21.15.49:0/2725517704 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f2f1c000bc0 con 0x7f2f18039150 2024-06-02T23:50:17.091 INFO:teuthology.orchestra.run.smithi049.stdout:Added host 'smithi057' with addr '172.21.15.57' 2024-06-02T23:50:17.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:17.094+0000 7f2f3642d700 1 -- 172.21.15.49:0/2725517704 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f2f18039150 msgr2=0x7f2f1803b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:17.094+0000 7f2f3642d700 1 --2- 172.21.15.49:0/2725517704 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f2f18039150 0x7f2f1803b610 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2f24006fd0 tx=0x7f2f24006e40 comp rx=0 tx=0).stop 2024-06-02T23:50:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:17.094+0000 7f2f3642d700 1 -- 172.21.15.49:0/2725517704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f30103060 msgr2=0x7f2f3019d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:17.094+0000 7f2f3642d700 1 --2- 172.21.15.49:0/2725517704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f30103060 0x7f2f3019d6f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2f20006010 tx=0x7f2f20005050 comp rx=0 tx=0).stop 2024-06-02T23:50:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:17.094+0000 7f2f3642d700 1 -- 172.21.15.49:0/2725517704 shutdown_connections 2024-06-02T23:50:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:17.094+0000 7f2f3642d700 1 --2- 172.21.15.49:0/2725517704 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f2f18039150 0x7f2f1803b610 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:17.094+0000 7f2f3642d700 1 --2- 172.21.15.49:0/2725517704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f30103060 0x7f2f3019d6f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:17.094+0000 7f2f3642d700 1 -- 172.21.15.49:0/2725517704 >> 172.21.15.49:0/2725517704 conn(0x7f2f300fc8b0 msgr2=0x7f2f30103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:50:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:17.094+0000 7f2f3642d700 1 -- 172.21.15.49:0/2725517704 shutdown_connections 2024-06-02T23:50:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:17.094+0000 7f2f3642d700 1 -- 172.21.15.49:0/2725517704 wait complete. 2024-06-02T23:50:17.842 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph orch host ls --format=json 2024-06-02T23:50:18.094 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:50:18.434 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:18 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:18.434 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:18 smithi049 ceph-mon[32302]: Added host smithi057 2024-06-02T23:50:18.434 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:18 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:50:18.434 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:18 smithi049 ceph-mon[32302]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:18.435 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:18 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:19.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:19 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:19.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.556+0000 7fc17b87f700 1 -- 172.21.15.49:0/1856563526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1741020e0 msgr2=0x7fc1741024c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:19.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.556+0000 7fc17b87f700 1 --2- 172.21.15.49:0/1856563526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1741020e0 0x7fc1741024c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc17000b0a0 tx=0x7fc17000b3b0 comp rx=0 tx=0).stop 2024-06-02T23:50:19.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.556+0000 7fc17b87f700 1 -- 172.21.15.49:0/1856563526 shutdown_connections 2024-06-02T23:50:19.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.556+0000 7fc17b87f700 1 --2- 172.21.15.49:0/1856563526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1741020e0 0x7fc1741024c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:19.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.556+0000 7fc17b87f700 1 -- 172.21.15.49:0/1856563526 >> 172.21.15.49:0/1856563526 conn(0x7fc1740fd9d0 msgr2=0x7fc1740ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:50:19.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.556+0000 7fc17b87f700 1 -- 172.21.15.49:0/1856563526 shutdown_connections 2024-06-02T23:50:19.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.556+0000 7fc17b87f700 1 -- 172.21.15.49:0/1856563526 wait complete. 2024-06-02T23:50:19.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.556+0000 7fc17b87f700 1 Processor -- start 2024-06-02T23:50:19.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.556+0000 7fc17b87f700 1 -- start start 2024-06-02T23:50:19.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.557+0000 7fc17b87f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1741020e0 0x7fc17419d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:19.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.557+0000 7fc17b87f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc17410c4b0 con 0x7fc1741020e0 2024-06-02T23:50:19.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.557+0000 7fc17961b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1741020e0 0x7fc17419d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:19.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.557+0000 7fc17961b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1741020e0 0x7fc17419d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60066/0 (socket says 172.21.15.49:60066) 2024-06-02T23:50:19.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.557+0000 7fc17961b700 1 -- 172.21.15.49:0/4186604621 learned_addr learned my addr 172.21.15.49:0/4186604621 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:50:19.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.557+0000 7fc17961b700 1 -- 172.21.15.49:0/4186604621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc17419dbd0 con 0x7fc1741020e0 2024-06-02T23:50:19.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.557+0000 7fc17961b700 1 --2- 172.21.15.49:0/4186604621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1741020e0 0x7fc17419d690 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc170015040 tx=0x7fc170003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:19.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.557+0000 7fc16a7fc700 1 -- 172.21.15.49:0/4186604621 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc170017040 con 0x7fc1741020e0 2024-06-02T23:50:19.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.557+0000 7fc16a7fc700 1 -- 172.21.15.49:0/4186604621 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc170022070 con 0x7fc1741020e0 2024-06-02T23:50:19.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.557+0000 7fc16a7fc700 1 -- 172.21.15.49:0/4186604621 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc17001d5d0 con 0x7fc1741020e0 2024-06-02T23:50:19.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.557+0000 7fc17b87f700 1 -- 172.21.15.49:0/4186604621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc17419de60 con 0x7fc1741020e0 2024-06-02T23:50:19.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.557+0000 7fc17b87f700 1 -- 172.21.15.49:0/4186604621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc174197760 con 0x7fc1741020e0 2024-06-02T23:50:19.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.558+0000 7fc16a7fc700 1 -- 172.21.15.49:0/4186604621 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fc17001d8d0 con 0x7fc1741020e0 2024-06-02T23:50:19.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.558+0000 7fc16a7fc700 1 --2- 172.21.15.49:0/4186604621 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc1600390f0 0x7fc16003b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:19.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.558+0000 7fc17b87f700 1 -- 172.21.15.49:0/4186604621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1741035c0 con 0x7fc1741020e0 2024-06-02T23:50:19.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.558+0000 7fc16a7fc700 1 -- 172.21.15.49:0/4186604621 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc17000f050 con 0x7fc1741020e0 2024-06-02T23:50:19.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.559+0000 7fc178e1a700 1 --2- 172.21.15.49:0/4186604621 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc1600390f0 0x7fc16003b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:19.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.559+0000 7fc178e1a700 1 --2- 172.21.15.49:0/4186604621 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc1600390f0 0x7fc16003b5b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc164006fd0 tx=0x7fc164006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:19.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.564+0000 7fc16a7fc700 1 -- 172.21.15.49:0/4186604621 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc170007e20 con 0x7fc1741020e0 2024-06-02T23:50:19.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.775+0000 7fc17b87f700 1 -- 172.21.15.49:0/4186604621 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc174198c90 con 0x7fc1600390f0 2024-06-02T23:50:19.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.776+0000 7fc16a7fc700 1 -- 172.21.15.49:0/4186604621 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7fc174198c90 con 0x7fc1600390f0 2024-06-02T23:50:19.775 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:50:19.776 INFO:teuthology.orchestra.run.smithi049.stdout:[{"addr": "172.21.15.49", "hostname": "smithi049", "labels": [], "status": ""}, {"addr": "172.21.15.57", "hostname": "smithi057", "labels": [], "status": ""}] 2024-06-02T23:50:19.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.778+0000 7fc17b87f700 1 -- 172.21.15.49:0/4186604621 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc1600390f0 msgr2=0x7fc16003b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:19.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.778+0000 7fc17b87f700 1 --2- 172.21.15.49:0/4186604621 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc1600390f0 0x7fc16003b5b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc164006fd0 tx=0x7fc164006e40 comp rx=0 tx=0).stop 2024-06-02T23:50:19.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.778+0000 7fc17b87f700 1 -- 172.21.15.49:0/4186604621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1741020e0 msgr2=0x7fc17419d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:19.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.778+0000 7fc17b87f700 1 --2- 172.21.15.49:0/4186604621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1741020e0 0x7fc17419d690 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc170015040 tx=0x7fc170003d50 comp rx=0 tx=0).stop 2024-06-02T23:50:19.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.778+0000 7fc17b87f700 1 -- 172.21.15.49:0/4186604621 shutdown_connections 2024-06-02T23:50:19.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.778+0000 7fc17b87f700 1 --2- 172.21.15.49:0/4186604621 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc1600390f0 0x7fc16003b5b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:19.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.778+0000 7fc17b87f700 1 --2- 172.21.15.49:0/4186604621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1741020e0 0x7fc17419d690 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:19.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.778+0000 7fc17b87f700 1 -- 172.21.15.49:0/4186604621 >> 172.21.15.49:0/4186604621 conn(0x7fc1740fd9d0 msgr2=0x7fc174103ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:50:19.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.778+0000 7fc17b87f700 1 -- 172.21.15.49:0/4186604621 shutdown_connections 2024-06-02T23:50:19.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:19.778+0000 7fc17b87f700 1 -- 172.21.15.49:0/4186604621 wait complete. 2024-06-02T23:50:20.432 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi107 2024-06-02T23:50:20.432 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-06-02T23:50:20.432 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/etc/ceph/ceph.conf 2024-06-02T23:50:20.450 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-06-02T23:50:20.451 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-02T23:50:20.508 INFO:tasks.cephadm:Adding host smithi107 to orchestrator... 2024-06-02T23:50:20.509 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph orch host add smithi107 2024-06-02T23:50:20.755 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:50:21.043 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:20 smithi049 ceph-mon[32302]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:21.043 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:20 smithi049 ceph-mon[32302]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T23:50:21.043 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:20 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:22.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:22.221+0000 7fa996cab700 1 -- 172.21.15.49:0/1344322484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa990103060 msgr2=0x7fa990103440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:22.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:22.221+0000 7fa996cab700 1 --2- 172.21.15.49:0/1344322484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa990103060 0x7fa990103440 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa98000b0a0 tx=0x7fa98000b3b0 comp rx=0 tx=0).stop 2024-06-02T23:50:22.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:22.221+0000 7fa996cab700 1 -- 172.21.15.49:0/1344322484 shutdown_connections 2024-06-02T23:50:22.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:22.221+0000 7fa996cab700 1 --2- 172.21.15.49:0/1344322484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa990103060 0x7fa990103440 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:22.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:22.221+0000 7fa996cab700 1 -- 172.21.15.49:0/1344322484 >> 172.21.15.49:0/1344322484 conn(0x7fa9900fc890 msgr2=0x7fa9900fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:50:22.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:22.221+0000 7fa996cab700 1 -- 172.21.15.49:0/1344322484 shutdown_connections 2024-06-02T23:50:22.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:22.221+0000 7fa996cab700 1 -- 172.21.15.49:0/1344322484 wait complete. 2024-06-02T23:50:22.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:22.222+0000 7fa996cab700 1 Processor -- start 2024-06-02T23:50:22.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:22.222+0000 7fa996cab700 1 -- start start 2024-06-02T23:50:22.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:22.222+0000 7fa996cab700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa990103060 0x7fa99019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:22.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:22.222+0000 7fa996cab700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa99010c530 con 0x7fa990103060 2024-06-02T23:50:22.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:22.222+0000 7fa994a47700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa990103060 0x7fa99019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:22.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:22.222+0000 7fa994a47700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa990103060 0x7fa99019d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60080/0 (socket says 172.21.15.49:60080) 2024-06-02T23:50:22.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:22.222+0000 7fa994a47700 1 -- 172.21.15.49:0/168304505 learned_addr learned my addr 172.21.15.49:0/168304505 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:50:22.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:22.222+0000 7fa994a47700 1 -- 172.21.15.49:0/168304505 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa99019dba0 con 0x7fa990103060 2024-06-02T23:50:22.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:22.222+0000 7fa994a47700 1 --2- 172.21.15.49:0/168304505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa990103060 0x7fa99019d660 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa9800062a0 tx=0x7fa98000bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:22.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:22.223+0000 7fa98dffb700 1 -- 172.21.15.49:0/168304505 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa980017050 con 0x7fa990103060 2024-06-02T23:50:22.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:22.223+0000 7fa996cab700 1 -- 172.21.15.49:0/168304505 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa99019de30 con 0x7fa990103060 2024-06-02T23:50:22.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:22.223+0000 7fa98dffb700 1 -- 172.21.15.49:0/168304505 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa980023070 con 0x7fa990103060 2024-06-02T23:50:22.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:22.223+0000 7fa98dffb700 1 -- 172.21.15.49:0/168304505 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa980004000 con 0x7fa990103060 2024-06-02T23:50:22.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:22.223+0000 7fa996cab700 1 -- 172.21.15.49:0/168304505 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9901977e0 con 0x7fa990103060 2024-06-02T23:50:22.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:22.224+0000 7fa98dffb700 1 -- 172.21.15.49:0/168304505 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fa9800042c0 con 0x7fa990103060 2024-06-02T23:50:22.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:22.224+0000 7fa98dffb700 1 --2- 172.21.15.49:0/168304505 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa97c0390f0 0x7fa97c03b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:22.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:22.224+0000 7fa996cab700 1 -- 172.21.15.49:0/168304505 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa99006ab80 con 0x7fa990103060 2024-06-02T23:50:22.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:22.224+0000 7fa98dffb700 1 -- 172.21.15.49:0/168304505 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa98000f050 con 0x7fa990103060 2024-06-02T23:50:22.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:22.224+0000 7fa98ffff700 1 --2- 172.21.15.49:0/168304505 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa97c0390f0 0x7fa97c03b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:22.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:22.224+0000 7fa98ffff700 1 --2- 172.21.15.49:0/168304505 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa97c0390f0 0x7fa97c03b5b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa978006fd0 tx=0x7fa978006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:22.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:22.229+0000 7fa98dffb700 1 -- 172.21.15.49:0/168304505 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa980026df0 con 0x7fa990103060 2024-06-02T23:50:22.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:22.442+0000 7fa996cab700 1 -- 172.21.15.49:0/168304505 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi107", "target": ["mon-mgr", ""]}) -- 0x7fa990063af0 con 0x7fa97c0390f0 2024-06-02T23:50:23.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:22 smithi049 ceph-mon[32302]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:24.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:23 smithi049 ceph-mon[32302]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi107", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:50:24.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:23 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:24.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:23 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:24.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:23 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:24.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:23 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:24.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:23 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:50:24.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:23 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:50:24.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:23 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:50:24.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:23 smithi049 ceph-mon[32302]: Updating smithi057:/etc/ceph/ceph.conf 2024-06-02T23:50:25.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:24 smithi049 ceph-mon[32302]: Deploying cephadm binary to smithi107 2024-06-02T23:50:25.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:24 smithi049 ceph-mon[32302]: Updating smithi057:/var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:50:25.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:24 smithi049 ceph-mon[32302]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:25.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:24 smithi049 ceph-mon[32302]: Updating smithi057:/etc/ceph/ceph.client.admin.keyring 2024-06-02T23:50:25.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:24 smithi049 ceph-mon[32302]: Updating smithi057:/var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T23:50:26.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:26.639+0000 7fa98dffb700 1 -- 172.21.15.49:0/168304505 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fa990063af0 con 0x7fa97c0390f0 2024-06-02T23:50:26.640 INFO:teuthology.orchestra.run.smithi049.stdout:Added host 'smithi107' with addr '172.21.15.107' 2024-06-02T23:50:26.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:26.641+0000 7fa996cab700 1 -- 172.21.15.49:0/168304505 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa97c0390f0 msgr2=0x7fa97c03b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:26.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:26.641+0000 7fa996cab700 1 --2- 172.21.15.49:0/168304505 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa97c0390f0 0x7fa97c03b5b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa978006fd0 tx=0x7fa978006e40 comp rx=0 tx=0).stop 2024-06-02T23:50:26.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:26.641+0000 7fa996cab700 1 -- 172.21.15.49:0/168304505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa990103060 msgr2=0x7fa99019d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:26.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:26.641+0000 7fa996cab700 1 --2- 172.21.15.49:0/168304505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa990103060 0x7fa99019d660 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa9800062a0 tx=0x7fa98000bdd0 comp rx=0 tx=0).stop 2024-06-02T23:50:26.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:26.641+0000 7fa996cab700 1 -- 172.21.15.49:0/168304505 shutdown_connections 2024-06-02T23:50:26.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:26.641+0000 7fa996cab700 1 --2- 172.21.15.49:0/168304505 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa97c0390f0 0x7fa97c03b5b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:26.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:26.642+0000 7fa996cab700 1 --2- 172.21.15.49:0/168304505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa990103060 0x7fa99019d660 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:26.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:26.642+0000 7fa996cab700 1 -- 172.21.15.49:0/168304505 >> 172.21.15.49:0/168304505 conn(0x7fa9900fc890 msgr2=0x7fa990103df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:50:26.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:26.642+0000 7fa996cab700 1 -- 172.21.15.49:0/168304505 shutdown_connections 2024-06-02T23:50:26.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:26.642+0000 7fa996cab700 1 -- 172.21.15.49:0/168304505 wait complete. 2024-06-02T23:50:26.905 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:26 smithi049 ceph-mon[32302]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:26.906 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:26 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:26.906 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:26 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:26.906 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:26 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:26.906 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:26 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:26.906 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:26 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:50:27.210 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph orch host ls --format=json 2024-06-02T23:50:27.455 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:50:27.824 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:27 smithi049 ceph-mon[32302]: Added host smithi107 2024-06-02T23:50:28.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:27 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:28.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:27 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:28.933 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:28 smithi049 ceph-mon[32302]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:28.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:28.961+0000 7f328a59e700 1 -- 172.21.15.49:0/2321469925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3284102100 msgr2=0x7f32841024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:28.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:28.961+0000 7f328a59e700 1 --2- 172.21.15.49:0/2321469925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3284102100 0x7f32841024e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3274009910 tx=0x7f3274009c20 comp rx=0 tx=0).stop 2024-06-02T23:50:28.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:28.961+0000 7f328a59e700 1 -- 172.21.15.49:0/2321469925 shutdown_connections 2024-06-02T23:50:28.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:28.961+0000 7f328a59e700 1 --2- 172.21.15.49:0/2321469925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3284102100 0x7f32841024e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:28.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:28.962+0000 7f328a59e700 1 -- 172.21.15.49:0/2321469925 >> 172.21.15.49:0/2321469925 conn(0x7f32840fd9d0 msgr2=0x7f32840ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:50:28.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:28.962+0000 7f328a59e700 1 -- 172.21.15.49:0/2321469925 shutdown_connections 2024-06-02T23:50:28.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:28.962+0000 7f328a59e700 1 -- 172.21.15.49:0/2321469925 wait complete. 2024-06-02T23:50:28.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:28.962+0000 7f328a59e700 1 Processor -- start 2024-06-02T23:50:28.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:28.962+0000 7f328a59e700 1 -- start start 2024-06-02T23:50:28.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:28.963+0000 7f328a59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3284102100 0x7f328419f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:28.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:28.963+0000 7f328a59e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f328410c4d0 con 0x7f3284102100 2024-06-02T23:50:28.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:28.963+0000 7f3283fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3284102100 0x7f328419f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:28.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:28.963+0000 7f3283fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3284102100 0x7f328419f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50646/0 (socket says 172.21.15.49:50646) 2024-06-02T23:50:28.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:28.963+0000 7f3283fff700 1 -- 172.21.15.49:0/144375572 learned_addr learned my addr 172.21.15.49:0/144375572 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:50:28.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:28.963+0000 7f3283fff700 1 -- 172.21.15.49:0/144375572 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f328419fe30 con 0x7f3284102100 2024-06-02T23:50:28.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:28.963+0000 7f3283fff700 1 --2- 172.21.15.49:0/144375572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3284102100 0x7f328419f8f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3274005850 tx=0x7f3274005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:28.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:28.963+0000 7f32817fa700 1 -- 172.21.15.49:0/144375572 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3274026070 con 0x7f3284102100 2024-06-02T23:50:28.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:28.963+0000 7f32817fa700 1 -- 172.21.15.49:0/144375572 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f327400bbd0 con 0x7f3284102100 2024-06-02T23:50:28.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:28.963+0000 7f328a59e700 1 -- 172.21.15.49:0/144375572 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32841a0120 con 0x7f3284102100 2024-06-02T23:50:28.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:28.963+0000 7f32817fa700 1 -- 172.21.15.49:0/144375572 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3274003970 con 0x7f3284102100 2024-06-02T23:50:28.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:28.963+0000 7f328a59e700 1 -- 172.21.15.49:0/144375572 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3284199ab0 con 0x7f3284102100 2024-06-02T23:50:28.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:28.964+0000 7f32817fa700 1 -- 172.21.15.49:0/144375572 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f3274029070 con 0x7f3284102100 2024-06-02T23:50:28.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:28.965+0000 7f328a59e700 1 -- 172.21.15.49:0/144375572 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32841035e0 con 0x7f3284102100 2024-06-02T23:50:28.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:28.965+0000 7f32817fa700 1 --2- 172.21.15.49:0/144375572 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f326c039150 0x7f326c03b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:28.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:28.965+0000 7f32817fa700 1 -- 172.21.15.49:0/144375572 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f327401e070 con 0x7f3284102100 2024-06-02T23:50:28.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:28.965+0000 7f32837fe700 1 --2- 172.21.15.49:0/144375572 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f326c039150 0x7f326c03b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:28.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:28.965+0000 7f32837fe700 1 --2- 172.21.15.49:0/144375572 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f326c039150 0x7f326c03b610 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3278006fd0 tx=0x7f3278006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:28.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:28.970+0000 7f32817fa700 1 -- 172.21.15.49:0/144375572 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3274013070 con 0x7f3284102100 2024-06-02T23:50:29.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:29.180+0000 7f328a59e700 1 -- 172.21.15.49:0/144375572 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f328419afe0 con 0x7f326c039150 2024-06-02T23:50:29.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:29.182+0000 7f32817fa700 1 -- 172.21.15.49:0/144375572 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7f328419afe0 con 0x7f326c039150 2024-06-02T23:50:29.183 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:50:29.183 INFO:teuthology.orchestra.run.smithi049.stdout:[{"addr": "172.21.15.49", "hostname": "smithi049", "labels": [], "status": ""}, {"addr": "172.21.15.57", "hostname": "smithi057", "labels": [], "status": ""}, {"addr": "172.21.15.107", "hostname": "smithi107", "labels": [], "status": ""}] 2024-06-02T23:50:29.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:29.184+0000 7f328a59e700 1 -- 172.21.15.49:0/144375572 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f326c039150 msgr2=0x7f326c03b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:29.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:29.184+0000 7f328a59e700 1 --2- 172.21.15.49:0/144375572 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f326c039150 0x7f326c03b610 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3278006fd0 tx=0x7f3278006e40 comp rx=0 tx=0).stop 2024-06-02T23:50:29.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:29.184+0000 7f328a59e700 1 -- 172.21.15.49:0/144375572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3284102100 msgr2=0x7f328419f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:29.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:29.184+0000 7f328a59e700 1 --2- 172.21.15.49:0/144375572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3284102100 0x7f328419f8f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3274005850 tx=0x7f3274005030 comp rx=0 tx=0).stop 2024-06-02T23:50:29.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:29.184+0000 7f328a59e700 1 -- 172.21.15.49:0/144375572 shutdown_connections 2024-06-02T23:50:29.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:29.184+0000 7f328a59e700 1 --2- 172.21.15.49:0/144375572 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f326c039150 0x7f326c03b610 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:29.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:29.184+0000 7f328a59e700 1 --2- 172.21.15.49:0/144375572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3284102100 0x7f328419f8f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:29.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:29.184+0000 7f328a59e700 1 -- 172.21.15.49:0/144375572 >> 172.21.15.49:0/144375572 conn(0x7f32840fd9d0 msgr2=0x7f32840746c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:50:29.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:29.184+0000 7f328a59e700 1 -- 172.21.15.49:0/144375572 shutdown_connections 2024-06-02T23:50:29.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:29.184+0000 7f328a59e700 1 -- 172.21.15.49:0/144375572 wait complete. 2024-06-02T23:50:29.714 INFO:tasks.cephadm:Setting crush tunables to default 2024-06-02T23:50:29.714 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph osd crush tunables default 2024-06-02T23:50:29.957 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:50:30.364 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:30 smithi049 ceph-mon[32302]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:30.365 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:30 smithi049 ceph-mon[32302]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T23:50:30.365 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:30 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:31.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:31.469+0000 7f75fd24c700 1 -- 172.21.15.49:0/2159815875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75f8101000 msgr2=0x7f75f81013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:31.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:31.469+0000 7f75fd24c700 1 --2- 172.21.15.49:0/2159815875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75f8101000 0x7f75f81013e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f75e8009910 tx=0x7f75e8009c20 comp rx=0 tx=0).stop 2024-06-02T23:50:31.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:31.469+0000 7f75fd24c700 1 -- 172.21.15.49:0/2159815875 shutdown_connections 2024-06-02T23:50:31.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:31.469+0000 7f75fd24c700 1 --2- 172.21.15.49:0/2159815875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75f8101000 0x7f75f81013e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:31.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:31.469+0000 7f75fd24c700 1 -- 172.21.15.49:0/2159815875 >> 172.21.15.49:0/2159815875 conn(0x7f75f80fc890 msgr2=0x7f75f80fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:50:31.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:31.469+0000 7f75fd24c700 1 -- 172.21.15.49:0/2159815875 shutdown_connections 2024-06-02T23:50:31.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:31.469+0000 7f75fd24c700 1 -- 172.21.15.49:0/2159815875 wait complete. 2024-06-02T23:50:31.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:31.470+0000 7f75fd24c700 1 Processor -- start 2024-06-02T23:50:31.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:31.470+0000 7f75fd24c700 1 -- start start 2024-06-02T23:50:31.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:31.471+0000 7f75fd24c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75f8101000 0x7f75f8198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:31.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:31.471+0000 7f75fd24c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f75f810b3d0 con 0x7f75f8101000 2024-06-02T23:50:31.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:31.471+0000 7f75f6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75f8101000 0x7f75f8198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:31.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:31.471+0000 7f75f6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75f8101000 0x7f75f8198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50652/0 (socket says 172.21.15.49:50652) 2024-06-02T23:50:31.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:31.471+0000 7f75f6d9d700 1 -- 172.21.15.49:0/3864749164 learned_addr learned my addr 172.21.15.49:0/3864749164 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:50:31.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:31.471+0000 7f75f6d9d700 1 -- 172.21.15.49:0/3864749164 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f8198dc0 con 0x7f75f8101000 2024-06-02T23:50:31.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:31.471+0000 7f75f6d9d700 1 --2- 172.21.15.49:0/3864749164 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75f8101000 0x7f75f8198880 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f75e8005850 tx=0x7f75e8005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:31.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:31.471+0000 7f75dffff700 1 -- 172.21.15.49:0/3864749164 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e8026070 con 0x7f75f8101000 2024-06-02T23:50:31.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:31.471+0000 7f75dffff700 1 -- 172.21.15.49:0/3864749164 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75e800bbd0 con 0x7f75f8101000 2024-06-02T23:50:31.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:31.471+0000 7f75fd24c700 1 -- 172.21.15.49:0/3864749164 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75f81990b0 con 0x7f75f8101000 2024-06-02T23:50:31.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:31.472+0000 7f75dffff700 1 -- 172.21.15.49:0/3864749164 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e8003970 con 0x7f75f8101000 2024-06-02T23:50:31.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:31.472+0000 7f75fd24c700 1 -- 172.21.15.49:0/3864749164 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75f8199570 con 0x7f75f8101000 2024-06-02T23:50:31.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:31.472+0000 7f75dffff700 1 -- 172.21.15.49:0/3864749164 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f75e8029070 con 0x7f75f8101000 2024-06-02T23:50:31.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:31.472+0000 7f75fd24c700 1 -- 172.21.15.49:0/3864749164 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75f81024e0 con 0x7f75f8101000 2024-06-02T23:50:31.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:31.473+0000 7f75dffff700 1 --2- 172.21.15.49:0/3864749164 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f75e00390f0 0x7f75e003b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:31.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:31.473+0000 7f75dffff700 1 -- 172.21.15.49:0/3864749164 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f75e801e070 con 0x7f75f8101000 2024-06-02T23:50:31.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:31.473+0000 7f75f659c700 1 --2- 172.21.15.49:0/3864749164 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f75e00390f0 0x7f75e003b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:31.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:31.473+0000 7f75f659c700 1 --2- 172.21.15.49:0/3864749164 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f75e00390f0 0x7f75e003b5b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f75ec006fd0 tx=0x7f75ec006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:31.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:31.478+0000 7f75dffff700 1 -- 172.21.15.49:0/3864749164 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f75e8013070 con 0x7f75f8101000 2024-06-02T23:50:31.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:31.688+0000 7f75fd24c700 1 -- 172.21.15.49:0/3864749164 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f75f8063af0 con 0x7f75f8101000 2024-06-02T23:50:32.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:32.236+0000 7f75dffff700 1 -- 172.21.15.49:0/3864749164 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f75e8030090 con 0x7f75f8101000 2024-06-02T23:50:32.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:32.239+0000 7f75fd24c700 1 -- 172.21.15.49:0/3864749164 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f75e00390f0 msgr2=0x7f75e003b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:32.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:32.239+0000 7f75fd24c700 1 --2- 172.21.15.49:0/3864749164 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f75e00390f0 0x7f75e003b5b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f75ec006fd0 tx=0x7f75ec006e40 comp rx=0 tx=0).stop 2024-06-02T23:50:32.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:32.239+0000 7f75fd24c700 1 -- 172.21.15.49:0/3864749164 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75f8101000 msgr2=0x7f75f8198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:32.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:32.239+0000 7f75fd24c700 1 --2- 172.21.15.49:0/3864749164 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75f8101000 0x7f75f8198880 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f75e8005850 tx=0x7f75e8005030 comp rx=0 tx=0).stop 2024-06-02T23:50:32.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:32.239+0000 7f75fd24c700 1 -- 172.21.15.49:0/3864749164 shutdown_connections 2024-06-02T23:50:32.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:32.239+0000 7f75fd24c700 1 --2- 172.21.15.49:0/3864749164 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f75e00390f0 0x7f75e003b5b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:32.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:32.239+0000 7f75fd24c700 1 --2- 172.21.15.49:0/3864749164 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75f8101000 0x7f75f8198880 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:32.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:32.239+0000 7f75fd24c700 1 -- 172.21.15.49:0/3864749164 >> 172.21.15.49:0/3864749164 conn(0x7f75f80fc890 msgr2=0x7f75f8103dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:50:32.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:32.239+0000 7f75fd24c700 1 -- 172.21.15.49:0/3864749164 shutdown_connections 2024-06-02T23:50:32.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:32.239+0000 7f75fd24c700 1 -- 172.21.15.49:0/3864749164 wait complete. 2024-06-02T23:50:32.241 INFO:teuthology.orchestra.run.smithi049.stderr:adjusted tunables profile to default 2024-06-02T23:50:32.557 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:32 smithi049 ceph-mon[32302]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:32.557 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:32 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3864749164' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-06-02T23:50:32.894 INFO:tasks.cephadm:Adding mon.a on smithi049 2024-06-02T23:50:32.895 INFO:tasks.cephadm:Adding mon.b on smithi057 2024-06-02T23:50:32.895 INFO:tasks.cephadm:Adding mon.c on smithi107 2024-06-02T23:50:32.895 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph orch apply mon '3;smithi049:172.21.15.49=a;smithi057:172.21.15.57=b;smithi107:172.21.15.107=c' 2024-06-02T23:50:33.128 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:50:33.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:33 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3864749164' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-06-02T23:50:33.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:33 smithi049 ceph-mon[32302]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T23:50:33.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:33 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:33.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:33 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:33.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:33 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:33.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:33 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:33.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:33 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi107", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:50:33.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:33 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:50:33.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:33 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:50:33.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:33 smithi049 ceph-mon[32302]: Updating smithi107:/etc/ceph/ceph.conf 2024-06-02T23:50:33.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:33 smithi049 ceph-mon[32302]: Updating smithi107:/var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:50:33.712 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:33 smithi049 ceph-mon[32302]: Updating smithi107:/etc/ceph/ceph.client.admin.keyring 2024-06-02T23:50:33.712 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:33 smithi049 ceph-mon[32302]: Updating smithi107:/var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T23:50:33.712 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:33 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:33.712 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:33 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:33.712 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:33 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:34.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.565+0000 7f7a41cf6700 1 -- 172.21.15.107:0/2334763155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a3c101000 msgr2=0x7f7a3c1013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:34.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.565+0000 7f7a41cf6700 1 --2- 172.21.15.107:0/2334763155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a3c101000 0x7f7a3c1013e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c009910 tx=0x7f7a2c009c20 comp rx=0 tx=0).stop 2024-06-02T23:50:34.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.566+0000 7f7a41cf6700 1 -- 172.21.15.107:0/2334763155 shutdown_connections 2024-06-02T23:50:34.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.566+0000 7f7a41cf6700 1 --2- 172.21.15.107:0/2334763155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a3c101000 0x7f7a3c1013e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:34.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.566+0000 7f7a41cf6700 1 -- 172.21.15.107:0/2334763155 >> 172.21.15.107:0/2334763155 conn(0x7f7a3c0fc890 msgr2=0x7f7a3c0fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:50:34.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.566+0000 7f7a41cf6700 1 -- 172.21.15.107:0/2334763155 shutdown_connections 2024-06-02T23:50:34.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.566+0000 7f7a41cf6700 1 -- 172.21.15.107:0/2334763155 wait complete. 2024-06-02T23:50:34.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.566+0000 7f7a41cf6700 1 Processor -- start 2024-06-02T23:50:34.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.566+0000 7f7a41cf6700 1 -- start start 2024-06-02T23:50:34.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.567+0000 7f7a41cf6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a3c101000 0x7f7a3c19c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:34.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.567+0000 7f7a41cf6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3c10b3d0 con 0x7f7a3c101000 2024-06-02T23:50:34.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.567+0000 7f7a3b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a3c101000 0x7f7a3c19c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:34.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.567+0000 7f7a3b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a3c101000 0x7f7a3c19c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.107:45776/0 (socket says 172.21.15.107:45776) 2024-06-02T23:50:34.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.567+0000 7f7a3b7fe700 1 -- 172.21.15.107:0/1966243421 learned_addr learned my addr 172.21.15.107:0/1966243421 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-06-02T23:50:34.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.567+0000 7f7a3b7fe700 1 -- 172.21.15.107:0/1966243421 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a3c19cbb0 con 0x7f7a3c101000 2024-06-02T23:50:34.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.568+0000 7f7a3b7fe700 1 --2- 172.21.15.107:0/1966243421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a3c101000 0x7f7a3c19c670 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c005850 tx=0x7f7a2c005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:34.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.568+0000 7f7a38ff9700 1 -- 172.21.15.107:0/1966243421 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a2c026070 con 0x7f7a3c101000 2024-06-02T23:50:34.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.568+0000 7f7a41cf6700 1 -- 172.21.15.107:0/1966243421 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a3c19cea0 con 0x7f7a3c101000 2024-06-02T23:50:34.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.568+0000 7f7a38ff9700 1 -- 172.21.15.107:0/1966243421 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a2c00bbd0 con 0x7f7a3c101000 2024-06-02T23:50:34.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.568+0000 7f7a38ff9700 1 -- 172.21.15.107:0/1966243421 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a2c003970 con 0x7f7a3c101000 2024-06-02T23:50:34.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.568+0000 7f7a41cf6700 1 -- 172.21.15.107:0/1966243421 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a3c196910 con 0x7f7a3c101000 2024-06-02T23:50:34.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.569+0000 7f7a41cf6700 1 -- 172.21.15.107:0/1966243421 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a3c1024e0 con 0x7f7a3c101000 2024-06-02T23:50:34.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.569+0000 7f7a38ff9700 1 -- 172.21.15.107:0/1966243421 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f7a2c029070 con 0x7f7a3c101000 2024-06-02T23:50:34.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.569+0000 7f7a38ff9700 1 --2- 172.21.15.107:0/1966243421 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7a240390f0 0x7f7a2403b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:34.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.569+0000 7f7a38ff9700 1 -- 172.21.15.107:0/1966243421 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7a2c01e070 con 0x7f7a3c101000 2024-06-02T23:50:34.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.569+0000 7f7a3affd700 1 --2- 172.21.15.107:0/1966243421 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7a240390f0 0x7f7a2403b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:34.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.570+0000 7f7a3affd700 1 --2- 172.21.15.107:0/1966243421 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7a240390f0 0x7f7a2403b5b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7a30006fd0 tx=0x7f7a30006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:34.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.575+0000 7f7a38ff9700 1 -- 172.21.15.107:0/1966243421 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7a2c013070 con 0x7f7a3c101000 2024-06-02T23:50:34.612 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:34 smithi049 ceph-mon[32302]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:34.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.780+0000 7f7a41cf6700 1 -- 172.21.15.107:0/1966243421 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi049:172.21.15.49=a;smithi057:172.21.15.57=b;smithi107:172.21.15.107=c", "target": ["mon-mgr", ""]}) -- 0x7f7a3c0008d0 con 0x7f7a240390f0 2024-06-02T23:50:34.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.787+0000 7f7a38ff9700 1 -- 172.21.15.107:0/1966243421 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f7a3c0008d0 con 0x7f7a240390f0 2024-06-02T23:50:34.789 INFO:teuthology.orchestra.run.smithi107.stdout:Scheduled mon update... 2024-06-02T23:50:34.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.789+0000 7f7a41cf6700 1 -- 172.21.15.107:0/1966243421 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7a240390f0 msgr2=0x7f7a2403b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:34.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.789+0000 7f7a41cf6700 1 --2- 172.21.15.107:0/1966243421 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7a240390f0 0x7f7a2403b5b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7a30006fd0 tx=0x7f7a30006e40 comp rx=0 tx=0).stop 2024-06-02T23:50:34.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.789+0000 7f7a41cf6700 1 -- 172.21.15.107:0/1966243421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a3c101000 msgr2=0x7f7a3c19c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:34.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.789+0000 7f7a41cf6700 1 --2- 172.21.15.107:0/1966243421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a3c101000 0x7f7a3c19c670 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c005850 tx=0x7f7a2c005030 comp rx=0 tx=0).stop 2024-06-02T23:50:34.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.789+0000 7f7a41cf6700 1 -- 172.21.15.107:0/1966243421 shutdown_connections 2024-06-02T23:50:34.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.789+0000 7f7a41cf6700 1 --2- 172.21.15.107:0/1966243421 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7a240390f0 0x7f7a2403b5b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:34.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.789+0000 7f7a41cf6700 1 --2- 172.21.15.107:0/1966243421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a3c101000 0x7f7a3c19c670 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:34.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.789+0000 7f7a41cf6700 1 -- 172.21.15.107:0/1966243421 >> 172.21.15.107:0/1966243421 conn(0x7f7a3c0fc890 msgr2=0x7f7a3c103dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:50:34.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.789+0000 7f7a41cf6700 1 -- 172.21.15.107:0/1966243421 shutdown_connections 2024-06-02T23:50:34.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:34.789+0000 7f7a41cf6700 1 -- 172.21.15.107:0/1966243421 wait complete. 2024-06-02T23:50:35.369 DEBUG:teuthology.orchestra.run.smithi057:mon.b> sudo journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mon.b.service 2024-06-02T23:50:35.371 DEBUG:teuthology.orchestra.run.smithi107:mon.c> sudo journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mon.c.service 2024-06-02T23:50:35.374 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-06-02T23:50:35.374 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-02T23:50:35.903 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:35 smithi049 ceph-mon[32302]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi049:172.21.15.49=a;smithi057:172.21.15.57=b;smithi107:172.21.15.107=c", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:50:35.903 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:35 smithi049 ceph-mon[32302]: Saving service mon spec with placement smithi049:172.21.15.49=a;smithi057:172.21.15.57=b;smithi107:172.21.15.107=c;count:3 2024-06-02T23:50:35.904 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:35 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:35.904 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:35 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:50:35.904 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:35 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:50:35.904 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:35 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:50:35.904 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:35 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:35.904 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:35 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T23:50:35.904 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:35 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:50:35.904 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:35 smithi049 ceph-mon[32302]: Deploying daemon mon.c on smithi107 2024-06-02T23:50:36.198 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:50:37.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:36 smithi049 ceph-mon[32302]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:39.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:38 smithi049 ceph-mon[32302]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:39.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.227+0000 7f8779ebc700 1 -- 172.21.15.107:0/938005468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87741065b0 msgr2=0x7f8774106990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:39.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.227+0000 7f8779ebc700 1 --2- 172.21.15.107:0/938005468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87741065b0 0x7f8774106990 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f876400aa20 tx=0x7f876400ad30 comp rx=0 tx=0).stop 2024-06-02T23:50:39.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.227+0000 7f8779ebc700 1 -- 172.21.15.107:0/938005468 shutdown_connections 2024-06-02T23:50:39.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.227+0000 7f8779ebc700 1 --2- 172.21.15.107:0/938005468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87741065b0 0x7f8774106990 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:39.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.227+0000 7f8779ebc700 1 -- 172.21.15.107:0/938005468 >> 172.21.15.107:0/938005468 conn(0x7f8774077510 msgr2=0x7f8774077920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:50:39.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.227+0000 7f8779ebc700 1 -- 172.21.15.107:0/938005468 shutdown_connections 2024-06-02T23:50:39.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.227+0000 7f8779ebc700 1 -- 172.21.15.107:0/938005468 wait complete. 2024-06-02T23:50:39.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.228+0000 7f8779ebc700 1 Processor -- start 2024-06-02T23:50:39.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.228+0000 7f8779ebc700 1 -- start start 2024-06-02T23:50:39.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.228+0000 7f8779ebc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87741065b0 0x7f877419d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:39.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.228+0000 7f8779ebc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f877410a300 con 0x7f87741065b0 2024-06-02T23:50:39.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.228+0000 7f87737fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87741065b0 0x7f877419d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:39.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.228+0000 7f87737fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87741065b0 0x7f877419d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.107:35352/0 (socket says 172.21.15.107:35352) 2024-06-02T23:50:39.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.228+0000 7f87737fe700 1 -- 172.21.15.107:0/3295878658 learned_addr learned my addr 172.21.15.107:0/3295878658 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-06-02T23:50:39.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.229+0000 7f87737fe700 1 -- 172.21.15.107:0/3295878658 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f877419db60 con 0x7f87741065b0 2024-06-02T23:50:39.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.229+0000 7f87737fe700 1 --2- 172.21.15.107:0/3295878658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87741065b0 0x7f877419d620 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8764004c90 tx=0x7f8764004d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:39.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.229+0000 7f8770ff9700 1 -- 172.21.15.107:0/3295878658 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8764005310 con 0x7f87741065b0 2024-06-02T23:50:39.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.229+0000 7f8779ebc700 1 -- 172.21.15.107:0/3295878658 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f877419ddf0 con 0x7f87741065b0 2024-06-02T23:50:39.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.229+0000 7f8770ff9700 1 -- 172.21.15.107:0/3295878658 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87640054b0 con 0x7f87741065b0 2024-06-02T23:50:39.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.229+0000 7f8770ff9700 1 -- 172.21.15.107:0/3295878658 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f876400e790 con 0x7f87741065b0 2024-06-02T23:50:39.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.229+0000 7f8779ebc700 1 -- 172.21.15.107:0/3295878658 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87741977a0 con 0x7f87741065b0 2024-06-02T23:50:39.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.230+0000 7f8779ebc700 1 -- 172.21.15.107:0/3295878658 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8774101c20 con 0x7f87741065b0 2024-06-02T23:50:39.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.230+0000 7f8770ff9700 1 -- 172.21.15.107:0/3295878658 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f876400ea90 con 0x7f87741065b0 2024-06-02T23:50:39.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.230+0000 7f8770ff9700 1 --2- 172.21.15.107:0/3295878658 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f875c03d500 0x7f875c03f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:39.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.231+0000 7f8770ff9700 1 -- 172.21.15.107:0/3295878658 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f876401e070 con 0x7f87741065b0 2024-06-02T23:50:39.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.231+0000 7f8772ffd700 1 --2- 172.21.15.107:0/3295878658 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f875c03d500 0x7f875c03f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:39.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.231+0000 7f8772ffd700 1 --2- 172.21.15.107:0/3295878658 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f875c03d500 0x7f875c03f9c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8768006fd0 tx=0x7f8768006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:39.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.236+0000 7f8770ff9700 1 -- 172.21.15.107:0/3295878658 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8764015c90 con 0x7f87741065b0 2024-06-02T23:50:39.469 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 systemd[1]: Starting Ceph mon.c for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-02T23:50:39.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.532+0000 7f8779ebc700 1 -- 172.21.15.107:0/3295878658 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f8774063b20 con 0x7f87741065b0 2024-06-02T23:50:39.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.533+0000 7f8770ff9700 1 -- 172.21.15.107:0/3295878658 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f8774063b20 con 0x7f87741065b0 2024-06-02T23:50:39.534 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-06-02T23:50:39.534 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":1,"fsid":"890dd222-213a-11ef-bc9b-c7b262605968","modified":"2024-06-02T23:48:50.407497Z","created":"2024-06-02T23:48:50.407497Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-06-02T23:50:39.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.536+0000 7f8779ebc700 1 -- 172.21.15.107:0/3295878658 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f875c03d500 msgr2=0x7f875c03f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:39.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.536+0000 7f8779ebc700 1 --2- 172.21.15.107:0/3295878658 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f875c03d500 0x7f875c03f9c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8768006fd0 tx=0x7f8768006e40 comp rx=0 tx=0).stop 2024-06-02T23:50:39.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.536+0000 7f8779ebc700 1 -- 172.21.15.107:0/3295878658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87741065b0 msgr2=0x7f877419d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:39.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.536+0000 7f8779ebc700 1 --2- 172.21.15.107:0/3295878658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87741065b0 0x7f877419d620 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8764004c90 tx=0x7f8764004d70 comp rx=0 tx=0).stop 2024-06-02T23:50:39.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.536+0000 7f8779ebc700 1 -- 172.21.15.107:0/3295878658 shutdown_connections 2024-06-02T23:50:39.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.536+0000 7f8779ebc700 1 --2- 172.21.15.107:0/3295878658 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f875c03d500 0x7f875c03f9c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:39.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.536+0000 7f8779ebc700 1 --2- 172.21.15.107:0/3295878658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87741065b0 0x7f877419d620 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:39.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.536+0000 7f8779ebc700 1 -- 172.21.15.107:0/3295878658 >> 172.21.15.107:0/3295878658 conn(0x7f8774077510 msgr2=0x7f87740ff0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:50:39.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.536+0000 7f8779ebc700 1 -- 172.21.15.107:0/3295878658 shutdown_connections 2024-06-02T23:50:39.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:39.536+0000 7f8779ebc700 1 -- 172.21.15.107:0/3295878658 wait complete. 2024-06-02T23:50:39.537 INFO:teuthology.orchestra.run.smithi107.stderr:dumped monmap epoch 1 2024-06-02T23:50:39.739 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 podman[37015]: 2024-06-02 23:50:39.371481992 +0000 UTC m=+0.016921157 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:50:39.739 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 podman[37015]: 2024-06-02 23:50:39.468645165 +0000 UTC m=+0.114084322 container create 6b2ebe4e3d4935f7f7417031e4fd8e0294f17536947c967adb4b861a26ace5bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mon-c, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-06-02T23:50:40.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:39 smithi049 ceph-mon[32302]: from='client.? 172.21.15.107:0/3295878658' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:50:40.316 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 podman[37015]: 2024-06-02 23:50:39.965534333 +0000 UTC m=+0.610973503 container init 6b2ebe4e3d4935f7f7417031e4fd8e0294f17536947c967adb4b861a26ace5bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mon-c, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-06-02T23:50:40.317 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 podman[37015]: 2024-06-02 23:50:39.968997253 +0000 UTC m=+0.614436428 container start 6b2ebe4e3d4935f7f7417031e4fd8e0294f17536947c967adb4b861a26ace5bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mon-c, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-02T23:50:40.317 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: set uid:gid to 167:167 (ceph:ceph) 2024-06-02T23:50:40.317 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc), process ceph-mon, pid 2 2024-06-02T23:50:40.317 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: pidfile_write: ignore empty --pid-file 2024-06-02T23:50:40.317 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: load: jerasure load: lrc 2024-06-02T23:50:40.317 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: RocksDB version: 7.9.2 2024-06-02T23:50:40.317 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Git sha 0 2024-06-02T23:50:40.317 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Compile date 2024-05-30 15:42:47 2024-06-02T23:50:40.317 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: DB SUMMARY 2024-06-02T23:50:40.317 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: DB Session ID: 4HN6RWKQDBKGCNW36WB5 2024-06-02T23:50:40.317 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: CURRENT file: CURRENT 2024-06-02T23:50:40.317 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: IDENTITY file: IDENTITY 2024-06-02T23:50:40.317 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-06-02T23:50:40.317 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-06-02T23:50:40.318 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-06-02T23:50:40.318 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.error_if_exists: 0 2024-06-02T23:50:40.318 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.create_if_missing: 0 2024-06-02T23:50:40.318 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.paranoid_checks: 1 2024-06-02T23:50:40.318 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.flush_verify_memtable_count: 1 2024-06-02T23:50:40.318 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-06-02T23:50:40.318 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-06-02T23:50:40.318 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.env: 0x55ca938b9c60 2024-06-02T23:50:40.318 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.fs: PosixFileSystem 2024-06-02T23:50:40.318 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.info_log: 0x55ca952a7b20 2024-06-02T23:50:40.318 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.max_file_opening_threads: 16 2024-06-02T23:50:40.319 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.statistics: (nil) 2024-06-02T23:50:40.319 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.use_fsync: 0 2024-06-02T23:50:40.319 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.max_log_file_size: 0 2024-06-02T23:50:40.319 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-06-02T23:50:40.319 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.log_file_time_to_roll: 0 2024-06-02T23:50:40.320 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.keep_log_file_num: 1000 2024-06-02T23:50:40.320 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.recycle_log_file_num: 0 2024-06-02T23:50:40.320 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.allow_fallocate: 1 2024-06-02T23:50:40.320 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.allow_mmap_reads: 0 2024-06-02T23:50:40.320 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.allow_mmap_writes: 0 2024-06-02T23:50:40.320 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.use_direct_reads: 0 2024-06-02T23:50:40.320 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-06-02T23:50:40.320 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.create_missing_column_families: 0 2024-06-02T23:50:40.320 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.db_log_dir: 2024-06-02T23:50:40.320 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.wal_dir: 2024-06-02T23:50:40.320 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.table_cache_numshardbits: 6 2024-06-02T23:50:40.320 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.WAL_ttl_seconds: 0 2024-06-02T23:50:40.320 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.WAL_size_limit_MB: 0 2024-06-02T23:50:40.320 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-06-02T23:50:40.321 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-06-02T23:50:40.321 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.is_fd_close_on_exec: 1 2024-06-02T23:50:40.321 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.advise_random_on_open: 1 2024-06-02T23:50:40.321 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.db_write_buffer_size: 0 2024-06-02T23:50:40.321 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.write_buffer_manager: 0x55ca952781e0 2024-06-02T23:50:40.321 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-06-02T23:50:40.321 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-06-02T23:50:40.321 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.use_adaptive_mutex: 0 2024-06-02T23:50:40.321 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.rate_limiter: (nil) 2024-06-02T23:50:40.321 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-06-02T23:50:40.321 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.wal_recovery_mode: 2 2024-06-02T23:50:40.321 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.enable_thread_tracking: 0 2024-06-02T23:50:40.321 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.enable_pipelined_write: 0 2024-06-02T23:50:40.321 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.unordered_write: 0 2024-06-02T23:50:40.322 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-06-02T23:50:40.322 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-06-02T23:50:40.322 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-06-02T23:50:40.322 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-06-02T23:50:40.322 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.row_cache: None 2024-06-02T23:50:40.322 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.wal_filter: None 2024-06-02T23:50:40.322 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-06-02T23:50:40.322 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.allow_ingest_behind: 0 2024-06-02T23:50:40.322 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.two_write_queues: 0 2024-06-02T23:50:40.322 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.manual_wal_flush: 0 2024-06-02T23:50:40.323 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.wal_compression: 0 2024-06-02T23:50:40.323 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.atomic_flush: 0 2024-06-02T23:50:40.323 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-06-02T23:50:40.323 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.persist_stats_to_disk: 0 2024-06-02T23:50:40.323 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.write_dbid_to_manifest: 0 2024-06-02T23:50:40.323 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.log_readahead_size: 0 2024-06-02T23:50:40.323 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-06-02T23:50:40.323 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.best_efforts_recovery: 0 2024-06-02T23:50:40.323 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-06-02T23:50:40.323 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-06-02T23:50:40.323 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.allow_data_in_errors: 0 2024-06-02T23:50:40.324 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.db_host_id: __hostname__ 2024-06-02T23:50:40.324 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.enforce_single_del_contracts: true 2024-06-02T23:50:40.324 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.max_background_jobs: 2 2024-06-02T23:50:40.324 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.max_background_compactions: -1 2024-06-02T23:50:40.324 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.max_subcompactions: 1 2024-06-02T23:50:40.324 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-06-02T23:50:40.324 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-06-02T23:50:40.324 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.delayed_write_rate : 16777216 2024-06-02T23:50:40.324 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.max_total_wal_size: 0 2024-06-02T23:50:40.324 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-06-02T23:50:40.324 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.stats_dump_period_sec: 600 2024-06-02T23:50:40.324 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.stats_persist_period_sec: 600 2024-06-02T23:50:40.324 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-06-02T23:50:40.324 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.max_open_files: -1 2024-06-02T23:50:40.324 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.bytes_per_sync: 0 2024-06-02T23:50:40.324 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.wal_bytes_per_sync: 0 2024-06-02T23:50:40.325 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.strict_bytes_per_sync: 0 2024-06-02T23:50:40.325 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.compaction_readahead_size: 0 2024-06-02T23:50:40.325 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.max_background_flushes: -1 2024-06-02T23:50:40.325 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Compression algorithms supported: 2024-06-02T23:50:40.325 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-06-02T23:50:40.325 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: kZSTD supported: 0 2024-06-02T23:50:40.325 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: kXpressCompression supported: 0 2024-06-02T23:50:40.325 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: kLZ4HCCompression supported: 1 2024-06-02T23:50:40.325 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: kZlibCompression supported: 1 2024-06-02T23:50:40.325 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: kSnappyCompression supported: 1 2024-06-02T23:50:40.325 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: kLZ4Compression supported: 1 2024-06-02T23:50:40.325 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: kBZip2Compression supported: 0 2024-06-02T23:50:40.325 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Fast CRC32 supported: Supported on x86 2024-06-02T23:50:40.325 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: DMutex implementation: pthread_mutex_t 2024-06-02T23:50:40.325 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-06-02T23:50:40.326 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-06-02T23:50:40.326 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-06-02T23:50:40.326 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.merge_operator: 2024-06-02T23:50:40.326 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.compaction_filter: None 2024-06-02T23:50:40.326 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.compaction_filter_factory: None 2024-06-02T23:50:40.326 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.sst_partitioner_factory: None 2024-06-02T23:50:40.326 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.memtable_factory: SkipListFactory 2024-06-02T23:50:40.326 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.table_factory: BlockBasedTable 2024-06-02T23:50:40.326 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ca952a7c40) 2024-06-02T23:50:40.326 INFO:journalctl@ceph.mon.c.smithi107.stdout: cache_index_and_filter_blocks: 1 2024-06-02T23:50:40.326 INFO:journalctl@ceph.mon.c.smithi107.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-06-02T23:50:40.326 INFO:journalctl@ceph.mon.c.smithi107.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-06-02T23:50:40.326 INFO:journalctl@ceph.mon.c.smithi107.stdout: pin_top_level_index_and_filter: 1 2024-06-02T23:50:40.326 INFO:journalctl@ceph.mon.c.smithi107.stdout: index_type: 0 2024-06-02T23:50:40.327 INFO:journalctl@ceph.mon.c.smithi107.stdout: data_block_index_type: 0 2024-06-02T23:50:40.327 INFO:journalctl@ceph.mon.c.smithi107.stdout: index_shortening: 1 2024-06-02T23:50:40.327 INFO:journalctl@ceph.mon.c.smithi107.stdout: data_block_hash_table_util_ratio: 0.750000 2024-06-02T23:50:40.327 INFO:journalctl@ceph.mon.c.smithi107.stdout: checksum: 4 2024-06-02T23:50:40.327 INFO:journalctl@ceph.mon.c.smithi107.stdout: no_block_cache: 0 2024-06-02T23:50:40.327 INFO:journalctl@ceph.mon.c.smithi107.stdout: block_cache: 0x55ca952a9090 2024-06-02T23:50:40.327 INFO:journalctl@ceph.mon.c.smithi107.stdout: block_cache_name: BinnedLRUCache 2024-06-02T23:50:40.327 INFO:journalctl@ceph.mon.c.smithi107.stdout: block_cache_options: 2024-06-02T23:50:40.327 INFO:journalctl@ceph.mon.c.smithi107.stdout: capacity : 536870912 2024-06-02T23:50:40.327 INFO:journalctl@ceph.mon.c.smithi107.stdout: num_shard_bits : 4 2024-06-02T23:50:40.327 INFO:journalctl@ceph.mon.c.smithi107.stdout: strict_capacity_limit : 0 2024-06-02T23:50:40.327 INFO:journalctl@ceph.mon.c.smithi107.stdout: high_pri_pool_ratio: 0.000 2024-06-02T23:50:40.327 INFO:journalctl@ceph.mon.c.smithi107.stdout: block_cache_compressed: (nil) 2024-06-02T23:50:40.327 INFO:journalctl@ceph.mon.c.smithi107.stdout: persistent_cache: (nil) 2024-06-02T23:50:40.328 INFO:journalctl@ceph.mon.c.smithi107.stdout: block_size: 4096 2024-06-02T23:50:40.328 INFO:journalctl@ceph.mon.c.smithi107.stdout: block_size_deviation: 10 2024-06-02T23:50:40.328 INFO:journalctl@ceph.mon.c.smithi107.stdout: block_restart_interval: 16 2024-06-02T23:50:40.328 INFO:journalctl@ceph.mon.c.smithi107.stdout: index_block_restart_interval: 1 2024-06-02T23:50:40.328 INFO:journalctl@ceph.mon.c.smithi107.stdout: metadata_block_size: 4096 2024-06-02T23:50:40.328 INFO:journalctl@ceph.mon.c.smithi107.stdout: partition_filters: 0 2024-06-02T23:50:40.328 INFO:journalctl@ceph.mon.c.smithi107.stdout: use_delta_encoding: 1 2024-06-02T23:50:40.328 INFO:journalctl@ceph.mon.c.smithi107.stdout: filter_policy: bloomfilter 2024-06-02T23:50:40.328 INFO:journalctl@ceph.mon.c.smithi107.stdout: whole_key_filtering: 1 2024-06-02T23:50:40.328 INFO:journalctl@ceph.mon.c.smithi107.stdout: verify_compression: 0 2024-06-02T23:50:40.328 INFO:journalctl@ceph.mon.c.smithi107.stdout: read_amp_bytes_per_bit: 0 2024-06-02T23:50:40.328 INFO:journalctl@ceph.mon.c.smithi107.stdout: format_version: 5 2024-06-02T23:50:40.328 INFO:journalctl@ceph.mon.c.smithi107.stdout: enable_index_compression: 1 2024-06-02T23:50:40.328 INFO:journalctl@ceph.mon.c.smithi107.stdout: block_align: 0 2024-06-02T23:50:40.328 INFO:journalctl@ceph.mon.c.smithi107.stdout: max_auto_readahead_size: 262144 2024-06-02T23:50:40.329 INFO:journalctl@ceph.mon.c.smithi107.stdout: prepopulate_block_cache: 0 2024-06-02T23:50:40.329 INFO:journalctl@ceph.mon.c.smithi107.stdout: initial_auto_readahead_size: 8192 2024-06-02T23:50:40.329 INFO:journalctl@ceph.mon.c.smithi107.stdout: num_file_reads_for_auto_readahead: 2 2024-06-02T23:50:40.329 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.write_buffer_size: 33554432 2024-06-02T23:50:40.329 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.max_write_buffer_number: 2 2024-06-02T23:50:40.329 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.compression: NoCompression 2024-06-02T23:50:40.329 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.bottommost_compression: Disabled 2024-06-02T23:50:40.329 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.prefix_extractor: nullptr 2024-06-02T23:50:40.329 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-06-02T23:50:40.329 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.num_levels: 7 2024-06-02T23:50:40.329 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-06-02T23:50:40.329 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-06-02T23:50:40.329 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-06-02T23:50:40.329 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-06-02T23:50:40.329 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-06-02T23:50:40.330 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-06-02T23:50:40.330 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-06-02T23:50:40.330 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-06-02T23:50:40.330 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-06-02T23:50:40.330 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-06-02T23:50:40.330 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-06-02T23:50:40.330 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-06-02T23:50:40.330 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.compression_opts.window_bits: -14 2024-06-02T23:50:40.330 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.compression_opts.level: 32767 2024-06-02T23:50:40.330 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.compression_opts.strategy: 0 2024-06-02T23:50:40.330 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-06-02T23:50:40.330 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-06-02T23:50:40.330 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-06-02T23:50:40.330 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-06-02T23:50:40.330 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.compression_opts.enabled: false 2024-06-02T23:50:40.331 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-06-02T23:50:40.331 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-06-02T23:50:40.331 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-06-02T23:50:40.331 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-06-02T23:50:40.331 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.target_file_size_base: 67108864 2024-06-02T23:50:40.331 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.target_file_size_multiplier: 1 2024-06-02T23:50:40.331 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-06-02T23:50:40.331 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-06-02T23:50:40.331 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-06-02T23:50:40.331 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-06-02T23:50:40.331 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-06-02T23:50:40.332 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-06-02T23:50:40.332 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-06-02T23:50:40.332 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-06-02T23:50:40.332 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-06-02T23:50:40.332 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-06-02T23:50:40.333 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-06-02T23:50:40.333 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-06-02T23:50:40.333 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-06-02T23:50:40.333 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.arena_block_size: 1048576 2024-06-02T23:50:40.333 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-06-02T23:50:40.333 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-06-02T23:50:40.333 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.disable_auto_compactions: 0 2024-06-02T23:50:40.333 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-06-02T23:50:40.333 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-06-02T23:50:40.334 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-06-02T23:50:40.334 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-06-02T23:50:40.334 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-06-02T23:50:40.334 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-06-02T23:50:40.334 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-06-02T23:50:40.334 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-06-02T23:50:40.334 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-06-02T23:50:40.334 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-06-02T23:50:40.334 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.table_properties_collectors: 2024-06-02T23:50:40.334 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.inplace_update_support: 0 2024-06-02T23:50:40.334 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.inplace_update_num_locks: 10000 2024-06-02T23:50:40.334 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-06-02T23:50:40.334 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-06-02T23:50:40.334 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.memtable_huge_page_size: 0 2024-06-02T23:50:40.334 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.bloom_locality: 0 2024-06-02T23:50:40.335 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.max_successive_merges: 0 2024-06-02T23:50:40.335 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.optimize_filters_for_hits: 0 2024-06-02T23:50:40.335 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.paranoid_file_checks: 0 2024-06-02T23:50:40.335 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.force_consistency_checks: 1 2024-06-02T23:50:40.335 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.report_bg_io_stats: 0 2024-06-02T23:50:40.335 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.ttl: 2592000 2024-06-02T23:50:40.335 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.periodic_compaction_seconds: 0 2024-06-02T23:50:40.335 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-06-02T23:50:40.335 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-06-02T23:50:40.335 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.enable_blob_files: false 2024-06-02T23:50:40.335 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.min_blob_size: 0 2024-06-02T23:50:40.335 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.blob_file_size: 268435456 2024-06-02T23:50:40.335 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.blob_compression_type: NoCompression 2024-06-02T23:50:40.335 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.enable_blob_garbage_collection: false 2024-06-02T23:50:40.336 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-06-02T23:50:40.336 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-06-02T23:50:40.336 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-06-02T23:50:40.336 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.blob_file_starting_level: 0 2024-06-02T23:50:40.336 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-06-02T23:50:40.336 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-06-02T23:50:40.336 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-06-02T23:50:40.336 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 866af5aa-6a2c-4d8c-a28a-97e3368a567a 2024-06-02T23:50:40.336 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717372239998743, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-06-02T23:50:40.336 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-06-02T23:50:40.336 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717372239999162, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1717372239, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "866af5aa-6a2c-4d8c-a28a-97e3368a567a", "db_session_id": "4HN6RWKQDBKGCNW36WB5", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-06-02T23:50:40.336 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717372239999242, "job": 1, "event": "recovery_finished"} 2024-06-02T23:50:40.336 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:39 smithi107 ceph-mon[37048]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-06-02T23:50:40.336 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-06-02T23:50:40.336 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ca95398000 2024-06-02T23:50:40.337 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: rocksdb: DB pointer 0x55ca95382000 2024-06-02T23:50:40.337 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-06-02T23:50:40.337 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-06-02T23:50:40.337 INFO:journalctl@ceph.mon.c.smithi107.stdout: ** DB Stats ** 2024-06-02T23:50:40.337 INFO:journalctl@ceph.mon.c.smithi107.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-02T23:50:40.337 INFO:journalctl@ceph.mon.c.smithi107.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-06-02T23:50:40.337 INFO:journalctl@ceph.mon.c.smithi107.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-02T23:50:40.337 INFO:journalctl@ceph.mon.c.smithi107.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-02T23:50:40.337 INFO:journalctl@ceph.mon.c.smithi107.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-06-02T23:50:40.337 INFO:journalctl@ceph.mon.c.smithi107.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-02T23:50:40.337 INFO:journalctl@ceph.mon.c.smithi107.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-02T23:50:40.337 INFO:journalctl@ceph.mon.c.smithi107.stdout: 2024-06-02T23:50:40.337 INFO:journalctl@ceph.mon.c.smithi107.stdout: ** Compaction Stats [default] ** 2024-06-02T23:50:40.337 INFO:journalctl@ceph.mon.c.smithi107.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-02T23:50:40.338 INFO:journalctl@ceph.mon.c.smithi107.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-06-02T23:50:40.338 INFO:journalctl@ceph.mon.c.smithi107.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-06-02T23:50:40.338 INFO:journalctl@ceph.mon.c.smithi107.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-06-02T23:50:40.338 INFO:journalctl@ceph.mon.c.smithi107.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-06-02T23:50:40.338 INFO:journalctl@ceph.mon.c.smithi107.stdout: 2024-06-02T23:50:40.338 INFO:journalctl@ceph.mon.c.smithi107.stdout: ** Compaction Stats [default] ** 2024-06-02T23:50:40.338 INFO:journalctl@ceph.mon.c.smithi107.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-02T23:50:40.338 INFO:journalctl@ceph.mon.c.smithi107.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-02T23:50:40.338 INFO:journalctl@ceph.mon.c.smithi107.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-06-02T23:50:40.338 INFO:journalctl@ceph.mon.c.smithi107.stdout: 2024-06-02T23:50:40.338 INFO:journalctl@ceph.mon.c.smithi107.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-06-02T23:50:40.338 INFO:journalctl@ceph.mon.c.smithi107.stdout: 2024-06-02T23:50:40.338 INFO:journalctl@ceph.mon.c.smithi107.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-02T23:50:40.338 INFO:journalctl@ceph.mon.c.smithi107.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-06-02T23:50:40.339 INFO:journalctl@ceph.mon.c.smithi107.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-02T23:50:40.339 INFO:journalctl@ceph.mon.c.smithi107.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-02T23:50:40.339 INFO:journalctl@ceph.mon.c.smithi107.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-02T23:50:40.339 INFO:journalctl@ceph.mon.c.smithi107.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-02T23:50:40.339 INFO:journalctl@ceph.mon.c.smithi107.stdout: Cumulative compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-02T23:50:40.339 INFO:journalctl@ceph.mon.c.smithi107.stdout: Interval compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-02T23:50:40.339 INFO:journalctl@ceph.mon.c.smithi107.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-02T23:50:40.339 INFO:journalctl@ceph.mon.c.smithi107.stdout: Block cache BinnedLRUCache@0x55ca952a9090#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-06-02T23:50:40.339 INFO:journalctl@ceph.mon.c.smithi107.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-06-02T23:50:40.339 INFO:journalctl@ceph.mon.c.smithi107.stdout: 2024-06-02T23:50:40.339 INFO:journalctl@ceph.mon.c.smithi107.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-02T23:50:40.339 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-06-02T23:50:40.339 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: using public_addr v2:172.21.15.107:0/0 -> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-06-02T23:50:40.339 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: starting mon.c rank -1 at public addrs [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] at bind addrs [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 890dd222-213a-11ef-bc9b-c7b262605968 2024-06-02T23:50:40.339 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: mon.c@-1(???) e0 preinit fsid 890dd222-213a-11ef-bc9b-c7b262605968 2024-06-02T23:50:40.340 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: mon.c@-1(synchronizing).mds e1 new map 2024-06-02T23:50:40.340 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: mon.c@-1(synchronizing).mds e1 print_map 2024-06-02T23:50:40.340 INFO:journalctl@ceph.mon.c.smithi107.stdout: e1 2024-06-02T23:50:40.340 INFO:journalctl@ceph.mon.c.smithi107.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T23:50:40.340 INFO:journalctl@ceph.mon.c.smithi107.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-02T23:50:40.340 INFO:journalctl@ceph.mon.c.smithi107.stdout: legacy client fscid: -1 2024-06-02T23:50:40.340 INFO:journalctl@ceph.mon.c.smithi107.stdout: 2024-06-02T23:50:40.340 INFO:journalctl@ceph.mon.c.smithi107.stdout: No filesystems configured 2024-06-02T23:50:40.340 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-06-02T23:50:40.340 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-06-02T23:50:40.340 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-06-02T23:50:40.340 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-06-02T23:50:40.340 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-06-02T23:50:40.340 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-06-02T23:50:40.340 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-06-02T23:50:40.341 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T23:50:40.341 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T23:50:40.341 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T23:50:40.341 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi107", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:50:40.341 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:40.341 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:40.341 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:40.341 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:40.341 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:50:40.341 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:50:40.341 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:50:40.341 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: Updating smithi057:/etc/ceph/ceph.conf 2024-06-02T23:50:40.341 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: Deploying cephadm binary to smithi107 2024-06-02T23:50:40.341 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: Updating smithi057:/var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:50:40.341 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:40.342 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: Updating smithi057:/etc/ceph/ceph.client.admin.keyring 2024-06-02T23:50:40.342 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: Updating smithi057:/var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T23:50:40.342 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:40.342 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:40.342 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:40.342 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:40.342 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:40.342 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:50:40.342 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: Added host smithi107 2024-06-02T23:50:40.342 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:40.342 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:40.342 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:40.342 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:40.342 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T23:50:40.343 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:40.343 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:40.343 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/3864749164' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-06-02T23:50:40.343 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/3864749164' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-06-02T23:50:40.343 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T23:50:40.343 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:40.343 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:40.343 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:40.343 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:40.343 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi107", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:50:40.343 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:50:40.343 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:50:40.344 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: Updating smithi107:/etc/ceph/ceph.conf 2024-06-02T23:50:40.344 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: Updating smithi107:/var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:50:40.344 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: Updating smithi107:/etc/ceph/ceph.client.admin.keyring 2024-06-02T23:50:40.344 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: Updating smithi107:/var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T23:50:40.344 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:40.344 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:40.344 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:40.344 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:40.344 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi049:172.21.15.49=a;smithi057:172.21.15.57=b;smithi107:172.21.15.107=c", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:50:40.344 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: Saving service mon spec with placement smithi049:172.21.15.49=a;smithi057:172.21.15.57=b;smithi107:172.21.15.107=c;count:3 2024-06-02T23:50:40.344 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:40.344 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:50:40.344 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:50:40.344 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:50:40.345 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:40.345 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T23:50:40.345 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:50:40.345 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: Deploying daemon mon.c on smithi107 2024-06-02T23:50:40.345 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:40.345 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:40.345 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: from='client.? 172.21.15.107:0/3295878658' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:50:40.345 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 ceph-mon[37048]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-06-02T23:50:40.345 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 bash[37015]: 6b2ebe4e3d4935f7f7417031e4fd8e0294f17536947c967adb4b861a26ace5bf 2024-06-02T23:50:40.345 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:40 smithi107 systemd[1]: Started Ceph mon.c for 890dd222-213a-11ef-bc9b-c7b262605968. 2024-06-02T23:50:41.347 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-06-02T23:50:41.347 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-02T23:50:41.589 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T23:50:45.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:45 smithi107 ceph-mon[37048]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:45.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:45 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T23:50:45.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:45 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T23:50:45.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:45 smithi107 ceph-mon[37048]: mon.a calling monitor election 2024-06-02T23:50:45.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:45 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T23:50:45.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:45 smithi107 ceph-mon[37048]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:45.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:45 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T23:50:45.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:45 smithi107 ceph-mon[37048]: mon.c calling monitor election 2024-06-02T23:50:45.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:45 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T23:50:45.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:45 smithi107 ceph-mon[37048]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:45.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:45 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T23:50:45.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:45 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T23:50:45.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:45 smithi107 ceph-mon[37048]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-02T23:50:45.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:45 smithi107 ceph-mon[37048]: monmap epoch 2 2024-06-02T23:50:45.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:45 smithi107 ceph-mon[37048]: fsid 890dd222-213a-11ef-bc9b-c7b262605968 2024-06-02T23:50:45.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:45 smithi107 ceph-mon[37048]: last_changed 2024-06-02T23:50:40.021490+0000 2024-06-02T23:50:45.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:45 smithi107 ceph-mon[37048]: created 2024-06-02T23:48:50.407497+0000 2024-06-02T23:50:45.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:45 smithi107 ceph-mon[37048]: min_mon_release 19 (squid) 2024-06-02T23:50:45.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:45 smithi107 ceph-mon[37048]: election_strategy: 1 2024-06-02T23:50:45.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:45 smithi107 ceph-mon[37048]: 0: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.a 2024-06-02T23:50:45.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:45 smithi107 ceph-mon[37048]: 1: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.c 2024-06-02T23:50:45.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:45 smithi107 ceph-mon[37048]: fsmap 2024-06-02T23:50:45.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:45 smithi107 ceph-mon[37048]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T23:50:45.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:45 smithi107 ceph-mon[37048]: mgrmap e13: x(active, since 49s) 2024-06-02T23:50:45.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:45 smithi107 ceph-mon[37048]: overall HEALTH_OK 2024-06-02T23:50:45.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:45 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:45.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:45 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:45.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:45 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:45.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:45 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T23:50:45.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:45 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:50:45.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:45 smithi049 ceph-mon[32302]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:45.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:45 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T23:50:45.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:45 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T23:50:45.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:45 smithi049 ceph-mon[32302]: mon.a calling monitor election 2024-06-02T23:50:45.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:45 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T23:50:45.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:45 smithi049 ceph-mon[32302]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:45.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:45 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T23:50:45.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:45 smithi049 ceph-mon[32302]: mon.c calling monitor election 2024-06-02T23:50:45.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:45 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T23:50:45.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:45 smithi049 ceph-mon[32302]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:45.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:45 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T23:50:45.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:45 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T23:50:45.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:45 smithi049 ceph-mon[32302]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-02T23:50:45.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:45 smithi049 ceph-mon[32302]: monmap epoch 2 2024-06-02T23:50:45.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:45 smithi049 ceph-mon[32302]: fsid 890dd222-213a-11ef-bc9b-c7b262605968 2024-06-02T23:50:45.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:45 smithi049 ceph-mon[32302]: last_changed 2024-06-02T23:50:40.021490+0000 2024-06-02T23:50:45.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:45 smithi049 ceph-mon[32302]: created 2024-06-02T23:48:50.407497+0000 2024-06-02T23:50:45.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:45 smithi049 ceph-mon[32302]: min_mon_release 19 (squid) 2024-06-02T23:50:45.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:45 smithi049 ceph-mon[32302]: election_strategy: 1 2024-06-02T23:50:45.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:45 smithi049 ceph-mon[32302]: 0: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.a 2024-06-02T23:50:45.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:45 smithi049 ceph-mon[32302]: 1: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.c 2024-06-02T23:50:45.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:45 smithi049 ceph-mon[32302]: fsmap 2024-06-02T23:50:45.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:45 smithi049 ceph-mon[32302]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T23:50:45.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:45 smithi049 ceph-mon[32302]: mgrmap e13: x(active, since 49s) 2024-06-02T23:50:45.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:45 smithi049 ceph-mon[32302]: overall HEALTH_OK 2024-06-02T23:50:45.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:45 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:45.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:45 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:45.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:45 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:45.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:45 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T23:50:45.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:45 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:50:45.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.909+0000 7f75b274d700 1 -- 172.21.15.107:0/3073815637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75940035c0 msgr2=0x7f7594005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:45.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.909+0000 7f75b274d700 1 --2- 172.21.15.107:0/3073815637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75940035c0 0x7f7594005a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f75ac06a780 tx=0x7f759c00feb0 comp rx=0 tx=0).stop 2024-06-02T23:50:45.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.909+0000 7f75b274d700 1 -- 172.21.15.107:0/3073815637 shutdown_connections 2024-06-02T23:50:45.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.909+0000 7f75b274d700 1 --2- 172.21.15.107:0/3073815637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75940035c0 0x7f7594005a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:45.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.909+0000 7f75b274d700 1 -- 172.21.15.107:0/3073815637 >> 172.21.15.107:0/3073815637 conn(0x7f75ac0fc990 msgr2=0x7f75ac0fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:50:45.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.909+0000 7f75b274d700 1 -- 172.21.15.107:0/3073815637 shutdown_connections 2024-06-02T23:50:45.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.909+0000 7f75b274d700 1 -- 172.21.15.107:0/3073815637 wait complete. 2024-06-02T23:50:45.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.910+0000 7f75b274d700 1 Processor -- start 2024-06-02T23:50:45.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.910+0000 7f75b274d700 1 -- start start 2024-06-02T23:50:45.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.911+0000 7f75b274d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75940035c0 0x7f75ac19d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:45.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.911+0000 7f75b274d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75ac19dd50 0x7f75ac1979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:45.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.911+0000 7f75b274d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f75ac10a040 con 0x7f75ac19dd50 2024-06-02T23:50:45.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.911+0000 7f75b274d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f75ac109ec0 con 0x7f75940035c0 2024-06-02T23:50:45.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.911+0000 7f75abfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75940035c0 0x7f75ac19d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:45.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.911+0000 7f75abfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75940035c0 0x7f75ac19d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50514/0 (socket says 172.21.15.107:50514) 2024-06-02T23:50:45.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.911+0000 7f75abfff700 1 -- 172.21.15.107:0/2689305922 learned_addr learned my addr 172.21.15.107:0/2689305922 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-06-02T23:50:45.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.911+0000 7f75ab7fe700 1 --2- 172.21.15.107:0/2689305922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75ac19dd50 0x7f75ac1979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:45.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.911+0000 7f75abfff700 1 -- 172.21.15.107:0/2689305922 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75940035c0 msgr2=0x7f75ac19d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-06-02T23:50:45.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.911+0000 7f75abfff700 1 -- 172.21.15.107:0/2689305922 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75940035c0 msgr2=0x7f75ac19d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-06-02T23:50:45.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.911+0000 7f75abfff700 1 --2- 172.21.15.107:0/2689305922 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75940035c0 0x7f75ac19d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-02T23:50:45.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.911+0000 7f75abfff700 1 --2- 172.21.15.107:0/2689305922 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75940035c0 0x7f75ac19d810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T23:50:45.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.911+0000 7f75ab7fe700 1 -- 172.21.15.107:0/2689305922 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75940035c0 msgr2=0x7f75ac19d810 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T23:50:45.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.911+0000 7f75ab7fe700 1 --2- 172.21.15.107:0/2689305922 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75940035c0 0x7f75ac19d810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:45.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.911+0000 7f75ab7fe700 1 -- 172.21.15.107:0/2689305922 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ac19e390 con 0x7f75ac19dd50 2024-06-02T23:50:45.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.912+0000 7f75ab7fe700 1 --2- 172.21.15.107:0/2689305922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75ac19dd50 0x7f75ac1979d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f75a000b4d0 tx=0x7f75a000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:45.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.912+0000 7f75a97fa700 1 -- 172.21.15.107:0/2689305922 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f75a0011630 con 0x7f75ac19dd50 2024-06-02T23:50:45.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.912+0000 7f75b274d700 1 -- 172.21.15.107:0/2689305922 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75ac197f10 con 0x7f75ac19dd50 2024-06-02T23:50:45.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.912+0000 7f75b274d700 1 -- 172.21.15.107:0/2689305922 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75ac1984a0 con 0x7f75ac19dd50 2024-06-02T23:50:45.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.912+0000 7f75a97fa700 1 -- 172.21.15.107:0/2689305922 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75a0011cb0 con 0x7f75ac19dd50 2024-06-02T23:50:45.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.912+0000 7f75a97fa700 1 -- 172.21.15.107:0/2689305922 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f75a00193b0 con 0x7f75ac19dd50 2024-06-02T23:50:45.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.913+0000 7f75a97fa700 1 -- 172.21.15.107:0/2689305922 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f75a0018020 con 0x7f75ac19dd50 2024-06-02T23:50:45.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.913+0000 7f75b274d700 1 -- 172.21.15.107:0/2689305922 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75ac06af80 con 0x7f75ac19dd50 2024-06-02T23:50:45.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.913+0000 7f75a97fa700 1 --2- 172.21.15.107:0/2689305922 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7598038e90 0x7f759803b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:45.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.913+0000 7f75a97fa700 1 -- 172.21.15.107:0/2689305922 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f75a001a590 con 0x7f75ac19dd50 2024-06-02T23:50:45.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.914+0000 7f75abfff700 1 --2- 172.21.15.107:0/2689305922 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7598038e90 0x7f759803b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:45.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.914+0000 7f75abfff700 1 --2- 172.21.15.107:0/2689305922 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7598038e90 0x7f759803b350 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f759c00fa60 tx=0x7f759c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:45.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:45.919+0000 7f75a97fa700 1 -- 172.21.15.107:0/2689305922 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f75a001f020 con 0x7f75ac19dd50 2024-06-02T23:50:46.204 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:46.204+0000 7f75b274d700 1 -- 172.21.15.107:0/2689305922 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f75ac198f00 con 0x7f75ac19dd50 2024-06-02T23:50:46.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:46 smithi107 ceph-mon[37048]: Deploying daemon mon.b on smithi057 2024-06-02T23:50:46.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:46 smithi107 ceph-mon[37048]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:46.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:46 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T23:50:46.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:46.204+0000 7f75a97fa700 1 -- 172.21.15.107:0/2689305922 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f75a0018570 con 0x7f75ac19dd50 2024-06-02T23:50:46.205 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-06-02T23:50:46.205 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":2,"fsid":"890dd222-213a-11ef-bc9b-c7b262605968","modified":"2024-06-02T23:50:40.021490Z","created":"2024-06-02T23:48:50.407497Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:3300","nonce":0},{"type":"v1","addr":"172.21.15.107:6789","nonce":0}]},"addr":"172.21.15.107:6789/0","public_addr":"172.21.15.107:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-06-02T23:50:46.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:46.206+0000 7f75b274d700 1 -- 172.21.15.107:0/2689305922 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7598038e90 msgr2=0x7f759803b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:46.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:46.206+0000 7f75b274d700 1 --2- 172.21.15.107:0/2689305922 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7598038e90 0x7f759803b350 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f759c00fa60 tx=0x7f759c005960 comp rx=0 tx=0).stop 2024-06-02T23:50:46.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:46.206+0000 7f75b274d700 1 -- 172.21.15.107:0/2689305922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75ac19dd50 msgr2=0x7f75ac1979d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:46.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:46.206+0000 7f75b274d700 1 --2- 172.21.15.107:0/2689305922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75ac19dd50 0x7f75ac1979d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f75a000b4d0 tx=0x7f75a000b890 comp rx=0 tx=0).stop 2024-06-02T23:50:46.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:46.206+0000 7f75b274d700 1 -- 172.21.15.107:0/2689305922 shutdown_connections 2024-06-02T23:50:46.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:46.206+0000 7f75b274d700 1 --2- 172.21.15.107:0/2689305922 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7598038e90 0x7f759803b350 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:46.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:46.206+0000 7f75b274d700 1 --2- 172.21.15.107:0/2689305922 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75940035c0 0x7f75ac19d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:46.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:46.206+0000 7f75b274d700 1 --2- 172.21.15.107:0/2689305922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75ac19dd50 0x7f75ac1979d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:46.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:46.206+0000 7f75b274d700 1 -- 172.21.15.107:0/2689305922 >> 172.21.15.107:0/2689305922 conn(0x7f75ac0fc990 msgr2=0x7f75ac0fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:50:46.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:46.207+0000 7f75b274d700 1 -- 172.21.15.107:0/2689305922 shutdown_connections 2024-06-02T23:50:46.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:46.207+0000 7f75b274d700 1 -- 172.21.15.107:0/2689305922 wait complete. 2024-06-02T23:50:46.208 INFO:teuthology.orchestra.run.smithi107.stderr:dumped monmap epoch 2 2024-06-02T23:50:46.364 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:46 smithi049 ceph-mon[32302]: Deploying daemon mon.b on smithi057 2024-06-02T23:50:46.364 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:46 smithi049 ceph-mon[32302]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:46.364 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:46 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T23:50:47.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:47 smithi049 ceph-mon[32302]: from='client.? 172.21.15.107:0/2689305922' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:50:47.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:47 smithi107 ceph-mon[37048]: from='client.? 172.21.15.107:0/2689305922' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:50:47.788 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-06-02T23:50:47.788 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-02T23:50:48.031 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T23:50:48.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:48 smithi107 ceph-mon[37048]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:48.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:48 smithi049 ceph-mon[32302]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:49.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:49 smithi057 ceph-mon[36457]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-06-02T23:50:54.701 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:54 smithi057 ceph-mon[36457]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:54.701 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:54 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T23:50:54.701 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:54 smithi057 ceph-mon[36457]: mon.a calling monitor election 2024-06-02T23:50:54.701 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:54 smithi057 ceph-mon[36457]: mon.c calling monitor election 2024-06-02T23:50:54.701 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:54 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T23:50:54.701 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:54 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T23:50:54.701 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:54 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T23:50:54.701 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:54 smithi057 ceph-mon[36457]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:54.701 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:54 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T23:50:54.702 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:54 smithi057 ceph-mon[36457]: mon.b calling monitor election 2024-06-02T23:50:54.702 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:54 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T23:50:54.702 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:54 smithi057 ceph-mon[36457]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:54.702 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:54 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T23:50:54.702 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:54 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T23:50:54.702 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:54 smithi057 ceph-mon[36457]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-02T23:50:54.702 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:54 smithi057 ceph-mon[36457]: monmap epoch 3 2024-06-02T23:50:54.702 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:54 smithi057 ceph-mon[36457]: fsid 890dd222-213a-11ef-bc9b-c7b262605968 2024-06-02T23:50:54.702 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:54 smithi057 ceph-mon[36457]: last_changed 2024-06-02T23:50:49.291380+0000 2024-06-02T23:50:54.702 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:54 smithi057 ceph-mon[36457]: created 2024-06-02T23:48:50.407497+0000 2024-06-02T23:50:54.702 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:54 smithi057 ceph-mon[36457]: min_mon_release 19 (squid) 2024-06-02T23:50:54.702 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:54 smithi057 ceph-mon[36457]: election_strategy: 1 2024-06-02T23:50:54.702 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:54 smithi057 ceph-mon[36457]: 0: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.a 2024-06-02T23:50:54.703 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:54 smithi057 ceph-mon[36457]: 1: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.c 2024-06-02T23:50:54.703 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:54 smithi057 ceph-mon[36457]: 2: [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] mon.b 2024-06-02T23:50:54.703 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:54 smithi057 ceph-mon[36457]: fsmap 2024-06-02T23:50:54.703 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:54 smithi057 ceph-mon[36457]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T23:50:54.703 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:54 smithi057 ceph-mon[36457]: mgrmap e13: x(active, since 59s) 2024-06-02T23:50:54.703 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:54 smithi057 ceph-mon[36457]: overall HEALTH_OK 2024-06-02T23:50:54.703 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:54 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:54.703 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:54 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:54.703 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:54 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:54.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:54 smithi049 ceph-mon[32302]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:54.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:54 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T23:50:54.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:54 smithi049 ceph-mon[32302]: mon.a calling monitor election 2024-06-02T23:50:54.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:54 smithi049 ceph-mon[32302]: mon.c calling monitor election 2024-06-02T23:50:54.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:54 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T23:50:54.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:54 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T23:50:54.712 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:54 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T23:50:54.712 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:54 smithi049 ceph-mon[32302]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:54.712 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:54 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T23:50:54.712 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:54 smithi049 ceph-mon[32302]: mon.b calling monitor election 2024-06-02T23:50:54.712 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:54 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T23:50:54.712 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:54 smithi049 ceph-mon[32302]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:54.712 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:54 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T23:50:54.712 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:54 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T23:50:54.712 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:54 smithi049 ceph-mon[32302]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-02T23:50:54.712 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:54 smithi049 ceph-mon[32302]: monmap epoch 3 2024-06-02T23:50:54.712 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:54 smithi049 ceph-mon[32302]: fsid 890dd222-213a-11ef-bc9b-c7b262605968 2024-06-02T23:50:54.712 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:54 smithi049 ceph-mon[32302]: last_changed 2024-06-02T23:50:49.291380+0000 2024-06-02T23:50:54.712 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:54 smithi049 ceph-mon[32302]: created 2024-06-02T23:48:50.407497+0000 2024-06-02T23:50:54.712 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:54 smithi049 ceph-mon[32302]: min_mon_release 19 (squid) 2024-06-02T23:50:54.713 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:54 smithi049 ceph-mon[32302]: election_strategy: 1 2024-06-02T23:50:54.713 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:54 smithi049 ceph-mon[32302]: 0: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.a 2024-06-02T23:50:54.713 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:54 smithi049 ceph-mon[32302]: 1: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.c 2024-06-02T23:50:54.713 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:54 smithi049 ceph-mon[32302]: 2: [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] mon.b 2024-06-02T23:50:54.713 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:54 smithi049 ceph-mon[32302]: fsmap 2024-06-02T23:50:54.713 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:54 smithi049 ceph-mon[32302]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T23:50:54.713 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:54 smithi049 ceph-mon[32302]: mgrmap e13: x(active, since 59s) 2024-06-02T23:50:54.713 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:54 smithi049 ceph-mon[32302]: overall HEALTH_OK 2024-06-02T23:50:54.713 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:54 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:54.714 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:54 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:54.714 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:54 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:54.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:54 smithi107 ceph-mon[37048]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:54.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:54 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T23:50:54.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:54 smithi107 ceph-mon[37048]: mon.a calling monitor election 2024-06-02T23:50:54.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:54 smithi107 ceph-mon[37048]: mon.c calling monitor election 2024-06-02T23:50:54.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:54 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T23:50:54.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:54 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T23:50:54.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:54 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T23:50:54.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:54 smithi107 ceph-mon[37048]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:54.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:54 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T23:50:54.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:54 smithi107 ceph-mon[37048]: mon.b calling monitor election 2024-06-02T23:50:54.852 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:54 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T23:50:54.852 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:54 smithi107 ceph-mon[37048]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:54.852 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:54 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T23:50:54.852 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:54 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T23:50:54.852 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:54 smithi107 ceph-mon[37048]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-02T23:50:54.852 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:54 smithi107 ceph-mon[37048]: monmap epoch 3 2024-06-02T23:50:54.852 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:54 smithi107 ceph-mon[37048]: fsid 890dd222-213a-11ef-bc9b-c7b262605968 2024-06-02T23:50:54.852 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:54 smithi107 ceph-mon[37048]: last_changed 2024-06-02T23:50:49.291380+0000 2024-06-02T23:50:54.852 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:54 smithi107 ceph-mon[37048]: created 2024-06-02T23:48:50.407497+0000 2024-06-02T23:50:54.852 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:54 smithi107 ceph-mon[37048]: min_mon_release 19 (squid) 2024-06-02T23:50:54.852 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:54 smithi107 ceph-mon[37048]: election_strategy: 1 2024-06-02T23:50:54.852 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:54 smithi107 ceph-mon[37048]: 0: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.a 2024-06-02T23:50:54.852 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:54 smithi107 ceph-mon[37048]: 1: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.c 2024-06-02T23:50:54.852 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:54 smithi107 ceph-mon[37048]: 2: [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] mon.b 2024-06-02T23:50:54.853 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:54 smithi107 ceph-mon[37048]: fsmap 2024-06-02T23:50:54.853 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:54 smithi107 ceph-mon[37048]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T23:50:54.853 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:54 smithi107 ceph-mon[37048]: mgrmap e13: x(active, since 59s) 2024-06-02T23:50:54.853 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:54 smithi107 ceph-mon[37048]: overall HEALTH_OK 2024-06-02T23:50:54.853 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:54 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:54.853 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:54 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:54.853 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:54 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:55.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.564+0000 7fc693e0b700 1 -- 172.21.15.107:0/98515678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6780062a0 msgr2=0x7fc678008710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:55.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.564+0000 7fc693e0b700 1 --2- 172.21.15.107:0/98515678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6780062a0 0x7fc678008710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc68c1016f0 tx=0x7fc67c00fe90 comp rx=0 tx=0).stop 2024-06-02T23:50:55.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.564+0000 7fc693e0b700 1 -- 172.21.15.107:0/98515678 shutdown_connections 2024-06-02T23:50:55.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.564+0000 7fc693e0b700 1 --2- 172.21.15.107:0/98515678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6780062a0 0x7fc678008710 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:55.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.564+0000 7fc693e0b700 1 -- 172.21.15.107:0/98515678 >> 172.21.15.107:0/98515678 conn(0x7fc68c077540 msgr2=0x7fc68c077950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:50:55.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.565+0000 7fc693e0b700 1 -- 172.21.15.107:0/98515678 shutdown_connections 2024-06-02T23:50:55.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.565+0000 7fc693e0b700 1 -- 172.21.15.107:0/98515678 wait complete. 2024-06-02T23:50:55.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.565+0000 7fc693e0b700 1 Processor -- start 2024-06-02T23:50:55.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.565+0000 7fc693e0b700 1 -- start start 2024-06-02T23:50:55.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.566+0000 7fc693e0b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6780062a0 0x7fc68c19d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:55.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.566+0000 7fc693e0b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc68c19de30 0x7fc68c197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:55.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.566+0000 7fc693e0b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc68c197ff0 0x7fc68c1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:55.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.566+0000 7fc693e0b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc68c107df0 con 0x7fc6780062a0 2024-06-02T23:50:55.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.566+0000 7fc693e0b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc68c107c70 con 0x7fc68c197ff0 2024-06-02T23:50:55.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.566+0000 7fc693e0b700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc68c107f70 con 0x7fc68c19de30 2024-06-02T23:50:55.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.566+0000 7fc6913a6700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc68c19de30 0x7fc68c197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:55.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.566+0000 7fc6913a6700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc68c19de30 0x7fc68c197ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47212/0 (socket says 172.21.15.107:47212) 2024-06-02T23:50:55.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.566+0000 7fc6913a6700 1 -- 172.21.15.107:0/3851690088 learned_addr learned my addr 172.21.15.107:0/3851690088 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-06-02T23:50:55.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.566+0000 7fc691ba7700 1 --2- 172.21.15.107:0/3851690088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6780062a0 0x7fc68c19d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:55.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.566+0000 7fc6923a8700 1 --2- 172.21.15.107:0/3851690088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc68c197ff0 0x7fc68c1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:55.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.566+0000 7fc6913a6700 1 -- 172.21.15.107:0/3851690088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc68c197ff0 msgr2=0x7fc68c1984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:55.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.566+0000 7fc6913a6700 1 --2- 172.21.15.107:0/3851690088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc68c197ff0 0x7fc68c1984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:55.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.566+0000 7fc6913a6700 1 -- 172.21.15.107:0/3851690088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6780062a0 msgr2=0x7fc68c19d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:55.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.566+0000 7fc6913a6700 1 --2- 172.21.15.107:0/3851690088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6780062a0 0x7fc68c19d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:55.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.566+0000 7fc6913a6700 1 -- 172.21.15.107:0/3851690088 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc68c1a47c0 con 0x7fc68c19de30 2024-06-02T23:50:55.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.566+0000 7fc6913a6700 1 --2- 172.21.15.107:0/3851690088 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc68c19de30 0x7fc68c197ab0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc68800b780 tx=0x7fc68800ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:55.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.566+0000 7fc682ffd700 1 -- 172.21.15.107:0/3851690088 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc688004230 con 0x7fc68c19de30 2024-06-02T23:50:55.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.566+0000 7fc682ffd700 1 -- 172.21.15.107:0/3851690088 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6880043d0 con 0x7fc68c19de30 2024-06-02T23:50:55.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.566+0000 7fc682ffd700 1 -- 172.21.15.107:0/3851690088 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc688011c90 con 0x7fc68c19de30 2024-06-02T23:50:55.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.566+0000 7fc693e0b700 1 -- 172.21.15.107:0/3851690088 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc68c1a49f0 con 0x7fc68c19de30 2024-06-02T23:50:55.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.567+0000 7fc693e0b700 1 -- 172.21.15.107:0/3851690088 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc68c1a4f30 con 0x7fc68c19de30 2024-06-02T23:50:55.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.567+0000 7fc682ffd700 1 -- 172.21.15.107:0/3851690088 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fc68801a400 con 0x7fc68c19de30 2024-06-02T23:50:55.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.567+0000 7fc693e0b700 1 -- 172.21.15.107:0/3851690088 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc68c063af0 con 0x7fc68c19de30 2024-06-02T23:50:55.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.567+0000 7fc682ffd700 1 --2- 172.21.15.107:0/3851690088 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc670039580 0x7fc67003ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:55.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.568+0000 7fc682ffd700 1 -- 172.21.15.107:0/3851690088 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc68804bfc0 con 0x7fc68c19de30 2024-06-02T23:50:55.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.568+0000 7fc691ba7700 1 --2- 172.21.15.107:0/3851690088 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc670039580 0x7fc67003ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:55.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.568+0000 7fc691ba7700 1 --2- 172.21.15.107:0/3851690088 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc670039580 0x7fc67003ba40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc67c00fa40 tx=0x7fc67c005ad0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:55.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.573+0000 7fc682ffd700 1 -- 172.21.15.107:0/3851690088 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc688020500 con 0x7fc68c19de30 2024-06-02T23:50:55.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:55 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:55.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:55 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:50:55.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:55 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:55.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:55 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T23:50:55.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:55 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:55.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:55 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:50:55.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:55 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:55.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:55 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T23:50:55.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:55 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:55.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:55 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:50:55.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:55 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:55.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:55 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T23:50:55.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.854+0000 7fc693e0b700 1 -- 172.21.15.107:0/3851690088 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fc68c1a5220 con 0x7fc68c19de30 2024-06-02T23:50:55.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.855+0000 7fc682ffd700 1 -- 172.21.15.107:0/3851690088 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1281 (secure 0 0 0) 0x7fc6880202a0 con 0x7fc68c19de30 2024-06-02T23:50:55.855 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-06-02T23:50:55.855 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":3,"fsid":"890dd222-213a-11ef-bc9b-c7b262605968","modified":"2024-06-02T23:50:49.291380Z","created":"2024-06-02T23:48:50.407497Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:3300","nonce":0},{"type":"v1","addr":"172.21.15.107:6789","nonce":0}]},"addr":"172.21.15.107:6789/0","public_addr":"172.21.15.107:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:3300","nonce":0},{"type":"v1","addr":"172.21.15.57:6789","nonce":0}]},"addr":"172.21.15.57:6789/0","public_addr":"172.21.15.57:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-06-02T23:50:55.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.857+0000 7fc693e0b700 1 -- 172.21.15.107:0/3851690088 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc670039580 msgr2=0x7fc67003ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:55.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.857+0000 7fc693e0b700 1 --2- 172.21.15.107:0/3851690088 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc670039580 0x7fc67003ba40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc67c00fa40 tx=0x7fc67c005ad0 comp rx=0 tx=0).stop 2024-06-02T23:50:55.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.857+0000 7fc693e0b700 1 -- 172.21.15.107:0/3851690088 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc68c19de30 msgr2=0x7fc68c197ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:55.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.857+0000 7fc693e0b700 1 --2- 172.21.15.107:0/3851690088 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc68c19de30 0x7fc68c197ab0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc68800b780 tx=0x7fc68800ba90 comp rx=0 tx=0).stop 2024-06-02T23:50:55.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.857+0000 7fc693e0b700 1 -- 172.21.15.107:0/3851690088 shutdown_connections 2024-06-02T23:50:55.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.857+0000 7fc693e0b700 1 --2- 172.21.15.107:0/3851690088 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc670039580 0x7fc67003ba40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:55.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.857+0000 7fc693e0b700 1 --2- 172.21.15.107:0/3851690088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc68c197ff0 0x7fc68c1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:55.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.857+0000 7fc693e0b700 1 --2- 172.21.15.107:0/3851690088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6780062a0 0x7fc68c19d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:55.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.857+0000 7fc693e0b700 1 --2- 172.21.15.107:0/3851690088 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc68c19de30 0x7fc68c197ab0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:55.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.857+0000 7fc693e0b700 1 -- 172.21.15.107:0/3851690088 >> 172.21.15.107:0/3851690088 conn(0x7fc68c077540 msgr2=0x7fc68c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:50:55.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.857+0000 7fc693e0b700 1 -- 172.21.15.107:0/3851690088 shutdown_connections 2024-06-02T23:50:55.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:50:55.857+0000 7fc693e0b700 1 -- 172.21.15.107:0/3851690088 wait complete. 2024-06-02T23:50:55.858 INFO:teuthology.orchestra.run.smithi107.stderr:dumped monmap epoch 3 2024-06-02T23:50:56.563 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-06-02T23:50:56.563 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph config generate-minimal-conf 2024-06-02T23:50:56.816 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:50:56.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:56 smithi107 ceph-mon[37048]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:56.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:56.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:56.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:56.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:56.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:50:56.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:50:56.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:56 smithi107 ceph-mon[37048]: Updating smithi049:/etc/ceph/ceph.conf 2024-06-02T23:50:56.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:56 smithi107 ceph-mon[37048]: Updating smithi057:/etc/ceph/ceph.conf 2024-06-02T23:50:56.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:56 smithi107 ceph-mon[37048]: Updating smithi107:/etc/ceph/ceph.conf 2024-06-02T23:50:56.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:56 smithi107 ceph-mon[37048]: from='client.? 172.21.15.107:0/3851690088' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:50:56.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:56.852 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:56.852 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:56.852 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:56.852 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:56.852 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:56.852 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:56.852 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:56.852 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:56.852 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:56.852 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:56.852 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T23:50:56.852 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T23:50:56.852 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:50:56.940 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:56 smithi049 ceph-mon[32302]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:56.940 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:56.940 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:56.940 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:56.940 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:56.940 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:50:56.940 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:50:56.941 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:56 smithi049 ceph-mon[32302]: Updating smithi049:/etc/ceph/ceph.conf 2024-06-02T23:50:56.941 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:56 smithi049 ceph-mon[32302]: Updating smithi057:/etc/ceph/ceph.conf 2024-06-02T23:50:56.941 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:56 smithi049 ceph-mon[32302]: Updating smithi107:/etc/ceph/ceph.conf 2024-06-02T23:50:56.941 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:56 smithi049 ceph-mon[32302]: from='client.? 172.21.15.107:0/3851690088' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:50:56.941 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:56.941 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:56.941 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:56.941 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:56.941 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:56.941 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:56.941 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:56.941 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:56.941 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:56.941 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:56.941 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:56.942 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T23:50:56.942 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T23:50:56.942 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:50:57.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:56 smithi057 ceph-mon[36457]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:57.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:57.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:57.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:57.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:57.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:50:57.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:50:57.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:56 smithi057 ceph-mon[36457]: Updating smithi049:/etc/ceph/ceph.conf 2024-06-02T23:50:57.202 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:56 smithi057 ceph-mon[36457]: Updating smithi057:/etc/ceph/ceph.conf 2024-06-02T23:50:57.202 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:56 smithi057 ceph-mon[36457]: Updating smithi107:/etc/ceph/ceph.conf 2024-06-02T23:50:57.202 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:56 smithi057 ceph-mon[36457]: from='client.? 172.21.15.107:0/3851690088' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T23:50:57.202 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:57.202 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:57.202 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:57.202 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:57.202 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:57.203 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:57.203 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:57.203 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:57.203 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:57.203 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:57.203 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:50:57.203 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T23:50:57.203 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T23:50:57.203 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:50:57.989 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:57 smithi049 ceph-mon[32302]: Updating smithi049:/var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:50:57.989 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:57 smithi049 ceph-mon[32302]: Updating smithi057:/var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:50:57.989 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:57 smithi049 ceph-mon[32302]: Updating smithi107:/var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:50:57.990 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:57 smithi049 ceph-mon[32302]: Reconfiguring mon.a (unknown last config time)... 2024-06-02T23:50:57.990 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:57 smithi049 ceph-mon[32302]: Reconfiguring daemon mon.a on smithi049 2024-06-02T23:50:58.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:57 smithi107 ceph-mon[37048]: Updating smithi049:/var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:50:58.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:57 smithi107 ceph-mon[37048]: Updating smithi057:/var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:50:58.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:57 smithi107 ceph-mon[37048]: Updating smithi107:/var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:50:58.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:57 smithi107 ceph-mon[37048]: Reconfiguring mon.a (unknown last config time)... 2024-06-02T23:50:58.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:57 smithi107 ceph-mon[37048]: Reconfiguring daemon mon.a on smithi049 2024-06-02T23:50:58.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:57 smithi057 ceph-mon[36457]: Updating smithi049:/var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:50:58.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:57 smithi057 ceph-mon[36457]: Updating smithi057:/var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:50:58.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:57 smithi057 ceph-mon[36457]: Updating smithi107:/var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T23:50:58.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:57 smithi057 ceph-mon[36457]: Reconfiguring mon.a (unknown last config time)... 2024-06-02T23:50:58.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:57 smithi057 ceph-mon[36457]: Reconfiguring daemon mon.a on smithi049 2024-06-02T23:50:59.051 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:58 smithi049 ceph-mon[32302]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:59.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:58 smithi107 ceph-mon[37048]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:59.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:58 smithi057 ceph-mon[36457]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:50:59.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.366+0000 7f65923e9700 1 -- 172.21.15.49:0/1341859993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f658c107840 msgr2=0x7f658c10f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:59.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.366+0000 7f65923e9700 1 --2- 172.21.15.49:0/1341859993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f658c107840 0x7f658c10f3c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f658400b0d0 tx=0x7f658400b3e0 comp rx=0 tx=0).stop 2024-06-02T23:50:59.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.367+0000 7f65923e9700 1 -- 172.21.15.49:0/1341859993 shutdown_connections 2024-06-02T23:50:59.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.367+0000 7f65923e9700 1 --2- 172.21.15.49:0/1341859993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f658c107840 0x7f658c10f3c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:59.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.367+0000 7f65923e9700 1 --2- 172.21.15.49:0/1341859993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f658c102740 0x7f658c102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:59.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.367+0000 7f65923e9700 1 --2- 172.21.15.49:0/1341859993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f658c1030f0 0x7f658c107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:59.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.367+0000 7f65923e9700 1 -- 172.21.15.49:0/1341859993 >> 172.21.15.49:0/1341859993 conn(0x7f658c0795f0 msgr2=0x7f658c079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:50:59.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.367+0000 7f65923e9700 1 -- 172.21.15.49:0/1341859993 shutdown_connections 2024-06-02T23:50:59.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.367+0000 7f65923e9700 1 -- 172.21.15.49:0/1341859993 wait complete. 2024-06-02T23:50:59.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.367+0000 7f65923e9700 1 Processor -- start 2024-06-02T23:50:59.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.367+0000 7f65923e9700 1 -- start start 2024-06-02T23:50:59.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.368+0000 7f65923e9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f658c102740 0x7f658c19e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:59.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.368+0000 7f65923e9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f658c1030f0 0x7f658c19ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:59.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.368+0000 7f65923e9700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f658c107840 0x7f658c1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:59.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.368+0000 7f65923e9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f658c1127b0 con 0x7f658c102740 2024-06-02T23:50:59.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.368+0000 7f65923e9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f658c112630 con 0x7f658c1030f0 2024-06-02T23:50:59.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.368+0000 7f65923e9700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f658c112930 con 0x7f658c107840 2024-06-02T23:50:59.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.368+0000 7f658bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f658c102740 0x7f658c19e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:59.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.368+0000 7f658bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f658c102740 0x7f658c19e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40008/0 (socket says 172.21.15.49:40008) 2024-06-02T23:50:59.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.368+0000 7f658b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f658c1030f0 0x7f658c19ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:59.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.368+0000 7f658bfff700 1 -- 172.21.15.49:0/2329105077 learned_addr learned my addr 172.21.15.49:0/2329105077 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:50:59.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.368+0000 7f6590986700 1 --2- 172.21.15.49:0/2329105077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f658c107840 0x7f658c1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:59.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.368+0000 7f658bfff700 1 -- 172.21.15.49:0/2329105077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f658c107840 msgr2=0x7f658c1989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:59.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.368+0000 7f658bfff700 1 --2- 172.21.15.49:0/2329105077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f658c107840 0x7f658c1989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:59.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.368+0000 7f658bfff700 1 -- 172.21.15.49:0/2329105077 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f658c1030f0 msgr2=0x7f658c19ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:59.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.368+0000 7f658bfff700 1 --2- 172.21.15.49:0/2329105077 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f658c1030f0 0x7f658c19ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:59.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.368+0000 7f658bfff700 1 -- 172.21.15.49:0/2329105077 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f658c199110 con 0x7f658c102740 2024-06-02T23:50:59.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.368+0000 7f658b7fe700 1 --2- 172.21.15.49:0/2329105077 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f658c1030f0 0x7f658c19ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:50:59.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.368+0000 7f6590986700 1 --2- 172.21.15.49:0/2329105077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f658c107840 0x7f658c1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:50:59.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.368+0000 7f658bfff700 1 --2- 172.21.15.49:0/2329105077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f658c102740 0x7f658c19e7f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f657c00e9a0 tx=0x7f657c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:59.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.369+0000 7f65897fa700 1 -- 172.21.15.49:0/2329105077 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657c00cbd0 con 0x7f658c102740 2024-06-02T23:50:59.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.369+0000 7f65897fa700 1 -- 172.21.15.49:0/2329105077 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f657c00cd70 con 0x7f658c102740 2024-06-02T23:50:59.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.369+0000 7f65897fa700 1 -- 172.21.15.49:0/2329105077 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657c018750 con 0x7f658c102740 2024-06-02T23:50:59.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.369+0000 7f65923e9700 1 -- 172.21.15.49:0/2329105077 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f658c199400 con 0x7f658c102740 2024-06-02T23:50:59.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.369+0000 7f65923e9700 1 -- 172.21.15.49:0/2329105077 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f658c1a56c0 con 0x7f658c102740 2024-06-02T23:50:59.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.369+0000 7f65897fa700 1 -- 172.21.15.49:0/2329105077 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f657c0188f0 con 0x7f658c102740 2024-06-02T23:50:59.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.370+0000 7f65923e9700 1 -- 172.21.15.49:0/2329105077 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f658c069180 con 0x7f658c102740 2024-06-02T23:50:59.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.370+0000 7f65897fa700 1 --2- 172.21.15.49:0/2329105077 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6574039330 0x7f657403b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:50:59.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.370+0000 7f65897fa700 1 -- 172.21.15.49:0/2329105077 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f657c04c800 con 0x7f658c102740 2024-06-02T23:50:59.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.370+0000 7f658b7fe700 1 --2- 172.21.15.49:0/2329105077 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6574039330 0x7f657403b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:50:59.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.370+0000 7f658b7fe700 1 --2- 172.21.15.49:0/2329105077 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6574039330 0x7f657403b7f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f658c108d00 tx=0x7f65800073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:50:59.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.375+0000 7f65897fa700 1 -- 172.21.15.49:0/2329105077 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f657c01c1c0 con 0x7f658c102740 2024-06-02T23:50:59.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.580+0000 7f65923e9700 1 -- 172.21.15.49:0/2329105077 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f658c02dca0 con 0x7f658c102740 2024-06-02T23:50:59.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.581+0000 7f65897fa700 1 -- 172.21.15.49:0/2329105077 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7f657c0109a0 con 0x7f658c102740 2024-06-02T23:50:59.581 INFO:teuthology.orchestra.run.smithi049.stdout:# minimal ceph.conf for 890dd222-213a-11ef-bc9b-c7b262605968 2024-06-02T23:50:59.581 INFO:teuthology.orchestra.run.smithi049.stdout:[global] 2024-06-02T23:50:59.581 INFO:teuthology.orchestra.run.smithi049.stdout: fsid = 890dd222-213a-11ef-bc9b-c7b262605968 2024-06-02T23:50:59.581 INFO:teuthology.orchestra.run.smithi049.stdout: mon_host = [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-06-02T23:50:59.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.583+0000 7f65923e9700 1 -- 172.21.15.49:0/2329105077 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6574039330 msgr2=0x7f657403b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:59.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.583+0000 7f65923e9700 1 --2- 172.21.15.49:0/2329105077 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6574039330 0x7f657403b7f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f658c108d00 tx=0x7f65800073d0 comp rx=0 tx=0).stop 2024-06-02T23:50:59.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.583+0000 7f65923e9700 1 -- 172.21.15.49:0/2329105077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f658c102740 msgr2=0x7f658c19e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:50:59.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.583+0000 7f65923e9700 1 --2- 172.21.15.49:0/2329105077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f658c102740 0x7f658c19e7f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f657c00e9a0 tx=0x7f657c00ecb0 comp rx=0 tx=0).stop 2024-06-02T23:50:59.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.583+0000 7f65923e9700 1 -- 172.21.15.49:0/2329105077 shutdown_connections 2024-06-02T23:50:59.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.583+0000 7f65923e9700 1 --2- 172.21.15.49:0/2329105077 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6574039330 0x7f657403b7f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:59.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.583+0000 7f65923e9700 1 --2- 172.21.15.49:0/2329105077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f658c107840 0x7f658c1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:59.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.583+0000 7f65923e9700 1 --2- 172.21.15.49:0/2329105077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f658c102740 0x7f658c19e7f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:59.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.583+0000 7f65923e9700 1 --2- 172.21.15.49:0/2329105077 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f658c1030f0 0x7f658c19ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:50:59.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.583+0000 7f65923e9700 1 -- 172.21.15.49:0/2329105077 >> 172.21.15.49:0/2329105077 conn(0x7f658c0795f0 msgr2=0x7f658c100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:50:59.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.583+0000 7f65923e9700 1 -- 172.21.15.49:0/2329105077 shutdown_connections 2024-06-02T23:50:59.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:50:59.583+0000 7f65923e9700 1 -- 172.21.15.49:0/2329105077 wait complete. 2024-06-02T23:51:00.087 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-06-02T23:51:00.087 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-06-02T23:51:00.087 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/ceph.conf 2024-06-02T23:51:00.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:59 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:00.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:59 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:00.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:59 smithi107 ceph-mon[37048]: Reconfiguring mon.b (monmap changed)... 2024-06-02T23:51:00.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:59 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T23:51:00.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:59 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T23:51:00.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:59 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:00.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:59 smithi107 ceph-mon[37048]: Reconfiguring daemon mon.b on smithi057 2024-06-02T23:51:00.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:50:59 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/2329105077' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:00.101 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:59 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:00.102 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:59 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:00.102 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:59 smithi049 ceph-mon[32302]: Reconfiguring mon.b (monmap changed)... 2024-06-02T23:51:00.102 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:59 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T23:51:00.102 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:59 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T23:51:00.102 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:59 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:00.102 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:59 smithi049 ceph-mon[32302]: Reconfiguring daemon mon.b on smithi057 2024-06-02T23:51:00.102 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:50:59 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/2329105077' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:00.116 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-06-02T23:51:00.116 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-02T23:51:00.183 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-06-02T23:51:00.183 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/ceph/ceph.conf 2024-06-02T23:51:00.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:59 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:00.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:59 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:00.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:59 smithi057 ceph-mon[36457]: Reconfiguring mon.b (monmap changed)... 2024-06-02T23:51:00.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:59 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T23:51:00.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:59 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T23:51:00.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:59 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:00.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:59 smithi057 ceph-mon[36457]: Reconfiguring daemon mon.b on smithi057 2024-06-02T23:51:00.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:50:59 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/2329105077' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:00.211 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-06-02T23:51:00.212 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-02T23:51:00.277 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-06-02T23:51:00.277 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.conf 2024-06-02T23:51:00.310 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-06-02T23:51:00.310 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-02T23:51:00.377 INFO:tasks.cephadm:Adding mgr.x on smithi049 2024-06-02T23:51:00.378 INFO:tasks.cephadm:Adding mgr.y on smithi057 2024-06-02T23:51:00.378 INFO:tasks.cephadm:Adding mgr.z on smithi107 2024-06-02T23:51:00.378 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph orch apply mgr '3;smithi049=x;smithi057=y;smithi107=z' 2024-06-02T23:51:00.662 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T23:51:01.048 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:00 smithi107 ceph-mon[37048]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:01.048 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:00 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:01.048 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:00 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:01.048 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:00 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T23:51:01.048 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:00 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T23:51:01.048 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:00 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:01.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:00 smithi057 ceph-mon[36457]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:01.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:00 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:01.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:00 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:01.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:00 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T23:51:01.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:00 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T23:51:01.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:00 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:01.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:00 smithi049 ceph-mon[32302]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:01.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:00 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:01.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:00 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:01.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:00 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T23:51:01.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:00 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T23:51:01.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:00 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:02.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:01 smithi107 ceph-mon[37048]: Reconfiguring mon.c (monmap changed)... 2024-06-02T23:51:02.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:01 smithi107 ceph-mon[37048]: Reconfiguring daemon mon.c on smithi107 2024-06-02T23:51:02.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:01 smithi057 ceph-mon[36457]: Reconfiguring mon.c (monmap changed)... 2024-06-02T23:51:02.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:01 smithi057 ceph-mon[36457]: Reconfiguring daemon mon.c on smithi107 2024-06-02T23:51:02.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:01 smithi049 ceph-mon[32302]: Reconfiguring mon.c (monmap changed)... 2024-06-02T23:51:02.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:01 smithi049 ceph-mon[32302]: Reconfiguring daemon mon.c on smithi107 2024-06-02T23:51:02.952 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:02 smithi107 ceph-mon[37048]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:02.952 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:02 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:02.952 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:02 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:02.952 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:02 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:51:02.971 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.970+0000 7fd2ca9ea700 1 -- 172.21.15.107:0/3742490719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2c4102010 msgr2=0x7fd2c4102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:51:02.971 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.970+0000 7fd2ca9ea700 1 --2- 172.21.15.107:0/3742490719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2c4102010 0x7fd2c4102430 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4009910 tx=0x7fd2b4009c20 comp rx=0 tx=0).stop 2024-06-02T23:51:02.971 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.970+0000 7fd2ca9ea700 1 -- 172.21.15.107:0/3742490719 shutdown_connections 2024-06-02T23:51:02.971 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.970+0000 7fd2ca9ea700 1 --2- 172.21.15.107:0/3742490719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2c4102010 0x7fd2c4102430 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:51:02.971 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.970+0000 7fd2ca9ea700 1 -- 172.21.15.107:0/3742490719 >> 172.21.15.107:0/3742490719 conn(0x7fd2c40fd5b0 msgr2=0x7fd2c40ff9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:51:02.971 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.970+0000 7fd2ca9ea700 1 -- 172.21.15.107:0/3742490719 shutdown_connections 2024-06-02T23:51:02.971 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.970+0000 7fd2ca9ea700 1 -- 172.21.15.107:0/3742490719 wait complete. 2024-06-02T23:51:02.971 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.971+0000 7fd2ca9ea700 1 Processor -- start 2024-06-02T23:51:02.971 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.971+0000 7fd2ca9ea700 1 -- start start 2024-06-02T23:51:02.974 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.971+0000 7fd2ca9ea700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2c4102010 0x7fd2c4076230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:51:02.974 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.971+0000 7fd2ca9ea700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2c4074880 0x7fd2c4074d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:51:02.974 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.971+0000 7fd2ca9ea700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2c4075240 0x7fd2c41a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:51:02.974 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.971+0000 7fd2ca9ea700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c4108050 con 0x7fd2c4075240 2024-06-02T23:51:02.974 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.971+0000 7fd2ca9ea700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c4107ed0 con 0x7fd2c4102010 2024-06-02T23:51:02.974 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.971+0000 7fd2ca9ea700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c41081d0 con 0x7fd2c4074880 2024-06-02T23:51:02.974 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.971+0000 7fd2c37fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2c4074880 0x7fd2c4074d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:51:02.974 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.971+0000 7fd2c37fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2c4074880 0x7fd2c4074d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47214/0 (socket says 172.21.15.107:47214) 2024-06-02T23:51:02.975 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.971+0000 7fd2c37fe700 1 -- 172.21.15.107:0/2213424102 learned_addr learned my addr 172.21.15.107:0/2213424102 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-06-02T23:51:02.975 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.971+0000 7fd2c8f87700 1 --2- 172.21.15.107:0/2213424102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2c4075240 0x7fd2c41a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:51:02.975 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.972+0000 7fd2c3fff700 1 --2- 172.21.15.107:0/2213424102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2c4102010 0x7fd2c4076230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:51:02.975 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.972+0000 7fd2c37fe700 1 -- 172.21.15.107:0/2213424102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2c4102010 msgr2=0x7fd2c4076230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:51:02.975 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.972+0000 7fd2c37fe700 1 --2- 172.21.15.107:0/2213424102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2c4102010 0x7fd2c4076230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:51:02.975 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.972+0000 7fd2c37fe700 1 -- 172.21.15.107:0/2213424102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2c4075240 msgr2=0x7fd2c41a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:51:02.975 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.972+0000 7fd2c37fe700 1 --2- 172.21.15.107:0/2213424102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2c4075240 0x7fd2c41a18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:51:02.975 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.972+0000 7fd2c37fe700 1 -- 172.21.15.107:0/2213424102 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c41a1e80 con 0x7fd2c4074880 2024-06-02T23:51:02.975 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.972+0000 7fd2c3fff700 1 --2- 172.21.15.107:0/2213424102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2c4102010 0x7fd2c4076230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:51:02.975 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.972+0000 7fd2c8f87700 1 --2- 172.21.15.107:0/2213424102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2c4075240 0x7fd2c41a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:51:02.975 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.972+0000 7fd2c37fe700 1 --2- 172.21.15.107:0/2213424102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2c4074880 0x7fd2c4074d00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd2b800b780 tx=0x7fd2b800ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:51:02.975 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.972+0000 7fd2c17fa700 1 -- 172.21.15.107:0/2213424102 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b8004230 con 0x7fd2c4074880 2024-06-02T23:51:02.975 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.972+0000 7fd2c17fa700 1 -- 172.21.15.107:0/2213424102 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2b80043d0 con 0x7fd2c4074880 2024-06-02T23:51:02.976 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.972+0000 7fd2ca9ea700 1 -- 172.21.15.107:0/2213424102 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2c41a2170 con 0x7fd2c4074880 2024-06-02T23:51:02.976 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.972+0000 7fd2c17fa700 1 -- 172.21.15.107:0/2213424102 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b8011c90 con 0x7fd2c4074880 2024-06-02T23:51:02.976 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.972+0000 7fd2ca9ea700 1 -- 172.21.15.107:0/2213424102 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2c41a2780 con 0x7fd2c4074880 2024-06-02T23:51:02.976 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.973+0000 7fd2c17fa700 1 -- 172.21.15.107:0/2213424102 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fd2b801a400 con 0x7fd2c4074880 2024-06-02T23:51:02.976 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.973+0000 7fd2ca9ea700 1 -- 172.21.15.107:0/2213424102 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2c4063af0 con 0x7fd2c4074880 2024-06-02T23:51:02.976 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.973+0000 7fd2c17fa700 1 --2- 172.21.15.107:0/2213424102 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fd2ac039580 0x7fd2ac03ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:51:02.976 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.973+0000 7fd2c17fa700 1 -- 172.21.15.107:0/2213424102 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd2b804bc70 con 0x7fd2c4074880 2024-06-02T23:51:02.976 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.973+0000 7fd2c3fff700 1 --2- 172.21.15.107:0/2213424102 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fd2ac039580 0x7fd2ac03ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:51:02.976 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.974+0000 7fd2c3fff700 1 --2- 172.21.15.107:0/2213424102 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fd2ac039580 0x7fd2ac03ba40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4005330 tx=0x7fd2b4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:51:02.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:02.978+0000 7fd2c17fa700 1 -- 172.21.15.107:0/2213424102 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd2b80151c0 con 0x7fd2c4074880 2024-06-02T23:51:03.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:03.185+0000 7fd2ca9ea700 1 -- 172.21.15.107:0/2213424102 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi049=x;smithi057=y;smithi107=z", "target": ["mon-mgr", ""]}) -- 0x7fd2c4062a20 con 0x7fd2ac039580 2024-06-02T23:51:03.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:03.192+0000 7fd2c17fa700 1 -- 172.21.15.107:0/2213424102 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fd2c4062a20 con 0x7fd2ac039580 2024-06-02T23:51:03.192 INFO:teuthology.orchestra.run.smithi107.stdout:Scheduled mgr update... 2024-06-02T23:51:03.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:03.194+0000 7fd2ca9ea700 1 -- 172.21.15.107:0/2213424102 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fd2ac039580 msgr2=0x7fd2ac03ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:51:03.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:03.194+0000 7fd2ca9ea700 1 --2- 172.21.15.107:0/2213424102 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fd2ac039580 0x7fd2ac03ba40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4005330 tx=0x7fd2b4005fd0 comp rx=0 tx=0).stop 2024-06-02T23:51:03.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:03.194+0000 7fd2ca9ea700 1 -- 172.21.15.107:0/2213424102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2c4074880 msgr2=0x7fd2c4074d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:51:03.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:03.194+0000 7fd2ca9ea700 1 --2- 172.21.15.107:0/2213424102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2c4074880 0x7fd2c4074d00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd2b800b780 tx=0x7fd2b800ba90 comp rx=0 tx=0).stop 2024-06-02T23:51:03.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:03.194+0000 7fd2ca9ea700 1 -- 172.21.15.107:0/2213424102 shutdown_connections 2024-06-02T23:51:03.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:03.194+0000 7fd2ca9ea700 1 --2- 172.21.15.107:0/2213424102 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fd2ac039580 0x7fd2ac03ba40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:51:03.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:03.194+0000 7fd2ca9ea700 1 --2- 172.21.15.107:0/2213424102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2c4075240 0x7fd2c41a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:51:03.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:03.194+0000 7fd2ca9ea700 1 --2- 172.21.15.107:0/2213424102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2c4102010 0x7fd2c4076230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:51:03.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:03.194+0000 7fd2ca9ea700 1 --2- 172.21.15.107:0/2213424102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2c4074880 0x7fd2c4074d00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:51:03.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:03.194+0000 7fd2ca9ea700 1 -- 172.21.15.107:0/2213424102 >> 172.21.15.107:0/2213424102 conn(0x7fd2c40fd5b0 msgr2=0x7fd2c40fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:51:03.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:03.194+0000 7fd2ca9ea700 1 -- 172.21.15.107:0/2213424102 shutdown_connections 2024-06-02T23:51:03.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:03.194+0000 7fd2ca9ea700 1 -- 172.21.15.107:0/2213424102 wait complete. 2024-06-02T23:51:03.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:02 smithi057 ceph-mon[36457]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:03.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:02 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:03.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:02 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:03.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:02 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:51:03.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:02 smithi049 ceph-mon[32302]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:03.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:02 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:03.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:02 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:03.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:02 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:51:03.791 DEBUG:teuthology.orchestra.run.smithi057:mgr.y> sudo journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mgr.y.service 2024-06-02T23:51:03.793 DEBUG:teuthology.orchestra.run.smithi107:mgr.z> sudo journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mgr.z.service 2024-06-02T23:51:03.796 INFO:tasks.cephadm:Deploying OSDs... 2024-06-02T23:51:03.796 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-06-02T23:51:03.796 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/scratch_devs of=/dev/stdout 2024-06-02T23:51:03.814 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-02T23:51:03.814 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_1 2024-06-02T23:51:03.871 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-02T23:51:03.871 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T23:51:03.871 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-06-02T23:51:03.872 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T23:51:03.872 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T23:51:03.872 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-06-02 23:50:05.329491682 +0000 2024-06-02T23:51:03.872 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-06-02 23:45:03.336750052 +0000 2024-06-02T23:51:03.872 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-06-02 23:45:03.336750052 +0000 2024-06-02T23:51:03.872 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2024-06-02 23:45:03.336750052 +0000 2024-06-02T23:51:03.872 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-02T23:51:03.938 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-06-02T23:51:03.938 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-06-02T23:51:03.938 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000113538 s, 4.5 MB/s 2024-06-02T23:51:03.939 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-02T23:51:03.997 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_2 2024-06-02T23:51:04.054 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-02T23:51:04.054 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T23:51:04.054 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-06-02T23:51:04.054 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T23:51:04.054 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T23:51:04.054 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-06-02 23:50:05.365490742 +0000 2024-06-02T23:51:04.054 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-06-02 23:45:03.650741819 +0000 2024-06-02T23:51:04.055 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-06-02 23:45:03.650741819 +0000 2024-06-02T23:51:04.055 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2024-06-02 23:45:03.650741819 +0000 2024-06-02T23:51:04.055 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-02T23:51:04.119 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-06-02T23:51:04.119 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-06-02T23:51:04.120 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 9.1685e-05 s, 5.6 MB/s 2024-06-02T23:51:04.121 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-02T23:51:04.179 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_3 2024-06-02T23:51:04.236 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-02T23:51:04.236 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T23:51:04.236 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-06-02T23:51:04.236 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T23:51:04.236 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T23:51:04.236 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-06-02 23:50:05.400489827 +0000 2024-06-02T23:51:04.236 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-06-02 23:45:03.974733325 +0000 2024-06-02T23:51:04.236 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-06-02 23:45:03.974733325 +0000 2024-06-02T23:51:04.236 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2024-06-02 23:45:03.974733325 +0000 2024-06-02T23:51:04.237 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-02T23:51:04.291 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:04 smithi107 ceph-mon[37048]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:04.291 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:04 smithi107 ceph-mon[37048]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi049=x;smithi057=y;smithi107=z", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:51:04.291 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:04 smithi107 ceph-mon[37048]: Saving service mgr spec with placement smithi049=x;smithi057=y;smithi107=z;count:3 2024-06-02T23:51:04.291 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:04 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:04.291 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:04 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:04.291 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:04 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:51:04.291 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:04 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:04.291 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:04 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T23:51:04.292 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:04 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-02T23:51:04.292 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:04 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T23:51:04.292 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:04 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:04.292 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:04 smithi107 ceph-mon[37048]: Deploying daemon mgr.z on smithi107 2024-06-02T23:51:04.301 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-06-02T23:51:04.301 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-06-02T23:51:04.301 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000108411 s, 4.7 MB/s 2024-06-02T23:51:04.302 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-02T23:51:04.359 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_4 2024-06-02T23:51:04.415 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-02T23:51:04.415 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T23:51:04.415 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-06-02T23:51:04.415 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T23:51:04.416 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T23:51:04.416 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-06-02 23:50:05.435488912 +0000 2024-06-02T23:51:04.416 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-06-02 23:45:04.320724254 +0000 2024-06-02T23:51:04.416 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-06-02 23:45:04.320724254 +0000 2024-06-02T23:51:04.416 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2024-06-02 23:45:04.320724254 +0000 2024-06-02T23:51:04.416 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-02T23:51:04.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:04 smithi057 ceph-mon[36457]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:04.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:04 smithi057 ceph-mon[36457]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi049=x;smithi057=y;smithi107=z", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:51:04.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:04 smithi057 ceph-mon[36457]: Saving service mgr spec with placement smithi049=x;smithi057=y;smithi107=z;count:3 2024-06-02T23:51:04.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:04 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:04.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:04 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:04.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:04 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:51:04.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:04 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:04.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:04 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T23:51:04.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:04 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-02T23:51:04.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:04 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T23:51:04.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:04 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:04.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:04 smithi057 ceph-mon[36457]: Deploying daemon mgr.z on smithi107 2024-06-02T23:51:04.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:04 smithi049 ceph-mon[32302]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:04.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:04 smithi049 ceph-mon[32302]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi049=x;smithi057=y;smithi107=z", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:51:04.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:04 smithi049 ceph-mon[32302]: Saving service mgr spec with placement smithi049=x;smithi057=y;smithi107=z;count:3 2024-06-02T23:51:04.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:04 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:04.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:04 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:04.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:04 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:51:04.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:04 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:04.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:04 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T23:51:04.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:04 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-02T23:51:04.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:04 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T23:51:04.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:04 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:04.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:04 smithi049 ceph-mon[32302]: Deploying daemon mgr.z on smithi107 2024-06-02T23:51:04.479 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-06-02T23:51:04.480 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-06-02T23:51:04.480 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000132826 s, 3.9 MB/s 2024-06-02T23:51:04.481 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-02T23:51:04.538 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-06-02T23:51:04.538 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/scratch_devs of=/dev/stdout 2024-06-02T23:51:04.557 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-02T23:51:04.557 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_1 2024-06-02T23:51:04.616 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-02T23:51:04.616 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T23:51:04.616 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-06-02T23:51:04.616 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T23:51:04.616 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T23:51:04.616 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-06-02 23:50:48.727763628 +0000 2024-06-02T23:51:04.616 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-06-02 23:45:15.996297787 +0000 2024-06-02T23:51:04.616 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-06-02 23:45:15.996297787 +0000 2024-06-02T23:51:04.616 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2024-06-02 23:45:15.996297787 +0000 2024-06-02T23:51:04.617 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-02T23:51:04.685 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-06-02T23:51:04.685 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-06-02T23:51:04.685 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000340847 s, 1.5 MB/s 2024-06-02T23:51:04.687 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-02T23:51:04.745 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_2 2024-06-02T23:51:04.803 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-02T23:51:04.803 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T23:51:04.803 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-06-02T23:51:04.803 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T23:51:04.803 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T23:51:04.803 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-06-02 23:50:48.728763613 +0000 2024-06-02T23:51:04.803 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-06-02 23:45:16.347292360 +0000 2024-06-02T23:51:04.803 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-06-02 23:45:16.347292360 +0000 2024-06-02T23:51:04.803 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2024-06-02 23:45:16.347292360 +0000 2024-06-02T23:51:04.803 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-02T23:51:04.868 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-06-02T23:51:04.868 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-06-02T23:51:04.868 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000304657 s, 1.7 MB/s 2024-06-02T23:51:04.870 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-02T23:51:04.927 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_3 2024-06-02T23:51:04.984 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-02T23:51:04.985 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T23:51:04.985 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-06-02T23:51:04.985 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T23:51:04.985 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T23:51:04.985 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-06-02 23:50:48.728763613 +0000 2024-06-02T23:51:04.985 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-06-02 23:45:16.698286932 +0000 2024-06-02T23:51:04.985 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-06-02 23:45:16.698286932 +0000 2024-06-02T23:51:04.985 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2024-06-02 23:45:16.698286932 +0000 2024-06-02T23:51:04.985 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-02T23:51:05.050 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-06-02T23:51:05.050 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-06-02T23:51:05.051 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000528837 s, 968 kB/s 2024-06-02T23:51:05.052 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-02T23:51:05.111 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_4 2024-06-02T23:51:05.169 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-02T23:51:05.169 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T23:51:05.170 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-06-02T23:51:05.170 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T23:51:05.170 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T23:51:05.170 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-06-02 23:50:48.729763598 +0000 2024-06-02T23:51:05.170 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-06-02 23:45:17.047281536 +0000 2024-06-02T23:51:05.170 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-06-02 23:45:17.047281536 +0000 2024-06-02T23:51:05.170 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2024-06-02 23:45:17.047281536 +0000 2024-06-02T23:51:05.171 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-02T23:51:05.235 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-06-02T23:51:05.235 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-06-02T23:51:05.235 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000308654 s, 1.7 MB/s 2024-06-02T23:51:05.237 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-02T23:51:05.295 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-06-02T23:51:05.295 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/scratch_devs of=/dev/stdout 2024-06-02T23:51:05.312 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-02T23:51:05.312 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_1 2024-06-02T23:51:05.368 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-02T23:51:05.368 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T23:51:05.368 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-06-02T23:51:05.368 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T23:51:05.368 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T23:51:05.368 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-06-02 23:51:05.210360640 +0000 2024-06-02T23:51:05.368 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-06-02 23:45:06.535294667 +0000 2024-06-02T23:51:05.368 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-06-02 23:45:06.535294667 +0000 2024-06-02T23:51:05.368 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-06-02 23:45:06.535294667 +0000 2024-06-02T23:51:05.369 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-02T23:51:05.429 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:05 smithi107 systemd[1]: Starting Ceph mgr.z for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-02T23:51:05.432 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-06-02T23:51:05.433 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-06-02T23:51:05.433 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.00024645 s, 2.1 MB/s 2024-06-02T23:51:05.434 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-02T23:51:05.489 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_2 2024-06-02T23:51:05.544 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-02T23:51:05.544 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T23:51:05.545 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-06-02T23:51:05.545 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T23:51:05.545 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T23:51:05.545 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-06-02 23:51:05.210360640 +0000 2024-06-02T23:51:05.545 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-06-02 23:45:06.887288873 +0000 2024-06-02T23:51:05.545 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-06-02 23:45:06.887288873 +0000 2024-06-02T23:51:05.545 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-06-02 23:45:06.887288873 +0000 2024-06-02T23:51:05.545 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-02T23:51:05.606 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-06-02T23:51:05.607 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-06-02T23:51:05.607 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000176152 s, 2.9 MB/s 2024-06-02T23:51:05.608 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-02T23:51:05.664 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_3 2024-06-02T23:51:05.718 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-02T23:51:05.719 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T23:51:05.719 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-06-02T23:51:05.719 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T23:51:05.719 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T23:51:05.719 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-06-02 23:51:05.211360624 +0000 2024-06-02T23:51:05.719 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-06-02 23:45:07.215283474 +0000 2024-06-02T23:51:05.719 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-06-02 23:45:07.215283474 +0000 2024-06-02T23:51:05.719 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-06-02 23:45:07.215283474 +0000 2024-06-02T23:51:05.719 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-02T23:51:05.732 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:05 smithi107 podman[38669]: 2024-06-02 23:51:05.397115747 +0000 UTC m=+0.016884109 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:51:05.732 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:05 smithi107 podman[38669]: 2024-06-02 23:51:05.529726282 +0000 UTC m=+0.149494634 container create 33a05c8db1e71376d565c270bb42d04ef6ed9de94ca4b9b2f1e008ed18019f48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-z, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240528) 2024-06-02T23:51:05.732 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:05 smithi107 podman[38669]: 2024-06-02 23:51:05.732326674 +0000 UTC m=+0.352095036 container init 33a05c8db1e71376d565c270bb42d04ef6ed9de94ca4b9b2f1e008ed18019f48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-06-02T23:51:05.754 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-06-02T23:51:05.754 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-06-02T23:51:05.754 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000203616 s, 2.5 MB/s 2024-06-02T23:51:05.755 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-02T23:51:05.811 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_4 2024-06-02T23:51:05.867 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-02T23:51:05.867 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T23:51:05.868 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-06-02T23:51:05.868 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T23:51:05.868 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T23:51:05.868 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-06-02 23:51:05.211360624 +0000 2024-06-02T23:51:05.868 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-06-02 23:45:07.558277828 +0000 2024-06-02T23:51:05.868 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-06-02 23:45:07.558277828 +0000 2024-06-02T23:51:05.868 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-06-02 23:45:07.558277828 +0000 2024-06-02T23:51:05.868 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-02T23:51:05.930 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-06-02T23:51:05.930 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-06-02T23:51:05.930 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000171574 s, 3.0 MB/s 2024-06-02T23:51:05.931 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-02T23:51:05.987 INFO:tasks.cephadm:Deploying osd.0 on smithi049 with /dev/vg_nvme/lv_4... 2024-06-02T23:51:05.987 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-06-02T23:51:06.080 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:05 smithi107 podman[38669]: 2024-06-02 23:51:05.735058237 +0000 UTC m=+0.354826592 container start 33a05c8db1e71376d565c270bb42d04ef6ed9de94ca4b9b2f1e008ed18019f48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-z, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-02T23:51:06.081 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:05 smithi107 ceph-mgr[38795]: -- 172.21.15.107:0/1252046412 <== mon.1 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dc3f1d25a0 con 0x55dc3f1a6c00 2024-06-02T23:51:06.081 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:05 smithi107 bash[38669]: 33a05c8db1e71376d565c270bb42d04ef6ed9de94ca4b9b2f1e008ed18019f48 2024-06-02T23:51:06.081 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:05 smithi107 systemd[1]: Started Ceph mgr.z for 890dd222-213a-11ef-bc9b-c7b262605968. 2024-06-02T23:51:06.081 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:05 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-z[38755]: 2024-06-02T23:51:05.888+0000 7fcf76c91200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-02T23:51:06.081 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:06 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-z[38755]: 2024-06-02T23:51:06.079+0000 7fcf76c91200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-02T23:51:06.236 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:51:06.350 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:06 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-z[38755]: 2024-06-02T23:51:06.181+0000 7fcf76c91200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-02T23:51:06.850 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:06 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-z[38755]: 2024-06-02T23:51:06.486+0000 7fcf76c91200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-02T23:51:06.851 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:06 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-z[38755]: 2024-06-02T23:51:06.569+0000 7fcf76c91200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-02T23:51:06.932 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:06 smithi049 ceph-mon[32302]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:06.933 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:06 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:06.933 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:06 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:06.933 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:06 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:06.933 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:06 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T23:51:06.933 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:06 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-02T23:51:06.933 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:06 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T23:51:06.933 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:06 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:06.933 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:06 smithi049 ceph-mon[32302]: Deploying daemon mgr.y on smithi057 2024-06-02T23:51:07.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:06 smithi057 ceph-mon[36457]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:07.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:06 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:07.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:06 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:07.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:06 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:07.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:06 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T23:51:07.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:06 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-02T23:51:07.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:06 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T23:51:07.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:06 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:07.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:06 smithi057 ceph-mon[36457]: Deploying daemon mgr.y on smithi057 2024-06-02T23:51:07.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:06 smithi107 ceph-mon[37048]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:07.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:06 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:07.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:06 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:07.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:06 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:07.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:06 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T23:51:07.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:06 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-02T23:51:07.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:06 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T23:51:07.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:06 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:07.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:06 smithi107 ceph-mon[37048]: Deploying daemon mgr.y on smithi057 2024-06-02T23:51:07.950 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:07 smithi057 systemd[1]: Starting Ceph mgr.y for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-02T23:51:08.000 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:07 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-z[38755]: 2024-06-02T23:51:07.749+0000 7fcf76c91200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-02T23:51:08.000 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:07 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-z[38755]: 2024-06-02T23:51:07.917+0000 7fcf76c91200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-02T23:51:08.009 INFO:teuthology.orchestra.run.smithi049.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-06-02T23:51:08.009 INFO:teuthology.orchestra.run.smithi049.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-06-02T23:51:08.009 INFO:teuthology.orchestra.run.smithi049.stderr: stderr: 10+0 records in 2024-06-02T23:51:08.009 INFO:teuthology.orchestra.run.smithi049.stderr:10+0 records out 2024-06-02T23:51:08.009 INFO:teuthology.orchestra.run.smithi049.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00912274 s, 1.1 GB/s 2024-06-02T23:51:08.009 INFO:teuthology.orchestra.run.smithi049.stderr:--> Zapping successful for: 2024-06-02T23:51:08.256 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:08 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-z[38755]: 2024-06-02T23:51:08.090+0000 7fcf76c91200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-02T23:51:08.327 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:08 smithi057 podman[37824]: 2024-06-02 23:51:07.980060342 +0000 UTC m=+0.017755617 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:51:08.328 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:08 smithi057 podman[37824]: 2024-06-02 23:51:08.089439535 +0000 UTC m=+0.127134831 container create 05fd17bb1135cc2c4ad652fbcb6d719e9b250b55ba836b97d4a22d68aaea1217 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-y, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, GIT_CLEAN=True) 2024-06-02T23:51:08.328 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:08 smithi057 podman[37824]: 2024-06-02 23:51:08.299967243 +0000 UTC m=+0.337662530 container init 05fd17bb1135cc2c4ad652fbcb6d719e9b250b55ba836b97d4a22d68aaea1217 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-y, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-06-02T23:51:08.328 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:08 smithi057 podman[37824]: 2024-06-02 23:51:08.302710402 +0000 UTC m=+0.340405677 container start 05fd17bb1135cc2c4ad652fbcb6d719e9b250b55ba836b97d4a22d68aaea1217 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-y, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-02T23:51:08.328 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:08 smithi057 ceph-mgr[37843]: -- 172.21.15.57:0/1167863349 <== mon.2 v2:172.21.15.57:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56152ceb85a0 con 0x56152ce8cc00 2024-06-02T23:51:08.600 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:08 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-z[38755]: 2024-06-02T23:51:08.391+0000 7fcf76c91200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-02T23:51:08.600 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:08 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-z[38755]: 2024-06-02T23:51:08.490+0000 7fcf76c91200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-02T23:51:08.615 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi049:vg_nvme/lv_4 2024-06-02T23:51:08.664 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:08 smithi057 bash[37824]: 05fd17bb1135cc2c4ad652fbcb6d719e9b250b55ba836b97d4a22d68aaea1217 2024-06-02T23:51:08.664 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:08 smithi057 systemd[1]: Started Ceph mgr.y for 890dd222-213a-11ef-bc9b-c7b262605968. 2024-06-02T23:51:08.664 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:08 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-y[37839]: 2024-06-02T23:51:08.461+0000 7fa66b8dc200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-02T23:51:08.664 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:08 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-y[37839]: 2024-06-02T23:51:08.664+0000 7fa66b8dc200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-02T23:51:08.858 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:51:08.921 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:08 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-y[37839]: 2024-06-02T23:51:08.774+0000 7fa66b8dc200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-02T23:51:09.100 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:08 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-z[38755]: 2024-06-02T23:51:08.702+0000 7fcf76c91200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-02T23:51:09.101 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:08 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-z[38755]: 2024-06-02T23:51:08.906+0000 7fcf76c91200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-02T23:51:09.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:08 smithi107 ceph-mon[37048]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:09.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:08 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:09.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:08 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:09.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:08 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:09.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:08 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:09.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:08 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:51:09.200 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:09 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-y[37839]: 2024-06-02T23:51:09.108+0000 7fa66b8dc200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-02T23:51:09.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:08 smithi057 ceph-mon[36457]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:09.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:08 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:09.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:08 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:09.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:08 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:09.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:08 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:09.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:08 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:51:09.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:08 smithi049 ceph-mon[32302]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:09.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:08 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:09.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:08 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:09.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:08 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:09.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:08 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:09.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:08 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:51:09.549 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:09 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-y[37839]: 2024-06-02T23:51:09.206+0000 7fa66b8dc200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-02T23:51:09.850 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:09 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-z[38755]: 2024-06-02T23:51:09.552+0000 7fcf76c91200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-02T23:51:10.311 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:10 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-z[38755]: 2024-06-02T23:51:10.012+0000 7fcf76c91200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-02T23:51:10.312 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:10 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-z[38755]: 2024-06-02T23:51:10.109+0000 7fcf76c91200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-02T23:51:10.312 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:10 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-z[38755]: 2024-06-02T23:51:10.311+0000 7fcf76c91200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-02T23:51:10.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.442+0000 7f99de199700 1 -- 172.21.15.49:0/1724303969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99d81013e0 msgr2=0x7f99d8101800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:51:10.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.442+0000 7f99de199700 1 --2- 172.21.15.49:0/1724303969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99d81013e0 0x7f99d8101800 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f99c80099c0 tx=0x7f99c8009cd0 comp rx=0 tx=0).stop 2024-06-02T23:51:10.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.442+0000 7f99de199700 1 -- 172.21.15.49:0/1724303969 shutdown_connections 2024-06-02T23:51:10.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.442+0000 7f99de199700 1 --2- 172.21.15.49:0/1724303969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99d8102f80 0x7f99d8109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:51:10.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.442+0000 7f99de199700 1 --2- 172.21.15.49:0/1724303969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99d81013e0 0x7f99d8101800 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:51:10.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.442+0000 7f99de199700 1 --2- 172.21.15.49:0/1724303969 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99d81025e0 0x7f99d8102a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:51:10.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.442+0000 7f99de199700 1 -- 172.21.15.49:0/1724303969 >> 172.21.15.49:0/1724303969 conn(0x7f99d80fc980 msgr2=0x7f99d80fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:51:10.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.442+0000 7f99de199700 1 -- 172.21.15.49:0/1724303969 shutdown_connections 2024-06-02T23:51:10.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.442+0000 7f99de199700 1 -- 172.21.15.49:0/1724303969 wait complete. 2024-06-02T23:51:10.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.443+0000 7f99de199700 1 Processor -- start 2024-06-02T23:51:10.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.443+0000 7f99de199700 1 -- start start 2024-06-02T23:51:10.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.443+0000 7f99de199700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99d81013e0 0x7f99d81986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:51:10.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.443+0000 7f99de199700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99d81025e0 0x7f99d8198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:51:10.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.443+0000 7f99de199700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99d8102f80 0x7f99d819fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:51:10.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.443+0000 7f99de199700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f99d810cfa0 con 0x7f99d81013e0 2024-06-02T23:51:10.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.443+0000 7f99de199700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f99d810ce20 con 0x7f99d8102f80 2024-06-02T23:51:10.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.443+0000 7f99de199700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f99d810d120 con 0x7f99d81025e0 2024-06-02T23:51:10.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.443+0000 7f99d77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99d81013e0 0x7f99d81986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:51:10.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.443+0000 7f99d6ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99d81025e0 0x7f99d8198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:51:10.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.443+0000 7f99d77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99d81013e0 0x7f99d81986d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54502/0 (socket says 172.21.15.49:54502) 2024-06-02T23:51:10.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.443+0000 7f99d6ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99d81025e0 0x7f99d8198c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:43490/0 (socket says 172.21.15.49:43490) 2024-06-02T23:51:10.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.443+0000 7f99d77fe700 1 -- 172.21.15.49:0/3031550205 learned_addr learned my addr 172.21.15.49:0/3031550205 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:51:10.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.443+0000 7f99d7fff700 1 --2- 172.21.15.49:0/3031550205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99d8102f80 0x7f99d819fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:51:10.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.444+0000 7f99d77fe700 1 -- 172.21.15.49:0/3031550205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99d81025e0 msgr2=0x7f99d8198c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:51:10.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.444+0000 7f99d77fe700 1 --2- 172.21.15.49:0/3031550205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99d81025e0 0x7f99d8198c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:51:10.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.444+0000 7f99d77fe700 1 -- 172.21.15.49:0/3031550205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99d8102f80 msgr2=0x7f99d819fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:51:10.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.444+0000 7f99d77fe700 1 --2- 172.21.15.49:0/3031550205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99d8102f80 0x7f99d819fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:51:10.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.444+0000 7f99d77fe700 1 -- 172.21.15.49:0/3031550205 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d81a0330 con 0x7f99d81013e0 2024-06-02T23:51:10.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.444+0000 7f99d7fff700 1 --2- 172.21.15.49:0/3031550205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99d8102f80 0x7f99d819fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:51:10.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.444+0000 7f99d6ffd700 1 --2- 172.21.15.49:0/3031550205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99d81025e0 0x7f99d8198c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:51:10.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.444+0000 7f99d77fe700 1 --2- 172.21.15.49:0/3031550205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99d81013e0 0x7f99d81986d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f99c800f710 tx=0x7f99c8009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:51:10.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.444+0000 7f99d4ff9700 1 -- 172.21.15.49:0/3031550205 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c8009e60 con 0x7f99d81013e0 2024-06-02T23:51:10.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.444+0000 7f99d4ff9700 1 -- 172.21.15.49:0/3031550205 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99c8003960 con 0x7f99d81013e0 2024-06-02T23:51:10.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.444+0000 7f99d4ff9700 1 -- 172.21.15.49:0/3031550205 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c8005560 con 0x7f99d81013e0 2024-06-02T23:51:10.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.444+0000 7f99de199700 1 -- 172.21.15.49:0/3031550205 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99d8103800 con 0x7f99d81013e0 2024-06-02T23:51:10.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.444+0000 7f99de199700 1 -- 172.21.15.49:0/3031550205 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99d8103c90 con 0x7f99d81013e0 2024-06-02T23:51:10.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.445+0000 7f99d4ff9700 1 -- 172.21.15.49:0/3031550205 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f99c802b440 con 0x7f99d81013e0 2024-06-02T23:51:10.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.445+0000 7f99de199700 1 -- 172.21.15.49:0/3031550205 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99d8069180 con 0x7f99d81013e0 2024-06-02T23:51:10.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.445+0000 7f99d4ff9700 1 --2- 172.21.15.49:0/3031550205 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f99c0039330 0x7f99c003b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:51:10.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.446+0000 7f99d4ff9700 1 -- 172.21.15.49:0/3031550205 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f99c804d0a0 con 0x7f99d81013e0 2024-06-02T23:51:10.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.446+0000 7f99d6ffd700 1 --2- 172.21.15.49:0/3031550205 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f99c0039330 0x7f99c003b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:51:10.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.446+0000 7f99d6ffd700 1 --2- 172.21.15.49:0/3031550205 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f99c0039330 0x7f99c003b7f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f99cc009730 tx=0x7f99cc012040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:51:10.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.451+0000 7f99d4ff9700 1 -- 172.21.15.49:0/3031550205 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f99c8013070 con 0x7f99d81013e0 2024-06-02T23:51:10.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:10.668+0000 7f99de199700 1 -- 172.21.15.49:0/3031550205 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f99d80feb50 con 0x7f99c0039330 2024-06-02T23:51:10.850 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:10 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-y[37839]: 2024-06-02T23:51:10.510+0000 7fa66b8dc200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-02T23:51:10.850 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:10 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-y[37839]: 2024-06-02T23:51:10.687+0000 7fa66b8dc200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-02T23:51:10.921 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:10 smithi049 ceph-mon[32302]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:10.922 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:10.922 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:10.922 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:10.922 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:10.922 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:10.922 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:51:10.922 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:10.922 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T23:51:10.922 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T23:51:10.922 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:10.922 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:10.923 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:51:10.923 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:51:10.923 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:11.100 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:10 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-z[38755]: 2024-06-02T23:51:10.829+0000 7fcf76c91200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-02T23:51:11.100 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:10 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-z[38755]: 2024-06-02T23:51:10.921+0000 7fcf76c91200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-02T23:51:11.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:10 smithi107 ceph-mon[37048]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:11.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:10 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:11.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:10 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:11.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:10 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:11.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:10 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:11.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:10 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:11.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:10 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:51:11.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:10 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:11.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:10 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T23:51:11.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:10 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T23:51:11.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:10 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:11.102 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:10 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:11.102 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:10 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:51:11.102 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:10 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:51:11.102 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:10 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:11.163 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:10 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-y[37839]: 2024-06-02T23:51:10.863+0000 7fa66b8dc200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-02T23:51:11.163 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:11 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-y[37839]: 2024-06-02T23:51:11.163+0000 7fa66b8dc200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-02T23:51:11.163 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:10 smithi057 ceph-mon[36457]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:11.164 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:10 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:11.164 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:10 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:11.164 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:10 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:11.164 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:10 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:11.164 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:10 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:11.164 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:10 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:51:11.164 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:10 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:11.164 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:10 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T23:51:11.164 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:10 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T23:51:11.164 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:10 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:11.164 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:10 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:11.164 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:10 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:51:11.164 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:10 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:51:11.164 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:10 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:11.450 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:11 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-y[37839]: 2024-06-02T23:51:11.258+0000 7fa66b8dc200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-02T23:51:11.509 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:11 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-z[38755]: 2024-06-02T23:51:11.163+0000 7fcf76c91200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-02T23:51:11.509 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:11 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-z[38755]: 2024-06-02T23:51:11.296+0000 7fcf76c91200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-02T23:51:11.509 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:11 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-z[38755]: 2024-06-02T23:51:11.391+0000 7fcf76c91200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-02T23:51:11.509 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:11 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-z[38755]: 2024-06-02T23:51:11.508+0000 7fcf76c91200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-02T23:51:11.853 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:11 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-y[37839]: 2024-06-02T23:51:11.468+0000 7fa66b8dc200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-02T23:51:11.853 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:11 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-y[37839]: 2024-06-02T23:51:11.667+0000 7fa66b8dc200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-02T23:51:12.100 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:11 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-z[38755]: 2024-06-02T23:51:11.804+0000 7fcf76c91200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-02T23:51:12.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:11 smithi107 ceph-mon[37048]: Reconfiguring mgr.x (unknown last config time)... 2024-06-02T23:51:12.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:11 smithi107 ceph-mon[37048]: Reconfiguring daemon mgr.x on smithi049 2024-06-02T23:51:12.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:11 smithi107 ceph-mon[37048]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:51:12.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:11 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:12.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:11 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:12.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:11 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:51:12.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:11 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:12.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:11 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:51:12.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:11 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:12.168 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:11 smithi049 ceph-mon[32302]: Reconfiguring mgr.x (unknown last config time)... 2024-06-02T23:51:12.169 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:11 smithi049 ceph-mon[32302]: Reconfiguring daemon mgr.x on smithi049 2024-06-02T23:51:12.169 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:11 smithi049 ceph-mon[32302]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:51:12.169 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:11 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:12.169 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:11 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:12.169 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:11 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:51:12.169 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:11 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:12.169 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:11 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:51:12.169 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:11 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:12.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:11 smithi057 ceph-mon[36457]: Reconfiguring mgr.x (unknown last config time)... 2024-06-02T23:51:12.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:11 smithi057 ceph-mon[36457]: Reconfiguring daemon mgr.x on smithi049 2024-06-02T23:51:12.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:11 smithi057 ceph-mon[36457]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:51:12.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:11 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:12.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:11 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:12.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:11 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:51:12.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:11 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:12.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:11 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:51:12.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:11 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:12.700 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:12 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-y[37839]: 2024-06-02T23:51:12.298+0000 7fa66b8dc200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-02T23:51:12.850 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:12 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-z[38755]: 2024-06-02T23:51:12.400+0000 7fcf76c91200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-02T23:51:12.851 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 02 23:51:12 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-z[38755]: 2024-06-02T23:51:12.613+0000 7fcf76c91200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-02T23:51:12.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:12.861+0000 7f99d4ff9700 1 -- 172.21.15.49:0/3031550205 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 14) ==== 92060+0+0 (secure 0 0 0) 0x7f99c80173f0 con 0x7f99d81013e0 2024-06-02T23:51:13.045 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:12 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-y[37839]: 2024-06-02T23:51:12.736+0000 7fa66b8dc200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-02T23:51:13.045 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:12 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-y[37839]: 2024-06-02T23:51:12.837+0000 7fa66b8dc200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-02T23:51:13.045 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:13 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-y[37839]: 2024-06-02T23:51:13.045+0000 7fa66b8dc200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-02T23:51:13.046 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:12 smithi057 ceph-mon[36457]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:13.046 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:12 smithi057 ceph-mon[36457]: Standby manager daemon z started 2024-06-02T23:51:13.046 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:12 smithi057 ceph-mon[36457]: from='mgr.? 172.21.15.107:0/2166302879' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-02T23:51:13.046 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:12 smithi057 ceph-mon[36457]: from='mgr.? 172.21.15.107:0/2166302879' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T23:51:13.046 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:12 smithi057 ceph-mon[36457]: from='mgr.? 172.21.15.107:0/2166302879' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-02T23:51:13.046 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:12 smithi057 ceph-mon[36457]: from='mgr.? 172.21.15.107:0/2166302879' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T23:51:13.142 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:12 smithi049 ceph-mon[32302]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:13.142 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:12 smithi049 ceph-mon[32302]: Standby manager daemon z started 2024-06-02T23:51:13.142 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:12 smithi049 ceph-mon[32302]: from='mgr.? 172.21.15.107:0/2166302879' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-02T23:51:13.142 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:12 smithi049 ceph-mon[32302]: from='mgr.? 172.21.15.107:0/2166302879' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T23:51:13.142 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:12 smithi049 ceph-mon[32302]: from='mgr.? 172.21.15.107:0/2166302879' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-02T23:51:13.142 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:12 smithi049 ceph-mon[32302]: from='mgr.? 172.21.15.107:0/2166302879' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T23:51:13.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:12 smithi107 ceph-mon[37048]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:13.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:12 smithi107 ceph-mon[37048]: Standby manager daemon z started 2024-06-02T23:51:13.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:12 smithi107 ceph-mon[37048]: from='mgr.? 172.21.15.107:0/2166302879' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-02T23:51:13.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:12 smithi107 ceph-mon[37048]: from='mgr.? 172.21.15.107:0/2166302879' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T23:51:13.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:12 smithi107 ceph-mon[37048]: from='mgr.? 172.21.15.107:0/2166302879' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-02T23:51:13.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:12 smithi107 ceph-mon[37048]: from='mgr.? 172.21.15.107:0/2166302879' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T23:51:13.863 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:13 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-y[37839]: 2024-06-02T23:51:13.609+0000 7fa66b8dc200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-02T23:51:13.863 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:13 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-y[37839]: 2024-06-02T23:51:13.704+0000 7fa66b8dc200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-02T23:51:14.156 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:13 smithi049 ceph-mon[32302]: mgrmap e14: x(active, since 77s), standbys: z 2024-06-02T23:51:14.156 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:13 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-02T23:51:14.156 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:13 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3833187938' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e0013e80-07d6-4ad3-87d8-d41988988ef5"}]: dispatch 2024-06-02T23:51:14.156 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:13 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3833187938' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e0013e80-07d6-4ad3-87d8-d41988988ef5"}]': finished 2024-06-02T23:51:14.157 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:13 smithi049 ceph-mon[32302]: osdmap e5: 1 total, 0 up, 1 in 2024-06-02T23:51:14.157 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:13 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:51:14.197 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:13 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-y[37839]: 2024-06-02T23:51:13.956+0000 7fa66b8dc200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-02T23:51:14.197 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:14 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-y[37839]: 2024-06-02T23:51:14.095+0000 7fa66b8dc200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-02T23:51:14.197 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:14 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-y[37839]: 2024-06-02T23:51:14.197+0000 7fa66b8dc200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-02T23:51:14.198 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:13 smithi057 ceph-mon[36457]: mgrmap e14: x(active, since 77s), standbys: z 2024-06-02T23:51:14.198 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:13 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-02T23:51:14.198 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:13 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/3833187938' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e0013e80-07d6-4ad3-87d8-d41988988ef5"}]: dispatch 2024-06-02T23:51:14.198 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:13 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/3833187938' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e0013e80-07d6-4ad3-87d8-d41988988ef5"}]': finished 2024-06-02T23:51:14.199 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:13 smithi057 ceph-mon[36457]: osdmap e5: 1 total, 0 up, 1 in 2024-06-02T23:51:14.199 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:13 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:51:14.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:13 smithi107 ceph-mon[37048]: mgrmap e14: x(active, since 77s), standbys: z 2024-06-02T23:51:14.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:13 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-02T23:51:14.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:13 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/3833187938' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e0013e80-07d6-4ad3-87d8-d41988988ef5"}]: dispatch 2024-06-02T23:51:14.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:13 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/3833187938' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e0013e80-07d6-4ad3-87d8-d41988988ef5"}]': finished 2024-06-02T23:51:14.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:13 smithi107 ceph-mon[37048]: osdmap e5: 1 total, 0 up, 1 in 2024-06-02T23:51:14.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:13 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:51:14.450 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:14 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-y[37839]: 2024-06-02T23:51:14.317+0000 7fa66b8dc200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-02T23:51:14.950 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:14 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-y[37839]: 2024-06-02T23:51:14.626+0000 7fa66b8dc200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-02T23:51:14.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:14 smithi057 ceph-mon[36457]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:14.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:14 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/3942149720' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:51:15.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:14 smithi049 ceph-mon[32302]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:15.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:14 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3942149720' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:51:15.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:14 smithi107 ceph-mon[37048]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:15.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:14 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/3942149720' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:51:15.700 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:15 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-y[37839]: 2024-06-02T23:51:15.258+0000 7fa66b8dc200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-02T23:51:15.700 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 02 23:51:15 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-y[37839]: 2024-06-02T23:51:15.482+0000 7fa66b8dc200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-02T23:51:15.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:15.874+0000 7f99d4ff9700 1 -- 172.21.15.49:0/3031550205 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f99c80213c0 con 0x7f99d81013e0 2024-06-02T23:51:16.183 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:15 smithi057 ceph-mon[36457]: Standby manager daemon y started 2024-06-02T23:51:16.183 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:15 smithi057 ceph-mon[36457]: from='mgr.? 172.21.15.57:0/2426968948' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-02T23:51:16.184 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:15 smithi057 ceph-mon[36457]: from='mgr.? 172.21.15.57:0/2426968948' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T23:51:16.184 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:15 smithi057 ceph-mon[36457]: from='mgr.? 172.21.15.57:0/2426968948' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-02T23:51:16.184 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:15 smithi057 ceph-mon[36457]: from='mgr.? 172.21.15.57:0/2426968948' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T23:51:16.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:15 smithi049 ceph-mon[32302]: Standby manager daemon y started 2024-06-02T23:51:16.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:15 smithi049 ceph-mon[32302]: from='mgr.? 172.21.15.57:0/2426968948' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-02T23:51:16.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:15 smithi049 ceph-mon[32302]: from='mgr.? 172.21.15.57:0/2426968948' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T23:51:16.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:15 smithi049 ceph-mon[32302]: from='mgr.? 172.21.15.57:0/2426968948' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-02T23:51:16.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:15 smithi049 ceph-mon[32302]: from='mgr.? 172.21.15.57:0/2426968948' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T23:51:16.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:15 smithi107 ceph-mon[37048]: Standby manager daemon y started 2024-06-02T23:51:16.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:15 smithi107 ceph-mon[37048]: from='mgr.? 172.21.15.57:0/2426968948' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-02T23:51:16.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:15 smithi107 ceph-mon[37048]: from='mgr.? 172.21.15.57:0/2426968948' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T23:51:16.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:15 smithi107 ceph-mon[37048]: from='mgr.? 172.21.15.57:0/2426968948' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-02T23:51:16.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:15 smithi107 ceph-mon[37048]: from='mgr.? 172.21.15.57:0/2426968948' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T23:51:17.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:16 smithi057 ceph-mon[36457]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:17.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:16 smithi057 ceph-mon[36457]: mgrmap e15: x(active, since 80s), standbys: z, y 2024-06-02T23:51:17.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:16 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-02T23:51:17.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:16 smithi049 ceph-mon[32302]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:17.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:16 smithi049 ceph-mon[32302]: mgrmap e15: x(active, since 80s), standbys: z, y 2024-06-02T23:51:17.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:16 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-02T23:51:17.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:16 smithi107 ceph-mon[37048]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:17.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:16 smithi107 ceph-mon[37048]: mgrmap e15: x(active, since 80s), standbys: z, y 2024-06-02T23:51:17.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:16 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-02T23:51:19.067 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:18 smithi049 ceph-mon[32302]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:19.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:18 smithi057 ceph-mon[36457]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:19.274 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:18 smithi107 ceph-mon[37048]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:21.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:20 smithi057 ceph-mon[36457]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:21.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:20 smithi049 ceph-mon[32302]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:21.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:20 smithi107 ceph-mon[37048]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:22.108 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:21 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-02T23:51:22.108 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:21 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:22.108 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:21 smithi049 ceph-mon[32302]: Deploying daemon osd.0 on smithi049 2024-06-02T23:51:22.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:21 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-02T23:51:22.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:21 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:22.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:21 smithi057 ceph-mon[36457]: Deploying daemon osd.0 on smithi049 2024-06-02T23:51:22.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:21 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-02T23:51:22.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:21 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:22.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:21 smithi107 ceph-mon[37048]: Deploying daemon osd.0 on smithi049 2024-06-02T23:51:22.960 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:22 smithi049 ceph-mon[32302]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:23.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:22 smithi057 ceph-mon[36457]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:23.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:22 smithi107 ceph-mon[37048]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:25.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:24 smithi057 ceph-mon[36457]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:25.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:24 smithi049 ceph-mon[32302]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:25.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:24 smithi107 ceph-mon[37048]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:27.122 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:26 smithi049 ceph-mon[32302]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:27.123 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:26 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:27.123 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:26 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:27.123 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:26 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:51:27.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:26 smithi057 ceph-mon[36457]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:27.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:26 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:27.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:26 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:27.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:26 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:51:27.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:26 smithi107 ceph-mon[37048]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:27.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:26 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:27.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:26 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:27.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:26 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:51:28.994 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:28 smithi049 ceph-mon[32302]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:29.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:28 smithi057 ceph-mon[36457]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:29.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:29.325+0000 7f99d4ff9700 1 -- 172.21.15.49:0/3031550205 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f99d80feb50 con 0x7f99c0039330 2024-06-02T23:51:29.325 INFO:teuthology.orchestra.run.smithi049.stdout:Created osd(s) 0 on host 'smithi049' 2024-06-02T23:51:29.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:29.328+0000 7f99de199700 1 -- 172.21.15.49:0/3031550205 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f99c0039330 msgr2=0x7f99c003b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:51:29.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:29.328+0000 7f99de199700 1 --2- 172.21.15.49:0/3031550205 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f99c0039330 0x7f99c003b7f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f99cc009730 tx=0x7f99cc012040 comp rx=0 tx=0).stop 2024-06-02T23:51:29.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:29.328+0000 7f99de199700 1 -- 172.21.15.49:0/3031550205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99d81013e0 msgr2=0x7f99d81986d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:51:29.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:29.328+0000 7f99de199700 1 --2- 172.21.15.49:0/3031550205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99d81013e0 0x7f99d81986d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f99c800f710 tx=0x7f99c8009580 comp rx=0 tx=0).stop 2024-06-02T23:51:29.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:29.328+0000 7f99de199700 1 -- 172.21.15.49:0/3031550205 shutdown_connections 2024-06-02T23:51:29.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:29.328+0000 7f99de199700 1 --2- 172.21.15.49:0/3031550205 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f99c0039330 0x7f99c003b7f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:51:29.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:29.328+0000 7f99de199700 1 --2- 172.21.15.49:0/3031550205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99d8102f80 0x7f99d819fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:51:29.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:29.328+0000 7f99de199700 1 --2- 172.21.15.49:0/3031550205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99d81013e0 0x7f99d81986d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:51:29.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:29.328+0000 7f99de199700 1 --2- 172.21.15.49:0/3031550205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99d81025e0 0x7f99d8198c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:51:29.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:29.328+0000 7f99de199700 1 -- 172.21.15.49:0/3031550205 >> 172.21.15.49:0/3031550205 conn(0x7f99d80fc980 msgr2=0x7f99d80fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:51:29.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:29.328+0000 7f99de199700 1 -- 172.21.15.49:0/3031550205 shutdown_connections 2024-06-02T23:51:29.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:51:29.328+0000 7f99de199700 1 -- 172.21.15.49:0/3031550205 wait complete. 2024-06-02T23:51:29.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:28 smithi107 ceph-mon[37048]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:29.908 DEBUG:teuthology.orchestra.run.smithi049:osd.0> sudo journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.0.service 2024-06-02T23:51:29.911 INFO:tasks.cephadm:Deploying osd.1 on smithi057 with /dev/vg_nvme/lv_4... 2024-06-02T23:51:29.911 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-06-02T23:51:30.164 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T23:51:30.211 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 02 23:51:30 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-0[44786]: 2024-06-02T23:51:30.058+0000 7ff3d1d657c0 -1 osd.0 0 log_to_monitors true 2024-06-02T23:51:30.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:30 smithi107 ceph-mon[37048]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:30.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:30 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:30.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:30 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:30.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:30 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:30.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:30 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:30.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:30 smithi107 ceph-mon[37048]: from='osd.0 [v2:172.21.15.49:6802/811647073,v1:172.21.15.49:6803/811647073]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-02T23:51:30.603 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:30 smithi057 ceph-mon[36457]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:30.603 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:30 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:30.603 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:30 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:30.603 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:30 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:30.604 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:30 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:30.604 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:30 smithi057 ceph-mon[36457]: from='osd.0 [v2:172.21.15.49:6802/811647073,v1:172.21.15.49:6803/811647073]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-02T23:51:30.636 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:30 smithi049 ceph-mon[32302]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:30.636 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:30 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:30.636 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:30 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:30.636 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:30 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:30.637 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:30 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:30.637 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:30 smithi049 ceph-mon[32302]: from='osd.0 [v2:172.21.15.49:6802/811647073,v1:172.21.15.49:6803/811647073]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-02T23:51:32.167 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-06-02T23:51:32.167 INFO:teuthology.orchestra.run.smithi057.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-06-02T23:51:32.167 INFO:teuthology.orchestra.run.smithi057.stderr: stderr: 10+0 records in 2024-06-02T23:51:32.168 INFO:teuthology.orchestra.run.smithi057.stderr:10+0 records out 2024-06-02T23:51:32.168 INFO:teuthology.orchestra.run.smithi057.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.012718 s, 824 MB/s 2024-06-02T23:51:32.168 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping successful for: 2024-06-02T23:51:32.168 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:32 smithi057 ceph-mon[36457]: from='osd.0 [v2:172.21.15.49:6802/811647073,v1:172.21.15.49:6803/811647073]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-02T23:51:32.168 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:32 smithi057 ceph-mon[36457]: osdmap e6: 1 total, 0 up, 1 in 2024-06-02T23:51:32.168 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:32 smithi057 ceph-mon[36457]: from='osd.0 [v2:172.21.15.49:6802/811647073,v1:172.21.15.49:6803/811647073]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-06-02T23:51:32.168 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:32 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:51:32.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:32 smithi049 ceph-mon[32302]: from='osd.0 [v2:172.21.15.49:6802/811647073,v1:172.21.15.49:6803/811647073]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-02T23:51:32.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:32 smithi049 ceph-mon[32302]: osdmap e6: 1 total, 0 up, 1 in 2024-06-02T23:51:32.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:32 smithi049 ceph-mon[32302]: from='osd.0 [v2:172.21.15.49:6802/811647073,v1:172.21.15.49:6803/811647073]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-06-02T23:51:32.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:32 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:51:32.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:32 smithi107 ceph-mon[37048]: from='osd.0 [v2:172.21.15.49:6802/811647073,v1:172.21.15.49:6803/811647073]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-02T23:51:32.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:32 smithi107 ceph-mon[37048]: osdmap e6: 1 total, 0 up, 1 in 2024-06-02T23:51:32.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:32 smithi107 ceph-mon[37048]: from='osd.0 [v2:172.21.15.49:6802/811647073,v1:172.21.15.49:6803/811647073]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-06-02T23:51:32.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:32 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:51:32.790 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi057:vg_nvme/lv_4 2024-06-02T23:51:33.038 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T23:51:33.106 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 02 23:51:32 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-0[44786]: 2024-06-02T23:51:32.807+0000 7ff3c6bc8700 -1 osd.0 0 waiting for initial osdmap 2024-06-02T23:51:33.106 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 02 23:51:32 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-0[44786]: 2024-06-02T23:51:32.811+0000 7ff3bf1b4700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T23:51:33.107 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:33 smithi049 ceph-mon[32302]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:33.107 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:33 smithi049 ceph-mon[32302]: from='osd.0 [v2:172.21.15.49:6802/811647073,v1:172.21.15.49:6803/811647073]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-06-02T23:51:33.107 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:33 smithi049 ceph-mon[32302]: osdmap e7: 1 total, 0 up, 1 in 2024-06-02T23:51:33.107 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:33 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:51:33.108 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:33 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:51:33.108 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:33 smithi049 ceph-mon[32302]: from='osd.0 [v2:172.21.15.49:6802/811647073,v1:172.21.15.49:6803/811647073]' entity='osd.0' 2024-06-02T23:51:33.157 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:33 smithi057 ceph-mon[36457]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:33.158 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:33 smithi057 ceph-mon[36457]: from='osd.0 [v2:172.21.15.49:6802/811647073,v1:172.21.15.49:6803/811647073]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-06-02T23:51:33.158 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:33 smithi057 ceph-mon[36457]: osdmap e7: 1 total, 0 up, 1 in 2024-06-02T23:51:33.158 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:33 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:51:33.158 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:33 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:51:33.158 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:33 smithi057 ceph-mon[36457]: from='osd.0 [v2:172.21.15.49:6802/811647073,v1:172.21.15.49:6803/811647073]' entity='osd.0' 2024-06-02T23:51:33.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:33 smithi107 ceph-mon[37048]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:33.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:33 smithi107 ceph-mon[37048]: from='osd.0 [v2:172.21.15.49:6802/811647073,v1:172.21.15.49:6803/811647073]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-06-02T23:51:33.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:33 smithi107 ceph-mon[37048]: osdmap e7: 1 total, 0 up, 1 in 2024-06-02T23:51:33.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:33 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:51:33.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:33 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:51:33.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:33 smithi107 ceph-mon[37048]: from='osd.0 [v2:172.21.15.49:6802/811647073,v1:172.21.15.49:6803/811647073]' entity='osd.0' 2024-06-02T23:51:34.113 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:34 smithi057 ceph-mon[36457]: purged_snaps scrub starts 2024-06-02T23:51:34.113 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:34 smithi057 ceph-mon[36457]: purged_snaps scrub ok 2024-06-02T23:51:34.113 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:34 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:51:34.113 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:34 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:34.113 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:34 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:34.113 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:34 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:51:34.113 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:34 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:34.114 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:34 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:34.114 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:34 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:51:34.114 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:34 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:34.114 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:34 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:51:34.114 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:34 smithi057 ceph-mon[36457]: osd.0 [v2:172.21.15.49:6802/811647073,v1:172.21.15.49:6803/811647073] boot 2024-06-02T23:51:34.114 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:34 smithi057 ceph-mon[36457]: osdmap e8: 1 total, 1 up, 1 in 2024-06-02T23:51:34.114 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:34 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:51:34.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:34 smithi107 ceph-mon[37048]: purged_snaps scrub starts 2024-06-02T23:51:34.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:34 smithi107 ceph-mon[37048]: purged_snaps scrub ok 2024-06-02T23:51:34.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:34 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:51:34.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:34 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:34.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:34 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:34.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:34 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:51:34.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:34 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:34.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:34 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:34.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:34 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:51:34.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:34 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:34.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:34 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:51:34.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:34 smithi107 ceph-mon[37048]: osd.0 [v2:172.21.15.49:6802/811647073,v1:172.21.15.49:6803/811647073] boot 2024-06-02T23:51:34.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:34 smithi107 ceph-mon[37048]: osdmap e8: 1 total, 1 up, 1 in 2024-06-02T23:51:34.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:34 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:51:34.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:34 smithi049 ceph-mon[32302]: purged_snaps scrub starts 2024-06-02T23:51:34.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:34 smithi049 ceph-mon[32302]: purged_snaps scrub ok 2024-06-02T23:51:34.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:34 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:51:34.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:34 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:34.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:34 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:34.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:34 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:51:34.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:34 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:34.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:34 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:34.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:34 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:51:34.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:34 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:34.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:34 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:51:34.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:34 smithi049 ceph-mon[32302]: osd.0 [v2:172.21.15.49:6802/811647073,v1:172.21.15.49:6803/811647073] boot 2024-06-02T23:51:34.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:34 smithi049 ceph-mon[32302]: osdmap e8: 1 total, 1 up, 1 in 2024-06-02T23:51:34.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:34 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T23:51:34.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.582+0000 7f9e1a761700 1 -- 172.21.15.57:0/221522301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e14105940 msgr2=0x7f9e14107d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:51:34.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.582+0000 7f9e1a761700 1 --2- 172.21.15.57:0/221522301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e14105940 0x7f9e14107d30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9e04009990 tx=0x7f9e04009ca0 comp rx=0 tx=0).stop 2024-06-02T23:51:34.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.582+0000 7f9e1a761700 1 -- 172.21.15.57:0/221522301 shutdown_connections 2024-06-02T23:51:34.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.582+0000 7f9e1a761700 1 --2- 172.21.15.57:0/221522301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e14108270 0x7f9e1410a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:51:34.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.582+0000 7f9e1a761700 1 --2- 172.21.15.57:0/221522301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e14103010 0x7f9e14105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:51:34.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.582+0000 7f9e1a761700 1 --2- 172.21.15.57:0/221522301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e14105940 0x7f9e14107d30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:51:34.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.582+0000 7f9e1a761700 1 -- 172.21.15.57:0/221522301 >> 172.21.15.57:0/221522301 conn(0x7f9e140fc960 msgr2=0x7f9e140feda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:51:34.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.582+0000 7f9e1a761700 1 -- 172.21.15.57:0/221522301 shutdown_connections 2024-06-02T23:51:34.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.582+0000 7f9e1a761700 1 -- 172.21.15.57:0/221522301 wait complete. 2024-06-02T23:51:34.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.583+0000 7f9e1a761700 1 Processor -- start 2024-06-02T23:51:34.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.583+0000 7f9e1a761700 1 -- start start 2024-06-02T23:51:34.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.583+0000 7f9e1a761700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e14103010 0x7f9e14198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:51:34.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.583+0000 7f9e1a761700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e14105940 0x7f9e14198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:51:34.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.583+0000 7f9e1a761700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e14108270 0x7f9e1419fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:51:34.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.583+0000 7f9e1a761700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9e1410e0d0 con 0x7f9e14105940 2024-06-02T23:51:34.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.583+0000 7f9e1a761700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9e1410df50 con 0x7f9e14108270 2024-06-02T23:51:34.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.583+0000 7f9e1a761700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9e1410e250 con 0x7f9e14103010 2024-06-02T23:51:34.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.583+0000 7f9e18cfe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e14108270 0x7f9e1419fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:51:34.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.583+0000 7f9e137fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e14105940 0x7f9e14198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:51:34.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.583+0000 7f9e137fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e14105940 0x7f9e14198c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.57:51694/0 (socket says 172.21.15.57:51694) 2024-06-02T23:51:34.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.583+0000 7f9e18cfe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e14108270 0x7f9e1419fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36528/0 (socket says 172.21.15.57:36528) 2024-06-02T23:51:34.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.583+0000 7f9e13fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e14103010 0x7f9e14198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:51:34.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.583+0000 7f9e18cfe700 1 -- 172.21.15.57:0/1709804521 learned_addr learned my addr 172.21.15.57:0/1709804521 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-06-02T23:51:34.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.584+0000 7f9e137fe700 1 -- 172.21.15.57:0/1709804521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e14103010 msgr2=0x7f9e14198740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:51:34.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.584+0000 7f9e137fe700 1 --2- 172.21.15.57:0/1709804521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e14103010 0x7f9e14198740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:51:34.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.584+0000 7f9e137fe700 1 -- 172.21.15.57:0/1709804521 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e14108270 msgr2=0x7f9e1419fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:51:34.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.584+0000 7f9e137fe700 1 --2- 172.21.15.57:0/1709804521 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e14108270 0x7f9e1419fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:51:34.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.584+0000 7f9e137fe700 1 -- 172.21.15.57:0/1709804521 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e141a03a0 con 0x7f9e14105940 2024-06-02T23:51:34.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.584+0000 7f9e18cfe700 1 --2- 172.21.15.57:0/1709804521 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e14108270 0x7f9e1419fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:51:34.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.584+0000 7f9e137fe700 1 --2- 172.21.15.57:0/1709804521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e14105940 0x7f9e14198c80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9e04009990 tx=0x7f9e04005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:51:34.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.584+0000 7f9e117fa700 1 -- 172.21.15.57:0/1709804521 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e04026070 con 0x7f9e14105940 2024-06-02T23:51:34.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.584+0000 7f9e117fa700 1 -- 172.21.15.57:0/1709804521 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e04005510 con 0x7f9e14105940 2024-06-02T23:51:34.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.584+0000 7f9e117fa700 1 -- 172.21.15.57:0/1709804521 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e04003ca0 con 0x7f9e14105940 2024-06-02T23:51:34.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.584+0000 7f9e1a761700 1 -- 172.21.15.57:0/1709804521 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e141a0630 con 0x7f9e14105940 2024-06-02T23:51:34.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.584+0000 7f9e1a761700 1 -- 172.21.15.57:0/1709804521 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e141a0a30 con 0x7f9e14105940 2024-06-02T23:51:34.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.585+0000 7f9e1a761700 1 -- 172.21.15.57:0/1709804521 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e14069180 con 0x7f9e14105940 2024-06-02T23:51:34.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.586+0000 7f9e117fa700 1 -- 172.21.15.57:0/1709804521 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f9e04029070 con 0x7f9e14105940 2024-06-02T23:51:34.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.587+0000 7f9e117fa700 1 --2- 172.21.15.57:0/1709804521 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9e000a2b90 0x7f9e000a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:51:34.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.587+0000 7f9e117fa700 1 -- 172.21.15.57:0/1709804521 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1767+0+0 (secure 0 0 0) 0x7f9e040ce3c0 con 0x7f9e14105940 2024-06-02T23:51:34.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.587+0000 7f9e13fff700 1 --2- 172.21.15.57:0/1709804521 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9e000a2b90 0x7f9e000a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:51:34.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.587+0000 7f9e13fff700 1 --2- 172.21.15.57:0/1709804521 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9e000a2b90 0x7f9e000a5050 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc005950 tx=0x7f9dfc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:51:34.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.591+0000 7f9e117fa700 1 -- 172.21.15.57:0/1709804521 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9e04013070 con 0x7f9e14105940 2024-06-02T23:51:34.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:34.804+0000 7f9e1a761700 1 -- 172.21.15.57:0/1709804521 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f9e140628d0 con 0x7f9e000a2b90 2024-06-02T23:51:35.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:35 smithi057 ceph-mon[36457]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:35.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:35 smithi057 ceph-mon[36457]: Detected new or changed devices on smithi049 2024-06-02T23:51:35.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:35 smithi057 ceph-mon[36457]: Adjusting osd_memory_target on smithi049 to 17088M 2024-06-02T23:51:35.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:35 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:35.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:35 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:51:35.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:35 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:35.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:35 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:51:35.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:35 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:51:35.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:35 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:35.267 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:35 smithi107 ceph-mon[37048]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:35.268 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:35 smithi107 ceph-mon[37048]: Detected new or changed devices on smithi049 2024-06-02T23:51:35.268 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:35 smithi107 ceph-mon[37048]: Adjusting osd_memory_target on smithi049 to 17088M 2024-06-02T23:51:35.268 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:35 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:35.268 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:35 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:51:35.268 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:35 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:35.268 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:35 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:51:35.268 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:35 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:51:35.268 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:35 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:35.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:35 smithi049 ceph-mon[32302]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T23:51:35.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:35 smithi049 ceph-mon[32302]: Detected new or changed devices on smithi049 2024-06-02T23:51:35.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:35 smithi049 ceph-mon[32302]: Adjusting osd_memory_target on smithi049 to 17088M 2024-06-02T23:51:35.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:35 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:35.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:35 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:51:35.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:35 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:35.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:35 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:51:35.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:35 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:51:35.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:35 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:36.331 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:36 smithi057 ceph-mon[36457]: from='client.14253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:51:36.331 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:36 smithi057 ceph-mon[36457]: osdmap e9: 1 total, 1 up, 1 in 2024-06-02T23:51:36.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:36 smithi107 ceph-mon[37048]: from='client.14253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:51:36.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:36 smithi107 ceph-mon[37048]: osdmap e9: 1 total, 1 up, 1 in 2024-06-02T23:51:36.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:36 smithi049 ceph-mon[32302]: from='client.14253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:51:36.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:36 smithi049 ceph-mon[32302]: osdmap e9: 1 total, 1 up, 1 in 2024-06-02T23:51:37.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:37 smithi107 ceph-mon[37048]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:37.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:37 smithi057 ceph-mon[36457]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:37.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:37 smithi049 ceph-mon[32302]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:38.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:38 smithi057 ceph-mon[36457]: from='client.? 172.21.15.57:0/648943400' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f37d9f79-e349-4de7-81e7-385ddb905f58"}]: dispatch 2024-06-02T23:51:38.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:38 smithi057 ceph-mon[36457]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f37d9f79-e349-4de7-81e7-385ddb905f58"}]: dispatch 2024-06-02T23:51:38.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:38 smithi057 ceph-mon[36457]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f37d9f79-e349-4de7-81e7-385ddb905f58"}]': finished 2024-06-02T23:51:38.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:38 smithi057 ceph-mon[36457]: osdmap e10: 2 total, 1 up, 2 in 2024-06-02T23:51:38.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:38 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:51:38.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:38 smithi107 ceph-mon[37048]: from='client.? 172.21.15.57:0/648943400' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f37d9f79-e349-4de7-81e7-385ddb905f58"}]: dispatch 2024-06-02T23:51:38.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:38 smithi107 ceph-mon[37048]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f37d9f79-e349-4de7-81e7-385ddb905f58"}]: dispatch 2024-06-02T23:51:38.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:38 smithi107 ceph-mon[37048]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f37d9f79-e349-4de7-81e7-385ddb905f58"}]': finished 2024-06-02T23:51:38.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:38 smithi107 ceph-mon[37048]: osdmap e10: 2 total, 1 up, 2 in 2024-06-02T23:51:38.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:38 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:51:38.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:38 smithi049 ceph-mon[32302]: from='client.? 172.21.15.57:0/648943400' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f37d9f79-e349-4de7-81e7-385ddb905f58"}]: dispatch 2024-06-02T23:51:38.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:38 smithi049 ceph-mon[32302]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f37d9f79-e349-4de7-81e7-385ddb905f58"}]: dispatch 2024-06-02T23:51:38.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:38 smithi049 ceph-mon[32302]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f37d9f79-e349-4de7-81e7-385ddb905f58"}]': finished 2024-06-02T23:51:38.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:38 smithi049 ceph-mon[32302]: osdmap e10: 2 total, 1 up, 2 in 2024-06-02T23:51:38.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:38 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:51:39.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:39 smithi049 ceph-mon[32302]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:39.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:39 smithi049 ceph-mon[32302]: from='client.? 172.21.15.57:0/3447894844' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:51:39.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:39 smithi107 ceph-mon[37048]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:39.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:39 smithi107 ceph-mon[37048]: from='client.? 172.21.15.57:0/3447894844' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:51:39.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:39 smithi057 ceph-mon[36457]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:39.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:39 smithi057 ceph-mon[36457]: from='client.? 172.21.15.57:0/3447894844' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:51:40.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:40 smithi057 ceph-mon[36457]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:40.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:40 smithi049 ceph-mon[32302]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:40.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:40 smithi107 ceph-mon[37048]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:42.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:42 smithi107 ceph-mon[37048]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:42.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:42 smithi057 ceph-mon[36457]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:42.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:42 smithi049 ceph-mon[32302]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:44.496 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:44 smithi057 ceph-mon[36457]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:44.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:44 smithi107 ceph-mon[37048]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:44.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:44 smithi049 ceph-mon[32302]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:46.526 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:46 smithi107 ceph-mon[37048]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:46.526 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:46 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-02T23:51:46.526 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:46 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:46.527 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:46 smithi107 ceph-mon[37048]: Deploying daemon osd.1 on smithi057 2024-06-02T23:51:46.573 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:46 smithi057 ceph-mon[36457]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:46.573 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:46 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-02T23:51:46.573 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:46 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:46.573 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:46 smithi057 ceph-mon[36457]: Deploying daemon osd.1 on smithi057 2024-06-02T23:51:46.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:46 smithi049 ceph-mon[32302]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:46.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:46 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-02T23:51:46.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:46 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:46.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:46 smithi049 ceph-mon[32302]: Deploying daemon osd.1 on smithi057 2024-06-02T23:51:48.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:48 smithi057 ceph-mon[36457]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:48.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:48 smithi107 ceph-mon[37048]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:48.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:48 smithi049 ceph-mon[32302]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:50.333 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:50 smithi057 ceph-mon[36457]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:50.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:50 smithi107 ceph-mon[37048]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:50.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:50 smithi049 ceph-mon[32302]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:52.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:52 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:52.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:52 smithi057 ceph-mon[36457]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:52.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:52 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:52.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:52 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:51:52.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:52 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:52.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:52 smithi049 ceph-mon[32302]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:52.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:52 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:52.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:52 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:51:52.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:52 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:52.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:52 smithi107 ceph-mon[37048]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:52.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:52 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:52.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:52 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:51:54.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:54 smithi057 ceph-mon[36457]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:54.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:54 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:54.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:54 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:54.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:54 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:54.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:54 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:51:54.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:54 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:54.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:54 smithi049 ceph-mon[32302]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:54.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:54 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:54.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:54 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:54.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:54 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:54.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:54 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:51:54.712 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:54 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:54.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:54.824+0000 7f9e117fa700 1 -- 172.21.15.57:0/1709804521 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9e140628d0 con 0x7f9e000a2b90 2024-06-02T23:51:54.825 INFO:teuthology.orchestra.run.smithi057.stdout:Created osd(s) 1 on host 'smithi057' 2024-06-02T23:51:54.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:54.826+0000 7f9e1a761700 1 -- 172.21.15.57:0/1709804521 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9e000a2b90 msgr2=0x7f9e000a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:51:54.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:54.826+0000 7f9e1a761700 1 --2- 172.21.15.57:0/1709804521 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9e000a2b90 0x7f9e000a5050 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc005950 tx=0x7f9dfc00b410 comp rx=0 tx=0).stop 2024-06-02T23:51:54.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:54.826+0000 7f9e1a761700 1 -- 172.21.15.57:0/1709804521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e14105940 msgr2=0x7f9e14198c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:51:54.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:54.826+0000 7f9e1a761700 1 --2- 172.21.15.57:0/1709804521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e14105940 0x7f9e14198c80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9e04009990 tx=0x7f9e04005e80 comp rx=0 tx=0).stop 2024-06-02T23:51:54.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:54.826+0000 7f9e1a761700 1 -- 172.21.15.57:0/1709804521 shutdown_connections 2024-06-02T23:51:54.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:54.826+0000 7f9e1a761700 1 --2- 172.21.15.57:0/1709804521 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9e000a2b90 0x7f9e000a5050 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:51:54.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:54.826+0000 7f9e1a761700 1 --2- 172.21.15.57:0/1709804521 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e14108270 0x7f9e1419fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:51:54.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:54.826+0000 7f9e1a761700 1 --2- 172.21.15.57:0/1709804521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e14103010 0x7f9e14198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:51:54.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:54.826+0000 7f9e1a761700 1 --2- 172.21.15.57:0/1709804521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e14105940 0x7f9e14198c80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:51:54.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:54.826+0000 7f9e1a761700 1 -- 172.21.15.57:0/1709804521 >> 172.21.15.57:0/1709804521 conn(0x7f9e140fc960 msgr2=0x7f9e14103a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:51:54.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:54.826+0000 7f9e1a761700 1 -- 172.21.15.57:0/1709804521 shutdown_connections 2024-06-02T23:51:54.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:51:54.826+0000 7f9e1a761700 1 -- 172.21.15.57:0/1709804521 wait complete. 2024-06-02T23:51:54.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:54 smithi107 ceph-mon[37048]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:54.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:54 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:54.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:54 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:54.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:54 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:54.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:54 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:51:54.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:54 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:55.401 DEBUG:teuthology.orchestra.run.smithi057:osd.1> sudo journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.1.service 2024-06-02T23:51:55.403 INFO:tasks.cephadm:Deploying osd.2 on smithi107 with /dev/vg_nvme/lv_4... 2024-06-02T23:51:55.403 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-06-02T23:51:55.643 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T23:51:56.071 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:55 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:56.072 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:55 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:56.072 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:55 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:51:56.072 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:55 smithi107 ceph-mon[37048]: from='osd.1 [v2:172.21.15.57:6800/1260507785,v1:172.21.15.57:6801/1260507785]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-02T23:51:56.072 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:55 smithi107 ceph-mon[37048]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-02T23:51:56.164 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:55 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:56.164 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:55 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:56.164 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:55 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:51:56.164 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:55 smithi057 ceph-mon[36457]: from='osd.1 [v2:172.21.15.57:6800/1260507785,v1:172.21.15.57:6801/1260507785]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-02T23:51:56.164 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:55 smithi057 ceph-mon[36457]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-02T23:51:56.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:55 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:56.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:55 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:56.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:55 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:51:56.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:55 smithi049 ceph-mon[32302]: from='osd.1 [v2:172.21.15.57:6800/1260507785,v1:172.21.15.57:6801/1260507785]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-02T23:51:56.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:55 smithi049 ceph-mon[32302]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-02T23:51:57.013 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:56 smithi107 ceph-mon[37048]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:57.013 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:56 smithi107 ceph-mon[37048]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-02T23:51:57.013 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:56 smithi107 ceph-mon[37048]: osdmap e11: 2 total, 1 up, 2 in 2024-06-02T23:51:57.013 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:51:57.013 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:56 smithi107 ceph-mon[37048]: from='osd.1 [v2:172.21.15.57:6800/1260507785,v1:172.21.15.57:6801/1260507785]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-06-02T23:51:57.013 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:56 smithi107 ceph-mon[37048]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-06-02T23:51:57.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:56 smithi057 ceph-mon[36457]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:57.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:56 smithi057 ceph-mon[36457]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-02T23:51:57.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:56 smithi057 ceph-mon[36457]: osdmap e11: 2 total, 1 up, 2 in 2024-06-02T23:51:57.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:51:57.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:56 smithi057 ceph-mon[36457]: from='osd.1 [v2:172.21.15.57:6800/1260507785,v1:172.21.15.57:6801/1260507785]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-06-02T23:51:57.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:56 smithi057 ceph-mon[36457]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-06-02T23:51:57.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:56 smithi049 ceph-mon[32302]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:57.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:56 smithi049 ceph-mon[32302]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-02T23:51:57.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:56 smithi049 ceph-mon[32302]: osdmap e11: 2 total, 1 up, 2 in 2024-06-02T23:51:57.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:51:57.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:56 smithi049 ceph-mon[32302]: from='osd.1 [v2:172.21.15.57:6800/1260507785,v1:172.21.15.57:6801/1260507785]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-06-02T23:51:57.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:56 smithi049 ceph-mon[32302]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-06-02T23:51:57.585 INFO:teuthology.orchestra.run.smithi107.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-06-02T23:51:57.585 INFO:teuthology.orchestra.run.smithi107.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-06-02T23:51:57.585 INFO:teuthology.orchestra.run.smithi107.stderr: stderr: 10+0 records in 2024-06-02T23:51:57.585 INFO:teuthology.orchestra.run.smithi107.stderr:10+0 records out 2024-06-02T23:51:57.585 INFO:teuthology.orchestra.run.smithi107.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114179 s, 918 MB/s 2024-06-02T23:51:57.585 INFO:teuthology.orchestra.run.smithi107.stderr:--> Zapping successful for: 2024-06-02T23:51:57.888 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:57 smithi107 ceph-mon[37048]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2024-06-02T23:51:57.888 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:57 smithi107 ceph-mon[37048]: osdmap e12: 2 total, 1 up, 2 in 2024-06-02T23:51:57.888 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:57 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:51:57.888 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:57 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:51:57.888 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:57 smithi107 ceph-mon[37048]: from='osd.1 ' entity='osd.1' 2024-06-02T23:51:58.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:57 smithi057 ceph-mon[36457]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2024-06-02T23:51:58.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:57 smithi057 ceph-mon[36457]: osdmap e12: 2 total, 1 up, 2 in 2024-06-02T23:51:58.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:57 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:51:58.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:57 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:51:58.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:57 smithi057 ceph-mon[36457]: from='osd.1 ' entity='osd.1' 2024-06-02T23:51:58.200 INFO:journalctl@ceph.osd.1.smithi057.stdout:Jun 02 23:51:57 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-1[41038]: 2024-06-02T23:51:57.746+0000 7f49cd0ac700 -1 osd.1 0 waiting for initial osdmap 2024-06-02T23:51:58.200 INFO:journalctl@ceph.osd.1.smithi057.stdout:Jun 02 23:51:57 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-1[41038]: 2024-06-02T23:51:57.751+0000 7f49c5698700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T23:51:58.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:57 smithi049 ceph-mon[32302]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2024-06-02T23:51:58.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:57 smithi049 ceph-mon[32302]: osdmap e12: 2 total, 1 up, 2 in 2024-06-02T23:51:58.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:57 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:51:58.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:57 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:51:58.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:57 smithi049 ceph-mon[32302]: from='osd.1 ' entity='osd.1' 2024-06-02T23:51:58.267 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi107:vg_nvme/lv_4 2024-06-02T23:51:58.503 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T23:51:58.950 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:58 smithi107 ceph-mon[37048]: purged_snaps scrub starts 2024-06-02T23:51:58.951 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:58 smithi107 ceph-mon[37048]: purged_snaps scrub ok 2024-06-02T23:51:58.951 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:58 smithi107 ceph-mon[37048]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:58.951 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:58 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:51:58.951 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:58 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:58.951 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:58 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:58.951 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:58 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:51:58.952 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:58 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:58.952 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:58 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:58.952 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:58 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:51:58.952 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:58 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:58.952 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:58 smithi107 ceph-mon[37048]: osd.1 [v2:172.21.15.57:6800/1260507785,v1:172.21.15.57:6801/1260507785] boot 2024-06-02T23:51:58.952 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:58 smithi107 ceph-mon[37048]: osdmap e13: 2 total, 2 up, 2 in 2024-06-02T23:51:58.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:58 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:51:59.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:58 smithi057 ceph-mon[36457]: purged_snaps scrub starts 2024-06-02T23:51:59.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:58 smithi057 ceph-mon[36457]: purged_snaps scrub ok 2024-06-02T23:51:59.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:58 smithi057 ceph-mon[36457]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:59.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:58 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:51:59.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:58 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:59.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:58 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:59.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:58 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:51:59.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:58 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:59.202 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:58 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:59.202 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:58 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:51:59.202 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:58 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:59.202 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:58 smithi057 ceph-mon[36457]: osd.1 [v2:172.21.15.57:6800/1260507785,v1:172.21.15.57:6801/1260507785] boot 2024-06-02T23:51:59.202 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:58 smithi057 ceph-mon[36457]: osdmap e13: 2 total, 2 up, 2 in 2024-06-02T23:51:59.202 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:58 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:51:59.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:58 smithi049 ceph-mon[32302]: purged_snaps scrub starts 2024-06-02T23:51:59.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:58 smithi049 ceph-mon[32302]: purged_snaps scrub ok 2024-06-02T23:51:59.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:58 smithi049 ceph-mon[32302]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-06-02T23:51:59.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:58 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:51:59.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:58 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:59.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:58 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:59.212 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:58 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:51:59.212 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:58 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:59.212 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:58 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:51:59.212 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:58 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:51:59.212 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:58 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:51:59.212 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:58 smithi049 ceph-mon[32302]: osd.1 [v2:172.21.15.57:6800/1260507785,v1:172.21.15.57:6801/1260507785] boot 2024-06-02T23:51:59.212 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:58 smithi049 ceph-mon[32302]: osdmap e13: 2 total, 2 up, 2 in 2024-06-02T23:51:59.213 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:58 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T23:51:59.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.924+0000 7f6cb2166700 1 -- 172.21.15.107:0/2277629885 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cac102f80 msgr2=0x7f6cac109830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:51:59.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.924+0000 7f6cb2166700 1 --2- 172.21.15.107:0/2277629885 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cac102f80 0x7f6cac109830 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6ca400b0a0 tx=0x7f6ca400b3b0 comp rx=0 tx=0).stop 2024-06-02T23:51:59.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.924+0000 7f6cb2166700 1 -- 172.21.15.107:0/2277629885 shutdown_connections 2024-06-02T23:51:59.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.924+0000 7f6cb2166700 1 --2- 172.21.15.107:0/2277629885 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cac102f80 0x7f6cac109830 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:51:59.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.924+0000 7f6cb2166700 1 --2- 172.21.15.107:0/2277629885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6cac1013e0 0x7f6cac101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:51:59.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.924+0000 7f6cb2166700 1 --2- 172.21.15.107:0/2277629885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6cac1025e0 0x7f6cac102a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:51:59.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.924+0000 7f6cb2166700 1 -- 172.21.15.107:0/2277629885 >> 172.21.15.107:0/2277629885 conn(0x7f6cac0fc980 msgr2=0x7f6cac0fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:51:59.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.924+0000 7f6cb2166700 1 -- 172.21.15.107:0/2277629885 shutdown_connections 2024-06-02T23:51:59.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.924+0000 7f6cb2166700 1 -- 172.21.15.107:0/2277629885 wait complete. 2024-06-02T23:51:59.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.925+0000 7f6cb2166700 1 Processor -- start 2024-06-02T23:51:59.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.925+0000 7f6cb2166700 1 -- start start 2024-06-02T23:51:59.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.925+0000 7f6cb2166700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6cac1013e0 0x7f6cac105370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:51:59.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.925+0000 7f6cb2166700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6cac1025e0 0x7f6cac1039c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:51:59.928 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.925+0000 7f6cb2166700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cac102f80 0x7f6cac103f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:51:59.928 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.925+0000 7f6cb2166700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6cac10d0c0 con 0x7f6cac1025e0 2024-06-02T23:51:59.928 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.925+0000 7f6cb2166700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6cac10cf40 con 0x7f6cac1013e0 2024-06-02T23:51:59.928 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.925+0000 7f6cb2166700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6cac10d240 con 0x7f6cac102f80 2024-06-02T23:51:59.928 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.925+0000 7f6cabfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cac102f80 0x7f6cac103f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:51:59.928 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.925+0000 7f6cabfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cac102f80 0x7f6cac103f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59168/0 (socket says 172.21.15.107:59168) 2024-06-02T23:51:59.928 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.925+0000 7f6cabfff700 1 -- 172.21.15.107:0/1112368554 learned_addr learned my addr 172.21.15.107:0/1112368554 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-06-02T23:51:59.928 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.925+0000 7f6cab7fe700 1 --2- 172.21.15.107:0/1112368554 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6cac1013e0 0x7f6cac105370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:51:59.928 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.926+0000 7f6caaffd700 1 --2- 172.21.15.107:0/1112368554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6cac1025e0 0x7f6cac1039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:51:59.928 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.926+0000 7f6cabfff700 1 -- 172.21.15.107:0/1112368554 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6cac1013e0 msgr2=0x7f6cac105370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:51:59.928 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.926+0000 7f6cabfff700 1 --2- 172.21.15.107:0/1112368554 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6cac1013e0 0x7f6cac105370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:51:59.928 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.926+0000 7f6cabfff700 1 -- 172.21.15.107:0/1112368554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6cac1025e0 msgr2=0x7f6cac1039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:51:59.928 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.926+0000 7f6cabfff700 1 --2- 172.21.15.107:0/1112368554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6cac1025e0 0x7f6cac1039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:51:59.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.926+0000 7f6cabfff700 1 -- 172.21.15.107:0/1112368554 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cac1047b0 con 0x7f6cac102f80 2024-06-02T23:51:59.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.926+0000 7f6cabfff700 1 --2- 172.21.15.107:0/1112368554 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cac102f80 0x7f6cac103f00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6ca400b070 tx=0x7f6ca400be60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:51:59.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.926+0000 7f6ca8ff9700 1 -- 172.21.15.107:0/1112368554 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca4021020 con 0x7f6cac102f80 2024-06-02T23:51:59.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.926+0000 7f6cb2166700 1 -- 172.21.15.107:0/1112368554 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cac1a2900 con 0x7f6cac102f80 2024-06-02T23:51:59.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.926+0000 7f6ca8ff9700 1 -- 172.21.15.107:0/1112368554 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ca4005520 con 0x7f6cac102f80 2024-06-02T23:51:59.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.926+0000 7f6ca8ff9700 1 -- 172.21.15.107:0/1112368554 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca401b900 con 0x7f6cac102f80 2024-06-02T23:51:59.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.926+0000 7f6cb2166700 1 -- 172.21.15.107:0/1112368554 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cac1a2de0 con 0x7f6cac102f80 2024-06-02T23:51:59.930 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.927+0000 7f6cb2166700 1 -- 172.21.15.107:0/1112368554 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cac069180 con 0x7f6cac102f80 2024-06-02T23:51:59.930 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.928+0000 7f6ca8ff9700 1 -- 172.21.15.107:0/1112368554 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f6ca4024020 con 0x7f6cac102f80 2024-06-02T23:51:59.930 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.929+0000 7f6ca8ff9700 1 --2- 172.21.15.107:0/1112368554 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6c940a2b90 0x7f6c940a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:51:59.930 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.929+0000 7f6ca8ff9700 1 -- 172.21.15.107:0/1112368554 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7f6ca400f020 con 0x7f6cac102f80 2024-06-02T23:51:59.930 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.929+0000 7f6cab7fe700 1 --2- 172.21.15.107:0/1112368554 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6c940a2b90 0x7f6c940a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:51:59.930 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.929+0000 7f6cab7fe700 1 --2- 172.21.15.107:0/1112368554 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6c940a2b90 0x7f6c940a5050 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6cac102440 tx=0x7f6c9c009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:51:59.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:51:59.933+0000 7f6ca8ff9700 1 -- 172.21.15.107:0/1112368554 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6ca409d120 con 0x7f6cac102f80 2024-06-02T23:52:00.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:59 smithi107 ceph-mon[37048]: Detected new or changed devices on smithi057 2024-06-02T23:52:00.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:51:59 smithi107 ceph-mon[37048]: Adjusting osd_memory_target on smithi057 to 17093M 2024-06-02T23:52:00.135 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:52:00.135+0000 7f6cb2166700 1 -- 172.21.15.107:0/1112368554 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f6cac0feb30 con 0x7f6c940a2b90 2024-06-02T23:52:00.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:59 smithi057 ceph-mon[36457]: Detected new or changed devices on smithi057 2024-06-02T23:52:00.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:51:59 smithi057 ceph-mon[36457]: Adjusting osd_memory_target on smithi057 to 17093M 2024-06-02T23:52:00.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:59 smithi049 ceph-mon[32302]: Detected new or changed devices on smithi057 2024-06-02T23:52:00.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:51:59 smithi049 ceph-mon[32302]: Adjusting osd_memory_target on smithi057 to 17093M 2024-06-02T23:52:01.000 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:00 smithi107 ceph-mon[37048]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:01.000 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:00 smithi107 ceph-mon[37048]: osdmap e14: 2 total, 2 up, 2 in 2024-06-02T23:52:01.000 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:00 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:52:01.001 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:00 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:52:01.001 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:00 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:52:01.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:00 smithi057 ceph-mon[36457]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:01.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:00 smithi057 ceph-mon[36457]: osdmap e14: 2 total, 2 up, 2 in 2024-06-02T23:52:01.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:00 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:52:01.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:00 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:52:01.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:00 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:52:01.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:00 smithi049 ceph-mon[32302]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:01.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:00 smithi049 ceph-mon[32302]: osdmap e14: 2 total, 2 up, 2 in 2024-06-02T23:52:01.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:00 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:52:01.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:00 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:52:01.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:00 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:52:01.934 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:01 smithi107 ceph-mon[37048]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:52:02.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:01 smithi057 ceph-mon[36457]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:52:02.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:01 smithi049 ceph-mon[32302]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:52:03.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:02 smithi107 ceph-mon[37048]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:03.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:02 smithi107 ceph-mon[37048]: from='client.? 172.21.15.107:0/3955572234' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "94889281-7d45-4e78-9d37-b98e3fbe8494"}]: dispatch 2024-06-02T23:52:03.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:02 smithi107 ceph-mon[37048]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "94889281-7d45-4e78-9d37-b98e3fbe8494"}]: dispatch 2024-06-02T23:52:03.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:02 smithi107 ceph-mon[37048]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "94889281-7d45-4e78-9d37-b98e3fbe8494"}]': finished 2024-06-02T23:52:03.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:02 smithi107 ceph-mon[37048]: osdmap e15: 3 total, 2 up, 3 in 2024-06-02T23:52:03.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:02 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:52:03.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:02 smithi057 ceph-mon[36457]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:03.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:02 smithi057 ceph-mon[36457]: from='client.? 172.21.15.107:0/3955572234' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "94889281-7d45-4e78-9d37-b98e3fbe8494"}]: dispatch 2024-06-02T23:52:03.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:02 smithi057 ceph-mon[36457]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "94889281-7d45-4e78-9d37-b98e3fbe8494"}]: dispatch 2024-06-02T23:52:03.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:02 smithi057 ceph-mon[36457]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "94889281-7d45-4e78-9d37-b98e3fbe8494"}]': finished 2024-06-02T23:52:03.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:02 smithi057 ceph-mon[36457]: osdmap e15: 3 total, 2 up, 3 in 2024-06-02T23:52:03.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:02 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:52:03.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:02 smithi049 ceph-mon[32302]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:03.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:02 smithi049 ceph-mon[32302]: from='client.? 172.21.15.107:0/3955572234' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "94889281-7d45-4e78-9d37-b98e3fbe8494"}]: dispatch 2024-06-02T23:52:03.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:02 smithi049 ceph-mon[32302]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "94889281-7d45-4e78-9d37-b98e3fbe8494"}]: dispatch 2024-06-02T23:52:03.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:02 smithi049 ceph-mon[32302]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "94889281-7d45-4e78-9d37-b98e3fbe8494"}]': finished 2024-06-02T23:52:03.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:02 smithi049 ceph-mon[32302]: osdmap e15: 3 total, 2 up, 3 in 2024-06-02T23:52:03.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:02 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:52:04.112 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:03 smithi049 ceph-mon[32302]: from='client.? 172.21.15.107:0/1654582148' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:52:04.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:03 smithi057 ceph-mon[36457]: from='client.? 172.21.15.107:0/1654582148' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:52:04.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:03 smithi107 ceph-mon[37048]: from='client.? 172.21.15.107:0/1654582148' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:52:05.115 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:04 smithi057 ceph-mon[36457]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:05.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:04 smithi049 ceph-mon[32302]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:05.253 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:04 smithi107 ceph-mon[37048]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:07.077 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:06 smithi107 ceph-mon[37048]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:07.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:06 smithi057 ceph-mon[36457]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:07.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:06 smithi049 ceph-mon[32302]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:09.135 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:08 smithi107 ceph-mon[37048]: pgmap v71: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:09.202 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:08 smithi057 ceph-mon[36457]: pgmap v71: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:09.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:08 smithi049 ceph-mon[32302]: pgmap v71: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:11.167 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:10 smithi107 ceph-mon[37048]: pgmap v72: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:11.167 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:10 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-02T23:52:11.167 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:10 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:52:11.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:10 smithi057 ceph-mon[36457]: pgmap v72: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:11.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:10 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-02T23:52:11.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:10 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:52:11.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:10 smithi049 ceph-mon[32302]: pgmap v72: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:11.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-02T23:52:11.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:52:12.162 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:11 smithi107 ceph-mon[37048]: Deploying daemon osd.2 on smithi107 2024-06-02T23:52:12.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:11 smithi057 ceph-mon[36457]: Deploying daemon osd.2 on smithi107 2024-06-02T23:52:12.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:11 smithi049 ceph-mon[32302]: Deploying daemon osd.2 on smithi107 2024-06-02T23:52:13.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:12 smithi057 ceph-mon[36457]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:13.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:12 smithi049 ceph-mon[32302]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:13.241 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:12 smithi107 ceph-mon[37048]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:15.033 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:14 smithi107 ceph-mon[37048]: pgmap v74: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:15.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:14 smithi057 ceph-mon[36457]: pgmap v74: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:15.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:14 smithi049 ceph-mon[32302]: pgmap v74: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:16.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:16 smithi057 ceph-mon[36457]: pgmap v75: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:16.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:16 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:16.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:16 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:16.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:16 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:52:16.816 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:16 smithi107 ceph-mon[37048]: pgmap v75: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:16.817 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:16 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:16.817 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:16 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:16.817 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:16 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:52:16.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:16 smithi049 ceph-mon[32302]: pgmap v75: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:16.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:16 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:16.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:16 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:16.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:16 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:52:18.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:52:18.555+0000 7f6ca8ff9700 1 -- 172.21.15.107:0/1112368554 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6cac0feb30 con 0x7f6c940a2b90 2024-06-02T23:52:18.555 INFO:teuthology.orchestra.run.smithi107.stdout:Created osd(s) 2 on host 'smithi107' 2024-06-02T23:52:18.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:52:18.557+0000 7f6cb2166700 1 -- 172.21.15.107:0/1112368554 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6c940a2b90 msgr2=0x7f6c940a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:52:18.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:52:18.557+0000 7f6cb2166700 1 --2- 172.21.15.107:0/1112368554 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6c940a2b90 0x7f6c940a5050 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6cac102440 tx=0x7f6c9c009190 comp rx=0 tx=0).stop 2024-06-02T23:52:18.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:52:18.557+0000 7f6cb2166700 1 -- 172.21.15.107:0/1112368554 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cac102f80 msgr2=0x7f6cac103f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:52:18.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:52:18.557+0000 7f6cb2166700 1 --2- 172.21.15.107:0/1112368554 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cac102f80 0x7f6cac103f00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6ca400b070 tx=0x7f6ca400be60 comp rx=0 tx=0).stop 2024-06-02T23:52:18.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:52:18.557+0000 7f6cb2166700 1 -- 172.21.15.107:0/1112368554 shutdown_connections 2024-06-02T23:52:18.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:52:18.557+0000 7f6cb2166700 1 --2- 172.21.15.107:0/1112368554 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6c940a2b90 0x7f6c940a5050 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:52:18.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:52:18.557+0000 7f6cb2166700 1 --2- 172.21.15.107:0/1112368554 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cac102f80 0x7f6cac103f00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:52:18.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:52:18.557+0000 7f6cb2166700 1 --2- 172.21.15.107:0/1112368554 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6cac1013e0 0x7f6cac105370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:52:18.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:52:18.557+0000 7f6cb2166700 1 --2- 172.21.15.107:0/1112368554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6cac1025e0 0x7f6cac1039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:52:18.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:52:18.557+0000 7f6cb2166700 1 -- 172.21.15.107:0/1112368554 >> 172.21.15.107:0/1112368554 conn(0x7f6cac0fc980 msgr2=0x7f6cac0fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:52:18.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:52:18.558+0000 7f6cb2166700 1 -- 172.21.15.107:0/1112368554 shutdown_connections 2024-06-02T23:52:18.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:52:18.558+0000 7f6cb2166700 1 -- 172.21.15.107:0/1112368554 wait complete. 2024-06-02T23:52:18.733 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:18 smithi107 ceph-mon[37048]: pgmap v76: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:18.734 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:18 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:18.734 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:18 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:18.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:18 smithi057 ceph-mon[36457]: pgmap v76: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:18.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:18 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:18.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:18 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:18.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:18 smithi049 ceph-mon[32302]: pgmap v76: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:18.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:18 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:18.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:18 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:19.415 DEBUG:teuthology.orchestra.run.smithi107:osd.2> sudo journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.2.service 2024-06-02T23:52:19.418 INFO:tasks.cephadm:Deploying osd.3 on smithi049 with /dev/vg_nvme/lv_3... 2024-06-02T23:52:19.418 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-06-02T23:52:19.681 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:52:19.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:19 smithi049 ceph-mon[32302]: from='osd.2 [v2:172.21.15.107:6800/303899951,v1:172.21.15.107:6801/303899951]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-02T23:52:19.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:19 smithi049 ceph-mon[32302]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-02T23:52:19.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:19 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:19.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:19 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:19.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:19 smithi107 ceph-mon[37048]: from='osd.2 [v2:172.21.15.107:6800/303899951,v1:172.21.15.107:6801/303899951]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-02T23:52:19.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:19 smithi107 ceph-mon[37048]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-02T23:52:19.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:19 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:19.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:19 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:19.851 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 02 23:52:19 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-2[42135]: 2024-06-02T23:52:19.530+0000 7fcaef1e17c0 -1 osd.2 0 log_to_monitors true 2024-06-02T23:52:19.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:19 smithi057 ceph-mon[36457]: from='osd.2 [v2:172.21.15.107:6800/303899951,v1:172.21.15.107:6801/303899951]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-02T23:52:19.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:19 smithi057 ceph-mon[36457]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-02T23:52:19.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:19 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:19.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:19 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:20.844 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:20 smithi107 ceph-mon[37048]: pgmap v77: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:20.844 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:20 smithi107 ceph-mon[37048]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-02T23:52:20.844 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:20 smithi107 ceph-mon[37048]: osdmap e16: 3 total, 2 up, 3 in 2024-06-02T23:52:20.844 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:20 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:52:20.844 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:20 smithi107 ceph-mon[37048]: from='osd.2 [v2:172.21.15.107:6800/303899951,v1:172.21.15.107:6801/303899951]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-06-02T23:52:20.844 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:20 smithi107 ceph-mon[37048]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-06-02T23:52:20.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:20 smithi057 ceph-mon[36457]: pgmap v77: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:20.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:20 smithi057 ceph-mon[36457]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-02T23:52:20.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:20 smithi057 ceph-mon[36457]: osdmap e16: 3 total, 2 up, 3 in 2024-06-02T23:52:20.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:20 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:52:20.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:20 smithi057 ceph-mon[36457]: from='osd.2 [v2:172.21.15.107:6800/303899951,v1:172.21.15.107:6801/303899951]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-06-02T23:52:20.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:20 smithi057 ceph-mon[36457]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-06-02T23:52:20.960 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:20 smithi049 ceph-mon[32302]: pgmap v77: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:20.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:20 smithi049 ceph-mon[32302]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-02T23:52:20.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:20 smithi049 ceph-mon[32302]: osdmap e16: 3 total, 2 up, 3 in 2024-06-02T23:52:20.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:20 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:52:20.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:20 smithi049 ceph-mon[32302]: from='osd.2 [v2:172.21.15.107:6800/303899951,v1:172.21.15.107:6801/303899951]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-06-02T23:52:20.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:20 smithi049 ceph-mon[32302]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-06-02T23:52:21.639 INFO:teuthology.orchestra.run.smithi049.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-06-02T23:52:21.639 INFO:teuthology.orchestra.run.smithi049.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-06-02T23:52:21.639 INFO:teuthology.orchestra.run.smithi049.stderr: stderr: 10+0 records in 2024-06-02T23:52:21.639 INFO:teuthology.orchestra.run.smithi049.stderr:10+0 records out 2024-06-02T23:52:21.639 INFO:teuthology.orchestra.run.smithi049.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0099417 s, 1.1 GB/s 2024-06-02T23:52:21.639 INFO:teuthology.orchestra.run.smithi049.stderr:--> Zapping successful for: 2024-06-02T23:52:21.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:21 smithi107 ceph-mon[37048]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-06-02T23:52:21.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:21 smithi107 ceph-mon[37048]: osdmap e17: 3 total, 2 up, 3 in 2024-06-02T23:52:21.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:21 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:52:21.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:21 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:52:21.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:21 smithi107 ceph-mon[37048]: from='osd.2 ' entity='osd.2' 2024-06-02T23:52:21.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:21 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:52:21.851 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 02 23:52:21 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-2[42135]: 2024-06-02T23:52:21.434+0000 7fcae5847700 -1 osd.2 0 waiting for initial osdmap 2024-06-02T23:52:21.851 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 02 23:52:21 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-2[42135]: 2024-06-02T23:52:21.440+0000 7fcadc630700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T23:52:21.937 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:21 smithi049 ceph-mon[32302]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-06-02T23:52:21.937 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:21 smithi049 ceph-mon[32302]: osdmap e17: 3 total, 2 up, 3 in 2024-06-02T23:52:21.937 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:21 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:52:21.937 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:21 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:52:21.937 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:21 smithi049 ceph-mon[32302]: from='osd.2 ' entity='osd.2' 2024-06-02T23:52:21.937 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:21 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:52:21.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:21 smithi057 ceph-mon[36457]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-06-02T23:52:21.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:21 smithi057 ceph-mon[36457]: osdmap e17: 3 total, 2 up, 3 in 2024-06-02T23:52:21.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:21 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:52:21.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:21 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:52:21.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:21 smithi057 ceph-mon[36457]: from='osd.2 ' entity='osd.2' 2024-06-02T23:52:21.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:21 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:52:22.224 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi049:vg_nvme/lv_3 2024-06-02T23:52:22.483 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:52:22.776 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:22 smithi049 ceph-mon[32302]: purged_snaps scrub starts 2024-06-02T23:52:22.776 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:22 smithi049 ceph-mon[32302]: purged_snaps scrub ok 2024-06-02T23:52:22.776 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:22 smithi049 ceph-mon[32302]: pgmap v80: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:22.776 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:22 smithi049 ceph-mon[32302]: osd.2 [v2:172.21.15.107:6800/303899951,v1:172.21.15.107:6801/303899951] boot 2024-06-02T23:52:22.777 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:22 smithi049 ceph-mon[32302]: osdmap e18: 3 total, 3 up, 3 in 2024-06-02T23:52:22.777 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:22 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:52:22.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:22 smithi057 ceph-mon[36457]: purged_snaps scrub starts 2024-06-02T23:52:22.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:22 smithi057 ceph-mon[36457]: purged_snaps scrub ok 2024-06-02T23:52:22.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:22 smithi057 ceph-mon[36457]: pgmap v80: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:22.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:22 smithi057 ceph-mon[36457]: osd.2 [v2:172.21.15.107:6800/303899951,v1:172.21.15.107:6801/303899951] boot 2024-06-02T23:52:22.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:22 smithi057 ceph-mon[36457]: osdmap e18: 3 total, 3 up, 3 in 2024-06-02T23:52:22.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:22 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:52:23.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:22 smithi107 ceph-mon[37048]: purged_snaps scrub starts 2024-06-02T23:52:23.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:22 smithi107 ceph-mon[37048]: purged_snaps scrub ok 2024-06-02T23:52:23.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:22 smithi107 ceph-mon[37048]: pgmap v80: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-06-02T23:52:23.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:22 smithi107 ceph-mon[37048]: osd.2 [v2:172.21.15.107:6800/303899951,v1:172.21.15.107:6801/303899951] boot 2024-06-02T23:52:23.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:22 smithi107 ceph-mon[37048]: osdmap e18: 3 total, 3 up, 3 in 2024-06-02T23:52:23.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:22 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T23:52:24.041 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:23 smithi049 ceph-mon[32302]: Detected new or changed devices on smithi107 2024-06-02T23:52:24.041 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:23 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:24.041 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:23 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:24.041 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:23 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:52:24.041 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:23 smithi049 ceph-mon[32302]: Adjusting osd_memory_target on smithi107 to 17088M 2024-06-02T23:52:24.041 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:23 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:24.041 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:23 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:52:24.042 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:23 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:52:24.042 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:23 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:24.042 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:23 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:52:24.042 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:23 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:52:24.042 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:23 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:52:24.042 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:23 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:24.042 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:23 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-06-02T23:52:24.042 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:23 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-06-02T23:52:24.042 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:23 smithi049 ceph-mon[32302]: osdmap e19: 3 total, 3 up, 3 in 2024-06-02T23:52:24.042 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:23 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-06-02T23:52:24.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.151+0000 7f2b9028a700 1 -- 172.21.15.49:0/1954774582 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b88105930 msgr2=0x7f2b88107d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:52:24.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.151+0000 7f2b9028a700 1 --2- 172.21.15.49:0/1954774582 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b88105930 0x7f2b88107d20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2b78009990 tx=0x7f2b78009ca0 comp rx=0 tx=0).stop 2024-06-02T23:52:24.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.151+0000 7f2b9028a700 1 -- 172.21.15.49:0/1954774582 shutdown_connections 2024-06-02T23:52:24.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.151+0000 7f2b9028a700 1 --2- 172.21.15.49:0/1954774582 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b88108260 0x7f2b8810a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:52:24.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.151+0000 7f2b9028a700 1 --2- 172.21.15.49:0/1954774582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b88103000 0x7f2b881053f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:52:24.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.151+0000 7f2b9028a700 1 --2- 172.21.15.49:0/1954774582 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b88105930 0x7f2b88107d20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:52:24.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.151+0000 7f2b9028a700 1 -- 172.21.15.49:0/1954774582 >> 172.21.15.49:0/1954774582 conn(0x7f2b880fc9b0 msgr2=0x7f2b880fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:52:24.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.151+0000 7f2b9028a700 1 -- 172.21.15.49:0/1954774582 shutdown_connections 2024-06-02T23:52:24.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.151+0000 7f2b9028a700 1 -- 172.21.15.49:0/1954774582 wait complete. 2024-06-02T23:52:24.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.152+0000 7f2b9028a700 1 Processor -- start 2024-06-02T23:52:24.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.152+0000 7f2b9028a700 1 -- start start 2024-06-02T23:52:24.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.152+0000 7f2b9028a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b88103000 0x7f2b88102960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:52:24.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.152+0000 7f2b9028a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b88105930 0x7f2b88100fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:52:24.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.152+0000 7f2b9028a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b88108260 0x7f2b881014f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:52:24.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.152+0000 7f2b9028a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8810e0c0 con 0x7f2b88108260 2024-06-02T23:52:24.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.152+0000 7f2b9028a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8810df40 con 0x7f2b88105930 2024-06-02T23:52:24.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.152+0000 7f2b9028a700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8810e240 con 0x7f2b88103000 2024-06-02T23:52:24.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.152+0000 7f2b8e827700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b88108260 0x7f2b881014f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:52:24.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.152+0000 7f2b8e827700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b88108260 0x7f2b881014f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43372/0 (socket says 172.21.15.49:43372) 2024-06-02T23:52:24.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.152+0000 7f2b8e827700 1 -- 172.21.15.49:0/2732236769 learned_addr learned my addr 172.21.15.49:0/2732236769 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:52:24.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.152+0000 7f2b8e026700 1 --2- 172.21.15.49:0/2732236769 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b88103000 0x7f2b88102960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:52:24.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.152+0000 7f2b8d825700 1 --2- 172.21.15.49:0/2732236769 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b88105930 0x7f2b88100fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:52:24.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.153+0000 7f2b8e827700 1 -- 172.21.15.49:0/2732236769 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b88103000 msgr2=0x7f2b88102960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:52:24.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.153+0000 7f2b8e827700 1 --2- 172.21.15.49:0/2732236769 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b88103000 0x7f2b88102960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:52:24.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.153+0000 7f2b8e827700 1 -- 172.21.15.49:0/2732236769 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b88105930 msgr2=0x7f2b88100fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:52:24.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.153+0000 7f2b8e827700 1 --2- 172.21.15.49:0/2732236769 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b88105930 0x7f2b88100fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:52:24.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.153+0000 7f2b8e827700 1 -- 172.21.15.49:0/2732236769 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b88101da0 con 0x7f2b88108260 2024-06-02T23:52:24.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.153+0000 7f2b8e827700 1 --2- 172.21.15.49:0/2732236769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b88108260 0x7f2b881014f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2b800094f0 tx=0x7f2b8000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:52:24.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.153+0000 7f2b7f7fe700 1 -- 172.21.15.49:0/2732236769 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8000ddd0 con 0x7f2b88108260 2024-06-02T23:52:24.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.153+0000 7f2b9028a700 1 -- 172.21.15.49:0/2732236769 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b881a2860 con 0x7f2b88108260 2024-06-02T23:52:24.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.153+0000 7f2b7f7fe700 1 -- 172.21.15.49:0/2732236769 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b80009e20 con 0x7f2b88108260 2024-06-02T23:52:24.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.153+0000 7f2b7f7fe700 1 -- 172.21.15.49:0/2732236769 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b80015660 con 0x7f2b88108260 2024-06-02T23:52:24.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.153+0000 7f2b9028a700 1 -- 172.21.15.49:0/2732236769 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b881a2d20 con 0x7f2b88108260 2024-06-02T23:52:24.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.154+0000 7f2b9028a700 1 -- 172.21.15.49:0/2732236769 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b88069180 con 0x7f2b88108260 2024-06-02T23:52:24.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.155+0000 7f2b7f7fe700 1 -- 172.21.15.49:0/2732236769 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f2b80004ad0 con 0x7f2b88108260 2024-06-02T23:52:24.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.156+0000 7f2b7f7fe700 1 --2- 172.21.15.49:0/2732236769 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f2b740a2b90 0x7f2b740a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:52:24.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.156+0000 7f2b8e026700 1 --2- 172.21.15.49:0/2732236769 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f2b740a2b90 0x7f2b740a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:52:24.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.156+0000 7f2b7f7fe700 1 -- 172.21.15.49:0/2732236769 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3226+0+0 (secure 0 0 0) 0x7f2b800cd620 con 0x7f2b88108260 2024-06-02T23:52:24.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.156+0000 7f2b8e026700 1 --2- 172.21.15.49:0/2732236769 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f2b740a2b90 0x7f2b740a5050 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2b84009c60 tx=0x7f2b84009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:52:24.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.161+0000 7f2b7f7fe700 1 -- 172.21.15.49:0/2732236769 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2b80010070 con 0x7f2b88108260 2024-06-02T23:52:24.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:23 smithi107 ceph-mon[37048]: Detected new or changed devices on smithi107 2024-06-02T23:52:24.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:23 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:24.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:23 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:24.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:23 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:52:24.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:23 smithi107 ceph-mon[37048]: Adjusting osd_memory_target on smithi107 to 17088M 2024-06-02T23:52:24.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:23 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:24.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:23 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:52:24.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:23 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:52:24.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:23 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:24.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:23 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:52:24.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:23 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:52:24.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:23 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:52:24.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:23 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:24.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:23 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-06-02T23:52:24.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:23 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-06-02T23:52:24.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:23 smithi107 ceph-mon[37048]: osdmap e19: 3 total, 3 up, 3 in 2024-06-02T23:52:24.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:23 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-06-02T23:52:24.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:24.377+0000 7f2b9028a700 1 -- 172.21.15.49:0/2732236769 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f2b880628d0 con 0x7f2b740a2b90 2024-06-02T23:52:24.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:23 smithi057 ceph-mon[36457]: Detected new or changed devices on smithi107 2024-06-02T23:52:24.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:23 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:24.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:23 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:24.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:23 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:52:24.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:23 smithi057 ceph-mon[36457]: Adjusting osd_memory_target on smithi107 to 17088M 2024-06-02T23:52:24.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:23 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:24.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:23 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:52:24.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:23 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:52:24.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:23 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:24.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:23 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:52:24.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:23 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:52:24.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:23 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:52:24.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:23 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:24.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:23 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-06-02T23:52:24.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:23 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-06-02T23:52:24.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:23 smithi057 ceph-mon[36457]: osdmap e19: 3 total, 3 up, 3 in 2024-06-02T23:52:24.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:23 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-06-02T23:52:25.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:24 smithi049 ceph-mon[32302]: pgmap v82: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-06-02T23:52:25.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:24 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:52:25.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:24 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:52:25.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:24 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:52:25.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:24 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-06-02T23:52:25.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:24 smithi049 ceph-mon[32302]: osdmap e20: 3 total, 3 up, 3 in 2024-06-02T23:52:25.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:24 smithi107 ceph-mon[37048]: pgmap v82: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-06-02T23:52:25.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:24 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:52:25.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:24 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:52:25.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:24 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:52:25.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:24 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-06-02T23:52:25.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:24 smithi107 ceph-mon[37048]: osdmap e20: 3 total, 3 up, 3 in 2024-06-02T23:52:25.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:24 smithi057 ceph-mon[36457]: pgmap v82: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-06-02T23:52:25.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:24 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:52:25.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:24 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:52:25.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:24 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:52:25.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:24 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-06-02T23:52:25.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:24 smithi057 ceph-mon[36457]: osdmap e20: 3 total, 3 up, 3 in 2024-06-02T23:52:25.696 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 02 23:52:25 smithi049 sudo[49178]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-02T23:52:25.696 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 02 23:52:25 smithi049 sudo[49178]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T23:52:25.696 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 02 23:52:25 smithi049 sudo[49178]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T23:52:25.696 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 02 23:52:25 smithi049 sudo[49178]: pam_unix(sudo:session): session closed for user root 2024-06-02T23:52:25.956 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 02 23:52:25 smithi049 sudo[49185]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-02T23:52:25.956 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 02 23:52:25 smithi049 sudo[49185]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T23:52:25.956 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 02 23:52:25 smithi049 sudo[49185]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T23:52:25.956 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 02 23:52:25 smithi049 sudo[49185]: pam_unix(sudo:session): session closed for user root 2024-06-02T23:52:25.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:25.962+0000 7f2b7f7fe700 1 -- 172.21.15.49:0/2732236769 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2b800979b0 con 0x7f2b88108260 2024-06-02T23:52:26.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:25 smithi049 ceph-mon[32302]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:52:26.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:25 smithi049 ceph-mon[32302]: osdmap e21: 3 total, 3 up, 3 in 2024-06-02T23:52:26.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:25 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:26.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:25 smithi107 ceph-mon[37048]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:52:26.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:25 smithi107 ceph-mon[37048]: osdmap e21: 3 total, 3 up, 3 in 2024-06-02T23:52:26.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:25 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:26.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:25 smithi057 ceph-mon[36457]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:52:26.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:25 smithi057 ceph-mon[36457]: osdmap e21: 3 total, 3 up, 3 in 2024-06-02T23:52:26.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:25 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:26.450 INFO:journalctl@ceph.osd.1.smithi057.stdout:Jun 02 23:52:26 smithi057 sudo[45194]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-02T23:52:26.450 INFO:journalctl@ceph.osd.1.smithi057.stdout:Jun 02 23:52:26 smithi057 sudo[45194]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T23:52:26.450 INFO:journalctl@ceph.osd.1.smithi057.stdout:Jun 02 23:52:26 smithi057 sudo[45194]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T23:52:26.450 INFO:journalctl@ceph.osd.1.smithi057.stdout:Jun 02 23:52:26 smithi057 sudo[45194]: pam_unix(sudo:session): session closed for user root 2024-06-02T23:52:26.950 INFO:journalctl@ceph.osd.1.smithi057.stdout:Jun 02 23:52:26 smithi057 sudo[45197]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-02T23:52:26.950 INFO:journalctl@ceph.osd.1.smithi057.stdout:Jun 02 23:52:26 smithi057 sudo[45197]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T23:52:26.950 INFO:journalctl@ceph.osd.1.smithi057.stdout:Jun 02 23:52:26 smithi057 sudo[45197]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T23:52:26.950 INFO:journalctl@ceph.osd.1.smithi057.stdout:Jun 02 23:52:26 smithi057 sudo[45197]: pam_unix(sudo:session): session closed for user root 2024-06-02T23:52:27.152 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:26 smithi107 ceph-mon[37048]: pgmap v85: 1 pgs: 1 creating+peering; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-06-02T23:52:27.152 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:26 smithi107 ceph-mon[37048]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-06-02T23:52:27.152 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:26 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:27.152 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 02 23:52:26 smithi107 sudo[46036]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-02T23:52:27.152 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 02 23:52:26 smithi107 sudo[46036]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T23:52:27.153 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 02 23:52:26 smithi107 sudo[46036]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T23:52:27.153 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 02 23:52:26 smithi107 sudo[46036]: pam_unix(sudo:session): session closed for user root 2024-06-02T23:52:27.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:26 smithi049 ceph-mon[32302]: pgmap v85: 1 pgs: 1 creating+peering; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-06-02T23:52:27.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:26 smithi049 ceph-mon[32302]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-06-02T23:52:27.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:26 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:27.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:26 smithi057 ceph-mon[36457]: pgmap v85: 1 pgs: 1 creating+peering; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-06-02T23:52:27.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:26 smithi057 ceph-mon[36457]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-06-02T23:52:27.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:26 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:27.600 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 02 23:52:27 smithi107 sudo[46039]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-02T23:52:27.600 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 02 23:52:27 smithi107 sudo[46039]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T23:52:27.600 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 02 23:52:27 smithi107 sudo[46039]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T23:52:27.600 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 02 23:52:27 smithi107 sudo[46039]: pam_unix(sudo:session): session closed for user root 2024-06-02T23:52:27.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:27 smithi049 sudo[49292]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-02T23:52:27.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:27 smithi049 sudo[49292]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T23:52:27.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:27 smithi049 sudo[49292]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T23:52:27.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:27 smithi049 sudo[49292]: pam_unix(sudo:session): session closed for user root 2024-06-02T23:52:28.343 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:28 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/1195054463' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31f4c18c-fbda-400d-8b3b-0955b0c4a6a4"}]: dispatch 2024-06-02T23:52:28.344 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:28 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/1195054463' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31f4c18c-fbda-400d-8b3b-0955b0c4a6a4"}]': finished 2024-06-02T23:52:28.344 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:28 smithi107 ceph-mon[37048]: osdmap e22: 4 total, 3 up, 4 in 2024-06-02T23:52:28.344 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:28 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:52:28.344 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:28 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:28.344 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:28 smithi107 ceph-mon[37048]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T23:52:28.344 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:28 smithi107 sudo[46042]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-02T23:52:28.344 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:28 smithi107 sudo[46042]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T23:52:28.344 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:28 smithi107 sudo[46042]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T23:52:28.344 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:28 smithi107 sudo[46042]: pam_unix(sudo:session): session closed for user root 2024-06-02T23:52:28.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:28 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/1195054463' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31f4c18c-fbda-400d-8b3b-0955b0c4a6a4"}]: dispatch 2024-06-02T23:52:28.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:28 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/1195054463' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31f4c18c-fbda-400d-8b3b-0955b0c4a6a4"}]': finished 2024-06-02T23:52:28.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:28 smithi057 ceph-mon[36457]: osdmap e22: 4 total, 3 up, 4 in 2024-06-02T23:52:28.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:28 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:52:28.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:28 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:28.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:28 smithi057 ceph-mon[36457]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T23:52:28.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:28 smithi049 sudo[49295]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-02T23:52:28.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:28 smithi049 sudo[49295]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T23:52:28.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:28 smithi049 sudo[49295]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T23:52:28.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:28 smithi049 sudo[49295]: pam_unix(sudo:session): session closed for user root 2024-06-02T23:52:28.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:28 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/1195054463' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31f4c18c-fbda-400d-8b3b-0955b0c4a6a4"}]: dispatch 2024-06-02T23:52:28.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:28 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/1195054463' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31f4c18c-fbda-400d-8b3b-0955b0c4a6a4"}]': finished 2024-06-02T23:52:28.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:28 smithi049 ceph-mon[32302]: osdmap e22: 4 total, 3 up, 4 in 2024-06-02T23:52:28.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:28 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:52:28.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:28 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:28.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:28 smithi049 ceph-mon[32302]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T23:52:28.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:28 smithi107 sudo[46045]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-02T23:52:28.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:28 smithi107 sudo[46045]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T23:52:28.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:28 smithi107 sudo[46045]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T23:52:28.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:28 smithi107 sudo[46045]: pam_unix(sudo:session): session closed for user root 2024-06-02T23:52:29.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:29 smithi057 sudo[45200]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-02T23:52:29.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:29 smithi057 sudo[45200]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T23:52:29.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:29 smithi057 sudo[45200]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T23:52:29.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:29 smithi057 sudo[45200]: pam_unix(sudo:session): session closed for user root 2024-06-02T23:52:29.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:29 smithi107 ceph-mon[37048]: pgmap v88: 1 pgs: 1 creating+peering; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-06-02T23:52:29.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:29 smithi107 ceph-mon[37048]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T23:52:29.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:29 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T23:52:29.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:29 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T23:52:29.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:29 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T23:52:29.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:29 smithi107 ceph-mon[37048]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T23:52:29.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:29 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T23:52:29.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:29 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T23:52:29.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:29 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T23:52:29.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:29 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/2601205562' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:52:29.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:29 smithi107 ceph-mon[37048]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T23:52:29.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:29 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T23:52:29.852 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:29 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T23:52:29.852 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:29 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T23:52:29.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:29 smithi057 sudo[45203]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-02T23:52:29.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:29 smithi057 sudo[45203]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T23:52:29.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:29 smithi057 sudo[45203]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T23:52:29.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:29 smithi057 sudo[45203]: pam_unix(sudo:session): session closed for user root 2024-06-02T23:52:29.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:29 smithi057 ceph-mon[36457]: pgmap v88: 1 pgs: 1 creating+peering; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-06-02T23:52:29.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:29 smithi057 ceph-mon[36457]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T23:52:29.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:29 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T23:52:29.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:29 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T23:52:29.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:29 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T23:52:29.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:29 smithi057 ceph-mon[36457]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T23:52:29.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:29 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T23:52:29.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:29 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T23:52:29.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:29 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T23:52:29.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:29 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/2601205562' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:52:29.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:29 smithi057 ceph-mon[36457]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T23:52:29.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:29 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T23:52:29.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:29 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T23:52:29.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:29 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T23:52:29.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:29 smithi049 ceph-mon[32302]: pgmap v88: 1 pgs: 1 creating+peering; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-06-02T23:52:29.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:29 smithi049 ceph-mon[32302]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T23:52:29.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:29 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T23:52:29.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:29 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T23:52:29.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:29 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T23:52:29.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:29 smithi049 ceph-mon[32302]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T23:52:29.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:29 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T23:52:29.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:29 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T23:52:29.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:29 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T23:52:29.962 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:29 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/2601205562' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:52:29.962 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:29 smithi049 ceph-mon[32302]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T23:52:29.962 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:29 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T23:52:29.962 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:29 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T23:52:29.962 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:29 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T23:52:30.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:30 smithi107 ceph-mon[37048]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T23:52:30.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:30 smithi107 ceph-mon[37048]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-06-02T23:52:30.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:30 smithi107 ceph-mon[37048]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T23:52:30.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:30 smithi057 ceph-mon[36457]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T23:52:30.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:30 smithi057 ceph-mon[36457]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-06-02T23:52:30.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:30 smithi057 ceph-mon[36457]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T23:52:30.960 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:30 smithi049 ceph-mon[32302]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T23:52:30.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:30 smithi049 ceph-mon[32302]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-06-02T23:52:30.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:30 smithi049 ceph-mon[32302]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T23:52:32.786 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:32 smithi049 ceph-mon[32302]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-06-02T23:52:32.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:32 smithi107 ceph-mon[37048]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-06-02T23:52:32.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:32 smithi057 ceph-mon[36457]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-06-02T23:52:34.666 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:34 smithi049 ceph-mon[32302]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-06-02T23:52:34.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:34 smithi107 ceph-mon[37048]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-06-02T23:52:34.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:34 smithi057 ceph-mon[36457]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-06-02T23:52:35.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:35 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-02T23:52:35.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:35 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:52:35.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:35 smithi049 ceph-mon[32302]: Deploying daemon osd.3 on smithi049 2024-06-02T23:52:35.752 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:35 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-02T23:52:35.752 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:35 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:52:35.752 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:35 smithi107 ceph-mon[37048]: Deploying daemon osd.3 on smithi049 2024-06-02T23:52:35.851 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:35 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-02T23:52:35.852 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:35 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:52:35.852 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:35 smithi057 ceph-mon[36457]: Deploying daemon osd.3 on smithi049 2024-06-02T23:52:36.591 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:36 smithi049 ceph-mon[32302]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-06-02T23:52:36.768 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:36 smithi107 ceph-mon[37048]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-06-02T23:52:36.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:36 smithi057 ceph-mon[36457]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-06-02T23:52:38.575 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:38 smithi049 ceph-mon[32302]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-06-02T23:52:38.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:38 smithi107 ceph-mon[37048]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-06-02T23:52:38.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:38 smithi057 ceph-mon[36457]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-06-02T23:52:40.783 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:40 smithi049 ceph-mon[32302]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-06-02T23:52:40.783 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:40 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:40.784 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:40 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:40.784 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:40 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:52:40.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:40 smithi107 ceph-mon[37048]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-06-02T23:52:40.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:40.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:40.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:52:40.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:40 smithi057 ceph-mon[36457]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-06-02T23:52:40.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:40 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:40.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:40 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:40.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:40 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:52:42.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:42 smithi049 ceph-mon[32302]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-06-02T23:52:42.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:42 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:42.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:42 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:42.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:42 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:52:42.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:42 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:52:42.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:42 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:42.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:42 smithi107 ceph-mon[37048]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-06-02T23:52:42.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:42 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:42.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:42 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:42.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:42 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:52:42.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:42 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:52:42.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:42 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:42.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:42 smithi057 ceph-mon[36457]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-06-02T23:52:42.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:42 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:42.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:42 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:42.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:42 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:52:42.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:42 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:52:42.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:42 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:43.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:43.786+0000 7f2b7f7fe700 1 -- 172.21.15.49:0/2732236769 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2b880628d0 con 0x7f2b740a2b90 2024-06-02T23:52:43.786 INFO:teuthology.orchestra.run.smithi049.stdout:Created osd(s) 3 on host 'smithi049' 2024-06-02T23:52:43.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:43.788+0000 7f2b9028a700 1 -- 172.21.15.49:0/2732236769 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f2b740a2b90 msgr2=0x7f2b740a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:52:43.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:43.788+0000 7f2b9028a700 1 --2- 172.21.15.49:0/2732236769 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f2b740a2b90 0x7f2b740a5050 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2b84009c60 tx=0x7f2b84009260 comp rx=0 tx=0).stop 2024-06-02T23:52:43.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:43.788+0000 7f2b9028a700 1 -- 172.21.15.49:0/2732236769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b88108260 msgr2=0x7f2b881014f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:52:43.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:43.788+0000 7f2b9028a700 1 --2- 172.21.15.49:0/2732236769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b88108260 0x7f2b881014f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2b800094f0 tx=0x7f2b8000d3b0 comp rx=0 tx=0).stop 2024-06-02T23:52:43.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:43.788+0000 7f2b9028a700 1 -- 172.21.15.49:0/2732236769 shutdown_connections 2024-06-02T23:52:43.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:43.788+0000 7f2b9028a700 1 --2- 172.21.15.49:0/2732236769 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f2b740a2b90 0x7f2b740a5050 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:52:43.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:43.788+0000 7f2b9028a700 1 --2- 172.21.15.49:0/2732236769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b88108260 0x7f2b881014f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:52:43.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:43.788+0000 7f2b9028a700 1 --2- 172.21.15.49:0/2732236769 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b88103000 0x7f2b88102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:52:43.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:43.788+0000 7f2b9028a700 1 --2- 172.21.15.49:0/2732236769 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b88105930 0x7f2b88100fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:52:43.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:43.788+0000 7f2b9028a700 1 -- 172.21.15.49:0/2732236769 >> 172.21.15.49:0/2732236769 conn(0x7f2b880fc9b0 msgr2=0x7f2b88103a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:52:43.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:43.789+0000 7f2b9028a700 1 -- 172.21.15.49:0/2732236769 shutdown_connections 2024-06-02T23:52:43.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:52:43.789+0000 7f2b9028a700 1 -- 172.21.15.49:0/2732236769 wait complete. 2024-06-02T23:52:44.363 DEBUG:teuthology.orchestra.run.smithi049:osd.3> sudo journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.3.service 2024-06-02T23:52:44.366 INFO:tasks.cephadm:Deploying osd.4 on smithi057 with /dev/vg_nvme/lv_3... 2024-06-02T23:52:44.366 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-06-02T23:52:44.619 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T23:52:44.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:44 smithi049 ceph-mon[32302]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-06-02T23:52:44.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:44 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:44.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:44 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:44.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:44 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:52:44.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:44 smithi049 ceph-mon[32302]: from='osd.3 [v2:172.21.15.49:6810/60796312,v1:172.21.15.49:6811/60796312]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-02T23:52:45.047 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:44 smithi057 ceph-mon[36457]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-06-02T23:52:45.047 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:44 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:45.047 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:44 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:45.047 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:44 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:52:45.048 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:44 smithi057 ceph-mon[36457]: from='osd.3 [v2:172.21.15.49:6810/60796312,v1:172.21.15.49:6811/60796312]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-02T23:52:45.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:44 smithi107 ceph-mon[37048]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-06-02T23:52:45.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:44 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:45.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:44 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:45.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:44 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:52:45.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:44 smithi107 ceph-mon[37048]: from='osd.3 [v2:172.21.15.49:6810/60796312,v1:172.21.15.49:6811/60796312]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-02T23:52:46.063 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:45 smithi057 ceph-mon[36457]: from='osd.3 [v2:172.21.15.49:6810/60796312,v1:172.21.15.49:6811/60796312]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-02T23:52:46.063 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:45 smithi057 ceph-mon[36457]: osdmap e23: 4 total, 3 up, 4 in 2024-06-02T23:52:46.063 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:45 smithi057 ceph-mon[36457]: from='osd.3 [v2:172.21.15.49:6810/60796312,v1:172.21.15.49:6811/60796312]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-06-02T23:52:46.063 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:45 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:52:46.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:45 smithi107 ceph-mon[37048]: from='osd.3 [v2:172.21.15.49:6810/60796312,v1:172.21.15.49:6811/60796312]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-02T23:52:46.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:45 smithi107 ceph-mon[37048]: osdmap e23: 4 total, 3 up, 4 in 2024-06-02T23:52:46.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:45 smithi107 ceph-mon[37048]: from='osd.3 [v2:172.21.15.49:6810/60796312,v1:172.21.15.49:6811/60796312]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-06-02T23:52:46.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:45 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:52:46.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:45 smithi049 ceph-mon[32302]: from='osd.3 [v2:172.21.15.49:6810/60796312,v1:172.21.15.49:6811/60796312]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-02T23:52:46.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:45 smithi049 ceph-mon[32302]: osdmap e23: 4 total, 3 up, 4 in 2024-06-02T23:52:46.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:45 smithi049 ceph-mon[32302]: from='osd.3 [v2:172.21.15.49:6810/60796312,v1:172.21.15.49:6811/60796312]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-06-02T23:52:46.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:45 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:52:46.212 INFO:journalctl@ceph.osd.3.smithi049.stdout:Jun 02 23:52:45 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-3[51317]: 2024-06-02T23:52:45.764+0000 7fc3855cd700 -1 osd.3 0 waiting for initial osdmap 2024-06-02T23:52:46.212 INFO:journalctl@ceph.osd.3.smithi049.stdout:Jun 02 23:52:45 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-3[51317]: 2024-06-02T23:52:45.770+0000 7fc381bc1700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T23:52:46.467 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-06-02T23:52:46.467 INFO:teuthology.orchestra.run.smithi057.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-06-02T23:52:46.467 INFO:teuthology.orchestra.run.smithi057.stderr: stderr: 10+0 records in 2024-06-02T23:52:46.467 INFO:teuthology.orchestra.run.smithi057.stderr:10+0 records out 2024-06-02T23:52:46.467 INFO:teuthology.orchestra.run.smithi057.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.010541 s, 995 MB/s 2024-06-02T23:52:46.467 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping successful for: 2024-06-02T23:52:46.875 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:46 smithi049 ceph-mon[32302]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-06-02T23:52:46.876 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:46 smithi049 ceph-mon[32302]: from='osd.3 [v2:172.21.15.49:6810/60796312,v1:172.21.15.49:6811/60796312]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-06-02T23:52:46.876 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:46 smithi049 ceph-mon[32302]: osdmap e24: 4 total, 3 up, 4 in 2024-06-02T23:52:46.876 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:46 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:52:46.876 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:46 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:52:46.876 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:46 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:52:47.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:46 smithi107 ceph-mon[37048]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-06-02T23:52:47.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:46 smithi107 ceph-mon[37048]: from='osd.3 [v2:172.21.15.49:6810/60796312,v1:172.21.15.49:6811/60796312]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-06-02T23:52:47.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:46 smithi107 ceph-mon[37048]: osdmap e24: 4 total, 3 up, 4 in 2024-06-02T23:52:47.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:46 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:52:47.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:46 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:52:47.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:46 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:52:47.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:46 smithi057 ceph-mon[36457]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-06-02T23:52:47.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:46 smithi057 ceph-mon[36457]: from='osd.3 [v2:172.21.15.49:6810/60796312,v1:172.21.15.49:6811/60796312]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-06-02T23:52:47.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:46 smithi057 ceph-mon[36457]: osdmap e24: 4 total, 3 up, 4 in 2024-06-02T23:52:47.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:46 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:52:47.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:46 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:52:47.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:46 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:52:47.253 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi057:vg_nvme/lv_3 2024-06-02T23:52:47.502 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T23:52:47.937 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:47 smithi057 ceph-mon[36457]: purged_snaps scrub starts 2024-06-02T23:52:47.937 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:47 smithi057 ceph-mon[36457]: purged_snaps scrub ok 2024-06-02T23:52:47.937 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:47 smithi057 ceph-mon[36457]: osd.3 [v2:172.21.15.49:6810/60796312,v1:172.21.15.49:6811/60796312] boot 2024-06-02T23:52:47.937 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:47 smithi057 ceph-mon[36457]: osdmap e25: 4 total, 4 up, 4 in 2024-06-02T23:52:47.937 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:47 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:52:47.937 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:47 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:47.937 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:47 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:47.937 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:47 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:52:47.937 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:47 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:52:47.937 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:47 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:47.937 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:47 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:52:47.937 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:47 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:52:47.937 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:47 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:48.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:47 smithi107 ceph-mon[37048]: purged_snaps scrub starts 2024-06-02T23:52:48.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:47 smithi107 ceph-mon[37048]: purged_snaps scrub ok 2024-06-02T23:52:48.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:47 smithi107 ceph-mon[37048]: osd.3 [v2:172.21.15.49:6810/60796312,v1:172.21.15.49:6811/60796312] boot 2024-06-02T23:52:48.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:47 smithi107 ceph-mon[37048]: osdmap e25: 4 total, 4 up, 4 in 2024-06-02T23:52:48.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:47 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:52:48.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:47 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:48.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:47 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:48.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:47 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:52:48.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:47 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:52:48.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:47 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:48.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:47 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:52:48.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:47 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:52:48.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:47 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:48.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:47 smithi049 ceph-mon[32302]: purged_snaps scrub starts 2024-06-02T23:52:48.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:47 smithi049 ceph-mon[32302]: purged_snaps scrub ok 2024-06-02T23:52:48.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:47 smithi049 ceph-mon[32302]: osd.3 [v2:172.21.15.49:6810/60796312,v1:172.21.15.49:6811/60796312] boot 2024-06-02T23:52:48.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:47 smithi049 ceph-mon[32302]: osdmap e25: 4 total, 4 up, 4 in 2024-06-02T23:52:48.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:47 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T23:52:48.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:47 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:48.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:47 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:48.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:47 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:52:48.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:47 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:52:48.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:47 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:48.212 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:47 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:52:48.212 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:47 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:52:48.212 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:47 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:52:48.903 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:48 smithi057 ceph-mon[36457]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-06-02T23:52:48.903 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:48 smithi057 ceph-mon[36457]: Detected new or changed devices on smithi049 2024-06-02T23:52:48.903 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:48 smithi057 ceph-mon[36457]: Adjusting osd_memory_target on smithi049 to 8544M 2024-06-02T23:52:48.903 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:48 smithi057 ceph-mon[36457]: osdmap e26: 4 total, 4 up, 4 in 2024-06-02T23:52:49.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:48 smithi107 ceph-mon[37048]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-06-02T23:52:49.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:48 smithi107 ceph-mon[37048]: Detected new or changed devices on smithi049 2024-06-02T23:52:49.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:48 smithi107 ceph-mon[37048]: Adjusting osd_memory_target on smithi049 to 8544M 2024-06-02T23:52:49.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:48 smithi107 ceph-mon[37048]: osdmap e26: 4 total, 4 up, 4 in 2024-06-02T23:52:49.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.112+0000 7f8d96f8f700 1 -- 172.21.15.57:0/1179116883 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d90105950 msgr2=0x7f8d90107d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:52:49.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.112+0000 7f8d96f8f700 1 --2- 172.21.15.57:0/1179116883 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d90105950 0x7f8d90107d40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c009990 tx=0x7f8d7c009ca0 comp rx=0 tx=0).stop 2024-06-02T23:52:49.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.112+0000 7f8d96f8f700 1 -- 172.21.15.57:0/1179116883 shutdown_connections 2024-06-02T23:52:49.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.112+0000 7f8d96f8f700 1 --2- 172.21.15.57:0/1179116883 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d90108280 0x7f8d9010a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:52:49.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.112+0000 7f8d96f8f700 1 --2- 172.21.15.57:0/1179116883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d90103020 0x7f8d90105410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:52:49.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.112+0000 7f8d96f8f700 1 --2- 172.21.15.57:0/1179116883 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d90105950 0x7f8d90107d40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:52:49.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.112+0000 7f8d96f8f700 1 -- 172.21.15.57:0/1179116883 >> 172.21.15.57:0/1179116883 conn(0x7f8d900fc9f0 msgr2=0x7f8d900fee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:52:49.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.112+0000 7f8d96f8f700 1 -- 172.21.15.57:0/1179116883 shutdown_connections 2024-06-02T23:52:49.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.112+0000 7f8d96f8f700 1 -- 172.21.15.57:0/1179116883 wait complete. 2024-06-02T23:52:49.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.113+0000 7f8d96f8f700 1 Processor -- start 2024-06-02T23:52:49.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.113+0000 7f8d96f8f700 1 -- start start 2024-06-02T23:52:49.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.113+0000 7f8d96f8f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d90103020 0x7f8d90198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:52:49.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.113+0000 7f8d96f8f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d90105950 0x7f8d90198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:52:49.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.113+0000 7f8d96f8f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d90108280 0x7f8d9019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:52:49.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.113+0000 7f8d96f8f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9010e150 con 0x7f8d90108280 2024-06-02T23:52:49.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.113+0000 7f8d96f8f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9010dfd0 con 0x7f8d90105950 2024-06-02T23:52:49.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.113+0000 7f8d96f8f700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9010e2d0 con 0x7f8d90103020 2024-06-02T23:52:49.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.113+0000 7f8d8ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d90105950 0x7f8d90198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:52:49.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.113+0000 7f8d8ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d90105950 0x7f8d90198ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36388/0 (socket says 172.21.15.57:36388) 2024-06-02T23:52:49.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.113+0000 7f8d8ffff700 1 -- 172.21.15.57:0/593614910 learned_addr learned my addr 172.21.15.57:0/593614910 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-06-02T23:52:49.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.113+0000 7f8d9552c700 1 --2- 172.21.15.57:0/593614910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d90108280 0x7f8d9019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:52:49.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.113+0000 7f8d94d2b700 1 --2- 172.21.15.57:0/593614910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d90103020 0x7f8d90198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:52:49.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.114+0000 7f8d8ffff700 1 -- 172.21.15.57:0/593614910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d90103020 msgr2=0x7f8d90198760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:52:49.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.114+0000 7f8d8ffff700 1 --2- 172.21.15.57:0/593614910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d90103020 0x7f8d90198760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:52:49.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.114+0000 7f8d8ffff700 1 -- 172.21.15.57:0/593614910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d90108280 msgr2=0x7f8d9019fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:52:49.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.114+0000 7f8d8ffff700 1 --2- 172.21.15.57:0/593614910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d90108280 0x7f8d9019fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:52:49.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.114+0000 7f8d8ffff700 1 -- 172.21.15.57:0/593614910 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d901a03c0 con 0x7f8d90105950 2024-06-02T23:52:49.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.114+0000 7f8d8ffff700 1 --2- 172.21.15.57:0/593614910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d90105950 0x7f8d90198ca0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c003890 tx=0x7f8d7c0047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:52:49.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.114+0000 7f8d8dffb700 1 -- 172.21.15.57:0/593614910 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c026070 con 0x7f8d90105950 2024-06-02T23:52:49.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.114+0000 7f8d8dffb700 1 -- 172.21.15.57:0/593614910 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d7c004150 con 0x7f8d90105950 2024-06-02T23:52:49.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.114+0000 7f8d96f8f700 1 -- 172.21.15.57:0/593614910 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d901a0650 con 0x7f8d90105950 2024-06-02T23:52:49.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.114+0000 7f8d8dffb700 1 -- 172.21.15.57:0/593614910 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c00fdf0 con 0x7f8d90105950 2024-06-02T23:52:49.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.114+0000 7f8d96f8f700 1 -- 172.21.15.57:0/593614910 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d901a0b00 con 0x7f8d90105950 2024-06-02T23:52:49.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.115+0000 7f8d96f8f700 1 -- 172.21.15.57:0/593614910 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d90069180 con 0x7f8d90105950 2024-06-02T23:52:49.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.117+0000 7f8d8dffb700 1 -- 172.21.15.57:0/593614910 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8d7c029070 con 0x7f8d90105950 2024-06-02T23:52:49.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.117+0000 7f8d8dffb700 1 --2- 172.21.15.57:0/593614910 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8d800a2ca0 0x7f8d800a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:52:49.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.117+0000 7f8d8dffb700 1 -- 172.21.15.57:0/593614910 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3698+0+0 (secure 0 0 0) 0x7f8d7c0ce950 con 0x7f8d90105950 2024-06-02T23:52:49.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.118+0000 7f8d94d2b700 1 --2- 172.21.15.57:0/593614910 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8d800a2ca0 0x7f8d800a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:52:49.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.118+0000 7f8d94d2b700 1 --2- 172.21.15.57:0/593614910 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8d800a2ca0 0x7f8d800a5160 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8d84005950 tx=0x7f8d8400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:52:49.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.121+0000 7f8d8dffb700 1 -- 172.21.15.57:0/593614910 <== mon.2 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8d7c030080 con 0x7f8d90105950 2024-06-02T23:52:49.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:48 smithi049 ceph-mon[32302]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-06-02T23:52:49.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:48 smithi049 ceph-mon[32302]: Detected new or changed devices on smithi049 2024-06-02T23:52:49.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:48 smithi049 ceph-mon[32302]: Adjusting osd_memory_target on smithi049 to 8544M 2024-06-02T23:52:49.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:48 smithi049 ceph-mon[32302]: osdmap e26: 4 total, 4 up, 4 in 2024-06-02T23:52:49.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:52:49.341+0000 7f8d96f8f700 1 -- 172.21.15.57:0/593614910 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f8d90062990 con 0x7f8d800a2ca0 2024-06-02T23:52:50.076 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:49 smithi057 ceph-mon[36457]: osdmap e27: 4 total, 4 up, 4 in 2024-06-02T23:52:50.076 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:49 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:52:50.076 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:49 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:52:50.076 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:49 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:52:50.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:49 smithi107 ceph-mon[37048]: osdmap e27: 4 total, 4 up, 4 in 2024-06-02T23:52:50.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:49 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:52:50.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:49 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:52:50.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:49 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:52:50.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:49 smithi049 ceph-mon[32302]: osdmap e27: 4 total, 4 up, 4 in 2024-06-02T23:52:50.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:49 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:52:50.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:49 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:52:50.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:49 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:52:50.900 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:50 smithi057 ceph-mon[36457]: pgmap v104: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-06-02T23:52:50.900 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:50 smithi057 ceph-mon[36457]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:52:50.901 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:50 smithi057 ceph-mon[36457]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-06-02T23:52:50.901 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:50 smithi057 ceph-mon[36457]: osdmap e28: 4 total, 4 up, 4 in 2024-06-02T23:52:51.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:50 smithi107 ceph-mon[37048]: pgmap v104: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-06-02T23:52:51.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:50 smithi107 ceph-mon[37048]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:52:51.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:50 smithi107 ceph-mon[37048]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-06-02T23:52:51.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:50 smithi107 ceph-mon[37048]: osdmap e28: 4 total, 4 up, 4 in 2024-06-02T23:52:51.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:50 smithi049 ceph-mon[32302]: pgmap v104: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-06-02T23:52:51.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:50 smithi049 ceph-mon[32302]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:52:51.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:50 smithi049 ceph-mon[32302]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-06-02T23:52:51.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:50 smithi049 ceph-mon[32302]: osdmap e28: 4 total, 4 up, 4 in 2024-06-02T23:52:52.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:51 smithi107 ceph-mon[37048]: osdmap e29: 4 total, 4 up, 4 in 2024-06-02T23:52:52.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:51 smithi057 ceph-mon[36457]: osdmap e29: 4 total, 4 up, 4 in 2024-06-02T23:52:52.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:51 smithi049 ceph-mon[32302]: osdmap e29: 4 total, 4 up, 4 in 2024-06-02T23:52:53.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:52 smithi107 ceph-mon[37048]: pgmap v107: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-06-02T23:52:53.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:52 smithi107 ceph-mon[37048]: from='client.? 172.21.15.57:0/146909781' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8076c2f3-0138-459e-89b5-c5c4586a14ee"}]: dispatch 2024-06-02T23:52:53.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:52 smithi107 ceph-mon[37048]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8076c2f3-0138-459e-89b5-c5c4586a14ee"}]: dispatch 2024-06-02T23:52:53.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:52 smithi107 ceph-mon[37048]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8076c2f3-0138-459e-89b5-c5c4586a14ee"}]': finished 2024-06-02T23:52:53.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:52 smithi107 ceph-mon[37048]: osdmap e30: 5 total, 4 up, 5 in 2024-06-02T23:52:53.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:52 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:52:53.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:52 smithi107 ceph-mon[37048]: from='client.? 172.21.15.57:0/678798095' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:52:53.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:52 smithi057 ceph-mon[36457]: pgmap v107: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-06-02T23:52:53.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:52 smithi057 ceph-mon[36457]: from='client.? 172.21.15.57:0/146909781' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8076c2f3-0138-459e-89b5-c5c4586a14ee"}]: dispatch 2024-06-02T23:52:53.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:52 smithi057 ceph-mon[36457]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8076c2f3-0138-459e-89b5-c5c4586a14ee"}]: dispatch 2024-06-02T23:52:53.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:52 smithi057 ceph-mon[36457]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8076c2f3-0138-459e-89b5-c5c4586a14ee"}]': finished 2024-06-02T23:52:53.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:52 smithi057 ceph-mon[36457]: osdmap e30: 5 total, 4 up, 5 in 2024-06-02T23:52:53.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:52 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:52:53.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:52 smithi057 ceph-mon[36457]: from='client.? 172.21.15.57:0/678798095' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:52:53.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:52 smithi049 ceph-mon[32302]: pgmap v107: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-06-02T23:52:53.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:52 smithi049 ceph-mon[32302]: from='client.? 172.21.15.57:0/146909781' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8076c2f3-0138-459e-89b5-c5c4586a14ee"}]: dispatch 2024-06-02T23:52:53.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:52 smithi049 ceph-mon[32302]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8076c2f3-0138-459e-89b5-c5c4586a14ee"}]: dispatch 2024-06-02T23:52:53.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:52 smithi049 ceph-mon[32302]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8076c2f3-0138-459e-89b5-c5c4586a14ee"}]': finished 2024-06-02T23:52:53.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:52 smithi049 ceph-mon[32302]: osdmap e30: 5 total, 4 up, 5 in 2024-06-02T23:52:53.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:52 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:52:53.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:52 smithi049 ceph-mon[32302]: from='client.? 172.21.15.57:0/678798095' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:52:55.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:54 smithi057 ceph-mon[36457]: pgmap v109: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-06-02T23:52:55.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:54 smithi049 ceph-mon[32302]: pgmap v109: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-06-02T23:52:55.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:54 smithi107 ceph-mon[37048]: pgmap v109: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-06-02T23:52:56.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:55 smithi049 ceph-mon[32302]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-06-02T23:52:56.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:55 smithi049 ceph-mon[32302]: Cluster is now healthy 2024-06-02T23:52:56.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:55 smithi107 ceph-mon[37048]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-06-02T23:52:56.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:55 smithi107 ceph-mon[37048]: Cluster is now healthy 2024-06-02T23:52:56.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:55 smithi057 ceph-mon[36457]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-06-02T23:52:56.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:55 smithi057 ceph-mon[36457]: Cluster is now healthy 2024-06-02T23:52:57.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:56 smithi057 ceph-mon[36457]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-02T23:52:57.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:56 smithi107 ceph-mon[37048]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-02T23:52:57.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:56 smithi049 ceph-mon[32302]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-02T23:52:59.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:52:58 smithi057 ceph-mon[36457]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-06-02T23:52:59.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:52:58 smithi107 ceph-mon[37048]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-06-02T23:52:59.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:52:58 smithi049 ceph-mon[32302]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-06-02T23:53:01.293 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:00 smithi057 ceph-mon[36457]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-06-02T23:53:01.293 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:00 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-02T23:53:01.293 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:00 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:53:01.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:00 smithi107 ceph-mon[37048]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-06-02T23:53:01.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:00 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-02T23:53:01.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:00 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:53:01.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:00 smithi049 ceph-mon[32302]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-06-02T23:53:01.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:00 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-02T23:53:01.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:00 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:53:02.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:01 smithi057 ceph-mon[36457]: Deploying daemon osd.4 on smithi057 2024-06-02T23:53:02.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:01 smithi107 ceph-mon[37048]: Deploying daemon osd.4 on smithi057 2024-06-02T23:53:02.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:01 smithi049 ceph-mon[32302]: Deploying daemon osd.4 on smithi057 2024-06-02T23:53:03.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:02 smithi107 ceph-mon[37048]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-02T23:53:03.404 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:02 smithi057 ceph-mon[36457]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-02T23:53:03.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:02 smithi049 ceph-mon[32302]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-02T23:53:05.263 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:04 smithi049 ceph-mon[32302]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-06-02T23:53:05.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:04 smithi107 ceph-mon[37048]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-06-02T23:53:05.387 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:04 smithi057 ceph-mon[36457]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-06-02T23:53:07.176 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:06 smithi057 ceph-mon[36457]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-06-02T23:53:07.176 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:06 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:07.176 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:06 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:07.176 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:06 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:53:07.346 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:06 smithi107 ceph-mon[37048]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-06-02T23:53:07.347 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:06 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:07.347 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:06 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:07.347 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:06 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:53:07.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:06 smithi049 ceph-mon[32302]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-06-02T23:53:07.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:06 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:07.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:06 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:07.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:06 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:53:09.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:08 smithi057 ceph-mon[36457]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-02T23:53:09.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:08 smithi107 ceph-mon[37048]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-02T23:53:09.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:08 smithi049 ceph-mon[32302]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-02T23:53:10.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:53:10.010+0000 7f8d8dffb700 1 -- 172.21.15.57:0/593614910 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8d90062990 con 0x7f8d800a2ca0 2024-06-02T23:53:10.011 INFO:teuthology.orchestra.run.smithi057.stdout:Created osd(s) 4 on host 'smithi057' 2024-06-02T23:53:10.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:53:10.013+0000 7f8d96f8f700 1 -- 172.21.15.57:0/593614910 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8d800a2ca0 msgr2=0x7f8d800a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:53:10.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:53:10.013+0000 7f8d96f8f700 1 --2- 172.21.15.57:0/593614910 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8d800a2ca0 0x7f8d800a5160 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8d84005950 tx=0x7f8d8400b410 comp rx=0 tx=0).stop 2024-06-02T23:53:10.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:53:10.013+0000 7f8d96f8f700 1 -- 172.21.15.57:0/593614910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d90105950 msgr2=0x7f8d90198ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:53:10.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:53:10.013+0000 7f8d96f8f700 1 --2- 172.21.15.57:0/593614910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d90105950 0x7f8d90198ca0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c003890 tx=0x7f8d7c0047b0 comp rx=0 tx=0).stop 2024-06-02T23:53:10.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:53:10.013+0000 7f8d96f8f700 1 -- 172.21.15.57:0/593614910 shutdown_connections 2024-06-02T23:53:10.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:53:10.013+0000 7f8d96f8f700 1 --2- 172.21.15.57:0/593614910 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8d800a2ca0 0x7f8d800a5160 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:53:10.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:53:10.013+0000 7f8d96f8f700 1 --2- 172.21.15.57:0/593614910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d90108280 0x7f8d9019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:53:10.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:53:10.013+0000 7f8d96f8f700 1 --2- 172.21.15.57:0/593614910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d90103020 0x7f8d90198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:53:10.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:53:10.013+0000 7f8d96f8f700 1 --2- 172.21.15.57:0/593614910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d90105950 0x7f8d90198ca0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:53:10.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:53:10.013+0000 7f8d96f8f700 1 -- 172.21.15.57:0/593614910 >> 172.21.15.57:0/593614910 conn(0x7f8d900fc9f0 msgr2=0x7f8d90103960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:53:10.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:53:10.013+0000 7f8d96f8f700 1 -- 172.21.15.57:0/593614910 shutdown_connections 2024-06-02T23:53:10.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:53:10.013+0000 7f8d96f8f700 1 -- 172.21.15.57:0/593614910 wait complete. 2024-06-02T23:53:10.206 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:10 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:10.206 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:10 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:10.206 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:10 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:53:10.207 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:10 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:53:10.207 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:10 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:10.207 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:10 smithi057 ceph-mon[36457]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-02T23:53:10.207 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:10 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:10.207 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:10 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:10.207 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:10 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:53:10.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:10.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:10.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:53:10.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:53:10.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:10.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:10 smithi049 ceph-mon[32302]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-02T23:53:10.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:10.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:10.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:53:10.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:10 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:10.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:10 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:10.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:10 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:53:10.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:10 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:53:10.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:10 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:10.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:10 smithi107 ceph-mon[37048]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-02T23:53:10.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:10 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:10.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:10 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:10.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:10 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:53:10.688 DEBUG:teuthology.orchestra.run.smithi057:osd.4> sudo journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.4.service 2024-06-02T23:53:10.690 INFO:tasks.cephadm:Deploying osd.5 on smithi107 with /dev/vg_nvme/lv_3... 2024-06-02T23:53:10.690 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-06-02T23:53:10.933 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T23:53:11.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:11 smithi057 ceph-mon[36457]: from='osd.4 [v2:172.21.15.57:6808/3106842986,v1:172.21.15.57:6809/3106842986]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-02T23:53:11.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:11 smithi057 ceph-mon[36457]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-02T23:53:11.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:11 smithi107 ceph-mon[37048]: from='osd.4 [v2:172.21.15.57:6808/3106842986,v1:172.21.15.57:6809/3106842986]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-02T23:53:11.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:11 smithi107 ceph-mon[37048]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-02T23:53:11.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:11 smithi049 ceph-mon[32302]: from='osd.4 [v2:172.21.15.57:6808/3106842986,v1:172.21.15.57:6809/3106842986]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-02T23:53:11.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:11 smithi049 ceph-mon[32302]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-02T23:53:12.290 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:12 smithi107 ceph-mon[37048]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-02T23:53:12.290 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:12 smithi107 ceph-mon[37048]: osdmap e31: 5 total, 4 up, 5 in 2024-06-02T23:53:12.290 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:12 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:53:12.290 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:12 smithi107 ceph-mon[37048]: from='osd.4 [v2:172.21.15.57:6808/3106842986,v1:172.21.15.57:6809/3106842986]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-06-02T23:53:12.290 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:12 smithi107 ceph-mon[37048]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-06-02T23:53:12.291 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:12 smithi107 ceph-mon[37048]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-02T23:53:12.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:12 smithi057 ceph-mon[36457]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-02T23:53:12.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:12 smithi057 ceph-mon[36457]: osdmap e31: 5 total, 4 up, 5 in 2024-06-02T23:53:12.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:12 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:53:12.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:12 smithi057 ceph-mon[36457]: from='osd.4 [v2:172.21.15.57:6808/3106842986,v1:172.21.15.57:6809/3106842986]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-06-02T23:53:12.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:12 smithi057 ceph-mon[36457]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-06-02T23:53:12.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:12 smithi057 ceph-mon[36457]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-02T23:53:12.451 INFO:journalctl@ceph.osd.4.smithi057.stdout:Jun 02 23:53:12 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-4[48004]: 2024-06-02T23:53:12.182+0000 7f5e0f7e9700 -1 osd.4 0 waiting for initial osdmap 2024-06-02T23:53:12.451 INFO:journalctl@ceph.osd.4.smithi057.stdout:Jun 02 23:53:12 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-4[48004]: 2024-06-02T23:53:12.188+0000 7f5e0bddd700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T23:53:12.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:12 smithi049 ceph-mon[32302]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-02T23:53:12.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:12 smithi049 ceph-mon[32302]: osdmap e31: 5 total, 4 up, 5 in 2024-06-02T23:53:12.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:12 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:53:12.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:12 smithi049 ceph-mon[32302]: from='osd.4 [v2:172.21.15.57:6808/3106842986,v1:172.21.15.57:6809/3106842986]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-06-02T23:53:12.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:12 smithi049 ceph-mon[32302]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-06-02T23:53:12.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:12 smithi049 ceph-mon[32302]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-02T23:53:12.856 INFO:teuthology.orchestra.run.smithi107.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-06-02T23:53:12.856 INFO:teuthology.orchestra.run.smithi107.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-06-02T23:53:12.856 INFO:teuthology.orchestra.run.smithi107.stderr: stderr: 10+0 records in 2024-06-02T23:53:12.856 INFO:teuthology.orchestra.run.smithi107.stderr:10+0 records out 2024-06-02T23:53:12.856 INFO:teuthology.orchestra.run.smithi107.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0128465 s, 816 MB/s 2024-06-02T23:53:12.856 INFO:teuthology.orchestra.run.smithi107.stderr:--> Zapping successful for: 2024-06-02T23:53:13.448 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:13 smithi107 ceph-mon[37048]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2024-06-02T23:53:13.448 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:13 smithi107 ceph-mon[37048]: osdmap e32: 5 total, 4 up, 5 in 2024-06-02T23:53:13.449 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:13 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:53:13.449 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:13 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:53:13.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:13 smithi057 ceph-mon[36457]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2024-06-02T23:53:13.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:13 smithi057 ceph-mon[36457]: osdmap e32: 5 total, 4 up, 5 in 2024-06-02T23:53:13.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:13 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:53:13.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:13 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:53:13.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:13 smithi049 ceph-mon[32302]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2024-06-02T23:53:13.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:13 smithi049 ceph-mon[32302]: osdmap e32: 5 total, 4 up, 5 in 2024-06-02T23:53:13.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:13 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:53:13.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:13 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:53:13.478 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi107:vg_nvme/lv_3 2024-06-02T23:53:13.713 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T23:53:14.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:14 smithi057 ceph-mon[36457]: purged_snaps scrub starts 2024-06-02T23:53:14.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:14 smithi057 ceph-mon[36457]: purged_snaps scrub ok 2024-06-02T23:53:14.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:14 smithi057 ceph-mon[36457]: osd.4 [v2:172.21.15.57:6808/3106842986,v1:172.21.15.57:6809/3106842986] boot 2024-06-02T23:53:14.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:14 smithi057 ceph-mon[36457]: osdmap e33: 5 total, 5 up, 5 in 2024-06-02T23:53:14.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:14 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:53:14.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:14 smithi057 ceph-mon[36457]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-02T23:53:14.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:14 smithi057 ceph-mon[36457]: Detected new or changed devices on smithi057 2024-06-02T23:53:14.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:14 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:14.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:14 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:14.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:14 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:53:14.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:14 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:53:14.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:14 smithi057 ceph-mon[36457]: Adjusting osd_memory_target on smithi057 to 8546M 2024-06-02T23:53:14.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:14 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:14.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:14 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:53:14.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:14 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:53:14.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:14 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:14.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:14 smithi107 ceph-mon[37048]: purged_snaps scrub starts 2024-06-02T23:53:14.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:14 smithi107 ceph-mon[37048]: purged_snaps scrub ok 2024-06-02T23:53:14.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:14 smithi107 ceph-mon[37048]: osd.4 [v2:172.21.15.57:6808/3106842986,v1:172.21.15.57:6809/3106842986] boot 2024-06-02T23:53:14.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:14 smithi107 ceph-mon[37048]: osdmap e33: 5 total, 5 up, 5 in 2024-06-02T23:53:14.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:14 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:53:14.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:14 smithi107 ceph-mon[37048]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-02T23:53:14.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:14 smithi107 ceph-mon[37048]: Detected new or changed devices on smithi057 2024-06-02T23:53:14.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:14 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:14.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:14 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:14.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:14 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:53:14.455 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:14 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:53:14.455 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:14 smithi107 ceph-mon[37048]: Adjusting osd_memory_target on smithi057 to 8546M 2024-06-02T23:53:14.455 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:14 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:14.455 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:14 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:53:14.455 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:14 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:53:14.455 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:14 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:14.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:14 smithi049 ceph-mon[32302]: purged_snaps scrub starts 2024-06-02T23:53:14.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:14 smithi049 ceph-mon[32302]: purged_snaps scrub ok 2024-06-02T23:53:14.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:14 smithi049 ceph-mon[32302]: osd.4 [v2:172.21.15.57:6808/3106842986,v1:172.21.15.57:6809/3106842986] boot 2024-06-02T23:53:14.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:14 smithi049 ceph-mon[32302]: osdmap e33: 5 total, 5 up, 5 in 2024-06-02T23:53:14.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:14 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T23:53:14.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:14 smithi049 ceph-mon[32302]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-02T23:53:14.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:14 smithi049 ceph-mon[32302]: Detected new or changed devices on smithi057 2024-06-02T23:53:14.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:14 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:14.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:14 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:14.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:14 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:53:14.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:14 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:53:14.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:14 smithi049 ceph-mon[32302]: Adjusting osd_memory_target on smithi057 to 8546M 2024-06-02T23:53:14.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:14 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:14.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:14 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:53:14.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:14 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:53:14.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:14 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:15.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.217+0000 7f206b83f700 1 -- 172.21.15.107:0/391949492 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20641036e0 msgr2=0x7f2064103b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:53:15.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.217+0000 7f206b83f700 1 --2- 172.21.15.107:0/391949492 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20641036e0 0x7f2064103b40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2060009990 tx=0x7f2060009ca0 comp rx=0 tx=0).stop 2024-06-02T23:53:15.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.218+0000 7f206b83f700 1 -- 172.21.15.107:0/391949492 shutdown_connections 2024-06-02T23:53:15.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.218+0000 7f206b83f700 1 --2- 172.21.15.107:0/391949492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2064104080 0x7f206410a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:53:15.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.218+0000 7f206b83f700 1 --2- 172.21.15.107:0/391949492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20641024e0 0x7f2064102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:53:15.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.218+0000 7f206b83f700 1 --2- 172.21.15.107:0/391949492 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20641036e0 0x7f2064103b40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:53:15.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.218+0000 7f206b83f700 1 -- 172.21.15.107:0/391949492 >> 172.21.15.107:0/391949492 conn(0x7f20640fda80 msgr2=0x7f20640ffec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:53:15.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.218+0000 7f206b83f700 1 -- 172.21.15.107:0/391949492 shutdown_connections 2024-06-02T23:53:15.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.218+0000 7f206b83f700 1 -- 172.21.15.107:0/391949492 wait complete. 2024-06-02T23:53:15.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.218+0000 7f206b83f700 1 Processor -- start 2024-06-02T23:53:15.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.218+0000 7f206b83f700 1 -- start start 2024-06-02T23:53:15.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.218+0000 7f206b83f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20641024e0 0x7f2064076230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:53:15.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.218+0000 7f206b83f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20641036e0 0x7f2064074880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:53:15.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.218+0000 7f206b83f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2064104080 0x7f2064074dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:53:15.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.218+0000 7f206b83f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f206410e0b0 con 0x7f2064104080 2024-06-02T23:53:15.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.218+0000 7f206b83f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f206410df30 con 0x7f20641036e0 2024-06-02T23:53:15.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.218+0000 7f206b83f700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f206410e230 con 0x7f20641024e0 2024-06-02T23:53:15.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.219+0000 7f20695db700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20641024e0 0x7f2064076230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:53:15.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.219+0000 7f20695db700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20641024e0 0x7f2064076230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42786/0 (socket says 172.21.15.107:42786) 2024-06-02T23:53:15.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.219+0000 7f20695db700 1 -- 172.21.15.107:0/2929104154 learned_addr learned my addr 172.21.15.107:0/2929104154 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-06-02T23:53:15.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.219+0000 7f2069ddc700 1 --2- 172.21.15.107:0/2929104154 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2064104080 0x7f2064074dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:53:15.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.219+0000 7f2068dda700 1 --2- 172.21.15.107:0/2929104154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20641036e0 0x7f2064074880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:53:15.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.219+0000 7f20695db700 1 -- 172.21.15.107:0/2929104154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20641036e0 msgr2=0x7f2064074880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:53:15.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.219+0000 7f20695db700 1 --2- 172.21.15.107:0/2929104154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20641036e0 0x7f2064074880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:53:15.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.219+0000 7f20695db700 1 -- 172.21.15.107:0/2929104154 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2064104080 msgr2=0x7f2064074dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:53:15.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.219+0000 7f20695db700 1 --2- 172.21.15.107:0/2929104154 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2064104080 0x7f2064074dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:53:15.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.219+0000 7f20695db700 1 -- 172.21.15.107:0/2929104154 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2064075670 con 0x7f20641024e0 2024-06-02T23:53:15.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.219+0000 7f20695db700 1 --2- 172.21.15.107:0/2929104154 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20641024e0 0x7f2064076230 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f205400c990 tx=0x7f205400cca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:53:15.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.219+0000 7f205a7fc700 1 -- 172.21.15.107:0/2929104154 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2054007940 con 0x7f20641024e0 2024-06-02T23:53:15.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.219+0000 7f205a7fc700 1 -- 172.21.15.107:0/2929104154 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f205400f450 con 0x7f20641024e0 2024-06-02T23:53:15.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.219+0000 7f206b83f700 1 -- 172.21.15.107:0/2929104154 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20641a27d0 con 0x7f20641024e0 2024-06-02T23:53:15.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.219+0000 7f205a7fc700 1 -- 172.21.15.107:0/2929104154 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2054018660 con 0x7f20641024e0 2024-06-02T23:53:15.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.219+0000 7f206b83f700 1 -- 172.21.15.107:0/2929104154 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20641a2ce0 con 0x7f20641024e0 2024-06-02T23:53:15.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.220+0000 7f206b83f700 1 -- 172.21.15.107:0/2929104154 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2064069180 con 0x7f20641024e0 2024-06-02T23:53:15.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.221+0000 7f205a7fc700 1 -- 172.21.15.107:0/2929104154 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f205400f600 con 0x7f20641024e0 2024-06-02T23:53:15.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.222+0000 7f205a7fc700 1 --2- 172.21.15.107:0/2929104154 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f20500a2c20 0x7f20500a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:53:15.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.222+0000 7f205a7fc700 1 -- 172.21.15.107:0/2929104154 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4101+0+0 (secure 0 0 0) 0x7f20540cde80 con 0x7f20641024e0 2024-06-02T23:53:15.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.222+0000 7f2068dda700 1 --2- 172.21.15.107:0/2929104154 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f20500a2c20 0x7f20500a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:53:15.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.223+0000 7f2068dda700 1 --2- 172.21.15.107:0/2929104154 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f20500a2c20 0x7f20500a50e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f206000b5c0 tx=0x7f2060003960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:53:15.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.227+0000 7f205a7fc700 1 -- 172.21.15.107:0/2929104154 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2054014030 con 0x7f20641024e0 2024-06-02T23:53:15.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:15 smithi107 ceph-mon[37048]: osdmap e34: 5 total, 5 up, 5 in 2024-06-02T23:53:15.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:15.431+0000 7f206b83f700 1 -- 172.21.15.107:0/2929104154 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f206402e080 con 0x7f20500a2c20 2024-06-02T23:53:15.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:15 smithi057 ceph-mon[36457]: osdmap e34: 5 total, 5 up, 5 in 2024-06-02T23:53:15.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:15 smithi049 ceph-mon[32302]: osdmap e34: 5 total, 5 up, 5 in 2024-06-02T23:53:16.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:16 smithi107 ceph-mon[37048]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:16.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:16 smithi107 ceph-mon[37048]: from='client.24253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:53:16.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:16 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:53:16.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:16 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:53:16.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:16 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:53:16.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:16 smithi049 ceph-mon[32302]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:16.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:16 smithi049 ceph-mon[32302]: from='client.24253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:53:16.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:16 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:53:16.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:16 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:53:16.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:16 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:53:16.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:16 smithi057 ceph-mon[36457]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:16.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:16 smithi057 ceph-mon[36457]: from='client.24253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:53:16.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:16 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:53:16.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:16 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:53:16.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:16 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:53:18.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:18 smithi049 ceph-mon[32302]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:18.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:18 smithi049 ceph-mon[32302]: from='client.? 172.21.15.107:0/3066231790' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "68f7abd3-4292-41fa-90ce-4ac34ea2b964"}]: dispatch 2024-06-02T23:53:18.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:18 smithi049 ceph-mon[32302]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "68f7abd3-4292-41fa-90ce-4ac34ea2b964"}]: dispatch 2024-06-02T23:53:18.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:18 smithi049 ceph-mon[32302]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "68f7abd3-4292-41fa-90ce-4ac34ea2b964"}]': finished 2024-06-02T23:53:18.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:18 smithi049 ceph-mon[32302]: osdmap e35: 6 total, 5 up, 6 in 2024-06-02T23:53:18.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:18 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:53:18.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:18 smithi107 ceph-mon[37048]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:18.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:18 smithi107 ceph-mon[37048]: from='client.? 172.21.15.107:0/3066231790' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "68f7abd3-4292-41fa-90ce-4ac34ea2b964"}]: dispatch 2024-06-02T23:53:18.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:18 smithi107 ceph-mon[37048]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "68f7abd3-4292-41fa-90ce-4ac34ea2b964"}]: dispatch 2024-06-02T23:53:18.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:18 smithi107 ceph-mon[37048]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "68f7abd3-4292-41fa-90ce-4ac34ea2b964"}]': finished 2024-06-02T23:53:18.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:18 smithi107 ceph-mon[37048]: osdmap e35: 6 total, 5 up, 6 in 2024-06-02T23:53:18.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:18 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:53:18.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:18 smithi057 ceph-mon[36457]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:18.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:18 smithi057 ceph-mon[36457]: from='client.? 172.21.15.107:0/3066231790' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "68f7abd3-4292-41fa-90ce-4ac34ea2b964"}]: dispatch 2024-06-02T23:53:18.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:18 smithi057 ceph-mon[36457]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "68f7abd3-4292-41fa-90ce-4ac34ea2b964"}]: dispatch 2024-06-02T23:53:18.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:18 smithi057 ceph-mon[36457]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "68f7abd3-4292-41fa-90ce-4ac34ea2b964"}]': finished 2024-06-02T23:53:18.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:18 smithi057 ceph-mon[36457]: osdmap e35: 6 total, 5 up, 6 in 2024-06-02T23:53:18.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:18 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:53:19.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:19 smithi107 ceph-mon[37048]: from='client.? 172.21.15.107:0/1154961541' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:53:19.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:19 smithi057 ceph-mon[36457]: from='client.? 172.21.15.107:0/1154961541' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:53:19.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:19 smithi049 ceph-mon[32302]: from='client.? 172.21.15.107:0/1154961541' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:53:20.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:20 smithi107 ceph-mon[37048]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:20.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:20 smithi057 ceph-mon[36457]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:20.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:20 smithi049 ceph-mon[32302]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:22.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:22 smithi107 ceph-mon[37048]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:22.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:22 smithi057 ceph-mon[36457]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:22.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:22 smithi049 ceph-mon[32302]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:24.495 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:24 smithi107 ceph-mon[37048]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:24.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:24 smithi057 ceph-mon[36457]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:24.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:24 smithi049 ceph-mon[32302]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:26.460 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:26 smithi107 ceph-mon[37048]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:26.460 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:26 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-02T23:53:26.460 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:26 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:53:26.460 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:26 smithi107 ceph-mon[37048]: Deploying daemon osd.5 on smithi107 2024-06-02T23:53:26.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:26 smithi057 ceph-mon[36457]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:26.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:26 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-02T23:53:26.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:26 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:53:26.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:26 smithi057 ceph-mon[36457]: Deploying daemon osd.5 on smithi107 2024-06-02T23:53:26.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:26 smithi049 ceph-mon[32302]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:26.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:26 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-02T23:53:26.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:26 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:53:26.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:26 smithi049 ceph-mon[32302]: Deploying daemon osd.5 on smithi107 2024-06-02T23:53:28.484 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:28 smithi107 ceph-mon[37048]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:28.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:28 smithi057 ceph-mon[36457]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:28.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:28 smithi049 ceph-mon[32302]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:30.319 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:30 smithi107 ceph-mon[37048]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:30.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:30 smithi057 ceph-mon[36457]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:30.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:30 smithi049 ceph-mon[32302]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:32.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:31 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:32.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:31 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:32.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:31 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:53:32.210 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:31 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:32.210 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:31 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:32.210 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:31 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:53:32.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:31 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:32.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:31 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:32.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:31 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:53:32.967 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:32 smithi107 ceph-mon[37048]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:33.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:32 smithi057 ceph-mon[36457]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:33.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:32 smithi049 ceph-mon[32302]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:34.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:34.452+0000 7f205a7fc700 1 -- 172.21.15.107:0/2929104154 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f206402e080 con 0x7f20500a2c20 2024-06-02T23:53:34.453 INFO:teuthology.orchestra.run.smithi107.stdout:Created osd(s) 5 on host 'smithi107' 2024-06-02T23:53:34.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:34.454+0000 7f206b83f700 1 -- 172.21.15.107:0/2929104154 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f20500a2c20 msgr2=0x7f20500a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:53:34.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:34.454+0000 7f206b83f700 1 --2- 172.21.15.107:0/2929104154 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f20500a2c20 0x7f20500a50e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f206000b5c0 tx=0x7f2060003960 comp rx=0 tx=0).stop 2024-06-02T23:53:34.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:34.454+0000 7f206b83f700 1 -- 172.21.15.107:0/2929104154 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20641024e0 msgr2=0x7f2064076230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:53:34.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:34.454+0000 7f206b83f700 1 --2- 172.21.15.107:0/2929104154 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20641024e0 0x7f2064076230 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f205400c990 tx=0x7f205400cca0 comp rx=0 tx=0).stop 2024-06-02T23:53:34.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:34.454+0000 7f206b83f700 1 -- 172.21.15.107:0/2929104154 shutdown_connections 2024-06-02T23:53:34.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:34.454+0000 7f206b83f700 1 --2- 172.21.15.107:0/2929104154 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f20500a2c20 0x7f20500a50e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:53:34.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:34.454+0000 7f206b83f700 1 --2- 172.21.15.107:0/2929104154 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2064104080 0x7f2064074dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:53:34.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:34.454+0000 7f206b83f700 1 --2- 172.21.15.107:0/2929104154 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20641024e0 0x7f2064076230 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:53:34.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:34.454+0000 7f206b83f700 1 --2- 172.21.15.107:0/2929104154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20641036e0 0x7f2064074880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:53:34.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:34.455+0000 7f206b83f700 1 -- 172.21.15.107:0/2929104154 >> 172.21.15.107:0/2929104154 conn(0x7f20640fda80 msgr2=0x7f20641069e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:53:34.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:34.455+0000 7f206b83f700 1 -- 172.21.15.107:0/2929104154 shutdown_connections 2024-06-02T23:53:34.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:53:34.455+0000 7f206b83f700 1 -- 172.21.15.107:0/2929104154 wait complete. 2024-06-02T23:53:34.752 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:34 smithi107 ceph-mon[37048]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:34.752 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:34 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:34.753 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:34 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:34.753 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:34 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:53:34.753 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:34 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:53:34.753 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:34 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:34.753 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:34 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:34.753 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:34 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:34.753 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:34 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:53:34.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:34 smithi057 ceph-mon[36457]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:34.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:34 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:34.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:34 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:34.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:34 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:53:34.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:34 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:53:34.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:34 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:34.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:34 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:34.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:34 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:34.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:34 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:53:34.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:34 smithi049 ceph-mon[32302]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:34.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:34 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:34.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:34 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:34.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:34 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:53:34.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:34 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:53:34.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:34 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:34.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:34 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:34.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:34 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:34.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:34 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:53:35.071 DEBUG:teuthology.orchestra.run.smithi107:osd.5> sudo journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.5.service 2024-06-02T23:53:35.073 INFO:tasks.cephadm:Deploying osd.6 on smithi049 with /dev/vg_nvme/lv_2... 2024-06-02T23:53:35.074 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-06-02T23:53:35.333 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:53:35.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:35 smithi049 ceph-mon[32302]: from='osd.5 [v2:172.21.15.107:6808/389294142,v1:172.21.15.107:6809/389294142]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-02T23:53:35.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:35 smithi049 ceph-mon[32302]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-02T23:53:35.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:35 smithi057 ceph-mon[36457]: from='osd.5 [v2:172.21.15.107:6808/389294142,v1:172.21.15.107:6809/389294142]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-02T23:53:35.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:35 smithi057 ceph-mon[36457]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-02T23:53:35.958 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:35 smithi107 ceph-mon[37048]: from='osd.5 [v2:172.21.15.107:6808/389294142,v1:172.21.15.107:6809/389294142]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-02T23:53:35.958 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:35 smithi107 ceph-mon[37048]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-02T23:53:36.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:36 smithi049 ceph-mon[32302]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:36.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:36 smithi049 ceph-mon[32302]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-02T23:53:36.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:36 smithi049 ceph-mon[32302]: osdmap e36: 6 total, 5 up, 6 in 2024-06-02T23:53:36.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:36 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:53:36.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:36 smithi049 ceph-mon[32302]: from='osd.5 [v2:172.21.15.107:6808/389294142,v1:172.21.15.107:6809/389294142]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-06-02T23:53:36.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:36 smithi049 ceph-mon[32302]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-06-02T23:53:36.781 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:36 smithi107 ceph-mon[37048]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:36.781 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:36 smithi107 ceph-mon[37048]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-02T23:53:36.781 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:36 smithi107 ceph-mon[37048]: osdmap e36: 6 total, 5 up, 6 in 2024-06-02T23:53:36.781 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:36 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:53:36.781 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:36 smithi107 ceph-mon[37048]: from='osd.5 [v2:172.21.15.107:6808/389294142,v1:172.21.15.107:6809/389294142]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-06-02T23:53:36.781 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:36 smithi107 ceph-mon[37048]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-06-02T23:53:36.782 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 02 23:53:36 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-02T23:53:36.639+0000 7faa22ba8700 -1 osd.5 0 waiting for initial osdmap 2024-06-02T23:53:36.782 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 02 23:53:36 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-02T23:53:36.649+0000 7faa1f19c700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T23:53:36.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:36 smithi057 ceph-mon[36457]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:36.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:36 smithi057 ceph-mon[36457]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-02T23:53:36.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:36 smithi057 ceph-mon[36457]: osdmap e36: 6 total, 5 up, 6 in 2024-06-02T23:53:36.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:36 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:53:36.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:36 smithi057 ceph-mon[36457]: from='osd.5 [v2:172.21.15.107:6808/389294142,v1:172.21.15.107:6809/389294142]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-06-02T23:53:36.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:36 smithi057 ceph-mon[36457]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-06-02T23:53:37.418 INFO:teuthology.orchestra.run.smithi049.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-06-02T23:53:37.419 INFO:teuthology.orchestra.run.smithi049.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-06-02T23:53:37.419 INFO:teuthology.orchestra.run.smithi049.stderr: stderr: 10+0 records in 2024-06-02T23:53:37.419 INFO:teuthology.orchestra.run.smithi049.stderr:10+0 records out 2024-06-02T23:53:37.419 INFO:teuthology.orchestra.run.smithi049.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00984327 s, 1.1 GB/s 2024-06-02T23:53:37.419 INFO:teuthology.orchestra.run.smithi049.stderr:--> Zapping successful for: 2024-06-02T23:53:37.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:37 smithi049 ceph-mon[32302]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-06-02T23:53:37.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:37 smithi049 ceph-mon[32302]: osdmap e37: 6 total, 5 up, 6 in 2024-06-02T23:53:37.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:37 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:53:37.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:37 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:53:37.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:37 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:53:37.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:37 smithi057 ceph-mon[36457]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-06-02T23:53:37.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:37 smithi057 ceph-mon[36457]: osdmap e37: 6 total, 5 up, 6 in 2024-06-02T23:53:37.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:37 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:53:37.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:37 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:53:37.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:37 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:53:38.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:37 smithi107 ceph-mon[37048]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-06-02T23:53:38.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:37 smithi107 ceph-mon[37048]: osdmap e37: 6 total, 5 up, 6 in 2024-06-02T23:53:38.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:37 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:53:38.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:37 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:53:38.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:37 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:53:38.173 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi049:vg_nvme/lv_2 2024-06-02T23:53:38.424 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:53:38.839 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:38 smithi049 ceph-mon[32302]: purged_snaps scrub starts 2024-06-02T23:53:38.839 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:38 smithi049 ceph-mon[32302]: purged_snaps scrub ok 2024-06-02T23:53:38.839 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:38 smithi049 ceph-mon[32302]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:38.839 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:38 smithi049 ceph-mon[32302]: osd.5 [v2:172.21.15.107:6808/389294142,v1:172.21.15.107:6809/389294142] boot 2024-06-02T23:53:38.839 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:38 smithi049 ceph-mon[32302]: osdmap e38: 6 total, 6 up, 6 in 2024-06-02T23:53:38.839 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:38 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:53:38.839 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:38 smithi049 ceph-mon[32302]: osdmap e39: 6 total, 6 up, 6 in 2024-06-02T23:53:38.839 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:38 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:38.839 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:38 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:38.840 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:38 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:53:38.840 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:38 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:53:38.840 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:38 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:38.840 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:38 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:53:38.840 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:38 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:53:38.840 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:38 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:38.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:38 smithi057 ceph-mon[36457]: purged_snaps scrub starts 2024-06-02T23:53:38.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:38 smithi057 ceph-mon[36457]: purged_snaps scrub ok 2024-06-02T23:53:38.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:38 smithi057 ceph-mon[36457]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:38.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:38 smithi057 ceph-mon[36457]: osd.5 [v2:172.21.15.107:6808/389294142,v1:172.21.15.107:6809/389294142] boot 2024-06-02T23:53:38.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:38 smithi057 ceph-mon[36457]: osdmap e38: 6 total, 6 up, 6 in 2024-06-02T23:53:38.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:38 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:53:38.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:38 smithi057 ceph-mon[36457]: osdmap e39: 6 total, 6 up, 6 in 2024-06-02T23:53:38.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:38 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:38.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:38 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:38.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:38 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:53:38.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:38 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:53:38.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:38 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:38.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:38 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:53:38.952 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:38 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:53:38.952 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:38 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:39.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:38 smithi107 ceph-mon[37048]: purged_snaps scrub starts 2024-06-02T23:53:39.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:38 smithi107 ceph-mon[37048]: purged_snaps scrub ok 2024-06-02T23:53:39.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:38 smithi107 ceph-mon[37048]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-02T23:53:39.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:38 smithi107 ceph-mon[37048]: osd.5 [v2:172.21.15.107:6808/389294142,v1:172.21.15.107:6809/389294142] boot 2024-06-02T23:53:39.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:38 smithi107 ceph-mon[37048]: osdmap e38: 6 total, 6 up, 6 in 2024-06-02T23:53:39.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:38 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T23:53:39.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:38 smithi107 ceph-mon[37048]: osdmap e39: 6 total, 6 up, 6 in 2024-06-02T23:53:39.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:38 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:39.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:38 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:39.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:38 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:53:39.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:38 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:53:39.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:38 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:39.102 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:38 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:53:39.102 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:38 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:53:39.102 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:38 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:39.936 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:39 smithi049 ceph-mon[32302]: Detected new or changed devices on smithi107 2024-06-02T23:53:39.937 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:39 smithi049 ceph-mon[32302]: Adjusting osd_memory_target on smithi107 to 8544M 2024-06-02T23:53:39.937 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:39 smithi049 ceph-mon[32302]: osdmap e40: 6 total, 6 up, 6 in 2024-06-02T23:53:39.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:39 smithi057 ceph-mon[36457]: Detected new or changed devices on smithi107 2024-06-02T23:53:39.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:39 smithi057 ceph-mon[36457]: Adjusting osd_memory_target on smithi107 to 8544M 2024-06-02T23:53:39.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:39 smithi057 ceph-mon[36457]: osdmap e40: 6 total, 6 up, 6 in 2024-06-02T23:53:40.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.045+0000 7f96fea80700 1 -- 172.21.15.49:0/2011808170 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96f81082a0 msgr2=0x7f96f810a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:53:40.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.045+0000 7f96fea80700 1 --2- 172.21.15.49:0/2011808170 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96f81082a0 0x7f96f810a690 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f96f000b0a0 tx=0x7f96f000b3b0 comp rx=0 tx=0).stop 2024-06-02T23:53:40.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.045+0000 7f96fea80700 1 -- 172.21.15.49:0/2011808170 shutdown_connections 2024-06-02T23:53:40.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.045+0000 7f96fea80700 1 --2- 172.21.15.49:0/2011808170 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96f81082a0 0x7f96f810a690 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:53:40.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.045+0000 7f96fea80700 1 --2- 172.21.15.49:0/2011808170 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96f8103040 0x7f96f8105430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:53:40.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.045+0000 7f96fea80700 1 --2- 172.21.15.49:0/2011808170 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96f8105970 0x7f96f8107d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:53:40.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.045+0000 7f96fea80700 1 -- 172.21.15.49:0/2011808170 >> 172.21.15.49:0/2011808170 conn(0x7f96f80fc990 msgr2=0x7f96f80fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:53:40.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.045+0000 7f96fea80700 1 -- 172.21.15.49:0/2011808170 shutdown_connections 2024-06-02T23:53:40.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.045+0000 7f96fea80700 1 -- 172.21.15.49:0/2011808170 wait complete. 2024-06-02T23:53:40.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.046+0000 7f96fea80700 1 Processor -- start 2024-06-02T23:53:40.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.046+0000 7f96fea80700 1 -- start start 2024-06-02T23:53:40.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.046+0000 7f96fea80700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96f8103040 0x7f96f81987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:53:40.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.046+0000 7f96fea80700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96f8105970 0x7f96f8198ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:53:40.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.046+0000 7f96fea80700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96f81082a0 0x7f96f819fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:53:40.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.046+0000 7f96fea80700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f96f810e190 con 0x7f96f8105970 2024-06-02T23:53:40.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.046+0000 7f96fea80700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f96f810e010 con 0x7f96f81082a0 2024-06-02T23:53:40.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.046+0000 7f96fea80700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f96f810e310 con 0x7f96f8103040 2024-06-02T23:53:40.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.046+0000 7f96f7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96f8105970 0x7f96f8198ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:53:40.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.046+0000 7f96f7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96f8105970 0x7f96f8198ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45148/0 (socket says 172.21.15.49:45148) 2024-06-02T23:53:40.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.046+0000 7f96f7fff700 1 -- 172.21.15.49:0/2048309089 learned_addr learned my addr 172.21.15.49:0/2048309089 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:53:40.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.046+0000 7f96fc81c700 1 --2- 172.21.15.49:0/2048309089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96f8103040 0x7f96f81987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:53:40.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.046+0000 7f96fd01d700 1 --2- 172.21.15.49:0/2048309089 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96f81082a0 0x7f96f819fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:53:40.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.046+0000 7f96f7fff700 1 -- 172.21.15.49:0/2048309089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96f8103040 msgr2=0x7f96f81987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:53:40.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.046+0000 7f96f7fff700 1 --2- 172.21.15.49:0/2048309089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96f8103040 0x7f96f81987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:53:40.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.046+0000 7f96f7fff700 1 -- 172.21.15.49:0/2048309089 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96f81082a0 msgr2=0x7f96f819fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:53:40.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.046+0000 7f96f7fff700 1 --2- 172.21.15.49:0/2048309089 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96f81082a0 0x7f96f819fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:53:40.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.047+0000 7f96f7fff700 1 -- 172.21.15.49:0/2048309089 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96f81a0400 con 0x7f96f8105970 2024-06-02T23:53:40.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.047+0000 7f96fc81c700 1 --2- 172.21.15.49:0/2048309089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96f8103040 0x7f96f81987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:53:40.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.047+0000 7f96f7fff700 1 --2- 172.21.15.49:0/2048309089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96f8105970 0x7f96f8198ce0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f96e400b560 tx=0x7f96e400b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:53:40.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.047+0000 7f96f5ffb700 1 -- 172.21.15.49:0/2048309089 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e4015020 con 0x7f96f8105970 2024-06-02T23:53:40.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.047+0000 7f96f5ffb700 1 -- 172.21.15.49:0/2048309089 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96e4011d10 con 0x7f96f8105970 2024-06-02T23:53:40.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.047+0000 7f96f5ffb700 1 -- 172.21.15.49:0/2048309089 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e400f2e0 con 0x7f96f8105970 2024-06-02T23:53:40.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.047+0000 7f96fea80700 1 -- 172.21.15.49:0/2048309089 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96f81a06f0 con 0x7f96f8105970 2024-06-02T23:53:40.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.047+0000 7f96fea80700 1 -- 172.21.15.49:0/2048309089 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96f81a0d00 con 0x7f96f8105970 2024-06-02T23:53:40.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.048+0000 7f96fea80700 1 -- 172.21.15.49:0/2048309089 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96f8069180 con 0x7f96f8105970 2024-06-02T23:53:40.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.049+0000 7f96f5ffb700 1 -- 172.21.15.49:0/2048309089 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f96e4018020 con 0x7f96f8105970 2024-06-02T23:53:40.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.050+0000 7f96f5ffb700 1 --2- 172.21.15.49:0/2048309089 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f96e80a2ca0 0x7f96e80a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:53:40.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.050+0000 7f96fc81c700 1 --2- 172.21.15.49:0/2048309089 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f96e80a2ca0 0x7f96e80a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:53:40.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.050+0000 7f96f5ffb700 1 -- 172.21.15.49:0/2048309089 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4562+0+0 (secure 0 0 0) 0x7f96e40cd980 con 0x7f96f8105970 2024-06-02T23:53:40.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.050+0000 7f96fc81c700 1 --2- 172.21.15.49:0/2048309089 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f96e80a2ca0 0x7f96e80a5160 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f96ec0099d0 tx=0x7f96ec008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:53:40.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.054+0000 7f96f5ffb700 1 -- 172.21.15.49:0/2048309089 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f96e401f020 con 0x7f96f8105970 2024-06-02T23:53:40.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:39 smithi107 ceph-mon[37048]: Detected new or changed devices on smithi107 2024-06-02T23:53:40.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:39 smithi107 ceph-mon[37048]: Adjusting osd_memory_target on smithi107 to 8544M 2024-06-02T23:53:40.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:39 smithi107 ceph-mon[37048]: osdmap e40: 6 total, 6 up, 6 in 2024-06-02T23:53:40.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:40.272+0000 7f96fea80700 1 -- 172.21.15.49:0/2048309089 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f96f80628d0 con 0x7f96e80a2ca0 2024-06-02T23:53:40.907 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:40 smithi049 ceph-mon[32302]: pgmap v142: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-06-02T23:53:40.908 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:40 smithi049 ceph-mon[32302]: osdmap e41: 6 total, 6 up, 6 in 2024-06-02T23:53:40.908 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:40 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:53:40.908 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:40 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:53:40.908 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:40 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:53:40.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:40 smithi057 ceph-mon[36457]: pgmap v142: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-06-02T23:53:40.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:40 smithi057 ceph-mon[36457]: osdmap e41: 6 total, 6 up, 6 in 2024-06-02T23:53:40.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:40 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:53:40.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:40 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:53:40.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:40 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:53:41.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:40 smithi107 ceph-mon[37048]: pgmap v142: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-06-02T23:53:41.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:40 smithi107 ceph-mon[37048]: osdmap e41: 6 total, 6 up, 6 in 2024-06-02T23:53:41.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:53:41.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:53:41.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:53:41.923 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:41 smithi049 ceph-mon[32302]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:53:41.923 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:41 smithi049 ceph-mon[32302]: osdmap e42: 6 total, 6 up, 6 in 2024-06-02T23:53:41.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:41 smithi057 ceph-mon[36457]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:53:41.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:41 smithi057 ceph-mon[36457]: osdmap e42: 6 total, 6 up, 6 in 2024-06-02T23:53:42.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:41 smithi107 ceph-mon[37048]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:53:42.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:41 smithi107 ceph-mon[37048]: osdmap e42: 6 total, 6 up, 6 in 2024-06-02T23:53:42.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:42 smithi057 ceph-mon[36457]: pgmap v145: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-06-02T23:53:42.960 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:42 smithi049 ceph-mon[32302]: pgmap v145: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-06-02T23:53:43.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:42 smithi107 ceph-mon[37048]: pgmap v145: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-06-02T23:53:43.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:43 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/3942899841' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0345dd0-71b7-436d-88f8-fe3d7cb69d8e"}]: dispatch 2024-06-02T23:53:43.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:43 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/3942899841' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c0345dd0-71b7-436d-88f8-fe3d7cb69d8e"}]': finished 2024-06-02T23:53:43.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:43 smithi057 ceph-mon[36457]: osdmap e43: 7 total, 6 up, 7 in 2024-06-02T23:53:43.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:43 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T23:53:43.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:43 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/2393991930' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:53:43.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:43 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3942899841' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0345dd0-71b7-436d-88f8-fe3d7cb69d8e"}]: dispatch 2024-06-02T23:53:43.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:43 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3942899841' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c0345dd0-71b7-436d-88f8-fe3d7cb69d8e"}]': finished 2024-06-02T23:53:43.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:43 smithi049 ceph-mon[32302]: osdmap e43: 7 total, 6 up, 7 in 2024-06-02T23:53:43.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:43 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T23:53:43.962 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:43 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/2393991930' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:53:44.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:43 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/3942899841' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0345dd0-71b7-436d-88f8-fe3d7cb69d8e"}]: dispatch 2024-06-02T23:53:44.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:43 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/3942899841' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c0345dd0-71b7-436d-88f8-fe3d7cb69d8e"}]': finished 2024-06-02T23:53:44.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:43 smithi107 ceph-mon[37048]: osdmap e43: 7 total, 6 up, 7 in 2024-06-02T23:53:44.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:43 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T23:53:44.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:43 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/2393991930' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:53:45.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:44 smithi057 ceph-mon[36457]: pgmap v147: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-06-02T23:53:45.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:44 smithi049 ceph-mon[32302]: pgmap v147: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-06-02T23:53:45.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:44 smithi107 ceph-mon[37048]: pgmap v147: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-06-02T23:53:47.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:46 smithi057 ceph-mon[36457]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-02T23:53:47.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:46 smithi049 ceph-mon[32302]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-02T23:53:47.254 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:46 smithi107 ceph-mon[37048]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-02T23:53:49.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:48 smithi057 ceph-mon[36457]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-06-02T23:53:49.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:48 smithi049 ceph-mon[32302]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-06-02T23:53:49.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:48 smithi107 ceph-mon[37048]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-06-02T23:53:51.190 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:50 smithi049 ceph-mon[32302]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-06-02T23:53:51.190 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:50 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-02T23:53:51.190 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:50 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:53:51.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:50 smithi057 ceph-mon[36457]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-06-02T23:53:51.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:50 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-02T23:53:51.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:50 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:53:51.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:50 smithi107 ceph-mon[37048]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-06-02T23:53:51.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:50 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-02T23:53:51.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:50 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:53:52.164 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:51 smithi049 ceph-mon[32302]: Deploying daemon osd.6 on smithi049 2024-06-02T23:53:52.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:51 smithi107 ceph-mon[37048]: Deploying daemon osd.6 on smithi049 2024-06-02T23:53:52.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:51 smithi057 ceph-mon[36457]: Deploying daemon osd.6 on smithi049 2024-06-02T23:53:53.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:52 smithi057 ceph-mon[36457]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-02T23:53:53.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:52 smithi049 ceph-mon[32302]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-02T23:53:53.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:52 smithi107 ceph-mon[37048]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-02T23:53:55.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:54 smithi049 ceph-mon[32302]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-06-02T23:53:55.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:54 smithi107 ceph-mon[37048]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-06-02T23:53:55.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:54 smithi057 ceph-mon[36457]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-06-02T23:53:57.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:56 smithi057 ceph-mon[36457]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-06-02T23:53:57.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:57.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:57.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:53:57.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:56 smithi049 ceph-mon[32302]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-06-02T23:53:57.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:57.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:57.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:53:57.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:56 smithi107 ceph-mon[37048]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-06-02T23:53:57.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:57.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:57.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:53:59.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:58 smithi057 ceph-mon[36457]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-06-02T23:53:59.276 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:58 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:59.277 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:58 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:59.277 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:58 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:53:59.277 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:58 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:53:59.277 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:53:58 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:59.278 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:58 smithi049 ceph-mon[32302]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-06-02T23:53:59.278 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:58 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:59.278 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:58 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:59.279 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:58 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:53:59.279 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:58 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:53:59.279 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:53:58 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:59.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:58 smithi107 ceph-mon[37048]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-06-02T23:53:59.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:58 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:59.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:58 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:59.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:58 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:53:59.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:58 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:53:59.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:53:58 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:53:59.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:59.786+0000 7f96f5ffb700 1 -- 172.21.15.49:0/2048309089 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f96f80628d0 con 0x7f96e80a2ca0 2024-06-02T23:53:59.786 INFO:teuthology.orchestra.run.smithi049.stdout:Created osd(s) 6 on host 'smithi049' 2024-06-02T23:53:59.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:59.789+0000 7f96fea80700 1 -- 172.21.15.49:0/2048309089 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f96e80a2ca0 msgr2=0x7f96e80a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:53:59.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:59.789+0000 7f96fea80700 1 --2- 172.21.15.49:0/2048309089 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f96e80a2ca0 0x7f96e80a5160 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f96ec0099d0 tx=0x7f96ec008040 comp rx=0 tx=0).stop 2024-06-02T23:53:59.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:59.789+0000 7f96fea80700 1 -- 172.21.15.49:0/2048309089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96f8105970 msgr2=0x7f96f8198ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:53:59.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:59.789+0000 7f96fea80700 1 --2- 172.21.15.49:0/2048309089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96f8105970 0x7f96f8198ce0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f96e400b560 tx=0x7f96e400b920 comp rx=0 tx=0).stop 2024-06-02T23:53:59.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:59.789+0000 7f96fea80700 1 -- 172.21.15.49:0/2048309089 shutdown_connections 2024-06-02T23:53:59.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:59.789+0000 7f96fea80700 1 --2- 172.21.15.49:0/2048309089 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f96e80a2ca0 0x7f96e80a5160 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:53:59.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:59.789+0000 7f96fea80700 1 --2- 172.21.15.49:0/2048309089 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96f81082a0 0x7f96f819fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:53:59.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:59.789+0000 7f96fea80700 1 --2- 172.21.15.49:0/2048309089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96f8103040 0x7f96f81987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:53:59.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:59.789+0000 7f96fea80700 1 --2- 172.21.15.49:0/2048309089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96f8105970 0x7f96f8198ce0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:53:59.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:59.789+0000 7f96fea80700 1 -- 172.21.15.49:0/2048309089 >> 172.21.15.49:0/2048309089 conn(0x7f96f80fc990 msgr2=0x7f96f8103980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:53:59.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:59.789+0000 7f96fea80700 1 -- 172.21.15.49:0/2048309089 shutdown_connections 2024-06-02T23:53:59.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:53:59.789+0000 7f96fea80700 1 -- 172.21.15.49:0/2048309089 wait complete. 2024-06-02T23:54:00.387 DEBUG:teuthology.orchestra.run.smithi049:osd.6> sudo journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.6.service 2024-06-02T23:54:00.390 INFO:tasks.cephadm:Deploying osd.7 on smithi057 with /dev/vg_nvme/lv_2... 2024-06-02T23:54:00.390 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-06-02T23:54:00.647 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T23:54:00.960 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:00 smithi049 ceph-mon[32302]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-06-02T23:54:00.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:00 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:00.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:00 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:00.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:00 smithi049 ceph-mon[32302]: from='osd.6 [v2:172.21.15.49:6818/894624552,v1:172.21.15.49:6819/894624552]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-02T23:54:00.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:00 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:54:01.003 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:00 smithi057 ceph-mon[36457]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-06-02T23:54:01.003 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:00 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:01.003 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:00 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:01.003 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:00 smithi057 ceph-mon[36457]: from='osd.6 [v2:172.21.15.49:6818/894624552,v1:172.21.15.49:6819/894624552]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-02T23:54:01.003 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:00 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:54:01.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:00 smithi107 ceph-mon[37048]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-06-02T23:54:01.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:00 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:01.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:00 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:01.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:00 smithi107 ceph-mon[37048]: from='osd.6 [v2:172.21.15.49:6818/894624552,v1:172.21.15.49:6819/894624552]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-02T23:54:01.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:00 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:54:02.062 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:01 smithi057 ceph-mon[36457]: from='osd.6 [v2:172.21.15.49:6818/894624552,v1:172.21.15.49:6819/894624552]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-02T23:54:02.062 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:01 smithi057 ceph-mon[36457]: osdmap e44: 7 total, 6 up, 7 in 2024-06-02T23:54:02.063 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:01 smithi057 ceph-mon[36457]: from='osd.6 [v2:172.21.15.49:6818/894624552,v1:172.21.15.49:6819/894624552]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-06-02T23:54:02.063 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:01 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T23:54:02.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:01 smithi107 ceph-mon[37048]: from='osd.6 [v2:172.21.15.49:6818/894624552,v1:172.21.15.49:6819/894624552]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-02T23:54:02.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:01 smithi107 ceph-mon[37048]: osdmap e44: 7 total, 6 up, 7 in 2024-06-02T23:54:02.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:01 smithi107 ceph-mon[37048]: from='osd.6 [v2:172.21.15.49:6818/894624552,v1:172.21.15.49:6819/894624552]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-06-02T23:54:02.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:01 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T23:54:02.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:01 smithi049 ceph-mon[32302]: from='osd.6 [v2:172.21.15.49:6818/894624552,v1:172.21.15.49:6819/894624552]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-02T23:54:02.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:01 smithi049 ceph-mon[32302]: osdmap e44: 7 total, 6 up, 7 in 2024-06-02T23:54:02.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:01 smithi049 ceph-mon[32302]: from='osd.6 [v2:172.21.15.49:6818/894624552,v1:172.21.15.49:6819/894624552]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-06-02T23:54:02.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:01 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T23:54:02.668 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-06-02T23:54:02.668 INFO:teuthology.orchestra.run.smithi057.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-06-02T23:54:02.668 INFO:teuthology.orchestra.run.smithi057.stderr: stderr: 10+0 records in 2024-06-02T23:54:02.668 INFO:teuthology.orchestra.run.smithi057.stderr:10+0 records out 2024-06-02T23:54:02.668 INFO:teuthology.orchestra.run.smithi057.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0128685 s, 815 MB/s 2024-06-02T23:54:02.669 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping successful for: 2024-06-02T23:54:02.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:02 smithi057 ceph-mon[36457]: purged_snaps scrub starts 2024-06-02T23:54:02.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:02 smithi057 ceph-mon[36457]: purged_snaps scrub ok 2024-06-02T23:54:02.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:02 smithi057 ceph-mon[36457]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-06-02T23:54:02.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:02 smithi057 ceph-mon[36457]: from='osd.6 [v2:172.21.15.49:6818/894624552,v1:172.21.15.49:6819/894624552]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-06-02T23:54:02.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:02 smithi057 ceph-mon[36457]: osdmap e45: 7 total, 6 up, 7 in 2024-06-02T23:54:02.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:02 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T23:54:02.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:02 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T23:54:02.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:02 smithi057 ceph-mon[36457]: from='osd.6 [v2:172.21.15.49:6818/894624552,v1:172.21.15.49:6819/894624552]' entity='osd.6' 2024-06-02T23:54:02.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:02 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T23:54:02.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:02 smithi049 ceph-mon[32302]: purged_snaps scrub starts 2024-06-02T23:54:02.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:02 smithi049 ceph-mon[32302]: purged_snaps scrub ok 2024-06-02T23:54:02.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:02 smithi049 ceph-mon[32302]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-06-02T23:54:02.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:02 smithi049 ceph-mon[32302]: from='osd.6 [v2:172.21.15.49:6818/894624552,v1:172.21.15.49:6819/894624552]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-06-02T23:54:02.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:02 smithi049 ceph-mon[32302]: osdmap e45: 7 total, 6 up, 7 in 2024-06-02T23:54:02.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:02 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T23:54:02.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:02 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T23:54:02.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:02 smithi049 ceph-mon[32302]: from='osd.6 [v2:172.21.15.49:6818/894624552,v1:172.21.15.49:6819/894624552]' entity='osd.6' 2024-06-02T23:54:02.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:02 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T23:54:02.961 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 02 23:54:02 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-02T23:54:02.569+0000 7f5300b8b700 -1 osd.6 0 waiting for initial osdmap 2024-06-02T23:54:02.961 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 02 23:54:02 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-02T23:54:02.582+0000 7f52f7974700 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T23:54:03.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:02 smithi107 ceph-mon[37048]: purged_snaps scrub starts 2024-06-02T23:54:03.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:02 smithi107 ceph-mon[37048]: purged_snaps scrub ok 2024-06-02T23:54:03.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:02 smithi107 ceph-mon[37048]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-06-02T23:54:03.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:02 smithi107 ceph-mon[37048]: from='osd.6 [v2:172.21.15.49:6818/894624552,v1:172.21.15.49:6819/894624552]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-06-02T23:54:03.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:02 smithi107 ceph-mon[37048]: osdmap e45: 7 total, 6 up, 7 in 2024-06-02T23:54:03.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:02 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T23:54:03.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:02 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T23:54:03.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:02 smithi107 ceph-mon[37048]: from='osd.6 [v2:172.21.15.49:6818/894624552,v1:172.21.15.49:6819/894624552]' entity='osd.6' 2024-06-02T23:54:03.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:02 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T23:54:03.415 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi057:vg_nvme/lv_2 2024-06-02T23:54:03.675 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T23:54:04.364 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:04 smithi057 ceph-mon[36457]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-06-02T23:54:04.364 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:04 smithi057 ceph-mon[36457]: Detected new or changed devices on smithi049 2024-06-02T23:54:04.365 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:04 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:04.365 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:04 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:04.365 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:04 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:54:04.365 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:04 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:54:04.365 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:04 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:54:04.365 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:04 smithi057 ceph-mon[36457]: Adjusting osd_memory_target on smithi049 to 5696M 2024-06-02T23:54:04.688 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:04 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:04.689 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:04 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:54:04.689 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:04 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:54:04.689 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:04 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:04.689 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:04 smithi057 ceph-mon[36457]: osd.6 [v2:172.21.15.49:6818/894624552,v1:172.21.15.49:6819/894624552] boot 2024-06-02T23:54:04.689 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:04 smithi057 ceph-mon[36457]: osdmap e46: 7 total, 7 up, 7 in 2024-06-02T23:54:04.689 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:04 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T23:54:04.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:04 smithi049 ceph-mon[32302]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-06-02T23:54:04.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:04 smithi049 ceph-mon[32302]: Detected new or changed devices on smithi049 2024-06-02T23:54:04.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:04 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:04.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:04 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:04.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:04 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:54:04.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:04 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:54:04.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:04 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:54:04.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:04 smithi049 ceph-mon[32302]: Adjusting osd_memory_target on smithi049 to 5696M 2024-06-02T23:54:04.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:04 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:04.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:04 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:54:04.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:04 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:54:04.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:04 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:04.712 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:04 smithi049 ceph-mon[32302]: osd.6 [v2:172.21.15.49:6818/894624552,v1:172.21.15.49:6819/894624552] boot 2024-06-02T23:54:04.712 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:04 smithi049 ceph-mon[32302]: osdmap e46: 7 total, 7 up, 7 in 2024-06-02T23:54:04.712 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:04 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T23:54:04.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:04 smithi107 ceph-mon[37048]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-06-02T23:54:04.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:04 smithi107 ceph-mon[37048]: Detected new or changed devices on smithi049 2024-06-02T23:54:04.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:04 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:04.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:04 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:04.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:04 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:54:04.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:04 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:54:04.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:04 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:54:04.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:04 smithi107 ceph-mon[37048]: Adjusting osd_memory_target on smithi049 to 5696M 2024-06-02T23:54:04.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:04 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:04.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:04 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:54:04.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:04 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:54:04.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:04 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:04.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:04 smithi107 ceph-mon[37048]: osd.6 [v2:172.21.15.49:6818/894624552,v1:172.21.15.49:6819/894624552] boot 2024-06-02T23:54:04.852 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:04 smithi107 ceph-mon[37048]: osdmap e46: 7 total, 7 up, 7 in 2024-06-02T23:54:04.852 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:04 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T23:54:05.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.197+0000 7f5daaa1a700 1 -- 172.21.15.57:0/1851196698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5da4102f80 msgr2=0x7f5da4109830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:54:05.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.197+0000 7f5daaa1a700 1 --2- 172.21.15.57:0/1851196698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5da4102f80 0x7f5da4109830 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c00b0d0 tx=0x7f5d9c00b3e0 comp rx=0 tx=0).stop 2024-06-02T23:54:05.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.197+0000 7f5daaa1a700 1 -- 172.21.15.57:0/1851196698 shutdown_connections 2024-06-02T23:54:05.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.197+0000 7f5daaa1a700 1 --2- 172.21.15.57:0/1851196698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5da4102f80 0x7f5da4109830 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:54:05.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.197+0000 7f5daaa1a700 1 --2- 172.21.15.57:0/1851196698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5da41013e0 0x7f5da4101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:54:05.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.197+0000 7f5daaa1a700 1 --2- 172.21.15.57:0/1851196698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5da41025e0 0x7f5da4102a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:54:05.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.197+0000 7f5daaa1a700 1 -- 172.21.15.57:0/1851196698 >> 172.21.15.57:0/1851196698 conn(0x7f5da40fc980 msgr2=0x7f5da40fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:54:05.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.197+0000 7f5daaa1a700 1 -- 172.21.15.57:0/1851196698 shutdown_connections 2024-06-02T23:54:05.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.197+0000 7f5daaa1a700 1 -- 172.21.15.57:0/1851196698 wait complete. 2024-06-02T23:54:05.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.197+0000 7f5daaa1a700 1 Processor -- start 2024-06-02T23:54:05.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.198+0000 7f5daaa1a700 1 -- start start 2024-06-02T23:54:05.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.198+0000 7f5daaa1a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5da41013e0 0x7f5da406b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:54:05.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.198+0000 7f5daaa1a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5da41025e0 0x7f5da419d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:54:05.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.198+0000 7f5daaa1a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5da4102f80 0x7f5da419fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:54:05.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.198+0000 7f5daaa1a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5da410cfc0 con 0x7f5da41013e0 2024-06-02T23:54:05.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.198+0000 7f5daaa1a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5da410ce40 con 0x7f5da41025e0 2024-06-02T23:54:05.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.198+0000 7f5daaa1a700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5da410d140 con 0x7f5da4102f80 2024-06-02T23:54:05.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.198+0000 7f5da37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5da41025e0 0x7f5da419d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:54:05.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.198+0000 7f5da37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5da41025e0 0x7f5da419d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54992/0 (socket says 172.21.15.57:54992) 2024-06-02T23:54:05.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.198+0000 7f5da37fe700 1 -- 172.21.15.57:0/3400226763 learned_addr learned my addr 172.21.15.57:0/3400226763 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-06-02T23:54:05.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.198+0000 7f5da3fff700 1 --2- 172.21.15.57:0/3400226763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5da41013e0 0x7f5da406b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:54:05.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.198+0000 7f5da37fe700 1 -- 172.21.15.57:0/3400226763 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5da4102f80 msgr2=0x7f5da419fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:54:05.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.198+0000 7f5da37fe700 1 --2- 172.21.15.57:0/3400226763 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5da4102f80 0x7f5da419fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:54:05.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.198+0000 7f5da37fe700 1 -- 172.21.15.57:0/3400226763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5da41013e0 msgr2=0x7f5da406b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:54:05.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.198+0000 7f5da37fe700 1 --2- 172.21.15.57:0/3400226763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5da41013e0 0x7f5da406b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:54:05.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.198+0000 7f5da37fe700 1 -- 172.21.15.57:0/3400226763 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5da41a02d0 con 0x7f5da41025e0 2024-06-02T23:54:05.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.198+0000 7f5da37fe700 1 --2- 172.21.15.57:0/3400226763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5da41025e0 0x7f5da419d3b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5d9800e9a0 tx=0x7f5d9800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:54:05.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.199+0000 7f5da17fa700 1 -- 172.21.15.57:0/3400226763 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9800cbd0 con 0x7f5da41025e0 2024-06-02T23:54:05.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.199+0000 7f5daaa1a700 1 -- 172.21.15.57:0/3400226763 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5da41a05c0 con 0x7f5da41025e0 2024-06-02T23:54:05.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.199+0000 7f5da17fa700 1 -- 172.21.15.57:0/3400226763 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d9800cd70 con 0x7f5da41025e0 2024-06-02T23:54:05.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.199+0000 7f5da17fa700 1 -- 172.21.15.57:0/3400226763 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d98018750 con 0x7f5da41025e0 2024-06-02T23:54:05.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.199+0000 7f5daaa1a700 1 -- 172.21.15.57:0/3400226763 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5da41a0b50 con 0x7f5da41025e0 2024-06-02T23:54:05.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.200+0000 7f5daaa1a700 1 -- 172.21.15.57:0/3400226763 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5da4069180 con 0x7f5da41025e0 2024-06-02T23:54:05.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.201+0000 7f5da17fa700 1 -- 172.21.15.57:0/3400226763 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5d98010430 con 0x7f5da41025e0 2024-06-02T23:54:05.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.201+0000 7f5da17fa700 1 --2- 172.21.15.57:0/3400226763 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f5d8c0a2c20 0x7f5d8c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:54:05.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.201+0000 7f5da17fa700 1 -- 172.21.15.57:0/3400226763 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 4965+0+0 (secure 0 0 0) 0x7f5d980ceab0 con 0x7f5da41025e0 2024-06-02T23:54:05.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.202+0000 7f5da3fff700 1 --2- 172.21.15.57:0/3400226763 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f5d8c0a2c20 0x7f5d8c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:54:05.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.202+0000 7f5da3fff700 1 --2- 172.21.15.57:0/3400226763 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f5d8c0a2c20 0x7f5d8c0a50e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5da4102440 tx=0x7f5d9400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:54:05.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.205+0000 7f5da17fa700 1 -- 172.21.15.57:0/3400226763 <== mon.2 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5d9809c720 con 0x7f5da41025e0 2024-06-02T23:54:05.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:05.420+0000 7f5daaa1a700 1 -- 172.21.15.57:0/3400226763 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f5da40628d0 con 0x7f5d8c0a2c20 2024-06-02T23:54:05.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:05 smithi057 ceph-mon[36457]: osdmap e47: 7 total, 7 up, 7 in 2024-06-02T23:54:05.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:05 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:54:05.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:05 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:54:05.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:05 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:54:05.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:05 smithi107 ceph-mon[37048]: osdmap e47: 7 total, 7 up, 7 in 2024-06-02T23:54:05.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:05 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:54:05.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:05 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:54:05.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:05 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:54:05.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:05 smithi049 ceph-mon[32302]: osdmap e47: 7 total, 7 up, 7 in 2024-06-02T23:54:05.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:05 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:54:05.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:05 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:54:05.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:05 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:54:06.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:06 smithi057 ceph-mon[36457]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:06.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:06 smithi057 ceph-mon[36457]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:54:06.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:06 smithi107 ceph-mon[37048]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:06.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:06 smithi107 ceph-mon[37048]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:54:06.898 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:06 smithi049 ceph-mon[32302]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:06.898 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:06 smithi049 ceph-mon[32302]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:54:08.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:08 smithi107 ceph-mon[37048]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:08.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:08 smithi107 ceph-mon[37048]: from='client.? 172.21.15.57:0/1471904892' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9abd81c7-dcc1-4e14-8ab7-9fa0746067ba"}]: dispatch 2024-06-02T23:54:08.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:08 smithi107 ceph-mon[37048]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9abd81c7-dcc1-4e14-8ab7-9fa0746067ba"}]: dispatch 2024-06-02T23:54:08.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:08 smithi107 ceph-mon[37048]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9abd81c7-dcc1-4e14-8ab7-9fa0746067ba"}]': finished 2024-06-02T23:54:08.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:08 smithi107 ceph-mon[37048]: osdmap e48: 8 total, 7 up, 8 in 2024-06-02T23:54:08.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:08 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T23:54:08.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:08 smithi057 ceph-mon[36457]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:08.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:08 smithi057 ceph-mon[36457]: from='client.? 172.21.15.57:0/1471904892' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9abd81c7-dcc1-4e14-8ab7-9fa0746067ba"}]: dispatch 2024-06-02T23:54:08.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:08 smithi057 ceph-mon[36457]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9abd81c7-dcc1-4e14-8ab7-9fa0746067ba"}]: dispatch 2024-06-02T23:54:08.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:08 smithi057 ceph-mon[36457]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9abd81c7-dcc1-4e14-8ab7-9fa0746067ba"}]': finished 2024-06-02T23:54:08.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:08 smithi057 ceph-mon[36457]: osdmap e48: 8 total, 7 up, 8 in 2024-06-02T23:54:08.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:08 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T23:54:08.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:08 smithi049 ceph-mon[32302]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:08.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:08 smithi049 ceph-mon[32302]: from='client.? 172.21.15.57:0/1471904892' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9abd81c7-dcc1-4e14-8ab7-9fa0746067ba"}]: dispatch 2024-06-02T23:54:08.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:08 smithi049 ceph-mon[32302]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9abd81c7-dcc1-4e14-8ab7-9fa0746067ba"}]: dispatch 2024-06-02T23:54:08.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:08 smithi049 ceph-mon[32302]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9abd81c7-dcc1-4e14-8ab7-9fa0746067ba"}]': finished 2024-06-02T23:54:08.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:08 smithi049 ceph-mon[32302]: osdmap e48: 8 total, 7 up, 8 in 2024-06-02T23:54:08.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:08 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T23:54:10.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:09 smithi049 ceph-mon[32302]: from='client.? 172.21.15.57:0/925679568' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:54:10.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:09 smithi107 ceph-mon[37048]: from='client.? 172.21.15.57:0/925679568' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:54:10.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:10 smithi057 ceph-mon[36457]: from='client.? 172.21.15.57:0/925679568' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:54:11.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:10 smithi057 ceph-mon[36457]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:11.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:10 smithi049 ceph-mon[32302]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:11.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:10 smithi107 ceph-mon[37048]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:13.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:12 smithi057 ceph-mon[36457]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:13.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:12 smithi049 ceph-mon[32302]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:13.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:12 smithi107 ceph-mon[37048]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:15.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:14 smithi057 ceph-mon[36457]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:15.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:14 smithi049 ceph-mon[32302]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:15.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:14 smithi107 ceph-mon[37048]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:16.998 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:16 smithi057 ceph-mon[36457]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:17.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:16 smithi049 ceph-mon[32302]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:17.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:16 smithi107 ceph-mon[37048]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:17.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:17 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-02T23:54:17.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:17 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:54:17.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:17 smithi057 ceph-mon[36457]: Deploying daemon osd.7 on smithi057 2024-06-02T23:54:18.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:17 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-02T23:54:18.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:17 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:54:18.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:17 smithi049 ceph-mon[32302]: Deploying daemon osd.7 on smithi057 2024-06-02T23:54:18.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:17 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-02T23:54:18.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:17 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:54:18.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:17 smithi107 ceph-mon[37048]: Deploying daemon osd.7 on smithi057 2024-06-02T23:54:19.059 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:18 smithi057 ceph-mon[36457]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:19.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:18 smithi049 ceph-mon[32302]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:19.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:18 smithi107 ceph-mon[37048]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:21.072 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:20 smithi057 ceph-mon[36457]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:21.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:20 smithi049 ceph-mon[32302]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:21.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:20 smithi107 ceph-mon[37048]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:23.202 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:22 smithi057 ceph-mon[36457]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:23.202 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:22 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:23.203 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:22 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:23.203 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:22 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:54:23.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:22 smithi049 ceph-mon[32302]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:23.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:22 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:23.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:22 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:23.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:22 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:54:23.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:22 smithi107 ceph-mon[37048]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:23.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:22 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:23.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:22 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:23.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:22 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:54:25.093 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:24 smithi057 ceph-mon[36457]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:25.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:24 smithi049 ceph-mon[32302]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:25.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:24 smithi107 ceph-mon[37048]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:26.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:26.492+0000 7f5da17fa700 1 -- 172.21.15.57:0/3400226763 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5da40628d0 con 0x7f5d8c0a2c20 2024-06-02T23:54:26.493 INFO:teuthology.orchestra.run.smithi057.stdout:Created osd(s) 7 on host 'smithi057' 2024-06-02T23:54:26.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:26.495+0000 7f5daaa1a700 1 -- 172.21.15.57:0/3400226763 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f5d8c0a2c20 msgr2=0x7f5d8c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:54:26.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:26.495+0000 7f5daaa1a700 1 --2- 172.21.15.57:0/3400226763 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f5d8c0a2c20 0x7f5d8c0a50e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5da4102440 tx=0x7f5d9400b410 comp rx=0 tx=0).stop 2024-06-02T23:54:26.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:26.495+0000 7f5daaa1a700 1 -- 172.21.15.57:0/3400226763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5da41025e0 msgr2=0x7f5da419d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:54:26.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:26.495+0000 7f5daaa1a700 1 --2- 172.21.15.57:0/3400226763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5da41025e0 0x7f5da419d3b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5d9800e9a0 tx=0x7f5d9800ecb0 comp rx=0 tx=0).stop 2024-06-02T23:54:26.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:26.495+0000 7f5daaa1a700 1 -- 172.21.15.57:0/3400226763 shutdown_connections 2024-06-02T23:54:26.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:26.495+0000 7f5daaa1a700 1 --2- 172.21.15.57:0/3400226763 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f5d8c0a2c20 0x7f5d8c0a50e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:54:26.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:26.495+0000 7f5daaa1a700 1 --2- 172.21.15.57:0/3400226763 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5da4102f80 0x7f5da419fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:54:26.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:26.495+0000 7f5daaa1a700 1 --2- 172.21.15.57:0/3400226763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5da41013e0 0x7f5da406b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:54:26.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:26.495+0000 7f5daaa1a700 1 --2- 172.21.15.57:0/3400226763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5da41025e0 0x7f5da419d3b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:54:26.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:26.495+0000 7f5daaa1a700 1 -- 172.21.15.57:0/3400226763 >> 172.21.15.57:0/3400226763 conn(0x7f5da40fc980 msgr2=0x7f5da4105880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:54:26.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:26.495+0000 7f5daaa1a700 1 -- 172.21.15.57:0/3400226763 shutdown_connections 2024-06-02T23:54:26.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:54:26.495+0000 7f5daaa1a700 1 -- 172.21.15.57:0/3400226763 wait complete. 2024-06-02T23:54:26.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:26 smithi057 ceph-mon[36457]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:26.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:26 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:26.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:26 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:26.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:26 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:54:26.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:26 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:54:26.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:26 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:26.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:26 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:54:26.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:26 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:26.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:26 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:26.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:26 smithi057 ceph-mon[36457]: from='osd.7 [v2:172.21.15.57:6816/3126027900,v1:172.21.15.57:6817/3126027900]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-02T23:54:26.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:26 smithi057 ceph-mon[36457]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-02T23:54:26.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:26 smithi049 ceph-mon[32302]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:26.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:26 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:26.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:26 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:26.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:26 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:54:26.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:26 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:54:26.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:26 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:26.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:26 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:54:26.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:26 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:26.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:26 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:26.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:26 smithi049 ceph-mon[32302]: from='osd.7 [v2:172.21.15.57:6816/3126027900,v1:172.21.15.57:6817/3126027900]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-02T23:54:26.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:26 smithi049 ceph-mon[32302]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-02T23:54:27.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:26 smithi107 ceph-mon[37048]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:27.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:26 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:27.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:26 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:27.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:26 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:54:27.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:26 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:54:27.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:26 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:27.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:26 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:54:27.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:26 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:27.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:26 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:27.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:26 smithi107 ceph-mon[37048]: from='osd.7 [v2:172.21.15.57:6816/3126027900,v1:172.21.15.57:6817/3126027900]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-02T23:54:27.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:26 smithi107 ceph-mon[37048]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-02T23:54:27.107 DEBUG:teuthology.orchestra.run.smithi057:osd.7> sudo journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.7.service 2024-06-02T23:54:27.109 INFO:tasks.cephadm:Deploying osd.8 on smithi107 with /dev/vg_nvme/lv_2... 2024-06-02T23:54:27.109 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-06-02T23:54:27.354 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T23:54:28.497 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:28 smithi057 ceph-mon[36457]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:28.498 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:28 smithi057 ceph-mon[36457]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-02T23:54:28.498 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:28 smithi057 ceph-mon[36457]: osdmap e49: 8 total, 7 up, 8 in 2024-06-02T23:54:28.498 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:28 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T23:54:28.498 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:28 smithi057 ceph-mon[36457]: from='osd.7 [v2:172.21.15.57:6816/3126027900,v1:172.21.15.57:6817/3126027900]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-06-02T23:54:28.498 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:28 smithi057 ceph-mon[36457]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-06-02T23:54:28.498 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 02 23:54:28 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-02T23:54:28.469+0000 7f7303748700 -1 osd.7 0 waiting for initial osdmap 2024-06-02T23:54:28.498 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 02 23:54:28 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-02T23:54:28.480+0000 7f72ffd3c700 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T23:54:28.695 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:28 smithi107 ceph-mon[37048]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:28.695 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:28 smithi107 ceph-mon[37048]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-02T23:54:28.696 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:28 smithi107 ceph-mon[37048]: osdmap e49: 8 total, 7 up, 8 in 2024-06-02T23:54:28.696 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:28 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T23:54:28.696 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:28 smithi107 ceph-mon[37048]: from='osd.7 [v2:172.21.15.57:6816/3126027900,v1:172.21.15.57:6817/3126027900]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-06-02T23:54:28.696 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:28 smithi107 ceph-mon[37048]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-06-02T23:54:28.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:28 smithi049 ceph-mon[32302]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:28.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:28 smithi049 ceph-mon[32302]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-02T23:54:28.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:28 smithi049 ceph-mon[32302]: osdmap e49: 8 total, 7 up, 8 in 2024-06-02T23:54:28.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:28 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T23:54:28.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:28 smithi049 ceph-mon[32302]: from='osd.7 [v2:172.21.15.57:6816/3126027900,v1:172.21.15.57:6817/3126027900]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-06-02T23:54:28.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:28 smithi049 ceph-mon[32302]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-06-02T23:54:29.267 INFO:teuthology.orchestra.run.smithi107.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-06-02T23:54:29.267 INFO:teuthology.orchestra.run.smithi107.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-06-02T23:54:29.267 INFO:teuthology.orchestra.run.smithi107.stderr: stderr: 10+0 records in 2024-06-02T23:54:29.267 INFO:teuthology.orchestra.run.smithi107.stderr:10+0 records out 2024-06-02T23:54:29.267 INFO:teuthology.orchestra.run.smithi107.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0119028 s, 881 MB/s 2024-06-02T23:54:29.267 INFO:teuthology.orchestra.run.smithi107.stderr:--> Zapping successful for: 2024-06-02T23:54:29.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:29 smithi057 ceph-mon[36457]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2024-06-02T23:54:29.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:29 smithi057 ceph-mon[36457]: osdmap e50: 8 total, 7 up, 8 in 2024-06-02T23:54:29.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:29 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T23:54:29.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:29 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T23:54:29.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:29 smithi057 ceph-mon[36457]: osd.7 [v2:172.21.15.57:6816/3126027900,v1:172.21.15.57:6817/3126027900] boot 2024-06-02T23:54:29.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:29 smithi057 ceph-mon[36457]: osdmap e51: 8 total, 8 up, 8 in 2024-06-02T23:54:29.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:29 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T23:54:29.738 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:29 smithi107 ceph-mon[37048]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2024-06-02T23:54:29.738 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:29 smithi107 ceph-mon[37048]: osdmap e50: 8 total, 7 up, 8 in 2024-06-02T23:54:29.738 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:29 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T23:54:29.738 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:29 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T23:54:29.738 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:29 smithi107 ceph-mon[37048]: osd.7 [v2:172.21.15.57:6816/3126027900,v1:172.21.15.57:6817/3126027900] boot 2024-06-02T23:54:29.738 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:29 smithi107 ceph-mon[37048]: osdmap e51: 8 total, 8 up, 8 in 2024-06-02T23:54:29.738 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:29 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T23:54:29.901 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi107:vg_nvme/lv_2 2024-06-02T23:54:29.962 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:29 smithi049 ceph-mon[32302]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2024-06-02T23:54:29.962 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:29 smithi049 ceph-mon[32302]: osdmap e50: 8 total, 7 up, 8 in 2024-06-02T23:54:29.962 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:29 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T23:54:29.962 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:29 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T23:54:29.962 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:29 smithi049 ceph-mon[32302]: osd.7 [v2:172.21.15.57:6816/3126027900,v1:172.21.15.57:6817/3126027900] boot 2024-06-02T23:54:29.962 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:29 smithi049 ceph-mon[32302]: osdmap e51: 8 total, 8 up, 8 in 2024-06-02T23:54:29.962 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:29 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T23:54:30.150 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T23:54:30.544 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:30 smithi107 ceph-mon[37048]: purged_snaps scrub starts 2024-06-02T23:54:30.544 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:30 smithi107 ceph-mon[37048]: purged_snaps scrub ok 2024-06-02T23:54:30.544 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:30 smithi107 ceph-mon[37048]: pgmap v177: 1 pgs: 1 unknown; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:30.544 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:30 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:30.544 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:30 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:30.544 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:30 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:54:30.545 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:30 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:54:30.545 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:30 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:54:30.545 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:30 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:30.545 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:30 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:54:30.545 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:30 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:54:30.545 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:30 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:30.545 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:30 smithi107 ceph-mon[37048]: osdmap e52: 8 total, 8 up, 8 in 2024-06-02T23:54:30.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:30 smithi057 ceph-mon[36457]: purged_snaps scrub starts 2024-06-02T23:54:30.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:30 smithi057 ceph-mon[36457]: purged_snaps scrub ok 2024-06-02T23:54:30.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:30 smithi057 ceph-mon[36457]: pgmap v177: 1 pgs: 1 unknown; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:30.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:30 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:30.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:30 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:30.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:30 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:54:30.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:30 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:54:30.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:30 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:54:30.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:30 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:30.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:30 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:54:30.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:30 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:54:30.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:30 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:30.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:30 smithi057 ceph-mon[36457]: osdmap e52: 8 total, 8 up, 8 in 2024-06-02T23:54:30.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:30 smithi049 ceph-mon[32302]: purged_snaps scrub starts 2024-06-02T23:54:30.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:30 smithi049 ceph-mon[32302]: purged_snaps scrub ok 2024-06-02T23:54:30.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:30 smithi049 ceph-mon[32302]: pgmap v177: 1 pgs: 1 unknown; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-06-02T23:54:30.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:30 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:30.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:30 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:30.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:30 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:54:30.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:30 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:54:30.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:30 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:54:30.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:30 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:30.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:30 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:54:30.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:30 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:54:30.962 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:30 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:30.962 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:30 smithi049 ceph-mon[32302]: osdmap e52: 8 total, 8 up, 8 in 2024-06-02T23:54:31.534 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:31 smithi107 ceph-mon[37048]: Detected new or changed devices on smithi057 2024-06-02T23:54:31.534 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:31 smithi107 ceph-mon[37048]: Adjusting osd_memory_target on smithi057 to 5697M 2024-06-02T23:54:31.534 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:31 smithi107 ceph-mon[37048]: osdmap e53: 8 total, 8 up, 8 in 2024-06-02T23:54:31.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.637+0000 7f2494528700 1 -- 172.21.15.107:0/1337067758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f248c104220 msgr2=0x7f248c10aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:54:31.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.637+0000 7f2494528700 1 --2- 172.21.15.107:0/1337067758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f248c104220 0x7f248c10aad0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f248400b0a0 tx=0x7f248400b3b0 comp rx=0 tx=0).stop 2024-06-02T23:54:31.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.637+0000 7f2494528700 1 -- 172.21.15.107:0/1337067758 shutdown_connections 2024-06-02T23:54:31.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.637+0000 7f2494528700 1 --2- 172.21.15.107:0/1337067758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f248c104220 0x7f248c10aad0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:54:31.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.637+0000 7f2494528700 1 --2- 172.21.15.107:0/1337067758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f248c100800 0x7f248c100c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:54:31.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.637+0000 7f2494528700 1 --2- 172.21.15.107:0/1337067758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f248c103880 0x7f248c103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:54:31.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.637+0000 7f2494528700 1 -- 172.21.15.107:0/1337067758 >> 172.21.15.107:0/1337067758 conn(0x7f248c0fc160 msgr2=0x7f248c0fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:54:31.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.637+0000 7f2494528700 1 -- 172.21.15.107:0/1337067758 shutdown_connections 2024-06-02T23:54:31.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.637+0000 7f2494528700 1 -- 172.21.15.107:0/1337067758 wait complete. 2024-06-02T23:54:31.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.637+0000 7f2494528700 1 Processor -- start 2024-06-02T23:54:31.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.637+0000 7f2494528700 1 -- start start 2024-06-02T23:54:31.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.637+0000 7f2494528700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f248c100800 0x7f248c198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:54:31.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.638+0000 7f2494528700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f248c103880 0x7f248c198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:54:31.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.638+0000 7f2494528700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f248c104220 0x7f248c19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:54:31.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.638+0000 7f2494528700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f248c10e100 con 0x7f248c103880 2024-06-02T23:54:31.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.638+0000 7f2494528700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f248c10df80 con 0x7f248c104220 2024-06-02T23:54:31.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.638+0000 7f2494528700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f248c10e280 con 0x7f248c100800 2024-06-02T23:54:31.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.638+0000 7f24922c4700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f248c100800 0x7f248c198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:54:31.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.638+0000 7f24922c4700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f248c100800 0x7f248c198700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44116/0 (socket says 172.21.15.107:44116) 2024-06-02T23:54:31.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.638+0000 7f24922c4700 1 -- 172.21.15.107:0/3273038871 learned_addr learned my addr 172.21.15.107:0/3273038871 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-06-02T23:54:31.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.638+0000 7f2492ac5700 1 --2- 172.21.15.107:0/3273038871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f248c104220 0x7f248c19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:54:31.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.638+0000 7f2491ac3700 1 --2- 172.21.15.107:0/3273038871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f248c103880 0x7f248c198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:54:31.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.638+0000 7f24922c4700 1 -- 172.21.15.107:0/3273038871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f248c104220 msgr2=0x7f248c19fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:54:31.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.638+0000 7f24922c4700 1 --2- 172.21.15.107:0/3273038871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f248c104220 0x7f248c19fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:54:31.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.638+0000 7f24922c4700 1 -- 172.21.15.107:0/3273038871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f248c103880 msgr2=0x7f248c198c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:54:31.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.638+0000 7f24922c4700 1 --2- 172.21.15.107:0/3273038871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f248c103880 0x7f248c198c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:54:31.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.638+0000 7f24922c4700 1 -- 172.21.15.107:0/3273038871 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f248c1a0360 con 0x7f248c100800 2024-06-02T23:54:31.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.638+0000 7f24922c4700 1 --2- 172.21.15.107:0/3273038871 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f248c100800 0x7f248c198700 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f248800c9a0 tx=0x7f248800ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:54:31.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.638+0000 7f24837fe700 1 -- 172.21.15.107:0/3273038871 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2488004220 con 0x7f248c100800 2024-06-02T23:54:31.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.638+0000 7f2494528700 1 -- 172.21.15.107:0/3273038871 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f248c1a0650 con 0x7f248c100800 2024-06-02T23:54:31.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.638+0000 7f24837fe700 1 -- 172.21.15.107:0/3273038871 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2488007d40 con 0x7f248c100800 2024-06-02T23:54:31.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.638+0000 7f24837fe700 1 -- 172.21.15.107:0/3273038871 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2488003da0 con 0x7f248c100800 2024-06-02T23:54:31.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.638+0000 7f2494528700 1 -- 172.21.15.107:0/3273038871 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f248c1a0b90 con 0x7f248c100800 2024-06-02T23:54:31.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.639+0000 7f2494528700 1 -- 172.21.15.107:0/3273038871 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f248c069180 con 0x7f248c100800 2024-06-02T23:54:31.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.641+0000 7f24837fe700 1 -- 172.21.15.107:0/3273038871 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f24880043c0 con 0x7f248c100800 2024-06-02T23:54:31.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.641+0000 7f24837fe700 1 --2- 172.21.15.107:0/3273038871 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f24780a2c20 0x7f24780a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:54:31.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.641+0000 7f24837fe700 1 -- 172.21.15.107:0/3273038871 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5426+0+0 (secure 0 0 0) 0x7f24880ce4d0 con 0x7f248c100800 2024-06-02T23:54:31.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.641+0000 7f2491ac3700 1 --2- 172.21.15.107:0/3273038871 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f24780a2c20 0x7f24780a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:54:31.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.642+0000 7f2491ac3700 1 --2- 172.21.15.107:0/3273038871 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f24780a2c20 0x7f24780a50e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f247c005950 tx=0x7f247c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:54:31.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.645+0000 7f24837fe700 1 -- 172.21.15.107:0/3273038871 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2488014030 con 0x7f248c100800 2024-06-02T23:54:31.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:31.846+0000 7f2494528700 1 -- 172.21.15.107:0/3273038871 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f248c0628d0 con 0x7f24780a2c20 2024-06-02T23:54:31.949 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:31 smithi057 ceph-mon[36457]: Detected new or changed devices on smithi057 2024-06-02T23:54:31.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:31 smithi057 ceph-mon[36457]: Adjusting osd_memory_target on smithi057 to 5697M 2024-06-02T23:54:31.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:31 smithi057 ceph-mon[36457]: osdmap e53: 8 total, 8 up, 8 in 2024-06-02T23:54:31.960 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:31 smithi049 ceph-mon[32302]: Detected new or changed devices on smithi057 2024-06-02T23:54:31.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:31 smithi049 ceph-mon[32302]: Adjusting osd_memory_target on smithi057 to 5697M 2024-06-02T23:54:31.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:31 smithi049 ceph-mon[32302]: osdmap e53: 8 total, 8 up, 8 in 2024-06-02T23:54:32.780 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:32 smithi107 ceph-mon[37048]: pgmap v180: 1 pgs: 1 unknown; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:32.780 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:32 smithi107 ceph-mon[37048]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:54:32.780 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:32 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:54:32.780 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:32 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:54:32.780 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:32 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:54:32.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:32 smithi057 ceph-mon[36457]: pgmap v180: 1 pgs: 1 unknown; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:32.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:32 smithi057 ceph-mon[36457]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:54:32.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:32 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:54:32.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:32 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:54:32.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:32 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:54:32.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:32 smithi049 ceph-mon[32302]: pgmap v180: 1 pgs: 1 unknown; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:32.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:32 smithi049 ceph-mon[32302]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:54:32.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:32 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:54:32.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:32 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:54:32.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:32 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:54:33.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:33 smithi107 ceph-mon[37048]: osdmap e54: 8 total, 8 up, 8 in 2024-06-02T23:54:33.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:33 smithi057 ceph-mon[36457]: osdmap e54: 8 total, 8 up, 8 in 2024-06-02T23:54:33.960 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:33 smithi049 ceph-mon[32302]: osdmap e54: 8 total, 8 up, 8 in 2024-06-02T23:54:34.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:34 smithi107 ceph-mon[37048]: pgmap v183: 1 pgs: 1 unknown; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:34.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:34 smithi107 ceph-mon[37048]: osdmap e55: 8 total, 8 up, 8 in 2024-06-02T23:54:34.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:34 smithi107 ceph-mon[37048]: from='client.? 172.21.15.107:0/3609606901' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80532119-5de8-45d2-9cb9-bd8a6194199b"}]: dispatch 2024-06-02T23:54:34.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:34 smithi107 ceph-mon[37048]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80532119-5de8-45d2-9cb9-bd8a6194199b"}]: dispatch 2024-06-02T23:54:34.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:34 smithi107 ceph-mon[37048]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "80532119-5de8-45d2-9cb9-bd8a6194199b"}]': finished 2024-06-02T23:54:34.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:34 smithi107 ceph-mon[37048]: osdmap e56: 9 total, 8 up, 9 in 2024-06-02T23:54:34.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:34 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T23:54:34.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:34 smithi057 ceph-mon[36457]: pgmap v183: 1 pgs: 1 unknown; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:34.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:34 smithi057 ceph-mon[36457]: osdmap e55: 8 total, 8 up, 8 in 2024-06-02T23:54:34.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:34 smithi057 ceph-mon[36457]: from='client.? 172.21.15.107:0/3609606901' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80532119-5de8-45d2-9cb9-bd8a6194199b"}]: dispatch 2024-06-02T23:54:34.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:34 smithi057 ceph-mon[36457]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80532119-5de8-45d2-9cb9-bd8a6194199b"}]: dispatch 2024-06-02T23:54:34.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:34 smithi057 ceph-mon[36457]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "80532119-5de8-45d2-9cb9-bd8a6194199b"}]': finished 2024-06-02T23:54:34.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:34 smithi057 ceph-mon[36457]: osdmap e56: 9 total, 8 up, 9 in 2024-06-02T23:54:34.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:34 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T23:54:34.960 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:34 smithi049 ceph-mon[32302]: pgmap v183: 1 pgs: 1 unknown; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:34.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:34 smithi049 ceph-mon[32302]: osdmap e55: 8 total, 8 up, 8 in 2024-06-02T23:54:34.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:34 smithi049 ceph-mon[32302]: from='client.? 172.21.15.107:0/3609606901' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80532119-5de8-45d2-9cb9-bd8a6194199b"}]: dispatch 2024-06-02T23:54:34.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:34 smithi049 ceph-mon[32302]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80532119-5de8-45d2-9cb9-bd8a6194199b"}]: dispatch 2024-06-02T23:54:34.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:34 smithi049 ceph-mon[32302]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "80532119-5de8-45d2-9cb9-bd8a6194199b"}]': finished 2024-06-02T23:54:34.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:34 smithi049 ceph-mon[32302]: osdmap e56: 9 total, 8 up, 9 in 2024-06-02T23:54:34.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:34 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T23:54:35.751 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:35 smithi107 ceph-mon[37048]: from='client.? 172.21.15.107:0/1075692741' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:54:35.851 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:35 smithi057 ceph-mon[36457]: from='client.? 172.21.15.107:0/1075692741' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:54:35.862 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:35 smithi049 ceph-mon[32302]: from='client.? 172.21.15.107:0/1075692741' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:54:36.763 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:36 smithi107 ceph-mon[37048]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:36.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:36 smithi057 ceph-mon[36457]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:36.960 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:36 smithi049 ceph-mon[32302]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:38.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:38 smithi107 ceph-mon[37048]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:38.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:38 smithi057 ceph-mon[36457]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:38.960 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:38 smithi049 ceph-mon[32302]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:40.699 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:40 smithi107 ceph-mon[37048]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:40.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:40 smithi057 ceph-mon[36457]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:40.960 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:40 smithi049 ceph-mon[32302]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:42.647 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:42 smithi107 ceph-mon[37048]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:42.648 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:42 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-06-02T23:54:42.648 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:42 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:54:42.648 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:42 smithi107 ceph-mon[37048]: Deploying daemon osd.8 on smithi107 2024-06-02T23:54:42.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:42 smithi057 ceph-mon[36457]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:42.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:42 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-06-02T23:54:42.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:42 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:54:42.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:42 smithi057 ceph-mon[36457]: Deploying daemon osd.8 on smithi107 2024-06-02T23:54:42.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:42 smithi049 ceph-mon[32302]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:42.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:42 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-06-02T23:54:42.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:42 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:54:42.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:42 smithi049 ceph-mon[32302]: Deploying daemon osd.8 on smithi107 2024-06-02T23:54:44.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:44 smithi107 ceph-mon[37048]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:44.949 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:44 smithi057 ceph-mon[36457]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:44.960 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:44 smithi049 ceph-mon[32302]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:46.641 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:46 smithi107 ceph-mon[37048]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:46.949 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:46 smithi057 ceph-mon[36457]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:46.960 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:46 smithi049 ceph-mon[32302]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:48.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:48 smithi107 ceph-mon[37048]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:48.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:48 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:48.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:48 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:48.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:48 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:54:48.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:48 smithi057 ceph-mon[36457]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:48.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:48 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:48.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:48 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:48.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:48 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:54:48.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:48 smithi049 ceph-mon[32302]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:48.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:48 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:48.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:48 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:48.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:48 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:54:50.553 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:50 smithi107 ceph-mon[37048]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:50.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:50.613+0000 7f24837fe700 1 -- 172.21.15.107:0/3273038871 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f248c0628d0 con 0x7f24780a2c20 2024-06-02T23:54:50.614 INFO:teuthology.orchestra.run.smithi107.stdout:Created osd(s) 8 on host 'smithi107' 2024-06-02T23:54:50.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:50.616+0000 7f2494528700 1 -- 172.21.15.107:0/3273038871 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f24780a2c20 msgr2=0x7f24780a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:54:50.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:50.616+0000 7f2494528700 1 --2- 172.21.15.107:0/3273038871 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f24780a2c20 0x7f24780a50e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f247c005950 tx=0x7f247c00b410 comp rx=0 tx=0).stop 2024-06-02T23:54:50.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:50.616+0000 7f2494528700 1 -- 172.21.15.107:0/3273038871 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f248c100800 msgr2=0x7f248c198700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:54:50.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:50.616+0000 7f2494528700 1 --2- 172.21.15.107:0/3273038871 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f248c100800 0x7f248c198700 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f248800c9a0 tx=0x7f248800ccb0 comp rx=0 tx=0).stop 2024-06-02T23:54:50.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:50.616+0000 7f2494528700 1 -- 172.21.15.107:0/3273038871 shutdown_connections 2024-06-02T23:54:50.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:50.616+0000 7f2494528700 1 --2- 172.21.15.107:0/3273038871 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f24780a2c20 0x7f24780a50e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:54:50.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:50.616+0000 7f2494528700 1 --2- 172.21.15.107:0/3273038871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f248c104220 0x7f248c19fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:54:50.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:50.616+0000 7f2494528700 1 --2- 172.21.15.107:0/3273038871 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f248c100800 0x7f248c198700 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:54:50.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:50.616+0000 7f2494528700 1 --2- 172.21.15.107:0/3273038871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f248c103880 0x7f248c198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:54:50.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:50.616+0000 7f2494528700 1 -- 172.21.15.107:0/3273038871 >> 172.21.15.107:0/3273038871 conn(0x7f248c0fc160 msgr2=0x7f248c106ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:54:50.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:50.616+0000 7f2494528700 1 -- 172.21.15.107:0/3273038871 shutdown_connections 2024-06-02T23:54:50.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:54:50.616+0000 7f2494528700 1 -- 172.21.15.107:0/3273038871 wait complete. 2024-06-02T23:54:50.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:50 smithi057 ceph-mon[36457]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:50.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:50 smithi049 ceph-mon[32302]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:51.182 DEBUG:teuthology.orchestra.run.smithi107:osd.8> sudo journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.8.service 2024-06-02T23:54:51.184 INFO:tasks.cephadm:Deploying osd.9 on smithi049 with /dev/vg_nvme/lv_1... 2024-06-02T23:54:51.185 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-06-02T23:54:51.444 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:54:51.833 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:51 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:51.833 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:51 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:51.833 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:51 smithi049 ceph-mon[32302]: from='osd.8 [v2:172.21.15.107:6816/3620047229,v1:172.21.15.107:6817/3620047229]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-02T23:54:51.833 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:51 smithi049 ceph-mon[32302]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-02T23:54:51.833 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:51 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:51.833 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:51 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:51.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:51 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:51.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:51 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:51.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:51 smithi107 ceph-mon[37048]: from='osd.8 [v2:172.21.15.107:6816/3620047229,v1:172.21.15.107:6817/3620047229]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-02T23:54:51.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:51 smithi107 ceph-mon[37048]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-02T23:54:51.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:51 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:51.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:51 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:51.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:51 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:51.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:51 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:51.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:51 smithi057 ceph-mon[36457]: from='osd.8 [v2:172.21.15.107:6816/3620047229,v1:172.21.15.107:6817/3620047229]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-02T23:54:51.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:51 smithi057 ceph-mon[36457]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-02T23:54:51.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:51 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:51.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:51 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:52.878 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:52 smithi049 ceph-mon[32302]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:52.878 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:52 smithi049 ceph-mon[32302]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-06-02T23:54:52.878 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:52 smithi049 ceph-mon[32302]: osdmap e57: 9 total, 8 up, 9 in 2024-06-02T23:54:52.878 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:52 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T23:54:52.878 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:52 smithi049 ceph-mon[32302]: from='osd.8 [v2:172.21.15.107:6816/3620047229,v1:172.21.15.107:6817/3620047229]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-06-02T23:54:52.879 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:52 smithi049 ceph-mon[32302]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-06-02T23:54:52.893 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:52 smithi107 ceph-mon[37048]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:52.893 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:52 smithi107 ceph-mon[37048]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-06-02T23:54:52.893 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:52 smithi107 ceph-mon[37048]: osdmap e57: 9 total, 8 up, 9 in 2024-06-02T23:54:52.893 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:52 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T23:54:52.893 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:52 smithi107 ceph-mon[37048]: from='osd.8 [v2:172.21.15.107:6816/3620047229,v1:172.21.15.107:6817/3620047229]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-06-02T23:54:52.893 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:52 smithi107 ceph-mon[37048]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-06-02T23:54:52.893 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 02 23:54:52 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-02T23:54:52.605+0000 7f6985860700 -1 osd.8 0 waiting for initial osdmap 2024-06-02T23:54:52.894 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 02 23:54:52 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-02T23:54:52.621+0000 7f6981e54700 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T23:54:52.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:52 smithi057 ceph-mon[36457]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:52.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:52 smithi057 ceph-mon[36457]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-06-02T23:54:52.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:52 smithi057 ceph-mon[36457]: osdmap e57: 9 total, 8 up, 9 in 2024-06-02T23:54:52.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:52 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T23:54:52.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:52 smithi057 ceph-mon[36457]: from='osd.8 [v2:172.21.15.107:6816/3620047229,v1:172.21.15.107:6817/3620047229]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-06-02T23:54:52.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:52 smithi057 ceph-mon[36457]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-06-02T23:54:53.750 INFO:teuthology.orchestra.run.smithi049.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-06-02T23:54:53.750 INFO:teuthology.orchestra.run.smithi049.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-06-02T23:54:53.751 INFO:teuthology.orchestra.run.smithi049.stderr: stderr: 10+0 records in 2024-06-02T23:54:53.751 INFO:teuthology.orchestra.run.smithi049.stderr:10+0 records out 2024-06-02T23:54:53.751 INFO:teuthology.orchestra.run.smithi049.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00945932 s, 1.1 GB/s 2024-06-02T23:54:53.751 INFO:teuthology.orchestra.run.smithi049.stderr:--> Zapping successful for: 2024-06-02T23:54:53.788 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:53 smithi049 ceph-mon[32302]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-06-02T23:54:53.788 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:53 smithi049 ceph-mon[32302]: osdmap e58: 9 total, 8 up, 9 in 2024-06-02T23:54:53.788 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:53 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T23:54:53.788 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:53 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T23:54:53.788 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:53 smithi049 ceph-mon[32302]: osd.8 [v2:172.21.15.107:6816/3620047229,v1:172.21.15.107:6817/3620047229] boot 2024-06-02T23:54:53.788 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:53 smithi049 ceph-mon[32302]: osdmap e59: 9 total, 9 up, 9 in 2024-06-02T23:54:53.788 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:53 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T23:54:53.863 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:53 smithi107 ceph-mon[37048]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-06-02T23:54:53.863 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:53 smithi107 ceph-mon[37048]: osdmap e58: 9 total, 8 up, 9 in 2024-06-02T23:54:53.863 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:53 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T23:54:53.863 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:53 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T23:54:53.863 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:53 smithi107 ceph-mon[37048]: osd.8 [v2:172.21.15.107:6816/3620047229,v1:172.21.15.107:6817/3620047229] boot 2024-06-02T23:54:53.863 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:53 smithi107 ceph-mon[37048]: osdmap e59: 9 total, 9 up, 9 in 2024-06-02T23:54:53.864 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:53 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T23:54:53.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:53 smithi057 ceph-mon[36457]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-06-02T23:54:53.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:53 smithi057 ceph-mon[36457]: osdmap e58: 9 total, 8 up, 9 in 2024-06-02T23:54:53.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:53 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T23:54:53.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:53 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T23:54:53.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:53 smithi057 ceph-mon[36457]: osd.8 [v2:172.21.15.107:6816/3620047229,v1:172.21.15.107:6817/3620047229] boot 2024-06-02T23:54:53.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:53 smithi057 ceph-mon[36457]: osdmap e59: 9 total, 9 up, 9 in 2024-06-02T23:54:53.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:53 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T23:54:54.316 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi049:vg_nvme/lv_1 2024-06-02T23:54:54.575 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:54:54.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:54 smithi107 ceph-mon[37048]: purged_snaps scrub starts 2024-06-02T23:54:54.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:54 smithi107 ceph-mon[37048]: purged_snaps scrub ok 2024-06-02T23:54:54.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:54 smithi107 ceph-mon[37048]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:54.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:54 smithi107 ceph-mon[37048]: osdmap e60: 9 total, 9 up, 9 in 2024-06-02T23:54:54.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:54 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:54.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:54 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:54.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:54 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:54:54.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:54 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:54:54.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:54 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:54:54.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:54 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:54.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:54 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:54:54.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:54 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:54:54.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:54 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:54.901 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:54 smithi049 ceph-mon[32302]: purged_snaps scrub starts 2024-06-02T23:54:54.901 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:54 smithi049 ceph-mon[32302]: purged_snaps scrub ok 2024-06-02T23:54:54.902 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:54 smithi049 ceph-mon[32302]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:54.902 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:54 smithi049 ceph-mon[32302]: osdmap e60: 9 total, 9 up, 9 in 2024-06-02T23:54:54.902 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:54 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:54.902 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:54 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:54.902 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:54 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:54:54.902 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:54 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:54:54.902 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:54 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:54:54.902 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:54 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:54.902 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:54 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:54:54.902 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:54 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:54:54.902 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:54 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:54.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:54 smithi057 ceph-mon[36457]: purged_snaps scrub starts 2024-06-02T23:54:54.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:54 smithi057 ceph-mon[36457]: purged_snaps scrub ok 2024-06-02T23:54:54.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:54 smithi057 ceph-mon[36457]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-06-02T23:54:54.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:54 smithi057 ceph-mon[36457]: osdmap e60: 9 total, 9 up, 9 in 2024-06-02T23:54:54.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:54 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:54.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:54 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:54.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:54 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:54:54.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:54 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:54:54.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:54 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:54:54.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:54 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:54.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:54 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:54:54.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:54 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:54:54.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:54 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:55.829 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:55 smithi049 ceph-mon[32302]: Detected new or changed devices on smithi107 2024-06-02T23:54:55.829 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:55 smithi049 ceph-mon[32302]: Adjusting osd_memory_target on smithi107 to 5696M 2024-06-02T23:54:55.829 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:55 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:54:55.829 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:55 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:54:55.829 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:55 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:54:55.829 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:55 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:55.829 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:55 smithi049 ceph-mon[32302]: osdmap e61: 9 total, 9 up, 9 in 2024-06-02T23:54:55.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:55 smithi057 ceph-mon[36457]: Detected new or changed devices on smithi107 2024-06-02T23:54:55.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:55 smithi057 ceph-mon[36457]: Adjusting osd_memory_target on smithi107 to 5696M 2024-06-02T23:54:55.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:55 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:54:55.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:55 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:54:55.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:55 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:54:55.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:55 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:55.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:55 smithi057 ceph-mon[36457]: osdmap e61: 9 total, 9 up, 9 in 2024-06-02T23:54:56.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.046+0000 7ff67ac17700 1 -- 172.21.15.49:0/1235133486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6741024c0 msgr2=0x7ff6741028e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:54:56.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.046+0000 7ff67ac17700 1 --2- 172.21.15.49:0/1235133486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6741024c0 0x7ff6741028e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff6680099c0 tx=0x7ff668009cd0 comp rx=0 tx=0).stop 2024-06-02T23:54:56.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.046+0000 7ff67ac17700 1 -- 172.21.15.49:0/1235133486 shutdown_connections 2024-06-02T23:54:56.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.046+0000 7ff67ac17700 1 --2- 172.21.15.49:0/1235133486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff674104060 0x7ff67410a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:54:56.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.046+0000 7ff67ac17700 1 --2- 172.21.15.49:0/1235133486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6741024c0 0x7ff6741028e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:54:56.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.046+0000 7ff67ac17700 1 --2- 172.21.15.49:0/1235133486 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6741036c0 0x7ff674103b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:54:56.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.046+0000 7ff67ac17700 1 -- 172.21.15.49:0/1235133486 >> 172.21.15.49:0/1235133486 conn(0x7ff6740fda60 msgr2=0x7ff6740ffea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:54:56.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.046+0000 7ff67ac17700 1 -- 172.21.15.49:0/1235133486 shutdown_connections 2024-06-02T23:54:56.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.046+0000 7ff67ac17700 1 -- 172.21.15.49:0/1235133486 wait complete. 2024-06-02T23:54:56.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.046+0000 7ff67ac17700 1 Processor -- start 2024-06-02T23:54:56.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.046+0000 7ff67ac17700 1 -- start start 2024-06-02T23:54:56.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.047+0000 7ff67ac17700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6741024c0 0x7ff67419a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:54:56.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.047+0000 7ff67ac17700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6741036c0 0x7ff67419ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:54:56.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.047+0000 7ff67ac17700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff674104060 0x7ff6741a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:54:56.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.047+0000 7ff67ac17700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff67410e0b0 con 0x7ff6741036c0 2024-06-02T23:54:56.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.047+0000 7ff67ac17700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff67410df30 con 0x7ff6741024c0 2024-06-02T23:54:56.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.047+0000 7ff67ac17700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff67410e230 con 0x7ff674104060 2024-06-02T23:54:56.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.047+0000 7ff673fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6741036c0 0x7ff67419ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:54:56.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.047+0000 7ff673fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6741036c0 0x7ff67419ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38564/0 (socket says 172.21.15.49:38564) 2024-06-02T23:54:56.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.047+0000 7ff673fff700 1 -- 172.21.15.49:0/2430294195 learned_addr learned my addr 172.21.15.49:0/2430294195 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:54:56.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.047+0000 7ff6791b4700 1 --2- 172.21.15.49:0/2430294195 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff674104060 0x7ff6741a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:54:56.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.047+0000 7ff6789b3700 1 --2- 172.21.15.49:0/2430294195 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6741024c0 0x7ff67419a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:54:56.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.047+0000 7ff673fff700 1 -- 172.21.15.49:0/2430294195 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff674104060 msgr2=0x7ff6741a1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:54:56.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.047+0000 7ff673fff700 1 --2- 172.21.15.49:0/2430294195 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff674104060 0x7ff6741a1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:54:56.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.047+0000 7ff673fff700 1 -- 172.21.15.49:0/2430294195 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6741024c0 msgr2=0x7ff67419a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:54:56.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.047+0000 7ff673fff700 1 --2- 172.21.15.49:0/2430294195 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6741024c0 0x7ff67419a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:54:56.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.047+0000 7ff673fff700 1 -- 172.21.15.49:0/2430294195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6741a2560 con 0x7ff6741036c0 2024-06-02T23:54:56.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.047+0000 7ff673fff700 1 --2- 172.21.15.49:0/2430294195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6741036c0 0x7ff67419ae40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff66000d980 tx=0x7ff66000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:54:56.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.047+0000 7ff671ffb700 1 -- 172.21.15.49:0/2430294195 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff660016070 con 0x7ff6741036c0 2024-06-02T23:54:56.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.048+0000 7ff671ffb700 1 -- 172.21.15.49:0/2430294195 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff66000de70 con 0x7ff6741036c0 2024-06-02T23:54:56.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.048+0000 7ff67ac17700 1 -- 172.21.15.49:0/2430294195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6741a2850 con 0x7ff6741036c0 2024-06-02T23:54:56.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.048+0000 7ff671ffb700 1 -- 172.21.15.49:0/2430294195 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66000f3c0 con 0x7ff6741036c0 2024-06-02T23:54:56.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.048+0000 7ff67ac17700 1 -- 172.21.15.49:0/2430294195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6741a2d90 con 0x7ff6741036c0 2024-06-02T23:54:56.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.049+0000 7ff67ac17700 1 -- 172.21.15.49:0/2430294195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff674069180 con 0x7ff6741036c0 2024-06-02T23:54:56.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.050+0000 7ff671ffb700 1 -- 172.21.15.49:0/2430294195 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff660019070 con 0x7ff6741036c0 2024-06-02T23:54:56.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.050+0000 7ff671ffb700 1 --2- 172.21.15.49:0/2430294195 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff6640a2c20 0x7ff6640a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:54:56.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.051+0000 7ff6789b3700 1 --2- 172.21.15.49:0/2430294195 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff6640a2c20 0x7ff6640a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:54:56.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.051+0000 7ff671ffb700 1 -- 172.21.15.49:0/2430294195 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5858+0+0 (secure 0 0 0) 0x7ff6600ce240 con 0x7ff6741036c0 2024-06-02T23:54:56.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.051+0000 7ff6789b3700 1 --2- 172.21.15.49:0/2430294195 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff6640a2c20 0x7ff6640a50e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff66800b580 tx=0x7ff668005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:54:56.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.055+0000 7ff671ffb700 1 -- 172.21.15.49:0/2430294195 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff66009bb30 con 0x7ff6741036c0 2024-06-02T23:54:56.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:55 smithi107 ceph-mon[37048]: Detected new or changed devices on smithi107 2024-06-02T23:54:56.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:55 smithi107 ceph-mon[37048]: Adjusting osd_memory_target on smithi107 to 5696M 2024-06-02T23:54:56.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:55 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:54:56.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:55 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:54:56.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:55 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:54:56.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:55 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:54:56.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:55 smithi107 ceph-mon[37048]: osdmap e61: 9 total, 9 up, 9 in 2024-06-02T23:54:56.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:54:56.275+0000 7ff67ac17700 1 -- 172.21.15.49:0/2430294195 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7ff6741a2ff0 con 0x7ff6640a2c20 2024-06-02T23:54:56.880 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:56 smithi049 ceph-mon[32302]: pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-06-02T23:54:56.880 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:56 smithi049 ceph-mon[32302]: osdmap e62: 9 total, 9 up, 9 in 2024-06-02T23:54:56.880 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:54:56.880 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:54:56.880 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:54:56.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:56 smithi057 ceph-mon[36457]: pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-06-02T23:54:56.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:56 smithi057 ceph-mon[36457]: osdmap e62: 9 total, 9 up, 9 in 2024-06-02T23:54:56.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:54:56.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:54:56.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:54:57.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:56 smithi107 ceph-mon[37048]: pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-06-02T23:54:57.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:56 smithi107 ceph-mon[37048]: osdmap e62: 9 total, 9 up, 9 in 2024-06-02T23:54:57.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:54:57.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:54:57.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:54:57.883 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:57 smithi049 ceph-mon[32302]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:54:57.883 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:57 smithi049 ceph-mon[32302]: osdmap e63: 9 total, 9 up, 9 in 2024-06-02T23:54:57.949 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:57 smithi057 ceph-mon[36457]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:54:57.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:57 smithi057 ceph-mon[36457]: osdmap e63: 9 total, 9 up, 9 in 2024-06-02T23:54:58.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:57 smithi107 ceph-mon[37048]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:54:58.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:57 smithi107 ceph-mon[37048]: osdmap e63: 9 total, 9 up, 9 in 2024-06-02T23:54:58.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:58 smithi057 ceph-mon[36457]: pgmap v204: 1 pgs: 1 remapped+peering; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-06-02T23:54:58.960 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:58 smithi049 ceph-mon[32302]: pgmap v204: 1 pgs: 1 remapped+peering; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-06-02T23:54:59.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:58 smithi107 ceph-mon[37048]: pgmap v204: 1 pgs: 1 remapped+peering; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-06-02T23:54:59.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:59 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/1074687857' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0b5dcfa-9fd2-4a98-863b-197defa890af"}]: dispatch 2024-06-02T23:54:59.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:59 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/1074687857' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0b5dcfa-9fd2-4a98-863b-197defa890af"}]': finished 2024-06-02T23:54:59.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:59 smithi049 ceph-mon[32302]: osdmap e64: 10 total, 9 up, 10 in 2024-06-02T23:54:59.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:54:59 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T23:54:59.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:59 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/1074687857' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0b5dcfa-9fd2-4a98-863b-197defa890af"}]: dispatch 2024-06-02T23:54:59.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:59 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/1074687857' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0b5dcfa-9fd2-4a98-863b-197defa890af"}]': finished 2024-06-02T23:54:59.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:59 smithi057 ceph-mon[36457]: osdmap e64: 10 total, 9 up, 10 in 2024-06-02T23:54:59.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:54:59 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T23:55:00.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:59 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/1074687857' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0b5dcfa-9fd2-4a98-863b-197defa890af"}]: dispatch 2024-06-02T23:55:00.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:59 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/1074687857' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0b5dcfa-9fd2-4a98-863b-197defa890af"}]': finished 2024-06-02T23:55:00.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:59 smithi107 ceph-mon[37048]: osdmap e64: 10 total, 9 up, 10 in 2024-06-02T23:55:00.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:54:59 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T23:55:00.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:00 smithi057 ceph-mon[36457]: pgmap v206: 1 pgs: 1 remapped+peering; 577 KiB data, 270 MiB used, 804 GiB / 805 GiB avail 2024-06-02T23:55:00.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:00 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/930066180' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:55:00.960 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:00 smithi049 ceph-mon[32302]: pgmap v206: 1 pgs: 1 remapped+peering; 577 KiB data, 270 MiB used, 804 GiB / 805 GiB avail 2024-06-02T23:55:00.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:00 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/930066180' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:55:01.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:00 smithi107 ceph-mon[37048]: pgmap v206: 1 pgs: 1 remapped+peering; 577 KiB data, 270 MiB used, 804 GiB / 805 GiB avail 2024-06-02T23:55:01.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:00 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/930066180' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:55:02.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:02 smithi057 ceph-mon[36457]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-02T23:55:02.960 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:02 smithi049 ceph-mon[32302]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-02T23:55:03.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:02 smithi107 ceph-mon[37048]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-02T23:55:04.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:04 smithi057 ceph-mon[36457]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-06-02T23:55:04.960 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:04 smithi049 ceph-mon[32302]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-06-02T23:55:05.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:04 smithi107 ceph-mon[37048]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-06-02T23:55:06.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:06 smithi049 ceph-mon[32302]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-06-02T23:55:06.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:06 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-06-02T23:55:06.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:06 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:55:06.903 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:06 smithi107 ceph-mon[37048]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-06-02T23:55:06.903 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:06 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-06-02T23:55:06.903 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:06 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:55:06.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:06 smithi057 ceph-mon[36457]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-06-02T23:55:06.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:06 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-06-02T23:55:06.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:06 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:55:07.919 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:07 smithi107 ceph-mon[37048]: Deploying daemon osd.9 on smithi049 2024-06-02T23:55:07.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:07 smithi057 ceph-mon[36457]: Deploying daemon osd.9 on smithi049 2024-06-02T23:55:07.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:07 smithi049 ceph-mon[32302]: Deploying daemon osd.9 on smithi049 2024-06-02T23:55:08.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:08 smithi049 ceph-mon[32302]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-02T23:55:08.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:08 smithi057 ceph-mon[36457]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-02T23:55:09.097 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:08 smithi107 ceph-mon[37048]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-02T23:55:10.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:10 smithi049 ceph-mon[32302]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-06-02T23:55:10.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:10 smithi057 ceph-mon[36457]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-06-02T23:55:11.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:10 smithi107 ceph-mon[37048]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-06-02T23:55:12.865 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:12 smithi049 ceph-mon[32302]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-06-02T23:55:12.865 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:12 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:12.865 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:12 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:12.865 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:12 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:55:12.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:12 smithi057 ceph-mon[36457]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-06-02T23:55:12.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:12 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:12.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:12 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:12.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:12 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:55:13.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:12 smithi107 ceph-mon[37048]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-06-02T23:55:13.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:12 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:13.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:12 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:13.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:12 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:55:14.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:14 smithi049 ceph-mon[32302]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-06-02T23:55:14.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:14 smithi057 ceph-mon[36457]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-06-02T23:55:15.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:14 smithi107 ceph-mon[37048]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-06-02T23:55:16.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:55:16.047+0000 7ff671ffb700 1 -- 172.21.15.49:0/2430294195 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff6741a2ff0 con 0x7ff6640a2c20 2024-06-02T23:55:16.047 INFO:teuthology.orchestra.run.smithi049.stdout:Created osd(s) 9 on host 'smithi049' 2024-06-02T23:55:16.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:55:16.050+0000 7ff67ac17700 1 -- 172.21.15.49:0/2430294195 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff6640a2c20 msgr2=0x7ff6640a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:55:16.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:55:16.050+0000 7ff67ac17700 1 --2- 172.21.15.49:0/2430294195 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff6640a2c20 0x7ff6640a50e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff66800b580 tx=0x7ff668005fb0 comp rx=0 tx=0).stop 2024-06-02T23:55:16.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:55:16.050+0000 7ff67ac17700 1 -- 172.21.15.49:0/2430294195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6741036c0 msgr2=0x7ff67419ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:55:16.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:55:16.050+0000 7ff67ac17700 1 --2- 172.21.15.49:0/2430294195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6741036c0 0x7ff67419ae40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff66000d980 tx=0x7ff66000dc90 comp rx=0 tx=0).stop 2024-06-02T23:55:16.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:55:16.050+0000 7ff67ac17700 1 -- 172.21.15.49:0/2430294195 shutdown_connections 2024-06-02T23:55:16.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:55:16.050+0000 7ff67ac17700 1 --2- 172.21.15.49:0/2430294195 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff6640a2c20 0x7ff6640a50e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:55:16.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:55:16.050+0000 7ff67ac17700 1 --2- 172.21.15.49:0/2430294195 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff674104060 0x7ff6741a1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:55:16.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:55:16.050+0000 7ff67ac17700 1 --2- 172.21.15.49:0/2430294195 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6741024c0 0x7ff67419a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:55:16.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:55:16.050+0000 7ff67ac17700 1 --2- 172.21.15.49:0/2430294195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6741036c0 0x7ff67419ae40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:55:16.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:55:16.050+0000 7ff67ac17700 1 -- 172.21.15.49:0/2430294195 >> 172.21.15.49:0/2430294195 conn(0x7ff6740fda60 msgr2=0x7ff6740746c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:55:16.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:55:16.050+0000 7ff67ac17700 1 -- 172.21.15.49:0/2430294195 shutdown_connections 2024-06-02T23:55:16.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:55:16.050+0000 7ff67ac17700 1 -- 172.21.15.49:0/2430294195 wait complete. 2024-06-02T23:55:16.376 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:16 smithi049 ceph-mon[32302]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-06-02T23:55:16.376 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:16 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:16.376 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:16 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:16.376 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:16 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:55:16.376 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:16 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:55:16.376 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:16 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:16.376 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:16 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:16.376 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:16 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:16.376 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:16 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:55:16.376 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:16 smithi049 ceph-mon[32302]: from='osd.9 [v2:172.21.15.49:6826/3627936526,v1:172.21.15.49:6827/3627936526]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-02T23:55:16.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:16 smithi107 ceph-mon[37048]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-06-02T23:55:16.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:16 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:16.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:16 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:16.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:16 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:55:16.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:16 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:55:16.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:16 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:16.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:16 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:16.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:16 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:16.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:16 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:55:16.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:16 smithi107 ceph-mon[37048]: from='osd.9 [v2:172.21.15.49:6826/3627936526,v1:172.21.15.49:6827/3627936526]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-02T23:55:16.697 DEBUG:teuthology.orchestra.run.smithi049:osd.9> sudo journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.9.service 2024-06-02T23:55:16.700 INFO:tasks.cephadm:Deploying osd.10 on smithi057 with /dev/vg_nvme/lv_1... 2024-06-02T23:55:16.700 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-06-02T23:55:16.701 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:16 smithi057 ceph-mon[36457]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-06-02T23:55:16.701 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:16 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:16.701 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:16 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:16.701 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:16 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:55:16.701 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:16 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:55:16.701 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:16 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:16.701 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:16 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:16.701 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:16 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:16.701 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:16 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:55:16.701 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:16 smithi057 ceph-mon[36457]: from='osd.9 [v2:172.21.15.49:6826/3627936526,v1:172.21.15.49:6827/3627936526]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-02T23:55:16.957 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T23:55:18.108 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:18 smithi049 ceph-mon[32302]: from='osd.9 [v2:172.21.15.49:6826/3627936526,v1:172.21.15.49:6827/3627936526]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-06-02T23:55:18.108 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:18 smithi049 ceph-mon[32302]: osdmap e65: 10 total, 9 up, 10 in 2024-06-02T23:55:18.108 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:18 smithi049 ceph-mon[32302]: from='osd.9 [v2:172.21.15.49:6826/3627936526,v1:172.21.15.49:6827/3627936526]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-06-02T23:55:18.108 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:18 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T23:55:18.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:18 smithi107 ceph-mon[37048]: from='osd.9 [v2:172.21.15.49:6826/3627936526,v1:172.21.15.49:6827/3627936526]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-06-02T23:55:18.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:18 smithi107 ceph-mon[37048]: osdmap e65: 10 total, 9 up, 10 in 2024-06-02T23:55:18.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:18 smithi107 ceph-mon[37048]: from='osd.9 [v2:172.21.15.49:6826/3627936526,v1:172.21.15.49:6827/3627936526]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-06-02T23:55:18.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:18 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T23:55:18.365 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:18 smithi057 ceph-mon[36457]: from='osd.9 [v2:172.21.15.49:6826/3627936526,v1:172.21.15.49:6827/3627936526]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-06-02T23:55:18.365 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:18 smithi057 ceph-mon[36457]: osdmap e65: 10 total, 9 up, 10 in 2024-06-02T23:55:18.365 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:18 smithi057 ceph-mon[36457]: from='osd.9 [v2:172.21.15.49:6826/3627936526,v1:172.21.15.49:6827/3627936526]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-06-02T23:55:18.365 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:18 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T23:55:18.979 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-06-02T23:55:18.979 INFO:teuthology.orchestra.run.smithi057.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-06-02T23:55:18.980 INFO:teuthology.orchestra.run.smithi057.stderr: stderr: 10+0 records in 2024-06-02T23:55:18.980 INFO:teuthology.orchestra.run.smithi057.stderr:10+0 records out 2024-06-02T23:55:18.980 INFO:teuthology.orchestra.run.smithi057.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0164311 s, 638 MB/s 2024-06-02T23:55:18.980 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping successful for: 2024-06-02T23:55:19.064 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:19 smithi049 ceph-mon[32302]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-06-02T23:55:19.064 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:19 smithi049 ceph-mon[32302]: from='osd.9 [v2:172.21.15.49:6826/3627936526,v1:172.21.15.49:6827/3627936526]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-06-02T23:55:19.064 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:19 smithi049 ceph-mon[32302]: osdmap e66: 10 total, 9 up, 10 in 2024-06-02T23:55:19.064 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:19 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T23:55:19.064 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:19 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T23:55:19.065 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:19 smithi049 ceph-mon[32302]: from='osd.9 [v2:172.21.15.49:6826/3627936526,v1:172.21.15.49:6827/3627936526]' entity='osd.9' 2024-06-02T23:55:19.065 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 02 23:55:18 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-02T23:55:18.799+0000 7ff1993e3700 -1 osd.9 0 waiting for initial osdmap 2024-06-02T23:55:19.065 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 02 23:55:18 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-02T23:55:18.813+0000 7ff1919cf700 -1 osd.9 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T23:55:19.288 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:19 smithi057 ceph-mon[36457]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-06-02T23:55:19.288 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:19 smithi057 ceph-mon[36457]: from='osd.9 [v2:172.21.15.49:6826/3627936526,v1:172.21.15.49:6827/3627936526]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-06-02T23:55:19.288 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:19 smithi057 ceph-mon[36457]: osdmap e66: 10 total, 9 up, 10 in 2024-06-02T23:55:19.289 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:19 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T23:55:19.289 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:19 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T23:55:19.289 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:19 smithi057 ceph-mon[36457]: from='osd.9 [v2:172.21.15.49:6826/3627936526,v1:172.21.15.49:6827/3627936526]' entity='osd.9' 2024-06-02T23:55:19.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:19 smithi107 ceph-mon[37048]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-06-02T23:55:19.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:19 smithi107 ceph-mon[37048]: from='osd.9 [v2:172.21.15.49:6826/3627936526,v1:172.21.15.49:6827/3627936526]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-06-02T23:55:19.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:19 smithi107 ceph-mon[37048]: osdmap e66: 10 total, 9 up, 10 in 2024-06-02T23:55:19.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:19 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T23:55:19.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:19 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T23:55:19.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:19 smithi107 ceph-mon[37048]: from='osd.9 [v2:172.21.15.49:6826/3627936526,v1:172.21.15.49:6827/3627936526]' entity='osd.9' 2024-06-02T23:55:19.802 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi057:vg_nvme/lv_1 2024-06-02T23:55:20.051 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T23:55:20.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:20 smithi107 ceph-mon[37048]: purged_snaps scrub starts 2024-06-02T23:55:20.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:20 smithi107 ceph-mon[37048]: purged_snaps scrub ok 2024-06-02T23:55:20.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:20 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T23:55:20.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:20 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:20.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:20 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:20.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:20 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:55:20.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:20 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:55:20.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:20 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:55:20.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:20 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:55:20.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:20 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:20.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:20 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:55:20.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:20 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:55:20.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:20 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:20.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:20 smithi107 ceph-mon[37048]: osd.9 [v2:172.21.15.49:6826/3627936526,v1:172.21.15.49:6827/3627936526] boot 2024-06-02T23:55:20.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:20 smithi107 ceph-mon[37048]: osdmap e67: 10 total, 10 up, 10 in 2024-06-02T23:55:20.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:20 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T23:55:20.385 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:20 smithi057 ceph-mon[36457]: purged_snaps scrub starts 2024-06-02T23:55:20.385 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:20 smithi057 ceph-mon[36457]: purged_snaps scrub ok 2024-06-02T23:55:20.385 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:20 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T23:55:20.385 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:20 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:20.385 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:20 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:20.385 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:20 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:55:20.386 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:20 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:55:20.386 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:20 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:55:20.386 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:20 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:55:20.386 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:20 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:20.386 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:20 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:55:20.386 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:20 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:55:20.386 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:20 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:20.386 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:20 smithi057 ceph-mon[36457]: osd.9 [v2:172.21.15.49:6826/3627936526,v1:172.21.15.49:6827/3627936526] boot 2024-06-02T23:55:20.386 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:20 smithi057 ceph-mon[36457]: osdmap e67: 10 total, 10 up, 10 in 2024-06-02T23:55:20.386 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:20 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T23:55:20.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:20 smithi049 ceph-mon[32302]: purged_snaps scrub starts 2024-06-02T23:55:20.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:20 smithi049 ceph-mon[32302]: purged_snaps scrub ok 2024-06-02T23:55:20.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:20 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T23:55:20.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:20 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:20.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:20 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:20.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:20 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:55:20.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:20 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:55:20.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:20 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:55:20.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:20 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:55:20.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:20 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:20.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:20 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:55:20.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:20 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:55:20.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:20 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:20.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:20 smithi049 ceph-mon[32302]: osd.9 [v2:172.21.15.49:6826/3627936526,v1:172.21.15.49:6827/3627936526] boot 2024-06-02T23:55:20.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:20 smithi049 ceph-mon[32302]: osdmap e67: 10 total, 10 up, 10 in 2024-06-02T23:55:20.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:20 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T23:55:21.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:21 smithi107 ceph-mon[37048]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-06-02T23:55:21.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:21 smithi107 ceph-mon[37048]: Detected new or changed devices on smithi049 2024-06-02T23:55:21.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:21 smithi107 ceph-mon[37048]: Adjusting osd_memory_target on smithi049 to 4272M 2024-06-02T23:55:21.391 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:21 smithi057 ceph-mon[36457]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-06-02T23:55:21.391 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:21 smithi057 ceph-mon[36457]: Detected new or changed devices on smithi049 2024-06-02T23:55:21.391 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:21 smithi057 ceph-mon[36457]: Adjusting osd_memory_target on smithi049 to 4272M 2024-06-02T23:55:21.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:21 smithi049 ceph-mon[32302]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-06-02T23:55:21.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:21 smithi049 ceph-mon[32302]: Detected new or changed devices on smithi049 2024-06-02T23:55:21.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:21 smithi049 ceph-mon[32302]: Adjusting osd_memory_target on smithi049 to 4272M 2024-06-02T23:55:21.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.752+0000 7fb246865700 1 -- 172.21.15.57:0/1084886608 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb240103710 msgr2=0x7fb240103b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:55:21.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.752+0000 7fb246865700 1 --2- 172.21.15.57:0/1084886608 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb240103710 0x7fb240103b70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb2340099c0 tx=0x7fb234009cd0 comp rx=0 tx=0).stop 2024-06-02T23:55:21.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.752+0000 7fb246865700 1 -- 172.21.15.57:0/1084886608 shutdown_connections 2024-06-02T23:55:21.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.752+0000 7fb246865700 1 --2- 172.21.15.57:0/1084886608 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2401040b0 0x7fb24010a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:55:21.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.752+0000 7fb246865700 1 --2- 172.21.15.57:0/1084886608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb240102510 0x7fb240102930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:55:21.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.752+0000 7fb246865700 1 --2- 172.21.15.57:0/1084886608 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb240103710 0x7fb240103b70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:55:21.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.752+0000 7fb246865700 1 -- 172.21.15.57:0/1084886608 >> 172.21.15.57:0/1084886608 conn(0x7fb2400fdab0 msgr2=0x7fb2400ffef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:55:21.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.752+0000 7fb246865700 1 -- 172.21.15.57:0/1084886608 shutdown_connections 2024-06-02T23:55:21.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.752+0000 7fb246865700 1 -- 172.21.15.57:0/1084886608 wait complete. 2024-06-02T23:55:21.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.753+0000 7fb246865700 1 Processor -- start 2024-06-02T23:55:21.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.753+0000 7fb246865700 1 -- start start 2024-06-02T23:55:21.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.753+0000 7fb246865700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb240102510 0x7fb240076230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:55:21.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.753+0000 7fb246865700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb240103710 0x7fb240074880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:55:21.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.753+0000 7fb246865700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2401040b0 0x7fb240074dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:55:21.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.753+0000 7fb246865700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb24010e120 con 0x7fb2401040b0 2024-06-02T23:55:21.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.753+0000 7fb246865700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb24010dfa0 con 0x7fb240102510 2024-06-02T23:55:21.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.753+0000 7fb246865700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb24010e2a0 con 0x7fb240103710 2024-06-02T23:55:21.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.753+0000 7fb23ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb240102510 0x7fb240076230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:55:21.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.753+0000 7fb23ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb240102510 0x7fb240076230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46066/0 (socket says 172.21.15.57:46066) 2024-06-02T23:55:21.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.753+0000 7fb23ffff700 1 -- 172.21.15.57:0/3112315378 learned_addr learned my addr 172.21.15.57:0/3112315378 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-06-02T23:55:21.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.753+0000 7fb23f7fe700 1 --2- 172.21.15.57:0/3112315378 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb240103710 0x7fb240074880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:55:21.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.753+0000 7fb244e02700 1 --2- 172.21.15.57:0/3112315378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2401040b0 0x7fb240074dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:55:21.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.754+0000 7fb23ffff700 1 -- 172.21.15.57:0/3112315378 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb240103710 msgr2=0x7fb240074880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:55:21.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.754+0000 7fb23ffff700 1 --2- 172.21.15.57:0/3112315378 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb240103710 0x7fb240074880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:55:21.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.754+0000 7fb23ffff700 1 -- 172.21.15.57:0/3112315378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2401040b0 msgr2=0x7fb240074dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:55:21.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.754+0000 7fb23ffff700 1 --2- 172.21.15.57:0/3112315378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2401040b0 0x7fb240074dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:55:21.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.754+0000 7fb23ffff700 1 -- 172.21.15.57:0/3112315378 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb240075670 con 0x7fb240102510 2024-06-02T23:55:21.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.754+0000 7fb23ffff700 1 --2- 172.21.15.57:0/3112315378 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb240102510 0x7fb240076230 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb23000d980 tx=0x7fb23000dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:55:21.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.754+0000 7fb23d7fa700 1 -- 172.21.15.57:0/3112315378 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb230016070 con 0x7fb240102510 2024-06-02T23:55:21.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.754+0000 7fb23d7fa700 1 -- 172.21.15.57:0/3112315378 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb23000be30 con 0x7fb240102510 2024-06-02T23:55:21.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.754+0000 7fb246865700 1 -- 172.21.15.57:0/3112315378 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2401a28c0 con 0x7fb240102510 2024-06-02T23:55:21.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.754+0000 7fb23d7fa700 1 -- 172.21.15.57:0/3112315378 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23000f3c0 con 0x7fb240102510 2024-06-02T23:55:21.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.754+0000 7fb246865700 1 -- 172.21.15.57:0/3112315378 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2401a2e00 con 0x7fb240102510 2024-06-02T23:55:21.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.755+0000 7fb246865700 1 -- 172.21.15.57:0/3112315378 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb240069180 con 0x7fb240102510 2024-06-02T23:55:21.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.756+0000 7fb23d7fa700 1 -- 172.21.15.57:0/3112315378 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb230019070 con 0x7fb240102510 2024-06-02T23:55:21.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.757+0000 7fb23d7fa700 1 --2- 172.21.15.57:0/3112315378 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fb2280a2ca0 0x7fb2280a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:55:21.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.757+0000 7fb23d7fa700 1 -- 172.21.15.57:0/3112315378 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6261+0+0 (secure 0 0 0) 0x7fb2300ce440 con 0x7fb240102510 2024-06-02T23:55:21.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.757+0000 7fb23f7fe700 1 --2- 172.21.15.57:0/3112315378 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fb2280a2ca0 0x7fb2280a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:55:21.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.758+0000 7fb23f7fe700 1 --2- 172.21.15.57:0/3112315378 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fb2280a2ca0 0x7fb2280a5160 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb234000c00 tx=0x7fb234005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:55:21.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.762+0000 7fb23d7fa700 1 -- 172.21.15.57:0/3112315378 <== mon.2 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb230020030 con 0x7fb240102510 2024-06-02T23:55:21.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:21.976+0000 7fb246865700 1 -- 172.21.15.57:0/3112315378 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fb240062990 con 0x7fb2280a2ca0 2024-06-02T23:55:22.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:22 smithi107 ceph-mon[37048]: osdmap e68: 10 total, 10 up, 10 in 2024-06-02T23:55:22.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:22 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:55:22.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:22 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:55:22.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:22 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:55:22.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:22 smithi057 ceph-mon[36457]: osdmap e68: 10 total, 10 up, 10 in 2024-06-02T23:55:22.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:22 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:55:22.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:22 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:55:22.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:22 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:55:22.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:22 smithi049 ceph-mon[32302]: osdmap e68: 10 total, 10 up, 10 in 2024-06-02T23:55:22.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:22 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:55:22.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:22 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:55:22.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:22 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:55:23.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:23 smithi057 ceph-mon[36457]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:23.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:23 smithi057 ceph-mon[36457]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:55:23.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:23 smithi107 ceph-mon[37048]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:23.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:23 smithi107 ceph-mon[37048]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:55:23.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:23 smithi049 ceph-mon[32302]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:23.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:23 smithi049 ceph-mon[32302]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:55:25.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:25 smithi107 ceph-mon[37048]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:25.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:25 smithi107 ceph-mon[37048]: from='client.? 172.21.15.57:0/3225831948' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "21a75846-adec-41b8-9e1d-e5c61ba30b12"}]: dispatch 2024-06-02T23:55:25.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:25 smithi107 ceph-mon[37048]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "21a75846-adec-41b8-9e1d-e5c61ba30b12"}]: dispatch 2024-06-02T23:55:25.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:25 smithi107 ceph-mon[37048]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21a75846-adec-41b8-9e1d-e5c61ba30b12"}]': finished 2024-06-02T23:55:25.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:25 smithi107 ceph-mon[37048]: osdmap e69: 11 total, 10 up, 11 in 2024-06-02T23:55:25.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:25 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T23:55:25.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:25 smithi057 ceph-mon[36457]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:25.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:25 smithi057 ceph-mon[36457]: from='client.? 172.21.15.57:0/3225831948' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "21a75846-adec-41b8-9e1d-e5c61ba30b12"}]: dispatch 2024-06-02T23:55:25.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:25 smithi057 ceph-mon[36457]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "21a75846-adec-41b8-9e1d-e5c61ba30b12"}]: dispatch 2024-06-02T23:55:25.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:25 smithi057 ceph-mon[36457]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21a75846-adec-41b8-9e1d-e5c61ba30b12"}]': finished 2024-06-02T23:55:25.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:25 smithi057 ceph-mon[36457]: osdmap e69: 11 total, 10 up, 11 in 2024-06-02T23:55:25.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:25 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T23:55:25.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:25 smithi049 ceph-mon[32302]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:25.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:25 smithi049 ceph-mon[32302]: from='client.? 172.21.15.57:0/3225831948' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "21a75846-adec-41b8-9e1d-e5c61ba30b12"}]: dispatch 2024-06-02T23:55:25.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:25 smithi049 ceph-mon[32302]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "21a75846-adec-41b8-9e1d-e5c61ba30b12"}]: dispatch 2024-06-02T23:55:25.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:25 smithi049 ceph-mon[32302]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21a75846-adec-41b8-9e1d-e5c61ba30b12"}]': finished 2024-06-02T23:55:25.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:25 smithi049 ceph-mon[32302]: osdmap e69: 11 total, 10 up, 11 in 2024-06-02T23:55:25.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:25 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T23:55:26.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:26 smithi107 ceph-mon[37048]: from='client.? 172.21.15.57:0/1939232956' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:55:26.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:26 smithi057 ceph-mon[36457]: from='client.? 172.21.15.57:0/1939232956' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:55:26.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:26 smithi049 ceph-mon[32302]: from='client.? 172.21.15.57:0/1939232956' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:55:27.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:27 smithi107 ceph-mon[37048]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:27.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:27 smithi057 ceph-mon[36457]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:27.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:27 smithi049 ceph-mon[32302]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:28.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:28 smithi107 ceph-mon[37048]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:28.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:28 smithi057 ceph-mon[36457]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:28.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:28 smithi049 ceph-mon[32302]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:30.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:30 smithi057 ceph-mon[36457]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:30.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:30 smithi107 ceph-mon[37048]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:30.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:30 smithi049 ceph-mon[32302]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:32.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:32 smithi107 ceph-mon[37048]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:32.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:32 smithi057 ceph-mon[36457]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:32.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:32 smithi049 ceph-mon[32302]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:34.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:34 smithi057 ceph-mon[36457]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:34.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:34 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-06-02T23:55:34.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:34 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:55:34.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:34 smithi057 ceph-mon[36457]: Deploying daemon osd.10 on smithi057 2024-06-02T23:55:34.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:34 smithi107 ceph-mon[37048]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:34.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:34 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-06-02T23:55:34.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:34 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:55:34.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:34 smithi107 ceph-mon[37048]: Deploying daemon osd.10 on smithi057 2024-06-02T23:55:34.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:34 smithi049 ceph-mon[32302]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:34.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:34 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-06-02T23:55:34.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:34 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:55:34.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:34 smithi049 ceph-mon[32302]: Deploying daemon osd.10 on smithi057 2024-06-02T23:55:36.500 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:36 smithi057 ceph-mon[36457]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:36.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:36 smithi107 ceph-mon[37048]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:36.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:36 smithi049 ceph-mon[32302]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:38.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:38 smithi107 ceph-mon[37048]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:38.675 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:38 smithi057 ceph-mon[36457]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:38.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:38 smithi049 ceph-mon[32302]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:40.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:40 smithi107 ceph-mon[37048]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:40.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:40.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:40.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:55:40.625 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:40 smithi057 ceph-mon[36457]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:40.625 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:40 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:40.625 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:40 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:40.625 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:40 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:55:40.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:40 smithi049 ceph-mon[32302]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:40.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:40 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:40.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:40 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:40.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:40 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:55:42.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:42 smithi107 ceph-mon[37048]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:42.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:42 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:42.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:42 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:42.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:42 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:55:42.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:42 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:55:42.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:42 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:42.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:42 smithi057 ceph-mon[36457]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:42.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:42 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:42.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:42 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:42.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:42 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:55:42.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:42 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:55:42.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:42 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:42.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:42 smithi049 ceph-mon[32302]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:42.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:42 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:42.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:42 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:42.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:42 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:55:42.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:42 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:55:42.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:42 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:43.048 INFO:teuthology.orchestra.run.smithi057.stdout:Created osd(s) 10 on host 'smithi057' 2024-06-02T23:55:43.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:43.047+0000 7fb23d7fa700 1 -- 172.21.15.57:0/3112315378 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fb240062990 con 0x7fb2280a2ca0 2024-06-02T23:55:43.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:43.050+0000 7fb246865700 1 -- 172.21.15.57:0/3112315378 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fb2280a2ca0 msgr2=0x7fb2280a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:55:43.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:43.050+0000 7fb246865700 1 --2- 172.21.15.57:0/3112315378 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fb2280a2ca0 0x7fb2280a5160 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb234000c00 tx=0x7fb234005fb0 comp rx=0 tx=0).stop 2024-06-02T23:55:43.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:43.050+0000 7fb246865700 1 -- 172.21.15.57:0/3112315378 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb240102510 msgr2=0x7fb240076230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:55:43.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:43.050+0000 7fb246865700 1 --2- 172.21.15.57:0/3112315378 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb240102510 0x7fb240076230 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb23000d980 tx=0x7fb23000dc90 comp rx=0 tx=0).stop 2024-06-02T23:55:43.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:43.050+0000 7fb246865700 1 -- 172.21.15.57:0/3112315378 shutdown_connections 2024-06-02T23:55:43.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:43.050+0000 7fb246865700 1 --2- 172.21.15.57:0/3112315378 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fb2280a2ca0 0x7fb2280a5160 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:55:43.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:43.050+0000 7fb246865700 1 --2- 172.21.15.57:0/3112315378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2401040b0 0x7fb240074dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:55:43.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:43.050+0000 7fb246865700 1 --2- 172.21.15.57:0/3112315378 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb240102510 0x7fb240076230 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:55:43.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:43.050+0000 7fb246865700 1 --2- 172.21.15.57:0/3112315378 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb240103710 0x7fb240074880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:55:43.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:43.050+0000 7fb246865700 1 -- 172.21.15.57:0/3112315378 >> 172.21.15.57:0/3112315378 conn(0x7fb2400fdab0 msgr2=0x7fb240106a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:55:43.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:43.050+0000 7fb246865700 1 -- 172.21.15.57:0/3112315378 shutdown_connections 2024-06-02T23:55:43.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-06-02T23:55:43.050+0000 7fb246865700 1 -- 172.21.15.57:0/3112315378 wait complete. 2024-06-02T23:55:43.768 DEBUG:teuthology.orchestra.run.smithi057:osd.10> sudo journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.10.service 2024-06-02T23:55:43.770 INFO:tasks.cephadm:Deploying osd.11 on smithi107 with /dev/vg_nvme/lv_1... 2024-06-02T23:55:43.770 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-06-02T23:55:44.014 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T23:55:44.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:44 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:44.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:44 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:44.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:44 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:55:44.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:44 smithi107 ceph-mon[37048]: from='osd.10 [v2:172.21.15.57:6824/3013235811,v1:172.21.15.57:6825/3013235811]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-02T23:55:44.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:44 smithi107 ceph-mon[37048]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-02T23:55:44.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:44 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:44.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:44 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:44.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:44 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:55:44.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:44 smithi057 ceph-mon[36457]: from='osd.10 [v2:172.21.15.57:6824/3013235811,v1:172.21.15.57:6825/3013235811]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-02T23:55:44.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:44 smithi057 ceph-mon[36457]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-02T23:55:44.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:44 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:44.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:44 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:44.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:44 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:55:44.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:44 smithi049 ceph-mon[32302]: from='osd.10 [v2:172.21.15.57:6824/3013235811,v1:172.21.15.57:6825/3013235811]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-02T23:55:44.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:44 smithi049 ceph-mon[32302]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-02T23:55:45.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:45 smithi107 ceph-mon[37048]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:45.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:45 smithi107 ceph-mon[37048]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-06-02T23:55:45.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:45 smithi107 ceph-mon[37048]: osdmap e70: 11 total, 10 up, 11 in 2024-06-02T23:55:45.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:45 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T23:55:45.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:45 smithi107 ceph-mon[37048]: from='osd.10 [v2:172.21.15.57:6824/3013235811,v1:172.21.15.57:6825/3013235811]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-06-02T23:55:45.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:45 smithi107 ceph-mon[37048]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-06-02T23:55:45.131 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:45 smithi057 ceph-mon[36457]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:45.131 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:45 smithi057 ceph-mon[36457]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-06-02T23:55:45.131 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:45 smithi057 ceph-mon[36457]: osdmap e70: 11 total, 10 up, 11 in 2024-06-02T23:55:45.131 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:45 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T23:55:45.131 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:45 smithi057 ceph-mon[36457]: from='osd.10 [v2:172.21.15.57:6824/3013235811,v1:172.21.15.57:6825/3013235811]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-06-02T23:55:45.131 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:45 smithi057 ceph-mon[36457]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-06-02T23:55:45.132 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 02 23:55:45 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-02T23:55:45.040+0000 7f289bb87700 -1 osd.10 0 waiting for initial osdmap 2024-06-02T23:55:45.132 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 02 23:55:45 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-02T23:55:45.055+0000 7f289817b700 -1 osd.10 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T23:55:45.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:45 smithi049 ceph-mon[32302]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:45.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:45 smithi049 ceph-mon[32302]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-06-02T23:55:45.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:45 smithi049 ceph-mon[32302]: osdmap e70: 11 total, 10 up, 11 in 2024-06-02T23:55:45.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:45 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T23:55:45.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:45 smithi049 ceph-mon[32302]: from='osd.10 [v2:172.21.15.57:6824/3013235811,v1:172.21.15.57:6825/3013235811]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-06-02T23:55:45.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:45 smithi049 ceph-mon[32302]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2024-06-02T23:55:46.048 INFO:teuthology.orchestra.run.smithi107.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-06-02T23:55:46.048 INFO:teuthology.orchestra.run.smithi107.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-06-02T23:55:46.048 INFO:teuthology.orchestra.run.smithi107.stderr: stderr: 10+0 records in 2024-06-02T23:55:46.048 INFO:teuthology.orchestra.run.smithi107.stderr:10+0 records out 2024-06-02T23:55:46.048 INFO:teuthology.orchestra.run.smithi107.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114977 s, 912 MB/s 2024-06-02T23:55:46.048 INFO:teuthology.orchestra.run.smithi107.stderr:--> Zapping successful for: 2024-06-02T23:55:46.103 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:46 smithi107 ceph-mon[37048]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2024-06-02T23:55:46.103 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:46 smithi107 ceph-mon[37048]: osdmap e71: 11 total, 10 up, 11 in 2024-06-02T23:55:46.103 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:46 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T23:55:46.103 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:46 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T23:55:46.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:46 smithi057 ceph-mon[36457]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2024-06-02T23:55:46.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:46 smithi057 ceph-mon[36457]: osdmap e71: 11 total, 10 up, 11 in 2024-06-02T23:55:46.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:46 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T23:55:46.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:46 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T23:55:46.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:46 smithi049 ceph-mon[32302]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2024-06-02T23:55:46.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:46 smithi049 ceph-mon[32302]: osdmap e71: 11 total, 10 up, 11 in 2024-06-02T23:55:46.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:46 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T23:55:46.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:46 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T23:55:46.756 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi107:vg_nvme/lv_1 2024-06-02T23:55:47.006 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T23:55:47.045 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:47 smithi107 ceph-mon[37048]: purged_snaps scrub starts 2024-06-02T23:55:47.046 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:47 smithi107 ceph-mon[37048]: purged_snaps scrub ok 2024-06-02T23:55:47.046 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:47 smithi107 ceph-mon[37048]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:47.046 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:47 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T23:55:47.046 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:47 smithi107 ceph-mon[37048]: osd.10 [v2:172.21.15.57:6824/3013235811,v1:172.21.15.57:6825/3013235811] boot 2024-06-02T23:55:47.046 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:47 smithi107 ceph-mon[37048]: osdmap e72: 11 total, 11 up, 11 in 2024-06-02T23:55:47.046 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:47 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T23:55:47.046 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:47 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:47.046 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:47 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:47.046 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:47 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:55:47.046 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:47 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:55:47.046 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:47 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:55:47.046 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:47 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:55:47.047 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:47 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:47.047 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:47 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:55:47.047 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:47 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:55:47.047 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:47 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:47.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:47 smithi057 ceph-mon[36457]: purged_snaps scrub starts 2024-06-02T23:55:47.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:47 smithi057 ceph-mon[36457]: purged_snaps scrub ok 2024-06-02T23:55:47.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:47 smithi057 ceph-mon[36457]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:47.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:47 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T23:55:47.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:47 smithi057 ceph-mon[36457]: osd.10 [v2:172.21.15.57:6824/3013235811,v1:172.21.15.57:6825/3013235811] boot 2024-06-02T23:55:47.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:47 smithi057 ceph-mon[36457]: osdmap e72: 11 total, 11 up, 11 in 2024-06-02T23:55:47.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:47 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T23:55:47.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:47 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:47.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:47 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:47.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:47 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:55:47.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:47 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:55:47.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:47 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:55:47.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:47 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:55:47.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:47 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:47.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:47 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:55:47.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:47 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:55:47.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:47 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:47.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:47 smithi049 ceph-mon[32302]: purged_snaps scrub starts 2024-06-02T23:55:47.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:47 smithi049 ceph-mon[32302]: purged_snaps scrub ok 2024-06-02T23:55:47.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:47 smithi049 ceph-mon[32302]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-02T23:55:47.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:47 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T23:55:47.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:47 smithi049 ceph-mon[32302]: osd.10 [v2:172.21.15.57:6824/3013235811,v1:172.21.15.57:6825/3013235811] boot 2024-06-02T23:55:47.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:47 smithi049 ceph-mon[32302]: osdmap e72: 11 total, 11 up, 11 in 2024-06-02T23:55:47.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:47 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T23:55:47.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:47 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:47.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:47 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:47.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:47 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:55:47.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:47 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:55:47.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:47 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:55:47.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:47 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:55:47.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:47 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:47.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:47 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:55:47.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:47 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:55:47.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:47 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:55:48.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:48 smithi107 ceph-mon[37048]: Detected new or changed devices on smithi057 2024-06-02T23:55:48.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:48 smithi107 ceph-mon[37048]: Adjusting osd_memory_target on smithi057 to 4273M 2024-06-02T23:55:48.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:48 smithi107 ceph-mon[37048]: osdmap e73: 11 total, 11 up, 11 in 2024-06-02T23:55:48.394 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:48 smithi057 ceph-mon[36457]: Detected new or changed devices on smithi057 2024-06-02T23:55:48.394 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:48 smithi057 ceph-mon[36457]: Adjusting osd_memory_target on smithi057 to 4273M 2024-06-02T23:55:48.394 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:48 smithi057 ceph-mon[36457]: osdmap e73: 11 total, 11 up, 11 in 2024-06-02T23:55:48.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:48 smithi049 ceph-mon[32302]: Detected new or changed devices on smithi057 2024-06-02T23:55:48.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:48 smithi049 ceph-mon[32302]: Adjusting osd_memory_target on smithi057 to 4273M 2024-06-02T23:55:48.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:48 smithi049 ceph-mon[32302]: osdmap e73: 11 total, 11 up, 11 in 2024-06-02T23:55:48.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.648+0000 7f980171e700 1 -- 172.21.15.107:0/2332535829 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97fc102f90 msgr2=0x7f97fc109840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:55:48.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.648+0000 7f980171e700 1 --2- 172.21.15.107:0/2332535829 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97fc102f90 0x7f97fc109840 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f97ec009990 tx=0x7f97ec009ca0 comp rx=0 tx=0).stop 2024-06-02T23:55:48.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.648+0000 7f980171e700 1 -- 172.21.15.107:0/2332535829 shutdown_connections 2024-06-02T23:55:48.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.648+0000 7f980171e700 1 --2- 172.21.15.107:0/2332535829 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97fc102f90 0x7f97fc109840 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:55:48.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.648+0000 7f980171e700 1 --2- 172.21.15.107:0/2332535829 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97fc1013f0 0x7f97fc101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:55:48.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.648+0000 7f980171e700 1 --2- 172.21.15.107:0/2332535829 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97fc1025f0 0x7f97fc102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:55:48.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.648+0000 7f980171e700 1 -- 172.21.15.107:0/2332535829 >> 172.21.15.107:0/2332535829 conn(0x7f97fc0fc990 msgr2=0x7f97fc0fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:55:48.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.648+0000 7f980171e700 1 -- 172.21.15.107:0/2332535829 shutdown_connections 2024-06-02T23:55:48.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.648+0000 7f980171e700 1 -- 172.21.15.107:0/2332535829 wait complete. 2024-06-02T23:55:48.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.648+0000 7f980171e700 1 Processor -- start 2024-06-02T23:55:48.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.648+0000 7f980171e700 1 -- start start 2024-06-02T23:55:48.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.649+0000 7f980171e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97fc1013f0 0x7f97fc06acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:55:48.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.649+0000 7f980171e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97fc1025f0 0x7f97fc19d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:55:48.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.649+0000 7f980171e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97fc102f90 0x7f97fc19fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:55:48.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.649+0000 7f980171e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc10cfd0 con 0x7f97fc1025f0 2024-06-02T23:55:48.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.649+0000 7f980171e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc10ce50 con 0x7f97fc1013f0 2024-06-02T23:55:48.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.649+0000 7f980171e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc10d150 con 0x7f97fc102f90 2024-06-02T23:55:48.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.649+0000 7f97fb7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97fc102f90 0x7f97fc19fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:55:48.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.649+0000 7f97fb7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97fc102f90 0x7f97fc19fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51764/0 (socket says 172.21.15.107:51764) 2024-06-02T23:55:48.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.649+0000 7f97fb7fe700 1 -- 172.21.15.107:0/3843406004 learned_addr learned my addr 172.21.15.107:0/3843406004 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-06-02T23:55:48.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.649+0000 7f97fa7fc700 1 --2- 172.21.15.107:0/3843406004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97fc1025f0 0x7f97fc19d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:55:48.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.649+0000 7f97faffd700 1 --2- 172.21.15.107:0/3843406004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97fc1013f0 0x7f97fc06acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:55:48.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.649+0000 7f97fb7fe700 1 -- 172.21.15.107:0/3843406004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97fc1013f0 msgr2=0x7f97fc06acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:55:48.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.649+0000 7f97fb7fe700 1 --2- 172.21.15.107:0/3843406004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97fc1013f0 0x7f97fc06acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:55:48.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.649+0000 7f97fb7fe700 1 -- 172.21.15.107:0/3843406004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97fc1025f0 msgr2=0x7f97fc19d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:55:48.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.649+0000 7f97fb7fe700 1 --2- 172.21.15.107:0/3843406004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97fc1025f0 0x7f97fc19d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:55:48.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.649+0000 7f97fb7fe700 1 -- 172.21.15.107:0/3843406004 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97fc1a0330 con 0x7f97fc102f90 2024-06-02T23:55:48.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.649+0000 7f97fb7fe700 1 --2- 172.21.15.107:0/3843406004 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97fc102f90 0x7f97fc19fa60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f97ec0059d0 tx=0x7f97ec009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:55:48.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.649+0000 7f97e3fff700 1 -- 172.21.15.107:0/3843406004 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ec026070 con 0x7f97fc102f90 2024-06-02T23:55:48.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.649+0000 7f97e3fff700 1 -- 172.21.15.107:0/3843406004 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97ec004cf0 con 0x7f97fc102f90 2024-06-02T23:55:48.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.649+0000 7f980171e700 1 -- 172.21.15.107:0/3843406004 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97fc1a05c0 con 0x7f97fc102f90 2024-06-02T23:55:48.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.649+0000 7f97e3fff700 1 -- 172.21.15.107:0/3843406004 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ec003d50 con 0x7f97fc102f90 2024-06-02T23:55:48.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.649+0000 7f980171e700 1 -- 172.21.15.107:0/3843406004 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97fc1a0a10 con 0x7f97fc102f90 2024-06-02T23:55:48.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.650+0000 7f980171e700 1 -- 172.21.15.107:0/3843406004 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97fc02dca0 con 0x7f97fc102f90 2024-06-02T23:55:48.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.651+0000 7f97e3fff700 1 -- 172.21.15.107:0/3843406004 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f97ec029070 con 0x7f97fc102f90 2024-06-02T23:55:48.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.652+0000 7f97e3fff700 1 --2- 172.21.15.107:0/3843406004 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f97e40a2c20 0x7f97e40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:55:48.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.652+0000 7f97e3fff700 1 -- 172.21.15.107:0/3843406004 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6723+0+0 (secure 0 0 0) 0x7f97ec0cf460 con 0x7f97fc102f90 2024-06-02T23:55:48.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.652+0000 7f97faffd700 1 --2- 172.21.15.107:0/3843406004 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f97e40a2c20 0x7f97e40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:55:48.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.653+0000 7f97faffd700 1 --2- 172.21.15.107:0/3843406004 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f97e40a2c20 0x7f97e40a50e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f97fc102450 tx=0x7f97f4009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:55:48.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.656+0000 7f97e3fff700 1 -- 172.21.15.107:0/3843406004 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f97ec05d850 con 0x7f97fc102f90 2024-06-02T23:55:48.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:55:48.862+0000 7f980171e700 1 -- 172.21.15.107:0/3843406004 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f97fc0628d0 con 0x7f97e40a2c20 2024-06-02T23:55:49.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:49 smithi049 ceph-mon[32302]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-06-02T23:55:49.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:49 smithi049 ceph-mon[32302]: osdmap e74: 11 total, 11 up, 11 in 2024-06-02T23:55:49.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:49 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:55:49.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:49 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:55:49.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:49 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:55:49.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:49 smithi107 ceph-mon[37048]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-06-02T23:55:49.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:49 smithi107 ceph-mon[37048]: osdmap e74: 11 total, 11 up, 11 in 2024-06-02T23:55:49.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:49 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:55:49.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:49 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:55:49.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:49 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:55:49.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:49 smithi057 ceph-mon[36457]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-06-02T23:55:49.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:49 smithi057 ceph-mon[36457]: osdmap e74: 11 total, 11 up, 11 in 2024-06-02T23:55:49.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:49 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T23:55:49.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:49 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T23:55:49.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:49 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:55:50.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:50 smithi107 ceph-mon[37048]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:55:50.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:50 smithi107 ceph-mon[37048]: osdmap e75: 11 total, 11 up, 11 in 2024-06-02T23:55:50.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:50 smithi057 ceph-mon[36457]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:55:50.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:50 smithi057 ceph-mon[36457]: osdmap e75: 11 total, 11 up, 11 in 2024-06-02T23:55:50.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:50 smithi049 ceph-mon[32302]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:55:50.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:50 smithi049 ceph-mon[32302]: osdmap e75: 11 total, 11 up, 11 in 2024-06-02T23:55:51.074 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:51 smithi107 ceph-mon[37048]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-06-02T23:55:51.074 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:51 smithi107 ceph-mon[37048]: osdmap e76: 11 total, 11 up, 11 in 2024-06-02T23:55:51.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:51 smithi057 ceph-mon[36457]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-06-02T23:55:51.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:51 smithi057 ceph-mon[36457]: osdmap e76: 11 total, 11 up, 11 in 2024-06-02T23:55:51.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:51 smithi049 ceph-mon[32302]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-06-02T23:55:51.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:51 smithi049 ceph-mon[32302]: osdmap e76: 11 total, 11 up, 11 in 2024-06-02T23:55:52.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:52 smithi107 ceph-mon[37048]: from='client.? 172.21.15.107:0/3286237725' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb963b63-2c61-4169-b8fe-31c7f5ec919d"}]: dispatch 2024-06-02T23:55:52.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:52 smithi107 ceph-mon[37048]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb963b63-2c61-4169-b8fe-31c7f5ec919d"}]: dispatch 2024-06-02T23:55:52.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:52 smithi107 ceph-mon[37048]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb963b63-2c61-4169-b8fe-31c7f5ec919d"}]': finished 2024-06-02T23:55:52.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:52 smithi107 ceph-mon[37048]: osdmap e77: 12 total, 11 up, 12 in 2024-06-02T23:55:52.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:52 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T23:55:52.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:52 smithi057 ceph-mon[36457]: from='client.? 172.21.15.107:0/3286237725' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb963b63-2c61-4169-b8fe-31c7f5ec919d"}]: dispatch 2024-06-02T23:55:52.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:52 smithi057 ceph-mon[36457]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb963b63-2c61-4169-b8fe-31c7f5ec919d"}]: dispatch 2024-06-02T23:55:52.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:52 smithi057 ceph-mon[36457]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb963b63-2c61-4169-b8fe-31c7f5ec919d"}]': finished 2024-06-02T23:55:52.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:52 smithi057 ceph-mon[36457]: osdmap e77: 12 total, 11 up, 12 in 2024-06-02T23:55:52.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:52 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T23:55:52.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:52 smithi049 ceph-mon[32302]: from='client.? 172.21.15.107:0/3286237725' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb963b63-2c61-4169-b8fe-31c7f5ec919d"}]: dispatch 2024-06-02T23:55:52.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:52 smithi049 ceph-mon[32302]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb963b63-2c61-4169-b8fe-31c7f5ec919d"}]: dispatch 2024-06-02T23:55:52.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:52 smithi049 ceph-mon[32302]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb963b63-2c61-4169-b8fe-31c7f5ec919d"}]': finished 2024-06-02T23:55:52.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:52 smithi049 ceph-mon[32302]: osdmap e77: 12 total, 11 up, 12 in 2024-06-02T23:55:52.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:52 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T23:55:53.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:53 smithi107 ceph-mon[37048]: pgmap v244: 1 pgs: 1 peering; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 138 KiB/s, 0 objects/s recovering 2024-06-02T23:55:53.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:53 smithi107 ceph-mon[37048]: from='client.? 172.21.15.107:0/1965131368' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:55:53.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:53 smithi057 ceph-mon[36457]: pgmap v244: 1 pgs: 1 peering; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 138 KiB/s, 0 objects/s recovering 2024-06-02T23:55:53.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:53 smithi057 ceph-mon[36457]: from='client.? 172.21.15.107:0/1965131368' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:55:53.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:53 smithi049 ceph-mon[32302]: pgmap v244: 1 pgs: 1 peering; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 138 KiB/s, 0 objects/s recovering 2024-06-02T23:55:53.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:53 smithi049 ceph-mon[32302]: from='client.? 172.21.15.107:0/1965131368' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T23:55:54.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:54 smithi107 ceph-mon[37048]: pgmap v246: 1 pgs: 1 peering; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-06-02T23:55:54.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:54 smithi057 ceph-mon[36457]: pgmap v246: 1 pgs: 1 peering; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-06-02T23:55:54.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:54 smithi049 ceph-mon[32302]: pgmap v246: 1 pgs: 1 peering; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-06-02T23:55:56.599 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:56 smithi107 ceph-mon[37048]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-06-02T23:55:56.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:56 smithi057 ceph-mon[36457]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-06-02T23:55:56.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:56 smithi049 ceph-mon[32302]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-06-02T23:55:58.558 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:55:58 smithi107 ceph-mon[37048]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-02T23:55:58.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:55:58 smithi057 ceph-mon[36457]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-02T23:55:58.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:55:58 smithi049 ceph-mon[32302]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-02T23:56:00.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:00 smithi107 ceph-mon[37048]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-06-02T23:56:00.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:00 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-06-02T23:56:00.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:00 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:00.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:00 smithi107 ceph-mon[37048]: Deploying daemon osd.11 on smithi107 2024-06-02T23:56:00.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:00 smithi057 ceph-mon[36457]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-06-02T23:56:00.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:00 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-06-02T23:56:00.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:00 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:00.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:00 smithi057 ceph-mon[36457]: Deploying daemon osd.11 on smithi107 2024-06-02T23:56:00.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:00 smithi049 ceph-mon[32302]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-06-02T23:56:00.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:00 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-06-02T23:56:00.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:00 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:00.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:00 smithi049 ceph-mon[32302]: Deploying daemon osd.11 on smithi107 2024-06-02T23:56:02.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:02 smithi107 ceph-mon[37048]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-06-02T23:56:02.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:02 smithi057 ceph-mon[36457]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-06-02T23:56:02.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:02 smithi049 ceph-mon[32302]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-06-02T23:56:04.583 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:04 smithi107 ceph-mon[37048]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-06-02T23:56:04.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:04 smithi057 ceph-mon[36457]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-06-02T23:56:04.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:04 smithi049 ceph-mon[32302]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-06-02T23:56:06.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:06 smithi107 ceph-mon[37048]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-06-02T23:56:06.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:06 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:06.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:06 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:06.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:06 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:56:06.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:06 smithi057 ceph-mon[36457]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-06-02T23:56:06.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:06 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:06.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:06 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:06.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:06 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:56:06.960 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:06 smithi049 ceph-mon[32302]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-06-02T23:56:06.960 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:06 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:06.960 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:06 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:06.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:06 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:56:08.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:08 smithi107 ceph-mon[37048]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-06-02T23:56:08.949 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:08 smithi057 ceph-mon[36457]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-06-02T23:56:08.960 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:08 smithi049 ceph-mon[32302]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-06-02T23:56:09.184 INFO:teuthology.orchestra.run.smithi107.stdout:Created osd(s) 11 on host 'smithi107' 2024-06-02T23:56:09.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:09.184+0000 7f97e3fff700 1 -- 172.21.15.107:0/3843406004 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f97fc0628d0 con 0x7f97e40a2c20 2024-06-02T23:56:09.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:09.186+0000 7f980171e700 1 -- 172.21.15.107:0/3843406004 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f97e40a2c20 msgr2=0x7f97e40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:09.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:09.186+0000 7f980171e700 1 --2- 172.21.15.107:0/3843406004 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f97e40a2c20 0x7f97e40a50e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f97fc102450 tx=0x7f97f4009040 comp rx=0 tx=0).stop 2024-06-02T23:56:09.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:09.186+0000 7f980171e700 1 -- 172.21.15.107:0/3843406004 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97fc102f90 msgr2=0x7f97fc19fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:09.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:09.186+0000 7f980171e700 1 --2- 172.21.15.107:0/3843406004 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97fc102f90 0x7f97fc19fa60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f97ec0059d0 tx=0x7f97ec009580 comp rx=0 tx=0).stop 2024-06-02T23:56:09.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:09.186+0000 7f980171e700 1 -- 172.21.15.107:0/3843406004 shutdown_connections 2024-06-02T23:56:09.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:09.186+0000 7f980171e700 1 --2- 172.21.15.107:0/3843406004 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f97e40a2c20 0x7f97e40a50e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:09.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:09.186+0000 7f980171e700 1 --2- 172.21.15.107:0/3843406004 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97fc102f90 0x7f97fc19fa60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:09.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:09.186+0000 7f980171e700 1 --2- 172.21.15.107:0/3843406004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97fc1013f0 0x7f97fc06acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:09.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:09.186+0000 7f980171e700 1 --2- 172.21.15.107:0/3843406004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97fc1025f0 0x7f97fc19d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:09.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:09.187+0000 7f980171e700 1 -- 172.21.15.107:0/3843406004 >> 172.21.15.107:0/3843406004 conn(0x7f97fc0fc990 msgr2=0x7f97fc105970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:56:09.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:09.187+0000 7f980171e700 1 -- 172.21.15.107:0/3843406004 shutdown_connections 2024-06-02T23:56:09.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:09.187+0000 7f980171e700 1 -- 172.21.15.107:0/3843406004 wait complete. 2024-06-02T23:56:09.757 DEBUG:teuthology.orchestra.run.smithi107:osd.11> sudo journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.11.service 2024-06-02T23:56:09.759 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-06-02T23:56:09.759 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph osd stat -f json 2024-06-02T23:56:10.021 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:56:10.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:10 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:10.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:10 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:10.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:10 smithi057 ceph-mon[36457]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-06-02T23:56:10.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:10 smithi057 ceph-mon[36457]: from='osd.11 [v2:172.21.15.107:6824/4217534517,v1:172.21.15.107:6825/4217534517]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-02T23:56:10.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:10 smithi057 ceph-mon[36457]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-02T23:56:10.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:10 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:10.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:10 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:10.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:10.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:10.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:10 smithi049 ceph-mon[32302]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-06-02T23:56:10.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:10 smithi049 ceph-mon[32302]: from='osd.11 [v2:172.21.15.107:6824/4217534517,v1:172.21.15.107:6825/4217534517]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-02T23:56:10.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:10 smithi049 ceph-mon[32302]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-02T23:56:10.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:10.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:10.490 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:10 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:10.490 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:10 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:10.490 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:10 smithi107 ceph-mon[37048]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-06-02T23:56:10.490 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:10 smithi107 ceph-mon[37048]: from='osd.11 [v2:172.21.15.107:6824/4217534517,v1:172.21.15.107:6825/4217534517]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-02T23:56:10.490 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:10 smithi107 ceph-mon[37048]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-02T23:56:10.490 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:10 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:10.491 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:10 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:11.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:11 smithi057 ceph-mon[36457]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-06-02T23:56:11.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:11 smithi057 ceph-mon[36457]: osdmap e78: 12 total, 11 up, 12 in 2024-06-02T23:56:11.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:11 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T23:56:11.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:11 smithi057 ceph-mon[36457]: from='osd.11 [v2:172.21.15.107:6824/4217534517,v1:172.21.15.107:6825/4217534517]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-06-02T23:56:11.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:11 smithi057 ceph-mon[36457]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-06-02T23:56:11.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:11 smithi049 ceph-mon[32302]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-06-02T23:56:11.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:11 smithi049 ceph-mon[32302]: osdmap e78: 12 total, 11 up, 12 in 2024-06-02T23:56:11.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:11 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T23:56:11.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:11 smithi049 ceph-mon[32302]: from='osd.11 [v2:172.21.15.107:6824/4217534517,v1:172.21.15.107:6825/4217534517]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-06-02T23:56:11.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:11 smithi049 ceph-mon[32302]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-06-02T23:56:11.470 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:11 smithi107 ceph-mon[37048]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-06-02T23:56:11.470 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:11 smithi107 ceph-mon[37048]: osdmap e78: 12 total, 11 up, 12 in 2024-06-02T23:56:11.471 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:11 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T23:56:11.471 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:11 smithi107 ceph-mon[37048]: from='osd.11 [v2:172.21.15.107:6824/4217534517,v1:172.21.15.107:6825/4217534517]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-06-02T23:56:11.471 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:11 smithi107 ceph-mon[37048]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-06-02T23:56:11.471 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 02 23:56:11 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-02T23:56:11.163+0000 7f8b20ee2700 -1 osd.11 0 waiting for initial osdmap 2024-06-02T23:56:11.471 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 02 23:56:11 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-02T23:56:11.179+0000 7f8b1d4d6700 -1 osd.11 79 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T23:56:11.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.816+0000 7f96a6bc7700 1 -- 172.21.15.49:0/4201042043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96a01024e0 msgr2=0x7f96a0102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:11.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.816+0000 7f96a6bc7700 1 --2- 172.21.15.49:0/4201042043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96a01024e0 0x7f96a0102900 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f969000b0d0 tx=0x7f969000b3e0 comp rx=0 tx=0).stop 2024-06-02T23:56:11.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.816+0000 7f96a6bc7700 1 -- 172.21.15.49:0/4201042043 shutdown_connections 2024-06-02T23:56:11.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.816+0000 7f96a6bc7700 1 --2- 172.21.15.49:0/4201042043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96a0104080 0x7f96a010a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:11.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.816+0000 7f96a6bc7700 1 --2- 172.21.15.49:0/4201042043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96a01024e0 0x7f96a0102900 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:11.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.816+0000 7f96a6bc7700 1 --2- 172.21.15.49:0/4201042043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96a01036e0 0x7f96a0103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:11.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.816+0000 7f96a6bc7700 1 -- 172.21.15.49:0/4201042043 >> 172.21.15.49:0/4201042043 conn(0x7f96a00fda80 msgr2=0x7f96a00ffec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:56:11.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.816+0000 7f96a6bc7700 1 -- 172.21.15.49:0/4201042043 shutdown_connections 2024-06-02T23:56:11.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.816+0000 7f96a6bc7700 1 -- 172.21.15.49:0/4201042043 wait complete. 2024-06-02T23:56:11.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.817+0000 7f96a6bc7700 1 Processor -- start 2024-06-02T23:56:11.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.817+0000 7f96a6bc7700 1 -- start start 2024-06-02T23:56:11.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.817+0000 7f96a6bc7700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96a01024e0 0x7f96a01987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:11.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.817+0000 7f96a6bc7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96a01036e0 0x7f96a0198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:11.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.817+0000 7f96a6bc7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96a0104080 0x7f96a019fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:11.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.817+0000 7f96a6bc7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f96a010e1a0 con 0x7f96a0104080 2024-06-02T23:56:11.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.817+0000 7f96a6bc7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f96a010e020 con 0x7f96a01036e0 2024-06-02T23:56:11.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.817+0000 7f96a6bc7700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f96a010e320 con 0x7f96a01024e0 2024-06-02T23:56:11.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.817+0000 7f96a4963700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96a01024e0 0x7f96a01987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:11.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.817+0000 7f96a4963700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96a01024e0 0x7f96a01987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:49322/0 (socket says 172.21.15.49:49322) 2024-06-02T23:56:11.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.817+0000 7f96a5164700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96a0104080 0x7f96a019fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:11.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.817+0000 7f96a4963700 1 -- 172.21.15.49:0/786431020 learned_addr learned my addr 172.21.15.49:0/786431020 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:56:11.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.817+0000 7f969ffff700 1 --2- 172.21.15.49:0/786431020 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96a01036e0 0x7f96a0198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:11.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.818+0000 7f96a5164700 1 -- 172.21.15.49:0/786431020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96a01024e0 msgr2=0x7f96a01987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:11.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.818+0000 7f96a5164700 1 --2- 172.21.15.49:0/786431020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96a01024e0 0x7f96a01987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:11.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.818+0000 7f96a5164700 1 -- 172.21.15.49:0/786431020 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96a01036e0 msgr2=0x7f96a0198d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:11.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.818+0000 7f96a5164700 1 --2- 172.21.15.49:0/786431020 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96a01036e0 0x7f96a0198d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:11.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.818+0000 7f96a5164700 1 -- 172.21.15.49:0/786431020 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a01a0450 con 0x7f96a0104080 2024-06-02T23:56:11.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.818+0000 7f96a4963700 1 --2- 172.21.15.49:0/786431020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96a01024e0 0x7f96a01987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:56:11.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.818+0000 7f96a5164700 1 --2- 172.21.15.49:0/786431020 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96a0104080 0x7f96a019fdb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f969800b420 tx=0x7f969800b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:56:11.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.818+0000 7f969dffb700 1 -- 172.21.15.49:0/786431020 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9698015020 con 0x7f96a0104080 2024-06-02T23:56:11.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.818+0000 7f969dffb700 1 -- 172.21.15.49:0/786431020 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9698011d10 con 0x7f96a0104080 2024-06-02T23:56:11.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.818+0000 7f96a6bc7700 1 -- 172.21.15.49:0/786431020 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a01a0740 con 0x7f96a0104080 2024-06-02T23:56:11.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.818+0000 7f969dffb700 1 -- 172.21.15.49:0/786431020 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9698010d70 con 0x7f96a0104080 2024-06-02T23:56:11.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.818+0000 7f96a6bc7700 1 -- 172.21.15.49:0/786431020 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a01a0d00 con 0x7f96a0104080 2024-06-02T23:56:11.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.819+0000 7f96a6bc7700 1 -- 172.21.15.49:0/786431020 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96a0069180 con 0x7f96a0104080 2024-06-02T23:56:11.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.820+0000 7f969dffb700 1 -- 172.21.15.49:0/786431020 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9698018020 con 0x7f96a0104080 2024-06-02T23:56:11.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.821+0000 7f969dffb700 1 --2- 172.21.15.49:0/786431020 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f968c0a2ca0 0x7f968c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:11.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.821+0000 7f96a4963700 1 --2- 172.21.15.49:0/786431020 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f968c0a2ca0 0x7f968c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:11.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.821+0000 7f969dffb700 1 -- 172.21.15.49:0/786431020 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6847+0+0 (secure 0 0 0) 0x7f96980ce0c0 con 0x7f96a0104080 2024-06-02T23:56:11.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.821+0000 7f96a4963700 1 --2- 172.21.15.49:0/786431020 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f968c0a2ca0 0x7f968c0a5160 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9690007fa0 tx=0x7f969000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:56:11.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:11.825+0000 7f969dffb700 1 -- 172.21.15.49:0/786431020 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f969801f020 con 0x7f96a0104080 2024-06-02T23:56:12.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:12.032+0000 7f96a6bc7700 1 -- 172.21.15.49:0/786431020 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f96a002dca0 con 0x7f96a0104080 2024-06-02T23:56:12.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:12.032+0000 7f969dffb700 1 -- 172.21.15.49:0/786431020 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v79) ==== 74+0+133 (secure 0 0 0) 0x7f969809b5e0 con 0x7f96a0104080 2024-06-02T23:56:12.033 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:56:12.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:12.034+0000 7f96a6bc7700 1 -- 172.21.15.49:0/786431020 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f968c0a2ca0 msgr2=0x7f968c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:12.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:12.034+0000 7f96a6bc7700 1 --2- 172.21.15.49:0/786431020 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f968c0a2ca0 0x7f968c0a5160 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9690007fa0 tx=0x7f969000b040 comp rx=0 tx=0).stop 2024-06-02T23:56:12.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:12.034+0000 7f96a6bc7700 1 -- 172.21.15.49:0/786431020 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96a0104080 msgr2=0x7f96a019fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:12.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:12.034+0000 7f96a6bc7700 1 --2- 172.21.15.49:0/786431020 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96a0104080 0x7f96a019fdb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f969800b420 tx=0x7f969800b730 comp rx=0 tx=0).stop 2024-06-02T23:56:12.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:12.034+0000 7f96a6bc7700 1 -- 172.21.15.49:0/786431020 shutdown_connections 2024-06-02T23:56:12.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:12.034+0000 7f96a6bc7700 1 --2- 172.21.15.49:0/786431020 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f968c0a2ca0 0x7f968c0a5160 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:12.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:12.034+0000 7f96a6bc7700 1 --2- 172.21.15.49:0/786431020 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96a0104080 0x7f96a019fdb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:12.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:12.034+0000 7f96a6bc7700 1 --2- 172.21.15.49:0/786431020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96a01024e0 0x7f96a01987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:12.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:12.034+0000 7f96a6bc7700 1 --2- 172.21.15.49:0/786431020 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96a01036e0 0x7f96a0198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:12.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:12.034+0000 7f96a6bc7700 1 -- 172.21.15.49:0/786431020 >> 172.21.15.49:0/786431020 conn(0x7f96a00fda80 msgr2=0x7f96a0106a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:56:12.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:12.035+0000 7f96a6bc7700 1 -- 172.21.15.49:0/786431020 shutdown_connections 2024-06-02T23:56:12.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:12.035+0000 7f96a6bc7700 1 -- 172.21.15.49:0/786431020 wait complete. 2024-06-02T23:56:12.339 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:12 smithi049 ceph-mon[32302]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-06-02T23:56:12.340 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:12 smithi049 ceph-mon[32302]: osdmap e79: 12 total, 11 up, 12 in 2024-06-02T23:56:12.340 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:12 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T23:56:12.340 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:12 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T23:56:12.340 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:12 smithi049 ceph-mon[32302]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-06-02T23:56:12.340 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:12 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/786431020' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-02T23:56:12.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:12 smithi057 ceph-mon[36457]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-06-02T23:56:12.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:12 smithi057 ceph-mon[36457]: osdmap e79: 12 total, 11 up, 12 in 2024-06-02T23:56:12.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:12 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T23:56:12.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:12 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T23:56:12.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:12 smithi057 ceph-mon[36457]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-06-02T23:56:12.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:12 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/786431020' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-02T23:56:12.533 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:12 smithi107 ceph-mon[37048]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-06-02T23:56:12.534 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:12 smithi107 ceph-mon[37048]: osdmap e79: 12 total, 11 up, 12 in 2024-06-02T23:56:12.534 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:12 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T23:56:12.534 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:12 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T23:56:12.534 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:12 smithi107 ceph-mon[37048]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-06-02T23:56:12.534 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:12 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/786431020' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-02T23:56:12.899 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":79,"num_osds":12,"num_up_osds":11,"osd_up_since":1717372546,"num_in_osds":12,"osd_in_since":1717372551,"num_remapped_pgs":0} 2024-06-02T23:56:13.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:13 smithi057 ceph-mon[36457]: purged_snaps scrub starts 2024-06-02T23:56:13.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:13 smithi057 ceph-mon[36457]: purged_snaps scrub ok 2024-06-02T23:56:13.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:13 smithi057 ceph-mon[36457]: osd.11 [v2:172.21.15.107:6824/4217534517,v1:172.21.15.107:6825/4217534517] boot 2024-06-02T23:56:13.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:13 smithi057 ceph-mon[36457]: osdmap e80: 12 total, 12 up, 12 in 2024-06-02T23:56:13.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:13 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T23:56:13.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:13 smithi049 ceph-mon[32302]: purged_snaps scrub starts 2024-06-02T23:56:13.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:13 smithi049 ceph-mon[32302]: purged_snaps scrub ok 2024-06-02T23:56:13.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:13 smithi049 ceph-mon[32302]: osd.11 [v2:172.21.15.107:6824/4217534517,v1:172.21.15.107:6825/4217534517] boot 2024-06-02T23:56:13.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:13 smithi049 ceph-mon[32302]: osdmap e80: 12 total, 12 up, 12 in 2024-06-02T23:56:13.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:13 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T23:56:13.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:13 smithi107 ceph-mon[37048]: purged_snaps scrub starts 2024-06-02T23:56:13.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:13 smithi107 ceph-mon[37048]: purged_snaps scrub ok 2024-06-02T23:56:13.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:13 smithi107 ceph-mon[37048]: osd.11 [v2:172.21.15.107:6824/4217534517,v1:172.21.15.107:6825/4217534517] boot 2024-06-02T23:56:13.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:13 smithi107 ceph-mon[37048]: osdmap e80: 12 total, 12 up, 12 in 2024-06-02T23:56:13.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:13 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T23:56:13.900 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph osd stat -f json 2024-06-02T23:56:14.153 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:56:14.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:14 smithi057 ceph-mon[36457]: osdmap e81: 12 total, 12 up, 12 in 2024-06-02T23:56:14.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:14 smithi057 ceph-mon[36457]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:14.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:14 smithi057 ceph-mon[36457]: Detected new or changed devices on smithi107 2024-06-02T23:56:14.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:14 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:14.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:14 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:14.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:14 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:56:14.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:14 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:56:14.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:14 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:56:14.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:14 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:56:14.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:14 smithi057 ceph-mon[36457]: Adjusting osd_memory_target on smithi107 to 4272M 2024-06-02T23:56:14.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:14 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:14.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:14 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:14.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:14 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:56:14.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:14 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:14.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:14 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:56:14.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:14 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:14.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:14 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:56:14.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:14 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:14.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:14 smithi049 ceph-mon[32302]: osdmap e81: 12 total, 12 up, 12 in 2024-06-02T23:56:14.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:14 smithi049 ceph-mon[32302]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:14.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:14 smithi049 ceph-mon[32302]: Detected new or changed devices on smithi107 2024-06-02T23:56:14.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:14 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:14.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:14 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:14.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:14 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:56:14.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:14 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:56:14.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:14 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:56:14.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:14 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:56:14.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:14 smithi049 ceph-mon[32302]: Adjusting osd_memory_target on smithi107 to 4272M 2024-06-02T23:56:14.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:14 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:14.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:14 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:14.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:14 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:56:14.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:14 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:14.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:14 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:56:14.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:14 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:14.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:14 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:56:14.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:14 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:14.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:14 smithi107 ceph-mon[37048]: osdmap e81: 12 total, 12 up, 12 in 2024-06-02T23:56:14.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:14 smithi107 ceph-mon[37048]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:14.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:14 smithi107 ceph-mon[37048]: Detected new or changed devices on smithi107 2024-06-02T23:56:14.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:14 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:14.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:14 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:14.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:14 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:56:14.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:14 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:56:14.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:14 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:56:14.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:14 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-02T23:56:14.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:14 smithi107 ceph-mon[37048]: Adjusting osd_memory_target on smithi107 to 4272M 2024-06-02T23:56:14.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:14 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:14.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:14 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:14.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:14 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:56:14.602 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:14 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:14.602 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:14 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:56:14.602 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:14 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:14.602 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:14 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:56:14.602 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:14 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:15.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.898+0000 7f6bbf3d8700 1 -- 172.21.15.49:0/2749386576 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bb8104090 msgr2=0x7f6bb810a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:15.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.898+0000 7f6bbf3d8700 1 --2- 172.21.15.49:0/2749386576 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bb8104090 0x7f6bb810a940 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6bb000b0d0 tx=0x7f6bb000b3e0 comp rx=0 tx=0).stop 2024-06-02T23:56:15.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.898+0000 7f6bbf3d8700 1 -- 172.21.15.49:0/2749386576 shutdown_connections 2024-06-02T23:56:15.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.898+0000 7f6bbf3d8700 1 --2- 172.21.15.49:0/2749386576 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bb8104090 0x7f6bb810a940 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:15.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.898+0000 7f6bbf3d8700 1 --2- 172.21.15.49:0/2749386576 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb81024f0 0x7f6bb8102910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:15.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.898+0000 7f6bbf3d8700 1 --2- 172.21.15.49:0/2749386576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6bb81036f0 0x7f6bb8103b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:15.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.898+0000 7f6bbf3d8700 1 -- 172.21.15.49:0/2749386576 >> 172.21.15.49:0/2749386576 conn(0x7f6bb80fda90 msgr2=0x7f6bb80ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:56:15.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.898+0000 7f6bbf3d8700 1 -- 172.21.15.49:0/2749386576 shutdown_connections 2024-06-02T23:56:15.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.898+0000 7f6bbf3d8700 1 -- 172.21.15.49:0/2749386576 wait complete. 2024-06-02T23:56:15.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.899+0000 7f6bbf3d8700 1 Processor -- start 2024-06-02T23:56:15.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.899+0000 7f6bbf3d8700 1 -- start start 2024-06-02T23:56:15.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.899+0000 7f6bbf3d8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bb81024f0 0x7f6bb8076230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:15.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.899+0000 7f6bbf3d8700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6bb81036f0 0x7f6bb8074880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:15.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.899+0000 7f6bbf3d8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb8104090 0x7f6bb8074dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:15.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.899+0000 7f6bbf3d8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb810e0c0 con 0x7f6bb81024f0 2024-06-02T23:56:15.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.899+0000 7f6bbf3d8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb810df40 con 0x7f6bb8104090 2024-06-02T23:56:15.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.899+0000 7f6bbf3d8700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb810e240 con 0x7f6bb81036f0 2024-06-02T23:56:15.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.900+0000 7f6bbd174700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bb81024f0 0x7f6bb8076230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:15.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.900+0000 7f6bbd174700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bb81024f0 0x7f6bb8076230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59362/0 (socket says 172.21.15.49:59362) 2024-06-02T23:56:15.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.900+0000 7f6bbd174700 1 -- 172.21.15.49:0/565001617 learned_addr learned my addr 172.21.15.49:0/565001617 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:56:15.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.900+0000 7f6bbd975700 1 --2- 172.21.15.49:0/565001617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb8104090 0x7f6bb8074dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:15.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.900+0000 7f6bbc973700 1 --2- 172.21.15.49:0/565001617 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6bb81036f0 0x7f6bb8074880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:15.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.900+0000 7f6bbd174700 1 -- 172.21.15.49:0/565001617 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6bb81036f0 msgr2=0x7f6bb8074880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:15.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.900+0000 7f6bbd174700 1 --2- 172.21.15.49:0/565001617 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6bb81036f0 0x7f6bb8074880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:15.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.900+0000 7f6bbd174700 1 -- 172.21.15.49:0/565001617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb8104090 msgr2=0x7f6bb8074dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:15.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.900+0000 7f6bbd174700 1 --2- 172.21.15.49:0/565001617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb8104090 0x7f6bb8074dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:15.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.900+0000 7f6bbd174700 1 -- 172.21.15.49:0/565001617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb8075670 con 0x7f6bb81024f0 2024-06-02T23:56:15.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.900+0000 7f6bbd174700 1 --2- 172.21.15.49:0/565001617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bb81024f0 0x7f6bb8076230 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6bb400c970 tx=0x7f6bb400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:56:15.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.900+0000 7f6bae7fc700 1 -- 172.21.15.49:0/565001617 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4004220 con 0x7f6bb81024f0 2024-06-02T23:56:15.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.900+0000 7f6bae7fc700 1 -- 172.21.15.49:0/565001617 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bb4007d80 con 0x7f6bb81024f0 2024-06-02T23:56:15.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.900+0000 7f6bbf3d8700 1 -- 172.21.15.49:0/565001617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bb81a2800 con 0x7f6bb81024f0 2024-06-02T23:56:15.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.900+0000 7f6bae7fc700 1 -- 172.21.15.49:0/565001617 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4003e50 con 0x7f6bb81024f0 2024-06-02T23:56:15.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.900+0000 7f6bbf3d8700 1 -- 172.21.15.49:0/565001617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bb81a2d10 con 0x7f6bb81024f0 2024-06-02T23:56:15.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.901+0000 7f6bbf3d8700 1 -- 172.21.15.49:0/565001617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bb8069180 con 0x7f6bb81024f0 2024-06-02T23:56:15.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.902+0000 7f6bae7fc700 1 -- 172.21.15.49:0/565001617 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6bb40078a0 con 0x7f6bb81024f0 2024-06-02T23:56:15.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.903+0000 7f6bae7fc700 1 --2- 172.21.15.49:0/565001617 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6ba40a2dc0 0x7f6ba40a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:15.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.903+0000 7f6bbc973700 1 --2- 172.21.15.49:0/565001617 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6ba40a2dc0 0x7f6ba40a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:15.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.903+0000 7f6bae7fc700 1 -- 172.21.15.49:0/565001617 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f6bb40ce7c0 con 0x7f6bb81024f0 2024-06-02T23:56:15.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.904+0000 7f6bbc973700 1 --2- 172.21.15.49:0/565001617 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6ba40a2dc0 0x7f6ba40a5280 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8005fd0 tx=0x7f6ba800a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:56:15.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:15.908+0000 7f6bae7fc700 1 -- 172.21.15.49:0/565001617 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6bb4014030 con 0x7f6bb81024f0 2024-06-02T23:56:16.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:16.116+0000 7f6bbf3d8700 1 -- 172.21.15.49:0/565001617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f6bb802dca0 con 0x7f6bb81024f0 2024-06-02T23:56:16.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:16.116+0000 7f6bae7fc700 1 -- 172.21.15.49:0/565001617 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v81) ==== 74+0+133 (secure 0 0 0) 0x7f6bb409bbc0 con 0x7f6bb81024f0 2024-06-02T23:56:16.117 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:56:16.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:16.118+0000 7f6bbf3d8700 1 -- 172.21.15.49:0/565001617 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6ba40a2dc0 msgr2=0x7f6ba40a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:16.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:16.118+0000 7f6bbf3d8700 1 --2- 172.21.15.49:0/565001617 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6ba40a2dc0 0x7f6ba40a5280 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8005fd0 tx=0x7f6ba800a560 comp rx=0 tx=0).stop 2024-06-02T23:56:16.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:16.118+0000 7f6bbf3d8700 1 -- 172.21.15.49:0/565001617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bb81024f0 msgr2=0x7f6bb8076230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:16.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:16.118+0000 7f6bbf3d8700 1 --2- 172.21.15.49:0/565001617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bb81024f0 0x7f6bb8076230 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6bb400c970 tx=0x7f6bb400cc80 comp rx=0 tx=0).stop 2024-06-02T23:56:16.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:16.118+0000 7f6bbf3d8700 1 -- 172.21.15.49:0/565001617 shutdown_connections 2024-06-02T23:56:16.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:16.118+0000 7f6bbf3d8700 1 --2- 172.21.15.49:0/565001617 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6ba40a2dc0 0x7f6ba40a5280 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:16.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:16.118+0000 7f6bbf3d8700 1 --2- 172.21.15.49:0/565001617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb8104090 0x7f6bb8074dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:16.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:16.118+0000 7f6bbf3d8700 1 --2- 172.21.15.49:0/565001617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bb81024f0 0x7f6bb8076230 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:16.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:16.118+0000 7f6bbf3d8700 1 --2- 172.21.15.49:0/565001617 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6bb81036f0 0x7f6bb8074880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:16.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:16.118+0000 7f6bbf3d8700 1 -- 172.21.15.49:0/565001617 >> 172.21.15.49:0/565001617 conn(0x7f6bb80fda90 msgr2=0x7f6bb81069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:56:16.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:16.119+0000 7f6bbf3d8700 1 -- 172.21.15.49:0/565001617 shutdown_connections 2024-06-02T23:56:16.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:16.119+0000 7f6bbf3d8700 1 -- 172.21.15.49:0/565001617 wait complete. 2024-06-02T23:56:16.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:16 smithi049 ceph-mon[32302]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:16.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:16 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/565001617' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-02T23:56:16.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:16 smithi107 ceph-mon[37048]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:16.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:16 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/565001617' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-02T23:56:16.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:16 smithi057 ceph-mon[36457]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:16.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:16 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/565001617' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-02T23:56:16.825 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":81,"num_osds":12,"num_up_osds":12,"osd_up_since":1717372572,"num_in_osds":12,"osd_in_since":1717372551,"num_remapped_pgs":0} 2024-06-02T23:56:16.825 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-02T23:56:17.077 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:56:18.371 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:18 smithi049 ceph-mon[32302]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:18.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.586+0000 7f3234372700 1 -- 172.21.15.49:0/4146976513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f322c103120 msgr2=0x7f322c107130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:18.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.586+0000 7f3234372700 1 --2- 172.21.15.49:0/4146976513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f322c103120 0x7f322c107130 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f321c0099c0 tx=0x7f321c009cd0 comp rx=0 tx=0).stop 2024-06-02T23:56:18.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.586+0000 7f3234372700 1 -- 172.21.15.49:0/4146976513 shutdown_connections 2024-06-02T23:56:18.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.586+0000 7f3234372700 1 --2- 172.21.15.49:0/4146976513 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f322c107860 0x7f322c10f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:18.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.586+0000 7f3234372700 1 --2- 172.21.15.49:0/4146976513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f322c102770 0x7f322c102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:18.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.586+0000 7f3234372700 1 --2- 172.21.15.49:0/4146976513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f322c103120 0x7f322c107130 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:18.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.586+0000 7f3234372700 1 -- 172.21.15.49:0/4146976513 >> 172.21.15.49:0/4146976513 conn(0x7f322c079600 msgr2=0x7f322c079a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:56:18.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.586+0000 7f3234372700 1 -- 172.21.15.49:0/4146976513 shutdown_connections 2024-06-02T23:56:18.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.586+0000 7f3234372700 1 -- 172.21.15.49:0/4146976513 wait complete. 2024-06-02T23:56:18.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.586+0000 7f3234372700 1 Processor -- start 2024-06-02T23:56:18.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.587+0000 7f3234372700 1 -- start start 2024-06-02T23:56:18.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.587+0000 7f3234372700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f322c102770 0x7f322c19e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:18.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.587+0000 7f3234372700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f322c103120 0x7f322c19ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:18.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.587+0000 7f3234372700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f322c107860 0x7f322c1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:18.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.587+0000 7f3234372700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f322c112770 con 0x7f322c107860 2024-06-02T23:56:18.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.587+0000 7f3234372700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f322c1125f0 con 0x7f322c102770 2024-06-02T23:56:18.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.587+0000 7f3234372700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f322c1128f0 con 0x7f322c103120 2024-06-02T23:56:18.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.587+0000 7f323290f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f322c107860 0x7f322c1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:18.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.587+0000 7f323290f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f322c107860 0x7f322c1989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59370/0 (socket says 172.21.15.49:59370) 2024-06-02T23:56:18.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.587+0000 7f323290f700 1 -- 172.21.15.49:0/324088028 learned_addr learned my addr 172.21.15.49:0/324088028 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:56:18.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.587+0000 7f323210e700 1 --2- 172.21.15.49:0/324088028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f322c102770 0x7f322c19e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:18.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.587+0000 7f323190d700 1 --2- 172.21.15.49:0/324088028 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f322c103120 0x7f322c19ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.587+0000 7f323290f700 1 -- 172.21.15.49:0/324088028 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f322c103120 msgr2=0x7f322c19ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.587+0000 7f323290f700 1 --2- 172.21.15.49:0/324088028 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f322c103120 0x7f322c19ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.587+0000 7f323290f700 1 -- 172.21.15.49:0/324088028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f322c102770 msgr2=0x7f322c19e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.587+0000 7f323290f700 1 --2- 172.21.15.49:0/324088028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f322c102770 0x7f322c19e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.587+0000 7f323290f700 1 -- 172.21.15.49:0/324088028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f322c199110 con 0x7f322c107860 2024-06-02T23:56:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.587+0000 7f323210e700 1 --2- 172.21.15.49:0/324088028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f322c102770 0x7f322c19e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:56:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.588+0000 7f323290f700 1 --2- 172.21.15.49:0/324088028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f322c107860 0x7f322c1989b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3224007ee0 tx=0x7f322400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:56:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.588+0000 7f32237fe700 1 -- 172.21.15.49:0/324088028 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322400dd20 con 0x7f322c107860 2024-06-02T23:56:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.588+0000 7f3234372700 1 -- 172.21.15.49:0/324088028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f322c199400 con 0x7f322c107860 2024-06-02T23:56:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.588+0000 7f32237fe700 1 -- 172.21.15.49:0/324088028 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3224004020 con 0x7f322c107860 2024-06-02T23:56:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.588+0000 7f32237fe700 1 -- 172.21.15.49:0/324088028 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3224015660 con 0x7f322c107860 2024-06-02T23:56:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.588+0000 7f3234372700 1 -- 172.21.15.49:0/324088028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f322c1a56c0 con 0x7f322c107860 2024-06-02T23:56:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.589+0000 7f3234372700 1 -- 172.21.15.49:0/324088028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f322c069180 con 0x7f322c107860 2024-06-02T23:56:18.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.591+0000 7f32237fe700 1 -- 172.21.15.49:0/324088028 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f32240041d0 con 0x7f322c107860 2024-06-02T23:56:18.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.591+0000 7f32237fe700 1 --2- 172.21.15.49:0/324088028 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f32180a2ca0 0x7f32180a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:18.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.591+0000 7f323210e700 1 --2- 172.21.15.49:0/324088028 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f32180a2ca0 0x7f32180a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:18.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.592+0000 7f32237fe700 1 -- 172.21.15.49:0/324088028 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f32240cedb0 con 0x7f322c107860 2024-06-02T23:56:18.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.592+0000 7f323210e700 1 --2- 172.21.15.49:0/324088028 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f32180a2ca0 0x7f32180a5160 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f322c199af0 tx=0x7f3228009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:56:18.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.595+0000 7f32237fe700 1 -- 172.21.15.49:0/324088028 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3224010070 con 0x7f322c107860 2024-06-02T23:56:18.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:18 smithi107 ceph-mon[37048]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:18.689 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:18 smithi057 ceph-mon[36457]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:18.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.801+0000 7f3234372700 1 -- 172.21.15.49:0/324088028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f322c02dca0 con 0x7f322c107860 2024-06-02T23:56:18.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.802+0000 7f32237fe700 1 -- 172.21.15.49:0/324088028 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18371 (secure 0 0 0) 0x7f322409c1b0 con 0x7f322c107860 2024-06-02T23:56:18.803 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:56:18.804 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":81,"fsid":"890dd222-213a-11ef-bc9b-c7b262605968","created":"2024-06-02T23:48:53.323536+0000","modified":"2024-06-02T23:56:13.164556+0000","last_up_change":"2024-06-02T23:56:12.156697+0000","last_in_change":"2024-06-02T23:55:51.667118+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:52:23.676079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e0013e80-07d6-4ad3-87d8-d41988988ef5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6803","nonce":811647073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6805","nonce":811647073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6809","nonce":811647073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6807","nonce":811647073}]},"public_addr":"172.21.15.49:6803/811647073","cluster_addr":"172.21.15.49:6805/811647073","heartbeat_back_addr":"172.21.15.49:6809/811647073","heartbeat_front_addr":"172.21.15.49:6807/811647073","state":["exists","up"]},{"osd":1,"uuid":"f37d9f79-e349-4de7-81e7-385ddb905f58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6801","nonce":1260507785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6803","nonce":1260507785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6807","nonce":1260507785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6805","nonce":1260507785}]},"public_addr":"172.21.15.57:6801/1260507785","cluster_addr":"172.21.15.57:6803/1260507785","heartbeat_back_addr":"172.21.15.57:6807/1260507785","heartbeat_front_addr":"172.21.15.57:6805/1260507785","state":["exists","up"]},{"osd":2,"uuid":"94889281-7d45-4e78-9d37-b98e3fbe8494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6801","nonce":303899951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6803","nonce":303899951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6807","nonce":303899951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6805","nonce":303899951}]},"public_addr":"172.21.15.107:6801/303899951","cluster_addr":"172.21.15.107:6803/303899951","heartbeat_back_addr":"172.21.15.107:6807/303899951","heartbeat_front_addr":"172.21.15.107:6805/303899951","state":["exists","up"]},{"osd":3,"uuid":"31f4c18c-fbda-400d-8b3b-0955b0c4a6a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6811","nonce":60796312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6813","nonce":60796312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6817","nonce":60796312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6815","nonce":60796312}]},"public_addr":"172.21.15.49:6811/60796312","cluster_addr":"172.21.15.49:6813/60796312","heartbeat_back_addr":"172.21.15.49:6817/60796312","heartbeat_front_addr":"172.21.15.49:6815/60796312","state":["exists","up"]},{"osd":4,"uuid":"8076c2f3-0138-459e-89b5-c5c4586a14ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6809","nonce":3106842986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6811","nonce":3106842986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6815","nonce":3106842986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6813","nonce":3106842986}]},"public_addr":"172.21.15.57:6809/3106842986","cluster_addr":"172.21.15.57:6811/3106842986","heartbeat_back_addr":"172.21.15.57:6815/3106842986","heartbeat_front_addr":"172.21.15.57:6813/3106842986","state":["exists","up"]},{"osd":5,"uuid":"68f7abd3-4292-41fa-90ce-4ac34ea2b964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6809","nonce":389294142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6811","nonce":389294142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6815","nonce":389294142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6813","nonce":389294142}]},"public_addr":"172.21.15.107:6809/389294142","cluster_addr":"172.21.15.107:6811/389294142","heartbeat_back_addr":"172.21.15.107:6815/389294142","heartbeat_front_addr":"172.21.15.107:6813/389294142","state":["exists","up"]},{"osd":6,"uuid":"c0345dd0-71b7-436d-88f8-fe3d7cb69d8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6819","nonce":894624552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6821","nonce":894624552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6825","nonce":894624552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6823","nonce":894624552}]},"public_addr":"172.21.15.49:6819/894624552","cluster_addr":"172.21.15.49:6821/894624552","heartbeat_back_addr":"172.21.15.49:6825/894624552","heartbeat_front_addr":"172.21.15.49:6823/894624552","state":["exists","up"]},{"osd":7,"uuid":"9abd81c7-dcc1-4e14-8ab7-9fa0746067ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6817","nonce":3126027900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6819","nonce":3126027900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6823","nonce":3126027900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6821","nonce":3126027900}]},"public_addr":"172.21.15.57:6817/3126027900","cluster_addr":"172.21.15.57:6819/3126027900","heartbeat_back_addr":"172.21.15.57:6823/3126027900","heartbeat_front_addr":"172.21.15.57:6821/3126027900","state":["exists","up"]},{"osd":8,"uuid":"80532119-5de8-45d2-9cb9-bd8a6194199b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6817","nonce":3620047229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6819","nonce":3620047229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6823","nonce":3620047229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6821","nonce":3620047229}]},"public_addr":"172.21.15.107:6817/3620047229","cluster_addr":"172.21.15.107:6819/3620047229","heartbeat_back_addr":"172.21.15.107:6823/3620047229","heartbeat_front_addr":"172.21.15.107:6821/3620047229","state":["exists","up"]},{"osd":9,"uuid":"f0b5dcfa-9fd2-4a98-863b-197defa890af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6827","nonce":3627936526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6829","nonce":3627936526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6833","nonce":3627936526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6831","nonce":3627936526}]},"public_addr":"172.21.15.49:6827/3627936526","cluster_addr":"172.21.15.49:6829/3627936526","heartbeat_back_addr":"172.21.15.49:6833/3627936526","heartbeat_front_addr":"172.21.15.49:6831/3627936526","state":["exists","up"]},{"osd":10,"uuid":"21a75846-adec-41b8-9e1d-e5c61ba30b12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6825","nonce":3013235811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6827","nonce":3013235811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6831","nonce":3013235811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6829","nonce":3013235811}]},"public_addr":"172.21.15.57:6825/3013235811","cluster_addr":"172.21.15.57:6827/3013235811","heartbeat_back_addr":"172.21.15.57:6831/3013235811","heartbeat_front_addr":"172.21.15.57:6829/3013235811","state":["exists","up"]},{"osd":11,"uuid":"eb963b63-2c61-4169-b8fe-31c7f5ec919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6825","nonce":4217534517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6827","nonce":4217534517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6831","nonce":4217534517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6829","nonce":4217534517}]},"public_addr":"172.21.15.107:6825/4217534517","cluster_addr":"172.21.15.107:6827/4217534517","heartbeat_back_addr":"172.21.15.107:6831/4217534517","heartbeat_front_addr":"172.21.15.107:6829/4217534517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:51:31.067312+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:51:56.088456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:52:20.539941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:52:45.055717+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:53:11.178438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:53:35.794217+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:00.775674+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:27.574752+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:52.177634+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:55:17.118854+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:55:44.217535+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:56:10.500970+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/525944311":"2024-06-03T23:49:55.151590+0000","172.21.15.49:0/1841969299":"2024-06-03T23:49:55.151590+0000","172.21.15.49:0/1880506696":"2024-06-03T23:49:55.151590+0000","172.21.15.49:6801/1206062338":"2024-06-03T23:49:55.151590+0000","172.21.15.49:6800/549058216":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/2112783954":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/2183920213":"2024-06-03T23:49:29.042670+0000","172.21.15.49:6801/549058216":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/3350970308":"2024-06-03T23:49:29.042670+0000","172.21.15.49:6800/1206062338":"2024-06-03T23:49:55.151590+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:56:18.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.805+0000 7f3234372700 1 -- 172.21.15.49:0/324088028 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f32180a2ca0 msgr2=0x7f32180a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:18.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.805+0000 7f3234372700 1 --2- 172.21.15.49:0/324088028 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f32180a2ca0 0x7f32180a5160 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f322c199af0 tx=0x7f3228009260 comp rx=0 tx=0).stop 2024-06-02T23:56:18.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.805+0000 7f3234372700 1 -- 172.21.15.49:0/324088028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f322c107860 msgr2=0x7f322c1989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:18.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.805+0000 7f3234372700 1 --2- 172.21.15.49:0/324088028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f322c107860 0x7f322c1989b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3224007ee0 tx=0x7f322400d3b0 comp rx=0 tx=0).stop 2024-06-02T23:56:18.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.805+0000 7f3234372700 1 -- 172.21.15.49:0/324088028 shutdown_connections 2024-06-02T23:56:18.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.805+0000 7f3234372700 1 --2- 172.21.15.49:0/324088028 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f32180a2ca0 0x7f32180a5160 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:18.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.805+0000 7f3234372700 1 --2- 172.21.15.49:0/324088028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f322c107860 0x7f322c1989b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:18.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.805+0000 7f3234372700 1 --2- 172.21.15.49:0/324088028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f322c102770 0x7f322c19e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:18.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.805+0000 7f3234372700 1 --2- 172.21.15.49:0/324088028 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f322c103120 0x7f322c19ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:18.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.805+0000 7f3234372700 1 -- 172.21.15.49:0/324088028 >> 172.21.15.49:0/324088028 conn(0x7f322c079600 msgr2=0x7f322c100780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:56:18.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.805+0000 7f3234372700 1 -- 172.21.15.49:0/324088028 shutdown_connections 2024-06-02T23:56:18.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:18.805+0000 7f3234372700 1 -- 172.21.15.49:0/324088028 wait complete. 2024-06-02T23:56:19.434 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:19 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/324088028' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T23:56:19.463 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T23:52:23.676079+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-02T23:56:19.463 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-06-02T23:56:19.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:19 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/324088028' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T23:56:19.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:19 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/324088028' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T23:56:19.711 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:56:20.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:20 smithi049 ceph-mon[32302]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:20.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:20 smithi107 ceph-mon[37048]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:20.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:20 smithi057 ceph-mon[36457]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:21.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.295+0000 7f87840e9700 1 -- 172.21.15.49:0/3641809088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f877c101390 msgr2=0x7f877c101810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:21.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.295+0000 7f87840e9700 1 --2- 172.21.15.49:0/3641809088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f877c101390 0x7f877c101810 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f876c009990 tx=0x7f876c009ca0 comp rx=0 tx=0).stop 2024-06-02T23:56:21.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.295+0000 7f87840e9700 1 -- 172.21.15.49:0/3641809088 shutdown_connections 2024-06-02T23:56:21.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.295+0000 7f87840e9700 1 --2- 172.21.15.49:0/3641809088 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f877c101d50 0x7f877c10e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:21.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.295+0000 7f87840e9700 1 --2- 172.21.15.49:0/3641809088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f877c107400 0x7f877c1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:21.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.295+0000 7f87840e9700 1 --2- 172.21.15.49:0/3641809088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f877c101390 0x7f877c101810 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:21.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.295+0000 7f87840e9700 1 -- 172.21.15.49:0/3641809088 >> 172.21.15.49:0/3641809088 conn(0x7f877c078340 msgr2=0x7f877c078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:56:21.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.295+0000 7f87840e9700 1 -- 172.21.15.49:0/3641809088 shutdown_connections 2024-06-02T23:56:21.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.295+0000 7f87840e9700 1 -- 172.21.15.49:0/3641809088 wait complete. 2024-06-02T23:56:21.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.296+0000 7f87840e9700 1 Processor -- start 2024-06-02T23:56:21.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.296+0000 7f87840e9700 1 -- start start 2024-06-02T23:56:21.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.296+0000 7f87840e9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f877c101390 0x7f877c199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:21.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.297+0000 7f87840e9700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f877c101d50 0x7f877c199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:21.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.297+0000 7f87840e9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f877c107400 0x7f877c1a4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:21.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.297+0000 7f87840e9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f877c111670 con 0x7f877c107400 2024-06-02T23:56:21.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.297+0000 7f87840e9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f877c1114f0 con 0x7f877c101390 2024-06-02T23:56:21.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.297+0000 7f87840e9700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f877c1117f0 con 0x7f877c101d50 2024-06-02T23:56:21.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.297+0000 7f8782686700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f877c107400 0x7f877c1a4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:21.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.297+0000 7f8782686700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f877c107400 0x7f877c1a4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59394/0 (socket says 172.21.15.49:59394) 2024-06-02T23:56:21.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.297+0000 7f8782686700 1 -- 172.21.15.49:0/2242454294 learned_addr learned my addr 172.21.15.49:0/2242454294 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:56:21.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.297+0000 7f8781e85700 1 --2- 172.21.15.49:0/2242454294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f877c101390 0x7f877c199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:21.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.297+0000 7f8781684700 1 --2- 172.21.15.49:0/2242454294 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f877c101d50 0x7f877c199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:21.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.297+0000 7f8782686700 1 -- 172.21.15.49:0/2242454294 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f877c101d50 msgr2=0x7f877c199f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:21.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.297+0000 7f8782686700 1 --2- 172.21.15.49:0/2242454294 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f877c101d50 0x7f877c199f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:21.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.297+0000 7f8782686700 1 -- 172.21.15.49:0/2242454294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f877c101390 msgr2=0x7f877c199a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:21.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.297+0000 7f8782686700 1 --2- 172.21.15.49:0/2242454294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f877c101390 0x7f877c199a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:21.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.297+0000 7f8782686700 1 -- 172.21.15.49:0/2242454294 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f877c1a4ff0 con 0x7f877c107400 2024-06-02T23:56:21.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.297+0000 7f8782686700 1 --2- 172.21.15.49:0/2242454294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f877c107400 0x7f877c1a4ab0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f877400ef30 tx=0x7f877400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:56:21.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.297+0000 7f8772ffd700 1 -- 172.21.15.49:0/2242454294 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87740092e0 con 0x7f877c107400 2024-06-02T23:56:21.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.297+0000 7f8772ffd700 1 -- 172.21.15.49:0/2242454294 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8774004bb0 con 0x7f877c107400 2024-06-02T23:56:21.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.297+0000 7f87840e9700 1 -- 172.21.15.49:0/2242454294 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f877c1a51c0 con 0x7f877c107400 2024-06-02T23:56:21.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.297+0000 7f8772ffd700 1 -- 172.21.15.49:0/2242454294 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8774004280 con 0x7f877c107400 2024-06-02T23:56:21.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.298+0000 7f87840e9700 1 -- 172.21.15.49:0/2242454294 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f877c1a56d0 con 0x7f877c107400 2024-06-02T23:56:21.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.298+0000 7f87840e9700 1 -- 172.21.15.49:0/2242454294 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f877c069180 con 0x7f877c107400 2024-06-02T23:56:21.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.300+0000 7f8772ffd700 1 -- 172.21.15.49:0/2242454294 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f877401b030 con 0x7f877c107400 2024-06-02T23:56:21.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.300+0000 7f8772ffd700 1 --2- 172.21.15.49:0/2242454294 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f87680a2ca0 0x7f87680a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:21.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.301+0000 7f8781e85700 1 --2- 172.21.15.49:0/2242454294 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f87680a2ca0 0x7f87680a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:21.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.301+0000 7f8772ffd700 1 -- 172.21.15.49:0/2242454294 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f87740ce600 con 0x7f877c107400 2024-06-02T23:56:21.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.301+0000 7f8781e85700 1 --2- 172.21.15.49:0/2242454294 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f87680a2ca0 0x7f87680a5160 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8778007b60 tx=0x7f87780073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:56:21.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.305+0000 7f8772ffd700 1 -- 172.21.15.49:0/2242454294 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8774022020 con 0x7f877c107400 2024-06-02T23:56:21.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.511+0000 7f87840e9700 1 -- 172.21.15.49:0/2242454294 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f877c02dca0 con 0x7f877c107400 2024-06-02T23:56:21.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.512+0000 7f8772ffd700 1 -- 172.21.15.49:0/2242454294 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f8774010040 con 0x7f877c107400 2024-06-02T23:56:21.513 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-06-02T23:56:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.514+0000 7f87840e9700 1 -- 172.21.15.49:0/2242454294 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f87680a2ca0 msgr2=0x7f87680a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.514+0000 7f87840e9700 1 --2- 172.21.15.49:0/2242454294 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f87680a2ca0 0x7f87680a5160 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8778007b60 tx=0x7f87780073d0 comp rx=0 tx=0).stop 2024-06-02T23:56:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.514+0000 7f87840e9700 1 -- 172.21.15.49:0/2242454294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f877c107400 msgr2=0x7f877c1a4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.514+0000 7f87840e9700 1 --2- 172.21.15.49:0/2242454294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f877c107400 0x7f877c1a4ab0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f877400ef30 tx=0x7f877400c3a0 comp rx=0 tx=0).stop 2024-06-02T23:56:21.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.514+0000 7f87840e9700 1 -- 172.21.15.49:0/2242454294 shutdown_connections 2024-06-02T23:56:21.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.514+0000 7f87840e9700 1 --2- 172.21.15.49:0/2242454294 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f87680a2ca0 0x7f87680a5160 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:21.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.514+0000 7f87840e9700 1 --2- 172.21.15.49:0/2242454294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f877c107400 0x7f877c1a4ab0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:21.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.514+0000 7f87840e9700 1 --2- 172.21.15.49:0/2242454294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f877c101390 0x7f877c199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:21.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.514+0000 7f87840e9700 1 --2- 172.21.15.49:0/2242454294 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f877c101d50 0x7f877c199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:21.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.514+0000 7f87840e9700 1 -- 172.21.15.49:0/2242454294 >> 172.21.15.49:0/2242454294 conn(0x7f877c078340 msgr2=0x7f877c0ffe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:56:21.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.514+0000 7f87840e9700 1 -- 172.21.15.49:0/2242454294 shutdown_connections 2024-06-02T23:56:21.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:21.514+0000 7f87840e9700 1 -- 172.21.15.49:0/2242454294 wait complete. 2024-06-02T23:56:22.186 INFO:tasks.cephadm:Adding mds.a on smithi049 2024-06-02T23:56:22.186 INFO:tasks.cephadm:Adding mds.d on smithi049 2024-06-02T23:56:22.186 INFO:tasks.cephadm:Adding mds.g on smithi049 2024-06-02T23:56:22.186 INFO:tasks.cephadm:Adding mds.j on smithi049 2024-06-02T23:56:22.186 INFO:tasks.cephadm:Adding mds.b on smithi057 2024-06-02T23:56:22.187 INFO:tasks.cephadm:Adding mds.e on smithi057 2024-06-02T23:56:22.187 INFO:tasks.cephadm:Adding mds.h on smithi057 2024-06-02T23:56:22.187 INFO:tasks.cephadm:Adding mds.k on smithi057 2024-06-02T23:56:22.187 INFO:tasks.cephadm:Adding mds.c on smithi107 2024-06-02T23:56:22.187 INFO:tasks.cephadm:Adding mds.f on smithi107 2024-06-02T23:56:22.187 INFO:tasks.cephadm:Adding mds.i on smithi107 2024-06-02T23:56:22.187 INFO:tasks.cephadm:Adding mds.l on smithi107 2024-06-02T23:56:22.187 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph orch apply mds all '12;smithi049=a;smithi049=d;smithi049=g;smithi049=j;smithi057=b;smithi057=e;smithi057=h;smithi057=k;smithi107=c;smithi107=f;smithi107=i;smithi107=l' 2024-06-02T23:56:22.433 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T23:56:22.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:22 smithi049 ceph-mon[32302]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:22.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:22 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/2242454294' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T23:56:22.554 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:22 smithi107 ceph-mon[37048]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:22.554 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:22 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/2242454294' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T23:56:22.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:22 smithi057 ceph-mon[36457]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:22.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:22 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/2242454294' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T23:56:24.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.141+0000 7f982b3f7700 1 -- 172.21.15.107:0/2470705579 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9824100540 msgr2=0x7f98241009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:24.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.141+0000 7f982b3f7700 1 --2- 172.21.15.107:0/2470705579 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9824100540 0x7f98241009a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9820009990 tx=0x7f9820009ca0 comp rx=0 tx=0).stop 2024-06-02T23:56:24.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.141+0000 7f982b3f7700 1 -- 172.21.15.107:0/2470705579 shutdown_connections 2024-06-02T23:56:24.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.141+0000 7f982b3f7700 1 --2- 172.21.15.107:0/2470705579 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9824100ee0 0x7f982410aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:24.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.141+0000 7f982b3f7700 1 --2- 172.21.15.107:0/2470705579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9824103ac0 0x7f9824103ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:24.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.141+0000 7f982b3f7700 1 --2- 172.21.15.107:0/2470705579 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9824100540 0x7f98241009a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:24.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.141+0000 7f982b3f7700 1 -- 172.21.15.107:0/2470705579 >> 172.21.15.107:0/2470705579 conn(0x7f98240fc120 msgr2=0x7f98240fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:56:24.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.141+0000 7f982b3f7700 1 -- 172.21.15.107:0/2470705579 shutdown_connections 2024-06-02T23:56:24.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.141+0000 7f982b3f7700 1 -- 172.21.15.107:0/2470705579 wait complete. 2024-06-02T23:56:24.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.142+0000 7f982b3f7700 1 Processor -- start 2024-06-02T23:56:24.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.142+0000 7f982b3f7700 1 -- start start 2024-06-02T23:56:24.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.142+0000 7f982b3f7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9824100540 0x7f9824198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:24.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.142+0000 7f982b3f7700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9824100ee0 0x7f9824198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:24.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.142+0000 7f982b3f7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9824103ac0 0x7f982419fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:24.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.142+0000 7f982b3f7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f982410e140 con 0x7f9824103ac0 2024-06-02T23:56:24.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.142+0000 7f982b3f7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f982410dfc0 con 0x7f9824100540 2024-06-02T23:56:24.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.142+0000 7f982b3f7700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f982410e2c0 con 0x7f9824100ee0 2024-06-02T23:56:24.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.142+0000 7f9828992700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9824100ee0 0x7f9824198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:24.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.142+0000 7f9828992700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9824100ee0 0x7f9824198c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41702/0 (socket says 172.21.15.107:41702) 2024-06-02T23:56:24.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.142+0000 7f9828992700 1 -- 172.21.15.107:0/1675303245 learned_addr learned my addr 172.21.15.107:0/1675303245 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-06-02T23:56:24.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.143+0000 7f9829994700 1 --2- 172.21.15.107:0/1675303245 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9824103ac0 0x7f982419fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:24.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.143+0000 7f9829193700 1 --2- 172.21.15.107:0/1675303245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9824100540 0x7f9824198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:24.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.143+0000 7f9828992700 1 -- 172.21.15.107:0/1675303245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9824100540 msgr2=0x7f9824198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:24.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.143+0000 7f9828992700 1 --2- 172.21.15.107:0/1675303245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9824100540 0x7f9824198700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:24.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.143+0000 7f9828992700 1 -- 172.21.15.107:0/1675303245 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9824103ac0 msgr2=0x7f982419fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:24.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.143+0000 7f9828992700 1 --2- 172.21.15.107:0/1675303245 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9824103ac0 0x7f982419fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:24.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.143+0000 7f9828992700 1 -- 172.21.15.107:0/1675303245 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9824101650 con 0x7f9824100ee0 2024-06-02T23:56:24.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.143+0000 7f9828992700 1 --2- 172.21.15.107:0/1675303245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9824100ee0 0x7f9824198c40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9820005910 tx=0x7f9820003730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:56:24.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.143+0000 7f981a7fc700 1 -- 172.21.15.107:0/1675303245 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9820027070 con 0x7f9824100ee0 2024-06-02T23:56:24.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.143+0000 7f982b3f7700 1 -- 172.21.15.107:0/1675303245 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98241018e0 con 0x7f9824100ee0 2024-06-02T23:56:24.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.143+0000 7f981a7fc700 1 -- 172.21.15.107:0/1675303245 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9820022470 con 0x7f9824100ee0 2024-06-02T23:56:24.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.143+0000 7f981a7fc700 1 -- 172.21.15.107:0/1675303245 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982000f6c0 con 0x7f9824100ee0 2024-06-02T23:56:24.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.143+0000 7f982b3f7700 1 -- 172.21.15.107:0/1675303245 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9824101ef0 con 0x7f9824100ee0 2024-06-02T23:56:24.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.144+0000 7f982b3f7700 1 -- 172.21.15.107:0/1675303245 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9824069180 con 0x7f9824100ee0 2024-06-02T23:56:24.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.146+0000 7f981a7fc700 1 -- 172.21.15.107:0/1675303245 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f982002a070 con 0x7f9824100ee0 2024-06-02T23:56:24.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.146+0000 7f981a7fc700 1 --2- 172.21.15.107:0/1675303245 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f98100a2c20 0x7f98100a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:24.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.147+0000 7f981a7fc700 1 -- 172.21.15.107:0/1675303245 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f98200cfc10 con 0x7f9824100ee0 2024-06-02T23:56:24.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.147+0000 7f9829193700 1 --2- 172.21.15.107:0/1675303245 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f98100a2c20 0x7f98100a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:24.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.147+0000 7f9829193700 1 --2- 172.21.15.107:0/1675303245 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f98100a2c20 0x7f98100a50e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9814006fd0 tx=0x7f9814008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:56:24.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.151+0000 7f981a7fc700 1 -- 172.21.15.107:0/1675303245 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f982005e850 con 0x7f9824100ee0 2024-06-02T23:56:24.368 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:24 smithi107 ceph-mon[37048]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:24.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.368+0000 7f982b3f7700 1 -- 172.21.15.107:0/1675303245 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi049=a;smithi049=d;smithi049=g;smithi049=j;smithi057=b;smithi057=e;smithi057=h;smithi057=k;smithi107=c;smithi107=f;smithi107=i;smithi107=l", "target": ["mon-mgr", ""]}) -- 0x7f9824109770 con 0x7f98100a2c20 2024-06-02T23:56:24.375 INFO:teuthology.orchestra.run.smithi107.stdout:Scheduled mds.all update... 2024-06-02T23:56:24.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.375+0000 7f981a7fc700 1 -- 172.21.15.107:0/1675303245 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f9824109770 con 0x7f98100a2c20 2024-06-02T23:56:24.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.378+0000 7f982b3f7700 1 -- 172.21.15.107:0/1675303245 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f98100a2c20 msgr2=0x7f98100a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:24.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.378+0000 7f982b3f7700 1 --2- 172.21.15.107:0/1675303245 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f98100a2c20 0x7f98100a50e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9814006fd0 tx=0x7f9814008040 comp rx=0 tx=0).stop 2024-06-02T23:56:24.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.378+0000 7f982b3f7700 1 -- 172.21.15.107:0/1675303245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9824100ee0 msgr2=0x7f9824198c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:24.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.378+0000 7f982b3f7700 1 --2- 172.21.15.107:0/1675303245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9824100ee0 0x7f9824198c40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9820005910 tx=0x7f9820003730 comp rx=0 tx=0).stop 2024-06-02T23:56:24.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.378+0000 7f982b3f7700 1 -- 172.21.15.107:0/1675303245 shutdown_connections 2024-06-02T23:56:24.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.378+0000 7f982b3f7700 1 --2- 172.21.15.107:0/1675303245 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f98100a2c20 0x7f98100a50e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:24.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.378+0000 7f982b3f7700 1 --2- 172.21.15.107:0/1675303245 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9824103ac0 0x7f982419fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:24.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.378+0000 7f982b3f7700 1 --2- 172.21.15.107:0/1675303245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9824100540 0x7f9824198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:24.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.378+0000 7f982b3f7700 1 --2- 172.21.15.107:0/1675303245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9824100ee0 0x7f9824198c40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:24.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.378+0000 7f982b3f7700 1 -- 172.21.15.107:0/1675303245 >> 172.21.15.107:0/1675303245 conn(0x7f98240fc120 msgr2=0x7f9824106b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:56:24.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.378+0000 7f982b3f7700 1 -- 172.21.15.107:0/1675303245 shutdown_connections 2024-06-02T23:56:24.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-06-02T23:56:24.378+0000 7f982b3f7700 1 -- 172.21.15.107:0/1675303245 wait complete. 2024-06-02T23:56:24.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:24 smithi057 ceph-mon[36457]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:24.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:24 smithi049 ceph-mon[32302]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:25.029 DEBUG:teuthology.orchestra.run.smithi049:mds.a> sudo journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.a.service 2024-06-02T23:56:25.032 DEBUG:teuthology.orchestra.run.smithi049:mds.d> sudo journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.d.service 2024-06-02T23:56:25.076 DEBUG:teuthology.orchestra.run.smithi049:mds.g> sudo journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.g.service 2024-06-02T23:56:25.118 DEBUG:teuthology.orchestra.run.smithi049:mds.j> sudo journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.j.service 2024-06-02T23:56:25.161 DEBUG:teuthology.orchestra.run.smithi057:mds.b> sudo journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.b.service 2024-06-02T23:56:25.164 DEBUG:teuthology.orchestra.run.smithi057:mds.e> sudo journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.e.service 2024-06-02T23:56:25.206 DEBUG:teuthology.orchestra.run.smithi057:mds.h> sudo journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.h.service 2024-06-02T23:56:25.249 DEBUG:teuthology.orchestra.run.smithi057:mds.k> sudo journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.k.service 2024-06-02T23:56:25.293 DEBUG:teuthology.orchestra.run.smithi107:mds.c> sudo journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.c.service 2024-06-02T23:56:25.295 DEBUG:teuthology.orchestra.run.smithi107:mds.f> sudo journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.f.service 2024-06-02T23:56:25.338 DEBUG:teuthology.orchestra.run.smithi107:mds.i> sudo journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.i.service 2024-06-02T23:56:25.380 DEBUG:teuthology.orchestra.run.smithi107:mds.l> sudo journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.l.service 2024-06-02T23:56:25.425 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-06-02T23:56:25.425 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T23:56:25.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:25 smithi057 ceph-mon[36457]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi049=a;smithi049=d;smithi049=g;smithi049=j;smithi057=b;smithi057=e;smithi057=h;smithi057=k;smithi107=c;smithi107=f;smithi107=i;smithi107=l", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:56:25.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:25 smithi057 ceph-mon[36457]: Saving service mds.all spec with placement smithi049=a;smithi049=d;smithi049=g;smithi049=j;smithi057=b;smithi057=e;smithi057=h;smithi057=k;smithi107=c;smithi107=f;smithi107=i;smithi107=l;count:12 2024-06-02T23:56:25.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:25 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:25.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:25 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:56:25.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:25 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:25.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:25 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:56:25.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:25 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:25.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:25 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:25.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:25 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:25.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:25 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:25.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:25 smithi057 ceph-mon[36457]: Deploying daemon mds.l on smithi107 2024-06-02T23:56:25.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:25 smithi107 ceph-mon[37048]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi049=a;smithi049=d;smithi049=g;smithi049=j;smithi057=b;smithi057=e;smithi057=h;smithi057=k;smithi107=c;smithi107=f;smithi107=i;smithi107=l", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:56:25.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:25 smithi107 ceph-mon[37048]: Saving service mds.all spec with placement smithi049=a;smithi049=d;smithi049=g;smithi049=j;smithi057=b;smithi057=e;smithi057=h;smithi057=k;smithi107=c;smithi107=f;smithi107=i;smithi107=l;count:12 2024-06-02T23:56:25.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:25 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:25.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:25 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:56:25.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:25 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:25.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:25 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:56:25.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:25 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:25.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:25 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:25.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:25 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:25.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:25 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:25.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:25 smithi107 ceph-mon[37048]: Deploying daemon mds.l on smithi107 2024-06-02T23:56:25.685 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:56:25.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:25 smithi049 ceph-mon[32302]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi049=a;smithi049=d;smithi049=g;smithi049=j;smithi057=b;smithi057=e;smithi057=h;smithi057=k;smithi107=c;smithi107=f;smithi107=i;smithi107=l", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:56:25.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:25 smithi049 ceph-mon[32302]: Saving service mds.all spec with placement smithi049=a;smithi049=d;smithi049=g;smithi049=j;smithi057=b;smithi057=e;smithi057=h;smithi057=k;smithi107=c;smithi107=f;smithi107=i;smithi107=l;count:12 2024-06-02T23:56:25.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:25 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:25.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:25 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:56:25.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:25 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:25.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:25 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:56:25.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:25 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:25.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:25 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:25.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:25 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:25.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:25 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:25.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:25 smithi049 ceph-mon[32302]: Deploying daemon mds.l on smithi107 2024-06-02T23:56:26.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:26 smithi057 ceph-mon[36457]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:26.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:26 smithi049 ceph-mon[32302]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:26.771 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:26 smithi107 ceph-mon[37048]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:26.771 INFO:journalctl@ceph.mds.l.smithi107.stdout:Jun 02 23:56:26 smithi107 systemd[1]: Starting Ceph mds.l for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-02T23:56:27.034 INFO:journalctl@ceph.mds.l.smithi107.stdout:Jun 02 23:56:26 smithi107 podman[67184]: 2024-06-02 23:56:26.674270607 +0000 UTC m=+0.017109670 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:56:27.034 INFO:journalctl@ceph.mds.l.smithi107.stdout:Jun 02 23:56:26 smithi107 podman[67184]: 2024-06-02 23:56:26.782598502 +0000 UTC m=+0.125437569 container create 753a3080ef56f1034422d852d5bcf2fa4d77a12ccc7db227d0adb13abb37499b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-l, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0) 2024-06-02T23:56:27.034 INFO:journalctl@ceph.mds.l.smithi107.stdout:Jun 02 23:56:27 smithi107 podman[67184]: 2024-06-02 23:56:27.034961766 +0000 UTC m=+0.377800825 container init 753a3080ef56f1034422d852d5bcf2fa4d77a12ccc7db227d0adb13abb37499b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-l, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0) 2024-06-02T23:56:27.350 INFO:journalctl@ceph.mds.l.smithi107.stdout:Jun 02 23:56:27 smithi107 podman[67184]: 2024-06-02 23:56:27.037484449 +0000 UTC m=+0.380323516 container start 753a3080ef56f1034422d852d5bcf2fa4d77a12ccc7db227d0adb13abb37499b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-l, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T23:56:27.351 INFO:journalctl@ceph.mds.l.smithi107.stdout:Jun 02 23:56:27 smithi107 ceph-mds[67203]: -- 172.21.15.107:0/2291201889 <== mon.1 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bed3407a40 con 0x55bed33db000 2024-06-02T23:56:27.351 INFO:journalctl@ceph.mds.l.smithi107.stdout:Jun 02 23:56:27 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-l[67199]: starting mds.l at 2024-06-02T23:56:27.351 INFO:journalctl@ceph.mds.l.smithi107.stdout:Jun 02 23:56:27 smithi107 bash[67184]: 753a3080ef56f1034422d852d5bcf2fa4d77a12ccc7db227d0adb13abb37499b 2024-06-02T23:56:27.351 INFO:journalctl@ceph.mds.l.smithi107.stdout:Jun 02 23:56:27 smithi107 systemd[1]: Started Ceph mds.l for 890dd222-213a-11ef-bc9b-c7b262605968. 2024-06-02T23:56:27.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.455+0000 7f9fab81e700 1 -- 172.21.15.49:0/3164447525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fa4108500 msgr2=0x7f9fa41088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:27.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.455+0000 7f9fab81e700 1 --2- 172.21.15.49:0/3164447525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fa4108500 0x7f9fa41088e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9f9400b0a0 tx=0x7f9f9400b3b0 comp rx=0 tx=0).stop 2024-06-02T23:56:27.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.455+0000 7f9fab81e700 1 -- 172.21.15.49:0/3164447525 shutdown_connections 2024-06-02T23:56:27.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.455+0000 7f9fab81e700 1 --2- 172.21.15.49:0/3164447525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fa406ab30 0x7f9fa410f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:27.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.455+0000 7f9fab81e700 1 --2- 172.21.15.49:0/3164447525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fa4108500 0x7f9fa41088e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:27.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.455+0000 7f9fab81e700 1 --2- 172.21.15.49:0/3164447525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9fa406a170 0x7f9fa406a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:27.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.455+0000 7f9fab81e700 1 -- 172.21.15.49:0/3164447525 >> 172.21.15.49:0/3164447525 conn(0x7f9fa4078340 msgr2=0x7f9fa4078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:56:27.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.455+0000 7f9fab81e700 1 -- 172.21.15.49:0/3164447525 shutdown_connections 2024-06-02T23:56:27.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.455+0000 7f9fab81e700 1 -- 172.21.15.49:0/3164447525 wait complete. 2024-06-02T23:56:27.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.456+0000 7f9fab81e700 1 Processor -- start 2024-06-02T23:56:27.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.456+0000 7f9fab81e700 1 -- start start 2024-06-02T23:56:27.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.456+0000 7f9fab81e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fa406a170 0x7f9fa419e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:27.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.456+0000 7f9fab81e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fa406ab30 0x7f9fa419ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:27.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.456+0000 7f9fab81e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9fa4108500 0x7f9fa4198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:27.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.456+0000 7f9fab81e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa4112760 con 0x7f9fa406ab30 2024-06-02T23:56:27.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.456+0000 7f9fab81e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa41125e0 con 0x7f9fa4108500 2024-06-02T23:56:27.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.456+0000 7f9fab81e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa41128e0 con 0x7f9fa406a170 2024-06-02T23:56:27.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.456+0000 7f9fa8db9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fa406ab30 0x7f9fa419ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:27.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.456+0000 7f9fa8db9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fa406ab30 0x7f9fa419ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58466/0 (socket says 172.21.15.49:58466) 2024-06-02T23:56:27.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.456+0000 7f9fa8db9700 1 -- 172.21.15.49:0/216156339 learned_addr learned my addr 172.21.15.49:0/216156339 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:56:27.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.456+0000 7f9fa95ba700 1 --2- 172.21.15.49:0/216156339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fa406a170 0x7f9fa419e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:27.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.456+0000 7f9fa9dbb700 1 --2- 172.21.15.49:0/216156339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9fa4108500 0x7f9fa4198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:27.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.457+0000 7f9fa8db9700 1 -- 172.21.15.49:0/216156339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fa406a170 msgr2=0x7f9fa419e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:27.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.457+0000 7f9fa8db9700 1 --2- 172.21.15.49:0/216156339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fa406a170 0x7f9fa419e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:27.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.457+0000 7f9fa8db9700 1 -- 172.21.15.49:0/216156339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9fa4108500 msgr2=0x7f9fa4198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:27.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.457+0000 7f9fa8db9700 1 --2- 172.21.15.49:0/216156339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9fa4108500 0x7f9fa4198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:27.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.457+0000 7f9fa8db9700 1 -- 172.21.15.49:0/216156339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa41991a0 con 0x7f9fa406ab30 2024-06-02T23:56:27.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.457+0000 7f9fa8db9700 1 --2- 172.21.15.49:0/216156339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fa406ab30 0x7f9fa419ed70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9f9800e9a0 tx=0x7f9f9800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:56:27.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.457+0000 7f9fa27fc700 1 -- 172.21.15.49:0/216156339 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9800c9c0 con 0x7f9fa406ab30 2024-06-02T23:56:27.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.457+0000 7f9fa27fc700 1 -- 172.21.15.49:0/216156339 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f9800cb60 con 0x7f9fa406ab30 2024-06-02T23:56:27.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.457+0000 7f9fab81e700 1 -- 172.21.15.49:0/216156339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa4199490 con 0x7f9fa406ab30 2024-06-02T23:56:27.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.457+0000 7f9fa27fc700 1 -- 172.21.15.49:0/216156339 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f98018660 con 0x7f9fa406ab30 2024-06-02T23:56:27.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.457+0000 7f9fab81e700 1 -- 172.21.15.49:0/216156339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa41a5700 con 0x7f9fa406ab30 2024-06-02T23:56:27.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.458+0000 7f9fab81e700 1 -- 172.21.15.49:0/216156339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fa410a9e0 con 0x7f9fa406ab30 2024-06-02T23:56:27.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.459+0000 7f9fa27fc700 1 -- 172.21.15.49:0/216156339 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9f9800cd10 con 0x7f9fa406ab30 2024-06-02T23:56:27.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.460+0000 7f9fa27fc700 1 --2- 172.21.15.49:0/216156339 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9f8c0a2ca0 0x7f9f8c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:27.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.460+0000 7f9fa95ba700 1 --2- 172.21.15.49:0/216156339 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9f8c0a2ca0 0x7f9f8c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:27.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.460+0000 7f9fa27fc700 1 -- 172.21.15.49:0/216156339 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f9f980ceec0 con 0x7f9fa406ab30 2024-06-02T23:56:27.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.460+0000 7f9fa95ba700 1 --2- 172.21.15.49:0/216156339 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9f8c0a2ca0 0x7f9f8c0a5160 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9f94009e60 tx=0x7f9f9400b700 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:56:27.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.463+0000 7f9fa27fc700 1 -- 172.21.15.49:0/216156339 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9f9809c2c0 con 0x7f9fa406ab30 2024-06-02T23:56:27.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.717+0000 7f9fab81e700 1 -- 172.21.15.49:0/216156339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9fa4069180 con 0x7f9fa406ab30 2024-06-02T23:56:27.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.718+0000 7f9fa27fc700 1 -- 172.21.15.49:0/216156339 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1396 (secure 0 0 0) 0x7f9f9809bbc0 con 0x7f9fa406ab30 2024-06-02T23:56:27.717 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:56:27.718 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-06-02T23:56:27.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.720+0000 7f9fab81e700 1 -- 172.21.15.49:0/216156339 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9f8c0a2ca0 msgr2=0x7f9f8c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:27.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.720+0000 7f9fab81e700 1 --2- 172.21.15.49:0/216156339 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9f8c0a2ca0 0x7f9f8c0a5160 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9f94009e60 tx=0x7f9f9400b700 comp rx=0 tx=0).stop 2024-06-02T23:56:27.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.720+0000 7f9fab81e700 1 -- 172.21.15.49:0/216156339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fa406ab30 msgr2=0x7f9fa419ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:27.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.720+0000 7f9fab81e700 1 --2- 172.21.15.49:0/216156339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fa406ab30 0x7f9fa419ed70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9f9800e9a0 tx=0x7f9f9800ecb0 comp rx=0 tx=0).stop 2024-06-02T23:56:27.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.720+0000 7f9fab81e700 1 -- 172.21.15.49:0/216156339 shutdown_connections 2024-06-02T23:56:27.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.720+0000 7f9fab81e700 1 --2- 172.21.15.49:0/216156339 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9f8c0a2ca0 0x7f9f8c0a5160 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:27.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.720+0000 7f9fab81e700 1 --2- 172.21.15.49:0/216156339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9fa4108500 0x7f9fa4198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:27.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.720+0000 7f9fab81e700 1 --2- 172.21.15.49:0/216156339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fa406a170 0x7f9fa419e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:27.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.720+0000 7f9fab81e700 1 --2- 172.21.15.49:0/216156339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fa406ab30 0x7f9fa419ed70 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:27.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.720+0000 7f9fab81e700 1 -- 172.21.15.49:0/216156339 >> 172.21.15.49:0/216156339 conn(0x7f9fa4078340 msgr2=0x7f9fa40ffef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:56:27.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.720+0000 7f9fab81e700 1 -- 172.21.15.49:0/216156339 shutdown_connections 2024-06-02T23:56:27.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:27.720+0000 7f9fab81e700 1 -- 172.21.15.49:0/216156339 wait complete. 2024-06-02T23:56:27.721 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 2 2024-06-02T23:56:28.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:28 smithi057 ceph-mon[36457]: mds.? [v2:172.21.15.107:6832/2662998293,v1:172.21.15.107:6833/2662998293] up:boot 2024-06-02T23:56:28.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:28 smithi057 ceph-mon[36457]: fsmap 1 up:standby 2024-06-02T23:56:28.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:28 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-02T23:56:28.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:28 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:28.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:28 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:28.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:28 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:28.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:28 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:28.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:28 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:28.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:28 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:28.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:28 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/216156339' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:56:28.306 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:28 smithi049 ceph-mon[32302]: mds.? [v2:172.21.15.107:6832/2662998293,v1:172.21.15.107:6833/2662998293] up:boot 2024-06-02T23:56:28.306 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:28 smithi049 ceph-mon[32302]: fsmap 1 up:standby 2024-06-02T23:56:28.306 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:28 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-02T23:56:28.306 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:28 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:28.306 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:28 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:28.306 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:28 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:28.307 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:28 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:28.307 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:28 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:28.307 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:28 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:28.307 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:28 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/216156339' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:56:28.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:28 smithi107 ceph-mon[37048]: mds.? [v2:172.21.15.107:6832/2662998293,v1:172.21.15.107:6833/2662998293] up:boot 2024-06-02T23:56:28.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:28 smithi107 ceph-mon[37048]: fsmap 1 up:standby 2024-06-02T23:56:28.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:28 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-02T23:56:28.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:28 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:28.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:28 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:28.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:28 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:28.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:28 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:28.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:28 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:28.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:28 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:28.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:28 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/216156339' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:56:29.308 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:29 smithi057 ceph-mon[36457]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:29.309 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:29 smithi057 ceph-mon[36457]: Deploying daemon mds.k on smithi057 2024-06-02T23:56:29.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:29 smithi107 ceph-mon[37048]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:29.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:29 smithi107 ceph-mon[37048]: Deploying daemon mds.k on smithi057 2024-06-02T23:56:29.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:29 smithi049 ceph-mon[32302]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:29.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:29 smithi049 ceph-mon[32302]: Deploying daemon mds.k on smithi057 2024-06-02T23:56:29.700 INFO:journalctl@ceph.mds.k.smithi057.stdout:Jun 02 23:56:29 smithi057 systemd[1]: Starting Ceph mds.k for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-02T23:56:29.974 INFO:journalctl@ceph.mds.k.smithi057.stdout:Jun 02 23:56:29 smithi057 podman[65592]: 2024-06-02 23:56:29.626976787 +0000 UTC m=+0.017549250 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:56:29.974 INFO:journalctl@ceph.mds.k.smithi057.stdout:Jun 02 23:56:29 smithi057 podman[65592]: 2024-06-02 23:56:29.744344254 +0000 UTC m=+0.134916709 container create 338578aa18a2e11746a7b656b2677c506496951ac9cd7ff7c65167dd7c9a99c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-k, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-06-02T23:56:29.974 INFO:journalctl@ceph.mds.k.smithi057.stdout:Jun 02 23:56:29 smithi057 podman[65592]: 2024-06-02 23:56:29.971766777 +0000 UTC m=+0.362339233 container init 338578aa18a2e11746a7b656b2677c506496951ac9cd7ff7c65167dd7c9a99c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-k, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-02T23:56:29.974 INFO:journalctl@ceph.mds.k.smithi057.stdout:Jun 02 23:56:29 smithi057 podman[65592]: 2024-06-02 23:56:29.974500201 +0000 UTC m=+0.365072663 container start 338578aa18a2e11746a7b656b2677c506496951ac9cd7ff7c65167dd7c9a99c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2) 2024-06-02T23:56:30.334 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T23:56:30.450 INFO:journalctl@ceph.mds.k.smithi057.stdout:Jun 02 23:56:29 smithi057 ceph-mds[65611]: -- 172.21.15.57:0/1621787768 <== mon.2 v2:172.21.15.57:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5594b9a81a40 con 0x5594b9a55000 2024-06-02T23:56:30.450 INFO:journalctl@ceph.mds.k.smithi057.stdout:Jun 02 23:56:30 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-k[65607]: starting mds.k at 2024-06-02T23:56:30.450 INFO:journalctl@ceph.mds.k.smithi057.stdout:Jun 02 23:56:30 smithi057 bash[65592]: 338578aa18a2e11746a7b656b2677c506496951ac9cd7ff7c65167dd7c9a99c5 2024-06-02T23:56:30.450 INFO:journalctl@ceph.mds.k.smithi057.stdout:Jun 02 23:56:30 smithi057 systemd[1]: Started Ceph mds.k for 890dd222-213a-11ef-bc9b-c7b262605968. 2024-06-02T23:56:30.589 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:56:31.262 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:31 smithi049 ceph-mon[32302]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:31.262 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:31 smithi049 ceph-mon[32302]: mds.? [v2:172.21.15.57:6832/1633534002,v1:172.21.15.57:6833/1633534002] up:boot 2024-06-02T23:56:31.263 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:31 smithi049 ceph-mon[32302]: fsmap 2 up:standby 2024-06-02T23:56:31.263 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:31 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-02T23:56:31.263 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:31 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:31.263 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:31 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:31.263 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:31 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:31.263 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:31 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:31.263 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:31 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:31.263 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:31 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:31.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:31 smithi107 ceph-mon[37048]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:31.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:31 smithi107 ceph-mon[37048]: mds.? [v2:172.21.15.57:6832/1633534002,v1:172.21.15.57:6833/1633534002] up:boot 2024-06-02T23:56:31.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:31 smithi107 ceph-mon[37048]: fsmap 2 up:standby 2024-06-02T23:56:31.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:31 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-02T23:56:31.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:31 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:31.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:31 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:31.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:31 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:31.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:31 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:31.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:31 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:31.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:31 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:31.417 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:31 smithi057 ceph-mon[36457]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:31.417 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:31 smithi057 ceph-mon[36457]: mds.? [v2:172.21.15.57:6832/1633534002,v1:172.21.15.57:6833/1633534002] up:boot 2024-06-02T23:56:31.417 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:31 smithi057 ceph-mon[36457]: fsmap 2 up:standby 2024-06-02T23:56:31.417 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:31 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-02T23:56:31.418 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:31 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:31.418 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:31 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:31.418 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:31 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:31.418 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:31 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:31.418 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:31 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:31.418 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:31 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:32.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.091+0000 7f0297a73700 1 -- 172.21.15.49:0/3679315353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f029006ac40 msgr2=0x7f029006b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:32.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.091+0000 7f0297a73700 1 --2- 172.21.15.49:0/3679315353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f029006ac40 0x7f029006b020 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f028000b0a0 tx=0x7f028000b3b0 comp rx=0 tx=0).stop 2024-06-02T23:56:32.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.091+0000 7f0297a73700 1 -- 172.21.15.49:0/3679315353 shutdown_connections 2024-06-02T23:56:32.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.091+0000 7f0297a73700 1 --2- 172.21.15.49:0/3679315353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029010eee0 0x7f02901112d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:32.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.091+0000 7f0297a73700 1 --2- 172.21.15.49:0/3679315353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f029006ac40 0x7f029006b020 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:32.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.091+0000 7f0297a73700 1 --2- 172.21.15.49:0/3679315353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f029006b560 0x7f029010e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:32.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.091+0000 7f0297a73700 1 -- 172.21.15.49:0/3679315353 >> 172.21.15.49:0/3679315353 conn(0x7f0290078430 msgr2=0x7f0290078840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:56:32.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.092+0000 7f0297a73700 1 -- 172.21.15.49:0/3679315353 shutdown_connections 2024-06-02T23:56:32.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.092+0000 7f0297a73700 1 -- 172.21.15.49:0/3679315353 wait complete. 2024-06-02T23:56:32.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.092+0000 7f0297a73700 1 Processor -- start 2024-06-02T23:56:32.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.092+0000 7f0297a73700 1 -- start start 2024-06-02T23:56:32.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.092+0000 7f0297a73700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f029006ac40 0x7f029019af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:32.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.092+0000 7f0297a73700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029006b560 0x7f029019b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:32.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.092+0000 7f0297a73700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f029010eee0 0x7f029019f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:32.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.092+0000 7f0297a73700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0290114ab0 con 0x7f029010eee0 2024-06-02T23:56:32.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.092+0000 7f0297a73700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0290114930 con 0x7f029006b560 2024-06-02T23:56:32.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.092+0000 7f0297a73700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0290114c30 con 0x7f029006ac40 2024-06-02T23:56:32.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.093+0000 7f0296010700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f029010eee0 0x7f029019f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:32.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.093+0000 7f029500e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029006b560 0x7f029019b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:32.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.093+0000 7f0296010700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f029010eee0 0x7f029019f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58478/0 (socket says 172.21.15.49:58478) 2024-06-02T23:56:32.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.093+0000 7f0296010700 1 -- 172.21.15.49:0/3159936641 learned_addr learned my addr 172.21.15.49:0/3159936641 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:56:32.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.093+0000 7f029580f700 1 --2- 172.21.15.49:0/3159936641 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f029006ac40 0x7f029019af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:32.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.093+0000 7f0296010700 1 -- 172.21.15.49:0/3159936641 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f029006ac40 msgr2=0x7f029019af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:32.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.093+0000 7f0296010700 1 --2- 172.21.15.49:0/3159936641 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f029006ac40 0x7f029019af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:32.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.093+0000 7f0296010700 1 -- 172.21.15.49:0/3159936641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029006b560 msgr2=0x7f029019b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:32.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.093+0000 7f0296010700 1 --2- 172.21.15.49:0/3159936641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029006b560 0x7f029019b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:32.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.093+0000 7f0296010700 1 -- 172.21.15.49:0/3159936641 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f029019ff70 con 0x7f029010eee0 2024-06-02T23:56:32.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.093+0000 7f0296010700 1 --2- 172.21.15.49:0/3159936641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f029010eee0 0x7f029019f830 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f028800d740 tx=0x7f028800da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:56:32.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.093+0000 7f028effd700 1 -- 172.21.15.49:0/3159936641 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0288014030 con 0x7f029010eee0 2024-06-02T23:56:32.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.093+0000 7f0297a73700 1 -- 172.21.15.49:0/3159936641 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02901a0260 con 0x7f029010eee0 2024-06-02T23:56:32.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.093+0000 7f028effd700 1 -- 172.21.15.49:0/3159936641 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0288004500 con 0x7f029010eee0 2024-06-02T23:56:32.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.093+0000 7f028effd700 1 -- 172.21.15.49:0/3159936641 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0288003950 con 0x7f029010eee0 2024-06-02T23:56:32.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.093+0000 7f0297a73700 1 -- 172.21.15.49:0/3159936641 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02901a7ae0 con 0x7f029010eee0 2024-06-02T23:56:32.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.094+0000 7f0297a73700 1 -- 172.21.15.49:0/3159936641 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0290069180 con 0x7f029010eee0 2024-06-02T23:56:32.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.096+0000 7f028effd700 1 -- 172.21.15.49:0/3159936641 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0288003af0 con 0x7f029010eee0 2024-06-02T23:56:32.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.096+0000 7f028effd700 1 --2- 172.21.15.49:0/3159936641 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f02780a2c20 0x7f02780a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:32.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.096+0000 7f029580f700 1 --2- 172.21.15.49:0/3159936641 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f02780a2c20 0x7f02780a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:32.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.096+0000 7f028effd700 1 -- 172.21.15.49:0/3159936641 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f02880ce8d0 con 0x7f029010eee0 2024-06-02T23:56:32.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.097+0000 7f029580f700 1 --2- 172.21.15.49:0/3159936641 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f02780a2c20 0x7f02780a50e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0280009fd0 tx=0x7f0280006210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:56:32.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.101+0000 7f028effd700 1 -- 172.21.15.49:0/3159936641 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f028809bcd0 con 0x7f029010eee0 2024-06-02T23:56:32.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:32 smithi049 ceph-mon[32302]: Deploying daemon mds.j on smithi049 2024-06-02T23:56:32.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:32 smithi107 ceph-mon[37048]: Deploying daemon mds.j on smithi049 2024-06-02T23:56:32.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.364+0000 7f0297a73700 1 -- 172.21.15.49:0/3159936641 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f029002dca0 con 0x7f029010eee0 2024-06-02T23:56:32.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.364+0000 7f028effd700 1 -- 172.21.15.49:0/3159936641 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2221 (secure 0 0 0) 0x7f028809b5d0 con 0x7f029010eee0 2024-06-02T23:56:32.364 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:56:32.364 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/1633534002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1633534002},{"type":"v1","addr":"172.21.15.57:6833","nonce":1633534002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-06-02T23:56:32.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.366+0000 7f0297a73700 1 -- 172.21.15.49:0/3159936641 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f02780a2c20 msgr2=0x7f02780a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:32.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.366+0000 7f0297a73700 1 --2- 172.21.15.49:0/3159936641 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f02780a2c20 0x7f02780a50e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0280009fd0 tx=0x7f0280006210 comp rx=0 tx=0).stop 2024-06-02T23:56:32.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.366+0000 7f0297a73700 1 -- 172.21.15.49:0/3159936641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f029010eee0 msgr2=0x7f029019f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:32.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.366+0000 7f0297a73700 1 --2- 172.21.15.49:0/3159936641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f029010eee0 0x7f029019f830 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f028800d740 tx=0x7f028800da50 comp rx=0 tx=0).stop 2024-06-02T23:56:32.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.366+0000 7f0297a73700 1 -- 172.21.15.49:0/3159936641 shutdown_connections 2024-06-02T23:56:32.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.366+0000 7f0297a73700 1 --2- 172.21.15.49:0/3159936641 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f02780a2c20 0x7f02780a50e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:32.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.366+0000 7f0297a73700 1 --2- 172.21.15.49:0/3159936641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f029010eee0 0x7f029019f830 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:32.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.366+0000 7f0297a73700 1 --2- 172.21.15.49:0/3159936641 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f029006ac40 0x7f029019af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:32.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.366+0000 7f0297a73700 1 --2- 172.21.15.49:0/3159936641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029006b560 0x7f029019b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:32.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.366+0000 7f0297a73700 1 -- 172.21.15.49:0/3159936641 >> 172.21.15.49:0/3159936641 conn(0x7f0290078430 msgr2=0x7f0290110310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:56:32.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.367+0000 7f0297a73700 1 -- 172.21.15.49:0/3159936641 shutdown_connections 2024-06-02T23:56:32.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:32.367+0000 7f0297a73700 1 -- 172.21.15.49:0/3159936641 wait complete. 2024-06-02T23:56:32.367 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 3 2024-06-02T23:56:32.382 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:32 smithi057 ceph-mon[36457]: Deploying daemon mds.j on smithi049 2024-06-02T23:56:33.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:33 smithi107 ceph-mon[37048]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:33.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:33 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/3159936641' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:56:33.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:33 smithi057 ceph-mon[36457]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:33.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:33 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/3159936641' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:56:33.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:33 smithi049 ceph-mon[32302]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:33.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:33 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3159936641' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:56:34.201 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:34 smithi049 ceph-mon[32302]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:34.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:34 smithi107 ceph-mon[37048]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:34.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:34 smithi057 ceph-mon[36457]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:34.461 INFO:journalctl@ceph.mds.j.smithi049.stdout:Jun 02 23:56:34 smithi049 systemd[1]: Starting Ceph mds.j for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-02T23:56:34.891 INFO:journalctl@ceph.mds.j.smithi049.stdout:Jun 02 23:56:34 smithi049 podman[70264]: 2024-06-02 23:56:34.509932142 +0000 UTC m=+0.017974236 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:56:34.891 INFO:journalctl@ceph.mds.j.smithi049.stdout:Jun 02 23:56:34 smithi049 podman[70264]: 2024-06-02 23:56:34.647541129 +0000 UTC m=+0.155583194 container create d6d1f578f6af536de0d53b0ba8b1e0598dbcd20c9addb7854003be2b18b69acb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-j, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-06-02T23:56:34.891 INFO:journalctl@ceph.mds.j.smithi049.stdout:Jun 02 23:56:34 smithi049 podman[70264]: 2024-06-02 23:56:34.891851316 +0000 UTC m=+0.399893393 container init d6d1f578f6af536de0d53b0ba8b1e0598dbcd20c9addb7854003be2b18b69acb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240528) 2024-06-02T23:56:35.095 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T23:56:35.211 INFO:journalctl@ceph.mds.j.smithi049.stdout:Jun 02 23:56:34 smithi049 podman[70264]: 2024-06-02 23:56:34.894977681 +0000 UTC m=+0.403019766 container start d6d1f578f6af536de0d53b0ba8b1e0598dbcd20c9addb7854003be2b18b69acb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-j, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-02T23:56:35.211 INFO:journalctl@ceph.mds.j.smithi049.stdout:Jun 02 23:56:34 smithi049 ceph-mds[70283]: -- 172.21.15.49:0/1058834056 <== mon.0 v2:172.21.15.49:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ff5b7cda40 con 0x55ff5b7a1000 2024-06-02T23:56:35.211 INFO:journalctl@ceph.mds.j.smithi049.stdout:Jun 02 23:56:34 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-j[70279]: starting mds.j at 2024-06-02T23:56:35.211 INFO:journalctl@ceph.mds.j.smithi049.stdout:Jun 02 23:56:34 smithi049 bash[70264]: d6d1f578f6af536de0d53b0ba8b1e0598dbcd20c9addb7854003be2b18b69acb 2024-06-02T23:56:35.211 INFO:journalctl@ceph.mds.j.smithi049.stdout:Jun 02 23:56:34 smithi049 systemd[1]: Started Ceph mds.j for 890dd222-213a-11ef-bc9b-c7b262605968. 2024-06-02T23:56:35.350 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:56:36.174 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:36 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:36.174 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:36 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:36.174 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:36 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:36.174 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:36 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:36.174 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:36 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:36.174 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:36 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:36.174 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:36 smithi049 ceph-mon[32302]: Deploying daemon mds.d on smithi049 2024-06-02T23:56:36.174 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:36 smithi049 ceph-mon[32302]: mds.? [v2:172.21.15.49:6834/1553264866,v1:172.21.15.49:6835/1553264866] up:boot 2024-06-02T23:56:36.174 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:36 smithi049 ceph-mon[32302]: fsmap 3 up:standby 2024-06-02T23:56:36.174 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:36 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-02T23:56:36.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:36 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:36.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:36 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:36.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:36 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:36.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:36 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:36.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:36 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:36.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:36 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:36.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:36 smithi107 ceph-mon[37048]: Deploying daemon mds.d on smithi049 2024-06-02T23:56:36.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:36 smithi107 ceph-mon[37048]: mds.? [v2:172.21.15.49:6834/1553264866,v1:172.21.15.49:6835/1553264866] up:boot 2024-06-02T23:56:36.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:36 smithi107 ceph-mon[37048]: fsmap 3 up:standby 2024-06-02T23:56:36.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:36 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-02T23:56:36.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:36 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:36.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:36 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:36.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:36 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:36.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:36 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:36.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:36 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:36.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:36 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:36.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:36 smithi057 ceph-mon[36457]: Deploying daemon mds.d on smithi049 2024-06-02T23:56:36.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:36 smithi057 ceph-mon[36457]: mds.? [v2:172.21.15.49:6834/1553264866,v1:172.21.15.49:6835/1553264866] up:boot 2024-06-02T23:56:36.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:36 smithi057 ceph-mon[36457]: fsmap 3 up:standby 2024-06-02T23:56:36.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:36 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-02T23:56:36.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.960+0000 7fa660b0c700 1 -- 172.21.15.49:0/1989671555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa65c102740 msgr2=0x7fa65c102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:36.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.960+0000 7fa660b0c700 1 --2- 172.21.15.49:0/1989671555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa65c102740 0x7fa65c102b20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa64c0099c0 tx=0x7fa64c009cd0 comp rx=0 tx=0).stop 2024-06-02T23:56:36.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.960+0000 7fa660b0c700 1 -- 172.21.15.49:0/1989671555 shutdown_connections 2024-06-02T23:56:36.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.960+0000 7fa660b0c700 1 --2- 172.21.15.49:0/1989671555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa65c107840 0x7fa65c10f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:36.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.960+0000 7fa660b0c700 1 --2- 172.21.15.49:0/1989671555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa65c102740 0x7fa65c102b20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:36.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.960+0000 7fa660b0c700 1 --2- 172.21.15.49:0/1989671555 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa65c1030f0 0x7fa65c107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:36.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.960+0000 7fa660b0c700 1 -- 172.21.15.49:0/1989671555 >> 172.21.15.49:0/1989671555 conn(0x7fa65c0795f0 msgr2=0x7fa65c079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:56:36.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.960+0000 7fa660b0c700 1 -- 172.21.15.49:0/1989671555 shutdown_connections 2024-06-02T23:56:36.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.960+0000 7fa660b0c700 1 -- 172.21.15.49:0/1989671555 wait complete. 2024-06-02T23:56:36.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.961+0000 7fa660b0c700 1 Processor -- start 2024-06-02T23:56:36.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.961+0000 7fa660b0c700 1 -- start start 2024-06-02T23:56:36.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.961+0000 7fa660b0c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa65c102740 0x7fa65c19e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:36.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.961+0000 7fa660b0c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa65c1030f0 0x7fa65c19ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:36.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.961+0000 7fa660b0c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa65c107840 0x7fa65c1989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:36.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.961+0000 7fa660b0c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa65c112760 con 0x7fa65c107840 2024-06-02T23:56:36.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.961+0000 7fa660b0c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa65c1125e0 con 0x7fa65c1030f0 2024-06-02T23:56:36.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.961+0000 7fa660b0c700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa65c1128e0 con 0x7fa65c102740 2024-06-02T23:56:36.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.961+0000 7fa65ad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa65c107840 0x7fa65c1989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:36.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.961+0000 7fa65ad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa65c107840 0x7fa65c1989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36792/0 (socket says 172.21.15.49:36792) 2024-06-02T23:56:36.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.961+0000 7fa65ad9d700 1 -- 172.21.15.49:0/142612742 learned_addr learned my addr 172.21.15.49:0/142612742 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:56:36.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.961+0000 7fa65a59c700 1 --2- 172.21.15.49:0/142612742 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa65c102740 0x7fa65c19e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:36.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.961+0000 7fa659d9b700 1 --2- 172.21.15.49:0/142612742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa65c1030f0 0x7fa65c19ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:36.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.962+0000 7fa65ad9d700 1 -- 172.21.15.49:0/142612742 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa65c102740 msgr2=0x7fa65c19e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:36.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.962+0000 7fa65ad9d700 1 --2- 172.21.15.49:0/142612742 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa65c102740 0x7fa65c19e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:36.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.962+0000 7fa65ad9d700 1 -- 172.21.15.49:0/142612742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa65c1030f0 msgr2=0x7fa65c19ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:36.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.962+0000 7fa65ad9d700 1 --2- 172.21.15.49:0/142612742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa65c1030f0 0x7fa65c19ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:36.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.962+0000 7fa65ad9d700 1 -- 172.21.15.49:0/142612742 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa65c199140 con 0x7fa65c107840 2024-06-02T23:56:36.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.962+0000 7fa65ad9d700 1 --2- 172.21.15.49:0/142612742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa65c107840 0x7fa65c1989e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa654007ee0 tx=0x7fa65400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:56:36.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.962+0000 7fa6537fe700 1 -- 172.21.15.49:0/142612742 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa654004bb0 con 0x7fa65c107840 2024-06-02T23:56:36.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.962+0000 7fa6537fe700 1 -- 172.21.15.49:0/142612742 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa654004d50 con 0x7fa65c107840 2024-06-02T23:56:36.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.962+0000 7fa660b0c700 1 -- 172.21.15.49:0/142612742 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa65c199430 con 0x7fa65c107840 2024-06-02T23:56:36.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.962+0000 7fa6537fe700 1 -- 172.21.15.49:0/142612742 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa654005960 con 0x7fa65c107840 2024-06-02T23:56:36.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.962+0000 7fa660b0c700 1 -- 172.21.15.49:0/142612742 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa65c1a56f0 con 0x7fa65c107840 2024-06-02T23:56:36.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.963+0000 7fa660b0c700 1 -- 172.21.15.49:0/142612742 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa65c10aa80 con 0x7fa65c107840 2024-06-02T23:56:36.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.964+0000 7fa6537fe700 1 -- 172.21.15.49:0/142612742 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa65401a020 con 0x7fa65c107840 2024-06-02T23:56:36.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.965+0000 7fa6537fe700 1 --2- 172.21.15.49:0/142612742 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa6480a2ca0 0x7fa6480a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:36.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.965+0000 7fa65a59c700 1 --2- 172.21.15.49:0/142612742 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa6480a2ca0 0x7fa6480a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:36.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.965+0000 7fa6537fe700 1 -- 172.21.15.49:0/142612742 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fa6540ce2c0 con 0x7fa65c107840 2024-06-02T23:56:36.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.965+0000 7fa65a59c700 1 --2- 172.21.15.49:0/142612742 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa6480a2ca0 0x7fa6480a5160 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa64c000c00 tx=0x7fa64c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:56:36.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:36.969+0000 7fa6537fe700 1 -- 172.21.15.49:0/142612742 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa654010070 con 0x7fa65c107840 2024-06-02T23:56:37.026 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:37 smithi049 ceph-mon[32302]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:37.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:37.228+0000 7fa660b0c700 1 -- 172.21.15.49:0/142612742 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa65c199f10 con 0x7fa65c107840 2024-06-02T23:56:37.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:37.229+0000 7fa6537fe700 1 -- 172.21.15.49:0/142612742 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3046 (secure 0 0 0) 0x7fa65409b6c0 con 0x7fa65c107840 2024-06-02T23:56:37.229 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:56:37.229 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1553264866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1553264866},{"type":"v1","addr":"172.21.15.49:6835","nonce":1553264866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/1633534002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1633534002},{"type":"v1","addr":"172.21.15.57:6833","nonce":1633534002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-06-02T23:56:37.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:37.231+0000 7fa660b0c700 1 -- 172.21.15.49:0/142612742 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa6480a2ca0 msgr2=0x7fa6480a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:37.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:37.231+0000 7fa660b0c700 1 --2- 172.21.15.49:0/142612742 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa6480a2ca0 0x7fa6480a5160 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa64c000c00 tx=0x7fa64c005fb0 comp rx=0 tx=0).stop 2024-06-02T23:56:37.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:37.231+0000 7fa660b0c700 1 -- 172.21.15.49:0/142612742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa65c107840 msgr2=0x7fa65c1989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:37.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:37.231+0000 7fa660b0c700 1 --2- 172.21.15.49:0/142612742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa65c107840 0x7fa65c1989e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa654007ee0 tx=0x7fa65400d3b0 comp rx=0 tx=0).stop 2024-06-02T23:56:37.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:37.231+0000 7fa660b0c700 1 -- 172.21.15.49:0/142612742 shutdown_connections 2024-06-02T23:56:37.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:37.231+0000 7fa660b0c700 1 --2- 172.21.15.49:0/142612742 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa6480a2ca0 0x7fa6480a5160 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:37.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:37.231+0000 7fa660b0c700 1 --2- 172.21.15.49:0/142612742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa65c107840 0x7fa65c1989e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:37.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:37.231+0000 7fa660b0c700 1 --2- 172.21.15.49:0/142612742 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa65c102740 0x7fa65c19e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:37.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:37.231+0000 7fa660b0c700 1 --2- 172.21.15.49:0/142612742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa65c1030f0 0x7fa65c19ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:37.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:37.231+0000 7fa660b0c700 1 -- 172.21.15.49:0/142612742 >> 172.21.15.49:0/142612742 conn(0x7fa65c0795f0 msgr2=0x7fa65c108990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:56:37.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:37.231+0000 7fa660b0c700 1 -- 172.21.15.49:0/142612742 shutdown_connections 2024-06-02T23:56:37.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:37.231+0000 7fa660b0c700 1 -- 172.21.15.49:0/142612742 wait complete. 2024-06-02T23:56:37.232 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 4 2024-06-02T23:56:37.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:37 smithi107 ceph-mon[37048]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:37.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:37 smithi057 ceph-mon[36457]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:38.291 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:38 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/142612742' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:56:38.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:38 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/142612742' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:56:38.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:38 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/142612742' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:56:38.632 INFO:journalctl@ceph.mds.d.smithi049.stdout:Jun 02 23:56:38 smithi049 systemd[1]: Starting Ceph mds.d for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-02T23:56:38.890 INFO:journalctl@ceph.mds.d.smithi049.stdout:Jun 02 23:56:38 smithi049 podman[70735]: 2024-06-02 23:56:38.809215496 +0000 UTC m=+0.089374240 container create f2a6c972aeab8f66d73a2655574b32bca528fbed9f6d3f945e754dc822dcf4e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-d, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-06-02T23:56:38.890 INFO:journalctl@ceph.mds.d.smithi049.stdout:Jun 02 23:56:38 smithi049 podman[70735]: 2024-06-02 23:56:38.737739146 +0000 UTC m=+0.017897884 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:56:39.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:39 smithi107 ceph-mon[37048]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:39.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:39 smithi057 ceph-mon[36457]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:39.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:39 smithi049 ceph-mon[32302]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:39.461 INFO:journalctl@ceph.mds.d.smithi049.stdout:Jun 02 23:56:38 smithi049 podman[70735]: 2024-06-02 23:56:38.986948909 +0000 UTC m=+0.267107641 container init f2a6c972aeab8f66d73a2655574b32bca528fbed9f6d3f945e754dc822dcf4e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-06-02T23:56:39.461 INFO:journalctl@ceph.mds.d.smithi049.stdout:Jun 02 23:56:38 smithi049 podman[70735]: 2024-06-02 23:56:38.990049628 +0000 UTC m=+0.270208358 container start f2a6c972aeab8f66d73a2655574b32bca528fbed9f6d3f945e754dc822dcf4e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-d, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-3d89acc) 2024-06-02T23:56:39.461 INFO:journalctl@ceph.mds.d.smithi049.stdout:Jun 02 23:56:39 smithi049 ceph-mds[70754]: -- 172.21.15.49:0/1709071937 <== mon.0 v2:172.21.15.49:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5593aa74da40 con 0x5593aa720c00 2024-06-02T23:56:39.462 INFO:journalctl@ceph.mds.d.smithi049.stdout:Jun 02 23:56:39 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-d[70750]: starting mds.d at 2024-06-02T23:56:39.462 INFO:journalctl@ceph.mds.d.smithi049.stdout:Jun 02 23:56:39 smithi049 bash[70735]: f2a6c972aeab8f66d73a2655574b32bca528fbed9f6d3f945e754dc822dcf4e6 2024-06-02T23:56:39.462 INFO:journalctl@ceph.mds.d.smithi049.stdout:Jun 02 23:56:39 smithi049 systemd[1]: Started Ceph mds.d for 890dd222-213a-11ef-bc9b-c7b262605968. 2024-06-02T23:56:40.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:40 smithi057 ceph-mon[36457]: mds.? [v2:172.21.15.49:6836/2266285252,v1:172.21.15.49:6837/2266285252] up:boot 2024-06-02T23:56:40.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:40 smithi057 ceph-mon[36457]: fsmap 4 up:standby 2024-06-02T23:56:40.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:40 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-02T23:56:40.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:40 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:40.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:40 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:40.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:40 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:40.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:40 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:40.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:40 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:40.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:40 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:40.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:40 smithi107 ceph-mon[37048]: mds.? [v2:172.21.15.49:6836/2266285252,v1:172.21.15.49:6837/2266285252] up:boot 2024-06-02T23:56:40.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:40 smithi107 ceph-mon[37048]: fsmap 4 up:standby 2024-06-02T23:56:40.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-02T23:56:40.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:40.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:40.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:40.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:40.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:40.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:40.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:40 smithi049 ceph-mon[32302]: mds.? [v2:172.21.15.49:6836/2266285252,v1:172.21.15.49:6837/2266285252] up:boot 2024-06-02T23:56:40.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:40 smithi049 ceph-mon[32302]: fsmap 4 up:standby 2024-06-02T23:56:40.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:40 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-02T23:56:40.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:40 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:40.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:40 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:40.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:40 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:40.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:40 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:40.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:40 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:40.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:40 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:40.663 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T23:56:40.929 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:56:41.105 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:41 smithi057 ceph-mon[36457]: Deploying daemon mds.e on smithi057 2024-06-02T23:56:41.105 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:41 smithi057 ceph-mon[36457]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:41.305 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:41 smithi049 ceph-mon[32302]: Deploying daemon mds.e on smithi057 2024-06-02T23:56:41.305 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:41 smithi049 ceph-mon[32302]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:41.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:41 smithi107 ceph-mon[37048]: Deploying daemon mds.e on smithi057 2024-06-02T23:56:41.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:41 smithi107 ceph-mon[37048]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:42.200 INFO:journalctl@ceph.mds.e.smithi057.stdout:Jun 02 23:56:42 smithi057 systemd[1]: Started Ceph mds.e for 890dd222-213a-11ef-bc9b-c7b262605968. 2024-06-02T23:56:42.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.686+0000 7f8d6c1d9700 1 -- 172.21.15.49:0/418225770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d6406b580 msgr2=0x7f8d6410f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:42.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.686+0000 7f8d6c1d9700 1 --2- 172.21.15.49:0/418225770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d6406b580 0x7f8d6410f370 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c00b0d0 tx=0x7f8d5c00b3e0 comp rx=0 tx=0).stop 2024-06-02T23:56:42.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.686+0000 7f8d6c1d9700 1 -- 172.21.15.49:0/418225770 shutdown_connections 2024-06-02T23:56:42.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.686+0000 7f8d6c1d9700 1 --2- 172.21.15.49:0/418225770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d6406b580 0x7f8d6410f370 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:42.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.686+0000 7f8d6c1d9700 1 --2- 172.21.15.49:0/418225770 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d641085a0 0x7f8d64108980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:42.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.686+0000 7f8d6c1d9700 1 --2- 172.21.15.49:0/418225770 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d6406abc0 0x7f8d6406b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:42.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.686+0000 7f8d6c1d9700 1 -- 172.21.15.49:0/418225770 >> 172.21.15.49:0/418225770 conn(0x7f8d64077200 msgr2=0x7f8d64077610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:56:42.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.686+0000 7f8d6c1d9700 1 -- 172.21.15.49:0/418225770 shutdown_connections 2024-06-02T23:56:42.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.686+0000 7f8d6c1d9700 1 -- 172.21.15.49:0/418225770 wait complete. 2024-06-02T23:56:42.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.686+0000 7f8d6c1d9700 1 Processor -- start 2024-06-02T23:56:42.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.687+0000 7f8d6c1d9700 1 -- start start 2024-06-02T23:56:42.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.687+0000 7f8d6c1d9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d6406abc0 0x7f8d6419ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:42.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.687+0000 7f8d6c1d9700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d6406b580 0x7f8d6419b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:42.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.687+0000 7f8d6c1d9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d641085a0 0x7f8d6419f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:42.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.687+0000 7f8d6c1d9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8d641127e0 con 0x7f8d641085a0 2024-06-02T23:56:42.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.687+0000 7f8d6c1d9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8d64112660 con 0x7f8d6406abc0 2024-06-02T23:56:42.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.687+0000 7f8d6c1d9700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8d64112960 con 0x7f8d6406b580 2024-06-02T23:56:42.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.687+0000 7f8d6a776700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d641085a0 0x7f8d6419f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:42.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.687+0000 7f8d6a776700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d641085a0 0x7f8d6419f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36816/0 (socket says 172.21.15.49:36816) 2024-06-02T23:56:42.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.687+0000 7f8d6a776700 1 -- 172.21.15.49:0/766729039 learned_addr learned my addr 172.21.15.49:0/766729039 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:56:42.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.687+0000 7f8d69774700 1 --2- 172.21.15.49:0/766729039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d6406b580 0x7f8d6419b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:42.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.687+0000 7f8d69f75700 1 --2- 172.21.15.49:0/766729039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d6406abc0 0x7f8d6419ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:42.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.687+0000 7f8d6a776700 1 -- 172.21.15.49:0/766729039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d6406b580 msgr2=0x7f8d6419b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:42.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.687+0000 7f8d6a776700 1 --2- 172.21.15.49:0/766729039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d6406b580 0x7f8d6419b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:42.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.687+0000 7f8d6a776700 1 -- 172.21.15.49:0/766729039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d6406abc0 msgr2=0x7f8d6419ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:42.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.687+0000 7f8d6a776700 1 --2- 172.21.15.49:0/766729039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d6406abc0 0x7f8d6419ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:42.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.687+0000 7f8d6a776700 1 -- 172.21.15.49:0/766729039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6419fdb0 con 0x7f8d641085a0 2024-06-02T23:56:42.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.688+0000 7f8d6a776700 1 --2- 172.21.15.49:0/766729039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d641085a0 0x7f8d6419f670 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c006070 tx=0x7f8d5c004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:56:42.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.688+0000 7f8d56ffd700 1 -- 172.21.15.49:0/766729039 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c021070 con 0x7f8d641085a0 2024-06-02T23:56:42.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.688+0000 7f8d56ffd700 1 -- 172.21.15.49:0/766729039 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d5c007b80 con 0x7f8d641085a0 2024-06-02T23:56:42.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.688+0000 7f8d6c1d9700 1 -- 172.21.15.49:0/766729039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d641a0040 con 0x7f8d641085a0 2024-06-02T23:56:42.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.688+0000 7f8d56ffd700 1 -- 172.21.15.49:0/766729039 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c0052a0 con 0x7f8d641085a0 2024-06-02T23:56:42.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.688+0000 7f8d6c1d9700 1 -- 172.21.15.49:0/766729039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d641a7920 con 0x7f8d641085a0 2024-06-02T23:56:42.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.689+0000 7f8d6c1d9700 1 -- 172.21.15.49:0/766729039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d64103bf0 con 0x7f8d641085a0 2024-06-02T23:56:42.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.690+0000 7f8d56ffd700 1 -- 172.21.15.49:0/766729039 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8d5c024070 con 0x7f8d641085a0 2024-06-02T23:56:42.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.691+0000 7f8d56ffd700 1 --2- 172.21.15.49:0/766729039 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8d500a2ca0 0x7f8d500a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:42.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.691+0000 7f8d69f75700 1 --2- 172.21.15.49:0/766729039 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8d500a2ca0 0x7f8d500a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:42.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.691+0000 7f8d56ffd700 1 -- 172.21.15.49:0/766729039 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f8d5c00f020 con 0x7f8d641085a0 2024-06-02T23:56:42.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.692+0000 7f8d69f75700 1 --2- 172.21.15.49:0/766729039 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8d500a2ca0 0x7f8d500a5160 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8d58005950 tx=0x7f8d5800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:56:42.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.696+0000 7f8d56ffd700 1 -- 172.21.15.49:0/766729039 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8d5c02b020 con 0x7f8d641085a0 2024-06-02T23:56:42.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.946+0000 7f8d6c1d9700 1 -- 172.21.15.49:0/766729039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d6419c100 con 0x7f8d641085a0 2024-06-02T23:56:42.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.946+0000 7f8d56ffd700 1 -- 172.21.15.49:0/766729039 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4696 (secure 0 0 0) 0x7f8d5c09d540 con 0x7f8d641085a0 2024-06-02T23:56:42.946 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:56:42.946 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1553264866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1553264866},{"type":"v1","addr":"172.21.15.49:6835","nonce":1553264866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2266285252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2266285252},{"type":"v1","addr":"172.21.15.49:6837","nonce":2266285252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/1633534002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1633534002},{"type":"v1","addr":"172.21.15.57:6833","nonce":1633534002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2254905671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2254905671},{"type":"v1","addr":"172.21.15.57:6835","nonce":2254905671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-06-02T23:56:42.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.948+0000 7f8d6c1d9700 1 -- 172.21.15.49:0/766729039 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8d500a2ca0 msgr2=0x7f8d500a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:42.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.948+0000 7f8d6c1d9700 1 --2- 172.21.15.49:0/766729039 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8d500a2ca0 0x7f8d500a5160 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8d58005950 tx=0x7f8d5800b410 comp rx=0 tx=0).stop 2024-06-02T23:56:42.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.949+0000 7f8d6c1d9700 1 -- 172.21.15.49:0/766729039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d641085a0 msgr2=0x7f8d6419f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:42.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.949+0000 7f8d6c1d9700 1 --2- 172.21.15.49:0/766729039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d641085a0 0x7f8d6419f670 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c006070 tx=0x7f8d5c004d00 comp rx=0 tx=0).stop 2024-06-02T23:56:42.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.949+0000 7f8d6c1d9700 1 -- 172.21.15.49:0/766729039 shutdown_connections 2024-06-02T23:56:42.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.949+0000 7f8d6c1d9700 1 --2- 172.21.15.49:0/766729039 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8d500a2ca0 0x7f8d500a5160 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:42.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.949+0000 7f8d6c1d9700 1 --2- 172.21.15.49:0/766729039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d641085a0 0x7f8d6419f670 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:42.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.949+0000 7f8d6c1d9700 1 --2- 172.21.15.49:0/766729039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d6406abc0 0x7f8d6419ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:42.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.949+0000 7f8d6c1d9700 1 --2- 172.21.15.49:0/766729039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d6406b580 0x7f8d6419b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:42.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.949+0000 7f8d6c1d9700 1 -- 172.21.15.49:0/766729039 >> 172.21.15.49:0/766729039 conn(0x7f8d64077200 msgr2=0x7f8d6410d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:56:42.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.949+0000 7f8d6c1d9700 1 -- 172.21.15.49:0/766729039 shutdown_connections 2024-06-02T23:56:42.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:42.949+0000 7f8d6c1d9700 1 -- 172.21.15.49:0/766729039 wait complete. 2024-06-02T23:56:42.949 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 6 2024-06-02T23:56:43.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:43 smithi049 ceph-mon[32302]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:43.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:43 smithi049 ceph-mon[32302]: mds.? [v2:172.21.15.57:6834/2254905671,v1:172.21.15.57:6835/2254905671] up:boot 2024-06-02T23:56:43.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:43 smithi049 ceph-mon[32302]: fsmap 5 up:standby 2024-06-02T23:56:43.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:43 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-02T23:56:43.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:43 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:43.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:43 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:43.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:43 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:43.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:43 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:43.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:43 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:43.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:43 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:43.212 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:43 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/766729039' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:56:43.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:43 smithi107 ceph-mon[37048]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:43.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:43 smithi107 ceph-mon[37048]: mds.? [v2:172.21.15.57:6834/2254905671,v1:172.21.15.57:6835/2254905671] up:boot 2024-06-02T23:56:43.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:43 smithi107 ceph-mon[37048]: fsmap 5 up:standby 2024-06-02T23:56:43.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:43 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-02T23:56:43.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:43 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:43.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:43 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:43.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:43 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:43.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:43 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:43.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:43 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:43.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:43 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:43.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:43 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/766729039' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:56:43.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:43 smithi057 ceph-mon[36457]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:43.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:43 smithi057 ceph-mon[36457]: mds.? [v2:172.21.15.57:6834/2254905671,v1:172.21.15.57:6835/2254905671] up:boot 2024-06-02T23:56:43.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:43 smithi057 ceph-mon[36457]: fsmap 5 up:standby 2024-06-02T23:56:43.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:43 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-02T23:56:43.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:43 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:43.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:43 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:43.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:43 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:43.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:43 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:43.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:43 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:43.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:43 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:43.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:43 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/766729039' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:56:44.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:44 smithi107 ceph-mon[37048]: Deploying daemon mds.f on smithi107 2024-06-02T23:56:44.351 INFO:journalctl@ceph.mds.f.smithi107.stdout:Jun 02 23:56:44 smithi107 systemd[1]: Starting Ceph mds.f for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-02T23:56:44.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:44 smithi057 ceph-mon[36457]: Deploying daemon mds.f on smithi107 2024-06-02T23:56:44.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:44 smithi049 ceph-mon[32302]: Deploying daemon mds.f on smithi107 2024-06-02T23:56:44.629 INFO:journalctl@ceph.mds.f.smithi107.stdout:Jun 02 23:56:44 smithi107 podman[67487]: 2024-06-02 23:56:44.280787363 +0000 UTC m=+0.017167459 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:56:44.629 INFO:journalctl@ceph.mds.f.smithi107.stdout:Jun 02 23:56:44 smithi107 podman[67487]: 2024-06-02 23:56:44.391818543 +0000 UTC m=+0.128198668 container create 0faeb1d20c2f69552ffe3de10a8c6452b077b48a081f35623d7b580f82f84f3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-f, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-06-02T23:56:44.629 INFO:journalctl@ceph.mds.f.smithi107.stdout:Jun 02 23:56:44 smithi107 podman[67487]: 2024-06-02 23:56:44.627405502 +0000 UTC m=+0.363785581 container init 0faeb1d20c2f69552ffe3de10a8c6452b077b48a081f35623d7b580f82f84f3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.build-date=20240528, ceph=True) 2024-06-02T23:56:44.629 INFO:journalctl@ceph.mds.f.smithi107.stdout:Jun 02 23:56:44 smithi107 podman[67487]: 2024-06-02 23:56:44.630024687 +0000 UTC m=+0.366404769 container start 0faeb1d20c2f69552ffe3de10a8c6452b077b48a081f35623d7b580f82f84f3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-f, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T23:56:45.055 INFO:journalctl@ceph.mds.f.smithi107.stdout:Jun 02 23:56:44 smithi107 ceph-mds[67507]: -- 172.21.15.107:0/4264888878 <== mon.1 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556646591a40 con 0x556646564c00 2024-06-02T23:56:45.055 INFO:journalctl@ceph.mds.f.smithi107.stdout:Jun 02 23:56:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-f[67503]: starting mds.f at 2024-06-02T23:56:45.055 INFO:journalctl@ceph.mds.f.smithi107.stdout:Jun 02 23:56:44 smithi107 bash[67487]: 0faeb1d20c2f69552ffe3de10a8c6452b077b48a081f35623d7b580f82f84f3f 2024-06-02T23:56:45.055 INFO:journalctl@ceph.mds.f.smithi107.stdout:Jun 02 23:56:44 smithi107 systemd[1]: Started Ceph mds.f for 890dd222-213a-11ef-bc9b-c7b262605968. 2024-06-02T23:56:45.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:45 smithi107 ceph-mon[37048]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:45.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:45 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:45.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:45 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:45.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:45 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:45.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:45 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:45.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:45 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:45.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:45 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:45.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:45 smithi057 ceph-mon[36457]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:45.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:45 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:45.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:45 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:45.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:45 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:45.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:45 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:45.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:45 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:45.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:45 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:45.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:45 smithi049 ceph-mon[32302]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:45.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:45 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:45.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:45 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:45.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:45 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:45.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:45 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:45.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:45 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:45.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:45 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:45.624 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T23:56:45.887 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:56:46.311 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:46 smithi049 ceph-mon[32302]: Deploying daemon mds.c on smithi107 2024-06-02T23:56:46.311 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:46 smithi049 ceph-mon[32302]: mds.? [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] up:boot 2024-06-02T23:56:46.311 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:46 smithi049 ceph-mon[32302]: fsmap 6 up:standby 2024-06-02T23:56:46.311 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:46 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-02T23:56:46.341 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:46 smithi057 ceph-mon[36457]: Deploying daemon mds.c on smithi107 2024-06-02T23:56:46.341 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:46 smithi057 ceph-mon[36457]: mds.? [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] up:boot 2024-06-02T23:56:46.341 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:46 smithi057 ceph-mon[36457]: fsmap 6 up:standby 2024-06-02T23:56:46.341 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:46 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-02T23:56:46.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:46 smithi107 ceph-mon[37048]: Deploying daemon mds.c on smithi107 2024-06-02T23:56:46.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:46 smithi107 ceph-mon[37048]: mds.? [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] up:boot 2024-06-02T23:56:46.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:46 smithi107 ceph-mon[37048]: fsmap 6 up:standby 2024-06-02T23:56:46.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:46 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-02T23:56:47.049 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 02 23:56:46 smithi107 systemd[1]: Starting Ceph mds.c for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-02T23:56:47.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:47 smithi049 ceph-mon[32302]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:47.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:47 smithi107 ceph-mon[37048]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:47.351 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 02 23:56:47 smithi107 podman[67790]: 2024-06-02 23:56:46.952426615 +0000 UTC m=+0.016920598 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:56:47.351 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 02 23:56:47 smithi107 podman[67790]: 2024-06-02 23:56:47.052001107 +0000 UTC m=+0.116495077 container create abe418febea0607dfba402a1cce2f69b508407ada57863282f8eb2eea9600b6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240528) 2024-06-02T23:56:47.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.447+0000 7fa3dd611700 1 -- 172.21.15.49:0/3048771371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d81084f0 msgr2=0x7fa3d81088d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:47.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.447+0000 7fa3dd611700 1 --2- 172.21.15.49:0/3048771371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d81084f0 0x7fa3d81088d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8009990 tx=0x7fa3c8009ca0 comp rx=0 tx=0).stop 2024-06-02T23:56:47.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.448+0000 7fa3dd611700 1 -- 172.21.15.49:0/3048771371 shutdown_connections 2024-06-02T23:56:47.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.448+0000 7fa3dd611700 1 --2- 172.21.15.49:0/3048771371 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3d8102f10 0x7fa3d810f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:47.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.448+0000 7fa3dd611700 1 --2- 172.21.15.49:0/3048771371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d81084f0 0x7fa3d81088d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:47.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.448+0000 7fa3dd611700 1 --2- 172.21.15.49:0/3048771371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3d8102550 0x7fa3d81029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:47.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.448+0000 7fa3dd611700 1 -- 172.21.15.49:0/3048771371 >> 172.21.15.49:0/3048771371 conn(0x7fa3d8079650 msgr2=0x7fa3d8079a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:56:47.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.448+0000 7fa3dd611700 1 -- 172.21.15.49:0/3048771371 shutdown_connections 2024-06-02T23:56:47.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.448+0000 7fa3dd611700 1 -- 172.21.15.49:0/3048771371 wait complete. 2024-06-02T23:56:47.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.448+0000 7fa3dd611700 1 Processor -- start 2024-06-02T23:56:47.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.448+0000 7fa3dd611700 1 -- start start 2024-06-02T23:56:47.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.449+0000 7fa3dd611700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d8102550 0x7fa3d819e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:47.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.449+0000 7fa3dd611700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3d8102f10 0x7fa3d819ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:47.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.449+0000 7fa3dd611700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3d81084f0 0x7fa3d8198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:47.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.449+0000 7fa3dd611700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d8112770 con 0x7fa3d8102550 2024-06-02T23:56:47.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.449+0000 7fa3dd611700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d81125f0 con 0x7fa3d81084f0 2024-06-02T23:56:47.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.449+0000 7fa3dd611700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d81128f0 con 0x7fa3d8102f10 2024-06-02T23:56:47.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.449+0000 7fa3d6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d8102550 0x7fa3d819e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:47.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.449+0000 7fa3d6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d8102550 0x7fa3d819e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38022/0 (socket says 172.21.15.49:38022) 2024-06-02T23:56:47.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.449+0000 7fa3d6ffd700 1 -- 172.21.15.49:0/791859812 learned_addr learned my addr 172.21.15.49:0/791859812 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:56:47.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.449+0000 7fa3d67fc700 1 --2- 172.21.15.49:0/791859812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3d8102f10 0x7fa3d819ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:47.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.449+0000 7fa3d77fe700 1 --2- 172.21.15.49:0/791859812 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3d81084f0 0x7fa3d8198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:47.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.449+0000 7fa3d67fc700 1 -- 172.21.15.49:0/791859812 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3d81084f0 msgr2=0x7fa3d8198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:47.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.449+0000 7fa3d67fc700 1 --2- 172.21.15.49:0/791859812 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3d81084f0 0x7fa3d8198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:47.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.449+0000 7fa3d67fc700 1 -- 172.21.15.49:0/791859812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d8102550 msgr2=0x7fa3d819e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:47.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.449+0000 7fa3d67fc700 1 --2- 172.21.15.49:0/791859812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d8102550 0x7fa3d819e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:47.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.449+0000 7fa3d67fc700 1 -- 172.21.15.49:0/791859812 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d8199170 con 0x7fa3d8102f10 2024-06-02T23:56:47.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.449+0000 7fa3d6ffd700 1 --2- 172.21.15.49:0/791859812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d8102550 0x7fa3d819e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:56:47.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.449+0000 7fa3d77fe700 1 --2- 172.21.15.49:0/791859812 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3d81084f0 0x7fa3d8198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:56:47.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.449+0000 7fa3d67fc700 1 --2- 172.21.15.49:0/791859812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3d8102f10 0x7fa3d819ed40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc00e9f0 tx=0x7fa3cc00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:56:47.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.450+0000 7fa3bffff700 1 -- 172.21.15.49:0/791859812 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc00cbd0 con 0x7fa3d8102f10 2024-06-02T23:56:47.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.450+0000 7fa3bffff700 1 -- 172.21.15.49:0/791859812 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3cc004500 con 0x7fa3d8102f10 2024-06-02T23:56:47.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.450+0000 7fa3bffff700 1 -- 172.21.15.49:0/791859812 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc005280 con 0x7fa3d8102f10 2024-06-02T23:56:47.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.450+0000 7fa3dd611700 1 -- 172.21.15.49:0/791859812 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3d8199460 con 0x7fa3d8102f10 2024-06-02T23:56:47.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.450+0000 7fa3dd611700 1 -- 172.21.15.49:0/791859812 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3d81a56d0 con 0x7fa3d8102f10 2024-06-02T23:56:47.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.450+0000 7fa3dd611700 1 -- 172.21.15.49:0/791859812 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3d810a9f0 con 0x7fa3d8102f10 2024-06-02T23:56:47.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:47 smithi057 ceph-mon[36457]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:47.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.452+0000 7fa3bffff700 1 -- 172.21.15.49:0/791859812 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa3cc005420 con 0x7fa3d8102f10 2024-06-02T23:56:47.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.452+0000 7fa3bffff700 1 --2- 172.21.15.49:0/791859812 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa3c00a2ca0 0x7fa3c00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:47.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.453+0000 7fa3d6ffd700 1 --2- 172.21.15.49:0/791859812 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa3c00a2ca0 0x7fa3c00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:47.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.453+0000 7fa3bffff700 1 -- 172.21.15.49:0/791859812 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fa3cc0cec00 con 0x7fa3d8102f10 2024-06-02T23:56:47.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.453+0000 7fa3d6ffd700 1 --2- 172.21.15.49:0/791859812 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa3c00a2ca0 0x7fa3c00a5160 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8009750 tx=0x7fa3c8005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:56:47.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.456+0000 7fa3bffff700 1 -- 172.21.15.49:0/791859812 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa3cc09bff0 con 0x7fa3d8102f10 2024-06-02T23:56:47.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.710+0000 7fa3dd611700 1 -- 172.21.15.49:0/791859812 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3d8103ba0 con 0x7fa3d8102f10 2024-06-02T23:56:47.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.711+0000 7fa3bffff700 1 -- 172.21.15.49:0/791859812 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5524 (secure 0 0 0) 0x7fa3cc01fe10 con 0x7fa3d8102f10 2024-06-02T23:56:47.712 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:56:47.712 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1553264866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1553264866},{"type":"v1","addr":"172.21.15.49:6835","nonce":1553264866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2266285252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2266285252},{"type":"v1","addr":"172.21.15.49:6837","nonce":2266285252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/1633534002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1633534002},{"type":"v1","addr":"172.21.15.57:6833","nonce":1633534002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2254905671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2254905671},{"type":"v1","addr":"172.21.15.57:6835","nonce":2254905671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3693542801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3693542801},{"type":"v1","addr":"172.21.15.107:6835","nonce":3693542801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-06-02T23:56:47.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.713+0000 7fa3dd611700 1 -- 172.21.15.49:0/791859812 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa3c00a2ca0 msgr2=0x7fa3c00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:47.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.713+0000 7fa3dd611700 1 --2- 172.21.15.49:0/791859812 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa3c00a2ca0 0x7fa3c00a5160 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8009750 tx=0x7fa3c8005e80 comp rx=0 tx=0).stop 2024-06-02T23:56:47.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.713+0000 7fa3dd611700 1 -- 172.21.15.49:0/791859812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3d8102f10 msgr2=0x7fa3d819ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:47.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.713+0000 7fa3dd611700 1 --2- 172.21.15.49:0/791859812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3d8102f10 0x7fa3d819ed40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc00e9f0 tx=0x7fa3cc00ed00 comp rx=0 tx=0).stop 2024-06-02T23:56:47.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.713+0000 7fa3dd611700 1 -- 172.21.15.49:0/791859812 shutdown_connections 2024-06-02T23:56:47.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.713+0000 7fa3dd611700 1 --2- 172.21.15.49:0/791859812 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa3c00a2ca0 0x7fa3c00a5160 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:47.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.713+0000 7fa3dd611700 1 --2- 172.21.15.49:0/791859812 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3d81084f0 0x7fa3d8198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:47.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.713+0000 7fa3dd611700 1 --2- 172.21.15.49:0/791859812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3d8102550 0x7fa3d819e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:47.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.713+0000 7fa3dd611700 1 --2- 172.21.15.49:0/791859812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3d8102f10 0x7fa3d819ed40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:47.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.713+0000 7fa3dd611700 1 -- 172.21.15.49:0/791859812 >> 172.21.15.49:0/791859812 conn(0x7fa3d8079650 msgr2=0x7fa3d81005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:56:47.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.713+0000 7fa3dd611700 1 -- 172.21.15.49:0/791859812 shutdown_connections 2024-06-02T23:56:47.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:47.713+0000 7fa3dd611700 1 -- 172.21.15.49:0/791859812 wait complete. 2024-06-02T23:56:47.715 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 7 2024-06-02T23:56:47.850 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 02 23:56:47 smithi107 podman[67790]: 2024-06-02 23:56:47.386649719 +0000 UTC m=+0.451143690 container init abe418febea0607dfba402a1cce2f69b508407ada57863282f8eb2eea9600b6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2) 2024-06-02T23:56:47.850 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 02 23:56:47 smithi107 podman[67790]: 2024-06-02 23:56:47.389136186 +0000 UTC m=+0.453630159 container start abe418febea0607dfba402a1cce2f69b508407ada57863282f8eb2eea9600b6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-06-02T23:56:47.851 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 02 23:56:47 smithi107 ceph-mds[67810]: -- 172.21.15.107:0/3942488235 <== mon.1 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5643caee9a40 con 0x5643caebc800 2024-06-02T23:56:47.851 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 02 23:56:47 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: starting mds.c at 2024-06-02T23:56:47.851 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 02 23:56:47 smithi107 bash[67790]: abe418febea0607dfba402a1cce2f69b508407ada57863282f8eb2eea9600b6a 2024-06-02T23:56:47.851 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 02 23:56:47 smithi107 systemd[1]: Started Ceph mds.c for 890dd222-213a-11ef-bc9b-c7b262605968. 2024-06-02T23:56:48.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:48 smithi057 ceph-mon[36457]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:48.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:48 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:48.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:48 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:48.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:48 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:48.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:48 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:48.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:48 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:48.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:48 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:48.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:48 smithi057 ceph-mon[36457]: Deploying daemon mds.h on smithi057 2024-06-02T23:56:48.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:48 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/791859812' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:56:48.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:48 smithi057 ceph-mon[36457]: mds.? [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] up:boot 2024-06-02T23:56:48.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:48 smithi057 ceph-mon[36457]: fsmap 7 up:standby 2024-06-02T23:56:48.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:48 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-02T23:56:48.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:48 smithi049 ceph-mon[32302]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:48.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:48 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:48.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:48 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:48.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:48 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:48.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:48 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:48.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:48 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:48.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:48 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:48.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:48 smithi049 ceph-mon[32302]: Deploying daemon mds.h on smithi057 2024-06-02T23:56:48.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:48 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/791859812' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:56:48.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:48 smithi049 ceph-mon[32302]: mds.? [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] up:boot 2024-06-02T23:56:48.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:48 smithi049 ceph-mon[32302]: fsmap 7 up:standby 2024-06-02T23:56:48.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:48 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-02T23:56:49.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:48 smithi107 ceph-mon[37048]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:49.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:48 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:49.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:48 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:49.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:48 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:49.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:48 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:49.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:48 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:49.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:48 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:49.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:48 smithi107 ceph-mon[37048]: Deploying daemon mds.h on smithi057 2024-06-02T23:56:49.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:48 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/791859812' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:56:49.102 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:48 smithi107 ceph-mon[37048]: mds.? [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] up:boot 2024-06-02T23:56:49.102 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:48 smithi107 ceph-mon[37048]: fsmap 7 up:standby 2024-06-02T23:56:49.102 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:48 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-02T23:56:49.950 INFO:journalctl@ceph.mds.h.smithi057.stdout:Jun 02 23:56:49 smithi057 systemd[1]: Starting Ceph mds.h for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-02T23:56:50.287 INFO:journalctl@ceph.mds.h.smithi057.stdout:Jun 02 23:56:50 smithi057 podman[66207]: 2024-06-02 23:56:49.926535337 +0000 UTC m=+0.017416688 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:56:50.287 INFO:journalctl@ceph.mds.h.smithi057.stdout:Jun 02 23:56:50 smithi057 podman[66207]: 2024-06-02 23:56:50.042061989 +0000 UTC m=+0.132943334 container create 7d3d672cb2be11e03b2d8c6710752a0ba3bccebc05eead13bee8ed319d0ed4f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-h, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-06-02T23:56:50.287 INFO:journalctl@ceph.mds.h.smithi057.stdout:Jun 02 23:56:50 smithi057 podman[66207]: 2024-06-02 23:56:50.261416603 +0000 UTC m=+0.352297953 container init 7d3d672cb2be11e03b2d8c6710752a0ba3bccebc05eead13bee8ed319d0ed4f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-h, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T23:56:50.287 INFO:journalctl@ceph.mds.h.smithi057.stdout:Jun 02 23:56:50 smithi057 podman[66207]: 2024-06-02 23:56:50.264021287 +0000 UTC m=+0.354902637 container start 7d3d672cb2be11e03b2d8c6710752a0ba3bccebc05eead13bee8ed319d0ed4f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-h, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-06-02T23:56:50.288 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T23:56:50.554 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:56:50.606 INFO:journalctl@ceph.mds.h.smithi057.stdout:Jun 02 23:56:50 smithi057 ceph-mds[66226]: -- 172.21.15.57:0/2322577221 <== mon.2 v2:172.21.15.57:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558577f15a40 con 0x558577ee9000 2024-06-02T23:56:50.607 INFO:journalctl@ceph.mds.h.smithi057.stdout:Jun 02 23:56:50 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-h[66222]: starting mds.h at 2024-06-02T23:56:50.607 INFO:journalctl@ceph.mds.h.smithi057.stdout:Jun 02 23:56:50 smithi057 bash[66207]: 7d3d672cb2be11e03b2d8c6710752a0ba3bccebc05eead13bee8ed319d0ed4f7 2024-06-02T23:56:50.607 INFO:journalctl@ceph.mds.h.smithi057.stdout:Jun 02 23:56:50 smithi057 systemd[1]: Started Ceph mds.h for 890dd222-213a-11ef-bc9b-c7b262605968. 2024-06-02T23:56:50.902 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:50 smithi049 ceph-mon[32302]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:50.903 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:50 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:50.903 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:50 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:50.903 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:50 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:50.903 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:50 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:50.903 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:50 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:50.903 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:50 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:50.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:50 smithi057 ceph-mon[36457]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:50.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:50 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:50.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:50 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:50.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:50 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:50.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:50 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:50.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:50 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:50.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:50 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:51.044 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:50 smithi107 ceph-mon[37048]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:51.044 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:50 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:51.044 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:50 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:51.044 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:50 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:51.044 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:50 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:51.044 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:50 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:51.044 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:50 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:51.900 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:51 smithi049 ceph-mon[32302]: Deploying daemon mds.i on smithi107 2024-06-02T23:56:51.900 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:51 smithi049 ceph-mon[32302]: mds.? [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] up:boot 2024-06-02T23:56:51.900 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:51 smithi049 ceph-mon[32302]: fsmap 8 up:standby 2024-06-02T23:56:51.900 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:51 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-02T23:56:51.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:51 smithi057 ceph-mon[36457]: Deploying daemon mds.i on smithi107 2024-06-02T23:56:51.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:51 smithi057 ceph-mon[36457]: mds.? [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] up:boot 2024-06-02T23:56:51.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:51 smithi057 ceph-mon[36457]: fsmap 8 up:standby 2024-06-02T23:56:51.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:51 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-02T23:56:51.976 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:51 smithi107 ceph-mon[37048]: Deploying daemon mds.i on smithi107 2024-06-02T23:56:51.976 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:51 smithi107 ceph-mon[37048]: mds.? [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] up:boot 2024-06-02T23:56:51.976 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:51 smithi107 ceph-mon[37048]: fsmap 8 up:standby 2024-06-02T23:56:51.976 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:51 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-02T23:56:52.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.120+0000 7f793d6ee700 1 -- 172.21.15.49:0/301188199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7938108530 msgr2=0x7f7938108910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:52.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.120+0000 7f793d6ee700 1 --2- 172.21.15.49:0/301188199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7938108530 0x7f7938108910 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7928009990 tx=0x7f7928009ca0 comp rx=0 tx=0).stop 2024-06-02T23:56:52.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.120+0000 7f793d6ee700 1 -- 172.21.15.49:0/301188199 shutdown_connections 2024-06-02T23:56:52.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.120+0000 7f793d6ee700 1 --2- 172.21.15.49:0/301188199 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f793806b5c0 0x7f793810f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:52.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.120+0000 7f793d6ee700 1 --2- 172.21.15.49:0/301188199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7938108530 0x7f7938108910 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:52.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.120+0000 7f793d6ee700 1 --2- 172.21.15.49:0/301188199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f793806ac00 0x7f793806b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:52.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.120+0000 7f793d6ee700 1 -- 172.21.15.49:0/301188199 >> 172.21.15.49:0/301188199 conn(0x7f7938077400 msgr2=0x7f7938077810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:56:52.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.120+0000 7f793d6ee700 1 -- 172.21.15.49:0/301188199 shutdown_connections 2024-06-02T23:56:52.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.120+0000 7f793d6ee700 1 -- 172.21.15.49:0/301188199 wait complete. 2024-06-02T23:56:52.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.121+0000 7f793d6ee700 1 Processor -- start 2024-06-02T23:56:52.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.121+0000 7f793d6ee700 1 -- start start 2024-06-02T23:56:52.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.121+0000 7f793d6ee700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f793806ac00 0x7f793819e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:52.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.121+0000 7f793d6ee700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f793806b5c0 0x7f793819edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:52.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.121+0000 7f793d6ee700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7938108530 0x7f7938198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:52.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.122+0000 7f793d6ee700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7938112760 con 0x7f7938108530 2024-06-02T23:56:52.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.122+0000 7f793d6ee700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f79381125e0 con 0x7f793806b5c0 2024-06-02T23:56:52.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.122+0000 7f793d6ee700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f79381128e0 con 0x7f793806ac00 2024-06-02T23:56:52.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.122+0000 7f79377fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7938108530 0x7f7938198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:52.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.122+0000 7f79377fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7938108530 0x7f7938198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38042/0 (socket says 172.21.15.49:38042) 2024-06-02T23:56:52.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.122+0000 7f79377fe700 1 -- 172.21.15.49:0/695500372 learned_addr learned my addr 172.21.15.49:0/695500372 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:56:52.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.122+0000 7f7936ffd700 1 --2- 172.21.15.49:0/695500372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f793806ac00 0x7f793819e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:52.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.122+0000 7f79367fc700 1 --2- 172.21.15.49:0/695500372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f793806b5c0 0x7f793819edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:52.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.122+0000 7f79377fe700 1 -- 172.21.15.49:0/695500372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f793806ac00 msgr2=0x7f793819e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:52.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.122+0000 7f79377fe700 1 --2- 172.21.15.49:0/695500372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f793806ac00 0x7f793819e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:52.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.122+0000 7f79377fe700 1 -- 172.21.15.49:0/695500372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f793806b5c0 msgr2=0x7f793819edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:52.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.122+0000 7f79377fe700 1 --2- 172.21.15.49:0/695500372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f793806b5c0 0x7f793819edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:52.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.122+0000 7f79377fe700 1 -- 172.21.15.49:0/695500372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79381991e0 con 0x7f7938108530 2024-06-02T23:56:52.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.122+0000 7f79377fe700 1 --2- 172.21.15.49:0/695500372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7938108530 0x7f7938198a80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f793000ada0 tx=0x7f793000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:56:52.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.122+0000 7f791ffff700 1 -- 172.21.15.49:0/695500372 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7930017020 con 0x7f7938108530 2024-06-02T23:56:52.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.122+0000 7f793d6ee700 1 -- 172.21.15.49:0/695500372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79381994d0 con 0x7f7938108530 2024-06-02T23:56:52.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.122+0000 7f791ffff700 1 -- 172.21.15.49:0/695500372 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f793000a0d0 con 0x7f7938108530 2024-06-02T23:56:52.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.122+0000 7f791ffff700 1 -- 172.21.15.49:0/695500372 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7930005480 con 0x7f7938108530 2024-06-02T23:56:52.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.122+0000 7f793d6ee700 1 -- 172.21.15.49:0/695500372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79381a5740 con 0x7f7938108530 2024-06-02T23:56:52.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.123+0000 7f793d6ee700 1 -- 172.21.15.49:0/695500372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f793810aa30 con 0x7f7938108530 2024-06-02T23:56:52.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.124+0000 7f791ffff700 1 -- 172.21.15.49:0/695500372 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7930005620 con 0x7f7938108530 2024-06-02T23:56:52.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.125+0000 7f791ffff700 1 --2- 172.21.15.49:0/695500372 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f79200a2c20 0x7f79200a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:52.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.125+0000 7f7936ffd700 1 --2- 172.21.15.49:0/695500372 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f79200a2c20 0x7f79200a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:52.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.125+0000 7f791ffff700 1 -- 172.21.15.49:0/695500372 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f79300ce240 con 0x7f7938108530 2024-06-02T23:56:52.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.126+0000 7f7936ffd700 1 --2- 172.21.15.49:0/695500372 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f79200a2c20 0x7f79200a50e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f792800b5c0 tx=0x7f7928005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:56:52.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.130+0000 7f791ffff700 1 -- 172.21.15.49:0/695500372 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7930021020 con 0x7f7938108530 2024-06-02T23:56:52.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.385+0000 7f793d6ee700 1 -- 172.21.15.49:0/695500372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f793810a410 con 0x7f7938108530 2024-06-02T23:56:52.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.386+0000 7f791ffff700 1 -- 172.21.15.49:0/695500372 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7174 (secure 0 0 0) 0x7f793009b6d0 con 0x7f7938108530 2024-06-02T23:56:52.387 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:56:52.387 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1553264866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1553264866},{"type":"v1","addr":"172.21.15.49:6835","nonce":1553264866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2266285252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2266285252},{"type":"v1","addr":"172.21.15.49:6837","nonce":2266285252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/1633534002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1633534002},{"type":"v1","addr":"172.21.15.57:6833","nonce":1633534002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2254905671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2254905671},{"type":"v1","addr":"172.21.15.57:6835","nonce":2254905671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3693542801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3693542801},{"type":"v1","addr":"172.21.15.107:6835","nonce":3693542801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24464,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/230452144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":230452144},{"type":"v1","addr":"172.21.15.57:6837","nonce":230452144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/3700593315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":3700593315},{"type":"v1","addr":"172.21.15.107:6837","nonce":3700593315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-06-02T23:56:52.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.388+0000 7f793d6ee700 1 -- 172.21.15.49:0/695500372 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f79200a2c20 msgr2=0x7f79200a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:52.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.388+0000 7f793d6ee700 1 --2- 172.21.15.49:0/695500372 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f79200a2c20 0x7f79200a50e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f792800b5c0 tx=0x7f7928005960 comp rx=0 tx=0).stop 2024-06-02T23:56:52.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.388+0000 7f793d6ee700 1 -- 172.21.15.49:0/695500372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7938108530 msgr2=0x7f7938198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:52.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.388+0000 7f793d6ee700 1 --2- 172.21.15.49:0/695500372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7938108530 0x7f7938198a80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f793000ada0 tx=0x7f793000c330 comp rx=0 tx=0).stop 2024-06-02T23:56:52.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.388+0000 7f793d6ee700 1 -- 172.21.15.49:0/695500372 shutdown_connections 2024-06-02T23:56:52.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.388+0000 7f793d6ee700 1 --2- 172.21.15.49:0/695500372 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f79200a2c20 0x7f79200a50e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:52.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.388+0000 7f793d6ee700 1 --2- 172.21.15.49:0/695500372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7938108530 0x7f7938198a80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:52.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.388+0000 7f793d6ee700 1 --2- 172.21.15.49:0/695500372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f793806ac00 0x7f793819e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:52.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.388+0000 7f793d6ee700 1 --2- 172.21.15.49:0/695500372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f793806b5c0 0x7f793819edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:52.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.388+0000 7f793d6ee700 1 -- 172.21.15.49:0/695500372 >> 172.21.15.49:0/695500372 conn(0x7f7938077400 msgr2=0x7f7938100120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:56:52.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.388+0000 7f793d6ee700 1 -- 172.21.15.49:0/695500372 shutdown_connections 2024-06-02T23:56:52.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:52.388+0000 7f793d6ee700 1 -- 172.21.15.49:0/695500372 wait complete. 2024-06-02T23:56:52.390 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 9 2024-06-02T23:56:52.601 INFO:journalctl@ceph.mds.i.smithi107.stdout:Jun 02 23:56:52 smithi107 systemd[1]: Starting Ceph mds.i for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-02T23:56:52.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:52 smithi049 ceph-mon[32302]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:52.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:52 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/695500372' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:56:52.889 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:52 smithi107 ceph-mon[37048]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:52.889 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:52 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/695500372' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:56:52.889 INFO:journalctl@ceph.mds.i.smithi107.stdout:Jun 02 23:56:52 smithi107 podman[68095]: 2024-06-02 23:56:52.558625153 +0000 UTC m=+0.016714733 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:56:52.889 INFO:journalctl@ceph.mds.i.smithi107.stdout:Jun 02 23:56:52 smithi107 podman[68095]: 2024-06-02 23:56:52.687676278 +0000 UTC m=+0.145765867 container create edb3cfd7fcf7bf2343b51581e319a7a9a5fac85d6552a4b491074bb92af82f68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True) 2024-06-02T23:56:52.889 INFO:journalctl@ceph.mds.i.smithi107.stdout:Jun 02 23:56:52 smithi107 podman[68095]: 2024-06-02 23:56:52.889711575 +0000 UTC m=+0.347801141 container init edb3cfd7fcf7bf2343b51581e319a7a9a5fac85d6552a4b491074bb92af82f68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-i, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-06-02T23:56:52.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:52 smithi057 ceph-mon[36457]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:52.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:52 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/695500372' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:56:53.350 INFO:journalctl@ceph.mds.i.smithi107.stdout:Jun 02 23:56:52 smithi107 podman[68095]: 2024-06-02 23:56:52.892419845 +0000 UTC m=+0.350509414 container start edb3cfd7fcf7bf2343b51581e319a7a9a5fac85d6552a4b491074bb92af82f68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-i, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-06-02T23:56:53.350 INFO:journalctl@ceph.mds.i.smithi107.stdout:Jun 02 23:56:52 smithi107 ceph-mds[68114]: -- 172.21.15.107:0/1980205432 <== mon.1 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fedb489a40 con 0x55fedb45cc00 2024-06-02T23:56:53.350 INFO:journalctl@ceph.mds.i.smithi107.stdout:Jun 02 23:56:52 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-i[68110]: starting mds.i at 2024-06-02T23:56:53.351 INFO:journalctl@ceph.mds.i.smithi107.stdout:Jun 02 23:56:53 smithi107 bash[68095]: edb3cfd7fcf7bf2343b51581e319a7a9a5fac85d6552a4b491074bb92af82f68 2024-06-02T23:56:53.351 INFO:journalctl@ceph.mds.i.smithi107.stdout:Jun 02 23:56:53 smithi107 systemd[1]: Started Ceph mds.i for 890dd222-213a-11ef-bc9b-c7b262605968. 2024-06-02T23:56:54.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:54 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:54.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:54 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:54.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:54 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:54.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:54 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:54.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:54 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:54.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:54 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:54.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:54 smithi107 ceph-mon[37048]: mds.? [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] up:boot 2024-06-02T23:56:54.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:54 smithi107 ceph-mon[37048]: fsmap 9 up:standby 2024-06-02T23:56:54.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:54 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-02T23:56:54.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:54 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:54.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:54 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:54.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:54 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:54.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:54 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:54.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:54 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:54.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:54 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:54.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:54 smithi057 ceph-mon[36457]: mds.? [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] up:boot 2024-06-02T23:56:54.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:54 smithi057 ceph-mon[36457]: fsmap 9 up:standby 2024-06-02T23:56:54.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:54 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-02T23:56:54.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:54 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:54.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:54 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:54.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:54 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:54.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:54 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:54.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:54 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:54.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:54 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:54.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:54 smithi049 ceph-mon[32302]: mds.? [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] up:boot 2024-06-02T23:56:54.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:54 smithi049 ceph-mon[32302]: fsmap 9 up:standby 2024-06-02T23:56:54.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:54 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-02T23:56:55.036 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T23:56:55.211 INFO:journalctl@ceph.mds.g.smithi049.stdout:Jun 02 23:56:55 smithi049 systemd[1]: Starting Ceph mds.g for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-02T23:56:55.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:55 smithi049 ceph-mon[32302]: Deploying daemon mds.g on smithi049 2024-06-02T23:56:55.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:55 smithi049 ceph-mon[32302]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:55.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:55 smithi107 ceph-mon[37048]: Deploying daemon mds.g on smithi049 2024-06-02T23:56:55.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:55 smithi107 ceph-mon[37048]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:55.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:55 smithi057 ceph-mon[36457]: Deploying daemon mds.g on smithi049 2024-06-02T23:56:55.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:55 smithi057 ceph-mon[36457]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:55.608 INFO:journalctl@ceph.mds.g.smithi049.stdout:Jun 02 23:56:55 smithi049 podman[71533]: 2024-06-02 23:56:55.2514552 +0000 UTC m=+0.019522759 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:56:55.608 INFO:journalctl@ceph.mds.g.smithi049.stdout:Jun 02 23:56:55 smithi049 podman[71533]: 2024-06-02 23:56:55.362470698 +0000 UTC m=+0.130538272 container create c1a3cb848b3f0084e211862f34d1d0e69f59f2fe34084b28ee4c35c4468d75a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-g, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, ceph=True) 2024-06-02T23:56:55.608 INFO:journalctl@ceph.mds.g.smithi049.stdout:Jun 02 23:56:55 smithi049 podman[71533]: 2024-06-02 23:56:55.58149901 +0000 UTC m=+0.349566561 container init c1a3cb848b3f0084e211862f34d1d0e69f59f2fe34084b28ee4c35c4468d75a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-g, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc) 2024-06-02T23:56:55.608 INFO:journalctl@ceph.mds.g.smithi049.stdout:Jun 02 23:56:55 smithi049 podman[71533]: 2024-06-02 23:56:55.584590587 +0000 UTC m=+0.352658135 container start c1a3cb848b3f0084e211862f34d1d0e69f59f2fe34084b28ee4c35c4468d75a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-g, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-06-02T23:56:55.608 INFO:journalctl@ceph.mds.g.smithi049.stdout:Jun 02 23:56:55 smithi049 ceph-mds[71577]: -- 172.21.15.49:0/155617070 <== mon.0 v2:172.21.15.49:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5641cc149a40 con 0x5641cc11cc00 2024-06-02T23:56:55.731 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:56:55.865 INFO:journalctl@ceph.mds.g.smithi049.stdout:Jun 02 23:56:55 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-g[71567]: starting mds.g at 2024-06-02T23:56:55.865 INFO:journalctl@ceph.mds.g.smithi049.stdout:Jun 02 23:56:55 smithi049 bash[71533]: c1a3cb848b3f0084e211862f34d1d0e69f59f2fe34084b28ee4c35c4468d75a6 2024-06-02T23:56:55.865 INFO:journalctl@ceph.mds.g.smithi049.stdout:Jun 02 23:56:55 smithi049 systemd[1]: Started Ceph mds.g for 890dd222-213a-11ef-bc9b-c7b262605968. 2024-06-02T23:56:57.064 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:56 smithi049 ceph-mon[32302]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:57.064 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:57.064 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:57.064 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:57.064 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:57.064 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:57.065 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:57.065 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:56 smithi049 ceph-mon[32302]: Deploying daemon mds.a on smithi049 2024-06-02T23:56:57.065 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:56 smithi049 ceph-mon[32302]: mds.? [v2:172.21.15.49:6838/1729124617,v1:172.21.15.49:6839/1729124617] up:boot 2024-06-02T23:56:57.065 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:56 smithi049 ceph-mon[32302]: fsmap 10 up:standby 2024-06-02T23:56:57.065 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-02T23:56:57.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:56 smithi107 ceph-mon[37048]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:57.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:57.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:57.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:57.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:57.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:57.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:57.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:56 smithi107 ceph-mon[37048]: Deploying daemon mds.a on smithi049 2024-06-02T23:56:57.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:56 smithi107 ceph-mon[37048]: mds.? [v2:172.21.15.49:6838/1729124617,v1:172.21.15.49:6839/1729124617] up:boot 2024-06-02T23:56:57.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:56 smithi107 ceph-mon[37048]: fsmap 10 up:standby 2024-06-02T23:56:57.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-02T23:56:57.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:56 smithi057 ceph-mon[36457]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:57.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:57.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:57.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:57.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:57.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:57.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:56:57.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:56 smithi057 ceph-mon[36457]: Deploying daemon mds.a on smithi049 2024-06-02T23:56:57.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:56 smithi057 ceph-mon[36457]: mds.? [v2:172.21.15.49:6838/1729124617,v1:172.21.15.49:6839/1729124617] up:boot 2024-06-02T23:56:57.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:56 smithi057 ceph-mon[36457]: fsmap 10 up:standby 2024-06-02T23:56:57.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-02T23:56:58.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.499+0000 7f3f7d01e700 1 -- 172.21.15.49:0/2719025222 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f7806a170 msgr2=0x7f3f7806a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:58.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.499+0000 7f3f7d01e700 1 --2- 172.21.15.49:0/2719025222 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f7806a170 0x7f3f7806a5f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009990 tx=0x7f3f6c009ca0 comp rx=0 tx=0).stop 2024-06-02T23:56:58.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.499+0000 7f3f7d01e700 1 -- 172.21.15.49:0/2719025222 shutdown_connections 2024-06-02T23:56:58.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.499+0000 7f3f7d01e700 1 --2- 172.21.15.49:0/2719025222 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f7806ab30 0x7f3f7810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:58.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.499+0000 7f3f7d01e700 1 --2- 172.21.15.49:0/2719025222 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f78108500 0x7f3f781088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:58.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.499+0000 7f3f7d01e700 1 --2- 172.21.15.49:0/2719025222 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f7806a170 0x7f3f7806a5f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:58.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.499+0000 7f3f7d01e700 1 -- 172.21.15.49:0/2719025222 >> 172.21.15.49:0/2719025222 conn(0x7f3f78078340 msgr2=0x7f3f78078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:56:58.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.499+0000 7f3f7d01e700 1 -- 172.21.15.49:0/2719025222 shutdown_connections 2024-06-02T23:56:58.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.499+0000 7f3f7d01e700 1 -- 172.21.15.49:0/2719025222 wait complete. 2024-06-02T23:56:58.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.500+0000 7f3f7d01e700 1 Processor -- start 2024-06-02T23:56:58.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.500+0000 7f3f7d01e700 1 -- start start 2024-06-02T23:56:58.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.500+0000 7f3f7d01e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f7806a170 0x7f3f781a4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:58.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.500+0000 7f3f7d01e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f7806ab30 0x7f3f781a5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:58.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.500+0000 7f3f7d01e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f78108500 0x7f3f7810d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:58.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.500+0000 7f3f7d01e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3f78112780 con 0x7f3f7806a170 2024-06-02T23:56:58.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.500+0000 7f3f7d01e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3f78112600 con 0x7f3f78108500 2024-06-02T23:56:58.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.500+0000 7f3f7d01e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3f78112900 con 0x7f3f7806ab30 2024-06-02T23:56:58.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.501+0000 7f3f7659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f7806ab30 0x7f3f781a5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:58.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.501+0000 7f3f7759e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f78108500 0x7f3f7810d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:58.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.501+0000 7f3f7659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f7806ab30 0x7f3f781a5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:39194/0 (socket says 172.21.15.49:39194) 2024-06-02T23:56:58.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.501+0000 7f3f7759e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f78108500 0x7f3f7810d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.49:56264/0 (socket says 172.21.15.49:56264) 2024-06-02T23:56:58.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.501+0000 7f3f7659c700 1 -- 172.21.15.49:0/842027954 learned_addr learned my addr 172.21.15.49:0/842027954 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:56:58.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.501+0000 7f3f76d9d700 1 --2- 172.21.15.49:0/842027954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f7806a170 0x7f3f781a4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:58.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.501+0000 7f3f7759e700 1 -- 172.21.15.49:0/842027954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f7806ab30 msgr2=0x7f3f781a5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:58.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.501+0000 7f3f7759e700 1 --2- 172.21.15.49:0/842027954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f7806ab30 0x7f3f781a5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:58.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.501+0000 7f3f7759e700 1 -- 172.21.15.49:0/842027954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f7806a170 msgr2=0x7f3f781a4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:58.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.501+0000 7f3f7759e700 1 --2- 172.21.15.49:0/842027954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f7806a170 0x7f3f781a4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:58.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.501+0000 7f3f7759e700 1 -- 172.21.15.49:0/842027954 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f7810dae0 con 0x7f3f78108500 2024-06-02T23:56:58.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.501+0000 7f3f76d9d700 1 --2- 172.21.15.49:0/842027954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f7806a170 0x7f3f781a4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:56:58.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.501+0000 7f3f7659c700 1 --2- 172.21.15.49:0/842027954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f7806ab30 0x7f3f781a5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:56:58.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.501+0000 7f3f7759e700 1 --2- 172.21.15.49:0/842027954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f78108500 0x7f3f7810d310 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3f7000efc0 tx=0x7f3f7000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:56:58.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.502+0000 7f3f5ffff700 1 -- 172.21.15.49:0/842027954 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f700092e0 con 0x7f3f78108500 2024-06-02T23:56:58.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.502+0000 7f3f7d01e700 1 -- 172.21.15.49:0/842027954 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f7810dd70 con 0x7f3f78108500 2024-06-02T23:56:58.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.502+0000 7f3f5ffff700 1 -- 172.21.15.49:0/842027954 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f70004bb0 con 0x7f3f78108500 2024-06-02T23:56:58.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.502+0000 7f3f5ffff700 1 -- 172.21.15.49:0/842027954 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f70004280 con 0x7f3f78108500 2024-06-02T23:56:58.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.502+0000 7f3f7d01e700 1 -- 172.21.15.49:0/842027954 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f781abd80 con 0x7f3f78108500 2024-06-02T23:56:58.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.503+0000 7f3f7d01e700 1 -- 172.21.15.49:0/842027954 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f78069180 con 0x7f3f78108500 2024-06-02T23:56:58.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.504+0000 7f3f5ffff700 1 -- 172.21.15.49:0/842027954 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3f7001b030 con 0x7f3f78108500 2024-06-02T23:56:58.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.505+0000 7f3f5ffff700 1 --2- 172.21.15.49:0/842027954 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3f600a2c20 0x7f3f600a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:56:58.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.505+0000 7f3f5ffff700 1 -- 172.21.15.49:0/842027954 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f3f700cf170 con 0x7f3f78108500 2024-06-02T23:56:58.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.505+0000 7f3f76d9d700 1 --2- 172.21.15.49:0/842027954 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3f600a2c20 0x7f3f600a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:56:58.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.505+0000 7f3f76d9d700 1 --2- 172.21.15.49:0/842027954 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3f600a2c20 0x7f3f600a50e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3f68009fd0 tx=0x7f3f68009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:56:58.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.509+0000 7f3f5ffff700 1 -- 172.21.15.49:0/842027954 <== mon.2 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3f70022020 con 0x7f3f78108500 2024-06-02T23:56:58.734 INFO:journalctl@ceph.mds.a.smithi049.stdout:Jun 02 23:56:58 smithi049 systemd[1]: Starting Ceph mds.a for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-02T23:56:58.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.774+0000 7f3f7d01e700 1 -- 172.21.15.49:0/842027954 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f781abfb0 con 0x7f3f78108500 2024-06-02T23:56:58.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.775+0000 7f3f5ffff700 1 -- 172.21.15.49:0/842027954 <== mon.2 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8830 (secure 0 0 0) 0x7f3f70010040 con 0x7f3f78108500 2024-06-02T23:56:58.776 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:56:58.776 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1553264866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1553264866},{"type":"v1","addr":"172.21.15.49:6835","nonce":1553264866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2266285252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2266285252},{"type":"v1","addr":"172.21.15.49:6837","nonce":2266285252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6839/1729124617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":1729124617},{"type":"v1","addr":"172.21.15.49:6839","nonce":1729124617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/1633534002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1633534002},{"type":"v1","addr":"172.21.15.57:6833","nonce":1633534002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2254905671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2254905671},{"type":"v1","addr":"172.21.15.57:6835","nonce":2254905671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3693542801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3693542801},{"type":"v1","addr":"172.21.15.107:6835","nonce":3693542801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24464,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/230452144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":230452144},{"type":"v1","addr":"172.21.15.57:6837","nonce":230452144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/3700593315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":3700593315},{"type":"v1","addr":"172.21.15.107:6837","nonce":3700593315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24487,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6839/1986600681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1986600681},{"type":"v1","addr":"172.21.15.107:6839","nonce":1986600681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-06-02T23:56:58.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.777+0000 7f3f7d01e700 1 -- 172.21.15.49:0/842027954 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3f600a2c20 msgr2=0x7f3f600a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:58.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.777+0000 7f3f7d01e700 1 --2- 172.21.15.49:0/842027954 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3f600a2c20 0x7f3f600a50e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3f68009fd0 tx=0x7f3f68009260 comp rx=0 tx=0).stop 2024-06-02T23:56:58.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.777+0000 7f3f7d01e700 1 -- 172.21.15.49:0/842027954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f78108500 msgr2=0x7f3f7810d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:56:58.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.777+0000 7f3f7d01e700 1 --2- 172.21.15.49:0/842027954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f78108500 0x7f3f7810d310 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3f7000efc0 tx=0x7f3f7000c3a0 comp rx=0 tx=0).stop 2024-06-02T23:56:58.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.777+0000 7f3f7d01e700 1 -- 172.21.15.49:0/842027954 shutdown_connections 2024-06-02T23:56:58.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.777+0000 7f3f7d01e700 1 --2- 172.21.15.49:0/842027954 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3f600a2c20 0x7f3f600a50e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:58.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.777+0000 7f3f7d01e700 1 --2- 172.21.15.49:0/842027954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f78108500 0x7f3f7810d310 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:58.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.777+0000 7f3f7d01e700 1 --2- 172.21.15.49:0/842027954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3f7806a170 0x7f3f781a4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:58.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.777+0000 7f3f7d01e700 1 --2- 172.21.15.49:0/842027954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f7806ab30 0x7f3f781a5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:56:58.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.777+0000 7f3f7d01e700 1 -- 172.21.15.49:0/842027954 >> 172.21.15.49:0/842027954 conn(0x7f3f78078340 msgr2=0x7f3f78101d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:56:58.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.777+0000 7f3f7d01e700 1 -- 172.21.15.49:0/842027954 shutdown_connections 2024-06-02T23:56:58.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:56:58.777+0000 7f3f7d01e700 1 -- 172.21.15.49:0/842027954 wait complete. 2024-06-02T23:56:58.779 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 11 2024-06-02T23:56:59.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:58 smithi107 ceph-mon[37048]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:59.188 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:58 smithi049 ceph-mon[32302]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:59.188 INFO:journalctl@ceph.mds.a.smithi049.stdout:Jun 02 23:56:58 smithi049 podman[71955]: 2024-06-02 23:56:58.734494733 +0000 UTC m=+0.106205420 container create 0dc3af67f43956d95107566364a929ae3f3b09f138743199dc5d0fac15804573 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240528, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-06-02T23:56:59.189 INFO:journalctl@ceph.mds.a.smithi049.stdout:Jun 02 23:56:58 smithi049 podman[71955]: 2024-06-02 23:56:58.64654598 +0000 UTC m=+0.018256681 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T23:56:59.189 INFO:journalctl@ceph.mds.a.smithi049.stdout:Jun 02 23:56:59 smithi049 podman[71955]: 2024-06-02 23:56:59.188949797 +0000 UTC m=+0.560660479 container init 0dc3af67f43956d95107566364a929ae3f3b09f138743199dc5d0fac15804573 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-a, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux ) 2024-06-02T23:56:59.199 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:58 smithi057 ceph-mon[36457]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:56:59.461 INFO:journalctl@ceph.mds.a.smithi049.stdout:Jun 02 23:56:59 smithi049 podman[71955]: 2024-06-02 23:56:59.192603686 +0000 UTC m=+0.564314381 container start 0dc3af67f43956d95107566364a929ae3f3b09f138743199dc5d0fac15804573 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc) 2024-06-02T23:56:59.461 INFO:journalctl@ceph.mds.a.smithi049.stdout:Jun 02 23:56:59 smithi049 ceph-mds[71988]: -- 172.21.15.49:0/2892771341 <== mon.0 v2:172.21.15.49:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563382949a40 con 0x56338291d000 2024-06-02T23:56:59.461 INFO:journalctl@ceph.mds.a.smithi049.stdout:Jun 02 23:56:59 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-a[71984]: starting mds.a at 2024-06-02T23:56:59.461 INFO:journalctl@ceph.mds.a.smithi049.stdout:Jun 02 23:56:59 smithi049 bash[71955]: 0dc3af67f43956d95107566364a929ae3f3b09f138743199dc5d0fac15804573 2024-06-02T23:56:59.461 INFO:journalctl@ceph.mds.a.smithi049.stdout:Jun 02 23:56:59 smithi049 systemd[1]: Started Ceph mds.a for 890dd222-213a-11ef-bc9b-c7b262605968. 2024-06-02T23:56:59.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:59 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/842027954' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:56:59.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:59 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:59.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:59 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:59.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:59 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:56:59.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:59 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:56:59.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:59 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:56:59.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:56:59 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:57:00.055 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:59 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/842027954' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:57:00.055 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:59 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:00.055 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:59 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:00.055 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:59 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:00.055 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:59 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:57:00.056 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:59 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:57:00.056 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:56:59 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:57:00.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:59 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/842027954' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:57:00.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:59 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:00.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:59 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:00.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:59 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:00.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:59 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T23:57:00.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:59 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T23:57:00.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:56:59 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:57:01.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:00 smithi107 ceph-mon[37048]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:57:01.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:00 smithi107 ceph-mon[37048]: Deploying daemon mds.b on smithi057 2024-06-02T23:57:01.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:00 smithi107 ceph-mon[37048]: mds.? [v2:172.21.15.49:6840/1902772235,v1:172.21.15.49:6841/1902772235] up:boot 2024-06-02T23:57:01.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:00 smithi107 ceph-mon[37048]: fsmap 11 up:standby 2024-06-02T23:57:01.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:00 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-02T23:57:01.111 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:00 smithi057 ceph-mon[36457]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:57:01.111 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:00 smithi057 ceph-mon[36457]: Deploying daemon mds.b on smithi057 2024-06-02T23:57:01.111 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:00 smithi057 ceph-mon[36457]: mds.? [v2:172.21.15.49:6840/1902772235,v1:172.21.15.49:6841/1902772235] up:boot 2024-06-02T23:57:01.111 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:00 smithi057 ceph-mon[36457]: fsmap 11 up:standby 2024-06-02T23:57:01.111 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:00 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-02T23:57:01.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:00 smithi049 ceph-mon[32302]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:57:01.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:00 smithi049 ceph-mon[32302]: Deploying daemon mds.b on smithi057 2024-06-02T23:57:01.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:00 smithi049 ceph-mon[32302]: mds.? [v2:172.21.15.49:6840/1902772235,v1:172.21.15.49:6841/1902772235] up:boot 2024-06-02T23:57:01.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:00 smithi049 ceph-mon[32302]: fsmap 11 up:standby 2024-06-02T23:57:01.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:00 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-02T23:57:01.721 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T23:57:01.990 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:57:02.450 INFO:journalctl@ceph.mds.b.smithi057.stdout:Jun 02 23:57:02 smithi057 systemd[1]: Started Ceph mds.b for 890dd222-213a-11ef-bc9b-c7b262605968. 2024-06-02T23:57:03.056 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:02 smithi049 ceph-mon[32302]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:57:03.057 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:02 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:03.057 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:02 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:03.057 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:02 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:03.057 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:02 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:03.057 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:02 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:03.057 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:02 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:57:03.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:02 smithi107 ceph-mon[37048]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:57:03.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:02 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:03.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:02 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:03.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:02 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:03.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:02 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:03.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:02 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:03.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:02 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:57:03.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:02 smithi057 ceph-mon[36457]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:57:03.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:02 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:03.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:02 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:03.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:02 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:03.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:02 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:03.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:02 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:03.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:02 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:57:03.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.513+0000 7f1e5d465700 1 -- 172.21.15.49:0/3591670477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e5806b620 msgr2=0x7f1e5810f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:03.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.513+0000 7f1e5d465700 1 --2- 172.21.15.49:0/3591670477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e5806b620 0x7f1e5810f350 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1e5000b0d0 tx=0x7f1e5000b3e0 comp rx=0 tx=0).stop 2024-06-02T23:57:03.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.513+0000 7f1e5d465700 1 -- 172.21.15.49:0/3591670477 shutdown_connections 2024-06-02T23:57:03.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.513+0000 7f1e5d465700 1 --2- 172.21.15.49:0/3591670477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e5806b620 0x7f1e5810f350 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:03.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.513+0000 7f1e5d465700 1 --2- 172.21.15.49:0/3591670477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e58108580 0x7f1e58108960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:03.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.513+0000 7f1e5d465700 1 --2- 172.21.15.49:0/3591670477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e5806ac60 0x7f1e5806b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:03.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.513+0000 7f1e5d465700 1 -- 172.21.15.49:0/3591670477 >> 172.21.15.49:0/3591670477 conn(0x7f1e58078430 msgr2=0x7f1e58078840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:03.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.514+0000 7f1e5d465700 1 -- 172.21.15.49:0/3591670477 shutdown_connections 2024-06-02T23:57:03.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.514+0000 7f1e5d465700 1 -- 172.21.15.49:0/3591670477 wait complete. 2024-06-02T23:57:03.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.514+0000 7f1e5d465700 1 Processor -- start 2024-06-02T23:57:03.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.514+0000 7f1e5d465700 1 -- start start 2024-06-02T23:57:03.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.515+0000 7f1e5d465700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e5806ac60 0x7f1e5819e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:03.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.515+0000 7f1e5d465700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e5806b620 0x7f1e5819ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:03.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.515+0000 7f1e5d465700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e58108580 0x7f1e581989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:03.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.515+0000 7f1e5d465700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1e581127c0 con 0x7f1e5806ac60 2024-06-02T23:57:03.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.515+0000 7f1e5d465700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1e58112640 con 0x7f1e58108580 2024-06-02T23:57:03.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.515+0000 7f1e5d465700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1e58112940 con 0x7f1e5806b620 2024-06-02T23:57:03.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.515+0000 7f1e56ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e5806ac60 0x7f1e5819e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:03.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.515+0000 7f1e56ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e5806ac60 0x7f1e5819e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52914/0 (socket says 172.21.15.49:52914) 2024-06-02T23:57:03.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.515+0000 7f1e567fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e5806b620 0x7f1e5819ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:03.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.515+0000 7f1e56ffd700 1 -- 172.21.15.49:0/3656598626 learned_addr learned my addr 172.21.15.49:0/3656598626 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:57:03.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.515+0000 7f1e577fe700 1 --2- 172.21.15.49:0/3656598626 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e58108580 0x7f1e581989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:03.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.515+0000 7f1e56ffd700 1 -- 172.21.15.49:0/3656598626 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e5806b620 msgr2=0x7f1e5819ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:03.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.515+0000 7f1e56ffd700 1 --2- 172.21.15.49:0/3656598626 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e5806b620 0x7f1e5819ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:03.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.515+0000 7f1e56ffd700 1 -- 172.21.15.49:0/3656598626 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e58108580 msgr2=0x7f1e581989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:03.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.515+0000 7f1e56ffd700 1 --2- 172.21.15.49:0/3656598626 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e58108580 0x7f1e581989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:03.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.515+0000 7f1e56ffd700 1 -- 172.21.15.49:0/3656598626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e58199120 con 0x7f1e5806ac60 2024-06-02T23:57:03.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.515+0000 7f1e56ffd700 1 --2- 172.21.15.49:0/3656598626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e5806ac60 0x7f1e5819e7b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1e4800c920 tx=0x7f1e4800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:03.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.515+0000 7f1e3ffff700 1 -- 172.21.15.49:0/3656598626 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e48004a30 con 0x7f1e5806ac60 2024-06-02T23:57:03.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.515+0000 7f1e5d465700 1 -- 172.21.15.49:0/3656598626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e58199410 con 0x7f1e5806ac60 2024-06-02T23:57:03.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.516+0000 7f1e3ffff700 1 -- 172.21.15.49:0/3656598626 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e48005500 con 0x7f1e5806ac60 2024-06-02T23:57:03.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.516+0000 7f1e3ffff700 1 -- 172.21.15.49:0/3656598626 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e48007d00 con 0x7f1e5806ac60 2024-06-02T23:57:03.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.516+0000 7f1e5d465700 1 -- 172.21.15.49:0/3656598626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e581a5680 con 0x7f1e5806ac60 2024-06-02T23:57:03.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.516+0000 7f1e5d465700 1 -- 172.21.15.49:0/3656598626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e58069180 con 0x7f1e5806ac60 2024-06-02T23:57:03.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.518+0000 7f1e3ffff700 1 -- 172.21.15.49:0/3656598626 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1e48005000 con 0x7f1e5806ac60 2024-06-02T23:57:03.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.518+0000 7f1e3ffff700 1 --2- 172.21.15.49:0/3656598626 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1e400a2c20 0x7f1e400a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:03.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.519+0000 7f1e567fc700 1 --2- 172.21.15.49:0/3656598626 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1e400a2c20 0x7f1e400a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:03.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.519+0000 7f1e3ffff700 1 -- 172.21.15.49:0/3656598626 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f1e480ceaa0 con 0x7f1e5806ac60 2024-06-02T23:57:03.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.519+0000 7f1e567fc700 1 --2- 172.21.15.49:0/3656598626 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1e400a2c20 0x7f1e400a50e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1e58078930 tx=0x7f1e4c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:03.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.522+0000 7f1e3ffff700 1 -- 172.21.15.49:0/3656598626 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1e48014030 con 0x7f1e5806ac60 2024-06-02T23:57:03.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.781+0000 7f1e5d465700 1 -- 172.21.15.49:0/3656598626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1e58199ed0 con 0x7f1e5806ac60 2024-06-02T23:57:03.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.781+0000 7f1e3ffff700 1 -- 172.21.15.49:0/3656598626 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10479 (secure 0 0 0) 0x7f1e58199ed0 con 0x7f1e5806ac60 2024-06-02T23:57:03.847 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:57:03.848 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1553264866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1553264866},{"type":"v1","addr":"172.21.15.49:6835","nonce":1553264866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2266285252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2266285252},{"type":"v1","addr":"172.21.15.49:6837","nonce":2266285252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6839/1729124617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":1729124617},{"type":"v1","addr":"172.21.15.49:6839","nonce":1729124617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6841/1902772235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":1902772235},{"type":"v1","addr":"172.21.15.49:6841","nonce":1902772235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/1633534002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1633534002},{"type":"v1","addr":"172.21.15.57:6833","nonce":1633534002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2254905671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2254905671},{"type":"v1","addr":"172.21.15.57:6835","nonce":2254905671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3693542801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3693542801},{"type":"v1","addr":"172.21.15.107:6835","nonce":3693542801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24464,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/230452144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":230452144},{"type":"v1","addr":"172.21.15.57:6837","nonce":230452144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/3700593315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":3700593315},{"type":"v1","addr":"172.21.15.107:6837","nonce":3700593315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24485,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6839/249825195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":249825195},{"type":"v1","addr":"172.21.15.57:6839","nonce":249825195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24487,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6839/1986600681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1986600681},{"type":"v1","addr":"172.21.15.107:6839","nonce":1986600681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-06-02T23:57:03.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.783+0000 7f1e5d465700 1 -- 172.21.15.49:0/3656598626 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1e400a2c20 msgr2=0x7f1e400a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:03.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.783+0000 7f1e5d465700 1 --2- 172.21.15.49:0/3656598626 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1e400a2c20 0x7f1e400a50e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1e58078930 tx=0x7f1e4c00b410 comp rx=0 tx=0).stop 2024-06-02T23:57:03.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.783+0000 7f1e5d465700 1 -- 172.21.15.49:0/3656598626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e5806ac60 msgr2=0x7f1e5819e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:03.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.783+0000 7f1e5d465700 1 --2- 172.21.15.49:0/3656598626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e5806ac60 0x7f1e5819e7b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1e4800c920 tx=0x7f1e4800cc30 comp rx=0 tx=0).stop 2024-06-02T23:57:03.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.784+0000 7f1e5d465700 1 -- 172.21.15.49:0/3656598626 shutdown_connections 2024-06-02T23:57:03.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.784+0000 7f1e5d465700 1 --2- 172.21.15.49:0/3656598626 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1e400a2c20 0x7f1e400a50e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:03.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.784+0000 7f1e5d465700 1 --2- 172.21.15.49:0/3656598626 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e58108580 0x7f1e581989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:03.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.784+0000 7f1e5d465700 1 --2- 172.21.15.49:0/3656598626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1e5806ac60 0x7f1e5819e7b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:03.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.784+0000 7f1e5d465700 1 --2- 172.21.15.49:0/3656598626 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e5806b620 0x7f1e5819ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:03.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.784+0000 7f1e5d465700 1 -- 172.21.15.49:0/3656598626 >> 172.21.15.49:0/3656598626 conn(0x7f1e58078430 msgr2=0x7f1e580ffe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:03.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.784+0000 7f1e5d465700 1 -- 172.21.15.49:0/3656598626 shutdown_connections 2024-06-02T23:57:03.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:03.784+0000 7f1e5d465700 1 -- 172.21.15.49:0/3656598626 wait complete. 2024-06-02T23:57:03.849 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 13 2024-06-02T23:57:03.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:03 smithi057 ceph-mon[36457]: mds.? [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] up:boot 2024-06-02T23:57:03.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:03 smithi057 ceph-mon[36457]: fsmap 12 up:standby 2024-06-02T23:57:03.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:03 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-02T23:57:04.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:03 smithi107 ceph-mon[37048]: mds.? [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] up:boot 2024-06-02T23:57:04.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:03 smithi107 ceph-mon[37048]: fsmap 12 up:standby 2024-06-02T23:57:04.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:03 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-02T23:57:04.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:03 smithi049 ceph-mon[32302]: mds.? [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] up:boot 2024-06-02T23:57:04.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:03 smithi049 ceph-mon[32302]: fsmap 12 up:standby 2024-06-02T23:57:04.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:03 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-02T23:57:04.779 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-06-02T23:57:04.806 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:04 smithi049 ceph-mon[32302]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:57:04.806 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:04 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3656598626' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:57:04.806 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:04 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:04.806 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:04 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:04.806 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:04 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:04.806 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:04 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:05.056 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:57:05.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:04 smithi107 ceph-mon[37048]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:57:05.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:04 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/3656598626' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:57:05.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:04 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:05.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:04 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:05.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:04 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:05.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:04 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:05.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:04 smithi057 ceph-mon[36457]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:57:05.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:04 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/3656598626' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:57:05.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:04 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:05.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:04 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:05.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:04 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:05.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:04 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:06.437 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:06 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:06.437 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:06 smithi049 ceph-mon[32302]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:57:06.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:06 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:06.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:06 smithi107 ceph-mon[37048]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:57:06.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.686+0000 7f18f0d73700 1 -- 172.21.15.49:0/3145700407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18ec101390 msgr2=0x7f18ec101810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:06.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.686+0000 7f18f0d73700 1 --2- 172.21.15.49:0/3145700407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18ec101390 0x7f18ec101810 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f18d4009990 tx=0x7f18d4009ca0 comp rx=0 tx=0).stop 2024-06-02T23:57:06.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.686+0000 7f18f0d73700 1 -- 172.21.15.49:0/3145700407 shutdown_connections 2024-06-02T23:57:06.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.686+0000 7f18f0d73700 1 --2- 172.21.15.49:0/3145700407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18ec101d50 0x7f18ec10e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:06.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.686+0000 7f18f0d73700 1 --2- 172.21.15.49:0/3145700407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18ec107400 0x7f18ec1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:06.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.686+0000 7f18f0d73700 1 --2- 172.21.15.49:0/3145700407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18ec101390 0x7f18ec101810 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:06.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.686+0000 7f18f0d73700 1 -- 172.21.15.49:0/3145700407 >> 172.21.15.49:0/3145700407 conn(0x7f18ec078340 msgr2=0x7f18ec078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:06.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.686+0000 7f18f0d73700 1 -- 172.21.15.49:0/3145700407 shutdown_connections 2024-06-02T23:57:06.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.686+0000 7f18f0d73700 1 -- 172.21.15.49:0/3145700407 wait complete. 2024-06-02T23:57:06.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.687+0000 7f18f0d73700 1 Processor -- start 2024-06-02T23:57:06.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.687+0000 7f18f0d73700 1 -- start start 2024-06-02T23:57:06.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.687+0000 7f18f0d73700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18ec101390 0x7f18ec103070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:06.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.687+0000 7f18f0d73700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18ec101d50 0x7f18ec1035b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:06.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.687+0000 7f18f0d73700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18ec107400 0x7f18ec103af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:06.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.687+0000 7f18f0d73700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f18ec111670 con 0x7f18ec101390 2024-06-02T23:57:06.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.687+0000 7f18f0d73700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f18ec1114f0 con 0x7f18ec101d50 2024-06-02T23:57:06.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.687+0000 7f18f0d73700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f18ec1117f0 con 0x7f18ec107400 2024-06-02T23:57:06.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.688+0000 7f18ead9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18ec107400 0x7f18ec103af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:06.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.688+0000 7f18ead9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18ec107400 0x7f18ec103af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:33628/0 (socket says 172.21.15.49:33628) 2024-06-02T23:57:06.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.688+0000 7f18ead9d700 1 -- 172.21.15.49:0/105380274 learned_addr learned my addr 172.21.15.49:0/105380274 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:57:06.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.688+0000 7f18ea59c700 1 --2- 172.21.15.49:0/105380274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18ec101390 0x7f18ec103070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:06.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.688+0000 7f18e9d9b700 1 --2- 172.21.15.49:0/105380274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18ec101d50 0x7f18ec1035b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:06.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.688+0000 7f18ead9d700 1 -- 172.21.15.49:0/105380274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18ec101d50 msgr2=0x7f18ec1035b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:06.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.688+0000 7f18ead9d700 1 --2- 172.21.15.49:0/105380274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18ec101d50 0x7f18ec1035b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:06.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.688+0000 7f18ead9d700 1 -- 172.21.15.49:0/105380274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18ec101390 msgr2=0x7f18ec103070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:06.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.688+0000 7f18ead9d700 1 --2- 172.21.15.49:0/105380274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18ec101390 0x7f18ec103070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:06.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.688+0000 7f18ead9d700 1 -- 172.21.15.49:0/105380274 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18ec1a7120 con 0x7f18ec107400 2024-06-02T23:57:06.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.688+0000 7f18ead9d700 1 --2- 172.21.15.49:0/105380274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18ec107400 0x7f18ec103af0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f18e4007ee0 tx=0x7f18e400d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:06.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.688+0000 7f18e37fe700 1 -- 172.21.15.49:0/105380274 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e4004bb0 con 0x7f18ec107400 2024-06-02T23:57:06.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.689+0000 7f18e37fe700 1 -- 172.21.15.49:0/105380274 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18e4004d50 con 0x7f18ec107400 2024-06-02T23:57:06.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.689+0000 7f18f0d73700 1 -- 172.21.15.49:0/105380274 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18ec1a7410 con 0x7f18ec107400 2024-06-02T23:57:06.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.689+0000 7f18e37fe700 1 -- 172.21.15.49:0/105380274 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e4005960 con 0x7f18ec107400 2024-06-02T23:57:06.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.689+0000 7f18f0d73700 1 -- 172.21.15.49:0/105380274 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18ec1a78d0 con 0x7f18ec107400 2024-06-02T23:57:06.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.690+0000 7f18f0d73700 1 -- 172.21.15.49:0/105380274 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18ec069180 con 0x7f18ec107400 2024-06-02T23:57:06.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.692+0000 7f18e37fe700 1 -- 172.21.15.49:0/105380274 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f18e401a020 con 0x7f18ec107400 2024-06-02T23:57:06.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.692+0000 7f18e37fe700 1 --2- 172.21.15.49:0/105380274 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f18d80a2c20 0x7f18d80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:06.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.693+0000 7f18ea59c700 1 --2- 172.21.15.49:0/105380274 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f18d80a2c20 0x7f18d80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:06.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.693+0000 7f18e37fe700 1 -- 172.21.15.49:0/105380274 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f18e40ce4e0 con 0x7f18ec107400 2024-06-02T23:57:06.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.693+0000 7f18ea59c700 1 --2- 172.21.15.49:0/105380274 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f18d80a2c20 0x7f18d80a50e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f18dc005950 tx=0x7f18dc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:06.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.695+0000 7f18e37fe700 1 -- 172.21.15.49:0/105380274 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f18e4010070 con 0x7f18ec107400 2024-06-02T23:57:06.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:06 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:06.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:06 smithi057 ceph-mon[36457]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:57:06.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.904+0000 7f18f0d73700 1 -- 172.21.15.49:0/105380274 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f18ec1a7aa0 con 0x7f18ec107400 2024-06-02T23:57:06.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.904+0000 7f18e37fe700 1 -- 172.21.15.49:0/105380274 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) ==== 84+0+65 (secure 0 0 0) 0x7f18e40b9e20 con 0x7f18ec107400 2024-06-02T23:57:06.904 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:57:06.904 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-06-02T23:57:06.904 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-02T23:57:06.905 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-06-02T23:57:06.905 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2024-06-02T23:57:06.905 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-02T23:57:06.905 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-06-02T23:57:06.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.906+0000 7f18f0d73700 1 -- 172.21.15.49:0/105380274 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f18d80a2c20 msgr2=0x7f18d80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:06.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.906+0000 7f18f0d73700 1 --2- 172.21.15.49:0/105380274 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f18d80a2c20 0x7f18d80a50e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f18dc005950 tx=0x7f18dc00b410 comp rx=0 tx=0).stop 2024-06-02T23:57:06.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.906+0000 7f18f0d73700 1 -- 172.21.15.49:0/105380274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18ec107400 msgr2=0x7f18ec103af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:06.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.906+0000 7f18f0d73700 1 --2- 172.21.15.49:0/105380274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18ec107400 0x7f18ec103af0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f18e4007ee0 tx=0x7f18e400d3b0 comp rx=0 tx=0).stop 2024-06-02T23:57:06.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.906+0000 7f18f0d73700 1 -- 172.21.15.49:0/105380274 shutdown_connections 2024-06-02T23:57:06.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.906+0000 7f18f0d73700 1 --2- 172.21.15.49:0/105380274 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f18d80a2c20 0x7f18d80a50e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:06.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.906+0000 7f18f0d73700 1 --2- 172.21.15.49:0/105380274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18ec107400 0x7f18ec103af0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:06.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.906+0000 7f18f0d73700 1 --2- 172.21.15.49:0/105380274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18ec101390 0x7f18ec103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:06.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.906+0000 7f18f0d73700 1 --2- 172.21.15.49:0/105380274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18ec101d50 0x7f18ec1035b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:06.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.906+0000 7f18f0d73700 1 -- 172.21.15.49:0/105380274 >> 172.21.15.49:0/105380274 conn(0x7f18ec078340 msgr2=0x7f18ec1005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:06.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.907+0000 7f18f0d73700 1 -- 172.21.15.49:0/105380274 shutdown_connections 2024-06-02T23:57:06.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:06.907+0000 7f18f0d73700 1 -- 172.21.15.49:0/105380274 wait complete. 2024-06-02T23:57:07.540 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-06-02T23:57:07.540 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-06-02T23:57:07.761 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:07 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:07.761 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:07 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:07.761 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:07 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/105380274' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-06-02T23:57:07.761 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:07 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:57:07.762 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:07 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:57:07.762 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:07 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:07.762 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:07 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:57:07.818 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:07 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:07.818 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:07 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:07.818 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:07 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/105380274' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-06-02T23:57:07.818 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:07 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:57:07.818 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:07 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:57:07.819 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:07 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:07.819 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:07 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:57:07.841 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:57:07.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:07 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:07.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:07 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:07.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:07 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/105380274' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-06-02T23:57:07.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:07 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:57:07.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:07 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:57:07.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:07 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:07.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:07 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:57:08.590 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:08 smithi049 ceph-mon[32302]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:57:08.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:08 smithi107 ceph-mon[37048]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:57:08.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:08 smithi057 ceph-mon[36457]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:57:10.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.076+0000 7f79a0ec3700 1 -- 172.21.15.49:0/4221669146 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f799c102ee0 msgr2=0x7f799c10f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:10.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.076+0000 7f79a0ec3700 1 --2- 172.21.15.49:0/4221669146 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f799c102ee0 0x7f799c10f390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f799400b0d0 tx=0x7f799400b3e0 comp rx=0 tx=0).stop 2024-06-02T23:57:10.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.076+0000 7f79a0ec3700 1 -- 172.21.15.49:0/4221669146 shutdown_connections 2024-06-02T23:57:10.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.076+0000 7f79a0ec3700 1 --2- 172.21.15.49:0/4221669146 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f799c102ee0 0x7f799c10f390 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:10.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.076+0000 7f79a0ec3700 1 --2- 172.21.15.49:0/4221669146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f799c1085c0 0x7f799c1089a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:10.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.076+0000 7f79a0ec3700 1 --2- 172.21.15.49:0/4221669146 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f799c102520 0x7f799c1029a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:10.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.076+0000 7f79a0ec3700 1 -- 172.21.15.49:0/4221669146 >> 172.21.15.49:0/4221669146 conn(0x7f799c079680 msgr2=0x7f799c079a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:10.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.077+0000 7f79a0ec3700 1 -- 172.21.15.49:0/4221669146 shutdown_connections 2024-06-02T23:57:10.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.077+0000 7f79a0ec3700 1 -- 172.21.15.49:0/4221669146 wait complete. 2024-06-02T23:57:10.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.078+0000 7f79a0ec3700 1 Processor -- start 2024-06-02T23:57:10.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.078+0000 7f79a0ec3700 1 -- start start 2024-06-02T23:57:10.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.078+0000 7f79a0ec3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f799c102520 0x7f799c074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:10.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.078+0000 7f79a0ec3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f799c102ee0 0x7f799c074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:10.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.078+0000 7f79a0ec3700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f799c1085c0 0x7f799c075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:10.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.078+0000 7f79a0ec3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f799c112800 con 0x7f799c102520 2024-06-02T23:57:10.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.078+0000 7f79a0ec3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f799c112680 con 0x7f799c102ee0 2024-06-02T23:57:10.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.078+0000 7f79a0ec3700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f799c112980 con 0x7f799c1085c0 2024-06-02T23:57:10.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.078+0000 7f799a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f799c102520 0x7f799c074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:10.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.078+0000 7f799a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f799c102520 0x7f799c074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52950/0 (socket says 172.21.15.49:52950) 2024-06-02T23:57:10.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.078+0000 7f799a59c700 1 -- 172.21.15.49:0/1997333616 learned_addr learned my addr 172.21.15.49:0/1997333616 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:57:10.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.079+0000 7f7999d9b700 1 --2- 172.21.15.49:0/1997333616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f799c102ee0 0x7f799c074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:10.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.079+0000 7f799ad9d700 1 --2- 172.21.15.49:0/1997333616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f799c1085c0 0x7f799c075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:10.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.079+0000 7f799a59c700 1 -- 172.21.15.49:0/1997333616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f799c1085c0 msgr2=0x7f799c075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:10.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.079+0000 7f799a59c700 1 --2- 172.21.15.49:0/1997333616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f799c1085c0 0x7f799c075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:10.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.079+0000 7f799a59c700 1 -- 172.21.15.49:0/1997333616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f799c102ee0 msgr2=0x7f799c074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:10.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.079+0000 7f799a59c700 1 --2- 172.21.15.49:0/1997333616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f799c102ee0 0x7f799c074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:10.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.079+0000 7f799a59c700 1 -- 172.21.15.49:0/1997333616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f799c1a7130 con 0x7f799c102520 2024-06-02T23:57:10.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.079+0000 7f799a59c700 1 --2- 172.21.15.49:0/1997333616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f799c102520 0x7f799c074790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f798c00d980 tx=0x7f798c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:10.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.079+0000 7f798b7fe700 1 -- 172.21.15.49:0/1997333616 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f798c016070 con 0x7f799c102520 2024-06-02T23:57:10.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.079+0000 7f79a0ec3700 1 -- 172.21.15.49:0/1997333616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f799c1a7420 con 0x7f799c102520 2024-06-02T23:57:10.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.079+0000 7f798b7fe700 1 -- 172.21.15.49:0/1997333616 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f798c004d10 con 0x7f799c102520 2024-06-02T23:57:10.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.079+0000 7f798b7fe700 1 -- 172.21.15.49:0/1997333616 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f798c0055f0 con 0x7f799c102520 2024-06-02T23:57:10.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.080+0000 7f79a0ec3700 1 -- 172.21.15.49:0/1997333616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f799c1a7960 con 0x7f799c102520 2024-06-02T23:57:10.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.080+0000 7f79a0ec3700 1 -- 172.21.15.49:0/1997333616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f799c069180 con 0x7f799c102520 2024-06-02T23:57:10.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.082+0000 7f798b7fe700 1 -- 172.21.15.49:0/1997333616 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f798c004750 con 0x7f799c102520 2024-06-02T23:57:10.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.082+0000 7f798b7fe700 1 --2- 172.21.15.49:0/1997333616 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f79840a2c20 0x7f79840a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:10.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.082+0000 7f7999d9b700 1 --2- 172.21.15.49:0/1997333616 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f79840a2c20 0x7f79840a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:10.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.083+0000 7f798b7fe700 1 -- 172.21.15.49:0/1997333616 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f798c0ce950 con 0x7f799c102520 2024-06-02T23:57:10.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.083+0000 7f7999d9b700 1 --2- 172.21.15.49:0/1997333616 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f79840a2c20 0x7f79840a50e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f799c079c30 tx=0x7f799000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:10.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.087+0000 7f798b7fe700 1 -- 172.21.15.49:0/1997333616 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f798c01f020 con 0x7f799c102520 2024-06-02T23:57:10.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:10.317+0000 7f79a0ec3700 1 -- 172.21.15.49:0/1997333616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f799c02dca0 con 0x7f799c102520 2024-06-02T23:57:10.317 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:10.318 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:10.318 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:10 smithi049 ceph-mon[32302]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:57:10.318 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:10.318 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:10 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:10.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:10 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:10.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:10 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:10.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:10 smithi057 ceph-mon[36457]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:57:10.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:10 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:10.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:10 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:10.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:10 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:10.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:10 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:10.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:10 smithi107 ceph-mon[37048]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:57:10.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:10 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:10.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:10 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:11.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:11.121+0000 7f798b7fe700 1 -- 172.21.15.49:0/1997333616 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) ==== 138+0+0 (secure 0 0 0) 0x7f798c09bd50 con 0x7f799c102520 2024-06-02T23:57:11.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:11.124+0000 7f79a0ec3700 1 -- 172.21.15.49:0/1997333616 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f79840a2c20 msgr2=0x7f79840a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:11.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:11.124+0000 7f79a0ec3700 1 --2- 172.21.15.49:0/1997333616 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f79840a2c20 0x7f79840a50e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f799c079c30 tx=0x7f799000a380 comp rx=0 tx=0).stop 2024-06-02T23:57:11.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:11.124+0000 7f79a0ec3700 1 -- 172.21.15.49:0/1997333616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f799c102520 msgr2=0x7f799c074790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:11.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:11.124+0000 7f79a0ec3700 1 --2- 172.21.15.49:0/1997333616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f799c102520 0x7f799c074790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f798c00d980 tx=0x7f798c00dc90 comp rx=0 tx=0).stop 2024-06-02T23:57:11.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:11.124+0000 7f79a0ec3700 1 -- 172.21.15.49:0/1997333616 shutdown_connections 2024-06-02T23:57:11.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:11.124+0000 7f79a0ec3700 1 --2- 172.21.15.49:0/1997333616 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f79840a2c20 0x7f79840a50e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:11.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:11.124+0000 7f79a0ec3700 1 --2- 172.21.15.49:0/1997333616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f799c1085c0 0x7f799c075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:11.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:11.124+0000 7f79a0ec3700 1 --2- 172.21.15.49:0/1997333616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f799c102520 0x7f799c074790 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:11.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:11.124+0000 7f79a0ec3700 1 --2- 172.21.15.49:0/1997333616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f799c102ee0 0x7f799c074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:11.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:11.124+0000 7f79a0ec3700 1 -- 172.21.15.49:0/1997333616 >> 172.21.15.49:0/1997333616 conn(0x7f799c079680 msgr2=0x7f799c100fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:11.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:11.124+0000 7f79a0ec3700 1 -- 172.21.15.49:0/1997333616 shutdown_connections 2024-06-02T23:57:11.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:11.124+0000 7f79a0ec3700 1 -- 172.21.15.49:0/1997333616 wait complete. 2024-06-02T23:57:11.125 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2024-06-02T23:57:11.443 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:11 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/1997333616' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-02T23:57:11.443 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:11 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:11.443 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:11 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:11.443 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:11 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:57:11.443 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:11 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:57:11.443 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:11 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:11.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:11 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/1997333616' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-02T23:57:11.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:11 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:11.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:11 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:11.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:11 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:57:11.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:11 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:57:11.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:11 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:11.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:11 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/1997333616' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-02T23:57:11.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:11 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:11.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:11 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:11.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:11 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:57:11.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:11 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:57:11.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:11 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:57:11.771 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-06-02T23:57:12.020 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:57:12.404 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:12 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/1997333616' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-06-02T23:57:12.404 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:12 smithi049 ceph-mon[32302]: osdmap e82: 12 total, 12 up, 12 in 2024-06-02T23:57:12.404 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:12 smithi049 ceph-mon[32302]: pgmap v290: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:57:12.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:12 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/1997333616' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-06-02T23:57:12.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:12 smithi057 ceph-mon[36457]: osdmap e82: 12 total, 12 up, 12 in 2024-06-02T23:57:12.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:12 smithi057 ceph-mon[36457]: pgmap v290: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:57:12.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:12 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/1997333616' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-06-02T23:57:12.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:12 smithi107 ceph-mon[37048]: osdmap e82: 12 total, 12 up, 12 in 2024-06-02T23:57:12.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:12 smithi107 ceph-mon[37048]: pgmap v290: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:57:13.334 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:13 smithi049 ceph-mon[32302]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-02T23:57:13.335 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:13 smithi049 ceph-mon[32302]: osdmap e83: 12 total, 12 up, 12 in 2024-06-02T23:57:13.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:13 smithi057 ceph-mon[36457]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-02T23:57:13.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:13 smithi057 ceph-mon[36457]: osdmap e83: 12 total, 12 up, 12 in 2024-06-02T23:57:13.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.589+0000 7f9d1b1ef700 1 -- 172.21.15.49:0/1708912422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d1406ae80 msgr2=0x7f9d1406b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:13.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.589+0000 7f9d1b1ef700 1 --2- 172.21.15.49:0/1708912422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d1406ae80 0x7f9d1406b260 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9d040099c0 tx=0x7f9d04009cd0 comp rx=0 tx=0).stop 2024-06-02T23:57:13.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.589+0000 7f9d1b1ef700 1 -- 172.21.15.49:0/1708912422 shutdown_connections 2024-06-02T23:57:13.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.589+0000 7f9d1b1ef700 1 --2- 172.21.15.49:0/1708912422 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d14107850 0x7f9d1410f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:13.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.589+0000 7f9d1b1ef700 1 --2- 172.21.15.49:0/1708912422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d1406ae80 0x7f9d1406b260 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:13.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.589+0000 7f9d1b1ef700 1 --2- 172.21.15.49:0/1708912422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d1406b830 0x7f9d14107120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:13.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.589+0000 7f9d1b1ef700 1 -- 172.21.15.49:0/1708912422 >> 172.21.15.49:0/1708912422 conn(0x7f9d14078400 msgr2=0x7f9d14078810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:13.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.589+0000 7f9d1b1ef700 1 -- 172.21.15.49:0/1708912422 shutdown_connections 2024-06-02T23:57:13.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.589+0000 7f9d1b1ef700 1 -- 172.21.15.49:0/1708912422 wait complete. 2024-06-02T23:57:13.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.590+0000 7f9d1b1ef700 1 Processor -- start 2024-06-02T23:57:13.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.590+0000 7f9d1b1ef700 1 -- start start 2024-06-02T23:57:13.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.591+0000 7f9d1b1ef700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d1406ae80 0x7f9d1419ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:13.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.591+0000 7f9d1b1ef700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d1406b830 0x7f9d1419b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:13.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.591+0000 7f9d1b1ef700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d14107850 0x7f9d1419f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:13.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.591+0000 7f9d1b1ef700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9d14112840 con 0x7f9d1406b830 2024-06-02T23:57:13.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.591+0000 7f9d1b1ef700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9d141126c0 con 0x7f9d1406ae80 2024-06-02T23:57:13.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.591+0000 7f9d1b1ef700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9d141129c0 con 0x7f9d14107850 2024-06-02T23:57:13.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.591+0000 7f9d13fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d1406b830 0x7f9d1419b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:13.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.591+0000 7f9d18f8b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d1406ae80 0x7f9d1419ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:13.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.591+0000 7f9d13fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d1406b830 0x7f9d1419b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55840/0 (socket says 172.21.15.49:55840) 2024-06-02T23:57:13.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.591+0000 7f9d18f8b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d1406ae80 0x7f9d1419ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.49:51204/0 (socket says 172.21.15.49:51204) 2024-06-02T23:57:13.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.591+0000 7f9d13fff700 1 -- 172.21.15.49:0/3639496566 learned_addr learned my addr 172.21.15.49:0/3639496566 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:57:13.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.591+0000 7f9d1978c700 1 --2- 172.21.15.49:0/3639496566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d14107850 0x7f9d1419f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:13.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.591+0000 7f9d13fff700 1 -- 172.21.15.49:0/3639496566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d14107850 msgr2=0x7f9d1419f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:13.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.591+0000 7f9d13fff700 1 --2- 172.21.15.49:0/3639496566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d14107850 0x7f9d1419f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:13.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.591+0000 7f9d13fff700 1 -- 172.21.15.49:0/3639496566 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d1406ae80 msgr2=0x7f9d1419ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:13.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.591+0000 7f9d13fff700 1 --2- 172.21.15.49:0/3639496566 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d1406ae80 0x7f9d1419ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:13.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.591+0000 7f9d13fff700 1 -- 172.21.15.49:0/3639496566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d1419fe30 con 0x7f9d1406b830 2024-06-02T23:57:13.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.591+0000 7f9d13fff700 1 --2- 172.21.15.49:0/3639496566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d1406b830 0x7f9d1419b360 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9d0800c920 tx=0x7f9d0800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:13.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.592+0000 7f9d11ffb700 1 -- 172.21.15.49:0/3639496566 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d08007b00 con 0x7f9d1406b830 2024-06-02T23:57:13.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.592+0000 7f9d11ffb700 1 -- 172.21.15.49:0/3639496566 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d08004d10 con 0x7f9d1406b830 2024-06-02T23:57:13.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.592+0000 7f9d1b1ef700 1 -- 172.21.15.49:0/3639496566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d141a0120 con 0x7f9d1406b830 2024-06-02T23:57:13.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.592+0000 7f9d11ffb700 1 -- 172.21.15.49:0/3639496566 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d08005680 con 0x7f9d1406b830 2024-06-02T23:57:13.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.592+0000 7f9d1b1ef700 1 -- 172.21.15.49:0/3639496566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d141a79a0 con 0x7f9d1406b830 2024-06-02T23:57:13.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.593+0000 7f9d1b1ef700 1 -- 172.21.15.49:0/3639496566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d14069180 con 0x7f9d1406b830 2024-06-02T23:57:13.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.594+0000 7f9d11ffb700 1 -- 172.21.15.49:0/3639496566 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9d08004750 con 0x7f9d1406b830 2024-06-02T23:57:13.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.595+0000 7f9d11ffb700 1 --2- 172.21.15.49:0/3639496566 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9cfc0a2c20 0x7f9cfc0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:13.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.595+0000 7f9d11ffb700 1 -- 172.21.15.49:0/3639496566 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7497+0+0 (secure 0 0 0) 0x7f9d080cecb0 con 0x7f9d1406b830 2024-06-02T23:57:13.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.595+0000 7f9d18f8b700 1 --2- 172.21.15.49:0/3639496566 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9cfc0a2c20 0x7f9cfc0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:13.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.595+0000 7f9d18f8b700 1 --2- 172.21.15.49:0/3639496566 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9cfc0a2c20 0x7f9cfc0a50e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9d04000c00 tx=0x7f9d04005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:13.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.598+0000 7f9d11ffb700 1 -- 172.21.15.49:0/3639496566 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9d08014030 con 0x7f9d1406b830 2024-06-02T23:57:13.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:13 smithi107 ceph-mon[37048]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-02T23:57:13.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:13 smithi107 ceph-mon[37048]: osdmap e83: 12 total, 12 up, 12 in 2024-06-02T23:57:13.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:13.803+0000 7f9d1b1ef700 1 -- 172.21.15.49:0/3639496566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f9d1419c180 con 0x7f9d1406b830 2024-06-02T23:57:14.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:14.292+0000 7f9d11ffb700 1 -- 172.21.15.49:0/3639496566 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v85) ==== 170+0+0 (secure 0 0 0) 0x7f9d1419c180 con 0x7f9d1406b830 2024-06-02T23:57:14.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:14.295+0000 7f9d1b1ef700 1 -- 172.21.15.49:0/3639496566 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9cfc0a2c20 msgr2=0x7f9cfc0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:14.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:14.295+0000 7f9d1b1ef700 1 --2- 172.21.15.49:0/3639496566 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9cfc0a2c20 0x7f9cfc0a50e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9d04000c00 tx=0x7f9d04005fb0 comp rx=0 tx=0).stop 2024-06-02T23:57:14.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:14.295+0000 7f9d1b1ef700 1 -- 172.21.15.49:0/3639496566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d1406b830 msgr2=0x7f9d1419b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:14.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:14.295+0000 7f9d1b1ef700 1 --2- 172.21.15.49:0/3639496566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d1406b830 0x7f9d1419b360 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9d0800c920 tx=0x7f9d0800cc30 comp rx=0 tx=0).stop 2024-06-02T23:57:14.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:14.295+0000 7f9d1b1ef700 1 -- 172.21.15.49:0/3639496566 shutdown_connections 2024-06-02T23:57:14.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:14.295+0000 7f9d1b1ef700 1 --2- 172.21.15.49:0/3639496566 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9cfc0a2c20 0x7f9cfc0a50e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:14.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:14.295+0000 7f9d1b1ef700 1 --2- 172.21.15.49:0/3639496566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d14107850 0x7f9d1419f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:14.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:14.295+0000 7f9d1b1ef700 1 --2- 172.21.15.49:0/3639496566 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d1406ae80 0x7f9d1419ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:14.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:14.295+0000 7f9d1b1ef700 1 --2- 172.21.15.49:0/3639496566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d1406b830 0x7f9d1419b360 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:14.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:14.295+0000 7f9d1b1ef700 1 -- 172.21.15.49:0/3639496566 >> 172.21.15.49:0/3639496566 conn(0x7f9d14078400 msgr2=0x7f9d1410d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:14.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:14.295+0000 7f9d1b1ef700 1 -- 172.21.15.49:0/3639496566 shutdown_connections 2024-06-02T23:57:14.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:14.295+0000 7f9d1b1ef700 1 -- 172.21.15.49:0/3639496566 wait complete. 2024-06-02T23:57:14.297 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2024-06-02T23:57:14.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:14 smithi107 ceph-mon[37048]: osdmap e84: 12 total, 12 up, 12 in 2024-06-02T23:57:14.606 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:14 smithi049 ceph-mon[32302]: osdmap e84: 12 total, 12 up, 12 in 2024-06-02T23:57:14.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:14 smithi057 ceph-mon[36457]: osdmap e84: 12 total, 12 up, 12 in 2024-06-02T23:57:14.877 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-06-02T23:57:15.126 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:57:15.594 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:15 smithi049 ceph-mon[32302]: pgmap v293: 33 pgs: 3 creating+peering, 6 active+clean, 24 unknown; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:57:15.594 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:15 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3639496566' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-02T23:57:15.594 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:15 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3639496566' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-06-02T23:57:15.594 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:15 smithi049 ceph-mon[32302]: osdmap e85: 12 total, 12 up, 12 in 2024-06-02T23:57:15.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:15 smithi107 ceph-mon[37048]: pgmap v293: 33 pgs: 3 creating+peering, 6 active+clean, 24 unknown; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:57:15.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:15 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/3639496566' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-02T23:57:15.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:15 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/3639496566' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-06-02T23:57:15.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:15 smithi107 ceph-mon[37048]: osdmap e85: 12 total, 12 up, 12 in 2024-06-02T23:57:15.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:15 smithi057 ceph-mon[36457]: pgmap v293: 33 pgs: 3 creating+peering, 6 active+clean, 24 unknown; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:57:15.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:15 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/3639496566' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-02T23:57:15.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:15 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/3639496566' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-06-02T23:57:15.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:15 smithi057 ceph-mon[36457]: osdmap e85: 12 total, 12 up, 12 in 2024-06-02T23:57:16.501 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:16 smithi049 ceph-mon[32302]: pgmap v295: 97 pgs: 13 creating+peering, 30 active+clean, 54 unknown; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:57:16.501 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:16 smithi049 ceph-mon[32302]: osdmap e86: 12 total, 12 up, 12 in 2024-06-02T23:57:16.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:16 smithi107 ceph-mon[37048]: pgmap v295: 97 pgs: 13 creating+peering, 30 active+clean, 54 unknown; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:57:16.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:16 smithi107 ceph-mon[37048]: osdmap e86: 12 total, 12 up, 12 in 2024-06-02T23:57:16.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:16 smithi057 ceph-mon[36457]: pgmap v295: 97 pgs: 13 creating+peering, 30 active+clean, 54 unknown; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:57:16.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:16 smithi057 ceph-mon[36457]: osdmap e86: 12 total, 12 up, 12 in 2024-06-02T23:57:16.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.725+0000 7f0b786ab700 1 -- 172.21.15.49:0/1877377899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b70102530 msgr2=0x7f0b701029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:16.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.725+0000 7f0b786ab700 1 --2- 172.21.15.49:0/1877377899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b70102530 0x7f0b701029b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0b600099c0 tx=0x7f0b60009cd0 comp rx=0 tx=0).stop 2024-06-02T23:57:16.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.725+0000 7f0b786ab700 1 -- 172.21.15.49:0/1877377899 shutdown_connections 2024-06-02T23:57:16.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.725+0000 7f0b786ab700 1 --2- 172.21.15.49:0/1877377899 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b70102ef0 0x7f0b7010f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:16.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.725+0000 7f0b786ab700 1 --2- 172.21.15.49:0/1877377899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b701085d0 0x7f0b701089b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:16.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.725+0000 7f0b786ab700 1 --2- 172.21.15.49:0/1877377899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b70102530 0x7f0b701029b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:16.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.725+0000 7f0b786ab700 1 -- 172.21.15.49:0/1877377899 >> 172.21.15.49:0/1877377899 conn(0x7f0b70079640 msgr2=0x7f0b70079a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:16.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.725+0000 7f0b786ab700 1 -- 172.21.15.49:0/1877377899 shutdown_connections 2024-06-02T23:57:16.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.725+0000 7f0b786ab700 1 -- 172.21.15.49:0/1877377899 wait complete. 2024-06-02T23:57:16.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.726+0000 7f0b786ab700 1 Processor -- start 2024-06-02T23:57:16.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.726+0000 7f0b786ab700 1 -- start start 2024-06-02T23:57:16.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.726+0000 7f0b786ab700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b70102530 0x7f0b7019e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:16.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.726+0000 7f0b786ab700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b70102ef0 0x7f0b7019edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:16.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.726+0000 7f0b786ab700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b701085d0 0x7f0b70198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:16.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.726+0000 7f0b786ab700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0b70112830 con 0x7f0b70102530 2024-06-02T23:57:16.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.726+0000 7f0b786ab700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0b701126b0 con 0x7f0b70102ef0 2024-06-02T23:57:16.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.726+0000 7f0b786ab700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0b701129b0 con 0x7f0b701085d0 2024-06-02T23:57:16.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.726+0000 7f0b76447700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b70102530 0x7f0b7019e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:16.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.726+0000 7f0b76447700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b70102530 0x7f0b7019e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55852/0 (socket says 172.21.15.49:55852) 2024-06-02T23:57:16.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.726+0000 7f0b76447700 1 -- 172.21.15.49:0/1598842178 learned_addr learned my addr 172.21.15.49:0/1598842178 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:57:16.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.727+0000 7f0b75c46700 1 --2- 172.21.15.49:0/1598842178 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b70102ef0 0x7f0b7019edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:16.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.727+0000 7f0b76c48700 1 --2- 172.21.15.49:0/1598842178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b701085d0 0x7f0b70198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:16.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.727+0000 7f0b76447700 1 -- 172.21.15.49:0/1598842178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b701085d0 msgr2=0x7f0b70198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:16.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.727+0000 7f0b76447700 1 --2- 172.21.15.49:0/1598842178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b701085d0 0x7f0b70198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:16.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.727+0000 7f0b76447700 1 -- 172.21.15.49:0/1598842178 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b70102ef0 msgr2=0x7f0b7019edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:16.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.727+0000 7f0b76447700 1 --2- 172.21.15.49:0/1598842178 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b70102ef0 0x7f0b7019edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:16.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.727+0000 7f0b76447700 1 -- 172.21.15.49:0/1598842178 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b70199190 con 0x7f0b70102530 2024-06-02T23:57:16.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.727+0000 7f0b76447700 1 --2- 172.21.15.49:0/1598842178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b70102530 0x7f0b7019e870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c00d980 tx=0x7f0b6c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:16.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.727+0000 7f0b677fe700 1 -- 172.21.15.49:0/1598842178 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c017070 con 0x7f0b70102530 2024-06-02T23:57:16.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.727+0000 7f0b677fe700 1 -- 172.21.15.49:0/1598842178 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b6c005020 con 0x7f0b70102530 2024-06-02T23:57:16.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.727+0000 7f0b786ab700 1 -- 172.21.15.49:0/1598842178 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b70199480 con 0x7f0b70102530 2024-06-02T23:57:16.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.727+0000 7f0b677fe700 1 -- 172.21.15.49:0/1598842178 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c00fbf0 con 0x7f0b70102530 2024-06-02T23:57:16.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.727+0000 7f0b786ab700 1 -- 172.21.15.49:0/1598842178 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b701a5740 con 0x7f0b70102530 2024-06-02T23:57:16.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.728+0000 7f0b786ab700 1 -- 172.21.15.49:0/1598842178 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b70103c40 con 0x7f0b70102530 2024-06-02T23:57:16.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.729+0000 7f0b677fe700 1 -- 172.21.15.49:0/1598842178 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0b6c0051d0 con 0x7f0b70102530 2024-06-02T23:57:16.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.730+0000 7f0b677fe700 1 --2- 172.21.15.49:0/1598842178 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f0b5c0a2ca0 0x7f0b5c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:16.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.730+0000 7f0b75c46700 1 --2- 172.21.15.49:0/1598842178 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f0b5c0a2ca0 0x7f0b5c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:16.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.730+0000 7f0b677fe700 1 -- 172.21.15.49:0/1598842178 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 7879+0+0 (secure 0 0 0) 0x7f0b6c0cf030 con 0x7f0b70102530 2024-06-02T23:57:16.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.731+0000 7f0b75c46700 1 --2- 172.21.15.49:0/1598842178 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f0b5c0a2ca0 0x7f0b5c0a5160 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0b70079ad0 tx=0x7f0b60005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:16.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.734+0000 7f0b677fe700 1 -- 172.21.15.49:0/1598842178 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f0b6c020020 con 0x7f0b70102530 2024-06-02T23:57:16.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:16.990+0000 7f0b786ab700 1 -- 172.21.15.49:0/1598842178 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f0b701a5970 con 0x7f0b70102530 2024-06-02T23:57:17.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:17.322+0000 7f0b677fe700 1 -- 172.21.15.49:0/1598842178 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f0b6c09c1c0 con 0x7f0b70102530 2024-06-02T23:57:17.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:17.325+0000 7f0b786ab700 1 -- 172.21.15.49:0/1598842178 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f0b5c0a2ca0 msgr2=0x7f0b5c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:17.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:17.325+0000 7f0b786ab700 1 --2- 172.21.15.49:0/1598842178 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f0b5c0a2ca0 0x7f0b5c0a5160 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0b70079ad0 tx=0x7f0b60005fb0 comp rx=0 tx=0).stop 2024-06-02T23:57:17.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:17.325+0000 7f0b786ab700 1 -- 172.21.15.49:0/1598842178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b70102530 msgr2=0x7f0b7019e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:17.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:17.325+0000 7f0b786ab700 1 --2- 172.21.15.49:0/1598842178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b70102530 0x7f0b7019e870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c00d980 tx=0x7f0b6c00dc90 comp rx=0 tx=0).stop 2024-06-02T23:57:17.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:17.325+0000 7f0b786ab700 1 -- 172.21.15.49:0/1598842178 shutdown_connections 2024-06-02T23:57:17.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:17.325+0000 7f0b786ab700 1 --2- 172.21.15.49:0/1598842178 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f0b5c0a2ca0 0x7f0b5c0a5160 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:17.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:17.325+0000 7f0b786ab700 1 --2- 172.21.15.49:0/1598842178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b701085d0 0x7f0b70198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:17.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:17.325+0000 7f0b786ab700 1 --2- 172.21.15.49:0/1598842178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b70102530 0x7f0b7019e870 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:17.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:17.325+0000 7f0b786ab700 1 --2- 172.21.15.49:0/1598842178 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b70102ef0 0x7f0b7019edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:17.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:17.325+0000 7f0b786ab700 1 -- 172.21.15.49:0/1598842178 >> 172.21.15.49:0/1598842178 conn(0x7f0b70079640 msgr2=0x7f0b70100fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:17.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:17.325+0000 7f0b786ab700 1 -- 172.21.15.49:0/1598842178 shutdown_connections 2024-06-02T23:57:17.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:17.325+0000 7f0b786ab700 1 -- 172.21.15.49:0/1598842178 wait complete. 2024-06-02T23:57:17.326 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 2 and data pool 3 2024-06-02T23:57:17.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:17 smithi107 ceph-mon[37048]: osdmap e87: 12 total, 12 up, 12 in 2024-06-02T23:57:17.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:17 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/1598842178' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-02T23:57:17.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:17 smithi107 ceph-mon[37048]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-06-02T23:57:17.637 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:17 smithi049 ceph-mon[32302]: osdmap e87: 12 total, 12 up, 12 in 2024-06-02T23:57:17.637 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:17 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/1598842178' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-02T23:57:17.637 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:17 smithi049 ceph-mon[32302]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-06-02T23:57:17.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:17 smithi057 ceph-mon[36457]: osdmap e87: 12 total, 12 up, 12 in 2024-06-02T23:57:17.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:17 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/1598842178' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-02T23:57:17.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:17 smithi057 ceph-mon[36457]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-06-02T23:57:17.954 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-02T23:57:18.210 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:57:18.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:18 smithi107 ceph-mon[37048]: pgmap v298: 97 pgs: 10 creating+peering, 37 active+clean, 50 unknown; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:57:18.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:18 smithi107 ceph-mon[37048]: osdmap e88: 12 total, 12 up, 12 in 2024-06-02T23:57:18.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:18 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/1598842178' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-06-02T23:57:18.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:18 smithi107 ceph-mon[37048]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-06-02T23:57:18.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:18 smithi107 ceph-mon[37048]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-06-02T23:57:18.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:18 smithi107 ceph-mon[37048]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-02T23:57:18.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:18 smithi107 ceph-mon[37048]: mds.? [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] up:active 2024-06-02T23:57:18.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:18 smithi107 ceph-mon[37048]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-02T23:57:18.633 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:18 smithi049 ceph-mon[32302]: pgmap v298: 97 pgs: 10 creating+peering, 37 active+clean, 50 unknown; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:57:18.633 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:18 smithi049 ceph-mon[32302]: osdmap e88: 12 total, 12 up, 12 in 2024-06-02T23:57:18.634 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:18 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/1598842178' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-06-02T23:57:18.634 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:18 smithi049 ceph-mon[32302]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-06-02T23:57:18.634 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:18 smithi049 ceph-mon[32302]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-06-02T23:57:18.634 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:18 smithi049 ceph-mon[32302]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-02T23:57:18.634 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:18 smithi049 ceph-mon[32302]: mds.? [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] up:active 2024-06-02T23:57:18.634 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:18 smithi049 ceph-mon[32302]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-02T23:57:18.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:18 smithi057 ceph-mon[36457]: pgmap v298: 97 pgs: 10 creating+peering, 37 active+clean, 50 unknown; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T23:57:18.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:18 smithi057 ceph-mon[36457]: osdmap e88: 12 total, 12 up, 12 in 2024-06-02T23:57:18.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:18 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/1598842178' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-06-02T23:57:18.701 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:18 smithi057 ceph-mon[36457]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-06-02T23:57:18.701 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:18 smithi057 ceph-mon[36457]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-06-02T23:57:18.701 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:18 smithi057 ceph-mon[36457]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-02T23:57:18.701 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:18 smithi057 ceph-mon[36457]: mds.? [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] up:active 2024-06-02T23:57:18.701 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:18 smithi057 ceph-mon[36457]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-02T23:57:19.100 INFO:journalctl@ceph.mds.i.smithi107.stdout:Jun 02 23:57:18 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-i[68110]: 2024-06-02T23:57:18.636+0000 7f58ba595700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-02T23:57:19.597 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:19 smithi049 ceph-mon[32302]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-06-02T23:57:19.598 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:19 smithi049 ceph-mon[32302]: Cluster is now healthy 2024-06-02T23:57:19.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:19 smithi057 ceph-mon[36457]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-06-02T23:57:19.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:19 smithi057 ceph-mon[36457]: Cluster is now healthy 2024-06-02T23:57:19.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.813+0000 7fb86c332700 1 -- 172.21.15.49:0/2259621216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb864107400 msgr2=0x7fb8641077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:19.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.813+0000 7fb86c332700 1 --2- 172.21.15.49:0/2259621216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb864107400 0x7fb8641077e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb860009990 tx=0x7fb860009ca0 comp rx=0 tx=0).stop 2024-06-02T23:57:19.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.813+0000 7fb86c332700 1 -- 172.21.15.49:0/2259621216 shutdown_connections 2024-06-02T23:57:19.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.813+0000 7fb86c332700 1 --2- 172.21.15.49:0/2259621216 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb864101d50 0x7fb86410e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:19.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.813+0000 7fb86c332700 1 --2- 172.21.15.49:0/2259621216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb864107400 0x7fb8641077e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:19.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.813+0000 7fb86c332700 1 --2- 172.21.15.49:0/2259621216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb864101390 0x7fb864101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:19.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.813+0000 7fb86c332700 1 -- 172.21.15.49:0/2259621216 >> 172.21.15.49:0/2259621216 conn(0x7fb864078340 msgr2=0x7fb864078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:19.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.814+0000 7fb86c332700 1 -- 172.21.15.49:0/2259621216 shutdown_connections 2024-06-02T23:57:19.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.814+0000 7fb86c332700 1 -- 172.21.15.49:0/2259621216 wait complete. 2024-06-02T23:57:19.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.814+0000 7fb86c332700 1 Processor -- start 2024-06-02T23:57:19.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.814+0000 7fb86c332700 1 -- start start 2024-06-02T23:57:19.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.814+0000 7fb86c332700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb864101390 0x7fb864198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:19.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.814+0000 7fb86c332700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb864101d50 0x7fb864199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:19.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.814+0000 7fb86c332700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb864107400 0x7fb86419d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:19.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.814+0000 7fb86c332700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb8641116f0 con 0x7fb864101d50 2024-06-02T23:57:19.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.814+0000 7fb86c332700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb864111570 con 0x7fb864107400 2024-06-02T23:57:19.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.815+0000 7fb86c332700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb864111870 con 0x7fb864101390 2024-06-02T23:57:19.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.815+0000 7fb8698cd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb864101d50 0x7fb864199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:19.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.815+0000 7fb8698cd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb864101d50 0x7fb864199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55866/0 (socket says 172.21.15.49:55866) 2024-06-02T23:57:19.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.815+0000 7fb8698cd700 1 -- 172.21.15.49:0/3099252978 learned_addr learned my addr 172.21.15.49:0/3099252978 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:57:19.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.815+0000 7fb86a8cf700 1 --2- 172.21.15.49:0/3099252978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb864107400 0x7fb86419d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:19.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.815+0000 7fb86a0ce700 1 --2- 172.21.15.49:0/3099252978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb864101390 0x7fb864198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:19.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.815+0000 7fb8698cd700 1 -- 172.21.15.49:0/3099252978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb864101390 msgr2=0x7fb864198d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:19.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.815+0000 7fb8698cd700 1 --2- 172.21.15.49:0/3099252978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb864101390 0x7fb864198d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:19.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.815+0000 7fb8698cd700 1 -- 172.21.15.49:0/3099252978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb864107400 msgr2=0x7fb86419d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:19.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.815+0000 7fb8698cd700 1 --2- 172.21.15.49:0/3099252978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb864107400 0x7fb86419d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:19.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.815+0000 7fb8698cd700 1 -- 172.21.15.49:0/3099252978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb86419dd40 con 0x7fb864101d50 2024-06-02T23:57:19.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.815+0000 7fb86a8cf700 1 --2- 172.21.15.49:0/3099252978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb864107400 0x7fb86419d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:57:19.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.815+0000 7fb8698cd700 1 --2- 172.21.15.49:0/3099252978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb864101d50 0x7fb864199270 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb85400b530 tx=0x7fb85400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:19.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.815+0000 7fb85b7fe700 1 -- 172.21.15.49:0/3099252978 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb854015020 con 0x7fb864101d50 2024-06-02T23:57:19.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.815+0000 7fb85b7fe700 1 -- 172.21.15.49:0/3099252978 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb854011d10 con 0x7fb864101d50 2024-06-02T23:57:19.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.815+0000 7fb86c332700 1 -- 172.21.15.49:0/3099252978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb86419e030 con 0x7fb864101d50 2024-06-02T23:57:19.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.815+0000 7fb85b7fe700 1 -- 172.21.15.49:0/3099252978 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb854010e50 con 0x7fb864101d50 2024-06-02T23:57:19.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.815+0000 7fb86c332700 1 -- 172.21.15.49:0/3099252978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8641a58b0 con 0x7fb864101d50 2024-06-02T23:57:19.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.816+0000 7fb86c332700 1 -- 172.21.15.49:0/3099252978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb864069180 con 0x7fb864101d50 2024-06-02T23:57:19.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.818+0000 7fb85b7fe700 1 -- 172.21.15.49:0/3099252978 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb854018020 con 0x7fb864101d50 2024-06-02T23:57:19.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.818+0000 7fb85b7fe700 1 --2- 172.21.15.49:0/3099252978 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fb8500a2dc0 0x7fb8500a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:19.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.818+0000 7fb86a0ce700 1 --2- 172.21.15.49:0/3099252978 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fb8500a2dc0 0x7fb8500a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:19.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.818+0000 7fb85b7fe700 1 -- 172.21.15.49:0/3099252978 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7fb8540cecb0 con 0x7fb864101d50 2024-06-02T23:57:19.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.819+0000 7fb86a0ce700 1 --2- 172.21.15.49:0/3099252978 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fb8500a2dc0 0x7fb8500a5280 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb860009750 tx=0x7fb86000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:19.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:19.822+0000 7fb85b7fe700 1 -- 172.21.15.49:0/3099252978 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb85401f020 con 0x7fb864101d50 2024-06-02T23:57:19.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:19 smithi107 ceph-mon[37048]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-06-02T23:57:19.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:19 smithi107 ceph-mon[37048]: Cluster is now healthy 2024-06-02T23:57:20.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:20.028+0000 7fb86c332700 1 -- 172.21.15.49:0/3099252978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb86419a090 con 0x7fb864101d50 2024-06-02T23:57:20.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:20.030+0000 7fb85b7fe700 1 -- 172.21.15.49:0/3099252978 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22134 (secure 0 0 0) 0x7fb86419a090 con 0x7fb864101d50 2024-06-02T23:57:20.030 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:57:20.030 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":88,"fsid":"890dd222-213a-11ef-bc9b-c7b262605968","created":"2024-06-02T23:48:53.323536+0000","modified":"2024-06-02T23:57:16.991066+0000","last_up_change":"2024-06-02T23:56:12.156697+0000","last_in_change":"2024-06-02T23:55:51.667118+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:52:23.676079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:57:10.753178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T23:57:14.240610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e0013e80-07d6-4ad3-87d8-d41988988ef5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6803","nonce":811647073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6805","nonce":811647073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6809","nonce":811647073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6807","nonce":811647073}]},"public_addr":"172.21.15.49:6803/811647073","cluster_addr":"172.21.15.49:6805/811647073","heartbeat_back_addr":"172.21.15.49:6809/811647073","heartbeat_front_addr":"172.21.15.49:6807/811647073","state":["exists","up"]},{"osd":1,"uuid":"f37d9f79-e349-4de7-81e7-385ddb905f58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6801","nonce":1260507785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6803","nonce":1260507785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6807","nonce":1260507785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6805","nonce":1260507785}]},"public_addr":"172.21.15.57:6801/1260507785","cluster_addr":"172.21.15.57:6803/1260507785","heartbeat_back_addr":"172.21.15.57:6807/1260507785","heartbeat_front_addr":"172.21.15.57:6805/1260507785","state":["exists","up"]},{"osd":2,"uuid":"94889281-7d45-4e78-9d37-b98e3fbe8494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6801","nonce":303899951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6803","nonce":303899951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6807","nonce":303899951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6805","nonce":303899951}]},"public_addr":"172.21.15.107:6801/303899951","cluster_addr":"172.21.15.107:6803/303899951","heartbeat_back_addr":"172.21.15.107:6807/303899951","heartbeat_front_addr":"172.21.15.107:6805/303899951","state":["exists","up"]},{"osd":3,"uuid":"31f4c18c-fbda-400d-8b3b-0955b0c4a6a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6811","nonce":60796312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6813","nonce":60796312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6817","nonce":60796312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6815","nonce":60796312}]},"public_addr":"172.21.15.49:6811/60796312","cluster_addr":"172.21.15.49:6813/60796312","heartbeat_back_addr":"172.21.15.49:6817/60796312","heartbeat_front_addr":"172.21.15.49:6815/60796312","state":["exists","up"]},{"osd":4,"uuid":"8076c2f3-0138-459e-89b5-c5c4586a14ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6809","nonce":3106842986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6811","nonce":3106842986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6815","nonce":3106842986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6813","nonce":3106842986}]},"public_addr":"172.21.15.57:6809/3106842986","cluster_addr":"172.21.15.57:6811/3106842986","heartbeat_back_addr":"172.21.15.57:6815/3106842986","heartbeat_front_addr":"172.21.15.57:6813/3106842986","state":["exists","up"]},{"osd":5,"uuid":"68f7abd3-4292-41fa-90ce-4ac34ea2b964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6809","nonce":389294142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6811","nonce":389294142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6815","nonce":389294142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6813","nonce":389294142}]},"public_addr":"172.21.15.107:6809/389294142","cluster_addr":"172.21.15.107:6811/389294142","heartbeat_back_addr":"172.21.15.107:6815/389294142","heartbeat_front_addr":"172.21.15.107:6813/389294142","state":["exists","up"]},{"osd":6,"uuid":"c0345dd0-71b7-436d-88f8-fe3d7cb69d8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6819","nonce":894624552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6821","nonce":894624552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6825","nonce":894624552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6823","nonce":894624552}]},"public_addr":"172.21.15.49:6819/894624552","cluster_addr":"172.21.15.49:6821/894624552","heartbeat_back_addr":"172.21.15.49:6825/894624552","heartbeat_front_addr":"172.21.15.49:6823/894624552","state":["exists","up"]},{"osd":7,"uuid":"9abd81c7-dcc1-4e14-8ab7-9fa0746067ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6817","nonce":3126027900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6819","nonce":3126027900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6823","nonce":3126027900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6821","nonce":3126027900}]},"public_addr":"172.21.15.57:6817/3126027900","cluster_addr":"172.21.15.57:6819/3126027900","heartbeat_back_addr":"172.21.15.57:6823/3126027900","heartbeat_front_addr":"172.21.15.57:6821/3126027900","state":["exists","up"]},{"osd":8,"uuid":"80532119-5de8-45d2-9cb9-bd8a6194199b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6817","nonce":3620047229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6819","nonce":3620047229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6823","nonce":3620047229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6821","nonce":3620047229}]},"public_addr":"172.21.15.107:6817/3620047229","cluster_addr":"172.21.15.107:6819/3620047229","heartbeat_back_addr":"172.21.15.107:6823/3620047229","heartbeat_front_addr":"172.21.15.107:6821/3620047229","state":["exists","up"]},{"osd":9,"uuid":"f0b5dcfa-9fd2-4a98-863b-197defa890af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6827","nonce":3627936526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6829","nonce":3627936526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6833","nonce":3627936526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6831","nonce":3627936526}]},"public_addr":"172.21.15.49:6827/3627936526","cluster_addr":"172.21.15.49:6829/3627936526","heartbeat_back_addr":"172.21.15.49:6833/3627936526","heartbeat_front_addr":"172.21.15.49:6831/3627936526","state":["exists","up"]},{"osd":10,"uuid":"21a75846-adec-41b8-9e1d-e5c61ba30b12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6825","nonce":3013235811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6827","nonce":3013235811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6831","nonce":3013235811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6829","nonce":3013235811}]},"public_addr":"172.21.15.57:6825/3013235811","cluster_addr":"172.21.15.57:6827/3013235811","heartbeat_back_addr":"172.21.15.57:6831/3013235811","heartbeat_front_addr":"172.21.15.57:6829/3013235811","state":["exists","up"]},{"osd":11,"uuid":"eb963b63-2c61-4169-b8fe-31c7f5ec919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6825","nonce":4217534517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6827","nonce":4217534517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6831","nonce":4217534517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6829","nonce":4217534517}]},"public_addr":"172.21.15.107:6825/4217534517","cluster_addr":"172.21.15.107:6827/4217534517","heartbeat_back_addr":"172.21.15.107:6831/4217534517","heartbeat_front_addr":"172.21.15.107:6829/4217534517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:51:31.067312+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:51:56.088456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:52:20.539941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:52:45.055717+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:53:11.178438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:53:35.794217+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:00.775674+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:27.574752+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:52.177634+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:55:17.118854+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:55:44.217535+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:56:10.500970+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/525944311":"2024-06-03T23:49:55.151590+0000","172.21.15.49:0/1841969299":"2024-06-03T23:49:55.151590+0000","172.21.15.49:0/1880506696":"2024-06-03T23:49:55.151590+0000","172.21.15.49:6801/1206062338":"2024-06-03T23:49:55.151590+0000","172.21.15.49:6800/549058216":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/2112783954":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/2183920213":"2024-06-03T23:49:29.042670+0000","172.21.15.49:6801/549058216":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/3350970308":"2024-06-03T23:49:29.042670+0000","172.21.15.49:6800/1206062338":"2024-06-03T23:49:55.151590+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:57:20.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:20.032+0000 7fb86c332700 1 -- 172.21.15.49:0/3099252978 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fb8500a2dc0 msgr2=0x7fb8500a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:20.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:20.032+0000 7fb86c332700 1 --2- 172.21.15.49:0/3099252978 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fb8500a2dc0 0x7fb8500a5280 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb860009750 tx=0x7fb86000b540 comp rx=0 tx=0).stop 2024-06-02T23:57:20.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:20.032+0000 7fb86c332700 1 -- 172.21.15.49:0/3099252978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb864101d50 msgr2=0x7fb864199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:20.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:20.032+0000 7fb86c332700 1 --2- 172.21.15.49:0/3099252978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb864101d50 0x7fb864199270 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb85400b530 tx=0x7fb85400b8f0 comp rx=0 tx=0).stop 2024-06-02T23:57:20.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:20.032+0000 7fb86c332700 1 -- 172.21.15.49:0/3099252978 shutdown_connections 2024-06-02T23:57:20.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:20.032+0000 7fb86c332700 1 --2- 172.21.15.49:0/3099252978 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fb8500a2dc0 0x7fb8500a5280 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:20.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:20.032+0000 7fb86c332700 1 --2- 172.21.15.49:0/3099252978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb864107400 0x7fb86419d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:20.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:20.032+0000 7fb86c332700 1 --2- 172.21.15.49:0/3099252978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb864101390 0x7fb864198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:20.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:20.032+0000 7fb86c332700 1 --2- 172.21.15.49:0/3099252978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb864101d50 0x7fb864199270 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:20.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:20.032+0000 7fb86c332700 1 -- 172.21.15.49:0/3099252978 >> 172.21.15.49:0/3099252978 conn(0x7fb864078340 msgr2=0x7fb864105760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:20.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:20.033+0000 7fb86c332700 1 -- 172.21.15.49:0/3099252978 shutdown_connections 2024-06-02T23:57:20.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:20.033+0000 7fb86c332700 1 -- 172.21.15.49:0/3099252978 wait complete. 2024-06-02T23:57:20.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:20 smithi057 ceph-mon[36457]: pgmap v300: 97 pgs: 10 creating+peering, 87 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-06-02T23:57:20.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:20 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/3099252978' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T23:57:20.703 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:20 smithi049 ceph-mon[32302]: pgmap v300: 97 pgs: 10 creating+peering, 87 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-06-02T23:57:20.703 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:20 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3099252978' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T23:57:20.735 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-02T23:57:20.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:20 smithi107 ceph-mon[37048]: pgmap v300: 97 pgs: 10 creating+peering, 87 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-06-02T23:57:20.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:20 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/3099252978' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T23:57:20.987 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:57:22.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.468+0000 7f849970b700 1 -- 172.21.15.49:0/3821586894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84941084f0 msgr2=0x7f84941088d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:22.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.468+0000 7f849970b700 1 --2- 172.21.15.49:0/3821586894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84941084f0 0x7f84941088d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8484009990 tx=0x7f8484009ca0 comp rx=0 tx=0).stop 2024-06-02T23:57:22.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.468+0000 7f849970b700 1 -- 172.21.15.49:0/3821586894 shutdown_connections 2024-06-02T23:57:22.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.468+0000 7f849970b700 1 --2- 172.21.15.49:0/3821586894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8494102e80 0x7f849410f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:22.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.468+0000 7f849970b700 1 --2- 172.21.15.49:0/3821586894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84941084f0 0x7f84941088d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:22.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.468+0000 7f849970b700 1 --2- 172.21.15.49:0/3821586894 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84941024e0 0x7f8494102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:22.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.468+0000 7f849970b700 1 -- 172.21.15.49:0/3821586894 >> 172.21.15.49:0/3821586894 conn(0x7f8494079530 msgr2=0x7f8494079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:22.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.468+0000 7f849970b700 1 -- 172.21.15.49:0/3821586894 shutdown_connections 2024-06-02T23:57:22.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.468+0000 7f849970b700 1 -- 172.21.15.49:0/3821586894 wait complete. 2024-06-02T23:57:22.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.469+0000 7f849970b700 1 Processor -- start 2024-06-02T23:57:22.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.469+0000 7f849970b700 1 -- start start 2024-06-02T23:57:22.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.469+0000 7f849970b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84941024e0 0x7f8494074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:22.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.469+0000 7f849970b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8494102e80 0x7f8494074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:22.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.469+0000 7f849970b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84941084f0 0x7f8494075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:22.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.469+0000 7f849970b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8494112800 con 0x7f8494102e80 2024-06-02T23:57:22.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.469+0000 7f849970b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8494112680 con 0x7f84941084f0 2024-06-02T23:57:22.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.469+0000 7f849970b700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8494112980 con 0x7f84941024e0 2024-06-02T23:57:22.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.470+0000 7f84927fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8494102e80 0x7f8494074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:22.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.470+0000 7f84927fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8494102e80 0x7f8494074cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55886/0 (socket says 172.21.15.49:55886) 2024-06-02T23:57:22.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.470+0000 7f84927fc700 1 -- 172.21.15.49:0/3776804808 learned_addr learned my addr 172.21.15.49:0/3776804808 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:57:22.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.470+0000 7f8492ffd700 1 --2- 172.21.15.49:0/3776804808 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84941024e0 0x7f8494074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:22.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.470+0000 7f84937fe700 1 --2- 172.21.15.49:0/3776804808 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84941084f0 0x7f8494075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:22.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.470+0000 7f84927fc700 1 -- 172.21.15.49:0/3776804808 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84941024e0 msgr2=0x7f8494074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:22.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.470+0000 7f84927fc700 1 --2- 172.21.15.49:0/3776804808 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84941024e0 0x7f8494074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:22.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.470+0000 7f84927fc700 1 -- 172.21.15.49:0/3776804808 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84941084f0 msgr2=0x7f8494075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:22.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.470+0000 7f84927fc700 1 --2- 172.21.15.49:0/3776804808 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84941084f0 0x7f8494075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:22.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.470+0000 7f84927fc700 1 -- 172.21.15.49:0/3776804808 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84941a71f0 con 0x7f8494102e80 2024-06-02T23:57:22.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.470+0000 7f84927fc700 1 --2- 172.21.15.49:0/3776804808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8494102e80 0x7f8494074cd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f848800d950 tx=0x7f848800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:22.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.470+0000 7f847bfff700 1 -- 172.21.15.49:0/3776804808 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8488016070 con 0x7f8494102e80 2024-06-02T23:57:22.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.470+0000 7f849970b700 1 -- 172.21.15.49:0/3776804808 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84941a74e0 con 0x7f8494102e80 2024-06-02T23:57:22.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.470+0000 7f847bfff700 1 -- 172.21.15.49:0/3776804808 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8488009e20 con 0x7f8494102e80 2024-06-02T23:57:22.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.470+0000 7f847bfff700 1 -- 172.21.15.49:0/3776804808 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848800f620 con 0x7f8494102e80 2024-06-02T23:57:22.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.470+0000 7f849970b700 1 -- 172.21.15.49:0/3776804808 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84941a7a70 con 0x7f8494102e80 2024-06-02T23:57:22.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.471+0000 7f849970b700 1 -- 172.21.15.49:0/3776804808 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8494069180 con 0x7f8494102e80 2024-06-02T23:57:22.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.473+0000 7f847bfff700 1 -- 172.21.15.49:0/3776804808 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8488019070 con 0x7f8494102e80 2024-06-02T23:57:22.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.473+0000 7f847bfff700 1 --2- 172.21.15.49:0/3776804808 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f847c0a2c20 0x7f847c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:22.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.473+0000 7f8492ffd700 1 --2- 172.21.15.49:0/3776804808 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f847c0a2c20 0x7f847c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:22.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.473+0000 7f847bfff700 1 -- 172.21.15.49:0/3776804808 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7f84880cee40 con 0x7f8494102e80 2024-06-02T23:57:22.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.474+0000 7f8492ffd700 1 --2- 172.21.15.49:0/3776804808 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f847c0a2c20 0x7f847c0a50e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f848400b5c0 tx=0x7f8484005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:22.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.478+0000 7f847bfff700 1 -- 172.21.15.49:0/3776804808 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f848809bef0 con 0x7f8494102e80 2024-06-02T23:57:22.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.683+0000 7f849970b700 1 -- 172.21.15.49:0/3776804808 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f849402dca0 con 0x7f8494102e80 2024-06-02T23:57:22.683 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:22 smithi049 ceph-mon[32302]: pgmap v301: 97 pgs: 97 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 6 op/s 2024-06-02T23:57:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.685+0000 7f847bfff700 1 -- 172.21.15.49:0/3776804808 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22134 (secure 0 0 0) 0x7f848809b7f0 con 0x7f8494102e80 2024-06-02T23:57:22.685 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:57:22.685 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":88,"fsid":"890dd222-213a-11ef-bc9b-c7b262605968","created":"2024-06-02T23:48:53.323536+0000","modified":"2024-06-02T23:57:16.991066+0000","last_up_change":"2024-06-02T23:56:12.156697+0000","last_in_change":"2024-06-02T23:55:51.667118+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:52:23.676079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:57:10.753178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T23:57:14.240610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e0013e80-07d6-4ad3-87d8-d41988988ef5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6803","nonce":811647073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6805","nonce":811647073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6809","nonce":811647073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6807","nonce":811647073}]},"public_addr":"172.21.15.49:6803/811647073","cluster_addr":"172.21.15.49:6805/811647073","heartbeat_back_addr":"172.21.15.49:6809/811647073","heartbeat_front_addr":"172.21.15.49:6807/811647073","state":["exists","up"]},{"osd":1,"uuid":"f37d9f79-e349-4de7-81e7-385ddb905f58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6801","nonce":1260507785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6803","nonce":1260507785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6807","nonce":1260507785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6805","nonce":1260507785}]},"public_addr":"172.21.15.57:6801/1260507785","cluster_addr":"172.21.15.57:6803/1260507785","heartbeat_back_addr":"172.21.15.57:6807/1260507785","heartbeat_front_addr":"172.21.15.57:6805/1260507785","state":["exists","up"]},{"osd":2,"uuid":"94889281-7d45-4e78-9d37-b98e3fbe8494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6801","nonce":303899951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6803","nonce":303899951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6807","nonce":303899951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6805","nonce":303899951}]},"public_addr":"172.21.15.107:6801/303899951","cluster_addr":"172.21.15.107:6803/303899951","heartbeat_back_addr":"172.21.15.107:6807/303899951","heartbeat_front_addr":"172.21.15.107:6805/303899951","state":["exists","up"]},{"osd":3,"uuid":"31f4c18c-fbda-400d-8b3b-0955b0c4a6a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6811","nonce":60796312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6813","nonce":60796312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6817","nonce":60796312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6815","nonce":60796312}]},"public_addr":"172.21.15.49:6811/60796312","cluster_addr":"172.21.15.49:6813/60796312","heartbeat_back_addr":"172.21.15.49:6817/60796312","heartbeat_front_addr":"172.21.15.49:6815/60796312","state":["exists","up"]},{"osd":4,"uuid":"8076c2f3-0138-459e-89b5-c5c4586a14ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6809","nonce":3106842986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6811","nonce":3106842986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6815","nonce":3106842986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6813","nonce":3106842986}]},"public_addr":"172.21.15.57:6809/3106842986","cluster_addr":"172.21.15.57:6811/3106842986","heartbeat_back_addr":"172.21.15.57:6815/3106842986","heartbeat_front_addr":"172.21.15.57:6813/3106842986","state":["exists","up"]},{"osd":5,"uuid":"68f7abd3-4292-41fa-90ce-4ac34ea2b964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6809","nonce":389294142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6811","nonce":389294142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6815","nonce":389294142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6813","nonce":389294142}]},"public_addr":"172.21.15.107:6809/389294142","cluster_addr":"172.21.15.107:6811/389294142","heartbeat_back_addr":"172.21.15.107:6815/389294142","heartbeat_front_addr":"172.21.15.107:6813/389294142","state":["exists","up"]},{"osd":6,"uuid":"c0345dd0-71b7-436d-88f8-fe3d7cb69d8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6819","nonce":894624552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6821","nonce":894624552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6825","nonce":894624552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6823","nonce":894624552}]},"public_addr":"172.21.15.49:6819/894624552","cluster_addr":"172.21.15.49:6821/894624552","heartbeat_back_addr":"172.21.15.49:6825/894624552","heartbeat_front_addr":"172.21.15.49:6823/894624552","state":["exists","up"]},{"osd":7,"uuid":"9abd81c7-dcc1-4e14-8ab7-9fa0746067ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6817","nonce":3126027900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6819","nonce":3126027900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6823","nonce":3126027900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6821","nonce":3126027900}]},"public_addr":"172.21.15.57:6817/3126027900","cluster_addr":"172.21.15.57:6819/3126027900","heartbeat_back_addr":"172.21.15.57:6823/3126027900","heartbeat_front_addr":"172.21.15.57:6821/3126027900","state":["exists","up"]},{"osd":8,"uuid":"80532119-5de8-45d2-9cb9-bd8a6194199b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6817","nonce":3620047229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6819","nonce":3620047229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6823","nonce":3620047229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6821","nonce":3620047229}]},"public_addr":"172.21.15.107:6817/3620047229","cluster_addr":"172.21.15.107:6819/3620047229","heartbeat_back_addr":"172.21.15.107:6823/3620047229","heartbeat_front_addr":"172.21.15.107:6821/3620047229","state":["exists","up"]},{"osd":9,"uuid":"f0b5dcfa-9fd2-4a98-863b-197defa890af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6827","nonce":3627936526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6829","nonce":3627936526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6833","nonce":3627936526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6831","nonce":3627936526}]},"public_addr":"172.21.15.49:6827/3627936526","cluster_addr":"172.21.15.49:6829/3627936526","heartbeat_back_addr":"172.21.15.49:6833/3627936526","heartbeat_front_addr":"172.21.15.49:6831/3627936526","state":["exists","up"]},{"osd":10,"uuid":"21a75846-adec-41b8-9e1d-e5c61ba30b12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6825","nonce":3013235811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6827","nonce":3013235811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6831","nonce":3013235811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6829","nonce":3013235811}]},"public_addr":"172.21.15.57:6825/3013235811","cluster_addr":"172.21.15.57:6827/3013235811","heartbeat_back_addr":"172.21.15.57:6831/3013235811","heartbeat_front_addr":"172.21.15.57:6829/3013235811","state":["exists","up"]},{"osd":11,"uuid":"eb963b63-2c61-4169-b8fe-31c7f5ec919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6825","nonce":4217534517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6827","nonce":4217534517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6831","nonce":4217534517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6829","nonce":4217534517}]},"public_addr":"172.21.15.107:6825/4217534517","cluster_addr":"172.21.15.107:6827/4217534517","heartbeat_back_addr":"172.21.15.107:6831/4217534517","heartbeat_front_addr":"172.21.15.107:6829/4217534517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:51:31.067312+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:51:56.088456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:52:20.539941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:52:45.055717+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:53:11.178438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:53:35.794217+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:00.775674+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:27.574752+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:52.177634+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:55:17.118854+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:55:44.217535+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:56:10.500970+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/525944311":"2024-06-03T23:49:55.151590+0000","172.21.15.49:0/1841969299":"2024-06-03T23:49:55.151590+0000","172.21.15.49:0/1880506696":"2024-06-03T23:49:55.151590+0000","172.21.15.49:6801/1206062338":"2024-06-03T23:49:55.151590+0000","172.21.15.49:6800/549058216":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/2112783954":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/2183920213":"2024-06-03T23:49:29.042670+0000","172.21.15.49:6801/549058216":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/3350970308":"2024-06-03T23:49:29.042670+0000","172.21.15.49:6800/1206062338":"2024-06-03T23:49:55.151590+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:57:22.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.687+0000 7f849970b700 1 -- 172.21.15.49:0/3776804808 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f847c0a2c20 msgr2=0x7f847c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:22.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.687+0000 7f849970b700 1 --2- 172.21.15.49:0/3776804808 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f847c0a2c20 0x7f847c0a50e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f848400b5c0 tx=0x7f8484005fd0 comp rx=0 tx=0).stop 2024-06-02T23:57:22.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.687+0000 7f849970b700 1 -- 172.21.15.49:0/3776804808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8494102e80 msgr2=0x7f8494074cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:22.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.687+0000 7f849970b700 1 --2- 172.21.15.49:0/3776804808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8494102e80 0x7f8494074cd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f848800d950 tx=0x7f848800dc60 comp rx=0 tx=0).stop 2024-06-02T23:57:22.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.687+0000 7f849970b700 1 -- 172.21.15.49:0/3776804808 shutdown_connections 2024-06-02T23:57:22.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.687+0000 7f849970b700 1 --2- 172.21.15.49:0/3776804808 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f847c0a2c20 0x7f847c0a50e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:22.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.687+0000 7f849970b700 1 --2- 172.21.15.49:0/3776804808 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84941084f0 0x7f8494075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:22.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.687+0000 7f849970b700 1 --2- 172.21.15.49:0/3776804808 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84941024e0 0x7f8494074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:22.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.687+0000 7f849970b700 1 --2- 172.21.15.49:0/3776804808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8494102e80 0x7f8494074cd0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:22.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.687+0000 7f849970b700 1 -- 172.21.15.49:0/3776804808 >> 172.21.15.49:0/3776804808 conn(0x7f8494079530 msgr2=0x7f84941005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:22.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.688+0000 7f849970b700 1 -- 172.21.15.49:0/3776804808 shutdown_connections 2024-06-02T23:57:22.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:22.688+0000 7f849970b700 1 -- 172.21.15.49:0/3776804808 wait complete. 2024-06-02T23:57:22.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:22 smithi057 ceph-mon[36457]: pgmap v301: 97 pgs: 97 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 6 op/s 2024-06-02T23:57:22.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:22 smithi107 ceph-mon[37048]: pgmap v301: 97 pgs: 97 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 6 op/s 2024-06-02T23:57:23.372 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-06-02T23:57:23.623 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:57:23.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:23 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/3776804808' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T23:57:23.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:23 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3776804808' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T23:57:23.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:23 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/3776804808' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T23:57:24.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:24 smithi057 ceph-mon[36457]: pgmap v302: 97 pgs: 97 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-06-02T23:57:24.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:24 smithi049 ceph-mon[32302]: pgmap v302: 97 pgs: 97 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-06-02T23:57:24.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:24 smithi107 ceph-mon[37048]: pgmap v302: 97 pgs: 97 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-06-02T23:57:25.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.205+0000 7f2a2c541700 1 -- 172.21.15.49:0/2132962005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a24102740 msgr2=0x7f2a24102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:25.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.205+0000 7f2a2c541700 1 --2- 172.21.15.49:0/2132962005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a24102740 0x7f2a24102b20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2a200099c0 tx=0x7f2a20009cd0 comp rx=0 tx=0).stop 2024-06-02T23:57:25.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.205+0000 7f2a2c541700 1 -- 172.21.15.49:0/2132962005 shutdown_connections 2024-06-02T23:57:25.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.205+0000 7f2a2c541700 1 --2- 172.21.15.49:0/2132962005 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a24107840 0x7f2a2410f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:25.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.205+0000 7f2a2c541700 1 --2- 172.21.15.49:0/2132962005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a24102740 0x7f2a24102b20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:25.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.205+0000 7f2a2c541700 1 --2- 172.21.15.49:0/2132962005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a241030f0 0x7f2a24107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:25.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.205+0000 7f2a2c541700 1 -- 172.21.15.49:0/2132962005 >> 172.21.15.49:0/2132962005 conn(0x7f2a240795f0 msgr2=0x7f2a24079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:25.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.205+0000 7f2a2c541700 1 -- 172.21.15.49:0/2132962005 shutdown_connections 2024-06-02T23:57:25.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.205+0000 7f2a2c541700 1 -- 172.21.15.49:0/2132962005 wait complete. 2024-06-02T23:57:25.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.205+0000 7f2a2c541700 1 Processor -- start 2024-06-02T23:57:25.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.205+0000 7f2a2c541700 1 -- start start 2024-06-02T23:57:25.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.206+0000 7f2a2c541700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a24102740 0x7f2a2419e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:25.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.206+0000 7f2a2c541700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a241030f0 0x7f2a2419ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:25.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.206+0000 7f2a2c541700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a24107840 0x7f2a24198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:25.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.206+0000 7f2a2c541700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2a24112820 con 0x7f2a241030f0 2024-06-02T23:57:25.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.206+0000 7f2a2c541700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f2a241126a0 con 0x7f2a24107840 2024-06-02T23:57:25.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.206+0000 7f2a2c541700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2a241129a0 con 0x7f2a24102740 2024-06-02T23:57:25.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.206+0000 7f2a29adc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a241030f0 0x7f2a2419ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:25.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.206+0000 7f2a29adc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a241030f0 0x7f2a2419ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55094/0 (socket says 172.21.15.49:55094) 2024-06-02T23:57:25.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.206+0000 7f2a29adc700 1 -- 172.21.15.49:0/1564553118 learned_addr learned my addr 172.21.15.49:0/1564553118 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:57:25.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.206+0000 7f2a2a2dd700 1 --2- 172.21.15.49:0/1564553118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a24102740 0x7f2a2419e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:25.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.206+0000 7f2a2aade700 1 --2- 172.21.15.49:0/1564553118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a24107840 0x7f2a24198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:25.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.206+0000 7f2a29adc700 1 -- 172.21.15.49:0/1564553118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a24102740 msgr2=0x7f2a2419e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:25.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.206+0000 7f2a29adc700 1 --2- 172.21.15.49:0/1564553118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a24102740 0x7f2a2419e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:25.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.206+0000 7f2a29adc700 1 -- 172.21.15.49:0/1564553118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a24107840 msgr2=0x7f2a24198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:25.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.206+0000 7f2a29adc700 1 --2- 172.21.15.49:0/1564553118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a24107840 0x7f2a24198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:25.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.206+0000 7f2a29adc700 1 -- 172.21.15.49:0/1564553118 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a24199260 con 0x7f2a241030f0 2024-06-02T23:57:25.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.206+0000 7f2a29adc700 1 --2- 172.21.15.49:0/1564553118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a241030f0 0x7f2a2419ee30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400b530 tx=0x7f2a1400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:25.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.206+0000 7f2a1b7fe700 1 -- 172.21.15.49:0/1564553118 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a14015020 con 0x7f2a241030f0 2024-06-02T23:57:25.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.207+0000 7f2a1b7fe700 1 -- 172.21.15.49:0/1564553118 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a14011d10 con 0x7f2a241030f0 2024-06-02T23:57:25.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.207+0000 7f2a1b7fe700 1 -- 172.21.15.49:0/1564553118 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1400f2e0 con 0x7f2a241030f0 2024-06-02T23:57:25.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.207+0000 7f2a2c541700 1 -- 172.21.15.49:0/1564553118 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a24199550 con 0x7f2a241030f0 2024-06-02T23:57:25.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.207+0000 7f2a2c541700 1 -- 172.21.15.49:0/1564553118 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a241a57c0 con 0x7f2a241030f0 2024-06-02T23:57:25.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.208+0000 7f2a2c541700 1 -- 172.21.15.49:0/1564553118 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a2410aa80 con 0x7f2a241030f0 2024-06-02T23:57:25.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.209+0000 7f2a1b7fe700 1 -- 172.21.15.49:0/1564553118 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2a14018020 con 0x7f2a241030f0 2024-06-02T23:57:25.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.210+0000 7f2a1b7fe700 1 --2- 172.21.15.49:0/1564553118 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f2a100a2c20 0x7f2a100a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:25.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.210+0000 7f2a2a2dd700 1 --2- 172.21.15.49:0/1564553118 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f2a100a2c20 0x7f2a100a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:25.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.210+0000 7f2a1b7fe700 1 -- 172.21.15.49:0/1564553118 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7f2a140ceb70 con 0x7f2a241030f0 2024-06-02T23:57:25.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.210+0000 7f2a2a2dd700 1 --2- 172.21.15.49:0/1564553118 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f2a100a2c20 0x7f2a100a50e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2a20000c00 tx=0x7f2a20005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:25.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.213+0000 7f2a1b7fe700 1 -- 172.21.15.49:0/1564553118 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2a1401f020 con 0x7f2a241030f0 2024-06-02T23:57:25.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:25.467+0000 7f2a2c541700 1 -- 172.21.15.49:0/1564553118 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f2a24069180 con 0x7f2a241030f0 2024-06-02T23:57:26.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:26.403+0000 7f2a1b7fe700 1 -- 172.21.15.49:0/1564553118 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f2a1409bc20 con 0x7f2a241030f0 2024-06-02T23:57:26.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:26.406+0000 7f2a2c541700 1 -- 172.21.15.49:0/1564553118 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f2a100a2c20 msgr2=0x7f2a100a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:26.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:26.406+0000 7f2a2c541700 1 --2- 172.21.15.49:0/1564553118 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f2a100a2c20 0x7f2a100a50e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2a20000c00 tx=0x7f2a20005fb0 comp rx=0 tx=0).stop 2024-06-02T23:57:26.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:26.406+0000 7f2a2c541700 1 -- 172.21.15.49:0/1564553118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a241030f0 msgr2=0x7f2a2419ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:26.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:26.406+0000 7f2a2c541700 1 --2- 172.21.15.49:0/1564553118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a241030f0 0x7f2a2419ee30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400b530 tx=0x7f2a1400b840 comp rx=0 tx=0).stop 2024-06-02T23:57:26.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:26.407+0000 7f2a2c541700 1 -- 172.21.15.49:0/1564553118 shutdown_connections 2024-06-02T23:57:26.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:26.407+0000 7f2a2c541700 1 --2- 172.21.15.49:0/1564553118 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f2a100a2c20 0x7f2a100a50e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:26.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:26.407+0000 7f2a2c541700 1 --2- 172.21.15.49:0/1564553118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a24107840 0x7f2a24198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:26.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:26.407+0000 7f2a2c541700 1 --2- 172.21.15.49:0/1564553118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a24102740 0x7f2a2419e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:26.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:26.407+0000 7f2a2c541700 1 --2- 172.21.15.49:0/1564553118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a241030f0 0x7f2a2419ee30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:26.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:26.407+0000 7f2a2c541700 1 -- 172.21.15.49:0/1564553118 >> 172.21.15.49:0/1564553118 conn(0x7f2a240795f0 msgr2=0x7f2a24100790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:26.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:26.407+0000 7f2a2c541700 1 -- 172.21.15.49:0/1564553118 shutdown_connections 2024-06-02T23:57:26.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:26.407+0000 7f2a2c541700 1 -- 172.21.15.49:0/1564553118 wait complete. 2024-06-02T23:57:26.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:26 smithi057 ceph-mon[36457]: pgmap v303: 97 pgs: 97 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-06-02T23:57:26.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:26 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/1564553118' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-02T23:57:26.707 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:26 smithi049 ceph-mon[32302]: pgmap v303: 97 pgs: 97 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-06-02T23:57:26.707 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:26 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/1564553118' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-02T23:57:26.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:26 smithi107 ceph-mon[37048]: pgmap v303: 97 pgs: 97 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-06-02T23:57:26.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:26 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/1564553118' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-02T23:57:27.090 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-06-02T23:57:27.090 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-06-02T23:57:27.344 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:57:27.685 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:27 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/1564553118' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-06-02T23:57:27.686 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:27 smithi049 ceph-mon[32302]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-02T23:57:27.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:27 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/1564553118' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-06-02T23:57:27.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:27 smithi057 ceph-mon[36457]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-02T23:57:27.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:27 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/1564553118' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-06-02T23:57:27.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:27 smithi107 ceph-mon[37048]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-02T23:57:28.576 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:28 smithi049 ceph-mon[32302]: pgmap v304: 97 pgs: 97 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-06-02T23:57:28.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:28 smithi057 ceph-mon[36457]: pgmap v304: 97 pgs: 97 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-06-02T23:57:28.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.795+0000 7fca648c8700 1 -- 172.21.15.49:0/3020154799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca60101fc0 msgr2=0x7fca60106010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:28.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.795+0000 7fca648c8700 1 --2- 172.21.15.49:0/3020154799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca60101fc0 0x7fca60106010 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fca540099c0 tx=0x7fca54009cd0 comp rx=0 tx=0).stop 2024-06-02T23:57:28.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.795+0000 7fca648c8700 1 -- 172.21.15.49:0/3020154799 shutdown_connections 2024-06-02T23:57:28.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.795+0000 7fca648c8700 1 --2- 172.21.15.49:0/3020154799 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca601066f0 0x7fca6010e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:28.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.795+0000 7fca648c8700 1 --2- 172.21.15.49:0/3020154799 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca60101610 0x7fca601019f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:28.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.795+0000 7fca648c8700 1 --2- 172.21.15.49:0/3020154799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca60101fc0 0x7fca60106010 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:28.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.795+0000 7fca648c8700 1 -- 172.21.15.49:0/3020154799 >> 172.21.15.49:0/3020154799 conn(0x7fca60078430 msgr2=0x7fca60078840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:28.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.795+0000 7fca648c8700 1 -- 172.21.15.49:0/3020154799 shutdown_connections 2024-06-02T23:57:28.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.795+0000 7fca648c8700 1 -- 172.21.15.49:0/3020154799 wait complete. 2024-06-02T23:57:28.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.796+0000 7fca648c8700 1 Processor -- start 2024-06-02T23:57:28.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.796+0000 7fca648c8700 1 -- start start 2024-06-02T23:57:28.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.796+0000 7fca648c8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca60101610 0x7fca60198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:28.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.796+0000 7fca648c8700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca60101fc0 0x7fca601993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:28.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.796+0000 7fca648c8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca601066f0 0x7fca6019d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:28.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.796+0000 7fca648c8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fca60111800 con 0x7fca601066f0 2024-06-02T23:57:28.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.796+0000 7fca648c8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fca60111680 con 0x7fca60101610 2024-06-02T23:57:28.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.796+0000 7fca648c8700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fca60111980 con 0x7fca60101fc0 2024-06-02T23:57:28.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.797+0000 7fca5ed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca601066f0 0x7fca6019d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:28.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.797+0000 7fca5ed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca601066f0 0x7fca6019d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55108/0 (socket says 172.21.15.49:55108) 2024-06-02T23:57:28.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.797+0000 7fca5ed9d700 1 -- 172.21.15.49:0/3627671678 learned_addr learned my addr 172.21.15.49:0/3627671678 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:57:28.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.797+0000 7fca5e59c700 1 --2- 172.21.15.49:0/3627671678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca60101610 0x7fca60198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:28.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.797+0000 7fca5dd9b700 1 --2- 172.21.15.49:0/3627671678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca60101fc0 0x7fca601993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:28.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.797+0000 7fca5ed9d700 1 -- 172.21.15.49:0/3627671678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca60101fc0 msgr2=0x7fca601993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:28.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.797+0000 7fca5ed9d700 1 --2- 172.21.15.49:0/3627671678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca60101fc0 0x7fca601993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:28.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.797+0000 7fca5ed9d700 1 -- 172.21.15.49:0/3627671678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca60101610 msgr2=0x7fca60198e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:28.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.797+0000 7fca5ed9d700 1 --2- 172.21.15.49:0/3627671678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca60101610 0x7fca60198e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:28.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.797+0000 7fca5ed9d700 1 -- 172.21.15.49:0/3627671678 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca6019de30 con 0x7fca601066f0 2024-06-02T23:57:28.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.797+0000 7fca5e59c700 1 --2- 172.21.15.49:0/3627671678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca60101610 0x7fca60198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:57:28.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.797+0000 7fca5ed9d700 1 --2- 172.21.15.49:0/3627671678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca601066f0 0x7fca6019d6f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fca5800b970 tx=0x7fca5800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:28.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.797+0000 7fca4f7fe700 1 -- 172.21.15.49:0/3627671678 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca58019070 con 0x7fca601066f0 2024-06-02T23:57:28.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.797+0000 7fca4f7fe700 1 -- 172.21.15.49:0/3627671678 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca58014440 con 0x7fca601066f0 2024-06-02T23:57:28.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.797+0000 7fca4f7fe700 1 -- 172.21.15.49:0/3627671678 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca580075d0 con 0x7fca601066f0 2024-06-02T23:57:28.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.797+0000 7fca648c8700 1 -- 172.21.15.49:0/3627671678 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca6019e120 con 0x7fca601066f0 2024-06-02T23:57:28.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.797+0000 7fca648c8700 1 -- 172.21.15.49:0/3627671678 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca601a59a0 con 0x7fca601066f0 2024-06-02T23:57:28.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.798+0000 7fca648c8700 1 -- 172.21.15.49:0/3627671678 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca60069180 con 0x7fca601066f0 2024-06-02T23:57:28.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.800+0000 7fca4f7fe700 1 -- 172.21.15.49:0/3627671678 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fca5801c070 con 0x7fca601066f0 2024-06-02T23:57:28.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.801+0000 7fca4f7fe700 1 --2- 172.21.15.49:0/3627671678 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fca480a2ca0 0x7fca480a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:28.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.801+0000 7fca5e59c700 1 --2- 172.21.15.49:0/3627671678 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fca480a2ca0 0x7fca480a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:28.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.801+0000 7fca4f7fe700 1 -- 172.21.15.49:0/3627671678 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7fca580cee90 con 0x7fca601066f0 2024-06-02T23:57:28.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.802+0000 7fca5e59c700 1 --2- 172.21.15.49:0/3627671678 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fca480a2ca0 0x7fca480a5160 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fca500099d0 tx=0x7fca50008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:28.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:28.805+0000 7fca4f7fe700 1 -- 172.21.15.49:0/3627671678 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fca58023030 con 0x7fca601066f0 2024-06-02T23:57:28.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:28 smithi107 ceph-mon[37048]: pgmap v304: 97 pgs: 97 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-06-02T23:57:29.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:29.063+0000 7fca648c8700 1 -- 172.21.15.49:0/3627671678 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7fca601a5bd0 con 0x7fca601066f0 2024-06-02T23:57:29.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:29.426+0000 7fca4f7fe700 1 -- 172.21.15.49:0/3627671678 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v17) ==== 105+0+0 (secure 0 0 0) 0x7fca5809bf40 con 0x7fca601066f0 2024-06-02T23:57:29.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:29.429+0000 7fca648c8700 1 -- 172.21.15.49:0/3627671678 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fca480a2ca0 msgr2=0x7fca480a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:29.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:29.429+0000 7fca648c8700 1 --2- 172.21.15.49:0/3627671678 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fca480a2ca0 0x7fca480a5160 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fca500099d0 tx=0x7fca50008040 comp rx=0 tx=0).stop 2024-06-02T23:57:29.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:29.429+0000 7fca648c8700 1 -- 172.21.15.49:0/3627671678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca601066f0 msgr2=0x7fca6019d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:29.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:29.429+0000 7fca648c8700 1 --2- 172.21.15.49:0/3627671678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca601066f0 0x7fca6019d6f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fca5800b970 tx=0x7fca5800bd30 comp rx=0 tx=0).stop 2024-06-02T23:57:29.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:29.429+0000 7fca648c8700 1 -- 172.21.15.49:0/3627671678 shutdown_connections 2024-06-02T23:57:29.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:29.429+0000 7fca648c8700 1 --2- 172.21.15.49:0/3627671678 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fca480a2ca0 0x7fca480a5160 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:29.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:29.429+0000 7fca648c8700 1 --2- 172.21.15.49:0/3627671678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca601066f0 0x7fca6019d6f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:29.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:29.429+0000 7fca648c8700 1 --2- 172.21.15.49:0/3627671678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca60101610 0x7fca60198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:29.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:29.429+0000 7fca648c8700 1 --2- 172.21.15.49:0/3627671678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca60101fc0 0x7fca601993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:29.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:29.429+0000 7fca648c8700 1 -- 172.21.15.49:0/3627671678 >> 172.21.15.49:0/3627671678 conn(0x7fca60078430 msgr2=0x7fca601053d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:29.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:29.429+0000 7fca648c8700 1 -- 172.21.15.49:0/3627671678 shutdown_connections 2024-06-02T23:57:29.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:29.429+0000 7fca648c8700 1 -- 172.21.15.49:0/3627671678 wait complete. 2024-06-02T23:57:29.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:29 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/3627671678' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-06-02T23:57:29.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:29 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3627671678' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-06-02T23:57:29.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:29 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/3627671678' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-06-02T23:57:30.029 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-06-02T23:57:30.281 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:57:30.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:30 smithi057 ceph-mon[36457]: pgmap v305: 97 pgs: 97 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-06-02T23:57:30.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:30 smithi057 ceph-mon[36457]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-06-02T23:57:30.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:30 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/3627671678' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-06-02T23:57:30.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:30 smithi057 ceph-mon[36457]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-06-02T23:57:30.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:30 smithi057 ceph-mon[36457]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-02T23:57:30.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:30 smithi057 ceph-mon[36457]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-06-02T23:57:30.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:30 smithi057 ceph-mon[36457]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-06-02T23:57:30.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:30 smithi049 ceph-mon[32302]: pgmap v305: 97 pgs: 97 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-06-02T23:57:30.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:30 smithi049 ceph-mon[32302]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-06-02T23:57:30.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:30 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3627671678' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-06-02T23:57:30.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:30 smithi049 ceph-mon[32302]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-06-02T23:57:30.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:30 smithi049 ceph-mon[32302]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-02T23:57:30.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:30 smithi049 ceph-mon[32302]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-06-02T23:57:30.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:30 smithi049 ceph-mon[32302]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-06-02T23:57:30.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:30 smithi107 ceph-mon[37048]: pgmap v305: 97 pgs: 97 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-06-02T23:57:30.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:30 smithi107 ceph-mon[37048]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-06-02T23:57:30.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:30 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/3627671678' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-06-02T23:57:30.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:30 smithi107 ceph-mon[37048]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-06-02T23:57:30.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:30 smithi107 ceph-mon[37048]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-02T23:57:30.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:30 smithi107 ceph-mon[37048]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-06-02T23:57:30.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:30 smithi107 ceph-mon[37048]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-06-02T23:57:31.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:31 smithi057 ceph-mon[36457]: mds.? [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] up:active 2024-06-02T23:57:31.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:31 smithi057 ceph-mon[36457]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-06-02T23:57:31.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:31 smithi057 ceph-mon[36457]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-06-02T23:57:31.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:31 smithi057 ceph-mon[36457]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-06-02T23:57:31.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:31 smithi057 ceph-mon[36457]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-06-02T23:57:31.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:31 smithi049 ceph-mon[32302]: mds.? [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] up:active 2024-06-02T23:57:31.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:31 smithi049 ceph-mon[32302]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-06-02T23:57:31.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:31 smithi049 ceph-mon[32302]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-06-02T23:57:31.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:31 smithi049 ceph-mon[32302]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-06-02T23:57:31.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:31 smithi049 ceph-mon[32302]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-06-02T23:57:31.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:31 smithi107 ceph-mon[37048]: mds.? [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] up:active 2024-06-02T23:57:31.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:31 smithi107 ceph-mon[37048]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-06-02T23:57:31.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:31 smithi107 ceph-mon[37048]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-06-02T23:57:31.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:31 smithi107 ceph-mon[37048]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-06-02T23:57:31.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:31 smithi107 ceph-mon[37048]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-06-02T23:57:31.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.977+0000 7f670176a700 1 -- 172.21.15.49:0/3816186218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66fc107840 msgr2=0x7f66fc10f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:31.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.977+0000 7f670176a700 1 --2- 172.21.15.49:0/3816186218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66fc107840 0x7f66fc10f3c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f66f400b0d0 tx=0x7f66f400b3e0 comp rx=0 tx=0).stop 2024-06-02T23:57:31.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.977+0000 7f670176a700 1 -- 172.21.15.49:0/3816186218 shutdown_connections 2024-06-02T23:57:31.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.977+0000 7f670176a700 1 --2- 172.21.15.49:0/3816186218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66fc107840 0x7f66fc10f3c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:31.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.977+0000 7f670176a700 1 --2- 172.21.15.49:0/3816186218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66fc102740 0x7f66fc102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:31.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.977+0000 7f670176a700 1 --2- 172.21.15.49:0/3816186218 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66fc1030f0 0x7f66fc107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:31.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.977+0000 7f670176a700 1 -- 172.21.15.49:0/3816186218 >> 172.21.15.49:0/3816186218 conn(0x7f66fc0795f0 msgr2=0x7f66fc079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:31.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.977+0000 7f670176a700 1 -- 172.21.15.49:0/3816186218 shutdown_connections 2024-06-02T23:57:31.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.977+0000 7f670176a700 1 -- 172.21.15.49:0/3816186218 wait complete. 2024-06-02T23:57:31.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.977+0000 7f670176a700 1 Processor -- start 2024-06-02T23:57:31.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.978+0000 7f670176a700 1 -- start start 2024-06-02T23:57:31.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.978+0000 7f670176a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66fc102740 0x7f66fc19e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:31.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.978+0000 7f670176a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66fc1030f0 0x7f66fc19ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:31.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.978+0000 7f670176a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66fc107840 0x7f66fc1988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:31.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.978+0000 7f670176a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc112760 con 0x7f66fc102740 2024-06-02T23:57:31.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.978+0000 7f670176a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc1125e0 con 0x7f66fc107840 2024-06-02T23:57:31.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.978+0000 7f670176a700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc1128e0 con 0x7f66fc1030f0 2024-06-02T23:57:31.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.978+0000 7f66faffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66fc102740 0x7f66fc19e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:31.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.978+0000 7f66faffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66fc102740 0x7f66fc19e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55126/0 (socket says 172.21.15.49:55126) 2024-06-02T23:57:31.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.978+0000 7f66faffd700 1 -- 172.21.15.49:0/1502184082 learned_addr learned my addr 172.21.15.49:0/1502184082 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:57:31.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.978+0000 7f66fb7fe700 1 --2- 172.21.15.49:0/1502184082 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66fc107840 0x7f66fc1988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:31.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.978+0000 7f66fa7fc700 1 --2- 172.21.15.49:0/1502184082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66fc1030f0 0x7f66fc19ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:31.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.979+0000 7f66faffd700 1 -- 172.21.15.49:0/1502184082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66fc1030f0 msgr2=0x7f66fc19ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:31.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.979+0000 7f66faffd700 1 --2- 172.21.15.49:0/1502184082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66fc1030f0 0x7f66fc19ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:31.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.979+0000 7f66faffd700 1 -- 172.21.15.49:0/1502184082 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66fc107840 msgr2=0x7f66fc1988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:31.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.979+0000 7f66faffd700 1 --2- 172.21.15.49:0/1502184082 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66fc107840 0x7f66fc1988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:31.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.979+0000 7f66faffd700 1 -- 172.21.15.49:0/1502184082 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66fc199020 con 0x7f66fc102740 2024-06-02T23:57:31.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.979+0000 7f66faffd700 1 --2- 172.21.15.49:0/1502184082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66fc102740 0x7f66fc19e700 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f66ec00c920 tx=0x7f66ec00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:31.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.979+0000 7f66f3fff700 1 -- 172.21.15.49:0/1502184082 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ec007b00 con 0x7f66fc102740 2024-06-02T23:57:31.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.979+0000 7f66f3fff700 1 -- 172.21.15.49:0/1502184082 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66ec004d10 con 0x7f66fc102740 2024-06-02T23:57:31.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.979+0000 7f670176a700 1 -- 172.21.15.49:0/1502184082 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66fc199310 con 0x7f66fc102740 2024-06-02T23:57:31.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.979+0000 7f66f3fff700 1 -- 172.21.15.49:0/1502184082 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ec005680 con 0x7f66fc102740 2024-06-02T23:57:31.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.979+0000 7f670176a700 1 -- 172.21.15.49:0/1502184082 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66fc1a55d0 con 0x7f66fc102740 2024-06-02T23:57:31.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.980+0000 7f670176a700 1 -- 172.21.15.49:0/1502184082 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66fc069180 con 0x7f66fc102740 2024-06-02T23:57:31.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.982+0000 7f66f3fff700 1 -- 172.21.15.49:0/1502184082 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f66ec004750 con 0x7f66fc102740 2024-06-02T23:57:31.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.983+0000 7f66f3fff700 1 --2- 172.21.15.49:0/1502184082 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f66e80a2ca0 0x7f66e80a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:31.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.983+0000 7f66fa7fc700 1 --2- 172.21.15.49:0/1502184082 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f66e80a2ca0 0x7f66e80a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:31.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.983+0000 7f66f3fff700 1 -- 172.21.15.49:0/1502184082 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7f66ec0cee00 con 0x7f66fc102740 2024-06-02T23:57:31.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.983+0000 7f66fa7fc700 1 --2- 172.21.15.49:0/1502184082 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f66e80a2ca0 0x7f66e80a5160 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f66e4005ea0 tx=0x7f66e4005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:31.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:31.986+0000 7f66f3fff700 1 -- 172.21.15.49:0/1502184082 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f66ec014030 con 0x7f66fc102740 2024-06-02T23:57:32.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:32.241+0000 7f670176a700 1 -- 172.21.15.49:0/1502184082 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f66fc1a58c0 con 0x7f66fc102740 2024-06-02T23:57:32.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:32.452+0000 7f66f3fff700 1 -- 172.21.15.49:0/1502184082 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f66ec09bf30 con 0x7f66fc102740 2024-06-02T23:57:32.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:32.455+0000 7f670176a700 1 -- 172.21.15.49:0/1502184082 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f66e80a2ca0 msgr2=0x7f66e80a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:32.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:32.455+0000 7f670176a700 1 --2- 172.21.15.49:0/1502184082 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f66e80a2ca0 0x7f66e80a5160 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f66e4005ea0 tx=0x7f66e4005e30 comp rx=0 tx=0).stop 2024-06-02T23:57:32.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:32.455+0000 7f670176a700 1 -- 172.21.15.49:0/1502184082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66fc102740 msgr2=0x7f66fc19e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:32.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:32.455+0000 7f670176a700 1 --2- 172.21.15.49:0/1502184082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66fc102740 0x7f66fc19e700 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f66ec00c920 tx=0x7f66ec00cc30 comp rx=0 tx=0).stop 2024-06-02T23:57:32.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:32.455+0000 7f670176a700 1 -- 172.21.15.49:0/1502184082 shutdown_connections 2024-06-02T23:57:32.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:32.455+0000 7f670176a700 1 --2- 172.21.15.49:0/1502184082 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f66e80a2ca0 0x7f66e80a5160 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:32.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:32.455+0000 7f670176a700 1 --2- 172.21.15.49:0/1502184082 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66fc107840 0x7f66fc1988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:32.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:32.455+0000 7f670176a700 1 --2- 172.21.15.49:0/1502184082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66fc102740 0x7f66fc19e700 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:32.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:32.455+0000 7f670176a700 1 --2- 172.21.15.49:0/1502184082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66fc1030f0 0x7f66fc19ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:32.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:32.455+0000 7f670176a700 1 -- 172.21.15.49:0/1502184082 >> 172.21.15.49:0/1502184082 conn(0x7f66fc0795f0 msgr2=0x7f66fc100450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:32.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:32.455+0000 7f670176a700 1 -- 172.21.15.49:0/1502184082 shutdown_connections 2024-06-02T23:57:32.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:32.455+0000 7f670176a700 1 -- 172.21.15.49:0/1502184082 wait complete. 2024-06-02T23:57:32.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:32 smithi057 ceph-mon[36457]: pgmap v306: 97 pgs: 97 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 1 op/s 2024-06-02T23:57:32.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:32 smithi057 ceph-mon[36457]: mds.? [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] up:active 2024-06-02T23:57:32.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:32 smithi057 ceph-mon[36457]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-06-02T23:57:32.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:32 smithi057 ceph-mon[36457]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-06-02T23:57:32.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:32 smithi057 ceph-mon[36457]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=h=up:creating} 8 up:standby 2024-06-02T23:57:32.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:32 smithi057 ceph-mon[36457]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-06-02T23:57:32.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:32 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/1502184082' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-02T23:57:32.704 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:32 smithi049 ceph-mon[32302]: pgmap v306: 97 pgs: 97 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 1 op/s 2024-06-02T23:57:32.704 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:32 smithi049 ceph-mon[32302]: mds.? [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] up:active 2024-06-02T23:57:32.704 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:32 smithi049 ceph-mon[32302]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-06-02T23:57:32.704 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:32 smithi049 ceph-mon[32302]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-06-02T23:57:32.704 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:32 smithi049 ceph-mon[32302]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=h=up:creating} 8 up:standby 2024-06-02T23:57:32.705 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:32 smithi049 ceph-mon[32302]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-06-02T23:57:32.705 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:32 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/1502184082' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-02T23:57:32.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:32 smithi107 ceph-mon[37048]: pgmap v306: 97 pgs: 97 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 1 op/s 2024-06-02T23:57:32.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:32 smithi107 ceph-mon[37048]: mds.? [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] up:active 2024-06-02T23:57:32.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:32 smithi107 ceph-mon[37048]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-06-02T23:57:32.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:32 smithi107 ceph-mon[37048]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-06-02T23:57:32.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:32 smithi107 ceph-mon[37048]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=h=up:creating} 8 up:standby 2024-06-02T23:57:32.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:32 smithi107 ceph-mon[37048]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-06-02T23:57:32.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:32 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/1502184082' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-02T23:57:33.109 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-06-02T23:57:33.360 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:57:33.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:33 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/1502184082' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-06-02T23:57:33.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:33 smithi049 ceph-mon[32302]: mds.? [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] up:active 2024-06-02T23:57:33.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:33 smithi049 ceph-mon[32302]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-06-02T23:57:33.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:33 smithi049 ceph-mon[32302]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-06-02T23:57:33.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:33 smithi049 ceph-mon[32302]: Cluster is now healthy 2024-06-02T23:57:33.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:33 smithi049 ceph-mon[32302]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=h=up:active} 8 up:standby 2024-06-02T23:57:33.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:33 smithi049 ceph-mon[32302]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-06-02T23:57:33.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:33 smithi049 ceph-mon[32302]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-06-02T23:57:33.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:33 smithi049 ceph-mon[32302]: mds.? [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] up:active 2024-06-02T23:57:33.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:33 smithi049 ceph-mon[32302]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-02T23:57:33.850 INFO:journalctl@ceph.mds.i.smithi107.stdout:Jun 02 23:57:33 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-i[68110]: 2024-06-02T23:57:33.638+0000 7f58ba595700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-06-02T23:57:33.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:33 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/1502184082' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-06-02T23:57:33.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:33 smithi107 ceph-mon[37048]: mds.? [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] up:active 2024-06-02T23:57:33.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:33 smithi107 ceph-mon[37048]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-06-02T23:57:33.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:33 smithi107 ceph-mon[37048]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-06-02T23:57:33.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:33 smithi107 ceph-mon[37048]: Cluster is now healthy 2024-06-02T23:57:33.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:33 smithi107 ceph-mon[37048]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=h=up:active} 8 up:standby 2024-06-02T23:57:33.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:33 smithi107 ceph-mon[37048]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-06-02T23:57:33.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:33 smithi107 ceph-mon[37048]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-06-02T23:57:33.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:33 smithi107 ceph-mon[37048]: mds.? [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] up:active 2024-06-02T23:57:33.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:33 smithi107 ceph-mon[37048]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-02T23:57:33.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:33 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/1502184082' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-06-02T23:57:33.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:33 smithi057 ceph-mon[36457]: mds.? [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] up:active 2024-06-02T23:57:33.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:33 smithi057 ceph-mon[36457]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-06-02T23:57:33.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:33 smithi057 ceph-mon[36457]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-06-02T23:57:33.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:33 smithi057 ceph-mon[36457]: Cluster is now healthy 2024-06-02T23:57:33.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:33 smithi057 ceph-mon[36457]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=h=up:active} 8 up:standby 2024-06-02T23:57:33.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:33 smithi057 ceph-mon[36457]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-06-02T23:57:33.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:33 smithi057 ceph-mon[36457]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-06-02T23:57:33.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:33 smithi057 ceph-mon[36457]: mds.? [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] up:active 2024-06-02T23:57:33.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:33 smithi057 ceph-mon[36457]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-02T23:57:34.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:34 smithi049 ceph-mon[32302]: pgmap v307: 97 pgs: 97 active+clean; 580 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 4 op/s 2024-06-02T23:57:34.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:34 smithi107 ceph-mon[37048]: pgmap v307: 97 pgs: 97 active+clean; 580 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 4 op/s 2024-06-02T23:57:34.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:34 smithi057 ceph-mon[36457]: pgmap v307: 97 pgs: 97 active+clean; 580 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 4 op/s 2024-06-02T23:57:34.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.953+0000 7fd9804a5700 1 -- 172.21.15.49:0/3591402264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9781066d0 msgr2=0x7fd97810e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:34.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.953+0000 7fd9804a5700 1 --2- 172.21.15.49:0/3591402264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9781066d0 0x7fd97810e2a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd97000b0d0 tx=0x7fd97000b3e0 comp rx=0 tx=0).stop 2024-06-02T23:57:34.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.953+0000 7fd9804a5700 1 -- 172.21.15.49:0/3591402264 shutdown_connections 2024-06-02T23:57:34.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.953+0000 7fd9804a5700 1 --2- 172.21.15.49:0/3591402264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd9781066d0 0x7fd97810e2a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:34.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.953+0000 7fd9804a5700 1 --2- 172.21.15.49:0/3591402264 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd978101680 0x7fd978101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:34.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.953+0000 7fd9804a5700 1 --2- 172.21.15.49:0/3591402264 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd978102030 0x7fd978105ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:34.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.953+0000 7fd9804a5700 1 -- 172.21.15.49:0/3591402264 >> 172.21.15.49:0/3591402264 conn(0x7fd9780773e0 msgr2=0x7fd9780777f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:34.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.953+0000 7fd9804a5700 1 -- 172.21.15.49:0/3591402264 shutdown_connections 2024-06-02T23:57:34.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.953+0000 7fd9804a5700 1 -- 172.21.15.49:0/3591402264 wait complete. 2024-06-02T23:57:34.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.954+0000 7fd9804a5700 1 Processor -- start 2024-06-02T23:57:34.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.954+0000 7fd9804a5700 1 -- start start 2024-06-02T23:57:34.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.954+0000 7fd9804a5700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd978101680 0x7fd97819ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:34.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.954+0000 7fd9804a5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd978102030 0x7fd97819b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:34.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.954+0000 7fd9804a5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9781066d0 0x7fd97819f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:34.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.954+0000 7fd9804a5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd9781116e0 con 0x7fd978102030 2024-06-02T23:57:34.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.954+0000 7fd9804a5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd978111560 con 0x7fd9781066d0 2024-06-02T23:57:34.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.954+0000 7fd9804a5700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd978111860 con 0x7fd978101680 2024-06-02T23:57:34.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.954+0000 7fd97da40700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd978102030 0x7fd97819b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:34.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.954+0000 7fd97da40700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd978102030 0x7fd97819b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59948/0 (socket says 172.21.15.49:59948) 2024-06-02T23:57:34.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.954+0000 7fd97da40700 1 -- 172.21.15.49:0/3290921050 learned_addr learned my addr 172.21.15.49:0/3290921050 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:57:34.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.954+0000 7fd97e241700 1 --2- 172.21.15.49:0/3290921050 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd978101680 0x7fd97819ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:34.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.954+0000 7fd97ea42700 1 --2- 172.21.15.49:0/3290921050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9781066d0 0x7fd97819f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:34.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.954+0000 7fd97da40700 1 -- 172.21.15.49:0/3290921050 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd978101680 msgr2=0x7fd97819ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:34.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.954+0000 7fd97da40700 1 --2- 172.21.15.49:0/3290921050 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd978101680 0x7fd97819ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:34.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.954+0000 7fd97da40700 1 -- 172.21.15.49:0/3290921050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9781066d0 msgr2=0x7fd97819f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:34.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.954+0000 7fd97da40700 1 --2- 172.21.15.49:0/3290921050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9781066d0 0x7fd97819f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:34.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.954+0000 7fd97da40700 1 -- 172.21.15.49:0/3290921050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd97819fdc0 con 0x7fd978102030 2024-06-02T23:57:34.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.954+0000 7fd97ea42700 1 --2- 172.21.15.49:0/3290921050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9781066d0 0x7fd97819f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:57:34.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.954+0000 7fd97da40700 1 --2- 172.21.15.49:0/3290921050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd978102030 0x7fd97819b340 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd96800d950 tx=0x7fd96800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:34.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.955+0000 7fd96f7fe700 1 -- 172.21.15.49:0/3290921050 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd968017070 con 0x7fd978102030 2024-06-02T23:57:34.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.955+0000 7fd9804a5700 1 -- 172.21.15.49:0/3290921050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9781a00b0 con 0x7fd978102030 2024-06-02T23:57:34.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.955+0000 7fd96f7fe700 1 -- 172.21.15.49:0/3290921050 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd968005020 con 0x7fd978102030 2024-06-02T23:57:34.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.955+0000 7fd96f7fe700 1 -- 172.21.15.49:0/3290921050 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd968009b20 con 0x7fd978102030 2024-06-02T23:57:34.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.955+0000 7fd9804a5700 1 -- 172.21.15.49:0/3290921050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9781a7930 con 0x7fd978102030 2024-06-02T23:57:34.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.956+0000 7fd9804a5700 1 -- 172.21.15.49:0/3290921050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd978069180 con 0x7fd978102030 2024-06-02T23:57:34.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.958+0000 7fd96f7fe700 1 -- 172.21.15.49:0/3290921050 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd9680051d0 con 0x7fd978102030 2024-06-02T23:57:34.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.958+0000 7fd96f7fe700 1 --2- 172.21.15.49:0/3290921050 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fd9640a2c20 0x7fd9640a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:34.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.959+0000 7fd97e241700 1 --2- 172.21.15.49:0/3290921050 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fd9640a2c20 0x7fd9640a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:34.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.959+0000 7fd96f7fe700 1 -- 172.21.15.49:0/3290921050 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7fd9680ceb40 con 0x7fd978102030 2024-06-02T23:57:34.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.959+0000 7fd97e241700 1 --2- 172.21.15.49:0/3290921050 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fd9640a2c20 0x7fd9640a50e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd974005950 tx=0x7fd97400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:34.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:34.962+0000 7fd96f7fe700 1 -- 172.21.15.49:0/3290921050 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd96809bbf0 con 0x7fd978102030 2024-06-02T23:57:35.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:35.217+0000 7fd9804a5700 1 -- 172.21.15.49:0/3290921050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fd97802dca0 con 0x7fd978102030 2024-06-02T23:57:35.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:35.469+0000 7fd96f7fe700 1 -- 172.21.15.49:0/3290921050 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7fd96809b4f0 con 0x7fd978102030 2024-06-02T23:57:35.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:35.472+0000 7fd9804a5700 1 -- 172.21.15.49:0/3290921050 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fd9640a2c20 msgr2=0x7fd9640a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:35.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:35.472+0000 7fd9804a5700 1 --2- 172.21.15.49:0/3290921050 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fd9640a2c20 0x7fd9640a50e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd974005950 tx=0x7fd97400b410 comp rx=0 tx=0).stop 2024-06-02T23:57:35.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:35.472+0000 7fd9804a5700 1 -- 172.21.15.49:0/3290921050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd978102030 msgr2=0x7fd97819b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:35.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:35.472+0000 7fd9804a5700 1 --2- 172.21.15.49:0/3290921050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd978102030 0x7fd97819b340 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd96800d950 tx=0x7fd96800dc60 comp rx=0 tx=0).stop 2024-06-02T23:57:35.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:35.472+0000 7fd9804a5700 1 -- 172.21.15.49:0/3290921050 shutdown_connections 2024-06-02T23:57:35.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:35.472+0000 7fd9804a5700 1 --2- 172.21.15.49:0/3290921050 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fd9640a2c20 0x7fd9640a50e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:35.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:35.472+0000 7fd9804a5700 1 --2- 172.21.15.49:0/3290921050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9781066d0 0x7fd97819f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:35.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:35.472+0000 7fd9804a5700 1 --2- 172.21.15.49:0/3290921050 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd978101680 0x7fd97819ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:35.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:35.472+0000 7fd9804a5700 1 --2- 172.21.15.49:0/3290921050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd978102030 0x7fd97819b340 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:35.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:35.472+0000 7fd9804a5700 1 -- 172.21.15.49:0/3290921050 >> 172.21.15.49:0/3290921050 conn(0x7fd9780773e0 msgr2=0x7fd97810d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:35.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:35.472+0000 7fd9804a5700 1 -- 172.21.15.49:0/3290921050 shutdown_connections 2024-06-02T23:57:35.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:35.472+0000 7fd9804a5700 1 -- 172.21.15.49:0/3290921050 wait complete. 2024-06-02T23:57:35.778 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:35 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3290921050' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-02T23:57:35.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:35 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/3290921050' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-02T23:57:35.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:35 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/3290921050' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-02T23:57:36.120 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-06-02T23:57:36.120 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-06-02T23:57:36.375 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:57:36.752 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:36 smithi107 ceph-mon[37048]: pgmap v308: 97 pgs: 97 active+clean; 584 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4.0 KiB/s wr, 15 op/s 2024-06-02T23:57:36.752 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:36 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/3290921050' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-06-02T23:57:36.752 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:36 smithi107 ceph-mon[37048]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-02T23:57:36.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:36 smithi049 ceph-mon[32302]: pgmap v308: 97 pgs: 97 active+clean; 584 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4.0 KiB/s wr, 15 op/s 2024-06-02T23:57:36.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:36 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3290921050' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-06-02T23:57:36.774 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:36 smithi049 ceph-mon[32302]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-02T23:57:36.851 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:36 smithi057 ceph-mon[36457]: pgmap v308: 97 pgs: 97 active+clean; 584 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4.0 KiB/s wr, 15 op/s 2024-06-02T23:57:36.851 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:36 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/3290921050' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-06-02T23:57:36.852 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:36 smithi057 ceph-mon[36457]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-02T23:57:37.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.805+0000 7f63486bb700 1 -- 172.21.15.49:0/1173792071 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6340102530 msgr2=0x7f63401029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:37.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.805+0000 7f63486bb700 1 --2- 172.21.15.49:0/1173792071 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6340102530 0x7f63401029b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f63300099c0 tx=0x7f6330009cd0 comp rx=0 tx=0).stop 2024-06-02T23:57:37.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.805+0000 7f63486bb700 1 -- 172.21.15.49:0/1173792071 shutdown_connections 2024-06-02T23:57:37.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.805+0000 7f63486bb700 1 --2- 172.21.15.49:0/1173792071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6340102ef0 0x7f634010f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:37.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.805+0000 7f63486bb700 1 --2- 172.21.15.49:0/1173792071 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63401085d0 0x7f63401089b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:37.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.805+0000 7f63486bb700 1 --2- 172.21.15.49:0/1173792071 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6340102530 0x7f63401029b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:37.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.805+0000 7f63486bb700 1 -- 172.21.15.49:0/1173792071 >> 172.21.15.49:0/1173792071 conn(0x7f6340079640 msgr2=0x7f6340079a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:37.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.805+0000 7f63486bb700 1 -- 172.21.15.49:0/1173792071 shutdown_connections 2024-06-02T23:57:37.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.805+0000 7f63486bb700 1 -- 172.21.15.49:0/1173792071 wait complete. 2024-06-02T23:57:37.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.806+0000 7f63486bb700 1 Processor -- start 2024-06-02T23:57:37.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.806+0000 7f63486bb700 1 -- start start 2024-06-02T23:57:37.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.806+0000 7f63486bb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6340102530 0x7f634019e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:37.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.806+0000 7f63486bb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6340102ef0 0x7f634019edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:37.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.806+0000 7f63486bb700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63401085d0 0x7f6340198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:37.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.806+0000 7f63486bb700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6340112830 con 0x7f6340102530 2024-06-02T23:57:37.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.806+0000 7f63486bb700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f63401126b0 con 0x7f6340102ef0 2024-06-02T23:57:37.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.806+0000 7f63486bb700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f63401129b0 con 0x7f63401085d0 2024-06-02T23:57:37.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.806+0000 7f6346457700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6340102530 0x7f634019e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:37.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.806+0000 7f6346457700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6340102530 0x7f634019e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59964/0 (socket says 172.21.15.49:59964) 2024-06-02T23:57:37.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.806+0000 7f6346457700 1 -- 172.21.15.49:0/3511793801 learned_addr learned my addr 172.21.15.49:0/3511793801 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:57:37.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.806+0000 7f6346c58700 1 --2- 172.21.15.49:0/3511793801 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63401085d0 0x7f6340198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:37.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.806+0000 7f6345c56700 1 --2- 172.21.15.49:0/3511793801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6340102ef0 0x7f634019edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:37.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.806+0000 7f6346457700 1 -- 172.21.15.49:0/3511793801 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63401085d0 msgr2=0x7f6340198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:37.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.806+0000 7f6346457700 1 --2- 172.21.15.49:0/3511793801 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63401085d0 0x7f6340198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:37.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.806+0000 7f6346457700 1 -- 172.21.15.49:0/3511793801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6340102ef0 msgr2=0x7f634019edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:37.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.806+0000 7f6346457700 1 --2- 172.21.15.49:0/3511793801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6340102ef0 0x7f634019edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:37.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.806+0000 7f6346457700 1 -- 172.21.15.49:0/3511793801 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6340199190 con 0x7f6340102530 2024-06-02T23:57:37.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.807+0000 7f6346457700 1 --2- 172.21.15.49:0/3511793801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6340102530 0x7f634019e870 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f633c00e9c0 tx=0x7f633c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:37.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.807+0000 7f63377fe700 1 -- 172.21.15.49:0/3511793801 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c00cbd0 con 0x7f6340102530 2024-06-02T23:57:37.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.807+0000 7f63486bb700 1 -- 172.21.15.49:0/3511793801 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6340199480 con 0x7f6340102530 2024-06-02T23:57:37.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.807+0000 7f63377fe700 1 -- 172.21.15.49:0/3511793801 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f633c00ee60 con 0x7f6340102530 2024-06-02T23:57:37.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.807+0000 7f63377fe700 1 -- 172.21.15.49:0/3511793801 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c005630 con 0x7f6340102530 2024-06-02T23:57:37.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.807+0000 7f63486bb700 1 -- 172.21.15.49:0/3511793801 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63401a5740 con 0x7f6340102530 2024-06-02T23:57:37.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.808+0000 7f63486bb700 1 -- 172.21.15.49:0/3511793801 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6340103c40 con 0x7f6340102530 2024-06-02T23:57:37.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.809+0000 7f63377fe700 1 -- 172.21.15.49:0/3511793801 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f633c004750 con 0x7f6340102530 2024-06-02T23:57:37.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.810+0000 7f63377fe700 1 --2- 172.21.15.49:0/3511793801 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f632c0a2c20 0x7f632c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:37.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.810+0000 7f6345c56700 1 --2- 172.21.15.49:0/3511793801 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f632c0a2c20 0x7f632c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:37.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.810+0000 7f63377fe700 1 -- 172.21.15.49:0/3511793801 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7f633c0cf340 con 0x7f6340102530 2024-06-02T23:57:37.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.810+0000 7f6345c56700 1 --2- 172.21.15.49:0/3511793801 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f632c0a2c20 0x7f632c0a50e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6340079ad0 tx=0x7f6330005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:37.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:37.813+0000 7f63377fe700 1 -- 172.21.15.49:0/3511793801 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f633c053850 con 0x7f6340102530 2024-06-02T23:57:38.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:38.052+0000 7f63486bb700 1 -- 172.21.15.49:0/3511793801 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f63401016b0 con 0x7f632c0a2c20 2024-06-02T23:57:38.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:38.077+0000 7f63377fe700 1 -- 172.21.15.49:0/3511793801 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f63401016b0 con 0x7f632c0a2c20 2024-06-02T23:57:38.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:38.080+0000 7f63486bb700 1 -- 172.21.15.49:0/3511793801 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f632c0a2c20 msgr2=0x7f632c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:38.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:38.080+0000 7f63486bb700 1 --2- 172.21.15.49:0/3511793801 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f632c0a2c20 0x7f632c0a50e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6340079ad0 tx=0x7f6330005fb0 comp rx=0 tx=0).stop 2024-06-02T23:57:38.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:38.080+0000 7f63486bb700 1 -- 172.21.15.49:0/3511793801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6340102530 msgr2=0x7f634019e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:38.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:38.080+0000 7f63486bb700 1 --2- 172.21.15.49:0/3511793801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6340102530 0x7f634019e870 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f633c00e9c0 tx=0x7f633c00ecd0 comp rx=0 tx=0).stop 2024-06-02T23:57:38.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:38.080+0000 7f63486bb700 1 -- 172.21.15.49:0/3511793801 shutdown_connections 2024-06-02T23:57:38.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:38.080+0000 7f63486bb700 1 --2- 172.21.15.49:0/3511793801 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f632c0a2c20 0x7f632c0a50e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:38.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:38.080+0000 7f63486bb700 1 --2- 172.21.15.49:0/3511793801 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63401085d0 0x7f6340198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:38.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:38.080+0000 7f63486bb700 1 --2- 172.21.15.49:0/3511793801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6340102530 0x7f634019e870 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:38.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:38.080+0000 7f63486bb700 1 --2- 172.21.15.49:0/3511793801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6340102ef0 0x7f634019edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:38.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:38.080+0000 7f63486bb700 1 -- 172.21.15.49:0/3511793801 >> 172.21.15.49:0/3511793801 conn(0x7f6340079640 msgr2=0x7f6340100fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:38.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:38.080+0000 7f63486bb700 1 -- 172.21.15.49:0/3511793801 shutdown_connections 2024-06-02T23:57:38.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:38.080+0000 7f63486bb700 1 -- 172.21.15.49:0/3511793801 wait complete. 2024-06-02T23:57:38.211 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:57:38 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:57:38.057+0000 7f0397a24700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:57:38.211 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:57:38 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:57:38.057+0000 7f0397a24700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:57:38.211 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:57:38 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:57:38.057+0000 7f0397a24700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:57:38.211 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:57:38 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:57:38.057+0000 7f0397a24700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:57:38.211 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 02 23:57:38 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-02T23:57:38.057+0000 7f0397a24700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:57:38.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:38 smithi049 ceph-mon[32302]: pgmap v309: 97 pgs: 97 active+clean; 584 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 4.0 KiB/s wr, 17 op/s 2024-06-02T23:57:38.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:38 smithi049 ceph-mon[32302]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:57:38.764 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-06-02T23:57:38.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:38 smithi107 ceph-mon[37048]: pgmap v309: 97 pgs: 97 active+clean; 584 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 4.0 KiB/s wr, 17 op/s 2024-06-02T23:57:38.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:38 smithi107 ceph-mon[37048]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:57:38.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:38 smithi057 ceph-mon[36457]: pgmap v309: 97 pgs: 97 active+clean; 584 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 4.0 KiB/s wr, 17 op/s 2024-06-02T23:57:38.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:38 smithi057 ceph-mon[36457]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:57:39.016 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:57:40.598 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:40 smithi049 ceph-mon[32302]: pgmap v310: 97 pgs: 97 active+clean; 585 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 4.1 KiB/s wr, 19 op/s 2024-06-02T23:57:40.598 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:40 smithi049 ceph-mon[32302]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-06-02T23:57:40.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.597+0000 7f090c4db700 1 -- 172.21.15.49:0/3771109261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f090406b620 msgr2=0x7f090410f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:40.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.597+0000 7f090c4db700 1 --2- 172.21.15.49:0/3771109261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f090406b620 0x7f090410f350 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f08fc00b0d0 tx=0x7f08fc00b3e0 comp rx=0 tx=0).stop 2024-06-02T23:57:40.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.597+0000 7f090c4db700 1 -- 172.21.15.49:0/3771109261 shutdown_connections 2024-06-02T23:57:40.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.597+0000 7f090c4db700 1 --2- 172.21.15.49:0/3771109261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f090406b620 0x7f090410f350 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:40.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.597+0000 7f090c4db700 1 --2- 172.21.15.49:0/3771109261 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0904108580 0x7f0904108960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:40.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.597+0000 7f090c4db700 1 --2- 172.21.15.49:0/3771109261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f090406ac60 0x7f090406b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:40.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.597+0000 7f090c4db700 1 -- 172.21.15.49:0/3771109261 >> 172.21.15.49:0/3771109261 conn(0x7f0904078430 msgr2=0x7f0904078840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:40.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.597+0000 7f090c4db700 1 -- 172.21.15.49:0/3771109261 shutdown_connections 2024-06-02T23:57:40.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.597+0000 7f090c4db700 1 -- 172.21.15.49:0/3771109261 wait complete. 2024-06-02T23:57:40.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.597+0000 7f090c4db700 1 Processor -- start 2024-06-02T23:57:40.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.597+0000 7f090c4db700 1 -- start start 2024-06-02T23:57:40.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.598+0000 7f090c4db700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f090406ac60 0x7f090419e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:40.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.598+0000 7f090c4db700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f090406b620 0x7f090419ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:40.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.598+0000 7f090c4db700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0904108580 0x7f0904198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:40.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.598+0000 7f090c4db700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f09041127c0 con 0x7f090406ac60 2024-06-02T23:57:40.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.598+0000 7f090c4db700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0904112640 con 0x7f090406b620 2024-06-02T23:57:40.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.598+0000 7f090c4db700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0904112940 con 0x7f0904108580 2024-06-02T23:57:40.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.598+0000 7f090a277700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f090406ac60 0x7f090419e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:40.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.598+0000 7f090a277700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f090406ac60 0x7f090419e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60004/0 (socket says 172.21.15.49:60004) 2024-06-02T23:57:40.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.598+0000 7f090a277700 1 -- 172.21.15.49:0/2929415334 learned_addr learned my addr 172.21.15.49:0/2929415334 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:57:40.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.598+0000 7f0909a76700 1 --2- 172.21.15.49:0/2929415334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f090406b620 0x7f090419ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:40.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.598+0000 7f090aa78700 1 --2- 172.21.15.49:0/2929415334 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0904108580 0x7f0904198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:40.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.598+0000 7f090a277700 1 -- 172.21.15.49:0/2929415334 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0904108580 msgr2=0x7f0904198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:40.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.598+0000 7f090a277700 1 --2- 172.21.15.49:0/2929415334 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0904108580 0x7f0904198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:40.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.598+0000 7f090a277700 1 -- 172.21.15.49:0/2929415334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f090406b620 msgr2=0x7f090419ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:40.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.598+0000 7f090a277700 1 --2- 172.21.15.49:0/2929415334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f090406b620 0x7f090419ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:40.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.598+0000 7f090a277700 1 -- 172.21.15.49:0/2929415334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0904199080 con 0x7f090406ac60 2024-06-02T23:57:40.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.598+0000 7f0909a76700 1 --2- 172.21.15.49:0/2929415334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f090406b620 0x7f090419ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:57:40.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.598+0000 7f090a277700 1 --2- 172.21.15.49:0/2929415334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f090406ac60 0x7f090419e710 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f090000d950 tx=0x7f090000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:40.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.599+0000 7f08fb7fe700 1 -- 172.21.15.49:0/2929415334 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0900016070 con 0x7f090406ac60 2024-06-02T23:57:40.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.599+0000 7f08fb7fe700 1 -- 172.21.15.49:0/2929415334 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0900009b40 con 0x7f090406ac60 2024-06-02T23:57:40.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.599+0000 7f090c4db700 1 -- 172.21.15.49:0/2929415334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0904199370 con 0x7f090406ac60 2024-06-02T23:57:40.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.599+0000 7f08fb7fe700 1 -- 172.21.15.49:0/2929415334 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f090000f620 con 0x7f090406ac60 2024-06-02T23:57:40.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.599+0000 7f090c4db700 1 -- 172.21.15.49:0/2929415334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09041a55e0 con 0x7f090406ac60 2024-06-02T23:57:40.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.600+0000 7f090c4db700 1 -- 172.21.15.49:0/2929415334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0904069180 con 0x7f090406ac60 2024-06-02T23:57:40.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.601+0000 7f08fb7fe700 1 -- 172.21.15.49:0/2929415334 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0900019070 con 0x7f090406ac60 2024-06-02T23:57:40.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.601+0000 7f08fb7fe700 1 --2- 172.21.15.49:0/2929415334 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f08f00a2cb0 0x7f08f00a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:40.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.602+0000 7f0909a76700 1 --2- 172.21.15.49:0/2929415334 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f08f00a2cb0 0x7f08f00a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:40.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.602+0000 7f08fb7fe700 1 -- 172.21.15.49:0/2929415334 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7f09000cf040 con 0x7f090406ac60 2024-06-02T23:57:40.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.602+0000 7f0909a76700 1 --2- 172.21.15.49:0/2929415334 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f08f00a2cb0 0x7f08f00a5170 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f08f4005fd0 tx=0x7f08f4005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:40.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.605+0000 7f08fb7fe700 1 -- 172.21.15.49:0/2929415334 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f090009bff0 con 0x7f090406ac60 2024-06-02T23:57:40.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.845+0000 7f090c4db700 1 -- 172.21.15.49:0/2929415334 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f0904100400 con 0x7f08f00a2cb0 2024-06-02T23:57:40.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:40 smithi107 ceph-mon[37048]: pgmap v310: 97 pgs: 97 active+clean; 585 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 4.1 KiB/s wr, 19 op/s 2024-06-02T23:57:40.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:40 smithi107 ceph-mon[37048]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-06-02T23:57:40.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.874+0000 7f08fb7fe700 1 -- 172.21.15.49:0/2929415334 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0904100400 con 0x7f08f00a2cb0 2024-06-02T23:57:40.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.876+0000 7f090c4db700 1 -- 172.21.15.49:0/2929415334 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f08f00a2cb0 msgr2=0x7f08f00a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:40.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.876+0000 7f090c4db700 1 --2- 172.21.15.49:0/2929415334 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f08f00a2cb0 0x7f08f00a5170 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f08f4005fd0 tx=0x7f08f4005e30 comp rx=0 tx=0).stop 2024-06-02T23:57:40.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.876+0000 7f090c4db700 1 -- 172.21.15.49:0/2929415334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f090406ac60 msgr2=0x7f090419e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:40.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.876+0000 7f090c4db700 1 --2- 172.21.15.49:0/2929415334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f090406ac60 0x7f090419e710 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f090000d950 tx=0x7f090000dd10 comp rx=0 tx=0).stop 2024-06-02T23:57:40.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.876+0000 7f090c4db700 1 -- 172.21.15.49:0/2929415334 shutdown_connections 2024-06-02T23:57:40.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.876+0000 7f090c4db700 1 --2- 172.21.15.49:0/2929415334 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f08f00a2cb0 0x7f08f00a5170 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:40.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.876+0000 7f090c4db700 1 --2- 172.21.15.49:0/2929415334 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0904108580 0x7f0904198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:40.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.876+0000 7f090c4db700 1 --2- 172.21.15.49:0/2929415334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f090406ac60 0x7f090419e710 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:40.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.876+0000 7f090c4db700 1 --2- 172.21.15.49:0/2929415334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f090406b620 0x7f090419ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:40.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.876+0000 7f090c4db700 1 -- 172.21.15.49:0/2929415334 >> 172.21.15.49:0/2929415334 conn(0x7f0904078430 msgr2=0x7f09040ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:40.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.876+0000 7f090c4db700 1 -- 172.21.15.49:0/2929415334 shutdown_connections 2024-06-02T23:57:40.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:40.876+0000 7f090c4db700 1 -- 172.21.15.49:0/2929415334 wait complete. 2024-06-02T23:57:40.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:40 smithi057 ceph-mon[36457]: pgmap v310: 97 pgs: 97 active+clean; 585 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 4.1 KiB/s wr, 19 op/s 2024-06-02T23:57:40.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:40 smithi057 ceph-mon[36457]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-06-02T23:57:41.538 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-06-02T23:57:41.788 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:57:41.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:41 smithi107 ceph-mon[37048]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:57:41.885 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:41 smithi049 ceph-mon[32302]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:57:41.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:41 smithi057 ceph-mon[36457]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:57:42.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:42 smithi107 ceph-mon[37048]: pgmap v311: 97 pgs: 97 active+clean; 585 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 4.2 KiB/s wr, 20 op/s 2024-06-02T23:57:42.866 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:42 smithi049 ceph-mon[32302]: pgmap v311: 97 pgs: 97 active+clean; 585 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 4.2 KiB/s wr, 20 op/s 2024-06-02T23:57:42.949 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:42 smithi057 ceph-mon[36457]: pgmap v311: 97 pgs: 97 active+clean; 585 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 4.2 KiB/s wr, 20 op/s 2024-06-02T23:57:43.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.441+0000 7f1d327e1700 1 -- 172.21.15.49:0/2947262378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d2c101390 msgr2=0x7f1d2c101810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:43.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.441+0000 7f1d327e1700 1 --2- 172.21.15.49:0/2947262378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d2c101390 0x7f1d2c101810 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1d14009990 tx=0x7f1d14009ca0 comp rx=0 tx=0).stop 2024-06-02T23:57:43.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.441+0000 7f1d327e1700 1 -- 172.21.15.49:0/2947262378 shutdown_connections 2024-06-02T23:57:43.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.441+0000 7f1d327e1700 1 --2- 172.21.15.49:0/2947262378 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d2c101d50 0x7f1d2c10e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:43.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.441+0000 7f1d327e1700 1 --2- 172.21.15.49:0/2947262378 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d2c107400 0x7f1d2c1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:43.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.441+0000 7f1d327e1700 1 --2- 172.21.15.49:0/2947262378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d2c101390 0x7f1d2c101810 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:43.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.441+0000 7f1d327e1700 1 -- 172.21.15.49:0/2947262378 >> 172.21.15.49:0/2947262378 conn(0x7f1d2c078340 msgr2=0x7f1d2c078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:43.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.441+0000 7f1d327e1700 1 -- 172.21.15.49:0/2947262378 shutdown_connections 2024-06-02T23:57:43.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.441+0000 7f1d327e1700 1 -- 172.21.15.49:0/2947262378 wait complete. 2024-06-02T23:57:43.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.442+0000 7f1d327e1700 1 Processor -- start 2024-06-02T23:57:43.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.442+0000 7f1d327e1700 1 -- start start 2024-06-02T23:57:43.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.442+0000 7f1d327e1700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d2c101390 0x7f1d2c19ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:43.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.442+0000 7f1d327e1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d2c101d50 0x7f1d2c19b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:43.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.442+0000 7f1d327e1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d2c107400 0x7f1d2c19f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:43.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.442+0000 7f1d327e1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c1116f0 con 0x7f1d2c101d50 2024-06-02T23:57:43.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.442+0000 7f1d327e1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c111570 con 0x7f1d2c107400 2024-06-02T23:57:43.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.442+0000 7f1d327e1700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c111870 con 0x7f1d2c101390 2024-06-02T23:57:43.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.442+0000 7f1d23fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d2c101d50 0x7f1d2c19b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:43.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.442+0000 7f1d23fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d2c101d50 0x7f1d2c19b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46918/0 (socket says 172.21.15.49:46918) 2024-06-02T23:57:43.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.442+0000 7f1d23fff700 1 -- 172.21.15.49:0/3649795616 learned_addr learned my addr 172.21.15.49:0/3649795616 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:57:43.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.442+0000 7f1d2bfff700 1 --2- 172.21.15.49:0/3649795616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d2c101390 0x7f1d2c19ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:43.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.443+0000 7f1d30d7e700 1 --2- 172.21.15.49:0/3649795616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d2c107400 0x7f1d2c19f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:43.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.443+0000 7f1d23fff700 1 -- 172.21.15.49:0/3649795616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d2c101390 msgr2=0x7f1d2c19ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:43.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.443+0000 7f1d23fff700 1 --2- 172.21.15.49:0/3649795616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d2c101390 0x7f1d2c19ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:43.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.443+0000 7f1d23fff700 1 -- 172.21.15.49:0/3649795616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d2c107400 msgr2=0x7f1d2c19f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:43.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.443+0000 7f1d23fff700 1 --2- 172.21.15.49:0/3649795616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d2c107400 0x7f1d2c19f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:43.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.443+0000 7f1d23fff700 1 -- 172.21.15.49:0/3649795616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d2c19fe80 con 0x7f1d2c101d50 2024-06-02T23:57:43.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.443+0000 7f1d2bfff700 1 --2- 172.21.15.49:0/3649795616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d2c101390 0x7f1d2c19ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:57:43.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.443+0000 7f1d23fff700 1 --2- 172.21.15.49:0/3649795616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d2c101d50 0x7f1d2c19b3b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1d1400bff0 tx=0x7f1d14005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:43.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.443+0000 7f1d29ffb700 1 -- 172.21.15.49:0/3649795616 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d14027070 con 0x7f1d2c101d50 2024-06-02T23:57:43.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.443+0000 7f1d29ffb700 1 -- 172.21.15.49:0/3649795616 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d14004150 con 0x7f1d2c101d50 2024-06-02T23:57:43.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.443+0000 7f1d327e1700 1 -- 172.21.15.49:0/3649795616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d2c1a0110 con 0x7f1d2c101d50 2024-06-02T23:57:43.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.443+0000 7f1d29ffb700 1 -- 172.21.15.49:0/3649795616 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d1400f460 con 0x7f1d2c101d50 2024-06-02T23:57:43.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.443+0000 7f1d327e1700 1 -- 172.21.15.49:0/3649795616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d2c1a79f0 con 0x7f1d2c101d50 2024-06-02T23:57:43.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.444+0000 7f1d327e1700 1 -- 172.21.15.49:0/3649795616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d2c069180 con 0x7f1d2c101d50 2024-06-02T23:57:43.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.445+0000 7f1d29ffb700 1 -- 172.21.15.49:0/3649795616 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1d1402a070 con 0x7f1d2c101d50 2024-06-02T23:57:43.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.446+0000 7f1d29ffb700 1 --2- 172.21.15.49:0/3649795616 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1d180a2cb0 0x7f1d180a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:43.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.446+0000 7f1d2bfff700 1 --2- 172.21.15.49:0/3649795616 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1d180a2cb0 0x7f1d180a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:43.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.446+0000 7f1d29ffb700 1 -- 172.21.15.49:0/3649795616 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7f1d140d06d0 con 0x7f1d2c101d50 2024-06-02T23:57:43.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.447+0000 7f1d2bfff700 1 --2- 172.21.15.49:0/3649795616 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1d180a2cb0 0x7f1d180a5170 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c005fd0 tx=0x7f1d1c005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:43.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.450+0000 7f1d29ffb700 1 -- 172.21.15.49:0/3649795616 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1d14031020 con 0x7f1d2c101d50 2024-06-02T23:57:43.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.692+0000 7f1d327e1700 1 -- 172.21.15.49:0/3649795616 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f1d2c100a20 con 0x7f1d180a2cb0 2024-06-02T23:57:43.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.697+0000 7f1d29ffb700 1 -- 172.21.15.49:0/3649795616 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f1d2c100a20 con 0x7f1d180a2cb0 2024-06-02T23:57:43.698 INFO:teuthology.orchestra.run.smithi049.stdout:/volumes/qa/sv_0/bd6afa56-8364-459d-89b3-2cb40a4dd7e8 2024-06-02T23:57:43.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.700+0000 7f1d327e1700 1 -- 172.21.15.49:0/3649795616 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1d180a2cb0 msgr2=0x7f1d180a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:43.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.700+0000 7f1d327e1700 1 --2- 172.21.15.49:0/3649795616 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1d180a2cb0 0x7f1d180a5170 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c005fd0 tx=0x7f1d1c005e30 comp rx=0 tx=0).stop 2024-06-02T23:57:43.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.700+0000 7f1d327e1700 1 -- 172.21.15.49:0/3649795616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d2c101d50 msgr2=0x7f1d2c19b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:43.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.700+0000 7f1d327e1700 1 --2- 172.21.15.49:0/3649795616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d2c101d50 0x7f1d2c19b3b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1d1400bff0 tx=0x7f1d14005640 comp rx=0 tx=0).stop 2024-06-02T23:57:43.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.700+0000 7f1d327e1700 1 -- 172.21.15.49:0/3649795616 shutdown_connections 2024-06-02T23:57:43.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.700+0000 7f1d327e1700 1 --2- 172.21.15.49:0/3649795616 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1d180a2cb0 0x7f1d180a5170 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:43.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.700+0000 7f1d327e1700 1 --2- 172.21.15.49:0/3649795616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d2c107400 0x7f1d2c19f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:43.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.700+0000 7f1d327e1700 1 --2- 172.21.15.49:0/3649795616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d2c101390 0x7f1d2c19ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:43.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.700+0000 7f1d327e1700 1 --2- 172.21.15.49:0/3649795616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d2c101d50 0x7f1d2c19b3b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:43.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.700+0000 7f1d327e1700 1 -- 172.21.15.49:0/3649795616 >> 172.21.15.49:0/3649795616 conn(0x7f1d2c078340 msgr2=0x7f1d2c100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:43.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.700+0000 7f1d327e1700 1 -- 172.21.15.49:0/3649795616 shutdown_connections 2024-06-02T23:57:43.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:43.700+0000 7f1d327e1700 1 -- 172.21.15.49:0/3649795616 wait complete. 2024-06-02T23:57:44.476 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-06-02T23:57:44.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:44 smithi049 ceph-mon[32302]: pgmap v312: 97 pgs: 97 active+clean; 605 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.2 KiB/s wr, 23 op/s 2024-06-02T23:57:44.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:44 smithi049 ceph-mon[32302]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:57:44.734 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:57:44.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:44 smithi107 ceph-mon[37048]: pgmap v312: 97 pgs: 97 active+clean; 605 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.2 KiB/s wr, 23 op/s 2024-06-02T23:57:44.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:44 smithi107 ceph-mon[37048]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:57:44.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:44 smithi057 ceph-mon[36457]: pgmap v312: 97 pgs: 97 active+clean; 605 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.2 KiB/s wr, 23 op/s 2024-06-02T23:57:44.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:44 smithi057 ceph-mon[36457]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:57:46.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.304+0000 7fd624d03700 1 -- 172.21.15.49:0/374865500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd620108500 msgr2=0x7fd6201088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:46.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.304+0000 7fd624d03700 1 --2- 172.21.15.49:0/374865500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd620108500 0x7fd6201088e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd610009990 tx=0x7fd610009ca0 comp rx=0 tx=0).stop 2024-06-02T23:57:46.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.304+0000 7fd624d03700 1 -- 172.21.15.49:0/374865500 shutdown_connections 2024-06-02T23:57:46.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.304+0000 7fd624d03700 1 --2- 172.21.15.49:0/374865500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd62006ab30 0x7fd62010f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:46.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.304+0000 7fd624d03700 1 --2- 172.21.15.49:0/374865500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd620108500 0x7fd6201088e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:46.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.304+0000 7fd624d03700 1 --2- 172.21.15.49:0/374865500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd62006a170 0x7fd62006a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:46.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.304+0000 7fd624d03700 1 -- 172.21.15.49:0/374865500 >> 172.21.15.49:0/374865500 conn(0x7fd620078340 msgr2=0x7fd620078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:46.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.305+0000 7fd624d03700 1 -- 172.21.15.49:0/374865500 shutdown_connections 2024-06-02T23:57:46.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.305+0000 7fd624d03700 1 -- 172.21.15.49:0/374865500 wait complete. 2024-06-02T23:57:46.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.305+0000 7fd624d03700 1 Processor -- start 2024-06-02T23:57:46.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.305+0000 7fd624d03700 1 -- start start 2024-06-02T23:57:46.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.305+0000 7fd624d03700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd62006a170 0x7fd62019e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:46.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.306+0000 7fd624d03700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd62006ab30 0x7fd62019ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:46.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.306+0000 7fd624d03700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd620108500 0x7fd620198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:46.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.306+0000 7fd624d03700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd620112800 con 0x7fd62006ab30 2024-06-02T23:57:46.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.306+0000 7fd624d03700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd620112680 con 0x7fd62006a170 2024-06-02T23:57:46.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.306+0000 7fd624d03700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd620112980 con 0x7fd620108500 2024-06-02T23:57:46.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.306+0000 7fd61dd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd62006ab30 0x7fd62019ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:46.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.306+0000 7fd61dd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd62006ab30 0x7fd62019ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46930/0 (socket says 172.21.15.49:46930) 2024-06-02T23:57:46.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.306+0000 7fd61dd9b700 1 -- 172.21.15.49:0/802450854 learned_addr learned my addr 172.21.15.49:0/802450854 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:57:46.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.306+0000 7fd61e59c700 1 --2- 172.21.15.49:0/802450854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd62006a170 0x7fd62019e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:46.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.306+0000 7fd61ed9d700 1 --2- 172.21.15.49:0/802450854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd620108500 0x7fd620198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:46.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.306+0000 7fd61dd9b700 1 -- 172.21.15.49:0/802450854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd620108500 msgr2=0x7fd620198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:46.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.306+0000 7fd61dd9b700 1 --2- 172.21.15.49:0/802450854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd620108500 0x7fd620198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:46.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.306+0000 7fd61dd9b700 1 -- 172.21.15.49:0/802450854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd62006a170 msgr2=0x7fd62019e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:46.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.306+0000 7fd61dd9b700 1 --2- 172.21.15.49:0/802450854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd62006a170 0x7fd62019e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:46.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.306+0000 7fd61dd9b700 1 -- 172.21.15.49:0/802450854 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd620199200 con 0x7fd62006ab30 2024-06-02T23:57:46.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.306+0000 7fd61dd9b700 1 --2- 172.21.15.49:0/802450854 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd62006ab30 0x7fd62019ee20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd61400c970 tx=0x7fd61400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:46.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.306+0000 7fd60f7fe700 1 -- 172.21.15.49:0/802450854 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd614007aa0 con 0x7fd62006ab30 2024-06-02T23:57:46.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.306+0000 7fd624d03700 1 -- 172.21.15.49:0/802450854 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6201994f0 con 0x7fd62006ab30 2024-06-02T23:57:46.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.306+0000 7fd60f7fe700 1 -- 172.21.15.49:0/802450854 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd614004d10 con 0x7fd62006ab30 2024-06-02T23:57:46.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.306+0000 7fd60f7fe700 1 -- 172.21.15.49:0/802450854 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd614005690 con 0x7fd62006ab30 2024-06-02T23:57:46.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.307+0000 7fd624d03700 1 -- 172.21.15.49:0/802450854 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6201a57b0 con 0x7fd62006ab30 2024-06-02T23:57:46.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.307+0000 7fd624d03700 1 -- 172.21.15.49:0/802450854 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd62010a9e0 con 0x7fd62006ab30 2024-06-02T23:57:46.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.309+0000 7fd60f7fe700 1 -- 172.21.15.49:0/802450854 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd614004750 con 0x7fd62006ab30 2024-06-02T23:57:46.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.309+0000 7fd60f7fe700 1 --2- 172.21.15.49:0/802450854 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fd6080a2cb0 0x7fd6080a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:46.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.309+0000 7fd61e59c700 1 --2- 172.21.15.49:0/802450854 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fd6080a2cb0 0x7fd6080a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:46.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.309+0000 7fd60f7fe700 1 -- 172.21.15.49:0/802450854 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7fd6140cedf0 con 0x7fd62006ab30 2024-06-02T23:57:46.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.310+0000 7fd61e59c700 1 --2- 172.21.15.49:0/802450854 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fd6080a2cb0 0x7fd6080a5170 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd610006010 tx=0x7fd61000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:46.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.314+0000 7fd60f7fe700 1 -- 172.21.15.49:0/802450854 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd61409be30 con 0x7fd62006ab30 2024-06-02T23:57:46.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.554+0000 7fd624d03700 1 -- 172.21.15.49:0/802450854 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fd620199fd0 con 0x7fd6080a2cb0 2024-06-02T23:57:46.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.582+0000 7fd60f7fe700 1 -- 172.21.15.49:0/802450854 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd620199fd0 con 0x7fd6080a2cb0 2024-06-02T23:57:46.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.584+0000 7fd624d03700 1 -- 172.21.15.49:0/802450854 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fd6080a2cb0 msgr2=0x7fd6080a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:46.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.584+0000 7fd624d03700 1 --2- 172.21.15.49:0/802450854 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fd6080a2cb0 0x7fd6080a5170 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd610006010 tx=0x7fd61000b540 comp rx=0 tx=0).stop 2024-06-02T23:57:46.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.584+0000 7fd624d03700 1 -- 172.21.15.49:0/802450854 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd62006ab30 msgr2=0x7fd62019ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:46.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.584+0000 7fd624d03700 1 --2- 172.21.15.49:0/802450854 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd62006ab30 0x7fd62019ee20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd61400c970 tx=0x7fd61400cd30 comp rx=0 tx=0).stop 2024-06-02T23:57:46.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.584+0000 7fd624d03700 1 -- 172.21.15.49:0/802450854 shutdown_connections 2024-06-02T23:57:46.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.584+0000 7fd624d03700 1 --2- 172.21.15.49:0/802450854 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fd6080a2cb0 0x7fd6080a5170 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:46.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.584+0000 7fd624d03700 1 --2- 172.21.15.49:0/802450854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd620108500 0x7fd620198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:46.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.584+0000 7fd624d03700 1 --2- 172.21.15.49:0/802450854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd62006a170 0x7fd62019e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:46.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.584+0000 7fd624d03700 1 --2- 172.21.15.49:0/802450854 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd62006ab30 0x7fd62019ee20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:46.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.584+0000 7fd624d03700 1 -- 172.21.15.49:0/802450854 >> 172.21.15.49:0/802450854 conn(0x7fd620078340 msgr2=0x7fd6200fffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:46.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.584+0000 7fd624d03700 1 -- 172.21.15.49:0/802450854 shutdown_connections 2024-06-02T23:57:46.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:46.584+0000 7fd624d03700 1 -- 172.21.15.49:0/802450854 wait complete. 2024-06-02T23:57:46.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:46 smithi107 ceph-mon[37048]: pgmap v313: 97 pgs: 97 active+clean; 605 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.8 KiB/s wr, 22 op/s 2024-06-02T23:57:46.888 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:46 smithi049 ceph-mon[32302]: pgmap v313: 97 pgs: 97 active+clean; 605 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.8 KiB/s wr, 22 op/s 2024-06-02T23:57:46.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:46 smithi057 ceph-mon[36457]: pgmap v313: 97 pgs: 97 active+clean; 605 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.8 KiB/s wr, 22 op/s 2024-06-02T23:57:47.302 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-06-02T23:57:47.558 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:57:47.680 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:47 smithi049 ceph-mon[32302]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:57:47.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:47 smithi107 ceph-mon[37048]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:57:47.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:47 smithi057 ceph-mon[36457]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:57:48.596 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:48 smithi049 ceph-mon[32302]: pgmap v314: 97 pgs: 97 active+clean; 623 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.9 KiB/s wr, 12 op/s 2024-06-02T23:57:48.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:48 smithi107 ceph-mon[37048]: pgmap v314: 97 pgs: 97 active+clean; 623 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.9 KiB/s wr, 12 op/s 2024-06-02T23:57:48.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:48 smithi057 ceph-mon[36457]: pgmap v314: 97 pgs: 97 active+clean; 623 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.9 KiB/s wr, 12 op/s 2024-06-02T23:57:49.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.112+0000 7fe7d1799700 1 -- 172.21.15.49:0/2265464259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7cc1066f0 msgr2=0x7fe7cc10e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:49.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.112+0000 7fe7d1799700 1 --2- 172.21.15.49:0/2265464259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7cc1066f0 0x7fe7cc10e2c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe7c400b0d0 tx=0x7fe7c400b3e0 comp rx=0 tx=0).stop 2024-06-02T23:57:49.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.112+0000 7fe7d1799700 1 -- 172.21.15.49:0/2265464259 shutdown_connections 2024-06-02T23:57:49.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.112+0000 7fe7d1799700 1 --2- 172.21.15.49:0/2265464259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7cc1066f0 0x7fe7cc10e2c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:49.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.112+0000 7fe7d1799700 1 --2- 172.21.15.49:0/2265464259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7cc101610 0x7fe7cc1019f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:49.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.112+0000 7fe7d1799700 1 --2- 172.21.15.49:0/2265464259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7cc101fc0 0x7fe7cc106010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:49.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.112+0000 7fe7d1799700 1 -- 172.21.15.49:0/2265464259 >> 172.21.15.49:0/2265464259 conn(0x7fe7cc078430 msgr2=0x7fe7cc078840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:49.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.112+0000 7fe7d1799700 1 -- 172.21.15.49:0/2265464259 shutdown_connections 2024-06-02T23:57:49.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.112+0000 7fe7d1799700 1 -- 172.21.15.49:0/2265464259 wait complete. 2024-06-02T23:57:49.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.112+0000 7fe7d1799700 1 Processor -- start 2024-06-02T23:57:49.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.113+0000 7fe7d1799700 1 -- start start 2024-06-02T23:57:49.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.113+0000 7fe7d1799700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7cc101610 0x7fe7cc198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:49.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.113+0000 7fe7d1799700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7cc101fc0 0x7fe7cc199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:49.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.113+0000 7fe7d1799700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7cc1066f0 0x7fe7cc19d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:49.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.113+0000 7fe7d1799700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe7cc1117d0 con 0x7fe7cc1066f0 2024-06-02T23:57:49.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.113+0000 7fe7d1799700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe7cc111650 con 0x7fe7cc101610 2024-06-02T23:57:49.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.113+0000 7fe7d1799700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe7cc111950 con 0x7fe7cc101fc0 2024-06-02T23:57:49.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.113+0000 7fe7cb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7cc1066f0 0x7fe7cc19d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:49.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.113+0000 7fe7cb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7cc1066f0 0x7fe7cc19d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46948/0 (socket says 172.21.15.49:46948) 2024-06-02T23:57:49.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.113+0000 7fe7cb7fe700 1 -- 172.21.15.49:0/19214338 learned_addr learned my addr 172.21.15.49:0/19214338 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:57:49.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.113+0000 7fe7caffd700 1 --2- 172.21.15.49:0/19214338 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7cc101610 0x7fe7cc198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:49.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.113+0000 7fe7ca7fc700 1 --2- 172.21.15.49:0/19214338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7cc101fc0 0x7fe7cc199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:49.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.113+0000 7fe7cb7fe700 1 -- 172.21.15.49:0/19214338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7cc101fc0 msgr2=0x7fe7cc199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:49.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.113+0000 7fe7cb7fe700 1 --2- 172.21.15.49:0/19214338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7cc101fc0 0x7fe7cc199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:49.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.113+0000 7fe7cb7fe700 1 -- 172.21.15.49:0/19214338 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7cc101610 msgr2=0x7fe7cc198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:49.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.113+0000 7fe7cb7fe700 1 --2- 172.21.15.49:0/19214338 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7cc101610 0x7fe7cc198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:49.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.113+0000 7fe7cb7fe700 1 -- 172.21.15.49:0/19214338 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7cc19de40 con 0x7fe7cc1066f0 2024-06-02T23:57:49.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.113+0000 7fe7ca7fc700 1 --2- 172.21.15.49:0/19214338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7cc101fc0 0x7fe7cc199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:57:49.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.113+0000 7fe7cb7fe700 1 --2- 172.21.15.49:0/19214338 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7cc1066f0 0x7fe7cc19d700 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4006070 tx=0x7fe7c4004e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:49.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.114+0000 7fe7b3fff700 1 -- 172.21.15.49:0/19214338 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4021070 con 0x7fe7cc1066f0 2024-06-02T23:57:49.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.114+0000 7fe7b3fff700 1 -- 172.21.15.49:0/19214338 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7c4007d00 con 0x7fe7cc1066f0 2024-06-02T23:57:49.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.114+0000 7fe7d1799700 1 -- 172.21.15.49:0/19214338 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7cc19e0d0 con 0x7fe7cc1066f0 2024-06-02T23:57:49.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.114+0000 7fe7b3fff700 1 -- 172.21.15.49:0/19214338 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4005470 con 0x7fe7cc1066f0 2024-06-02T23:57:49.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.114+0000 7fe7d1799700 1 -- 172.21.15.49:0/19214338 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7cc1a59b0 con 0x7fe7cc1066f0 2024-06-02T23:57:49.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.115+0000 7fe7d1799700 1 -- 172.21.15.49:0/19214338 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7cc069180 con 0x7fe7cc1066f0 2024-06-02T23:57:49.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.116+0000 7fe7b3fff700 1 -- 172.21.15.49:0/19214338 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe7c4024070 con 0x7fe7cc1066f0 2024-06-02T23:57:49.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.116+0000 7fe7b3fff700 1 --2- 172.21.15.49:0/19214338 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe7b40a2cb0 0x7fe7b40a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:49.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.117+0000 7fe7caffd700 1 --2- 172.21.15.49:0/19214338 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe7b40a2cb0 0x7fe7b40a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:49.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.117+0000 7fe7b3fff700 1 -- 172.21.15.49:0/19214338 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7fe7c400f020 con 0x7fe7cc1066f0 2024-06-02T23:57:49.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.117+0000 7fe7caffd700 1 --2- 172.21.15.49:0/19214338 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe7b40a2cb0 0x7fe7b40a5170 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc009a10 tx=0x7fe7bc009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:49.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.120+0000 7fe7b3fff700 1 -- 172.21.15.49:0/19214338 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe7c402b020 con 0x7fe7cc1066f0 2024-06-02T23:57:49.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.363+0000 7fe7d1799700 1 -- 172.21.15.49:0/19214338 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fe7cc19a190 con 0x7fe7b40a2cb0 2024-06-02T23:57:49.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.369+0000 7fe7b3fff700 1 -- 172.21.15.49:0/19214338 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fe7cc19a190 con 0x7fe7b40a2cb0 2024-06-02T23:57:49.368 INFO:teuthology.orchestra.run.smithi049.stdout:/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8 2024-06-02T23:57:49.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.371+0000 7fe7d1799700 1 -- 172.21.15.49:0/19214338 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe7b40a2cb0 msgr2=0x7fe7b40a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:49.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.371+0000 7fe7d1799700 1 --2- 172.21.15.49:0/19214338 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe7b40a2cb0 0x7fe7b40a5170 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc009a10 tx=0x7fe7bc009190 comp rx=0 tx=0).stop 2024-06-02T23:57:49.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.371+0000 7fe7d1799700 1 -- 172.21.15.49:0/19214338 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7cc1066f0 msgr2=0x7fe7cc19d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:49.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.371+0000 7fe7d1799700 1 --2- 172.21.15.49:0/19214338 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7cc1066f0 0x7fe7cc19d700 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4006070 tx=0x7fe7c4004e40 comp rx=0 tx=0).stop 2024-06-02T23:57:49.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.371+0000 7fe7d1799700 1 -- 172.21.15.49:0/19214338 shutdown_connections 2024-06-02T23:57:49.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.371+0000 7fe7d1799700 1 --2- 172.21.15.49:0/19214338 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe7b40a2cb0 0x7fe7b40a5170 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:49.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.371+0000 7fe7d1799700 1 --2- 172.21.15.49:0/19214338 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7cc1066f0 0x7fe7cc19d700 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:49.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.371+0000 7fe7d1799700 1 --2- 172.21.15.49:0/19214338 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7cc101610 0x7fe7cc198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:49.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.371+0000 7fe7d1799700 1 --2- 172.21.15.49:0/19214338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7cc101fc0 0x7fe7cc199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:49.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.371+0000 7fe7d1799700 1 -- 172.21.15.49:0/19214338 >> 172.21.15.49:0/19214338 conn(0x7fe7cc078430 msgr2=0x7fe7cc06af00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:49.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.371+0000 7fe7d1799700 1 -- 172.21.15.49:0/19214338 shutdown_connections 2024-06-02T23:57:49.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:49.371+0000 7fe7d1799700 1 -- 172.21.15.49:0/19214338 wait complete. 2024-06-02T23:57:50.016 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T23:57:50.265 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:57:50.665 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:50 smithi049 ceph-mon[32302]: pgmap v315: 97 pgs: 97 active+clean; 623 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.9 KiB/s wr, 12 op/s 2024-06-02T23:57:50.665 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:50 smithi049 ceph-mon[32302]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:57:50.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:50 smithi107 ceph-mon[37048]: pgmap v315: 97 pgs: 97 active+clean; 623 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.9 KiB/s wr, 12 op/s 2024-06-02T23:57:50.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:50 smithi107 ceph-mon[37048]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:57:50.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:50 smithi057 ceph-mon[36457]: pgmap v315: 97 pgs: 97 active+clean; 623 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.9 KiB/s wr, 12 op/s 2024-06-02T23:57:50.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:50 smithi057 ceph-mon[36457]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:57:51.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.711+0000 7f2c244c3700 1 -- 172.21.15.49:0/3927990139 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c1c107400 msgr2=0x7f2c1c1077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:51.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.711+0000 7f2c244c3700 1 --2- 172.21.15.49:0/3927990139 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c1c107400 0x7f2c1c1077e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2c18009990 tx=0x7f2c18009ca0 comp rx=0 tx=0).stop 2024-06-02T23:57:51.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.711+0000 7f2c244c3700 1 -- 172.21.15.49:0/3927990139 shutdown_connections 2024-06-02T23:57:51.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.711+0000 7f2c244c3700 1 --2- 172.21.15.49:0/3927990139 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c1c101d50 0x7f2c1c10e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:51.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.711+0000 7f2c244c3700 1 --2- 172.21.15.49:0/3927990139 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c1c107400 0x7f2c1c1077e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:51.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.711+0000 7f2c244c3700 1 --2- 172.21.15.49:0/3927990139 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c1c101390 0x7f2c1c101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:51.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.711+0000 7f2c244c3700 1 -- 172.21.15.49:0/3927990139 >> 172.21.15.49:0/3927990139 conn(0x7f2c1c078340 msgr2=0x7f2c1c078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:51.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.711+0000 7f2c244c3700 1 -- 172.21.15.49:0/3927990139 shutdown_connections 2024-06-02T23:57:51.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.711+0000 7f2c244c3700 1 -- 172.21.15.49:0/3927990139 wait complete. 2024-06-02T23:57:51.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.712+0000 7f2c244c3700 1 Processor -- start 2024-06-02T23:57:51.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.712+0000 7f2c244c3700 1 -- start start 2024-06-02T23:57:51.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.712+0000 7f2c244c3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c1c101390 0x7f2c1c103370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:51.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.712+0000 7f2c244c3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c1c101d50 0x7f2c1c1038b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:51.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.712+0000 7f2c244c3700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c1c107400 0x7f2c1c103df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:51.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.712+0000 7f2c244c3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c111670 con 0x7f2c1c101390 2024-06-02T23:57:51.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.712+0000 7f2c244c3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c1114f0 con 0x7f2c1c101d50 2024-06-02T23:57:51.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.712+0000 7f2c2225f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c1c101390 0x7f2c1c103370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:51.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.712+0000 7f2c244c3700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c1117f0 con 0x7f2c1c107400 2024-06-02T23:57:51.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.712+0000 7f2c2225f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c1c101390 0x7f2c1c103370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46954/0 (socket says 172.21.15.49:46954) 2024-06-02T23:57:51.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.712+0000 7f2c2225f700 1 -- 172.21.15.49:0/2151682270 learned_addr learned my addr 172.21.15.49:0/2151682270 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:57:51.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.712+0000 7f2c21a5e700 1 --2- 172.21.15.49:0/2151682270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c1c101d50 0x7f2c1c1038b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:51.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.713+0000 7f2c22a60700 1 --2- 172.21.15.49:0/2151682270 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c1c107400 0x7f2c1c103df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:51.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.713+0000 7f2c2225f700 1 -- 172.21.15.49:0/2151682270 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c1c107400 msgr2=0x7f2c1c103df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:51.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.713+0000 7f2c2225f700 1 --2- 172.21.15.49:0/2151682270 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c1c107400 0x7f2c1c103df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:51.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.713+0000 7f2c2225f700 1 -- 172.21.15.49:0/2151682270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c1c101d50 msgr2=0x7f2c1c1038b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:51.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.713+0000 7f2c2225f700 1 --2- 172.21.15.49:0/2151682270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c1c101d50 0x7f2c1c1038b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:51.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.713+0000 7f2c2225f700 1 -- 172.21.15.49:0/2151682270 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c1c1a70a0 con 0x7f2c1c101390 2024-06-02T23:57:51.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.713+0000 7f2c21a5e700 1 --2- 172.21.15.49:0/2151682270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c1c101d50 0x7f2c1c1038b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:57:51.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.713+0000 7f2c2225f700 1 --2- 172.21.15.49:0/2151682270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c1c101390 0x7f2c1c103370 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2c18000c00 tx=0x7f2c18003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:51.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.713+0000 7f2c137fe700 1 -- 172.21.15.49:0/2151682270 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c18027070 con 0x7f2c1c101390 2024-06-02T23:57:51.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.713+0000 7f2c137fe700 1 -- 172.21.15.49:0/2151682270 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c18004190 con 0x7f2c1c101390 2024-06-02T23:57:51.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.713+0000 7f2c244c3700 1 -- 172.21.15.49:0/2151682270 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c1c1a7330 con 0x7f2c1c101390 2024-06-02T23:57:51.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.713+0000 7f2c137fe700 1 -- 172.21.15.49:0/2151682270 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c1800f460 con 0x7f2c1c101390 2024-06-02T23:57:51.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.713+0000 7f2c244c3700 1 -- 172.21.15.49:0/2151682270 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c1c1a7780 con 0x7f2c1c101390 2024-06-02T23:57:51.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.714+0000 7f2c244c3700 1 -- 172.21.15.49:0/2151682270 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c1c069180 con 0x7f2c1c101390 2024-06-02T23:57:51.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.716+0000 7f2c137fe700 1 -- 172.21.15.49:0/2151682270 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2c1802a070 con 0x7f2c1c101390 2024-06-02T23:57:51.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.717+0000 7f2c137fe700 1 --2- 172.21.15.49:0/2151682270 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f2c080a2cb0 0x7f2c080a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:51.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.717+0000 7f2c21a5e700 1 --2- 172.21.15.49:0/2151682270 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f2c080a2cb0 0x7f2c080a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:51.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.717+0000 7f2c137fe700 1 -- 172.21.15.49:0/2151682270 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7f2c180d03b0 con 0x7f2c1c101390 2024-06-02T23:57:51.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.717+0000 7f2c21a5e700 1 --2- 172.21.15.49:0/2151682270 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f2c080a2cb0 0x7f2c080a5170 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c06b1c0 tx=0x7f2c0c005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:51.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.720+0000 7f2c137fe700 1 -- 172.21.15.49:0/2151682270 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2c18013070 con 0x7f2c1c101390 2024-06-02T23:57:51.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.971+0000 7f2c244c3700 1 -- 172.21.15.49:0/2151682270 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c1c1a7ae0 con 0x7f2c1c101390 2024-06-02T23:57:51.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.972+0000 7f2c137fe700 1 -- 172.21.15.49:0/2151682270 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11929 (secure 0 0 0) 0x7f2c1809d3f0 con 0x7f2c1c101390 2024-06-02T23:57:51.972 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:57:51.972 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1553264866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1553264866},{"type":"v1","addr":"172.21.15.49:6835","nonce":1553264866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2266285252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2266285252},{"type":"v1","addr":"172.21.15.49:6837","nonce":2266285252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T23:57:16.991201+0000","modified":"2024-06-02T23:57:35.219435+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24485,"mds_2":24466,"mds_3":24464,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6839/1729124617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":1729124617},{"type":"v1","addr":"172.21.15.49:6839","nonce":1729124617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6841/1902772235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":1902772235},{"type":"v1","addr":"172.21.15.49:6841","nonce":1902772235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6833/1633534002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1633534002},{"type":"v1","addr":"172.21.15.57:6833","nonce":1633534002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6835/2254905671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2254905671},{"type":"v1","addr":"172.21.15.57:6835","nonce":2254905671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.107:6835/3693542801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3693542801},{"type":"v1","addr":"172.21.15.107:6835","nonce":3693542801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.57:6837/230452144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":230452144},{"type":"v1","addr":"172.21.15.57:6837","nonce":230452144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.107:6837/3700593315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":3700593315},{"type":"v1","addr":"172.21.15.107:6837","nonce":3700593315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6839/249825195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":249825195},{"type":"v1","addr":"172.21.15.57:6839","nonce":249825195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6839/1986600681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1986600681},{"type":"v1","addr":"172.21.15.107:6839","nonce":1986600681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24466,24487,24460,24464,24485]},"id":1}]} 2024-06-02T23:57:51.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.974+0000 7f2c244c3700 1 -- 172.21.15.49:0/2151682270 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f2c080a2cb0 msgr2=0x7f2c080a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:51.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.974+0000 7f2c244c3700 1 --2- 172.21.15.49:0/2151682270 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f2c080a2cb0 0x7f2c080a5170 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c06b1c0 tx=0x7f2c0c005f50 comp rx=0 tx=0).stop 2024-06-02T23:57:51.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.974+0000 7f2c244c3700 1 -- 172.21.15.49:0/2151682270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c1c101390 msgr2=0x7f2c1c103370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:51.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.974+0000 7f2c244c3700 1 --2- 172.21.15.49:0/2151682270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c1c101390 0x7f2c1c103370 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2c18000c00 tx=0x7f2c18003730 comp rx=0 tx=0).stop 2024-06-02T23:57:51.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.974+0000 7f2c244c3700 1 -- 172.21.15.49:0/2151682270 shutdown_connections 2024-06-02T23:57:51.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.974+0000 7f2c244c3700 1 --2- 172.21.15.49:0/2151682270 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f2c080a2cb0 0x7f2c080a5170 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:51.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.974+0000 7f2c244c3700 1 --2- 172.21.15.49:0/2151682270 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c1c107400 0x7f2c1c103df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:51.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.974+0000 7f2c244c3700 1 --2- 172.21.15.49:0/2151682270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2c1c101390 0x7f2c1c103370 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:51.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.974+0000 7f2c244c3700 1 --2- 172.21.15.49:0/2151682270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c1c101d50 0x7f2c1c1038b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:51.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.974+0000 7f2c244c3700 1 -- 172.21.15.49:0/2151682270 >> 172.21.15.49:0/2151682270 conn(0x7f2c1c078340 msgr2=0x7f2c1c105570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:51.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.975+0000 7f2c244c3700 1 -- 172.21.15.49:0/2151682270 shutdown_connections 2024-06-02T23:57:51.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:51.975+0000 7f2c244c3700 1 -- 172.21.15.49:0/2151682270 wait complete. 2024-06-02T23:57:51.975 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-06-02T23:57:52.596 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-02T23:57:52.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:52 smithi049 ceph-mon[32302]: pgmap v316: 97 pgs: 97 active+clean; 624 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.1 KiB/s wr, 11 op/s 2024-06-02T23:57:52.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:52 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/2151682270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:57:52.844 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:57:52.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:52 smithi107 ceph-mon[37048]: pgmap v316: 97 pgs: 97 active+clean; 624 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.1 KiB/s wr, 11 op/s 2024-06-02T23:57:52.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:52 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/2151682270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:57:52.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:52 smithi057 ceph-mon[36457]: pgmap v316: 97 pgs: 97 active+clean; 624 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.1 KiB/s wr, 11 op/s 2024-06-02T23:57:52.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:52 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/2151682270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:57:54.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.401+0000 7f78db59e700 1 -- 172.21.15.49:0/2256281074 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78dc101520 msgr2=0x7f78dc101900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:54.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.401+0000 7f78db59e700 1 --2- 172.21.15.49:0/2256281074 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78dc101520 0x7f78dc101900 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f78c40099c0 tx=0x7f78c4009cd0 comp rx=0 tx=0).stop 2024-06-02T23:57:54.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.401+0000 7f78db59e700 1 -- 172.21.15.49:0/2256281074 shutdown_connections 2024-06-02T23:57:54.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.401+0000 7f78db59e700 1 --2- 172.21.15.49:0/2256281074 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78dc106600 0x7f78dc10e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:54.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.401+0000 7f78db59e700 1 --2- 172.21.15.49:0/2256281074 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78dc101520 0x7f78dc101900 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:54.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.401+0000 7f78db59e700 1 --2- 172.21.15.49:0/2256281074 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78dc101ed0 0x7f78dc105f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:54.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.401+0000 7f78db59e700 1 -- 172.21.15.49:0/2256281074 >> 172.21.15.49:0/2256281074 conn(0x7f78dc0fcdb0 msgr2=0x7f78dc0ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:54.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.401+0000 7f78db59e700 1 -- 172.21.15.49:0/2256281074 shutdown_connections 2024-06-02T23:57:54.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.401+0000 7f78db59e700 1 -- 172.21.15.49:0/2256281074 wait complete. 2024-06-02T23:57:54.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.401+0000 7f78db59e700 1 Processor -- start 2024-06-02T23:57:54.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.402+0000 7f78db59e700 1 -- start start 2024-06-02T23:57:54.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.402+0000 7f78db59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78dc101520 0x7f78dc102fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:54.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.402+0000 7f78db59e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78dc101ed0 0x7f78dc103500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:54.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.402+0000 7f78db59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78dc106600 0x7f78dc103a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:54.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.402+0000 7f78db59e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f78dc111610 con 0x7f78dc106600 2024-06-02T23:57:54.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.402+0000 7f78db59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f78dc111490 con 0x7f78dc101520 2024-06-02T23:57:54.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.402+0000 7f78db59e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f78dc111790 con 0x7f78dc101ed0 2024-06-02T23:57:54.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.402+0000 7f78dad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78dc106600 0x7f78dc103a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:54.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.402+0000 7f78da59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78dc101520 0x7f78dc102fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:54.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.402+0000 7f78dad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78dc106600 0x7f78dc103a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59834/0 (socket says 172.21.15.49:59834) 2024-06-02T23:57:54.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.402+0000 7f78da59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78dc101520 0x7f78dc102fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.49:46618/0 (socket says 172.21.15.49:46618) 2024-06-02T23:57:54.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.402+0000 7f78dad9d700 1 -- 172.21.15.49:0/3897815418 learned_addr learned my addr 172.21.15.49:0/3897815418 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:57:54.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.402+0000 7f78d9d9b700 1 --2- 172.21.15.49:0/3897815418 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78dc101ed0 0x7f78dc103500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:54.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.402+0000 7f78dad9d700 1 -- 172.21.15.49:0/3897815418 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78dc101ed0 msgr2=0x7f78dc103500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:54.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.402+0000 7f78dad9d700 1 --2- 172.21.15.49:0/3897815418 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78dc101ed0 0x7f78dc103500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:54.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.402+0000 7f78dad9d700 1 -- 172.21.15.49:0/3897815418 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78dc101520 msgr2=0x7f78dc102fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:54.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.402+0000 7f78dad9d700 1 --2- 172.21.15.49:0/3897815418 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78dc101520 0x7f78dc102fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:54.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.402+0000 7f78dad9d700 1 -- 172.21.15.49:0/3897815418 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78dc1a7150 con 0x7f78dc106600 2024-06-02T23:57:54.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.402+0000 7f78dad9d700 1 --2- 172.21.15.49:0/3897815418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78dc106600 0x7f78dc103a40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f78d400ada0 tx=0x7f78d400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:54.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.403+0000 7f78d37fe700 1 -- 172.21.15.49:0/3897815418 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d4017020 con 0x7f78dc106600 2024-06-02T23:57:54.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.403+0000 7f78d37fe700 1 -- 172.21.15.49:0/3897815418 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78d400a0d0 con 0x7f78dc106600 2024-06-02T23:57:54.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.403+0000 7f78db59e700 1 -- 172.21.15.49:0/3897815418 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78dc1a7440 con 0x7f78dc106600 2024-06-02T23:57:54.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.403+0000 7f78d37fe700 1 -- 172.21.15.49:0/3897815418 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d4005480 con 0x7f78dc106600 2024-06-02T23:57:54.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.403+0000 7f78db59e700 1 -- 172.21.15.49:0/3897815418 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78dc1a7980 con 0x7f78dc106600 2024-06-02T23:57:54.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.404+0000 7f78db59e700 1 -- 172.21.15.49:0/3897815418 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78dc069180 con 0x7f78dc106600 2024-06-02T23:57:54.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.405+0000 7f78d37fe700 1 -- 172.21.15.49:0/3897815418 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f78d4005620 con 0x7f78dc106600 2024-06-02T23:57:54.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.406+0000 7f78d37fe700 1 --2- 172.21.15.49:0/3897815418 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f78c80a2cb0 0x7f78c80a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:54.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.406+0000 7f78da59c700 1 --2- 172.21.15.49:0/3897815418 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f78c80a2cb0 0x7f78c80a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:54.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.406+0000 7f78d37fe700 1 -- 172.21.15.49:0/3897815418 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7f78d40ce6e0 con 0x7f78dc106600 2024-06-02T23:57:54.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.406+0000 7f78da59c700 1 --2- 172.21.15.49:0/3897815418 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f78c80a2cb0 0x7f78c80a5170 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f78c4000c00 tx=0x7f78c4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:54.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.411+0000 7f78d37fe700 1 -- 172.21.15.49:0/3897815418 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f78d4021020 con 0x7f78dc106600 2024-06-02T23:57:54.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.637+0000 7f78db59e700 1 -- 172.21.15.49:0/3897815418 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f78dc1044a0 con 0x7f78dc106600 2024-06-02T23:57:54.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.638+0000 7f78d37fe700 1 -- 172.21.15.49:0/3897815418 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22134 (secure 0 0 0) 0x7f78d409b720 con 0x7f78dc106600 2024-06-02T23:57:54.638 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:57:54.638 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":88,"fsid":"890dd222-213a-11ef-bc9b-c7b262605968","created":"2024-06-02T23:48:53.323536+0000","modified":"2024-06-02T23:57:16.991066+0000","last_up_change":"2024-06-02T23:56:12.156697+0000","last_in_change":"2024-06-02T23:55:51.667118+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:52:23.676079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:57:10.753178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T23:57:14.240610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e0013e80-07d6-4ad3-87d8-d41988988ef5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6803","nonce":811647073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6805","nonce":811647073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6809","nonce":811647073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6807","nonce":811647073}]},"public_addr":"172.21.15.49:6803/811647073","cluster_addr":"172.21.15.49:6805/811647073","heartbeat_back_addr":"172.21.15.49:6809/811647073","heartbeat_front_addr":"172.21.15.49:6807/811647073","state":["exists","up"]},{"osd":1,"uuid":"f37d9f79-e349-4de7-81e7-385ddb905f58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6801","nonce":1260507785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6803","nonce":1260507785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6807","nonce":1260507785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6805","nonce":1260507785}]},"public_addr":"172.21.15.57:6801/1260507785","cluster_addr":"172.21.15.57:6803/1260507785","heartbeat_back_addr":"172.21.15.57:6807/1260507785","heartbeat_front_addr":"172.21.15.57:6805/1260507785","state":["exists","up"]},{"osd":2,"uuid":"94889281-7d45-4e78-9d37-b98e3fbe8494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6801","nonce":303899951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6803","nonce":303899951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6807","nonce":303899951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6805","nonce":303899951}]},"public_addr":"172.21.15.107:6801/303899951","cluster_addr":"172.21.15.107:6803/303899951","heartbeat_back_addr":"172.21.15.107:6807/303899951","heartbeat_front_addr":"172.21.15.107:6805/303899951","state":["exists","up"]},{"osd":3,"uuid":"31f4c18c-fbda-400d-8b3b-0955b0c4a6a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6811","nonce":60796312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6813","nonce":60796312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6817","nonce":60796312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6815","nonce":60796312}]},"public_addr":"172.21.15.49:6811/60796312","cluster_addr":"172.21.15.49:6813/60796312","heartbeat_back_addr":"172.21.15.49:6817/60796312","heartbeat_front_addr":"172.21.15.49:6815/60796312","state":["exists","up"]},{"osd":4,"uuid":"8076c2f3-0138-459e-89b5-c5c4586a14ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6809","nonce":3106842986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6811","nonce":3106842986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6815","nonce":3106842986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6813","nonce":3106842986}]},"public_addr":"172.21.15.57:6809/3106842986","cluster_addr":"172.21.15.57:6811/3106842986","heartbeat_back_addr":"172.21.15.57:6815/3106842986","heartbeat_front_addr":"172.21.15.57:6813/3106842986","state":["exists","up"]},{"osd":5,"uuid":"68f7abd3-4292-41fa-90ce-4ac34ea2b964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6809","nonce":389294142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6811","nonce":389294142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6815","nonce":389294142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6813","nonce":389294142}]},"public_addr":"172.21.15.107:6809/389294142","cluster_addr":"172.21.15.107:6811/389294142","heartbeat_back_addr":"172.21.15.107:6815/389294142","heartbeat_front_addr":"172.21.15.107:6813/389294142","state":["exists","up"]},{"osd":6,"uuid":"c0345dd0-71b7-436d-88f8-fe3d7cb69d8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6819","nonce":894624552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6821","nonce":894624552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6825","nonce":894624552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6823","nonce":894624552}]},"public_addr":"172.21.15.49:6819/894624552","cluster_addr":"172.21.15.49:6821/894624552","heartbeat_back_addr":"172.21.15.49:6825/894624552","heartbeat_front_addr":"172.21.15.49:6823/894624552","state":["exists","up"]},{"osd":7,"uuid":"9abd81c7-dcc1-4e14-8ab7-9fa0746067ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6817","nonce":3126027900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6819","nonce":3126027900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6823","nonce":3126027900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6821","nonce":3126027900}]},"public_addr":"172.21.15.57:6817/3126027900","cluster_addr":"172.21.15.57:6819/3126027900","heartbeat_back_addr":"172.21.15.57:6823/3126027900","heartbeat_front_addr":"172.21.15.57:6821/3126027900","state":["exists","up"]},{"osd":8,"uuid":"80532119-5de8-45d2-9cb9-bd8a6194199b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6817","nonce":3620047229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6819","nonce":3620047229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6823","nonce":3620047229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6821","nonce":3620047229}]},"public_addr":"172.21.15.107:6817/3620047229","cluster_addr":"172.21.15.107:6819/3620047229","heartbeat_back_addr":"172.21.15.107:6823/3620047229","heartbeat_front_addr":"172.21.15.107:6821/3620047229","state":["exists","up"]},{"osd":9,"uuid":"f0b5dcfa-9fd2-4a98-863b-197defa890af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6827","nonce":3627936526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6829","nonce":3627936526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6833","nonce":3627936526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6831","nonce":3627936526}]},"public_addr":"172.21.15.49:6827/3627936526","cluster_addr":"172.21.15.49:6829/3627936526","heartbeat_back_addr":"172.21.15.49:6833/3627936526","heartbeat_front_addr":"172.21.15.49:6831/3627936526","state":["exists","up"]},{"osd":10,"uuid":"21a75846-adec-41b8-9e1d-e5c61ba30b12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6825","nonce":3013235811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6827","nonce":3013235811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6831","nonce":3013235811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6829","nonce":3013235811}]},"public_addr":"172.21.15.57:6825/3013235811","cluster_addr":"172.21.15.57:6827/3013235811","heartbeat_back_addr":"172.21.15.57:6831/3013235811","heartbeat_front_addr":"172.21.15.57:6829/3013235811","state":["exists","up"]},{"osd":11,"uuid":"eb963b63-2c61-4169-b8fe-31c7f5ec919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6825","nonce":4217534517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6827","nonce":4217534517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6831","nonce":4217534517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6829","nonce":4217534517}]},"public_addr":"172.21.15.107:6825/4217534517","cluster_addr":"172.21.15.107:6827/4217534517","heartbeat_back_addr":"172.21.15.107:6831/4217534517","heartbeat_front_addr":"172.21.15.107:6829/4217534517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:51:31.067312+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:51:56.088456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:52:20.539941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:52:45.055717+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:53:11.178438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:53:35.794217+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:00.775674+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:27.574752+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:52.177634+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:55:17.118854+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:55:44.217535+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:56:10.500970+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/525944311":"2024-06-03T23:49:55.151590+0000","172.21.15.49:0/1841969299":"2024-06-03T23:49:55.151590+0000","172.21.15.49:0/1880506696":"2024-06-03T23:49:55.151590+0000","172.21.15.49:6801/1206062338":"2024-06-03T23:49:55.151590+0000","172.21.15.49:6800/549058216":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/2112783954":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/2183920213":"2024-06-03T23:49:29.042670+0000","172.21.15.49:6801/549058216":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/3350970308":"2024-06-03T23:49:29.042670+0000","172.21.15.49:6800/1206062338":"2024-06-03T23:49:55.151590+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:57:54.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.641+0000 7f78db59e700 1 -- 172.21.15.49:0/3897815418 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f78c80a2cb0 msgr2=0x7f78c80a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:54.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.641+0000 7f78db59e700 1 --2- 172.21.15.49:0/3897815418 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f78c80a2cb0 0x7f78c80a5170 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f78c4000c00 tx=0x7f78c4005fb0 comp rx=0 tx=0).stop 2024-06-02T23:57:54.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.641+0000 7f78db59e700 1 -- 172.21.15.49:0/3897815418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78dc106600 msgr2=0x7f78dc103a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:54.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.641+0000 7f78db59e700 1 --2- 172.21.15.49:0/3897815418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78dc106600 0x7f78dc103a40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f78d400ada0 tx=0x7f78d400c330 comp rx=0 tx=0).stop 2024-06-02T23:57:54.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.641+0000 7f78db59e700 1 -- 172.21.15.49:0/3897815418 shutdown_connections 2024-06-02T23:57:54.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.641+0000 7f78db59e700 1 --2- 172.21.15.49:0/3897815418 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f78c80a2cb0 0x7f78c80a5170 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:54.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.641+0000 7f78db59e700 1 --2- 172.21.15.49:0/3897815418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78dc106600 0x7f78dc103a40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:54.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.641+0000 7f78db59e700 1 --2- 172.21.15.49:0/3897815418 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78dc101520 0x7f78dc102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:54.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.641+0000 7f78db59e700 1 --2- 172.21.15.49:0/3897815418 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78dc101ed0 0x7f78dc103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:54.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.641+0000 7f78db59e700 1 -- 172.21.15.49:0/3897815418 >> 172.21.15.49:0/3897815418 conn(0x7f78dc0fcdb0 msgr2=0x7f78dc06a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:54.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.641+0000 7f78db59e700 1 -- 172.21.15.49:0/3897815418 shutdown_connections 2024-06-02T23:57:54.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:54.641+0000 7f78db59e700 1 -- 172.21.15.49:0/3897815418 wait complete. 2024-06-02T23:57:54.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:54 smithi107 ceph-mon[37048]: pgmap v317: 97 pgs: 97 active+clean; 632 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.9 KiB/s wr, 13 op/s 2024-06-02T23:57:54.949 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:54 smithi057 ceph-mon[36457]: pgmap v317: 97 pgs: 97 active+clean; 632 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.9 KiB/s wr, 13 op/s 2024-06-02T23:57:54.960 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:54 smithi049 ceph-mon[32302]: pgmap v317: 97 pgs: 97 active+clean; 632 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.9 KiB/s wr, 13 op/s 2024-06-02T23:57:55.331 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-06-02T23:57:55.331 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-06-02T23:57:55.584 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:57:55.706 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:55 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3897815418' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T23:57:55.707 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:55 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-06-02T23:57:55.707 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:55 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]: dispatch 2024-06-02T23:57:55.707 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:55 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]: dispatch 2024-06-02T23:57:55.707 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:55 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-06-02T23:57:55.707 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:55 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-06-02T23:57:55.707 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:55 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-06-02T23:57:55.707 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:55 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]: dispatch 2024-06-02T23:57:55.707 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:55 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]: dispatch 2024-06-02T23:57:55.707 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:55 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]}]: dispatch 2024-06-02T23:57:55.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:55 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/3897815418' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T23:57:55.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:55 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-06-02T23:57:55.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:55 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]: dispatch 2024-06-02T23:57:55.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:55 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]: dispatch 2024-06-02T23:57:55.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:55 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-06-02T23:57:55.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:55 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-06-02T23:57:55.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:55 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-06-02T23:57:55.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:55 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]: dispatch 2024-06-02T23:57:55.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:55 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]: dispatch 2024-06-02T23:57:55.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:55 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]}]: dispatch 2024-06-02T23:57:55.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:55 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/3897815418' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T23:57:55.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:55 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-06-02T23:57:55.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:55 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]: dispatch 2024-06-02T23:57:55.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:55 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]: dispatch 2024-06-02T23:57:55.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:55 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-06-02T23:57:55.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:55 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-06-02T23:57:55.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:55 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-06-02T23:57:55.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:55 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]: dispatch 2024-06-02T23:57:55.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:55 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]: dispatch 2024-06-02T23:57:55.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:55 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]}]: dispatch 2024-06-02T23:57:56.690 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:56 smithi049 ceph-mon[32302]: pgmap v318: 97 pgs: 97 active+clean; 632 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.9 KiB/s wr, 12 op/s 2024-06-02T23:57:56.690 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-06-02T23:57:56.690 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-06-02T23:57:56.690 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]': finished 2024-06-02T23:57:56.691 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-06-02T23:57:56.691 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-06-02T23:57:56.691 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-06-02T23:57:56.691 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]': finished 2024-06-02T23:57:56.691 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-06-02T23:57:56.691 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:56 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]}]': finished 2024-06-02T23:57:56.691 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:56 smithi049 ceph-mon[32302]: osdmap e89: 12 total, 12 up, 12 in 2024-06-02T23:57:56.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:56 smithi107 ceph-mon[37048]: pgmap v318: 97 pgs: 97 active+clean; 632 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.9 KiB/s wr, 12 op/s 2024-06-02T23:57:56.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-06-02T23:57:56.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-06-02T23:57:56.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]': finished 2024-06-02T23:57:56.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-06-02T23:57:56.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-06-02T23:57:56.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-06-02T23:57:56.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]': finished 2024-06-02T23:57:56.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-06-02T23:57:56.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:56 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]}]': finished 2024-06-02T23:57:56.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:56 smithi107 ceph-mon[37048]: osdmap e89: 12 total, 12 up, 12 in 2024-06-02T23:57:56.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:56 smithi057 ceph-mon[36457]: pgmap v318: 97 pgs: 97 active+clean; 632 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.9 KiB/s wr, 12 op/s 2024-06-02T23:57:56.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-06-02T23:57:56.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-06-02T23:57:56.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]': finished 2024-06-02T23:57:56.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-06-02T23:57:56.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-06-02T23:57:56.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-06-02T23:57:56.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]': finished 2024-06-02T23:57:56.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-06-02T23:57:56.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:56 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]}]': finished 2024-06-02T23:57:56.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:56 smithi057 ceph-mon[36457]: osdmap e89: 12 total, 12 up, 12 in 2024-06-02T23:57:57.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.182+0000 7fe5ce57c700 1 -- 172.21.15.49:0/549139665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5c8107840 msgr2=0x7fe5c810f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:57.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.182+0000 7fe5ce57c700 1 --2- 172.21.15.49:0/549139665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5c8107840 0x7fe5c810f3c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe5c000b0d0 tx=0x7fe5c000b3e0 comp rx=0 tx=0).stop 2024-06-02T23:57:57.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.182+0000 7fe5ce57c700 1 -- 172.21.15.49:0/549139665 shutdown_connections 2024-06-02T23:57:57.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.182+0000 7fe5ce57c700 1 --2- 172.21.15.49:0/549139665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5c8107840 0x7fe5c810f3c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:57.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.182+0000 7fe5ce57c700 1 --2- 172.21.15.49:0/549139665 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5c8102740 0x7fe5c8102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:57.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.182+0000 7fe5ce57c700 1 --2- 172.21.15.49:0/549139665 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5c81030f0 0x7fe5c8107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:57.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.182+0000 7fe5ce57c700 1 -- 172.21.15.49:0/549139665 >> 172.21.15.49:0/549139665 conn(0x7fe5c80795f0 msgr2=0x7fe5c8079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:57.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.182+0000 7fe5ce57c700 1 -- 172.21.15.49:0/549139665 shutdown_connections 2024-06-02T23:57:57.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.182+0000 7fe5ce57c700 1 -- 172.21.15.49:0/549139665 wait complete. 2024-06-02T23:57:57.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.183+0000 7fe5ce57c700 1 Processor -- start 2024-06-02T23:57:57.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.183+0000 7fe5ce57c700 1 -- start start 2024-06-02T23:57:57.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.183+0000 7fe5ce57c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5c8102740 0x7fe5c819e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:57.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.183+0000 7fe5ce57c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5c81030f0 0x7fe5c819ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:57.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.183+0000 7fe5ce57c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5c8107840 0x7fe5c8198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:57.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.183+0000 7fe5ce57c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c81127e0 con 0x7fe5c8107840 2024-06-02T23:57:57.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.183+0000 7fe5ce57c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c8112660 con 0x7fe5c8102740 2024-06-02T23:57:57.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.183+0000 7fe5ce57c700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c8112960 con 0x7fe5c81030f0 2024-06-02T23:57:57.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.183+0000 7fe5ccb19700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5c8107840 0x7fe5c8198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:57.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.183+0000 7fe5ccb19700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5c8107840 0x7fe5c8198940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59862/0 (socket says 172.21.15.49:59862) 2024-06-02T23:57:57.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.183+0000 7fe5ccb19700 1 -- 172.21.15.49:0/4131593408 learned_addr learned my addr 172.21.15.49:0/4131593408 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:57:57.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.183+0000 7fe5c77fe700 1 --2- 172.21.15.49:0/4131593408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5c81030f0 0x7fe5c819ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:57.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.183+0000 7fe5c7fff700 1 --2- 172.21.15.49:0/4131593408 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5c8102740 0x7fe5c819e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:57.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.184+0000 7fe5ccb19700 1 -- 172.21.15.49:0/4131593408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5c81030f0 msgr2=0x7fe5c819ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:57.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.184+0000 7fe5ccb19700 1 --2- 172.21.15.49:0/4131593408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5c81030f0 0x7fe5c819ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:57.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.184+0000 7fe5ccb19700 1 -- 172.21.15.49:0/4131593408 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5c8102740 msgr2=0x7fe5c819e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:57.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.184+0000 7fe5ccb19700 1 --2- 172.21.15.49:0/4131593408 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5c8102740 0x7fe5c819e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:57.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.184+0000 7fe5ccb19700 1 -- 172.21.15.49:0/4131593408 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c81990a0 con 0x7fe5c8107840 2024-06-02T23:57:57.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.184+0000 7fe5ccb19700 1 --2- 172.21.15.49:0/4131593408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5c8107840 0x7fe5c8198940 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0006070 tx=0x7fe5c0004e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:57.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.184+0000 7fe5c57fa700 1 -- 172.21.15.49:0/4131593408 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c0021070 con 0x7fe5c8107840 2024-06-02T23:57:57.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.184+0000 7fe5c57fa700 1 -- 172.21.15.49:0/4131593408 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5c0007c00 con 0x7fe5c8107840 2024-06-02T23:57:57.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.184+0000 7fe5ce57c700 1 -- 172.21.15.49:0/4131593408 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5c8199330 con 0x7fe5c8107840 2024-06-02T23:57:57.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.184+0000 7fe5c57fa700 1 -- 172.21.15.49:0/4131593408 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c00052a0 con 0x7fe5c8107840 2024-06-02T23:57:57.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.184+0000 7fe5ce57c700 1 -- 172.21.15.49:0/4131593408 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5c81a5650 con 0x7fe5c8107840 2024-06-02T23:57:57.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.185+0000 7fe5ce57c700 1 -- 172.21.15.49:0/4131593408 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5c8069180 con 0x7fe5c8107840 2024-06-02T23:57:57.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.186+0000 7fe5c57fa700 1 -- 172.21.15.49:0/4131593408 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe5c0024070 con 0x7fe5c8107840 2024-06-02T23:57:57.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.187+0000 7fe5c57fa700 1 --2- 172.21.15.49:0/4131593408 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe5b40a2d30 0x7fe5b40a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:57:57.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.187+0000 7fe5c7fff700 1 --2- 172.21.15.49:0/4131593408 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe5b40a2d30 0x7fe5b40a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:57:57.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.187+0000 7fe5c57fa700 1 -- 172.21.15.49:0/4131593408 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fe5c000f020 con 0x7fe5c8107840 2024-06-02T23:57:57.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.187+0000 7fe5c7fff700 1 --2- 172.21.15.49:0/4131593408 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe5b40a2d30 0x7fe5b40a51f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8199a80 tx=0x7fe5b8009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:57:57.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.190+0000 7fe5c57fa700 1 -- 172.21.15.49:0/4131593408 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe5c002b020 con 0x7fe5c8107840 2024-06-02T23:57:57.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.392+0000 7fe5ce57c700 1 -- 172.21.15.49:0/4131593408 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe5c8100b00 con 0x7fe5b40a2d30 2024-06-02T23:57:57.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.400+0000 7fe5c57fa700 1 -- 172.21.15.49:0/4131593408 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258750 (secure 0 0 0) 0x7fe5c8100b00 con 0x7fe5b40a2d30 2024-06-02T23:57:57.403 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:57:57.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.404+0000 7fe5ce57c700 1 -- 172.21.15.49:0/4131593408 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe5b40a2d30 msgr2=0x7fe5b40a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:57.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.404+0000 7fe5ce57c700 1 --2- 172.21.15.49:0/4131593408 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe5b40a2d30 0x7fe5b40a51f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8199a80 tx=0x7fe5b8009190 comp rx=0 tx=0).stop 2024-06-02T23:57:57.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.404+0000 7fe5ce57c700 1 -- 172.21.15.49:0/4131593408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5c8107840 msgr2=0x7fe5c8198940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:57:57.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.404+0000 7fe5ce57c700 1 --2- 172.21.15.49:0/4131593408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5c8107840 0x7fe5c8198940 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0006070 tx=0x7fe5c0004e40 comp rx=0 tx=0).stop 2024-06-02T23:57:57.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.405+0000 7fe5ce57c700 1 -- 172.21.15.49:0/4131593408 shutdown_connections 2024-06-02T23:57:57.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.405+0000 7fe5ce57c700 1 --2- 172.21.15.49:0/4131593408 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe5b40a2d30 0x7fe5b40a51f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:57.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.405+0000 7fe5ce57c700 1 --2- 172.21.15.49:0/4131593408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5c8107840 0x7fe5c8198940 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:57.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.405+0000 7fe5ce57c700 1 --2- 172.21.15.49:0/4131593408 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5c8102740 0x7fe5c819e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:57.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.405+0000 7fe5ce57c700 1 --2- 172.21.15.49:0/4131593408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5c81030f0 0x7fe5c819ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:57:57.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.405+0000 7fe5ce57c700 1 -- 172.21.15.49:0/4131593408 >> 172.21.15.49:0/4131593408 conn(0x7fe5c80795f0 msgr2=0x7fe5c81003f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:57:57.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.405+0000 7fe5ce57c700 1 -- 172.21.15.49:0/4131593408 shutdown_connections 2024-06-02T23:57:57.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:57:57.405+0000 7fe5ce57c700 1 -- 172.21.15.49:0/4131593408 wait complete. 2024-06-02T23:57:57.407 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-06-02T23:57:57.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:57 smithi049 ceph-mon[32302]: osdmap e90: 12 total, 12 up, 12 in 2024-06-02T23:57:57.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:57 smithi107 ceph-mon[37048]: osdmap e90: 12 total, 12 up, 12 in 2024-06-02T23:57:57.949 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:57 smithi057 ceph-mon[36457]: osdmap e90: 12 total, 12 up, 12 in 2024-06-02T23:57:58.210 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":321,"stamp":"2024-06-02T23:57:57.248216+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651271,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":389,"num_read_kb":311,"num_write":423,"num_write_kb":3066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":345,"ondisk_log_size":345,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375076,"kb_used_data":13440,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124566748,"statfs":{"total":1151940427776,"available":1151556349952,"internally_reserved":0,"allocated":13762560,"data_stored":7504717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":12912,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":83,"num_read_kb":73,"num_write":16,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001771"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.316196+0000","last_change":"2024-06-02T23:57:15.321542+0000","last_active":"2024-06-02T23:57:17.316196+0000","last_peered":"2024-06-02T23:57:17.316196+0000","last_clean":"2024-06-02T23:57:17.316196+0000","last_became_active":"2024-06-02T23:57:15.321129+0000","last_became_peered":"2024-06-02T23:57:15.321129+0000","last_unstale":"2024-06-02T23:57:17.316196+0000","last_undegraded":"2024-06-02T23:57:17.316196+0000","last_fullsized":"2024-06-02T23:57:17.316196+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:35:50.218316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.335050+0000","last_change":"2024-06-02T23:57:15.327432+0000","last_active":"2024-06-02T23:57:17.335050+0000","last_peered":"2024-06-02T23:57:17.335050+0000","last_clean":"2024-06-02T23:57:17.335050+0000","last_became_active":"2024-06-02T23:57:15.326759+0000","last_became_peered":"2024-06-02T23:57:15.326759+0000","last_unstale":"2024-06-02T23:57:17.335050+0000","last_undegraded":"2024-06-02T23:57:17.335050+0000","last_fullsized":"2024-06-02T23:57:17.335050+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:42:20.473216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.335096+0000","last_change":"2024-06-02T23:57:15.323721+0000","last_active":"2024-06-02T23:57:17.335096+0000","last_peered":"2024-06-02T23:57:17.335096+0000","last_clean":"2024-06-02T23:57:17.335096+0000","last_became_active":"2024-06-02T23:57:15.321277+0000","last_became_peered":"2024-06-02T23:57:15.321277+0000","last_unstale":"2024-06-02T23:57:17.335096+0000","last_undegraded":"2024-06-02T23:57:17.335096+0000","last_fullsized":"2024-06-02T23:57:17.335096+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:34:31.667999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.332031+0000","last_change":"2024-06-02T23:57:15.323769+0000","last_active":"2024-06-02T23:57:17.332031+0000","last_peered":"2024-06-02T23:57:17.332031+0000","last_clean":"2024-06-02T23:57:17.332031+0000","last_became_active":"2024-06-02T23:57:15.323406+0000","last_became_peered":"2024-06-02T23:57:15.323406+0000","last_unstale":"2024-06-02T23:57:17.332031+0000","last_undegraded":"2024-06-02T23:57:17.332031+0000","last_fullsized":"2024-06-02T23:57:17.332031+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:51:27.456210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.331077+0000","last_change":"2024-06-02T23:57:15.321361+0000","last_active":"2024-06-02T23:57:17.331077+0000","last_peered":"2024-06-02T23:57:17.331077+0000","last_clean":"2024-06-02T23:57:17.331077+0000","last_became_active":"2024-06-02T23:57:15.321020+0000","last_became_peered":"2024-06-02T23:57:15.321020+0000","last_unstale":"2024-06-02T23:57:17.331077+0000","last_undegraded":"2024-06-02T23:57:17.331077+0000","last_fullsized":"2024-06-02T23:57:17.331077+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:32:07.392685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.735964+0000","last_change":"2024-06-02T23:57:15.320843+0000","last_active":"2024-06-02T23:57:56.735964+0000","last_peered":"2024-06-02T23:57:56.735964+0000","last_clean":"2024-06-02T23:57:56.735964+0000","last_became_active":"2024-06-02T23:57:15.320472+0000","last_became_peered":"2024-06-02T23:57:15.320472+0000","last_unstale":"2024-06-02T23:57:56.735964+0000","last_undegraded":"2024-06-02T23:57:56.735964+0000","last_fullsized":"2024-06-02T23:57:56.735964+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:49:02.620777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.320674+0000","last_change":"2024-06-02T23:57:15.321799+0000","last_active":"2024-06-02T23:57:17.320674+0000","last_peered":"2024-06-02T23:57:17.320674+0000","last_clean":"2024-06-02T23:57:17.320674+0000","last_became_active":"2024-06-02T23:57:15.321379+0000","last_became_peered":"2024-06-02T23:57:15.321379+0000","last_unstale":"2024-06-02T23:57:17.320674+0000","last_undegraded":"2024-06-02T23:57:17.320674+0000","last_fullsized":"2024-06-02T23:57:17.320674+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:36:56.404936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.331653+0000","last_change":"2024-06-02T23:57:15.318771+0000","last_active":"2024-06-02T23:57:17.331653+0000","last_peered":"2024-06-02T23:57:17.331653+0000","last_clean":"2024-06-02T23:57:17.331653+0000","last_became_active":"2024-06-02T23:57:15.318420+0000","last_became_peered":"2024-06-02T23:57:15.318420+0000","last_unstale":"2024-06-02T23:57:17.331653+0000","last_undegraded":"2024-06-02T23:57:17.331653+0000","last_fullsized":"2024-06-02T23:57:17.331653+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:07:53.769443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.333314+0000","last_change":"2024-06-02T23:57:15.318989+0000","last_active":"2024-06-02T23:57:17.333314+0000","last_peered":"2024-06-02T23:57:17.333314+0000","last_clean":"2024-06-02T23:57:17.333314+0000","last_became_active":"2024-06-02T23:57:15.318424+0000","last_became_peered":"2024-06-02T23:57:15.318424+0000","last_unstale":"2024-06-02T23:57:17.333314+0000","last_undegraded":"2024-06-02T23:57:17.333314+0000","last_fullsized":"2024-06-02T23:57:17.333314+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:30:47.634662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.736257+0000","last_change":"2024-06-02T23:57:15.326251+0000","last_active":"2024-06-02T23:57:56.736257+0000","last_peered":"2024-06-02T23:57:56.736257+0000","last_clean":"2024-06-02T23:57:56.736257+0000","last_became_active":"2024-06-02T23:57:15.325890+0000","last_became_peered":"2024-06-02T23:57:15.325890+0000","last_unstale":"2024-06-02T23:57:56.736257+0000","last_undegraded":"2024-06-02T23:57:56.736257+0000","last_fullsized":"2024-06-02T23:57:56.736257+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:18:54.871410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.320986+0000","last_change":"2024-06-02T23:57:15.325364+0000","last_active":"2024-06-02T23:57:17.320986+0000","last_peered":"2024-06-02T23:57:17.320986+0000","last_clean":"2024-06-02T23:57:17.320986+0000","last_became_active":"2024-06-02T23:57:15.324987+0000","last_became_peered":"2024-06-02T23:57:15.324987+0000","last_unstale":"2024-06-02T23:57:17.320986+0000","last_undegraded":"2024-06-02T23:57:17.320986+0000","last_fullsized":"2024-06-02T23:57:17.320986+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:59:11.827263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.332341+0000","last_change":"2024-06-02T23:57:15.328027+0000","last_active":"2024-06-02T23:57:17.332341+0000","last_peered":"2024-06-02T23:57:17.332341+0000","last_clean":"2024-06-02T23:57:17.332341+0000","last_became_active":"2024-06-02T23:57:15.327608+0000","last_became_peered":"2024-06-02T23:57:15.327608+0000","last_unstale":"2024-06-02T23:57:17.332341+0000","last_undegraded":"2024-06-02T23:57:17.332341+0000","last_fullsized":"2024-06-02T23:57:17.332341+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:09:42.152689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.331324+0000","last_change":"2024-06-02T23:57:15.323095+0000","last_active":"2024-06-02T23:57:17.331324+0000","last_peered":"2024-06-02T23:57:17.331324+0000","last_clean":"2024-06-02T23:57:17.331324+0000","last_became_active":"2024-06-02T23:57:15.322755+0000","last_became_peered":"2024-06-02T23:57:15.322755+0000","last_unstale":"2024-06-02T23:57:17.331324+0000","last_undegraded":"2024-06-02T23:57:17.331324+0000","last_fullsized":"2024-06-02T23:57:17.331324+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:43:53.195192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.334283+0000","last_change":"2024-06-02T23:57:15.327437+0000","last_active":"2024-06-02T23:57:17.334283+0000","last_peered":"2024-06-02T23:57:17.334283+0000","last_clean":"2024-06-02T23:57:17.334283+0000","last_became_active":"2024-06-02T23:57:15.326974+0000","last_became_peered":"2024-06-02T23:57:15.326974+0000","last_unstale":"2024-06-02T23:57:17.334283+0000","last_undegraded":"2024-06-02T23:57:17.334283+0000","last_fullsized":"2024-06-02T23:57:17.334283+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:20:44.978213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.334772+0000","last_change":"2024-06-02T23:57:15.325414+0000","last_active":"2024-06-02T23:57:17.334772+0000","last_peered":"2024-06-02T23:57:17.334772+0000","last_clean":"2024-06-02T23:57:17.334772+0000","last_became_active":"2024-06-02T23:57:15.325033+0000","last_became_peered":"2024-06-02T23:57:15.325033+0000","last_unstale":"2024-06-02T23:57:17.334772+0000","last_undegraded":"2024-06-02T23:57:17.334772+0000","last_fullsized":"2024-06-02T23:57:17.334772+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:27:14.536646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.331925+0000","last_change":"2024-06-02T23:57:15.315833+0000","last_active":"2024-06-02T23:57:17.331925+0000","last_peered":"2024-06-02T23:57:17.331925+0000","last_clean":"2024-06-02T23:57:17.331925+0000","last_became_active":"2024-06-02T23:57:15.315355+0000","last_became_peered":"2024-06-02T23:57:15.315355+0000","last_unstale":"2024-06-02T23:57:17.331925+0000","last_undegraded":"2024-06-02T23:57:17.331925+0000","last_fullsized":"2024-06-02T23:57:17.331925+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:52:05.915828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.316375+0000","last_change":"2024-06-02T23:57:15.322407+0000","last_active":"2024-06-02T23:57:17.316375+0000","last_peered":"2024-06-02T23:57:17.316375+0000","last_clean":"2024-06-02T23:57:17.316375+0000","last_became_active":"2024-06-02T23:57:15.322090+0000","last_became_peered":"2024-06-02T23:57:15.322090+0000","last_unstale":"2024-06-02T23:57:17.316375+0000","last_undegraded":"2024-06-02T23:57:17.316375+0000","last_fullsized":"2024-06-02T23:57:17.316375+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:08:48.071192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.315369+0000","last_change":"2024-06-02T23:57:15.327331+0000","last_active":"2024-06-02T23:57:17.315369+0000","last_peered":"2024-06-02T23:57:17.315369+0000","last_clean":"2024-06-02T23:57:17.315369+0000","last_became_active":"2024-06-02T23:57:15.326863+0000","last_became_peered":"2024-06-02T23:57:15.326863+0000","last_unstale":"2024-06-02T23:57:17.315369+0000","last_undegraded":"2024-06-02T23:57:17.315369+0000","last_fullsized":"2024-06-02T23:57:17.315369+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:45:05.443751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.331147+0000","last_change":"2024-06-02T23:57:15.313008+0000","last_active":"2024-06-02T23:57:17.331147+0000","last_peered":"2024-06-02T23:57:17.331147+0000","last_clean":"2024-06-02T23:57:17.331147+0000","last_became_active":"2024-06-02T23:57:15.312322+0000","last_became_peered":"2024-06-02T23:57:15.312322+0000","last_unstale":"2024-06-02T23:57:17.331147+0000","last_undegraded":"2024-06-02T23:57:17.331147+0000","last_fullsized":"2024-06-02T23:57:17.331147+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:54:03.744964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":57,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:53.184856+0000","last_change":"2024-06-02T23:57:12.153410+0000","last_active":"2024-06-02T23:57:53.184856+0000","last_peered":"2024-06-02T23:57:53.184856+0000","last_clean":"2024-06-02T23:57:53.184856+0000","last_became_active":"2024-06-02T23:57:12.153065+0000","last_became_peered":"2024-06-02T23:57:12.153065+0000","last_unstale":"2024-06-02T23:57:53.184856+0000","last_undegraded":"2024-06-02T23:57:53.184856+0000","last_fullsized":"2024-06-02T23:57:53.184856+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:45:30.058961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.331914+0000","last_change":"2024-06-02T23:57:15.314168+0000","last_active":"2024-06-02T23:57:17.331914+0000","last_peered":"2024-06-02T23:57:17.331914+0000","last_clean":"2024-06-02T23:57:17.331914+0000","last_became_active":"2024-06-02T23:57:15.313838+0000","last_became_peered":"2024-06-02T23:57:15.313838+0000","last_unstale":"2024-06-02T23:57:17.331914+0000","last_undegraded":"2024-06-02T23:57:17.331914+0000","last_fullsized":"2024-06-02T23:57:17.331914+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:56:14.137471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.337125+0000","last_change":"2024-06-02T23:57:12.305448+0000","last_active":"2024-06-02T23:57:17.337125+0000","last_peered":"2024-06-02T23:57:17.337125+0000","last_clean":"2024-06-02T23:57:17.337125+0000","last_became_active":"2024-06-02T23:57:12.305080+0000","last_became_peered":"2024-06-02T23:57:12.305080+0000","last_unstale":"2024-06-02T23:57:17.337125+0000","last_undegraded":"2024-06-02T23:57:17.337125+0000","last_fullsized":"2024-06-02T23:57:17.337125+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:20:18.660943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.335215+0000","last_change":"2024-06-02T23:57:15.321660+0000","last_active":"2024-06-02T23:57:17.335215+0000","last_peered":"2024-06-02T23:57:17.335215+0000","last_clean":"2024-06-02T23:57:17.335215+0000","last_became_active":"2024-06-02T23:57:15.321304+0000","last_became_peered":"2024-06-02T23:57:15.321304+0000","last_unstale":"2024-06-02T23:57:17.335215+0000","last_undegraded":"2024-06-02T23:57:17.335215+0000","last_fullsized":"2024-06-02T23:57:17.335215+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:10:10.933291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:33.154989+0000","last_change":"2024-06-02T23:57:12.153309+0000","last_active":"2024-06-02T23:57:33.154989+0000","last_peered":"2024-06-02T23:57:33.154989+0000","last_clean":"2024-06-02T23:57:33.154989+0000","last_became_active":"2024-06-02T23:57:12.152921+0000","last_became_peered":"2024-06-02T23:57:12.152921+0000","last_unstale":"2024-06-02T23:57:33.154989+0000","last_undegraded":"2024-06-02T23:57:33.154989+0000","last_fullsized":"2024-06-02T23:57:33.154989+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:50:10.869736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.332203+0000","last_change":"2024-06-02T23:57:15.328944+0000","last_active":"2024-06-02T23:57:17.332203+0000","last_peered":"2024-06-02T23:57:17.332203+0000","last_clean":"2024-06-02T23:57:17.332203+0000","last_became_active":"2024-06-02T23:57:15.328531+0000","last_became_peered":"2024-06-02T23:57:15.328531+0000","last_unstale":"2024-06-02T23:57:17.332203+0000","last_undegraded":"2024-06-02T23:57:17.332203+0000","last_fullsized":"2024-06-02T23:57:17.332203+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:48:19.709989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:32.469593+0000","last_change":"2024-06-02T23:57:12.153967+0000","last_active":"2024-06-02T23:57:32.469593+0000","last_peered":"2024-06-02T23:57:32.469593+0000","last_clean":"2024-06-02T23:57:32.469593+0000","last_became_active":"2024-06-02T23:57:12.153600+0000","last_became_peered":"2024-06-02T23:57:12.153600+0000","last_unstale":"2024-06-02T23:57:32.469593+0000","last_undegraded":"2024-06-02T23:57:32.469593+0000","last_fullsized":"2024-06-02T23:57:32.469593+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:47:58.761573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.333688+0000","last_change":"2024-06-02T23:57:15.318089+0000","last_active":"2024-06-02T23:57:17.333688+0000","last_peered":"2024-06-02T23:57:17.333688+0000","last_clean":"2024-06-02T23:57:17.333688+0000","last_became_active":"2024-06-02T23:57:15.316494+0000","last_became_peered":"2024-06-02T23:57:15.316494+0000","last_unstale":"2024-06-02T23:57:17.333688+0000","last_undegraded":"2024-06-02T23:57:17.333688+0000","last_fullsized":"2024-06-02T23:57:17.333688+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:21:15.839255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'6","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:52.185970+0000","last_change":"2024-06-02T23:57:12.153624+0000","last_active":"2024-06-02T23:57:52.185970+0000","last_peered":"2024-06-02T23:57:52.185970+0000","last_clean":"2024-06-02T23:57:52.185970+0000","last_became_active":"2024-06-02T23:57:12.152712+0000","last_became_peered":"2024-06-02T23:57:12.152712+0000","last_unstale":"2024-06-02T23:57:52.185970+0000","last_undegraded":"2024-06-02T23:57:52.185970+0000","last_fullsized":"2024-06-02T23:57:52.185970+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:14:50.236213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.330501+0000","last_change":"2024-06-02T23:57:15.325293+0000","last_active":"2024-06-02T23:57:17.330501+0000","last_peered":"2024-06-02T23:57:17.330501+0000","last_clean":"2024-06-02T23:57:17.330501+0000","last_became_active":"2024-06-02T23:57:15.324967+0000","last_became_peered":"2024-06-02T23:57:15.324967+0000","last_unstale":"2024-06-02T23:57:17.330501+0000","last_undegraded":"2024-06-02T23:57:17.330501+0000","last_fullsized":"2024-06-02T23:57:17.330501+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:21:23.634118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.735901+0000","last_change":"2024-06-02T23:57:12.155927+0000","last_active":"2024-06-02T23:57:56.735901+0000","last_peered":"2024-06-02T23:57:56.735901+0000","last_clean":"2024-06-02T23:57:56.735901+0000","last_became_active":"2024-06-02T23:57:12.155505+0000","last_became_peered":"2024-06-02T23:57:12.155505+0000","last_unstale":"2024-06-02T23:57:56.735901+0000","last_undegraded":"2024-06-02T23:57:56.735901+0000","last_fullsized":"2024-06-02T23:57:56.735901+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:47.555747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.332894+0000","last_change":"2024-06-02T23:57:15.321796+0000","last_active":"2024-06-02T23:57:17.332894+0000","last_peered":"2024-06-02T23:57:17.332894+0000","last_clean":"2024-06-02T23:57:17.332894+0000","last_became_active":"2024-06-02T23:57:15.320850+0000","last_became_peered":"2024-06-02T23:57:15.320850+0000","last_unstale":"2024-06-02T23:57:17.332894+0000","last_undegraded":"2024-06-02T23:57:17.332894+0000","last_fullsized":"2024-06-02T23:57:17.332894+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:04:10.991920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:30.451128+0000","last_change":"2024-06-02T23:57:12.146589+0000","last_active":"2024-06-02T23:57:30.451128+0000","last_peered":"2024-06-02T23:57:30.451128+0000","last_clean":"2024-06-02T23:57:30.451128+0000","last_became_active":"2024-06-02T23:57:12.146224+0000","last_became_peered":"2024-06-02T23:57:12.146224+0000","last_unstale":"2024-06-02T23:57:30.451128+0000","last_undegraded":"2024-06-02T23:57:30.451128+0000","last_fullsized":"2024-06-02T23:57:30.451128+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:17:31.250585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.331605+0000","last_change":"2024-06-02T23:57:15.315553+0000","last_active":"2024-06-02T23:57:17.331605+0000","last_peered":"2024-06-02T23:57:17.331605+0000","last_clean":"2024-06-02T23:57:17.331605+0000","last_became_active":"2024-06-02T23:57:15.315217+0000","last_became_peered":"2024-06-02T23:57:15.315217+0000","last_unstale":"2024-06-02T23:57:17.331605+0000","last_undegraded":"2024-06-02T23:57:17.331605+0000","last_fullsized":"2024-06-02T23:57:17.331605+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:00:23.097949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:32.467854+0000","last_change":"2024-06-02T23:57:12.156971+0000","last_active":"2024-06-02T23:57:32.467854+0000","last_peered":"2024-06-02T23:57:32.467854+0000","last_clean":"2024-06-02T23:57:32.467854+0000","last_became_active":"2024-06-02T23:57:12.156379+0000","last_became_peered":"2024-06-02T23:57:12.156379+0000","last_unstale":"2024-06-02T23:57:32.467854+0000","last_undegraded":"2024-06-02T23:57:32.467854+0000","last_fullsized":"2024-06-02T23:57:32.467854+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:28:50.057736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.315110+0000","last_change":"2024-06-02T23:57:15.313985+0000","last_active":"2024-06-02T23:57:17.315110+0000","last_peered":"2024-06-02T23:57:17.315110+0000","last_clean":"2024-06-02T23:57:17.315110+0000","last_became_active":"2024-06-02T23:57:15.313668+0000","last_became_peered":"2024-06-02T23:57:15.313668+0000","last_unstale":"2024-06-02T23:57:17.315110+0000","last_undegraded":"2024-06-02T23:57:17.315110+0000","last_fullsized":"2024-06-02T23:57:17.315110+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:10:56.560660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'4","reported_seq":78,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.736277+0000","last_change":"2024-06-02T23:57:12.156025+0000","last_active":"2024-06-02T23:57:56.736277+0000","last_peered":"2024-06-02T23:57:56.736277+0000","last_clean":"2024-06-02T23:57:56.736277+0000","last_became_active":"2024-06-02T23:57:12.155609+0000","last_became_peered":"2024-06-02T23:57:12.155609+0000","last_unstale":"2024-06-02T23:57:56.736277+0000","last_undegraded":"2024-06-02T23:57:56.736277+0000","last_fullsized":"2024-06-02T23:57:56.736277+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:27:48.953456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.332956+0000","last_change":"2024-06-02T23:57:15.329711+0000","last_active":"2024-06-02T23:57:17.332956+0000","last_peered":"2024-06-02T23:57:17.332956+0000","last_clean":"2024-06-02T23:57:17.332956+0000","last_became_active":"2024-06-02T23:57:15.329284+0000","last_became_peered":"2024-06-02T23:57:15.329284+0000","last_unstale":"2024-06-02T23:57:17.332956+0000","last_undegraded":"2024-06-02T23:57:17.332956+0000","last_fullsized":"2024-06-02T23:57:17.332956+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:58:06.165152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:32.468198+0000","last_change":"2024-06-02T23:57:12.156949+0000","last_active":"2024-06-02T23:57:32.468198+0000","last_peered":"2024-06-02T23:57:32.468198+0000","last_clean":"2024-06-02T23:57:32.468198+0000","last_became_active":"2024-06-02T23:57:12.156558+0000","last_became_peered":"2024-06-02T23:57:12.156558+0000","last_unstale":"2024-06-02T23:57:32.468198+0000","last_undegraded":"2024-06-02T23:57:32.468198+0000","last_fullsized":"2024-06-02T23:57:32.468198+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:05:57.658900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.335159+0000","last_change":"2024-06-02T23:57:15.318638+0000","last_active":"2024-06-02T23:57:17.335159+0000","last_peered":"2024-06-02T23:57:17.335159+0000","last_clean":"2024-06-02T23:57:17.335159+0000","last_became_active":"2024-06-02T23:57:15.318321+0000","last_became_peered":"2024-06-02T23:57:15.318321+0000","last_unstale":"2024-06-02T23:57:17.335159+0000","last_undegraded":"2024-06-02T23:57:17.335159+0000","last_fullsized":"2024-06-02T23:57:17.335159+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:21:57.877235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:31.460739+0000","last_change":"2024-06-02T23:57:12.306278+0000","last_active":"2024-06-02T23:57:31.460739+0000","last_peered":"2024-06-02T23:57:31.460739+0000","last_clean":"2024-06-02T23:57:31.460739+0000","last_became_active":"2024-06-02T23:57:12.305885+0000","last_became_peered":"2024-06-02T23:57:12.305885+0000","last_unstale":"2024-06-02T23:57:31.460739+0000","last_undegraded":"2024-06-02T23:57:31.460739+0000","last_fullsized":"2024-06-02T23:57:31.460739+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:05:07.723501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.332622+0000","last_change":"2024-06-02T23:57:15.322489+0000","last_active":"2024-06-02T23:57:17.332622+0000","last_peered":"2024-06-02T23:57:17.332622+0000","last_clean":"2024-06-02T23:57:17.332622+0000","last_became_active":"2024-06-02T23:57:15.322131+0000","last_became_peered":"2024-06-02T23:57:15.322131+0000","last_unstale":"2024-06-02T23:57:17.332622+0000","last_undegraded":"2024-06-02T23:57:17.332622+0000","last_fullsized":"2024-06-02T23:57:17.332622+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:34:43.362338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'28","reported_seq":110,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.736040+0000","last_change":"2024-06-02T23:57:12.156920+0000","last_active":"2024-06-02T23:57:56.736040+0000","last_peered":"2024-06-02T23:57:56.736040+0000","last_clean":"2024-06-02T23:57:56.736040+0000","last_became_active":"2024-06-02T23:57:12.156494+0000","last_became_peered":"2024-06-02T23:57:12.156494+0000","last_unstale":"2024-06-02T23:57:56.736040+0000","last_undegraded":"2024-06-02T23:57:56.736040+0000","last_fullsized":"2024-06-02T23:57:56.736040+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:49:56.458730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53857,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":56,"num_read_kb":80,"num_write":30,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.331047+0000","last_change":"2024-06-02T23:57:15.328502+0000","last_active":"2024-06-02T23:57:17.331047+0000","last_peered":"2024-06-02T23:57:17.331047+0000","last_clean":"2024-06-02T23:57:17.331047+0000","last_became_active":"2024-06-02T23:57:15.328174+0000","last_became_peered":"2024-06-02T23:57:15.328174+0000","last_unstale":"2024-06-02T23:57:17.331047+0000","last_undegraded":"2024-06-02T23:57:17.331047+0000","last_fullsized":"2024-06-02T23:57:17.331047+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:58:33.355397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:33.155228+0000","last_change":"2024-06-02T23:57:12.154204+0000","last_active":"2024-06-02T23:57:33.155228+0000","last_peered":"2024-06-02T23:57:33.155228+0000","last_clean":"2024-06-02T23:57:33.155228+0000","last_became_active":"2024-06-02T23:57:12.153412+0000","last_became_peered":"2024-06-02T23:57:12.153412+0000","last_unstale":"2024-06-02T23:57:33.155228+0000","last_undegraded":"2024-06-02T23:57:33.155228+0000","last_fullsized":"2024-06-02T23:57:33.155228+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:15.472279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.330872+0000","last_change":"2024-06-02T23:57:15.314274+0000","last_active":"2024-06-02T23:57:17.330872+0000","last_peered":"2024-06-02T23:57:17.330872+0000","last_clean":"2024-06-02T23:57:17.330872+0000","last_became_active":"2024-06-02T23:57:15.313946+0000","last_became_peered":"2024-06-02T23:57:15.313946+0000","last_unstale":"2024-06-02T23:57:17.330872+0000","last_undegraded":"2024-06-02T23:57:17.330872+0000","last_fullsized":"2024-06-02T23:57:17.330872+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:07.909977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:32.467225+0000","last_change":"2024-06-02T23:57:12.156767+0000","last_active":"2024-06-02T23:57:32.467225+0000","last_peered":"2024-06-02T23:57:32.467225+0000","last_clean":"2024-06-02T23:57:32.467225+0000","last_became_active":"2024-06-02T23:57:12.156346+0000","last_became_peered":"2024-06-02T23:57:12.156346+0000","last_unstale":"2024-06-02T23:57:32.467225+0000","last_undegraded":"2024-06-02T23:57:32.467225+0000","last_fullsized":"2024-06-02T23:57:32.467225+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:29:45.801904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.320999+0000","last_change":"2024-06-02T23:57:15.322676+0000","last_active":"2024-06-02T23:57:17.320999+0000","last_peered":"2024-06-02T23:57:17.320999+0000","last_clean":"2024-06-02T23:57:17.320999+0000","last_became_active":"2024-06-02T23:57:15.319429+0000","last_became_peered":"2024-06-02T23:57:15.319429+0000","last_unstale":"2024-06-02T23:57:17.320999+0000","last_undegraded":"2024-06-02T23:57:17.320999+0000","last_fullsized":"2024-06-02T23:57:17.320999+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:48:15.984818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'5","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:53.185713+0000","last_change":"2024-06-02T23:57:12.153925+0000","last_active":"2024-06-02T23:57:53.185713+0000","last_peered":"2024-06-02T23:57:53.185713+0000","last_clean":"2024-06-02T23:57:53.185713+0000","last_became_active":"2024-06-02T23:57:12.152990+0000","last_became_peered":"2024-06-02T23:57:12.152990+0000","last_unstale":"2024-06-02T23:57:53.185713+0000","last_undegraded":"2024-06-02T23:57:53.185713+0000","last_fullsized":"2024-06-02T23:57:53.185713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:32:21.845946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.320550+0000","last_change":"2024-06-02T23:57:15.327662+0000","last_active":"2024-06-02T23:57:17.320550+0000","last_peered":"2024-06-02T23:57:17.320550+0000","last_clean":"2024-06-02T23:57:17.320550+0000","last_became_active":"2024-06-02T23:57:15.327320+0000","last_became_peered":"2024-06-02T23:57:15.327320+0000","last_unstale":"2024-06-02T23:57:17.320550+0000","last_undegraded":"2024-06-02T23:57:17.320550+0000","last_fullsized":"2024-06-02T23:57:17.320550+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:44:37.561533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:32.467738+0000","last_change":"2024-06-02T23:57:12.306856+0000","last_active":"2024-06-02T23:57:32.467738+0000","last_peered":"2024-06-02T23:57:32.467738+0000","last_clean":"2024-06-02T23:57:32.467738+0000","last_became_active":"2024-06-02T23:57:12.306476+0000","last_became_peered":"2024-06-02T23:57:12.306476+0000","last_unstale":"2024-06-02T23:57:32.467738+0000","last_undegraded":"2024-06-02T23:57:32.467738+0000","last_fullsized":"2024-06-02T23:57:32.467738+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:30:22.839589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.332654+0000","last_change":"2024-06-02T23:57:15.322895+0000","last_active":"2024-06-02T23:57:17.332654+0000","last_peered":"2024-06-02T23:57:17.332654+0000","last_clean":"2024-06-02T23:57:17.332654+0000","last_became_active":"2024-06-02T23:57:15.322549+0000","last_became_peered":"2024-06-02T23:57:15.322549+0000","last_unstale":"2024-06-02T23:57:17.332654+0000","last_undegraded":"2024-06-02T23:57:17.332654+0000","last_fullsized":"2024-06-02T23:57:17.332654+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:21:55.548657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:32.447284+0000","last_change":"2024-06-02T23:57:12.146690+0000","last_active":"2024-06-02T23:57:32.447284+0000","last_peered":"2024-06-02T23:57:32.447284+0000","last_clean":"2024-06-02T23:57:32.447284+0000","last_became_active":"2024-06-02T23:57:12.146372+0000","last_became_peered":"2024-06-02T23:57:12.146372+0000","last_unstale":"2024-06-02T23:57:32.447284+0000","last_undegraded":"2024-06-02T23:57:32.447284+0000","last_fullsized":"2024-06-02T23:57:32.447284+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:45:04.421365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.316015+0000","last_change":"2024-06-02T23:57:15.320938+0000","last_active":"2024-06-02T23:57:17.316015+0000","last_peered":"2024-06-02T23:57:17.316015+0000","last_clean":"2024-06-02T23:57:17.316015+0000","last_became_active":"2024-06-02T23:57:15.320567+0000","last_became_peered":"2024-06-02T23:57:15.320567+0000","last_unstale":"2024-06-02T23:57:17.316015+0000","last_undegraded":"2024-06-02T23:57:17.316015+0000","last_fullsized":"2024-06-02T23:57:17.316015+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:04:29.736387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"88'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.315396+0000","last_change":"2024-06-02T23:57:12.307020+0000","last_active":"2024-06-02T23:57:17.315396+0000","last_peered":"2024-06-02T23:57:17.315396+0000","last_clean":"2024-06-02T23:57:17.315396+0000","last_became_active":"2024-06-02T23:57:12.306650+0000","last_became_peered":"2024-06-02T23:57:12.306650+0000","last_unstale":"2024-06-02T23:57:17.315396+0000","last_undegraded":"2024-06-02T23:57:17.315396+0000","last_fullsized":"2024-06-02T23:57:17.315396+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:18:03.679704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'1","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.736095+0000","last_change":"2024-06-02T23:57:15.319300+0000","last_active":"2024-06-02T23:57:56.736095+0000","last_peered":"2024-06-02T23:57:56.736095+0000","last_clean":"2024-06-02T23:57:56.736095+0000","last_became_active":"2024-06-02T23:57:15.318903+0000","last_became_peered":"2024-06-02T23:57:15.318903+0000","last_unstale":"2024-06-02T23:57:56.736095+0000","last_undegraded":"2024-06-02T23:57:56.736095+0000","last_fullsized":"2024-06-02T23:57:56.736095+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:38:25.521337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:53.185408+0000","last_change":"2024-06-02T23:57:12.155260+0000","last_active":"2024-06-02T23:57:53.185408+0000","last_peered":"2024-06-02T23:57:53.185408+0000","last_clean":"2024-06-02T23:57:53.185408+0000","last_became_active":"2024-06-02T23:57:12.154884+0000","last_became_peered":"2024-06-02T23:57:12.154884+0000","last_unstale":"2024-06-02T23:57:53.185408+0000","last_undegraded":"2024-06-02T23:57:53.185408+0000","last_fullsized":"2024-06-02T23:57:53.185408+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:34:52.390752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.736008+0000","last_change":"2024-06-02T23:57:15.323490+0000","last_active":"2024-06-02T23:57:56.736008+0000","last_peered":"2024-06-02T23:57:56.736008+0000","last_clean":"2024-06-02T23:57:56.736008+0000","last_became_active":"2024-06-02T23:57:15.323142+0000","last_became_peered":"2024-06-02T23:57:15.323142+0000","last_unstale":"2024-06-02T23:57:56.736008+0000","last_undegraded":"2024-06-02T23:57:56.736008+0000","last_fullsized":"2024-06-02T23:57:56.736008+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:32:32.445823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.332834+0000","last_change":"2024-06-02T23:57:15.317451+0000","last_active":"2024-06-02T23:57:17.332834+0000","last_peered":"2024-06-02T23:57:17.332834+0000","last_clean":"2024-06-02T23:57:17.332834+0000","last_became_active":"2024-06-02T23:57:15.316403+0000","last_became_peered":"2024-06-02T23:57:15.316403+0000","last_unstale":"2024-06-02T23:57:17.332834+0000","last_undegraded":"2024-06-02T23:57:17.332834+0000","last_fullsized":"2024-06-02T23:57:17.332834+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:03:51.198123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:52.184024+0000","last_change":"2024-06-02T23:57:12.305475+0000","last_active":"2024-06-02T23:57:52.184024+0000","last_peered":"2024-06-02T23:57:52.184024+0000","last_clean":"2024-06-02T23:57:52.184024+0000","last_became_active":"2024-06-02T23:57:12.305071+0000","last_became_peered":"2024-06-02T23:57:12.305071+0000","last_unstale":"2024-06-02T23:57:52.184024+0000","last_undegraded":"2024-06-02T23:57:52.184024+0000","last_fullsized":"2024-06-02T23:57:52.184024+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:08:29.024447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.333458+0000","last_change":"2024-06-02T23:57:15.308629+0000","last_active":"2024-06-02T23:57:17.333458+0000","last_peered":"2024-06-02T23:57:17.333458+0000","last_clean":"2024-06-02T23:57:17.333458+0000","last_became_active":"2024-06-02T23:57:15.307981+0000","last_became_peered":"2024-06-02T23:57:15.307981+0000","last_unstale":"2024-06-02T23:57:17.333458+0000","last_undegraded":"2024-06-02T23:57:17.333458+0000","last_fullsized":"2024-06-02T23:57:17.333458+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:14:22.446599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:33.156747+0000","last_change":"2024-06-02T23:57:12.155968+0000","last_active":"2024-06-02T23:57:33.156747+0000","last_peered":"2024-06-02T23:57:33.156747+0000","last_clean":"2024-06-02T23:57:33.156747+0000","last_became_active":"2024-06-02T23:57:12.155521+0000","last_became_peered":"2024-06-02T23:57:12.155521+0000","last_unstale":"2024-06-02T23:57:33.156747+0000","last_undegraded":"2024-06-02T23:57:33.156747+0000","last_fullsized":"2024-06-02T23:57:33.156747+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:45:00.397317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":344,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.320615+0000","last_change":"2024-06-02T23:55:50.081978+0000","last_active":"2024-06-02T23:57:17.320615+0000","last_peered":"2024-06-02T23:57:17.320615+0000","last_clean":"2024-06-02T23:57:17.320615+0000","last_became_active":"2024-06-02T23:55:50.081431+0000","last_became_peered":"2024-06-02T23:55:50.081431+0000","last_unstale":"2024-06-02T23:57:17.320615+0000","last_undegraded":"2024-06-02T23:57:17.320615+0000","last_fullsized":"2024-06-02T23:57:17.320615+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:52:23.676206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:52:23.676206+0000","last_clean_scrub_stamp":"2024-06-02T23:52:23.676206+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:29:59.979935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.330579+0000","last_change":"2024-06-02T23:57:15.319003+0000","last_active":"2024-06-02T23:57:17.330579+0000","last_peered":"2024-06-02T23:57:17.330579+0000","last_clean":"2024-06-02T23:57:17.330579+0000","last_became_active":"2024-06-02T23:57:15.318554+0000","last_became_peered":"2024-06-02T23:57:15.318554+0000","last_unstale":"2024-06-02T23:57:17.330579+0000","last_undegraded":"2024-06-02T23:57:17.330579+0000","last_fullsized":"2024-06-02T23:57:17.330579+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:49:06.707181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:30.451109+0000","last_change":"2024-06-02T23:57:12.155897+0000","last_active":"2024-06-02T23:57:30.451109+0000","last_peered":"2024-06-02T23:57:30.451109+0000","last_clean":"2024-06-02T23:57:30.451109+0000","last_became_active":"2024-06-02T23:57:12.155461+0000","last_became_peered":"2024-06-02T23:57:12.155461+0000","last_unstale":"2024-06-02T23:57:30.451109+0000","last_undegraded":"2024-06-02T23:57:30.451109+0000","last_fullsized":"2024-06-02T23:57:30.451109+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:19:22.104104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:32.468060+0000","last_change":"2024-06-02T23:57:12.306363+0000","last_active":"2024-06-02T23:57:32.468060+0000","last_peered":"2024-06-02T23:57:32.468060+0000","last_clean":"2024-06-02T23:57:32.468060+0000","last_became_active":"2024-06-02T23:57:12.305920+0000","last_became_peered":"2024-06-02T23:57:12.305920+0000","last_unstale":"2024-06-02T23:57:32.468060+0000","last_undegraded":"2024-06-02T23:57:32.468060+0000","last_fullsized":"2024-06-02T23:57:32.468060+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:31:01.787879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.331607+0000","last_change":"2024-06-02T23:57:15.316038+0000","last_active":"2024-06-02T23:57:17.331607+0000","last_peered":"2024-06-02T23:57:17.331607+0000","last_clean":"2024-06-02T23:57:17.331607+0000","last_became_active":"2024-06-02T23:57:15.315715+0000","last_became_peered":"2024-06-02T23:57:15.315715+0000","last_unstale":"2024-06-02T23:57:17.331607+0000","last_undegraded":"2024-06-02T23:57:17.331607+0000","last_fullsized":"2024-06-02T23:57:17.331607+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:34:36.014251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'15","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:49.334121+0000","last_change":"2024-06-02T23:57:12.139095+0000","last_active":"2024-06-02T23:57:49.334121+0000","last_peered":"2024-06-02T23:57:49.334121+0000","last_clean":"2024-06-02T23:57:49.334121+0000","last_became_active":"2024-06-02T23:57:12.138686+0000","last_became_peered":"2024-06-02T23:57:12.138686+0000","last_unstale":"2024-06-02T23:57:49.334121+0000","last_undegraded":"2024-06-02T23:57:49.334121+0000","last_fullsized":"2024-06-02T23:57:49.334121+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:28:25.963359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.332990+0000","last_change":"2024-06-02T23:57:15.315657+0000","last_active":"2024-06-02T23:57:17.332990+0000","last_peered":"2024-06-02T23:57:17.332990+0000","last_clean":"2024-06-02T23:57:17.332990+0000","last_became_active":"2024-06-02T23:57:15.315293+0000","last_became_peered":"2024-06-02T23:57:15.315293+0000","last_unstale":"2024-06-02T23:57:17.332990+0000","last_undegraded":"2024-06-02T23:57:17.332990+0000","last_fullsized":"2024-06-02T23:57:17.332990+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:52:55.241379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:32.469266+0000","last_change":"2024-06-02T23:57:12.405664+0000","last_active":"2024-06-02T23:57:32.469266+0000","last_peered":"2024-06-02T23:57:32.469266+0000","last_clean":"2024-06-02T23:57:32.469266+0000","last_became_active":"2024-06-02T23:57:12.405281+0000","last_became_peered":"2024-06-02T23:57:12.405281+0000","last_unstale":"2024-06-02T23:57:32.469266+0000","last_undegraded":"2024-06-02T23:57:32.469266+0000","last_fullsized":"2024-06-02T23:57:32.469266+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:46:50.119466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.335039+0000","last_change":"2024-06-02T23:57:15.318136+0000","last_active":"2024-06-02T23:57:17.335039+0000","last_peered":"2024-06-02T23:57:17.335039+0000","last_clean":"2024-06-02T23:57:17.335039+0000","last_became_active":"2024-06-02T23:57:15.317753+0000","last_became_peered":"2024-06-02T23:57:15.317753+0000","last_unstale":"2024-06-02T23:57:17.335039+0000","last_undegraded":"2024-06-02T23:57:17.335039+0000","last_fullsized":"2024-06-02T23:57:17.335039+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:35:11.025266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:29.448950+0000","last_change":"2024-06-02T23:57:12.305954+0000","last_active":"2024-06-02T23:57:29.448950+0000","last_peered":"2024-06-02T23:57:29.448950+0000","last_clean":"2024-06-02T23:57:29.448950+0000","last_became_active":"2024-06-02T23:57:12.305589+0000","last_became_peered":"2024-06-02T23:57:12.305589+0000","last_unstale":"2024-06-02T23:57:29.448950+0000","last_undegraded":"2024-06-02T23:57:29.448950+0000","last_fullsized":"2024-06-02T23:57:29.448950+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:34:34.178446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.330304+0000","last_change":"2024-06-02T23:57:15.327115+0000","last_active":"2024-06-02T23:57:17.330304+0000","last_peered":"2024-06-02T23:57:17.330304+0000","last_clean":"2024-06-02T23:57:17.330304+0000","last_became_active":"2024-06-02T23:57:15.326746+0000","last_became_peered":"2024-06-02T23:57:15.326746+0000","last_unstale":"2024-06-02T23:57:17.330304+0000","last_undegraded":"2024-06-02T23:57:17.330304+0000","last_fullsized":"2024-06-02T23:57:17.330304+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:08:04.340517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:32.467422+0000","last_change":"2024-06-02T23:57:12.152933+0000","last_active":"2024-06-02T23:57:32.467422+0000","last_peered":"2024-06-02T23:57:32.467422+0000","last_clean":"2024-06-02T23:57:32.467422+0000","last_became_active":"2024-06-02T23:57:12.152453+0000","last_became_peered":"2024-06-02T23:57:12.152453+0000","last_unstale":"2024-06-02T23:57:32.467422+0000","last_undegraded":"2024-06-02T23:57:32.467422+0000","last_fullsized":"2024-06-02T23:57:32.467422+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:47:05.144374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.315860+0000","last_change":"2024-06-02T23:57:15.326042+0000","last_active":"2024-06-02T23:57:17.315860+0000","last_peered":"2024-06-02T23:57:17.315860+0000","last_clean":"2024-06-02T23:57:17.315860+0000","last_became_active":"2024-06-02T23:57:15.325585+0000","last_became_peered":"2024-06-02T23:57:15.325585+0000","last_unstale":"2024-06-02T23:57:17.315860+0000","last_undegraded":"2024-06-02T23:57:17.315860+0000","last_fullsized":"2024-06-02T23:57:17.315860+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:40:37.305875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"88'3","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:31.461256+0000","last_change":"2024-06-02T23:57:12.139155+0000","last_active":"2024-06-02T23:57:31.461256+0000","last_peered":"2024-06-02T23:57:31.461256+0000","last_clean":"2024-06-02T23:57:31.461256+0000","last_became_active":"2024-06-02T23:57:12.138732+0000","last_became_peered":"2024-06-02T23:57:12.138732+0000","last_unstale":"2024-06-02T23:57:31.461256+0000","last_undegraded":"2024-06-02T23:57:31.461256+0000","last_fullsized":"2024-06-02T23:57:31.461256+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:18:29.148439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.331915+0000","last_change":"2024-06-02T23:57:15.319510+0000","last_active":"2024-06-02T23:57:17.331915+0000","last_peered":"2024-06-02T23:57:17.331915+0000","last_clean":"2024-06-02T23:57:17.331915+0000","last_became_active":"2024-06-02T23:57:15.319192+0000","last_became_peered":"2024-06-02T23:57:15.319192+0000","last_unstale":"2024-06-02T23:57:17.331915+0000","last_undegraded":"2024-06-02T23:57:17.331915+0000","last_fullsized":"2024-06-02T23:57:17.331915+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:04:04.241833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:29.449623+0000","last_change":"2024-06-02T23:57:12.152945+0000","last_active":"2024-06-02T23:57:29.449623+0000","last_peered":"2024-06-02T23:57:29.449623+0000","last_clean":"2024-06-02T23:57:29.449623+0000","last_became_active":"2024-06-02T23:57:12.152538+0000","last_became_peered":"2024-06-02T23:57:12.152538+0000","last_unstale":"2024-06-02T23:57:29.449623+0000","last_undegraded":"2024-06-02T23:57:29.449623+0000","last_fullsized":"2024-06-02T23:57:29.449623+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:10:38.513361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.321161+0000","last_change":"2024-06-02T23:57:15.320837+0000","last_active":"2024-06-02T23:57:17.321161+0000","last_peered":"2024-06-02T23:57:17.321161+0000","last_clean":"2024-06-02T23:57:17.321161+0000","last_became_active":"2024-06-02T23:57:15.320257+0000","last_became_peered":"2024-06-02T23:57:15.320257+0000","last_unstale":"2024-06-02T23:57:17.321161+0000","last_undegraded":"2024-06-02T23:57:17.321161+0000","last_fullsized":"2024-06-02T23:57:17.321161+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:18:29.638614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'5","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:51.184549+0000","last_change":"2024-06-02T23:57:12.405175+0000","last_active":"2024-06-02T23:57:51.184549+0000","last_peered":"2024-06-02T23:57:51.184549+0000","last_clean":"2024-06-02T23:57:51.184549+0000","last_became_active":"2024-06-02T23:57:12.404767+0000","last_became_peered":"2024-06-02T23:57:12.404767+0000","last_unstale":"2024-06-02T23:57:51.184549+0000","last_undegraded":"2024-06-02T23:57:51.184549+0000","last_fullsized":"2024-06-02T23:57:51.184549+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:46:57.421288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.321330+0000","last_change":"2024-06-02T23:57:15.322888+0000","last_active":"2024-06-02T23:57:17.321330+0000","last_peered":"2024-06-02T23:57:17.321330+0000","last_clean":"2024-06-02T23:57:17.321330+0000","last_became_active":"2024-06-02T23:57:15.321982+0000","last_became_peered":"2024-06-02T23:57:15.321982+0000","last_unstale":"2024-06-02T23:57:17.321330+0000","last_undegraded":"2024-06-02T23:57:17.321330+0000","last_fullsized":"2024-06-02T23:57:17.321330+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:51:57.253824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:32.467601+0000","last_change":"2024-06-02T23:57:12.153715+0000","last_active":"2024-06-02T23:57:32.467601+0000","last_peered":"2024-06-02T23:57:32.467601+0000","last_clean":"2024-06-02T23:57:32.467601+0000","last_became_active":"2024-06-02T23:57:12.152544+0000","last_became_peered":"2024-06-02T23:57:12.152544+0000","last_unstale":"2024-06-02T23:57:32.467601+0000","last_undegraded":"2024-06-02T23:57:32.467601+0000","last_fullsized":"2024-06-02T23:57:32.467601+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:51:05.874962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"88'1","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.321132+0000","last_change":"2024-06-02T23:57:15.318759+0000","last_active":"2024-06-02T23:57:17.321132+0000","last_peered":"2024-06-02T23:57:17.321132+0000","last_clean":"2024-06-02T23:57:17.321132+0000","last_became_active":"2024-06-02T23:57:15.317942+0000","last_became_peered":"2024-06-02T23:57:15.317942+0000","last_unstale":"2024-06-02T23:57:17.321132+0000","last_undegraded":"2024-06-02T23:57:17.321132+0000","last_fullsized":"2024-06-02T23:57:17.321132+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:39:44.142890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:32.465804+0000","last_change":"2024-06-02T23:57:12.138157+0000","last_active":"2024-06-02T23:57:32.465804+0000","last_peered":"2024-06-02T23:57:32.465804+0000","last_clean":"2024-06-02T23:57:32.465804+0000","last_became_active":"2024-06-02T23:57:12.137834+0000","last_became_peered":"2024-06-02T23:57:12.137834+0000","last_unstale":"2024-06-02T23:57:32.465804+0000","last_undegraded":"2024-06-02T23:57:32.465804+0000","last_fullsized":"2024-06-02T23:57:32.465804+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:00:55.812731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.321361+0000","last_change":"2024-06-02T23:57:15.324355+0000","last_active":"2024-06-02T23:57:17.321361+0000","last_peered":"2024-06-02T23:57:17.321361+0000","last_clean":"2024-06-02T23:57:17.321361+0000","last_became_active":"2024-06-02T23:57:15.324019+0000","last_became_peered":"2024-06-02T23:57:15.324019+0000","last_unstale":"2024-06-02T23:57:17.321361+0000","last_undegraded":"2024-06-02T23:57:17.321361+0000","last_fullsized":"2024-06-02T23:57:17.321361+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:27:01.927109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.315936+0000","last_change":"2024-06-02T23:57:15.326420+0000","last_active":"2024-06-02T23:57:17.315936+0000","last_peered":"2024-06-02T23:57:17.315936+0000","last_clean":"2024-06-02T23:57:17.315936+0000","last_became_active":"2024-06-02T23:57:15.326091+0000","last_became_peered":"2024-06-02T23:57:15.326091+0000","last_unstale":"2024-06-02T23:57:17.315936+0000","last_undegraded":"2024-06-02T23:57:17.315936+0000","last_fullsized":"2024-06-02T23:57:17.315936+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:54:05.355352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.334177+0000","last_change":"2024-06-02T23:57:15.326785+0000","last_active":"2024-06-02T23:57:17.334177+0000","last_peered":"2024-06-02T23:57:17.334177+0000","last_clean":"2024-06-02T23:57:17.334177+0000","last_became_active":"2024-06-02T23:57:15.326436+0000","last_became_peered":"2024-06-02T23:57:15.326436+0000","last_unstale":"2024-06-02T23:57:17.334177+0000","last_undegraded":"2024-06-02T23:57:17.334177+0000","last_fullsized":"2024-06-02T23:57:17.334177+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:18:59.231430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.333367+0000","last_change":"2024-06-02T23:57:15.319266+0000","last_active":"2024-06-02T23:57:17.333367+0000","last_peered":"2024-06-02T23:57:17.333367+0000","last_clean":"2024-06-02T23:57:17.333367+0000","last_became_active":"2024-06-02T23:57:15.317468+0000","last_became_peered":"2024-06-02T23:57:15.317468+0000","last_unstale":"2024-06-02T23:57:17.333367+0000","last_undegraded":"2024-06-02T23:57:17.333367+0000","last_fullsized":"2024-06-02T23:57:17.333367+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:49:53.675524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.334409+0000","last_change":"2024-06-02T23:57:15.315798+0000","last_active":"2024-06-02T23:57:17.334409+0000","last_peered":"2024-06-02T23:57:17.334409+0000","last_clean":"2024-06-02T23:57:17.334409+0000","last_became_active":"2024-06-02T23:57:15.314886+0000","last_became_peered":"2024-06-02T23:57:15.314886+0000","last_unstale":"2024-06-02T23:57:17.334409+0000","last_undegraded":"2024-06-02T23:57:17.334409+0000","last_fullsized":"2024-06-02T23:57:17.334409+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:23.042226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.331899+0000","last_change":"2024-06-02T23:57:15.315081+0000","last_active":"2024-06-02T23:57:17.331899+0000","last_peered":"2024-06-02T23:57:17.331899+0000","last_clean":"2024-06-02T23:57:17.331899+0000","last_became_active":"2024-06-02T23:57:15.314745+0000","last_became_peered":"2024-06-02T23:57:15.314745+0000","last_unstale":"2024-06-02T23:57:17.331899+0000","last_undegraded":"2024-06-02T23:57:17.331899+0000","last_fullsized":"2024-06-02T23:57:17.331899+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:17:49.506950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.316154+0000","last_change":"2024-06-02T23:57:15.323687+0000","last_active":"2024-06-02T23:57:17.316154+0000","last_peered":"2024-06-02T23:57:17.316154+0000","last_clean":"2024-06-02T23:57:17.316154+0000","last_became_active":"2024-06-02T23:57:15.323345+0000","last_became_peered":"2024-06-02T23:57:15.323345+0000","last_unstale":"2024-06-02T23:57:17.316154+0000","last_undegraded":"2024-06-02T23:57:17.316154+0000","last_fullsized":"2024-06-02T23:57:17.316154+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:47:40.234811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.334730+0000","last_change":"2024-06-02T23:57:15.320632+0000","last_active":"2024-06-02T23:57:17.334730+0000","last_peered":"2024-06-02T23:57:17.334730+0000","last_clean":"2024-06-02T23:57:17.334730+0000","last_became_active":"2024-06-02T23:57:15.318427+0000","last_became_peered":"2024-06-02T23:57:15.318427+0000","last_unstale":"2024-06-02T23:57:17.334730+0000","last_undegraded":"2024-06-02T23:57:17.334730+0000","last_fullsized":"2024-06-02T23:57:17.334730+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:04:51.729326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.332599+0000","last_change":"2024-06-02T23:57:15.312039+0000","last_active":"2024-06-02T23:57:17.332599+0000","last_peered":"2024-06-02T23:57:17.332599+0000","last_clean":"2024-06-02T23:57:17.332599+0000","last_became_active":"2024-06-02T23:57:15.311275+0000","last_became_peered":"2024-06-02T23:57:15.311275+0000","last_unstale":"2024-06-02T23:57:17.332599+0000","last_undegraded":"2024-06-02T23:57:17.332599+0000","last_fullsized":"2024-06-02T23:57:17.332599+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:50:25.509550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.333395+0000","last_change":"2024-06-02T23:57:15.311927+0000","last_active":"2024-06-02T23:57:17.333395+0000","last_peered":"2024-06-02T23:57:17.333395+0000","last_clean":"2024-06-02T23:57:17.333395+0000","last_became_active":"2024-06-02T23:57:15.311484+0000","last_became_peered":"2024-06-02T23:57:15.311484+0000","last_unstale":"2024-06-02T23:57:17.333395+0000","last_undegraded":"2024-06-02T23:57:17.333395+0000","last_fullsized":"2024-06-02T23:57:17.333395+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:29:27.789219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.332178+0000","last_change":"2024-06-02T23:57:15.321218+0000","last_active":"2024-06-02T23:57:17.332178+0000","last_peered":"2024-06-02T23:57:17.332178+0000","last_clean":"2024-06-02T23:57:17.332178+0000","last_became_active":"2024-06-02T23:57:15.320884+0000","last_became_peered":"2024-06-02T23:57:15.320884+0000","last_unstale":"2024-06-02T23:57:17.332178+0000","last_undegraded":"2024-06-02T23:57:17.332178+0000","last_fullsized":"2024-06-02T23:57:17.332178+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:57:20.583655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.332307+0000","last_change":"2024-06-02T23:57:15.315213+0000","last_active":"2024-06-02T23:57:17.332307+0000","last_peered":"2024-06-02T23:57:17.332307+0000","last_clean":"2024-06-02T23:57:17.332307+0000","last_became_active":"2024-06-02T23:57:15.314050+0000","last_became_peered":"2024-06-02T23:57:15.314050+0000","last_unstale":"2024-06-02T23:57:17.332307+0000","last_undegraded":"2024-06-02T23:57:17.332307+0000","last_fullsized":"2024-06-02T23:57:17.332307+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:35.214351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.331368+0000","last_change":"2024-06-02T23:57:15.313901+0000","last_active":"2024-06-02T23:57:17.331368+0000","last_peered":"2024-06-02T23:57:17.331368+0000","last_clean":"2024-06-02T23:57:17.331368+0000","last_became_active":"2024-06-02T23:57:15.313452+0000","last_became_peered":"2024-06-02T23:57:15.313452+0000","last_unstale":"2024-06-02T23:57:17.331368+0000","last_undegraded":"2024-06-02T23:57:17.331368+0000","last_fullsized":"2024-06-02T23:57:17.331368+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:41:38.366741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.315888+0000","last_change":"2024-06-02T23:57:15.323660+0000","last_active":"2024-06-02T23:57:17.315888+0000","last_peered":"2024-06-02T23:57:17.315888+0000","last_clean":"2024-06-02T23:57:17.315888+0000","last_became_active":"2024-06-02T23:57:15.323316+0000","last_became_peered":"2024-06-02T23:57:15.323316+0000","last_unstale":"2024-06-02T23:57:17.315888+0000","last_undegraded":"2024-06-02T23:57:17.315888+0000","last_fullsized":"2024-06-02T23:57:17.315888+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:33:10.245563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60669,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":263,"num_read_kb":202,"num_write":240,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":536576,"data_stored":177750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383703,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":463397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645341,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28652,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716500,"statfs":{"total":95995035648,"available":95965696000,"internally_reserved":0,"allocated":1671168,"data_stored":1116984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":987136,"data_stored":463327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070502,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":463705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332139,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28560,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716592,"statfs":{"total":95995035648,"available":95965790208,"internally_reserved":0,"allocated":1581056,"data_stored":1056222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495665,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36284,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708868,"statfs":{"total":95995035648,"available":95957880832,"internally_reserved":0,"allocated":970752,"data_stored":463044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32176,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712976,"statfs":{"total":95995035648,"available":95962087424,"internally_reserved":0,"allocated":1024000,"data_stored":517814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40464,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704688,"statfs":{"total":95995035648,"available":95953600512,"internally_reserved":0,"allocated":991232,"data_stored":464383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411397,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1040384,"data_stored":514167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182464,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":462869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920827,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":462905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757302,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28572,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716580,"statfs":{"total":95995035648,"available":95965777920,"internally_reserved":0,"allocated":1593344,"data_stored":1055900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":55609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":51962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":55593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T23:57:58.215 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-06-02T23:57:58.469 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:57:58.801 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:58 smithi049 ceph-mon[32302]: pgmap v321: 97 pgs: 97 active+clean; 636 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 2.4 KiB/s wr, 12 op/s 2024-06-02T23:57:58.801 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:57:58 smithi049 ceph-mon[32302]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T23:57:58.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:58 smithi107 ceph-mon[37048]: pgmap v321: 97 pgs: 97 active+clean; 636 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 2.4 KiB/s wr, 12 op/s 2024-06-02T23:57:58.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:57:58 smithi107 ceph-mon[37048]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T23:57:58.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:58 smithi057 ceph-mon[36457]: pgmap v321: 97 pgs: 97 active+clean; 636 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 2.4 KiB/s wr, 12 op/s 2024-06-02T23:57:58.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:57:58 smithi057 ceph-mon[36457]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T23:58:00.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.064+0000 7f64f4fab700 1 -- 172.21.15.49:0/4066707294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64f01066b0 msgr2=0x7f64f010e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:00.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.064+0000 7f64f4fab700 1 --2- 172.21.15.49:0/4066707294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64f01066b0 0x7f64f010e280 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f64e80099c0 tx=0x7f64e8009cd0 comp rx=0 tx=0).stop 2024-06-02T23:58:00.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.064+0000 7f64f4fab700 1 -- 172.21.15.49:0/4066707294 shutdown_connections 2024-06-02T23:58:00.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.064+0000 7f64f4fab700 1 --2- 172.21.15.49:0/4066707294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64f01066b0 0x7f64f010e280 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:00.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.064+0000 7f64f4fab700 1 --2- 172.21.15.49:0/4066707294 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64f0101620 0x7f64f0101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:00.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.064+0000 7f64f4fab700 1 --2- 172.21.15.49:0/4066707294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64f0101fd0 0x7f64f0105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:00.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.064+0000 7f64f4fab700 1 -- 172.21.15.49:0/4066707294 >> 172.21.15.49:0/4066707294 conn(0x7f64f0078340 msgr2=0x7f64f0078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:00.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.064+0000 7f64f4fab700 1 -- 172.21.15.49:0/4066707294 shutdown_connections 2024-06-02T23:58:00.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.064+0000 7f64f4fab700 1 -- 172.21.15.49:0/4066707294 wait complete. 2024-06-02T23:58:00.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.065+0000 7f64f4fab700 1 Processor -- start 2024-06-02T23:58:00.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.065+0000 7f64f4fab700 1 -- start start 2024-06-02T23:58:00.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.065+0000 7f64f4fab700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64f0101620 0x7f64f019e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:00.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.065+0000 7f64f4fab700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64f0101fd0 0x7f64f019ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:00.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.065+0000 7f64f4fab700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64f01066b0 0x7f64f0198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:00.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.066+0000 7f64f4fab700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f64f01116c0 con 0x7f64f0101620 2024-06-02T23:58:00.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.066+0000 7f64f4fab700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f64f0111540 con 0x7f64f0101fd0 2024-06-02T23:58:00.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.066+0000 7f64f4fab700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f64f0111840 con 0x7f64f01066b0 2024-06-02T23:58:00.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.066+0000 7f64ee59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64f0101620 0x7f64f019e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:00.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.066+0000 7f64ee59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64f0101620 0x7f64f019e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59888/0 (socket says 172.21.15.49:59888) 2024-06-02T23:58:00.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.066+0000 7f64ee59c700 1 -- 172.21.15.49:0/4002957756 learned_addr learned my addr 172.21.15.49:0/4002957756 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:58:00.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.066+0000 7f64e5d9b700 1 --2- 172.21.15.49:0/4002957756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64f0101fd0 0x7f64f019ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:00.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.066+0000 7f64eed9d700 1 --2- 172.21.15.49:0/4002957756 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64f01066b0 0x7f64f0198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:00.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.066+0000 7f64ee59c700 1 -- 172.21.15.49:0/4002957756 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64f01066b0 msgr2=0x7f64f0198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:00.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.066+0000 7f64ee59c700 1 --2- 172.21.15.49:0/4002957756 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64f01066b0 0x7f64f0198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:00.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.066+0000 7f64ee59c700 1 -- 172.21.15.49:0/4002957756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64f0101fd0 msgr2=0x7f64f019ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:00.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.066+0000 7f64ee59c700 1 --2- 172.21.15.49:0/4002957756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64f0101fd0 0x7f64f019ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:00.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.066+0000 7f64ee59c700 1 -- 172.21.15.49:0/4002957756 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64f0199230 con 0x7f64f0101620 2024-06-02T23:58:00.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.066+0000 7f64eed9d700 1 --2- 172.21.15.49:0/4002957756 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64f01066b0 0x7f64f0198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:58:00.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.066+0000 7f64ee59c700 1 --2- 172.21.15.49:0/4002957756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64f0101620 0x7f64f019e8c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f64e0007f10 tx=0x7f64e000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:00.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.066+0000 7f64e7fff700 1 -- 172.21.15.49:0/4002957756 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e000dbd0 con 0x7f64f0101620 2024-06-02T23:58:00.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.066+0000 7f64f4fab700 1 -- 172.21.15.49:0/4002957756 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64f0199520 con 0x7f64f0101620 2024-06-02T23:58:00.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.066+0000 7f64e7fff700 1 -- 172.21.15.49:0/4002957756 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f64e000dd70 con 0x7f64f0101620 2024-06-02T23:58:00.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.066+0000 7f64e7fff700 1 -- 172.21.15.49:0/4002957756 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e00133f0 con 0x7f64f0101620 2024-06-02T23:58:00.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.066+0000 7f64f4fab700 1 -- 172.21.15.49:0/4002957756 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64f01a5790 con 0x7f64f0101620 2024-06-02T23:58:00.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.068+0000 7f64f4fab700 1 -- 172.21.15.49:0/4002957756 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64f0069180 con 0x7f64f0101620 2024-06-02T23:58:00.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.069+0000 7f64e7fff700 1 -- 172.21.15.49:0/4002957756 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f64e001a020 con 0x7f64f0101620 2024-06-02T23:58:00.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.069+0000 7f64e7fff700 1 --2- 172.21.15.49:0/4002957756 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f64dc0a2cb0 0x7f64dc0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:00.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.069+0000 7f64e5d9b700 1 --2- 172.21.15.49:0/4002957756 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f64dc0a2cb0 0x7f64dc0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:00.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.069+0000 7f64e7fff700 1 -- 172.21.15.49:0/4002957756 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f64e00cea30 con 0x7f64f0101620 2024-06-02T23:58:00.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.070+0000 7f64e5d9b700 1 --2- 172.21.15.49:0/4002957756 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f64dc0a2cb0 0x7f64dc0a5170 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f64f006bc30 tx=0x7f64d800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:00.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.074+0000 7f64e7fff700 1 -- 172.21.15.49:0/4002957756 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f64e0010070 con 0x7f64f0101620 2024-06-02T23:58:00.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.278+0000 7f64f4fab700 1 -- 172.21.15.49:0/4002957756 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f64f006abc0 con 0x7f64dc0a2cb0 2024-06-02T23:58:00.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.285+0000 7f64e7fff700 1 -- 172.21.15.49:0/4002957756 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258764 (secure 0 0 0) 0x7f64f006abc0 con 0x7f64dc0a2cb0 2024-06-02T23:58:00.288 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:58:00.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.289+0000 7f64f4fab700 1 -- 172.21.15.49:0/4002957756 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f64dc0a2cb0 msgr2=0x7f64dc0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:00.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.289+0000 7f64f4fab700 1 --2- 172.21.15.49:0/4002957756 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f64dc0a2cb0 0x7f64dc0a5170 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f64f006bc30 tx=0x7f64d800a300 comp rx=0 tx=0).stop 2024-06-02T23:58:00.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.289+0000 7f64f4fab700 1 -- 172.21.15.49:0/4002957756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64f0101620 msgr2=0x7f64f019e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:00.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.289+0000 7f64f4fab700 1 --2- 172.21.15.49:0/4002957756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64f0101620 0x7f64f019e8c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f64e0007f10 tx=0x7f64e000d3b0 comp rx=0 tx=0).stop 2024-06-02T23:58:00.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.290+0000 7f64f4fab700 1 -- 172.21.15.49:0/4002957756 shutdown_connections 2024-06-02T23:58:00.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.290+0000 7f64f4fab700 1 --2- 172.21.15.49:0/4002957756 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f64dc0a2cb0 0x7f64dc0a5170 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:00.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.290+0000 7f64f4fab700 1 --2- 172.21.15.49:0/4002957756 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64f01066b0 0x7f64f0198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:00.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.290+0000 7f64f4fab700 1 --2- 172.21.15.49:0/4002957756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64f0101620 0x7f64f019e8c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:00.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.290+0000 7f64f4fab700 1 --2- 172.21.15.49:0/4002957756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64f0101fd0 0x7f64f019ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:00.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.290+0000 7f64f4fab700 1 -- 172.21.15.49:0/4002957756 >> 172.21.15.49:0/4002957756 conn(0x7f64f0078340 msgr2=0x7f64f0105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:00.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.290+0000 7f64f4fab700 1 -- 172.21.15.49:0/4002957756 shutdown_connections 2024-06-02T23:58:00.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:00.290+0000 7f64f4fab700 1 -- 172.21.15.49:0/4002957756 wait complete. 2024-06-02T23:58:00.291 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-06-02T23:58:00.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:00 smithi107 ceph-mon[37048]: pgmap v322: 97 pgs: 97 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 2.0 KiB/s wr, 12 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-06-02T23:58:00.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:00 smithi057 ceph-mon[36457]: pgmap v322: 97 pgs: 97 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 2.0 KiB/s wr, 12 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-06-02T23:58:00.954 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:00 smithi049 ceph-mon[32302]: pgmap v322: 97 pgs: 97 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 2.0 KiB/s wr, 12 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-06-02T23:58:00.984 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":322,"stamp":"2024-06-02T23:57:59.248659+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651271,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":407,"num_read_kb":314,"num_write":423,"num_write_kb":3066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1180736,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":345,"ondisk_log_size":345,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":293,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375432,"kb_used_data":13740,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124566392,"statfs":{"total":1151940427776,"available":1151555985408,"internally_reserved":0,"allocated":14069760,"data_stored":7670473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":12795,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":71,"num_write":7,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001757"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.530543+0000","last_change":"2024-06-02T23:57:15.321542+0000","last_active":"2024-06-02T23:57:56.530543+0000","last_peered":"2024-06-02T23:57:56.530543+0000","last_clean":"2024-06-02T23:57:56.530543+0000","last_became_active":"2024-06-02T23:57:15.321129+0000","last_became_peered":"2024-06-02T23:57:15.321129+0000","last_unstale":"2024-06-02T23:57:56.530543+0000","last_undegraded":"2024-06-02T23:57:56.530543+0000","last_fullsized":"2024-06-02T23:57:56.530543+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:35:50.218316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.887576+0000","last_change":"2024-06-02T23:57:15.327432+0000","last_active":"2024-06-02T23:57:56.887576+0000","last_peered":"2024-06-02T23:57:56.887576+0000","last_clean":"2024-06-02T23:57:56.887576+0000","last_became_active":"2024-06-02T23:57:15.326759+0000","last_became_peered":"2024-06-02T23:57:15.326759+0000","last_unstale":"2024-06-02T23:57:56.887576+0000","last_undegraded":"2024-06-02T23:57:56.887576+0000","last_fullsized":"2024-06-02T23:57:56.887576+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:42:20.473216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.887558+0000","last_change":"2024-06-02T23:57:15.323721+0000","last_active":"2024-06-02T23:57:56.887558+0000","last_peered":"2024-06-02T23:57:56.887558+0000","last_clean":"2024-06-02T23:57:56.887558+0000","last_became_active":"2024-06-02T23:57:15.321277+0000","last_became_peered":"2024-06-02T23:57:15.321277+0000","last_unstale":"2024-06-02T23:57:56.887558+0000","last_undegraded":"2024-06-02T23:57:56.887558+0000","last_fullsized":"2024-06-02T23:57:56.887558+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:34:31.667999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.652160+0000","last_change":"2024-06-02T23:57:15.323769+0000","last_active":"2024-06-02T23:57:56.652160+0000","last_peered":"2024-06-02T23:57:56.652160+0000","last_clean":"2024-06-02T23:57:56.652160+0000","last_became_active":"2024-06-02T23:57:15.323406+0000","last_became_peered":"2024-06-02T23:57:15.323406+0000","last_unstale":"2024-06-02T23:57:56.652160+0000","last_undegraded":"2024-06-02T23:57:56.652160+0000","last_fullsized":"2024-06-02T23:57:56.652160+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:51:27.456210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.531404+0000","last_change":"2024-06-02T23:57:56.531404+0000","last_active":"2024-06-02T23:57:56.531404+0000","last_peered":"2024-06-02T23:57:56.531404+0000","last_clean":"2024-06-02T23:57:56.531404+0000","last_became_active":"2024-06-02T23:57:56.530952+0000","last_became_peered":"2024-06-02T23:57:56.530952+0000","last_unstale":"2024-06-02T23:57:56.531404+0000","last_undegraded":"2024-06-02T23:57:56.531404+0000","last_fullsized":"2024-06-02T23:57:56.531404+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:39:30.405113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.735964+0000","last_change":"2024-06-02T23:57:15.320843+0000","last_active":"2024-06-02T23:57:56.735964+0000","last_peered":"2024-06-02T23:57:56.735964+0000","last_clean":"2024-06-02T23:57:56.735964+0000","last_became_active":"2024-06-02T23:57:15.320472+0000","last_became_peered":"2024-06-02T23:57:15.320472+0000","last_unstale":"2024-06-02T23:57:56.735964+0000","last_undegraded":"2024-06-02T23:57:56.735964+0000","last_fullsized":"2024-06-02T23:57:56.735964+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:49:02.620777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.320674+0000","last_change":"2024-06-02T23:57:15.321799+0000","last_active":"2024-06-02T23:57:17.320674+0000","last_peered":"2024-06-02T23:57:17.320674+0000","last_clean":"2024-06-02T23:57:17.320674+0000","last_became_active":"2024-06-02T23:57:15.321379+0000","last_became_peered":"2024-06-02T23:57:15.321379+0000","last_unstale":"2024-06-02T23:57:17.320674+0000","last_undegraded":"2024-06-02T23:57:17.320674+0000","last_fullsized":"2024-06-02T23:57:17.320674+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:36:56.404936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.525945+0000","last_change":"2024-06-02T23:57:15.318771+0000","last_active":"2024-06-02T23:57:56.525945+0000","last_peered":"2024-06-02T23:57:56.525945+0000","last_clean":"2024-06-02T23:57:56.525945+0000","last_became_active":"2024-06-02T23:57:15.318420+0000","last_became_peered":"2024-06-02T23:57:15.318420+0000","last_unstale":"2024-06-02T23:57:56.525945+0000","last_undegraded":"2024-06-02T23:57:56.525945+0000","last_fullsized":"2024-06-02T23:57:56.525945+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:07:53.769443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.888611+0000","last_change":"2024-06-02T23:57:15.318989+0000","last_active":"2024-06-02T23:57:56.888611+0000","last_peered":"2024-06-02T23:57:56.888611+0000","last_clean":"2024-06-02T23:57:56.888611+0000","last_became_active":"2024-06-02T23:57:15.318424+0000","last_became_peered":"2024-06-02T23:57:15.318424+0000","last_unstale":"2024-06-02T23:57:56.888611+0000","last_undegraded":"2024-06-02T23:57:56.888611+0000","last_fullsized":"2024-06-02T23:57:56.888611+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:30:47.634662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.736257+0000","last_change":"2024-06-02T23:57:15.326251+0000","last_active":"2024-06-02T23:57:56.736257+0000","last_peered":"2024-06-02T23:57:56.736257+0000","last_clean":"2024-06-02T23:57:56.736257+0000","last_became_active":"2024-06-02T23:57:15.325890+0000","last_became_peered":"2024-06-02T23:57:15.325890+0000","last_unstale":"2024-06-02T23:57:56.736257+0000","last_undegraded":"2024-06-02T23:57:56.736257+0000","last_fullsized":"2024-06-02T23:57:56.736257+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:18:54.871410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.320986+0000","last_change":"2024-06-02T23:57:15.325364+0000","last_active":"2024-06-02T23:57:17.320986+0000","last_peered":"2024-06-02T23:57:17.320986+0000","last_clean":"2024-06-02T23:57:17.320986+0000","last_became_active":"2024-06-02T23:57:15.324987+0000","last_became_peered":"2024-06-02T23:57:15.324987+0000","last_unstale":"2024-06-02T23:57:17.320986+0000","last_undegraded":"2024-06-02T23:57:17.320986+0000","last_fullsized":"2024-06-02T23:57:17.320986+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:59:11.827263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.652016+0000","last_change":"2024-06-02T23:57:15.328027+0000","last_active":"2024-06-02T23:57:56.652016+0000","last_peered":"2024-06-02T23:57:56.652016+0000","last_clean":"2024-06-02T23:57:56.652016+0000","last_became_active":"2024-06-02T23:57:15.327608+0000","last_became_peered":"2024-06-02T23:57:15.327608+0000","last_unstale":"2024-06-02T23:57:56.652016+0000","last_undegraded":"2024-06-02T23:57:56.652016+0000","last_fullsized":"2024-06-02T23:57:56.652016+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:09:42.152689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.524024+0000","last_change":"2024-06-02T23:57:15.323095+0000","last_active":"2024-06-02T23:57:56.524024+0000","last_peered":"2024-06-02T23:57:56.524024+0000","last_clean":"2024-06-02T23:57:56.524024+0000","last_became_active":"2024-06-02T23:57:15.322755+0000","last_became_peered":"2024-06-02T23:57:15.322755+0000","last_unstale":"2024-06-02T23:57:56.524024+0000","last_undegraded":"2024-06-02T23:57:56.524024+0000","last_fullsized":"2024-06-02T23:57:56.524024+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:43:53.195192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.887430+0000","last_change":"2024-06-02T23:57:15.327437+0000","last_active":"2024-06-02T23:57:56.887430+0000","last_peered":"2024-06-02T23:57:56.887430+0000","last_clean":"2024-06-02T23:57:56.887430+0000","last_became_active":"2024-06-02T23:57:15.326974+0000","last_became_peered":"2024-06-02T23:57:15.326974+0000","last_unstale":"2024-06-02T23:57:56.887430+0000","last_undegraded":"2024-06-02T23:57:56.887430+0000","last_fullsized":"2024-06-02T23:57:56.887430+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:20:44.978213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.887391+0000","last_change":"2024-06-02T23:57:15.325414+0000","last_active":"2024-06-02T23:57:56.887391+0000","last_peered":"2024-06-02T23:57:56.887391+0000","last_clean":"2024-06-02T23:57:56.887391+0000","last_became_active":"2024-06-02T23:57:15.325033+0000","last_became_peered":"2024-06-02T23:57:15.325033+0000","last_unstale":"2024-06-02T23:57:56.887391+0000","last_undegraded":"2024-06-02T23:57:56.887391+0000","last_fullsized":"2024-06-02T23:57:56.887391+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:27:14.536646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.887849+0000","last_change":"2024-06-02T23:57:15.315833+0000","last_active":"2024-06-02T23:57:56.887849+0000","last_peered":"2024-06-02T23:57:56.887849+0000","last_clean":"2024-06-02T23:57:56.887849+0000","last_became_active":"2024-06-02T23:57:15.315355+0000","last_became_peered":"2024-06-02T23:57:15.315355+0000","last_unstale":"2024-06-02T23:57:56.887849+0000","last_undegraded":"2024-06-02T23:57:56.887849+0000","last_fullsized":"2024-06-02T23:57:56.887849+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:52:05.915828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.530794+0000","last_change":"2024-06-02T23:57:15.322407+0000","last_active":"2024-06-02T23:57:56.530794+0000","last_peered":"2024-06-02T23:57:56.530794+0000","last_clean":"2024-06-02T23:57:56.530794+0000","last_became_active":"2024-06-02T23:57:15.322090+0000","last_became_peered":"2024-06-02T23:57:15.322090+0000","last_unstale":"2024-06-02T23:57:56.530794+0000","last_undegraded":"2024-06-02T23:57:56.530794+0000","last_fullsized":"2024-06-02T23:57:56.530794+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:08:48.071192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.315369+0000","last_change":"2024-06-02T23:57:15.327331+0000","last_active":"2024-06-02T23:57:17.315369+0000","last_peered":"2024-06-02T23:57:17.315369+0000","last_clean":"2024-06-02T23:57:17.315369+0000","last_became_active":"2024-06-02T23:57:15.326863+0000","last_became_peered":"2024-06-02T23:57:15.326863+0000","last_unstale":"2024-06-02T23:57:17.315369+0000","last_undegraded":"2024-06-02T23:57:17.315369+0000","last_fullsized":"2024-06-02T23:57:17.315369+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:45:05.443751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527462+0000","last_change":"2024-06-02T23:57:15.313008+0000","last_active":"2024-06-02T23:57:56.527462+0000","last_peered":"2024-06-02T23:57:56.527462+0000","last_clean":"2024-06-02T23:57:56.527462+0000","last_became_active":"2024-06-02T23:57:15.312322+0000","last_became_peered":"2024-06-02T23:57:15.312322+0000","last_unstale":"2024-06-02T23:57:56.527462+0000","last_undegraded":"2024-06-02T23:57:56.527462+0000","last_fullsized":"2024-06-02T23:57:56.527462+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:54:03.744964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":57,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:53.184856+0000","last_change":"2024-06-02T23:57:12.153410+0000","last_active":"2024-06-02T23:57:53.184856+0000","last_peered":"2024-06-02T23:57:53.184856+0000","last_clean":"2024-06-02T23:57:53.184856+0000","last_became_active":"2024-06-02T23:57:12.153065+0000","last_became_peered":"2024-06-02T23:57:12.153065+0000","last_unstale":"2024-06-02T23:57:53.184856+0000","last_undegraded":"2024-06-02T23:57:53.184856+0000","last_fullsized":"2024-06-02T23:57:53.184856+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:45:30.058961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526897+0000","last_change":"2024-06-02T23:57:15.314168+0000","last_active":"2024-06-02T23:57:56.526897+0000","last_peered":"2024-06-02T23:57:56.526897+0000","last_clean":"2024-06-02T23:57:56.526897+0000","last_became_active":"2024-06-02T23:57:15.313838+0000","last_became_peered":"2024-06-02T23:57:15.313838+0000","last_unstale":"2024-06-02T23:57:56.526897+0000","last_undegraded":"2024-06-02T23:57:56.526897+0000","last_fullsized":"2024-06-02T23:57:56.526897+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:56:14.137471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526679+0000","last_change":"2024-06-02T23:57:12.305448+0000","last_active":"2024-06-02T23:57:56.526679+0000","last_peered":"2024-06-02T23:57:56.526679+0000","last_clean":"2024-06-02T23:57:56.526679+0000","last_became_active":"2024-06-02T23:57:12.305080+0000","last_became_peered":"2024-06-02T23:57:12.305080+0000","last_unstale":"2024-06-02T23:57:56.526679+0000","last_undegraded":"2024-06-02T23:57:56.526679+0000","last_fullsized":"2024-06-02T23:57:56.526679+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:20:18.660943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.887818+0000","last_change":"2024-06-02T23:57:15.321660+0000","last_active":"2024-06-02T23:57:56.887818+0000","last_peered":"2024-06-02T23:57:56.887818+0000","last_clean":"2024-06-02T23:57:56.887818+0000","last_became_active":"2024-06-02T23:57:15.321304+0000","last_became_peered":"2024-06-02T23:57:15.321304+0000","last_unstale":"2024-06-02T23:57:56.887818+0000","last_undegraded":"2024-06-02T23:57:56.887818+0000","last_fullsized":"2024-06-02T23:57:56.887818+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:10:10.933291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.544868+0000","last_change":"2024-06-02T23:57:56.544458+0000","last_active":"2024-06-02T23:57:56.544868+0000","last_peered":"2024-06-02T23:57:56.544868+0000","last_clean":"2024-06-02T23:57:56.544868+0000","last_became_active":"2024-06-02T23:57:56.532838+0000","last_became_peered":"2024-06-02T23:57:56.532838+0000","last_unstale":"2024-06-02T23:57:56.544868+0000","last_undegraded":"2024-06-02T23:57:56.544868+0000","last_fullsized":"2024-06-02T23:57:56.544868+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:27:44.700493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.887994+0000","last_change":"2024-06-02T23:57:15.328944+0000","last_active":"2024-06-02T23:57:56.887994+0000","last_peered":"2024-06-02T23:57:56.887994+0000","last_clean":"2024-06-02T23:57:56.887994+0000","last_became_active":"2024-06-02T23:57:15.328531+0000","last_became_peered":"2024-06-02T23:57:15.328531+0000","last_unstale":"2024-06-02T23:57:56.887994+0000","last_undegraded":"2024-06-02T23:57:56.887994+0000","last_fullsized":"2024-06-02T23:57:56.887994+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:48:19.709989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528340+0000","last_change":"2024-06-02T23:57:12.153967+0000","last_active":"2024-06-02T23:57:56.528340+0000","last_peered":"2024-06-02T23:57:56.528340+0000","last_clean":"2024-06-02T23:57:56.528340+0000","last_became_active":"2024-06-02T23:57:12.153600+0000","last_became_peered":"2024-06-02T23:57:12.153600+0000","last_unstale":"2024-06-02T23:57:56.528340+0000","last_undegraded":"2024-06-02T23:57:56.528340+0000","last_fullsized":"2024-06-02T23:57:56.528340+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:47:58.761573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.525991+0000","last_change":"2024-06-02T23:57:15.318089+0000","last_active":"2024-06-02T23:57:56.525991+0000","last_peered":"2024-06-02T23:57:56.525991+0000","last_clean":"2024-06-02T23:57:56.525991+0000","last_became_active":"2024-06-02T23:57:15.316494+0000","last_became_peered":"2024-06-02T23:57:15.316494+0000","last_unstale":"2024-06-02T23:57:56.525991+0000","last_undegraded":"2024-06-02T23:57:56.525991+0000","last_fullsized":"2024-06-02T23:57:56.525991+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:21:15.839255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'6","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:57.191899+0000","last_change":"2024-06-02T23:57:12.153624+0000","last_active":"2024-06-02T23:57:57.191899+0000","last_peered":"2024-06-02T23:57:57.191899+0000","last_clean":"2024-06-02T23:57:57.191899+0000","last_became_active":"2024-06-02T23:57:12.152712+0000","last_became_peered":"2024-06-02T23:57:12.152712+0000","last_unstale":"2024-06-02T23:57:57.191899+0000","last_undegraded":"2024-06-02T23:57:57.191899+0000","last_fullsized":"2024-06-02T23:57:57.191899+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:14:50.236213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527933+0000","last_change":"2024-06-02T23:57:15.325293+0000","last_active":"2024-06-02T23:57:56.527933+0000","last_peered":"2024-06-02T23:57:56.527933+0000","last_clean":"2024-06-02T23:57:56.527933+0000","last_became_active":"2024-06-02T23:57:15.324967+0000","last_became_peered":"2024-06-02T23:57:15.324967+0000","last_unstale":"2024-06-02T23:57:56.527933+0000","last_undegraded":"2024-06-02T23:57:56.527933+0000","last_fullsized":"2024-06-02T23:57:56.527933+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:21:23.634118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.735901+0000","last_change":"2024-06-02T23:57:12.155927+0000","last_active":"2024-06-02T23:57:56.735901+0000","last_peered":"2024-06-02T23:57:56.735901+0000","last_clean":"2024-06-02T23:57:56.735901+0000","last_became_active":"2024-06-02T23:57:12.155505+0000","last_became_peered":"2024-06-02T23:57:12.155505+0000","last_unstale":"2024-06-02T23:57:56.735901+0000","last_undegraded":"2024-06-02T23:57:56.735901+0000","last_fullsized":"2024-06-02T23:57:56.735901+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:47.555747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.525626+0000","last_change":"2024-06-02T23:57:15.321796+0000","last_active":"2024-06-02T23:57:56.525626+0000","last_peered":"2024-06-02T23:57:56.525626+0000","last_clean":"2024-06-02T23:57:56.525626+0000","last_became_active":"2024-06-02T23:57:15.320850+0000","last_became_peered":"2024-06-02T23:57:15.320850+0000","last_unstale":"2024-06-02T23:57:56.525626+0000","last_undegraded":"2024-06-02T23:57:56.525626+0000","last_fullsized":"2024-06-02T23:57:56.525626+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:04:10.991920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.523804+0000","last_change":"2024-06-02T23:57:12.146589+0000","last_active":"2024-06-02T23:57:56.523804+0000","last_peered":"2024-06-02T23:57:56.523804+0000","last_clean":"2024-06-02T23:57:56.523804+0000","last_became_active":"2024-06-02T23:57:12.146224+0000","last_became_peered":"2024-06-02T23:57:12.146224+0000","last_unstale":"2024-06-02T23:57:56.523804+0000","last_undegraded":"2024-06-02T23:57:56.523804+0000","last_fullsized":"2024-06-02T23:57:56.523804+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:17:31.250585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.525904+0000","last_change":"2024-06-02T23:57:15.315553+0000","last_active":"2024-06-02T23:57:56.525904+0000","last_peered":"2024-06-02T23:57:56.525904+0000","last_clean":"2024-06-02T23:57:56.525904+0000","last_became_active":"2024-06-02T23:57:15.315217+0000","last_became_peered":"2024-06-02T23:57:15.315217+0000","last_unstale":"2024-06-02T23:57:56.525904+0000","last_undegraded":"2024-06-02T23:57:56.525904+0000","last_fullsized":"2024-06-02T23:57:56.525904+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:00:23.097949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.525090+0000","last_change":"2024-06-02T23:57:12.156971+0000","last_active":"2024-06-02T23:57:56.525090+0000","last_peered":"2024-06-02T23:57:56.525090+0000","last_clean":"2024-06-02T23:57:56.525090+0000","last_became_active":"2024-06-02T23:57:12.156379+0000","last_became_peered":"2024-06-02T23:57:12.156379+0000","last_unstale":"2024-06-02T23:57:56.525090+0000","last_undegraded":"2024-06-02T23:57:56.525090+0000","last_fullsized":"2024-06-02T23:57:56.525090+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:28:50.057736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.315110+0000","last_change":"2024-06-02T23:57:15.313985+0000","last_active":"2024-06-02T23:57:17.315110+0000","last_peered":"2024-06-02T23:57:17.315110+0000","last_clean":"2024-06-02T23:57:17.315110+0000","last_became_active":"2024-06-02T23:57:15.313668+0000","last_became_peered":"2024-06-02T23:57:15.313668+0000","last_unstale":"2024-06-02T23:57:17.315110+0000","last_undegraded":"2024-06-02T23:57:17.315110+0000","last_fullsized":"2024-06-02T23:57:17.315110+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:10:56.560660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'4","reported_seq":78,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.736277+0000","last_change":"2024-06-02T23:57:12.156025+0000","last_active":"2024-06-02T23:57:56.736277+0000","last_peered":"2024-06-02T23:57:56.736277+0000","last_clean":"2024-06-02T23:57:56.736277+0000","last_became_active":"2024-06-02T23:57:12.155609+0000","last_became_peered":"2024-06-02T23:57:12.155609+0000","last_unstale":"2024-06-02T23:57:56.736277+0000","last_undegraded":"2024-06-02T23:57:56.736277+0000","last_fullsized":"2024-06-02T23:57:56.736277+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:27:48.953456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.888652+0000","last_change":"2024-06-02T23:57:15.329711+0000","last_active":"2024-06-02T23:57:56.888652+0000","last_peered":"2024-06-02T23:57:56.888652+0000","last_clean":"2024-06-02T23:57:56.888652+0000","last_became_active":"2024-06-02T23:57:15.329284+0000","last_became_peered":"2024-06-02T23:57:15.329284+0000","last_unstale":"2024-06-02T23:57:56.888652+0000","last_undegraded":"2024-06-02T23:57:56.888652+0000","last_fullsized":"2024-06-02T23:57:56.888652+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:58:06.165152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:32.468198+0000","last_change":"2024-06-02T23:57:12.156949+0000","last_active":"2024-06-02T23:57:32.468198+0000","last_peered":"2024-06-02T23:57:32.468198+0000","last_clean":"2024-06-02T23:57:32.468198+0000","last_became_active":"2024-06-02T23:57:12.156558+0000","last_became_peered":"2024-06-02T23:57:12.156558+0000","last_unstale":"2024-06-02T23:57:32.468198+0000","last_undegraded":"2024-06-02T23:57:32.468198+0000","last_fullsized":"2024-06-02T23:57:32.468198+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:05:57.658900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.887794+0000","last_change":"2024-06-02T23:57:15.318638+0000","last_active":"2024-06-02T23:57:56.887794+0000","last_peered":"2024-06-02T23:57:56.887794+0000","last_clean":"2024-06-02T23:57:56.887794+0000","last_became_active":"2024-06-02T23:57:15.318321+0000","last_became_peered":"2024-06-02T23:57:15.318321+0000","last_unstale":"2024-06-02T23:57:56.887794+0000","last_undegraded":"2024-06-02T23:57:56.887794+0000","last_fullsized":"2024-06-02T23:57:56.887794+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:21:57.877235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526095+0000","last_change":"2024-06-02T23:57:12.306278+0000","last_active":"2024-06-02T23:57:56.526095+0000","last_peered":"2024-06-02T23:57:56.526095+0000","last_clean":"2024-06-02T23:57:56.526095+0000","last_became_active":"2024-06-02T23:57:12.305885+0000","last_became_peered":"2024-06-02T23:57:12.305885+0000","last_unstale":"2024-06-02T23:57:56.526095+0000","last_undegraded":"2024-06-02T23:57:56.526095+0000","last_fullsized":"2024-06-02T23:57:56.526095+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:05:07.723501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.888102+0000","last_change":"2024-06-02T23:57:15.322489+0000","last_active":"2024-06-02T23:57:56.888102+0000","last_peered":"2024-06-02T23:57:56.888102+0000","last_clean":"2024-06-02T23:57:56.888102+0000","last_became_active":"2024-06-02T23:57:15.322131+0000","last_became_peered":"2024-06-02T23:57:15.322131+0000","last_unstale":"2024-06-02T23:57:56.888102+0000","last_undegraded":"2024-06-02T23:57:56.888102+0000","last_fullsized":"2024-06-02T23:57:56.888102+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:34:43.362338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'28","reported_seq":110,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.736040+0000","last_change":"2024-06-02T23:57:12.156920+0000","last_active":"2024-06-02T23:57:56.736040+0000","last_peered":"2024-06-02T23:57:56.736040+0000","last_clean":"2024-06-02T23:57:56.736040+0000","last_became_active":"2024-06-02T23:57:12.156494+0000","last_became_peered":"2024-06-02T23:57:12.156494+0000","last_unstale":"2024-06-02T23:57:56.736040+0000","last_undegraded":"2024-06-02T23:57:56.736040+0000","last_fullsized":"2024-06-02T23:57:56.736040+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:49:56.458730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53857,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":56,"num_read_kb":80,"num_write":30,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527868+0000","last_change":"2024-06-02T23:57:15.328502+0000","last_active":"2024-06-02T23:57:56.527868+0000","last_peered":"2024-06-02T23:57:56.527868+0000","last_clean":"2024-06-02T23:57:56.527868+0000","last_became_active":"2024-06-02T23:57:15.328174+0000","last_became_peered":"2024-06-02T23:57:15.328174+0000","last_unstale":"2024-06-02T23:57:56.527868+0000","last_undegraded":"2024-06-02T23:57:56.527868+0000","last_fullsized":"2024-06-02T23:57:56.527868+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:58:33.355397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527324+0000","last_change":"2024-06-02T23:57:12.154204+0000","last_active":"2024-06-02T23:57:56.527324+0000","last_peered":"2024-06-02T23:57:56.527324+0000","last_clean":"2024-06-02T23:57:56.527324+0000","last_became_active":"2024-06-02T23:57:12.153412+0000","last_became_peered":"2024-06-02T23:57:12.153412+0000","last_unstale":"2024-06-02T23:57:56.527324+0000","last_undegraded":"2024-06-02T23:57:56.527324+0000","last_fullsized":"2024-06-02T23:57:56.527324+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:15.472279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.523785+0000","last_change":"2024-06-02T23:57:15.314274+0000","last_active":"2024-06-02T23:57:56.523785+0000","last_peered":"2024-06-02T23:57:56.523785+0000","last_clean":"2024-06-02T23:57:56.523785+0000","last_became_active":"2024-06-02T23:57:15.313946+0000","last_became_peered":"2024-06-02T23:57:15.313946+0000","last_unstale":"2024-06-02T23:57:56.523785+0000","last_undegraded":"2024-06-02T23:57:56.523785+0000","last_fullsized":"2024-06-02T23:57:56.523785+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:07.909977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.525155+0000","last_change":"2024-06-02T23:57:12.156767+0000","last_active":"2024-06-02T23:57:56.525155+0000","last_peered":"2024-06-02T23:57:56.525155+0000","last_clean":"2024-06-02T23:57:56.525155+0000","last_became_active":"2024-06-02T23:57:12.156346+0000","last_became_peered":"2024-06-02T23:57:12.156346+0000","last_unstale":"2024-06-02T23:57:56.525155+0000","last_undegraded":"2024-06-02T23:57:56.525155+0000","last_fullsized":"2024-06-02T23:57:56.525155+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:29:45.801904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.320999+0000","last_change":"2024-06-02T23:57:15.322676+0000","last_active":"2024-06-02T23:57:17.320999+0000","last_peered":"2024-06-02T23:57:17.320999+0000","last_clean":"2024-06-02T23:57:17.320999+0000","last_became_active":"2024-06-02T23:57:15.319429+0000","last_became_peered":"2024-06-02T23:57:15.319429+0000","last_unstale":"2024-06-02T23:57:17.320999+0000","last_undegraded":"2024-06-02T23:57:17.320999+0000","last_fullsized":"2024-06-02T23:57:17.320999+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:48:15.984818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'5","reported_seq":60,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:58.199197+0000","last_change":"2024-06-02T23:57:12.153925+0000","last_active":"2024-06-02T23:57:58.199197+0000","last_peered":"2024-06-02T23:57:58.199197+0000","last_clean":"2024-06-02T23:57:58.199197+0000","last_became_active":"2024-06-02T23:57:12.152990+0000","last_became_peered":"2024-06-02T23:57:12.152990+0000","last_unstale":"2024-06-02T23:57:58.199197+0000","last_undegraded":"2024-06-02T23:57:58.199197+0000","last_fullsized":"2024-06-02T23:57:58.199197+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:32:21.845946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.320550+0000","last_change":"2024-06-02T23:57:15.327662+0000","last_active":"2024-06-02T23:57:17.320550+0000","last_peered":"2024-06-02T23:57:17.320550+0000","last_clean":"2024-06-02T23:57:17.320550+0000","last_became_active":"2024-06-02T23:57:15.327320+0000","last_became_peered":"2024-06-02T23:57:15.327320+0000","last_unstale":"2024-06-02T23:57:17.320550+0000","last_undegraded":"2024-06-02T23:57:17.320550+0000","last_fullsized":"2024-06-02T23:57:17.320550+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:44:37.561533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528365+0000","last_change":"2024-06-02T23:57:12.306856+0000","last_active":"2024-06-02T23:57:56.528365+0000","last_peered":"2024-06-02T23:57:56.528365+0000","last_clean":"2024-06-02T23:57:56.528365+0000","last_became_active":"2024-06-02T23:57:12.306476+0000","last_became_peered":"2024-06-02T23:57:12.306476+0000","last_unstale":"2024-06-02T23:57:56.528365+0000","last_undegraded":"2024-06-02T23:57:56.528365+0000","last_fullsized":"2024-06-02T23:57:56.528365+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:30:22.839589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.890015+0000","last_change":"2024-06-02T23:57:56.890015+0000","last_active":"2024-06-02T23:57:56.890015+0000","last_peered":"2024-06-02T23:57:56.890015+0000","last_clean":"2024-06-02T23:57:56.890015+0000","last_became_active":"2024-06-02T23:57:56.889591+0000","last_became_peered":"2024-06-02T23:57:56.889591+0000","last_unstale":"2024-06-02T23:57:56.890015+0000","last_undegraded":"2024-06-02T23:57:56.890015+0000","last_fullsized":"2024-06-02T23:57:56.890015+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:14:37.851207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528059+0000","last_change":"2024-06-02T23:57:12.146690+0000","last_active":"2024-06-02T23:57:56.528059+0000","last_peered":"2024-06-02T23:57:56.528059+0000","last_clean":"2024-06-02T23:57:56.528059+0000","last_became_active":"2024-06-02T23:57:12.146372+0000","last_became_peered":"2024-06-02T23:57:12.146372+0000","last_unstale":"2024-06-02T23:57:56.528059+0000","last_undegraded":"2024-06-02T23:57:56.528059+0000","last_fullsized":"2024-06-02T23:57:56.528059+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:45:04.421365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.530330+0000","last_change":"2024-06-02T23:57:15.320938+0000","last_active":"2024-06-02T23:57:56.530330+0000","last_peered":"2024-06-02T23:57:56.530330+0000","last_clean":"2024-06-02T23:57:56.530330+0000","last_became_active":"2024-06-02T23:57:15.320567+0000","last_became_peered":"2024-06-02T23:57:15.320567+0000","last_unstale":"2024-06-02T23:57:56.530330+0000","last_undegraded":"2024-06-02T23:57:56.530330+0000","last_fullsized":"2024-06-02T23:57:56.530330+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:04:29.736387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"88'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.315396+0000","last_change":"2024-06-02T23:57:12.307020+0000","last_active":"2024-06-02T23:57:17.315396+0000","last_peered":"2024-06-02T23:57:17.315396+0000","last_clean":"2024-06-02T23:57:17.315396+0000","last_became_active":"2024-06-02T23:57:12.306650+0000","last_became_peered":"2024-06-02T23:57:12.306650+0000","last_unstale":"2024-06-02T23:57:17.315396+0000","last_undegraded":"2024-06-02T23:57:17.315396+0000","last_fullsized":"2024-06-02T23:57:17.315396+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:18:03.679704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'1","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.736095+0000","last_change":"2024-06-02T23:57:15.319300+0000","last_active":"2024-06-02T23:57:56.736095+0000","last_peered":"2024-06-02T23:57:56.736095+0000","last_clean":"2024-06-02T23:57:56.736095+0000","last_became_active":"2024-06-02T23:57:15.318903+0000","last_became_peered":"2024-06-02T23:57:15.318903+0000","last_unstale":"2024-06-02T23:57:56.736095+0000","last_undegraded":"2024-06-02T23:57:56.736095+0000","last_fullsized":"2024-06-02T23:57:56.736095+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:38:25.521337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:53.185408+0000","last_change":"2024-06-02T23:57:12.155260+0000","last_active":"2024-06-02T23:57:53.185408+0000","last_peered":"2024-06-02T23:57:53.185408+0000","last_clean":"2024-06-02T23:57:53.185408+0000","last_became_active":"2024-06-02T23:57:12.154884+0000","last_became_peered":"2024-06-02T23:57:12.154884+0000","last_unstale":"2024-06-02T23:57:53.185408+0000","last_undegraded":"2024-06-02T23:57:53.185408+0000","last_fullsized":"2024-06-02T23:57:53.185408+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:34:52.390752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.736008+0000","last_change":"2024-06-02T23:57:15.323490+0000","last_active":"2024-06-02T23:57:56.736008+0000","last_peered":"2024-06-02T23:57:56.736008+0000","last_clean":"2024-06-02T23:57:56.736008+0000","last_became_active":"2024-06-02T23:57:15.323142+0000","last_became_peered":"2024-06-02T23:57:15.323142+0000","last_unstale":"2024-06-02T23:57:56.736008+0000","last_undegraded":"2024-06-02T23:57:56.736008+0000","last_fullsized":"2024-06-02T23:57:56.736008+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:32:32.445823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.531715+0000","last_change":"2024-06-02T23:57:56.531715+0000","last_active":"2024-06-02T23:57:56.531715+0000","last_peered":"2024-06-02T23:57:56.531715+0000","last_clean":"2024-06-02T23:57:56.531715+0000","last_became_active":"2024-06-02T23:57:56.531304+0000","last_became_peered":"2024-06-02T23:57:56.531304+0000","last_unstale":"2024-06-02T23:57:56.531715+0000","last_undegraded":"2024-06-02T23:57:56.531715+0000","last_fullsized":"2024-06-02T23:57:56.531715+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:58:02.532206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":58,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:57.196946+0000","last_change":"2024-06-02T23:57:12.305475+0000","last_active":"2024-06-02T23:57:57.196946+0000","last_peered":"2024-06-02T23:57:57.196946+0000","last_clean":"2024-06-02T23:57:57.196946+0000","last_became_active":"2024-06-02T23:57:12.305071+0000","last_became_peered":"2024-06-02T23:57:12.305071+0000","last_unstale":"2024-06-02T23:57:57.196946+0000","last_undegraded":"2024-06-02T23:57:57.196946+0000","last_fullsized":"2024-06-02T23:57:57.196946+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:08:29.024447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526181+0000","last_change":"2024-06-02T23:57:15.308629+0000","last_active":"2024-06-02T23:57:56.526181+0000","last_peered":"2024-06-02T23:57:56.526181+0000","last_clean":"2024-06-02T23:57:56.526181+0000","last_became_active":"2024-06-02T23:57:15.307981+0000","last_became_peered":"2024-06-02T23:57:15.307981+0000","last_unstale":"2024-06-02T23:57:56.526181+0000","last_undegraded":"2024-06-02T23:57:56.526181+0000","last_fullsized":"2024-06-02T23:57:56.526181+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:14:22.446599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.652511+0000","last_change":"2024-06-02T23:57:12.155968+0000","last_active":"2024-06-02T23:57:56.652511+0000","last_peered":"2024-06-02T23:57:56.652511+0000","last_clean":"2024-06-02T23:57:56.652511+0000","last_became_active":"2024-06-02T23:57:12.155521+0000","last_became_peered":"2024-06-02T23:57:12.155521+0000","last_unstale":"2024-06-02T23:57:56.652511+0000","last_undegraded":"2024-06-02T23:57:56.652511+0000","last_fullsized":"2024-06-02T23:57:56.652511+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:45:00.397317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":344,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.320615+0000","last_change":"2024-06-02T23:55:50.081978+0000","last_active":"2024-06-02T23:57:17.320615+0000","last_peered":"2024-06-02T23:57:17.320615+0000","last_clean":"2024-06-02T23:57:17.320615+0000","last_became_active":"2024-06-02T23:55:50.081431+0000","last_became_peered":"2024-06-02T23:55:50.081431+0000","last_unstale":"2024-06-02T23:57:17.320615+0000","last_undegraded":"2024-06-02T23:57:17.320615+0000","last_fullsized":"2024-06-02T23:57:17.320615+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:52:23.676206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:52:23.676206+0000","last_clean_scrub_stamp":"2024-06-02T23:52:23.676206+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:29:59.979935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.529633+0000","last_change":"2024-06-02T23:57:56.529633+0000","last_active":"2024-06-02T23:57:56.529633+0000","last_peered":"2024-06-02T23:57:56.529633+0000","last_clean":"2024-06-02T23:57:56.529633+0000","last_became_active":"2024-06-02T23:57:56.529210+0000","last_became_peered":"2024-06-02T23:57:56.529210+0000","last_unstale":"2024-06-02T23:57:56.529633+0000","last_undegraded":"2024-06-02T23:57:56.529633+0000","last_fullsized":"2024-06-02T23:57:56.529633+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:51:31.807162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:30.451109+0000","last_change":"2024-06-02T23:57:12.155897+0000","last_active":"2024-06-02T23:57:30.451109+0000","last_peered":"2024-06-02T23:57:30.451109+0000","last_clean":"2024-06-02T23:57:30.451109+0000","last_became_active":"2024-06-02T23:57:12.155461+0000","last_became_peered":"2024-06-02T23:57:12.155461+0000","last_unstale":"2024-06-02T23:57:30.451109+0000","last_undegraded":"2024-06-02T23:57:30.451109+0000","last_fullsized":"2024-06-02T23:57:30.451109+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:19:22.104104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527986+0000","last_change":"2024-06-02T23:57:12.306363+0000","last_active":"2024-06-02T23:57:56.527986+0000","last_peered":"2024-06-02T23:57:56.527986+0000","last_clean":"2024-06-02T23:57:56.527986+0000","last_became_active":"2024-06-02T23:57:12.305920+0000","last_became_peered":"2024-06-02T23:57:12.305920+0000","last_unstale":"2024-06-02T23:57:56.527986+0000","last_undegraded":"2024-06-02T23:57:56.527986+0000","last_fullsized":"2024-06-02T23:57:56.527986+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:31:01.787879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.524217+0000","last_change":"2024-06-02T23:57:15.316038+0000","last_active":"2024-06-02T23:57:56.524217+0000","last_peered":"2024-06-02T23:57:56.524217+0000","last_clean":"2024-06-02T23:57:56.524217+0000","last_became_active":"2024-06-02T23:57:15.315715+0000","last_became_peered":"2024-06-02T23:57:15.315715+0000","last_unstale":"2024-06-02T23:57:56.524217+0000","last_undegraded":"2024-06-02T23:57:56.524217+0000","last_fullsized":"2024-06-02T23:57:56.524217+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:34:36.014251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'15","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:49.334121+0000","last_change":"2024-06-02T23:57:12.139095+0000","last_active":"2024-06-02T23:57:49.334121+0000","last_peered":"2024-06-02T23:57:49.334121+0000","last_clean":"2024-06-02T23:57:49.334121+0000","last_became_active":"2024-06-02T23:57:12.138686+0000","last_became_peered":"2024-06-02T23:57:12.138686+0000","last_unstale":"2024-06-02T23:57:49.334121+0000","last_undegraded":"2024-06-02T23:57:49.334121+0000","last_fullsized":"2024-06-02T23:57:49.334121+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:28:25.963359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526272+0000","last_change":"2024-06-02T23:57:15.315657+0000","last_active":"2024-06-02T23:57:56.526272+0000","last_peered":"2024-06-02T23:57:56.526272+0000","last_clean":"2024-06-02T23:57:56.526272+0000","last_became_active":"2024-06-02T23:57:15.315293+0000","last_became_peered":"2024-06-02T23:57:15.315293+0000","last_unstale":"2024-06-02T23:57:56.526272+0000","last_undegraded":"2024-06-02T23:57:56.526272+0000","last_fullsized":"2024-06-02T23:57:56.526272+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:52:55.241379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.652145+0000","last_change":"2024-06-02T23:57:12.405664+0000","last_active":"2024-06-02T23:57:56.652145+0000","last_peered":"2024-06-02T23:57:56.652145+0000","last_clean":"2024-06-02T23:57:56.652145+0000","last_became_active":"2024-06-02T23:57:12.405281+0000","last_became_peered":"2024-06-02T23:57:12.405281+0000","last_unstale":"2024-06-02T23:57:56.652145+0000","last_undegraded":"2024-06-02T23:57:56.652145+0000","last_fullsized":"2024-06-02T23:57:56.652145+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:46:50.119466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.887638+0000","last_change":"2024-06-02T23:57:15.318136+0000","last_active":"2024-06-02T23:57:56.887638+0000","last_peered":"2024-06-02T23:57:56.887638+0000","last_clean":"2024-06-02T23:57:56.887638+0000","last_became_active":"2024-06-02T23:57:15.317753+0000","last_became_peered":"2024-06-02T23:57:15.317753+0000","last_unstale":"2024-06-02T23:57:56.887638+0000","last_undegraded":"2024-06-02T23:57:56.887638+0000","last_fullsized":"2024-06-02T23:57:56.887638+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:35:11.025266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.887858+0000","last_change":"2024-06-02T23:57:12.305954+0000","last_active":"2024-06-02T23:57:56.887858+0000","last_peered":"2024-06-02T23:57:56.887858+0000","last_clean":"2024-06-02T23:57:56.887858+0000","last_became_active":"2024-06-02T23:57:12.305589+0000","last_became_peered":"2024-06-02T23:57:12.305589+0000","last_unstale":"2024-06-02T23:57:56.887858+0000","last_undegraded":"2024-06-02T23:57:56.887858+0000","last_fullsized":"2024-06-02T23:57:56.887858+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:34:34.178446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527729+0000","last_change":"2024-06-02T23:57:15.327115+0000","last_active":"2024-06-02T23:57:56.527729+0000","last_peered":"2024-06-02T23:57:56.527729+0000","last_clean":"2024-06-02T23:57:56.527729+0000","last_became_active":"2024-06-02T23:57:15.326746+0000","last_became_peered":"2024-06-02T23:57:15.326746+0000","last_unstale":"2024-06-02T23:57:56.527729+0000","last_undegraded":"2024-06-02T23:57:56.527729+0000","last_fullsized":"2024-06-02T23:57:56.527729+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:08:04.340517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526196+0000","last_change":"2024-06-02T23:57:12.152933+0000","last_active":"2024-06-02T23:57:56.526196+0000","last_peered":"2024-06-02T23:57:56.526196+0000","last_clean":"2024-06-02T23:57:56.526196+0000","last_became_active":"2024-06-02T23:57:12.152453+0000","last_became_peered":"2024-06-02T23:57:12.152453+0000","last_unstale":"2024-06-02T23:57:56.526196+0000","last_undegraded":"2024-06-02T23:57:56.526196+0000","last_fullsized":"2024-06-02T23:57:56.526196+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:47:05.144374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.530031+0000","last_change":"2024-06-02T23:57:15.326042+0000","last_active":"2024-06-02T23:57:56.530031+0000","last_peered":"2024-06-02T23:57:56.530031+0000","last_clean":"2024-06-02T23:57:56.530031+0000","last_became_active":"2024-06-02T23:57:15.325585+0000","last_became_peered":"2024-06-02T23:57:15.325585+0000","last_unstale":"2024-06-02T23:57:56.530031+0000","last_undegraded":"2024-06-02T23:57:56.530031+0000","last_fullsized":"2024-06-02T23:57:56.530031+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:40:37.305875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"88'3","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527114+0000","last_change":"2024-06-02T23:57:12.139155+0000","last_active":"2024-06-02T23:57:56.527114+0000","last_peered":"2024-06-02T23:57:56.527114+0000","last_clean":"2024-06-02T23:57:56.527114+0000","last_became_active":"2024-06-02T23:57:12.138732+0000","last_became_peered":"2024-06-02T23:57:12.138732+0000","last_unstale":"2024-06-02T23:57:56.527114+0000","last_undegraded":"2024-06-02T23:57:56.527114+0000","last_fullsized":"2024-06-02T23:57:56.527114+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:18:29.148439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526164+0000","last_change":"2024-06-02T23:57:15.319510+0000","last_active":"2024-06-02T23:57:56.526164+0000","last_peered":"2024-06-02T23:57:56.526164+0000","last_clean":"2024-06-02T23:57:56.526164+0000","last_became_active":"2024-06-02T23:57:15.319192+0000","last_became_peered":"2024-06-02T23:57:15.319192+0000","last_unstale":"2024-06-02T23:57:56.526164+0000","last_undegraded":"2024-06-02T23:57:56.526164+0000","last_fullsized":"2024-06-02T23:57:56.526164+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:04:04.241833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.657766+0000","last_change":"2024-06-02T23:57:56.657766+0000","last_active":"2024-06-02T23:57:56.657766+0000","last_peered":"2024-06-02T23:57:56.657766+0000","last_clean":"2024-06-02T23:57:56.657766+0000","last_became_active":"2024-06-02T23:57:56.653435+0000","last_became_peered":"2024-06-02T23:57:56.653435+0000","last_unstale":"2024-06-02T23:57:56.657766+0000","last_undegraded":"2024-06-02T23:57:56.657766+0000","last_fullsized":"2024-06-02T23:57:56.657766+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:03:23.594470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.321161+0000","last_change":"2024-06-02T23:57:15.320837+0000","last_active":"2024-06-02T23:57:17.321161+0000","last_peered":"2024-06-02T23:57:17.321161+0000","last_clean":"2024-06-02T23:57:17.321161+0000","last_became_active":"2024-06-02T23:57:15.320257+0000","last_became_peered":"2024-06-02T23:57:15.320257+0000","last_unstale":"2024-06-02T23:57:17.321161+0000","last_undegraded":"2024-06-02T23:57:17.321161+0000","last_fullsized":"2024-06-02T23:57:17.321161+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:18:29.638614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'5","reported_seq":58,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527826+0000","last_change":"2024-06-02T23:57:12.405175+0000","last_active":"2024-06-02T23:57:56.527826+0000","last_peered":"2024-06-02T23:57:56.527826+0000","last_clean":"2024-06-02T23:57:56.527826+0000","last_became_active":"2024-06-02T23:57:12.404767+0000","last_became_peered":"2024-06-02T23:57:12.404767+0000","last_unstale":"2024-06-02T23:57:56.527826+0000","last_undegraded":"2024-06-02T23:57:56.527826+0000","last_fullsized":"2024-06-02T23:57:56.527826+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:46:57.421288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.321330+0000","last_change":"2024-06-02T23:57:15.322888+0000","last_active":"2024-06-02T23:57:17.321330+0000","last_peered":"2024-06-02T23:57:17.321330+0000","last_clean":"2024-06-02T23:57:17.321330+0000","last_became_active":"2024-06-02T23:57:15.321982+0000","last_became_peered":"2024-06-02T23:57:15.321982+0000","last_unstale":"2024-06-02T23:57:17.321330+0000","last_undegraded":"2024-06-02T23:57:17.321330+0000","last_fullsized":"2024-06-02T23:57:17.321330+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:51:57.253824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526128+0000","last_change":"2024-06-02T23:57:12.153715+0000","last_active":"2024-06-02T23:57:56.526128+0000","last_peered":"2024-06-02T23:57:56.526128+0000","last_clean":"2024-06-02T23:57:56.526128+0000","last_became_active":"2024-06-02T23:57:12.152544+0000","last_became_peered":"2024-06-02T23:57:12.152544+0000","last_unstale":"2024-06-02T23:57:56.526128+0000","last_undegraded":"2024-06-02T23:57:56.526128+0000","last_fullsized":"2024-06-02T23:57:56.526128+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:51:05.874962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"88'1","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.321132+0000","last_change":"2024-06-02T23:57:15.318759+0000","last_active":"2024-06-02T23:57:17.321132+0000","last_peered":"2024-06-02T23:57:17.321132+0000","last_clean":"2024-06-02T23:57:17.321132+0000","last_became_active":"2024-06-02T23:57:15.317942+0000","last_became_peered":"2024-06-02T23:57:15.317942+0000","last_unstale":"2024-06-02T23:57:17.321132+0000","last_undegraded":"2024-06-02T23:57:17.321132+0000","last_fullsized":"2024-06-02T23:57:17.321132+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:39:44.142890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.894131+0000","last_change":"2024-06-02T23:57:56.894131+0000","last_active":"2024-06-02T23:57:56.894131+0000","last_peered":"2024-06-02T23:57:56.894131+0000","last_clean":"2024-06-02T23:57:56.894131+0000","last_became_active":"2024-06-02T23:57:56.889794+0000","last_became_peered":"2024-06-02T23:57:56.889794+0000","last_unstale":"2024-06-02T23:57:56.894131+0000","last_undegraded":"2024-06-02T23:57:56.894131+0000","last_fullsized":"2024-06-02T23:57:56.894131+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:02:41.670419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-06-02T23:57:17.321361+0000","last_change":"2024-06-02T23:57:15.324355+0000","last_active":"2024-06-02T23:57:17.321361+0000","last_peered":"2024-06-02T23:57:17.321361+0000","last_clean":"2024-06-02T23:57:17.321361+0000","last_became_active":"2024-06-02T23:57:15.324019+0000","last_became_peered":"2024-06-02T23:57:15.324019+0000","last_unstale":"2024-06-02T23:57:17.321361+0000","last_undegraded":"2024-06-02T23:57:17.321361+0000","last_fullsized":"2024-06-02T23:57:17.321361+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:27:01.927109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.530268+0000","last_change":"2024-06-02T23:57:15.326420+0000","last_active":"2024-06-02T23:57:56.530268+0000","last_peered":"2024-06-02T23:57:56.530268+0000","last_clean":"2024-06-02T23:57:56.530268+0000","last_became_active":"2024-06-02T23:57:15.326091+0000","last_became_peered":"2024-06-02T23:57:15.326091+0000","last_unstale":"2024-06-02T23:57:56.530268+0000","last_undegraded":"2024-06-02T23:57:56.530268+0000","last_fullsized":"2024-06-02T23:57:56.530268+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:54:05.355352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.653297+0000","last_change":"2024-06-02T23:57:56.653297+0000","last_active":"2024-06-02T23:57:56.653297+0000","last_peered":"2024-06-02T23:57:56.653297+0000","last_clean":"2024-06-02T23:57:56.653297+0000","last_became_active":"2024-06-02T23:57:56.652874+0000","last_became_peered":"2024-06-02T23:57:56.652874+0000","last_unstale":"2024-06-02T23:57:56.653297+0000","last_undegraded":"2024-06-02T23:57:56.653297+0000","last_fullsized":"2024-06-02T23:57:56.653297+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:27:55.486382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526942+0000","last_change":"2024-06-02T23:57:15.319266+0000","last_active":"2024-06-02T23:57:56.526942+0000","last_peered":"2024-06-02T23:57:56.526942+0000","last_clean":"2024-06-02T23:57:56.526942+0000","last_became_active":"2024-06-02T23:57:15.317468+0000","last_became_peered":"2024-06-02T23:57:15.317468+0000","last_unstale":"2024-06-02T23:57:56.526942+0000","last_undegraded":"2024-06-02T23:57:56.526942+0000","last_fullsized":"2024-06-02T23:57:56.526942+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:49:53.675524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.887634+0000","last_change":"2024-06-02T23:57:15.315798+0000","last_active":"2024-06-02T23:57:56.887634+0000","last_peered":"2024-06-02T23:57:56.887634+0000","last_clean":"2024-06-02T23:57:56.887634+0000","last_became_active":"2024-06-02T23:57:15.314886+0000","last_became_peered":"2024-06-02T23:57:15.314886+0000","last_unstale":"2024-06-02T23:57:56.887634+0000","last_undegraded":"2024-06-02T23:57:56.887634+0000","last_fullsized":"2024-06-02T23:57:56.887634+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:23.042226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.524056+0000","last_change":"2024-06-02T23:57:15.315081+0000","last_active":"2024-06-02T23:57:56.524056+0000","last_peered":"2024-06-02T23:57:56.524056+0000","last_clean":"2024-06-02T23:57:56.524056+0000","last_became_active":"2024-06-02T23:57:15.314745+0000","last_became_peered":"2024-06-02T23:57:15.314745+0000","last_unstale":"2024-06-02T23:57:56.524056+0000","last_undegraded":"2024-06-02T23:57:56.524056+0000","last_fullsized":"2024-06-02T23:57:56.524056+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:17:49.506950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.530998+0000","last_change":"2024-06-02T23:57:15.323687+0000","last_active":"2024-06-02T23:57:56.530998+0000","last_peered":"2024-06-02T23:57:56.530998+0000","last_clean":"2024-06-02T23:57:56.530998+0000","last_became_active":"2024-06-02T23:57:15.323345+0000","last_became_peered":"2024-06-02T23:57:15.323345+0000","last_unstale":"2024-06-02T23:57:56.530998+0000","last_undegraded":"2024-06-02T23:57:56.530998+0000","last_fullsized":"2024-06-02T23:57:56.530998+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:47:40.234811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528084+0000","last_change":"2024-06-02T23:57:15.320632+0000","last_active":"2024-06-02T23:57:56.528084+0000","last_peered":"2024-06-02T23:57:56.528084+0000","last_clean":"2024-06-02T23:57:56.528084+0000","last_became_active":"2024-06-02T23:57:15.318427+0000","last_became_peered":"2024-06-02T23:57:15.318427+0000","last_unstale":"2024-06-02T23:57:56.528084+0000","last_undegraded":"2024-06-02T23:57:56.528084+0000","last_fullsized":"2024-06-02T23:57:56.528084+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:04:51.729326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526143+0000","last_change":"2024-06-02T23:57:15.312039+0000","last_active":"2024-06-02T23:57:56.526143+0000","last_peered":"2024-06-02T23:57:56.526143+0000","last_clean":"2024-06-02T23:57:56.526143+0000","last_became_active":"2024-06-02T23:57:15.311275+0000","last_became_peered":"2024-06-02T23:57:15.311275+0000","last_unstale":"2024-06-02T23:57:56.526143+0000","last_undegraded":"2024-06-02T23:57:56.526143+0000","last_fullsized":"2024-06-02T23:57:56.526143+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:50:25.509550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.525155+0000","last_change":"2024-06-02T23:57:15.311927+0000","last_active":"2024-06-02T23:57:56.525155+0000","last_peered":"2024-06-02T23:57:56.525155+0000","last_clean":"2024-06-02T23:57:56.525155+0000","last_became_active":"2024-06-02T23:57:15.311484+0000","last_became_peered":"2024-06-02T23:57:15.311484+0000","last_unstale":"2024-06-02T23:57:56.525155+0000","last_undegraded":"2024-06-02T23:57:56.525155+0000","last_fullsized":"2024-06-02T23:57:56.525155+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:29:27.789219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526065+0000","last_change":"2024-06-02T23:57:15.321218+0000","last_active":"2024-06-02T23:57:56.526065+0000","last_peered":"2024-06-02T23:57:56.526065+0000","last_clean":"2024-06-02T23:57:56.526065+0000","last_became_active":"2024-06-02T23:57:15.320884+0000","last_became_peered":"2024-06-02T23:57:15.320884+0000","last_unstale":"2024-06-02T23:57:56.526065+0000","last_undegraded":"2024-06-02T23:57:56.526065+0000","last_fullsized":"2024-06-02T23:57:56.526065+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:57:20.583655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.888111+0000","last_change":"2024-06-02T23:57:15.315213+0000","last_active":"2024-06-02T23:57:56.888111+0000","last_peered":"2024-06-02T23:57:56.888111+0000","last_clean":"2024-06-02T23:57:56.888111+0000","last_became_active":"2024-06-02T23:57:15.314050+0000","last_became_peered":"2024-06-02T23:57:15.314050+0000","last_unstale":"2024-06-02T23:57:56.888111+0000","last_undegraded":"2024-06-02T23:57:56.888111+0000","last_fullsized":"2024-06-02T23:57:56.888111+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:35.214351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.523976+0000","last_change":"2024-06-02T23:57:15.313901+0000","last_active":"2024-06-02T23:57:56.523976+0000","last_peered":"2024-06-02T23:57:56.523976+0000","last_clean":"2024-06-02T23:57:56.523976+0000","last_became_active":"2024-06-02T23:57:15.313452+0000","last_became_peered":"2024-06-02T23:57:15.313452+0000","last_unstale":"2024-06-02T23:57:56.523976+0000","last_undegraded":"2024-06-02T23:57:56.523976+0000","last_fullsized":"2024-06-02T23:57:56.523976+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:41:38.366741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.530347+0000","last_change":"2024-06-02T23:57:15.323660+0000","last_active":"2024-06-02T23:57:56.530347+0000","last_peered":"2024-06-02T23:57:56.530347+0000","last_clean":"2024-06-02T23:57:56.530347+0000","last_became_active":"2024-06-02T23:57:15.323316+0000","last_became_peered":"2024-06-02T23:57:15.323316+0000","last_unstale":"2024-06-02T23:57:56.530347+0000","last_undegraded":"2024-06-02T23:57:56.530347+0000","last_fullsized":"2024-06-02T23:57:56.530347+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:33:10.245563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60669,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":281,"num_read_kb":205,"num_write":240,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":188805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383704,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":480586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645341,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28652,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716500,"statfs":{"total":95995035648,"available":95965696000,"internally_reserved":0,"allocated":1671168,"data_stored":1116984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":987136,"data_stored":463327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070503,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":480894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332139,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28560,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716592,"statfs":{"total":95995035648,"available":95965790208,"internally_reserved":0,"allocated":1581056,"data_stored":1056222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495666,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":1003520,"data_stored":480233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1064960,"data_stored":541801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40504,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704648,"statfs":{"total":95995035648,"available":95953559552,"internally_reserved":0,"allocated":1024000,"data_stored":481572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411398,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32236,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712916,"statfs":{"total":95995035648,"available":95962025984,"internally_reserved":0,"allocated":1077248,"data_stored":535613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182465,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":480058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920828,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1003520,"data_stored":480094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757303,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1626112,"data_stored":1073089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":56219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":55593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T23:58:00.992 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-06-02T23:58:00.992 INFO:tasks.cephadm:Setting up client nodes... 2024-06-02T23:58:00.993 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-06-02T23:58:01.277 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:58:01.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:01 smithi049 ceph-mon[32302]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T23:58:01.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:01 smithi107 ceph-mon[37048]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T23:58:01.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:01 smithi057 ceph-mon[36457]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T23:58:02.648 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:02 smithi049 ceph-mon[32302]: pgmap v323: 97 pgs: 97 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 639 B/s wr, 9 op/s; 0 B/s, 2 keys/s, 1 objects/s recovering 2024-06-02T23:58:02.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:02 smithi107 ceph-mon[37048]: pgmap v323: 97 pgs: 97 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 639 B/s wr, 9 op/s; 0 B/s, 2 keys/s, 1 objects/s recovering 2024-06-02T23:58:02.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.872+0000 7fc398190700 1 -- 172.21.15.49:0/2292317811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc390101410 msgr2=0x7fc390101830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:02.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.872+0000 7fc398190700 1 --2- 172.21.15.49:0/2292317811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc390101410 0x7fc390101830 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc38000b0d0 tx=0x7fc38000b3e0 comp rx=0 tx=0).stop 2024-06-02T23:58:02.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.872+0000 7fc398190700 1 -- 172.21.15.49:0/2292317811 shutdown_connections 2024-06-02T23:58:02.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.872+0000 7fc398190700 1 --2- 172.21.15.49:0/2292317811 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc390102fb0 0x7fc390109860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:02.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.872+0000 7fc398190700 1 --2- 172.21.15.49:0/2292317811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc390101410 0x7fc390101830 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:02.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.872+0000 7fc398190700 1 --2- 172.21.15.49:0/2292317811 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc390102610 0x7fc390102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:02.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.872+0000 7fc398190700 1 -- 172.21.15.49:0/2292317811 >> 172.21.15.49:0/2292317811 conn(0x7fc3900fc9b0 msgr2=0x7fc3900fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:02.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.872+0000 7fc398190700 1 -- 172.21.15.49:0/2292317811 shutdown_connections 2024-06-02T23:58:02.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.872+0000 7fc398190700 1 -- 172.21.15.49:0/2292317811 wait complete. 2024-06-02T23:58:02.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.873+0000 7fc398190700 1 Processor -- start 2024-06-02T23:58:02.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.873+0000 7fc398190700 1 -- start start 2024-06-02T23:58:02.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.873+0000 7fc398190700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc390101410 0x7fc3901986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:02.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.873+0000 7fc398190700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc390102610 0x7fc390198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:02.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.873+0000 7fc398190700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc390102fb0 0x7fc39019fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:02.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.873+0000 7fc398190700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc39010cfd0 con 0x7fc390102fb0 2024-06-02T23:58:02.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.873+0000 7fc398190700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc39010ce50 con 0x7fc390102610 2024-06-02T23:58:02.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.873+0000 7fc398190700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc39010d150 con 0x7fc390101410 2024-06-02T23:58:02.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.873+0000 7fc39672d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc390102fb0 0x7fc39019fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:02.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.873+0000 7fc395f2c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc390101410 0x7fc3901986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:02.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.873+0000 7fc39672d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc390102fb0 0x7fc39019fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46248/0 (socket says 172.21.15.49:46248) 2024-06-02T23:58:02.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.873+0000 7fc39672d700 1 -- 172.21.15.49:0/3479860572 learned_addr learned my addr 172.21.15.49:0/3479860572 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:58:02.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.874+0000 7fc39572b700 1 --2- 172.21.15.49:0/3479860572 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc390102610 0x7fc390198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:02.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.874+0000 7fc39672d700 1 -- 172.21.15.49:0/3479860572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc390101410 msgr2=0x7fc3901986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:02.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.874+0000 7fc39672d700 1 --2- 172.21.15.49:0/3479860572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc390101410 0x7fc3901986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:02.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.874+0000 7fc39672d700 1 -- 172.21.15.49:0/3479860572 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc390102610 msgr2=0x7fc390198be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:02.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.874+0000 7fc39672d700 1 --2- 172.21.15.49:0/3479860572 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc390102610 0x7fc390198be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:02.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.874+0000 7fc39672d700 1 -- 172.21.15.49:0/3479860572 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3901a0300 con 0x7fc390102fb0 2024-06-02T23:58:02.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.874+0000 7fc39572b700 1 --2- 172.21.15.49:0/3479860572 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc390102610 0x7fc390198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:02.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.874+0000 7fc39672d700 1 --2- 172.21.15.49:0/3479860572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc390102fb0 0x7fc39019fc60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc38800c9a0 tx=0x7fc38800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:02.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.874+0000 7fc38effd700 1 -- 172.21.15.49:0/3479860572 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc388007ac0 con 0x7fc390102fb0 2024-06-02T23:58:02.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.874+0000 7fc38effd700 1 -- 172.21.15.49:0/3479860572 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc388004d10 con 0x7fc390102fb0 2024-06-02T23:58:02.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.874+0000 7fc38effd700 1 -- 172.21.15.49:0/3479860572 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3880055e0 con 0x7fc390102fb0 2024-06-02T23:58:02.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.874+0000 7fc398190700 1 -- 172.21.15.49:0/3479860572 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3901a05f0 con 0x7fc390102fb0 2024-06-02T23:58:02.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.874+0000 7fc398190700 1 -- 172.21.15.49:0/3479860572 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3901a0ae0 con 0x7fc390102fb0 2024-06-02T23:58:02.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.875+0000 7fc398190700 1 -- 172.21.15.49:0/3479860572 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc390050a00 con 0x7fc390102fb0 2024-06-02T23:58:02.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.876+0000 7fc38effd700 1 -- 172.21.15.49:0/3479860572 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc388004750 con 0x7fc390102fb0 2024-06-02T23:58:02.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.877+0000 7fc38effd700 1 --2- 172.21.15.49:0/3479860572 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc3780a2d60 0x7fc3780a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:02.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.877+0000 7fc395f2c700 1 --2- 172.21.15.49:0/3479860572 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc3780a2d60 0x7fc3780a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:02.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.877+0000 7fc38effd700 1 -- 172.21.15.49:0/3479860572 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fc3880ced80 con 0x7fc390102fb0 2024-06-02T23:58:02.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.877+0000 7fc395f2c700 1 --2- 172.21.15.49:0/3479860572 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc3780a2d60 0x7fc3780a5220 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc380009fd0 tx=0x7fc38000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:02.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:02.881+0000 7fc38effd700 1 -- 172.21.15.49:0/3479860572 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc388014030 con 0x7fc390102fb0 2024-06-02T23:58:02.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:02 smithi057 ceph-mon[36457]: pgmap v323: 97 pgs: 97 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 639 B/s wr, 9 op/s; 0 B/s, 2 keys/s, 1 objects/s recovering 2024-06-02T23:58:03.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:03.178+0000 7fc398190700 1 -- 172.21.15.49:0/3479860572 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fc3901a0f60 con 0x7fc390102fb0 2024-06-02T23:58:03.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:03.180+0000 7fc38effd700 1 -- 172.21.15.49:0/3479860572 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7fc38809bb80 con 0x7fc390102fb0 2024-06-02T23:58:03.180 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2024-06-02T23:58:03.180 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQALB11mwlKyChAAOpRnKwQGHa/3AI32S4RZUQ== 2024-06-02T23:58:03.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:03.183+0000 7fc398190700 1 -- 172.21.15.49:0/3479860572 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc3780a2d60 msgr2=0x7fc3780a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:03.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:03.183+0000 7fc398190700 1 --2- 172.21.15.49:0/3479860572 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc3780a2d60 0x7fc3780a5220 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc380009fd0 tx=0x7fc38000b040 comp rx=0 tx=0).stop 2024-06-02T23:58:03.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:03.183+0000 7fc398190700 1 -- 172.21.15.49:0/3479860572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc390102fb0 msgr2=0x7fc39019fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:03.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:03.183+0000 7fc398190700 1 --2- 172.21.15.49:0/3479860572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc390102fb0 0x7fc39019fc60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc38800c9a0 tx=0x7fc38800ccb0 comp rx=0 tx=0).stop 2024-06-02T23:58:03.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:03.183+0000 7fc398190700 1 -- 172.21.15.49:0/3479860572 shutdown_connections 2024-06-02T23:58:03.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:03.183+0000 7fc398190700 1 --2- 172.21.15.49:0/3479860572 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc3780a2d60 0x7fc3780a5220 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:03.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:03.183+0000 7fc398190700 1 --2- 172.21.15.49:0/3479860572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc390102fb0 0x7fc39019fc60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:03.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:03.183+0000 7fc398190700 1 --2- 172.21.15.49:0/3479860572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc390101410 0x7fc3901986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:03.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:03.183+0000 7fc398190700 1 --2- 172.21.15.49:0/3479860572 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc390102610 0x7fc390198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:03.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:03.183+0000 7fc398190700 1 -- 172.21.15.49:0/3479860572 >> 172.21.15.49:0/3479860572 conn(0x7fc3900fc9b0 msgr2=0x7fc3900fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:03.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:03.183+0000 7fc398190700 1 -- 172.21.15.49:0/3479860572 shutdown_connections 2024-06-02T23:58:03.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:03.183+0000 7fc398190700 1 -- 172.21.15.49:0/3479860572 wait complete. 2024-06-02T23:58:03.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:03 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/3479860572' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-02T23:58:03.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:03 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/3479860572' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-02T23:58:03.852 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:03 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3479860572' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-02T23:58:03.852 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:03 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3479860572' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-02T23:58:03.881 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-06-02T23:58:03.881 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-06-02T23:58:03.882 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-06-02T23:58:03.921 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-06-02T23:58:03.921 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-06-02T23:58:03.921 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph mgr dump --format=json 2024-06-02T23:58:03.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:03 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/3479860572' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-02T23:58:03.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:03 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/3479860572' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-02T23:58:04.210 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:58:04.631 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:04 smithi049 ceph-mon[32302]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.9 KiB/s wr, 10 op/s; 0 B/s, 2 keys/s, 1 objects/s recovering 2024-06-02T23:58:04.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:04 smithi107 ceph-mon[37048]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.9 KiB/s wr, 10 op/s; 0 B/s, 2 keys/s, 1 objects/s recovering 2024-06-02T23:58:04.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:04 smithi057 ceph-mon[36457]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.9 KiB/s wr, 10 op/s; 0 B/s, 2 keys/s, 1 objects/s recovering 2024-06-02T23:58:05.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.886+0000 7f21a9d47700 1 -- 172.21.15.49:0/3975064540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21a4107840 msgr2=0x7f21a410f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:05.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.886+0000 7f21a9d47700 1 --2- 172.21.15.49:0/3975064540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21a4107840 0x7f21a410f3c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f219c00b0d0 tx=0x7f219c00b3e0 comp rx=0 tx=0).stop 2024-06-02T23:58:05.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.886+0000 7f21a9d47700 1 -- 172.21.15.49:0/3975064540 shutdown_connections 2024-06-02T23:58:05.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.886+0000 7f21a9d47700 1 --2- 172.21.15.49:0/3975064540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21a4107840 0x7f21a410f3c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:05.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.886+0000 7f21a9d47700 1 --2- 172.21.15.49:0/3975064540 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21a4102740 0x7f21a4102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:05.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.886+0000 7f21a9d47700 1 --2- 172.21.15.49:0/3975064540 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21a41030f0 0x7f21a4107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:05.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.886+0000 7f21a9d47700 1 -- 172.21.15.49:0/3975064540 >> 172.21.15.49:0/3975064540 conn(0x7f21a40795f0 msgr2=0x7f21a4079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:05.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.886+0000 7f21a9d47700 1 -- 172.21.15.49:0/3975064540 shutdown_connections 2024-06-02T23:58:05.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.886+0000 7f21a9d47700 1 -- 172.21.15.49:0/3975064540 wait complete. 2024-06-02T23:58:05.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.886+0000 7f21a9d47700 1 Processor -- start 2024-06-02T23:58:05.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.887+0000 7f21a9d47700 1 -- start start 2024-06-02T23:58:05.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.887+0000 7f21a9d47700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21a4102740 0x7f21a419e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:05.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.887+0000 7f21a9d47700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21a41030f0 0x7f21a419ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:05.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.887+0000 7f21a9d47700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21a4107840 0x7f21a4198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:05.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.887+0000 7f21a9d47700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f21a41127d0 con 0x7f21a41030f0 2024-06-02T23:58:05.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.887+0000 7f21a9d47700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f21a4112650 con 0x7f21a4102740 2024-06-02T23:58:05.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.887+0000 7f21a9d47700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f21a4112950 con 0x7f21a4107840 2024-06-02T23:58:05.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.887+0000 7f21a2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21a41030f0 0x7f21a419ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:05.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.887+0000 7f21a2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21a41030f0 0x7f21a419ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46264/0 (socket says 172.21.15.49:46264) 2024-06-02T23:58:05.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.887+0000 7f21a2ffd700 1 -- 172.21.15.49:0/1963394984 learned_addr learned my addr 172.21.15.49:0/1963394984 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:58:05.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.887+0000 7f21a3fff700 1 --2- 172.21.15.49:0/1963394984 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21a4107840 0x7f21a4198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:05.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.887+0000 7f21a37fe700 1 --2- 172.21.15.49:0/1963394984 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21a4102740 0x7f21a419e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:05.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.887+0000 7f21a2ffd700 1 -- 172.21.15.49:0/1963394984 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21a4107840 msgr2=0x7f21a4198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:05.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.887+0000 7f21a2ffd700 1 --2- 172.21.15.49:0/1963394984 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21a4107840 0x7f21a4198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:05.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.887+0000 7f21a2ffd700 1 -- 172.21.15.49:0/1963394984 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21a4102740 msgr2=0x7f21a419e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:05.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.887+0000 7f21a2ffd700 1 --2- 172.21.15.49:0/1963394984 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21a4102740 0x7f21a419e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:05.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.887+0000 7f21a2ffd700 1 -- 172.21.15.49:0/1963394984 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21a41990f0 con 0x7f21a41030f0 2024-06-02T23:58:05.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.888+0000 7f21a2ffd700 1 --2- 172.21.15.49:0/1963394984 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21a41030f0 0x7f21a419ed10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f218c00b530 tx=0x7f218c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:05.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.888+0000 7f21a0ff9700 1 -- 172.21.15.49:0/1963394984 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f218c015020 con 0x7f21a41030f0 2024-06-02T23:58:05.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.888+0000 7f21a9d47700 1 -- 172.21.15.49:0/1963394984 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21a41993e0 con 0x7f21a41030f0 2024-06-02T23:58:05.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.888+0000 7f21a0ff9700 1 -- 172.21.15.49:0/1963394984 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f218c011d10 con 0x7f21a41030f0 2024-06-02T23:58:05.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.888+0000 7f21a0ff9700 1 -- 172.21.15.49:0/1963394984 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f218c00f2e0 con 0x7f21a41030f0 2024-06-02T23:58:05.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.888+0000 7f21a9d47700 1 -- 172.21.15.49:0/1963394984 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21a41a56a0 con 0x7f21a41030f0 2024-06-02T23:58:05.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.889+0000 7f21a9d47700 1 -- 172.21.15.49:0/1963394984 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21a4069180 con 0x7f21a41030f0 2024-06-02T23:58:05.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.890+0000 7f21a0ff9700 1 -- 172.21.15.49:0/1963394984 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f218c018020 con 0x7f21a41030f0 2024-06-02T23:58:05.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.891+0000 7f21a0ff9700 1 --2- 172.21.15.49:0/1963394984 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f21900a2cb0 0x7f21900a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:05.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.891+0000 7f21a37fe700 1 --2- 172.21.15.49:0/1963394984 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f21900a2cb0 0x7f21900a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:05.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.891+0000 7f21a0ff9700 1 -- 172.21.15.49:0/1963394984 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f218c0ce810 con 0x7f21a41030f0 2024-06-02T23:58:05.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.891+0000 7f21a37fe700 1 --2- 172.21.15.49:0/1963394984 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f21900a2cb0 0x7f21900a5170 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2194005950 tx=0x7f219400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:05.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:05.896+0000 7f21a0ff9700 1 -- 172.21.15.49:0/1963394984 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f218c01f020 con 0x7f21a41030f0 2024-06-02T23:58:06.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:06.166+0000 7f21a9d47700 1 -- 172.21.15.49:0/1963394984 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f21a402dca0 con 0x7f21a41030f0 2024-06-02T23:58:06.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:06.171+0000 7f21a0ff9700 1 -- 172.21.15.49:0/1963394984 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263199 (secure 0 0 0) 0x7f218c09b720 con 0x7f21a41030f0 2024-06-02T23:58:06.174 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:58:06.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:06.173+0000 7f21a9d47700 1 -- 172.21.15.49:0/1963394984 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f21900a2cb0 msgr2=0x7f21900a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:06.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:06.173+0000 7f21a9d47700 1 --2- 172.21.15.49:0/1963394984 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f21900a2cb0 0x7f21900a5170 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2194005950 tx=0x7f219400a300 comp rx=0 tx=0).stop 2024-06-02T23:58:06.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:06.173+0000 7f21a9d47700 1 -- 172.21.15.49:0/1963394984 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21a41030f0 msgr2=0x7f21a419ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:06.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:06.173+0000 7f21a9d47700 1 --2- 172.21.15.49:0/1963394984 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21a41030f0 0x7f21a419ed10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f218c00b530 tx=0x7f218c00b840 comp rx=0 tx=0).stop 2024-06-02T23:58:06.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:06.173+0000 7f21a9d47700 1 -- 172.21.15.49:0/1963394984 shutdown_connections 2024-06-02T23:58:06.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:06.173+0000 7f21a9d47700 1 --2- 172.21.15.49:0/1963394984 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f21900a2cb0 0x7f21900a5170 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:06.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:06.173+0000 7f21a9d47700 1 --2- 172.21.15.49:0/1963394984 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21a4107840 0x7f21a4198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:06.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:06.174+0000 7f21a9d47700 1 --2- 172.21.15.49:0/1963394984 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21a4102740 0x7f21a419e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:06.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:06.174+0000 7f21a9d47700 1 --2- 172.21.15.49:0/1963394984 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21a41030f0 0x7f21a419ed10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:06.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:06.174+0000 7f21a9d47700 1 -- 172.21.15.49:0/1963394984 >> 172.21.15.49:0/1963394984 conn(0x7f21a40795f0 msgr2=0x7f21a41004f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:06.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:06.174+0000 7f21a9d47700 1 -- 172.21.15.49:0/1963394984 shutdown_connections 2024-06-02T23:58:06.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:06.174+0000 7f21a9d47700 1 -- 172.21.15.49:0/1963394984 wait complete. 2024-06-02T23:58:06.775 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:06 smithi049 ceph-mon[32302]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 10 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-06-02T23:58:06.776 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:06 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/1963394984' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-06-02T23:58:06.803 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2948657177},{"type":"v1","addr":"172.21.15.49:6801","nonce":2948657177}]},"active_addr":"172.21.15.49:6801/2948657177","active_change":"2024-06-02T23:49:55.151699+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24112,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24119,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.49:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":2082751845}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":220668660}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":4291290287}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":464952308}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":4121609113}]}]} 2024-06-02T23:58:06.809 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-06-02T23:58:06.809 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-06-02T23:58:06.809 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-02T23:58:06.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:06 smithi107 ceph-mon[37048]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 10 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-06-02T23:58:06.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:06 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/1963394984' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-06-02T23:58:06.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:06 smithi057 ceph-mon[36457]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 10 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-06-02T23:58:06.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:06 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/1963394984' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-06-02T23:58:07.060 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:58:08.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.611+0000 7fc105c65700 1 -- 172.21.15.49:0/1072031641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc100107400 msgr2=0x7fc1001077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:08.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.611+0000 7fc105c65700 1 --2- 172.21.15.49:0/1072031641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc100107400 0x7fc1001077e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0009990 tx=0x7fc0f0009ca0 comp rx=0 tx=0).stop 2024-06-02T23:58:08.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.611+0000 7fc105c65700 1 -- 172.21.15.49:0/1072031641 shutdown_connections 2024-06-02T23:58:08.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.611+0000 7fc105c65700 1 --2- 172.21.15.49:0/1072031641 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc100101d50 0x7fc10010e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:08.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.611+0000 7fc105c65700 1 --2- 172.21.15.49:0/1072031641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc100107400 0x7fc1001077e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:08.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.611+0000 7fc105c65700 1 --2- 172.21.15.49:0/1072031641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc100101390 0x7fc100101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:08.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.611+0000 7fc105c65700 1 -- 172.21.15.49:0/1072031641 >> 172.21.15.49:0/1072031641 conn(0x7fc100078340 msgr2=0x7fc100078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:08.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.611+0000 7fc105c65700 1 -- 172.21.15.49:0/1072031641 shutdown_connections 2024-06-02T23:58:08.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.611+0000 7fc105c65700 1 -- 172.21.15.49:0/1072031641 wait complete. 2024-06-02T23:58:08.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.612+0000 7fc105c65700 1 Processor -- start 2024-06-02T23:58:08.613 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:08 smithi049 ceph-mon[32302]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.4 KiB/s wr, 11 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-06-02T23:58:08.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.612+0000 7fc105c65700 1 -- start start 2024-06-02T23:58:08.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.612+0000 7fc105c65700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc100101390 0x7fc10019f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:08.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.613+0000 7fc105c65700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc100101d50 0x7fc10019fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:08.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.613+0000 7fc105c65700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc100107400 0x7fc1001a3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:08.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.613+0000 7fc105c65700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc100111670 con 0x7fc100101390 2024-06-02T23:58:08.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.613+0000 7fc105c65700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc1001114f0 con 0x7fc100101d50 2024-06-02T23:58:08.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.613+0000 7fc105c65700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc1001117f0 con 0x7fc100107400 2024-06-02T23:58:08.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.613+0000 7fc0ff7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc100101390 0x7fc10019f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:08.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.613+0000 7fc0ff7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc100101390 0x7fc10019f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46274/0 (socket says 172.21.15.49:46274) 2024-06-02T23:58:08.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.613+0000 7fc0ff7fe700 1 -- 172.21.15.49:0/4128753536 learned_addr learned my addr 172.21.15.49:0/4128753536 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:58:08.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.613+0000 7fc0f6ffd700 1 --2- 172.21.15.49:0/4128753536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc100101d50 0x7fc10019fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:08.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.613+0000 7fc0fffff700 1 --2- 172.21.15.49:0/4128753536 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc100107400 0x7fc1001a3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:08.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.613+0000 7fc0ff7fe700 1 -- 172.21.15.49:0/4128753536 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc100107400 msgr2=0x7fc1001a3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:08.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.613+0000 7fc0ff7fe700 1 --2- 172.21.15.49:0/4128753536 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc100107400 0x7fc1001a3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:08.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.613+0000 7fc0ff7fe700 1 -- 172.21.15.49:0/4128753536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc100101d50 msgr2=0x7fc10019fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:08.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.613+0000 7fc0ff7fe700 1 --2- 172.21.15.49:0/4128753536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc100101d50 0x7fc10019fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:08.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.613+0000 7fc0ff7fe700 1 -- 172.21.15.49:0/4128753536 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1001a4240 con 0x7fc100101390 2024-06-02T23:58:08.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.613+0000 7fc0fffff700 1 --2- 172.21.15.49:0/4128753536 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc100107400 0x7fc1001a3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:08.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.614+0000 7fc0ff7fe700 1 --2- 172.21.15.49:0/4128753536 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc100101390 0x7fc10019f520 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0000c00 tx=0x7fc0f00047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:08.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.614+0000 7fc0fd7fa700 1 -- 172.21.15.49:0/4128753536 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0027070 con 0x7fc100101390 2024-06-02T23:58:08.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.614+0000 7fc0fd7fa700 1 -- 172.21.15.49:0/4128753536 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0f0003780 con 0x7fc100101390 2024-06-02T23:58:08.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.614+0000 7fc0fd7fa700 1 -- 172.21.15.49:0/4128753536 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0022dd0 con 0x7fc100101390 2024-06-02T23:58:08.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.614+0000 7fc105c65700 1 -- 172.21.15.49:0/4128753536 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1001a44d0 con 0x7fc100101390 2024-06-02T23:58:08.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.614+0000 7fc105c65700 1 -- 172.21.15.49:0/4128753536 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1001a48a0 con 0x7fc100101390 2024-06-02T23:58:08.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.616+0000 7fc105c65700 1 -- 172.21.15.49:0/4128753536 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc100069180 con 0x7fc100101390 2024-06-02T23:58:08.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.617+0000 7fc0fd7fa700 1 -- 172.21.15.49:0/4128753536 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc0f002a070 con 0x7fc100101390 2024-06-02T23:58:08.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.617+0000 7fc0fd7fa700 1 --2- 172.21.15.49:0/4128753536 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc0ec0a2e00 0x7fc0ec0a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:08.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.618+0000 7fc0f6ffd700 1 --2- 172.21.15.49:0/4128753536 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc0ec0a2e00 0x7fc0ec0a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:08.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.618+0000 7fc0fd7fa700 1 -- 172.21.15.49:0/4128753536 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fc0f00cffa0 con 0x7fc100101390 2024-06-02T23:58:08.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.618+0000 7fc0f6ffd700 1 --2- 172.21.15.49:0/4128753536 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc0ec0a2e00 0x7fc0ec0a52c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc10006b250 tx=0x7fc0e800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:08.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.625+0000 7fc0fd7fa700 1 -- 172.21.15.49:0/4128753536 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc0f0013070 con 0x7fc100101390 2024-06-02T23:58:08.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.835+0000 7fc105c65700 1 -- 172.21.15.49:0/4128753536 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc1001abdb0 con 0x7fc100101390 2024-06-02T23:58:08.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.837+0000 7fc0fd7fa700 1 -- 172.21.15.49:0/4128753536 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+22612 (secure 0 0 0) 0x7fc0f009d000 con 0x7fc100101390 2024-06-02T23:58:08.838 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:58:08.838 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":90,"fsid":"890dd222-213a-11ef-bc9b-c7b262605968","created":"2024-06-02T23:48:53.323536+0000","modified":"2024-06-02T23:57:56.520324+0000","last_up_change":"2024-06-02T23:56:12.156697+0000","last_in_change":"2024-06-02T23:55:51.667118+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:52:23.676079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:57:10.753178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T23:57:14.240610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e0013e80-07d6-4ad3-87d8-d41988988ef5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6803","nonce":811647073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6805","nonce":811647073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6809","nonce":811647073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6807","nonce":811647073}]},"public_addr":"172.21.15.49:6803/811647073","cluster_addr":"172.21.15.49:6805/811647073","heartbeat_back_addr":"172.21.15.49:6809/811647073","heartbeat_front_addr":"172.21.15.49:6807/811647073","state":["exists","up"]},{"osd":1,"uuid":"f37d9f79-e349-4de7-81e7-385ddb905f58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6801","nonce":1260507785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6803","nonce":1260507785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6807","nonce":1260507785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6805","nonce":1260507785}]},"public_addr":"172.21.15.57:6801/1260507785","cluster_addr":"172.21.15.57:6803/1260507785","heartbeat_back_addr":"172.21.15.57:6807/1260507785","heartbeat_front_addr":"172.21.15.57:6805/1260507785","state":["exists","up"]},{"osd":2,"uuid":"94889281-7d45-4e78-9d37-b98e3fbe8494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6801","nonce":303899951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6803","nonce":303899951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6807","nonce":303899951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6805","nonce":303899951}]},"public_addr":"172.21.15.107:6801/303899951","cluster_addr":"172.21.15.107:6803/303899951","heartbeat_back_addr":"172.21.15.107:6807/303899951","heartbeat_front_addr":"172.21.15.107:6805/303899951","state":["exists","up"]},{"osd":3,"uuid":"31f4c18c-fbda-400d-8b3b-0955b0c4a6a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6811","nonce":60796312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6813","nonce":60796312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6817","nonce":60796312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6815","nonce":60796312}]},"public_addr":"172.21.15.49:6811/60796312","cluster_addr":"172.21.15.49:6813/60796312","heartbeat_back_addr":"172.21.15.49:6817/60796312","heartbeat_front_addr":"172.21.15.49:6815/60796312","state":["exists","up"]},{"osd":4,"uuid":"8076c2f3-0138-459e-89b5-c5c4586a14ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6809","nonce":3106842986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6811","nonce":3106842986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6815","nonce":3106842986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6813","nonce":3106842986}]},"public_addr":"172.21.15.57:6809/3106842986","cluster_addr":"172.21.15.57:6811/3106842986","heartbeat_back_addr":"172.21.15.57:6815/3106842986","heartbeat_front_addr":"172.21.15.57:6813/3106842986","state":["exists","up"]},{"osd":5,"uuid":"68f7abd3-4292-41fa-90ce-4ac34ea2b964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6809","nonce":389294142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6811","nonce":389294142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6815","nonce":389294142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6813","nonce":389294142}]},"public_addr":"172.21.15.107:6809/389294142","cluster_addr":"172.21.15.107:6811/389294142","heartbeat_back_addr":"172.21.15.107:6815/389294142","heartbeat_front_addr":"172.21.15.107:6813/389294142","state":["exists","up"]},{"osd":6,"uuid":"c0345dd0-71b7-436d-88f8-fe3d7cb69d8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6819","nonce":894624552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6821","nonce":894624552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6825","nonce":894624552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6823","nonce":894624552}]},"public_addr":"172.21.15.49:6819/894624552","cluster_addr":"172.21.15.49:6821/894624552","heartbeat_back_addr":"172.21.15.49:6825/894624552","heartbeat_front_addr":"172.21.15.49:6823/894624552","state":["exists","up"]},{"osd":7,"uuid":"9abd81c7-dcc1-4e14-8ab7-9fa0746067ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6817","nonce":3126027900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6819","nonce":3126027900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6823","nonce":3126027900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6821","nonce":3126027900}]},"public_addr":"172.21.15.57:6817/3126027900","cluster_addr":"172.21.15.57:6819/3126027900","heartbeat_back_addr":"172.21.15.57:6823/3126027900","heartbeat_front_addr":"172.21.15.57:6821/3126027900","state":["exists","up"]},{"osd":8,"uuid":"80532119-5de8-45d2-9cb9-bd8a6194199b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6817","nonce":3620047229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6819","nonce":3620047229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6823","nonce":3620047229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6821","nonce":3620047229}]},"public_addr":"172.21.15.107:6817/3620047229","cluster_addr":"172.21.15.107:6819/3620047229","heartbeat_back_addr":"172.21.15.107:6823/3620047229","heartbeat_front_addr":"172.21.15.107:6821/3620047229","state":["exists","up"]},{"osd":9,"uuid":"f0b5dcfa-9fd2-4a98-863b-197defa890af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6827","nonce":3627936526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6829","nonce":3627936526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6833","nonce":3627936526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6831","nonce":3627936526}]},"public_addr":"172.21.15.49:6827/3627936526","cluster_addr":"172.21.15.49:6829/3627936526","heartbeat_back_addr":"172.21.15.49:6833/3627936526","heartbeat_front_addr":"172.21.15.49:6831/3627936526","state":["exists","up"]},{"osd":10,"uuid":"21a75846-adec-41b8-9e1d-e5c61ba30b12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6825","nonce":3013235811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6827","nonce":3013235811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6831","nonce":3013235811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6829","nonce":3013235811}]},"public_addr":"172.21.15.57:6825/3013235811","cluster_addr":"172.21.15.57:6827/3013235811","heartbeat_back_addr":"172.21.15.57:6831/3013235811","heartbeat_front_addr":"172.21.15.57:6829/3013235811","state":["exists","up"]},{"osd":11,"uuid":"eb963b63-2c61-4169-b8fe-31c7f5ec919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6825","nonce":4217534517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6827","nonce":4217534517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6831","nonce":4217534517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6829","nonce":4217534517}]},"public_addr":"172.21.15.107:6825/4217534517","cluster_addr":"172.21.15.107:6827/4217534517","heartbeat_back_addr":"172.21.15.107:6831/4217534517","heartbeat_front_addr":"172.21.15.107:6829/4217534517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:51:31.067312+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:51:56.088456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:52:20.539941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:52:45.055717+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:53:11.178438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:53:35.794217+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:00.775674+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:27.574752+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:52.177634+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:55:17.118854+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:55:44.217535+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:56:10.500970+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/525944311":"2024-06-03T23:49:55.151590+0000","172.21.15.49:0/1841969299":"2024-06-03T23:49:55.151590+0000","172.21.15.49:0/1880506696":"2024-06-03T23:49:55.151590+0000","172.21.15.49:6801/1206062338":"2024-06-03T23:49:55.151590+0000","172.21.15.49:6800/549058216":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/2112783954":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/2183920213":"2024-06-03T23:49:29.042670+0000","172.21.15.49:6801/549058216":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/3350970308":"2024-06-03T23:49:29.042670+0000","172.21.15.49:6800/1206062338":"2024-06-03T23:49:55.151590+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:58:08.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.839+0000 7fc105c65700 1 -- 172.21.15.49:0/4128753536 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc0ec0a2e00 msgr2=0x7fc0ec0a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:08.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.839+0000 7fc105c65700 1 --2- 172.21.15.49:0/4128753536 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc0ec0a2e00 0x7fc0ec0a52c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc10006b250 tx=0x7fc0e800b410 comp rx=0 tx=0).stop 2024-06-02T23:58:08.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.839+0000 7fc105c65700 1 -- 172.21.15.49:0/4128753536 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc100101390 msgr2=0x7fc10019f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:08.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.839+0000 7fc105c65700 1 --2- 172.21.15.49:0/4128753536 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc100101390 0x7fc10019f520 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0000c00 tx=0x7fc0f00047b0 comp rx=0 tx=0).stop 2024-06-02T23:58:08.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.839+0000 7fc105c65700 1 -- 172.21.15.49:0/4128753536 shutdown_connections 2024-06-02T23:58:08.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.839+0000 7fc105c65700 1 --2- 172.21.15.49:0/4128753536 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc0ec0a2e00 0x7fc0ec0a52c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:08.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.839+0000 7fc105c65700 1 --2- 172.21.15.49:0/4128753536 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc100107400 0x7fc1001a3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:08.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.839+0000 7fc105c65700 1 --2- 172.21.15.49:0/4128753536 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc100101390 0x7fc10019f520 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:08.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.839+0000 7fc105c65700 1 --2- 172.21.15.49:0/4128753536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc100101d50 0x7fc10019fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:08.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.839+0000 7fc105c65700 1 -- 172.21.15.49:0/4128753536 >> 172.21.15.49:0/4128753536 conn(0x7fc100078340 msgr2=0x7fc10006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:08.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.839+0000 7fc105c65700 1 -- 172.21.15.49:0/4128753536 shutdown_connections 2024-06-02T23:58:08.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:08.839+0000 7fc105c65700 1 -- 172.21.15.49:0/4128753536 wait complete. 2024-06-02T23:58:08.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:08 smithi107 ceph-mon[37048]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.4 KiB/s wr, 11 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-06-02T23:58:08.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:08 smithi057 ceph-mon[36457]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.4 KiB/s wr, 11 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-06-02T23:58:09.494 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-06-02T23:58:09.495 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-02T23:58:09.636 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:09 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/4128753536' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T23:58:09.747 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:58:09.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:09 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/4128753536' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T23:58:09.949 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:09 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/4128753536' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T23:58:10.806 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:10 smithi049 ceph-mon[32302]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 10 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-06-02T23:58:10.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:10 smithi107 ceph-mon[37048]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 10 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-06-02T23:58:10.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:10 smithi057 ceph-mon[36457]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 10 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-06-02T23:58:11.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.318+0000 7f01f7e0f700 1 -- 172.21.15.49:0/1238061304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f0108510 msgr2=0x7f01f01088f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:11.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.318+0000 7f01f7e0f700 1 --2- 172.21.15.49:0/1238061304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f0108510 0x7f01f01088f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f01ec009990 tx=0x7f01ec009ca0 comp rx=0 tx=0).stop 2024-06-02T23:58:11.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.319+0000 7f01f7e0f700 1 -- 172.21.15.49:0/1238061304 shutdown_connections 2024-06-02T23:58:11.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.319+0000 7f01f7e0f700 1 --2- 172.21.15.49:0/1238061304 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01f0101440 0x7f01f010f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:11.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.319+0000 7f01f7e0f700 1 --2- 172.21.15.49:0/1238061304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f0108510 0x7f01f01088f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:11.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.319+0000 7f01f7e0f700 1 --2- 172.21.15.49:0/1238061304 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01f0100a80 0x7f01f0100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:11.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.319+0000 7f01f7e0f700 1 -- 172.21.15.49:0/1238061304 >> 172.21.15.49:0/1238061304 conn(0x7f01f0077a00 msgr2=0x7f01f00fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:11.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.319+0000 7f01f7e0f700 1 -- 172.21.15.49:0/1238061304 shutdown_connections 2024-06-02T23:58:11.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.319+0000 7f01f7e0f700 1 -- 172.21.15.49:0/1238061304 wait complete. 2024-06-02T23:58:11.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.319+0000 7f01f7e0f700 1 Processor -- start 2024-06-02T23:58:11.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.320+0000 7f01f7e0f700 1 -- start start 2024-06-02T23:58:11.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.320+0000 7f01f7e0f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01f0100a80 0x7f01f019e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:11.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.320+0000 7f01f7e0f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f0101440 0x7f01f019edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:11.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.320+0000 7f01f7e0f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01f0108510 0x7f01f0198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:11.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.320+0000 7f01f7e0f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f01f01127e0 con 0x7f01f0101440 2024-06-02T23:58:11.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.320+0000 7f01f7e0f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f01f0112660 con 0x7f01f0108510 2024-06-02T23:58:11.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.320+0000 7f01f7e0f700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f01f0112960 con 0x7f01f0100a80 2024-06-02T23:58:11.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.320+0000 7f01f53aa700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f0101440 0x7f01f019edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:11.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.320+0000 7f01f53aa700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f0101440 0x7f01f019edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46292/0 (socket says 172.21.15.49:46292) 2024-06-02T23:58:11.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.320+0000 7f01f53aa700 1 -- 172.21.15.49:0/2088408633 learned_addr learned my addr 172.21.15.49:0/2088408633 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:58:11.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.320+0000 7f01f5bab700 1 --2- 172.21.15.49:0/2088408633 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01f0100a80 0x7f01f019e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:11.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.320+0000 7f01f63ac700 1 --2- 172.21.15.49:0/2088408633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01f0108510 0x7f01f0198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:11.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.320+0000 7f01f53aa700 1 -- 172.21.15.49:0/2088408633 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01f0100a80 msgr2=0x7f01f019e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:11.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.320+0000 7f01f53aa700 1 --2- 172.21.15.49:0/2088408633 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01f0100a80 0x7f01f019e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:11.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.320+0000 7f01f53aa700 1 -- 172.21.15.49:0/2088408633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01f0108510 msgr2=0x7f01f0198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:11.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.320+0000 7f01f53aa700 1 --2- 172.21.15.49:0/2088408633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01f0108510 0x7f01f0198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:11.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.320+0000 7f01f53aa700 1 -- 172.21.15.49:0/2088408633 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f0199200 con 0x7f01f0101440 2024-06-02T23:58:11.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.321+0000 7f01f53aa700 1 --2- 172.21.15.49:0/2088408633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f0101440 0x7f01f019edd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f01e000e9c0 tx=0x7f01e000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:11.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.321+0000 7f01e6ffd700 1 -- 172.21.15.49:0/2088408633 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e000cbd0 con 0x7f01f0101440 2024-06-02T23:58:11.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.321+0000 7f01e6ffd700 1 -- 172.21.15.49:0/2088408633 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01e000ee60 con 0x7f01f0101440 2024-06-02T23:58:11.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.321+0000 7f01f7e0f700 1 -- 172.21.15.49:0/2088408633 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01f01994f0 con 0x7f01f0101440 2024-06-02T23:58:11.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.321+0000 7f01f7e0f700 1 -- 172.21.15.49:0/2088408633 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01f01a5760 con 0x7f01f0101440 2024-06-02T23:58:11.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.321+0000 7f01e6ffd700 1 -- 172.21.15.49:0/2088408633 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e0005630 con 0x7f01f0101440 2024-06-02T23:58:11.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.322+0000 7f01f7e0f700 1 -- 172.21.15.49:0/2088408633 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01f010a9f0 con 0x7f01f0101440 2024-06-02T23:58:11.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.324+0000 7f01e6ffd700 1 -- 172.21.15.49:0/2088408633 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f01e0004750 con 0x7f01f0101440 2024-06-02T23:58:11.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.324+0000 7f01e6ffd700 1 --2- 172.21.15.49:0/2088408633 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f01dc0a2cb0 0x7f01dc0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:11.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.324+0000 7f01f5bab700 1 --2- 172.21.15.49:0/2088408633 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f01dc0a2cb0 0x7f01dc0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:11.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.324+0000 7f01e6ffd700 1 -- 172.21.15.49:0/2088408633 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f01e00cf650 con 0x7f01f0101440 2024-06-02T23:58:11.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.325+0000 7f01f5bab700 1 --2- 172.21.15.49:0/2088408633 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f01dc0a2cb0 0x7f01dc0a5170 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f01f01075c0 tx=0x7f01ec01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:11.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.332+0000 7f01e6ffd700 1 -- 172.21.15.49:0/2088408633 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f01e0053850 con 0x7f01f0101440 2024-06-02T23:58:11.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.559+0000 7f01f7e0f700 1 -- 172.21.15.49:0/2088408633 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01f0199f80 con 0x7f01f0101440 2024-06-02T23:58:11.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.560+0000 7f01e6ffd700 1 -- 172.21.15.49:0/2088408633 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+22612 (secure 0 0 0) 0x7f01e009c450 con 0x7f01f0101440 2024-06-02T23:58:11.561 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:58:11.561 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":90,"fsid":"890dd222-213a-11ef-bc9b-c7b262605968","created":"2024-06-02T23:48:53.323536+0000","modified":"2024-06-02T23:57:56.520324+0000","last_up_change":"2024-06-02T23:56:12.156697+0000","last_in_change":"2024-06-02T23:55:51.667118+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:52:23.676079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:57:10.753178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T23:57:14.240610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e0013e80-07d6-4ad3-87d8-d41988988ef5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6803","nonce":811647073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6805","nonce":811647073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6809","nonce":811647073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6807","nonce":811647073}]},"public_addr":"172.21.15.49:6803/811647073","cluster_addr":"172.21.15.49:6805/811647073","heartbeat_back_addr":"172.21.15.49:6809/811647073","heartbeat_front_addr":"172.21.15.49:6807/811647073","state":["exists","up"]},{"osd":1,"uuid":"f37d9f79-e349-4de7-81e7-385ddb905f58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6801","nonce":1260507785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6803","nonce":1260507785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6807","nonce":1260507785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6805","nonce":1260507785}]},"public_addr":"172.21.15.57:6801/1260507785","cluster_addr":"172.21.15.57:6803/1260507785","heartbeat_back_addr":"172.21.15.57:6807/1260507785","heartbeat_front_addr":"172.21.15.57:6805/1260507785","state":["exists","up"]},{"osd":2,"uuid":"94889281-7d45-4e78-9d37-b98e3fbe8494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6801","nonce":303899951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6803","nonce":303899951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6807","nonce":303899951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6805","nonce":303899951}]},"public_addr":"172.21.15.107:6801/303899951","cluster_addr":"172.21.15.107:6803/303899951","heartbeat_back_addr":"172.21.15.107:6807/303899951","heartbeat_front_addr":"172.21.15.107:6805/303899951","state":["exists","up"]},{"osd":3,"uuid":"31f4c18c-fbda-400d-8b3b-0955b0c4a6a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6811","nonce":60796312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6813","nonce":60796312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6817","nonce":60796312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6815","nonce":60796312}]},"public_addr":"172.21.15.49:6811/60796312","cluster_addr":"172.21.15.49:6813/60796312","heartbeat_back_addr":"172.21.15.49:6817/60796312","heartbeat_front_addr":"172.21.15.49:6815/60796312","state":["exists","up"]},{"osd":4,"uuid":"8076c2f3-0138-459e-89b5-c5c4586a14ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6809","nonce":3106842986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6811","nonce":3106842986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6815","nonce":3106842986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6813","nonce":3106842986}]},"public_addr":"172.21.15.57:6809/3106842986","cluster_addr":"172.21.15.57:6811/3106842986","heartbeat_back_addr":"172.21.15.57:6815/3106842986","heartbeat_front_addr":"172.21.15.57:6813/3106842986","state":["exists","up"]},{"osd":5,"uuid":"68f7abd3-4292-41fa-90ce-4ac34ea2b964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6809","nonce":389294142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6811","nonce":389294142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6815","nonce":389294142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6813","nonce":389294142}]},"public_addr":"172.21.15.107:6809/389294142","cluster_addr":"172.21.15.107:6811/389294142","heartbeat_back_addr":"172.21.15.107:6815/389294142","heartbeat_front_addr":"172.21.15.107:6813/389294142","state":["exists","up"]},{"osd":6,"uuid":"c0345dd0-71b7-436d-88f8-fe3d7cb69d8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6819","nonce":894624552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6821","nonce":894624552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6825","nonce":894624552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6823","nonce":894624552}]},"public_addr":"172.21.15.49:6819/894624552","cluster_addr":"172.21.15.49:6821/894624552","heartbeat_back_addr":"172.21.15.49:6825/894624552","heartbeat_front_addr":"172.21.15.49:6823/894624552","state":["exists","up"]},{"osd":7,"uuid":"9abd81c7-dcc1-4e14-8ab7-9fa0746067ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6817","nonce":3126027900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6819","nonce":3126027900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6823","nonce":3126027900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6821","nonce":3126027900}]},"public_addr":"172.21.15.57:6817/3126027900","cluster_addr":"172.21.15.57:6819/3126027900","heartbeat_back_addr":"172.21.15.57:6823/3126027900","heartbeat_front_addr":"172.21.15.57:6821/3126027900","state":["exists","up"]},{"osd":8,"uuid":"80532119-5de8-45d2-9cb9-bd8a6194199b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6817","nonce":3620047229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6819","nonce":3620047229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6823","nonce":3620047229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6821","nonce":3620047229}]},"public_addr":"172.21.15.107:6817/3620047229","cluster_addr":"172.21.15.107:6819/3620047229","heartbeat_back_addr":"172.21.15.107:6823/3620047229","heartbeat_front_addr":"172.21.15.107:6821/3620047229","state":["exists","up"]},{"osd":9,"uuid":"f0b5dcfa-9fd2-4a98-863b-197defa890af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6827","nonce":3627936526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6829","nonce":3627936526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6833","nonce":3627936526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6831","nonce":3627936526}]},"public_addr":"172.21.15.49:6827/3627936526","cluster_addr":"172.21.15.49:6829/3627936526","heartbeat_back_addr":"172.21.15.49:6833/3627936526","heartbeat_front_addr":"172.21.15.49:6831/3627936526","state":["exists","up"]},{"osd":10,"uuid":"21a75846-adec-41b8-9e1d-e5c61ba30b12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6825","nonce":3013235811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6827","nonce":3013235811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6831","nonce":3013235811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6829","nonce":3013235811}]},"public_addr":"172.21.15.57:6825/3013235811","cluster_addr":"172.21.15.57:6827/3013235811","heartbeat_back_addr":"172.21.15.57:6831/3013235811","heartbeat_front_addr":"172.21.15.57:6829/3013235811","state":["exists","up"]},{"osd":11,"uuid":"eb963b63-2c61-4169-b8fe-31c7f5ec919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6825","nonce":4217534517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6827","nonce":4217534517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6831","nonce":4217534517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6829","nonce":4217534517}]},"public_addr":"172.21.15.107:6825/4217534517","cluster_addr":"172.21.15.107:6827/4217534517","heartbeat_back_addr":"172.21.15.107:6831/4217534517","heartbeat_front_addr":"172.21.15.107:6829/4217534517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:51:31.067312+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:51:56.088456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:52:20.539941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:52:45.055717+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:53:11.178438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:53:35.794217+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:00.775674+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:27.574752+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:52.177634+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:55:17.118854+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:55:44.217535+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:56:10.500970+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/525944311":"2024-06-03T23:49:55.151590+0000","172.21.15.49:0/1841969299":"2024-06-03T23:49:55.151590+0000","172.21.15.49:0/1880506696":"2024-06-03T23:49:55.151590+0000","172.21.15.49:6801/1206062338":"2024-06-03T23:49:55.151590+0000","172.21.15.49:6800/549058216":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/2112783954":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/2183920213":"2024-06-03T23:49:29.042670+0000","172.21.15.49:6801/549058216":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/3350970308":"2024-06-03T23:49:29.042670+0000","172.21.15.49:6800/1206062338":"2024-06-03T23:49:55.151590+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:58:11.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.563+0000 7f01f7e0f700 1 -- 172.21.15.49:0/2088408633 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f01dc0a2cb0 msgr2=0x7f01dc0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:11.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.563+0000 7f01f7e0f700 1 --2- 172.21.15.49:0/2088408633 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f01dc0a2cb0 0x7f01dc0a5170 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f01f01075c0 tx=0x7f01ec01a040 comp rx=0 tx=0).stop 2024-06-02T23:58:11.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.563+0000 7f01f7e0f700 1 -- 172.21.15.49:0/2088408633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f0101440 msgr2=0x7f01f019edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:11.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.563+0000 7f01f7e0f700 1 --2- 172.21.15.49:0/2088408633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f0101440 0x7f01f019edd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f01e000e9c0 tx=0x7f01e000ecd0 comp rx=0 tx=0).stop 2024-06-02T23:58:11.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.563+0000 7f01f7e0f700 1 -- 172.21.15.49:0/2088408633 shutdown_connections 2024-06-02T23:58:11.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.563+0000 7f01f7e0f700 1 --2- 172.21.15.49:0/2088408633 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f01dc0a2cb0 0x7f01dc0a5170 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:11.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.563+0000 7f01f7e0f700 1 --2- 172.21.15.49:0/2088408633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01f0108510 0x7f01f0198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:11.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.563+0000 7f01f7e0f700 1 --2- 172.21.15.49:0/2088408633 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01f0100a80 0x7f01f019e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:11.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.563+0000 7f01f7e0f700 1 --2- 172.21.15.49:0/2088408633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f0101440 0x7f01f019edd0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:11.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.563+0000 7f01f7e0f700 1 -- 172.21.15.49:0/2088408633 >> 172.21.15.49:0/2088408633 conn(0x7f01f0077a00 msgr2=0x7f01f00ff130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:11.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.563+0000 7f01f7e0f700 1 -- 172.21.15.49:0/2088408633 shutdown_connections 2024-06-02T23:58:11.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:11.563+0000 7f01f7e0f700 1 -- 172.21.15.49:0/2088408633 wait complete. 2024-06-02T23:58:11.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:11 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:58:11.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:11 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/2088408633' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T23:58:11.870 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:11 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:58:11.870 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:11 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/2088408633' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T23:58:11.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:11 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:58:11.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:11 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/2088408633' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T23:58:12.210 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-06-02T23:58:12.210 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-06-02T23:58:12.211 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-06-02T23:58:12.211 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-06-02T23:58:12.212 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-06-02T23:58:12.212 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-06-02T23:58:12.213 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-06-02T23:58:12.213 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-06-02T23:58:12.214 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-06-02T23:58:12.214 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-06-02T23:58:12.214 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-06-02T23:58:12.215 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-06-02T23:58:12.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:12 smithi107 ceph-mon[37048]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-06-02T23:58:12.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:12 smithi057 ceph-mon[36457]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-06-02T23:58:12.960 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:12 smithi049 ceph-mon[32302]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-06-02T23:58:13.116 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:58:13.120 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:58:13.121 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:58:13.650 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:58:13.651 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:58:13.652 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:58:13.675 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:58:13.880 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:13 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:58:13.880 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:13 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:58:13.880 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:13 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:58:13.880 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:13 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:58:13.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:13 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:58:13.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:13 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:58:13.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:13 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:58:13.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:13 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:58:14.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:13 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:58:14.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:13 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:58:14.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:13 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:58:14.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:13 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:58:14.949 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:14 smithi057 ceph-mon[36457]: pgmap v329: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1023 B/s wr, 10 op/s 2024-06-02T23:58:14.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:14 smithi049 ceph-mon[32302]: pgmap v329: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1023 B/s wr, 10 op/s 2024-06-02T23:58:15.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:14 smithi107 ceph-mon[37048]: pgmap v329: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1023 B/s wr, 10 op/s 2024-06-02T23:58:16.571 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:58:16.876 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:16 smithi049 ceph-mon[32302]: pgmap v330: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-06-02T23:58:16.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:16 smithi057 ceph-mon[36457]: pgmap v330: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-06-02T23:58:17.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:16 smithi107 ceph-mon[37048]: pgmap v330: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-06-02T23:58:17.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.262+0000 7f0be4fc8700 1 -- 172.21.15.49:0/231043151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0be01030f0 msgr2=0x7f0be0107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:17.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.262+0000 7f0be4fc8700 1 --2- 172.21.15.49:0/231043151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0be01030f0 0x7f0be0107110 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0bd40099c0 tx=0x7f0bd4009cd0 comp rx=0 tx=0).stop 2024-06-02T23:58:17.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.262+0000 7f0be4fc8700 1 -- 172.21.15.49:0/231043151 shutdown_connections 2024-06-02T23:58:17.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.262+0000 7f0be4fc8700 1 --2- 172.21.15.49:0/231043151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0be0107840 0x7f0be010f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:17.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.262+0000 7f0be4fc8700 1 --2- 172.21.15.49:0/231043151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0be0102740 0x7f0be0102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:17.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.262+0000 7f0be4fc8700 1 --2- 172.21.15.49:0/231043151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0be01030f0 0x7f0be0107110 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:17.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.262+0000 7f0be4fc8700 1 -- 172.21.15.49:0/231043151 >> 172.21.15.49:0/231043151 conn(0x7f0be00795f0 msgr2=0x7f0be0079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:17.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.262+0000 7f0be4fc8700 1 -- 172.21.15.49:0/231043151 shutdown_connections 2024-06-02T23:58:17.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.262+0000 7f0be4fc8700 1 -- 172.21.15.49:0/231043151 wait complete. 2024-06-02T23:58:17.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.263+0000 7f0be4fc8700 1 Processor -- start 2024-06-02T23:58:17.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.263+0000 7f0be4fc8700 1 -- start start 2024-06-02T23:58:17.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.263+0000 7f0be4fc8700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0be0102740 0x7f0be019e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:17.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.263+0000 7f0be4fc8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0be01030f0 0x7f0be019ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:17.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.263+0000 7f0be4fc8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0be0107840 0x7f0be0198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:17.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.263+0000 7f0be4fc8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0be0112750 con 0x7f0be0107840 2024-06-02T23:58:17.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.263+0000 7f0be4fc8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0be01125d0 con 0x7f0be01030f0 2024-06-02T23:58:17.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.263+0000 7f0be4fc8700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0be01128d0 con 0x7f0be0102740 2024-06-02T23:58:17.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.264+0000 7f0bded9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0be0107840 0x7f0be0198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:17.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.264+0000 7f0bded9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0be0107840 0x7f0be0198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35104/0 (socket says 172.21.15.49:35104) 2024-06-02T23:58:17.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.264+0000 7f0bded9d700 1 -- 172.21.15.49:0/1662762463 learned_addr learned my addr 172.21.15.49:0/1662762463 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:58:17.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.264+0000 7f0bde59c700 1 --2- 172.21.15.49:0/1662762463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0be0102740 0x7f0be019e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:17.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.264+0000 7f0bddd9b700 1 --2- 172.21.15.49:0/1662762463 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0be01030f0 0x7f0be019ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:17.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.264+0000 7f0bded9d700 1 -- 172.21.15.49:0/1662762463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0be0102740 msgr2=0x7f0be019e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:17.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.264+0000 7f0bded9d700 1 --2- 172.21.15.49:0/1662762463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0be0102740 0x7f0be019e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:17.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.264+0000 7f0bded9d700 1 -- 172.21.15.49:0/1662762463 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0be01030f0 msgr2=0x7f0be019ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:17.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.264+0000 7f0bded9d700 1 --2- 172.21.15.49:0/1662762463 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0be01030f0 0x7f0be019ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.264+0000 7f0bded9d700 1 -- 172.21.15.49:0/1662762463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be01990b0 con 0x7f0be0107840 2024-06-02T23:58:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.264+0000 7f0bded9d700 1 --2- 172.21.15.49:0/1662762463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0be0107840 0x7f0be0198950 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8007d70 tx=0x7f0bd800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.264+0000 7f0bcf7fe700 1 -- 172.21.15.49:0/1662762463 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd8016020 con 0x7f0be0107840 2024-06-02T23:58:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.264+0000 7f0be4fc8700 1 -- 172.21.15.49:0/1662762463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0be01993a0 con 0x7f0be0107840 2024-06-02T23:58:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.264+0000 7f0bcf7fe700 1 -- 172.21.15.49:0/1662762463 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bd800ad40 con 0x7f0be0107840 2024-06-02T23:58:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.264+0000 7f0bcf7fe700 1 -- 172.21.15.49:0/1662762463 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd8011600 con 0x7f0be0107840 2024-06-02T23:58:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.264+0000 7f0be4fc8700 1 -- 172.21.15.49:0/1662762463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0be01a5610 con 0x7f0be0107840 2024-06-02T23:58:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.265+0000 7f0be4fc8700 1 -- 172.21.15.49:0/1662762463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0be0062c20 con 0x7f0be0107840 2024-06-02T23:58:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.267+0000 7f0bcf7fe700 1 -- 172.21.15.49:0/1662762463 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0bd8019020 con 0x7f0be0107840 2024-06-02T23:58:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.267+0000 7f0bcf7fe700 1 --2- 172.21.15.49:0/1662762463 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f0bc80a2cb0 0x7f0bc80a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.267+0000 7f0bde59c700 1 --2- 172.21.15.49:0/1662762463 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f0bc80a2cb0 0x7f0bc80a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.268+0000 7f0bcf7fe700 1 -- 172.21.15.49:0/1662762463 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f0bd80cf5e0 con 0x7f0be0107840 2024-06-02T23:58:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.268+0000 7f0bcf7fe700 1 --2- 172.21.15.49:0/1662762463 >> [v2:172.21.15.107:6808/389294142,v1:172.21.15.107:6809/389294142] conn(0x7f0bc80ac870 0x7f0bc80aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.268+0000 7f0bcf7fe700 1 -- 172.21.15.49:0/1662762463 --> [v2:172.21.15.107:6808/389294142,v1:172.21.15.107:6809/389294142] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0bd8027ea0 con 0x7f0bc80ac870 2024-06-02T23:58:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.268+0000 7f0bcf7fe700 1 -- 172.21.15.49:0/1662762463 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f0bd80cfa10 con 0x7f0be0107840 2024-06-02T23:58:17.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.268+0000 7f0bde59c700 1 --2- 172.21.15.49:0/1662762463 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f0bc80a2cb0 0x7f0bc80a5170 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0be01075a0 tx=0x7f0bd000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:17.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.268+0000 7f0bddd9b700 1 --2- 172.21.15.49:0/1662762463 >> [v2:172.21.15.107:6808/389294142,v1:172.21.15.107:6809/389294142] conn(0x7f0bc80ac870 0x7f0bc80aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:17.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.268+0000 7f0bddd9b700 1 --2- 172.21.15.49:0/1662762463 >> [v2:172.21.15.107:6808/389294142,v1:172.21.15.107:6809/389294142] conn(0x7f0bc80ac870 0x7f0bc80aed10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:17.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.269+0000 7f0bcf7fe700 1 -- 172.21.15.49:0/1662762463 <== osd.5 v2:172.21.15.107:6808/389294142 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0bd8027ea0 con 0x7f0bc80ac870 2024-06-02T23:58:17.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.286+0000 7f0be4fc8700 1 -- 172.21.15.49:0/1662762463 --> [v2:172.21.15.107:6808/389294142,v1:172.21.15.107:6809/389294142] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0be00630a0 con 0x7f0bc80ac870 2024-06-02T23:58:17.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.286+0000 7f0bcf7fe700 1 -- 172.21.15.49:0/1662762463 <== osd.5 v2:172.21.15.107:6808/389294142 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0be00630a0 con 0x7f0bc80ac870 2024-06-02T23:58:17.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.287+0000 7f0be4fc8700 1 -- 172.21.15.49:0/1662762463 >> [v2:172.21.15.107:6808/389294142,v1:172.21.15.107:6809/389294142] conn(0x7f0bc80ac870 msgr2=0x7f0bc80aed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:17.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.287+0000 7f0be4fc8700 1 --2- 172.21.15.49:0/1662762463 >> [v2:172.21.15.107:6808/389294142,v1:172.21.15.107:6809/389294142] conn(0x7f0bc80ac870 0x7f0bc80aed10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:17.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.287+0000 7f0be4fc8700 1 -- 172.21.15.49:0/1662762463 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f0bc80a2cb0 msgr2=0x7f0bc80a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:17.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.287+0000 7f0be4fc8700 1 --2- 172.21.15.49:0/1662762463 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f0bc80a2cb0 0x7f0bc80a5170 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0be01075a0 tx=0x7f0bd000a380 comp rx=0 tx=0).stop 2024-06-02T23:58:17.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.287+0000 7f0be4fc8700 1 -- 172.21.15.49:0/1662762463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0be0107840 msgr2=0x7f0be0198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:17.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.287+0000 7f0be4fc8700 1 --2- 172.21.15.49:0/1662762463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0be0107840 0x7f0be0198950 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8007d70 tx=0x7f0bd800a340 comp rx=0 tx=0).stop 2024-06-02T23:58:17.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.287+0000 7f0bded9d700 1 -- 172.21.15.49:0/1662762463 reap_dead start 2024-06-02T23:58:17.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.287+0000 7f0be4fc8700 1 -- 172.21.15.49:0/1662762463 shutdown_connections 2024-06-02T23:58:17.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.287+0000 7f0be4fc8700 1 -- 172.21.15.49:0/1662762463 >> 172.21.15.49:0/1662762463 conn(0x7f0be00795f0 msgr2=0x7f0be0100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:17.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.287+0000 7f0be4fc8700 1 -- 172.21.15.49:0/1662762463 shutdown_connections 2024-06-02T23:58:17.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:17.287+0000 7f0be4fc8700 1 -- 172.21.15.49:0/1662762463 wait complete. 2024-06-02T23:58:17.865 INFO:teuthology.orchestra.run.smithi049.stdout:163208757307 2024-06-02T23:58:17.865 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-06-02T23:58:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.588+0000 7fef58fc0700 1 -- 172.21.15.49:0/19333170 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef54101390 msgr2=0x7fef541017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.588+0000 7fef58fc0700 1 --2- 172.21.15.49:0/19333170 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef54101390 0x7fef541017f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fef3c009990 tx=0x7fef3c009ca0 comp rx=0 tx=0).stop 2024-06-02T23:58:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.588+0000 7fef58fc0700 1 -- 172.21.15.49:0/19333170 shutdown_connections 2024-06-02T23:58:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.588+0000 7fef58fc0700 1 --2- 172.21.15.49:0/19333170 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef54101d30 0x7fef5410e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.588+0000 7fef58fc0700 1 --2- 172.21.15.49:0/19333170 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef541073d0 0x7fef541077b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.588+0000 7fef58fc0700 1 --2- 172.21.15.49:0/19333170 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef54101390 0x7fef541017f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.588+0000 7fef58fc0700 1 -- 172.21.15.49:0/19333170 >> 172.21.15.49:0/19333170 conn(0x7fef540782c0 msgr2=0x7fef540786d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.588+0000 7fef58fc0700 1 -- 172.21.15.49:0/19333170 shutdown_connections 2024-06-02T23:58:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.588+0000 7fef58fc0700 1 -- 172.21.15.49:0/19333170 wait complete. 2024-06-02T23:58:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.589+0000 7fef58fc0700 1 Processor -- start 2024-06-02T23:58:18.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.589+0000 7fef58fc0700 1 -- start start 2024-06-02T23:58:18.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.589+0000 7fef58fc0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef54101390 0x7fef5419e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:18.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.589+0000 7fef58fc0700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef54101d30 0x7fef5419ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:18.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.589+0000 7fef58fc0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef541073d0 0x7fef54198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:18.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.589+0000 7fef58fc0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fef54111630 con 0x7fef54101390 2024-06-02T23:58:18.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.589+0000 7fef58fc0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fef541114b0 con 0x7fef541073d0 2024-06-02T23:58:18.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.589+0000 7fef58fc0700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fef541117b0 con 0x7fef54101d30 2024-06-02T23:58:18.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.589+0000 7fef5259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef54101390 0x7fef5419e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:18.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.589+0000 7fef5259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef54101390 0x7fef5419e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35124/0 (socket says 172.21.15.49:35124) 2024-06-02T23:58:18.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.589+0000 7fef5259c700 1 -- 172.21.15.49:0/3464469698 learned_addr learned my addr 172.21.15.49:0/3464469698 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:58:18.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.589+0000 7fef52d9d700 1 --2- 172.21.15.49:0/3464469698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef541073d0 0x7fef54198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:18.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.590+0000 7fef51d9b700 1 --2- 172.21.15.49:0/3464469698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef54101d30 0x7fef5419ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:18.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.590+0000 7fef5259c700 1 -- 172.21.15.49:0/3464469698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef54101d30 msgr2=0x7fef5419ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:18.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.590+0000 7fef5259c700 1 --2- 172.21.15.49:0/3464469698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef54101d30 0x7fef5419ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:18.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.590+0000 7fef5259c700 1 -- 172.21.15.49:0/3464469698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef541073d0 msgr2=0x7fef54198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:18.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.590+0000 7fef5259c700 1 --2- 172.21.15.49:0/3464469698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef541073d0 0x7fef54198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:18.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.590+0000 7fef5259c700 1 -- 172.21.15.49:0/3464469698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef54199170 con 0x7fef54101390 2024-06-02T23:58:18.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.590+0000 7fef5259c700 1 --2- 172.21.15.49:0/3464469698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef54101390 0x7fef5419e850 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fef4400ef30 tx=0x7fef4400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:18.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.590+0000 7fef4b7fe700 1 -- 172.21.15.49:0/3464469698 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef440092e0 con 0x7fef54101390 2024-06-02T23:58:18.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.590+0000 7fef4b7fe700 1 -- 172.21.15.49:0/3464469698 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef44004bb0 con 0x7fef54101390 2024-06-02T23:58:18.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.590+0000 7fef58fc0700 1 -- 172.21.15.49:0/3464469698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef54199400 con 0x7fef54101390 2024-06-02T23:58:18.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.590+0000 7fef4b7fe700 1 -- 172.21.15.49:0/3464469698 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef44004280 con 0x7fef54101390 2024-06-02T23:58:18.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.590+0000 7fef58fc0700 1 -- 172.21.15.49:0/3464469698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef541a5720 con 0x7fef54101390 2024-06-02T23:58:18.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.591+0000 7fef58fc0700 1 -- 172.21.15.49:0/3464469698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fef5406a4e0 con 0x7fef54101390 2024-06-02T23:58:18.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.592+0000 7fef4b7fe700 1 -- 172.21.15.49:0/3464469698 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fef4401b030 con 0x7fef54101390 2024-06-02T23:58:18.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.594+0000 7fef4b7fe700 1 --2- 172.21.15.49:0/3464469698 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fef400a2d30 0x7fef400a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:18.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.594+0000 7fef51d9b700 1 --2- 172.21.15.49:0/3464469698 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fef400a2d30 0x7fef400a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:18.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.594+0000 7fef4b7fe700 1 -- 172.21.15.49:0/3464469698 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fef440cf740 con 0x7fef54101390 2024-06-02T23:58:18.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.594+0000 7fef4b7fe700 1 --2- 172.21.15.49:0/3464469698 >> [v2:172.21.15.57:6800/1260507785,v1:172.21.15.57:6801/1260507785] conn(0x7fef400ac8f0 0x7fef400aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:18.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.594+0000 7fef4b7fe700 1 -- 172.21.15.49:0/3464469698 --> [v2:172.21.15.57:6800/1260507785,v1:172.21.15.57:6801/1260507785] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fef400af460 con 0x7fef400ac8f0 2024-06-02T23:58:18.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.594+0000 7fef51d9b700 1 --2- 172.21.15.49:0/3464469698 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fef400a2d30 0x7fef400a51f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fef3c006010 tx=0x7fef3c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:18.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.594+0000 7fef4b7fe700 1 -- 172.21.15.49:0/3464469698 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fef440cfaf0 con 0x7fef54101390 2024-06-02T23:58:18.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.595+0000 7fef52d9d700 1 --2- 172.21.15.49:0/3464469698 >> [v2:172.21.15.57:6800/1260507785,v1:172.21.15.57:6801/1260507785] conn(0x7fef400ac8f0 0x7fef400aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:18.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.595+0000 7fef52d9d700 1 --2- 172.21.15.49:0/3464469698 >> [v2:172.21.15.57:6800/1260507785,v1:172.21.15.57:6801/1260507785] conn(0x7fef400ac8f0 0x7fef400aed90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:18.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.596+0000 7fef4b7fe700 1 -- 172.21.15.49:0/3464469698 <== osd.1 v2:172.21.15.57:6800/1260507785 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fef400af460 con 0x7fef400ac8f0 2024-06-02T23:58:18.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.613+0000 7fef58fc0700 1 -- 172.21.15.49:0/3464469698 --> [v2:172.21.15.57:6800/1260507785,v1:172.21.15.57:6801/1260507785] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fef54102a80 con 0x7fef400ac8f0 2024-06-02T23:58:18.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.613+0000 7fef4b7fe700 1 -- 172.21.15.49:0/3464469698 <== osd.1 v2:172.21.15.57:6800/1260507785 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fef54102a80 con 0x7fef400ac8f0 2024-06-02T23:58:18.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.614+0000 7fef58fc0700 1 -- 172.21.15.49:0/3464469698 >> [v2:172.21.15.57:6800/1260507785,v1:172.21.15.57:6801/1260507785] conn(0x7fef400ac8f0 msgr2=0x7fef400aed90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:18.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.614+0000 7fef58fc0700 1 --2- 172.21.15.49:0/3464469698 >> [v2:172.21.15.57:6800/1260507785,v1:172.21.15.57:6801/1260507785] conn(0x7fef400ac8f0 0x7fef400aed90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:18.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.614+0000 7fef58fc0700 1 -- 172.21.15.49:0/3464469698 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fef400a2d30 msgr2=0x7fef400a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:18.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.614+0000 7fef58fc0700 1 --2- 172.21.15.49:0/3464469698 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fef400a2d30 0x7fef400a51f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fef3c006010 tx=0x7fef3c01a040 comp rx=0 tx=0).stop 2024-06-02T23:58:18.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.614+0000 7fef58fc0700 1 -- 172.21.15.49:0/3464469698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef54101390 msgr2=0x7fef5419e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:18.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.614+0000 7fef58fc0700 1 --2- 172.21.15.49:0/3464469698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef54101390 0x7fef5419e850 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fef4400ef30 tx=0x7fef4400c3a0 comp rx=0 tx=0).stop 2024-06-02T23:58:18.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.614+0000 7fef52d9d700 1 -- 172.21.15.49:0/3464469698 reap_dead start 2024-06-02T23:58:18.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.614+0000 7fef58fc0700 1 -- 172.21.15.49:0/3464469698 shutdown_connections 2024-06-02T23:58:18.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.614+0000 7fef58fc0700 1 -- 172.21.15.49:0/3464469698 >> 172.21.15.49:0/3464469698 conn(0x7fef540782c0 msgr2=0x7fef54100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:18.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.614+0000 7fef58fc0700 1 -- 172.21.15.49:0/3464469698 shutdown_connections 2024-06-02T23:58:18.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:18.614+0000 7fef58fc0700 1 -- 172.21.15.49:0/3464469698 wait complete. 2024-06-02T23:58:18.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:18 smithi057 ceph-mon[36457]: pgmap v331: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 10 op/s 2024-06-02T23:58:18.960 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:18 smithi049 ceph-mon[32302]: pgmap v331: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 10 op/s 2024-06-02T23:58:19.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:18 smithi107 ceph-mon[37048]: pgmap v331: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 10 op/s 2024-06-02T23:58:19.755 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:58:20.382 INFO:teuthology.orchestra.run.smithi049.stdout:55834574927 2024-06-02T23:58:20.383 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-06-02T23:58:20.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:20 smithi049 ceph-mon[32302]: pgmap v332: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-06-02T23:58:21.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:20 smithi107 ceph-mon[37048]: pgmap v332: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-06-02T23:58:21.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:20 smithi057 ceph-mon[36457]: pgmap v332: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-06-02T23:58:22.192 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:58:22.193 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:58:22.882 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:22 smithi049 ceph-mon[32302]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-06-02T23:58:23.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:22 smithi107 ceph-mon[37048]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-06-02T23:58:23.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:22 smithi057 ceph-mon[36457]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-06-02T23:58:23.260 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:58:23.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.295+0000 7fad9aeb9700 1 -- 172.21.15.49:0/601414991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad94101d30 msgr2=0x7fad9410e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:23.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.295+0000 7fad9aeb9700 1 --2- 172.21.15.49:0/601414991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad94101d30 0x7fad9410e210 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00b0a0 tx=0x7fad8c00b3b0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.295+0000 7fad9aeb9700 1 -- 172.21.15.49:0/601414991 shutdown_connections 2024-06-02T23:58:23.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.295+0000 7fad9aeb9700 1 --2- 172.21.15.49:0/601414991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad94101d30 0x7fad9410e210 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.295+0000 7fad9aeb9700 1 --2- 172.21.15.49:0/601414991 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad941073d0 0x7fad941077b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.295+0000 7fad9aeb9700 1 --2- 172.21.15.49:0/601414991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad94101390 0x7fad941017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.296+0000 7fad9aeb9700 1 -- 172.21.15.49:0/601414991 >> 172.21.15.49:0/601414991 conn(0x7fad940782c0 msgr2=0x7fad940786d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:23.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.296+0000 7fad9aeb9700 1 -- 172.21.15.49:0/601414991 shutdown_connections 2024-06-02T23:58:23.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.296+0000 7fad9aeb9700 1 -- 172.21.15.49:0/601414991 wait complete. 2024-06-02T23:58:23.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.296+0000 7fad9aeb9700 1 Processor -- start 2024-06-02T23:58:23.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.296+0000 7fad9aeb9700 1 -- start start 2024-06-02T23:58:23.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.297+0000 7fad9aeb9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad94101390 0x7fad9419e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:23.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.297+0000 7fad9aeb9700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad94101d30 0x7fad9419ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:23.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.297+0000 7fad9aeb9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad941073d0 0x7fad94198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:23.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.297+0000 7fad9aeb9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fad941116d0 con 0x7fad941073d0 2024-06-02T23:58:23.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.297+0000 7fad9aeb9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fad94111550 con 0x7fad94101390 2024-06-02T23:58:23.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.297+0000 7fad9aeb9700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fad94111850 con 0x7fad94101d30 2024-06-02T23:58:23.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.297+0000 7fad99456700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad941073d0 0x7fad94198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:23.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.297+0000 7fad99456700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad941073d0 0x7fad94198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40476/0 (socket says 172.21.15.49:40476) 2024-06-02T23:58:23.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.297+0000 7fad99456700 1 -- 172.21.15.49:0/530493128 learned_addr learned my addr 172.21.15.49:0/530493128 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:58:23.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.297+0000 7fad98c55700 1 --2- 172.21.15.49:0/530493128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad94101390 0x7fad9419e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:23.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.297+0000 7fad99456700 1 -- 172.21.15.49:0/530493128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad94101d30 msgr2=0x7fad9419ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:23.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.297+0000 7fad93fff700 1 --2- 172.21.15.49:0/530493128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad94101d30 0x7fad9419ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:23.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.297+0000 7fad99456700 1 --2- 172.21.15.49:0/530493128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad94101d30 0x7fad9419ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.297+0000 7fad99456700 1 -- 172.21.15.49:0/530493128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad94101390 msgr2=0x7fad9419e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:23.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.297+0000 7fad99456700 1 --2- 172.21.15.49:0/530493128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad94101390 0x7fad9419e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.297+0000 7fad99456700 1 -- 172.21.15.49:0/530493128 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad94199170 con 0x7fad941073d0 2024-06-02T23:58:23.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.297+0000 7fad98c55700 1 --2- 172.21.15.49:0/530493128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad94101390 0x7fad9419e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:58:23.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.297+0000 7fad99456700 1 --2- 172.21.15.49:0/530493128 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad941073d0 0x7fad94198a10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00b780 tx=0x7fad8c004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:23.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.297+0000 7fad93fff700 1 --2- 172.21.15.49:0/530493128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad94101d30 0x7fad9419ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:58:23.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.298+0000 7fad91ffb700 1 -- 172.21.15.49:0/530493128 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c021070 con 0x7fad941073d0 2024-06-02T23:58:23.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.298+0000 7fad91ffb700 1 -- 172.21.15.49:0/530493128 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad8c007d40 con 0x7fad941073d0 2024-06-02T23:58:23.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.298+0000 7fad91ffb700 1 -- 172.21.15.49:0/530493128 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c005370 con 0x7fad941073d0 2024-06-02T23:58:23.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.298+0000 7fad9aeb9700 1 -- 172.21.15.49:0/530493128 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad94199400 con 0x7fad941073d0 2024-06-02T23:58:23.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.298+0000 7fad9aeb9700 1 -- 172.21.15.49:0/530493128 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad941a5720 con 0x7fad941073d0 2024-06-02T23:58:23.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.299+0000 7fad9aeb9700 1 -- 172.21.15.49:0/530493128 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fad941054d0 con 0x7fad941073d0 2024-06-02T23:58:23.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.300+0000 7fad91ffb700 1 -- 172.21.15.49:0/530493128 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fad8c024070 con 0x7fad941073d0 2024-06-02T23:58:23.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.301+0000 7fad91ffb700 1 --2- 172.21.15.49:0/530493128 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fad840a2e00 0x7fad840a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:23.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.301+0000 7fad98c55700 1 --2- 172.21.15.49:0/530493128 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fad840a2e00 0x7fad840a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:23.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.301+0000 7fad91ffb700 1 -- 172.21.15.49:0/530493128 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fad8c00f020 con 0x7fad941073d0 2024-06-02T23:58:23.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.301+0000 7fad91ffb700 1 --2- 172.21.15.49:0/530493128 >> [v2:172.21.15.49:6826/3627936526,v1:172.21.15.49:6827/3627936526] conn(0x7fad840ac9c0 0x7fad840aee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:23.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.301+0000 7fad91ffb700 1 -- 172.21.15.49:0/530493128 --> [v2:172.21.15.49:6826/3627936526,v1:172.21.15.49:6827/3627936526] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fad840af530 con 0x7fad840ac9c0 2024-06-02T23:58:23.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.301+0000 7fad91ffb700 1 -- 172.21.15.49:0/530493128 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fad8c0d0d90 con 0x7fad941073d0 2024-06-02T23:58:23.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.301+0000 7fad98c55700 1 --2- 172.21.15.49:0/530493128 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fad840a2e00 0x7fad840a52c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fad94199b50 tx=0x7fad88009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:23.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.301+0000 7fad93fff700 1 --2- 172.21.15.49:0/530493128 >> [v2:172.21.15.49:6826/3627936526,v1:172.21.15.49:6827/3627936526] conn(0x7fad840ac9c0 0x7fad840aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:23.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.302+0000 7fad93fff700 1 --2- 172.21.15.49:0/530493128 >> [v2:172.21.15.49:6826/3627936526,v1:172.21.15.49:6827/3627936526] conn(0x7fad840ac9c0 0x7fad840aee60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:23.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.302+0000 7fad91ffb700 1 -- 172.21.15.49:0/530493128 <== osd.9 v2:172.21.15.49:6826/3627936526 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fad840af530 con 0x7fad840ac9c0 2024-06-02T23:58:23.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.320+0000 7fad9aeb9700 1 -- 172.21.15.49:0/530493128 --> [v2:172.21.15.49:6826/3627936526,v1:172.21.15.49:6827/3627936526] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fad94102a80 con 0x7fad840ac9c0 2024-06-02T23:58:23.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.320+0000 7fad91ffb700 1 -- 172.21.15.49:0/530493128 <== osd.9 v2:172.21.15.49:6826/3627936526 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fad94102a80 con 0x7fad840ac9c0 2024-06-02T23:58:23.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.320+0000 7fad9aeb9700 1 -- 172.21.15.49:0/530493128 >> [v2:172.21.15.49:6826/3627936526,v1:172.21.15.49:6827/3627936526] conn(0x7fad840ac9c0 msgr2=0x7fad840aee60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:23.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.320+0000 7fad9aeb9700 1 --2- 172.21.15.49:0/530493128 >> [v2:172.21.15.49:6826/3627936526,v1:172.21.15.49:6827/3627936526] conn(0x7fad840ac9c0 0x7fad840aee60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.320+0000 7fad9aeb9700 1 -- 172.21.15.49:0/530493128 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fad840a2e00 msgr2=0x7fad840a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:23.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.320+0000 7fad9aeb9700 1 --2- 172.21.15.49:0/530493128 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fad840a2e00 0x7fad840a52c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fad94199b50 tx=0x7fad88009260 comp rx=0 tx=0).stop 2024-06-02T23:58:23.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.320+0000 7fad9aeb9700 1 -- 172.21.15.49:0/530493128 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad941073d0 msgr2=0x7fad94198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:23.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.320+0000 7fad9aeb9700 1 --2- 172.21.15.49:0/530493128 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad941073d0 0x7fad94198a10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00b780 tx=0x7fad8c004db0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.320+0000 7fad99456700 1 -- 172.21.15.49:0/530493128 reap_dead start 2024-06-02T23:58:23.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.320+0000 7fad9aeb9700 1 -- 172.21.15.49:0/530493128 shutdown_connections 2024-06-02T23:58:23.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.320+0000 7fad9aeb9700 1 -- 172.21.15.49:0/530493128 >> 172.21.15.49:0/530493128 conn(0x7fad940782c0 msgr2=0x7fad94100650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:23.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.321+0000 7fad9aeb9700 1 -- 172.21.15.49:0/530493128 shutdown_connections 2024-06-02T23:58:23.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:23.321+0000 7fad9aeb9700 1 -- 172.21.15.49:0/530493128 wait complete. 2024-06-02T23:58:24.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.946+0000 7f57e50e4700 1 -- 172.21.15.49:0/2702139037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57e006ac60 msgr2=0x7f57e006b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:24.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.946+0000 7f57e50e4700 1 --2- 172.21.15.49:0/2702139037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57e006ac60 0x7f57e006b0e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f57d40099c0 tx=0x7f57d4009cd0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.946+0000 7f57e50e4700 1 -- 172.21.15.49:0/2702139037 shutdown_connections 2024-06-02T23:58:24.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.946+0000 7f57e50e4700 1 --2- 172.21.15.49:0/2702139037 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57e006b620 0x7f57e010f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.946+0000 7f57e50e4700 1 --2- 172.21.15.49:0/2702139037 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57e0108580 0x7f57e0108960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.946+0000 7f57e50e4700 1 --2- 172.21.15.49:0/2702139037 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57e006ac60 0x7f57e006b0e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.946+0000 7f57e50e4700 1 -- 172.21.15.49:0/2702139037 >> 172.21.15.49:0/2702139037 conn(0x7f57e0078430 msgr2=0x7f57e0078840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:24.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.947+0000 7f57e50e4700 1 -- 172.21.15.49:0/2702139037 shutdown_connections 2024-06-02T23:58:24.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.947+0000 7f57e50e4700 1 -- 172.21.15.49:0/2702139037 wait complete. 2024-06-02T23:58:24.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.947+0000 7f57e50e4700 1 Processor -- start 2024-06-02T23:58:24.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.948+0000 7f57e50e4700 1 -- start start 2024-06-02T23:58:24.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.948+0000 7f57e50e4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57e006ac60 0x7f57e019e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:24.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.948+0000 7f57e50e4700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57e006b620 0x7f57e019eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:24.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.948+0000 7f57e50e4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57e0108580 0x7f57e0198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:24.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.948+0000 7f57e50e4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f57e0112840 con 0x7f57e0108580 2024-06-02T23:58:24.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.948+0000 7f57e50e4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f57e01126c0 con 0x7f57e006ac60 2024-06-02T23:58:24.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.948+0000 7f57e50e4700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f57e01129c0 con 0x7f57e006b620 2024-06-02T23:58:24.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.948+0000 7f57df59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57e0108580 0x7f57e0198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:24.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.948+0000 7f57df59e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57e0108580 0x7f57e0198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40498/0 (socket says 172.21.15.49:40498) 2024-06-02T23:58:24.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.948+0000 7f57df59e700 1 -- 172.21.15.49:0/2398092096 learned_addr learned my addr 172.21.15.49:0/2398092096 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:58:24.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.948+0000 7f57de59c700 1 --2- 172.21.15.49:0/2398092096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57e006b620 0x7f57e019eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:24.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.948+0000 7f57ded9d700 1 --2- 172.21.15.49:0/2398092096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57e006ac60 0x7f57e019e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:24.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.948+0000 7f57df59e700 1 -- 172.21.15.49:0/2398092096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57e006b620 msgr2=0x7f57e019eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:24.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.948+0000 7f57df59e700 1 --2- 172.21.15.49:0/2398092096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57e006b620 0x7f57e019eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.948+0000 7f57df59e700 1 -- 172.21.15.49:0/2398092096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57e006ac60 msgr2=0x7f57e019e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:24.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.948+0000 7f57df59e700 1 --2- 172.21.15.49:0/2398092096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57e006ac60 0x7f57e019e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.948+0000 7f57df59e700 1 -- 172.21.15.49:0/2398092096 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e0199180 con 0x7f57e0108580 2024-06-02T23:58:24.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.948+0000 7f57de59c700 1 --2- 172.21.15.49:0/2398092096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57e006b620 0x7f57e019eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:24.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.949+0000 7f57df59e700 1 --2- 172.21.15.49:0/2398092096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57e0108580 0x7f57e0198a20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f57d8007ee0 tx=0x7f57d800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:24.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.949+0000 7f57c7fff700 1 -- 172.21.15.49:0/2398092096 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d800dbd0 con 0x7f57e0108580 2024-06-02T23:58:24.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.949+0000 7f57e50e4700 1 -- 172.21.15.49:0/2398092096 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57e0199470 con 0x7f57e0108580 2024-06-02T23:58:24.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.949+0000 7f57c7fff700 1 -- 172.21.15.49:0/2398092096 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57d800dd70 con 0x7f57e0108580 2024-06-02T23:58:24.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.949+0000 7f57c7fff700 1 -- 172.21.15.49:0/2398092096 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d80133f0 con 0x7f57e0108580 2024-06-02T23:58:24.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.949+0000 7f57e50e4700 1 -- 172.21.15.49:0/2398092096 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57e01a5730 con 0x7f57e0108580 2024-06-02T23:58:24.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.950+0000 7f57e50e4700 1 -- 172.21.15.49:0/2398092096 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f57e0100800 con 0x7f57e0108580 2024-06-02T23:58:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.951+0000 7f57c7fff700 1 -- 172.21.15.49:0/2398092096 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f57d801a020 con 0x7f57e0108580 2024-06-02T23:58:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.952+0000 7f57c7fff700 1 --2- 172.21.15.49:0/2398092096 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f57c80a2cb0 0x7f57c80a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.952+0000 7f57ded9d700 1 --2- 172.21.15.49:0/2398092096 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f57c80a2cb0 0x7f57c80a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.952+0000 7f57c7fff700 1 -- 172.21.15.49:0/2398092096 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f57d80cf0e0 con 0x7f57e0108580 2024-06-02T23:58:24.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.952+0000 7f57c7fff700 1 --2- 172.21.15.49:0/2398092096 >> [v2:172.21.15.49:6802/811647073,v1:172.21.15.49:6803/811647073] conn(0x7f57c80ac870 0x7f57c80aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:24.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.952+0000 7f57c7fff700 1 -- 172.21.15.49:0/2398092096 --> [v2:172.21.15.49:6802/811647073,v1:172.21.15.49:6803/811647073] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f57d8009390 con 0x7f57c80ac870 2024-06-02T23:58:24.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.952+0000 7f57c7fff700 1 -- 172.21.15.49:0/2398092096 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f57d80cf510 con 0x7f57e0108580 2024-06-02T23:58:24.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.952+0000 7f57ded9d700 1 --2- 172.21.15.49:0/2398092096 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f57c80a2cb0 0x7f57c80a5170 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f57d0006fd0 tx=0x7f57d0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:24.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.952+0000 7f57de59c700 1 --2- 172.21.15.49:0/2398092096 >> [v2:172.21.15.49:6802/811647073,v1:172.21.15.49:6803/811647073] conn(0x7f57c80ac870 0x7f57c80aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:24.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.953+0000 7f57de59c700 1 --2- 172.21.15.49:0/2398092096 >> [v2:172.21.15.49:6802/811647073,v1:172.21.15.49:6803/811647073] conn(0x7f57c80ac870 0x7f57c80aed10 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:24.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.953+0000 7f57c7fff700 1 -- 172.21.15.49:0/2398092096 <== osd.0 v2:172.21.15.49:6802/811647073 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f57d8009390 con 0x7f57c80ac870 2024-06-02T23:58:24.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.970+0000 7f57e50e4700 1 -- 172.21.15.49:0/2398092096 --> [v2:172.21.15.49:6802/811647073,v1:172.21.15.49:6803/811647073] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f57e0103bf0 con 0x7f57c80ac870 2024-06-02T23:58:24.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.970+0000 7f57c7fff700 1 -- 172.21.15.49:0/2398092096 <== osd.0 v2:172.21.15.49:6802/811647073 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f57e0103bf0 con 0x7f57c80ac870 2024-06-02T23:58:24.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.970+0000 7f57e50e4700 1 -- 172.21.15.49:0/2398092096 >> [v2:172.21.15.49:6802/811647073,v1:172.21.15.49:6803/811647073] conn(0x7f57c80ac870 msgr2=0x7f57c80aed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:24.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.970+0000 7f57e50e4700 1 --2- 172.21.15.49:0/2398092096 >> [v2:172.21.15.49:6802/811647073,v1:172.21.15.49:6803/811647073] conn(0x7f57c80ac870 0x7f57c80aed10 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.970+0000 7f57e50e4700 1 -- 172.21.15.49:0/2398092096 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f57c80a2cb0 msgr2=0x7f57c80a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:24.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.970+0000 7f57e50e4700 1 --2- 172.21.15.49:0/2398092096 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f57c80a2cb0 0x7f57c80a5170 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f57d0006fd0 tx=0x7f57d0008040 comp rx=0 tx=0).stop 2024-06-02T23:58:24.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.970+0000 7f57e50e4700 1 -- 172.21.15.49:0/2398092096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57e0108580 msgr2=0x7f57e0198a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:24.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.970+0000 7f57e50e4700 1 --2- 172.21.15.49:0/2398092096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57e0108580 0x7f57e0198a20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f57d8007ee0 tx=0x7f57d800d3b0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.970+0000 7f57df59e700 1 -- 172.21.15.49:0/2398092096 reap_dead start 2024-06-02T23:58:24.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.970+0000 7f57e50e4700 1 -- 172.21.15.49:0/2398092096 shutdown_connections 2024-06-02T23:58:24.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.970+0000 7f57e50e4700 1 -- 172.21.15.49:0/2398092096 >> 172.21.15.49:0/2398092096 conn(0x7f57e0078430 msgr2=0x7f57e00ffda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:24.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.971+0000 7f57e50e4700 1 -- 172.21.15.49:0/2398092096 shutdown_connections 2024-06-02T23:58:24.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:24.971+0000 7f57e50e4700 1 -- 172.21.15.49:0/2398092096 wait complete. 2024-06-02T23:58:25.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:24 smithi049 ceph-mon[32302]: pgmap v334: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 10 op/s 2024-06-02T23:58:25.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:24 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:58:25.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:24 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:58:25.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:24 smithi107 ceph-mon[37048]: pgmap v334: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 10 op/s 2024-06-02T23:58:25.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:24 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:58:25.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:24 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:58:25.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:24 smithi057 ceph-mon[36457]: pgmap v334: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 10 op/s 2024-06-02T23:58:25.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:24 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:58:25.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:24 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:58:25.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.634+0000 7f22f7af3700 1 -- 172.21.15.49:0/2594942130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22f0102740 msgr2=0x7f22f0102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:25.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.634+0000 7f22f7af3700 1 --2- 172.21.15.49:0/2594942130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22f0102740 0x7f22f0102b20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f22ec0099c0 tx=0x7f22ec009cd0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.634+0000 7f22f7af3700 1 -- 172.21.15.49:0/2594942130 shutdown_connections 2024-06-02T23:58:25.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.634+0000 7f22f7af3700 1 --2- 172.21.15.49:0/2594942130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22f0107840 0x7f22f010f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.634+0000 7f22f7af3700 1 --2- 172.21.15.49:0/2594942130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22f0102740 0x7f22f0102b20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.634+0000 7f22f7af3700 1 --2- 172.21.15.49:0/2594942130 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22f01030f0 0x7f22f0107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.634+0000 7f22f7af3700 1 -- 172.21.15.49:0/2594942130 >> 172.21.15.49:0/2594942130 conn(0x7f22f00795f0 msgr2=0x7f22f0079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:25.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.634+0000 7f22f7af3700 1 -- 172.21.15.49:0/2594942130 shutdown_connections 2024-06-02T23:58:25.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.634+0000 7f22f7af3700 1 -- 172.21.15.49:0/2594942130 wait complete. 2024-06-02T23:58:25.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.635+0000 7f22f7af3700 1 Processor -- start 2024-06-02T23:58:25.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.635+0000 7f22f7af3700 1 -- start start 2024-06-02T23:58:25.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.635+0000 7f22f7af3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22f0102740 0x7f22f019e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:25.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.635+0000 7f22f7af3700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22f01030f0 0x7f22f019ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:25.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.635+0000 7f22f7af3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22f0107840 0x7f22f0198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:25.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.635+0000 7f22f7af3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f22f0112850 con 0x7f22f0102740 2024-06-02T23:58:25.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.635+0000 7f22f7af3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f22f01126d0 con 0x7f22f0107840 2024-06-02T23:58:25.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.635+0000 7f22f7af3700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f22f01129d0 con 0x7f22f01030f0 2024-06-02T23:58:25.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.635+0000 7f22f588f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22f0102740 0x7f22f019e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:25.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.636+0000 7f22f588f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22f0102740 0x7f22f019e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40514/0 (socket says 172.21.15.49:40514) 2024-06-02T23:58:25.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.636+0000 7f22f588f700 1 -- 172.21.15.49:0/3564957249 learned_addr learned my addr 172.21.15.49:0/3564957249 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:58:25.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.636+0000 7f22f508e700 1 --2- 172.21.15.49:0/3564957249 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22f01030f0 0x7f22f019ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:25.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.636+0000 7f22f588f700 1 -- 172.21.15.49:0/3564957249 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22f01030f0 msgr2=0x7f22f019ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:25.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.636+0000 7f22f588f700 1 --2- 172.21.15.49:0/3564957249 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22f01030f0 0x7f22f019ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.636+0000 7f22f588f700 1 -- 172.21.15.49:0/3564957249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22f0107840 msgr2=0x7f22f0198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:25.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.636+0000 7f22f6090700 1 --2- 172.21.15.49:0/3564957249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22f0107840 0x7f22f0198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:25.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.636+0000 7f22f588f700 1 --2- 172.21.15.49:0/3564957249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22f0107840 0x7f22f0198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.636+0000 7f22f588f700 1 -- 172.21.15.49:0/3564957249 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f01992b0 con 0x7f22f0102740 2024-06-02T23:58:25.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.636+0000 7f22f6090700 1 --2- 172.21.15.49:0/3564957249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22f0107840 0x7f22f0198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:58:25.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.636+0000 7f22f588f700 1 --2- 172.21.15.49:0/3564957249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22f0102740 0x7f22f019e940 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f22ec009fd0 tx=0x7f22ec003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:25.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.636+0000 7f22e6ffd700 1 -- 172.21.15.49:0/3564957249 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ec027070 con 0x7f22f0102740 2024-06-02T23:58:25.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.636+0000 7f22e6ffd700 1 -- 172.21.15.49:0/3564957249 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22ec004150 con 0x7f22f0102740 2024-06-02T23:58:25.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.636+0000 7f22f7af3700 1 -- 172.21.15.49:0/3564957249 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22f0199540 con 0x7f22f0102740 2024-06-02T23:58:25.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.636+0000 7f22e6ffd700 1 -- 172.21.15.49:0/3564957249 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ec00f460 con 0x7f22f0102740 2024-06-02T23:58:25.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.636+0000 7f22f7af3700 1 -- 172.21.15.49:0/3564957249 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22f01a5810 con 0x7f22f0102740 2024-06-02T23:58:25.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.637+0000 7f22f7af3700 1 -- 172.21.15.49:0/3564957249 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f22f0062c20 con 0x7f22f0102740 2024-06-02T23:58:25.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.638+0000 7f22e6ffd700 1 -- 172.21.15.49:0/3564957249 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f22ec02a070 con 0x7f22f0102740 2024-06-02T23:58:25.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.639+0000 7f22e6ffd700 1 --2- 172.21.15.49:0/3564957249 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f22dc0a2cb0 0x7f22dc0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:25.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.639+0000 7f22f508e700 1 --2- 172.21.15.49:0/3564957249 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f22dc0a2cb0 0x7f22dc0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:25.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.639+0000 7f22e6ffd700 1 -- 172.21.15.49:0/3564957249 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f22ec0d0be0 con 0x7f22f0102740 2024-06-02T23:58:25.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.639+0000 7f22e6ffd700 1 --2- 172.21.15.49:0/3564957249 >> [v2:172.21.15.49:6810/60796312,v1:172.21.15.49:6811/60796312] conn(0x7f22dc0ac870 0x7f22dc0aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:25.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.639+0000 7f22e6ffd700 1 -- 172.21.15.49:0/3564957249 --> [v2:172.21.15.49:6810/60796312,v1:172.21.15.49:6811/60796312] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f22ec010ea0 con 0x7f22dc0ac870 2024-06-02T23:58:25.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.639+0000 7f22e6ffd700 1 -- 172.21.15.49:0/3564957249 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f22ec0d1010 con 0x7f22f0102740 2024-06-02T23:58:25.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.640+0000 7f22f6090700 1 --2- 172.21.15.49:0/3564957249 >> [v2:172.21.15.49:6810/60796312,v1:172.21.15.49:6811/60796312] conn(0x7f22dc0ac870 0x7f22dc0aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:25.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.640+0000 7f22f508e700 1 --2- 172.21.15.49:0/3564957249 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f22dc0a2cb0 0x7f22dc0a5170 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f22e0006fd0 tx=0x7f22e0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:25.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.640+0000 7f22f6090700 1 --2- 172.21.15.49:0/3564957249 >> [v2:172.21.15.49:6810/60796312,v1:172.21.15.49:6811/60796312] conn(0x7f22dc0ac870 0x7f22dc0aed10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:25.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.641+0000 7f22e6ffd700 1 -- 172.21.15.49:0/3564957249 <== osd.3 v2:172.21.15.49:6810/60796312 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f22ec010ea0 con 0x7f22dc0ac870 2024-06-02T23:58:25.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.657+0000 7f22f7af3700 1 -- 172.21.15.49:0/3564957249 --> [v2:172.21.15.49:6810/60796312,v1:172.21.15.49:6811/60796312] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f22f0063020 con 0x7f22dc0ac870 2024-06-02T23:58:25.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.657+0000 7f22e6ffd700 1 -- 172.21.15.49:0/3564957249 <== osd.3 v2:172.21.15.49:6810/60796312 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f22f0063020 con 0x7f22dc0ac870 2024-06-02T23:58:25.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.657+0000 7f22f7af3700 1 -- 172.21.15.49:0/3564957249 >> [v2:172.21.15.49:6810/60796312,v1:172.21.15.49:6811/60796312] conn(0x7f22dc0ac870 msgr2=0x7f22dc0aed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:25.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.657+0000 7f22f7af3700 1 --2- 172.21.15.49:0/3564957249 >> [v2:172.21.15.49:6810/60796312,v1:172.21.15.49:6811/60796312] conn(0x7f22dc0ac870 0x7f22dc0aed10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.658+0000 7f22f7af3700 1 -- 172.21.15.49:0/3564957249 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f22dc0a2cb0 msgr2=0x7f22dc0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:25.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.658+0000 7f22f7af3700 1 --2- 172.21.15.49:0/3564957249 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f22dc0a2cb0 0x7f22dc0a5170 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f22e0006fd0 tx=0x7f22e0008040 comp rx=0 tx=0).stop 2024-06-02T23:58:25.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.658+0000 7f22f7af3700 1 -- 172.21.15.49:0/3564957249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22f0102740 msgr2=0x7f22f019e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:25.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.658+0000 7f22f7af3700 1 --2- 172.21.15.49:0/3564957249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22f0102740 0x7f22f019e940 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f22ec009fd0 tx=0x7f22ec003730 comp rx=0 tx=0).stop 2024-06-02T23:58:25.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.658+0000 7f22f6090700 1 -- 172.21.15.49:0/3564957249 reap_dead start 2024-06-02T23:58:25.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.658+0000 7f22f7af3700 1 -- 172.21.15.49:0/3564957249 shutdown_connections 2024-06-02T23:58:25.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.658+0000 7f22f7af3700 1 -- 172.21.15.49:0/3564957249 >> 172.21.15.49:0/3564957249 conn(0x7f22f00795f0 msgr2=0x7f22f01007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:25.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.658+0000 7f22f7af3700 1 -- 172.21.15.49:0/3564957249 shutdown_connections 2024-06-02T23:58:25.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:25.658+0000 7f22f7af3700 1 -- 172.21.15.49:0/3564957249 wait complete. 2024-06-02T23:58:26.305 INFO:teuthology.orchestra.run.smithi049.stdout:287762808872 2024-06-02T23:58:26.305 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-06-02T23:58:27.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:26 smithi049 ceph-mon[32302]: pgmap v335: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-06-02T23:58:27.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:26 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:58:27.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:26 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:58:27.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:26 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:58:27.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:26 smithi107 ceph-mon[37048]: pgmap v335: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-06-02T23:58:27.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:26 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:58:27.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:26 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:58:27.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:26 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:58:27.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.448+0000 7ff9b6869700 1 -- 172.21.15.49:0/177419250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9b01085a0 msgr2=0x7ff9b0108980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:27.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.448+0000 7ff9b6869700 1 --2- 172.21.15.49:0/177419250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9b01085a0 0x7ff9b0108980 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00099c0 tx=0x7ff9a0009cd0 comp rx=0 tx=0).stop 2024-06-02T23:58:27.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.448+0000 7ff9b6869700 1 -- 172.21.15.49:0/177419250 shutdown_connections 2024-06-02T23:58:27.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.448+0000 7ff9b6869700 1 --2- 172.21.15.49:0/177419250 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9b006b580 0x7ff9b010f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:27.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.448+0000 7ff9b6869700 1 --2- 172.21.15.49:0/177419250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9b01085a0 0x7ff9b0108980 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:27.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.448+0000 7ff9b6869700 1 --2- 172.21.15.49:0/177419250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9b006abc0 0x7ff9b006b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:27.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.448+0000 7ff9b6869700 1 -- 172.21.15.49:0/177419250 >> 172.21.15.49:0/177419250 conn(0x7ff9b0077200 msgr2=0x7ff9b0077610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:27.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.448+0000 7ff9b6869700 1 -- 172.21.15.49:0/177419250 shutdown_connections 2024-06-02T23:58:27.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.448+0000 7ff9b6869700 1 -- 172.21.15.49:0/177419250 wait complete. 2024-06-02T23:58:27.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:26 smithi057 ceph-mon[36457]: pgmap v335: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-06-02T23:58:27.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:26 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:58:27.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:26 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:58:27.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:26 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:58:27.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.449+0000 7ff9b6869700 1 Processor -- start 2024-06-02T23:58:27.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.449+0000 7ff9b6869700 1 -- start start 2024-06-02T23:58:27.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.450+0000 7ff9b6869700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9b006abc0 0x7ff9b019e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:27.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.450+0000 7ff9b6869700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9b006b580 0x7ff9b019ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:27.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.450+0000 7ff9b6869700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9b01085a0 0x7ff9b0198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:27.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.450+0000 7ff9b6869700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b0112860 con 0x7ff9b006b580 2024-06-02T23:58:27.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.450+0000 7ff9b6869700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b01126e0 con 0x7ff9b006abc0 2024-06-02T23:58:27.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.450+0000 7ff9b6869700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b01129e0 con 0x7ff9b01085a0 2024-06-02T23:58:27.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.450+0000 7ff9af7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9b006b580 0x7ff9b019ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:27.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.450+0000 7ff9af7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9b006b580 0x7ff9b019ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40526/0 (socket says 172.21.15.49:40526) 2024-06-02T23:58:27.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.450+0000 7ff9af7fe700 1 -- 172.21.15.49:0/3826439065 learned_addr learned my addr 172.21.15.49:0/3826439065 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:58:27.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.450+0000 7ff9af7fe700 1 -- 172.21.15.49:0/3826439065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9b01085a0 msgr2=0x7ff9b0198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:27.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.450+0000 7ff9b4e06700 1 --2- 172.21.15.49:0/3826439065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9b01085a0 0x7ff9b0198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:27.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.450+0000 7ff9af7fe700 1 --2- 172.21.15.49:0/3826439065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9b01085a0 0x7ff9b0198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:27.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.450+0000 7ff9affff700 1 --2- 172.21.15.49:0/3826439065 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9b006abc0 0x7ff9b019e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:27.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.450+0000 7ff9af7fe700 1 -- 172.21.15.49:0/3826439065 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9b006abc0 msgr2=0x7ff9b019e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:27.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.450+0000 7ff9af7fe700 1 --2- 172.21.15.49:0/3826439065 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9b006abc0 0x7ff9b019e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:27.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.450+0000 7ff9af7fe700 1 -- 172.21.15.49:0/3826439065 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b0199160 con 0x7ff9b006b580 2024-06-02T23:58:27.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.450+0000 7ff9b4e06700 1 --2- 172.21.15.49:0/3826439065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9b01085a0 0x7ff9b0198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:58:27.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.450+0000 7ff9af7fe700 1 --2- 172.21.15.49:0/3826439065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9b006b580 0x7ff9b019ed80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff9a400c9b0 tx=0x7ff9a400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:27.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.451+0000 7ff9ad7fa700 1 -- 172.21.15.49:0/3826439065 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4007b00 con 0x7ff9b006b580 2024-06-02T23:58:27.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.451+0000 7ff9b6869700 1 -- 172.21.15.49:0/3826439065 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9b0199450 con 0x7ff9b006b580 2024-06-02T23:58:27.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.451+0000 7ff9ad7fa700 1 -- 172.21.15.49:0/3826439065 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9a4007ca0 con 0x7ff9b006b580 2024-06-02T23:58:27.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.451+0000 7ff9ad7fa700 1 -- 172.21.15.49:0/3826439065 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4018780 con 0x7ff9b006b580 2024-06-02T23:58:27.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.451+0000 7ff9b6869700 1 -- 172.21.15.49:0/3826439065 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9b01a5710 con 0x7ff9b006b580 2024-06-02T23:58:27.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.452+0000 7ff9b6869700 1 -- 172.21.15.49:0/3826439065 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff9b0062c20 con 0x7ff9b006b580 2024-06-02T23:58:27.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.453+0000 7ff9ad7fa700 1 -- 172.21.15.49:0/3826439065 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff9a400f450 con 0x7ff9b006b580 2024-06-02T23:58:27.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.454+0000 7ff9ad7fa700 1 --2- 172.21.15.49:0/3826439065 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff9980a2cb0 0x7ff9980a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:27.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.454+0000 7ff9affff700 1 --2- 172.21.15.49:0/3826439065 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff9980a2cb0 0x7ff9980a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:27.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.454+0000 7ff9ad7fa700 1 -- 172.21.15.49:0/3826439065 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7ff9a40cf6a0 con 0x7ff9b006b580 2024-06-02T23:58:27.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.454+0000 7ff9ad7fa700 1 --2- 172.21.15.49:0/3826439065 >> [v2:172.21.15.107:6800/303899951,v1:172.21.15.107:6801/303899951] conn(0x7ff9980ac870 0x7ff9980aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:27.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.454+0000 7ff9ad7fa700 1 -- 172.21.15.49:0/3826439065 --> [v2:172.21.15.107:6800/303899951,v1:172.21.15.107:6801/303899951] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9a4015e70 con 0x7ff9980ac870 2024-06-02T23:58:27.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.454+0000 7ff9ad7fa700 1 -- 172.21.15.49:0/3826439065 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7ff9a40cfad0 con 0x7ff9b006b580 2024-06-02T23:58:27.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.454+0000 7ff9affff700 1 --2- 172.21.15.49:0/3826439065 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff9980a2cb0 0x7ff9980a5170 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0006010 tx=0x7ff9a0009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:27.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.454+0000 7ff9b4e06700 1 --2- 172.21.15.49:0/3826439065 >> [v2:172.21.15.107:6800/303899951,v1:172.21.15.107:6801/303899951] conn(0x7ff9980ac870 0x7ff9980aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:27.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.455+0000 7ff9b4e06700 1 --2- 172.21.15.49:0/3826439065 >> [v2:172.21.15.107:6800/303899951,v1:172.21.15.107:6801/303899951] conn(0x7ff9980ac870 0x7ff9980aed10 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:27.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.456+0000 7ff9ad7fa700 1 -- 172.21.15.49:0/3826439065 <== osd.2 v2:172.21.15.107:6800/303899951 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff9a4015e70 con 0x7ff9980ac870 2024-06-02T23:58:27.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.472+0000 7ff9b6869700 1 -- 172.21.15.49:0/3826439065 --> [v2:172.21.15.107:6800/303899951,v1:172.21.15.107:6801/303899951] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff9b00630a0 con 0x7ff9980ac870 2024-06-02T23:58:27.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.472+0000 7ff9ad7fa700 1 -- 172.21.15.49:0/3826439065 <== osd.2 v2:172.21.15.107:6800/303899951 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff9b00630a0 con 0x7ff9980ac870 2024-06-02T23:58:27.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.473+0000 7ff9b6869700 1 -- 172.21.15.49:0/3826439065 >> [v2:172.21.15.107:6800/303899951,v1:172.21.15.107:6801/303899951] conn(0x7ff9980ac870 msgr2=0x7ff9980aed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:27.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.473+0000 7ff9b6869700 1 --2- 172.21.15.49:0/3826439065 >> [v2:172.21.15.107:6800/303899951,v1:172.21.15.107:6801/303899951] conn(0x7ff9980ac870 0x7ff9980aed10 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:27.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.473+0000 7ff9b6869700 1 -- 172.21.15.49:0/3826439065 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff9980a2cb0 msgr2=0x7ff9980a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:27.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.473+0000 7ff9b6869700 1 --2- 172.21.15.49:0/3826439065 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff9980a2cb0 0x7ff9980a5170 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0006010 tx=0x7ff9a0009f10 comp rx=0 tx=0).stop 2024-06-02T23:58:27.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.473+0000 7ff9b6869700 1 -- 172.21.15.49:0/3826439065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9b006b580 msgr2=0x7ff9b019ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:27.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.473+0000 7ff9b6869700 1 --2- 172.21.15.49:0/3826439065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9b006b580 0x7ff9b019ed80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff9a400c9b0 tx=0x7ff9a400cd70 comp rx=0 tx=0).stop 2024-06-02T23:58:27.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.473+0000 7ff9b4e06700 1 -- 172.21.15.49:0/3826439065 reap_dead start 2024-06-02T23:58:27.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.473+0000 7ff9b6869700 1 -- 172.21.15.49:0/3826439065 shutdown_connections 2024-06-02T23:58:27.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.473+0000 7ff9b6869700 1 -- 172.21.15.49:0/3826439065 >> 172.21.15.49:0/3826439065 conn(0x7ff9b0077200 msgr2=0x7ff9b0100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:27.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.473+0000 7ff9b6869700 1 -- 172.21.15.49:0/3826439065 shutdown_connections 2024-06-02T23:58:27.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:27.473+0000 7ff9b6869700 1 -- 172.21.15.49:0/3826439065 wait complete. 2024-06-02T23:58:28.943 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:58:29.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:28 smithi049 ceph-mon[32302]: pgmap v336: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-06-02T23:58:29.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:28 smithi107 ceph-mon[37048]: pgmap v336: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-06-02T23:58:29.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:28 smithi057 ceph-mon[36457]: pgmap v336: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-06-02T23:58:29.583 INFO:teuthology.orchestra.run.smithi049.stdout:107374182471 2024-06-02T23:58:29.584 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-06-02T23:58:29.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.986+0000 7f45a9356700 1 -- 172.21.15.49:0/2327625061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45a4100a80 msgr2=0x7f45a4100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:29.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.986+0000 7f45a9356700 1 --2- 172.21.15.49:0/2327625061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45a4100a80 0x7f45a4100f00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f458c009990 tx=0x7f458c009ca0 comp rx=0 tx=0).stop 2024-06-02T23:58:29.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.986+0000 7f45a9356700 1 -- 172.21.15.49:0/2327625061 shutdown_connections 2024-06-02T23:58:29.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.986+0000 7f45a9356700 1 --2- 172.21.15.49:0/2327625061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45a4101440 0x7f45a410f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:29.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.986+0000 7f45a9356700 1 --2- 172.21.15.49:0/2327625061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45a4108510 0x7f45a41088f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:29.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.986+0000 7f45a9356700 1 --2- 172.21.15.49:0/2327625061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45a4100a80 0x7f45a4100f00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:29.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.986+0000 7f45a9356700 1 -- 172.21.15.49:0/2327625061 >> 172.21.15.49:0/2327625061 conn(0x7f45a4077a00 msgr2=0x7f45a40fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:29.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.986+0000 7f45a9356700 1 -- 172.21.15.49:0/2327625061 shutdown_connections 2024-06-02T23:58:29.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.986+0000 7f45a9356700 1 -- 172.21.15.49:0/2327625061 wait complete. 2024-06-02T23:58:29.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.987+0000 7f45a9356700 1 Processor -- start 2024-06-02T23:58:29.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.987+0000 7f45a9356700 1 -- start start 2024-06-02T23:58:29.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.987+0000 7f45a9356700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45a4100a80 0x7f45a419e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:29.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.987+0000 7f45a9356700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45a4101440 0x7f45a419ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:29.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.987+0000 7f45a9356700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45a4108510 0x7f45a4198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:29.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.987+0000 7f45a9356700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f45a4112790 con 0x7f45a4100a80 2024-06-02T23:58:29.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.987+0000 7f45a9356700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f45a4112610 con 0x7f45a4101440 2024-06-02T23:58:29.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.987+0000 7f45a9356700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f45a4112910 con 0x7f45a4108510 2024-06-02T23:58:29.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.987+0000 7f45a2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45a4100a80 0x7f45a419e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:29.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.987+0000 7f45a2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45a4100a80 0x7f45a419e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40540/0 (socket says 172.21.15.49:40540) 2024-06-02T23:58:29.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.987+0000 7f45a2ffd700 1 -- 172.21.15.49:0/3982466176 learned_addr learned my addr 172.21.15.49:0/3982466176 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:58:29.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.987+0000 7f45a27fc700 1 --2- 172.21.15.49:0/3982466176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45a4101440 0x7f45a419ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:29.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.988+0000 7f45a37fe700 1 --2- 172.21.15.49:0/3982466176 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45a4108510 0x7f45a4198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:29.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.988+0000 7f45a2ffd700 1 -- 172.21.15.49:0/3982466176 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45a4108510 msgr2=0x7f45a4198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:29.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.988+0000 7f45a2ffd700 1 --2- 172.21.15.49:0/3982466176 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45a4108510 0x7f45a4198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.988+0000 7f45a2ffd700 1 -- 172.21.15.49:0/3982466176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45a4101440 msgr2=0x7f45a419ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.988+0000 7f45a2ffd700 1 --2- 172.21.15.49:0/3982466176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45a4101440 0x7f45a419ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.988+0000 7f45a2ffd700 1 -- 172.21.15.49:0/3982466176 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a4199230 con 0x7f45a4100a80 2024-06-02T23:58:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.988+0000 7f45a37fe700 1 --2- 172.21.15.49:0/3982466176 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45a4108510 0x7f45a4198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:58:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.988+0000 7f45a2ffd700 1 --2- 172.21.15.49:0/3982466176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45a4100a80 0x7f45a419e910 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f459400ef10 tx=0x7f459400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.988+0000 7f459bfff700 1 -- 172.21.15.49:0/3982466176 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459400ca70 con 0x7f45a4100a80 2024-06-02T23:58:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.988+0000 7f45a9356700 1 -- 172.21.15.49:0/3982466176 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45a41994c0 con 0x7f45a4100a80 2024-06-02T23:58:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.988+0000 7f459bfff700 1 -- 172.21.15.49:0/3982466176 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4594019070 con 0x7f45a4100a80 2024-06-02T23:58:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.988+0000 7f459bfff700 1 -- 172.21.15.49:0/3982466176 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45940146e0 con 0x7f45a4100a80 2024-06-02T23:58:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.988+0000 7f45a9356700 1 -- 172.21.15.49:0/3982466176 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45a41a57e0 con 0x7f45a4100a80 2024-06-02T23:58:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.989+0000 7f45a9356700 1 -- 172.21.15.49:0/3982466176 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f45a4062ba0 con 0x7f45a4100a80 2024-06-02T23:58:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.991+0000 7f459bfff700 1 -- 172.21.15.49:0/3982466176 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4594012050 con 0x7f45a4100a80 2024-06-02T23:58:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.991+0000 7f459bfff700 1 --2- 172.21.15.49:0/3982466176 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f45900a2cb0 0x7f45900a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.991+0000 7f45a27fc700 1 --2- 172.21.15.49:0/3982466176 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f45900a2cb0 0x7f45900a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:29.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.991+0000 7f459bfff700 1 -- 172.21.15.49:0/3982466176 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f45940cfcc0 con 0x7f45a4100a80 2024-06-02T23:58:29.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.992+0000 7f459bfff700 1 --2- 172.21.15.49:0/3982466176 >> [v2:172.21.15.57:6808/3106842986,v1:172.21.15.57:6809/3106842986] conn(0x7f45900ac870 0x7f45900aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:29.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.992+0000 7f459bfff700 1 -- 172.21.15.49:0/3982466176 --> [v2:172.21.15.57:6808/3106842986,v1:172.21.15.57:6809/3106842986] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f45900af3e0 con 0x7f45900ac870 2024-06-02T23:58:29.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.992+0000 7f459bfff700 1 -- 172.21.15.49:0/3982466176 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f45940d0070 con 0x7f45a4100a80 2024-06-02T23:58:29.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.992+0000 7f45a27fc700 1 --2- 172.21.15.49:0/3982466176 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f45900a2cb0 0x7f45900a5170 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f458c00b2e0 tx=0x7f458c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:29.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.992+0000 7f45a37fe700 1 --2- 172.21.15.49:0/3982466176 >> [v2:172.21.15.57:6808/3106842986,v1:172.21.15.57:6809/3106842986] conn(0x7f45900ac870 0x7f45900aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:29.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.992+0000 7f45a37fe700 1 --2- 172.21.15.49:0/3982466176 >> [v2:172.21.15.57:6808/3106842986,v1:172.21.15.57:6809/3106842986] conn(0x7f45900ac870 0x7f45900aed10 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:29.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:29.993+0000 7f459bfff700 1 -- 172.21.15.49:0/3982466176 <== osd.4 v2:172.21.15.57:6808/3106842986 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f45900af3e0 con 0x7f45900ac870 2024-06-02T23:58:30.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.010+0000 7f45a9356700 1 -- 172.21.15.49:0/3982466176 --> [v2:172.21.15.57:6808/3106842986,v1:172.21.15.57:6809/3106842986] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f45a4063020 con 0x7f45900ac870 2024-06-02T23:58:30.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.010+0000 7f459bfff700 1 -- 172.21.15.49:0/3982466176 <== osd.4 v2:172.21.15.57:6808/3106842986 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f45a4063020 con 0x7f45900ac870 2024-06-02T23:58:30.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.011+0000 7f45a9356700 1 -- 172.21.15.49:0/3982466176 >> [v2:172.21.15.57:6808/3106842986,v1:172.21.15.57:6809/3106842986] conn(0x7f45900ac870 msgr2=0x7f45900aed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:30.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.011+0000 7f45a9356700 1 --2- 172.21.15.49:0/3982466176 >> [v2:172.21.15.57:6808/3106842986,v1:172.21.15.57:6809/3106842986] conn(0x7f45900ac870 0x7f45900aed10 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:30.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.011+0000 7f45a9356700 1 -- 172.21.15.49:0/3982466176 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f45900a2cb0 msgr2=0x7f45900a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:30.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.011+0000 7f45a9356700 1 --2- 172.21.15.49:0/3982466176 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f45900a2cb0 0x7f45900a5170 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f458c00b2e0 tx=0x7f458c005960 comp rx=0 tx=0).stop 2024-06-02T23:58:30.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.011+0000 7f45a9356700 1 -- 172.21.15.49:0/3982466176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45a4100a80 msgr2=0x7f45a419e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:30.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.011+0000 7f45a9356700 1 --2- 172.21.15.49:0/3982466176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45a4100a80 0x7f45a419e910 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f459400ef10 tx=0x7f459400c3a0 comp rx=0 tx=0).stop 2024-06-02T23:58:30.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.011+0000 7f45a37fe700 1 -- 172.21.15.49:0/3982466176 reap_dead start 2024-06-02T23:58:30.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.011+0000 7f45a9356700 1 -- 172.21.15.49:0/3982466176 shutdown_connections 2024-06-02T23:58:30.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.011+0000 7f45a9356700 1 -- 172.21.15.49:0/3982466176 >> 172.21.15.49:0/3982466176 conn(0x7f45a4077a00 msgr2=0x7f45a40ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:30.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.011+0000 7f45a9356700 1 -- 172.21.15.49:0/3982466176 shutdown_connections 2024-06-02T23:58:30.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.011+0000 7f45a9356700 1 -- 172.21.15.49:0/3982466176 wait complete. 2024-06-02T23:58:30.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.648+0000 7f1ebd5f6700 1 -- 172.21.15.49:0/606163606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1eb8101380 msgr2=0x7f1eb8101800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:30.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.648+0000 7f1ebd5f6700 1 --2- 172.21.15.49:0/606163606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1eb8101380 0x7f1eb8101800 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0009990 tx=0x7f1ea0009ca0 comp rx=0 tx=0).stop 2024-06-02T23:58:30.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.648+0000 7f1ebd5f6700 1 -- 172.21.15.49:0/606163606 shutdown_connections 2024-06-02T23:58:30.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.648+0000 7f1ebd5f6700 1 --2- 172.21.15.49:0/606163606 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1eb8101d40 0x7f1eb810e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:30.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.648+0000 7f1ebd5f6700 1 --2- 172.21.15.49:0/606163606 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1eb81073f0 0x7f1eb81077d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:30.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.648+0000 7f1ebd5f6700 1 --2- 172.21.15.49:0/606163606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1eb8101380 0x7f1eb8101800 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:30.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.648+0000 7f1ebd5f6700 1 -- 172.21.15.49:0/606163606 >> 172.21.15.49:0/606163606 conn(0x7f1eb8078300 msgr2=0x7f1eb8078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:30.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.648+0000 7f1ebd5f6700 1 -- 172.21.15.49:0/606163606 shutdown_connections 2024-06-02T23:58:30.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.648+0000 7f1ebd5f6700 1 -- 172.21.15.49:0/606163606 wait complete. 2024-06-02T23:58:30.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.649+0000 7f1ebd5f6700 1 Processor -- start 2024-06-02T23:58:30.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.649+0000 7f1ebd5f6700 1 -- start start 2024-06-02T23:58:30.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.649+0000 7f1ebd5f6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1eb8101380 0x7f1eb8103060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:30.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.649+0000 7f1ebd5f6700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1eb8101d40 0x7f1eb81035a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:30.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.649+0000 7f1ebd5f6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1eb81073f0 0x7f1eb8103ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:30.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.649+0000 7f1ebd5f6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb8111680 con 0x7f1eb8101380 2024-06-02T23:58:30.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.649+0000 7f1ebd5f6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb8111500 con 0x7f1eb81073f0 2024-06-02T23:58:30.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.649+0000 7f1ebd5f6700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb8111800 con 0x7f1eb8101d40 2024-06-02T23:58:30.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.649+0000 7f1eb6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1eb8101380 0x7f1eb8103060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:30.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.649+0000 7f1eb6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1eb8101380 0x7f1eb8103060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40550/0 (socket says 172.21.15.49:40550) 2024-06-02T23:58:30.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.649+0000 7f1eb6ffd700 1 -- 172.21.15.49:0/1031765705 learned_addr learned my addr 172.21.15.49:0/1031765705 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:58:30.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.649+0000 7f1eb67fc700 1 --2- 172.21.15.49:0/1031765705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1eb8101d40 0x7f1eb81035a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:30.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.650+0000 7f1eb77fe700 1 --2- 172.21.15.49:0/1031765705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1eb81073f0 0x7f1eb8103ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:30.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.650+0000 7f1eb6ffd700 1 -- 172.21.15.49:0/1031765705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1eb8101d40 msgr2=0x7f1eb81035a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:30.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.650+0000 7f1eb6ffd700 1 --2- 172.21.15.49:0/1031765705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1eb8101d40 0x7f1eb81035a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:30.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.650+0000 7f1eb6ffd700 1 -- 172.21.15.49:0/1031765705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1eb81073f0 msgr2=0x7f1eb8103ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:30.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.650+0000 7f1eb6ffd700 1 --2- 172.21.15.49:0/1031765705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1eb81073f0 0x7f1eb8103ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:30.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.650+0000 7f1eb6ffd700 1 -- 172.21.15.49:0/1031765705 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb81a7160 con 0x7f1eb8101380 2024-06-02T23:58:30.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.650+0000 7f1eb67fc700 1 --2- 172.21.15.49:0/1031765705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1eb8101d40 0x7f1eb81035a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:58:30.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.650+0000 7f1eb6ffd700 1 --2- 172.21.15.49:0/1031765705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1eb8101380 0x7f1eb8103060 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8007f10 tx=0x7f1ea800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:30.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.650+0000 7f1eaffff700 1 -- 172.21.15.49:0/1031765705 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea800dbd0 con 0x7f1eb8101380 2024-06-02T23:58:30.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.650+0000 7f1ebd5f6700 1 -- 172.21.15.49:0/1031765705 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eb81a7450 con 0x7f1eb8101380 2024-06-02T23:58:30.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.650+0000 7f1eaffff700 1 -- 172.21.15.49:0/1031765705 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ea800dd70 con 0x7f1eb8101380 2024-06-02T23:58:30.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.650+0000 7f1eaffff700 1 -- 172.21.15.49:0/1031765705 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea80133f0 con 0x7f1eb8101380 2024-06-02T23:58:30.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.650+0000 7f1ebd5f6700 1 -- 172.21.15.49:0/1031765705 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eb81a7960 con 0x7f1eb8101380 2024-06-02T23:58:30.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.651+0000 7f1ebd5f6700 1 -- 172.21.15.49:0/1031765705 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1eb8105470 con 0x7f1eb8101380 2024-06-02T23:58:30.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.652+0000 7f1eaffff700 1 -- 172.21.15.49:0/1031765705 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1ea801a020 con 0x7f1eb8101380 2024-06-02T23:58:30.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.653+0000 7f1eaffff700 1 --2- 172.21.15.49:0/1031765705 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1ea40a2cb0 0x7f1ea40a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:30.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.653+0000 7f1eb67fc700 1 --2- 172.21.15.49:0/1031765705 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1ea40a2cb0 0x7f1ea40a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:30.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.653+0000 7f1eaffff700 1 -- 172.21.15.49:0/1031765705 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f1ea80cefa0 con 0x7f1eb8101380 2024-06-02T23:58:30.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.653+0000 7f1eaffff700 1 --2- 172.21.15.49:0/1031765705 >> [v2:172.21.15.49:6818/894624552,v1:172.21.15.49:6819/894624552] conn(0x7f1ea40ac870 0x7f1ea40aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:30.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.653+0000 7f1eaffff700 1 -- 172.21.15.49:0/1031765705 --> [v2:172.21.15.49:6818/894624552,v1:172.21.15.49:6819/894624552] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1ea40af3e0 con 0x7f1ea40ac870 2024-06-02T23:58:30.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.653+0000 7f1eaffff700 1 -- 172.21.15.49:0/1031765705 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f1ea80cf480 con 0x7f1eb8101380 2024-06-02T23:58:30.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.654+0000 7f1eb77fe700 1 --2- 172.21.15.49:0/1031765705 >> [v2:172.21.15.49:6818/894624552,v1:172.21.15.49:6819/894624552] conn(0x7f1ea40ac870 0x7f1ea40aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:30.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.654+0000 7f1eb67fc700 1 --2- 172.21.15.49:0/1031765705 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1ea40a2cb0 0x7f1ea40a5170 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000b5c0 tx=0x7f1ea0005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:30.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.654+0000 7f1eb77fe700 1 --2- 172.21.15.49:0/1031765705 >> [v2:172.21.15.49:6818/894624552,v1:172.21.15.49:6819/894624552] conn(0x7f1ea40ac870 0x7f1ea40aed10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:30.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.655+0000 7f1eaffff700 1 -- 172.21.15.49:0/1031765705 <== osd.6 v2:172.21.15.49:6818/894624552 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1ea40af3e0 con 0x7f1ea40ac870 2024-06-02T23:58:30.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.671+0000 7f1ebd5f6700 1 -- 172.21.15.49:0/1031765705 --> [v2:172.21.15.49:6818/894624552,v1:172.21.15.49:6819/894624552] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1eb8102aa0 con 0x7f1ea40ac870 2024-06-02T23:58:30.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.671+0000 7f1eaffff700 1 -- 172.21.15.49:0/1031765705 <== osd.6 v2:172.21.15.49:6818/894624552 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1eb8102aa0 con 0x7f1ea40ac870 2024-06-02T23:58:30.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.672+0000 7f1ebd5f6700 1 -- 172.21.15.49:0/1031765705 >> [v2:172.21.15.49:6818/894624552,v1:172.21.15.49:6819/894624552] conn(0x7f1ea40ac870 msgr2=0x7f1ea40aed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:30.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.672+0000 7f1ebd5f6700 1 --2- 172.21.15.49:0/1031765705 >> [v2:172.21.15.49:6818/894624552,v1:172.21.15.49:6819/894624552] conn(0x7f1ea40ac870 0x7f1ea40aed10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:30.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.672+0000 7f1ebd5f6700 1 -- 172.21.15.49:0/1031765705 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1ea40a2cb0 msgr2=0x7f1ea40a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:30.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.672+0000 7f1ebd5f6700 1 --2- 172.21.15.49:0/1031765705 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1ea40a2cb0 0x7f1ea40a5170 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000b5c0 tx=0x7f1ea0005960 comp rx=0 tx=0).stop 2024-06-02T23:58:30.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.672+0000 7f1ebd5f6700 1 -- 172.21.15.49:0/1031765705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1eb8101380 msgr2=0x7f1eb8103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:30.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.672+0000 7f1ebd5f6700 1 --2- 172.21.15.49:0/1031765705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1eb8101380 0x7f1eb8103060 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8007f10 tx=0x7f1ea800d3b0 comp rx=0 tx=0).stop 2024-06-02T23:58:30.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.672+0000 7f1eb77fe700 1 -- 172.21.15.49:0/1031765705 reap_dead start 2024-06-02T23:58:30.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.672+0000 7f1ebd5f6700 1 -- 172.21.15.49:0/1031765705 shutdown_connections 2024-06-02T23:58:30.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.672+0000 7f1ebd5f6700 1 -- 172.21.15.49:0/1031765705 >> 172.21.15.49:0/1031765705 conn(0x7f1eb8078300 msgr2=0x7f1eb8100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:30.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.672+0000 7f1ebd5f6700 1 -- 172.21.15.49:0/1031765705 shutdown_connections 2024-06-02T23:58:30.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:30.672+0000 7f1ebd5f6700 1 -- 172.21.15.49:0/1031765705 wait complete. 2024-06-02T23:58:31.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:30 smithi049 ceph-mon[32302]: pgmap v337: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:58:31.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:30 smithi107 ceph-mon[37048]: pgmap v337: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:58:31.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:30 smithi057 ceph-mon[36457]: pgmap v337: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:58:31.637 INFO:teuthology.orchestra.run.smithi049.stdout:197568495673 2024-06-02T23:58:31.637 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-06-02T23:58:32.014 INFO:teuthology.orchestra.run.smithi049.stdout:34359738454 2024-06-02T23:58:32.015 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-06-02T23:58:33.203 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:32 smithi049 ceph-mon[32302]: pgmap v338: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-06-02T23:58:33.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:32 smithi107 ceph-mon[37048]: pgmap v338: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-06-02T23:58:33.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:32 smithi057 ceph-mon[36457]: pgmap v338: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-06-02T23:58:34.033 INFO:teuthology.orchestra.run.smithi049.stdout:77309411404 2024-06-02T23:58:34.034 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-06-02T23:58:34.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.234+0000 7ff234f7e700 1 -- 172.21.15.49:0/2400517208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff230107840 msgr2=0x7ff23010f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:34.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.234+0000 7ff234f7e700 1 --2- 172.21.15.49:0/2400517208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff230107840 0x7ff23010f3c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff22800b0d0 tx=0x7ff22800b3e0 comp rx=0 tx=0).stop 2024-06-02T23:58:34.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.234+0000 7ff234f7e700 1 -- 172.21.15.49:0/2400517208 shutdown_connections 2024-06-02T23:58:34.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.234+0000 7ff234f7e700 1 --2- 172.21.15.49:0/2400517208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff230107840 0x7ff23010f3c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:34.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.234+0000 7ff234f7e700 1 --2- 172.21.15.49:0/2400517208 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff230102740 0x7ff230102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:34.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.234+0000 7ff234f7e700 1 --2- 172.21.15.49:0/2400517208 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2301030f0 0x7ff230107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:34.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.234+0000 7ff234f7e700 1 -- 172.21.15.49:0/2400517208 >> 172.21.15.49:0/2400517208 conn(0x7ff2300795f0 msgr2=0x7ff230079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:34.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.234+0000 7ff234f7e700 1 -- 172.21.15.49:0/2400517208 shutdown_connections 2024-06-02T23:58:34.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.234+0000 7ff234f7e700 1 -- 172.21.15.49:0/2400517208 wait complete. 2024-06-02T23:58:34.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.235+0000 7ff234f7e700 1 Processor -- start 2024-06-02T23:58:34.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.235+0000 7ff234f7e700 1 -- start start 2024-06-02T23:58:34.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.235+0000 7ff234f7e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff230102740 0x7ff230074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:34.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.235+0000 7ff234f7e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2301030f0 0x7ff230074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:34.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.235+0000 7ff234f7e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff230107840 0x7ff230075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:34.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.235+0000 7ff234f7e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff230112760 con 0x7ff230102740 2024-06-02T23:58:34.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.235+0000 7ff234f7e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff2301125e0 con 0x7ff2301030f0 2024-06-02T23:58:34.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.235+0000 7ff234f7e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff2301128e0 con 0x7ff230107840 2024-06-02T23:58:34.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.235+0000 7ff22e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff230102740 0x7ff230074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:34.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.235+0000 7ff22e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff230102740 0x7ff230074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48498/0 (socket says 172.21.15.49:48498) 2024-06-02T23:58:34.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.235+0000 7ff22e59c700 1 -- 172.21.15.49:0/110556254 learned_addr learned my addr 172.21.15.49:0/110556254 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:58:34.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.236+0000 7ff22dd9b700 1 --2- 172.21.15.49:0/110556254 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2301030f0 0x7ff230074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:34.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.236+0000 7ff22ed9d700 1 --2- 172.21.15.49:0/110556254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff230107840 0x7ff230075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:34.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.236+0000 7ff22e59c700 1 -- 172.21.15.49:0/110556254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff230107840 msgr2=0x7ff230075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:34.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.236+0000 7ff22e59c700 1 --2- 172.21.15.49:0/110556254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff230107840 0x7ff230075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:34.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.236+0000 7ff22e59c700 1 -- 172.21.15.49:0/110556254 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2301030f0 msgr2=0x7ff230074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:34.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.236+0000 7ff22e59c700 1 --2- 172.21.15.49:0/110556254 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2301030f0 0x7ff230074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:34.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.236+0000 7ff22e59c700 1 -- 172.21.15.49:0/110556254 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2301a6f40 con 0x7ff230102740 2024-06-02T23:58:34.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.236+0000 7ff22e59c700 1 --2- 172.21.15.49:0/110556254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff230102740 0x7ff230074790 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff22000c9b0 tx=0x7ff22000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:34.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.236+0000 7ff21f7fe700 1 -- 172.21.15.49:0/110556254 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff220007b00 con 0x7ff230102740 2024-06-02T23:58:34.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.236+0000 7ff234f7e700 1 -- 172.21.15.49:0/110556254 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2301a7230 con 0x7ff230102740 2024-06-02T23:58:34.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.236+0000 7ff21f7fe700 1 -- 172.21.15.49:0/110556254 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff220007ca0 con 0x7ff230102740 2024-06-02T23:58:34.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.237+0000 7ff21f7fe700 1 -- 172.21.15.49:0/110556254 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff220018730 con 0x7ff230102740 2024-06-02T23:58:34.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.237+0000 7ff234f7e700 1 -- 172.21.15.49:0/110556254 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2301a77c0 con 0x7ff230102740 2024-06-02T23:58:34.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.237+0000 7ff234f7e700 1 -- 172.21.15.49:0/110556254 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff230100db0 con 0x7ff230102740 2024-06-02T23:58:34.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.239+0000 7ff21f7fe700 1 -- 172.21.15.49:0/110556254 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff2200188d0 con 0x7ff230102740 2024-06-02T23:58:34.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.240+0000 7ff21f7fe700 1 --2- 172.21.15.49:0/110556254 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff2180a2d30 0x7ff2180a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:34.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.240+0000 7ff22dd9b700 1 --2- 172.21.15.49:0/110556254 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff2180a2d30 0x7ff2180a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:34.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.240+0000 7ff21f7fe700 1 -- 172.21.15.49:0/110556254 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7ff2200cf760 con 0x7ff230102740 2024-06-02T23:58:34.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.240+0000 7ff21f7fe700 1 --2- 172.21.15.49:0/110556254 >> [v2:172.21.15.57:6824/3013235811,v1:172.21.15.57:6825/3013235811] conn(0x7ff2180ac8f0 0x7ff2180aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:34.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.240+0000 7ff21f7fe700 1 -- 172.21.15.49:0/110556254 --> [v2:172.21.15.57:6824/3013235811,v1:172.21.15.57:6825/3013235811] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff22001fe50 con 0x7ff2180ac8f0 2024-06-02T23:58:34.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.240+0000 7ff21f7fe700 1 -- 172.21.15.49:0/110556254 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7ff2200cfb90 con 0x7ff230102740 2024-06-02T23:58:34.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.240+0000 7ff22dd9b700 1 --2- 172.21.15.49:0/110556254 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff2180a2d30 0x7ff2180a51f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff230079f80 tx=0x7ff22400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:34.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.241+0000 7ff22ed9d700 1 --2- 172.21.15.49:0/110556254 >> [v2:172.21.15.57:6824/3013235811,v1:172.21.15.57:6825/3013235811] conn(0x7ff2180ac8f0 0x7ff2180aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:34.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.241+0000 7ff22ed9d700 1 --2- 172.21.15.49:0/110556254 >> [v2:172.21.15.57:6824/3013235811,v1:172.21.15.57:6825/3013235811] conn(0x7ff2180ac8f0 0x7ff2180aed90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:34.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.242+0000 7ff21f7fe700 1 -- 172.21.15.49:0/110556254 <== osd.10 v2:172.21.15.57:6824/3013235811 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff22001fe50 con 0x7ff2180ac8f0 2024-06-02T23:58:34.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.260+0000 7ff234f7e700 1 -- 172.21.15.49:0/110556254 --> [v2:172.21.15.57:6824/3013235811,v1:172.21.15.57:6825/3013235811] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff230100fc0 con 0x7ff2180ac8f0 2024-06-02T23:58:34.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.260+0000 7ff21f7fe700 1 -- 172.21.15.49:0/110556254 <== osd.10 v2:172.21.15.57:6824/3013235811 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff230100fc0 con 0x7ff2180ac8f0 2024-06-02T23:58:34.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.261+0000 7ff234f7e700 1 -- 172.21.15.49:0/110556254 >> [v2:172.21.15.57:6824/3013235811,v1:172.21.15.57:6825/3013235811] conn(0x7ff2180ac8f0 msgr2=0x7ff2180aed90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:34.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.261+0000 7ff234f7e700 1 --2- 172.21.15.49:0/110556254 >> [v2:172.21.15.57:6824/3013235811,v1:172.21.15.57:6825/3013235811] conn(0x7ff2180ac8f0 0x7ff2180aed90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:34.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.261+0000 7ff234f7e700 1 -- 172.21.15.49:0/110556254 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff2180a2d30 msgr2=0x7ff2180a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:34.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.261+0000 7ff234f7e700 1 --2- 172.21.15.49:0/110556254 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff2180a2d30 0x7ff2180a51f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff230079f80 tx=0x7ff22400a380 comp rx=0 tx=0).stop 2024-06-02T23:58:34.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.261+0000 7ff234f7e700 1 -- 172.21.15.49:0/110556254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff230102740 msgr2=0x7ff230074790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:34.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.261+0000 7ff234f7e700 1 --2- 172.21.15.49:0/110556254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff230102740 0x7ff230074790 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff22000c9b0 tx=0x7ff22000ccc0 comp rx=0 tx=0).stop 2024-06-02T23:58:34.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.261+0000 7ff22ed9d700 1 -- 172.21.15.49:0/110556254 reap_dead start 2024-06-02T23:58:34.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.261+0000 7ff234f7e700 1 -- 172.21.15.49:0/110556254 shutdown_connections 2024-06-02T23:58:34.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.261+0000 7ff234f7e700 1 -- 172.21.15.49:0/110556254 >> 172.21.15.49:0/110556254 conn(0x7ff2300795f0 msgr2=0x7ff230100350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:34.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.261+0000 7ff234f7e700 1 -- 172.21.15.49:0/110556254 shutdown_connections 2024-06-02T23:58:34.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.261+0000 7ff234f7e700 1 -- 172.21.15.49:0/110556254 wait complete. 2024-06-02T23:58:34.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.471+0000 7fdfe4368700 1 -- 172.21.15.49:0/1374992737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfdc102530 msgr2=0x7fdfdc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:34.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.471+0000 7fdfe4368700 1 --2- 172.21.15.49:0/1374992737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfdc102530 0x7fdfdc1029b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdfd00099c0 tx=0x7fdfd0009cd0 comp rx=0 tx=0).stop 2024-06-02T23:58:34.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.471+0000 7fdfe4368700 1 -- 172.21.15.49:0/1374992737 shutdown_connections 2024-06-02T23:58:34.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.471+0000 7fdfe4368700 1 --2- 172.21.15.49:0/1374992737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfdc102ef0 0x7fdfdc10f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:34.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.471+0000 7fdfe4368700 1 --2- 172.21.15.49:0/1374992737 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfdc1085d0 0x7fdfdc1089b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:34.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.471+0000 7fdfe4368700 1 --2- 172.21.15.49:0/1374992737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfdc102530 0x7fdfdc1029b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:34.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.471+0000 7fdfe4368700 1 -- 172.21.15.49:0/1374992737 >> 172.21.15.49:0/1374992737 conn(0x7fdfdc079640 msgr2=0x7fdfdc079a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:34.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.471+0000 7fdfe4368700 1 -- 172.21.15.49:0/1374992737 shutdown_connections 2024-06-02T23:58:34.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.471+0000 7fdfe4368700 1 -- 172.21.15.49:0/1374992737 wait complete. 2024-06-02T23:58:34.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.472+0000 7fdfe4368700 1 Processor -- start 2024-06-02T23:58:34.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.472+0000 7fdfe4368700 1 -- start start 2024-06-02T23:58:34.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.472+0000 7fdfe4368700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfdc102530 0x7fdfdc19e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:34.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.472+0000 7fdfe4368700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfdc102ef0 0x7fdfdc19ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:34.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.472+0000 7fdfe4368700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfdc1085d0 0x7fdfdc198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:34.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.472+0000 7fdfe4368700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fdfdc1128a0 con 0x7fdfdc102530 2024-06-02T23:58:34.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.472+0000 7fdfe4368700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fdfdc112720 con 0x7fdfdc1085d0 2024-06-02T23:58:34.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.472+0000 7fdfe4368700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fdfdc112a20 con 0x7fdfdc102ef0 2024-06-02T23:58:34.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.472+0000 7fdfe2104700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfdc102530 0x7fdfdc19e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:34.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.472+0000 7fdfe2104700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfdc102530 0x7fdfdc19e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48514/0 (socket says 172.21.15.49:48514) 2024-06-02T23:58:34.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.472+0000 7fdfe2104700 1 -- 172.21.15.49:0/2697814325 learned_addr learned my addr 172.21.15.49:0/2697814325 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:58:34.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.473+0000 7fdfe1903700 1 --2- 172.21.15.49:0/2697814325 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfdc102ef0 0x7fdfdc19ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:34.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.473+0000 7fdfe2905700 1 --2- 172.21.15.49:0/2697814325 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfdc1085d0 0x7fdfdc198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:34.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.473+0000 7fdfe2104700 1 -- 172.21.15.49:0/2697814325 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfdc102ef0 msgr2=0x7fdfdc19ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:34.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.473+0000 7fdfe2104700 1 --2- 172.21.15.49:0/2697814325 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfdc102ef0 0x7fdfdc19ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:34.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.473+0000 7fdfe2104700 1 -- 172.21.15.49:0/2697814325 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfdc1085d0 msgr2=0x7fdfdc198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:34.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.473+0000 7fdfe2104700 1 --2- 172.21.15.49:0/2697814325 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfdc1085d0 0x7fdfdc198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:34.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.473+0000 7fdfe2104700 1 -- 172.21.15.49:0/2697814325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfdc1991c0 con 0x7fdfdc102530 2024-06-02T23:58:34.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.473+0000 7fdfe1903700 1 --2- 172.21.15.49:0/2697814325 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfdc102ef0 0x7fdfdc19ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:34.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.473+0000 7fdfe2104700 1 --2- 172.21.15.49:0/2697814325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfdc102530 0x7fdfdc19e8a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc00e9c0 tx=0x7fdfcc00ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:34.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.473+0000 7fdfdb7fe700 1 -- 172.21.15.49:0/2697814325 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc00cbd0 con 0x7fdfdc102530 2024-06-02T23:58:34.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.473+0000 7fdfe4368700 1 -- 172.21.15.49:0/2697814325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfdc1994b0 con 0x7fdfdc102530 2024-06-02T23:58:34.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.473+0000 7fdfdb7fe700 1 -- 172.21.15.49:0/2697814325 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfcc00cd70 con 0x7fdfdc102530 2024-06-02T23:58:34.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.473+0000 7fdfdb7fe700 1 -- 172.21.15.49:0/2697814325 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc010430 con 0x7fdfdc102530 2024-06-02T23:58:34.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.473+0000 7fdfe4368700 1 -- 172.21.15.49:0/2697814325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfdc0746c0 con 0x7fdfdc102530 2024-06-02T23:58:34.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.474+0000 7fdfd97fa700 1 -- 172.21.15.49:0/2697814325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdfdc062ba0 con 0x7fdfdc102530 2024-06-02T23:58:34.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.476+0000 7fdfdb7fe700 1 -- 172.21.15.49:0/2697814325 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdfcc004750 con 0x7fdfdc102530 2024-06-02T23:58:34.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.476+0000 7fdfdb7fe700 1 --2- 172.21.15.49:0/2697814325 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fdfc40a2cb0 0x7fdfc40a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:34.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.476+0000 7fdfe1903700 1 --2- 172.21.15.49:0/2697814325 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fdfc40a2cb0 0x7fdfc40a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:34.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.476+0000 7fdfdb7fe700 1 -- 172.21.15.49:0/2697814325 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fdfcc0cfa80 con 0x7fdfdc102530 2024-06-02T23:58:34.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.476+0000 7fdfdb7fe700 1 --2- 172.21.15.49:0/2697814325 >> [v2:172.21.15.57:6816/3126027900,v1:172.21.15.57:6817/3126027900] conn(0x7fdfc40ac870 0x7fdfc40aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:34.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.477+0000 7fdfdb7fe700 1 -- 172.21.15.49:0/2697814325 --> [v2:172.21.15.57:6816/3126027900,v1:172.21.15.57:6817/3126027900] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdfc40af3e0 con 0x7fdfc40ac870 2024-06-02T23:58:34.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.477+0000 7fdfdb7fe700 1 -- 172.21.15.49:0/2697814325 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fdfcc0cfeb0 con 0x7fdfdc102530 2024-06-02T23:58:34.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.477+0000 7fdfe1903700 1 --2- 172.21.15.49:0/2697814325 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fdfc40a2cb0 0x7fdfc40a5170 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc079bd0 tx=0x7fdfd0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:34.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.477+0000 7fdfe2905700 1 --2- 172.21.15.49:0/2697814325 >> [v2:172.21.15.57:6816/3126027900,v1:172.21.15.57:6817/3126027900] conn(0x7fdfc40ac870 0x7fdfc40aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:34.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.477+0000 7fdfe2905700 1 --2- 172.21.15.49:0/2697814325 >> [v2:172.21.15.57:6816/3126027900,v1:172.21.15.57:6817/3126027900] conn(0x7fdfc40ac870 0x7fdfc40aed10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:34.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.478+0000 7fdfdb7fe700 1 -- 172.21.15.49:0/2697814325 <== osd.7 v2:172.21.15.57:6816/3126027900 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdfc40af3e0 con 0x7fdfc40ac870 2024-06-02T23:58:34.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.494+0000 7fdfd97fa700 1 -- 172.21.15.49:0/2697814325 --> [v2:172.21.15.57:6816/3126027900,v1:172.21.15.57:6817/3126027900] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdfdc063020 con 0x7fdfc40ac870 2024-06-02T23:58:34.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.495+0000 7fdfdb7fe700 1 -- 172.21.15.49:0/2697814325 <== osd.7 v2:172.21.15.57:6816/3126027900 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdfdc063020 con 0x7fdfc40ac870 2024-06-02T23:58:34.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.495+0000 7fdfd97fa700 1 -- 172.21.15.49:0/2697814325 >> [v2:172.21.15.57:6816/3126027900,v1:172.21.15.57:6817/3126027900] conn(0x7fdfc40ac870 msgr2=0x7fdfc40aed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:34.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.495+0000 7fdfd97fa700 1 --2- 172.21.15.49:0/2697814325 >> [v2:172.21.15.57:6816/3126027900,v1:172.21.15.57:6817/3126027900] conn(0x7fdfc40ac870 0x7fdfc40aed10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:34.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.495+0000 7fdfd97fa700 1 -- 172.21.15.49:0/2697814325 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fdfc40a2cb0 msgr2=0x7fdfc40a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:34.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.496+0000 7fdfd97fa700 1 --2- 172.21.15.49:0/2697814325 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fdfc40a2cb0 0x7fdfc40a5170 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc079bd0 tx=0x7fdfd0005fd0 comp rx=0 tx=0).stop 2024-06-02T23:58:34.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.496+0000 7fdfd97fa700 1 -- 172.21.15.49:0/2697814325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfdc102530 msgr2=0x7fdfdc19e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:34.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.496+0000 7fdfd97fa700 1 --2- 172.21.15.49:0/2697814325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfdc102530 0x7fdfdc19e8a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc00e9c0 tx=0x7fdfcc00ed80 comp rx=0 tx=0).stop 2024-06-02T23:58:34.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.496+0000 7fdfe2905700 1 -- 172.21.15.49:0/2697814325 reap_dead start 2024-06-02T23:58:34.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.496+0000 7fdfd97fa700 1 -- 172.21.15.49:0/2697814325 shutdown_connections 2024-06-02T23:58:34.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.496+0000 7fdfd97fa700 1 -- 172.21.15.49:0/2697814325 >> 172.21.15.49:0/2697814325 conn(0x7fdfdc079640 msgr2=0x7fdfdc101080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:34.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.496+0000 7fdfd97fa700 1 -- 172.21.15.49:0/2697814325 shutdown_connections 2024-06-02T23:58:34.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.496+0000 7fdfd97fa700 1 -- 172.21.15.49:0/2697814325 wait complete. 2024-06-02T23:58:34.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.928+0000 7f61b130d700 1 -- 172.21.15.49:0/2983750093 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61ac101d50 msgr2=0x7f61ac10e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:34.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.928+0000 7f61b130d700 1 --2- 172.21.15.49:0/2983750093 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61ac101d50 0x7f61ac10e240 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f61a400b0a0 tx=0x7f61a400b3b0 comp rx=0 tx=0).stop 2024-06-02T23:58:34.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.928+0000 7f61b130d700 1 -- 172.21.15.49:0/2983750093 shutdown_connections 2024-06-02T23:58:34.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.928+0000 7f61b130d700 1 --2- 172.21.15.49:0/2983750093 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61ac101d50 0x7f61ac10e240 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:34.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.928+0000 7f61b130d700 1 --2- 172.21.15.49:0/2983750093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61ac107400 0x7f61ac1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:34.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.928+0000 7f61b130d700 1 --2- 172.21.15.49:0/2983750093 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61ac101390 0x7f61ac101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:34.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.928+0000 7f61b130d700 1 -- 172.21.15.49:0/2983750093 >> 172.21.15.49:0/2983750093 conn(0x7f61ac078340 msgr2=0x7f61ac078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:34.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.928+0000 7f61b130d700 1 -- 172.21.15.49:0/2983750093 shutdown_connections 2024-06-02T23:58:34.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.928+0000 7f61b130d700 1 -- 172.21.15.49:0/2983750093 wait complete. 2024-06-02T23:58:34.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.929+0000 7f61b130d700 1 Processor -- start 2024-06-02T23:58:34.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.929+0000 7f61b130d700 1 -- start start 2024-06-02T23:58:34.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.929+0000 7f61b130d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61ac101390 0x7f61ac19e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:34.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.929+0000 7f61b130d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61ac101d50 0x7f61ac19ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:34.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.929+0000 7f61b130d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61ac107400 0x7f61ac1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:34.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.929+0000 7f61b130d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f61ac1116a0 con 0x7f61ac101d50 2024-06-02T23:58:34.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.929+0000 7f61b130d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f61ac111520 con 0x7f61ac101390 2024-06-02T23:58:34.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.929+0000 7f61b130d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f61ac111820 con 0x7f61ac107400 2024-06-02T23:58:34.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.930+0000 7f61a27fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61ac101d50 0x7f61ac19ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:34.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.930+0000 7f61a27fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61ac101d50 0x7f61ac19ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48542/0 (socket says 172.21.15.49:48542) 2024-06-02T23:58:34.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.930+0000 7f61a27fc700 1 -- 172.21.15.49:0/126845021 learned_addr learned my addr 172.21.15.49:0/126845021 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:58:34.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.930+0000 7f61aaffd700 1 --2- 172.21.15.49:0/126845021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61ac101390 0x7f61ac19e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:34.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.930+0000 7f61ab7fe700 1 --2- 172.21.15.49:0/126845021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61ac107400 0x7f61ac1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:34.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.930+0000 7f61aaffd700 1 -- 172.21.15.49:0/126845021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61ac107400 msgr2=0x7f61ac1989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:34.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.930+0000 7f61aaffd700 1 --2- 172.21.15.49:0/126845021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61ac107400 0x7f61ac1989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:34.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.930+0000 7f61aaffd700 1 -- 172.21.15.49:0/126845021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61ac101d50 msgr2=0x7f61ac19ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:34.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.930+0000 7f61aaffd700 1 --2- 172.21.15.49:0/126845021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61ac101d50 0x7f61ac19ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:34.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.930+0000 7f61aaffd700 1 -- 172.21.15.49:0/126845021 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61ac199100 con 0x7f61ac101390 2024-06-02T23:58:34.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.930+0000 7f61a27fc700 1 --2- 172.21.15.49:0/126845021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61ac101d50 0x7f61ac19ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:58:34.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.930+0000 7f61aaffd700 1 --2- 172.21.15.49:0/126845021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61ac101390 0x7f61ac19e7e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f619c00e9f0 tx=0x7f619c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:34.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.930+0000 7f61a8ff9700 1 -- 172.21.15.49:0/126845021 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619c00c9c0 con 0x7f61ac101390 2024-06-02T23:58:34.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.930+0000 7f61b130d700 1 -- 172.21.15.49:0/126845021 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61ac1993f0 con 0x7f61ac101390 2024-06-02T23:58:34.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.930+0000 7f61b130d700 1 -- 172.21.15.49:0/126845021 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61ac1a56b0 con 0x7f61ac101390 2024-06-02T23:58:34.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.930+0000 7f61a8ff9700 1 -- 172.21.15.49:0/126845021 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f619c00cb60 con 0x7f61ac101390 2024-06-02T23:58:34.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.930+0000 7f61a8ff9700 1 -- 172.21.15.49:0/126845021 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619c018680 con 0x7f61ac101390 2024-06-02T23:58:34.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.931+0000 7f61b130d700 1 -- 172.21.15.49:0/126845021 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f61ac1054c0 con 0x7f61ac101390 2024-06-02T23:58:34.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.933+0000 7f61a8ff9700 1 -- 172.21.15.49:0/126845021 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f619c010430 con 0x7f61ac101390 2024-06-02T23:58:34.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.934+0000 7f61a8ff9700 1 --2- 172.21.15.49:0/126845021 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f61980a2cb0 0x7f61980a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:34.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.934+0000 7f61a27fc700 1 --2- 172.21.15.49:0/126845021 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f61980a2cb0 0x7f61980a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:34.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.934+0000 7f61a8ff9700 1 -- 172.21.15.49:0/126845021 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f619c0cf6a0 con 0x7f61ac101390 2024-06-02T23:58:34.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.934+0000 7f61a8ff9700 1 --2- 172.21.15.49:0/126845021 >> [v2:172.21.15.107:6824/4217534517,v1:172.21.15.107:6825/4217534517] conn(0x7f61980ac870 0x7f61980aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:34.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.934+0000 7f61a8ff9700 1 -- 172.21.15.49:0/126845021 --> [v2:172.21.15.107:6824/4217534517,v1:172.21.15.107:6825/4217534517] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f619c01bec0 con 0x7f61980ac870 2024-06-02T23:58:34.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.934+0000 7f61a8ff9700 1 -- 172.21.15.49:0/126845021 <== mon.2 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f619c0cfad0 con 0x7f61ac101390 2024-06-02T23:58:34.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.934+0000 7f61a27fc700 1 --2- 172.21.15.49:0/126845021 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f61980a2cb0 0x7f61980a5170 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0ffab0 tx=0x7f619400b480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:34.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.934+0000 7f61ab7fe700 1 --2- 172.21.15.49:0/126845021 >> [v2:172.21.15.107:6824/4217534517,v1:172.21.15.107:6825/4217534517] conn(0x7f61980ac870 0x7f61980aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:34.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.935+0000 7f61ab7fe700 1 --2- 172.21.15.49:0/126845021 >> [v2:172.21.15.107:6824/4217534517,v1:172.21.15.107:6825/4217534517] conn(0x7f61980ac870 0x7f61980aed10 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:34.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.935+0000 7f61a8ff9700 1 -- 172.21.15.49:0/126845021 <== osd.11 v2:172.21.15.107:6824/4217534517 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f619c01bec0 con 0x7f61980ac870 2024-06-02T23:58:34.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.952+0000 7f61b130d700 1 -- 172.21.15.49:0/126845021 --> [v2:172.21.15.107:6824/4217534517,v1:172.21.15.107:6825/4217534517] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f61ac102ab0 con 0x7f61980ac870 2024-06-02T23:58:34.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.952+0000 7f61a8ff9700 1 -- 172.21.15.49:0/126845021 <== osd.11 v2:172.21.15.107:6824/4217534517 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f61ac102ab0 con 0x7f61980ac870 2024-06-02T23:58:34.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.952+0000 7f61b130d700 1 -- 172.21.15.49:0/126845021 >> [v2:172.21.15.107:6824/4217534517,v1:172.21.15.107:6825/4217534517] conn(0x7f61980ac870 msgr2=0x7f61980aed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:34.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.952+0000 7f61b130d700 1 --2- 172.21.15.49:0/126845021 >> [v2:172.21.15.107:6824/4217534517,v1:172.21.15.107:6825/4217534517] conn(0x7f61980ac870 0x7f61980aed10 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:34.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.953+0000 7f61b130d700 1 -- 172.21.15.49:0/126845021 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f61980a2cb0 msgr2=0x7f61980a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:34.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.953+0000 7f61b130d700 1 --2- 172.21.15.49:0/126845021 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f61980a2cb0 0x7f61980a5170 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0ffab0 tx=0x7f619400b480 comp rx=0 tx=0).stop 2024-06-02T23:58:34.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.953+0000 7f61b130d700 1 -- 172.21.15.49:0/126845021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61ac101390 msgr2=0x7f61ac19e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:34.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.953+0000 7f61b130d700 1 --2- 172.21.15.49:0/126845021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61ac101390 0x7f61ac19e7e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f619c00e9f0 tx=0x7f619c00ed00 comp rx=0 tx=0).stop 2024-06-02T23:58:34.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.953+0000 7f61ab7fe700 1 -- 172.21.15.49:0/126845021 reap_dead start 2024-06-02T23:58:34.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.953+0000 7f61b130d700 1 -- 172.21.15.49:0/126845021 shutdown_connections 2024-06-02T23:58:34.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.953+0000 7f61b130d700 1 -- 172.21.15.49:0/126845021 >> 172.21.15.49:0/126845021 conn(0x7f61ac078340 msgr2=0x7f61ac100550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:34.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.953+0000 7f61b130d700 1 -- 172.21.15.49:0/126845021 shutdown_connections 2024-06-02T23:58:34.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:34.953+0000 7f61b130d700 1 -- 172.21.15.49:0/126845021 wait complete. 2024-06-02T23:58:35.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:34 smithi049 ceph-mon[32302]: pgmap v339: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-06-02T23:58:35.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:34 smithi107 ceph-mon[37048]: pgmap v339: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-06-02T23:58:35.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:35 smithi057 ceph-mon[36457]: pgmap v339: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-06-02T23:58:35.467 INFO:teuthology.orchestra.run.smithi049.stdout:309237645349 2024-06-02T23:58:35.467 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-06-02T23:58:36.413 INFO:teuthology.orchestra.run.smithi049.stdout:141733920835 2024-06-02T23:58:36.413 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-06-02T23:58:37.027 INFO:teuthology.orchestra.run.smithi049.stdout:343597383712 2024-06-02T23:58:37.027 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-06-02T23:58:37.252 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:37 smithi057 ceph-mon[36457]: pgmap v340: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-06-02T23:58:37.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:37 smithi107 ceph-mon[37048]: pgmap v340: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-06-02T23:58:37.357 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:37 smithi049 ceph-mon[32302]: pgmap v340: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-06-02T23:58:37.512 INFO:teuthology.orchestra.run.smithi049.stdout:219043332148 2024-06-02T23:58:37.512 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-06-02T23:58:38.111 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:58:38.300 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:58:38.309 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:58:38.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.332+0000 7f0902ffd700 1 -- 172.21.15.49:0/989252770 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f4004230 con 0x7f090410a8b0 2024-06-02T23:58:38.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.332+0000 7f090a374700 1 -- 172.21.15.49:0/989252770 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f090410a8b0 msgr2=0x7f090410e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:38.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.332+0000 7f090a374700 1 --2- 172.21.15.49:0/989252770 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f090410a8b0 0x7f090410e4f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f08f4009990 tx=0x7f08f4009ca0 comp rx=0 tx=0).stop 2024-06-02T23:58:38.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.332+0000 7f090a374700 1 -- 172.21.15.49:0/989252770 shutdown_connections 2024-06-02T23:58:38.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.332+0000 7f090a374700 1 --2- 172.21.15.49:0/989252770 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f090410a8b0 0x7f090410e4f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:38.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.332+0000 7f090a374700 1 --2- 172.21.15.49:0/989252770 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0904109520 0x7f0904109ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:38.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.332+0000 7f090a374700 1 --2- 172.21.15.49:0/989252770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f090410a430 0x7f090410dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:38.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.332+0000 7f090a374700 1 -- 172.21.15.49:0/989252770 >> 172.21.15.49:0/989252770 conn(0x7f090406d600 msgr2=0x7f090406da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:38.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.333+0000 7f090a374700 1 -- 172.21.15.49:0/989252770 shutdown_connections 2024-06-02T23:58:38.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.333+0000 7f090a374700 1 -- 172.21.15.49:0/989252770 wait complete. 2024-06-02T23:58:38.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.334+0000 7f090a374700 1 Processor -- start 2024-06-02T23:58:38.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.334+0000 7f090a374700 1 -- start start 2024-06-02T23:58:38.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.334+0000 7f090a374700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0904109520 0x7f0904118ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:38.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.334+0000 7f090a374700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f090410a430 0x7f0904115f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:38.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.334+0000 7f090a374700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f090410a8b0 0x7f09041164c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:38.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.335+0000 7f090a374700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0904112f00 con 0x7f090410a430 2024-06-02T23:58:38.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.335+0000 7f090a374700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0904112d80 con 0x7f0904109520 2024-06-02T23:58:38.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.335+0000 7f090a374700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0904113080 con 0x7f090410a8b0 2024-06-02T23:58:38.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.335+0000 7f09037fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f090410a430 0x7f0904115f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:38.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.335+0000 7f0908911700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f090410a8b0 0x7f09041164c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:38.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.335+0000 7f09037fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f090410a430 0x7f0904115f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48574/0 (socket says 172.21.15.49:48574) 2024-06-02T23:58:38.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.335+0000 7f09037fe700 1 -- 172.21.15.49:0/1067231643 learned_addr learned my addr 172.21.15.49:0/1067231643 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:58:38.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.335+0000 7f0903fff700 1 --2- 172.21.15.49:0/1067231643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0904109520 0x7f0904118ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:38.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.335+0000 7f0908911700 1 -- 172.21.15.49:0/1067231643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0904109520 msgr2=0x7f0904118ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:38.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.335+0000 7f0908911700 1 --2- 172.21.15.49:0/1067231643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0904109520 0x7f0904118ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:38.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.335+0000 7f0908911700 1 -- 172.21.15.49:0/1067231643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f090410a430 msgr2=0x7f0904115f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:38.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.335+0000 7f0908911700 1 --2- 172.21.15.49:0/1067231643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f090410a430 0x7f0904115f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:38.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.335+0000 7f0908911700 1 -- 172.21.15.49:0/1067231643 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0904116d90 con 0x7f090410a8b0 2024-06-02T23:58:38.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.335+0000 7f09037fe700 1 --2- 172.21.15.49:0/1067231643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f090410a430 0x7f0904115f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:38.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.335+0000 7f0908911700 1 --2- 172.21.15.49:0/1067231643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f090410a8b0 0x7f09041164c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f08f4006010 tx=0x7f08f400b950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:38.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.336+0000 7f09017fa700 1 -- 172.21.15.49:0/1067231643 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f4026070 con 0x7f090410a8b0 2024-06-02T23:58:38.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.336+0000 7f09017fa700 1 -- 172.21.15.49:0/1067231643 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08f4003d70 con 0x7f090410a8b0 2024-06-02T23:58:38.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.336+0000 7f09017fa700 1 -- 172.21.15.49:0/1067231643 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f4021410 con 0x7f090410a8b0 2024-06-02T23:58:38.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.336+0000 7f090a374700 1 -- 172.21.15.49:0/1067231643 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09041b4010 con 0x7f090410a8b0 2024-06-02T23:58:38.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.336+0000 7f090a374700 1 -- 172.21.15.49:0/1067231643 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09041b4410 con 0x7f090410a8b0 2024-06-02T23:58:38.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.337+0000 7f090a374700 1 -- 172.21.15.49:0/1067231643 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f090410e270 con 0x7f090410a8b0 2024-06-02T23:58:38.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.339+0000 7f09017fa700 1 -- 172.21.15.49:0/1067231643 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f08f4029070 con 0x7f090410a8b0 2024-06-02T23:58:38.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.339+0000 7f09017fa700 1 --2- 172.21.15.49:0/1067231643 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f08ec0a2e80 0x7f08ec0a5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:38.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.340+0000 7f09017fa700 1 -- 172.21.15.49:0/1067231643 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f08f40cfd80 con 0x7f090410a8b0 2024-06-02T23:58:38.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.340+0000 7f0903fff700 1 --2- 172.21.15.49:0/1067231643 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f08ec0a2e80 0x7f08ec0a5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:38.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.340+0000 7f09017fa700 1 --2- 172.21.15.49:0/1067231643 >> [v2:172.21.15.107:6816/3620047229,v1:172.21.15.107:6817/3620047229] conn(0x7f08ec0ac910 0x7f08ec0aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:38.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.340+0000 7f09017fa700 1 -- 172.21.15.49:0/1067231643 --> [v2:172.21.15.107:6816/3620047229,v1:172.21.15.107:6817/3620047229] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f08f400eea0 con 0x7f08ec0ac910 2024-06-02T23:58:38.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.340+0000 7f09017fa700 1 -- 172.21.15.49:0/1067231643 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f08f40d23e0 con 0x7f090410a8b0 2024-06-02T23:58:38.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.340+0000 7f09037fe700 1 --2- 172.21.15.49:0/1067231643 >> [v2:172.21.15.107:6816/3620047229,v1:172.21.15.107:6817/3620047229] conn(0x7f08ec0ac910 0x7f08ec0aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:38.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.341+0000 7f0903fff700 1 --2- 172.21.15.49:0/1067231643 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f08ec0a2e80 0x7f08ec0a5340 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f08fc009380 tx=0x7f08fc00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:38.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.341+0000 7f09037fe700 1 --2- 172.21.15.49:0/1067231643 >> [v2:172.21.15.107:6816/3620047229,v1:172.21.15.107:6817/3620047229] conn(0x7f08ec0ac910 0x7f08ec0aedb0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:38.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.342+0000 7f09017fa700 1 -- 172.21.15.49:0/1067231643 <== osd.8 v2:172.21.15.107:6816/3620047229 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f08f400eea0 con 0x7f08ec0ac910 2024-06-02T23:58:38.364 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:58:38.369 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:58:38.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.370+0000 7f090a374700 1 -- 172.21.15.49:0/1067231643 --> [v2:172.21.15.107:6816/3620047229,v1:172.21.15.107:6817/3620047229] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f090406eb90 con 0x7f08ec0ac910 2024-06-02T23:58:38.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.370+0000 7f09017fa700 1 -- 172.21.15.49:0/1067231643 <== osd.8 v2:172.21.15.107:6816/3620047229 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f090406eb90 con 0x7f08ec0ac910 2024-06-02T23:58:38.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.371+0000 7f090a374700 1 -- 172.21.15.49:0/1067231643 >> [v2:172.21.15.107:6816/3620047229,v1:172.21.15.107:6817/3620047229] conn(0x7f08ec0ac910 msgr2=0x7f08ec0aedb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:38.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.371+0000 7f090a374700 1 --2- 172.21.15.49:0/1067231643 >> [v2:172.21.15.107:6816/3620047229,v1:172.21.15.107:6817/3620047229] conn(0x7f08ec0ac910 0x7f08ec0aedb0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:38.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.371+0000 7f090a374700 1 -- 172.21.15.49:0/1067231643 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f08ec0a2e80 msgr2=0x7f08ec0a5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:38.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.371+0000 7f090a374700 1 --2- 172.21.15.49:0/1067231643 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f08ec0a2e80 0x7f08ec0a5340 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f08fc009380 tx=0x7f08fc00b040 comp rx=0 tx=0).stop 2024-06-02T23:58:38.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.371+0000 7f090a374700 1 -- 172.21.15.49:0/1067231643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f090410a8b0 msgr2=0x7f09041164c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:38.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.371+0000 7f090a374700 1 --2- 172.21.15.49:0/1067231643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f090410a8b0 0x7f09041164c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f08f4006010 tx=0x7f08f400b950 comp rx=0 tx=0).stop 2024-06-02T23:58:38.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.371+0000 7f0908911700 1 -- 172.21.15.49:0/1067231643 reap_dead start 2024-06-02T23:58:38.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.371+0000 7f090a374700 1 -- 172.21.15.49:0/1067231643 shutdown_connections 2024-06-02T23:58:38.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.371+0000 7f090a374700 1 -- 172.21.15.49:0/1067231643 >> 172.21.15.49:0/1067231643 conn(0x7f090406d600 msgr2=0x7f09040738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:38.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.371+0000 7f090a374700 1 -- 172.21.15.49:0/1067231643 shutdown_connections 2024-06-02T23:58:38.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:38.371+0000 7f090a374700 1 -- 172.21.15.49:0/1067231643 wait complete. 2024-06-02T23:58:39.002 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:39 smithi049 ceph-mon[32302]: pgmap v341: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-06-02T23:58:39.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:39 smithi107 ceph-mon[37048]: pgmap v341: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-06-02T23:58:39.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:39 smithi057 ceph-mon[36457]: pgmap v341: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-06-02T23:58:41.075 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:41 smithi049 ceph-mon[32302]: pgmap v342: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:58:41.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:41 smithi107 ceph-mon[37048]: pgmap v342: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:58:41.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:41 smithi057 ceph-mon[36457]: pgmap v342: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:58:42.445 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:58:42.445 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:58:42.792 INFO:teuthology.orchestra.run.smithi049.stdout:253403070511 2024-06-02T23:58:42.793 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-06-02T23:58:43.311 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:43 smithi049 ceph-mon[32302]: pgmap v343: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:58:43.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:43 smithi107 ceph-mon[37048]: pgmap v343: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:58:43.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:43 smithi057 ceph-mon[36457]: pgmap v343: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:58:44.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.110+0000 7f6fa6a8c700 1 -- 172.21.15.49:0/3689247959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fa01030f0 msgr2=0x7f6fa0107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:44.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.110+0000 7f6fa6a8c700 1 --2- 172.21.15.49:0/3689247959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fa01030f0 0x7f6fa0107110 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6f900099c0 tx=0x7f6f90009cd0 comp rx=0 tx=0).stop 2024-06-02T23:58:44.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.111+0000 7f6fa6a8c700 1 -- 172.21.15.49:0/3689247959 shutdown_connections 2024-06-02T23:58:44.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.111+0000 7f6fa6a8c700 1 --2- 172.21.15.49:0/3689247959 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fa0107840 0x7f6fa010f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:44.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.111+0000 7f6fa6a8c700 1 --2- 172.21.15.49:0/3689247959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fa0102740 0x7f6fa0102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:44.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.111+0000 7f6fa6a8c700 1 --2- 172.21.15.49:0/3689247959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fa01030f0 0x7f6fa0107110 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:44.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.111+0000 7f6fa6a8c700 1 -- 172.21.15.49:0/3689247959 >> 172.21.15.49:0/3689247959 conn(0x7f6fa00795f0 msgr2=0x7f6fa0079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:44.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.111+0000 7f6fa6a8c700 1 -- 172.21.15.49:0/3689247959 shutdown_connections 2024-06-02T23:58:44.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.111+0000 7f6fa6a8c700 1 -- 172.21.15.49:0/3689247959 wait complete. 2024-06-02T23:58:44.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.111+0000 7f6fa6a8c700 1 Processor -- start 2024-06-02T23:58:44.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.111+0000 7f6fa6a8c700 1 -- start start 2024-06-02T23:58:44.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.111+0000 7f6fa6a8c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fa0102740 0x7f6fa0074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:44.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.111+0000 7f6fa6a8c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fa01030f0 0x7f6fa0074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:44.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.111+0000 7f6fa6a8c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fa0107840 0x7f6fa0075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:44.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.111+0000 7f6fa6a8c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa0112850 con 0x7f6fa01030f0 2024-06-02T23:58:44.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.111+0000 7f6fa6a8c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa01126d0 con 0x7f6fa0102740 2024-06-02T23:58:44.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.111+0000 7f6fa6a8c700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa01129d0 con 0x7f6fa0107840 2024-06-02T23:58:44.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.112+0000 7f6f97fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fa01030f0 0x7f6fa0074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:44.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.112+0000 7f6f97fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fa01030f0 0x7f6fa0074cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57500/0 (socket says 172.21.15.49:57500) 2024-06-02T23:58:44.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.112+0000 7f6f97fff700 1 -- 172.21.15.49:0/2494324831 learned_addr learned my addr 172.21.15.49:0/2494324831 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:58:44.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.112+0000 7f6fa4828700 1 --2- 172.21.15.49:0/2494324831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fa0102740 0x7f6fa0074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:44.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.112+0000 7f6fa5029700 1 --2- 172.21.15.49:0/2494324831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fa0107840 0x7f6fa0075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:44.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.112+0000 7f6f97fff700 1 -- 172.21.15.49:0/2494324831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fa0107840 msgr2=0x7f6fa0075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:44.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.112+0000 7f6f97fff700 1 --2- 172.21.15.49:0/2494324831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fa0107840 0x7f6fa0075210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:44.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.112+0000 7f6f97fff700 1 -- 172.21.15.49:0/2494324831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fa0102740 msgr2=0x7f6fa0074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:44.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.112+0000 7f6f97fff700 1 --2- 172.21.15.49:0/2494324831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fa0102740 0x7f6fa0074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:44.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.112+0000 7f6f97fff700 1 -- 172.21.15.49:0/2494324831 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa01a7220 con 0x7f6fa01030f0 2024-06-02T23:58:44.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.112+0000 7f6fa4828700 1 --2- 172.21.15.49:0/2494324831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fa0102740 0x7f6fa0074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:58:44.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.112+0000 7f6f97fff700 1 --2- 172.21.15.49:0/2494324831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fa01030f0 0x7f6fa0074cd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6f90009fd0 tx=0x7f6f90003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:44.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.112+0000 7f6f95ffb700 1 -- 172.21.15.49:0/2494324831 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f90027070 con 0x7f6fa01030f0 2024-06-02T23:58:44.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.112+0000 7f6fa6a8c700 1 -- 172.21.15.49:0/2494324831 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fa01a74b0 con 0x7f6fa01030f0 2024-06-02T23:58:44.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.112+0000 7f6f95ffb700 1 -- 172.21.15.49:0/2494324831 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f90004150 con 0x7f6fa01030f0 2024-06-02T23:58:44.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.112+0000 7f6f95ffb700 1 -- 172.21.15.49:0/2494324831 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9000f460 con 0x7f6fa01030f0 2024-06-02T23:58:44.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.113+0000 7f6fa6a8c700 1 -- 172.21.15.49:0/2494324831 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fa01a7960 con 0x7f6fa01030f0 2024-06-02T23:58:44.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.113+0000 7f6fa6a8c700 1 -- 172.21.15.49:0/2494324831 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fa0069180 con 0x7f6fa01030f0 2024-06-02T23:58:44.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.115+0000 7f6f95ffb700 1 -- 172.21.15.49:0/2494324831 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6f9002a070 con 0x7f6fa01030f0 2024-06-02T23:58:44.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.115+0000 7f6f95ffb700 1 --2- 172.21.15.49:0/2494324831 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6f880a2cb0 0x7f6f880a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:44.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.116+0000 7f6f95ffb700 1 -- 172.21.15.49:0/2494324831 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f6f900d08b0 con 0x7f6fa01030f0 2024-06-02T23:58:44.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.116+0000 7f6fa4828700 1 --2- 172.21.15.49:0/2494324831 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6f880a2cb0 0x7f6f880a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:44.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.116+0000 7f6fa4828700 1 --2- 172.21.15.49:0/2494324831 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6f880a2cb0 0x7f6f880a5170 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c007eb0 tx=0x7f6f9c0073c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:44.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.119+0000 7f6f95ffb700 1 -- 172.21.15.49:0/2494324831 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6f90031070 con 0x7f6fa01030f0 2024-06-02T23:58:44.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.333+0000 7f6fa6a8c700 1 -- 172.21.15.49:0/2494324831 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6fa010aa80 con 0x7f6fa01030f0 2024-06-02T23:58:44.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.334+0000 7f6f95ffb700 1 -- 172.21.15.49:0/2494324831 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6f90013070 con 0x7f6fa01030f0 2024-06-02T23:58:44.335 INFO:teuthology.orchestra.run.smithi049.stdout:55834574932 2024-06-02T23:58:44.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.336+0000 7f6fa6a8c700 1 -- 172.21.15.49:0/2494324831 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6f880a2cb0 msgr2=0x7f6f880a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:44.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.336+0000 7f6fa6a8c700 1 --2- 172.21.15.49:0/2494324831 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6f880a2cb0 0x7f6f880a5170 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c007eb0 tx=0x7f6f9c0073c0 comp rx=0 tx=0).stop 2024-06-02T23:58:44.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.336+0000 7f6fa6a8c700 1 -- 172.21.15.49:0/2494324831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fa01030f0 msgr2=0x7f6fa0074cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:44.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.336+0000 7f6fa6a8c700 1 --2- 172.21.15.49:0/2494324831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fa01030f0 0x7f6fa0074cd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6f90009fd0 tx=0x7f6f90003730 comp rx=0 tx=0).stop 2024-06-02T23:58:44.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.336+0000 7f6fa6a8c700 1 -- 172.21.15.49:0/2494324831 shutdown_connections 2024-06-02T23:58:44.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.336+0000 7f6fa6a8c700 1 --2- 172.21.15.49:0/2494324831 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6f880a2cb0 0x7f6f880a5170 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:44.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.336+0000 7f6fa6a8c700 1 --2- 172.21.15.49:0/2494324831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fa0107840 0x7f6fa0075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:44.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.336+0000 7f6fa6a8c700 1 --2- 172.21.15.49:0/2494324831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fa0102740 0x7f6fa0074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:44.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.336+0000 7f6fa6a8c700 1 --2- 172.21.15.49:0/2494324831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6fa01030f0 0x7f6fa0074cd0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:44.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.336+0000 7f6fa6a8c700 1 -- 172.21.15.49:0/2494324831 >> 172.21.15.49:0/2494324831 conn(0x7f6fa00795f0 msgr2=0x7f6fa01007a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:44.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.336+0000 7f6fa6a8c700 1 -- 172.21.15.49:0/2494324831 shutdown_connections 2024-06-02T23:58:44.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:44.336+0000 7f6fa6a8c700 1 -- 172.21.15.49:0/2494324831 wait complete. 2024-06-02T23:58:45.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:45 smithi049 ceph-mon[32302]: pgmap v344: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-06-02T23:58:45.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:45 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/2494324831' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-06-02T23:58:45.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:45 smithi107 ceph-mon[37048]: pgmap v344: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-06-02T23:58:45.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:45 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/2494324831' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-06-02T23:58:45.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:45 smithi057 ceph-mon[36457]: pgmap v344: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-06-02T23:58:45.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:45 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/2494324831' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-06-02T23:58:45.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.555+0000 7f5ea5a13700 1 -- 172.21.15.49:0/2898834655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ea0107570 msgr2=0x7f5ea0107950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:45.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.555+0000 7f5ea5a13700 1 --2- 172.21.15.49:0/2898834655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ea0107570 0x7f5ea0107950 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5e90009990 tx=0x7f5e90009ca0 comp rx=0 tx=0).stop 2024-06-02T23:58:45.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.555+0000 7f5ea5a13700 1 -- 172.21.15.49:0/2898834655 shutdown_connections 2024-06-02T23:58:45.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.555+0000 7f5ea5a13700 1 --2- 172.21.15.49:0/2898834655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ea0101810 0x7f5ea010f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:45.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.555+0000 7f5ea5a13700 1 --2- 172.21.15.49:0/2898834655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ea0107570 0x7f5ea0107950 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:45.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.555+0000 7f5ea5a13700 1 --2- 172.21.15.49:0/2898834655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ea0100e50 0x7f5ea01012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:45.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.555+0000 7f5ea5a13700 1 -- 172.21.15.49:0/2898834655 >> 172.21.15.49:0/2898834655 conn(0x7f5ea00766b0 msgr2=0x7f5ea0076ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:45.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.555+0000 7f5ea5a13700 1 -- 172.21.15.49:0/2898834655 shutdown_connections 2024-06-02T23:58:45.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.555+0000 7f5ea5a13700 1 -- 172.21.15.49:0/2898834655 wait complete. 2024-06-02T23:58:45.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.556+0000 7f5ea5a13700 1 Processor -- start 2024-06-02T23:58:45.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.556+0000 7f5ea5a13700 1 -- start start 2024-06-02T23:58:45.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.556+0000 7f5ea5a13700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ea0100e50 0x7f5ea0102030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:45.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.556+0000 7f5ea5a13700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ea0101810 0x7f5ea0102570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:45.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.556+0000 7f5ea5a13700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ea0107570 0x7f5ea0102ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:45.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.557+0000 7f5ea5a13700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea0112880 con 0x7f5ea0101810 2024-06-02T23:58:45.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.557+0000 7f5ea5a13700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea0112700 con 0x7f5ea0100e50 2024-06-02T23:58:45.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.557+0000 7f5ea5a13700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea0112a00 con 0x7f5ea0107570 2024-06-02T23:58:45.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.557+0000 7f5e9e7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ea0101810 0x7f5ea0102570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:45.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.557+0000 7f5e9e7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ea0101810 0x7f5ea0102570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57518/0 (socket says 172.21.15.49:57518) 2024-06-02T23:58:45.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.557+0000 7f5e9e7fc700 1 -- 172.21.15.49:0/4086507798 learned_addr learned my addr 172.21.15.49:0/4086507798 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:58:45.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.557+0000 7f5e9effd700 1 --2- 172.21.15.49:0/4086507798 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ea0100e50 0x7f5ea0102030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:45.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.557+0000 7f5e9f7fe700 1 --2- 172.21.15.49:0/4086507798 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ea0107570 0x7f5ea0102ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:45.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.557+0000 7f5e9e7fc700 1 -- 172.21.15.49:0/4086507798 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ea0107570 msgr2=0x7f5ea0102ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:45.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.557+0000 7f5e9e7fc700 1 --2- 172.21.15.49:0/4086507798 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ea0107570 0x7f5ea0102ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:45.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.557+0000 7f5e9e7fc700 1 -- 172.21.15.49:0/4086507798 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ea0100e50 msgr2=0x7f5ea0102030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:45.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.557+0000 7f5e9e7fc700 1 --2- 172.21.15.49:0/4086507798 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ea0100e50 0x7f5ea0102030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:45.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.557+0000 7f5e9e7fc700 1 -- 172.21.15.49:0/4086507798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea01a71a0 con 0x7f5ea0101810 2024-06-02T23:58:45.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.557+0000 7f5e9e7fc700 1 --2- 172.21.15.49:0/4086507798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ea0101810 0x7f5ea0102570 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400d950 tx=0x7f5e9400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:45.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.557+0000 7f5ea4a11700 1 -- 172.21.15.49:0/4086507798 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e94016070 con 0x7f5ea0101810 2024-06-02T23:58:45.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.557+0000 7f5ea5a13700 1 -- 172.21.15.49:0/4086507798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ea01a7490 con 0x7f5ea0101810 2024-06-02T23:58:45.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.557+0000 7f5ea4a11700 1 -- 172.21.15.49:0/4086507798 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e94009e20 con 0x7f5ea0101810 2024-06-02T23:58:45.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.557+0000 7f5ea4a11700 1 -- 172.21.15.49:0/4086507798 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9400f620 con 0x7f5ea0101810 2024-06-02T23:58:45.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.557+0000 7f5ea5a13700 1 -- 172.21.15.49:0/4086507798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ea01a7a20 con 0x7f5ea0101810 2024-06-02T23:58:45.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.559+0000 7f5ea5a13700 1 -- 172.21.15.49:0/4086507798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ea0069180 con 0x7f5ea0101810 2024-06-02T23:58:45.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.561+0000 7f5ea4a11700 1 -- 172.21.15.49:0/4086507798 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5e94019070 con 0x7f5ea0101810 2024-06-02T23:58:45.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.561+0000 7f5ea4a11700 1 --2- 172.21.15.49:0/4086507798 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f5e880a2cb0 0x7f5e880a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:45.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.562+0000 7f5e9effd700 1 --2- 172.21.15.49:0/4086507798 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f5e880a2cb0 0x7f5e880a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:45.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.562+0000 7f5ea4a11700 1 -- 172.21.15.49:0/4086507798 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f5e940cf130 con 0x7f5ea0101810 2024-06-02T23:58:45.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.562+0000 7f5e9effd700 1 --2- 172.21.15.49:0/4086507798 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f5e880a2cb0 0x7f5e880a5170 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5e9000b5c0 tx=0x7f5e90005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:45.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.565+0000 7f5ea4a11700 1 -- 172.21.15.49:0/4086507798 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5e9409bf30 con 0x7f5ea0101810 2024-06-02T23:58:45.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.772+0000 7f1439ea7700 1 -- 172.21.15.49:0/1887353203 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1434101d40 msgr2=0x7f143410e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:45.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.772+0000 7f1439ea7700 1 --2- 172.21.15.49:0/1887353203 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1434101d40 0x7f143410e200 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f142c00b0a0 tx=0x7f142c00b3b0 comp rx=0 tx=0).stop 2024-06-02T23:58:45.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.772+0000 7f1439ea7700 1 -- 172.21.15.49:0/1887353203 shutdown_connections 2024-06-02T23:58:45.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.772+0000 7f1439ea7700 1 --2- 172.21.15.49:0/1887353203 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1434101d40 0x7f143410e200 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:45.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.772+0000 7f1439ea7700 1 --2- 172.21.15.49:0/1887353203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14341073c0 0x7f14341077a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:45.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.772+0000 7f1439ea7700 1 --2- 172.21.15.49:0/1887353203 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1434101380 0x7f1434101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:45.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.772+0000 7f1439ea7700 1 -- 172.21.15.49:0/1887353203 >> 172.21.15.49:0/1887353203 conn(0x7f1434078330 msgr2=0x7f1434078740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:45.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.772+0000 7f1439ea7700 1 -- 172.21.15.49:0/1887353203 shutdown_connections 2024-06-02T23:58:45.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.772+0000 7f1439ea7700 1 -- 172.21.15.49:0/1887353203 wait complete. 2024-06-02T23:58:45.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.773+0000 7f1439ea7700 1 Processor -- start 2024-06-02T23:58:45.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.773+0000 7f1439ea7700 1 -- start start 2024-06-02T23:58:45.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.773+0000 7f5ea5a13700 1 -- 172.21.15.49:0/4086507798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f5ea01a7d20 con 0x7f5ea0101810 2024-06-02T23:58:45.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.773+0000 7f1439ea7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1434101380 0x7f1434199a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:45.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.773+0000 7f1439ea7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1434101d40 0x7f1434199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:45.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.773+0000 7f1439ea7700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14341073c0 0x7f14341a4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:45.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.773+0000 7f1439ea7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1434111680 con 0x7f1434101380 2024-06-02T23:58:45.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.773+0000 7f1439ea7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1434111500 con 0x7f1434101d40 2024-06-02T23:58:45.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.773+0000 7f1439ea7700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1434111800 con 0x7f14341073c0 2024-06-02T23:58:45.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.774+0000 7f14337fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1434101380 0x7f1434199a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:45.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.774+0000 7f14337fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1434101380 0x7f1434199a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57536/0 (socket says 172.21.15.49:57536) 2024-06-02T23:58:45.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.774+0000 7f14337fe700 1 -- 172.21.15.49:0/1647128151 learned_addr learned my addr 172.21.15.49:0/1647128151 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:58:45.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.774+0000 7f1432ffd700 1 --2- 172.21.15.49:0/1647128151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1434101d40 0x7f1434199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:45.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.774+0000 7f1433fff700 1 --2- 172.21.15.49:0/1647128151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14341073c0 0x7f14341a4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:45.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.774+0000 7f5ea4a11700 1 -- 172.21.15.49:0/4086507798 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f5e9409b830 con 0x7f5ea0101810 2024-06-02T23:58:45.778 INFO:teuthology.orchestra.run.smithi049.stdout:309237645351 2024-06-02T23:58:45.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.774+0000 7f14337fe700 1 -- 172.21.15.49:0/1647128151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14341073c0 msgr2=0x7f14341a4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:45.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.774+0000 7f14337fe700 1 --2- 172.21.15.49:0/1647128151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14341073c0 0x7f14341a4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:45.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.774+0000 7f14337fe700 1 -- 172.21.15.49:0/1647128151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1434101d40 msgr2=0x7f1434199f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:45.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.774+0000 7f14337fe700 1 --2- 172.21.15.49:0/1647128151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1434101d40 0x7f1434199f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:45.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.774+0000 7f14337fe700 1 -- 172.21.15.49:0/1647128151 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14341a5000 con 0x7f1434101380 2024-06-02T23:58:45.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.774+0000 7f1433fff700 1 --2- 172.21.15.49:0/1647128151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14341073c0 0x7f14341a4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:45.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.774+0000 7f14337fe700 1 --2- 172.21.15.49:0/1647128151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1434101380 0x7f1434199a40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f142400d950 tx=0x7f142400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:45.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.774+0000 7f1430ff9700 1 -- 172.21.15.49:0/1647128151 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1424016070 con 0x7f1434101380 2024-06-02T23:58:45.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.774+0000 7f1430ff9700 1 -- 172.21.15.49:0/1647128151 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1424009e20 con 0x7f1434101380 2024-06-02T23:58:45.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.774+0000 7f1439ea7700 1 -- 172.21.15.49:0/1647128151 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14341a5230 con 0x7f1434101380 2024-06-02T23:58:45.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.774+0000 7f1430ff9700 1 -- 172.21.15.49:0/1647128151 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142400f620 con 0x7f1434101380 2024-06-02T23:58:45.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.775+0000 7f1439ea7700 1 -- 172.21.15.49:0/1647128151 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14341a5740 con 0x7f1434101380 2024-06-02T23:58:45.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.776+0000 7f1439ea7700 1 -- 172.21.15.49:0/1647128151 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1434102a70 con 0x7f1434101380 2024-06-02T23:58:45.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.776+0000 7f5ea5a13700 1 -- 172.21.15.49:0/4086507798 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f5e880a2cb0 msgr2=0x7f5e880a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:45.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.776+0000 7f5ea5a13700 1 --2- 172.21.15.49:0/4086507798 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f5e880a2cb0 0x7f5e880a5170 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5e9000b5c0 tx=0x7f5e90005fd0 comp rx=0 tx=0).stop 2024-06-02T23:58:45.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.776+0000 7f5ea5a13700 1 -- 172.21.15.49:0/4086507798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ea0101810 msgr2=0x7f5ea0102570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:45.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.776+0000 7f5ea5a13700 1 --2- 172.21.15.49:0/4086507798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ea0101810 0x7f5ea0102570 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400d950 tx=0x7f5e9400dc60 comp rx=0 tx=0).stop 2024-06-02T23:58:45.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.776+0000 7f5ea5a13700 1 -- 172.21.15.49:0/4086507798 shutdown_connections 2024-06-02T23:58:45.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.776+0000 7f5ea5a13700 1 --2- 172.21.15.49:0/4086507798 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f5e880a2cb0 0x7f5e880a5170 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:45.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.776+0000 7f5ea5a13700 1 --2- 172.21.15.49:0/4086507798 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ea0107570 0x7f5ea0102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:45.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.776+0000 7f5ea5a13700 1 --2- 172.21.15.49:0/4086507798 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ea0100e50 0x7f5ea0102030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:45.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.777+0000 7f5ea5a13700 1 --2- 172.21.15.49:0/4086507798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ea0101810 0x7f5ea0102570 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:45.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.777+0000 7f5ea5a13700 1 -- 172.21.15.49:0/4086507798 >> 172.21.15.49:0/4086507798 conn(0x7f5ea00766b0 msgr2=0x7f5ea00ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:45.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.777+0000 7f5ea5a13700 1 -- 172.21.15.49:0/4086507798 shutdown_connections 2024-06-02T23:58:45.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.777+0000 7f5ea5a13700 1 -- 172.21.15.49:0/4086507798 wait complete. 2024-06-02T23:58:45.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.777+0000 7f1430ff9700 1 -- 172.21.15.49:0/1647128151 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1424019070 con 0x7f1434101380 2024-06-02T23:58:45.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.777+0000 7f1430ff9700 1 --2- 172.21.15.49:0/1647128151 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f141c0a2cb0 0x7f141c0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:45.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.778+0000 7f1430ff9700 1 -- 172.21.15.49:0/1647128151 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f14240ced00 con 0x7f1434101380 2024-06-02T23:58:45.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.778+0000 7f1432ffd700 1 --2- 172.21.15.49:0/1647128151 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f141c0a2cb0 0x7f141c0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:45.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.779+0000 7f1432ffd700 1 --2- 172.21.15.49:0/1647128151 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f141c0a2cb0 0x7f141c0a5170 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1434078910 tx=0x7f142800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:45.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.786+0000 7f1430ff9700 1 -- 172.21.15.49:0/1647128151 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f142409bb00 con 0x7f1434101380 2024-06-02T23:58:45.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.996+0000 7f1439ea7700 1 -- 172.21.15.49:0/1647128151 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f143402dca0 con 0x7f1434101380 2024-06-02T23:58:45.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.996+0000 7f1430ff9700 1 -- 172.21.15.49:0/1647128151 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f142409b400 con 0x7f1434101380 2024-06-02T23:58:45.997 INFO:teuthology.orchestra.run.smithi049.stdout:77309411408 2024-06-02T23:58:45.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.999+0000 7f1439ea7700 1 -- 172.21.15.49:0/1647128151 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f141c0a2cb0 msgr2=0x7f141c0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:45.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.999+0000 7f1439ea7700 1 --2- 172.21.15.49:0/1647128151 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f141c0a2cb0 0x7f141c0a5170 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1434078910 tx=0x7f142800a380 comp rx=0 tx=0).stop 2024-06-02T23:58:46.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.999+0000 7f1439ea7700 1 -- 172.21.15.49:0/1647128151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1434101380 msgr2=0x7f1434199a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:46.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.999+0000 7f1439ea7700 1 --2- 172.21.15.49:0/1647128151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1434101380 0x7f1434199a40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f142400d950 tx=0x7f142400dc60 comp rx=0 tx=0).stop 2024-06-02T23:58:46.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.999+0000 7f1439ea7700 1 -- 172.21.15.49:0/1647128151 shutdown_connections 2024-06-02T23:58:46.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.999+0000 7f1439ea7700 1 --2- 172.21.15.49:0/1647128151 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f141c0a2cb0 0x7f141c0a5170 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:46.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.999+0000 7f1439ea7700 1 --2- 172.21.15.49:0/1647128151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14341073c0 0x7f14341a4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:46.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.999+0000 7f1439ea7700 1 --2- 172.21.15.49:0/1647128151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1434101380 0x7f1434199a40 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:46.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.999+0000 7f1439ea7700 1 --2- 172.21.15.49:0/1647128151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1434101d40 0x7f1434199f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:46.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.999+0000 7f1439ea7700 1 -- 172.21.15.49:0/1647128151 >> 172.21.15.49:0/1647128151 conn(0x7f1434078330 msgr2=0x7f14340ffea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:46.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.999+0000 7f1439ea7700 1 -- 172.21.15.49:0/1647128151 shutdown_connections 2024-06-02T23:58:46.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:45.999+0000 7f1439ea7700 1 -- 172.21.15.49:0/1647128151 wait complete. 2024-06-02T23:58:46.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:46 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/4086507798' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-06-02T23:58:46.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:46 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/1647128151' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-06-02T23:58:46.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:46 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/4086507798' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-06-02T23:58:46.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:46 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/1647128151' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-06-02T23:58:46.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:46 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/4086507798' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-06-02T23:58:46.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:46 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/1647128151' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-06-02T23:58:47.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:47 smithi049 ceph-mon[32302]: pgmap v345: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-06-02T23:58:47.307 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411404 got 77309411408 for osd.2 2024-06-02T23:58:47.308 DEBUG:teuthology.parallel:result is None 2024-06-02T23:58:47.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:47 smithi107 ceph-mon[37048]: pgmap v345: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-06-02T23:58:47.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:47 smithi057 ceph-mon[36457]: pgmap v345: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-06-02T23:58:47.904 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574927 got 55834574932 for osd.1 2024-06-02T23:58:47.904 DEBUG:teuthology.parallel:result is None 2024-06-02T23:58:48.389 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645349 got 309237645351 for osd.10 2024-06-02T23:58:48.389 DEBUG:teuthology.parallel:result is None 2024-06-02T23:58:49.074 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:49 smithi049 ceph-mon[32302]: pgmap v346: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-06-02T23:58:49.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:49 smithi107 ceph-mon[37048]: pgmap v346: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-06-02T23:58:49.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:49 smithi057 ceph-mon[36457]: pgmap v346: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-06-02T23:58:49.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.457+0000 7f400eddd700 1 -- 172.21.15.49:0/105886151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4008108500 msgr2=0x7f40081088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:49.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.457+0000 7f400eddd700 1 --2- 172.21.15.49:0/105886151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4008108500 0x7f40081088e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f400400b0a0 tx=0x7f400400b3b0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.457+0000 7f400eddd700 1 -- 172.21.15.49:0/105886151 shutdown_connections 2024-06-02T23:58:49.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.457+0000 7f400eddd700 1 --2- 172.21.15.49:0/105886151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f400806ab30 0x7f400810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.457+0000 7f400eddd700 1 --2- 172.21.15.49:0/105886151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4008108500 0x7f40081088e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.457+0000 7f400eddd700 1 --2- 172.21.15.49:0/105886151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f400806a170 0x7f400806a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.457+0000 7f400eddd700 1 -- 172.21.15.49:0/105886151 >> 172.21.15.49:0/105886151 conn(0x7f4008078340 msgr2=0x7f4008078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:49.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.457+0000 7f400eddd700 1 -- 172.21.15.49:0/105886151 shutdown_connections 2024-06-02T23:58:49.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.457+0000 7f400eddd700 1 -- 172.21.15.49:0/105886151 wait complete. 2024-06-02T23:58:49.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.458+0000 7f400eddd700 1 Processor -- start 2024-06-02T23:58:49.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.458+0000 7f400eddd700 1 -- start start 2024-06-02T23:58:49.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.458+0000 7f400eddd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f400806a170 0x7f400819e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:49.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.458+0000 7f400eddd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f400806ab30 0x7f400819ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:49.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.458+0000 7f400eddd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4008108500 0x7f4008198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:49.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.458+0000 7f400eddd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4008112760 con 0x7f4008108500 2024-06-02T23:58:49.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.458+0000 7f400eddd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f40081125e0 con 0x7f400806a170 2024-06-02T23:58:49.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.458+0000 7f400eddd700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f40081128e0 con 0x7f400806ab30 2024-06-02T23:58:49.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.459+0000 7f400d37a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4008108500 0x7f4008198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:49.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.459+0000 7f400d37a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4008108500 0x7f4008198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57546/0 (socket says 172.21.15.49:57546) 2024-06-02T23:58:49.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.459+0000 7f400d37a700 1 -- 172.21.15.49:0/900821616 learned_addr learned my addr 172.21.15.49:0/900821616 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:58:49.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.459+0000 7f3ffffff700 1 --2- 172.21.15.49:0/900821616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f400806ab30 0x7f400819ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:49.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.459+0000 7f400cb79700 1 --2- 172.21.15.49:0/900821616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f400806a170 0x7f400819e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:49.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.459+0000 7f400d37a700 1 -- 172.21.15.49:0/900821616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f400806ab30 msgr2=0x7f400819ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:49.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.459+0000 7f400d37a700 1 --2- 172.21.15.49:0/900821616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f400806ab30 0x7f400819ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.459+0000 7f400d37a700 1 -- 172.21.15.49:0/900821616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f400806a170 msgr2=0x7f400819e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:49.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.459+0000 7f400d37a700 1 --2- 172.21.15.49:0/900821616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f400806a170 0x7f400819e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.459+0000 7f400d37a700 1 -- 172.21.15.49:0/900821616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4008199160 con 0x7f4008108500 2024-06-02T23:58:49.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.459+0000 7f400d37a700 1 --2- 172.21.15.49:0/900821616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4008108500 0x7f4008198a00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f400000d980 tx=0x7f400000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:49.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.459+0000 7f3ffdffb700 1 -- 172.21.15.49:0/900821616 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4000016070 con 0x7f4008108500 2024-06-02T23:58:49.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.459+0000 7f400eddd700 1 -- 172.21.15.49:0/900821616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4008199450 con 0x7f4008108500 2024-06-02T23:58:49.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.459+0000 7f3ffdffb700 1 -- 172.21.15.49:0/900821616 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4000004d10 con 0x7f4008108500 2024-06-02T23:58:49.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.459+0000 7f3ffdffb700 1 -- 172.21.15.49:0/900821616 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40000055e0 con 0x7f4008108500 2024-06-02T23:58:49.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.460+0000 7f400eddd700 1 -- 172.21.15.49:0/900821616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40081a5710 con 0x7f4008108500 2024-06-02T23:58:49.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.461+0000 7f400eddd700 1 -- 172.21.15.49:0/900821616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f400810a9e0 con 0x7f4008108500 2024-06-02T23:58:49.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.462+0000 7f3ffdffb700 1 -- 172.21.15.49:0/900821616 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4000004750 con 0x7f4008108500 2024-06-02T23:58:49.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.463+0000 7f3ffdffb700 1 --2- 172.21.15.49:0/900821616 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3ff00a2cb0 0x7f3ff00a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:49.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.463+0000 7f400cb79700 1 --2- 172.21.15.49:0/900821616 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3ff00a2cb0 0x7f3ff00a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:49.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.463+0000 7f3ffdffb700 1 -- 172.21.15.49:0/900821616 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f40000cef80 con 0x7f4008108500 2024-06-02T23:58:49.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.464+0000 7f400cb79700 1 --2- 172.21.15.49:0/900821616 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3ff00a2cb0 0x7f3ff00a5170 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f400400b070 tx=0x7f4004006210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:49.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.468+0000 7f3ffdffb700 1 -- 172.21.15.49:0/900821616 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f400001f020 con 0x7f4008108500 2024-06-02T23:58:49.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.643+0000 7f7fd371d700 1 -- 172.21.15.49:0/2356079432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fcc06a170 msgr2=0x7f7fcc06a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:49.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.643+0000 7f7fd371d700 1 --2- 172.21.15.49:0/2356079432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fcc06a170 0x7f7fcc06a5f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc009990 tx=0x7f7fbc009ca0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.643+0000 7f7fd371d700 1 -- 172.21.15.49:0/2356079432 shutdown_connections 2024-06-02T23:58:49.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.643+0000 7f7fd371d700 1 --2- 172.21.15.49:0/2356079432 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fcc06ab30 0x7f7fcc10f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.643+0000 7f7fd371d700 1 --2- 172.21.15.49:0/2356079432 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fcc108500 0x7f7fcc1088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.643+0000 7f7fd371d700 1 --2- 172.21.15.49:0/2356079432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fcc06a170 0x7f7fcc06a5f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.643+0000 7f7fd371d700 1 -- 172.21.15.49:0/2356079432 >> 172.21.15.49:0/2356079432 conn(0x7f7fcc078340 msgr2=0x7f7fcc078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:49.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.643+0000 7f7fd371d700 1 -- 172.21.15.49:0/2356079432 shutdown_connections 2024-06-02T23:58:49.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.643+0000 7f7fd371d700 1 -- 172.21.15.49:0/2356079432 wait complete. 2024-06-02T23:58:49.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.644+0000 7f7fd371d700 1 Processor -- start 2024-06-02T23:58:49.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.644+0000 7f7fd371d700 1 -- start start 2024-06-02T23:58:49.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.644+0000 7f7fd371d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fcc06a170 0x7f7fcc19ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:49.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.644+0000 7f7fd371d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fcc06ab30 0x7f7fcc19b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:49.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.644+0000 7f7fd371d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fcc108500 0x7f7fcc19f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:49.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.644+0000 7f7fd371d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc112780 con 0x7f7fcc108500 2024-06-02T23:58:49.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.644+0000 7f7fd371d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc112600 con 0x7f7fcc06ab30 2024-06-02T23:58:49.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.644+0000 7f7fd371d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc112900 con 0x7f7fcc06a170 2024-06-02T23:58:49.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.645+0000 7f7fd1cba700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fcc108500 0x7f7fcc19f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:49.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.645+0000 7f7fd1cba700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fcc108500 0x7f7fcc19f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57562/0 (socket says 172.21.15.49:57562) 2024-06-02T23:58:49.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.645+0000 7f7fd1cba700 1 -- 172.21.15.49:0/1669448759 learned_addr learned my addr 172.21.15.49:0/1669448759 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:58:49.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.645+0000 7f7fd0cb8700 1 --2- 172.21.15.49:0/1669448759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fcc06ab30 0x7f7fcc19b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:49.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.645+0000 7f7fd14b9700 1 --2- 172.21.15.49:0/1669448759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fcc06a170 0x7f7fcc19ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:49.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.645+0000 7f7fd1cba700 1 -- 172.21.15.49:0/1669448759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fcc06a170 msgr2=0x7f7fcc19ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:49.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.645+0000 7f7fd1cba700 1 --2- 172.21.15.49:0/1669448759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fcc06a170 0x7f7fcc19ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.645+0000 7f7fd1cba700 1 -- 172.21.15.49:0/1669448759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fcc06ab30 msgr2=0x7f7fcc19b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:49.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.645+0000 7f7fd1cba700 1 --2- 172.21.15.49:0/1669448759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fcc06ab30 0x7f7fcc19b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.645+0000 7f7fd1cba700 1 -- 172.21.15.49:0/1669448759 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fcc19fdf0 con 0x7f7fcc108500 2024-06-02T23:58:49.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.645+0000 7f7fd14b9700 1 --2- 172.21.15.49:0/1669448759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fcc06a170 0x7f7fcc19ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:49.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.645+0000 7f7fd0cb8700 1 --2- 172.21.15.49:0/1669448759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fcc06ab30 0x7f7fcc19b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:49.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.645+0000 7f7fd1cba700 1 --2- 172.21.15.49:0/1669448759 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fcc108500 0x7f7fcc19f6b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400ef30 tx=0x7f7fc400c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:49.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.645+0000 7f7fc27fc700 1 -- 172.21.15.49:0/1669448759 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc40092e0 con 0x7f7fcc108500 2024-06-02T23:58:49.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.646+0000 7f7fd371d700 1 -- 172.21.15.49:0/1669448759 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fcc1a0080 con 0x7f7fcc108500 2024-06-02T23:58:49.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.646+0000 7f7fc27fc700 1 -- 172.21.15.49:0/1669448759 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fc4004bb0 con 0x7f7fcc108500 2024-06-02T23:58:49.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.646+0000 7f7fc27fc700 1 -- 172.21.15.49:0/1669448759 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4004280 con 0x7f7fcc108500 2024-06-02T23:58:49.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.646+0000 7f7fd371d700 1 -- 172.21.15.49:0/1669448759 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fcc1a7960 con 0x7f7fcc108500 2024-06-02T23:58:49.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.647+0000 7f7fd371d700 1 -- 172.21.15.49:0/1669448759 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fcc069180 con 0x7f7fcc108500 2024-06-02T23:58:49.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.648+0000 7f7fc27fc700 1 -- 172.21.15.49:0/1669448759 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7fc401b030 con 0x7f7fcc108500 2024-06-02T23:58:49.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.649+0000 7f7fc27fc700 1 --2- 172.21.15.49:0/1669448759 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7fb80a2d30 0x7f7fb80a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:49.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.650+0000 7f7fd14b9700 1 --2- 172.21.15.49:0/1669448759 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7fb80a2d30 0x7f7fb80a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:49.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.650+0000 7f7fc27fc700 1 -- 172.21.15.49:0/1669448759 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f7fc40cf1d0 con 0x7f7fcc108500 2024-06-02T23:58:49.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.650+0000 7f7fd14b9700 1 --2- 172.21.15.49:0/1669448759 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7fb80a2d30 0x7f7fb80a51f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8009c90 tx=0x7f7fc8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:49.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.657+0000 7f7fc27fc700 1 -- 172.21.15.49:0/1669448759 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7fc4010040 con 0x7f7fcc108500 2024-06-02T23:58:49.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.683+0000 7f400eddd700 1 -- 172.21.15.49:0/900821616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f4008199f30 con 0x7f4008108500 2024-06-02T23:58:49.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.683+0000 7f3ffdffb700 1 -- 172.21.15.49:0/900821616 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f400009bd80 con 0x7f4008108500 2024-06-02T23:58:49.685 INFO:teuthology.orchestra.run.smithi049.stdout:287762808877 2024-06-02T23:58:49.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.686+0000 7f400eddd700 1 -- 172.21.15.49:0/900821616 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3ff00a2cb0 msgr2=0x7f3ff00a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:49.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.686+0000 7f400eddd700 1 --2- 172.21.15.49:0/900821616 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3ff00a2cb0 0x7f3ff00a5170 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f400400b070 tx=0x7f4004006210 comp rx=0 tx=0).stop 2024-06-02T23:58:49.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.686+0000 7f400eddd700 1 -- 172.21.15.49:0/900821616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4008108500 msgr2=0x7f4008198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:49.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.686+0000 7f400eddd700 1 --2- 172.21.15.49:0/900821616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4008108500 0x7f4008198a00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f400000d980 tx=0x7f400000dc90 comp rx=0 tx=0).stop 2024-06-02T23:58:49.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.686+0000 7f400eddd700 1 -- 172.21.15.49:0/900821616 shutdown_connections 2024-06-02T23:58:49.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.686+0000 7f400eddd700 1 --2- 172.21.15.49:0/900821616 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3ff00a2cb0 0x7f3ff00a5170 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.686+0000 7f400eddd700 1 --2- 172.21.15.49:0/900821616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4008108500 0x7f4008198a00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.686+0000 7f400eddd700 1 --2- 172.21.15.49:0/900821616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f400806a170 0x7f400819e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.686+0000 7f400eddd700 1 --2- 172.21.15.49:0/900821616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f400806ab30 0x7f400819ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.686+0000 7f400eddd700 1 -- 172.21.15.49:0/900821616 >> 172.21.15.49:0/900821616 conn(0x7f4008078340 msgr2=0x7f40080ffe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:49.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.686+0000 7f400eddd700 1 -- 172.21.15.49:0/900821616 shutdown_connections 2024-06-02T23:58:49.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.686+0000 7f400eddd700 1 -- 172.21.15.49:0/900821616 wait complete. 2024-06-02T23:58:49.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.880+0000 7f7fd371d700 1 -- 172.21.15.49:0/1669448759 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f7fcc1a7bf0 con 0x7f7fcc108500 2024-06-02T23:58:49.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.880+0000 7f7fc27fc700 1 -- 172.21.15.49:0/1669448759 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7fc401b320 con 0x7f7fcc108500 2024-06-02T23:58:49.881 INFO:teuthology.orchestra.run.smithi049.stdout:107374182475 2024-06-02T23:58:49.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.883+0000 7f7fd371d700 1 -- 172.21.15.49:0/1669448759 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7fb80a2d30 msgr2=0x7f7fb80a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:49.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.883+0000 7f7fd371d700 1 --2- 172.21.15.49:0/1669448759 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7fb80a2d30 0x7f7fb80a51f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8009c90 tx=0x7f7fc8009260 comp rx=0 tx=0).stop 2024-06-02T23:58:49.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.883+0000 7f7fd371d700 1 -- 172.21.15.49:0/1669448759 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fcc108500 msgr2=0x7f7fcc19f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:49.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.883+0000 7f7fd371d700 1 --2- 172.21.15.49:0/1669448759 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fcc108500 0x7f7fcc19f6b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400ef30 tx=0x7f7fc400c450 comp rx=0 tx=0).stop 2024-06-02T23:58:49.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.883+0000 7f7fd371d700 1 -- 172.21.15.49:0/1669448759 shutdown_connections 2024-06-02T23:58:49.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.883+0000 7f7fd371d700 1 --2- 172.21.15.49:0/1669448759 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7fb80a2d30 0x7f7fb80a51f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.883+0000 7f7fd371d700 1 --2- 172.21.15.49:0/1669448759 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fcc108500 0x7f7fcc19f6b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.883+0000 7f7fd371d700 1 --2- 172.21.15.49:0/1669448759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7fcc06a170 0x7f7fcc19ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.883+0000 7f7fd371d700 1 --2- 172.21.15.49:0/1669448759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fcc06ab30 0x7f7fcc19b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.883+0000 7f7fd371d700 1 -- 172.21.15.49:0/1669448759 >> 172.21.15.49:0/1669448759 conn(0x7f7fcc078340 msgr2=0x7f7fcc10d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:49.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.883+0000 7f7fd371d700 1 -- 172.21.15.49:0/1669448759 shutdown_connections 2024-06-02T23:58:49.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:49.883+0000 7f7fd371d700 1 -- 172.21.15.49:0/1669448759 wait complete. 2024-06-02T23:58:50.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:50 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/900821616' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-06-02T23:58:50.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:50 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/1669448759' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-06-02T23:58:50.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:50 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/900821616' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-06-02T23:58:50.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:50 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/1669448759' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-06-02T23:58:50.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:50 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/900821616' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-06-02T23:58:50.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:50 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/1669448759' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-06-02T23:58:51.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:51 smithi049 ceph-mon[32302]: pgmap v347: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:58:51.296 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182471 got 107374182475 for osd.3 2024-06-02T23:58:51.296 DEBUG:teuthology.parallel:result is None 2024-06-02T23:58:51.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:51 smithi107 ceph-mon[37048]: pgmap v347: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:58:51.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:51 smithi057 ceph-mon[36457]: pgmap v347: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:58:52.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.395+0000 7fb5ee0c4700 1 -- 172.21.15.49:0/2821982162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5e8101390 msgr2=0x7fb5e8101810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:52.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.395+0000 7fb5ee0c4700 1 --2- 172.21.15.49:0/2821982162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5e8101390 0x7fb5e8101810 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc009990 tx=0x7fb5dc009ca0 comp rx=0 tx=0).stop 2024-06-02T23:58:52.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.395+0000 7fb5ee0c4700 1 -- 172.21.15.49:0/2821982162 shutdown_connections 2024-06-02T23:58:52.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.395+0000 7fb5ee0c4700 1 --2- 172.21.15.49:0/2821982162 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5e8101d50 0x7fb5e810e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:52.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.395+0000 7fb5ee0c4700 1 --2- 172.21.15.49:0/2821982162 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5e8107400 0x7fb5e81077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:52.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.395+0000 7fb5ee0c4700 1 --2- 172.21.15.49:0/2821982162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5e8101390 0x7fb5e8101810 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:52.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.395+0000 7fb5ee0c4700 1 -- 172.21.15.49:0/2821982162 >> 172.21.15.49:0/2821982162 conn(0x7fb5e8078340 msgr2=0x7fb5e8078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:52.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.395+0000 7fb5ee0c4700 1 -- 172.21.15.49:0/2821982162 shutdown_connections 2024-06-02T23:58:52.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.395+0000 7fb5ee0c4700 1 -- 172.21.15.49:0/2821982162 wait complete. 2024-06-02T23:58:52.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.396+0000 7fb5ee0c4700 1 Processor -- start 2024-06-02T23:58:52.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.396+0000 7fb5ee0c4700 1 -- start start 2024-06-02T23:58:52.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.396+0000 7fb5ee0c4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5e8101390 0x7fb5e819e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:52.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.397+0000 7fb5ee0c4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5e8101d50 0x7fb5e819ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:52.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.397+0000 7fb5ee0c4700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5e8107400 0x7fb5e8198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:52.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.397+0000 7fb5ee0c4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e81116e0 con 0x7fb5e8101390 2024-06-02T23:58:52.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.397+0000 7fb5ee0c4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e8111560 con 0x7fb5e8101d50 2024-06-02T23:58:52.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.397+0000 7fb5ee0c4700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e8111860 con 0x7fb5e8107400 2024-06-02T23:58:52.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.397+0000 7fb5e77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5e8101390 0x7fb5e819e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:52.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.397+0000 7fb5e77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5e8101390 0x7fb5e819e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57582/0 (socket says 172.21.15.49:57582) 2024-06-02T23:58:52.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.397+0000 7fb5e77fe700 1 -- 172.21.15.49:0/885980079 learned_addr learned my addr 172.21.15.49:0/885980079 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:58:52.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.397+0000 7fb5e6ffd700 1 --2- 172.21.15.49:0/885980079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5e8101d50 0x7fb5e819ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:52.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.397+0000 7fb5e7fff700 1 --2- 172.21.15.49:0/885980079 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5e8107400 0x7fb5e8198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:52.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.397+0000 7fb5e77fe700 1 -- 172.21.15.49:0/885980079 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5e8107400 msgr2=0x7fb5e8198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:52.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.397+0000 7fb5e77fe700 1 --2- 172.21.15.49:0/885980079 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5e8107400 0x7fb5e8198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:52.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.397+0000 7fb5e77fe700 1 -- 172.21.15.49:0/885980079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5e8101d50 msgr2=0x7fb5e819ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:52.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.397+0000 7fb5e77fe700 1 --2- 172.21.15.49:0/885980079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5e8101d50 0x7fb5e819ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:52.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.397+0000 7fb5e77fe700 1 -- 172.21.15.49:0/885980079 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e8199240 con 0x7fb5e8101390 2024-06-02T23:58:52.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.397+0000 7fb5e77fe700 1 --2- 172.21.15.49:0/885980079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5e8101390 0x7fb5e819e8d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb5d800d980 tx=0x7fb5d800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:52.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.398+0000 7fb5e4ff9700 1 -- 172.21.15.49:0/885980079 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d8017070 con 0x7fb5e8101390 2024-06-02T23:58:52.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.398+0000 7fb5e4ff9700 1 -- 172.21.15.49:0/885980079 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5d8005020 con 0x7fb5e8101390 2024-06-02T23:58:52.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.398+0000 7fb5ee0c4700 1 -- 172.21.15.49:0/885980079 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e8199530 con 0x7fb5e8101390 2024-06-02T23:58:52.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.398+0000 7fb5e4ff9700 1 -- 172.21.15.49:0/885980079 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d800fbf0 con 0x7fb5e8101390 2024-06-02T23:58:52.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.398+0000 7fb5ee0c4700 1 -- 172.21.15.49:0/885980079 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5e81a57a0 con 0x7fb5e8101390 2024-06-02T23:58:52.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.399+0000 7fb5ee0c4700 1 -- 172.21.15.49:0/885980079 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5e8069180 con 0x7fb5e8101390 2024-06-02T23:58:52.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.400+0000 7fb5e4ff9700 1 -- 172.21.15.49:0/885980079 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb5d80051d0 con 0x7fb5e8101390 2024-06-02T23:58:52.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.400+0000 7fb5e4ff9700 1 --2- 172.21.15.49:0/885980079 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fb5d00a2d30 0x7fb5d00a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:52.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.401+0000 7fb5e6ffd700 1 --2- 172.21.15.49:0/885980079 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fb5d00a2d30 0x7fb5d00a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:52.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.401+0000 7fb5e4ff9700 1 -- 172.21.15.49:0/885980079 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fb5d80cef30 con 0x7fb5e8101390 2024-06-02T23:58:52.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.401+0000 7fb5e6ffd700 1 --2- 172.21.15.49:0/885980079 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fb5d00a2d30 0x7fb5d00a51f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8078940 tx=0x7fb5dc005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:52.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.405+0000 7fb5e4ff9700 1 -- 172.21.15.49:0/885980079 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb5d8020020 con 0x7fb5e8101390 2024-06-02T23:58:52.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.570+0000 7f566f521700 1 -- 172.21.15.49:0/3030498569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5668101390 msgr2=0x7f5668101810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:52.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.570+0000 7f566f521700 1 --2- 172.21.15.49:0/3030498569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5668101390 0x7f5668101810 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5658009990 tx=0x7f5658009ca0 comp rx=0 tx=0).stop 2024-06-02T23:58:52.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.570+0000 7f566f521700 1 -- 172.21.15.49:0/3030498569 shutdown_connections 2024-06-02T23:58:52.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.570+0000 7f566f521700 1 --2- 172.21.15.49:0/3030498569 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5668101d50 0x7f566810e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:52.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.570+0000 7f566f521700 1 --2- 172.21.15.49:0/3030498569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5668107400 0x7f56681077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:52.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.570+0000 7f566f521700 1 --2- 172.21.15.49:0/3030498569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5668101390 0x7f5668101810 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:52.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.570+0000 7f566f521700 1 -- 172.21.15.49:0/3030498569 >> 172.21.15.49:0/3030498569 conn(0x7f5668078340 msgr2=0x7f5668078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:52.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.570+0000 7f566f521700 1 -- 172.21.15.49:0/3030498569 shutdown_connections 2024-06-02T23:58:52.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.570+0000 7f566f521700 1 -- 172.21.15.49:0/3030498569 wait complete. 2024-06-02T23:58:52.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.570+0000 7f566f521700 1 Processor -- start 2024-06-02T23:58:52.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.570+0000 7f566f521700 1 -- start start 2024-06-02T23:58:52.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.571+0000 7f566f521700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5668101390 0x7f566819add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:52.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.571+0000 7f566f521700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5668101d50 0x7f566819b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:52.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.571+0000 7f566f521700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5668107400 0x7f566819f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:52.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.571+0000 7f566f521700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f56681116a0 con 0x7f5668107400 2024-06-02T23:58:52.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.571+0000 7f566f521700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5668111520 con 0x7f5668101d50 2024-06-02T23:58:52.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.571+0000 7f566f521700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5668111820 con 0x7f5668101390 2024-06-02T23:58:52.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.571+0000 7f566dabe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5668107400 0x7f566819f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:52.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.571+0000 7f566dabe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5668107400 0x7f566819f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57608/0 (socket says 172.21.15.49:57608) 2024-06-02T23:58:52.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.571+0000 7f566dabe700 1 -- 172.21.15.49:0/230210692 learned_addr learned my addr 172.21.15.49:0/230210692 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:58:52.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.571+0000 7f566d2bd700 1 --2- 172.21.15.49:0/230210692 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5668101390 0x7f566819add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:52.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.571+0000 7f566cabc700 1 --2- 172.21.15.49:0/230210692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5668101d50 0x7f566819b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:52.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.571+0000 7f566d2bd700 1 -- 172.21.15.49:0/230210692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5668101d50 msgr2=0x7f566819b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:52.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.571+0000 7f566d2bd700 1 --2- 172.21.15.49:0/230210692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5668101d50 0x7f566819b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:52.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.571+0000 7f566d2bd700 1 -- 172.21.15.49:0/230210692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5668107400 msgr2=0x7f566819f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:52.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.571+0000 7f566d2bd700 1 --2- 172.21.15.49:0/230210692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5668107400 0x7f566819f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:52.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.571+0000 7f566d2bd700 1 -- 172.21.15.49:0/230210692 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f566819fde0 con 0x7f5668101390 2024-06-02T23:58:52.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.571+0000 7f566dabe700 1 --2- 172.21.15.49:0/230210692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5668107400 0x7f566819f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:58:52.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.571+0000 7f566d2bd700 1 --2- 172.21.15.49:0/230210692 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5668101390 0x7f566819add0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f566400d950 tx=0x7f566400dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:52.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.572+0000 7f565e7fc700 1 -- 172.21.15.49:0/230210692 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5664016070 con 0x7f5668101390 2024-06-02T23:58:52.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.572+0000 7f566f521700 1 -- 172.21.15.49:0/230210692 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56681a00d0 con 0x7f5668101390 2024-06-02T23:58:52.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.572+0000 7f565e7fc700 1 -- 172.21.15.49:0/230210692 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f566400fd70 con 0x7f5668101390 2024-06-02T23:58:52.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.572+0000 7f565e7fc700 1 -- 172.21.15.49:0/230210692 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f566400e3b0 con 0x7f5668101390 2024-06-02T23:58:52.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.572+0000 7f566f521700 1 -- 172.21.15.49:0/230210692 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56681a7950 con 0x7f5668101390 2024-06-02T23:58:52.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.573+0000 7f566f521700 1 -- 172.21.15.49:0/230210692 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5668069180 con 0x7f5668101390 2024-06-02T23:58:52.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.574+0000 7f565e7fc700 1 -- 172.21.15.49:0/230210692 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5664019070 con 0x7f5668101390 2024-06-02T23:58:52.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.575+0000 7f565e7fc700 1 --2- 172.21.15.49:0/230210692 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f56540a2cb0 0x7f56540a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:52.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.575+0000 7f566cabc700 1 --2- 172.21.15.49:0/230210692 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f56540a2cb0 0x7f56540a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:52.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.575+0000 7f565e7fc700 1 -- 172.21.15.49:0/230210692 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f56640cf060 con 0x7f5668101390 2024-06-02T23:58:52.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.575+0000 7f566cabc700 1 --2- 172.21.15.49:0/230210692 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f56540a2cb0 0x7f56540a5170 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f56580098e0 tx=0x7f5658005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:52.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.578+0000 7f565e7fc700 1 -- 172.21.15.49:0/230210692 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5664010460 con 0x7f5668101390 2024-06-02T23:58:52.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.614+0000 7fb5ee0c4700 1 -- 172.21.15.49:0/885980079 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb5e81a59d0 con 0x7fb5e8101390 2024-06-02T23:58:52.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.614+0000 7fb5e4ff9700 1 -- 172.21.15.49:0/885980079 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb5d809bd30 con 0x7fb5e8101390 2024-06-02T23:58:52.615 INFO:teuthology.orchestra.run.smithi049.stdout:34359738459 2024-06-02T23:58:52.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.616+0000 7fb5ee0c4700 1 -- 172.21.15.49:0/885980079 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fb5d00a2d30 msgr2=0x7fb5d00a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:52.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.616+0000 7fb5ee0c4700 1 --2- 172.21.15.49:0/885980079 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fb5d00a2d30 0x7fb5d00a51f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8078940 tx=0x7fb5dc005fd0 comp rx=0 tx=0).stop 2024-06-02T23:58:52.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.616+0000 7fb5ee0c4700 1 -- 172.21.15.49:0/885980079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5e8101390 msgr2=0x7fb5e819e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:52.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.616+0000 7fb5ee0c4700 1 --2- 172.21.15.49:0/885980079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5e8101390 0x7fb5e819e8d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb5d800d980 tx=0x7fb5d800dc90 comp rx=0 tx=0).stop 2024-06-02T23:58:52.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.616+0000 7fb5ee0c4700 1 -- 172.21.15.49:0/885980079 shutdown_connections 2024-06-02T23:58:52.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.616+0000 7fb5ee0c4700 1 --2- 172.21.15.49:0/885980079 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fb5d00a2d30 0x7fb5d00a51f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:52.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.616+0000 7fb5ee0c4700 1 --2- 172.21.15.49:0/885980079 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5e8107400 0x7fb5e8198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:52.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.616+0000 7fb5ee0c4700 1 --2- 172.21.15.49:0/885980079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5e8101390 0x7fb5e819e8d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:52.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.616+0000 7fb5ee0c4700 1 --2- 172.21.15.49:0/885980079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5e8101d50 0x7fb5e819ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:52.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.616+0000 7fb5ee0c4700 1 -- 172.21.15.49:0/885980079 >> 172.21.15.49:0/885980079 conn(0x7fb5e8078340 msgr2=0x7fb5e8100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:52.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.616+0000 7fb5ee0c4700 1 -- 172.21.15.49:0/885980079 shutdown_connections 2024-06-02T23:58:52.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.616+0000 7fb5ee0c4700 1 -- 172.21.15.49:0/885980079 wait complete. 2024-06-02T23:58:52.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.794+0000 7f566f521700 1 -- 172.21.15.49:0/230210692 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f566819c130 con 0x7f5668101390 2024-06-02T23:58:52.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.794+0000 7f565e7fc700 1 -- 172.21.15.49:0/230210692 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f566409be60 con 0x7f5668101390 2024-06-02T23:58:52.795 INFO:teuthology.orchestra.run.smithi049.stdout:163208757314 2024-06-02T23:58:52.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.797+0000 7f566f521700 1 -- 172.21.15.49:0/230210692 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f56540a2cb0 msgr2=0x7f56540a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:52.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.797+0000 7f566f521700 1 --2- 172.21.15.49:0/230210692 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f56540a2cb0 0x7f56540a5170 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f56580098e0 tx=0x7f5658005960 comp rx=0 tx=0).stop 2024-06-02T23:58:52.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.797+0000 7f566f521700 1 -- 172.21.15.49:0/230210692 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5668101390 msgr2=0x7f566819add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:52.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.797+0000 7f566f521700 1 --2- 172.21.15.49:0/230210692 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5668101390 0x7f566819add0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f566400d950 tx=0x7f566400dc60 comp rx=0 tx=0).stop 2024-06-02T23:58:52.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.797+0000 7f566f521700 1 -- 172.21.15.49:0/230210692 shutdown_connections 2024-06-02T23:58:52.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.797+0000 7f566f521700 1 --2- 172.21.15.49:0/230210692 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f56540a2cb0 0x7f56540a5170 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:52.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.797+0000 7f566f521700 1 --2- 172.21.15.49:0/230210692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5668107400 0x7f566819f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:52.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.797+0000 7f566f521700 1 --2- 172.21.15.49:0/230210692 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5668101390 0x7f566819add0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:52.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.797+0000 7f566f521700 1 --2- 172.21.15.49:0/230210692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5668101d50 0x7f566819b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:52.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.797+0000 7f566f521700 1 -- 172.21.15.49:0/230210692 >> 172.21.15.49:0/230210692 conn(0x7f5668078340 msgr2=0x7f566806a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:52.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.797+0000 7f566f521700 1 -- 172.21.15.49:0/230210692 shutdown_connections 2024-06-02T23:58:52.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:52.797+0000 7f566f521700 1 -- 172.21.15.49:0/230210692 wait complete. 2024-06-02T23:58:53.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:53 smithi049 ceph-mon[32302]: pgmap v348: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:58:53.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:53 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/885980079' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-06-02T23:58:53.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:53 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/230210692' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-06-02T23:58:53.211 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:58:53.212 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:58:53.212 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:58:53.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:53 smithi107 ceph-mon[37048]: pgmap v348: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:58:53.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:53 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/885980079' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-06-02T23:58:53.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:53 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/230210692' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-06-02T23:58:53.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:53 smithi057 ceph-mon[36457]: pgmap v348: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:58:53.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:53 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/885980079' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-06-02T23:58:53.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:53 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/230210692' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-06-02T23:58:53.712 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808872 got 287762808877 for osd.9 2024-06-02T23:58:53.713 DEBUG:teuthology.parallel:result is None 2024-06-02T23:58:54.105 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757307 got 163208757314 for osd.5 2024-06-02T23:58:54.105 DEBUG:teuthology.parallel:result is None 2024-06-02T23:58:54.599 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738454 got 34359738459 for osd.0 2024-06-02T23:58:54.600 DEBUG:teuthology.parallel:result is None 2024-06-02T23:58:55.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.083+0000 7f10d7956700 1 -- 172.21.15.49:0/403929140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d01085c0 msgr2=0x7f10d01089a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:55.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.083+0000 7f10d7956700 1 --2- 172.21.15.49:0/403929140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d01085c0 0x7f10d01089a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f10cc0099c0 tx=0x7f10cc009cd0 comp rx=0 tx=0).stop 2024-06-02T23:58:55.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.083+0000 7f10d7956700 1 -- 172.21.15.49:0/403929140 shutdown_connections 2024-06-02T23:58:55.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.083+0000 7f10d7956700 1 --2- 172.21.15.49:0/403929140 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10d0102ee0 0x7f10d010f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:55.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.083+0000 7f10d7956700 1 --2- 172.21.15.49:0/403929140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d01085c0 0x7f10d01089a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:55.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.083+0000 7f10d7956700 1 --2- 172.21.15.49:0/403929140 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10d0102520 0x7f10d01029a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:55.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.083+0000 7f10d7956700 1 -- 172.21.15.49:0/403929140 >> 172.21.15.49:0/403929140 conn(0x7f10d0079680 msgr2=0x7f10d0079a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:55.086 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:55 smithi049 ceph-mon[32302]: pgmap v349: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-02T23:58:55.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.084+0000 7f10d7956700 1 -- 172.21.15.49:0/403929140 shutdown_connections 2024-06-02T23:58:55.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.085+0000 7f10d7956700 1 -- 172.21.15.49:0/403929140 wait complete. 2024-06-02T23:58:55.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.085+0000 7f10d7956700 1 Processor -- start 2024-06-02T23:58:55.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.086+0000 7f10d7956700 1 -- start start 2024-06-02T23:58:55.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.086+0000 7f10d7956700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10d0102520 0x7f10d0074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:55.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.086+0000 7f10d7956700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10d0102ee0 0x7f10d0074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:55.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.086+0000 7f10d7956700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d01085c0 0x7f10d0075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:55.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.086+0000 7f10d7956700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f10d0112800 con 0x7f10d01085c0 2024-06-02T23:58:55.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.086+0000 7f10d7956700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f10d0112680 con 0x7f10d0102520 2024-06-02T23:58:55.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.086+0000 7f10d7956700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f10d0112980 con 0x7f10d0102ee0 2024-06-02T23:58:55.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.086+0000 7f10d5ef3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d01085c0 0x7f10d0075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:55.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.086+0000 7f10d5ef3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d01085c0 0x7f10d0075210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43492/0 (socket says 172.21.15.49:43492) 2024-06-02T23:58:55.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.086+0000 7f10d5ef3700 1 -- 172.21.15.49:0/993108206 learned_addr learned my addr 172.21.15.49:0/993108206 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:58:55.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.086+0000 7f10d4ef1700 1 --2- 172.21.15.49:0/993108206 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10d0102ee0 0x7f10d0074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:55.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.086+0000 7f10d56f2700 1 --2- 172.21.15.49:0/993108206 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10d0102520 0x7f10d0074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:55.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.086+0000 7f10d5ef3700 1 -- 172.21.15.49:0/993108206 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10d0102ee0 msgr2=0x7f10d0074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:55.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.086+0000 7f10d5ef3700 1 --2- 172.21.15.49:0/993108206 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10d0102ee0 0x7f10d0074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:55.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.086+0000 7f10d5ef3700 1 -- 172.21.15.49:0/993108206 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10d0102520 msgr2=0x7f10d0074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:55.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.087+0000 7f10d5ef3700 1 --2- 172.21.15.49:0/993108206 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10d0102520 0x7f10d0074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:55.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.087+0000 7f10d5ef3700 1 -- 172.21.15.49:0/993108206 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10d01a7140 con 0x7f10d01085c0 2024-06-02T23:58:55.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.087+0000 7f10d56f2700 1 --2- 172.21.15.49:0/993108206 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10d0102520 0x7f10d0074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:58:55.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.087+0000 7f10d5ef3700 1 --2- 172.21.15.49:0/993108206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d01085c0 0x7f10d0075210 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f10c8007ee0 tx=0x7f10c800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:55.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.087+0000 7f10c67fc700 1 -- 172.21.15.49:0/993108206 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c800dbd0 con 0x7f10d01085c0 2024-06-02T23:58:55.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.087+0000 7f10c67fc700 1 -- 172.21.15.49:0/993108206 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10c800dd70 con 0x7f10d01085c0 2024-06-02T23:58:55.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.087+0000 7f10d7956700 1 -- 172.21.15.49:0/993108206 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10d01a7430 con 0x7f10d01085c0 2024-06-02T23:58:55.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.087+0000 7f10c67fc700 1 -- 172.21.15.49:0/993108206 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c8005a60 con 0x7f10d01085c0 2024-06-02T23:58:55.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.087+0000 7f10d7956700 1 -- 172.21.15.49:0/993108206 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10d01a7920 con 0x7f10d01085c0 2024-06-02T23:58:55.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.088+0000 7f10d7956700 1 -- 172.21.15.49:0/993108206 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10d0069180 con 0x7f10d01085c0 2024-06-02T23:58:55.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.090+0000 7f10c67fc700 1 -- 172.21.15.49:0/993108206 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f10c801a020 con 0x7f10d01085c0 2024-06-02T23:58:55.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.090+0000 7f10c67fc700 1 --2- 172.21.15.49:0/993108206 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f10bc0a2cb0 0x7f10bc0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:55.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.090+0000 7f10d56f2700 1 --2- 172.21.15.49:0/993108206 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f10bc0a2cb0 0x7f10bc0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:55.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.090+0000 7f10c67fc700 1 -- 172.21.15.49:0/993108206 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f10c80cef50 con 0x7f10d01085c0 2024-06-02T23:58:55.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.091+0000 7f10d56f2700 1 --2- 172.21.15.49:0/993108206 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f10bc0a2cb0 0x7f10bc0a5170 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f10cc00b580 tx=0x7f10cc009f30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:55.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.094+0000 7f10c67fc700 1 -- 172.21.15.49:0/993108206 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f10c8010070 con 0x7f10d01085c0 2024-06-02T23:58:55.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.335+0000 7f10d7956700 1 -- 172.21.15.49:0/993108206 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f10d002de60 con 0x7f10d01085c0 2024-06-02T23:58:55.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.335+0000 7f10c67fc700 1 -- 172.21.15.49:0/993108206 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f10c809bd50 con 0x7f10d01085c0 2024-06-02T23:58:55.336 INFO:teuthology.orchestra.run.smithi049.stdout:197568495677 2024-06-02T23:58:55.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.337+0000 7f10d7956700 1 -- 172.21.15.49:0/993108206 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f10bc0a2cb0 msgr2=0x7f10bc0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:55.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.337+0000 7f10d7956700 1 --2- 172.21.15.49:0/993108206 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f10bc0a2cb0 0x7f10bc0a5170 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f10cc00b580 tx=0x7f10cc009f30 comp rx=0 tx=0).stop 2024-06-02T23:58:55.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.337+0000 7f10d7956700 1 -- 172.21.15.49:0/993108206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d01085c0 msgr2=0x7f10d0075210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:55.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.337+0000 7f10d7956700 1 --2- 172.21.15.49:0/993108206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d01085c0 0x7f10d0075210 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f10c8007ee0 tx=0x7f10c800d3b0 comp rx=0 tx=0).stop 2024-06-02T23:58:55.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.337+0000 7f10d7956700 1 -- 172.21.15.49:0/993108206 shutdown_connections 2024-06-02T23:58:55.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.337+0000 7f10d7956700 1 --2- 172.21.15.49:0/993108206 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f10bc0a2cb0 0x7f10bc0a5170 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:55.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.337+0000 7f10d7956700 1 --2- 172.21.15.49:0/993108206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d01085c0 0x7f10d0075210 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:55.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.337+0000 7f10d7956700 1 --2- 172.21.15.49:0/993108206 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10d0102520 0x7f10d0074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:55.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.337+0000 7f10d7956700 1 --2- 172.21.15.49:0/993108206 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10d0102ee0 0x7f10d0074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:55.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.337+0000 7f10d7956700 1 -- 172.21.15.49:0/993108206 >> 172.21.15.49:0/993108206 conn(0x7f10d0079680 msgr2=0x7f10d0101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:55.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.337+0000 7f10d7956700 1 -- 172.21.15.49:0/993108206 shutdown_connections 2024-06-02T23:58:55.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:55.337+0000 7f10d7956700 1 -- 172.21.15.49:0/993108206 wait complete. 2024-06-02T23:58:55.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:55 smithi107 ceph-mon[37048]: pgmap v349: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-02T23:58:55.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:55 smithi057 ceph-mon[36457]: pgmap v349: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-02T23:58:55.961 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495673 got 197568495677 for osd.6 2024-06-02T23:58:55.961 DEBUG:teuthology.parallel:result is None 2024-06-02T23:58:56.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:56 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/993108206' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-06-02T23:58:56.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:56 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/993108206' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-06-02T23:58:56.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:56 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/993108206' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-06-02T23:58:57.043 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:58:57.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:57 smithi049 ceph-mon[32302]: pgmap v350: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-06-02T23:58:57.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:57 smithi049 ceph-mon[32302]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-06-02T23:58:57.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:57 smithi107 ceph-mon[37048]: pgmap v350: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-06-02T23:58:57.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:57 smithi107 ceph-mon[37048]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-06-02T23:58:57.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:57 smithi057 ceph-mon[36457]: pgmap v350: 97 pgs: 97 active+clean; 644 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-06-02T23:58:57.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:57 smithi057 ceph-mon[36457]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-06-02T23:58:59.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.143+0000 7f31599dd700 1 -- 172.21.15.49:0/3611714484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3154102e80 msgr2=0x7f315410f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:59.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.143+0000 7f31599dd700 1 --2- 172.21.15.49:0/3611714484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3154102e80 0x7f315410f330 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f314c00b0a0 tx=0x7f314c00b3b0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.143+0000 7f31599dd700 1 -- 172.21.15.49:0/3611714484 shutdown_connections 2024-06-02T23:58:59.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.143+0000 7f31599dd700 1 --2- 172.21.15.49:0/3611714484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3154102e80 0x7f315410f330 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.143+0000 7f31599dd700 1 --2- 172.21.15.49:0/3611714484 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31541084f0 0x7f31541088d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.143+0000 7f31599dd700 1 --2- 172.21.15.49:0/3611714484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31541024e0 0x7f3154102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.143+0000 7f31599dd700 1 -- 172.21.15.49:0/3611714484 >> 172.21.15.49:0/3611714484 conn(0x7f3154079530 msgr2=0x7f3154079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:59.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.143+0000 7f31599dd700 1 -- 172.21.15.49:0/3611714484 shutdown_connections 2024-06-02T23:58:59.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.143+0000 7f31599dd700 1 -- 172.21.15.49:0/3611714484 wait complete. 2024-06-02T23:58:59.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.144+0000 7f31599dd700 1 Processor -- start 2024-06-02T23:58:59.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.144+0000 7f31599dd700 1 -- start start 2024-06-02T23:58:59.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.144+0000 7f31599dd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31541024e0 0x7f315419e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:59.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.144+0000 7f31599dd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3154102e80 0x7f315419ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:59.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.144+0000 7f31599dd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31541084f0 0x7f31541989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:59.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.144+0000 7f31599dd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f31541127f0 con 0x7f3154102e80 2024-06-02T23:58:59.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.144+0000 7f31599dd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3154112670 con 0x7f31541084f0 2024-06-02T23:58:59.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.144+0000 7f31599dd700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3154112970 con 0x7f31541024e0 2024-06-02T23:58:59.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.144+0000 7f31527fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3154102e80 0x7f315419ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:59.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.144+0000 7f31527fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3154102e80 0x7f315419ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43510/0 (socket says 172.21.15.49:43510) 2024-06-02T23:58:59.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.144+0000 7f31527fc700 1 -- 172.21.15.49:0/102283869 learned_addr learned my addr 172.21.15.49:0/102283869 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:58:59.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.144+0000 7f31537fe700 1 --2- 172.21.15.49:0/102283869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31541084f0 0x7f31541989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:59.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.144+0000 7f3152ffd700 1 --2- 172.21.15.49:0/102283869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31541024e0 0x7f315419e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:59.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.144+0000 7f31527fc700 1 -- 172.21.15.49:0/102283869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31541024e0 msgr2=0x7f315419e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:59.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.144+0000 7f31527fc700 1 --2- 172.21.15.49:0/102283869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31541024e0 0x7f315419e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.144+0000 7f31527fc700 1 -- 172.21.15.49:0/102283869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31541084f0 msgr2=0x7f31541989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:59.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.144+0000 7f31527fc700 1 --2- 172.21.15.49:0/102283869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31541084f0 0x7f31541989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.144+0000 7f31527fc700 1 -- 172.21.15.49:0/102283869 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3154199130 con 0x7f3154102e80 2024-06-02T23:58:59.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.145+0000 7f31527fc700 1 --2- 172.21.15.49:0/102283869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3154102e80 0x7f315419ed50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f314800b530 tx=0x7f314800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:59.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.145+0000 7f31589db700 1 -- 172.21.15.49:0/102283869 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3148015020 con 0x7f3154102e80 2024-06-02T23:58:59.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.145+0000 7f31599dd700 1 -- 172.21.15.49:0/102283869 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3154199420 con 0x7f3154102e80 2024-06-02T23:58:59.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.145+0000 7f31589db700 1 -- 172.21.15.49:0/102283869 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3148011d10 con 0x7f3154102e80 2024-06-02T23:58:59.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.145+0000 7f31589db700 1 -- 172.21.15.49:0/102283869 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314800f2e0 con 0x7f3154102e80 2024-06-02T23:58:59.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.145+0000 7f31599dd700 1 -- 172.21.15.49:0/102283869 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31541a56e0 con 0x7f3154102e80 2024-06-02T23:58:59.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.146+0000 7f31599dd700 1 -- 172.21.15.49:0/102283869 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3154069180 con 0x7f3154102e80 2024-06-02T23:58:59.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.147+0000 7f31589db700 1 -- 172.21.15.49:0/102283869 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3148018020 con 0x7f3154102e80 2024-06-02T23:58:59.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.148+0000 7f31589db700 1 --2- 172.21.15.49:0/102283869 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f313c0a2c20 0x7f313c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:59.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.148+0000 7f31589db700 1 -- 172.21.15.49:0/102283869 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f31480cecc0 con 0x7f3154102e80 2024-06-02T23:58:59.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.148+0000 7f3152ffd700 1 --2- 172.21.15.49:0/102283869 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f313c0a2c20 0x7f313c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:59.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.149+0000 7f3152ffd700 1 --2- 172.21.15.49:0/102283869 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f313c0a2c20 0x7f313c0a50e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3144005ea0 tx=0x7f3144005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:59.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.151+0000 7f31589db700 1 -- 172.21.15.49:0/102283869 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f314801f020 con 0x7f3154102e80 2024-06-02T23:58:59.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:58:59 smithi107 ceph-mon[37048]: pgmap v351: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 341 B/s wr, 10 op/s 2024-06-02T23:58:59.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.365+0000 7f31599dd700 1 -- 172.21.15.49:0/102283869 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f315402dca0 con 0x7f3154102e80 2024-06-02T23:58:59.366 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:58:59 smithi049 ceph-mon[32302]: pgmap v351: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 341 B/s wr, 10 op/s 2024-06-02T23:58:59.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.365+0000 7f31589db700 1 -- 172.21.15.49:0/102283869 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f314809bc20 con 0x7f3154102e80 2024-06-02T23:58:59.367 INFO:teuthology.orchestra.run.smithi049.stdout:343597383716 2024-06-02T23:58:59.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.368+0000 7f31599dd700 1 -- 172.21.15.49:0/102283869 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f313c0a2c20 msgr2=0x7f313c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:59.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.368+0000 7f31599dd700 1 --2- 172.21.15.49:0/102283869 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f313c0a2c20 0x7f313c0a50e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3144005ea0 tx=0x7f3144005e30 comp rx=0 tx=0).stop 2024-06-02T23:58:59.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.368+0000 7f31599dd700 1 -- 172.21.15.49:0/102283869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3154102e80 msgr2=0x7f315419ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:59.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.368+0000 7f31599dd700 1 --2- 172.21.15.49:0/102283869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3154102e80 0x7f315419ed50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f314800b530 tx=0x7f314800b840 comp rx=0 tx=0).stop 2024-06-02T23:58:59.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.368+0000 7f31599dd700 1 -- 172.21.15.49:0/102283869 shutdown_connections 2024-06-02T23:58:59.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.368+0000 7f31599dd700 1 --2- 172.21.15.49:0/102283869 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f313c0a2c20 0x7f313c0a50e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.368+0000 7f31599dd700 1 --2- 172.21.15.49:0/102283869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31541084f0 0x7f31541989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.368+0000 7f31599dd700 1 --2- 172.21.15.49:0/102283869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31541024e0 0x7f315419e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.368+0000 7f31599dd700 1 --2- 172.21.15.49:0/102283869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3154102e80 0x7f315419ed50 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.368+0000 7f31599dd700 1 -- 172.21.15.49:0/102283869 >> 172.21.15.49:0/102283869 conn(0x7f3154079530 msgr2=0x7f3154100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:59.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.368+0000 7f31599dd700 1 -- 172.21.15.49:0/102283869 shutdown_connections 2024-06-02T23:58:59.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:58:59.368+0000 7f31599dd700 1 -- 172.21.15.49:0/102283869 wait complete. 2024-06-02T23:58:59.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:58:59 smithi057 ceph-mon[36457]: pgmap v351: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 341 B/s wr, 10 op/s 2024-06-02T23:59:00.340 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:00 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/102283869' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-06-02T23:59:00.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:00 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/102283869' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-06-02T23:59:00.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:00 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/102283869' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-06-02T23:59:01.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.110+0000 7fe3e56b7700 1 -- 172.21.15.49:0/3945247271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3e0101610 msgr2=0x7fe3e01019f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:01.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.110+0000 7fe3e56b7700 1 --2- 172.21.15.49:0/3945247271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3e0101610 0x7fe3e01019f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe3d00099c0 tx=0x7fe3d0009cd0 comp rx=0 tx=0).stop 2024-06-02T23:59:01.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.110+0000 7fe3e56b7700 1 -- 172.21.15.49:0/3945247271 shutdown_connections 2024-06-02T23:59:01.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.110+0000 7fe3e56b7700 1 --2- 172.21.15.49:0/3945247271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3e01066f0 0x7fe3e010e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:01.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.110+0000 7fe3e56b7700 1 --2- 172.21.15.49:0/3945247271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3e0101610 0x7fe3e01019f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:01.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.110+0000 7fe3e56b7700 1 --2- 172.21.15.49:0/3945247271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3e0101fc0 0x7fe3e0106010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:01.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.110+0000 7fe3e56b7700 1 -- 172.21.15.49:0/3945247271 >> 172.21.15.49:0/3945247271 conn(0x7fe3e0078430 msgr2=0x7fe3e0078840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:01.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.110+0000 7fe3e56b7700 1 -- 172.21.15.49:0/3945247271 shutdown_connections 2024-06-02T23:59:01.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.110+0000 7fe3e56b7700 1 -- 172.21.15.49:0/3945247271 wait complete. 2024-06-02T23:59:01.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.111+0000 7fe3e56b7700 1 Processor -- start 2024-06-02T23:59:01.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.111+0000 7fe3e56b7700 1 -- start start 2024-06-02T23:59:01.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.111+0000 7fe3e56b7700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3e0101610 0x7fe3e019e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:01.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.111+0000 7fe3e56b7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3e0101fc0 0x7fe3e019ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:01.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.111+0000 7fe3e56b7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3e01066f0 0x7fe3e01989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:01.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.111+0000 7fe3e56b7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e0112830 con 0x7fe3e01066f0 2024-06-02T23:59:01.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.111+0000 7fe3e56b7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e01126b0 con 0x7fe3e0101fc0 2024-06-02T23:59:01.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.111+0000 7fe3e56b7700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e01129b0 con 0x7fe3e0101610 2024-06-02T23:59:01.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.111+0000 7fe3df7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3e01066f0 0x7fe3e01989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:01.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.111+0000 7fe3df7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3e01066f0 0x7fe3e01989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43526/0 (socket says 172.21.15.49:43526) 2024-06-02T23:59:01.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.111+0000 7fe3df7fe700 1 -- 172.21.15.49:0/2263003923 learned_addr learned my addr 172.21.15.49:0/2263003923 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:01.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.111+0000 7fe3deffd700 1 --2- 172.21.15.49:0/2263003923 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3e0101610 0x7fe3e019e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:01.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.111+0000 7fe3d67fc700 1 --2- 172.21.15.49:0/2263003923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3e0101fc0 0x7fe3e019ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:01.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.112+0000 7fe3df7fe700 1 -- 172.21.15.49:0/2263003923 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3e0101610 msgr2=0x7fe3e019e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:01.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.112+0000 7fe3df7fe700 1 --2- 172.21.15.49:0/2263003923 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3e0101610 0x7fe3e019e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:01.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.112+0000 7fe3df7fe700 1 -- 172.21.15.49:0/2263003923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3e0101fc0 msgr2=0x7fe3e019ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:01.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.112+0000 7fe3df7fe700 1 --2- 172.21.15.49:0/2263003923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3e0101fc0 0x7fe3e019ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:01.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.112+0000 7fe3df7fe700 1 -- 172.21.15.49:0/2263003923 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e0199130 con 0x7fe3e01066f0 2024-06-02T23:59:01.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.112+0000 7fe3df7fe700 1 --2- 172.21.15.49:0/2263003923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3e01066f0 0x7fe3e01989d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800ada0 tx=0x7fe3d800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:01.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.112+0000 7fe3dcff9700 1 -- 172.21.15.49:0/2263003923 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d8017020 con 0x7fe3e01066f0 2024-06-02T23:59:01.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.112+0000 7fe3e56b7700 1 -- 172.21.15.49:0/2263003923 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3e0199420 con 0x7fe3e01066f0 2024-06-02T23:59:01.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.112+0000 7fe3dcff9700 1 -- 172.21.15.49:0/2263003923 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3d800cdb0 con 0x7fe3e01066f0 2024-06-02T23:59:01.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.112+0000 7fe3dcff9700 1 -- 172.21.15.49:0/2263003923 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d80053e0 con 0x7fe3e01066f0 2024-06-02T23:59:01.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.112+0000 7fe3e56b7700 1 -- 172.21.15.49:0/2263003923 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3e01a56e0 con 0x7fe3e01066f0 2024-06-02T23:59:01.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.113+0000 7fe3e56b7700 1 -- 172.21.15.49:0/2263003923 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3e0069180 con 0x7fe3e01066f0 2024-06-02T23:59:01.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.114+0000 7fe3dcff9700 1 -- 172.21.15.49:0/2263003923 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe3d800c8d0 con 0x7fe3e01066f0 2024-06-02T23:59:01.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.115+0000 7fe3dcff9700 1 --2- 172.21.15.49:0/2263003923 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe3cc0a2c20 0x7fe3cc0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:01.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.115+0000 7fe3deffd700 1 --2- 172.21.15.49:0/2263003923 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe3cc0a2c20 0x7fe3cc0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:01.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.115+0000 7fe3dcff9700 1 -- 172.21.15.49:0/2263003923 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fe3d80ced20 con 0x7fe3e01066f0 2024-06-02T23:59:01.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.116+0000 7fe3deffd700 1 --2- 172.21.15.49:0/2263003923 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe3cc0a2c20 0x7fe3cc0a50e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0000c00 tx=0x7fe3d0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:01.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.119+0000 7fe3dcff9700 1 -- 172.21.15.49:0/2263003923 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe3d8021020 con 0x7fe3e01066f0 2024-06-02T23:59:01.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.330+0000 7fe3e56b7700 1 -- 172.21.15.49:0/2263003923 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fe3e002dca0 con 0x7fe3e01066f0 2024-06-02T23:59:01.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.331+0000 7fe3dcff9700 1 -- 172.21.15.49:0/2263003923 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe3d809bd10 con 0x7fe3e01066f0 2024-06-02T23:59:01.331 INFO:teuthology.orchestra.run.smithi049.stdout:253403070516 2024-06-02T23:59:01.331 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:01 smithi049 ceph-mon[32302]: pgmap v352: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 426 B/s wr, 10 op/s 2024-06-02T23:59:01.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.333+0000 7fe3e56b7700 1 -- 172.21.15.49:0/2263003923 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe3cc0a2c20 msgr2=0x7fe3cc0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:01.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.333+0000 7fe3e56b7700 1 --2- 172.21.15.49:0/2263003923 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe3cc0a2c20 0x7fe3cc0a50e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0000c00 tx=0x7fe3d0005fb0 comp rx=0 tx=0).stop 2024-06-02T23:59:01.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.333+0000 7fe3e56b7700 1 -- 172.21.15.49:0/2263003923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3e01066f0 msgr2=0x7fe3e01989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:01.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.333+0000 7fe3e56b7700 1 --2- 172.21.15.49:0/2263003923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3e01066f0 0x7fe3e01989d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800ada0 tx=0x7fe3d800c330 comp rx=0 tx=0).stop 2024-06-02T23:59:01.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.333+0000 7fe3e56b7700 1 -- 172.21.15.49:0/2263003923 shutdown_connections 2024-06-02T23:59:01.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.333+0000 7fe3e56b7700 1 --2- 172.21.15.49:0/2263003923 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe3cc0a2c20 0x7fe3cc0a50e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:01.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.333+0000 7fe3e56b7700 1 --2- 172.21.15.49:0/2263003923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3e01066f0 0x7fe3e01989d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:01.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.333+0000 7fe3e56b7700 1 --2- 172.21.15.49:0/2263003923 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3e0101610 0x7fe3e019e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:01.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.333+0000 7fe3e56b7700 1 --2- 172.21.15.49:0/2263003923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3e0101fc0 0x7fe3e019ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:01.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.333+0000 7fe3e56b7700 1 -- 172.21.15.49:0/2263003923 >> 172.21.15.49:0/2263003923 conn(0x7fe3e0078430 msgr2=0x7fe3e00ff340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:01.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.334+0000 7fe3e56b7700 1 -- 172.21.15.49:0/2263003923 shutdown_connections 2024-06-02T23:59:01.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:01.334+0000 7fe3e56b7700 1 -- 172.21.15.49:0/2263003923 wait complete. 2024-06-02T23:59:01.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:01 smithi107 ceph-mon[37048]: pgmap v352: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 426 B/s wr, 10 op/s 2024-06-02T23:59:01.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:01 smithi057 ceph-mon[36457]: pgmap v352: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 426 B/s wr, 10 op/s 2024-06-02T23:59:02.068 INFO:tasks.cephadm.ceph_manager.ceph:need seq 343597383712 got 343597383716 for osd.11 2024-06-02T23:59:02.069 DEBUG:teuthology.parallel:result is None 2024-06-02T23:59:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.271+0000 7fdbe6ad5700 1 -- 172.21.15.49:0/1399992263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbe006ab30 msgr2=0x7fdbe010f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.271+0000 7fdbe6ad5700 1 --2- 172.21.15.49:0/1399992263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbe006ab30 0x7fdbe010f320 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdbd800b0a0 tx=0x7fdbd800b3b0 comp rx=0 tx=0).stop 2024-06-02T23:59:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.271+0000 7fdbe6ad5700 1 -- 172.21.15.49:0/1399992263 shutdown_connections 2024-06-02T23:59:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.271+0000 7fdbe6ad5700 1 --2- 172.21.15.49:0/1399992263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbe006ab30 0x7fdbe010f320 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.271+0000 7fdbe6ad5700 1 --2- 172.21.15.49:0/1399992263 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbe0108500 0x7fdbe01088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.271+0000 7fdbe6ad5700 1 --2- 172.21.15.49:0/1399992263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbe006a170 0x7fdbe006a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.271+0000 7fdbe6ad5700 1 -- 172.21.15.49:0/1399992263 >> 172.21.15.49:0/1399992263 conn(0x7fdbe0078340 msgr2=0x7fdbe0078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.271+0000 7fdbe6ad5700 1 -- 172.21.15.49:0/1399992263 shutdown_connections 2024-06-02T23:59:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.271+0000 7fdbe6ad5700 1 -- 172.21.15.49:0/1399992263 wait complete. 2024-06-02T23:59:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.271+0000 7fdbe6ad5700 1 Processor -- start 2024-06-02T23:59:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.271+0000 7fdbe6ad5700 1 -- start start 2024-06-02T23:59:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.272+0000 7fdbe6ad5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbe006a170 0x7fdbe019e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.272+0000 7fdbe6ad5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbe006ab30 0x7fdbe019ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.272+0000 7fdbe6ad5700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbe0108500 0x7fdbe0198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.272+0000 7fdbe6ad5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe0112860 con 0x7fdbe006ab30 2024-06-02T23:59:02.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.272+0000 7fdbe6ad5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe01126e0 con 0x7fdbe006a170 2024-06-02T23:59:02.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.272+0000 7fdbe6ad5700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe01129e0 con 0x7fdbe0108500 2024-06-02T23:59:02.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.272+0000 7fdbdffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbe006ab30 0x7fdbe019ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:02.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.272+0000 7fdbdffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbe006ab30 0x7fdbe019ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43544/0 (socket says 172.21.15.49:43544) 2024-06-02T23:59:02.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.272+0000 7fdbdffff700 1 -- 172.21.15.49:0/1380853786 learned_addr learned my addr 172.21.15.49:0/1380853786 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:02.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.272+0000 7fdbe5072700 1 --2- 172.21.15.49:0/1380853786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbe0108500 0x7fdbe0198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:02.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.272+0000 7fdbe4871700 1 --2- 172.21.15.49:0/1380853786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbe006a170 0x7fdbe019e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:02.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.272+0000 7fdbdffff700 1 -- 172.21.15.49:0/1380853786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbe0108500 msgr2=0x7fdbe0198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:02.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.272+0000 7fdbdffff700 1 --2- 172.21.15.49:0/1380853786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbe0108500 0x7fdbe0198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:02.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.272+0000 7fdbdffff700 1 -- 172.21.15.49:0/1380853786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbe006a170 msgr2=0x7fdbe019e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:02.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.272+0000 7fdbdffff700 1 --2- 172.21.15.49:0/1380853786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbe006a170 0x7fdbe019e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:02.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.272+0000 7fdbdffff700 1 -- 172.21.15.49:0/1380853786 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe0199220 con 0x7fdbe006ab30 2024-06-02T23:59:02.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.272+0000 7fdbe5072700 1 --2- 172.21.15.49:0/1380853786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbe0108500 0x7fdbe0198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:59:02.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.272+0000 7fdbdffff700 1 --2- 172.21.15.49:0/1380853786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbe006ab30 0x7fdbe019ee40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc00b530 tx=0x7fdbcc00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:02.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.272+0000 7fdbddffb700 1 -- 172.21.15.49:0/1380853786 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc015020 con 0x7fdbe006ab30 2024-06-02T23:59:02.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.272+0000 7fdbe6ad5700 1 -- 172.21.15.49:0/1380853786 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe0199510 con 0x7fdbe006ab30 2024-06-02T23:59:02.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.272+0000 7fdbddffb700 1 -- 172.21.15.49:0/1380853786 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbcc011d10 con 0x7fdbe006ab30 2024-06-02T23:59:02.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.272+0000 7fdbddffb700 1 -- 172.21.15.49:0/1380853786 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc010e50 con 0x7fdbe006ab30 2024-06-02T23:59:02.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.273+0000 7fdbe6ad5700 1 -- 172.21.15.49:0/1380853786 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbe0101390 con 0x7fdbe006ab30 2024-06-02T23:59:02.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.274+0000 7fdbe6ad5700 1 -- 172.21.15.49:0/1380853786 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbe010a9e0 con 0x7fdbe006ab30 2024-06-02T23:59:02.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.275+0000 7fdbddffb700 1 -- 172.21.15.49:0/1380853786 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fdbcc018020 con 0x7fdbe006ab30 2024-06-02T23:59:02.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.275+0000 7fdbddffb700 1 --2- 172.21.15.49:0/1380853786 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fdbd00a2dc0 0x7fdbd00a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:02.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.275+0000 7fdbe4871700 1 --2- 172.21.15.49:0/1380853786 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fdbd00a2dc0 0x7fdbd00a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:02.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.275+0000 7fdbddffb700 1 -- 172.21.15.49:0/1380853786 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fdbcc0ce8d0 con 0x7fdbe006ab30 2024-06-02T23:59:02.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.276+0000 7fdbe4871700 1 --2- 172.21.15.49:0/1380853786 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fdbd00a2dc0 0x7fdbd00a5280 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4006fd0 tx=0x7fdbd4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:02.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.280+0000 7fdbddffb700 1 -- 172.21.15.49:0/1380853786 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fdbcc01f020 con 0x7fdbe006ab30 2024-06-02T23:59:02.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:02 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/2263003923' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-06-02T23:59:02.357 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:02 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/2263003923' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-06-02T23:59:02.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:02 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/2263003923' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-06-02T23:59:02.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.492+0000 7fdbe6ad5700 1 -- 172.21.15.49:0/1380853786 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fdbe0199ff0 con 0x7fdbe006ab30 2024-06-02T23:59:02.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.493+0000 7fdbddffb700 1 -- 172.21.15.49:0/1380853786 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdbcc09b830 con 0x7fdbe006ab30 2024-06-02T23:59:02.493 INFO:teuthology.orchestra.run.smithi049.stdout:141733920841 2024-06-02T23:59:02.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.495+0000 7fdbe6ad5700 1 -- 172.21.15.49:0/1380853786 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fdbd00a2dc0 msgr2=0x7fdbd00a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:02.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.495+0000 7fdbe6ad5700 1 --2- 172.21.15.49:0/1380853786 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fdbd00a2dc0 0x7fdbd00a5280 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4006fd0 tx=0x7fdbd4008040 comp rx=0 tx=0).stop 2024-06-02T23:59:02.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.495+0000 7fdbe6ad5700 1 -- 172.21.15.49:0/1380853786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbe006ab30 msgr2=0x7fdbe019ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:02.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.495+0000 7fdbe6ad5700 1 --2- 172.21.15.49:0/1380853786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbe006ab30 0x7fdbe019ee40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc00b530 tx=0x7fdbcc00b8f0 comp rx=0 tx=0).stop 2024-06-02T23:59:02.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.495+0000 7fdbe6ad5700 1 -- 172.21.15.49:0/1380853786 shutdown_connections 2024-06-02T23:59:02.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.495+0000 7fdbe6ad5700 1 --2- 172.21.15.49:0/1380853786 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fdbd00a2dc0 0x7fdbd00a5280 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:02.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.495+0000 7fdbe6ad5700 1 --2- 172.21.15.49:0/1380853786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbe0108500 0x7fdbe0198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:02.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.495+0000 7fdbe6ad5700 1 --2- 172.21.15.49:0/1380853786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbe006a170 0x7fdbe019e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:02.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.495+0000 7fdbe6ad5700 1 --2- 172.21.15.49:0/1380853786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbe006ab30 0x7fdbe019ee40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:02.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.495+0000 7fdbe6ad5700 1 -- 172.21.15.49:0/1380853786 >> 172.21.15.49:0/1380853786 conn(0x7fdbe0078340 msgr2=0x7fdbe00ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:02.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.495+0000 7fdbe6ad5700 1 -- 172.21.15.49:0/1380853786 shutdown_connections 2024-06-02T23:59:02.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:02.495+0000 7fdbe6ad5700 1 -- 172.21.15.49:0/1380853786 wait complete. 2024-06-02T23:59:03.192 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920835 got 141733920841 for osd.4 2024-06-02T23:59:03.192 DEBUG:teuthology.parallel:result is None 2024-06-02T23:59:03.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:03 smithi107 ceph-mon[37048]: pgmap v353: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 426 B/s wr, 9 op/s 2024-06-02T23:59:03.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:03 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/1380853786' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-06-02T23:59:03.360 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:03 smithi049 ceph-mon[32302]: pgmap v353: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 426 B/s wr, 9 op/s 2024-06-02T23:59:03.360 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:03 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/1380853786' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-06-02T23:59:03.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:03 smithi057 ceph-mon[36457]: pgmap v353: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 426 B/s wr, 9 op/s 2024-06-02T23:59:03.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:03 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/1380853786' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-06-02T23:59:03.904 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070511 got 253403070516 for osd.8 2024-06-02T23:59:03.905 DEBUG:teuthology.parallel:result is None 2024-06-02T23:59:03.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.570+0000 7f547df03700 1 -- 172.21.15.49:0/3609431414 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5478107400 msgr2=0x7f54781077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:03.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.570+0000 7f547df03700 1 --2- 172.21.15.49:0/3609431414 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5478107400 0x7f54781077e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5468009990 tx=0x7f5468009ca0 comp rx=0 tx=0).stop 2024-06-02T23:59:03.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.570+0000 7f547df03700 1 -- 172.21.15.49:0/3609431414 shutdown_connections 2024-06-02T23:59:03.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.570+0000 7f547df03700 1 --2- 172.21.15.49:0/3609431414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5478101d50 0x7f547810e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:03.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.570+0000 7f547df03700 1 --2- 172.21.15.49:0/3609431414 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5478107400 0x7f54781077e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:03.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.570+0000 7f547df03700 1 --2- 172.21.15.49:0/3609431414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5478101390 0x7f5478101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:03.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.570+0000 7f547df03700 1 -- 172.21.15.49:0/3609431414 >> 172.21.15.49:0/3609431414 conn(0x7f5478078340 msgr2=0x7f5478078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:03.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.570+0000 7f547df03700 1 -- 172.21.15.49:0/3609431414 shutdown_connections 2024-06-02T23:59:03.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.570+0000 7f547df03700 1 -- 172.21.15.49:0/3609431414 wait complete. 2024-06-02T23:59:03.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.571+0000 7f547df03700 1 Processor -- start 2024-06-02T23:59:03.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.571+0000 7f547df03700 1 -- start start 2024-06-02T23:59:03.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.571+0000 7f547df03700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5478101390 0x7f547819ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:03.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.571+0000 7f547df03700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5478101d50 0x7f547819b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:03.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.571+0000 7f547df03700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5478107400 0x7f547819f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:03.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.571+0000 7f547df03700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5478111740 con 0x7f5478107400 2024-06-02T23:59:03.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.571+0000 7f547df03700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f54781115c0 con 0x7f5478101390 2024-06-02T23:59:03.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.571+0000 7f547df03700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f54781118c0 con 0x7f5478101d50 2024-06-02T23:59:03.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.571+0000 7f5477fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5478107400 0x7f547819f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:03.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.571+0000 7f5477fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5478107400 0x7f547819f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57966/0 (socket says 172.21.15.49:57966) 2024-06-02T23:59:03.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.571+0000 7f5477fff700 1 -- 172.21.15.49:0/439559455 learned_addr learned my addr 172.21.15.49:0/439559455 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:03.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.571+0000 7f54777fe700 1 --2- 172.21.15.49:0/439559455 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5478101390 0x7f547819ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:03.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.572+0000 7f5476ffd700 1 --2- 172.21.15.49:0/439559455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5478101d50 0x7f547819b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:03.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.572+0000 7f5477fff700 1 -- 172.21.15.49:0/439559455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5478101d50 msgr2=0x7f547819b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:03.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.572+0000 7f5477fff700 1 --2- 172.21.15.49:0/439559455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5478101d50 0x7f547819b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:03.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.572+0000 7f5477fff700 1 -- 172.21.15.49:0/439559455 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5478101390 msgr2=0x7f547819ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:03.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.572+0000 7f5477fff700 1 --2- 172.21.15.49:0/439559455 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5478101390 0x7f547819ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:03.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.572+0000 7f5477fff700 1 -- 172.21.15.49:0/439559455 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f547819fdf0 con 0x7f5478107400 2024-06-02T23:59:03.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.572+0000 7f5476ffd700 1 --2- 172.21.15.49:0/439559455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5478101d50 0x7f547819b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:59:03.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.572+0000 7f5477fff700 1 --2- 172.21.15.49:0/439559455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5478107400 0x7f547819f6b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f547000b970 tx=0x7f547000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:03.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.572+0000 7f5474ff9700 1 -- 172.21.15.49:0/439559455 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5470019070 con 0x7f5478107400 2024-06-02T23:59:03.989 INFO:teuthology.orchestra.run.smithi049.stdout:219043332153 2024-06-02T23:59:03.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.572+0000 7f5474ff9700 1 -- 172.21.15.49:0/439559455 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f547000ce10 con 0x7f5478107400 2024-06-02T23:59:03.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.572+0000 7f547df03700 1 -- 172.21.15.49:0/439559455 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54781a00e0 con 0x7f5478107400 2024-06-02T23:59:03.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.572+0000 7f5474ff9700 1 -- 172.21.15.49:0/439559455 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5470007370 con 0x7f5478107400 2024-06-02T23:59:03.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.572+0000 7f547df03700 1 -- 172.21.15.49:0/439559455 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54781a7960 con 0x7f5478107400 2024-06-02T23:59:03.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.573+0000 7f547df03700 1 -- 172.21.15.49:0/439559455 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5478069180 con 0x7f5478107400 2024-06-02T23:59:03.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.574+0000 7f5474ff9700 1 -- 172.21.15.49:0/439559455 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f547001c070 con 0x7f5478107400 2024-06-02T23:59:03.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.575+0000 7f5474ff9700 1 --2- 172.21.15.49:0/439559455 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f54600a2c20 0x7f54600a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:03.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.575+0000 7f54777fe700 1 --2- 172.21.15.49:0/439559455 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f54600a2c20 0x7f54600a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:03.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.575+0000 7f5474ff9700 1 -- 172.21.15.49:0/439559455 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f54700ce3b0 con 0x7f5478107400 2024-06-02T23:59:03.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.575+0000 7f54777fe700 1 --2- 172.21.15.49:0/439559455 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f54600a2c20 0x7f54600a50e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5468009750 tx=0x7f5468005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:03.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.579+0000 7f5474ff9700 1 -- 172.21.15.49:0/439559455 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f547009b310 con 0x7f5478107400 2024-06-02T23:59:03.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.787+0000 7f547df03700 1 -- 172.21.15.49:0/439559455 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f54781a7b90 con 0x7f5478107400 2024-06-02T23:59:03.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.788+0000 7f5474ff9700 1 -- 172.21.15.49:0/439559455 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f547009ac10 con 0x7f5478107400 2024-06-02T23:59:03.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.790+0000 7f547df03700 1 -- 172.21.15.49:0/439559455 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f54600a2c20 msgr2=0x7f54600a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:03.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.790+0000 7f547df03700 1 --2- 172.21.15.49:0/439559455 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f54600a2c20 0x7f54600a50e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5468009750 tx=0x7f5468005fd0 comp rx=0 tx=0).stop 2024-06-02T23:59:03.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.790+0000 7f547df03700 1 -- 172.21.15.49:0/439559455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5478107400 msgr2=0x7f547819f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:03.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.790+0000 7f547df03700 1 --2- 172.21.15.49:0/439559455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5478107400 0x7f547819f6b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f547000b970 tx=0x7f547000bc80 comp rx=0 tx=0).stop 2024-06-02T23:59:03.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.790+0000 7f547df03700 1 -- 172.21.15.49:0/439559455 shutdown_connections 2024-06-02T23:59:03.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.790+0000 7f547df03700 1 --2- 172.21.15.49:0/439559455 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f54600a2c20 0x7f54600a50e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:03.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.790+0000 7f547df03700 1 --2- 172.21.15.49:0/439559455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5478107400 0x7f547819f6b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:03.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.790+0000 7f547df03700 1 --2- 172.21.15.49:0/439559455 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5478101390 0x7f547819ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:03.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.790+0000 7f547df03700 1 --2- 172.21.15.49:0/439559455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5478101d50 0x7f547819b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:03.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.790+0000 7f547df03700 1 -- 172.21.15.49:0/439559455 >> 172.21.15.49:0/439559455 conn(0x7f5478078340 msgr2=0x7f547806a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:03.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.790+0000 7f547df03700 1 -- 172.21.15.49:0/439559455 shutdown_connections 2024-06-02T23:59:03.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:03.790+0000 7f547df03700 1 -- 172.21.15.49:0/439559455 wait complete. 2024-06-02T23:59:04.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:04 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/439559455' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-06-02T23:59:04.360 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:04 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/439559455' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-06-02T23:59:04.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:04 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/439559455' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-06-02T23:59:04.657 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332148 got 219043332153 for osd.7 2024-06-02T23:59:04.657 DEBUG:teuthology.parallel:result is None 2024-06-02T23:59:04.658 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-06-02T23:59:04.658 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-06-02T23:59:04.916 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:59:05.302 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:05 smithi049 ceph-mon[32302]: pgmap v354: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 11 op/s 2024-06-02T23:59:05.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:05 smithi107 ceph-mon[37048]: pgmap v354: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 11 op/s 2024-06-02T23:59:05.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:05 smithi057 ceph-mon[36457]: pgmap v354: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 11 op/s 2024-06-02T23:59:06.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.540+0000 7f929199b700 1 -- 172.21.15.49:0/828666965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f928c06aba0 msgr2=0x7f928c06af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:06.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.540+0000 7f929199b700 1 --2- 172.21.15.49:0/828666965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f928c06aba0 0x7f928c06af80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f927c009990 tx=0x7f927c009ca0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.540+0000 7f929199b700 1 -- 172.21.15.49:0/828666965 shutdown_connections 2024-06-02T23:59:06.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.540+0000 7f929199b700 1 --2- 172.21.15.49:0/828666965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f928c10efd0 0x7f928c1113c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.540+0000 7f929199b700 1 --2- 172.21.15.49:0/828666965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f928c06aba0 0x7f928c06af80 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.540+0000 7f929199b700 1 --2- 172.21.15.49:0/828666965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f928c06b4c0 0x7f928c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.540+0000 7f929199b700 1 -- 172.21.15.49:0/828666965 >> 172.21.15.49:0/828666965 conn(0x7f928c0773e0 msgr2=0x7f928c0777f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:06.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.540+0000 7f929199b700 1 -- 172.21.15.49:0/828666965 shutdown_connections 2024-06-02T23:59:06.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.541+0000 7f929199b700 1 -- 172.21.15.49:0/828666965 wait complete. 2024-06-02T23:59:06.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.541+0000 7f929199b700 1 Processor -- start 2024-06-02T23:59:06.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.541+0000 7f929199b700 1 -- start start 2024-06-02T23:59:06.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.541+0000 7f929199b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f928c06aba0 0x7f928c19aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:06.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.541+0000 7f929199b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f928c06b4c0 0x7f928c19b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:06.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.542+0000 7f929199b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f928c10efd0 0x7f928c19f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:06.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.542+0000 7f929199b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f928c114a10 con 0x7f928c06b4c0 2024-06-02T23:59:06.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.542+0000 7f929199b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f928c114890 con 0x7f928c10efd0 2024-06-02T23:59:06.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.542+0000 7f929199b700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f928c114b90 con 0x7f928c06aba0 2024-06-02T23:59:06.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.542+0000 7f928a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f928c06b4c0 0x7f928c19b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:06.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.542+0000 7f928a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f928c06b4c0 0x7f928c19b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57996/0 (socket says 172.21.15.49:57996) 2024-06-02T23:59:06.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.542+0000 7f928a7fc700 1 -- 172.21.15.49:0/1604439774 learned_addr learned my addr 172.21.15.49:0/1604439774 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:06.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.542+0000 7f928b7fe700 1 --2- 172.21.15.49:0/1604439774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f928c10efd0 0x7f928c19f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:06.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.542+0000 7f928affd700 1 --2- 172.21.15.49:0/1604439774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f928c06aba0 0x7f928c19aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:06.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.542+0000 7f928a7fc700 1 -- 172.21.15.49:0/1604439774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f928c06aba0 msgr2=0x7f928c19aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:06.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.542+0000 7f928a7fc700 1 --2- 172.21.15.49:0/1604439774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f928c06aba0 0x7f928c19aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.542+0000 7f928a7fc700 1 -- 172.21.15.49:0/1604439774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f928c10efd0 msgr2=0x7f928c19f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:06.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.542+0000 7f928a7fc700 1 --2- 172.21.15.49:0/1604439774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f928c10efd0 0x7f928c19f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.542+0000 7f928a7fc700 1 -- 172.21.15.49:0/1604439774 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f928c19fe80 con 0x7f928c06b4c0 2024-06-02T23:59:06.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.542+0000 7f928affd700 1 --2- 172.21.15.49:0/1604439774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f928c06aba0 0x7f928c19aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:59:06.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.542+0000 7f928a7fc700 1 --2- 172.21.15.49:0/1604439774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f928c06b4c0 0x7f928c19b400 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f928000d950 tx=0x7f928000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:06.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.542+0000 7f9290999700 1 -- 172.21.15.49:0/1604439774 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9280016070 con 0x7f928c06b4c0 2024-06-02T23:59:06.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.542+0000 7f929199b700 1 -- 172.21.15.49:0/1604439774 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f928c1a0170 con 0x7f928c06b4c0 2024-06-02T23:59:06.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.542+0000 7f9290999700 1 -- 172.21.15.49:0/1604439774 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9280009e20 con 0x7f928c06b4c0 2024-06-02T23:59:06.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.542+0000 7f9290999700 1 -- 172.21.15.49:0/1604439774 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928000f620 con 0x7f928c06b4c0 2024-06-02T23:59:06.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.542+0000 7f929199b700 1 -- 172.21.15.49:0/1604439774 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f928c1a79f0 con 0x7f928c06b4c0 2024-06-02T23:59:06.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.543+0000 7f929199b700 1 -- 172.21.15.49:0/1604439774 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f928c069180 con 0x7f928c06b4c0 2024-06-02T23:59:06.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.545+0000 7f9290999700 1 -- 172.21.15.49:0/1604439774 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9280019070 con 0x7f928c06b4c0 2024-06-02T23:59:06.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.546+0000 7f9290999700 1 --2- 172.21.15.49:0/1604439774 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f92740a2c20 0x7f92740a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:06.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.546+0000 7f928affd700 1 --2- 172.21.15.49:0/1604439774 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f92740a2c20 0x7f92740a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:06.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.546+0000 7f9290999700 1 -- 172.21.15.49:0/1604439774 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f92800cec40 con 0x7f928c06b4c0 2024-06-02T23:59:06.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.546+0000 7f928affd700 1 --2- 172.21.15.49:0/1604439774 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f92740a2c20 0x7f92740a50e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f927c00b5c0 tx=0x7f927c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:06.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.549+0000 7f9290999700 1 -- 172.21.15.49:0/1604439774 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f928009bb60 con 0x7f928c06b4c0 2024-06-02T23:59:06.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.753+0000 7f929199b700 1 -- 172.21.15.49:0/1604439774 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f928c0628d0 con 0x7f92740a2c20 2024-06-02T23:59:06.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.760+0000 7f9290999700 1 -- 172.21.15.49:0/1604439774 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258883 (secure 0 0 0) 0x7f928c0628d0 con 0x7f92740a2c20 2024-06-02T23:59:06.764 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:59:06.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.764+0000 7f929199b700 1 -- 172.21.15.49:0/1604439774 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f92740a2c20 msgr2=0x7f92740a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:06.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.764+0000 7f929199b700 1 --2- 172.21.15.49:0/1604439774 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f92740a2c20 0x7f92740a50e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f927c00b5c0 tx=0x7f927c005fb0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.764+0000 7f929199b700 1 -- 172.21.15.49:0/1604439774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f928c06b4c0 msgr2=0x7f928c19b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:06.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.764+0000 7f929199b700 1 --2- 172.21.15.49:0/1604439774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f928c06b4c0 0x7f928c19b400 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f928000d950 tx=0x7f928000dc60 comp rx=0 tx=0).stop 2024-06-02T23:59:06.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.764+0000 7f929199b700 1 -- 172.21.15.49:0/1604439774 shutdown_connections 2024-06-02T23:59:06.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.764+0000 7f929199b700 1 --2- 172.21.15.49:0/1604439774 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f92740a2c20 0x7f92740a50e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.764+0000 7f929199b700 1 --2- 172.21.15.49:0/1604439774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f928c10efd0 0x7f928c19f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.764+0000 7f929199b700 1 --2- 172.21.15.49:0/1604439774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f928c06aba0 0x7f928c19aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.764+0000 7f929199b700 1 --2- 172.21.15.49:0/1604439774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f928c06b4c0 0x7f928c19b400 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.764+0000 7f929199b700 1 -- 172.21.15.49:0/1604439774 >> 172.21.15.49:0/1604439774 conn(0x7f928c0773e0 msgr2=0x7f928c110420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:06.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.765+0000 7f929199b700 1 -- 172.21.15.49:0/1604439774 shutdown_connections 2024-06-02T23:59:06.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:06.765+0000 7f929199b700 1 -- 172.21.15.49:0/1604439774 wait complete. 2024-06-02T23:59:06.767 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-06-02T23:59:07.315 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:07 smithi049 ceph-mon[32302]: pgmap v355: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 11 op/s 2024-06-02T23:59:07.345 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":355,"stamp":"2024-06-02T23:59:05.265607+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660111,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1071,"num_read_kb":656,"num_write":437,"num_write_kb":3083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":1180736,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":857,"ondisk_log_size":857,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375480,"kb_used_data":13848,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124566344,"statfs":{"total":1151940427776,"available":1151555936256,"internally_reserved":0,"allocated":14180352,"data_stored":7733061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":390,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":63,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003444"},"pg_stats":[{"pgid":"3.3f","version":"90'8","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.274900+0000","last_change":"2024-06-02T23:57:15.321542+0000","last_active":"2024-06-02T23:58:55.274900+0000","last_peered":"2024-06-02T23:58:55.274900+0000","last_clean":"2024-06-02T23:58:55.274900+0000","last_became_active":"2024-06-02T23:57:15.321129+0000","last_became_peered":"2024-06-02T23:57:15.321129+0000","last_unstale":"2024-06-02T23:58:55.274900+0000","last_undegraded":"2024-06-02T23:58:55.274900+0000","last_fullsized":"2024-06-02T23:58:55.274900+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:35:50.218316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.271121+0000","last_change":"2024-06-02T23:57:15.327432+0000","last_active":"2024-06-02T23:58:55.271121+0000","last_peered":"2024-06-02T23:58:55.271121+0000","last_clean":"2024-06-02T23:58:55.271121+0000","last_became_active":"2024-06-02T23:57:15.326759+0000","last_became_peered":"2024-06-02T23:57:15.326759+0000","last_unstale":"2024-06-02T23:58:55.271121+0000","last_undegraded":"2024-06-02T23:58:55.271121+0000","last_fullsized":"2024-06-02T23:58:55.271121+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:42:20.473216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.274419+0000","last_change":"2024-06-02T23:57:15.323721+0000","last_active":"2024-06-02T23:58:55.274419+0000","last_peered":"2024-06-02T23:58:55.274419+0000","last_clean":"2024-06-02T23:58:55.274419+0000","last_became_active":"2024-06-02T23:57:15.321277+0000","last_became_peered":"2024-06-02T23:57:15.321277+0000","last_unstale":"2024-06-02T23:58:55.274419+0000","last_undegraded":"2024-06-02T23:58:55.274419+0000","last_fullsized":"2024-06-02T23:58:55.274419+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:34:31.667999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.258175+0000","last_change":"2024-06-02T23:57:15.323769+0000","last_active":"2024-06-02T23:58:55.258175+0000","last_peered":"2024-06-02T23:58:55.258175+0000","last_clean":"2024-06-02T23:58:55.258175+0000","last_became_active":"2024-06-02T23:57:15.323406+0000","last_became_peered":"2024-06-02T23:57:15.323406+0000","last_unstale":"2024-06-02T23:58:55.258175+0000","last_undegraded":"2024-06-02T23:58:55.258175+0000","last_fullsized":"2024-06-02T23:58:55.258175+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:51:27.456210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.258320+0000","last_change":"2024-06-02T23:57:56.531404+0000","last_active":"2024-06-02T23:58:55.258320+0000","last_peered":"2024-06-02T23:58:55.258320+0000","last_clean":"2024-06-02T23:58:55.258320+0000","last_became_active":"2024-06-02T23:57:56.530952+0000","last_became_peered":"2024-06-02T23:57:56.530952+0000","last_unstale":"2024-06-02T23:58:55.258320+0000","last_undegraded":"2024-06-02T23:58:55.258320+0000","last_fullsized":"2024-06-02T23:58:55.258320+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:39:30.405113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268401+0000","last_change":"2024-06-02T23:57:15.320843+0000","last_active":"2024-06-02T23:58:55.268401+0000","last_peered":"2024-06-02T23:58:55.268401+0000","last_clean":"2024-06-02T23:58:55.268401+0000","last_became_active":"2024-06-02T23:57:15.320472+0000","last_became_peered":"2024-06-02T23:57:15.320472+0000","last_unstale":"2024-06-02T23:58:55.268401+0000","last_undegraded":"2024-06-02T23:58:55.268401+0000","last_fullsized":"2024-06-02T23:58:55.268401+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:49:02.620777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.270784+0000","last_change":"2024-06-02T23:57:15.321799+0000","last_active":"2024-06-02T23:58:55.270784+0000","last_peered":"2024-06-02T23:58:55.270784+0000","last_clean":"2024-06-02T23:58:55.270784+0000","last_became_active":"2024-06-02T23:57:15.321379+0000","last_became_peered":"2024-06-02T23:57:15.321379+0000","last_unstale":"2024-06-02T23:58:55.270784+0000","last_undegraded":"2024-06-02T23:58:55.270784+0000","last_fullsized":"2024-06-02T23:58:55.270784+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:36:56.404936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268771+0000","last_change":"2024-06-02T23:57:15.318771+0000","last_active":"2024-06-02T23:58:55.268771+0000","last_peered":"2024-06-02T23:58:55.268771+0000","last_clean":"2024-06-02T23:58:55.268771+0000","last_became_active":"2024-06-02T23:57:15.318420+0000","last_became_peered":"2024-06-02T23:57:15.318420+0000","last_unstale":"2024-06-02T23:58:55.268771+0000","last_undegraded":"2024-06-02T23:58:55.268771+0000","last_fullsized":"2024-06-02T23:58:55.268771+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:07:53.769443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.274434+0000","last_change":"2024-06-02T23:57:15.318989+0000","last_active":"2024-06-02T23:58:55.274434+0000","last_peered":"2024-06-02T23:58:55.274434+0000","last_clean":"2024-06-02T23:58:55.274434+0000","last_became_active":"2024-06-02T23:57:15.318424+0000","last_became_peered":"2024-06-02T23:57:15.318424+0000","last_unstale":"2024-06-02T23:58:55.274434+0000","last_undegraded":"2024-06-02T23:58:55.274434+0000","last_fullsized":"2024-06-02T23:58:55.274434+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:30:47.634662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265111+0000","last_change":"2024-06-02T23:57:15.326251+0000","last_active":"2024-06-02T23:58:55.265111+0000","last_peered":"2024-06-02T23:58:55.265111+0000","last_clean":"2024-06-02T23:58:55.265111+0000","last_became_active":"2024-06-02T23:57:15.325890+0000","last_became_peered":"2024-06-02T23:57:15.325890+0000","last_unstale":"2024-06-02T23:58:55.265111+0000","last_undegraded":"2024-06-02T23:58:55.265111+0000","last_fullsized":"2024-06-02T23:58:55.265111+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:18:54.871410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273505+0000","last_change":"2024-06-02T23:57:15.325364+0000","last_active":"2024-06-02T23:58:55.273505+0000","last_peered":"2024-06-02T23:58:55.273505+0000","last_clean":"2024-06-02T23:58:55.273505+0000","last_became_active":"2024-06-02T23:57:15.324987+0000","last_became_peered":"2024-06-02T23:57:15.324987+0000","last_unstale":"2024-06-02T23:58:55.273505+0000","last_undegraded":"2024-06-02T23:58:55.273505+0000","last_fullsized":"2024-06-02T23:58:55.273505+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:59:11.827263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.257280+0000","last_change":"2024-06-02T23:57:15.328027+0000","last_active":"2024-06-02T23:58:55.257280+0000","last_peered":"2024-06-02T23:58:55.257280+0000","last_clean":"2024-06-02T23:58:55.257280+0000","last_became_active":"2024-06-02T23:57:15.327608+0000","last_became_peered":"2024-06-02T23:57:15.327608+0000","last_unstale":"2024-06-02T23:58:55.257280+0000","last_undegraded":"2024-06-02T23:58:55.257280+0000","last_fullsized":"2024-06-02T23:58:55.257280+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:09:42.152689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.257242+0000","last_change":"2024-06-02T23:57:15.323095+0000","last_active":"2024-06-02T23:58:55.257242+0000","last_peered":"2024-06-02T23:58:55.257242+0000","last_clean":"2024-06-02T23:58:55.257242+0000","last_became_active":"2024-06-02T23:57:15.322755+0000","last_became_peered":"2024-06-02T23:57:15.322755+0000","last_unstale":"2024-06-02T23:58:55.257242+0000","last_undegraded":"2024-06-02T23:58:55.257242+0000","last_fullsized":"2024-06-02T23:58:55.257242+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:43:53.195192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272229+0000","last_change":"2024-06-02T23:57:15.327437+0000","last_active":"2024-06-02T23:58:55.272229+0000","last_peered":"2024-06-02T23:58:55.272229+0000","last_clean":"2024-06-02T23:58:55.272229+0000","last_became_active":"2024-06-02T23:57:15.326974+0000","last_became_peered":"2024-06-02T23:57:15.326974+0000","last_unstale":"2024-06-02T23:58:55.272229+0000","last_undegraded":"2024-06-02T23:58:55.272229+0000","last_fullsized":"2024-06-02T23:58:55.272229+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:20:44.978213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273212+0000","last_change":"2024-06-02T23:57:15.325414+0000","last_active":"2024-06-02T23:58:55.273212+0000","last_peered":"2024-06-02T23:58:55.273212+0000","last_clean":"2024-06-02T23:58:55.273212+0000","last_became_active":"2024-06-02T23:57:15.325033+0000","last_became_peered":"2024-06-02T23:57:15.325033+0000","last_unstale":"2024-06-02T23:58:55.273212+0000","last_undegraded":"2024-06-02T23:58:55.273212+0000","last_fullsized":"2024-06-02T23:58:55.273212+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:27:14.536646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272529+0000","last_change":"2024-06-02T23:57:15.315833+0000","last_active":"2024-06-02T23:58:55.272529+0000","last_peered":"2024-06-02T23:58:55.272529+0000","last_clean":"2024-06-02T23:58:55.272529+0000","last_became_active":"2024-06-02T23:57:15.315355+0000","last_became_peered":"2024-06-02T23:57:15.315355+0000","last_unstale":"2024-06-02T23:58:55.272529+0000","last_undegraded":"2024-06-02T23:58:55.272529+0000","last_fullsized":"2024-06-02T23:58:55.272529+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:52:05.915828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.275016+0000","last_change":"2024-06-02T23:57:15.322407+0000","last_active":"2024-06-02T23:58:55.275016+0000","last_peered":"2024-06-02T23:58:55.275016+0000","last_clean":"2024-06-02T23:58:55.275016+0000","last_became_active":"2024-06-02T23:57:15.322090+0000","last_became_peered":"2024-06-02T23:57:15.322090+0000","last_unstale":"2024-06-02T23:58:55.275016+0000","last_undegraded":"2024-06-02T23:58:55.275016+0000","last_fullsized":"2024-06-02T23:58:55.275016+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:08:48.071192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268421+0000","last_change":"2024-06-02T23:57:15.327331+0000","last_active":"2024-06-02T23:58:55.268421+0000","last_peered":"2024-06-02T23:58:55.268421+0000","last_clean":"2024-06-02T23:58:55.268421+0000","last_became_active":"2024-06-02T23:57:15.326863+0000","last_became_peered":"2024-06-02T23:57:15.326863+0000","last_unstale":"2024-06-02T23:58:55.268421+0000","last_undegraded":"2024-06-02T23:58:55.268421+0000","last_fullsized":"2024-06-02T23:58:55.268421+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:45:05.443751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.260931+0000","last_change":"2024-06-02T23:57:15.313008+0000","last_active":"2024-06-02T23:58:55.260931+0000","last_peered":"2024-06-02T23:58:55.260931+0000","last_clean":"2024-06-02T23:58:55.260931+0000","last_became_active":"2024-06-02T23:57:15.312322+0000","last_became_peered":"2024-06-02T23:57:15.312322+0000","last_unstale":"2024-06-02T23:58:55.260931+0000","last_undegraded":"2024-06-02T23:58:55.260931+0000","last_fullsized":"2024-06-02T23:58:55.260931+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:54:03.744964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":131,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.286849+0000","last_change":"2024-06-02T23:57:12.153410+0000","last_active":"2024-06-02T23:59:03.286849+0000","last_peered":"2024-06-02T23:59:03.286849+0000","last_clean":"2024-06-02T23:59:03.286849+0000","last_became_active":"2024-06-02T23:57:12.153065+0000","last_became_peered":"2024-06-02T23:57:12.153065+0000","last_unstale":"2024-06-02T23:59:03.286849+0000","last_undegraded":"2024-06-02T23:59:03.286849+0000","last_fullsized":"2024-06-02T23:59:03.286849+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:45:30.058961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":93,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.258300+0000","last_change":"2024-06-02T23:57:15.314168+0000","last_active":"2024-06-02T23:58:55.258300+0000","last_peered":"2024-06-02T23:58:55.258300+0000","last_clean":"2024-06-02T23:58:55.258300+0000","last_became_active":"2024-06-02T23:57:15.313838+0000","last_became_peered":"2024-06-02T23:57:15.313838+0000","last_unstale":"2024-06-02T23:58:55.258300+0000","last_undegraded":"2024-06-02T23:58:55.258300+0000","last_fullsized":"2024-06-02T23:58:55.258300+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:56:14.137471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526679+0000","last_change":"2024-06-02T23:57:12.305448+0000","last_active":"2024-06-02T23:57:56.526679+0000","last_peered":"2024-06-02T23:57:56.526679+0000","last_clean":"2024-06-02T23:57:56.526679+0000","last_became_active":"2024-06-02T23:57:12.305080+0000","last_became_peered":"2024-06-02T23:57:12.305080+0000","last_unstale":"2024-06-02T23:57:56.526679+0000","last_undegraded":"2024-06-02T23:57:56.526679+0000","last_fullsized":"2024-06-02T23:57:56.526679+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:20:18.660943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.275050+0000","last_change":"2024-06-02T23:57:15.321660+0000","last_active":"2024-06-02T23:58:55.275050+0000","last_peered":"2024-06-02T23:58:55.275050+0000","last_clean":"2024-06-02T23:58:55.275050+0000","last_became_active":"2024-06-02T23:57:15.321304+0000","last_became_peered":"2024-06-02T23:57:15.321304+0000","last_unstale":"2024-06-02T23:58:55.275050+0000","last_undegraded":"2024-06-02T23:58:55.275050+0000","last_fullsized":"2024-06-02T23:58:55.275050+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:10:10.933291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.544868+0000","last_change":"2024-06-02T23:57:56.544458+0000","last_active":"2024-06-02T23:57:56.544868+0000","last_peered":"2024-06-02T23:57:56.544868+0000","last_clean":"2024-06-02T23:57:56.544868+0000","last_became_active":"2024-06-02T23:57:56.532838+0000","last_became_peered":"2024-06-02T23:57:56.532838+0000","last_unstale":"2024-06-02T23:57:56.544868+0000","last_undegraded":"2024-06-02T23:57:56.544868+0000","last_fullsized":"2024-06-02T23:57:56.544868+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:27:44.700493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272420+0000","last_change":"2024-06-02T23:57:15.328944+0000","last_active":"2024-06-02T23:58:55.272420+0000","last_peered":"2024-06-02T23:58:55.272420+0000","last_clean":"2024-06-02T23:58:55.272420+0000","last_became_active":"2024-06-02T23:57:15.328531+0000","last_became_peered":"2024-06-02T23:57:15.328531+0000","last_unstale":"2024-06-02T23:58:55.272420+0000","last_undegraded":"2024-06-02T23:58:55.272420+0000","last_fullsized":"2024-06-02T23:58:55.272420+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:48:19.709989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528340+0000","last_change":"2024-06-02T23:57:12.153967+0000","last_active":"2024-06-02T23:57:56.528340+0000","last_peered":"2024-06-02T23:57:56.528340+0000","last_clean":"2024-06-02T23:57:56.528340+0000","last_became_active":"2024-06-02T23:57:12.153600+0000","last_became_peered":"2024-06-02T23:57:12.153600+0000","last_unstale":"2024-06-02T23:57:56.528340+0000","last_undegraded":"2024-06-02T23:57:56.528340+0000","last_fullsized":"2024-06-02T23:57:56.528340+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:47:58.761573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267288+0000","last_change":"2024-06-02T23:57:15.318089+0000","last_active":"2024-06-02T23:58:55.267288+0000","last_peered":"2024-06-02T23:58:55.267288+0000","last_clean":"2024-06-02T23:58:55.267288+0000","last_became_active":"2024-06-02T23:57:15.316494+0000","last_became_peered":"2024-06-02T23:57:15.316494+0000","last_unstale":"2024-06-02T23:58:55.267288+0000","last_undegraded":"2024-06-02T23:58:55.267288+0000","last_fullsized":"2024-06-02T23:58:55.267288+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:21:15.839255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"90'7","reported_seq":128,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.284769+0000","last_change":"2024-06-02T23:57:12.153624+0000","last_active":"2024-06-02T23:59:02.284769+0000","last_peered":"2024-06-02T23:59:02.284769+0000","last_clean":"2024-06-02T23:59:02.284769+0000","last_became_active":"2024-06-02T23:57:12.152712+0000","last_became_peered":"2024-06-02T23:57:12.152712+0000","last_unstale":"2024-06-02T23:59:02.284769+0000","last_undegraded":"2024-06-02T23:59:02.284769+0000","last_fullsized":"2024-06-02T23:59:02.284769+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:14:50.236213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259301+0000","last_change":"2024-06-02T23:57:15.325293+0000","last_active":"2024-06-02T23:58:55.259301+0000","last_peered":"2024-06-02T23:58:55.259301+0000","last_clean":"2024-06-02T23:58:55.259301+0000","last_became_active":"2024-06-02T23:57:15.324967+0000","last_became_peered":"2024-06-02T23:57:15.324967+0000","last_unstale":"2024-06-02T23:58:55.259301+0000","last_undegraded":"2024-06-02T23:58:55.259301+0000","last_fullsized":"2024-06-02T23:58:55.259301+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:21:23.634118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.735901+0000","last_change":"2024-06-02T23:57:12.155927+0000","last_active":"2024-06-02T23:57:56.735901+0000","last_peered":"2024-06-02T23:57:56.735901+0000","last_clean":"2024-06-02T23:57:56.735901+0000","last_became_active":"2024-06-02T23:57:12.155505+0000","last_became_peered":"2024-06-02T23:57:12.155505+0000","last_unstale":"2024-06-02T23:57:56.735901+0000","last_undegraded":"2024-06-02T23:57:56.735901+0000","last_fullsized":"2024-06-02T23:57:56.735901+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:47.555747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262351+0000","last_change":"2024-06-02T23:57:15.321796+0000","last_active":"2024-06-02T23:58:55.262351+0000","last_peered":"2024-06-02T23:58:55.262351+0000","last_clean":"2024-06-02T23:58:55.262351+0000","last_became_active":"2024-06-02T23:57:15.320850+0000","last_became_peered":"2024-06-02T23:57:15.320850+0000","last_unstale":"2024-06-02T23:58:55.262351+0000","last_undegraded":"2024-06-02T23:58:55.262351+0000","last_fullsized":"2024-06-02T23:58:55.262351+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:04:10.991920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.523804+0000","last_change":"2024-06-02T23:57:12.146589+0000","last_active":"2024-06-02T23:57:56.523804+0000","last_peered":"2024-06-02T23:57:56.523804+0000","last_clean":"2024-06-02T23:57:56.523804+0000","last_became_active":"2024-06-02T23:57:12.146224+0000","last_became_peered":"2024-06-02T23:57:12.146224+0000","last_unstale":"2024-06-02T23:57:56.523804+0000","last_undegraded":"2024-06-02T23:57:56.523804+0000","last_fullsized":"2024-06-02T23:57:56.523804+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:17:31.250585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268440+0000","last_change":"2024-06-02T23:57:15.315553+0000","last_active":"2024-06-02T23:58:55.268440+0000","last_peered":"2024-06-02T23:58:55.268440+0000","last_clean":"2024-06-02T23:58:55.268440+0000","last_became_active":"2024-06-02T23:57:15.315217+0000","last_became_peered":"2024-06-02T23:57:15.315217+0000","last_unstale":"2024-06-02T23:58:55.268440+0000","last_undegraded":"2024-06-02T23:58:55.268440+0000","last_fullsized":"2024-06-02T23:58:55.268440+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:00:23.097949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.525090+0000","last_change":"2024-06-02T23:57:12.156971+0000","last_active":"2024-06-02T23:57:56.525090+0000","last_peered":"2024-06-02T23:57:56.525090+0000","last_clean":"2024-06-02T23:57:56.525090+0000","last_became_active":"2024-06-02T23:57:12.156379+0000","last_became_peered":"2024-06-02T23:57:12.156379+0000","last_unstale":"2024-06-02T23:57:56.525090+0000","last_undegraded":"2024-06-02T23:57:56.525090+0000","last_fullsized":"2024-06-02T23:57:56.525090+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:28:50.057736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.266289+0000","last_change":"2024-06-02T23:57:15.313985+0000","last_active":"2024-06-02T23:58:55.266289+0000","last_peered":"2024-06-02T23:58:55.266289+0000","last_clean":"2024-06-02T23:58:55.266289+0000","last_became_active":"2024-06-02T23:57:15.313668+0000","last_became_peered":"2024-06-02T23:57:15.313668+0000","last_unstale":"2024-06-02T23:58:55.266289+0000","last_undegraded":"2024-06-02T23:58:55.266289+0000","last_fullsized":"2024-06-02T23:58:55.266289+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:10:56.560660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"90'5","reported_seq":209,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:59:01.282379+0000","last_change":"2024-06-02T23:57:12.156025+0000","last_active":"2024-06-02T23:59:01.282379+0000","last_peered":"2024-06-02T23:59:01.282379+0000","last_clean":"2024-06-02T23:59:01.282379+0000","last_became_active":"2024-06-02T23:57:12.155609+0000","last_became_peered":"2024-06-02T23:57:12.155609+0000","last_unstale":"2024-06-02T23:59:01.282379+0000","last_undegraded":"2024-06-02T23:59:01.282379+0000","last_fullsized":"2024-06-02T23:59:01.282379+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:27:48.953456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272478+0000","last_change":"2024-06-02T23:57:15.329711+0000","last_active":"2024-06-02T23:58:55.272478+0000","last_peered":"2024-06-02T23:58:55.272478+0000","last_clean":"2024-06-02T23:58:55.272478+0000","last_became_active":"2024-06-02T23:57:15.329284+0000","last_became_peered":"2024-06-02T23:57:15.329284+0000","last_unstale":"2024-06-02T23:58:55.272478+0000","last_undegraded":"2024-06-02T23:58:55.272478+0000","last_fullsized":"2024-06-02T23:58:55.272478+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:58:06.165152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528997+0000","last_change":"2024-06-02T23:57:12.156949+0000","last_active":"2024-06-02T23:57:56.528997+0000","last_peered":"2024-06-02T23:57:56.528997+0000","last_clean":"2024-06-02T23:57:56.528997+0000","last_became_active":"2024-06-02T23:57:12.156558+0000","last_became_peered":"2024-06-02T23:57:12.156558+0000","last_unstale":"2024-06-02T23:57:56.528997+0000","last_undegraded":"2024-06-02T23:57:56.528997+0000","last_fullsized":"2024-06-02T23:57:56.528997+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:05:57.658900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273601+0000","last_change":"2024-06-02T23:57:15.318638+0000","last_active":"2024-06-02T23:58:55.273601+0000","last_peered":"2024-06-02T23:58:55.273601+0000","last_clean":"2024-06-02T23:58:55.273601+0000","last_became_active":"2024-06-02T23:57:15.318321+0000","last_became_peered":"2024-06-02T23:57:15.318321+0000","last_unstale":"2024-06-02T23:58:55.273601+0000","last_undegraded":"2024-06-02T23:58:55.273601+0000","last_fullsized":"2024-06-02T23:58:55.273601+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:21:57.877235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526095+0000","last_change":"2024-06-02T23:57:12.306278+0000","last_active":"2024-06-02T23:57:56.526095+0000","last_peered":"2024-06-02T23:57:56.526095+0000","last_clean":"2024-06-02T23:57:56.526095+0000","last_became_active":"2024-06-02T23:57:12.305885+0000","last_became_peered":"2024-06-02T23:57:12.305885+0000","last_unstale":"2024-06-02T23:57:56.526095+0000","last_undegraded":"2024-06-02T23:57:56.526095+0000","last_fullsized":"2024-06-02T23:57:56.526095+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:05:07.723501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.266526+0000","last_change":"2024-06-02T23:57:15.322489+0000","last_active":"2024-06-02T23:58:55.266526+0000","last_peered":"2024-06-02T23:58:55.266526+0000","last_clean":"2024-06-02T23:58:55.266526+0000","last_became_active":"2024-06-02T23:57:15.322131+0000","last_became_peered":"2024-06-02T23:57:15.322131+0000","last_unstale":"2024-06-02T23:58:55.266526+0000","last_undegraded":"2024-06-02T23:58:55.266526+0000","last_fullsized":"2024-06-02T23:58:55.266526+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:34:43.362338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"90'36","reported_seq":252,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:59:01.282371+0000","last_change":"2024-06-02T23:57:12.156920+0000","last_active":"2024-06-02T23:59:01.282371+0000","last_peered":"2024-06-02T23:59:01.282371+0000","last_clean":"2024-06-02T23:59:01.282371+0000","last_became_active":"2024-06-02T23:57:12.156494+0000","last_became_peered":"2024-06-02T23:57:12.156494+0000","last_unstale":"2024-06-02T23:59:01.282371+0000","last_undegraded":"2024-06-02T23:59:01.282371+0000","last_fullsized":"2024-06-02T23:59:01.282371+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:49:56.458730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62556,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":190,"num_read_kb":156,"num_write":38,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265433+0000","last_change":"2024-06-02T23:57:15.328502+0000","last_active":"2024-06-02T23:58:55.265433+0000","last_peered":"2024-06-02T23:58:55.265433+0000","last_clean":"2024-06-02T23:58:55.265433+0000","last_became_active":"2024-06-02T23:57:15.328174+0000","last_became_peered":"2024-06-02T23:57:15.328174+0000","last_unstale":"2024-06-02T23:58:55.265433+0000","last_undegraded":"2024-06-02T23:58:55.265433+0000","last_fullsized":"2024-06-02T23:58:55.265433+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:58:33.355397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527324+0000","last_change":"2024-06-02T23:57:12.154204+0000","last_active":"2024-06-02T23:57:56.527324+0000","last_peered":"2024-06-02T23:57:56.527324+0000","last_clean":"2024-06-02T23:57:56.527324+0000","last_became_active":"2024-06-02T23:57:12.153412+0000","last_became_peered":"2024-06-02T23:57:12.153412+0000","last_unstale":"2024-06-02T23:57:56.527324+0000","last_undegraded":"2024-06-02T23:57:56.527324+0000","last_fullsized":"2024-06-02T23:57:56.527324+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:15.472279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262042+0000","last_change":"2024-06-02T23:57:15.314274+0000","last_active":"2024-06-02T23:58:55.262042+0000","last_peered":"2024-06-02T23:58:55.262042+0000","last_clean":"2024-06-02T23:58:55.262042+0000","last_became_active":"2024-06-02T23:57:15.313946+0000","last_became_peered":"2024-06-02T23:57:15.313946+0000","last_unstale":"2024-06-02T23:58:55.262042+0000","last_undegraded":"2024-06-02T23:58:55.262042+0000","last_fullsized":"2024-06-02T23:58:55.262042+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:07.909977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.525155+0000","last_change":"2024-06-02T23:57:12.156767+0000","last_active":"2024-06-02T23:57:56.525155+0000","last_peered":"2024-06-02T23:57:56.525155+0000","last_clean":"2024-06-02T23:57:56.525155+0000","last_became_active":"2024-06-02T23:57:12.156346+0000","last_became_peered":"2024-06-02T23:57:12.156346+0000","last_unstale":"2024-06-02T23:57:56.525155+0000","last_undegraded":"2024-06-02T23:57:56.525155+0000","last_fullsized":"2024-06-02T23:57:56.525155+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:29:45.801904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267500+0000","last_change":"2024-06-02T23:57:15.322676+0000","last_active":"2024-06-02T23:58:55.267500+0000","last_peered":"2024-06-02T23:58:55.267500+0000","last_clean":"2024-06-02T23:58:55.267500+0000","last_became_active":"2024-06-02T23:57:15.319429+0000","last_became_peered":"2024-06-02T23:57:15.319429+0000","last_unstale":"2024-06-02T23:58:55.267500+0000","last_undegraded":"2024-06-02T23:58:55.267500+0000","last_fullsized":"2024-06-02T23:58:55.267500+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:48:15.984818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'5","reported_seq":124,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.286560+0000","last_change":"2024-06-02T23:57:12.153925+0000","last_active":"2024-06-02T23:59:02.286560+0000","last_peered":"2024-06-02T23:59:02.286560+0000","last_clean":"2024-06-02T23:59:02.286560+0000","last_became_active":"2024-06-02T23:57:12.152990+0000","last_became_peered":"2024-06-02T23:57:12.152990+0000","last_unstale":"2024-06-02T23:59:02.286560+0000","last_undegraded":"2024-06-02T23:59:02.286560+0000","last_fullsized":"2024-06-02T23:59:02.286560+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:32:21.845946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":94,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.269950+0000","last_change":"2024-06-02T23:57:15.327662+0000","last_active":"2024-06-02T23:58:55.269950+0000","last_peered":"2024-06-02T23:58:55.269950+0000","last_clean":"2024-06-02T23:58:55.269950+0000","last_became_active":"2024-06-02T23:57:15.327320+0000","last_became_peered":"2024-06-02T23:57:15.327320+0000","last_unstale":"2024-06-02T23:58:55.269950+0000","last_undegraded":"2024-06-02T23:58:55.269950+0000","last_fullsized":"2024-06-02T23:58:55.269950+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:44:37.561533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528365+0000","last_change":"2024-06-02T23:57:12.306856+0000","last_active":"2024-06-02T23:57:56.528365+0000","last_peered":"2024-06-02T23:57:56.528365+0000","last_clean":"2024-06-02T23:57:56.528365+0000","last_became_active":"2024-06-02T23:57:12.306476+0000","last_became_peered":"2024-06-02T23:57:12.306476+0000","last_unstale":"2024-06-02T23:57:56.528365+0000","last_undegraded":"2024-06-02T23:57:56.528365+0000","last_fullsized":"2024-06-02T23:57:56.528365+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:30:22.839589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.258777+0000","last_change":"2024-06-02T23:57:56.890015+0000","last_active":"2024-06-02T23:58:55.258777+0000","last_peered":"2024-06-02T23:58:55.258777+0000","last_clean":"2024-06-02T23:58:55.258777+0000","last_became_active":"2024-06-02T23:57:56.889591+0000","last_became_peered":"2024-06-02T23:57:56.889591+0000","last_unstale":"2024-06-02T23:58:55.258777+0000","last_undegraded":"2024-06-02T23:58:55.258777+0000","last_fullsized":"2024-06-02T23:58:55.258777+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:14:37.851207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528059+0000","last_change":"2024-06-02T23:57:12.146690+0000","last_active":"2024-06-02T23:57:56.528059+0000","last_peered":"2024-06-02T23:57:56.528059+0000","last_clean":"2024-06-02T23:57:56.528059+0000","last_became_active":"2024-06-02T23:57:12.146372+0000","last_became_peered":"2024-06-02T23:57:12.146372+0000","last_unstale":"2024-06-02T23:57:56.528059+0000","last_undegraded":"2024-06-02T23:57:56.528059+0000","last_fullsized":"2024-06-02T23:57:56.528059+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:45:04.421365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262452+0000","last_change":"2024-06-02T23:57:15.320938+0000","last_active":"2024-06-02T23:58:55.262452+0000","last_peered":"2024-06-02T23:58:55.262452+0000","last_clean":"2024-06-02T23:58:55.262452+0000","last_became_active":"2024-06-02T23:57:15.320567+0000","last_became_peered":"2024-06-02T23:57:15.320567+0000","last_unstale":"2024-06-02T23:58:55.262452+0000","last_undegraded":"2024-06-02T23:58:55.262452+0000","last_fullsized":"2024-06-02T23:58:55.262452+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:04:29.736387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"88'1","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527707+0000","last_change":"2024-06-02T23:57:12.307020+0000","last_active":"2024-06-02T23:57:56.527707+0000","last_peered":"2024-06-02T23:57:56.527707+0000","last_clean":"2024-06-02T23:57:56.527707+0000","last_became_active":"2024-06-02T23:57:12.306650+0000","last_became_peered":"2024-06-02T23:57:12.306650+0000","last_unstale":"2024-06-02T23:57:56.527707+0000","last_undegraded":"2024-06-02T23:57:56.527707+0000","last_fullsized":"2024-06-02T23:57:56.527707+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:18:03.679704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"90'5","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.264827+0000","last_change":"2024-06-02T23:57:15.319300+0000","last_active":"2024-06-02T23:58:55.264827+0000","last_peered":"2024-06-02T23:58:55.264827+0000","last_clean":"2024-06-02T23:58:55.264827+0000","last_became_active":"2024-06-02T23:57:15.318903+0000","last_became_peered":"2024-06-02T23:57:15.318903+0000","last_unstale":"2024-06-02T23:58:55.264827+0000","last_undegraded":"2024-06-02T23:58:55.264827+0000","last_fullsized":"2024-06-02T23:58:55.264827+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:38:25.521337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":124,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.287318+0000","last_change":"2024-06-02T23:57:12.155260+0000","last_active":"2024-06-02T23:59:03.287318+0000","last_peered":"2024-06-02T23:59:03.287318+0000","last_clean":"2024-06-02T23:59:03.287318+0000","last_became_active":"2024-06-02T23:57:12.154884+0000","last_became_peered":"2024-06-02T23:57:12.154884+0000","last_unstale":"2024-06-02T23:59:03.287318+0000","last_undegraded":"2024-06-02T23:59:03.287318+0000","last_fullsized":"2024-06-02T23:59:03.287318+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:34:52.390752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.269696+0000","last_change":"2024-06-02T23:57:15.323490+0000","last_active":"2024-06-02T23:58:55.269696+0000","last_peered":"2024-06-02T23:58:55.269696+0000","last_clean":"2024-06-02T23:58:55.269696+0000","last_became_active":"2024-06-02T23:57:15.323142+0000","last_became_peered":"2024-06-02T23:57:15.323142+0000","last_unstale":"2024-06-02T23:58:55.269696+0000","last_undegraded":"2024-06-02T23:58:55.269696+0000","last_fullsized":"2024-06-02T23:58:55.269696+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:32:32.445823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.261654+0000","last_change":"2024-06-02T23:57:56.531715+0000","last_active":"2024-06-02T23:58:55.261654+0000","last_peered":"2024-06-02T23:58:55.261654+0000","last_clean":"2024-06-02T23:58:55.261654+0000","last_became_active":"2024-06-02T23:57:56.531304+0000","last_became_peered":"2024-06-02T23:57:56.531304+0000","last_unstale":"2024-06-02T23:58:55.261654+0000","last_undegraded":"2024-06-02T23:58:55.261654+0000","last_fullsized":"2024-06-02T23:58:55.261654+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:58:02.532206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":123,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.286067+0000","last_change":"2024-06-02T23:57:12.305475+0000","last_active":"2024-06-02T23:59:02.286067+0000","last_peered":"2024-06-02T23:59:02.286067+0000","last_clean":"2024-06-02T23:59:02.286067+0000","last_became_active":"2024-06-02T23:57:12.305071+0000","last_became_peered":"2024-06-02T23:57:12.305071+0000","last_unstale":"2024-06-02T23:59:02.286067+0000","last_undegraded":"2024-06-02T23:59:02.286067+0000","last_fullsized":"2024-06-02T23:59:02.286067+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:08:29.024447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259920+0000","last_change":"2024-06-02T23:57:15.308629+0000","last_active":"2024-06-02T23:58:55.259920+0000","last_peered":"2024-06-02T23:58:55.259920+0000","last_clean":"2024-06-02T23:58:55.259920+0000","last_became_active":"2024-06-02T23:57:15.307981+0000","last_became_peered":"2024-06-02T23:57:15.307981+0000","last_unstale":"2024-06-02T23:58:55.259920+0000","last_undegraded":"2024-06-02T23:58:55.259920+0000","last_fullsized":"2024-06-02T23:58:55.259920+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:14:22.446599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.652511+0000","last_change":"2024-06-02T23:57:12.155968+0000","last_active":"2024-06-02T23:57:56.652511+0000","last_peered":"2024-06-02T23:57:56.652511+0000","last_clean":"2024-06-02T23:57:56.652511+0000","last_became_active":"2024-06-02T23:57:12.155521+0000","last_became_peered":"2024-06-02T23:57:12.155521+0000","last_unstale":"2024-06-02T23:57:56.652511+0000","last_undegraded":"2024-06-02T23:57:56.652511+0000","last_fullsized":"2024-06-02T23:57:56.652511+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:45:00.397317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":349,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528775+0000","last_change":"2024-06-02T23:55:50.081978+0000","last_active":"2024-06-02T23:57:56.528775+0000","last_peered":"2024-06-02T23:57:56.528775+0000","last_clean":"2024-06-02T23:57:56.528775+0000","last_became_active":"2024-06-02T23:55:50.081431+0000","last_became_peered":"2024-06-02T23:55:50.081431+0000","last_unstale":"2024-06-02T23:57:56.528775+0000","last_undegraded":"2024-06-02T23:57:56.528775+0000","last_fullsized":"2024-06-02T23:57:56.528775+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:52:23.676206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:52:23.676206+0000","last_clean_scrub_stamp":"2024-06-02T23:52:23.676206+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:29:59.979935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262328+0000","last_change":"2024-06-02T23:57:56.529633+0000","last_active":"2024-06-02T23:58:55.262328+0000","last_peered":"2024-06-02T23:58:55.262328+0000","last_clean":"2024-06-02T23:58:55.262328+0000","last_became_active":"2024-06-02T23:57:56.529210+0000","last_became_peered":"2024-06-02T23:57:56.529210+0000","last_unstale":"2024-06-02T23:58:55.262328+0000","last_undegraded":"2024-06-02T23:58:55.262328+0000","last_fullsized":"2024-06-02T23:58:55.262328+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:51:31.807162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.529000+0000","last_change":"2024-06-02T23:57:12.155897+0000","last_active":"2024-06-02T23:57:56.529000+0000","last_peered":"2024-06-02T23:57:56.529000+0000","last_clean":"2024-06-02T23:57:56.529000+0000","last_became_active":"2024-06-02T23:57:12.155461+0000","last_became_peered":"2024-06-02T23:57:12.155461+0000","last_unstale":"2024-06-02T23:57:56.529000+0000","last_undegraded":"2024-06-02T23:57:56.529000+0000","last_fullsized":"2024-06-02T23:57:56.529000+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:19:22.104104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527986+0000","last_change":"2024-06-02T23:57:12.306363+0000","last_active":"2024-06-02T23:57:56.527986+0000","last_peered":"2024-06-02T23:57:56.527986+0000","last_clean":"2024-06-02T23:57:56.527986+0000","last_became_active":"2024-06-02T23:57:12.305920+0000","last_became_peered":"2024-06-02T23:57:12.305920+0000","last_unstale":"2024-06-02T23:57:56.527986+0000","last_undegraded":"2024-06-02T23:57:56.527986+0000","last_fullsized":"2024-06-02T23:57:56.527986+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:31:01.787879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262136+0000","last_change":"2024-06-02T23:57:15.316038+0000","last_active":"2024-06-02T23:58:55.262136+0000","last_peered":"2024-06-02T23:58:55.262136+0000","last_clean":"2024-06-02T23:58:55.262136+0000","last_became_active":"2024-06-02T23:57:15.315715+0000","last_became_peered":"2024-06-02T23:57:15.315715+0000","last_unstale":"2024-06-02T23:58:55.262136+0000","last_undegraded":"2024-06-02T23:58:55.262136+0000","last_fullsized":"2024-06-02T23:58:55.262136+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:34:36.014251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"90'17","reported_seq":58,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.540024+0000","last_change":"2024-06-02T23:57:56.539596+0000","last_active":"2024-06-02T23:57:56.540024+0000","last_peered":"2024-06-02T23:57:56.540024+0000","last_clean":"2024-06-02T23:57:56.540024+0000","last_became_active":"2024-06-02T23:57:56.532686+0000","last_became_peered":"2024-06-02T23:57:56.532686+0000","last_unstale":"2024-06-02T23:57:56.540024+0000","last_undegraded":"2024-06-02T23:57:56.540024+0000","last_fullsized":"2024-06-02T23:57:56.540024+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:29:24.691941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267245+0000","last_change":"2024-06-02T23:57:15.315657+0000","last_active":"2024-06-02T23:58:55.267245+0000","last_peered":"2024-06-02T23:58:55.267245+0000","last_clean":"2024-06-02T23:58:55.267245+0000","last_became_active":"2024-06-02T23:57:15.315293+0000","last_became_peered":"2024-06-02T23:57:15.315293+0000","last_unstale":"2024-06-02T23:58:55.267245+0000","last_undegraded":"2024-06-02T23:58:55.267245+0000","last_fullsized":"2024-06-02T23:58:55.267245+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:52:55.241379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.652145+0000","last_change":"2024-06-02T23:57:12.405664+0000","last_active":"2024-06-02T23:57:56.652145+0000","last_peered":"2024-06-02T23:57:56.652145+0000","last_clean":"2024-06-02T23:57:56.652145+0000","last_became_active":"2024-06-02T23:57:12.405281+0000","last_became_peered":"2024-06-02T23:57:12.405281+0000","last_unstale":"2024-06-02T23:57:56.652145+0000","last_undegraded":"2024-06-02T23:57:56.652145+0000","last_fullsized":"2024-06-02T23:57:56.652145+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:46:50.119466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273511+0000","last_change":"2024-06-02T23:57:15.318136+0000","last_active":"2024-06-02T23:58:55.273511+0000","last_peered":"2024-06-02T23:58:55.273511+0000","last_clean":"2024-06-02T23:58:55.273511+0000","last_became_active":"2024-06-02T23:57:15.317753+0000","last_became_peered":"2024-06-02T23:57:15.317753+0000","last_unstale":"2024-06-02T23:58:55.273511+0000","last_undegraded":"2024-06-02T23:58:55.273511+0000","last_fullsized":"2024-06-02T23:58:55.273511+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:35:11.025266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.887858+0000","last_change":"2024-06-02T23:57:12.305954+0000","last_active":"2024-06-02T23:57:56.887858+0000","last_peered":"2024-06-02T23:57:56.887858+0000","last_clean":"2024-06-02T23:57:56.887858+0000","last_became_active":"2024-06-02T23:57:12.305589+0000","last_became_peered":"2024-06-02T23:57:12.305589+0000","last_unstale":"2024-06-02T23:57:56.887858+0000","last_undegraded":"2024-06-02T23:57:56.887858+0000","last_fullsized":"2024-06-02T23:57:56.887858+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:34:34.178446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.243354+0000","last_change":"2024-06-02T23:57:15.327115+0000","last_active":"2024-06-02T23:58:55.243354+0000","last_peered":"2024-06-02T23:58:55.243354+0000","last_clean":"2024-06-02T23:58:55.243354+0000","last_became_active":"2024-06-02T23:57:15.326746+0000","last_became_peered":"2024-06-02T23:57:15.326746+0000","last_unstale":"2024-06-02T23:58:55.243354+0000","last_undegraded":"2024-06-02T23:58:55.243354+0000","last_fullsized":"2024-06-02T23:58:55.243354+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:08:04.340517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526196+0000","last_change":"2024-06-02T23:57:12.152933+0000","last_active":"2024-06-02T23:57:56.526196+0000","last_peered":"2024-06-02T23:57:56.526196+0000","last_clean":"2024-06-02T23:57:56.526196+0000","last_became_active":"2024-06-02T23:57:12.152453+0000","last_became_peered":"2024-06-02T23:57:12.152453+0000","last_unstale":"2024-06-02T23:57:56.526196+0000","last_undegraded":"2024-06-02T23:57:56.526196+0000","last_fullsized":"2024-06-02T23:57:56.526196+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:47:05.144374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272363+0000","last_change":"2024-06-02T23:57:15.326042+0000","last_active":"2024-06-02T23:58:55.272363+0000","last_peered":"2024-06-02T23:58:55.272363+0000","last_clean":"2024-06-02T23:58:55.272363+0000","last_became_active":"2024-06-02T23:57:15.325585+0000","last_became_peered":"2024-06-02T23:57:15.325585+0000","last_unstale":"2024-06-02T23:58:55.272363+0000","last_undegraded":"2024-06-02T23:58:55.272363+0000","last_fullsized":"2024-06-02T23:58:55.272363+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:40:37.305875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"88'3","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527114+0000","last_change":"2024-06-02T23:57:12.139155+0000","last_active":"2024-06-02T23:57:56.527114+0000","last_peered":"2024-06-02T23:57:56.527114+0000","last_clean":"2024-06-02T23:57:56.527114+0000","last_became_active":"2024-06-02T23:57:12.138732+0000","last_became_peered":"2024-06-02T23:57:12.138732+0000","last_unstale":"2024-06-02T23:57:56.527114+0000","last_undegraded":"2024-06-02T23:57:56.527114+0000","last_fullsized":"2024-06-02T23:57:56.527114+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:18:29.148439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265401+0000","last_change":"2024-06-02T23:57:15.319510+0000","last_active":"2024-06-02T23:58:55.265401+0000","last_peered":"2024-06-02T23:58:55.265401+0000","last_clean":"2024-06-02T23:58:55.265401+0000","last_became_active":"2024-06-02T23:57:15.319192+0000","last_became_peered":"2024-06-02T23:57:15.319192+0000","last_unstale":"2024-06-02T23:58:55.265401+0000","last_undegraded":"2024-06-02T23:58:55.265401+0000","last_fullsized":"2024-06-02T23:58:55.265401+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:04:04.241833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.657766+0000","last_change":"2024-06-02T23:57:56.657766+0000","last_active":"2024-06-02T23:57:56.657766+0000","last_peered":"2024-06-02T23:57:56.657766+0000","last_clean":"2024-06-02T23:57:56.657766+0000","last_became_active":"2024-06-02T23:57:56.653435+0000","last_became_peered":"2024-06-02T23:57:56.653435+0000","last_unstale":"2024-06-02T23:57:56.657766+0000","last_undegraded":"2024-06-02T23:57:56.657766+0000","last_fullsized":"2024-06-02T23:57:56.657766+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:03:23.594470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273064+0000","last_change":"2024-06-02T23:57:15.320837+0000","last_active":"2024-06-02T23:58:55.273064+0000","last_peered":"2024-06-02T23:58:55.273064+0000","last_clean":"2024-06-02T23:58:55.273064+0000","last_became_active":"2024-06-02T23:57:15.320257+0000","last_became_peered":"2024-06-02T23:57:15.320257+0000","last_unstale":"2024-06-02T23:58:55.273064+0000","last_undegraded":"2024-06-02T23:58:55.273064+0000","last_fullsized":"2024-06-02T23:58:55.273064+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:18:29.638614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'5","reported_seq":123,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:59:01.283291+0000","last_change":"2024-06-02T23:57:12.405175+0000","last_active":"2024-06-02T23:59:01.283291+0000","last_peered":"2024-06-02T23:59:01.283291+0000","last_clean":"2024-06-02T23:59:01.283291+0000","last_became_active":"2024-06-02T23:57:12.404767+0000","last_became_peered":"2024-06-02T23:57:12.404767+0000","last_unstale":"2024-06-02T23:59:01.283291+0000","last_undegraded":"2024-06-02T23:59:01.283291+0000","last_fullsized":"2024-06-02T23:59:01.283291+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:46:57.421288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":92,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273631+0000","last_change":"2024-06-02T23:57:15.322888+0000","last_active":"2024-06-02T23:58:55.273631+0000","last_peered":"2024-06-02T23:58:55.273631+0000","last_clean":"2024-06-02T23:58:55.273631+0000","last_became_active":"2024-06-02T23:57:15.321982+0000","last_became_peered":"2024-06-02T23:57:15.321982+0000","last_unstale":"2024-06-02T23:58:55.273631+0000","last_undegraded":"2024-06-02T23:58:55.273631+0000","last_fullsized":"2024-06-02T23:58:55.273631+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:51:57.253824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526128+0000","last_change":"2024-06-02T23:57:12.153715+0000","last_active":"2024-06-02T23:57:56.526128+0000","last_peered":"2024-06-02T23:57:56.526128+0000","last_clean":"2024-06-02T23:57:56.526128+0000","last_became_active":"2024-06-02T23:57:12.152544+0000","last_became_peered":"2024-06-02T23:57:12.152544+0000","last_unstale":"2024-06-02T23:57:56.526128+0000","last_undegraded":"2024-06-02T23:57:56.526128+0000","last_fullsized":"2024-06-02T23:57:56.526128+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:51:05.874962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"90'7","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.271174+0000","last_change":"2024-06-02T23:57:15.318759+0000","last_active":"2024-06-02T23:58:55.271174+0000","last_peered":"2024-06-02T23:58:55.271174+0000","last_clean":"2024-06-02T23:58:55.271174+0000","last_became_active":"2024-06-02T23:57:15.317942+0000","last_became_peered":"2024-06-02T23:57:15.317942+0000","last_unstale":"2024-06-02T23:58:55.271174+0000","last_undegraded":"2024-06-02T23:58:55.271174+0000","last_fullsized":"2024-06-02T23:58:55.271174+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:39:44.142890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.894131+0000","last_change":"2024-06-02T23:57:56.894131+0000","last_active":"2024-06-02T23:57:56.894131+0000","last_peered":"2024-06-02T23:57:56.894131+0000","last_clean":"2024-06-02T23:57:56.894131+0000","last_became_active":"2024-06-02T23:57:56.889794+0000","last_became_peered":"2024-06-02T23:57:56.889794+0000","last_unstale":"2024-06-02T23:57:56.894131+0000","last_undegraded":"2024-06-02T23:57:56.894131+0000","last_fullsized":"2024-06-02T23:57:56.894131+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:02:41.670419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.266418+0000","last_change":"2024-06-02T23:57:15.324355+0000","last_active":"2024-06-02T23:58:55.266418+0000","last_peered":"2024-06-02T23:58:55.266418+0000","last_clean":"2024-06-02T23:58:55.266418+0000","last_became_active":"2024-06-02T23:57:15.324019+0000","last_became_peered":"2024-06-02T23:57:15.324019+0000","last_unstale":"2024-06-02T23:58:55.266418+0000","last_undegraded":"2024-06-02T23:58:55.266418+0000","last_fullsized":"2024-06-02T23:58:55.266418+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:27:01.927109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.266349+0000","last_change":"2024-06-02T23:57:15.326420+0000","last_active":"2024-06-02T23:58:55.266349+0000","last_peered":"2024-06-02T23:58:55.266349+0000","last_clean":"2024-06-02T23:58:55.266349+0000","last_became_active":"2024-06-02T23:57:15.326091+0000","last_became_peered":"2024-06-02T23:57:15.326091+0000","last_unstale":"2024-06-02T23:58:55.266349+0000","last_undegraded":"2024-06-02T23:58:55.266349+0000","last_fullsized":"2024-06-02T23:58:55.266349+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:54:05.355352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.252603+0000","last_change":"2024-06-02T23:57:56.653297+0000","last_active":"2024-06-02T23:58:55.252603+0000","last_peered":"2024-06-02T23:58:55.252603+0000","last_clean":"2024-06-02T23:58:55.252603+0000","last_became_active":"2024-06-02T23:57:56.652874+0000","last_became_peered":"2024-06-02T23:57:56.652874+0000","last_unstale":"2024-06-02T23:58:55.252603+0000","last_undegraded":"2024-06-02T23:58:55.252603+0000","last_fullsized":"2024-06-02T23:58:55.252603+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:27:55.486382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.249208+0000","last_change":"2024-06-02T23:57:15.319266+0000","last_active":"2024-06-02T23:58:55.249208+0000","last_peered":"2024-06-02T23:58:55.249208+0000","last_clean":"2024-06-02T23:58:55.249208+0000","last_became_active":"2024-06-02T23:57:15.317468+0000","last_became_peered":"2024-06-02T23:57:15.317468+0000","last_unstale":"2024-06-02T23:58:55.249208+0000","last_undegraded":"2024-06-02T23:58:55.249208+0000","last_fullsized":"2024-06-02T23:58:55.249208+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:49:53.675524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273231+0000","last_change":"2024-06-02T23:57:15.315798+0000","last_active":"2024-06-02T23:58:55.273231+0000","last_peered":"2024-06-02T23:58:55.273231+0000","last_clean":"2024-06-02T23:58:55.273231+0000","last_became_active":"2024-06-02T23:57:15.314886+0000","last_became_peered":"2024-06-02T23:57:15.314886+0000","last_unstale":"2024-06-02T23:58:55.273231+0000","last_undegraded":"2024-06-02T23:58:55.273231+0000","last_fullsized":"2024-06-02T23:58:55.273231+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:23.042226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259083+0000","last_change":"2024-06-02T23:57:15.315081+0000","last_active":"2024-06-02T23:58:55.259083+0000","last_peered":"2024-06-02T23:58:55.259083+0000","last_clean":"2024-06-02T23:58:55.259083+0000","last_became_active":"2024-06-02T23:57:15.314745+0000","last_became_peered":"2024-06-02T23:57:15.314745+0000","last_unstale":"2024-06-02T23:58:55.259083+0000","last_undegraded":"2024-06-02T23:58:55.259083+0000","last_fullsized":"2024-06-02T23:58:55.259083+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:17:49.506950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.261285+0000","last_change":"2024-06-02T23:57:15.323687+0000","last_active":"2024-06-02T23:58:55.261285+0000","last_peered":"2024-06-02T23:58:55.261285+0000","last_clean":"2024-06-02T23:58:55.261285+0000","last_became_active":"2024-06-02T23:57:15.323345+0000","last_became_peered":"2024-06-02T23:57:15.323345+0000","last_unstale":"2024-06-02T23:58:55.261285+0000","last_undegraded":"2024-06-02T23:58:55.261285+0000","last_fullsized":"2024-06-02T23:58:55.261285+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:47:40.234811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265321+0000","last_change":"2024-06-02T23:57:15.320632+0000","last_active":"2024-06-02T23:58:55.265321+0000","last_peered":"2024-06-02T23:58:55.265321+0000","last_clean":"2024-06-02T23:58:55.265321+0000","last_became_active":"2024-06-02T23:57:15.318427+0000","last_became_peered":"2024-06-02T23:57:15.318427+0000","last_unstale":"2024-06-02T23:58:55.265321+0000","last_undegraded":"2024-06-02T23:58:55.265321+0000","last_fullsized":"2024-06-02T23:58:55.265321+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:04:51.729326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259055+0000","last_change":"2024-06-02T23:57:15.312039+0000","last_active":"2024-06-02T23:58:55.259055+0000","last_peered":"2024-06-02T23:58:55.259055+0000","last_clean":"2024-06-02T23:58:55.259055+0000","last_became_active":"2024-06-02T23:57:15.311275+0000","last_became_peered":"2024-06-02T23:57:15.311275+0000","last_unstale":"2024-06-02T23:58:55.259055+0000","last_undegraded":"2024-06-02T23:58:55.259055+0000","last_fullsized":"2024-06-02T23:58:55.259055+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:50:25.509550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259686+0000","last_change":"2024-06-02T23:57:15.311927+0000","last_active":"2024-06-02T23:58:55.259686+0000","last_peered":"2024-06-02T23:58:55.259686+0000","last_clean":"2024-06-02T23:58:55.259686+0000","last_became_active":"2024-06-02T23:57:15.311484+0000","last_became_peered":"2024-06-02T23:57:15.311484+0000","last_unstale":"2024-06-02T23:58:55.259686+0000","last_undegraded":"2024-06-02T23:58:55.259686+0000","last_fullsized":"2024-06-02T23:58:55.259686+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:29:27.789219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268224+0000","last_change":"2024-06-02T23:57:15.321218+0000","last_active":"2024-06-02T23:58:55.268224+0000","last_peered":"2024-06-02T23:58:55.268224+0000","last_clean":"2024-06-02T23:58:55.268224+0000","last_became_active":"2024-06-02T23:57:15.320884+0000","last_became_peered":"2024-06-02T23:57:15.320884+0000","last_unstale":"2024-06-02T23:58:55.268224+0000","last_undegraded":"2024-06-02T23:58:55.268224+0000","last_fullsized":"2024-06-02T23:58:55.268224+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:57:20.583655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.270544+0000","last_change":"2024-06-02T23:57:15.315213+0000","last_active":"2024-06-02T23:58:55.270544+0000","last_peered":"2024-06-02T23:58:55.270544+0000","last_clean":"2024-06-02T23:58:55.270544+0000","last_became_active":"2024-06-02T23:57:15.314050+0000","last_became_peered":"2024-06-02T23:57:15.314050+0000","last_unstale":"2024-06-02T23:58:55.270544+0000","last_undegraded":"2024-06-02T23:58:55.270544+0000","last_fullsized":"2024-06-02T23:58:55.270544+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:35.214351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265267+0000","last_change":"2024-06-02T23:57:15.313901+0000","last_active":"2024-06-02T23:58:55.265267+0000","last_peered":"2024-06-02T23:58:55.265267+0000","last_clean":"2024-06-02T23:58:55.265267+0000","last_became_active":"2024-06-02T23:57:15.313452+0000","last_became_peered":"2024-06-02T23:57:15.313452+0000","last_unstale":"2024-06-02T23:58:55.265267+0000","last_undegraded":"2024-06-02T23:58:55.265267+0000","last_fullsized":"2024-06-02T23:58:55.265267+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:41:38.366741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262696+0000","last_change":"2024-06-02T23:57:15.323660+0000","last_active":"2024-06-02T23:58:55.262696+0000","last_peered":"2024-06-02T23:58:55.262696+0000","last_clean":"2024-06-02T23:58:55.262696+0000","last_became_active":"2024-06-02T23:57:15.323316+0000","last_became_peered":"2024-06-02T23:57:15.323316+0000","last_unstale":"2024-06-02T23:58:55.262696+0000","last_undegraded":"2024-06-02T23:58:55.262696+0000","last_fullsized":"2024-06-02T23:58:55.262696+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:33:10.245563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69509,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":945,"num_read_kb":547,"num_write":254,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":208527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":218,"ondisk_log_size":218,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383718,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":480586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645355,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28676,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716476,"statfs":{"total":95995035648,"available":95965671424,"internally_reserved":0,"allocated":1699840,"data_stored":1134171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808881,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1019904,"data_stored":480516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070517,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":480894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332154,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28592,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716560,"statfs":{"total":95995035648,"available":95965757440,"internally_reserved":0,"allocated":1613824,"data_stored":1073552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495680,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":1003520,"data_stored":480233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1069056,"data_stored":543702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40496,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704656,"statfs":{"total":95995035648,"available":95953567744,"internally_reserved":0,"allocated":1024000,"data_stored":481572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411412,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1089536,"data_stored":544453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":480058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920842,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":480094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757317,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28604,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716548,"statfs":{"total":95995035648,"available":95965745152,"internally_reserved":0,"allocated":1626112,"data_stored":1073230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T23:59:07.349 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-06-02T23:59:07.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:07 smithi107 ceph-mon[37048]: pgmap v355: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 11 op/s 2024-06-02T23:59:07.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:07 smithi057 ceph-mon[36457]: pgmap v355: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 11 op/s 2024-06-02T23:59:07.607 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:59:08.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:08 smithi107 ceph-mon[37048]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T23:59:08.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:08 smithi057 ceph-mon[36457]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T23:59:08.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:08 smithi049 ceph-mon[32302]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T23:59:09.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:09 smithi049 ceph-mon[32302]: pgmap v356: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-06-02T23:59:09.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.242+0000 7ffac9dff700 1 -- 172.21.15.49:0/668006434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac4101680 msgr2=0x7ffac4101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:09.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.242+0000 7ffac9dff700 1 --2- 172.21.15.49:0/668006434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac4101680 0x7ffac4101a60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ffab40099c0 tx=0x7ffab4009cd0 comp rx=0 tx=0).stop 2024-06-02T23:59:09.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.242+0000 7ffac9dff700 1 -- 172.21.15.49:0/668006434 shutdown_connections 2024-06-02T23:59:09.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.242+0000 7ffac9dff700 1 --2- 172.21.15.49:0/668006434 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffac41066d0 0x7ffac410e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:09.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.242+0000 7ffac9dff700 1 --2- 172.21.15.49:0/668006434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac4101680 0x7ffac4101a60 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:09.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.242+0000 7ffac9dff700 1 --2- 172.21.15.49:0/668006434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffac4102030 0x7ffac4105ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:09.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.242+0000 7ffac9dff700 1 -- 172.21.15.49:0/668006434 >> 172.21.15.49:0/668006434 conn(0x7ffac40773e0 msgr2=0x7ffac40777f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:09.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.242+0000 7ffac9dff700 1 -- 172.21.15.49:0/668006434 shutdown_connections 2024-06-02T23:59:09.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.242+0000 7ffac9dff700 1 -- 172.21.15.49:0/668006434 wait complete. 2024-06-02T23:59:09.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.242+0000 7ffac9dff700 1 Processor -- start 2024-06-02T23:59:09.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.243+0000 7ffac9dff700 1 -- start start 2024-06-02T23:59:09.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.243+0000 7ffac9dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffac4101680 0x7ffac4199b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:09.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.243+0000 7ffac9dff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffac4102030 0x7ffac419a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:09.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.243+0000 7ffac9dff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac41066d0 0x7ffac41a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:09.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.243+0000 7ffac9dff700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ffac4111730 con 0x7ffac41066d0 2024-06-02T23:59:09.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.243+0000 7ffac9dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ffac41115b0 con 0x7ffac4101680 2024-06-02T23:59:09.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.243+0000 7ffac9dff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ffac41118b0 con 0x7ffac4102030 2024-06-02T23:59:09.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.243+0000 7ffac3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac41066d0 0x7ffac41a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:09.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.243+0000 7ffac3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac41066d0 0x7ffac41a4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58024/0 (socket says 172.21.15.49:58024) 2024-06-02T23:59:09.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.243+0000 7ffac37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffac4101680 0x7ffac4199b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:09.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.243+0000 7ffac3fff700 1 -- 172.21.15.49:0/456234379 learned_addr learned my addr 172.21.15.49:0/456234379 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:09.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.243+0000 7ffac2ffd700 1 --2- 172.21.15.49:0/456234379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffac4102030 0x7ffac419a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:09.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.243+0000 7ffac3fff700 1 -- 172.21.15.49:0/456234379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffac4102030 msgr2=0x7ffac419a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:09.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.243+0000 7ffac3fff700 1 --2- 172.21.15.49:0/456234379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffac4102030 0x7ffac419a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:09.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.243+0000 7ffac3fff700 1 -- 172.21.15.49:0/456234379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffac4101680 msgr2=0x7ffac4199b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:09.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.243+0000 7ffac3fff700 1 --2- 172.21.15.49:0/456234379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffac4101680 0x7ffac4199b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:09.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.243+0000 7ffac3fff700 1 -- 172.21.15.49:0/456234379 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac41a5130 con 0x7ffac41066d0 2024-06-02T23:59:09.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.243+0000 7ffac3fff700 1 --2- 172.21.15.49:0/456234379 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac41066d0 0x7ffac41a4bf0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ffabc007d70 tx=0x7ffabc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:09.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.244+0000 7ffac0ff9700 1 -- 172.21.15.49:0/456234379 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc016020 con 0x7ffac41066d0 2024-06-02T23:59:09.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.244+0000 7ffac9dff700 1 -- 172.21.15.49:0/456234379 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffac41a5360 con 0x7ffac41066d0 2024-06-02T23:59:09.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.244+0000 7ffac0ff9700 1 -- 172.21.15.49:0/456234379 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffabc00ad40 con 0x7ffac41066d0 2024-06-02T23:59:09.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.244+0000 7ffac0ff9700 1 -- 172.21.15.49:0/456234379 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc011600 con 0x7ffac41066d0 2024-06-02T23:59:09.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.244+0000 7ffac9dff700 1 -- 172.21.15.49:0/456234379 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffac41a5820 con 0x7ffac41066d0 2024-06-02T23:59:09.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.245+0000 7ffac9dff700 1 -- 172.21.15.49:0/456234379 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffac4069180 con 0x7ffac41066d0 2024-06-02T23:59:09.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.246+0000 7ffac0ff9700 1 -- 172.21.15.49:0/456234379 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ffabc019020 con 0x7ffac41066d0 2024-06-02T23:59:09.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.246+0000 7ffac0ff9700 1 --2- 172.21.15.49:0/456234379 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ffaac0a2c20 0x7ffaac0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:09.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.246+0000 7ffac37fe700 1 --2- 172.21.15.49:0/456234379 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ffaac0a2c20 0x7ffaac0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:09.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.247+0000 7ffac0ff9700 1 -- 172.21.15.49:0/456234379 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7ffabc0cf010 con 0x7ffac41066d0 2024-06-02T23:59:09.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.247+0000 7ffac37fe700 1 --2- 172.21.15.49:0/456234379 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ffaac0a2c20 0x7ffaac0a50e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffab4000c00 tx=0x7ffab4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:09.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.251+0000 7ffac0ff9700 1 -- 172.21.15.49:0/456234379 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ffabc020020 con 0x7ffac41066d0 2024-06-02T23:59:09.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:09 smithi107 ceph-mon[37048]: pgmap v356: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-06-02T23:59:09.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:09 smithi057 ceph-mon[36457]: pgmap v356: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-06-02T23:59:09.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.453+0000 7ffac9dff700 1 -- 172.21.15.49:0/456234379 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffac40628d0 con 0x7ffaac0a2c20 2024-06-02T23:59:09.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.460+0000 7ffac0ff9700 1 -- 172.21.15.49:0/456234379 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258884 (secure 0 0 0) 0x7ffac40628d0 con 0x7ffaac0a2c20 2024-06-02T23:59:09.463 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:59:09.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.463+0000 7ffac9dff700 1 -- 172.21.15.49:0/456234379 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ffaac0a2c20 msgr2=0x7ffaac0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:09.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.463+0000 7ffac9dff700 1 --2- 172.21.15.49:0/456234379 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ffaac0a2c20 0x7ffaac0a50e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffab4000c00 tx=0x7ffab4005fb0 comp rx=0 tx=0).stop 2024-06-02T23:59:09.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.463+0000 7ffac9dff700 1 -- 172.21.15.49:0/456234379 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac41066d0 msgr2=0x7ffac41a4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:09.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.463+0000 7ffac9dff700 1 --2- 172.21.15.49:0/456234379 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac41066d0 0x7ffac41a4bf0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ffabc007d70 tx=0x7ffabc00a340 comp rx=0 tx=0).stop 2024-06-02T23:59:09.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.463+0000 7ffac9dff700 1 -- 172.21.15.49:0/456234379 shutdown_connections 2024-06-02T23:59:09.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.463+0000 7ffac9dff700 1 --2- 172.21.15.49:0/456234379 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ffaac0a2c20 0x7ffaac0a50e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:09.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.463+0000 7ffac9dff700 1 --2- 172.21.15.49:0/456234379 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac41066d0 0x7ffac41a4bf0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:09.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.463+0000 7ffac9dff700 1 --2- 172.21.15.49:0/456234379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffac4101680 0x7ffac4199b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:09.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.463+0000 7ffac9dff700 1 --2- 172.21.15.49:0/456234379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffac4102030 0x7ffac419a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:09.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.463+0000 7ffac9dff700 1 -- 172.21.15.49:0/456234379 >> 172.21.15.49:0/456234379 conn(0x7ffac40773e0 msgr2=0x7ffac40ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:09.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.463+0000 7ffac9dff700 1 -- 172.21.15.49:0/456234379 shutdown_connections 2024-06-02T23:59:09.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:09.463+0000 7ffac9dff700 1 -- 172.21.15.49:0/456234379 wait complete. 2024-06-02T23:59:09.466 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-06-02T23:59:10.136 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":357,"stamp":"2024-06-02T23:59:09.266799+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660111,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1111,"num_read_kb":676,"num_write":437,"num_write_kb":3083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":1180736,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":857,"ondisk_log_size":857,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375480,"kb_used_data":13848,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124566344,"statfs":{"total":1151940427776,"available":1151555936256,"internally_reserved":0,"allocated":14180352,"data_stored":7733061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":56,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003329"},"pg_stats":[{"pgid":"3.3f","version":"90'8","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.274900+0000","last_change":"2024-06-02T23:57:15.321542+0000","last_active":"2024-06-02T23:58:55.274900+0000","last_peered":"2024-06-02T23:58:55.274900+0000","last_clean":"2024-06-02T23:58:55.274900+0000","last_became_active":"2024-06-02T23:57:15.321129+0000","last_became_peered":"2024-06-02T23:57:15.321129+0000","last_unstale":"2024-06-02T23:58:55.274900+0000","last_undegraded":"2024-06-02T23:58:55.274900+0000","last_fullsized":"2024-06-02T23:58:55.274900+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:35:50.218316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.271121+0000","last_change":"2024-06-02T23:57:15.327432+0000","last_active":"2024-06-02T23:58:55.271121+0000","last_peered":"2024-06-02T23:58:55.271121+0000","last_clean":"2024-06-02T23:58:55.271121+0000","last_became_active":"2024-06-02T23:57:15.326759+0000","last_became_peered":"2024-06-02T23:57:15.326759+0000","last_unstale":"2024-06-02T23:58:55.271121+0000","last_undegraded":"2024-06-02T23:58:55.271121+0000","last_fullsized":"2024-06-02T23:58:55.271121+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:42:20.473216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.274419+0000","last_change":"2024-06-02T23:57:15.323721+0000","last_active":"2024-06-02T23:58:55.274419+0000","last_peered":"2024-06-02T23:58:55.274419+0000","last_clean":"2024-06-02T23:58:55.274419+0000","last_became_active":"2024-06-02T23:57:15.321277+0000","last_became_peered":"2024-06-02T23:57:15.321277+0000","last_unstale":"2024-06-02T23:58:55.274419+0000","last_undegraded":"2024-06-02T23:58:55.274419+0000","last_fullsized":"2024-06-02T23:58:55.274419+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:34:31.667999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.258175+0000","last_change":"2024-06-02T23:57:15.323769+0000","last_active":"2024-06-02T23:58:55.258175+0000","last_peered":"2024-06-02T23:58:55.258175+0000","last_clean":"2024-06-02T23:58:55.258175+0000","last_became_active":"2024-06-02T23:57:15.323406+0000","last_became_peered":"2024-06-02T23:57:15.323406+0000","last_unstale":"2024-06-02T23:58:55.258175+0000","last_undegraded":"2024-06-02T23:58:55.258175+0000","last_fullsized":"2024-06-02T23:58:55.258175+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:51:27.456210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.258320+0000","last_change":"2024-06-02T23:57:56.531404+0000","last_active":"2024-06-02T23:58:55.258320+0000","last_peered":"2024-06-02T23:58:55.258320+0000","last_clean":"2024-06-02T23:58:55.258320+0000","last_became_active":"2024-06-02T23:57:56.530952+0000","last_became_peered":"2024-06-02T23:57:56.530952+0000","last_unstale":"2024-06-02T23:58:55.258320+0000","last_undegraded":"2024-06-02T23:58:55.258320+0000","last_fullsized":"2024-06-02T23:58:55.258320+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:39:30.405113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268401+0000","last_change":"2024-06-02T23:57:15.320843+0000","last_active":"2024-06-02T23:58:55.268401+0000","last_peered":"2024-06-02T23:58:55.268401+0000","last_clean":"2024-06-02T23:58:55.268401+0000","last_became_active":"2024-06-02T23:57:15.320472+0000","last_became_peered":"2024-06-02T23:57:15.320472+0000","last_unstale":"2024-06-02T23:58:55.268401+0000","last_undegraded":"2024-06-02T23:58:55.268401+0000","last_fullsized":"2024-06-02T23:58:55.268401+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:49:02.620777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.270784+0000","last_change":"2024-06-02T23:57:15.321799+0000","last_active":"2024-06-02T23:58:55.270784+0000","last_peered":"2024-06-02T23:58:55.270784+0000","last_clean":"2024-06-02T23:58:55.270784+0000","last_became_active":"2024-06-02T23:57:15.321379+0000","last_became_peered":"2024-06-02T23:57:15.321379+0000","last_unstale":"2024-06-02T23:58:55.270784+0000","last_undegraded":"2024-06-02T23:58:55.270784+0000","last_fullsized":"2024-06-02T23:58:55.270784+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:36:56.404936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268771+0000","last_change":"2024-06-02T23:57:15.318771+0000","last_active":"2024-06-02T23:58:55.268771+0000","last_peered":"2024-06-02T23:58:55.268771+0000","last_clean":"2024-06-02T23:58:55.268771+0000","last_became_active":"2024-06-02T23:57:15.318420+0000","last_became_peered":"2024-06-02T23:57:15.318420+0000","last_unstale":"2024-06-02T23:58:55.268771+0000","last_undegraded":"2024-06-02T23:58:55.268771+0000","last_fullsized":"2024-06-02T23:58:55.268771+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:07:53.769443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.274434+0000","last_change":"2024-06-02T23:57:15.318989+0000","last_active":"2024-06-02T23:58:55.274434+0000","last_peered":"2024-06-02T23:58:55.274434+0000","last_clean":"2024-06-02T23:58:55.274434+0000","last_became_active":"2024-06-02T23:57:15.318424+0000","last_became_peered":"2024-06-02T23:57:15.318424+0000","last_unstale":"2024-06-02T23:58:55.274434+0000","last_undegraded":"2024-06-02T23:58:55.274434+0000","last_fullsized":"2024-06-02T23:58:55.274434+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:30:47.634662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265111+0000","last_change":"2024-06-02T23:57:15.326251+0000","last_active":"2024-06-02T23:58:55.265111+0000","last_peered":"2024-06-02T23:58:55.265111+0000","last_clean":"2024-06-02T23:58:55.265111+0000","last_became_active":"2024-06-02T23:57:15.325890+0000","last_became_peered":"2024-06-02T23:57:15.325890+0000","last_unstale":"2024-06-02T23:58:55.265111+0000","last_undegraded":"2024-06-02T23:58:55.265111+0000","last_fullsized":"2024-06-02T23:58:55.265111+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:18:54.871410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273505+0000","last_change":"2024-06-02T23:57:15.325364+0000","last_active":"2024-06-02T23:58:55.273505+0000","last_peered":"2024-06-02T23:58:55.273505+0000","last_clean":"2024-06-02T23:58:55.273505+0000","last_became_active":"2024-06-02T23:57:15.324987+0000","last_became_peered":"2024-06-02T23:57:15.324987+0000","last_unstale":"2024-06-02T23:58:55.273505+0000","last_undegraded":"2024-06-02T23:58:55.273505+0000","last_fullsized":"2024-06-02T23:58:55.273505+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:59:11.827263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.257280+0000","last_change":"2024-06-02T23:57:15.328027+0000","last_active":"2024-06-02T23:58:55.257280+0000","last_peered":"2024-06-02T23:58:55.257280+0000","last_clean":"2024-06-02T23:58:55.257280+0000","last_became_active":"2024-06-02T23:57:15.327608+0000","last_became_peered":"2024-06-02T23:57:15.327608+0000","last_unstale":"2024-06-02T23:58:55.257280+0000","last_undegraded":"2024-06-02T23:58:55.257280+0000","last_fullsized":"2024-06-02T23:58:55.257280+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:09:42.152689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.257242+0000","last_change":"2024-06-02T23:57:15.323095+0000","last_active":"2024-06-02T23:58:55.257242+0000","last_peered":"2024-06-02T23:58:55.257242+0000","last_clean":"2024-06-02T23:58:55.257242+0000","last_became_active":"2024-06-02T23:57:15.322755+0000","last_became_peered":"2024-06-02T23:57:15.322755+0000","last_unstale":"2024-06-02T23:58:55.257242+0000","last_undegraded":"2024-06-02T23:58:55.257242+0000","last_fullsized":"2024-06-02T23:58:55.257242+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:43:53.195192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272229+0000","last_change":"2024-06-02T23:57:15.327437+0000","last_active":"2024-06-02T23:58:55.272229+0000","last_peered":"2024-06-02T23:58:55.272229+0000","last_clean":"2024-06-02T23:58:55.272229+0000","last_became_active":"2024-06-02T23:57:15.326974+0000","last_became_peered":"2024-06-02T23:57:15.326974+0000","last_unstale":"2024-06-02T23:58:55.272229+0000","last_undegraded":"2024-06-02T23:58:55.272229+0000","last_fullsized":"2024-06-02T23:58:55.272229+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:20:44.978213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273212+0000","last_change":"2024-06-02T23:57:15.325414+0000","last_active":"2024-06-02T23:58:55.273212+0000","last_peered":"2024-06-02T23:58:55.273212+0000","last_clean":"2024-06-02T23:58:55.273212+0000","last_became_active":"2024-06-02T23:57:15.325033+0000","last_became_peered":"2024-06-02T23:57:15.325033+0000","last_unstale":"2024-06-02T23:58:55.273212+0000","last_undegraded":"2024-06-02T23:58:55.273212+0000","last_fullsized":"2024-06-02T23:58:55.273212+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:27:14.536646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272529+0000","last_change":"2024-06-02T23:57:15.315833+0000","last_active":"2024-06-02T23:58:55.272529+0000","last_peered":"2024-06-02T23:58:55.272529+0000","last_clean":"2024-06-02T23:58:55.272529+0000","last_became_active":"2024-06-02T23:57:15.315355+0000","last_became_peered":"2024-06-02T23:57:15.315355+0000","last_unstale":"2024-06-02T23:58:55.272529+0000","last_undegraded":"2024-06-02T23:58:55.272529+0000","last_fullsized":"2024-06-02T23:58:55.272529+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:52:05.915828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.275016+0000","last_change":"2024-06-02T23:57:15.322407+0000","last_active":"2024-06-02T23:58:55.275016+0000","last_peered":"2024-06-02T23:58:55.275016+0000","last_clean":"2024-06-02T23:58:55.275016+0000","last_became_active":"2024-06-02T23:57:15.322090+0000","last_became_peered":"2024-06-02T23:57:15.322090+0000","last_unstale":"2024-06-02T23:58:55.275016+0000","last_undegraded":"2024-06-02T23:58:55.275016+0000","last_fullsized":"2024-06-02T23:58:55.275016+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:08:48.071192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268421+0000","last_change":"2024-06-02T23:57:15.327331+0000","last_active":"2024-06-02T23:58:55.268421+0000","last_peered":"2024-06-02T23:58:55.268421+0000","last_clean":"2024-06-02T23:58:55.268421+0000","last_became_active":"2024-06-02T23:57:15.326863+0000","last_became_peered":"2024-06-02T23:57:15.326863+0000","last_unstale":"2024-06-02T23:58:55.268421+0000","last_undegraded":"2024-06-02T23:58:55.268421+0000","last_fullsized":"2024-06-02T23:58:55.268421+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:45:05.443751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.260931+0000","last_change":"2024-06-02T23:57:15.313008+0000","last_active":"2024-06-02T23:58:55.260931+0000","last_peered":"2024-06-02T23:58:55.260931+0000","last_clean":"2024-06-02T23:58:55.260931+0000","last_became_active":"2024-06-02T23:57:15.312322+0000","last_became_peered":"2024-06-02T23:57:15.312322+0000","last_unstale":"2024-06-02T23:58:55.260931+0000","last_undegraded":"2024-06-02T23:58:55.260931+0000","last_fullsized":"2024-06-02T23:58:55.260931+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:54:03.744964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":131,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.286849+0000","last_change":"2024-06-02T23:57:12.153410+0000","last_active":"2024-06-02T23:59:03.286849+0000","last_peered":"2024-06-02T23:59:03.286849+0000","last_clean":"2024-06-02T23:59:03.286849+0000","last_became_active":"2024-06-02T23:57:12.153065+0000","last_became_peered":"2024-06-02T23:57:12.153065+0000","last_unstale":"2024-06-02T23:59:03.286849+0000","last_undegraded":"2024-06-02T23:59:03.286849+0000","last_fullsized":"2024-06-02T23:59:03.286849+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:45:30.058961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":93,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.258300+0000","last_change":"2024-06-02T23:57:15.314168+0000","last_active":"2024-06-02T23:58:55.258300+0000","last_peered":"2024-06-02T23:58:55.258300+0000","last_clean":"2024-06-02T23:58:55.258300+0000","last_became_active":"2024-06-02T23:57:15.313838+0000","last_became_peered":"2024-06-02T23:57:15.313838+0000","last_unstale":"2024-06-02T23:58:55.258300+0000","last_undegraded":"2024-06-02T23:58:55.258300+0000","last_fullsized":"2024-06-02T23:58:55.258300+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:56:14.137471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526679+0000","last_change":"2024-06-02T23:57:12.305448+0000","last_active":"2024-06-02T23:57:56.526679+0000","last_peered":"2024-06-02T23:57:56.526679+0000","last_clean":"2024-06-02T23:57:56.526679+0000","last_became_active":"2024-06-02T23:57:12.305080+0000","last_became_peered":"2024-06-02T23:57:12.305080+0000","last_unstale":"2024-06-02T23:57:56.526679+0000","last_undegraded":"2024-06-02T23:57:56.526679+0000","last_fullsized":"2024-06-02T23:57:56.526679+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:20:18.660943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.275050+0000","last_change":"2024-06-02T23:57:15.321660+0000","last_active":"2024-06-02T23:58:55.275050+0000","last_peered":"2024-06-02T23:58:55.275050+0000","last_clean":"2024-06-02T23:58:55.275050+0000","last_became_active":"2024-06-02T23:57:15.321304+0000","last_became_peered":"2024-06-02T23:57:15.321304+0000","last_unstale":"2024-06-02T23:58:55.275050+0000","last_undegraded":"2024-06-02T23:58:55.275050+0000","last_fullsized":"2024-06-02T23:58:55.275050+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:10:10.933291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.544868+0000","last_change":"2024-06-02T23:57:56.544458+0000","last_active":"2024-06-02T23:57:56.544868+0000","last_peered":"2024-06-02T23:57:56.544868+0000","last_clean":"2024-06-02T23:57:56.544868+0000","last_became_active":"2024-06-02T23:57:56.532838+0000","last_became_peered":"2024-06-02T23:57:56.532838+0000","last_unstale":"2024-06-02T23:57:56.544868+0000","last_undegraded":"2024-06-02T23:57:56.544868+0000","last_fullsized":"2024-06-02T23:57:56.544868+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:27:44.700493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272420+0000","last_change":"2024-06-02T23:57:15.328944+0000","last_active":"2024-06-02T23:58:55.272420+0000","last_peered":"2024-06-02T23:58:55.272420+0000","last_clean":"2024-06-02T23:58:55.272420+0000","last_became_active":"2024-06-02T23:57:15.328531+0000","last_became_peered":"2024-06-02T23:57:15.328531+0000","last_unstale":"2024-06-02T23:58:55.272420+0000","last_undegraded":"2024-06-02T23:58:55.272420+0000","last_fullsized":"2024-06-02T23:58:55.272420+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:48:19.709989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528340+0000","last_change":"2024-06-02T23:57:12.153967+0000","last_active":"2024-06-02T23:57:56.528340+0000","last_peered":"2024-06-02T23:57:56.528340+0000","last_clean":"2024-06-02T23:57:56.528340+0000","last_became_active":"2024-06-02T23:57:12.153600+0000","last_became_peered":"2024-06-02T23:57:12.153600+0000","last_unstale":"2024-06-02T23:57:56.528340+0000","last_undegraded":"2024-06-02T23:57:56.528340+0000","last_fullsized":"2024-06-02T23:57:56.528340+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:47:58.761573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267288+0000","last_change":"2024-06-02T23:57:15.318089+0000","last_active":"2024-06-02T23:58:55.267288+0000","last_peered":"2024-06-02T23:58:55.267288+0000","last_clean":"2024-06-02T23:58:55.267288+0000","last_became_active":"2024-06-02T23:57:15.316494+0000","last_became_peered":"2024-06-02T23:57:15.316494+0000","last_unstale":"2024-06-02T23:58:55.267288+0000","last_undegraded":"2024-06-02T23:58:55.267288+0000","last_fullsized":"2024-06-02T23:58:55.267288+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:21:15.839255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"90'7","reported_seq":133,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:59:07.292182+0000","last_change":"2024-06-02T23:57:12.153624+0000","last_active":"2024-06-02T23:59:07.292182+0000","last_peered":"2024-06-02T23:59:07.292182+0000","last_clean":"2024-06-02T23:59:07.292182+0000","last_became_active":"2024-06-02T23:57:12.152712+0000","last_became_peered":"2024-06-02T23:57:12.152712+0000","last_unstale":"2024-06-02T23:59:07.292182+0000","last_undegraded":"2024-06-02T23:59:07.292182+0000","last_fullsized":"2024-06-02T23:59:07.292182+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:14:50.236213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259301+0000","last_change":"2024-06-02T23:57:15.325293+0000","last_active":"2024-06-02T23:58:55.259301+0000","last_peered":"2024-06-02T23:58:55.259301+0000","last_clean":"2024-06-02T23:58:55.259301+0000","last_became_active":"2024-06-02T23:57:15.324967+0000","last_became_peered":"2024-06-02T23:57:15.324967+0000","last_unstale":"2024-06-02T23:58:55.259301+0000","last_undegraded":"2024-06-02T23:58:55.259301+0000","last_fullsized":"2024-06-02T23:58:55.259301+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:21:23.634118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.735901+0000","last_change":"2024-06-02T23:57:12.155927+0000","last_active":"2024-06-02T23:57:56.735901+0000","last_peered":"2024-06-02T23:57:56.735901+0000","last_clean":"2024-06-02T23:57:56.735901+0000","last_became_active":"2024-06-02T23:57:12.155505+0000","last_became_peered":"2024-06-02T23:57:12.155505+0000","last_unstale":"2024-06-02T23:57:56.735901+0000","last_undegraded":"2024-06-02T23:57:56.735901+0000","last_fullsized":"2024-06-02T23:57:56.735901+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:47.555747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262351+0000","last_change":"2024-06-02T23:57:15.321796+0000","last_active":"2024-06-02T23:58:55.262351+0000","last_peered":"2024-06-02T23:58:55.262351+0000","last_clean":"2024-06-02T23:58:55.262351+0000","last_became_active":"2024-06-02T23:57:15.320850+0000","last_became_peered":"2024-06-02T23:57:15.320850+0000","last_unstale":"2024-06-02T23:58:55.262351+0000","last_undegraded":"2024-06-02T23:58:55.262351+0000","last_fullsized":"2024-06-02T23:58:55.262351+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:04:10.991920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.523804+0000","last_change":"2024-06-02T23:57:12.146589+0000","last_active":"2024-06-02T23:57:56.523804+0000","last_peered":"2024-06-02T23:57:56.523804+0000","last_clean":"2024-06-02T23:57:56.523804+0000","last_became_active":"2024-06-02T23:57:12.146224+0000","last_became_peered":"2024-06-02T23:57:12.146224+0000","last_unstale":"2024-06-02T23:57:56.523804+0000","last_undegraded":"2024-06-02T23:57:56.523804+0000","last_fullsized":"2024-06-02T23:57:56.523804+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:17:31.250585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268440+0000","last_change":"2024-06-02T23:57:15.315553+0000","last_active":"2024-06-02T23:58:55.268440+0000","last_peered":"2024-06-02T23:58:55.268440+0000","last_clean":"2024-06-02T23:58:55.268440+0000","last_became_active":"2024-06-02T23:57:15.315217+0000","last_became_peered":"2024-06-02T23:57:15.315217+0000","last_unstale":"2024-06-02T23:58:55.268440+0000","last_undegraded":"2024-06-02T23:58:55.268440+0000","last_fullsized":"2024-06-02T23:58:55.268440+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:00:23.097949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.525090+0000","last_change":"2024-06-02T23:57:12.156971+0000","last_active":"2024-06-02T23:57:56.525090+0000","last_peered":"2024-06-02T23:57:56.525090+0000","last_clean":"2024-06-02T23:57:56.525090+0000","last_became_active":"2024-06-02T23:57:12.156379+0000","last_became_peered":"2024-06-02T23:57:12.156379+0000","last_unstale":"2024-06-02T23:57:56.525090+0000","last_undegraded":"2024-06-02T23:57:56.525090+0000","last_fullsized":"2024-06-02T23:57:56.525090+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:28:50.057736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.266289+0000","last_change":"2024-06-02T23:57:15.313985+0000","last_active":"2024-06-02T23:58:55.266289+0000","last_peered":"2024-06-02T23:58:55.266289+0000","last_clean":"2024-06-02T23:58:55.266289+0000","last_became_active":"2024-06-02T23:57:15.313668+0000","last_became_peered":"2024-06-02T23:57:15.313668+0000","last_unstale":"2024-06-02T23:58:55.266289+0000","last_undegraded":"2024-06-02T23:58:55.266289+0000","last_fullsized":"2024-06-02T23:58:55.266289+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:10:56.560660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"90'5","reported_seq":219,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:59:06.290057+0000","last_change":"2024-06-02T23:57:12.156025+0000","last_active":"2024-06-02T23:59:06.290057+0000","last_peered":"2024-06-02T23:59:06.290057+0000","last_clean":"2024-06-02T23:59:06.290057+0000","last_became_active":"2024-06-02T23:57:12.155609+0000","last_became_peered":"2024-06-02T23:57:12.155609+0000","last_unstale":"2024-06-02T23:59:06.290057+0000","last_undegraded":"2024-06-02T23:59:06.290057+0000","last_fullsized":"2024-06-02T23:59:06.290057+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:27:48.953456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":188,"num_read_kb":188,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272478+0000","last_change":"2024-06-02T23:57:15.329711+0000","last_active":"2024-06-02T23:58:55.272478+0000","last_peered":"2024-06-02T23:58:55.272478+0000","last_clean":"2024-06-02T23:58:55.272478+0000","last_became_active":"2024-06-02T23:57:15.329284+0000","last_became_peered":"2024-06-02T23:57:15.329284+0000","last_unstale":"2024-06-02T23:58:55.272478+0000","last_undegraded":"2024-06-02T23:58:55.272478+0000","last_fullsized":"2024-06-02T23:58:55.272478+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:58:06.165152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528997+0000","last_change":"2024-06-02T23:57:12.156949+0000","last_active":"2024-06-02T23:57:56.528997+0000","last_peered":"2024-06-02T23:57:56.528997+0000","last_clean":"2024-06-02T23:57:56.528997+0000","last_became_active":"2024-06-02T23:57:12.156558+0000","last_became_peered":"2024-06-02T23:57:12.156558+0000","last_unstale":"2024-06-02T23:57:56.528997+0000","last_undegraded":"2024-06-02T23:57:56.528997+0000","last_fullsized":"2024-06-02T23:57:56.528997+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:05:57.658900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273601+0000","last_change":"2024-06-02T23:57:15.318638+0000","last_active":"2024-06-02T23:58:55.273601+0000","last_peered":"2024-06-02T23:58:55.273601+0000","last_clean":"2024-06-02T23:58:55.273601+0000","last_became_active":"2024-06-02T23:57:15.318321+0000","last_became_peered":"2024-06-02T23:57:15.318321+0000","last_unstale":"2024-06-02T23:58:55.273601+0000","last_undegraded":"2024-06-02T23:58:55.273601+0000","last_fullsized":"2024-06-02T23:58:55.273601+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:21:57.877235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526095+0000","last_change":"2024-06-02T23:57:12.306278+0000","last_active":"2024-06-02T23:57:56.526095+0000","last_peered":"2024-06-02T23:57:56.526095+0000","last_clean":"2024-06-02T23:57:56.526095+0000","last_became_active":"2024-06-02T23:57:12.305885+0000","last_became_peered":"2024-06-02T23:57:12.305885+0000","last_unstale":"2024-06-02T23:57:56.526095+0000","last_undegraded":"2024-06-02T23:57:56.526095+0000","last_fullsized":"2024-06-02T23:57:56.526095+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:05:07.723501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.266526+0000","last_change":"2024-06-02T23:57:15.322489+0000","last_active":"2024-06-02T23:58:55.266526+0000","last_peered":"2024-06-02T23:58:55.266526+0000","last_clean":"2024-06-02T23:58:55.266526+0000","last_became_active":"2024-06-02T23:57:15.322131+0000","last_became_peered":"2024-06-02T23:57:15.322131+0000","last_unstale":"2024-06-02T23:58:55.266526+0000","last_undegraded":"2024-06-02T23:58:55.266526+0000","last_fullsized":"2024-06-02T23:58:55.266526+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:34:43.362338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"90'36","reported_seq":262,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:59:06.289993+0000","last_change":"2024-06-02T23:57:12.156920+0000","last_active":"2024-06-02T23:59:06.289993+0000","last_peered":"2024-06-02T23:59:06.289993+0000","last_clean":"2024-06-02T23:59:06.289993+0000","last_became_active":"2024-06-02T23:57:12.156494+0000","last_became_peered":"2024-06-02T23:57:12.156494+0000","last_unstale":"2024-06-02T23:59:06.289993+0000","last_undegraded":"2024-06-02T23:59:06.289993+0000","last_fullsized":"2024-06-02T23:59:06.289993+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:49:56.458730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62556,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":200,"num_read_kb":161,"num_write":38,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265433+0000","last_change":"2024-06-02T23:57:15.328502+0000","last_active":"2024-06-02T23:58:55.265433+0000","last_peered":"2024-06-02T23:58:55.265433+0000","last_clean":"2024-06-02T23:58:55.265433+0000","last_became_active":"2024-06-02T23:57:15.328174+0000","last_became_peered":"2024-06-02T23:57:15.328174+0000","last_unstale":"2024-06-02T23:58:55.265433+0000","last_undegraded":"2024-06-02T23:58:55.265433+0000","last_fullsized":"2024-06-02T23:58:55.265433+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:58:33.355397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527324+0000","last_change":"2024-06-02T23:57:12.154204+0000","last_active":"2024-06-02T23:57:56.527324+0000","last_peered":"2024-06-02T23:57:56.527324+0000","last_clean":"2024-06-02T23:57:56.527324+0000","last_became_active":"2024-06-02T23:57:12.153412+0000","last_became_peered":"2024-06-02T23:57:12.153412+0000","last_unstale":"2024-06-02T23:57:56.527324+0000","last_undegraded":"2024-06-02T23:57:56.527324+0000","last_fullsized":"2024-06-02T23:57:56.527324+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:15.472279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262042+0000","last_change":"2024-06-02T23:57:15.314274+0000","last_active":"2024-06-02T23:58:55.262042+0000","last_peered":"2024-06-02T23:58:55.262042+0000","last_clean":"2024-06-02T23:58:55.262042+0000","last_became_active":"2024-06-02T23:57:15.313946+0000","last_became_peered":"2024-06-02T23:57:15.313946+0000","last_unstale":"2024-06-02T23:58:55.262042+0000","last_undegraded":"2024-06-02T23:58:55.262042+0000","last_fullsized":"2024-06-02T23:58:55.262042+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:07.909977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.525155+0000","last_change":"2024-06-02T23:57:12.156767+0000","last_active":"2024-06-02T23:57:56.525155+0000","last_peered":"2024-06-02T23:57:56.525155+0000","last_clean":"2024-06-02T23:57:56.525155+0000","last_became_active":"2024-06-02T23:57:12.156346+0000","last_became_peered":"2024-06-02T23:57:12.156346+0000","last_unstale":"2024-06-02T23:57:56.525155+0000","last_undegraded":"2024-06-02T23:57:56.525155+0000","last_fullsized":"2024-06-02T23:57:56.525155+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:29:45.801904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267500+0000","last_change":"2024-06-02T23:57:15.322676+0000","last_active":"2024-06-02T23:58:55.267500+0000","last_peered":"2024-06-02T23:58:55.267500+0000","last_clean":"2024-06-02T23:58:55.267500+0000","last_became_active":"2024-06-02T23:57:15.319429+0000","last_became_peered":"2024-06-02T23:57:15.319429+0000","last_unstale":"2024-06-02T23:58:55.267500+0000","last_undegraded":"2024-06-02T23:58:55.267500+0000","last_fullsized":"2024-06-02T23:58:55.267500+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:48:15.984818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'5","reported_seq":129,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:59:07.292251+0000","last_change":"2024-06-02T23:57:12.153925+0000","last_active":"2024-06-02T23:59:07.292251+0000","last_peered":"2024-06-02T23:59:07.292251+0000","last_clean":"2024-06-02T23:59:07.292251+0000","last_became_active":"2024-06-02T23:57:12.152990+0000","last_became_peered":"2024-06-02T23:57:12.152990+0000","last_unstale":"2024-06-02T23:59:07.292251+0000","last_undegraded":"2024-06-02T23:59:07.292251+0000","last_fullsized":"2024-06-02T23:59:07.292251+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:32:21.845946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.269950+0000","last_change":"2024-06-02T23:57:15.327662+0000","last_active":"2024-06-02T23:58:55.269950+0000","last_peered":"2024-06-02T23:58:55.269950+0000","last_clean":"2024-06-02T23:58:55.269950+0000","last_became_active":"2024-06-02T23:57:15.327320+0000","last_became_peered":"2024-06-02T23:57:15.327320+0000","last_unstale":"2024-06-02T23:58:55.269950+0000","last_undegraded":"2024-06-02T23:58:55.269950+0000","last_fullsized":"2024-06-02T23:58:55.269950+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:44:37.561533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528365+0000","last_change":"2024-06-02T23:57:12.306856+0000","last_active":"2024-06-02T23:57:56.528365+0000","last_peered":"2024-06-02T23:57:56.528365+0000","last_clean":"2024-06-02T23:57:56.528365+0000","last_became_active":"2024-06-02T23:57:12.306476+0000","last_became_peered":"2024-06-02T23:57:12.306476+0000","last_unstale":"2024-06-02T23:57:56.528365+0000","last_undegraded":"2024-06-02T23:57:56.528365+0000","last_fullsized":"2024-06-02T23:57:56.528365+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:30:22.839589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.258777+0000","last_change":"2024-06-02T23:57:56.890015+0000","last_active":"2024-06-02T23:58:55.258777+0000","last_peered":"2024-06-02T23:58:55.258777+0000","last_clean":"2024-06-02T23:58:55.258777+0000","last_became_active":"2024-06-02T23:57:56.889591+0000","last_became_peered":"2024-06-02T23:57:56.889591+0000","last_unstale":"2024-06-02T23:58:55.258777+0000","last_undegraded":"2024-06-02T23:58:55.258777+0000","last_fullsized":"2024-06-02T23:58:55.258777+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:14:37.851207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528059+0000","last_change":"2024-06-02T23:57:12.146690+0000","last_active":"2024-06-02T23:57:56.528059+0000","last_peered":"2024-06-02T23:57:56.528059+0000","last_clean":"2024-06-02T23:57:56.528059+0000","last_became_active":"2024-06-02T23:57:12.146372+0000","last_became_peered":"2024-06-02T23:57:12.146372+0000","last_unstale":"2024-06-02T23:57:56.528059+0000","last_undegraded":"2024-06-02T23:57:56.528059+0000","last_fullsized":"2024-06-02T23:57:56.528059+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:45:04.421365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262452+0000","last_change":"2024-06-02T23:57:15.320938+0000","last_active":"2024-06-02T23:58:55.262452+0000","last_peered":"2024-06-02T23:58:55.262452+0000","last_clean":"2024-06-02T23:58:55.262452+0000","last_became_active":"2024-06-02T23:57:15.320567+0000","last_became_peered":"2024-06-02T23:57:15.320567+0000","last_unstale":"2024-06-02T23:58:55.262452+0000","last_undegraded":"2024-06-02T23:58:55.262452+0000","last_fullsized":"2024-06-02T23:58:55.262452+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:04:29.736387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"88'1","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527707+0000","last_change":"2024-06-02T23:57:12.307020+0000","last_active":"2024-06-02T23:57:56.527707+0000","last_peered":"2024-06-02T23:57:56.527707+0000","last_clean":"2024-06-02T23:57:56.527707+0000","last_became_active":"2024-06-02T23:57:12.306650+0000","last_became_peered":"2024-06-02T23:57:12.306650+0000","last_unstale":"2024-06-02T23:57:56.527707+0000","last_undegraded":"2024-06-02T23:57:56.527707+0000","last_fullsized":"2024-06-02T23:57:56.527707+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:18:03.679704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"90'5","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.264827+0000","last_change":"2024-06-02T23:57:15.319300+0000","last_active":"2024-06-02T23:58:55.264827+0000","last_peered":"2024-06-02T23:58:55.264827+0000","last_clean":"2024-06-02T23:58:55.264827+0000","last_became_active":"2024-06-02T23:57:15.318903+0000","last_became_peered":"2024-06-02T23:57:15.318903+0000","last_unstale":"2024-06-02T23:58:55.264827+0000","last_undegraded":"2024-06-02T23:58:55.264827+0000","last_fullsized":"2024-06-02T23:58:55.264827+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:38:25.521337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":124,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.287318+0000","last_change":"2024-06-02T23:57:12.155260+0000","last_active":"2024-06-02T23:59:03.287318+0000","last_peered":"2024-06-02T23:59:03.287318+0000","last_clean":"2024-06-02T23:59:03.287318+0000","last_became_active":"2024-06-02T23:57:12.154884+0000","last_became_peered":"2024-06-02T23:57:12.154884+0000","last_unstale":"2024-06-02T23:59:03.287318+0000","last_undegraded":"2024-06-02T23:59:03.287318+0000","last_fullsized":"2024-06-02T23:59:03.287318+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:34:52.390752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.269696+0000","last_change":"2024-06-02T23:57:15.323490+0000","last_active":"2024-06-02T23:58:55.269696+0000","last_peered":"2024-06-02T23:58:55.269696+0000","last_clean":"2024-06-02T23:58:55.269696+0000","last_became_active":"2024-06-02T23:57:15.323142+0000","last_became_peered":"2024-06-02T23:57:15.323142+0000","last_unstale":"2024-06-02T23:58:55.269696+0000","last_undegraded":"2024-06-02T23:58:55.269696+0000","last_fullsized":"2024-06-02T23:58:55.269696+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:32:32.445823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.261654+0000","last_change":"2024-06-02T23:57:56.531715+0000","last_active":"2024-06-02T23:58:55.261654+0000","last_peered":"2024-06-02T23:58:55.261654+0000","last_clean":"2024-06-02T23:58:55.261654+0000","last_became_active":"2024-06-02T23:57:56.531304+0000","last_became_peered":"2024-06-02T23:57:56.531304+0000","last_unstale":"2024-06-02T23:58:55.261654+0000","last_undegraded":"2024-06-02T23:58:55.261654+0000","last_fullsized":"2024-06-02T23:58:55.261654+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:58:02.532206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":128,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:59:07.291698+0000","last_change":"2024-06-02T23:57:12.305475+0000","last_active":"2024-06-02T23:59:07.291698+0000","last_peered":"2024-06-02T23:59:07.291698+0000","last_clean":"2024-06-02T23:59:07.291698+0000","last_became_active":"2024-06-02T23:57:12.305071+0000","last_became_peered":"2024-06-02T23:57:12.305071+0000","last_unstale":"2024-06-02T23:59:07.291698+0000","last_undegraded":"2024-06-02T23:59:07.291698+0000","last_fullsized":"2024-06-02T23:59:07.291698+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:08:29.024447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259920+0000","last_change":"2024-06-02T23:57:15.308629+0000","last_active":"2024-06-02T23:58:55.259920+0000","last_peered":"2024-06-02T23:58:55.259920+0000","last_clean":"2024-06-02T23:58:55.259920+0000","last_became_active":"2024-06-02T23:57:15.307981+0000","last_became_peered":"2024-06-02T23:57:15.307981+0000","last_unstale":"2024-06-02T23:58:55.259920+0000","last_undegraded":"2024-06-02T23:58:55.259920+0000","last_fullsized":"2024-06-02T23:58:55.259920+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:14:22.446599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.652511+0000","last_change":"2024-06-02T23:57:12.155968+0000","last_active":"2024-06-02T23:57:56.652511+0000","last_peered":"2024-06-02T23:57:56.652511+0000","last_clean":"2024-06-02T23:57:56.652511+0000","last_became_active":"2024-06-02T23:57:12.155521+0000","last_became_peered":"2024-06-02T23:57:12.155521+0000","last_unstale":"2024-06-02T23:57:56.652511+0000","last_undegraded":"2024-06-02T23:57:56.652511+0000","last_fullsized":"2024-06-02T23:57:56.652511+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:45:00.397317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":349,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528775+0000","last_change":"2024-06-02T23:55:50.081978+0000","last_active":"2024-06-02T23:57:56.528775+0000","last_peered":"2024-06-02T23:57:56.528775+0000","last_clean":"2024-06-02T23:57:56.528775+0000","last_became_active":"2024-06-02T23:55:50.081431+0000","last_became_peered":"2024-06-02T23:55:50.081431+0000","last_unstale":"2024-06-02T23:57:56.528775+0000","last_undegraded":"2024-06-02T23:57:56.528775+0000","last_fullsized":"2024-06-02T23:57:56.528775+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:52:23.676206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:52:23.676206+0000","last_clean_scrub_stamp":"2024-06-02T23:52:23.676206+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:29:59.979935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262328+0000","last_change":"2024-06-02T23:57:56.529633+0000","last_active":"2024-06-02T23:58:55.262328+0000","last_peered":"2024-06-02T23:58:55.262328+0000","last_clean":"2024-06-02T23:58:55.262328+0000","last_became_active":"2024-06-02T23:57:56.529210+0000","last_became_peered":"2024-06-02T23:57:56.529210+0000","last_unstale":"2024-06-02T23:58:55.262328+0000","last_undegraded":"2024-06-02T23:58:55.262328+0000","last_fullsized":"2024-06-02T23:58:55.262328+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:51:31.807162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.529000+0000","last_change":"2024-06-02T23:57:12.155897+0000","last_active":"2024-06-02T23:57:56.529000+0000","last_peered":"2024-06-02T23:57:56.529000+0000","last_clean":"2024-06-02T23:57:56.529000+0000","last_became_active":"2024-06-02T23:57:12.155461+0000","last_became_peered":"2024-06-02T23:57:12.155461+0000","last_unstale":"2024-06-02T23:57:56.529000+0000","last_undegraded":"2024-06-02T23:57:56.529000+0000","last_fullsized":"2024-06-02T23:57:56.529000+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:19:22.104104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527986+0000","last_change":"2024-06-02T23:57:12.306363+0000","last_active":"2024-06-02T23:57:56.527986+0000","last_peered":"2024-06-02T23:57:56.527986+0000","last_clean":"2024-06-02T23:57:56.527986+0000","last_became_active":"2024-06-02T23:57:12.305920+0000","last_became_peered":"2024-06-02T23:57:12.305920+0000","last_unstale":"2024-06-02T23:57:56.527986+0000","last_undegraded":"2024-06-02T23:57:56.527986+0000","last_fullsized":"2024-06-02T23:57:56.527986+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:31:01.787879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262136+0000","last_change":"2024-06-02T23:57:15.316038+0000","last_active":"2024-06-02T23:58:55.262136+0000","last_peered":"2024-06-02T23:58:55.262136+0000","last_clean":"2024-06-02T23:58:55.262136+0000","last_became_active":"2024-06-02T23:57:15.315715+0000","last_became_peered":"2024-06-02T23:57:15.315715+0000","last_unstale":"2024-06-02T23:58:55.262136+0000","last_undegraded":"2024-06-02T23:58:55.262136+0000","last_fullsized":"2024-06-02T23:58:55.262136+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:34:36.014251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"90'17","reported_seq":58,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.540024+0000","last_change":"2024-06-02T23:57:56.539596+0000","last_active":"2024-06-02T23:57:56.540024+0000","last_peered":"2024-06-02T23:57:56.540024+0000","last_clean":"2024-06-02T23:57:56.540024+0000","last_became_active":"2024-06-02T23:57:56.532686+0000","last_became_peered":"2024-06-02T23:57:56.532686+0000","last_unstale":"2024-06-02T23:57:56.540024+0000","last_undegraded":"2024-06-02T23:57:56.540024+0000","last_fullsized":"2024-06-02T23:57:56.540024+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:29:24.691941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267245+0000","last_change":"2024-06-02T23:57:15.315657+0000","last_active":"2024-06-02T23:58:55.267245+0000","last_peered":"2024-06-02T23:58:55.267245+0000","last_clean":"2024-06-02T23:58:55.267245+0000","last_became_active":"2024-06-02T23:57:15.315293+0000","last_became_peered":"2024-06-02T23:57:15.315293+0000","last_unstale":"2024-06-02T23:58:55.267245+0000","last_undegraded":"2024-06-02T23:58:55.267245+0000","last_fullsized":"2024-06-02T23:58:55.267245+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:52:55.241379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.652145+0000","last_change":"2024-06-02T23:57:12.405664+0000","last_active":"2024-06-02T23:57:56.652145+0000","last_peered":"2024-06-02T23:57:56.652145+0000","last_clean":"2024-06-02T23:57:56.652145+0000","last_became_active":"2024-06-02T23:57:12.405281+0000","last_became_peered":"2024-06-02T23:57:12.405281+0000","last_unstale":"2024-06-02T23:57:56.652145+0000","last_undegraded":"2024-06-02T23:57:56.652145+0000","last_fullsized":"2024-06-02T23:57:56.652145+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:46:50.119466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273511+0000","last_change":"2024-06-02T23:57:15.318136+0000","last_active":"2024-06-02T23:58:55.273511+0000","last_peered":"2024-06-02T23:58:55.273511+0000","last_clean":"2024-06-02T23:58:55.273511+0000","last_became_active":"2024-06-02T23:57:15.317753+0000","last_became_peered":"2024-06-02T23:57:15.317753+0000","last_unstale":"2024-06-02T23:58:55.273511+0000","last_undegraded":"2024-06-02T23:58:55.273511+0000","last_fullsized":"2024-06-02T23:58:55.273511+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:35:11.025266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.887858+0000","last_change":"2024-06-02T23:57:12.305954+0000","last_active":"2024-06-02T23:57:56.887858+0000","last_peered":"2024-06-02T23:57:56.887858+0000","last_clean":"2024-06-02T23:57:56.887858+0000","last_became_active":"2024-06-02T23:57:12.305589+0000","last_became_peered":"2024-06-02T23:57:12.305589+0000","last_unstale":"2024-06-02T23:57:56.887858+0000","last_undegraded":"2024-06-02T23:57:56.887858+0000","last_fullsized":"2024-06-02T23:57:56.887858+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:34:34.178446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.243354+0000","last_change":"2024-06-02T23:57:15.327115+0000","last_active":"2024-06-02T23:58:55.243354+0000","last_peered":"2024-06-02T23:58:55.243354+0000","last_clean":"2024-06-02T23:58:55.243354+0000","last_became_active":"2024-06-02T23:57:15.326746+0000","last_became_peered":"2024-06-02T23:57:15.326746+0000","last_unstale":"2024-06-02T23:58:55.243354+0000","last_undegraded":"2024-06-02T23:58:55.243354+0000","last_fullsized":"2024-06-02T23:58:55.243354+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:08:04.340517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526196+0000","last_change":"2024-06-02T23:57:12.152933+0000","last_active":"2024-06-02T23:57:56.526196+0000","last_peered":"2024-06-02T23:57:56.526196+0000","last_clean":"2024-06-02T23:57:56.526196+0000","last_became_active":"2024-06-02T23:57:12.152453+0000","last_became_peered":"2024-06-02T23:57:12.152453+0000","last_unstale":"2024-06-02T23:57:56.526196+0000","last_undegraded":"2024-06-02T23:57:56.526196+0000","last_fullsized":"2024-06-02T23:57:56.526196+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:47:05.144374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272363+0000","last_change":"2024-06-02T23:57:15.326042+0000","last_active":"2024-06-02T23:58:55.272363+0000","last_peered":"2024-06-02T23:58:55.272363+0000","last_clean":"2024-06-02T23:58:55.272363+0000","last_became_active":"2024-06-02T23:57:15.325585+0000","last_became_peered":"2024-06-02T23:57:15.325585+0000","last_unstale":"2024-06-02T23:58:55.272363+0000","last_undegraded":"2024-06-02T23:58:55.272363+0000","last_fullsized":"2024-06-02T23:58:55.272363+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:40:37.305875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"88'3","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527114+0000","last_change":"2024-06-02T23:57:12.139155+0000","last_active":"2024-06-02T23:57:56.527114+0000","last_peered":"2024-06-02T23:57:56.527114+0000","last_clean":"2024-06-02T23:57:56.527114+0000","last_became_active":"2024-06-02T23:57:12.138732+0000","last_became_peered":"2024-06-02T23:57:12.138732+0000","last_unstale":"2024-06-02T23:57:56.527114+0000","last_undegraded":"2024-06-02T23:57:56.527114+0000","last_fullsized":"2024-06-02T23:57:56.527114+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:18:29.148439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265401+0000","last_change":"2024-06-02T23:57:15.319510+0000","last_active":"2024-06-02T23:58:55.265401+0000","last_peered":"2024-06-02T23:58:55.265401+0000","last_clean":"2024-06-02T23:58:55.265401+0000","last_became_active":"2024-06-02T23:57:15.319192+0000","last_became_peered":"2024-06-02T23:57:15.319192+0000","last_unstale":"2024-06-02T23:58:55.265401+0000","last_undegraded":"2024-06-02T23:58:55.265401+0000","last_fullsized":"2024-06-02T23:58:55.265401+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:04:04.241833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.657766+0000","last_change":"2024-06-02T23:57:56.657766+0000","last_active":"2024-06-02T23:57:56.657766+0000","last_peered":"2024-06-02T23:57:56.657766+0000","last_clean":"2024-06-02T23:57:56.657766+0000","last_became_active":"2024-06-02T23:57:56.653435+0000","last_became_peered":"2024-06-02T23:57:56.653435+0000","last_unstale":"2024-06-02T23:57:56.657766+0000","last_undegraded":"2024-06-02T23:57:56.657766+0000","last_fullsized":"2024-06-02T23:57:56.657766+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:03:23.594470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273064+0000","last_change":"2024-06-02T23:57:15.320837+0000","last_active":"2024-06-02T23:58:55.273064+0000","last_peered":"2024-06-02T23:58:55.273064+0000","last_clean":"2024-06-02T23:58:55.273064+0000","last_became_active":"2024-06-02T23:57:15.320257+0000","last_became_peered":"2024-06-02T23:57:15.320257+0000","last_unstale":"2024-06-02T23:58:55.273064+0000","last_undegraded":"2024-06-02T23:58:55.273064+0000","last_fullsized":"2024-06-02T23:58:55.273064+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:18:29.638614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'5","reported_seq":128,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:59:06.290705+0000","last_change":"2024-06-02T23:57:12.405175+0000","last_active":"2024-06-02T23:59:06.290705+0000","last_peered":"2024-06-02T23:59:06.290705+0000","last_clean":"2024-06-02T23:59:06.290705+0000","last_became_active":"2024-06-02T23:57:12.404767+0000","last_became_peered":"2024-06-02T23:57:12.404767+0000","last_unstale":"2024-06-02T23:59:06.290705+0000","last_undegraded":"2024-06-02T23:59:06.290705+0000","last_fullsized":"2024-06-02T23:59:06.290705+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:46:57.421288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":97,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273631+0000","last_change":"2024-06-02T23:57:15.322888+0000","last_active":"2024-06-02T23:58:55.273631+0000","last_peered":"2024-06-02T23:58:55.273631+0000","last_clean":"2024-06-02T23:58:55.273631+0000","last_became_active":"2024-06-02T23:57:15.321982+0000","last_became_peered":"2024-06-02T23:57:15.321982+0000","last_unstale":"2024-06-02T23:58:55.273631+0000","last_undegraded":"2024-06-02T23:58:55.273631+0000","last_fullsized":"2024-06-02T23:58:55.273631+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:51:57.253824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526128+0000","last_change":"2024-06-02T23:57:12.153715+0000","last_active":"2024-06-02T23:57:56.526128+0000","last_peered":"2024-06-02T23:57:56.526128+0000","last_clean":"2024-06-02T23:57:56.526128+0000","last_became_active":"2024-06-02T23:57:12.152544+0000","last_became_peered":"2024-06-02T23:57:12.152544+0000","last_unstale":"2024-06-02T23:57:56.526128+0000","last_undegraded":"2024-06-02T23:57:56.526128+0000","last_fullsized":"2024-06-02T23:57:56.526128+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:51:05.874962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"90'7","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.271174+0000","last_change":"2024-06-02T23:57:15.318759+0000","last_active":"2024-06-02T23:58:55.271174+0000","last_peered":"2024-06-02T23:58:55.271174+0000","last_clean":"2024-06-02T23:58:55.271174+0000","last_became_active":"2024-06-02T23:57:15.317942+0000","last_became_peered":"2024-06-02T23:57:15.317942+0000","last_unstale":"2024-06-02T23:58:55.271174+0000","last_undegraded":"2024-06-02T23:58:55.271174+0000","last_fullsized":"2024-06-02T23:58:55.271174+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:39:44.142890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.894131+0000","last_change":"2024-06-02T23:57:56.894131+0000","last_active":"2024-06-02T23:57:56.894131+0000","last_peered":"2024-06-02T23:57:56.894131+0000","last_clean":"2024-06-02T23:57:56.894131+0000","last_became_active":"2024-06-02T23:57:56.889794+0000","last_became_peered":"2024-06-02T23:57:56.889794+0000","last_unstale":"2024-06-02T23:57:56.894131+0000","last_undegraded":"2024-06-02T23:57:56.894131+0000","last_fullsized":"2024-06-02T23:57:56.894131+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:02:41.670419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.266418+0000","last_change":"2024-06-02T23:57:15.324355+0000","last_active":"2024-06-02T23:58:55.266418+0000","last_peered":"2024-06-02T23:58:55.266418+0000","last_clean":"2024-06-02T23:58:55.266418+0000","last_became_active":"2024-06-02T23:57:15.324019+0000","last_became_peered":"2024-06-02T23:57:15.324019+0000","last_unstale":"2024-06-02T23:58:55.266418+0000","last_undegraded":"2024-06-02T23:58:55.266418+0000","last_fullsized":"2024-06-02T23:58:55.266418+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:27:01.927109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.266349+0000","last_change":"2024-06-02T23:57:15.326420+0000","last_active":"2024-06-02T23:58:55.266349+0000","last_peered":"2024-06-02T23:58:55.266349+0000","last_clean":"2024-06-02T23:58:55.266349+0000","last_became_active":"2024-06-02T23:57:15.326091+0000","last_became_peered":"2024-06-02T23:57:15.326091+0000","last_unstale":"2024-06-02T23:58:55.266349+0000","last_undegraded":"2024-06-02T23:58:55.266349+0000","last_fullsized":"2024-06-02T23:58:55.266349+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:54:05.355352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.252603+0000","last_change":"2024-06-02T23:57:56.653297+0000","last_active":"2024-06-02T23:58:55.252603+0000","last_peered":"2024-06-02T23:58:55.252603+0000","last_clean":"2024-06-02T23:58:55.252603+0000","last_became_active":"2024-06-02T23:57:56.652874+0000","last_became_peered":"2024-06-02T23:57:56.652874+0000","last_unstale":"2024-06-02T23:58:55.252603+0000","last_undegraded":"2024-06-02T23:58:55.252603+0000","last_fullsized":"2024-06-02T23:58:55.252603+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:27:55.486382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.249208+0000","last_change":"2024-06-02T23:57:15.319266+0000","last_active":"2024-06-02T23:58:55.249208+0000","last_peered":"2024-06-02T23:58:55.249208+0000","last_clean":"2024-06-02T23:58:55.249208+0000","last_became_active":"2024-06-02T23:57:15.317468+0000","last_became_peered":"2024-06-02T23:57:15.317468+0000","last_unstale":"2024-06-02T23:58:55.249208+0000","last_undegraded":"2024-06-02T23:58:55.249208+0000","last_fullsized":"2024-06-02T23:58:55.249208+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:49:53.675524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273231+0000","last_change":"2024-06-02T23:57:15.315798+0000","last_active":"2024-06-02T23:58:55.273231+0000","last_peered":"2024-06-02T23:58:55.273231+0000","last_clean":"2024-06-02T23:58:55.273231+0000","last_became_active":"2024-06-02T23:57:15.314886+0000","last_became_peered":"2024-06-02T23:57:15.314886+0000","last_unstale":"2024-06-02T23:58:55.273231+0000","last_undegraded":"2024-06-02T23:58:55.273231+0000","last_fullsized":"2024-06-02T23:58:55.273231+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:23.042226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259083+0000","last_change":"2024-06-02T23:57:15.315081+0000","last_active":"2024-06-02T23:58:55.259083+0000","last_peered":"2024-06-02T23:58:55.259083+0000","last_clean":"2024-06-02T23:58:55.259083+0000","last_became_active":"2024-06-02T23:57:15.314745+0000","last_became_peered":"2024-06-02T23:57:15.314745+0000","last_unstale":"2024-06-02T23:58:55.259083+0000","last_undegraded":"2024-06-02T23:58:55.259083+0000","last_fullsized":"2024-06-02T23:58:55.259083+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:17:49.506950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.261285+0000","last_change":"2024-06-02T23:57:15.323687+0000","last_active":"2024-06-02T23:58:55.261285+0000","last_peered":"2024-06-02T23:58:55.261285+0000","last_clean":"2024-06-02T23:58:55.261285+0000","last_became_active":"2024-06-02T23:57:15.323345+0000","last_became_peered":"2024-06-02T23:57:15.323345+0000","last_unstale":"2024-06-02T23:58:55.261285+0000","last_undegraded":"2024-06-02T23:58:55.261285+0000","last_fullsized":"2024-06-02T23:58:55.261285+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:47:40.234811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265321+0000","last_change":"2024-06-02T23:57:15.320632+0000","last_active":"2024-06-02T23:58:55.265321+0000","last_peered":"2024-06-02T23:58:55.265321+0000","last_clean":"2024-06-02T23:58:55.265321+0000","last_became_active":"2024-06-02T23:57:15.318427+0000","last_became_peered":"2024-06-02T23:57:15.318427+0000","last_unstale":"2024-06-02T23:58:55.265321+0000","last_undegraded":"2024-06-02T23:58:55.265321+0000","last_fullsized":"2024-06-02T23:58:55.265321+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:04:51.729326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259055+0000","last_change":"2024-06-02T23:57:15.312039+0000","last_active":"2024-06-02T23:58:55.259055+0000","last_peered":"2024-06-02T23:58:55.259055+0000","last_clean":"2024-06-02T23:58:55.259055+0000","last_became_active":"2024-06-02T23:57:15.311275+0000","last_became_peered":"2024-06-02T23:57:15.311275+0000","last_unstale":"2024-06-02T23:58:55.259055+0000","last_undegraded":"2024-06-02T23:58:55.259055+0000","last_fullsized":"2024-06-02T23:58:55.259055+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:50:25.509550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259686+0000","last_change":"2024-06-02T23:57:15.311927+0000","last_active":"2024-06-02T23:58:55.259686+0000","last_peered":"2024-06-02T23:58:55.259686+0000","last_clean":"2024-06-02T23:58:55.259686+0000","last_became_active":"2024-06-02T23:57:15.311484+0000","last_became_peered":"2024-06-02T23:57:15.311484+0000","last_unstale":"2024-06-02T23:58:55.259686+0000","last_undegraded":"2024-06-02T23:58:55.259686+0000","last_fullsized":"2024-06-02T23:58:55.259686+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:29:27.789219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268224+0000","last_change":"2024-06-02T23:57:15.321218+0000","last_active":"2024-06-02T23:58:55.268224+0000","last_peered":"2024-06-02T23:58:55.268224+0000","last_clean":"2024-06-02T23:58:55.268224+0000","last_became_active":"2024-06-02T23:57:15.320884+0000","last_became_peered":"2024-06-02T23:57:15.320884+0000","last_unstale":"2024-06-02T23:58:55.268224+0000","last_undegraded":"2024-06-02T23:58:55.268224+0000","last_fullsized":"2024-06-02T23:58:55.268224+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:57:20.583655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.270544+0000","last_change":"2024-06-02T23:57:15.315213+0000","last_active":"2024-06-02T23:58:55.270544+0000","last_peered":"2024-06-02T23:58:55.270544+0000","last_clean":"2024-06-02T23:58:55.270544+0000","last_became_active":"2024-06-02T23:57:15.314050+0000","last_became_peered":"2024-06-02T23:57:15.314050+0000","last_unstale":"2024-06-02T23:58:55.270544+0000","last_undegraded":"2024-06-02T23:58:55.270544+0000","last_fullsized":"2024-06-02T23:58:55.270544+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:35.214351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265267+0000","last_change":"2024-06-02T23:57:15.313901+0000","last_active":"2024-06-02T23:58:55.265267+0000","last_peered":"2024-06-02T23:58:55.265267+0000","last_clean":"2024-06-02T23:58:55.265267+0000","last_became_active":"2024-06-02T23:57:15.313452+0000","last_became_peered":"2024-06-02T23:57:15.313452+0000","last_unstale":"2024-06-02T23:58:55.265267+0000","last_undegraded":"2024-06-02T23:58:55.265267+0000","last_fullsized":"2024-06-02T23:58:55.265267+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:41:38.366741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262696+0000","last_change":"2024-06-02T23:57:15.323660+0000","last_active":"2024-06-02T23:58:55.262696+0000","last_peered":"2024-06-02T23:58:55.262696+0000","last_clean":"2024-06-02T23:58:55.262696+0000","last_became_active":"2024-06-02T23:57:15.323316+0000","last_became_peered":"2024-06-02T23:57:15.323316+0000","last_unstale":"2024-06-02T23:58:55.262696+0000","last_undegraded":"2024-06-02T23:58:55.262696+0000","last_fullsized":"2024-06-02T23:58:55.262696+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:33:10.245563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69509,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":985,"num_read_kb":567,"num_write":254,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":208527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":218,"ondisk_log_size":218,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383719,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":480586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645356,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28676,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716476,"statfs":{"total":95995035648,"available":95965671424,"internally_reserved":0,"allocated":1699840,"data_stored":1134171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808881,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1019904,"data_stored":480516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070518,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":480894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332154,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28592,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716560,"statfs":{"total":95995035648,"available":95965757440,"internally_reserved":0,"allocated":1613824,"data_stored":1073552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495681,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":1003520,"data_stored":480233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1069056,"data_stored":543702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738463,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40496,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704656,"statfs":{"total":95995035648,"available":95953567744,"internally_reserved":0,"allocated":1024000,"data_stored":481572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1089536,"data_stored":544453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182480,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":480058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920843,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":480094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757318,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28604,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716548,"statfs":{"total":95995035648,"available":95965745152,"internally_reserved":0,"allocated":1626112,"data_stored":1073230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T23:59:10.141 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-06-02T23:59:10.141 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-06-02T23:59:10.141 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-06-02T23:59:10.141 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph health --format=json 2024-06-02T23:59:10.395 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:59:11.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:11 smithi107 ceph-mon[37048]: pgmap v357: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2024-06-02T23:59:11.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:11 smithi107 ceph-mon[37048]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T23:59:11.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:11 smithi057 ceph-mon[36457]: pgmap v357: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2024-06-02T23:59:11.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:11 smithi057 ceph-mon[36457]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T23:59:11.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:11 smithi049 ceph-mon[32302]: pgmap v357: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2024-06-02T23:59:11.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:11 smithi049 ceph-mon[32302]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T23:59:12.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.012+0000 7f025ccbb700 1 -- 172.21.15.49:0/3910594712 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0258106720 msgr2=0x7f025810e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:12.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.012+0000 7f025ccbb700 1 --2- 172.21.15.49:0/3910594712 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0258106720 0x7f025810e2c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f025000b0d0 tx=0x7f025000b3e0 comp rx=0 tx=0).stop 2024-06-02T23:59:12.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.012+0000 7f025ccbb700 1 -- 172.21.15.49:0/3910594712 shutdown_connections 2024-06-02T23:59:12.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.012+0000 7f025ccbb700 1 --2- 172.21.15.49:0/3910594712 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0258106720 0x7f025810e2c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:12.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.012+0000 7f025ccbb700 1 --2- 172.21.15.49:0/3910594712 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02581019d0 0x7f0258101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:12.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.012+0000 7f025ccbb700 1 --2- 172.21.15.49:0/3910594712 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0258102380 0x7f0258105ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:12.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.012+0000 7f025ccbb700 1 -- 172.21.15.49:0/3910594712 >> 172.21.15.49:0/3910594712 conn(0x7f0258078340 msgr2=0x7f0258078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:12.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.012+0000 7f025ccbb700 1 -- 172.21.15.49:0/3910594712 shutdown_connections 2024-06-02T23:59:12.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.013+0000 7f025ccbb700 1 -- 172.21.15.49:0/3910594712 wait complete. 2024-06-02T23:59:12.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.013+0000 7f025ccbb700 1 Processor -- start 2024-06-02T23:59:12.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.014+0000 7f025ccbb700 1 -- start start 2024-06-02T23:59:12.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.014+0000 7f025ccbb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02581019d0 0x7f025819e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:12.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.014+0000 7f025ccbb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0258102380 0x7f025819ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:12.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.014+0000 7f025ccbb700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0258106720 0x7f0258198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:12.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.014+0000 7f025ccbb700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0258111750 con 0x7f0258102380 2024-06-02T23:59:12.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.014+0000 7f025ccbb700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f02581115d0 con 0x7f02581019d0 2024-06-02T23:59:12.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.014+0000 7f025ccbb700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f02581118d0 con 0x7f0258106720 2024-06-02T23:59:12.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.014+0000 7f025659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02581019d0 0x7f025819e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:12.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.014+0000 7f024dd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0258102380 0x7f025819ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:12.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.014+0000 7f025659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02581019d0 0x7f025819e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.49:37094/0 (socket says 172.21.15.49:37094) 2024-06-02T23:59:12.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.014+0000 7f024dd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0258102380 0x7f025819ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58032/0 (socket says 172.21.15.49:58032) 2024-06-02T23:59:12.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.014+0000 7f025659c700 1 -- 172.21.15.49:0/50024832 learned_addr learned my addr 172.21.15.49:0/50024832 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:12.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.014+0000 7f0256d9d700 1 --2- 172.21.15.49:0/50024832 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0258106720 0x7f0258198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:12.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.014+0000 7f024dd9b700 1 -- 172.21.15.49:0/50024832 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0258106720 msgr2=0x7f0258198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:12.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.014+0000 7f024dd9b700 1 --2- 172.21.15.49:0/50024832 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0258106720 0x7f0258198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:12.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.014+0000 7f024dd9b700 1 -- 172.21.15.49:0/50024832 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02581019d0 msgr2=0x7f025819e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:12.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.014+0000 7f024dd9b700 1 --2- 172.21.15.49:0/50024832 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02581019d0 0x7f025819e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:12.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.014+0000 7f024dd9b700 1 -- 172.21.15.49:0/50024832 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0258199200 con 0x7f0258102380 2024-06-02T23:59:12.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.015+0000 7f024dd9b700 1 --2- 172.21.15.49:0/50024832 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0258102380 0x7f025819ee20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f025806a9d0 tx=0x7f024000b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:12.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.015+0000 7f024ffff700 1 -- 172.21.15.49:0/50024832 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0240015020 con 0x7f0258102380 2024-06-02T23:59:12.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.015+0000 7f024ffff700 1 -- 172.21.15.49:0/50024832 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0240011b10 con 0x7f0258102380 2024-06-02T23:59:12.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.015+0000 7f025ccbb700 1 -- 172.21.15.49:0/50024832 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02581994f0 con 0x7f0258102380 2024-06-02T23:59:12.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.015+0000 7f024ffff700 1 -- 172.21.15.49:0/50024832 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0240010c50 con 0x7f0258102380 2024-06-02T23:59:12.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.015+0000 7f025ccbb700 1 -- 172.21.15.49:0/50024832 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02581a57b0 con 0x7f0258102380 2024-06-02T23:59:12.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.016+0000 7f025ccbb700 1 -- 172.21.15.49:0/50024832 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0258102ad0 con 0x7f0258102380 2024-06-02T23:59:12.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.017+0000 7f024ffff700 1 -- 172.21.15.49:0/50024832 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0240018020 con 0x7f0258102380 2024-06-02T23:59:12.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.018+0000 7f024ffff700 1 --2- 172.21.15.49:0/50024832 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f02440a2c20 0x7f02440a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:12.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.018+0000 7f025659c700 1 --2- 172.21.15.49:0/50024832 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f02440a2c20 0x7f02440a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:12.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.018+0000 7f024ffff700 1 -- 172.21.15.49:0/50024832 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f02400ceb90 con 0x7f0258102380 2024-06-02T23:59:12.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.018+0000 7f025659c700 1 --2- 172.21.15.49:0/50024832 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f02440a2c20 0x7f02440a50e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0248005950 tx=0x7f024800a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:12.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.021+0000 7f024ffff700 1 -- 172.21.15.49:0/50024832 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f024001f020 con 0x7f0258102380 2024-06-02T23:59:12.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.282+0000 7f025ccbb700 1 -- 172.21.15.49:0/50024832 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0258199fd0 con 0x7f0258102380 2024-06-02T23:59:12.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.282+0000 7f024ffff700 1 -- 172.21.15.49:0/50024832 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f024009baf0 con 0x7f0258102380 2024-06-02T23:59:12.282 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:59:12.282 INFO:teuthology.orchestra.run.smithi049.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-06-02T23:59:12.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.284+0000 7f025ccbb700 1 -- 172.21.15.49:0/50024832 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f02440a2c20 msgr2=0x7f02440a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:12.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.284+0000 7f025ccbb700 1 --2- 172.21.15.49:0/50024832 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f02440a2c20 0x7f02440a50e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0248005950 tx=0x7f024800a3b0 comp rx=0 tx=0).stop 2024-06-02T23:59:12.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.284+0000 7f025ccbb700 1 -- 172.21.15.49:0/50024832 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0258102380 msgr2=0x7f025819ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:12.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.284+0000 7f025ccbb700 1 --2- 172.21.15.49:0/50024832 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0258102380 0x7f025819ee20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f025806a9d0 tx=0x7f024000b730 comp rx=0 tx=0).stop 2024-06-02T23:59:12.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.284+0000 7f025ccbb700 1 -- 172.21.15.49:0/50024832 shutdown_connections 2024-06-02T23:59:12.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.284+0000 7f025ccbb700 1 --2- 172.21.15.49:0/50024832 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f02440a2c20 0x7f02440a50e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:12.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.284+0000 7f025ccbb700 1 --2- 172.21.15.49:0/50024832 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0258106720 0x7f0258198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:12.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.284+0000 7f025ccbb700 1 --2- 172.21.15.49:0/50024832 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02581019d0 0x7f025819e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:12.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.284+0000 7f025ccbb700 1 --2- 172.21.15.49:0/50024832 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0258102380 0x7f025819ee20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:12.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.284+0000 7f025ccbb700 1 -- 172.21.15.49:0/50024832 >> 172.21.15.49:0/50024832 conn(0x7f0258078340 msgr2=0x7f025806ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:12.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.284+0000 7f025ccbb700 1 -- 172.21.15.49:0/50024832 shutdown_connections 2024-06-02T23:59:12.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:12.284+0000 7f025ccbb700 1 -- 172.21.15.49:0/50024832 wait complete. 2024-06-02T23:59:12.923 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-06-02T23:59:12.923 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T23:59:13.181 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:59:13.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:13 smithi049 ceph-mon[32302]: pgmap v358: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-06-02T23:59:13.212 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:13 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/50024832' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-06-02T23:59:13.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:13 smithi107 ceph-mon[37048]: pgmap v358: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-06-02T23:59:13.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:13 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/50024832' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-06-02T23:59:13.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:13 smithi057 ceph-mon[36457]: pgmap v358: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-06-02T23:59:13.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:13 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/50024832' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-06-02T23:59:14.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.959+0000 7f83facf4700 1 -- 172.21.15.49:0/1993928445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83f4102ed0 msgr2=0x7f83f410f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:14.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.959+0000 7f83facf4700 1 --2- 172.21.15.49:0/1993928445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83f4102ed0 0x7f83f410f350 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f83ec00b0a0 tx=0x7f83ec00b3b0 comp rx=0 tx=0).stop 2024-06-02T23:59:14.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.959+0000 7f83facf4700 1 -- 172.21.15.49:0/1993928445 shutdown_connections 2024-06-02T23:59:14.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.959+0000 7f83facf4700 1 --2- 172.21.15.49:0/1993928445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83f4102ed0 0x7f83f410f350 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:14.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.959+0000 7f83facf4700 1 --2- 172.21.15.49:0/1993928445 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83f4108510 0x7f83f41088f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:14.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.959+0000 7f83facf4700 1 --2- 172.21.15.49:0/1993928445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83f4102510 0x7f83f4102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:14.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.959+0000 7f83facf4700 1 -- 172.21.15.49:0/1993928445 >> 172.21.15.49:0/1993928445 conn(0x7f83f40795b0 msgr2=0x7f83f40799c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:14.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.959+0000 7f83facf4700 1 -- 172.21.15.49:0/1993928445 shutdown_connections 2024-06-02T23:59:14.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.959+0000 7f83facf4700 1 -- 172.21.15.49:0/1993928445 wait complete. 2024-06-02T23:59:14.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.960+0000 7f83facf4700 1 Processor -- start 2024-06-02T23:59:14.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.960+0000 7f83facf4700 1 -- start start 2024-06-02T23:59:14.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.961+0000 7f83facf4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83f4102510 0x7f83f4074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:14.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.961+0000 7f83facf4700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83f4102ed0 0x7f83f4074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:14.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.961+0000 7f83facf4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83f4108510 0x7f83f4075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:14.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.961+0000 7f83facf4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f83f4112840 con 0x7f83f4108510 2024-06-02T23:59:14.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.961+0000 7f83facf4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f83f41126c0 con 0x7f83f4102510 2024-06-02T23:59:14.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.961+0000 7f83facf4700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f83f41129c0 con 0x7f83f4102ed0 2024-06-02T23:59:14.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.961+0000 7f83f9291700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83f4108510 0x7f83f4075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:14.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.961+0000 7f83f9291700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83f4108510 0x7f83f4075210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37970/0 (socket says 172.21.15.49:37970) 2024-06-02T23:59:14.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.961+0000 7f83f9291700 1 -- 172.21.15.49:0/3879231752 learned_addr learned my addr 172.21.15.49:0/3879231752 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:14.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.961+0000 7f83f3fff700 1 --2- 172.21.15.49:0/3879231752 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83f4102ed0 0x7f83f4074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:14.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.961+0000 7f83f8a90700 1 --2- 172.21.15.49:0/3879231752 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83f4102510 0x7f83f4074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:14.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.961+0000 7f83f9291700 1 -- 172.21.15.49:0/3879231752 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83f4102ed0 msgr2=0x7f83f4074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:14.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.961+0000 7f83f9291700 1 --2- 172.21.15.49:0/3879231752 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83f4102ed0 0x7f83f4074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:14.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.961+0000 7f83f9291700 1 -- 172.21.15.49:0/3879231752 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83f4102510 msgr2=0x7f83f4074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:14.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.961+0000 7f83f9291700 1 --2- 172.21.15.49:0/3879231752 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83f4102510 0x7f83f4074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:14.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.961+0000 7f83f9291700 1 -- 172.21.15.49:0/3879231752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83f41a71e0 con 0x7f83f4108510 2024-06-02T23:59:14.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.961+0000 7f83f9291700 1 --2- 172.21.15.49:0/3879231752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83f4108510 0x7f83f4075210 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f83ec0062a0 tx=0x7f83ec00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:14.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.961+0000 7f83f1ffb700 1 -- 172.21.15.49:0/3879231752 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ec021070 con 0x7f83f4108510 2024-06-02T23:59:14.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.961+0000 7f83f1ffb700 1 -- 172.21.15.49:0/3879231752 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83ec007db0 con 0x7f83f4108510 2024-06-02T23:59:14.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.961+0000 7f83f1ffb700 1 -- 172.21.15.49:0/3879231752 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ec005460 con 0x7f83f4108510 2024-06-02T23:59:14.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.962+0000 7f83facf4700 1 -- 172.21.15.49:0/3879231752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83f41a7470 con 0x7f83f4108510 2024-06-02T23:59:14.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.962+0000 7f83facf4700 1 -- 172.21.15.49:0/3879231752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83f41a78d0 con 0x7f83f4108510 2024-06-02T23:59:14.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.963+0000 7f83facf4700 1 -- 172.21.15.49:0/3879231752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83f410aa10 con 0x7f83f4108510 2024-06-02T23:59:14.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.964+0000 7f83f1ffb700 1 -- 172.21.15.49:0/3879231752 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f83ec024070 con 0x7f83f4108510 2024-06-02T23:59:14.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.965+0000 7f83f1ffb700 1 --2- 172.21.15.49:0/3879231752 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f83e40a2c20 0x7f83e40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:14.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.965+0000 7f83f8a90700 1 --2- 172.21.15.49:0/3879231752 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f83e40a2c20 0x7f83e40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:14.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.965+0000 7f83f1ffb700 1 -- 172.21.15.49:0/3879231752 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f83ec0d0380 con 0x7f83f4108510 2024-06-02T23:59:14.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.965+0000 7f83f8a90700 1 --2- 172.21.15.49:0/3879231752 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f83e40a2c20 0x7f83e40a50e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f83e8006fd0 tx=0x7f83e8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:14.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:14.968+0000 7f83f1ffb700 1 -- 172.21.15.49:0/3879231752 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f83ec09d370 con 0x7f83f4108510 2024-06-02T23:59:15.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:15 smithi049 ceph-mon[32302]: pgmap v359: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-02T23:59:15.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:15.222+0000 7f83facf4700 1 -- 172.21.15.49:0/3879231752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83f4069180 con 0x7f83f4108510 2024-06-02T23:59:15.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:15.223+0000 7f83f1ffb700 1 -- 172.21.15.49:0/3879231752 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11929 (secure 0 0 0) 0x7f83ec0a3090 con 0x7f83f4108510 2024-06-02T23:59:15.223 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:59:15.223 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1553264866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1553264866},{"type":"v1","addr":"172.21.15.49:6835","nonce":1553264866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2266285252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2266285252},{"type":"v1","addr":"172.21.15.49:6837","nonce":2266285252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T23:57:16.991201+0000","modified":"2024-06-02T23:57:35.219435+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24485,"mds_2":24466,"mds_3":24464,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6839/1729124617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":1729124617},{"type":"v1","addr":"172.21.15.49:6839","nonce":1729124617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6841/1902772235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":1902772235},{"type":"v1","addr":"172.21.15.49:6841","nonce":1902772235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6833/1633534002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1633534002},{"type":"v1","addr":"172.21.15.57:6833","nonce":1633534002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6835/2254905671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2254905671},{"type":"v1","addr":"172.21.15.57:6835","nonce":2254905671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.107:6835/3693542801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3693542801},{"type":"v1","addr":"172.21.15.107:6835","nonce":3693542801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.57:6837/230452144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":230452144},{"type":"v1","addr":"172.21.15.57:6837","nonce":230452144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.107:6837/3700593315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":3700593315},{"type":"v1","addr":"172.21.15.107:6837","nonce":3700593315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6839/249825195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":249825195},{"type":"v1","addr":"172.21.15.57:6839","nonce":249825195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6839/1986600681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1986600681},{"type":"v1","addr":"172.21.15.107:6839","nonce":1986600681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24466,24487,24460,24464,24485]},"id":1}]} 2024-06-02T23:59:15.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:15.225+0000 7f83facf4700 1 -- 172.21.15.49:0/3879231752 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f83e40a2c20 msgr2=0x7f83e40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:15.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:15.225+0000 7f83facf4700 1 --2- 172.21.15.49:0/3879231752 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f83e40a2c20 0x7f83e40a50e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f83e8006fd0 tx=0x7f83e8008040 comp rx=0 tx=0).stop 2024-06-02T23:59:15.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:15.225+0000 7f83facf4700 1 -- 172.21.15.49:0/3879231752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83f4108510 msgr2=0x7f83f4075210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:15.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:15.225+0000 7f83facf4700 1 --2- 172.21.15.49:0/3879231752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83f4108510 0x7f83f4075210 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f83ec0062a0 tx=0x7f83ec00bf10 comp rx=0 tx=0).stop 2024-06-02T23:59:15.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:15.225+0000 7f83facf4700 1 -- 172.21.15.49:0/3879231752 shutdown_connections 2024-06-02T23:59:15.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:15.225+0000 7f83facf4700 1 --2- 172.21.15.49:0/3879231752 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f83e40a2c20 0x7f83e40a50e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:15.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:15.225+0000 7f83facf4700 1 --2- 172.21.15.49:0/3879231752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83f4108510 0x7f83f4075210 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:15.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:15.225+0000 7f83facf4700 1 --2- 172.21.15.49:0/3879231752 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83f4102510 0x7f83f4074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:15.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:15.225+0000 7f83facf4700 1 --2- 172.21.15.49:0/3879231752 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83f4102ed0 0x7f83f4074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:15.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:15.225+0000 7f83facf4700 1 -- 172.21.15.49:0/3879231752 >> 172.21.15.49:0/3879231752 conn(0x7f83f40795b0 msgr2=0x7f83f41010d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:15.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:15.225+0000 7f83facf4700 1 -- 172.21.15.49:0/3879231752 shutdown_connections 2024-06-02T23:59:15.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:15.225+0000 7f83facf4700 1 -- 172.21.15.49:0/3879231752 wait complete. 2024-06-02T23:59:15.226 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-06-02T23:59:15.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:15 smithi057 ceph-mon[36457]: pgmap v359: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-02T23:59:15.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:15 smithi107 ceph-mon[37048]: pgmap v359: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-02T23:59:15.818 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T23:59:16.068 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:59:16.374 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:16 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3879231752' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:59:16.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:16 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/3879231752' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:59:16.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:16 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/3879231752' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:59:17.229 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:17 smithi049 ceph-mon[32302]: pgmap v360: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-06-02T23:59:17.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:17 smithi057 ceph-mon[36457]: pgmap v360: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-06-02T23:59:17.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:17 smithi107 ceph-mon[37048]: pgmap v360: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-06-02T23:59:17.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.723+0000 7f2a6a544700 1 -- 172.21.15.49:0/2400790202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a64101fd0 msgr2=0x7f2a64105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:17.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.723+0000 7f2a6a544700 1 --2- 172.21.15.49:0/2400790202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a64101fd0 0x7f2a64105fd0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c0099c0 tx=0x7f2a4c009cd0 comp rx=0 tx=0).stop 2024-06-02T23:59:17.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.723+0000 7f2a6a544700 1 -- 172.21.15.49:0/2400790202 shutdown_connections 2024-06-02T23:59:17.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.723+0000 7f2a6a544700 1 --2- 172.21.15.49:0/2400790202 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a641066b0 0x7f2a6410e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:17.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.723+0000 7f2a6a544700 1 --2- 172.21.15.49:0/2400790202 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a64101620 0x7f2a64101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:17.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.723+0000 7f2a6a544700 1 --2- 172.21.15.49:0/2400790202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a64101fd0 0x7f2a64105fd0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:17.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.723+0000 7f2a6a544700 1 -- 172.21.15.49:0/2400790202 >> 172.21.15.49:0/2400790202 conn(0x7f2a64078340 msgr2=0x7f2a64078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:17.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.723+0000 7f2a6a544700 1 -- 172.21.15.49:0/2400790202 shutdown_connections 2024-06-02T23:59:17.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.723+0000 7f2a6a544700 1 -- 172.21.15.49:0/2400790202 wait complete. 2024-06-02T23:59:17.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.724+0000 7f2a6a544700 1 Processor -- start 2024-06-02T23:59:17.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.724+0000 7f2a6a544700 1 -- start start 2024-06-02T23:59:17.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.724+0000 7f2a6a544700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a64101620 0x7f2a64103070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:17.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.724+0000 7f2a6a544700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a64101fd0 0x7f2a641035b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:17.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.724+0000 7f2a6a544700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a641066b0 0x7f2a64103af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:17.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.724+0000 7f2a6a544700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2a641117c0 con 0x7f2a641066b0 2024-06-02T23:59:17.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.724+0000 7f2a6a544700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f2a64111640 con 0x7f2a64101620 2024-06-02T23:59:17.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.724+0000 7f2a6a544700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2a64111940 con 0x7f2a64101fd0 2024-06-02T23:59:17.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.724+0000 7f2a68ae1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a641066b0 0x7f2a64103af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:17.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.724+0000 7f2a68ae1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a641066b0 0x7f2a64103af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37980/0 (socket says 172.21.15.49:37980) 2024-06-02T23:59:17.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.724+0000 7f2a68ae1700 1 -- 172.21.15.49:0/3850932879 learned_addr learned my addr 172.21.15.49:0/3850932879 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:17.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.724+0000 7f2a5bfff700 1 --2- 172.21.15.49:0/3850932879 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a64101fd0 0x7f2a641035b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:17.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.724+0000 7f2a63fff700 1 --2- 172.21.15.49:0/3850932879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a64101620 0x7f2a64103070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:17.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.724+0000 7f2a68ae1700 1 -- 172.21.15.49:0/3850932879 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a64101fd0 msgr2=0x7f2a641035b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:17.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.724+0000 7f2a68ae1700 1 --2- 172.21.15.49:0/3850932879 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a64101fd0 0x7f2a641035b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:17.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.724+0000 7f2a68ae1700 1 -- 172.21.15.49:0/3850932879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a64101620 msgr2=0x7f2a64103070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:17.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.724+0000 7f2a68ae1700 1 --2- 172.21.15.49:0/3850932879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a64101620 0x7f2a64103070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:17.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.724+0000 7f2a68ae1700 1 -- 172.21.15.49:0/3850932879 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a641a73c0 con 0x7f2a641066b0 2024-06-02T23:59:17.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.725+0000 7f2a68ae1700 1 --2- 172.21.15.49:0/3850932879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a641066b0 0x7f2a64103af0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c00b970 tx=0x7f2a5c00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:17.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.725+0000 7f2a61ffb700 1 -- 172.21.15.49:0/3850932879 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c00d860 con 0x7f2a641066b0 2024-06-02T23:59:17.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.725+0000 7f2a6a544700 1 -- 172.21.15.49:0/3850932879 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a641a76b0 con 0x7f2a641066b0 2024-06-02T23:59:17.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.725+0000 7f2a61ffb700 1 -- 172.21.15.49:0/3850932879 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a5c00e430 con 0x7f2a641066b0 2024-06-02T23:59:17.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.725+0000 7f2a61ffb700 1 -- 172.21.15.49:0/3850932879 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c017660 con 0x7f2a641066b0 2024-06-02T23:59:17.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.725+0000 7f2a6a544700 1 -- 172.21.15.49:0/3850932879 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a641a7bc0 con 0x7f2a641066b0 2024-06-02T23:59:17.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.726+0000 7f2a6a544700 1 -- 172.21.15.49:0/3850932879 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a64102ab0 con 0x7f2a641066b0 2024-06-02T23:59:17.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.727+0000 7f2a61ffb700 1 -- 172.21.15.49:0/3850932879 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2a5c00e5e0 con 0x7f2a641066b0 2024-06-02T23:59:17.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.728+0000 7f2a61ffb700 1 --2- 172.21.15.49:0/3850932879 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f2a500a2c20 0x7f2a500a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:17.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.728+0000 7f2a63fff700 1 --2- 172.21.15.49:0/3850932879 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f2a500a2c20 0x7f2a500a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:17.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.728+0000 7f2a61ffb700 1 -- 172.21.15.49:0/3850932879 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f2a5c0cec00 con 0x7f2a641066b0 2024-06-02T23:59:17.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.728+0000 7f2a63fff700 1 --2- 172.21.15.49:0/3850932879 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f2a500a2c20 0x7f2a500a50e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2a54009a10 tx=0x7f2a54009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:17.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.732+0000 7f2a61ffb700 1 -- 172.21.15.49:0/3850932879 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2a5c013030 con 0x7f2a641066b0 2024-06-02T23:59:17.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.982+0000 7f2a6a544700 1 -- 172.21.15.49:0/3850932879 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a641a7eb0 con 0x7f2a641066b0 2024-06-02T23:59:17.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.983+0000 7f2a61ffb700 1 -- 172.21.15.49:0/3850932879 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11929 (secure 0 0 0) 0x7f2a5c09bb60 con 0x7f2a641066b0 2024-06-02T23:59:17.983 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:59:17.983 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1553264866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1553264866},{"type":"v1","addr":"172.21.15.49:6835","nonce":1553264866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2266285252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2266285252},{"type":"v1","addr":"172.21.15.49:6837","nonce":2266285252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T23:57:16.991201+0000","modified":"2024-06-02T23:57:35.219435+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24485,"mds_2":24466,"mds_3":24464,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6839/1729124617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":1729124617},{"type":"v1","addr":"172.21.15.49:6839","nonce":1729124617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6841/1902772235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":1902772235},{"type":"v1","addr":"172.21.15.49:6841","nonce":1902772235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6833/1633534002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1633534002},{"type":"v1","addr":"172.21.15.57:6833","nonce":1633534002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6835/2254905671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2254905671},{"type":"v1","addr":"172.21.15.57:6835","nonce":2254905671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.107:6835/3693542801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3693542801},{"type":"v1","addr":"172.21.15.107:6835","nonce":3693542801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.57:6837/230452144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":230452144},{"type":"v1","addr":"172.21.15.57:6837","nonce":230452144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.107:6837/3700593315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":3700593315},{"type":"v1","addr":"172.21.15.107:6837","nonce":3700593315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6839/249825195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":249825195},{"type":"v1","addr":"172.21.15.57:6839","nonce":249825195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6839/1986600681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1986600681},{"type":"v1","addr":"172.21.15.107:6839","nonce":1986600681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24466,24487,24460,24464,24485]},"id":1}]} 2024-06-02T23:59:17.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.985+0000 7f2a6a544700 1 -- 172.21.15.49:0/3850932879 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f2a500a2c20 msgr2=0x7f2a500a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:17.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.985+0000 7f2a6a544700 1 --2- 172.21.15.49:0/3850932879 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f2a500a2c20 0x7f2a500a50e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2a54009a10 tx=0x7f2a54009190 comp rx=0 tx=0).stop 2024-06-02T23:59:17.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.985+0000 7f2a6a544700 1 -- 172.21.15.49:0/3850932879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a641066b0 msgr2=0x7f2a64103af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:17.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.985+0000 7f2a6a544700 1 --2- 172.21.15.49:0/3850932879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a641066b0 0x7f2a64103af0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c00b970 tx=0x7f2a5c00bc80 comp rx=0 tx=0).stop 2024-06-02T23:59:17.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.985+0000 7f2a6a544700 1 -- 172.21.15.49:0/3850932879 shutdown_connections 2024-06-02T23:59:17.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.985+0000 7f2a6a544700 1 --2- 172.21.15.49:0/3850932879 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f2a500a2c20 0x7f2a500a50e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:17.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.985+0000 7f2a6a544700 1 --2- 172.21.15.49:0/3850932879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a641066b0 0x7f2a64103af0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:17.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.985+0000 7f2a6a544700 1 --2- 172.21.15.49:0/3850932879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a64101620 0x7f2a64103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:17.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.985+0000 7f2a6a544700 1 --2- 172.21.15.49:0/3850932879 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a64101fd0 0x7f2a641035b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:17.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.985+0000 7f2a6a544700 1 -- 172.21.15.49:0/3850932879 >> 172.21.15.49:0/3850932879 conn(0x7f2a64078340 msgr2=0x7f2a641053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:17.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.986+0000 7f2a6a544700 1 -- 172.21.15.49:0/3850932879 shutdown_connections 2024-06-02T23:59:17.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:17.986+0000 7f2a6a544700 1 -- 172.21.15.49:0/3850932879 wait complete. 2024-06-02T23:59:17.986 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-06-02T23:59:18.261 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:18 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3850932879' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:59:18.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:18 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/3850932879' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:59:18.538 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-02T23:59:18.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:18 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/3850932879' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:59:18.790 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:59:19.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:19 smithi049 ceph-mon[32302]: pgmap v361: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-06-02T23:59:19.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:19 smithi057 ceph-mon[36457]: pgmap v361: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-06-02T23:59:19.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:19 smithi107 ceph-mon[37048]: pgmap v361: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-06-02T23:59:20.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:20 smithi049 ceph-mon[32302]: pgmap v362: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:59:20.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:20 smithi057 ceph-mon[36457]: pgmap v362: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:59:20.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.472+0000 7ff385a6d700 1 -- 172.21.15.49:0/2231681967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff380102740 msgr2=0x7ff380102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:20.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.472+0000 7ff385a6d700 1 --2- 172.21.15.49:0/2231681967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff380102740 0x7ff380102b20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff3700099c0 tx=0x7ff370009cd0 comp rx=0 tx=0).stop 2024-06-02T23:59:20.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.472+0000 7ff385a6d700 1 -- 172.21.15.49:0/2231681967 shutdown_connections 2024-06-02T23:59:20.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.472+0000 7ff385a6d700 1 --2- 172.21.15.49:0/2231681967 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff380107840 0x7ff38010f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:20.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.472+0000 7ff385a6d700 1 --2- 172.21.15.49:0/2231681967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff380102740 0x7ff380102b20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:20.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.472+0000 7ff385a6d700 1 --2- 172.21.15.49:0/2231681967 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3801030f0 0x7ff380107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:20.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.472+0000 7ff385a6d700 1 -- 172.21.15.49:0/2231681967 >> 172.21.15.49:0/2231681967 conn(0x7ff3800795f0 msgr2=0x7ff380079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:20.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.472+0000 7ff385a6d700 1 -- 172.21.15.49:0/2231681967 shutdown_connections 2024-06-02T23:59:20.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.472+0000 7ff385a6d700 1 -- 172.21.15.49:0/2231681967 wait complete. 2024-06-02T23:59:20.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.473+0000 7ff385a6d700 1 Processor -- start 2024-06-02T23:59:20.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.473+0000 7ff385a6d700 1 -- start start 2024-06-02T23:59:20.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.473+0000 7ff385a6d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff380102740 0x7ff38019e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:20.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.473+0000 7ff385a6d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3801030f0 0x7ff38019ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:20.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.473+0000 7ff385a6d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff380107840 0x7ff380198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:20.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.473+0000 7ff385a6d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff380112780 con 0x7ff380102740 2024-06-02T23:59:20.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.473+0000 7ff385a6d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff380112600 con 0x7ff380107840 2024-06-02T23:59:20.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.473+0000 7ff385a6d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff380112900 con 0x7ff3801030f0 2024-06-02T23:59:20.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.474+0000 7ff37f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff380102740 0x7ff38019e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:20.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.474+0000 7ff37f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff380102740 0x7ff38019e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37988/0 (socket says 172.21.15.49:37988) 2024-06-02T23:59:20.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.474+0000 7ff37f7fe700 1 -- 172.21.15.49:0/286487216 learned_addr learned my addr 172.21.15.49:0/286487216 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:20.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.474+0000 7ff37effd700 1 --2- 172.21.15.49:0/286487216 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3801030f0 0x7ff38019ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:20.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.474+0000 7ff37ffff700 1 --2- 172.21.15.49:0/286487216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff380107840 0x7ff380198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:20.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.474+0000 7ff37f7fe700 1 -- 172.21.15.49:0/286487216 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3801030f0 msgr2=0x7ff38019ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:20.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.474+0000 7ff37f7fe700 1 --2- 172.21.15.49:0/286487216 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3801030f0 0x7ff38019ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:20.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.474+0000 7ff37f7fe700 1 -- 172.21.15.49:0/286487216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff380107840 msgr2=0x7ff380198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:20.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.474+0000 7ff37f7fe700 1 --2- 172.21.15.49:0/286487216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff380107840 0x7ff380198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:20.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.474+0000 7ff37f7fe700 1 -- 172.21.15.49:0/286487216 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3801991c0 con 0x7ff380102740 2024-06-02T23:59:20.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.474+0000 7ff37ffff700 1 --2- 172.21.15.49:0/286487216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff380107840 0x7ff380198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:59:20.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.474+0000 7ff37f7fe700 1 --2- 172.21.15.49:0/286487216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff380102740 0x7ff38019e850 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff370009fd0 tx=0x7ff370003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:20.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.474+0000 7ff37cff9700 1 -- 172.21.15.49:0/286487216 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff370027070 con 0x7ff380102740 2024-06-02T23:59:20.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.474+0000 7ff37cff9700 1 -- 172.21.15.49:0/286487216 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3700040d0 con 0x7ff380102740 2024-06-02T23:59:20.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.474+0000 7ff385a6d700 1 -- 172.21.15.49:0/286487216 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff380199450 con 0x7ff380102740 2024-06-02T23:59:20.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.474+0000 7ff37cff9700 1 -- 172.21.15.49:0/286487216 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff37000f460 con 0x7ff380102740 2024-06-02T23:59:20.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.474+0000 7ff385a6d700 1 -- 172.21.15.49:0/286487216 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3800746c0 con 0x7ff380102740 2024-06-02T23:59:20.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.475+0000 7ff385a6d700 1 -- 172.21.15.49:0/286487216 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff380103bd0 con 0x7ff380102740 2024-06-02T23:59:20.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.477+0000 7ff37cff9700 1 -- 172.21.15.49:0/286487216 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff37002a070 con 0x7ff380102740 2024-06-02T23:59:20.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.477+0000 7ff37cff9700 1 --2- 172.21.15.49:0/286487216 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff3680a2c20 0x7ff3680a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:20.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.477+0000 7ff37effd700 1 --2- 172.21.15.49:0/286487216 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff3680a2c20 0x7ff3680a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:20.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.477+0000 7ff37cff9700 1 -- 172.21.15.49:0/286487216 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7ff3700d07d0 con 0x7ff380102740 2024-06-02T23:59:20.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.478+0000 7ff37effd700 1 --2- 172.21.15.49:0/286487216 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff3680a2c20 0x7ff3680a50e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff380102040 tx=0x7ff37400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:20.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.481+0000 7ff37cff9700 1 -- 172.21.15.49:0/286487216 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff370031070 con 0x7ff380102740 2024-06-02T23:59:20.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:20 smithi107 ceph-mon[37048]: pgmap v362: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:59:20.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.692+0000 7ff385a6d700 1 -- 172.21.15.49:0/286487216 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff380069180 con 0x7ff380102740 2024-06-02T23:59:20.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.694+0000 7ff37cff9700 1 -- 172.21.15.49:0/286487216 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+22612 (secure 0 0 0) 0x7ff370013070 con 0x7ff380102740 2024-06-02T23:59:20.695 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:59:20.695 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":90,"fsid":"890dd222-213a-11ef-bc9b-c7b262605968","created":"2024-06-02T23:48:53.323536+0000","modified":"2024-06-02T23:57:56.520324+0000","last_up_change":"2024-06-02T23:56:12.156697+0000","last_in_change":"2024-06-02T23:55:51.667118+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:52:23.676079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:57:10.753178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T23:57:14.240610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e0013e80-07d6-4ad3-87d8-d41988988ef5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6803","nonce":811647073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6805","nonce":811647073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6809","nonce":811647073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6807","nonce":811647073}]},"public_addr":"172.21.15.49:6803/811647073","cluster_addr":"172.21.15.49:6805/811647073","heartbeat_back_addr":"172.21.15.49:6809/811647073","heartbeat_front_addr":"172.21.15.49:6807/811647073","state":["exists","up"]},{"osd":1,"uuid":"f37d9f79-e349-4de7-81e7-385ddb905f58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6801","nonce":1260507785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6803","nonce":1260507785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6807","nonce":1260507785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6805","nonce":1260507785}]},"public_addr":"172.21.15.57:6801/1260507785","cluster_addr":"172.21.15.57:6803/1260507785","heartbeat_back_addr":"172.21.15.57:6807/1260507785","heartbeat_front_addr":"172.21.15.57:6805/1260507785","state":["exists","up"]},{"osd":2,"uuid":"94889281-7d45-4e78-9d37-b98e3fbe8494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6801","nonce":303899951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6803","nonce":303899951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6807","nonce":303899951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6805","nonce":303899951}]},"public_addr":"172.21.15.107:6801/303899951","cluster_addr":"172.21.15.107:6803/303899951","heartbeat_back_addr":"172.21.15.107:6807/303899951","heartbeat_front_addr":"172.21.15.107:6805/303899951","state":["exists","up"]},{"osd":3,"uuid":"31f4c18c-fbda-400d-8b3b-0955b0c4a6a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6811","nonce":60796312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6813","nonce":60796312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6817","nonce":60796312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6815","nonce":60796312}]},"public_addr":"172.21.15.49:6811/60796312","cluster_addr":"172.21.15.49:6813/60796312","heartbeat_back_addr":"172.21.15.49:6817/60796312","heartbeat_front_addr":"172.21.15.49:6815/60796312","state":["exists","up"]},{"osd":4,"uuid":"8076c2f3-0138-459e-89b5-c5c4586a14ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6809","nonce":3106842986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6811","nonce":3106842986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6815","nonce":3106842986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6813","nonce":3106842986}]},"public_addr":"172.21.15.57:6809/3106842986","cluster_addr":"172.21.15.57:6811/3106842986","heartbeat_back_addr":"172.21.15.57:6815/3106842986","heartbeat_front_addr":"172.21.15.57:6813/3106842986","state":["exists","up"]},{"osd":5,"uuid":"68f7abd3-4292-41fa-90ce-4ac34ea2b964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6809","nonce":389294142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6811","nonce":389294142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6815","nonce":389294142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6813","nonce":389294142}]},"public_addr":"172.21.15.107:6809/389294142","cluster_addr":"172.21.15.107:6811/389294142","heartbeat_back_addr":"172.21.15.107:6815/389294142","heartbeat_front_addr":"172.21.15.107:6813/389294142","state":["exists","up"]},{"osd":6,"uuid":"c0345dd0-71b7-436d-88f8-fe3d7cb69d8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6819","nonce":894624552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6821","nonce":894624552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6825","nonce":894624552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6823","nonce":894624552}]},"public_addr":"172.21.15.49:6819/894624552","cluster_addr":"172.21.15.49:6821/894624552","heartbeat_back_addr":"172.21.15.49:6825/894624552","heartbeat_front_addr":"172.21.15.49:6823/894624552","state":["exists","up"]},{"osd":7,"uuid":"9abd81c7-dcc1-4e14-8ab7-9fa0746067ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6817","nonce":3126027900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6819","nonce":3126027900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6823","nonce":3126027900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6821","nonce":3126027900}]},"public_addr":"172.21.15.57:6817/3126027900","cluster_addr":"172.21.15.57:6819/3126027900","heartbeat_back_addr":"172.21.15.57:6823/3126027900","heartbeat_front_addr":"172.21.15.57:6821/3126027900","state":["exists","up"]},{"osd":8,"uuid":"80532119-5de8-45d2-9cb9-bd8a6194199b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6817","nonce":3620047229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6819","nonce":3620047229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6823","nonce":3620047229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6821","nonce":3620047229}]},"public_addr":"172.21.15.107:6817/3620047229","cluster_addr":"172.21.15.107:6819/3620047229","heartbeat_back_addr":"172.21.15.107:6823/3620047229","heartbeat_front_addr":"172.21.15.107:6821/3620047229","state":["exists","up"]},{"osd":9,"uuid":"f0b5dcfa-9fd2-4a98-863b-197defa890af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6827","nonce":3627936526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6829","nonce":3627936526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6833","nonce":3627936526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6831","nonce":3627936526}]},"public_addr":"172.21.15.49:6827/3627936526","cluster_addr":"172.21.15.49:6829/3627936526","heartbeat_back_addr":"172.21.15.49:6833/3627936526","heartbeat_front_addr":"172.21.15.49:6831/3627936526","state":["exists","up"]},{"osd":10,"uuid":"21a75846-adec-41b8-9e1d-e5c61ba30b12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6825","nonce":3013235811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6827","nonce":3013235811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6831","nonce":3013235811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6829","nonce":3013235811}]},"public_addr":"172.21.15.57:6825/3013235811","cluster_addr":"172.21.15.57:6827/3013235811","heartbeat_back_addr":"172.21.15.57:6831/3013235811","heartbeat_front_addr":"172.21.15.57:6829/3013235811","state":["exists","up"]},{"osd":11,"uuid":"eb963b63-2c61-4169-b8fe-31c7f5ec919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6825","nonce":4217534517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6827","nonce":4217534517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6831","nonce":4217534517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6829","nonce":4217534517}]},"public_addr":"172.21.15.107:6825/4217534517","cluster_addr":"172.21.15.107:6827/4217534517","heartbeat_back_addr":"172.21.15.107:6831/4217534517","heartbeat_front_addr":"172.21.15.107:6829/4217534517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:51:31.067312+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:51:56.088456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:52:20.539941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:52:45.055717+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:53:11.178438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:53:35.794217+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:00.775674+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:27.574752+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:52.177634+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:55:17.118854+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:55:44.217535+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:56:10.500970+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/525944311":"2024-06-03T23:49:55.151590+0000","172.21.15.49:0/1841969299":"2024-06-03T23:49:55.151590+0000","172.21.15.49:0/1880506696":"2024-06-03T23:49:55.151590+0000","172.21.15.49:6801/1206062338":"2024-06-03T23:49:55.151590+0000","172.21.15.49:6800/549058216":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/2112783954":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/2183920213":"2024-06-03T23:49:29.042670+0000","172.21.15.49:6801/549058216":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/3350970308":"2024-06-03T23:49:29.042670+0000","172.21.15.49:6800/1206062338":"2024-06-03T23:49:55.151590+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:59:20.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.697+0000 7ff385a6d700 1 -- 172.21.15.49:0/286487216 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff3680a2c20 msgr2=0x7ff3680a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:20.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.697+0000 7ff385a6d700 1 --2- 172.21.15.49:0/286487216 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff3680a2c20 0x7ff3680a50e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff380102040 tx=0x7ff37400a300 comp rx=0 tx=0).stop 2024-06-02T23:59:20.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.697+0000 7ff385a6d700 1 -- 172.21.15.49:0/286487216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff380102740 msgr2=0x7ff38019e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:20.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.697+0000 7ff385a6d700 1 --2- 172.21.15.49:0/286487216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff380102740 0x7ff38019e850 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff370009fd0 tx=0x7ff370003680 comp rx=0 tx=0).stop 2024-06-02T23:59:20.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.697+0000 7ff385a6d700 1 -- 172.21.15.49:0/286487216 shutdown_connections 2024-06-02T23:59:20.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.697+0000 7ff385a6d700 1 --2- 172.21.15.49:0/286487216 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff3680a2c20 0x7ff3680a50e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:20.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.697+0000 7ff385a6d700 1 --2- 172.21.15.49:0/286487216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff380107840 0x7ff380198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:20.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.697+0000 7ff385a6d700 1 --2- 172.21.15.49:0/286487216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff380102740 0x7ff38019e850 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:20.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.697+0000 7ff385a6d700 1 --2- 172.21.15.49:0/286487216 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3801030f0 0x7ff38019ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:20.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.697+0000 7ff385a6d700 1 -- 172.21.15.49:0/286487216 >> 172.21.15.49:0/286487216 conn(0x7ff3800795f0 msgr2=0x7ff380100790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:20.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.697+0000 7ff385a6d700 1 -- 172.21.15.49:0/286487216 shutdown_connections 2024-06-02T23:59:20.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:20.697+0000 7ff385a6d700 1 -- 172.21.15.49:0/286487216 wait complete. 2024-06-02T23:59:21.285 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:21 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/286487216' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T23:59:21.315 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T23:59:21.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:21 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/286487216' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T23:59:21.569 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:59:21.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:21 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/286487216' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T23:59:22.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:22 smithi049 ceph-mon[32302]: pgmap v363: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:59:22.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:22 smithi057 ceph-mon[36457]: pgmap v363: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:59:22.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:22 smithi107 ceph-mon[37048]: pgmap v363: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:59:23.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.185+0000 7fade45a0700 1 -- 172.21.15.49:0/3635462789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faddc107870 msgr2=0x7faddc10f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:23.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.185+0000 7fade45a0700 1 --2- 172.21.15.49:0/3635462789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faddc107870 0x7faddc10f3f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fadd40099c0 tx=0x7fadd4009cd0 comp rx=0 tx=0).stop 2024-06-02T23:59:23.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.185+0000 7fade45a0700 1 -- 172.21.15.49:0/3635462789 shutdown_connections 2024-06-02T23:59:23.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.185+0000 7fade45a0700 1 --2- 172.21.15.49:0/3635462789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faddc107870 0x7faddc10f3f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:23.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.185+0000 7fade45a0700 1 --2- 172.21.15.49:0/3635462789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faddc1027a0 0x7faddc102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:23.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.185+0000 7fade45a0700 1 --2- 172.21.15.49:0/3635462789 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faddc103150 0x7faddc107140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:23.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.185+0000 7fade45a0700 1 -- 172.21.15.49:0/3635462789 >> 172.21.15.49:0/3635462789 conn(0x7faddc079570 msgr2=0x7faddc079980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:23.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.185+0000 7fade45a0700 1 -- 172.21.15.49:0/3635462789 shutdown_connections 2024-06-02T23:59:23.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.185+0000 7fade45a0700 1 -- 172.21.15.49:0/3635462789 wait complete. 2024-06-02T23:59:23.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.186+0000 7fade45a0700 1 Processor -- start 2024-06-02T23:59:23.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.186+0000 7fade45a0700 1 -- start start 2024-06-02T23:59:23.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.186+0000 7fade45a0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faddc1027a0 0x7faddc19e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:23.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.186+0000 7fade45a0700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faddc103150 0x7faddc19ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:23.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.186+0000 7fade45a0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faddc107870 0x7faddc1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:23.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.186+0000 7fade45a0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7faddc112790 con 0x7faddc1027a0 2024-06-02T23:59:23.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.186+0000 7fade45a0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7faddc112610 con 0x7faddc107870 2024-06-02T23:59:23.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.186+0000 7fade45a0700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7faddc112910 con 0x7faddc103150 2024-06-02T23:59:23.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.186+0000 7fade233c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faddc1027a0 0x7faddc19e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:23.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.187+0000 7fade233c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faddc1027a0 0x7faddc19e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50858/0 (socket says 172.21.15.49:50858) 2024-06-02T23:59:23.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.187+0000 7fade233c700 1 -- 172.21.15.49:0/1452384577 learned_addr learned my addr 172.21.15.49:0/1452384577 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:23.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.187+0000 7fade1b3b700 1 --2- 172.21.15.49:0/1452384577 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faddc103150 0x7faddc19ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:23.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.187+0000 7fade2b3d700 1 --2- 172.21.15.49:0/1452384577 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faddc107870 0x7faddc1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:23.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.187+0000 7fade233c700 1 -- 172.21.15.49:0/1452384577 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faddc103150 msgr2=0x7faddc19ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:23.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.187+0000 7fade233c700 1 --2- 172.21.15.49:0/1452384577 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faddc103150 0x7faddc19ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.187+0000 7fade233c700 1 -- 172.21.15.49:0/1452384577 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faddc107870 msgr2=0x7faddc1989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.187+0000 7fade233c700 1 --2- 172.21.15.49:0/1452384577 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faddc107870 0x7faddc1989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.187+0000 7fade233c700 1 -- 172.21.15.49:0/1452384577 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faddc199110 con 0x7faddc1027a0 2024-06-02T23:59:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.187+0000 7fade233c700 1 --2- 172.21.15.49:0/1452384577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faddc1027a0 0x7faddc19e7f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fadcc00ada0 tx=0x7fadcc00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.187+0000 7faddb7fe700 1 -- 172.21.15.49:0/1452384577 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc017020 con 0x7faddc1027a0 2024-06-02T23:59:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.187+0000 7fade45a0700 1 -- 172.21.15.49:0/1452384577 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faddc199400 con 0x7faddc1027a0 2024-06-02T23:59:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.187+0000 7faddb7fe700 1 -- 172.21.15.49:0/1452384577 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fadcc004bb0 con 0x7faddc1027a0 2024-06-02T23:59:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.187+0000 7faddb7fe700 1 -- 172.21.15.49:0/1452384577 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc005620 con 0x7faddc1027a0 2024-06-02T23:59:23.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.187+0000 7fade45a0700 1 -- 172.21.15.49:0/1452384577 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faddc0746c0 con 0x7faddc1027a0 2024-06-02T23:59:23.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.188+0000 7fade45a0700 1 -- 172.21.15.49:0/1452384577 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faddc069180 con 0x7faddc1027a0 2024-06-02T23:59:23.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.190+0000 7faddb7fe700 1 -- 172.21.15.49:0/1452384577 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fadcc004d60 con 0x7faddc1027a0 2024-06-02T23:59:23.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.190+0000 7faddb7fe700 1 --2- 172.21.15.49:0/1452384577 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fadc40a2c20 0x7fadc40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:23.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.190+0000 7fade1b3b700 1 --2- 172.21.15.49:0/1452384577 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fadc40a2c20 0x7fadc40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:23.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.191+0000 7faddb7fe700 1 -- 172.21.15.49:0/1452384577 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fadcc0ceee0 con 0x7faddc1027a0 2024-06-02T23:59:23.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.191+0000 7fade1b3b700 1 --2- 172.21.15.49:0/1452384577 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fadc40a2c20 0x7fadc40a50e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fadd0005950 tx=0x7fadd00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:23.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.194+0000 7faddb7fe700 1 -- 172.21.15.49:0/1452384577 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fadcc021020 con 0x7faddc1027a0 2024-06-02T23:59:23.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.448+0000 7fade45a0700 1 -- 172.21.15.49:0/1452384577 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faddc199ee0 con 0x7faddc1027a0 2024-06-02T23:59:23.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.449+0000 7faddb7fe700 1 -- 172.21.15.49:0/1452384577 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11929 (secure 0 0 0) 0x7fadcc09be90 con 0x7faddc1027a0 2024-06-02T23:59:23.450 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:59:23.450 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1553264866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1553264866},{"type":"v1","addr":"172.21.15.49:6835","nonce":1553264866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2266285252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2266285252},{"type":"v1","addr":"172.21.15.49:6837","nonce":2266285252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T23:57:16.991201+0000","modified":"2024-06-02T23:57:35.219435+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24485,"mds_2":24466,"mds_3":24464,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6839/1729124617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":1729124617},{"type":"v1","addr":"172.21.15.49:6839","nonce":1729124617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6841/1902772235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":1902772235},{"type":"v1","addr":"172.21.15.49:6841","nonce":1902772235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6833/1633534002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1633534002},{"type":"v1","addr":"172.21.15.57:6833","nonce":1633534002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6835/2254905671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2254905671},{"type":"v1","addr":"172.21.15.57:6835","nonce":2254905671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.107:6835/3693542801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3693542801},{"type":"v1","addr":"172.21.15.107:6835","nonce":3693542801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.57:6837/230452144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":230452144},{"type":"v1","addr":"172.21.15.57:6837","nonce":230452144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.107:6837/3700593315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":3700593315},{"type":"v1","addr":"172.21.15.107:6837","nonce":3700593315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6839/249825195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":249825195},{"type":"v1","addr":"172.21.15.57:6839","nonce":249825195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6839/1986600681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1986600681},{"type":"v1","addr":"172.21.15.107:6839","nonce":1986600681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24466,24487,24460,24464,24485]},"id":1}]} 2024-06-02T23:59:23.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.451+0000 7fade45a0700 1 -- 172.21.15.49:0/1452384577 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fadc40a2c20 msgr2=0x7fadc40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:23.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.451+0000 7fade45a0700 1 --2- 172.21.15.49:0/1452384577 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fadc40a2c20 0x7fadc40a50e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fadd0005950 tx=0x7fadd00058e0 comp rx=0 tx=0).stop 2024-06-02T23:59:23.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.451+0000 7fade45a0700 1 -- 172.21.15.49:0/1452384577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faddc1027a0 msgr2=0x7faddc19e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:23.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.451+0000 7fade45a0700 1 --2- 172.21.15.49:0/1452384577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faddc1027a0 0x7faddc19e7f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fadcc00ada0 tx=0x7fadcc00c330 comp rx=0 tx=0).stop 2024-06-02T23:59:23.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.451+0000 7fade45a0700 1 -- 172.21.15.49:0/1452384577 shutdown_connections 2024-06-02T23:59:23.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.452+0000 7fade45a0700 1 --2- 172.21.15.49:0/1452384577 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fadc40a2c20 0x7fadc40a50e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:23.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.452+0000 7fade45a0700 1 --2- 172.21.15.49:0/1452384577 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faddc107870 0x7faddc1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:23.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.452+0000 7fade45a0700 1 --2- 172.21.15.49:0/1452384577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faddc1027a0 0x7faddc19e7f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:23.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.452+0000 7fade45a0700 1 --2- 172.21.15.49:0/1452384577 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faddc103150 0x7faddc19ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:23.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.452+0000 7fade45a0700 1 -- 172.21.15.49:0/1452384577 >> 172.21.15.49:0/1452384577 conn(0x7faddc079570 msgr2=0x7faddc100510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:23.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.452+0000 7fade45a0700 1 -- 172.21.15.49:0/1452384577 shutdown_connections 2024-06-02T23:59:23.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:23.452+0000 7fade45a0700 1 -- 172.21.15.49:0/1452384577 wait complete. 2024-06-02T23:59:23.453 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-06-02T23:59:24.084 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-06-02T23:57:16.991201+0000', 'modified': '2024-06-02T23:57:35.219435+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24487, 'mds_1': 24485, 'mds_2': 24466, 'mds_3': 24464, 'mds_4': 24460}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14598': {'gid': 14598, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.49:6839/1729124617', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6838', 'nonce': 1729124617}, {'type': 'v1', 'addr': '172.21.15.49:6839', 'nonce': 1729124617}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14610': {'gid': 14610, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.49:6841/1902772235', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6840', 'nonce': 1902772235}, {'type': 'v1', 'addr': '172.21.15.49:6841', 'nonce': 1902772235}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24416': {'gid': 24416, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.57:6833/1633534002', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 1633534002}, {'type': 'v1', 'addr': '172.21.15.57:6833', 'nonce': 1633534002}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24418': {'gid': 24418, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.107:6833/2662998293', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6832', 'nonce': 2662998293}, {'type': 'v1', 'addr': '172.21.15.107:6833', 'nonce': 2662998293}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24440': {'gid': 24440, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.57:6835/2254905671', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 2254905671}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 2254905671}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24460': {'gid': 24460, 'name': 'f', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.107:6835/3693542801', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6834', 'nonce': 3693542801}, {'type': 'v1', 'addr': '172.21.15.107:6835', 'nonce': 3693542801}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24464': {'gid': 24464, 'name': 'h', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.57:6837/230452144', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6836', 'nonce': 230452144}, {'type': 'v1', 'addr': '172.21.15.57:6837', 'nonce': 230452144}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'c', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.107:6837/3700593315', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6836', 'nonce': 3700593315}, {'type': 'v1', 'addr': '172.21.15.107:6837', 'nonce': 3700593315}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24485': {'gid': 24485, 'name': 'b', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.57:6839/249825195', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6838', 'nonce': 249825195}, {'type': 'v1', 'addr': '172.21.15.57:6839', 'nonce': 249825195}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24487': {'gid': 24487, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.107:6839/1986600681', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6838', 'nonce': 1986600681}, {'type': 'v1', 'addr': '172.21.15.107:6839', 'nonce': 1986600681}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24487, 'qdb_cluster': [24466, 24487, 24460, 24464, 24485]} 2024-06-02T23:59:24.085 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-06-02T23:59:24.085 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.f status 2024-06-02T23:59:24.341 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:59:24.582 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:24 smithi049 ceph-mon[32302]: pgmap v364: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-02T23:59:24.582 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:24 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/1452384577' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:59:24.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:24 smithi107 ceph-mon[37048]: pgmap v364: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-02T23:59:24.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:24 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/1452384577' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:59:24.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:24 smithi057 ceph-mon[36457]: pgmap v364: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-02T23:59:24.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:24 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/1452384577' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T23:59:25.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.986+0000 7f57facc0700 1 -- 172.21.15.49:0/3500343180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57f4102ed0 msgr2=0x7f57f410f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:25.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.986+0000 7f57facc0700 1 --2- 172.21.15.49:0/3500343180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57f4102ed0 0x7f57f410f350 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f57e4009990 tx=0x7f57e4009ca0 comp rx=0 tx=0).stop 2024-06-02T23:59:25.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.986+0000 7f57facc0700 1 -- 172.21.15.49:0/3500343180 shutdown_connections 2024-06-02T23:59:25.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.986+0000 7f57facc0700 1 --2- 172.21.15.49:0/3500343180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57f4102ed0 0x7f57f410f350 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:25.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.986+0000 7f57facc0700 1 --2- 172.21.15.49:0/3500343180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57f4108510 0x7f57f41088f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:25.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.986+0000 7f57facc0700 1 --2- 172.21.15.49:0/3500343180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57f4102510 0x7f57f4102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:25.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.986+0000 7f57facc0700 1 -- 172.21.15.49:0/3500343180 >> 172.21.15.49:0/3500343180 conn(0x7f57f40795b0 msgr2=0x7f57f40799c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:25.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.986+0000 7f57facc0700 1 -- 172.21.15.49:0/3500343180 shutdown_connections 2024-06-02T23:59:25.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.986+0000 7f57facc0700 1 -- 172.21.15.49:0/3500343180 wait complete. 2024-06-02T23:59:25.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.987+0000 7f57facc0700 1 Processor -- start 2024-06-02T23:59:25.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.987+0000 7f57facc0700 1 -- start start 2024-06-02T23:59:25.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.987+0000 7f57facc0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57f4102510 0x7f57f419e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:25.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.987+0000 7f57facc0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57f4102ed0 0x7f57f419eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:25.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.987+0000 7f57facc0700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57f4108510 0x7f57f4198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:25.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.987+0000 7f57facc0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f57f4112740 con 0x7f57f4102ed0 2024-06-02T23:59:25.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.987+0000 7f57facc0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f57f41125c0 con 0x7f57f4102510 2024-06-02T23:59:25.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.987+0000 7f57facc0700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f57f41128c0 con 0x7f57f4108510 2024-06-02T23:59:25.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.987+0000 7f57f3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57f4102ed0 0x7f57f419eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:25.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.987+0000 7f57f3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57f4102ed0 0x7f57f419eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50872/0 (socket says 172.21.15.49:50872) 2024-06-02T23:59:25.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.987+0000 7f57f3fff700 1 -- 172.21.15.49:0/3829941006 learned_addr learned my addr 172.21.15.49:0/3829941006 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:25.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.987+0000 7f57f925d700 1 --2- 172.21.15.49:0/3829941006 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57f4108510 0x7f57f4198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:25.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.988+0000 7f57f8a5c700 1 --2- 172.21.15.49:0/3829941006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57f4102510 0x7f57f419e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:25.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.988+0000 7f57f3fff700 1 -- 172.21.15.49:0/3829941006 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57f4108510 msgr2=0x7f57f4198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:25.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.988+0000 7f57f3fff700 1 --2- 172.21.15.49:0/3829941006 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57f4108510 0x7f57f4198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:25.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.988+0000 7f57f3fff700 1 -- 172.21.15.49:0/3829941006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57f4102510 msgr2=0x7f57f419e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:25.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.988+0000 7f57f3fff700 1 --2- 172.21.15.49:0/3829941006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57f4102510 0x7f57f419e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:25.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.988+0000 7f57f3fff700 1 -- 172.21.15.49:0/3829941006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f4199080 con 0x7f57f4102ed0 2024-06-02T23:59:25.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.988+0000 7f57f925d700 1 --2- 172.21.15.49:0/3829941006 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57f4108510 0x7f57f4198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:59:25.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.988+0000 7f57f3fff700 1 --2- 172.21.15.49:0/3829941006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57f4102ed0 0x7f57f419eca0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f57dc00c9b0 tx=0x7f57dc00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:25.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.988+0000 7f57f1ffb700 1 -- 172.21.15.49:0/3829941006 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57dc007b00 con 0x7f57f4102ed0 2024-06-02T23:59:25.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.988+0000 7f57f1ffb700 1 -- 172.21.15.49:0/3829941006 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57dc007ca0 con 0x7f57f4102ed0 2024-06-02T23:59:25.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.988+0000 7f57facc0700 1 -- 172.21.15.49:0/3829941006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57f4199370 con 0x7f57f4102ed0 2024-06-02T23:59:25.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.988+0000 7f57f1ffb700 1 -- 172.21.15.49:0/3829941006 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57dc018780 con 0x7f57f4102ed0 2024-06-02T23:59:25.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.988+0000 7f57facc0700 1 -- 172.21.15.49:0/3829941006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57f41a5630 con 0x7f57f4102ed0 2024-06-02T23:59:25.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.990+0000 7f57f1ffb700 1 -- 172.21.15.49:0/3829941006 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f57dc00f450 con 0x7f57f4102ed0 2024-06-02T23:59:25.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.991+0000 7f57f1ffb700 1 --2- 172.21.15.49:0/3829941006 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f57e00a2ca0 0x7f57e00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:25.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.991+0000 7f57f8a5c700 1 --2- 172.21.15.49:0/3829941006 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f57e00a2ca0 0x7f57e00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:25.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.991+0000 7f57f1ffb700 1 -- 172.21.15.49:0/3829941006 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f57dc0cefc0 con 0x7f57f4102ed0 2024-06-02T23:59:25.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.992+0000 7f57f8a5c700 1 --2- 172.21.15.49:0/3829941006 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f57e00a2ca0 0x7f57e00a5160 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f57f4199a60 tx=0x7f57ec009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:25.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.992+0000 7f5805543b80 1 Processor -- start 2024-06-02T23:59:25.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.992+0000 7f5805543b80 1 -- start start 2024-06-02T23:59:25.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.992+0000 7f5805543b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564c0024a320 0x564c0024a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:25.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.993+0000 7f5805543b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564c0024ac40 0x564c00244620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:25.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.993+0000 7f5805543b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c00244b60 0x564c00244fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:25.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.993+0000 7f5805543b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564c00132f10 con 0x564c0024ac40 2024-06-02T23:59:25.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.993+0000 7f5805543b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x564c00191800 con 0x564c0024a320 2024-06-02T23:59:25.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.993+0000 7f5805543b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564c000f9410 con 0x564c00244b60 2024-06-02T23:59:25.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.993+0000 7f57f3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564c0024ac40 0x564c00244620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:25.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.993+0000 7f57f3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564c0024ac40 0x564c00244620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50884/0 (socket says 172.21.15.49:50884) 2024-06-02T23:59:25.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.993+0000 7f57f3fff700 1 -- 172.21.15.49:0/394642902 learned_addr learned my addr 172.21.15.49:0/394642902 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:25.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.993+0000 7f57f8a5c700 1 --2- 172.21.15.49:0/394642902 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564c0024a320 0x564c0024a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:25.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.993+0000 7f57f925d700 1 --2- 172.21.15.49:0/394642902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c00244b60 0x564c00244fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:25.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.993+0000 7f57f3fff700 1 -- 172.21.15.49:0/394642902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c00244b60 msgr2=0x564c00244fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:25.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.993+0000 7f57f3fff700 1 --2- 172.21.15.49:0/394642902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c00244b60 0x564c00244fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:25.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.993+0000 7f57f3fff700 1 -- 172.21.15.49:0/394642902 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564c0024a320 msgr2=0x564c0024a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:25.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.993+0000 7f57f3fff700 1 --2- 172.21.15.49:0/394642902 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564c0024a320 0x564c0024a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:25.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.993+0000 7f57f3fff700 1 -- 172.21.15.49:0/394642902 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c000e0880 con 0x564c0024ac40 2024-06-02T23:59:25.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.993+0000 7f57f3fff700 1 --2- 172.21.15.49:0/394642902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564c0024ac40 0x564c00244620 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f57dc09b850 tx=0x7f57dc09bfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1f7fc19d7ea970 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:25.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.993+0000 7f57eaffd700 1 -- 172.21.15.49:0/394642902 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57dc09fc70 con 0x564c0024ac40 2024-06-02T23:59:25.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.993+0000 7f57eaffd700 1 -- 172.21.15.49:0/394642902 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57dc084e50 con 0x564c0024ac40 2024-06-02T23:59:25.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.993+0000 7f57eaffd700 1 -- 172.21.15.49:0/394642902 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57dc09bb20 con 0x564c0024ac40 2024-06-02T23:59:25.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.994+0000 7f5805543b80 1 -- 172.21.15.49:0/394642902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564c0024ac40 msgr2=0x564c00244620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:25.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.994+0000 7f5805543b80 1 --2- 172.21.15.49:0/394642902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564c0024ac40 0x564c00244620 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f57dc09b850 tx=0x7f57dc09bfc0 comp rx=0 tx=0).stop 2024-06-02T23:59:25.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.994+0000 7f5805543b80 1 -- 172.21.15.49:0/394642902 shutdown_connections 2024-06-02T23:59:26.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.994+0000 7f5805543b80 1 --2- 172.21.15.49:0/394642902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c00244b60 0x564c00244fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:26.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.994+0000 7f5805543b80 1 --2- 172.21.15.49:0/394642902 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564c0024a320 0x564c0024a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:26.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.994+0000 7f5805543b80 1 --2- 172.21.15.49:0/394642902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564c0024ac40 0x564c00244620 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:26.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.994+0000 7f5805543b80 1 -- 172.21.15.49:0/394642902 >> 172.21.15.49:0/394642902 conn(0x564c0016d030 msgr2=0x564c0023b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:26.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.994+0000 7f5805543b80 1 -- 172.21.15.49:0/394642902 shutdown_connections 2024-06-02T23:59:26.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.994+0000 7f5805543b80 1 -- 172.21.15.49:0/394642902 wait complete. 2024-06-02T23:59:26.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.995+0000 7f5805543b80 1 -- start start 2024-06-02T23:59:26.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.995+0000 7f5805543b80 1 Processor -- start 2024-06-02T23:59:26.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.995+0000 7f5805543b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c00244b60 0x564c002509d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:26.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.995+0000 7f5805543b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564c0024a320 0x564c0024dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:26.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.995+0000 7f5805543b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564c0024ac40 0x564c0024e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:26.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.995+0000 7f5805543b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564c00131f70 con 0x564c0024ac40 2024-06-02T23:59:26.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.995+0000 7f5805543b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x564c0018d7c0 con 0x564c0024a320 2024-06-02T23:59:26.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.995+0000 7f5805543b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564c00251630 con 0x564c00244b60 2024-06-02T23:59:26.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.995+0000 7f5805543b80 10 client.0 _ll_register_callbacks cb 0x564c00127560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T23:59:26.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.995+0000 7f57f925d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564c0024ac40 0x564c0024e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:26.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.995+0000 7f57f925d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564c0024ac40 0x564c0024e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50890/0 (socket says 172.21.15.49:50890) 2024-06-02T23:59:26.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.995+0000 7f57f925d700 1 -- 172.21.15.49:0/3353595723 learned_addr learned my addr 172.21.15.49:0/3353595723 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:26.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.995+0000 7f57f8a5c700 1 --2- 172.21.15.49:0/3353595723 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c00244b60 0x564c002509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:26.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.995+0000 7f57f3fff700 1 --2- 172.21.15.49:0/3353595723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564c0024a320 0x564c0024dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:26.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.996+0000 7f57f925d700 1 -- 172.21.15.49:0/3353595723 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c00244b60 msgr2=0x564c002509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:26.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.996+0000 7f57f925d700 1 --2- 172.21.15.49:0/3353595723 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c00244b60 0x564c002509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:26.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.996+0000 7f57f925d700 1 -- 172.21.15.49:0/3353595723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564c0024a320 msgr2=0x564c0024dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:26.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.996+0000 7f57f925d700 1 --2- 172.21.15.49:0/3353595723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564c0024a320 0x564c0024dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:26.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.996+0000 7f57f925d700 1 -- 172.21.15.49:0/3353595723 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c00157700 con 0x564c0024ac40 2024-06-02T23:59:26.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.996+0000 7f57f925d700 1 --2- 172.21.15.49:0/3353595723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564c0024ac40 0x564c0024e210 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f57e400b5c0 tx=0x7f57e4005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd474f06b4103c5e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:26.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.996+0000 7f57d3fff700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-02T23:59:26.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.996+0000 7f57d3fff700 1 -- 172.21.15.49:0/3353595723 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e4027060 con 0x564c0024ac40 2024-06-02T23:59:26.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.996+0000 7f57d3fff700 1 -- 172.21.15.49:0/3353595723 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f57e4005270 con 0x564c0024ac40 2024-06-02T23:59:26.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.996+0000 7f5805543b80 1 -- 172.21.15.49:0/3353595723 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57dc084e50 con 0x564c0024ac40 2024-06-02T23:59:26.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.996+0000 7f57d3fff700 1 -- 172.21.15.49:0/3353595723 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f57e4005470 con 0x564c0024ac40 2024-06-02T23:59:26.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.996+0000 7f5805543b80 10 client.14964 fetch_fsmap learned FSMap version 26 2024-06-02T23:59:26.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.996+0000 7f5805543b80 1 -- 172.21.15.49:0/3353595723 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564c0025bdb0 con 0x564c0024ac40 2024-06-02T23:59:26.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.996+0000 7f57d3fff700 1 -- 172.21.15.49:0/3353595723 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57dc084e50 con 0x564c0024ac40 2024-06-02T23:59:26.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.996+0000 7f57d3fff700 1 -- 172.21.15.49:0/3353595723 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f57e402c070 con 0x564c0024ac40 2024-06-02T23:59:26.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.997+0000 7f5805543b80 10 client.14964 fetch_fsmap finished waiting for FSMap version 26 2024-06-02T23:59:26.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.997+0000 7f5805543b80 10 client.14964 resolve_mds: resolved name 'f' to daemon mds.f 2024-06-02T23:59:26.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.997+0000 7f5805543b80 20 client.14964 populate_metadata read hostname 'smithi049' 2024-06-02T23:59:26.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.997+0000 7f5805543b80 1 --2- 172.21.15.49:0/3353595723 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x564c0025e3b0 0x564c0025f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:26.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.997+0000 7f5805543b80 4 client.14964 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T23:59:26.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.997+0000 7f5805543b80 1 -- 172.21.15.49:0/3353595723 --> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c0019ed00 con 0x564c0025e3b0 2024-06-02T23:59:26.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.997+0000 7f57f8a5c700 1 --2- 172.21.15.49:0/3353595723 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x564c0025e3b0 0x564c0025f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:26.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.997+0000 7f57f8a5c700 1 --2- 172.21.15.49:0/3353595723 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x564c0025e3b0 0x564c0025f820 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4f1d065538a2ab51 server_cookie=144de93a3cdeb0e4 in_seq=0 out_seq=0 2024-06-02T23:59:26.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.997+0000 7f57d3fff700 10 client.14964 ms_handle_connect on v2:172.21.15.107:6834/3693542801 2024-06-02T23:59:26.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.998+0000 7f57d3fff700 1 -- 172.21.15.49:0/3353595723 <== mds.4 v2:172.21.15.107:6834/3693542801 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x564c0019ed00 con 0x564c0025e3b0 2024-06-02T23:59:26.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.998+0000 7f57d3fff700 10 client.14964 handle_command_reply: tid=0 2024-06-02T23:59:26.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.998+0000 7f5805543b80 1 client.14964 shutdown 2024-06-02T23:59:26.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.998+0000 7f5805543b80 1 -- 172.21.15.49:0/3353595723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564c0024ac40 msgr2=0x564c0024e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:26.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.998+0000 7f5805543b80 1 --2- 172.21.15.49:0/3353595723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564c0024ac40 0x564c0024e210 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f57e400b5c0 tx=0x7f57e4005bc0 comp rx=0 tx=0).stop 2024-06-02T23:59:26.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.998+0000 7f5805543b80 1 -- 172.21.15.49:0/3353595723 shutdown_connections 2024-06-02T23:59:26.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.998+0000 7f5805543b80 1 --2- 172.21.15.49:0/3353595723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564c0024ac40 0x564c0024e210 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:26.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.998+0000 7f5805543b80 1 --2- 172.21.15.49:0/3353595723 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x564c0025e3b0 0x564c0025f820 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:26.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.998+0000 7f5805543b80 1 --2- 172.21.15.49:0/3353595723 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c00244b60 0x564c002509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:26.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.998+0000 7f5805543b80 1 --2- 172.21.15.49:0/3353595723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564c0024a320 0x564c0024dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:26.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.998+0000 7f57d3fff700 0 client.14964 ms_handle_reset on v2:172.21.15.107:6834/3693542801 2024-06-02T23:59:26.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.998+0000 7f5805543b80 1 -- 172.21.15.49:0/3353595723 >> 172.21.15.49:0/3353595723 conn(0x564c0016d030 msgr2=0x564c0023a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:26.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.998+0000 7f5805543b80 1 -- 172.21.15.49:0/3353595723 shutdown_connections 2024-06-02T23:59:26.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.998+0000 7f5805543b80 1 -- 172.21.15.49:0/3353595723 wait complete. 2024-06-02T23:59:26.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:25.998+0000 7f5805543b80 20 client.14964 trim_cache size 0 max 16384 2024-06-02T23:59:26.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.020+0000 7f5805543b80 1 Processor -- start 2024-06-02T23:59:26.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.020+0000 7f5805543b80 1 -- start start 2024-06-02T23:59:26.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.020+0000 7f5805543b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c00244b60 0x564c0024b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:26.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.020+0000 7f5805543b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564c0024a320 0x564c0023ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:26.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.020+0000 7f5805543b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564c0024ac40 0x564c0023b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:26.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.021+0000 7f5805543b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564c0025db60 con 0x564c0024a320 2024-06-02T23:59:26.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.021+0000 7f5805543b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x564c0025e230 con 0x564c0024ac40 2024-06-02T23:59:26.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.021+0000 7f5805543b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564c0025e900 con 0x564c00244b60 2024-06-02T23:59:26.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.021+0000 7f57f3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564c0024a320 0x564c0023ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:26.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.021+0000 7f57f3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564c0024a320 0x564c0023ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50900/0 (socket says 172.21.15.49:50900) 2024-06-02T23:59:26.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.021+0000 7f57f3fff700 1 -- 172.21.15.49:0/1122026792 learned_addr learned my addr 172.21.15.49:0/1122026792 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:26.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.021+0000 7f57f3fff700 1 -- 172.21.15.49:0/1122026792 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c00244b60 msgr2=0x564c0024b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:26.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.021+0000 7f57f3fff700 1 --2- 172.21.15.49:0/1122026792 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c00244b60 0x564c0024b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:26.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.021+0000 7f57f3fff700 1 -- 172.21.15.49:0/1122026792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564c0024ac40 msgr2=0x564c0023b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:26.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.021+0000 7f57f925d700 1 --2- 172.21.15.49:0/1122026792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564c0024ac40 0x564c0023b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:26.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.021+0000 7f57f3fff700 1 --2- 172.21.15.49:0/1122026792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564c0024ac40 0x564c0023b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:26.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.021+0000 7f57f3fff700 1 -- 172.21.15.49:0/1122026792 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c0024bd30 con 0x564c0024a320 2024-06-02T23:59:26.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.021+0000 7f57f925d700 1 --2- 172.21.15.49:0/1122026792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564c0024ac40 0x564c0023b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:59:26.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.021+0000 7f57f3fff700 1 --2- 172.21.15.49:0/1122026792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564c0024a320 0x564c0023ae30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f57dc0074a0 tx=0x7f57dc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=163d787a626bdb60 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:26.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.021+0000 7f57ea7fc700 1 -- 172.21.15.49:0/1122026792 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57dc09fc70 con 0x564c0024a320 2024-06-02T23:59:26.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.021+0000 7f57ea7fc700 1 -- 172.21.15.49:0/1122026792 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57dc0a4530 con 0x564c0024a320 2024-06-02T23:59:26.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.021+0000 7f57ea7fc700 1 -- 172.21.15.49:0/1122026792 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57dc0860c0 con 0x564c0024a320 2024-06-02T23:59:26.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.022+0000 7f5805543b80 1 -- 172.21.15.49:0/1122026792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564c0024a320 msgr2=0x564c0023ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:26.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.022+0000 7f5805543b80 1 --2- 172.21.15.49:0/1122026792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564c0024a320 0x564c0023ae30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f57dc0074a0 tx=0x7f57dc000bc0 comp rx=0 tx=0).stop 2024-06-02T23:59:26.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.022+0000 7f5805543b80 1 -- 172.21.15.49:0/1122026792 shutdown_connections 2024-06-02T23:59:26.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.022+0000 7f5805543b80 1 --2- 172.21.15.49:0/1122026792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564c0024ac40 0x564c0023b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:26.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.022+0000 7f5805543b80 1 --2- 172.21.15.49:0/1122026792 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c00244b60 0x564c0024b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:26.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.022+0000 7f5805543b80 1 --2- 172.21.15.49:0/1122026792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564c0024a320 0x564c0023ae30 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:26.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.022+0000 7f5805543b80 1 -- 172.21.15.49:0/1122026792 >> 172.21.15.49:0/1122026792 conn(0x564c0016d030 msgr2=0x564c0024b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:26.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.022+0000 7f5805543b80 1 -- 172.21.15.49:0/1122026792 shutdown_connections 2024-06-02T23:59:26.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.022+0000 7f5805543b80 1 -- 172.21.15.49:0/1122026792 wait complete. 2024-06-02T23:59:26.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.022+0000 7f5805543b80 1 -- start start 2024-06-02T23:59:26.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.022+0000 7f5805543b80 1 Processor -- start 2024-06-02T23:59:26.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.023+0000 7f5805543b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c00244b60 0x564c002694c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:26.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.023+0000 7f5805543b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564c0024a320 0x564c00264840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:26.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.023+0000 7f5805543b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564c0024ac40 0x564c00264e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:26.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.023+0000 7f5805543b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564c0025f6a0 con 0x564c0024ac40 2024-06-02T23:59:26.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.023+0000 7f5805543b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x564c0025efd0 con 0x564c0024a320 2024-06-02T23:59:26.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.023+0000 7f5805543b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564c0025fd70 con 0x564c00244b60 2024-06-02T23:59:26.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.023+0000 7f5805543b80 10 client.0 _ll_register_callbacks cb 0x564c00127560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T23:59:26.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.023+0000 7f57f925d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564c0024ac40 0x564c00264e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:26.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.023+0000 7f57f925d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564c0024ac40 0x564c00264e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50902/0 (socket says 172.21.15.49:50902) 2024-06-02T23:59:26.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.023+0000 7f57f925d700 1 -- 172.21.15.49:0/267504111 learned_addr learned my addr 172.21.15.49:0/267504111 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:26.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.023+0000 7f57f3fff700 1 --2- 172.21.15.49:0/267504111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564c0024a320 0x564c00264840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:26.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.023+0000 7f57f8a5c700 1 --2- 172.21.15.49:0/267504111 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c00244b60 0x564c002694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:26.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.023+0000 7f57f925d700 1 -- 172.21.15.49:0/267504111 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c00244b60 msgr2=0x564c002694c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:26.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.023+0000 7f57f925d700 1 --2- 172.21.15.49:0/267504111 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c00244b60 0x564c002694c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:26.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.023+0000 7f57f925d700 1 -- 172.21.15.49:0/267504111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564c0024a320 msgr2=0x564c00264840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:26.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.023+0000 7f57f925d700 1 --2- 172.21.15.49:0/267504111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564c0024a320 0x564c00264840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:26.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.023+0000 7f57f925d700 1 -- 172.21.15.49:0/267504111 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c002c8c40 con 0x564c0024ac40 2024-06-02T23:59:26.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.023+0000 7f57f925d700 1 --2- 172.21.15.49:0/267504111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564c0024ac40 0x564c00264e50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f57e4009ce0 tx=0x7f57e400f4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75dd695cdeeccd07 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:26.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.023+0000 7f57d3fff700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-02T23:59:26.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.023+0000 7f57d3fff700 1 -- 172.21.15.49:0/267504111 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e4032030 con 0x564c0024ac40 2024-06-02T23:59:26.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.024+0000 7f57d3fff700 1 -- 172.21.15.49:0/267504111 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f57e40050b0 con 0x564c0024ac40 2024-06-02T23:59:26.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.024+0000 7f5805543b80 1 -- 172.21.15.49:0/267504111 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57dc0a4530 con 0x564c0024ac40 2024-06-02T23:59:26.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.024+0000 7f57d3fff700 1 -- 172.21.15.49:0/267504111 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f57e4027040 con 0x564c0024ac40 2024-06-02T23:59:26.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.024+0000 7f5805543b80 10 client.14970 fetch_fsmap learned FSMap version 26 2024-06-02T23:59:26.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.024+0000 7f5805543b80 1 -- 172.21.15.49:0/267504111 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564c002c9cf0 con 0x564c0024ac40 2024-06-02T23:59:26.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.024+0000 7f57d3fff700 1 -- 172.21.15.49:0/267504111 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57dc0a4530 con 0x564c0024ac40 2024-06-02T23:59:26.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.024+0000 7f57d3fff700 1 -- 172.21.15.49:0/267504111 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f57e402c070 con 0x564c0024ac40 2024-06-02T23:59:26.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.024+0000 7f5805543b80 10 client.14970 fetch_fsmap finished waiting for FSMap version 26 2024-06-02T23:59:26.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.024+0000 7f5805543b80 10 client.14970 resolve_mds: resolved name 'f' to daemon mds.f 2024-06-02T23:59:26.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.024+0000 7f5805543b80 20 client.14970 populate_metadata read hostname 'smithi049' 2024-06-02T23:59:26.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.024+0000 7f5805543b80 1 --2- 172.21.15.49:0/267504111 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x564c002ce860 0x564c002cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:26.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.024+0000 7f5805543b80 4 client.14970 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T23:59:26.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.024+0000 7f5805543b80 1 -- 172.21.15.49:0/267504111 --> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] -- command(tid 0: {"prefix": "status"}) -- 0x564c00199280 con 0x564c002ce860 2024-06-02T23:59:26.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.025+0000 7f57f8a5c700 1 --2- 172.21.15.49:0/267504111 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x564c002ce860 0x564c002cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:26.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.025+0000 7f57f8a5c700 1 --2- 172.21.15.49:0/267504111 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x564c002ce860 0x564c002cd570 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c16f9fea091c4e8c server_cookie=f742e8b636707805 in_seq=0 out_seq=0 2024-06-02T23:59:26.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.025+0000 7f57d3fff700 10 client.14970 ms_handle_connect on v2:172.21.15.107:6834/3693542801 2024-06-02T23:59:26.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.025+0000 7f57d3fff700 1 -- 172.21.15.49:0/267504111 <== mds.4 v2:172.21.15.107:6834/3693542801 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x564c00199280 con 0x564c002ce860 2024-06-02T23:59:26.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.025+0000 7f57d3fff700 10 client.14970 handle_command_reply: tid=0 2024-06-02T23:59:26.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.025+0000 7f5805543b80 1 client.14970 shutdown 2024-06-02T23:59:26.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.025+0000 7f5805543b80 1 -- 172.21.15.49:0/267504111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564c0024ac40 msgr2=0x564c00264e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:26.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.025+0000 7f5805543b80 1 --2- 172.21.15.49:0/267504111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564c0024ac40 0x564c00264e50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f57e4009ce0 tx=0x7f57e400f4e0 comp rx=0 tx=0).stop 2024-06-02T23:59:26.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.025+0000 7f5805543b80 1 -- 172.21.15.49:0/267504111 shutdown_connections 2024-06-02T23:59:26.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.025+0000 7f5805543b80 1 --2- 172.21.15.49:0/267504111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564c0024ac40 0x564c00264e50 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:26.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.025+0000 7f5805543b80 1 --2- 172.21.15.49:0/267504111 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x564c002ce860 0x564c002cd570 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:26.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.025+0000 7f5805543b80 1 --2- 172.21.15.49:0/267504111 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c00244b60 0x564c002694c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:26.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.025+0000 7f5805543b80 1 --2- 172.21.15.49:0/267504111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564c0024a320 0x564c00264840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:26.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.025+0000 7f5805543b80 1 -- 172.21.15.49:0/267504111 >> 172.21.15.49:0/267504111 conn(0x564c0016d030 msgr2=0x564c0023f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:26.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.025+0000 7f57d3fff700 0 client.14970 ms_handle_reset on v2:172.21.15.107:6834/3693542801 2024-06-02T23:59:26.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.026+0000 7f5805543b80 1 -- 172.21.15.49:0/267504111 shutdown_connections 2024-06-02T23:59:26.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.026+0000 7f5805543b80 1 -- 172.21.15.49:0/267504111 wait complete. 2024-06-02T23:59:26.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.026+0000 7f5805543b80 20 client.14970 trim_cache size 0 max 16384 2024-06-02T23:59:26.032 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-02T23:59:26.032 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "890dd222-213a-11ef-bc9b-c7b262605968", 2024-06-02T23:59:26.032 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 4, 2024-06-02T23:59:26.032 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 24460, 2024-06-02T23:59:26.032 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-06-02T23:59:26.032 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-06-02T23:59:26.032 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-06-02T23:59:26.032 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 113.567498931, 2024-06-02T23:59:26.032 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 26, 2024-06-02T23:59:26.032 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 90, 2024-06-02T23:59:26.032 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 88, 2024-06-02T23:59:26.032 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 161.371754925 2024-06-02T23:59:26.033 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-02T23:59:26.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.026+0000 7f57facc0700 1 -- 172.21.15.49:0/3829941006 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f57e00a2ca0 msgr2=0x7f57e00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:26.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.026+0000 7f57facc0700 1 --2- 172.21.15.49:0/3829941006 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f57e00a2ca0 0x7f57e00a5160 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f57f4199a60 tx=0x7f57ec009040 comp rx=0 tx=0).stop 2024-06-02T23:59:26.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.026+0000 7f57facc0700 1 -- 172.21.15.49:0/3829941006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57f4102ed0 msgr2=0x7f57f419eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:26.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.026+0000 7f57facc0700 1 --2- 172.21.15.49:0/3829941006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57f4102ed0 0x7f57f419eca0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f57dc00c9b0 tx=0x7f57dc00cd70 comp rx=0 tx=0).stop 2024-06-02T23:59:26.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.026+0000 7f57facc0700 1 -- 172.21.15.49:0/3829941006 shutdown_connections 2024-06-02T23:59:26.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.026+0000 7f57facc0700 1 --2- 172.21.15.49:0/3829941006 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f57e00a2ca0 0x7f57e00a5160 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:26.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.026+0000 7f57facc0700 1 --2- 172.21.15.49:0/3829941006 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57f4108510 0x7f57f4198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:26.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.026+0000 7f57facc0700 1 --2- 172.21.15.49:0/3829941006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57f4102510 0x7f57f419e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:26.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.026+0000 7f57facc0700 1 --2- 172.21.15.49:0/3829941006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57f4102ed0 0x7f57f419eca0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:26.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.026+0000 7f57facc0700 1 -- 172.21.15.49:0/3829941006 >> 172.21.15.49:0/3829941006 conn(0x7f57f40795b0 msgr2=0x7f57f4101050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:26.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.026+0000 7f57facc0700 1 -- 172.21.15.49:0/3829941006 shutdown_connections 2024-06-02T23:59:26.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:26.026+0000 7f57facc0700 1 -- 172.21.15.49:0/3829941006 wait complete. 2024-06-02T23:59:26.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:26 smithi107 ceph-mon[37048]: pgmap v365: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-06-02T23:59:26.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:26 smithi057 ceph-mon[36457]: pgmap v365: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-06-02T23:59:26.709 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:26 smithi049 ceph-mon[32302]: pgmap v365: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-06-02T23:59:26.740 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.h status 2024-06-02T23:59:27.001 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:59:27.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:27 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:59:27.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:27 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:59:27.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:27 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T23:59:28.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:28 smithi107 ceph-mon[37048]: pgmap v366: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-06-02T23:59:28.615 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:28 smithi049 ceph-mon[32302]: pgmap v366: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-06-02T23:59:28.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.620+0000 7f73d18a2700 1 -- 172.21.15.49:0/1594492609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73cc107400 msgr2=0x7f73cc1077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:28.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.620+0000 7f73d18a2700 1 --2- 172.21.15.49:0/1594492609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73cc107400 0x7f73cc1077e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f73bc00b0a0 tx=0x7f73bc00b3b0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.620+0000 7f73d18a2700 1 -- 172.21.15.49:0/1594492609 shutdown_connections 2024-06-02T23:59:28.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.620+0000 7f73d18a2700 1 --2- 172.21.15.49:0/1594492609 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73cc101d50 0x7f73cc10e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.620+0000 7f73d18a2700 1 --2- 172.21.15.49:0/1594492609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73cc107400 0x7f73cc1077e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.620+0000 7f73d18a2700 1 --2- 172.21.15.49:0/1594492609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73cc101390 0x7f73cc101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.620+0000 7f73d18a2700 1 -- 172.21.15.49:0/1594492609 >> 172.21.15.49:0/1594492609 conn(0x7f73cc078340 msgr2=0x7f73cc078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:28.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.620+0000 7f73d18a2700 1 -- 172.21.15.49:0/1594492609 shutdown_connections 2024-06-02T23:59:28.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.620+0000 7f73d18a2700 1 -- 172.21.15.49:0/1594492609 wait complete. 2024-06-02T23:59:28.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.621+0000 7f73d18a2700 1 Processor -- start 2024-06-02T23:59:28.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.621+0000 7f73d18a2700 1 -- start start 2024-06-02T23:59:28.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.621+0000 7f73d18a2700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73cc101390 0x7f73cc103070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:28.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.621+0000 7f73d18a2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73cc101d50 0x7f73cc1035b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:28.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.621+0000 7f73d18a2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73cc107400 0x7f73cc103af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:28.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.621+0000 7f73d18a2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc1116a0 con 0x7f73cc107400 2024-06-02T23:59:28.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.621+0000 7f73d18a2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc111520 con 0x7f73cc101d50 2024-06-02T23:59:28.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.621+0000 7f73d18a2700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc111820 con 0x7f73cc101390 2024-06-02T23:59:28.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.621+0000 7f73cb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73cc107400 0x7f73cc103af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:28.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.621+0000 7f73caffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73cc101390 0x7f73cc103070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:28.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.621+0000 7f73caffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73cc101390 0x7f73cc103070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:40132/0 (socket says 172.21.15.49:40132) 2024-06-02T23:59:28.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.621+0000 7f73ca7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73cc101d50 0x7f73cc1035b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:28.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.621+0000 7f73cb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73cc107400 0x7f73cc103af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50928/0 (socket says 172.21.15.49:50928) 2024-06-02T23:59:28.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.621+0000 7f73caffd700 1 -- 172.21.15.49:0/3244015639 learned_addr learned my addr 172.21.15.49:0/3244015639 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:28.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.622+0000 7f73caffd700 1 -- 172.21.15.49:0/3244015639 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73cc101d50 msgr2=0x7f73cc1035b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:28.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.622+0000 7f73caffd700 1 --2- 172.21.15.49:0/3244015639 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73cc101d50 0x7f73cc1035b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.622+0000 7f73caffd700 1 -- 172.21.15.49:0/3244015639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73cc107400 msgr2=0x7f73cc103af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:28.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.622+0000 7f73caffd700 1 --2- 172.21.15.49:0/3244015639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73cc107400 0x7f73cc103af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.622+0000 7f73caffd700 1 -- 172.21.15.49:0/3244015639 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73cc1a7160 con 0x7f73cc101390 2024-06-02T23:59:28.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.622+0000 7f73ca7fc700 1 --2- 172.21.15.49:0/3244015639 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73cc101d50 0x7f73cc1035b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:59:28.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.622+0000 7f73caffd700 1 --2- 172.21.15.49:0/3244015639 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73cc101390 0x7f73cc103070 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f73bc00b070 tx=0x7f73bc004e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:28.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.622+0000 7f73d08a0700 1 -- 172.21.15.49:0/3244015639 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73bc021070 con 0x7f73cc101390 2024-06-02T23:59:28.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.622+0000 7f73d08a0700 1 -- 172.21.15.49:0/3244015639 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73bc007b80 con 0x7f73cc101390 2024-06-02T23:59:28.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.622+0000 7f73d18a2700 1 -- 172.21.15.49:0/3244015639 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73cc1a73f0 con 0x7f73cc101390 2024-06-02T23:59:28.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.622+0000 7f73d08a0700 1 -- 172.21.15.49:0/3244015639 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73bc0052a0 con 0x7f73cc101390 2024-06-02T23:59:28.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.622+0000 7f73d18a2700 1 -- 172.21.15.49:0/3244015639 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73cc1a78a0 con 0x7f73cc101390 2024-06-02T23:59:28.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.624+0000 7f73d08a0700 1 -- 172.21.15.49:0/3244015639 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f73bc024070 con 0x7f73cc101390 2024-06-02T23:59:28.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.625+0000 7f73d08a0700 1 --2- 172.21.15.49:0/3244015639 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f73b80a2c20 0x7f73b80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:28.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.625+0000 7f73ca7fc700 1 --2- 172.21.15.49:0/3244015639 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f73b80a2c20 0x7f73b80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:28.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.625+0000 7f73d08a0700 1 -- 172.21.15.49:0/3244015639 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f73bc00f020 con 0x7f73cc101390 2024-06-02T23:59:28.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.625+0000 7f73ca7fc700 1 --2- 172.21.15.49:0/3244015639 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f73b80a2c20 0x7f73b80a50e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f73cc0788b0 tx=0x7f73b400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:28.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.626+0000 7f73dc125b80 1 Processor -- start 2024-06-02T23:59:28.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.626+0000 7f73dc125b80 1 -- start start 2024-06-02T23:59:28.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.626+0000 7f73dc125b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d0c3f32f10 0x55d0c3f332f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:28.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.626+0000 7f73dc125b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d0c3f33830 0x55d0c3f2d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:28.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.626+0000 7f73dc125b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d0c3f2d750 0x55d0c3f2db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:28.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.626+0000 7f73dc125b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55d0c3e1ff10 con 0x55d0c3f32f10 2024-06-02T23:59:28.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.626+0000 7f73dc125b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55d0c3e7e800 con 0x55d0c3f33830 2024-06-02T23:59:28.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.626+0000 7f73dc125b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d0c3de6410 con 0x55d0c3f2d750 2024-06-02T23:59:28.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.626+0000 7f73caffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d0c3f32f10 0x55d0c3f332f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:28.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.626+0000 7f73caffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d0c3f32f10 0x55d0c3f332f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50940/0 (socket says 172.21.15.49:50940) 2024-06-02T23:59:28.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.626+0000 7f73caffd700 1 -- 172.21.15.49:0/2822926581 learned_addr learned my addr 172.21.15.49:0/2822926581 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:28.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.626+0000 7f73ca7fc700 1 --2- 172.21.15.49:0/2822926581 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d0c3f33830 0x55d0c3f2d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:28.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.626+0000 7f73cb7fe700 1 --2- 172.21.15.49:0/2822926581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d0c3f2d750 0x55d0c3f2db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:28.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.626+0000 7f73caffd700 1 -- 172.21.15.49:0/2822926581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d0c3f2d750 msgr2=0x55d0c3f2db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:28.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.626+0000 7f73caffd700 1 --2- 172.21.15.49:0/2822926581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d0c3f2d750 0x55d0c3f2db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.626+0000 7f73caffd700 1 -- 172.21.15.49:0/2822926581 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d0c3f33830 msgr2=0x55d0c3f2d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:28.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.626+0000 7f73caffd700 1 --2- 172.21.15.49:0/2822926581 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d0c3f33830 0x55d0c3f2d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.626+0000 7f73caffd700 1 -- 172.21.15.49:0/2822926581 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0c3dcd880 con 0x55d0c3f32f10 2024-06-02T23:59:28.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.626+0000 7f73caffd700 1 --2- 172.21.15.49:0/2822926581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d0c3f32f10 0x55d0c3f332f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f73bc09ccc0 tx=0x7f73bc0099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc566da6ab3e593 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:28.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.627+0000 7f73c1ffb700 1 -- 172.21.15.49:0/2822926581 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73bc09d6c0 con 0x55d0c3f32f10 2024-06-02T23:59:28.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.627+0000 7f73c1ffb700 1 -- 172.21.15.49:0/2822926581 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73bc09cfc0 con 0x55d0c3f32f10 2024-06-02T23:59:28.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.627+0000 7f73c1ffb700 1 -- 172.21.15.49:0/2822926581 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73bc02edb0 con 0x55d0c3f32f10 2024-06-02T23:59:28.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.627+0000 7f73dc125b80 1 -- 172.21.15.49:0/2822926581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d0c3f32f10 msgr2=0x55d0c3f332f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:28.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.627+0000 7f73dc125b80 1 --2- 172.21.15.49:0/2822926581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d0c3f32f10 0x55d0c3f332f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f73bc09ccc0 tx=0x7f73bc0099e0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.627+0000 7f73dc125b80 1 -- 172.21.15.49:0/2822926581 shutdown_connections 2024-06-02T23:59:28.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.627+0000 7f73dc125b80 1 --2- 172.21.15.49:0/2822926581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d0c3f2d750 0x55d0c3f2db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.627+0000 7f73dc125b80 1 --2- 172.21.15.49:0/2822926581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d0c3f32f10 0x55d0c3f332f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.627+0000 7f73dc125b80 1 --2- 172.21.15.49:0/2822926581 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d0c3f33830 0x55d0c3f2d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.627+0000 7f73dc125b80 1 -- 172.21.15.49:0/2822926581 >> 172.21.15.49:0/2822926581 conn(0x55d0c3e5a030 msgr2=0x55d0c3f281d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:28.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.627+0000 7f73dc125b80 1 -- 172.21.15.49:0/2822926581 shutdown_connections 2024-06-02T23:59:28.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.627+0000 7f73dc125b80 1 -- 172.21.15.49:0/2822926581 wait complete. 2024-06-02T23:59:28.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.628+0000 7f73dc125b80 1 -- start start 2024-06-02T23:59:28.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.628+0000 7f73dc125b80 1 Processor -- start 2024-06-02T23:59:28.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.628+0000 7f73dc125b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d0c3f2d750 0x55d0c3f39550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:28.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.628+0000 7f73dc125b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d0c3f32f10 0x55d0c3f36850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:28.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.628+0000 7f73dc125b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d0c3f33830 0x55d0c3f36d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:28.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.628+0000 7f73dc125b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55d0c3e1ef70 con 0x55d0c3f2d750 2024-06-02T23:59:28.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.628+0000 7f73dc125b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55d0c3e7a7c0 con 0x55d0c3f33830 2024-06-02T23:59:28.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.628+0000 7f73dc125b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d0c3f39fc0 con 0x55d0c3f32f10 2024-06-02T23:59:28.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.628+0000 7f73dc125b80 10 client.0 _ll_register_callbacks cb 0x55d0c3e14560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T23:59:28.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.628+0000 7f73caffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d0c3f2d750 0x55d0c3f39550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:28.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.628+0000 7f73ca7fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d0c3f32f10 0x55d0c3f36850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:28.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.628+0000 7f73ca7fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d0c3f32f10 0x55d0c3f36850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:40148/0 (socket says 172.21.15.49:40148) 2024-06-02T23:59:28.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.628+0000 7f73caffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d0c3f2d750 0x55d0c3f39550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50948/0 (socket says 172.21.15.49:50948) 2024-06-02T23:59:28.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.628+0000 7f73ca7fc700 1 -- 172.21.15.49:0/554518765 learned_addr learned my addr 172.21.15.49:0/554518765 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:28.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.628+0000 7f73cb7fe700 1 --2- 172.21.15.49:0/554518765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d0c3f33830 0x55d0c3f36d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:28.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.629+0000 7f73ca7fc700 1 -- 172.21.15.49:0/554518765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d0c3f33830 msgr2=0x55d0c3f36d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:28.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.629+0000 7f73ca7fc700 1 --2- 172.21.15.49:0/554518765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d0c3f33830 0x55d0c3f36d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.629+0000 7f73ca7fc700 1 -- 172.21.15.49:0/554518765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d0c3f2d750 msgr2=0x55d0c3f39550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:28.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.629+0000 7f73ca7fc700 1 --2- 172.21.15.49:0/554518765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d0c3f2d750 0x55d0c3f39550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.629+0000 7f73ca7fc700 1 -- 172.21.15.49:0/554518765 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0c3e44700 con 0x55d0c3f32f10 2024-06-02T23:59:28.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.629+0000 7f73cb7fe700 1 --2- 172.21.15.49:0/554518765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d0c3f33830 0x55d0c3f36d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:59:28.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.629+0000 7f73ca7fc700 1 --2- 172.21.15.49:0/554518765 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d0c3f32f10 0x55d0c3f36850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f73b4011a60 tx=0x7f73b40047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2334b60a2664644d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:28.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.629+0000 7f73aaffd700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-06-02T23:59:28.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.629+0000 7f73aaffd700 1 -- 172.21.15.49:0/554518765 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b4004220 con 0x55d0c3f32f10 2024-06-02T23:59:28.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.629+0000 7f73aaffd700 1 -- 172.21.15.49:0/554518765 <== mon.1 v2:172.21.15.107:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f73b40043c0 con 0x55d0c3f32f10 2024-06-02T23:59:28.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.629+0000 7f73dc125b80 1 -- 172.21.15.49:0/554518765 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73bc09cfc0 con 0x55d0c3f32f10 2024-06-02T23:59:28.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.629+0000 7f73aaffd700 1 -- 172.21.15.49:0/554518765 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f73b4003680 con 0x55d0c3f32f10 2024-06-02T23:59:28.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.629+0000 7f73dc125b80 10 client.24736 fetch_fsmap learned FSMap version 26 2024-06-02T23:59:28.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.629+0000 7f73dc125b80 1 -- 172.21.15.49:0/554518765 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d0c3f44720 con 0x55d0c3f32f10 2024-06-02T23:59:28.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.630+0000 7f73aaffd700 1 -- 172.21.15.49:0/554518765 <== mon.1 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73bc09cfc0 con 0x55d0c3f32f10 2024-06-02T23:59:28.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.630+0000 7f73aaffd700 1 -- 172.21.15.49:0/554518765 <== mon.1 v2:172.21.15.107:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f73b401fbe0 con 0x55d0c3f32f10 2024-06-02T23:59:28.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.630+0000 7f73dc125b80 10 client.24736 fetch_fsmap finished waiting for FSMap version 26 2024-06-02T23:59:28.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.630+0000 7f73dc125b80 10 client.24736 resolve_mds: resolved name 'h' to daemon mds.h 2024-06-02T23:59:28.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.630+0000 7f73dc125b80 20 client.24736 populate_metadata read hostname 'smithi049' 2024-06-02T23:59:28.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.630+0000 7f73dc125b80 1 --2- 172.21.15.49:0/554518765 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x55d0c3f46d50 0x55d0c3f481c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:28.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.630+0000 7f73dc125b80 4 client.24736 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T23:59:28.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.630+0000 7f73dc125b80 1 -- 172.21.15.49:0/554518765 --> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0c3e8bd00 con 0x55d0c3f46d50 2024-06-02T23:59:28.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.630+0000 7f73caffd700 1 --2- 172.21.15.49:0/554518765 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x55d0c3f46d50 0x55d0c3f481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:28.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.630+0000 7f73caffd700 1 --2- 172.21.15.49:0/554518765 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x55d0c3f46d50 0x55d0c3f481c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fad808000e8e2370 server_cookie=17ec8c977652847c in_seq=0 out_seq=0 2024-06-02T23:59:28.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.630+0000 7f73aaffd700 10 client.24736 ms_handle_connect on v2:172.21.15.57:6836/230452144 2024-06-02T23:59:28.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.631+0000 7f73aaffd700 1 -- 172.21.15.49:0/554518765 <== mds.3 v2:172.21.15.57:6836/230452144 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55d0c3e8bd00 con 0x55d0c3f46d50 2024-06-02T23:59:28.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.631+0000 7f73aaffd700 10 client.24736 handle_command_reply: tid=0 2024-06-02T23:59:28.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.632+0000 7f73dc125b80 1 client.24736 shutdown 2024-06-02T23:59:28.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.632+0000 7f73dc125b80 1 -- 172.21.15.49:0/554518765 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d0c3f32f10 msgr2=0x55d0c3f36850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:28.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.632+0000 7f73dc125b80 1 --2- 172.21.15.49:0/554518765 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d0c3f32f10 0x55d0c3f36850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f73b4011a60 tx=0x7f73b40047c0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.632+0000 7f73dc125b80 1 -- 172.21.15.49:0/554518765 shutdown_connections 2024-06-02T23:59:28.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.632+0000 7f73dc125b80 1 --2- 172.21.15.49:0/554518765 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x55d0c3f46d50 0x55d0c3f481c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.632+0000 7f73dc125b80 1 --2- 172.21.15.49:0/554518765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d0c3f33830 0x55d0c3f36d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.632+0000 7f73dc125b80 1 --2- 172.21.15.49:0/554518765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d0c3f2d750 0x55d0c3f39550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.632+0000 7f73dc125b80 1 --2- 172.21.15.49:0/554518765 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d0c3f32f10 0x55d0c3f36850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.632+0000 7f73aaffd700 0 client.24736 ms_handle_reset on v2:172.21.15.57:6836/230452144 2024-06-02T23:59:28.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.632+0000 7f73dc125b80 1 -- 172.21.15.49:0/554518765 >> 172.21.15.49:0/554518765 conn(0x55d0c3e5a030 msgr2=0x55d0c3f276b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:28.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.632+0000 7f73dc125b80 1 -- 172.21.15.49:0/554518765 shutdown_connections 2024-06-02T23:59:28.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.632+0000 7f73dc125b80 1 -- 172.21.15.49:0/554518765 wait complete. 2024-06-02T23:59:28.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.632+0000 7f73dc125b80 20 client.24736 trim_cache size 0 max 16384 2024-06-02T23:59:28.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.653+0000 7f73dc125b80 1 Processor -- start 2024-06-02T23:59:28.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.653+0000 7f73dc125b80 1 -- start start 2024-06-02T23:59:28.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.654+0000 7f73dc125b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d0c3f2d750 0x55d0c3f2d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:28.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.654+0000 7f73dc125b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d0c3f32f10 0x55d0c3f27e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:28.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.654+0000 7f73dc125b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d0c3f33830 0x55d0c3f28370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:28.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.654+0000 7f73dc125b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55d0c3f46500 con 0x55d0c3f2d750 2024-06-02T23:59:28.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.654+0000 7f73dc125b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55d0c3f46bd0 con 0x55d0c3f32f10 2024-06-02T23:59:28.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.654+0000 7f73dc125b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d0c3f472a0 con 0x55d0c3f33830 2024-06-02T23:59:28.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.654+0000 7f73caffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d0c3f2d750 0x55d0c3f2d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.654+0000 7f73caffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d0c3f2d750 0x55d0c3f2d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50962/0 (socket says 172.21.15.49:50962) 2024-06-02T23:59:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.654+0000 7f73caffd700 1 -- 172.21.15.49:0/3850195981 learned_addr learned my addr 172.21.15.49:0/3850195981 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.654+0000 7f73ca7fc700 1 --2- 172.21.15.49:0/3850195981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d0c3f32f10 0x55d0c3f27e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.654+0000 7f73caffd700 1 -- 172.21.15.49:0/3850195981 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d0c3f33830 msgr2=0x55d0c3f28370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.654+0000 7f73caffd700 1 --2- 172.21.15.49:0/3850195981 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d0c3f33830 0x55d0c3f28370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.654+0000 7f73caffd700 1 -- 172.21.15.49:0/3850195981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d0c3f32f10 msgr2=0x55d0c3f27e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.654+0000 7f73caffd700 1 --2- 172.21.15.49:0/3850195981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d0c3f32f10 0x55d0c3f27e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.654+0000 7f73caffd700 1 -- 172.21.15.49:0/3850195981 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0c3f469f0 con 0x55d0c3f2d750 2024-06-02T23:59:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.654+0000 7f73ca7fc700 1 --2- 172.21.15.49:0/3850195981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d0c3f32f10 0x55d0c3f27e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:59:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.654+0000 7f73caffd700 1 --2- 172.21.15.49:0/3850195981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d0c3f2d750 0x55d0c3f2d210 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f73bc0062a0 tx=0x7f73bc09c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a8a3ea5ca21d17 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.654+0000 7f73c17fa700 1 -- 172.21.15.49:0/3850195981 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73bc09cfc0 con 0x55d0c3f2d750 2024-06-02T23:59:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.654+0000 7f73c17fa700 1 -- 172.21.15.49:0/3850195981 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73bc09b2c0 con 0x55d0c3f2d750 2024-06-02T23:59:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.654+0000 7f73c17fa700 1 -- 172.21.15.49:0/3850195981 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73bc09d220 con 0x55d0c3f2d750 2024-06-02T23:59:28.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.655+0000 7f73dc125b80 1 -- 172.21.15.49:0/3850195981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d0c3f2d750 msgr2=0x55d0c3f2d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:28.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.655+0000 7f73dc125b80 1 --2- 172.21.15.49:0/3850195981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d0c3f2d750 0x55d0c3f2d210 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f73bc0062a0 tx=0x7f73bc09c9e0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.655+0000 7f73dc125b80 1 -- 172.21.15.49:0/3850195981 shutdown_connections 2024-06-02T23:59:28.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.655+0000 7f73dc125b80 1 --2- 172.21.15.49:0/3850195981 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d0c3f33830 0x55d0c3f28370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.655+0000 7f73dc125b80 1 --2- 172.21.15.49:0/3850195981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d0c3f2d750 0x55d0c3f2d210 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.655+0000 7f73dc125b80 1 --2- 172.21.15.49:0/3850195981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d0c3f32f10 0x55d0c3f27e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.655+0000 7f73dc125b80 1 -- 172.21.15.49:0/3850195981 >> 172.21.15.49:0/3850195981 conn(0x55d0c3e5a030 msgr2=0x55d0c3f35160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:28.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.655+0000 7f73dc125b80 1 -- 172.21.15.49:0/3850195981 shutdown_connections 2024-06-02T23:59:28.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.655+0000 7f73dc125b80 1 -- 172.21.15.49:0/3850195981 wait complete. 2024-06-02T23:59:28.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.655+0000 7f73dc125b80 1 -- start start 2024-06-02T23:59:28.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.656+0000 7f73dc125b80 1 Processor -- start 2024-06-02T23:59:28.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.656+0000 7f73dc125b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d0c3f2d750 0x55d0c3f26e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:28.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.656+0000 7f73dc125b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d0c3f32f10 0x55d0c3f27360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:28.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.656+0000 7f73dc125b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d0c3f33830 0x55d0c3f278a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:28.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.656+0000 7f73dc125b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55d0c3f48040 con 0x55d0c3f2d750 2024-06-02T23:59:28.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.656+0000 7f73dc125b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55d0c3f47970 con 0x55d0c3f32f10 2024-06-02T23:59:28.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.656+0000 7f73dc125b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d0c3f48710 con 0x55d0c3f33830 2024-06-02T23:59:28.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.656+0000 7f73dc125b80 10 client.0 _ll_register_callbacks cb 0x55d0c3e14560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T23:59:28.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.656+0000 7f73caffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d0c3f2d750 0x55d0c3f26e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:28.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.656+0000 7f73caffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d0c3f2d750 0x55d0c3f26e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50972/0 (socket says 172.21.15.49:50972) 2024-06-02T23:59:28.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.656+0000 7f73caffd700 1 -- 172.21.15.49:0/3538713489 learned_addr learned my addr 172.21.15.49:0/3538713489 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:28.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.656+0000 7f73cb7fe700 1 --2- 172.21.15.49:0/3538713489 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d0c3f33830 0x55d0c3f278a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:28.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.656+0000 7f73ca7fc700 1 --2- 172.21.15.49:0/3538713489 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d0c3f32f10 0x55d0c3f27360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:28.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.656+0000 7f73caffd700 1 -- 172.21.15.49:0/3538713489 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d0c3f33830 msgr2=0x55d0c3f278a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:28.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.656+0000 7f73caffd700 1 --2- 172.21.15.49:0/3538713489 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d0c3f33830 0x55d0c3f278a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.656+0000 7f73caffd700 1 -- 172.21.15.49:0/3538713489 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d0c3f32f10 msgr2=0x55d0c3f27360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:28.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.656+0000 7f73caffd700 1 --2- 172.21.15.49:0/3538713489 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d0c3f32f10 0x55d0c3f27360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.656+0000 7f73caffd700 1 -- 172.21.15.49:0/3538713489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0c3f508e0 con 0x55d0c3f2d750 2024-06-02T23:59:28.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.657+0000 7f73caffd700 1 --2- 172.21.15.49:0/3538713489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d0c3f2d750 0x55d0c3f26e20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f73bc09ccc0 tx=0x7f73bc009df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b90cf775207e609 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:28.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.657+0000 7f73aaffd700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-02T23:59:28.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.657+0000 7f73aaffd700 1 -- 172.21.15.49:0/3538713489 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73bc007d30 con 0x55d0c3f2d750 2024-06-02T23:59:28.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.657+0000 7f73aaffd700 1 -- 172.21.15.49:0/3538713489 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f73bc02edb0 con 0x55d0c3f2d750 2024-06-02T23:59:28.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.657+0000 7f73dc125b80 1 -- 172.21.15.49:0/3538713489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73bc09b2c0 con 0x55d0c3f2d750 2024-06-02T23:59:28.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.657+0000 7f73aaffd700 1 -- 172.21.15.49:0/3538713489 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f73bc09d220 con 0x55d0c3f2d750 2024-06-02T23:59:28.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.657+0000 7f73dc125b80 10 client.14988 fetch_fsmap learned FSMap version 26 2024-06-02T23:59:28.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.657+0000 7f73dc125b80 1 -- 172.21.15.49:0/3538713489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d0c3f508e0 con 0x55d0c3f2d750 2024-06-02T23:59:28.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.657+0000 7f73aaffd700 1 -- 172.21.15.49:0/3538713489 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73bc09b2c0 con 0x55d0c3f2d750 2024-06-02T23:59:28.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.657+0000 7f73aaffd700 1 -- 172.21.15.49:0/3538713489 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f73bc09f030 con 0x55d0c3f2d750 2024-06-02T23:59:28.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.657+0000 7f73dc125b80 10 client.14988 fetch_fsmap finished waiting for FSMap version 26 2024-06-02T23:59:28.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.657+0000 7f73dc125b80 10 client.14988 resolve_mds: resolved name 'h' to daemon mds.h 2024-06-02T23:59:28.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.657+0000 7f73dc125b80 20 client.14988 populate_metadata read hostname 'smithi049' 2024-06-02T23:59:28.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.657+0000 7f73dc125b80 1 --2- 172.21.15.49:0/3538713489 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x55d0c3fb6290 0x55d0c3fb4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:28.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.657+0000 7f73dc125b80 4 client.14988 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T23:59:28.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.657+0000 7f73dc125b80 1 -- 172.21.15.49:0/3538713489 --> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] -- command(tid 0: {"prefix": "status"}) -- 0x55d0c3e86280 con 0x55d0c3fb6290 2024-06-02T23:59:28.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.658+0000 7f73ca7fc700 1 --2- 172.21.15.49:0/3538713489 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x55d0c3fb6290 0x55d0c3fb4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:28.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.658+0000 7f73aaffd700 10 client.14988 ms_handle_connect on v2:172.21.15.57:6836/230452144 2024-06-02T23:59:28.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.658+0000 7f73ca7fc700 1 --2- 172.21.15.49:0/3538713489 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x55d0c3fb6290 0x55d0c3fb4fa0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2a706b45cb64416b server_cookie=c8b50ac328da43bb in_seq=0 out_seq=0 2024-06-02T23:59:28.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.658+0000 7f73aaffd700 1 -- 172.21.15.49:0/3538713489 <== mds.3 v2:172.21.15.57:6836/230452144 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55d0c3e86280 con 0x55d0c3fb6290 2024-06-02T23:59:28.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.658+0000 7f73aaffd700 10 client.14988 handle_command_reply: tid=0 2024-06-02T23:59:28.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.658+0000 7f73dc125b80 1 client.14988 shutdown 2024-06-02T23:59:28.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.658+0000 7f73dc125b80 1 -- 172.21.15.49:0/3538713489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d0c3f2d750 msgr2=0x55d0c3f26e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:28.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.658+0000 7f73dc125b80 1 --2- 172.21.15.49:0/3538713489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d0c3f2d750 0x55d0c3f26e20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f73bc09ccc0 tx=0x7f73bc009df0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.659+0000 7f73dc125b80 1 -- 172.21.15.49:0/3538713489 shutdown_connections 2024-06-02T23:59:28.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.659+0000 7f73dc125b80 1 --2- 172.21.15.49:0/3538713489 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x55d0c3fb6290 0x55d0c3fb4fa0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.659+0000 7f73dc125b80 1 --2- 172.21.15.49:0/3538713489 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d0c3f33830 0x55d0c3f278a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.659+0000 7f73dc125b80 1 --2- 172.21.15.49:0/3538713489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d0c3f2d750 0x55d0c3f26e20 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.659+0000 7f73dc125b80 1 --2- 172.21.15.49:0/3538713489 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d0c3f32f10 0x55d0c3f27360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.659+0000 7f73aaffd700 0 client.14988 ms_handle_reset on v2:172.21.15.57:6836/230452144 2024-06-02T23:59:28.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.659+0000 7f73dc125b80 1 -- 172.21.15.49:0/3538713489 >> 172.21.15.49:0/3538713489 conn(0x55d0c3e5a030 msgr2=0x55d0c3f34d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:28.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.659+0000 7f73dc125b80 1 -- 172.21.15.49:0/3538713489 shutdown_connections 2024-06-02T23:59:28.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.659+0000 7f73dc125b80 1 -- 172.21.15.49:0/3538713489 wait complete. 2024-06-02T23:59:28.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.659+0000 7f73dc125b80 20 client.14988 trim_cache size 0 max 16384 2024-06-02T23:59:28.664 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-02T23:59:28.664 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "890dd222-213a-11ef-bc9b-c7b262605968", 2024-06-02T23:59:28.664 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 3, 2024-06-02T23:59:28.664 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 24464, 2024-06-02T23:59:28.664 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-06-02T23:59:28.664 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-06-02T23:59:28.664 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-06-02T23:59:28.665 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 117.20876504100001, 2024-06-02T23:59:28.665 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 26, 2024-06-02T23:59:28.665 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 90, 2024-06-02T23:59:28.665 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 88, 2024-06-02T23:59:28.665 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 158.369586481 2024-06-02T23:59:28.665 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-02T23:59:28.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.659+0000 7f73d18a2700 1 -- 172.21.15.49:0/3244015639 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f73b80a2c20 msgr2=0x7f73b80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:28.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.659+0000 7f73d18a2700 1 --2- 172.21.15.49:0/3244015639 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f73b80a2c20 0x7f73b80a50e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f73cc0788b0 tx=0x7f73b400b410 comp rx=0 tx=0).stop 2024-06-02T23:59:28.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.659+0000 7f73d18a2700 1 -- 172.21.15.49:0/3244015639 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73cc101390 msgr2=0x7f73cc103070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:28.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.659+0000 7f73d18a2700 1 --2- 172.21.15.49:0/3244015639 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73cc101390 0x7f73cc103070 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f73bc00b070 tx=0x7f73bc004e40 comp rx=0 tx=0).stop 2024-06-02T23:59:28.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.659+0000 7f73d18a2700 1 -- 172.21.15.49:0/3244015639 shutdown_connections 2024-06-02T23:59:28.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.659+0000 7f73d18a2700 1 --2- 172.21.15.49:0/3244015639 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f73b80a2c20 0x7f73b80a50e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.659+0000 7f73d18a2700 1 --2- 172.21.15.49:0/3244015639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f73cc107400 0x7f73cc103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.659+0000 7f73d18a2700 1 --2- 172.21.15.49:0/3244015639 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73cc101390 0x7f73cc103070 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.659+0000 7f73d18a2700 1 --2- 172.21.15.49:0/3244015639 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73cc101d50 0x7f73cc1035b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:28.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.659+0000 7f73d18a2700 1 -- 172.21.15.49:0/3244015639 >> 172.21.15.49:0/3244015639 conn(0x7f73cc078340 msgr2=0x7f73cc100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:28.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.660+0000 7f73d18a2700 1 -- 172.21.15.49:0/3244015639 shutdown_connections 2024-06-02T23:59:28.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:28.660+0000 7f73d18a2700 1 -- 172.21.15.49:0/3244015639 wait complete. 2024-06-02T23:59:28.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:28 smithi057 ceph-mon[36457]: pgmap v366: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-06-02T23:59:29.380 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.c status 2024-06-02T23:59:29.607 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:29 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:59:29.607 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:29 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:59:29.607 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:29 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:59:29.608 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:29 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:59:29.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:29 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:59:29.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:29 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:59:29.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:29 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:59:29.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:29 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:59:29.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:29 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:59:29.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:29 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:59:29.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:29 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:59:29.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:29 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:59:30.116 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:59:30.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:30 smithi107 ceph-mon[37048]: pgmap v367: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:59:30.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:30 smithi057 ceph-mon[36457]: pgmap v367: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:59:30.960 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:30 smithi049 ceph-mon[32302]: pgmap v367: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:59:31.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.865+0000 7f337f77a700 1 -- 172.21.15.49:0/2267838404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3378102530 msgr2=0x7f33781029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:31.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.865+0000 7f337f77a700 1 --2- 172.21.15.49:0/2267838404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3378102530 0x7f33781029b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f336c0099c0 tx=0x7f336c009cd0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.865+0000 7f337f77a700 1 -- 172.21.15.49:0/2267838404 shutdown_connections 2024-06-02T23:59:31.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.865+0000 7f337f77a700 1 --2- 172.21.15.49:0/2267838404 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3378102ef0 0x7f337810f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.865+0000 7f337f77a700 1 --2- 172.21.15.49:0/2267838404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33781085d0 0x7f33781089b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.865+0000 7f337f77a700 1 --2- 172.21.15.49:0/2267838404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3378102530 0x7f33781029b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.865+0000 7f337f77a700 1 -- 172.21.15.49:0/2267838404 >> 172.21.15.49:0/2267838404 conn(0x7f3378079640 msgr2=0x7f3378079a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:31.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.865+0000 7f337f77a700 1 -- 172.21.15.49:0/2267838404 shutdown_connections 2024-06-02T23:59:31.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.865+0000 7f337f77a700 1 -- 172.21.15.49:0/2267838404 wait complete. 2024-06-02T23:59:31.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.866+0000 7f337f77a700 1 Processor -- start 2024-06-02T23:59:31.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.866+0000 7f337f77a700 1 -- start start 2024-06-02T23:59:31.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.866+0000 7f337f77a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3378102530 0x7f337819e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:31.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.866+0000 7f337f77a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3378102ef0 0x7f337819ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:31.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.866+0000 7f337f77a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33781085d0 0x7f3378198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:31.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.866+0000 7f337f77a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3378112810 con 0x7f3378102530 2024-06-02T23:59:31.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.866+0000 7f337f77a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3378112690 con 0x7f33781085d0 2024-06-02T23:59:31.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.866+0000 7f337f77a700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3378112990 con 0x7f3378102ef0 2024-06-02T23:59:31.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.867+0000 7f337d516700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3378102530 0x7f337819e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:31.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.867+0000 7f337d516700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3378102530 0x7f337819e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50998/0 (socket says 172.21.15.49:50998) 2024-06-02T23:59:31.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.867+0000 7f337d516700 1 -- 172.21.15.49:0/2973484704 learned_addr learned my addr 172.21.15.49:0/2973484704 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:31.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.867+0000 7f337cd15700 1 --2- 172.21.15.49:0/2973484704 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3378102ef0 0x7f337819ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:31.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.867+0000 7f337dd17700 1 --2- 172.21.15.49:0/2973484704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33781085d0 0x7f3378198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:31.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.867+0000 7f337d516700 1 -- 172.21.15.49:0/2973484704 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3378102ef0 msgr2=0x7f337819ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:31.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.867+0000 7f337d516700 1 --2- 172.21.15.49:0/2973484704 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3378102ef0 0x7f337819ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.867+0000 7f337d516700 1 -- 172.21.15.49:0/2973484704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33781085d0 msgr2=0x7f3378198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:31.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.867+0000 7f337d516700 1 --2- 172.21.15.49:0/2973484704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33781085d0 0x7f3378198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.867+0000 7f337d516700 1 -- 172.21.15.49:0/2973484704 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3378199170 con 0x7f3378102530 2024-06-02T23:59:31.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.867+0000 7f337dd17700 1 --2- 172.21.15.49:0/2973484704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33781085d0 0x7f3378198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:59:31.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.867+0000 7f337cd15700 1 --2- 172.21.15.49:0/2973484704 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3378102ef0 0x7f337819ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:59:31.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.867+0000 7f337d516700 1 --2- 172.21.15.49:0/2973484704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3378102530 0x7f337819e850 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f336800ada0 tx=0x7f336800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:31.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.867+0000 7f33767fc700 1 -- 172.21.15.49:0/2973484704 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3368017020 con 0x7f3378102530 2024-06-02T23:59:31.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.868+0000 7f337f77a700 1 -- 172.21.15.49:0/2973484704 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3378199460 con 0x7f3378102530 2024-06-02T23:59:31.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.868+0000 7f33767fc700 1 -- 172.21.15.49:0/2973484704 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3368004bb0 con 0x7f3378102530 2024-06-02T23:59:31.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.868+0000 7f33767fc700 1 -- 172.21.15.49:0/2973484704 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3368005460 con 0x7f3378102530 2024-06-02T23:59:31.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.868+0000 7f337f77a700 1 -- 172.21.15.49:0/2973484704 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33781a5720 con 0x7f3378102530 2024-06-02T23:59:31.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.870+0000 7f33767fc700 1 -- 172.21.15.49:0/2973484704 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f336800c980 con 0x7f3378102530 2024-06-02T23:59:31.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.871+0000 7f33767fc700 1 --2- 172.21.15.49:0/2973484704 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f33600a2ca0 0x7f33600a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:31.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.871+0000 7f337cd15700 1 --2- 172.21.15.49:0/2973484704 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f33600a2ca0 0x7f33600a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:31.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.871+0000 7f33767fc700 1 -- 172.21.15.49:0/2973484704 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f33680ce7a0 con 0x7f3378102530 2024-06-02T23:59:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.872+0000 7f337cd15700 1 --2- 172.21.15.49:0/2973484704 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f33600a2ca0 0x7f33600a5160 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3378079c40 tx=0x7f336c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.872+0000 7f3389ffdb80 1 Processor -- start 2024-06-02T23:59:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.872+0000 7f3389ffdb80 1 -- start start 2024-06-02T23:59:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.872+0000 7f3389ffdb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563d366da420 0x563d366da800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.872+0000 7f3389ffdb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d366d4620 0x563d366d4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.872+0000 7f3389ffdb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d366d4fe0 0x563d366e11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.872+0000 7f3389ffdb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x563d365c2f10 con 0x563d366d4620 2024-06-02T23:59:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.872+0000 7f3389ffdb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x563d36621800 con 0x563d366d4fe0 2024-06-02T23:59:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.872+0000 7f3389ffdb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x563d36589410 con 0x563d366da420 2024-06-02T23:59:31.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.872+0000 7f337cd15700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d366d4620 0x563d366d4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:31.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.872+0000 7f337cd15700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d366d4620 0x563d366d4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51012/0 (socket says 172.21.15.49:51012) 2024-06-02T23:59:31.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.872+0000 7f337cd15700 1 -- 172.21.15.49:0/584036659 learned_addr learned my addr 172.21.15.49:0/584036659 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:31.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.872+0000 7f337dd17700 1 --2- 172.21.15.49:0/584036659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d366d4fe0 0x563d366e11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:31.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.873+0000 7f337d516700 1 --2- 172.21.15.49:0/584036659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563d366da420 0x563d366da800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:31.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.873+0000 7f337cd15700 1 -- 172.21.15.49:0/584036659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563d366da420 msgr2=0x563d366da800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:31.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.873+0000 7f337cd15700 1 --2- 172.21.15.49:0/584036659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563d366da420 0x563d366da800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.873+0000 7f337cd15700 1 -- 172.21.15.49:0/584036659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d366d4fe0 msgr2=0x563d366e11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:31.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.873+0000 7f337cd15700 1 --2- 172.21.15.49:0/584036659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d366d4fe0 0x563d366e11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.873+0000 7f337cd15700 1 -- 172.21.15.49:0/584036659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d36570880 con 0x563d366d4620 2024-06-02T23:59:31.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.873+0000 7f337d516700 1 --2- 172.21.15.49:0/584036659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563d366da420 0x563d366da800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:59:31.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.873+0000 7f337cd15700 1 --2- 172.21.15.49:0/584036659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d366d4620 0x563d366d4aa0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f336c015000 tx=0x7f336c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58004cb89759f7b2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:31.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.873+0000 7f335f7fe700 1 -- 172.21.15.49:0/584036659 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c0050c0 con 0x563d366d4620 2024-06-02T23:59:31.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.873+0000 7f335f7fe700 1 -- 172.21.15.49:0/584036659 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f336c00f460 con 0x563d366d4620 2024-06-02T23:59:31.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.873+0000 7f335f7fe700 1 -- 172.21.15.49:0/584036659 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c024650 con 0x563d366d4620 2024-06-02T23:59:31.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.874+0000 7f3389ffdb80 1 -- 172.21.15.49:0/584036659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d366d4620 msgr2=0x563d366d4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:31.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.874+0000 7f3389ffdb80 1 --2- 172.21.15.49:0/584036659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d366d4620 0x563d366d4aa0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f336c015000 tx=0x7f336c020000 comp rx=0 tx=0).stop 2024-06-02T23:59:31.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.874+0000 7f3389ffdb80 1 -- 172.21.15.49:0/584036659 shutdown_connections 2024-06-02T23:59:31.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.874+0000 7f3389ffdb80 1 --2- 172.21.15.49:0/584036659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d366d4fe0 0x563d366e11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.874+0000 7f3389ffdb80 1 --2- 172.21.15.49:0/584036659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563d366da420 0x563d366da800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.874+0000 7f3389ffdb80 1 --2- 172.21.15.49:0/584036659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d366d4620 0x563d366d4aa0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.874+0000 7f3389ffdb80 1 -- 172.21.15.49:0/584036659 >> 172.21.15.49:0/584036659 conn(0x563d365fd030 msgr2=0x563d366cb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:31.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.874+0000 7f3389ffdb80 1 -- 172.21.15.49:0/584036659 shutdown_connections 2024-06-02T23:59:31.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.874+0000 7f3389ffdb80 1 -- 172.21.15.49:0/584036659 wait complete. 2024-06-02T23:59:31.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.874+0000 7f3389ffdb80 1 -- start start 2024-06-02T23:59:31.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.874+0000 7f3389ffdb80 1 Processor -- start 2024-06-02T23:59:31.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.875+0000 7f3389ffdb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d366d4620 0x563d366e0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:31.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.875+0000 7f3389ffdb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563d366d4fe0 0x563d366de180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:31.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.875+0000 7f3389ffdb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d366da420 0x563d366de6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:31.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.875+0000 7f3389ffdb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x563d365c1f70 con 0x563d366da420 2024-06-02T23:59:31.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.875+0000 7f3389ffdb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x563d3661d7c0 con 0x563d366d4620 2024-06-02T23:59:31.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.875+0000 7f3389ffdb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x563d366e1700 con 0x563d366d4fe0 2024-06-02T23:59:31.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.875+0000 7f3389ffdb80 10 client.0 _ll_register_callbacks cb 0x563d365b7560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T23:59:31.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.875+0000 7f337dd17700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d366da420 0x563d366de6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:31.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.875+0000 7f337dd17700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d366da420 0x563d366de6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51014/0 (socket says 172.21.15.49:51014) 2024-06-02T23:59:31.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.875+0000 7f337cd15700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563d366d4fe0 0x563d366de180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:31.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.875+0000 7f337d516700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d366d4620 0x563d366e0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:31.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.875+0000 7f337dd17700 1 -- 172.21.15.49:0/829347693 learned_addr learned my addr 172.21.15.49:0/829347693 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:31.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.875+0000 7f337cd15700 1 -- 172.21.15.49:0/829347693 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d366d4620 msgr2=0x563d366e0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:31.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.875+0000 7f337cd15700 1 --2- 172.21.15.49:0/829347693 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d366d4620 0x563d366e0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.875+0000 7f337cd15700 1 -- 172.21.15.49:0/829347693 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d366da420 msgr2=0x563d366de6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:31.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.875+0000 7f337cd15700 1 --2- 172.21.15.49:0/829347693 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d366da420 0x563d366de6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.875+0000 7f337cd15700 1 -- 172.21.15.49:0/829347693 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d365e7700 con 0x563d366d4fe0 2024-06-02T23:59:31.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.875+0000 7f337dd17700 1 --2- 172.21.15.49:0/829347693 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d366da420 0x563d366de6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:59:31.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.875+0000 7f337cd15700 1 --2- 172.21.15.49:0/829347693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563d366d4fe0 0x563d366de180 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f336c0098e0 tx=0x7f336c005280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=473689e7fe56e4b5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:31.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.875+0000 7f335cff9700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-06-02T23:59:31.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.876+0000 7f335cff9700 1 -- 172.21.15.49:0/829347693 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c033070 con 0x563d366d4fe0 2024-06-02T23:59:31.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.876+0000 7f3389ffdb80 1 -- 172.21.15.49:0/829347693 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f336c00f460 con 0x563d366d4fe0 2024-06-02T23:59:31.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.876+0000 7f335cff9700 1 -- 172.21.15.49:0/829347693 <== mon.1 v2:172.21.15.107:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f336c038460 con 0x563d366d4fe0 2024-06-02T23:59:31.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.876+0000 7f335cff9700 1 -- 172.21.15.49:0/829347693 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f336c038660 con 0x563d366d4fe0 2024-06-02T23:59:31.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.876+0000 7f3389ffdb80 10 client.24748 fetch_fsmap learned FSMap version 26 2024-06-02T23:59:31.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.876+0000 7f3389ffdb80 1 -- 172.21.15.49:0/829347693 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563d366ebcd0 con 0x563d366d4fe0 2024-06-02T23:59:31.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.876+0000 7f335cff9700 1 -- 172.21.15.49:0/829347693 <== mon.1 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f336c00f460 con 0x563d366d4fe0 2024-06-02T23:59:31.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.876+0000 7f335cff9700 1 -- 172.21.15.49:0/829347693 <== mon.1 v2:172.21.15.107:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f336c02fc20 con 0x563d366d4fe0 2024-06-02T23:59:31.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.876+0000 7f3389ffdb80 10 client.24748 fetch_fsmap finished waiting for FSMap version 26 2024-06-02T23:59:31.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.876+0000 7f3389ffdb80 10 client.24748 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-02T23:59:31.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.876+0000 7f3389ffdb80 20 client.24748 populate_metadata read hostname 'smithi049' 2024-06-02T23:59:31.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.876+0000 7f3389ffdb80 1 --2- 172.21.15.49:0/829347693 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x563d366ed020 0x563d366ef170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:31.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.876+0000 7f3389ffdb80 4 client.24748 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T23:59:31.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.876+0000 7f3389ffdb80 1 -- 172.21.15.49:0/829347693 --> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d3662ed00 con 0x563d366ed020 2024-06-02T23:59:31.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.877+0000 7f337d516700 1 --2- 172.21.15.49:0/829347693 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x563d366ed020 0x563d366ef170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:31.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.877+0000 7f337d516700 1 --2- 172.21.15.49:0/829347693 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x563d366ed020 0x563d366ef170 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2ae0ad735db4ed2b server_cookie=e0dd33e6b183aceb in_seq=0 out_seq=0 2024-06-02T23:59:31.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.877+0000 7f335cff9700 10 client.24748 ms_handle_connect on v2:172.21.15.107:6836/3700593315 2024-06-02T23:59:31.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.878+0000 7f335cff9700 1 -- 172.21.15.49:0/829347693 <== mds.2 v2:172.21.15.107:6836/3700593315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x563d3662ed00 con 0x563d366ed020 2024-06-02T23:59:31.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.878+0000 7f335cff9700 10 client.24748 handle_command_reply: tid=0 2024-06-02T23:59:31.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.878+0000 7f3389ffdb80 1 client.24748 shutdown 2024-06-02T23:59:31.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.878+0000 7f3389ffdb80 1 -- 172.21.15.49:0/829347693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563d366d4fe0 msgr2=0x563d366de180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:31.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.878+0000 7f3389ffdb80 1 --2- 172.21.15.49:0/829347693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563d366d4fe0 0x563d366de180 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f336c0098e0 tx=0x7f336c005280 comp rx=0 tx=0).stop 2024-06-02T23:59:31.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.878+0000 7f3389ffdb80 1 -- 172.21.15.49:0/829347693 shutdown_connections 2024-06-02T23:59:31.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.878+0000 7f3389ffdb80 1 --2- 172.21.15.49:0/829347693 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x563d366ed020 0x563d366ef170 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.878+0000 7f3389ffdb80 1 --2- 172.21.15.49:0/829347693 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d366da420 0x563d366de6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.878+0000 7f3389ffdb80 1 --2- 172.21.15.49:0/829347693 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d366d4620 0x563d366e0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.878+0000 7f3389ffdb80 1 --2- 172.21.15.49:0/829347693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563d366d4fe0 0x563d366de180 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.878+0000 7f335cff9700 0 client.24748 ms_handle_reset on v2:172.21.15.107:6836/3700593315 2024-06-02T23:59:31.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.878+0000 7f3389ffdb80 1 -- 172.21.15.49:0/829347693 >> 172.21.15.49:0/829347693 conn(0x563d365fd030 msgr2=0x563d366ca6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:31.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.878+0000 7f3389ffdb80 1 -- 172.21.15.49:0/829347693 shutdown_connections 2024-06-02T23:59:31.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.878+0000 7f3389ffdb80 1 -- 172.21.15.49:0/829347693 wait complete. 2024-06-02T23:59:31.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.879+0000 7f3389ffdb80 20 client.24748 trim_cache size 0 max 16384 2024-06-02T23:59:31.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.900+0000 7f3389ffdb80 1 Processor -- start 2024-06-02T23:59:31.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.900+0000 7f3389ffdb80 1 -- start start 2024-06-02T23:59:31.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.900+0000 7f3389ffdb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d366d4620 0x563d366d9b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:31.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.900+0000 7f3389ffdb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563d366d4fe0 0x563d366cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:31.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.900+0000 7f3389ffdb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d366da420 0x563d366e09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:31.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.900+0000 7f3389ffdb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x563d366ed4b0 con 0x563d366d4620 2024-06-02T23:59:31.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.900+0000 7f3389ffdb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x563d366edb80 con 0x563d366da420 2024-06-02T23:59:31.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.900+0000 7f3389ffdb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x563d366ee250 con 0x563d366d4fe0 2024-06-02T23:59:31.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.900+0000 7f337d516700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d366d4620 0x563d366d9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:31.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.901+0000 7f337d516700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d366d4620 0x563d366d9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51028/0 (socket says 172.21.15.49:51028) 2024-06-02T23:59:31.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.901+0000 7f337d516700 1 -- 172.21.15.49:0/434861133 learned_addr learned my addr 172.21.15.49:0/434861133 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:31.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.901+0000 7f337dd17700 1 --2- 172.21.15.49:0/434861133 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d366da420 0x563d366e09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:31.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.901+0000 7f337cd15700 1 --2- 172.21.15.49:0/434861133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563d366d4fe0 0x563d366cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:31.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.901+0000 7f337d516700 1 -- 172.21.15.49:0/434861133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563d366d4fe0 msgr2=0x563d366cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:31.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.901+0000 7f337d516700 1 --2- 172.21.15.49:0/434861133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563d366d4fe0 0x563d366cf910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.901+0000 7f337d516700 1 -- 172.21.15.49:0/434861133 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d366da420 msgr2=0x563d366e09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:31.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.901+0000 7f337d516700 1 --2- 172.21.15.49:0/434861133 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d366da420 0x563d366e09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.901+0000 7f337d516700 1 -- 172.21.15.49:0/434861133 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d366deaa0 con 0x563d366d4620 2024-06-02T23:59:31.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.901+0000 7f337dd17700 1 --2- 172.21.15.49:0/434861133 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d366da420 0x563d366e09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:59:31.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.901+0000 7f337d516700 1 --2- 172.21.15.49:0/434861133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d366d4620 0x563d366d9b50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3368000f80 tx=0x7f33680bb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab5b29c22ebb1509 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:31.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.901+0000 7f335effd700 1 -- 172.21.15.49:0/434861133 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33680bb0b0 con 0x563d366d4620 2024-06-02T23:59:31.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.901+0000 7f335effd700 1 -- 172.21.15.49:0/434861133 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33680cc3b0 con 0x563d366d4620 2024-06-02T23:59:31.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.901+0000 7f335effd700 1 -- 172.21.15.49:0/434861133 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336809b2f0 con 0x563d366d4620 2024-06-02T23:59:31.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.902+0000 7f3389ffdb80 1 -- 172.21.15.49:0/434861133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d366d4620 msgr2=0x563d366d9b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:31.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.902+0000 7f3389ffdb80 1 --2- 172.21.15.49:0/434861133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d366d4620 0x563d366d9b50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3368000f80 tx=0x7f33680bb040 comp rx=0 tx=0).stop 2024-06-02T23:59:31.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.902+0000 7f3389ffdb80 1 -- 172.21.15.49:0/434861133 shutdown_connections 2024-06-02T23:59:31.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.902+0000 7f3389ffdb80 1 --2- 172.21.15.49:0/434861133 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d366da420 0x563d366e09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.902+0000 7f3389ffdb80 1 --2- 172.21.15.49:0/434861133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d366d4620 0x563d366d9b50 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.902+0000 7f3389ffdb80 1 --2- 172.21.15.49:0/434861133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563d366d4fe0 0x563d366cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.902+0000 7f3389ffdb80 1 -- 172.21.15.49:0/434861133 >> 172.21.15.49:0/434861133 conn(0x563d365fd030 msgr2=0x563d366cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:31.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.902+0000 7f3389ffdb80 1 -- 172.21.15.49:0/434861133 shutdown_connections 2024-06-02T23:59:31.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.902+0000 7f3389ffdb80 1 -- 172.21.15.49:0/434861133 wait complete. 2024-06-02T23:59:31.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.903+0000 7f3389ffdb80 1 -- start start 2024-06-02T23:59:31.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.903+0000 7f3389ffdb80 1 Processor -- start 2024-06-02T23:59:31.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.904+0000 7f3389ffdb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563d366d4620 0x563d366f4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:31.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.904+0000 7f3389ffdb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d366d4fe0 0x563d366f4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:31.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.904+0000 7f3389ffdb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d366da420 0x563d366f4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:31.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.904+0000 7f3389ffdb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x563d366eeff0 con 0x563d366da420 2024-06-02T23:59:31.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.904+0000 7f3389ffdb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x563d366ee920 con 0x563d366d4fe0 2024-06-02T23:59:31.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.904+0000 7f3389ffdb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x563d366ef6c0 con 0x563d366d4620 2024-06-02T23:59:31.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.904+0000 7f3389ffdb80 10 client.0 _ll_register_callbacks cb 0x563d365b7560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T23:59:31.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.904+0000 7f337dd17700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d366da420 0x563d366f4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:31.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.904+0000 7f337dd17700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d366da420 0x563d366f4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51040/0 (socket says 172.21.15.49:51040) 2024-06-02T23:59:31.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.904+0000 7f337dd17700 1 -- 172.21.15.49:0/4245425426 learned_addr learned my addr 172.21.15.49:0/4245425426 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:31.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.904+0000 7f337cd15700 1 --2- 172.21.15.49:0/4245425426 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d366d4fe0 0x563d366f4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:31.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.904+0000 7f337d516700 1 --2- 172.21.15.49:0/4245425426 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563d366d4620 0x563d366f4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:31.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.904+0000 7f337dd17700 1 -- 172.21.15.49:0/4245425426 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563d366d4620 msgr2=0x563d366f4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:31.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.904+0000 7f337dd17700 1 --2- 172.21.15.49:0/4245425426 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563d366d4620 0x563d366f4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.904+0000 7f337dd17700 1 -- 172.21.15.49:0/4245425426 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d366d4fe0 msgr2=0x563d366f4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:31.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.904+0000 7f337dd17700 1 --2- 172.21.15.49:0/4245425426 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d366d4fe0 0x563d366f4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.904+0000 7f337dd17700 1 -- 172.21.15.49:0/4245425426 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d366f00d0 con 0x563d366da420 2024-06-02T23:59:31.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.904+0000 7f337d516700 1 --2- 172.21.15.49:0/4245425426 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563d366d4620 0x563d366f4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:59:31.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.904+0000 7f337dd17700 1 --2- 172.21.15.49:0/4245425426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d366da420 0x563d366f4db0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f33700127a0 tx=0x7f3370012ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a9572a588e02e09 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:31.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.904+0000 7f335cff9700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-02T23:59:31.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.905+0000 7f335cff9700 1 -- 172.21.15.49:0/4245425426 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3370021060 con 0x563d366da420 2024-06-02T23:59:31.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.905+0000 7f335cff9700 1 -- 172.21.15.49:0/4245425426 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f33700119d0 con 0x563d366da420 2024-06-02T23:59:31.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.905+0000 7f3389ffdb80 1 -- 172.21.15.49:0/4245425426 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33680cc3b0 con 0x563d366da420 2024-06-02T23:59:31.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.905+0000 7f335cff9700 1 -- 172.21.15.49:0/4245425426 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3370011bd0 con 0x563d366da420 2024-06-02T23:59:31.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.905+0000 7f3389ffdb80 10 client.15006 fetch_fsmap learned FSMap version 26 2024-06-02T23:59:31.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.905+0000 7f3389ffdb80 1 -- 172.21.15.49:0/4245425426 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563d36759700 con 0x563d366da420 2024-06-02T23:59:31.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.905+0000 7f335cff9700 1 -- 172.21.15.49:0/4245425426 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33680cc3b0 con 0x563d366da420 2024-06-02T23:59:31.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.905+0000 7f335cff9700 1 -- 172.21.15.49:0/4245425426 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f3370026070 con 0x563d366da420 2024-06-02T23:59:31.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.905+0000 7f3389ffdb80 10 client.15006 fetch_fsmap finished waiting for FSMap version 26 2024-06-02T23:59:31.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.905+0000 7f3389ffdb80 10 client.15006 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-02T23:59:31.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.905+0000 7f3389ffdb80 20 client.15006 populate_metadata read hostname 'smithi049' 2024-06-02T23:59:31.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.905+0000 7f3389ffdb80 1 --2- 172.21.15.49:0/4245425426 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x563d3675e2c0 0x563d3675cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:31.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.905+0000 7f3389ffdb80 4 client.15006 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T23:59:31.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.905+0000 7f3389ffdb80 1 -- 172.21.15.49:0/4245425426 --> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] -- command(tid 0: {"prefix": "status"}) -- 0x563d36629280 con 0x563d3675e2c0 2024-06-02T23:59:31.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.906+0000 7f337d516700 1 --2- 172.21.15.49:0/4245425426 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x563d3675e2c0 0x563d3675cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:31.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.906+0000 7f335cff9700 10 client.15006 ms_handle_connect on v2:172.21.15.107:6836/3700593315 2024-06-02T23:59:31.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.906+0000 7f337d516700 1 --2- 172.21.15.49:0/4245425426 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x563d3675e2c0 0x563d3675cfd0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9e5bb3e13390d1aa server_cookie=420025e2a76f2545 in_seq=0 out_seq=0 2024-06-02T23:59:31.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.906+0000 7f335cff9700 1 -- 172.21.15.49:0/4245425426 <== mds.2 v2:172.21.15.107:6836/3700593315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x563d36629280 con 0x563d3675e2c0 2024-06-02T23:59:31.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.906+0000 7f335cff9700 10 client.15006 handle_command_reply: tid=0 2024-06-02T23:59:31.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.906+0000 7f3389ffdb80 1 client.15006 shutdown 2024-06-02T23:59:31.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.906+0000 7f3389ffdb80 1 -- 172.21.15.49:0/4245425426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d366da420 msgr2=0x563d366f4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:31.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.906+0000 7f3389ffdb80 1 --2- 172.21.15.49:0/4245425426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d366da420 0x563d366f4db0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f33700127a0 tx=0x7f3370012ab0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.906+0000 7f3389ffdb80 1 -- 172.21.15.49:0/4245425426 shutdown_connections 2024-06-02T23:59:31.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.906+0000 7f3389ffdb80 1 --2- 172.21.15.49:0/4245425426 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x563d3675e2c0 0x563d3675cfd0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.907+0000 7f335cff9700 0 client.15006 ms_handle_reset on v2:172.21.15.107:6836/3700593315 2024-06-02T23:59:31.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.907+0000 7f3389ffdb80 1 --2- 172.21.15.49:0/4245425426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d366da420 0x563d366f4db0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.907+0000 7f3389ffdb80 1 --2- 172.21.15.49:0/4245425426 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563d366d4620 0x563d366f4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.907+0000 7f3389ffdb80 1 --2- 172.21.15.49:0/4245425426 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d366d4fe0 0x563d366f4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.907+0000 7f3389ffdb80 1 -- 172.21.15.49:0/4245425426 >> 172.21.15.49:0/4245425426 conn(0x563d365fd030 msgr2=0x563d366cfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:31.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.907+0000 7f3389ffdb80 1 -- 172.21.15.49:0/4245425426 shutdown_connections 2024-06-02T23:59:31.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.907+0000 7f3389ffdb80 1 -- 172.21.15.49:0/4245425426 wait complete. 2024-06-02T23:59:31.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.907+0000 7f3389ffdb80 20 client.15006 trim_cache size 0 max 16384 2024-06-02T23:59:31.912 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-02T23:59:31.913 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "890dd222-213a-11ef-bc9b-c7b262605968", 2024-06-02T23:59:31.913 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 2, 2024-06-02T23:59:31.913 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 24466, 2024-06-02T23:59:31.913 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-06-02T23:59:31.913 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-06-02T23:59:31.913 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-06-02T23:59:31.913 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 121.466517384, 2024-06-02T23:59:31.913 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 26, 2024-06-02T23:59:31.913 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 90, 2024-06-02T23:59:31.913 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 88, 2024-06-02T23:59:31.913 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 164.49327332199999 2024-06-02T23:59:31.913 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-02T23:59:31.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.907+0000 7f337f77a700 1 -- 172.21.15.49:0/2973484704 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f33600a2ca0 msgr2=0x7f33600a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:31.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.908+0000 7f337f77a700 1 --2- 172.21.15.49:0/2973484704 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f33600a2ca0 0x7f33600a5160 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3378079c40 tx=0x7f336c005fb0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.908+0000 7f337f77a700 1 -- 172.21.15.49:0/2973484704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3378102530 msgr2=0x7f337819e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:31.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.908+0000 7f337f77a700 1 --2- 172.21.15.49:0/2973484704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3378102530 0x7f337819e850 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f336800ada0 tx=0x7f336800c330 comp rx=0 tx=0).stop 2024-06-02T23:59:31.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.908+0000 7f337f77a700 1 -- 172.21.15.49:0/2973484704 shutdown_connections 2024-06-02T23:59:31.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.908+0000 7f337f77a700 1 --2- 172.21.15.49:0/2973484704 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f33600a2ca0 0x7f33600a5160 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.908+0000 7f337f77a700 1 --2- 172.21.15.49:0/2973484704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33781085d0 0x7f3378198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.908+0000 7f337f77a700 1 --2- 172.21.15.49:0/2973484704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3378102530 0x7f337819e850 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.908+0000 7f337f77a700 1 --2- 172.21.15.49:0/2973484704 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3378102ef0 0x7f337819ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:31.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.908+0000 7f337f77a700 1 -- 172.21.15.49:0/2973484704 >> 172.21.15.49:0/2973484704 conn(0x7f3378079640 msgr2=0x7f3378101160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:31.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.908+0000 7f337f77a700 1 -- 172.21.15.49:0/2973484704 shutdown_connections 2024-06-02T23:59:31.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:31.908+0000 7f337f77a700 1 -- 172.21.15.49:0/2973484704 wait complete. 2024-06-02T23:59:32.589 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:32 smithi049 ceph-mon[32302]: pgmap v368: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:59:32.620 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.b status 2024-06-02T23:59:32.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:32 smithi107 ceph-mon[37048]: pgmap v368: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:59:32.884 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:59:32.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:32 smithi057 ceph-mon[36457]: pgmap v368: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:59:34.014 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:33 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:59:34.014 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:33 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:59:34.014 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:33 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:59:34.014 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:33 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:59:34.014 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:33 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:59:34.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:33 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:59:34.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:33 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:59:34.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:33 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:59:34.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:33 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:59:34.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:33 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:59:34.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:33 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:59:34.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:33 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:59:34.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:33 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T23:59:34.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:33 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T23:59:34.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:33 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-02T23:59:34.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.541+0000 7fccf9c5d700 1 -- 172.21.15.49:0/830755124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccf41024e0 msgr2=0x7fccf4102940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:34.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.541+0000 7fccf9c5d700 1 --2- 172.21.15.49:0/830755124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccf41024e0 0x7fccf4102940 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcce8009990 tx=0x7fcce8009ca0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.541+0000 7fccf9c5d700 1 -- 172.21.15.49:0/830755124 shutdown_connections 2024-06-02T23:59:34.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.541+0000 7fccf9c5d700 1 --2- 172.21.15.49:0/830755124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fccf4102e80 0x7fccf410f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.541+0000 7fccf9c5d700 1 --2- 172.21.15.49:0/830755124 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccf41084f0 0x7fccf41088d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.541+0000 7fccf9c5d700 1 --2- 172.21.15.49:0/830755124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccf41024e0 0x7fccf4102940 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.541+0000 7fccf9c5d700 1 -- 172.21.15.49:0/830755124 >> 172.21.15.49:0/830755124 conn(0x7fccf4079530 msgr2=0x7fccf4079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:34.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.541+0000 7fccf9c5d700 1 -- 172.21.15.49:0/830755124 shutdown_connections 2024-06-02T23:59:34.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.541+0000 7fccf9c5d700 1 -- 172.21.15.49:0/830755124 wait complete. 2024-06-02T23:59:34.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.541+0000 7fccf9c5d700 1 Processor -- start 2024-06-02T23:59:34.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.542+0000 7fccf9c5d700 1 -- start start 2024-06-02T23:59:34.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.542+0000 7fccf9c5d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccf41024e0 0x7fccf419e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:34.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.542+0000 7fccf9c5d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fccf4102e80 0x7fccf419ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:34.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.542+0000 7fccf9c5d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccf41084f0 0x7fccf4198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:34.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.542+0000 7fccf9c5d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fccf4112750 con 0x7fccf41084f0 2024-06-02T23:59:34.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.542+0000 7fccf9c5d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fccf41125d0 con 0x7fccf4102e80 2024-06-02T23:59:34.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.542+0000 7fccf9c5d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fccf41128d0 con 0x7fccf41024e0 2024-06-02T23:59:34.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.542+0000 7fccf3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccf41084f0 0x7fccf4198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:34.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.542+0000 7fccf3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccf41084f0 0x7fccf4198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38660/0 (socket says 172.21.15.49:38660) 2024-06-02T23:59:34.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.542+0000 7fccf3fff700 1 -- 172.21.15.49:0/3867864908 learned_addr learned my addr 172.21.15.49:0/3867864908 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:34.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.542+0000 7fccf2ffd700 1 --2- 172.21.15.49:0/3867864908 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fccf4102e80 0x7fccf419ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:34.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.542+0000 7fccf37fe700 1 --2- 172.21.15.49:0/3867864908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccf41024e0 0x7fccf419e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:34.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.542+0000 7fccf3fff700 1 -- 172.21.15.49:0/3867864908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccf41024e0 msgr2=0x7fccf419e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:34.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.542+0000 7fccf3fff700 1 --2- 172.21.15.49:0/3867864908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccf41024e0 0x7fccf419e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.542+0000 7fccf3fff700 1 -- 172.21.15.49:0/3867864908 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fccf4102e80 msgr2=0x7fccf419ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:34.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.542+0000 7fccf3fff700 1 --2- 172.21.15.49:0/3867864908 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fccf4102e80 0x7fccf419ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.542+0000 7fccf3fff700 1 -- 172.21.15.49:0/3867864908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf4199170 con 0x7fccf41084f0 2024-06-02T23:59:34.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.543+0000 7fccf3fff700 1 --2- 172.21.15.49:0/3867864908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccf41084f0 0x7fccf4198a10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fccec007ee0 tx=0x7fccec00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:34.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.543+0000 7fccf0ff9700 1 -- 172.21.15.49:0/3867864908 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec00ddd0 con 0x7fccf41084f0 2024-06-02T23:59:34.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.543+0000 7fccf9c5d700 1 -- 172.21.15.49:0/3867864908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccf4199460 con 0x7fccf41084f0 2024-06-02T23:59:34.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.543+0000 7fccf0ff9700 1 -- 172.21.15.49:0/3867864908 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fccec004020 con 0x7fccf41084f0 2024-06-02T23:59:34.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.543+0000 7fccf0ff9700 1 -- 172.21.15.49:0/3867864908 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec015660 con 0x7fccf41084f0 2024-06-02T23:59:34.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.543+0000 7fccf9c5d700 1 -- 172.21.15.49:0/3867864908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccf41a5720 con 0x7fccf41084f0 2024-06-02T23:59:34.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.545+0000 7fccf0ff9700 1 -- 172.21.15.49:0/3867864908 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fccec0041d0 con 0x7fccf41084f0 2024-06-02T23:59:34.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.546+0000 7fccf0ff9700 1 --2- 172.21.15.49:0/3867864908 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fccdc0a2c20 0x7fccdc0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:34.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.546+0000 7fccf37fe700 1 --2- 172.21.15.49:0/3867864908 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fccdc0a2c20 0x7fccdc0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:34.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.546+0000 7fccf0ff9700 1 -- 172.21.15.49:0/3867864908 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fccec0ceac0 con 0x7fccf41084f0 2024-06-02T23:59:34.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.547+0000 7fccf37fe700 1 --2- 172.21.15.49:0/3867864908 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fccdc0a2c20 0x7fccdc0a50e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fccf4199b50 tx=0x7fcce400b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:34.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.547+0000 7fcd044e0b80 1 Processor -- start 2024-06-02T23:59:34.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.547+0000 7fcd044e0b80 1 -- start start 2024-06-02T23:59:34.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.547+0000 7fcd044e0b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5653dc41af10 0x5653dc41b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:34.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.547+0000 7fcd044e0b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5653dc41b830 0x5653dc415210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:34.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.547+0000 7fcd044e0b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5653dc415750 0x5653dc415b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:34.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.547+0000 7fcd044e0b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5653dc307f10 con 0x5653dc41af10 2024-06-02T23:59:34.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.547+0000 7fcd044e0b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5653dc366800 con 0x5653dc415750 2024-06-02T23:59:34.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.547+0000 7fcd044e0b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5653dc2ce410 con 0x5653dc41b830 2024-06-02T23:59:34.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.547+0000 7fccf37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5653dc41af10 0x5653dc41b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:34.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.547+0000 7fccf37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5653dc41af10 0x5653dc41b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38666/0 (socket says 172.21.15.49:38666) 2024-06-02T23:59:34.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.547+0000 7fccf37fe700 1 -- 172.21.15.49:0/3870626631 learned_addr learned my addr 172.21.15.49:0/3870626631 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:34.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.547+0000 7fccf2ffd700 1 --2- 172.21.15.49:0/3870626631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5653dc41b830 0x5653dc415210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:34.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.548+0000 7fccf3fff700 1 --2- 172.21.15.49:0/3870626631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5653dc415750 0x5653dc415b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:34.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.548+0000 7fccf37fe700 1 -- 172.21.15.49:0/3870626631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5653dc41b830 msgr2=0x5653dc415210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:34.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.548+0000 7fccf37fe700 1 --2- 172.21.15.49:0/3870626631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5653dc41b830 0x5653dc415210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.548+0000 7fccf37fe700 1 -- 172.21.15.49:0/3870626631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5653dc415750 msgr2=0x5653dc415b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:34.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.548+0000 7fccf37fe700 1 --2- 172.21.15.49:0/3870626631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5653dc415750 0x5653dc415b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.548+0000 7fccf37fe700 1 -- 172.21.15.49:0/3870626631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653dc2b5880 con 0x5653dc41af10 2024-06-02T23:59:34.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.548+0000 7fccf3fff700 1 --2- 172.21.15.49:0/3870626631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5653dc415750 0x5653dc415b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:59:34.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.548+0000 7fccf37fe700 1 --2- 172.21.15.49:0/3870626631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5653dc41af10 0x5653dc41b2f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcce400fcc0 tx=0x7fcce4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec54e33940d39e07 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:34.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.548+0000 7fccd9ffb700 1 -- 172.21.15.49:0/3870626631 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce4022070 con 0x5653dc41af10 2024-06-02T23:59:34.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.548+0000 7fccd9ffb700 1 -- 172.21.15.49:0/3870626631 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcce401e450 con 0x5653dc41af10 2024-06-02T23:59:34.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.548+0000 7fccd9ffb700 1 -- 172.21.15.49:0/3870626631 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce401d610 con 0x5653dc41af10 2024-06-02T23:59:34.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.549+0000 7fcd044e0b80 1 -- 172.21.15.49:0/3870626631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5653dc41af10 msgr2=0x5653dc41b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:34.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.549+0000 7fcd044e0b80 1 --2- 172.21.15.49:0/3870626631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5653dc41af10 0x5653dc41b2f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcce400fcc0 tx=0x7fcce4012000 comp rx=0 tx=0).stop 2024-06-02T23:59:34.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.549+0000 7fcd044e0b80 1 -- 172.21.15.49:0/3870626631 shutdown_connections 2024-06-02T23:59:34.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.549+0000 7fcd044e0b80 1 --2- 172.21.15.49:0/3870626631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5653dc415750 0x5653dc415b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.549+0000 7fcd044e0b80 1 --2- 172.21.15.49:0/3870626631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5653dc41af10 0x5653dc41b2f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.549+0000 7fcd044e0b80 1 --2- 172.21.15.49:0/3870626631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5653dc41b830 0x5653dc415210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.549+0000 7fcd044e0b80 1 -- 172.21.15.49:0/3870626631 >> 172.21.15.49:0/3870626631 conn(0x5653dc342030 msgr2=0x5653dc4101d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:34.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.549+0000 7fcd044e0b80 1 -- 172.21.15.49:0/3870626631 shutdown_connections 2024-06-02T23:59:34.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.549+0000 7fcd044e0b80 1 -- 172.21.15.49:0/3870626631 wait complete. 2024-06-02T23:59:34.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.549+0000 7fcd044e0b80 1 -- start start 2024-06-02T23:59:34.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.549+0000 7fcd044e0b80 1 Processor -- start 2024-06-02T23:59:34.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.550+0000 7fcd044e0b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5653dc415750 0x5653dc421530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:34.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.550+0000 7fcd044e0b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5653dc41af10 0x5653dc41e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:34.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.550+0000 7fcd044e0b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5653dc41b830 0x5653dc41ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:34.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.550+0000 7fcd044e0b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5653dc306f70 con 0x5653dc41af10 2024-06-02T23:59:34.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.550+0000 7fcd044e0b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5653dc3627c0 con 0x5653dc415750 2024-06-02T23:59:34.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.550+0000 7fcd044e0b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5653dc422210 con 0x5653dc41b830 2024-06-02T23:59:34.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.550+0000 7fcd044e0b80 10 client.0 _ll_register_callbacks cb 0x5653dc2fc560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T23:59:34.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.550+0000 7fccf2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5653dc41af10 0x5653dc41e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:34.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.550+0000 7fccf37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5653dc415750 0x5653dc421530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:34.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.550+0000 7fccf2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5653dc41af10 0x5653dc41e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38678/0 (socket says 172.21.15.49:38678) 2024-06-02T23:59:34.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.550+0000 7fccf2ffd700 1 -- 172.21.15.49:0/2891833734 learned_addr learned my addr 172.21.15.49:0/2891833734 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:34.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.550+0000 7fccf3fff700 1 --2- 172.21.15.49:0/2891833734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5653dc41b830 0x5653dc41ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:34.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.550+0000 7fccf2ffd700 1 -- 172.21.15.49:0/2891833734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5653dc41b830 msgr2=0x5653dc41ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:34.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.550+0000 7fccf2ffd700 1 --2- 172.21.15.49:0/2891833734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5653dc41b830 0x5653dc41ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.550+0000 7fccf2ffd700 1 -- 172.21.15.49:0/2891833734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5653dc415750 msgr2=0x5653dc421530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:34.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.550+0000 7fccf2ffd700 1 --2- 172.21.15.49:0/2891833734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5653dc415750 0x5653dc421530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.550+0000 7fccf2ffd700 1 -- 172.21.15.49:0/2891833734 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653dc32c700 con 0x5653dc41af10 2024-06-02T23:59:34.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.551+0000 7fccf2ffd700 1 --2- 172.21.15.49:0/2891833734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5653dc41af10 0x5653dc41e830 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcce8000c00 tx=0x7fcce800bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4537c4e58c1e6f2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:34.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.551+0000 7fccd2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-02T23:59:34.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.551+0000 7fccd2ffd700 1 -- 172.21.15.49:0/2891833734 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce8029060 con 0x5653dc41af10 2024-06-02T23:59:34.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.551+0000 7fccd2ffd700 1 -- 172.21.15.49:0/2891833734 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fcce8003b60 con 0x5653dc41af10 2024-06-02T23:59:34.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.551+0000 7fcd044e0b80 1 -- 172.21.15.49:0/2891833734 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcce401e450 con 0x5653dc41af10 2024-06-02T23:59:34.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.551+0000 7fccd2ffd700 1 -- 172.21.15.49:0/2891833734 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fcce8003d60 con 0x5653dc41af10 2024-06-02T23:59:34.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.551+0000 7fcd044e0b80 10 client.15018 fetch_fsmap learned FSMap version 26 2024-06-02T23:59:34.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.551+0000 7fcd044e0b80 1 -- 172.21.15.49:0/2891833734 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5653dc42c950 con 0x5653dc41af10 2024-06-02T23:59:34.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.551+0000 7fccd2ffd700 1 -- 172.21.15.49:0/2891833734 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcce401e450 con 0x5653dc41af10 2024-06-02T23:59:34.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.551+0000 7fccd2ffd700 1 -- 172.21.15.49:0/2891833734 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fcce802e070 con 0x5653dc41af10 2024-06-02T23:59:34.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.551+0000 7fcd044e0b80 10 client.15018 fetch_fsmap finished waiting for FSMap version 26 2024-06-02T23:59:34.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.551+0000 7fcd044e0b80 10 client.15018 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-02T23:59:34.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.551+0000 7fcd044e0b80 20 client.15018 populate_metadata read hostname 'smithi049' 2024-06-02T23:59:34.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.551+0000 7fcd044e0b80 1 --2- 172.21.15.49:0/2891833734 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x5653dc42ef70 0x5653dc4303e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:34.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.551+0000 7fcd044e0b80 4 client.15018 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T23:59:34.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.551+0000 7fcd044e0b80 1 -- 172.21.15.49:0/2891833734 --> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653dc373d00 con 0x5653dc42ef70 2024-06-02T23:59:34.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.552+0000 7fccf37fe700 1 --2- 172.21.15.49:0/2891833734 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x5653dc42ef70 0x5653dc4303e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:34.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.552+0000 7fccf37fe700 1 --2- 172.21.15.49:0/2891833734 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x5653dc42ef70 0x5653dc4303e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=de8f157c8d5ea1ea server_cookie=8aa80bc7929cd7f0 in_seq=0 out_seq=0 2024-06-02T23:59:34.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.552+0000 7fccd2ffd700 10 client.15018 ms_handle_connect on v2:172.21.15.57:6838/249825195 2024-06-02T23:59:34.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.553+0000 7fccd2ffd700 1 -- 172.21.15.49:0/2891833734 <== mds.1 v2:172.21.15.57:6838/249825195 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5653dc373d00 con 0x5653dc42ef70 2024-06-02T23:59:34.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.553+0000 7fccd2ffd700 10 client.15018 handle_command_reply: tid=0 2024-06-02T23:59:34.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.553+0000 7fcd044e0b80 1 client.15018 shutdown 2024-06-02T23:59:34.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.553+0000 7fcd044e0b80 1 -- 172.21.15.49:0/2891833734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5653dc41af10 msgr2=0x5653dc41e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:34.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.553+0000 7fcd044e0b80 1 --2- 172.21.15.49:0/2891833734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5653dc41af10 0x5653dc41e830 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcce8000c00 tx=0x7fcce800bfb0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.553+0000 7fcd044e0b80 1 -- 172.21.15.49:0/2891833734 shutdown_connections 2024-06-02T23:59:34.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.553+0000 7fcd044e0b80 1 --2- 172.21.15.49:0/2891833734 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x5653dc42ef70 0x5653dc4303e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.553+0000 7fcd044e0b80 1 --2- 172.21.15.49:0/2891833734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5653dc41b830 0x5653dc41ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.553+0000 7fcd044e0b80 1 --2- 172.21.15.49:0/2891833734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5653dc415750 0x5653dc421530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.553+0000 7fcd044e0b80 1 --2- 172.21.15.49:0/2891833734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5653dc41af10 0x5653dc41e830 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.553+0000 7fcd044e0b80 1 -- 172.21.15.49:0/2891833734 >> 172.21.15.49:0/2891833734 conn(0x5653dc342030 msgr2=0x5653dc40f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:34.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.553+0000 7fccd2ffd700 0 client.15018 ms_handle_reset on v2:172.21.15.57:6838/249825195 2024-06-02T23:59:34.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.554+0000 7fcd044e0b80 1 -- 172.21.15.49:0/2891833734 shutdown_connections 2024-06-02T23:59:34.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.554+0000 7fcd044e0b80 1 -- 172.21.15.49:0/2891833734 wait complete. 2024-06-02T23:59:34.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.554+0000 7fcd044e0b80 20 client.15018 trim_cache size 0 max 16384 2024-06-02T23:59:34.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.575+0000 7fcd044e0b80 1 Processor -- start 2024-06-02T23:59:34.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.575+0000 7fcd044e0b80 1 -- start start 2024-06-02T23:59:34.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.576+0000 7fcd044e0b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5653dc415750 0x5653dc41c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:34.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.576+0000 7fcd044e0b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5653dc41af10 0x5653dc40fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:34.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.576+0000 7fcd044e0b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5653dc41b830 0x5653dc410370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:34.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.576+0000 7fcd044e0b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5653dc42e720 con 0x5653dc41b830 2024-06-02T23:59:34.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.576+0000 7fcd044e0b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5653dc42edf0 con 0x5653dc41af10 2024-06-02T23:59:34.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.576+0000 7fcd044e0b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5653dc42f4c0 con 0x5653dc415750 2024-06-02T23:59:34.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.576+0000 7fccf3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5653dc41b830 0x5653dc410370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:34.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.576+0000 7fccf3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5653dc41b830 0x5653dc410370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38692/0 (socket says 172.21.15.49:38692) 2024-06-02T23:59:34.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.576+0000 7fccf3fff700 1 -- 172.21.15.49:0/100330550 learned_addr learned my addr 172.21.15.49:0/100330550 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:34.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.576+0000 7fccf37fe700 1 --2- 172.21.15.49:0/100330550 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5653dc415750 0x5653dc41c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:34.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.576+0000 7fccf2ffd700 1 --2- 172.21.15.49:0/100330550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5653dc41af10 0x5653dc40fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:34.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.576+0000 7fccf3fff700 1 -- 172.21.15.49:0/100330550 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5653dc415750 msgr2=0x5653dc41c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:34.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.576+0000 7fccf3fff700 1 --2- 172.21.15.49:0/100330550 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5653dc415750 0x5653dc41c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.576+0000 7fccf3fff700 1 -- 172.21.15.49:0/100330550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5653dc41af10 msgr2=0x5653dc40fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:34.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.576+0000 7fccf3fff700 1 --2- 172.21.15.49:0/100330550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5653dc41af10 0x5653dc40fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.576+0000 7fccf3fff700 1 -- 172.21.15.49:0/100330550 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653dc41cda0 con 0x5653dc41b830 2024-06-02T23:59:34.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.576+0000 7fccf2ffd700 1 --2- 172.21.15.49:0/100330550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5653dc41af10 0x5653dc40fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:59:34.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.576+0000 7fccf3fff700 1 --2- 172.21.15.49:0/100330550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5653dc41b830 0x5653dc410370 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fccec0a3a20 tx=0x7fccec09af30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3be89d2359df809 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:34.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.576+0000 7fccd97fa700 1 -- 172.21.15.49:0/100330550 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec0a3f50 con 0x5653dc41b830 2024-06-02T23:59:34.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.577+0000 7fccd97fa700 1 -- 172.21.15.49:0/100330550 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fccec095e50 con 0x5653dc41b830 2024-06-02T23:59:34.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.577+0000 7fccd97fa700 1 -- 172.21.15.49:0/100330550 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec004bd0 con 0x5653dc41b830 2024-06-02T23:59:34.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.577+0000 7fcd044e0b80 1 -- 172.21.15.49:0/100330550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5653dc41b830 msgr2=0x5653dc410370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:34.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.577+0000 7fcd044e0b80 1 --2- 172.21.15.49:0/100330550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5653dc41b830 0x5653dc410370 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fccec0a3a20 tx=0x7fccec09af30 comp rx=0 tx=0).stop 2024-06-02T23:59:34.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.577+0000 7fcd044e0b80 1 -- 172.21.15.49:0/100330550 shutdown_connections 2024-06-02T23:59:34.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.577+0000 7fcd044e0b80 1 --2- 172.21.15.49:0/100330550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5653dc41b830 0x5653dc410370 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.577+0000 7fcd044e0b80 1 --2- 172.21.15.49:0/100330550 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5653dc415750 0x5653dc41c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.577+0000 7fcd044e0b80 1 --2- 172.21.15.49:0/100330550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5653dc41af10 0x5653dc40fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.577+0000 7fcd044e0b80 1 -- 172.21.15.49:0/100330550 >> 172.21.15.49:0/100330550 conn(0x5653dc342030 msgr2=0x5653dc41bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:34.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.577+0000 7fcd044e0b80 1 -- 172.21.15.49:0/100330550 shutdown_connections 2024-06-02T23:59:34.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.577+0000 7fcd044e0b80 1 -- 172.21.15.49:0/100330550 wait complete. 2024-06-02T23:59:34.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.577+0000 7fcd044e0b80 1 -- start start 2024-06-02T23:59:34.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.578+0000 7fcd044e0b80 1 Processor -- start 2024-06-02T23:59:34.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.578+0000 7fcd044e0b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5653dc415750 0x5653dc439860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:34.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.578+0000 7fcd044e0b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5653dc41af10 0x5653dc439da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:34.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.578+0000 7fcd044e0b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5653dc41b830 0x5653dc434810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:34.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.578+0000 7fcd044e0b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5653dc430260 con 0x5653dc41af10 2024-06-02T23:59:34.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.578+0000 7fcd044e0b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5653dc42fb90 con 0x5653dc415750 2024-06-02T23:59:34.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.578+0000 7fcd044e0b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5653dc430930 con 0x5653dc41b830 2024-06-02T23:59:34.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.578+0000 7fcd044e0b80 10 client.0 _ll_register_callbacks cb 0x5653dc2fc560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T23:59:34.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.578+0000 7fccf2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5653dc41af10 0x5653dc439da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:34.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.578+0000 7fccf2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5653dc41af10 0x5653dc439da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38696/0 (socket says 172.21.15.49:38696) 2024-06-02T23:59:34.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.578+0000 7fccf2ffd700 1 -- 172.21.15.49:0/1580302518 learned_addr learned my addr 172.21.15.49:0/1580302518 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:34.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.578+0000 7fccf3fff700 1 --2- 172.21.15.49:0/1580302518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5653dc41b830 0x5653dc434810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:34.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.578+0000 7fccf37fe700 1 --2- 172.21.15.49:0/1580302518 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5653dc415750 0x5653dc439860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:34.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.578+0000 7fccf2ffd700 1 -- 172.21.15.49:0/1580302518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5653dc41b830 msgr2=0x5653dc434810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:34.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.578+0000 7fccf2ffd700 1 --2- 172.21.15.49:0/1580302518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5653dc41b830 0x5653dc434810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.578+0000 7fccf2ffd700 1 -- 172.21.15.49:0/1580302518 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5653dc415750 msgr2=0x5653dc439860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:34.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.578+0000 7fccf2ffd700 1 --2- 172.21.15.49:0/1580302518 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5653dc415750 0x5653dc439860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.578+0000 7fccf2ffd700 1 -- 172.21.15.49:0/1580302518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653dc434d50 con 0x5653dc41af10 2024-06-02T23:59:34.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.578+0000 7fccf37fe700 1 --2- 172.21.15.49:0/1580302518 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5653dc415750 0x5653dc439860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:59:34.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.578+0000 7fccf3fff700 1 --2- 172.21.15.49:0/1580302518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5653dc41b830 0x5653dc434810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:59:34.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.579+0000 7fccf2ffd700 1 --2- 172.21.15.49:0/1580302518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5653dc41af10 0x5653dc439da0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcce8009ce0 tx=0x7fcce8009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef35974991ec1f40 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:34.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.579+0000 7fccd2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-02T23:59:34.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.579+0000 7fccd2ffd700 1 -- 172.21.15.49:0/1580302518 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce8034030 con 0x5653dc41af10 2024-06-02T23:59:34.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.579+0000 7fccd2ffd700 1 -- 172.21.15.49:0/1580302518 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fcce800f730 con 0x5653dc41af10 2024-06-02T23:59:34.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.579+0000 7fcd044e0b80 1 -- 172.21.15.49:0/1580302518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccec095e50 con 0x5653dc41af10 2024-06-02T23:59:34.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.579+0000 7fccd2ffd700 1 -- 172.21.15.49:0/1580302518 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fcce8029070 con 0x5653dc41af10 2024-06-02T23:59:34.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.579+0000 7fcd044e0b80 10 client.15024 fetch_fsmap learned FSMap version 26 2024-06-02T23:59:34.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.579+0000 7fcd044e0b80 1 -- 172.21.15.49:0/1580302518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5653dc49af50 con 0x5653dc41af10 2024-06-02T23:59:34.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.579+0000 7fccd2ffd700 1 -- 172.21.15.49:0/1580302518 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fccec095e50 con 0x5653dc41af10 2024-06-02T23:59:34.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.579+0000 7fccd2ffd700 1 -- 172.21.15.49:0/1580302518 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fcce802e040 con 0x5653dc41af10 2024-06-02T23:59:34.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.579+0000 7fcd044e0b80 10 client.15024 fetch_fsmap finished waiting for FSMap version 26 2024-06-02T23:59:34.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.579+0000 7fcd044e0b80 10 client.15024 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-02T23:59:34.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.579+0000 7fcd044e0b80 20 client.15024 populate_metadata read hostname 'smithi049' 2024-06-02T23:59:34.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.580+0000 7fcd044e0b80 1 --2- 172.21.15.49:0/1580302518 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x5653dc49fb40 0x5653dc49e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:34.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.580+0000 7fcd044e0b80 4 client.15024 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T23:59:34.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.580+0000 7fcd044e0b80 1 -- 172.21.15.49:0/1580302518 --> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] -- command(tid 0: {"prefix": "status"}) -- 0x5653dc36e280 con 0x5653dc49fb40 2024-06-02T23:59:34.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.580+0000 7fccf37fe700 1 --2- 172.21.15.49:0/1580302518 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x5653dc49fb40 0x5653dc49e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:34.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.580+0000 7fccf37fe700 1 --2- 172.21.15.49:0/1580302518 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x5653dc49fb40 0x5653dc49e850 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e1e0b95a49d25bd8 server_cookie=37d17320d075e718 in_seq=0 out_seq=0 2024-06-02T23:59:34.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.580+0000 7fccd2ffd700 10 client.15024 ms_handle_connect on v2:172.21.15.57:6838/249825195 2024-06-02T23:59:34.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.580+0000 7fccd2ffd700 1 -- 172.21.15.49:0/1580302518 <== mds.1 v2:172.21.15.57:6838/249825195 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5653dc36e280 con 0x5653dc49fb40 2024-06-02T23:59:34.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.580+0000 7fccd2ffd700 10 client.15024 handle_command_reply: tid=0 2024-06-02T23:59:34.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.580+0000 7fcd044e0b80 1 client.15024 shutdown 2024-06-02T23:59:34.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.581+0000 7fcd044e0b80 1 -- 172.21.15.49:0/1580302518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5653dc41af10 msgr2=0x5653dc439da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:34.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.581+0000 7fcd044e0b80 1 --2- 172.21.15.49:0/1580302518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5653dc41af10 0x5653dc439da0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcce8009ce0 tx=0x7fcce8009290 comp rx=0 tx=0).stop 2024-06-02T23:59:34.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.581+0000 7fcd044e0b80 1 -- 172.21.15.49:0/1580302518 shutdown_connections 2024-06-02T23:59:34.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.581+0000 7fcd044e0b80 1 --2- 172.21.15.49:0/1580302518 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x5653dc49fb40 0x5653dc49e850 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.581+0000 7fcd044e0b80 1 --2- 172.21.15.49:0/1580302518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5653dc41b830 0x5653dc434810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.581+0000 7fcd044e0b80 1 --2- 172.21.15.49:0/1580302518 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5653dc415750 0x5653dc439860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.581+0000 7fccd2ffd700 0 client.15024 ms_handle_reset on v2:172.21.15.57:6838/249825195 2024-06-02T23:59:34.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.581+0000 7fcd044e0b80 1 --2- 172.21.15.49:0/1580302518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5653dc41af10 0x5653dc439da0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.581+0000 7fcd044e0b80 1 -- 172.21.15.49:0/1580302518 >> 172.21.15.49:0/1580302518 conn(0x5653dc342030 msgr2=0x5653dc420060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:34.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.581+0000 7fcd044e0b80 1 -- 172.21.15.49:0/1580302518 shutdown_connections 2024-06-02T23:59:34.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.581+0000 7fcd044e0b80 1 -- 172.21.15.49:0/1580302518 wait complete. 2024-06-02T23:59:34.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.581+0000 7fcd044e0b80 20 client.15024 trim_cache size 0 max 16384 2024-06-02T23:59:34.587 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-02T23:59:34.588 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "890dd222-213a-11ef-bc9b-c7b262605968", 2024-06-02T23:59:34.588 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 1, 2024-06-02T23:59:34.588 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 24485, 2024-06-02T23:59:34.588 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-06-02T23:59:34.588 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-06-02T23:59:34.588 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-06-02T23:59:34.588 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 125.143314946, 2024-06-02T23:59:34.588 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 26, 2024-06-02T23:59:34.588 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 90, 2024-06-02T23:59:34.588 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 88, 2024-06-02T23:59:34.588 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 152.26206230899999 2024-06-02T23:59:34.588 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-02T23:59:34.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.581+0000 7fccf9c5d700 1 -- 172.21.15.49:0/3867864908 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fccdc0a2c20 msgr2=0x7fccdc0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:34.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.581+0000 7fccf9c5d700 1 --2- 172.21.15.49:0/3867864908 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fccdc0a2c20 0x7fccdc0a50e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fccf4199b50 tx=0x7fcce400b5b0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.581+0000 7fccf9c5d700 1 -- 172.21.15.49:0/3867864908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccf41084f0 msgr2=0x7fccf4198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:34.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.581+0000 7fccf9c5d700 1 --2- 172.21.15.49:0/3867864908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccf41084f0 0x7fccf4198a10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fccec007ee0 tx=0x7fccec00d3b0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.581+0000 7fccf9c5d700 1 -- 172.21.15.49:0/3867864908 shutdown_connections 2024-06-02T23:59:34.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.581+0000 7fccf9c5d700 1 --2- 172.21.15.49:0/3867864908 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fccdc0a2c20 0x7fccdc0a50e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.581+0000 7fccf9c5d700 1 --2- 172.21.15.49:0/3867864908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccf41084f0 0x7fccf4198a10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.581+0000 7fccf9c5d700 1 --2- 172.21.15.49:0/3867864908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccf41024e0 0x7fccf419e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.581+0000 7fccf9c5d700 1 --2- 172.21.15.49:0/3867864908 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fccf4102e80 0x7fccf419ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:34.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.581+0000 7fccf9c5d700 1 -- 172.21.15.49:0/3867864908 >> 172.21.15.49:0/3867864908 conn(0x7fccf4079530 msgr2=0x7fccf4100590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:34.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.582+0000 7fccf9c5d700 1 -- 172.21.15.49:0/3867864908 shutdown_connections 2024-06-02T23:59:34.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:34.582+0000 7fccf9c5d700 1 -- 172.21.15.49:0/3867864908 wait complete. 2024-06-02T23:59:35.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:34 smithi057 ceph-mon[36457]: pgmap v369: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-02T23:59:35.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:34 smithi049 ceph-mon[32302]: pgmap v369: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-02T23:59:35.326 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.i status 2024-06-02T23:59:35.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:34 smithi107 ceph-mon[37048]: pgmap v369: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-02T23:59:35.577 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:59:36.970 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:36 smithi049 ceph-mon[32302]: pgmap v370: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-06-02T23:59:37.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.192+0000 7f3a26382700 1 -- 172.21.15.49:0/2347642367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a20108570 msgr2=0x7f3a20108950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:37.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.192+0000 7f3a26382700 1 --2- 172.21.15.49:0/2347642367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a20108570 0x7f3a20108950 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3a10009990 tx=0x7f3a10009ca0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.192+0000 7f3a26382700 1 -- 172.21.15.49:0/2347642367 shutdown_connections 2024-06-02T23:59:37.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.192+0000 7f3a26382700 1 --2- 172.21.15.49:0/2347642367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a2006b5c0 0x7f3a2010f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.192+0000 7f3a26382700 1 --2- 172.21.15.49:0/2347642367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a20108570 0x7f3a20108950 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.192+0000 7f3a26382700 1 --2- 172.21.15.49:0/2347642367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a2006ac00 0x7f3a2006b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.192+0000 7f3a26382700 1 -- 172.21.15.49:0/2347642367 >> 172.21.15.49:0/2347642367 conn(0x7f3a200773e0 msgr2=0x7f3a200777f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:37.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.192+0000 7f3a26382700 1 -- 172.21.15.49:0/2347642367 shutdown_connections 2024-06-02T23:59:37.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.192+0000 7f3a26382700 1 -- 172.21.15.49:0/2347642367 wait complete. 2024-06-02T23:59:37.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.192+0000 7f3a26382700 1 Processor -- start 2024-06-02T23:59:37.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.192+0000 7f3a26382700 1 -- start start 2024-06-02T23:59:37.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.193+0000 7f3a26382700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a2006ac00 0x7f3a201014f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:37.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.193+0000 7f3a26382700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a2006b5c0 0x7f3a20101a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:37.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.193+0000 7f3a26382700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a20108570 0x7f3a20101f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:37.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.193+0000 7f3a26382700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3a20112810 con 0x7f3a2006b5c0 2024-06-02T23:59:37.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.193+0000 7f3a26382700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3a20112690 con 0x7f3a2006ac00 2024-06-02T23:59:37.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.193+0000 7f3a26382700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3a20112990 con 0x7f3a20108570 2024-06-02T23:59:37.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.193+0000 7f3a1f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a2006b5c0 0x7f3a20101a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:37.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.193+0000 7f3a1f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a2006b5c0 0x7f3a20101a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38710/0 (socket says 172.21.15.49:38710) 2024-06-02T23:59:37.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.193+0000 7f3a1f7fe700 1 -- 172.21.15.49:0/55964052 learned_addr learned my addr 172.21.15.49:0/55964052 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:37.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.193+0000 7f3a1ffff700 1 --2- 172.21.15.49:0/55964052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a2006ac00 0x7f3a201014f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:37.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.193+0000 7f3a2491f700 1 --2- 172.21.15.49:0/55964052 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a20108570 0x7f3a20101f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:37.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.193+0000 7f3a1f7fe700 1 -- 172.21.15.49:0/55964052 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a20108570 msgr2=0x7f3a20101f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:37.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.193+0000 7f3a1f7fe700 1 --2- 172.21.15.49:0/55964052 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a20108570 0x7f3a20101f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.193+0000 7f3a1f7fe700 1 -- 172.21.15.49:0/55964052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a2006ac00 msgr2=0x7f3a201014f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:37.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.193+0000 7f3a1f7fe700 1 --2- 172.21.15.49:0/55964052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a2006ac00 0x7f3a201014f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.193+0000 7f3a1f7fe700 1 -- 172.21.15.49:0/55964052 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a201a7150 con 0x7f3a2006b5c0 2024-06-02T23:59:37.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.193+0000 7f3a1ffff700 1 --2- 172.21.15.49:0/55964052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a2006ac00 0x7f3a201014f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:59:37.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.193+0000 7f3a2491f700 1 --2- 172.21.15.49:0/55964052 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a20108570 0x7f3a20101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:59:37.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.193+0000 7f3a1f7fe700 1 --2- 172.21.15.49:0/55964052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a2006b5c0 0x7f3a20101a30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400c920 tx=0x7f3a1400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:37.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.194+0000 7f3a1d7fa700 1 -- 172.21.15.49:0/55964052 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a14007b00 con 0x7f3a2006b5c0 2024-06-02T23:59:37.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.194+0000 7f3a26382700 1 -- 172.21.15.49:0/55964052 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a201a7440 con 0x7f3a2006b5c0 2024-06-02T23:59:37.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.194+0000 7f3a1d7fa700 1 -- 172.21.15.49:0/55964052 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a14004d10 con 0x7f3a2006b5c0 2024-06-02T23:59:37.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.194+0000 7f3a1d7fa700 1 -- 172.21.15.49:0/55964052 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a140056e0 con 0x7f3a2006b5c0 2024-06-02T23:59:37.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.194+0000 7f3a26382700 1 -- 172.21.15.49:0/55964052 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a201a7980 con 0x7f3a2006b5c0 2024-06-02T23:59:37.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.196+0000 7f3a1d7fa700 1 -- 172.21.15.49:0/55964052 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3a14007ca0 con 0x7f3a2006b5c0 2024-06-02T23:59:37.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.197+0000 7f3a1d7fa700 1 --2- 172.21.15.49:0/55964052 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3a080a2c20 0x7f3a080a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:37.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.197+0000 7f3a1ffff700 1 --2- 172.21.15.49:0/55964052 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3a080a2c20 0x7f3a080a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:37.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.197+0000 7f3a1d7fa700 1 -- 172.21.15.49:0/55964052 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f3a140cecb0 con 0x7f3a2006b5c0 2024-06-02T23:59:37.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.197+0000 7f3a1ffff700 1 --2- 172.21.15.49:0/55964052 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3a080a2c20 0x7f3a080a50e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000b5c0 tx=0x7f3a10005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:37.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.197+0000 7f3a30c05b80 1 Processor -- start 2024-06-02T23:59:37.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.197+0000 7f3a30c05b80 1 -- start start 2024-06-02T23:59:37.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.198+0000 7f3a30c05b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599c0001f10 0x5599c00022f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:37.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.198+0000 7f3a30c05b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5599c0002830 0x5599bfffc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:37.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.198+0000 7f3a30c05b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5599bfffc750 0x5599bfffcb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:37.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.198+0000 7f3a30c05b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5599bfeeef10 con 0x5599c0001f10 2024-06-02T23:59:37.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.198+0000 7f3a30c05b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5599bff4d800 con 0x5599bfffc750 2024-06-02T23:59:37.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.198+0000 7f3a30c05b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5599bfeb5410 con 0x5599c0002830 2024-06-02T23:59:37.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.198+0000 7f3a1ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599c0001f10 0x5599c00022f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:37.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.198+0000 7f3a1ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599c0001f10 0x5599c00022f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38712/0 (socket says 172.21.15.49:38712) 2024-06-02T23:59:37.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.198+0000 7f3a1ffff700 1 -- 172.21.15.49:0/1405893757 learned_addr learned my addr 172.21.15.49:0/1405893757 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:37.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.198+0000 7f3a1f7fe700 1 --2- 172.21.15.49:0/1405893757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5599c0002830 0x5599bfffc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:37.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.198+0000 7f3a2491f700 1 --2- 172.21.15.49:0/1405893757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5599bfffc750 0x5599bfffcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:37.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.198+0000 7f3a1ffff700 1 -- 172.21.15.49:0/1405893757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5599c0002830 msgr2=0x5599bfffc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:37.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.198+0000 7f3a1ffff700 1 --2- 172.21.15.49:0/1405893757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5599c0002830 0x5599bfffc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.198+0000 7f3a1ffff700 1 -- 172.21.15.49:0/1405893757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5599bfffc750 msgr2=0x5599bfffcb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:37.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.198+0000 7f3a1ffff700 1 --2- 172.21.15.49:0/1405893757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5599bfffc750 0x5599bfffcb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.198+0000 7f3a1ffff700 1 -- 172.21.15.49:0/1405893757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599bfe9c880 con 0x5599c0001f10 2024-06-02T23:59:37.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.198+0000 7f3a2491f700 1 --2- 172.21.15.49:0/1405893757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5599bfffc750 0x5599bfffcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:59:37.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.198+0000 7f3a1ffff700 1 --2- 172.21.15.49:0/1405893757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599c0001f10 0x5599c00022f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000ba60 tx=0x7f3a1001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d7ff80042f137a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:37.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.198+0000 7f3a067fc700 1 -- 172.21.15.49:0/1405893757 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1000bea0 con 0x5599c0001f10 2024-06-02T23:59:37.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.198+0000 7f3a067fc700 1 -- 172.21.15.49:0/1405893757 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a10003e40 con 0x5599c0001f10 2024-06-02T23:59:37.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.198+0000 7f3a067fc700 1 -- 172.21.15.49:0/1405893757 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1000f780 con 0x5599c0001f10 2024-06-02T23:59:37.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:36 smithi057 ceph-mon[36457]: pgmap v370: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-06-02T23:59:37.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.199+0000 7f3a30c05b80 1 -- 172.21.15.49:0/1405893757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599c0001f10 msgr2=0x5599c00022f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:37.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.199+0000 7f3a30c05b80 1 --2- 172.21.15.49:0/1405893757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599c0001f10 0x5599c00022f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000ba60 tx=0x7f3a1001f000 comp rx=0 tx=0).stop 2024-06-02T23:59:37.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.199+0000 7f3a30c05b80 1 -- 172.21.15.49:0/1405893757 shutdown_connections 2024-06-02T23:59:37.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.199+0000 7f3a30c05b80 1 --2- 172.21.15.49:0/1405893757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5599bfffc750 0x5599bfffcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.199+0000 7f3a30c05b80 1 --2- 172.21.15.49:0/1405893757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599c0001f10 0x5599c00022f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.199+0000 7f3a30c05b80 1 --2- 172.21.15.49:0/1405893757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5599c0002830 0x5599bfffc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.199+0000 7f3a30c05b80 1 -- 172.21.15.49:0/1405893757 >> 172.21.15.49:0/1405893757 conn(0x5599bff29030 msgr2=0x5599bfff71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:37.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.199+0000 7f3a30c05b80 1 -- 172.21.15.49:0/1405893757 shutdown_connections 2024-06-02T23:59:37.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.199+0000 7f3a30c05b80 1 -- 172.21.15.49:0/1405893757 wait complete. 2024-06-02T23:59:37.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.200+0000 7f3a30c05b80 1 -- start start 2024-06-02T23:59:37.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.200+0000 7f3a30c05b80 1 Processor -- start 2024-06-02T23:59:37.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.200+0000 7f3a30c05b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5599bfffc750 0x5599c0008570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:37.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.200+0000 7f3a30c05b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599c0001f10 0x5599c0005870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:37.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.200+0000 7f3a30c05b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5599c0002830 0x5599c0005db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:37.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.200+0000 7f3a30c05b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5599bfeedf70 con 0x5599c0001f10 2024-06-02T23:59:37.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.200+0000 7f3a30c05b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5599bff497c0 con 0x5599bfffc750 2024-06-02T23:59:37.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.200+0000 7f3a30c05b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5599c00091b0 con 0x5599c0002830 2024-06-02T23:59:37.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.200+0000 7f3a30c05b80 10 client.0 _ll_register_callbacks cb 0x5599bfee3560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T23:59:37.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.200+0000 7f3a1f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599c0001f10 0x5599c0005870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:37.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.200+0000 7f3a1f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599c0001f10 0x5599c0005870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38716/0 (socket says 172.21.15.49:38716) 2024-06-02T23:59:37.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.200+0000 7f3a1f7fe700 1 -- 172.21.15.49:0/3118026307 learned_addr learned my addr 172.21.15.49:0/3118026307 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:37.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.200+0000 7f3a1ffff700 1 --2- 172.21.15.49:0/3118026307 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5599bfffc750 0x5599c0008570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:37.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.201+0000 7f3a1f7fe700 1 -- 172.21.15.49:0/3118026307 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5599c0002830 msgr2=0x5599c0005db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:37.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.201+0000 7f3a2491f700 1 --2- 172.21.15.49:0/3118026307 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5599c0002830 0x5599c0005db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:37.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.201+0000 7f3a1f7fe700 1 --2- 172.21.15.49:0/3118026307 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5599c0002830 0x5599c0005db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.201+0000 7f3a1f7fe700 1 -- 172.21.15.49:0/3118026307 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5599bfffc750 msgr2=0x5599c0008570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:37.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.201+0000 7f3a1f7fe700 1 --2- 172.21.15.49:0/3118026307 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5599bfffc750 0x5599c0008570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.201+0000 7f3a1f7fe700 1 -- 172.21.15.49:0/3118026307 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599bff13700 con 0x5599c0001f10 2024-06-02T23:59:37.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.201+0000 7f3a1f7fe700 1 --2- 172.21.15.49:0/3118026307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599c0001f10 0x5599c0005870 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400c8f0 tx=0x7f3a1409b120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75125c963cb18756 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:37.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.201+0000 7f39ff7fe700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-02T23:59:37.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.201+0000 7f39ff7fe700 1 -- 172.21.15.49:0/3118026307 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1401d040 con 0x5599c0001f10 2024-06-02T23:59:37.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.201+0000 7f39ff7fe700 1 -- 172.21.15.49:0/3118026307 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f3a140a3cf0 con 0x5599c0001f10 2024-06-02T23:59:37.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.201+0000 7f3a30c05b80 1 -- 172.21.15.49:0/3118026307 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5599bff5ad00 con 0x5599c0001f10 2024-06-02T23:59:37.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.201+0000 7f39ff7fe700 1 -- 172.21.15.49:0/3118026307 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3a1409b510 con 0x5599c0001f10 2024-06-02T23:59:37.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.201+0000 7f3a30c05b80 10 client.15036 fetch_fsmap learned FSMap version 26 2024-06-02T23:59:37.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.201+0000 7f3a30c05b80 1 -- 172.21.15.49:0/3118026307 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5599c00139a0 con 0x5599c0001f10 2024-06-02T23:59:37.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.201+0000 7f39ff7fe700 1 -- 172.21.15.49:0/3118026307 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5599bff5ad00 con 0x5599c0001f10 2024-06-02T23:59:37.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.201+0000 7f39ff7fe700 1 -- 172.21.15.49:0/3118026307 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f3a1409a960 con 0x5599c0001f10 2024-06-02T23:59:37.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.202+0000 7f3a30c05b80 10 client.15036 fetch_fsmap finished waiting for FSMap version 26 2024-06-02T23:59:37.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.202+0000 7f3a30c05b80 10 client.15036 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-02T23:59:37.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.202+0000 7f3a30c05b80 20 client.15036 populate_metadata read hostname 'smithi049' 2024-06-02T23:59:37.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.202+0000 7f3a30c05b80 1 --2- 172.21.15.49:0/3118026307 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5599c0015f60 0x5599c00173d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:37.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.202+0000 7f3a30c05b80 4 client.15036 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T23:59:37.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.202+0000 7f3a30c05b80 1 -- 172.21.15.49:0/3118026307 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599bff55280 con 0x5599c0015f60 2024-06-02T23:59:37.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.202+0000 7f3a1ffff700 1 --2- 172.21.15.49:0/3118026307 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5599c0015f60 0x5599c00173d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:37.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.202+0000 7f3a1ffff700 1 --2- 172.21.15.49:0/3118026307 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5599c0015f60 0x5599c00173d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14b37d68550f1098 server_cookie=c35ec277f6eaf794 in_seq=0 out_seq=0 2024-06-02T23:59:37.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.202+0000 7f39ff7fe700 10 client.15036 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-02T23:59:37.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.203+0000 7f39ff7fe700 1 -- 172.21.15.49:0/3118026307 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5599bff55280 con 0x5599c0015f60 2024-06-02T23:59:37.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.203+0000 7f39ff7fe700 10 client.15036 handle_command_reply: tid=0 2024-06-02T23:59:37.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.203+0000 7f3a30c05b80 1 client.15036 shutdown 2024-06-02T23:59:37.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.204+0000 7f3a30c05b80 1 -- 172.21.15.49:0/3118026307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599c0001f10 msgr2=0x5599c0005870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:37.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.204+0000 7f3a30c05b80 1 --2- 172.21.15.49:0/3118026307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599c0001f10 0x5599c0005870 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400c8f0 tx=0x7f3a1409b120 comp rx=0 tx=0).stop 2024-06-02T23:59:37.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.204+0000 7f3a30c05b80 1 -- 172.21.15.49:0/3118026307 shutdown_connections 2024-06-02T23:59:37.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.204+0000 7f3a30c05b80 1 --2- 172.21.15.49:0/3118026307 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5599c0002830 0x5599c0005db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.204+0000 7f3a30c05b80 1 --2- 172.21.15.49:0/3118026307 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5599bfffc750 0x5599c0008570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.204+0000 7f3a30c05b80 1 --2- 172.21.15.49:0/3118026307 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5599c0015f60 0x5599c00173d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.204+0000 7f3a30c05b80 1 --2- 172.21.15.49:0/3118026307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599c0001f10 0x5599c0005870 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.204+0000 7f3a30c05b80 1 -- 172.21.15.49:0/3118026307 >> 172.21.15.49:0/3118026307 conn(0x5599bff29030 msgr2=0x5599bfff66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:37.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.204+0000 7f39ff7fe700 0 client.15036 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-02T23:59:37.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.204+0000 7f3a30c05b80 1 -- 172.21.15.49:0/3118026307 shutdown_connections 2024-06-02T23:59:37.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.204+0000 7f3a30c05b80 1 -- 172.21.15.49:0/3118026307 wait complete. 2024-06-02T23:59:37.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.204+0000 7f3a30c05b80 20 client.15036 trim_cache size 0 max 16384 2024-06-02T23:59:37.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.225+0000 7f3a30c05b80 1 Processor -- start 2024-06-02T23:59:37.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.225+0000 7f3a30c05b80 1 -- start start 2024-06-02T23:59:37.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.226+0000 7f3a30c05b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599bfffc750 0x5599bfff6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:37.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.226+0000 7f3a30c05b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5599c0001f10 0x5599bfff7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:37.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.226+0000 7f3a30c05b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5599c0002830 0x5599c0004180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:37.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.226+0000 7f3a30c05b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5599c0015710 con 0x5599bfffc750 2024-06-02T23:59:37.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.226+0000 7f3a30c05b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5599c0015de0 con 0x5599c0001f10 2024-06-02T23:59:37.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.226+0000 7f3a30c05b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5599c00164b0 con 0x5599c0002830 2024-06-02T23:59:37.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.226+0000 7f3a1ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599bfffc750 0x5599bfff6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:37.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.226+0000 7f3a1ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599bfffc750 0x5599bfff6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38722/0 (socket says 172.21.15.49:38722) 2024-06-02T23:59:37.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.226+0000 7f3a1ffff700 1 -- 172.21.15.49:0/3577806 learned_addr learned my addr 172.21.15.49:0/3577806 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:37.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.226+0000 7f3a1f7fe700 1 --2- 172.21.15.49:0/3577806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5599c0001f10 0x5599bfff7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:37.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.226+0000 7f3a1ffff700 1 -- 172.21.15.49:0/3577806 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5599c0002830 msgr2=0x5599c0004180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:37.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.226+0000 7f3a1ffff700 1 --2- 172.21.15.49:0/3577806 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5599c0002830 0x5599c0004180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.226+0000 7f3a1ffff700 1 -- 172.21.15.49:0/3577806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5599c0001f10 msgr2=0x5599bfff7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:37.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.226+0000 7f3a1ffff700 1 --2- 172.21.15.49:0/3577806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5599c0001f10 0x5599bfff7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.226+0000 7f3a1ffff700 1 -- 172.21.15.49:0/3577806 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599c0015c00 con 0x5599bfffc750 2024-06-02T23:59:37.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.226+0000 7f3a1ffff700 1 --2- 172.21.15.49:0/3577806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599bfffc750 0x5599bfff6e30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000bd70 tx=0x7f3a10019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3603c3418a01b023 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:37.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.227+0000 7f3a05ffb700 1 -- 172.21.15.49:0/3577806 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1003d070 con 0x5599bfffc750 2024-06-02T23:59:37.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.227+0000 7f3a05ffb700 1 -- 172.21.15.49:0/3577806 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a100094d0 con 0x5599bfffc750 2024-06-02T23:59:37.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.227+0000 7f3a05ffb700 1 -- 172.21.15.49:0/3577806 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a10038880 con 0x5599bfffc750 2024-06-02T23:59:37.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.227+0000 7f3a30c05b80 1 -- 172.21.15.49:0/3577806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599bfffc750 msgr2=0x5599bfff6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:37.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.227+0000 7f3a30c05b80 1 --2- 172.21.15.49:0/3577806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599bfffc750 0x5599bfff6e30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000bd70 tx=0x7f3a10019040 comp rx=0 tx=0).stop 2024-06-02T23:59:37.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.227+0000 7f3a30c05b80 1 -- 172.21.15.49:0/3577806 shutdown_connections 2024-06-02T23:59:37.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.227+0000 7f3a30c05b80 1 --2- 172.21.15.49:0/3577806 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5599c0002830 0x5599c0004180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.227+0000 7f3a30c05b80 1 --2- 172.21.15.49:0/3577806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599bfffc750 0x5599bfff6e30 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.227+0000 7f3a30c05b80 1 --2- 172.21.15.49:0/3577806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5599c0001f10 0x5599bfff7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.227+0000 7f3a30c05b80 1 -- 172.21.15.49:0/3577806 >> 172.21.15.49:0/3577806 conn(0x5599bff29030 msgr2=0x5599bffffa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:37.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.227+0000 7f3a30c05b80 1 -- 172.21.15.49:0/3577806 shutdown_connections 2024-06-02T23:59:37.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.227+0000 7f3a30c05b80 1 -- 172.21.15.49:0/3577806 wait complete. 2024-06-02T23:59:37.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.228+0000 7f3a30c05b80 1 -- start start 2024-06-02T23:59:37.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.228+0000 7f3a30c05b80 1 Processor -- start 2024-06-02T23:59:37.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.228+0000 7f3a30c05b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5599bfffc750 0x5599bfff6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:37.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.228+0000 7f3a30c05b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599c0001f10 0x5599bfff6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:37.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.228+0000 7f3a30c05b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5599c0002830 0x5599c001f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:37.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.228+0000 7f3a30c05b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5599c0017250 con 0x5599c0001f10 2024-06-02T23:59:37.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.228+0000 7f3a30c05b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5599c0016b80 con 0x5599c0002830 2024-06-02T23:59:37.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.228+0000 7f3a30c05b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5599c0017920 con 0x5599bfffc750 2024-06-02T23:59:37.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.228+0000 7f3a30c05b80 10 client.0 _ll_register_callbacks cb 0x5599bfee3560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T23:59:37.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.228+0000 7f3a1f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599c0001f10 0x5599bfff6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:37.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.228+0000 7f3a1f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599c0001f10 0x5599bfff6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38734/0 (socket says 172.21.15.49:38734) 2024-06-02T23:59:37.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.228+0000 7f3a1f7fe700 1 -- 172.21.15.49:0/3483246960 learned_addr learned my addr 172.21.15.49:0/3483246960 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:37.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.228+0000 7f3a1ffff700 1 --2- 172.21.15.49:0/3483246960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5599bfffc750 0x5599bfff6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:37.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.229+0000 7f3a2491f700 1 --2- 172.21.15.49:0/3483246960 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5599c0002830 0x5599c001f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:37.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.229+0000 7f3a1f7fe700 1 -- 172.21.15.49:0/3483246960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5599bfffc750 msgr2=0x5599bfff6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:37.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.229+0000 7f3a1f7fe700 1 --2- 172.21.15.49:0/3483246960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5599bfffc750 0x5599bfff6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.229+0000 7f3a1f7fe700 1 -- 172.21.15.49:0/3483246960 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5599c0002830 msgr2=0x5599c001f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:37.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.229+0000 7f3a1f7fe700 1 --2- 172.21.15.49:0/3483246960 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5599c0002830 0x5599c001f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.229+0000 7f3a1f7fe700 1 -- 172.21.15.49:0/3483246960 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599c001fe00 con 0x5599c0001f10 2024-06-02T23:59:37.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.229+0000 7f3a1f7fe700 1 --2- 172.21.15.49:0/3483246960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599c0001f10 0x5599bfff6540 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3a14097e90 tx=0x7f3a140a3fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d901555469251c9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:37.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.229+0000 7f39ff7fe700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-02T23:59:37.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.229+0000 7f39ff7fe700 1 -- 172.21.15.49:0/3483246960 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a140b8070 con 0x5599c0001f10 2024-06-02T23:59:37.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.229+0000 7f3a30c05b80 1 -- 172.21.15.49:0/3483246960 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a100094d0 con 0x5599c0001f10 2024-06-02T23:59:37.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.229+0000 7f39ff7fe700 1 -- 172.21.15.49:0/3483246960 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f3a140662c0 con 0x5599c0001f10 2024-06-02T23:59:37.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.229+0000 7f39ff7fe700 1 -- 172.21.15.49:0/3483246960 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3a1401d040 con 0x5599c0001f10 2024-06-02T23:59:37.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.229+0000 7f3a30c05b80 10 client.15042 fetch_fsmap learned FSMap version 26 2024-06-02T23:59:37.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.229+0000 7f3a30c05b80 1 -- 172.21.15.49:0/3483246960 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5599c00210c0 con 0x5599c0001f10 2024-06-02T23:59:37.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.229+0000 7f39ff7fe700 1 -- 172.21.15.49:0/3483246960 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a100094d0 con 0x5599c0001f10 2024-06-02T23:59:37.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.230+0000 7f39ff7fe700 1 -- 172.21.15.49:0/3483246960 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f3a140b4220 con 0x5599c0001f10 2024-06-02T23:59:37.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.230+0000 7f3a30c05b80 10 client.15042 fetch_fsmap finished waiting for FSMap version 26 2024-06-02T23:59:37.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.230+0000 7f3a30c05b80 10 client.15042 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-02T23:59:37.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.230+0000 7f3a30c05b80 20 client.15042 populate_metadata read hostname 'smithi049' 2024-06-02T23:59:37.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.230+0000 7f3a30c05b80 1 --2- 172.21.15.49:0/3483246960 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5599c0085bc0 0x5599c00848d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:37.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.230+0000 7f3a30c05b80 4 client.15042 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T23:59:37.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.230+0000 7f3a30c05b80 1 -- 172.21.15.49:0/3483246960 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "status"}) -- 0x5599bff08f00 con 0x5599c0085bc0 2024-06-02T23:59:37.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.230+0000 7f3a1ffff700 1 --2- 172.21.15.49:0/3483246960 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5599c0085bc0 0x5599c00848d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:37.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.231+0000 7f3a1ffff700 1 --2- 172.21.15.49:0/3483246960 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5599c0085bc0 0x5599c00848d0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c99e429e43dc0b8 server_cookie=80f9431c556709ee in_seq=0 out_seq=0 2024-06-02T23:59:37.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.231+0000 7f39ff7fe700 10 client.15042 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-02T23:59:37.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.231+0000 7f39ff7fe700 1 -- 172.21.15.49:0/3483246960 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5599bff08f00 con 0x5599c0085bc0 2024-06-02T23:59:37.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.231+0000 7f39ff7fe700 10 client.15042 handle_command_reply: tid=0 2024-06-02T23:59:37.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.231+0000 7f3a30c05b80 1 client.15042 shutdown 2024-06-02T23:59:37.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.231+0000 7f3a30c05b80 1 -- 172.21.15.49:0/3483246960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599c0001f10 msgr2=0x5599bfff6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:37.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.231+0000 7f3a30c05b80 1 --2- 172.21.15.49:0/3483246960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599c0001f10 0x5599bfff6540 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3a14097e90 tx=0x7f3a140a3fa0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.231+0000 7f3a30c05b80 1 -- 172.21.15.49:0/3483246960 shutdown_connections 2024-06-02T23:59:37.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.231+0000 7f3a30c05b80 1 --2- 172.21.15.49:0/3483246960 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5599c0002830 0x5599c001f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.231+0000 7f3a30c05b80 1 --2- 172.21.15.49:0/3483246960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5599bfffc750 0x5599bfff6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.231+0000 7f3a30c05b80 1 --2- 172.21.15.49:0/3483246960 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5599c0085bc0 0x5599c00848d0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.231+0000 7f3a30c05b80 1 --2- 172.21.15.49:0/3483246960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5599c0001f10 0x5599bfff6540 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.231+0000 7f3a30c05b80 1 -- 172.21.15.49:0/3483246960 >> 172.21.15.49:0/3483246960 conn(0x5599bff29030 msgr2=0x5599c0004100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:37.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.231+0000 7f39ff7fe700 0 client.15042 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-02T23:59:37.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.231+0000 7f3a30c05b80 1 -- 172.21.15.49:0/3483246960 shutdown_connections 2024-06-02T23:59:37.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.231+0000 7f3a30c05b80 1 -- 172.21.15.49:0/3483246960 wait complete. 2024-06-02T23:59:37.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.231+0000 7f3a30c05b80 20 client.15042 trim_cache size 0 max 16384 2024-06-02T23:59:37.237 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-02T23:59:37.237 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "890dd222-213a-11ef-bc9b-c7b262605968", 2024-06-02T23:59:37.237 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-06-02T23:59:37.237 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 24487, 2024-06-02T23:59:37.237 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-06-02T23:59:37.237 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-06-02T23:59:37.237 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-06-02T23:59:37.237 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 139.90845189300001, 2024-06-02T23:59:37.237 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 26, 2024-06-02T23:59:37.237 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 90, 2024-06-02T23:59:37.237 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 88, 2024-06-02T23:59:37.238 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 164.31481658199999 2024-06-02T23:59:37.238 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-02T23:59:37.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.232+0000 7f3a26382700 1 -- 172.21.15.49:0/55964052 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3a080a2c20 msgr2=0x7f3a080a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:37.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.232+0000 7f3a26382700 1 --2- 172.21.15.49:0/55964052 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3a080a2c20 0x7f3a080a50e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000b5c0 tx=0x7f3a10005fd0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.232+0000 7f3a26382700 1 -- 172.21.15.49:0/55964052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a2006b5c0 msgr2=0x7f3a20101a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:37.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.232+0000 7f3a26382700 1 --2- 172.21.15.49:0/55964052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a2006b5c0 0x7f3a20101a30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400c920 tx=0x7f3a1400cce0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.232+0000 7f3a26382700 1 -- 172.21.15.49:0/55964052 shutdown_connections 2024-06-02T23:59:37.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.232+0000 7f3a26382700 1 --2- 172.21.15.49:0/55964052 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3a080a2c20 0x7f3a080a50e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.232+0000 7f3a26382700 1 --2- 172.21.15.49:0/55964052 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a20108570 0x7f3a20101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.232+0000 7f3a26382700 1 --2- 172.21.15.49:0/55964052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a2006ac00 0x7f3a201014f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.232+0000 7f3a26382700 1 --2- 172.21.15.49:0/55964052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a2006b5c0 0x7f3a20101a30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:37.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.232+0000 7f3a26382700 1 -- 172.21.15.49:0/55964052 >> 172.21.15.49:0/55964052 conn(0x7f3a200773e0 msgr2=0x7f3a200fff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:37.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.232+0000 7f3a26382700 1 -- 172.21.15.49:0/55964052 shutdown_connections 2024-06-02T23:59:37.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:37.232+0000 7f3a26382700 1 -- 172.21.15.49:0/55964052 wait complete. 2024-06-02T23:59:37.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:36 smithi107 ceph-mon[37048]: pgmap v370: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-06-02T23:59:37.875 INFO:tasks.cephadm:Setup complete, yielding 2024-06-02T23:59:37.875 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-06-02T23:59:37.884 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi049.front.sepia.ceph.com 2024-06-02T23:59:37.885 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch status' 2024-06-02T23:59:38.145 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:59:39.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:38 smithi057 ceph-mon[36457]: pgmap v371: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-06-02T23:59:39.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:38 smithi049 ceph-mon[32302]: pgmap v371: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-06-02T23:59:39.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:38 smithi107 ceph-mon[37048]: pgmap v371: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-06-02T23:59:39.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.834+0000 7f4f35859700 1 -- 172.21.15.49:0/2925943453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f30102520 msgr2=0x7f4f30102940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:39.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.834+0000 7f4f35859700 1 --2- 172.21.15.49:0/2925943453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f30102520 0x7f4f30102940 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000b0d0 tx=0x7f4f2000b3e0 comp rx=0 tx=0).stop 2024-06-02T23:59:39.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.834+0000 7f4f35859700 1 -- 172.21.15.49:0/2925943453 shutdown_connections 2024-06-02T23:59:39.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.834+0000 7f4f35859700 1 --2- 172.21.15.49:0/2925943453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f301040c0 0x7f4f3010a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:39.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.834+0000 7f4f35859700 1 --2- 172.21.15.49:0/2925943453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f30102520 0x7f4f30102940 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:39.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.834+0000 7f4f35859700 1 --2- 172.21.15.49:0/2925943453 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f30103720 0x7f4f30103b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:39.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.834+0000 7f4f35859700 1 -- 172.21.15.49:0/2925943453 >> 172.21.15.49:0/2925943453 conn(0x7f4f300fdae0 msgr2=0x7f4f300fff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:39.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.834+0000 7f4f35859700 1 -- 172.21.15.49:0/2925943453 shutdown_connections 2024-06-02T23:59:39.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.834+0000 7f4f35859700 1 -- 172.21.15.49:0/2925943453 wait complete. 2024-06-02T23:59:39.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.835+0000 7f4f35859700 1 Processor -- start 2024-06-02T23:59:39.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.835+0000 7f4f35859700 1 -- start start 2024-06-02T23:59:39.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.835+0000 7f4f35859700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f30102520 0x7f4f30198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:39.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.835+0000 7f4f35859700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f30103720 0x7f4f30198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:39.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.835+0000 7f4f35859700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f301040c0 0x7f4f3019fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:39.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.835+0000 7f4f35859700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3010e120 con 0x7f4f30103720 2024-06-02T23:59:39.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.835+0000 7f4f35859700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3010dfa0 con 0x7f4f30102520 2024-06-02T23:59:39.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.835+0000 7f4f35859700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3010e2a0 con 0x7f4f301040c0 2024-06-02T23:59:39.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.836+0000 7f4f2e7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f30103720 0x7f4f30198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:39.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.836+0000 7f4f2e7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f30103720 0x7f4f30198c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38750/0 (socket says 172.21.15.49:38750) 2024-06-02T23:59:39.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.836+0000 7f4f2e7fc700 1 -- 172.21.15.49:0/4235825259 learned_addr learned my addr 172.21.15.49:0/4235825259 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:39.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.836+0000 7f4f2f7fe700 1 --2- 172.21.15.49:0/4235825259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f301040c0 0x7f4f3019fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:39.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.836+0000 7f4f2effd700 1 --2- 172.21.15.49:0/4235825259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f30102520 0x7f4f30198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:39.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.836+0000 7f4f2e7fc700 1 -- 172.21.15.49:0/4235825259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f301040c0 msgr2=0x7f4f3019fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:39.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.836+0000 7f4f2e7fc700 1 --2- 172.21.15.49:0/4235825259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f301040c0 0x7f4f3019fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:39.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.836+0000 7f4f2e7fc700 1 -- 172.21.15.49:0/4235825259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f30102520 msgr2=0x7f4f30198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:39.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.836+0000 7f4f2e7fc700 1 --2- 172.21.15.49:0/4235825259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f30102520 0x7f4f30198700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:39.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.836+0000 7f4f2e7fc700 1 -- 172.21.15.49:0/4235825259 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f301a0360 con 0x7f4f30103720 2024-06-02T23:59:39.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.836+0000 7f4f2e7fc700 1 --2- 172.21.15.49:0/4235825259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f30103720 0x7f4f30198c40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800d9b0 tx=0x7f4f1800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:39.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.836+0000 7f4f34857700 1 -- 172.21.15.49:0/4235825259 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f18017070 con 0x7f4f30103720 2024-06-02T23:59:39.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.836+0000 7f4f34857700 1 -- 172.21.15.49:0/4235825259 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f18005020 con 0x7f4f30103720 2024-06-02T23:59:39.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.836+0000 7f4f35859700 1 -- 172.21.15.49:0/4235825259 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f30074720 con 0x7f4f30103720 2024-06-02T23:59:39.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.836+0000 7f4f34857700 1 -- 172.21.15.49:0/4235825259 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f18009a90 con 0x7f4f30103720 2024-06-02T23:59:39.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.837+0000 7f4f35859700 1 -- 172.21.15.49:0/4235825259 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f30074c10 con 0x7f4f30103720 2024-06-02T23:59:39.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.838+0000 7f4f35859700 1 -- 172.21.15.49:0/4235825259 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f30069180 con 0x7f4f30103720 2024-06-02T23:59:39.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.839+0000 7f4f34857700 1 -- 172.21.15.49:0/4235825259 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4f180051d0 con 0x7f4f30103720 2024-06-02T23:59:39.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.840+0000 7f4f34857700 1 --2- 172.21.15.49:0/4235825259 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f4f1c0a2c20 0x7f4f1c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:39.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.840+0000 7f4f2effd700 1 --2- 172.21.15.49:0/4235825259 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f4f1c0a2c20 0x7f4f1c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:39.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.840+0000 7f4f34857700 1 -- 172.21.15.49:0/4235825259 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f4f180cef00 con 0x7f4f30103720 2024-06-02T23:59:39.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.840+0000 7f4f2effd700 1 --2- 172.21.15.49:0/4235825259 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f4f1c0a2c20 0x7f4f1c0a50e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009fd0 tx=0x7f4f2000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:39.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:39.844+0000 7f4f34857700 1 -- 172.21.15.49:0/4235825259 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4f18020020 con 0x7f4f30103720 2024-06-02T23:59:40.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:40.071+0000 7f4f35859700 1 -- 172.21.15.49:0/4235825259 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f4f300628d0 con 0x7f4f1c0a2c20 2024-06-02T23:59:40.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:40.072+0000 7f4f34857700 1 -- 172.21.15.49:0/4235825259 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f4f300628d0 con 0x7f4f1c0a2c20 2024-06-02T23:59:40.072 INFO:teuthology.orchestra.run.smithi049.stdout:Backend: cephadm 2024-06-02T23:59:40.072 INFO:teuthology.orchestra.run.smithi049.stdout:Available: Yes 2024-06-02T23:59:40.072 INFO:teuthology.orchestra.run.smithi049.stdout:Paused: No 2024-06-02T23:59:40.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:40.074+0000 7f4f35859700 1 -- 172.21.15.49:0/4235825259 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f4f1c0a2c20 msgr2=0x7f4f1c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:40.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:40.074+0000 7f4f35859700 1 --2- 172.21.15.49:0/4235825259 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f4f1c0a2c20 0x7f4f1c0a50e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009fd0 tx=0x7f4f2000b040 comp rx=0 tx=0).stop 2024-06-02T23:59:40.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:40.074+0000 7f4f35859700 1 -- 172.21.15.49:0/4235825259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f30103720 msgr2=0x7f4f30198c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:40.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:40.074+0000 7f4f35859700 1 --2- 172.21.15.49:0/4235825259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f30103720 0x7f4f30198c40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800d9b0 tx=0x7f4f1800dcc0 comp rx=0 tx=0).stop 2024-06-02T23:59:40.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:40.074+0000 7f4f35859700 1 -- 172.21.15.49:0/4235825259 shutdown_connections 2024-06-02T23:59:40.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:40.074+0000 7f4f35859700 1 --2- 172.21.15.49:0/4235825259 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f4f1c0a2c20 0x7f4f1c0a50e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:40.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:40.074+0000 7f4f35859700 1 --2- 172.21.15.49:0/4235825259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f301040c0 0x7f4f3019fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:40.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:40.074+0000 7f4f35859700 1 --2- 172.21.15.49:0/4235825259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f30102520 0x7f4f30198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:40.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:40.074+0000 7f4f35859700 1 --2- 172.21.15.49:0/4235825259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f30103720 0x7f4f30198c40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:40.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:40.074+0000 7f4f35859700 1 -- 172.21.15.49:0/4235825259 >> 172.21.15.49:0/4235825259 conn(0x7f4f300fdae0 msgr2=0x7f4f30106a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:40.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:40.074+0000 7f4f35859700 1 -- 172.21.15.49:0/4235825259 shutdown_connections 2024-06-02T23:59:40.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:40.074+0000 7f4f35859700 1 -- 172.21.15.49:0/4235825259 wait complete. 2024-06-02T23:59:40.739 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch ps' 2024-06-02T23:59:40.991 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:59:41.112 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:40 smithi049 ceph-mon[32302]: pgmap v372: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:59:41.112 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:40 smithi049 ceph-mon[32302]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:59:41.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:40 smithi057 ceph-mon[36457]: pgmap v372: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:59:41.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:40 smithi057 ceph-mon[36457]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:59:41.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:40 smithi107 ceph-mon[37048]: pgmap v372: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:59:41.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:40 smithi107 ceph-mon[37048]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:59:42.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.605+0000 7fcee0e5f700 1 -- 172.21.15.49:0/1905255609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcedc1024f0 msgr2=0x7fcedc102910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:42.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.605+0000 7fcee0e5f700 1 --2- 172.21.15.49:0/1905255609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcedc1024f0 0x7fcedc102910 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fcecc00b0d0 tx=0x7fcecc00b3e0 comp rx=0 tx=0).stop 2024-06-02T23:59:42.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.605+0000 7fcee0e5f700 1 -- 172.21.15.49:0/1905255609 shutdown_connections 2024-06-02T23:59:42.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.605+0000 7fcee0e5f700 1 --2- 172.21.15.49:0/1905255609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcedc104090 0x7fcedc10a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:42.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.605+0000 7fcee0e5f700 1 --2- 172.21.15.49:0/1905255609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcedc1024f0 0x7fcedc102910 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:42.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.605+0000 7fcee0e5f700 1 --2- 172.21.15.49:0/1905255609 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcedc1036f0 0x7fcedc103b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:42.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.605+0000 7fcee0e5f700 1 -- 172.21.15.49:0/1905255609 >> 172.21.15.49:0/1905255609 conn(0x7fcedc0fda90 msgr2=0x7fcedc0ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:42.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.605+0000 7fcee0e5f700 1 -- 172.21.15.49:0/1905255609 shutdown_connections 2024-06-02T23:59:42.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.605+0000 7fcee0e5f700 1 -- 172.21.15.49:0/1905255609 wait complete. 2024-06-02T23:59:42.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.606+0000 7fcee0e5f700 1 Processor -- start 2024-06-02T23:59:42.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.606+0000 7fcee0e5f700 1 -- start start 2024-06-02T23:59:42.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.607+0000 7fcee0e5f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcedc1024f0 0x7fcedc1987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:42.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.607+0000 7fcee0e5f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcedc1036f0 0x7fcedc198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:42.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.607+0000 7fcee0e5f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcedc104090 0x7fcedc19fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:42.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.607+0000 7fcee0e5f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcedc10e160 con 0x7fcedc104090 2024-06-02T23:59:42.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.607+0000 7fcee0e5f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fcedc10dfe0 con 0x7fcedc1036f0 2024-06-02T23:59:42.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.607+0000 7fcee0e5f700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcedc10e2e0 con 0x7fcedc1024f0 2024-06-02T23:59:42.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.607+0000 7fcedad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcedc104090 0x7fcedc19fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:42.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.607+0000 7fcedad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcedc104090 0x7fcedc19fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38758/0 (socket says 172.21.15.49:38758) 2024-06-02T23:59:42.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.607+0000 7fcedad9d700 1 -- 172.21.15.49:0/1698935746 learned_addr learned my addr 172.21.15.49:0/1698935746 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:42.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.607+0000 7fced1d9b700 1 --2- 172.21.15.49:0/1698935746 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcedc1036f0 0x7fcedc198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:42.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.607+0000 7fceda59c700 1 --2- 172.21.15.49:0/1698935746 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcedc1024f0 0x7fcedc1987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:42.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.607+0000 7fcedad9d700 1 -- 172.21.15.49:0/1698935746 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcedc1024f0 msgr2=0x7fcedc1987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:42.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.607+0000 7fcedad9d700 1 --2- 172.21.15.49:0/1698935746 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcedc1024f0 0x7fcedc1987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:42.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.607+0000 7fcedad9d700 1 -- 172.21.15.49:0/1698935746 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcedc1036f0 msgr2=0x7fcedc198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:42.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.607+0000 7fcedad9d700 1 --2- 172.21.15.49:0/1698935746 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcedc1036f0 0x7fcedc198d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:42.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.607+0000 7fcedad9d700 1 -- 172.21.15.49:0/1698935746 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcedc1a0430 con 0x7fcedc104090 2024-06-02T23:59:42.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.607+0000 7fcedad9d700 1 --2- 172.21.15.49:0/1698935746 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcedc104090 0x7fcedc19fd90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fced400b580 tx=0x7fced400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:42.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.607+0000 7fced3fff700 1 -- 172.21.15.49:0/1698935746 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced4015020 con 0x7fcedc104090 2024-06-02T23:59:42.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.607+0000 7fced3fff700 1 -- 172.21.15.49:0/1698935746 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fced4011d10 con 0x7fcedc104090 2024-06-02T23:59:42.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.607+0000 7fcee0e5f700 1 -- 172.21.15.49:0/1698935746 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcedc1a0720 con 0x7fcedc104090 2024-06-02T23:59:42.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.608+0000 7fced3fff700 1 -- 172.21.15.49:0/1698935746 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced4010e00 con 0x7fcedc104090 2024-06-02T23:59:42.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.608+0000 7fcee0e5f700 1 -- 172.21.15.49:0/1698935746 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcedc1a0ce0 con 0x7fcedc104090 2024-06-02T23:59:42.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.608+0000 7fcee0e5f700 1 -- 172.21.15.49:0/1698935746 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcedc069180 con 0x7fcedc104090 2024-06-02T23:59:42.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.610+0000 7fced3fff700 1 -- 172.21.15.49:0/1698935746 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fced4018020 con 0x7fcedc104090 2024-06-02T23:59:42.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.610+0000 7fced3fff700 1 --2- 172.21.15.49:0/1698935746 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fcec80a2c20 0x7fcec80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:42.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.610+0000 7fceda59c700 1 --2- 172.21.15.49:0/1698935746 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fcec80a2c20 0x7fcec80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:42.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.610+0000 7fced3fff700 1 -- 172.21.15.49:0/1698935746 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fced40cec10 con 0x7fcedc104090 2024-06-02T23:59:42.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.611+0000 7fceda59c700 1 --2- 172.21.15.49:0/1698935746 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fcec80a2c20 0x7fcec80a50e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009fd0 tx=0x7fcecc00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:42.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.614+0000 7fced3fff700 1 -- 172.21.15.49:0/1698935746 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fced401f020 con 0x7fcedc104090 2024-06-02T23:59:42.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.829+0000 7fcee0e5f700 1 -- 172.21.15.49:0/1698935746 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fcedc0628d0 con 0x7fcec80a2c20 2024-06-02T23:59:42.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.843+0000 7fced3fff700 1 -- 172.21.15.49:0/1698935746 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7fcedc0628d0 con 0x7fcec80a2c20 2024-06-02T23:59:42.843 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-02T23:59:42.843 INFO:teuthology.orchestra.run.smithi049.stdout:mds.a smithi049 running (2m) 9s ago 2m 19.9M - 19.0.0-2946-g3d89accf b045ac545f82 0dc3af67f439 2024-06-02T23:59:42.843 INFO:teuthology.orchestra.run.smithi049.stdout:mds.b smithi057 running (2m) 14s ago 2m 22.5M - 19.0.0-2946-g3d89accf b045ac545f82 46ad7000e829 2024-06-02T23:59:42.843 INFO:teuthology.orchestra.run.smithi049.stdout:mds.c smithi107 running (2m) 14s ago 2m 19.1M - 19.0.0-2946-g3d89accf b045ac545f82 abe418febea0 2024-06-02T23:59:42.843 INFO:teuthology.orchestra.run.smithi049.stdout:mds.d smithi049 running (3m) 9s ago 3m 14.8M - 19.0.0-2946-g3d89accf b045ac545f82 f2a6c972aeab 2024-06-02T23:59:42.843 INFO:teuthology.orchestra.run.smithi049.stdout:mds.e smithi057 running (3m) 14s ago 3m 21.3M - 19.0.0-2946-g3d89accf b045ac545f82 c4cca4ed0d32 2024-06-02T23:59:42.843 INFO:teuthology.orchestra.run.smithi049.stdout:mds.f smithi107 running (2m) 14s ago 2m 19.7M - 19.0.0-2946-g3d89accf b045ac545f82 0faeb1d20c2f 2024-06-02T23:59:42.843 INFO:teuthology.orchestra.run.smithi049.stdout:mds.g smithi049 running (2m) 9s ago 2m 19.9M - 19.0.0-2946-g3d89accf b045ac545f82 c1a3cb848b3f 2024-06-02T23:59:42.843 INFO:teuthology.orchestra.run.smithi049.stdout:mds.h smithi057 running (2m) 14s ago 2m 18.7M - 19.0.0-2946-g3d89accf b045ac545f82 7d3d672cb2be 2024-06-02T23:59:42.844 INFO:teuthology.orchestra.run.smithi049.stdout:mds.i smithi107 running (2m) 14s ago 2m 27.4M - 19.0.0-2946-g3d89accf b045ac545f82 edb3cfd7fcf7 2024-06-02T23:59:42.844 INFO:teuthology.orchestra.run.smithi049.stdout:mds.j smithi049 running (3m) 9s ago 3m 17.0M - 19.0.0-2946-g3d89accf b045ac545f82 d6d1f578f6af 2024-06-02T23:59:42.844 INFO:teuthology.orchestra.run.smithi049.stdout:mds.k smithi057 running (3m) 14s ago 3m 21.4M - 19.0.0-2946-g3d89accf b045ac545f82 338578aa18a2 2024-06-02T23:59:42.844 INFO:teuthology.orchestra.run.smithi049.stdout:mds.l smithi107 running (3m) 14s ago 3m 22.6M - 19.0.0-2946-g3d89accf b045ac545f82 753a3080ef56 2024-06-02T23:59:42.844 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.x smithi049 *:9283,8765 running (10m) 9s ago 10m 516M - 19.0.0-2946-g3d89accf b045ac545f82 196f847adf9e 2024-06-02T23:59:42.844 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.y smithi057 *:8443,8765 running (8m) 14s ago 8m 456M - 19.0.0-2946-g3d89accf b045ac545f82 05fd17bb1135 2024-06-02T23:59:42.844 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.z smithi107 *:8443,8765 running (8m) 14s ago 8m 456M - 19.0.0-2946-g3d89accf b045ac545f82 33a05c8db1e7 2024-06-02T23:59:42.844 INFO:teuthology.orchestra.run.smithi049.stdout:mon.a smithi049 running (10m) 9s ago 10m 51.9M 2048M 19.0.0-2946-g3d89accf b045ac545f82 d07abbb94eed 2024-06-02T23:59:42.844 INFO:teuthology.orchestra.run.smithi049.stdout:mon.b smithi057 running (8m) 14s ago 8m 40.5M 2048M 19.0.0-2946-g3d89accf b045ac545f82 498be37079c5 2024-06-02T23:59:42.844 INFO:teuthology.orchestra.run.smithi049.stdout:mon.c smithi107 running (9m) 14s ago 9m 40.0M 2048M 19.0.0-2946-g3d89accf b045ac545f82 6b2ebe4e3d49 2024-06-02T23:59:42.844 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (8m) 9s ago 8m 59.5M 4272M 19.0.0-2946-g3d89accf b045ac545f82 b54e57989ec4 2024-06-02T23:59:42.844 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi057 running (7m) 14s ago 7m 58.3M 4273M 19.0.0-2946-g3d89accf b045ac545f82 5dfc772de88d 2024-06-02T23:59:42.844 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi107 running (7m) 14s ago 7m 62.5M 4272M 19.0.0-2946-g3d89accf b045ac545f82 ba33c43a2749 2024-06-02T23:59:42.845 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi049 running (7m) 9s ago 7m 48.2M 4272M 19.0.0-2946-g3d89accf b045ac545f82 66f73f6fcff8 2024-06-02T23:59:42.845 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi057 running (6m) 14s ago 6m 46.8M 4273M 19.0.0-2946-g3d89accf b045ac545f82 10dc8a3907a2 2024-06-02T23:59:42.845 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi107 running (6m) 14s ago 6m 49.2M 4272M 19.0.0-2946-g3d89accf b045ac545f82 f15bcf59185c 2024-06-02T23:59:42.845 INFO:teuthology.orchestra.run.smithi049.stdout:osd.6 smithi049 running (5m) 9s ago 5m 55.8M 4272M 19.0.0-2946-g3d89accf b045ac545f82 29802f25a6ba 2024-06-02T23:59:42.845 INFO:teuthology.orchestra.run.smithi049.stdout:osd.7 smithi057 running (5m) 14s ago 5m 48.7M 4273M 19.0.0-2946-g3d89accf b045ac545f82 55cc065f396d 2024-06-02T23:59:42.845 INFO:teuthology.orchestra.run.smithi049.stdout:osd.8 smithi107 running (4m) 14s ago 4m 48.9M 4272M 19.0.0-2946-g3d89accf b045ac545f82 d9c18b4fd0c1 2024-06-02T23:59:42.845 INFO:teuthology.orchestra.run.smithi049.stdout:osd.9 smithi049 running (4m) 9s ago 4m 55.7M 4272M 19.0.0-2946-g3d89accf b045ac545f82 2bcc89625e1f 2024-06-02T23:59:42.845 INFO:teuthology.orchestra.run.smithi049.stdout:osd.10 smithi057 running (4m) 14s ago 4m 51.5M 4273M 19.0.0-2946-g3d89accf b045ac545f82 901387adb1d9 2024-06-02T23:59:42.845 INFO:teuthology.orchestra.run.smithi049.stdout:osd.11 smithi107 running (3m) 14s ago 3m 45.5M 4272M 19.0.0-2946-g3d89accf b045ac545f82 2f7dc8531e61 2024-06-02T23:59:42.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.845+0000 7fcee0e5f700 1 -- 172.21.15.49:0/1698935746 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fcec80a2c20 msgr2=0x7fcec80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:42.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.845+0000 7fcee0e5f700 1 --2- 172.21.15.49:0/1698935746 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fcec80a2c20 0x7fcec80a50e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009fd0 tx=0x7fcecc00b040 comp rx=0 tx=0).stop 2024-06-02T23:59:42.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.845+0000 7fcee0e5f700 1 -- 172.21.15.49:0/1698935746 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcedc104090 msgr2=0x7fcedc19fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:42.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.845+0000 7fcee0e5f700 1 --2- 172.21.15.49:0/1698935746 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcedc104090 0x7fcedc19fd90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fced400b580 tx=0x7fced400b890 comp rx=0 tx=0).stop 2024-06-02T23:59:42.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.845+0000 7fcee0e5f700 1 -- 172.21.15.49:0/1698935746 shutdown_connections 2024-06-02T23:59:42.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.845+0000 7fcee0e5f700 1 --2- 172.21.15.49:0/1698935746 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fcec80a2c20 0x7fcec80a50e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:42.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.845+0000 7fcee0e5f700 1 --2- 172.21.15.49:0/1698935746 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcedc104090 0x7fcedc19fd90 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:42.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.845+0000 7fcee0e5f700 1 --2- 172.21.15.49:0/1698935746 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcedc1024f0 0x7fcedc1987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:42.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.845+0000 7fcee0e5f700 1 --2- 172.21.15.49:0/1698935746 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcedc1036f0 0x7fcedc198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:42.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.845+0000 7fcee0e5f700 1 -- 172.21.15.49:0/1698935746 >> 172.21.15.49:0/1698935746 conn(0x7fcedc0fda90 msgr2=0x7fcedc106a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:42.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.846+0000 7fcee0e5f700 1 -- 172.21.15.49:0/1698935746 shutdown_connections 2024-06-02T23:59:42.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:42.846+0000 7fcee0e5f700 1 -- 172.21.15.49:0/1698935746 wait complete. 2024-06-02T23:59:43.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:42 smithi057 ceph-mon[36457]: pgmap v373: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:59:43.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:42 smithi049 ceph-mon[32302]: pgmap v373: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:59:43.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:42 smithi107 ceph-mon[37048]: pgmap v373: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:59:43.507 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch ls' 2024-06-02T23:59:43.760 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:59:44.138 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:43 smithi049 ceph-mon[32302]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:59:44.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:43 smithi057 ceph-mon[36457]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:59:44.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:43 smithi107 ceph-mon[37048]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:59:45.175 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:44 smithi049 ceph-mon[32302]: pgmap v374: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-02T23:59:45.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:44 smithi057 ceph-mon[36457]: pgmap v374: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-02T23:59:45.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:44 smithi107 ceph-mon[37048]: pgmap v374: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-02T23:59:45.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.422+0000 7f3bd7fe3700 1 -- 172.21.15.49:0/1503444398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bd01025f0 msgr2=0x7f3bd0102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:45.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.422+0000 7f3bd7fe3700 1 --2- 172.21.15.49:0/1503444398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bd01025f0 0x7f3bd0102a50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3bc00099c0 tx=0x7f3bc0009cd0 comp rx=0 tx=0).stop 2024-06-02T23:59:45.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.422+0000 7f3bd7fe3700 1 -- 172.21.15.49:0/1503444398 shutdown_connections 2024-06-02T23:59:45.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.422+0000 7f3bd7fe3700 1 --2- 172.21.15.49:0/1503444398 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd0102f90 0x7f3bd0109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:45.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.422+0000 7f3bd7fe3700 1 --2- 172.21.15.49:0/1503444398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bd01013f0 0x7f3bd0101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:45.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.422+0000 7f3bd7fe3700 1 --2- 172.21.15.49:0/1503444398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bd01025f0 0x7f3bd0102a50 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:45.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.422+0000 7f3bd7fe3700 1 -- 172.21.15.49:0/1503444398 >> 172.21.15.49:0/1503444398 conn(0x7f3bd00fc990 msgr2=0x7f3bd00fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:45.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.422+0000 7f3bd7fe3700 1 -- 172.21.15.49:0/1503444398 shutdown_connections 2024-06-02T23:59:45.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.422+0000 7f3bd7fe3700 1 -- 172.21.15.49:0/1503444398 wait complete. 2024-06-02T23:59:45.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.423+0000 7f3bd7fe3700 1 Processor -- start 2024-06-02T23:59:45.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.423+0000 7f3bd7fe3700 1 -- start start 2024-06-02T23:59:45.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.423+0000 7f3bd7fe3700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bd01013f0 0x7f3bd019a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:45.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.423+0000 7f3bd7fe3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bd01025f0 0x7f3bd019ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:45.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.423+0000 7f3bd7fe3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd0102f90 0x7f3bd01a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:45.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.423+0000 7f3bd7fe3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd010cfc0 con 0x7f3bd01025f0 2024-06-02T23:59:45.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.423+0000 7f3bd7fe3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd010ce40 con 0x7f3bd0102f90 2024-06-02T23:59:45.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.423+0000 7f3bd7fe3700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd010d140 con 0x7f3bd01013f0 2024-06-02T23:59:45.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.423+0000 7f3bd557e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bd01025f0 0x7f3bd019ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:45.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.423+0000 7f3bd557e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bd01025f0 0x7f3bd019ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59868/0 (socket says 172.21.15.49:59868) 2024-06-02T23:59:45.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.423+0000 7f3bd557e700 1 -- 172.21.15.49:0/3191787343 learned_addr learned my addr 172.21.15.49:0/3191787343 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:45.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.423+0000 7f3bd5d7f700 1 --2- 172.21.15.49:0/3191787343 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bd01013f0 0x7f3bd019a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:45.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.423+0000 7f3bd6580700 1 --2- 172.21.15.49:0/3191787343 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd0102f90 0x7f3bd01a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:45.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.424+0000 7f3bd557e700 1 -- 172.21.15.49:0/3191787343 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bd01013f0 msgr2=0x7f3bd019a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:45.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.424+0000 7f3bd557e700 1 --2- 172.21.15.49:0/3191787343 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bd01013f0 0x7f3bd019a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:45.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.424+0000 7f3bd557e700 1 -- 172.21.15.49:0/3191787343 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd0102f90 msgr2=0x7f3bd01a1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:45.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.424+0000 7f3bd557e700 1 --2- 172.21.15.49:0/3191787343 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd0102f90 0x7f3bd01a1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:45.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.424+0000 7f3bd557e700 1 -- 172.21.15.49:0/3191787343 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd01a25b0 con 0x7f3bd01025f0 2024-06-02T23:59:45.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.424+0000 7f3bd6580700 1 --2- 172.21.15.49:0/3191787343 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd0102f90 0x7f3bd01a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:59:45.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.424+0000 7f3bd557e700 1 --2- 172.21.15.49:0/3191787343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bd01025f0 0x7f3bd019ae90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0000c00 tx=0x7f3bc0009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:45.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.424+0000 7f3bc6ffd700 1 -- 172.21.15.49:0/3191787343 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0026070 con 0x7f3bd01025f0 2024-06-02T23:59:45.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.424+0000 7f3bd7fe3700 1 -- 172.21.15.49:0/3191787343 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd01a2840 con 0x7f3bd01025f0 2024-06-02T23:59:45.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.424+0000 7f3bc6ffd700 1 -- 172.21.15.49:0/3191787343 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bc0004150 con 0x7f3bd01025f0 2024-06-02T23:59:45.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.424+0000 7f3bc6ffd700 1 -- 172.21.15.49:0/3191787343 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0004a00 con 0x7f3bd01025f0 2024-06-02T23:59:45.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.424+0000 7f3bd7fe3700 1 -- 172.21.15.49:0/3191787343 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd01a2c90 con 0x7f3bd01025f0 2024-06-02T23:59:45.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.425+0000 7f3bd7fe3700 1 -- 172.21.15.49:0/3191787343 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bd0069180 con 0x7f3bd01025f0 2024-06-02T23:59:45.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.426+0000 7f3bc6ffd700 1 -- 172.21.15.49:0/3191787343 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3bc0029070 con 0x7f3bd01025f0 2024-06-02T23:59:45.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.427+0000 7f3bc6ffd700 1 --2- 172.21.15.49:0/3191787343 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3bbc0a2c20 0x7f3bbc0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:45.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.427+0000 7f3bd5d7f700 1 --2- 172.21.15.49:0/3191787343 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3bbc0a2c20 0x7f3bbc0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:45.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.427+0000 7f3bc6ffd700 1 -- 172.21.15.49:0/3191787343 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f3bc00cfe90 con 0x7f3bd01025f0 2024-06-02T23:59:45.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.428+0000 7f3bd5d7f700 1 --2- 172.21.15.49:0/3191787343 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3bbc0a2c20 0x7f3bbc0a50e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0102450 tx=0x7f3bcc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:45.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.431+0000 7f3bc6ffd700 1 -- 172.21.15.49:0/3191787343 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3bc0030020 con 0x7f3bd01025f0 2024-06-02T23:59:45.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.646+0000 7f3bd7fe3700 1 -- 172.21.15.49:0/3191787343 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f3bd00feb90 con 0x7f3bbc0a2c20 2024-06-02T23:59:45.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.652+0000 7f3bc6ffd700 1 -- 172.21.15.49:0/3191787343 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f3bd00feb90 con 0x7f3bbc0a2c20 2024-06-02T23:59:45.651 INFO:teuthology.orchestra.run.smithi049.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-06-02T23:59:45.651 INFO:teuthology.orchestra.run.smithi049.stdout:mds.all 12/12 17s ago 3m smithi049=a;smithi049=d;smithi049=g;smithi049=j;smithi057=b;smithi057=e;smithi057=h;smithi057=k;smithi107=c;smithi107=f;smithi107=i;smithi107=l;count:12 2024-06-02T23:59:45.652 INFO:teuthology.orchestra.run.smithi049.stdout:mgr 3/3 17s ago 8m smithi049=x;smithi057=y;smithi107=z;count:3 2024-06-02T23:59:45.652 INFO:teuthology.orchestra.run.smithi049.stdout:mon 3/3 17s ago 9m smithi049:172.21.15.49=a;smithi057:172.21.15.57=b;smithi107:172.21.15.107=c;count:3 2024-06-02T23:59:45.652 INFO:teuthology.orchestra.run.smithi049.stdout:osd 12 17s ago - 2024-06-02T23:59:45.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.654+0000 7f3bd7fe3700 1 -- 172.21.15.49:0/3191787343 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3bbc0a2c20 msgr2=0x7f3bbc0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:45.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.654+0000 7f3bd7fe3700 1 --2- 172.21.15.49:0/3191787343 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3bbc0a2c20 0x7f3bbc0a50e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0102450 tx=0x7f3bcc00b410 comp rx=0 tx=0).stop 2024-06-02T23:59:45.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.654+0000 7f3bd7fe3700 1 -- 172.21.15.49:0/3191787343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bd01025f0 msgr2=0x7f3bd019ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:45.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.654+0000 7f3bd7fe3700 1 --2- 172.21.15.49:0/3191787343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bd01025f0 0x7f3bd019ae90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0000c00 tx=0x7f3bc0009f10 comp rx=0 tx=0).stop 2024-06-02T23:59:45.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.654+0000 7f3bd7fe3700 1 -- 172.21.15.49:0/3191787343 shutdown_connections 2024-06-02T23:59:45.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.654+0000 7f3bd7fe3700 1 --2- 172.21.15.49:0/3191787343 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3bbc0a2c20 0x7f3bbc0a50e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:45.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.654+0000 7f3bd7fe3700 1 --2- 172.21.15.49:0/3191787343 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd0102f90 0x7f3bd01a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:45.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.654+0000 7f3bd7fe3700 1 --2- 172.21.15.49:0/3191787343 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bd01013f0 0x7f3bd019a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:45.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.654+0000 7f3bd7fe3700 1 --2- 172.21.15.49:0/3191787343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bd01025f0 0x7f3bd019ae90 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:45.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.654+0000 7f3bd7fe3700 1 -- 172.21.15.49:0/3191787343 >> 172.21.15.49:0/3191787343 conn(0x7f3bd00fc990 msgr2=0x7f3bd00fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:45.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.654+0000 7f3bd7fe3700 1 -- 172.21.15.49:0/3191787343 shutdown_connections 2024-06-02T23:59:45.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:45.654+0000 7f3bd7fe3700 1 -- 172.21.15.49:0/3191787343 wait complete. 2024-06-02T23:59:46.296 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch host ls' 2024-06-02T23:59:46.547 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:59:47.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:46 smithi057 ceph-mon[36457]: pgmap v375: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-06-02T23:59:47.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:46 smithi057 ceph-mon[36457]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:59:47.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:46 smithi049 ceph-mon[32302]: pgmap v375: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-06-02T23:59:47.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:46 smithi049 ceph-mon[32302]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:59:47.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:46 smithi107 ceph-mon[37048]: pgmap v375: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-06-02T23:59:47.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:46 smithi107 ceph-mon[37048]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:59:48.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.209+0000 7fbb8ca1f700 1 -- 172.21.15.49:0/442887940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb88105950 msgr2=0x7fbb88107d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:48.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.209+0000 7fbb8ca1f700 1 --2- 172.21.15.49:0/442887940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb88105950 0x7fbb88107d40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbb70009990 tx=0x7fbb70009ca0 comp rx=0 tx=0).stop 2024-06-02T23:59:48.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.209+0000 7fbb8ca1f700 1 -- 172.21.15.49:0/442887940 shutdown_connections 2024-06-02T23:59:48.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.209+0000 7fbb8ca1f700 1 --2- 172.21.15.49:0/442887940 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb88108280 0x7fbb8810a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:48.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.209+0000 7fbb8ca1f700 1 --2- 172.21.15.49:0/442887940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb88103020 0x7fbb88105410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:48.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.209+0000 7fbb8ca1f700 1 --2- 172.21.15.49:0/442887940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb88105950 0x7fbb88107d40 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:48.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.209+0000 7fbb8ca1f700 1 -- 172.21.15.49:0/442887940 >> 172.21.15.49:0/442887940 conn(0x7fbb880fc990 msgr2=0x7fbb880fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:48.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.209+0000 7fbb8ca1f700 1 -- 172.21.15.49:0/442887940 shutdown_connections 2024-06-02T23:59:48.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.209+0000 7fbb8ca1f700 1 -- 172.21.15.49:0/442887940 wait complete. 2024-06-02T23:59:48.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.210+0000 7fbb8ca1f700 1 Processor -- start 2024-06-02T23:59:48.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.210+0000 7fbb8ca1f700 1 -- start start 2024-06-02T23:59:48.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.210+0000 7fbb8ca1f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb88103020 0x7fbb881987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:48.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.210+0000 7fbb8ca1f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb88105950 0x7fbb88198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:48.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.210+0000 7fbb8ca1f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb88108280 0x7fbb8819fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:48.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.210+0000 7fbb8ca1f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8810e120 con 0x7fbb88108280 2024-06-02T23:59:48.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.210+0000 7fbb8ca1f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8810dfa0 con 0x7fbb88103020 2024-06-02T23:59:48.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.210+0000 7fbb8ca1f700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8810e2a0 con 0x7fbb88105950 2024-06-02T23:59:48.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.210+0000 7fbb86d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb88108280 0x7fbb8819fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:48.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.210+0000 7fbb86d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb88108280 0x7fbb8819fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59880/0 (socket says 172.21.15.49:59880) 2024-06-02T23:59:48.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.210+0000 7fbb86d9d700 1 -- 172.21.15.49:0/190661983 learned_addr learned my addr 172.21.15.49:0/190661983 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:48.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.211+0000 7fbb85d9b700 1 --2- 172.21.15.49:0/190661983 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb88105950 0x7fbb88198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:48.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.211+0000 7fbb8659c700 1 --2- 172.21.15.49:0/190661983 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb88103020 0x7fbb881987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:48.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.211+0000 7fbb86d9d700 1 -- 172.21.15.49:0/190661983 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb88105950 msgr2=0x7fbb88198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:48.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.211+0000 7fbb86d9d700 1 --2- 172.21.15.49:0/190661983 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb88105950 0x7fbb88198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:48.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.211+0000 7fbb86d9d700 1 -- 172.21.15.49:0/190661983 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb88103020 msgr2=0x7fbb881987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:48.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.211+0000 7fbb86d9d700 1 --2- 172.21.15.49:0/190661983 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb88103020 0x7fbb881987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:48.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.211+0000 7fbb86d9d700 1 -- 172.21.15.49:0/190661983 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb881a0420 con 0x7fbb88108280 2024-06-02T23:59:48.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.211+0000 7fbb86d9d700 1 --2- 172.21.15.49:0/190661983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb88108280 0x7fbb8819fd80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbb8000c9a0 tx=0x7fbb8000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:48.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.211+0000 7fbb7f7fe700 1 -- 172.21.15.49:0/190661983 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb80004230 con 0x7fbb88108280 2024-06-02T23:59:48.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.211+0000 7fbb8ca1f700 1 -- 172.21.15.49:0/190661983 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb881a0710 con 0x7fbb88108280 2024-06-02T23:59:48.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.211+0000 7fbb7f7fe700 1 -- 172.21.15.49:0/190661983 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb800043d0 con 0x7fbb88108280 2024-06-02T23:59:48.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.211+0000 7fbb7f7fe700 1 -- 172.21.15.49:0/190661983 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8000ec70 con 0x7fbb88108280 2024-06-02T23:59:48.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.211+0000 7fbb8ca1f700 1 -- 172.21.15.49:0/190661983 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb881a0c80 con 0x7fbb88108280 2024-06-02T23:59:48.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.212+0000 7fbb8ca1f700 1 -- 172.21.15.49:0/190661983 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb88069180 con 0x7fbb88108280 2024-06-02T23:59:48.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.214+0000 7fbb7f7fe700 1 -- 172.21.15.49:0/190661983 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbb800036a0 con 0x7fbb88108280 2024-06-02T23:59:48.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.214+0000 7fbb7f7fe700 1 --2- 172.21.15.49:0/190661983 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbb740a2c20 0x7fbb740a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:48.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.214+0000 7fbb8659c700 1 --2- 172.21.15.49:0/190661983 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbb740a2c20 0x7fbb740a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:48.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.214+0000 7fbb7f7fe700 1 -- 172.21.15.49:0/190661983 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fbb800ceae0 con 0x7fbb88108280 2024-06-02T23:59:48.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.215+0000 7fbb8659c700 1 --2- 172.21.15.49:0/190661983 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbb740a2c20 0x7fbb740a50e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbb7800a400 tx=0x7fbb7800d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:48.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.219+0000 7fbb7f7fe700 1 -- 172.21.15.49:0/190661983 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fbb80014070 con 0x7fbb88108280 2024-06-02T23:59:48.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.431+0000 7fbb8ca1f700 1 -- 172.21.15.49:0/190661983 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fbb880628d0 con 0x7fbb740a2c20 2024-06-02T23:59:48.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.433+0000 7fbb7f7fe700 1 -- 172.21.15.49:0/190661983 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fbb880628d0 con 0x7fbb740a2c20 2024-06-02T23:59:48.432 INFO:teuthology.orchestra.run.smithi049.stdout:HOST ADDR LABELS STATUS 2024-06-02T23:59:48.432 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049 172.21.15.49 2024-06-02T23:59:48.432 INFO:teuthology.orchestra.run.smithi049.stdout:smithi057 172.21.15.57 2024-06-02T23:59:48.433 INFO:teuthology.orchestra.run.smithi049.stdout:smithi107 172.21.15.107 2024-06-02T23:59:48.433 INFO:teuthology.orchestra.run.smithi049.stdout:3 hosts in cluster 2024-06-02T23:59:48.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.435+0000 7fbb8ca1f700 1 -- 172.21.15.49:0/190661983 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbb740a2c20 msgr2=0x7fbb740a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:48.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.435+0000 7fbb8ca1f700 1 --2- 172.21.15.49:0/190661983 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbb740a2c20 0x7fbb740a50e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbb7800a400 tx=0x7fbb7800d040 comp rx=0 tx=0).stop 2024-06-02T23:59:48.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.435+0000 7fbb8ca1f700 1 -- 172.21.15.49:0/190661983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb88108280 msgr2=0x7fbb8819fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:48.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.435+0000 7fbb8ca1f700 1 --2- 172.21.15.49:0/190661983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb88108280 0x7fbb8819fd80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbb8000c9a0 tx=0x7fbb8000ccb0 comp rx=0 tx=0).stop 2024-06-02T23:59:48.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.435+0000 7fbb8ca1f700 1 -- 172.21.15.49:0/190661983 shutdown_connections 2024-06-02T23:59:48.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.435+0000 7fbb8ca1f700 1 --2- 172.21.15.49:0/190661983 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbb740a2c20 0x7fbb740a50e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:48.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.435+0000 7fbb8ca1f700 1 --2- 172.21.15.49:0/190661983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb88108280 0x7fbb8819fd80 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:48.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.435+0000 7fbb8ca1f700 1 --2- 172.21.15.49:0/190661983 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb88103020 0x7fbb881987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:48.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.435+0000 7fbb8ca1f700 1 --2- 172.21.15.49:0/190661983 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb88105950 0x7fbb88198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:48.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.435+0000 7fbb8ca1f700 1 -- 172.21.15.49:0/190661983 >> 172.21.15.49:0/190661983 conn(0x7fbb880fc990 msgr2=0x7fbb88103ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:48.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.435+0000 7fbb8ca1f700 1 -- 172.21.15.49:0/190661983 shutdown_connections 2024-06-02T23:59:48.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:48.435+0000 7fbb8ca1f700 1 -- 172.21.15.49:0/190661983 wait complete. 2024-06-02T23:59:49.079 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch device ls' 2024-06-02T23:59:49.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:48 smithi057 ceph-mon[36457]: pgmap v376: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-06-02T23:59:49.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:48 smithi049 ceph-mon[32302]: pgmap v376: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-06-02T23:59:49.328 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:59:49.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:48 smithi107 ceph-mon[37048]: pgmap v376: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-06-02T23:59:50.181 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:49 smithi049 ceph-mon[32302]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:59:50.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:49 smithi057 ceph-mon[36457]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:59:50.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:49 smithi107 ceph-mon[37048]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:59:51.010 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:50 smithi049 ceph-mon[32302]: pgmap v377: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:59:51.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.023+0000 7f79e3d75700 1 -- 172.21.15.49:0/3961019284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79dc108280 msgr2=0x7f79dc10a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:51.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.023+0000 7f79e3d75700 1 --2- 172.21.15.49:0/3961019284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79dc108280 0x7f79dc10a670 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f79d400b0a0 tx=0x7f79d400b3b0 comp rx=0 tx=0).stop 2024-06-02T23:59:51.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.023+0000 7f79e3d75700 1 -- 172.21.15.49:0/3961019284 shutdown_connections 2024-06-02T23:59:51.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.023+0000 7f79e3d75700 1 --2- 172.21.15.49:0/3961019284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79dc108280 0x7f79dc10a670 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:51.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.023+0000 7f79e3d75700 1 --2- 172.21.15.49:0/3961019284 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79dc103020 0x7f79dc105410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:51.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.023+0000 7f79e3d75700 1 --2- 172.21.15.49:0/3961019284 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79dc105950 0x7f79dc107d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:51.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.023+0000 7f79e3d75700 1 -- 172.21.15.49:0/3961019284 >> 172.21.15.49:0/3961019284 conn(0x7f79dc0fc990 msgr2=0x7f79dc0fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:51.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.023+0000 7f79e3d75700 1 -- 172.21.15.49:0/3961019284 shutdown_connections 2024-06-02T23:59:51.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.023+0000 7f79e3d75700 1 -- 172.21.15.49:0/3961019284 wait complete. 2024-06-02T23:59:51.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.024+0000 7f79e3d75700 1 Processor -- start 2024-06-02T23:59:51.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.024+0000 7f79e3d75700 1 -- start start 2024-06-02T23:59:51.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.024+0000 7f79e3d75700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79dc103020 0x7f79dc198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:51.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.024+0000 7f79e3d75700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79dc105950 0x7f79dc198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:51.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.024+0000 7f79e3d75700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79dc108280 0x7f79dc19fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:51.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.024+0000 7f79e3d75700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc10e100 con 0x7f79dc103020 2024-06-02T23:59:51.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.024+0000 7f79e3d75700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc10df80 con 0x7f79dc105950 2024-06-02T23:59:51.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.024+0000 7f79e3d75700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc10e280 con 0x7f79dc108280 2024-06-02T23:59:51.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.024+0000 7f79e1b11700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79dc103020 0x7f79dc198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:51.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.024+0000 7f79e1b11700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79dc103020 0x7f79dc198690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59894/0 (socket says 172.21.15.49:59894) 2024-06-02T23:59:51.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.024+0000 7f79e1b11700 1 -- 172.21.15.49:0/2234980412 learned_addr learned my addr 172.21.15.49:0/2234980412 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:51.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.025+0000 7f79e1310700 1 --2- 172.21.15.49:0/2234980412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79dc105950 0x7f79dc198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:51.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.025+0000 7f79e1b11700 1 -- 172.21.15.49:0/2234980412 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79dc108280 msgr2=0x7f79dc19fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:51.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.025+0000 7f79e2312700 1 --2- 172.21.15.49:0/2234980412 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79dc108280 0x7f79dc19fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:51.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.025+0000 7f79e1b11700 1 --2- 172.21.15.49:0/2234980412 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79dc108280 0x7f79dc19fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:51.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.025+0000 7f79e1b11700 1 -- 172.21.15.49:0/2234980412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79dc105950 msgr2=0x7f79dc198bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:51.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.025+0000 7f79e1b11700 1 --2- 172.21.15.49:0/2234980412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79dc105950 0x7f79dc198bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:51.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.025+0000 7f79e1b11700 1 -- 172.21.15.49:0/2234980412 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79dc1a02f0 con 0x7f79dc103020 2024-06-02T23:59:51.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.025+0000 7f79e1310700 1 --2- 172.21.15.49:0/2234980412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79dc105950 0x7f79dc198bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:59:51.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.025+0000 7f79e1b11700 1 --2- 172.21.15.49:0/2234980412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79dc103020 0x7f79dc198690 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f79d800c950 tx=0x7f79d800cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:51.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.025+0000 7f79d2ffd700 1 -- 172.21.15.49:0/2234980412 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d8007ac0 con 0x7f79dc103020 2024-06-02T23:59:51.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.025+0000 7f79e3d75700 1 -- 172.21.15.49:0/2234980412 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79dc1a05e0 con 0x7f79dc103020 2024-06-02T23:59:51.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.025+0000 7f79d2ffd700 1 -- 172.21.15.49:0/2234980412 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79d8004d10 con 0x7f79dc103020 2024-06-02T23:59:51.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.025+0000 7f79d2ffd700 1 -- 172.21.15.49:0/2234980412 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d800f450 con 0x7f79dc103020 2024-06-02T23:59:51.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.025+0000 7f79e3d75700 1 -- 172.21.15.49:0/2234980412 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79dc1a0b20 con 0x7f79dc103020 2024-06-02T23:59:51.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.026+0000 7f79e3d75700 1 -- 172.21.15.49:0/2234980412 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79dc069180 con 0x7f79dc103020 2024-06-02T23:59:51.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.027+0000 7f79d2ffd700 1 -- 172.21.15.49:0/2234980412 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f79d8004750 con 0x7f79dc103020 2024-06-02T23:59:51.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.028+0000 7f79d2ffd700 1 --2- 172.21.15.49:0/2234980412 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f79c80a2c20 0x7f79c80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:51.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.029+0000 7f79e1310700 1 --2- 172.21.15.49:0/2234980412 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f79c80a2c20 0x7f79c80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:51.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.029+0000 7f79d2ffd700 1 -- 172.21.15.49:0/2234980412 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f79d80cf130 con 0x7f79dc103020 2024-06-02T23:59:51.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.029+0000 7f79e1310700 1 --2- 172.21.15.49:0/2234980412 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f79c80a2c20 0x7f79c80a50e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f79cc005fd0 tx=0x7f79cc005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:51.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.032+0000 7f79d2ffd700 1 -- 172.21.15.49:0/2234980412 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f79d8014030 con 0x7f79dc103020 2024-06-02T23:59:51.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:50 smithi057 ceph-mon[36457]: pgmap v377: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:59:51.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.249+0000 7f79e3d75700 1 -- 172.21.15.49:0/2234980412 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f79dc0628d0 con 0x7f79c80a2c20 2024-06-02T23:59:51.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.251+0000 7f79d2ffd700 1 -- 172.21.15.49:0/2234980412 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f79dc0628d0 con 0x7f79c80a2c20 2024-06-02T23:59:51.250 INFO:teuthology.orchestra.run.smithi049.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-06-02T23:59:51.251 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB747500D2480DGN 447G No 4m ago Has a FileSystem, LVM detected 2024-06-02T23:59:51.251 INFO:teuthology.orchestra.run.smithi049.stdout:smithi057 /dev/nvme0n1 ssd INTEL_SSDPEDKE040T7_BTLE7361049H4P0KGN 3726G No 4m ago Has a FileSystem, LVM detected 2024-06-02T23:59:51.251 INFO:teuthology.orchestra.run.smithi049.stdout:smithi107 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400NK400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-06-02T23:59:51.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.253+0000 7f79e3d75700 1 -- 172.21.15.49:0/2234980412 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f79c80a2c20 msgr2=0x7f79c80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:51.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.253+0000 7f79e3d75700 1 --2- 172.21.15.49:0/2234980412 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f79c80a2c20 0x7f79c80a50e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f79cc005fd0 tx=0x7f79cc005e20 comp rx=0 tx=0).stop 2024-06-02T23:59:51.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.253+0000 7f79e3d75700 1 -- 172.21.15.49:0/2234980412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79dc103020 msgr2=0x7f79dc198690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:51.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.253+0000 7f79e3d75700 1 --2- 172.21.15.49:0/2234980412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79dc103020 0x7f79dc198690 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f79d800c950 tx=0x7f79d800cd10 comp rx=0 tx=0).stop 2024-06-02T23:59:51.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.253+0000 7f79e3d75700 1 -- 172.21.15.49:0/2234980412 shutdown_connections 2024-06-02T23:59:51.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.253+0000 7f79e3d75700 1 --2- 172.21.15.49:0/2234980412 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f79c80a2c20 0x7f79c80a50e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:51.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.253+0000 7f79e3d75700 1 --2- 172.21.15.49:0/2234980412 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79dc108280 0x7f79dc19fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:51.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.253+0000 7f79e3d75700 1 --2- 172.21.15.49:0/2234980412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79dc103020 0x7f79dc198690 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:51.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.253+0000 7f79e3d75700 1 --2- 172.21.15.49:0/2234980412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79dc105950 0x7f79dc198bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:51.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.253+0000 7f79e3d75700 1 -- 172.21.15.49:0/2234980412 >> 172.21.15.49:0/2234980412 conn(0x7f79dc0fc990 msgr2=0x7f79dc103980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:51.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.253+0000 7f79e3d75700 1 -- 172.21.15.49:0/2234980412 shutdown_connections 2024-06-02T23:59:51.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:51.253+0000 7f79e3d75700 1 -- 172.21.15.49:0/2234980412 wait complete. 2024-06-02T23:59:51.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:50 smithi107 ceph-mon[37048]: pgmap v377: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:59:51.911 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-06-02T23:59:51.920 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi049.front.sepia.ceph.com 2024-06-02T23:59:51.921 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- bash -c 'ceph fs dump' 2024-06-02T23:59:52.179 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:59:53.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:52 smithi049 ceph-mon[32302]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:59:53.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:52 smithi049 ceph-mon[32302]: pgmap v378: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:59:53.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:52 smithi107 ceph-mon[37048]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:59:53.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:52 smithi107 ceph-mon[37048]: pgmap v378: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:59:53.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:52 smithi057 ceph-mon[36457]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T23:59:53.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:52 smithi057 ceph-mon[36457]: pgmap v378: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T23:59:53.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.901+0000 7f610f2f2700 1 -- 172.21.15.49:0/2538006286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61081025f0 msgr2=0x7f6108102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:53.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.901+0000 7f610f2f2700 1 --2- 172.21.15.49:0/2538006286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61081025f0 0x7f6108102a50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f60fc0099c0 tx=0x7f60fc009cd0 comp rx=0 tx=0).stop 2024-06-02T23:59:53.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.901+0000 7f610f2f2700 1 -- 172.21.15.49:0/2538006286 shutdown_connections 2024-06-02T23:59:53.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.901+0000 7f610f2f2700 1 --2- 172.21.15.49:0/2538006286 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6108102f90 0x7f6108109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:53.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.901+0000 7f610f2f2700 1 --2- 172.21.15.49:0/2538006286 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61081013f0 0x7f6108101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:53.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.901+0000 7f610f2f2700 1 --2- 172.21.15.49:0/2538006286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61081025f0 0x7f6108102a50 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:53.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.901+0000 7f610f2f2700 1 -- 172.21.15.49:0/2538006286 >> 172.21.15.49:0/2538006286 conn(0x7f61080fc990 msgr2=0x7f61080fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:53.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.901+0000 7f610f2f2700 1 -- 172.21.15.49:0/2538006286 shutdown_connections 2024-06-02T23:59:53.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.901+0000 7f610f2f2700 1 -- 172.21.15.49:0/2538006286 wait complete. 2024-06-02T23:59:53.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.902+0000 7f610f2f2700 1 Processor -- start 2024-06-02T23:59:53.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.902+0000 7f610f2f2700 1 -- start start 2024-06-02T23:59:53.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.902+0000 7f610f2f2700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61081013f0 0x7f6108105380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:53.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.902+0000 7f610f2f2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61081025f0 0x7f61081039d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:53.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.902+0000 7f610f2f2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6108102f90 0x7f6108103f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:53.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.902+0000 7f610f2f2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f610810d0a0 con 0x7f61081025f0 2024-06-02T23:59:53.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.902+0000 7f610f2f2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f610810cf20 con 0x7f6108102f90 2024-06-02T23:59:53.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.902+0000 7f610f2f2700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f610810d220 con 0x7f61081013f0 2024-06-02T23:59:53.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.902+0000 7f610c88d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61081025f0 0x7f61081039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:53.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.902+0000 7f610c88d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61081025f0 0x7f61081039d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44588/0 (socket says 172.21.15.49:44588) 2024-06-02T23:59:53.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.902+0000 7f610c88d700 1 -- 172.21.15.49:0/4197984798 learned_addr learned my addr 172.21.15.49:0/4197984798 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:53.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.902+0000 7f610d08e700 1 --2- 172.21.15.49:0/4197984798 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61081013f0 0x7f6108105380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:53.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.902+0000 7f610d88f700 1 --2- 172.21.15.49:0/4197984798 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6108102f90 0x7f6108103f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:53.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.903+0000 7f610c88d700 1 -- 172.21.15.49:0/4197984798 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61081013f0 msgr2=0x7f6108105380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:53.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.903+0000 7f610c88d700 1 --2- 172.21.15.49:0/4197984798 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61081013f0 0x7f6108105380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:53.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.903+0000 7f610c88d700 1 -- 172.21.15.49:0/4197984798 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6108102f90 msgr2=0x7f6108103f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:53.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.903+0000 7f610c88d700 1 --2- 172.21.15.49:0/4197984798 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6108102f90 0x7f6108103f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:53.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.903+0000 7f610c88d700 1 -- 172.21.15.49:0/4197984798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61081047c0 con 0x7f61081025f0 2024-06-02T23:59:53.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.903+0000 7f610c88d700 1 --2- 172.21.15.49:0/4197984798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61081025f0 0x7f61081039d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f60fc00b580 tx=0x7f60fc0038b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:53.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.903+0000 7f61067fc700 1 -- 172.21.15.49:0/4197984798 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60fc027070 con 0x7f61081025f0 2024-06-02T23:59:53.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.903+0000 7f61067fc700 1 -- 172.21.15.49:0/4197984798 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60fc004150 con 0x7f61081025f0 2024-06-02T23:59:53.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.903+0000 7f610f2f2700 1 -- 172.21.15.49:0/4197984798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61081a29c0 con 0x7f61081025f0 2024-06-02T23:59:53.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.903+0000 7f61067fc700 1 -- 172.21.15.49:0/4197984798 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60fc00f460 con 0x7f61081025f0 2024-06-02T23:59:53.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.903+0000 7f610f2f2700 1 -- 172.21.15.49:0/4197984798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61081a2e90 con 0x7f61081025f0 2024-06-02T23:59:53.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.904+0000 7f610f2f2700 1 -- 172.21.15.49:0/4197984798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61080691b0 con 0x7f61081025f0 2024-06-02T23:59:53.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.905+0000 7f61067fc700 1 -- 172.21.15.49:0/4197984798 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f60fc02a070 con 0x7f61081025f0 2024-06-02T23:59:53.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.906+0000 7f61067fc700 1 --2- 172.21.15.49:0/4197984798 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f60f00a2ca0 0x7f60f00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:53.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.906+0000 7f610d08e700 1 --2- 172.21.15.49:0/4197984798 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f60f00a2ca0 0x7f60f00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:53.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.907+0000 7f61067fc700 1 -- 172.21.15.49:0/4197984798 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f60fc0cff20 con 0x7f61081025f0 2024-06-02T23:59:53.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.907+0000 7f610d08e700 1 --2- 172.21.15.49:0/4197984798 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f60f00a2ca0 0x7f60f00a5160 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6108102450 tx=0x7f60f800d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:53.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:53.911+0000 7f61067fc700 1 -- 172.21.15.49:0/4197984798 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f60fc05e850 con 0x7f61081025f0 2024-06-02T23:59:54.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:54.164+0000 7f610f2f2700 1 -- 172.21.15.49:0/4197984798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f61081a3110 con 0x7f61081025f0 2024-06-02T23:59:54.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:54.165+0000 7f61067fc700 1 -- 172.21.15.49:0/4197984798 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+3089 (secure 0 0 0) 0x7f61080691b0 con 0x7f61081025f0 2024-06-02T23:59:54.165 INFO:teuthology.orchestra.run.smithi049.stdout:e26 2024-06-02T23:59:54.165 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T23:59:54.165 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-02T23:59:54.166 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-06-02T23:59:54.166 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:59:54.166 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-06-02T23:59:54.166 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-06-02T23:59:54.166 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 26 2024-06-02T23:59:54.166 INFO:teuthology.orchestra.run.smithi049.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-06-02T23:59:54.166 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-06-02T23:57:16.991201+0000 2024-06-02T23:59:54.167 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-06-02T23:57:35.219435+0000 2024-06-02T23:59:54.167 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-06-02T23:59:54.167 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-06-02T23:59:54.167 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 300 2024-06-02T23:59:54.167 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-06-02T23:59:54.167 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-06-02T23:59:54.167 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-06-02T23:59:54.167 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-06-02T23:59:54.167 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-06-02T23:59:54.167 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 0 2024-06-02T23:59:54.167 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-02T23:59:54.167 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 5 2024-06-02T23:59:54.167 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1,2,3,4 2024-06-02T23:59:54.167 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=24487,1=24485,2=24466,3=24464,4=24460} 2024-06-02T23:59:54.168 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-06-02T23:59:54.168 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-06-02T23:59:54.168 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-06-02T23:59:54.168 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-06-02T23:59:54.168 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-06-02T23:59:54.168 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-06-02T23:59:54.168 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-06-02T23:59:54.168 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-06-02T23:59:54.168 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 0 2024-06-02T23:59:54.168 INFO:teuthology.orchestra.run.smithi049.stdout:qdb_cluster leader: 24487 members: 24466,24487,24460,24464,24485 2024-06-02T23:59:54.168 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.i{0:24487} state up:active seq 8 addr [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T23:59:54.168 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.e{0:24440} state up:standby-replay seq 1 addr [v2:172.21.15.57:6834/2254905671,v1:172.21.15.57:6835/2254905671] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T23:59:54.168 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.b{1:24485} state up:active seq 8 addr [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T23:59:54.168 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.l{1:24418} state up:standby-replay seq 1 addr [v2:172.21.15.107:6832/2662998293,v1:172.21.15.107:6833/2662998293] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T23:59:54.169 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.c{2:24466} state up:active seq 12 addr [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T23:59:54.169 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.k{2:24416} state up:standby-replay seq 1 addr [v2:172.21.15.57:6832/1633534002,v1:172.21.15.57:6833/1633534002] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T23:59:54.169 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.h{3:24464} state up:active seq 12 addr [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T23:59:54.169 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.a{3:14610} state up:standby-replay seq 1 addr [v2:172.21.15.49:6840/1902772235,v1:172.21.15.49:6841/1902772235] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T23:59:54.169 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.f{4:24460} state up:active seq 13 addr [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T23:59:54.169 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.g{4:14598} state up:standby-replay seq 1 addr [v2:172.21.15.49:6838/1729124617,v1:172.21.15.49:6839/1729124617] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T23:59:54.169 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:59:54.169 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:59:54.169 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-06-02T23:59:54.169 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:59:54.169 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.j{-1:14538} state up:standby seq 1 addr [v2:172.21.15.49:6834/1553264866,v1:172.21.15.49:6835/1553264866] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T23:59:54.170 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.d{-1:14550} state up:standby seq 1 addr [v2:172.21.15.49:6836/2266285252,v1:172.21.15.49:6837/2266285252] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T23:59:54.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:54.167+0000 7f610f2f2700 1 -- 172.21.15.49:0/4197984798 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f60f00a2ca0 msgr2=0x7f60f00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:54.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:54.167+0000 7f610f2f2700 1 --2- 172.21.15.49:0/4197984798 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f60f00a2ca0 0x7f60f00a5160 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6108102450 tx=0x7f60f800d040 comp rx=0 tx=0).stop 2024-06-02T23:59:54.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:54.167+0000 7f610f2f2700 1 -- 172.21.15.49:0/4197984798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61081025f0 msgr2=0x7f61081039d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:54.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:54.167+0000 7f610f2f2700 1 --2- 172.21.15.49:0/4197984798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61081025f0 0x7f61081039d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f60fc00b580 tx=0x7f60fc0038b0 comp rx=0 tx=0).stop 2024-06-02T23:59:54.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:54.167+0000 7f610f2f2700 1 -- 172.21.15.49:0/4197984798 shutdown_connections 2024-06-02T23:59:54.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:54.167+0000 7f610f2f2700 1 --2- 172.21.15.49:0/4197984798 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f60f00a2ca0 0x7f60f00a5160 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:54.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:54.167+0000 7f610f2f2700 1 --2- 172.21.15.49:0/4197984798 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6108102f90 0x7f6108103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:54.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:54.167+0000 7f610f2f2700 1 --2- 172.21.15.49:0/4197984798 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61081013f0 0x7f6108105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:54.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:54.167+0000 7f610f2f2700 1 --2- 172.21.15.49:0/4197984798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61081025f0 0x7f61081039d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:54.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:54.167+0000 7f610f2f2700 1 -- 172.21.15.49:0/4197984798 >> 172.21.15.49:0/4197984798 conn(0x7f61080fc990 msgr2=0x7f61080fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:54.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:54.167+0000 7f610f2f2700 1 -- 172.21.15.49:0/4197984798 shutdown_connections 2024-06-02T23:59:54.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:54.167+0000 7f610f2f2700 1 -- 172.21.15.49:0/4197984798 wait complete. 2024-06-02T23:59:54.172 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-06-02T23:59:54.844 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- bash -c 'ceph osd dump' 2024-06-02T23:59:55.098 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:59:55.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:54 smithi049 ceph-mon[32302]: pgmap v379: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-02T23:59:55.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:54 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/4197984798' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:59:55.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:54 smithi107 ceph-mon[37048]: pgmap v379: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-02T23:59:55.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:54 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/4197984798' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:59:55.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:54 smithi057 ceph-mon[36457]: pgmap v379: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-02T23:59:55.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:54 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/4197984798' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T23:59:56.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.747+0000 7fa065717700 1 -- 172.21.15.49:0/2504245023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa060102f90 msgr2=0x7fa060109840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:56.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.747+0000 7fa065717700 1 --2- 172.21.15.49:0/2504245023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa060102f90 0x7fa060109840 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa05800b0d0 tx=0x7fa05800b3e0 comp rx=0 tx=0).stop 2024-06-02T23:59:56.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.747+0000 7fa065717700 1 -- 172.21.15.49:0/2504245023 shutdown_connections 2024-06-02T23:59:56.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.747+0000 7fa065717700 1 --2- 172.21.15.49:0/2504245023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa060102f90 0x7fa060109840 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:56.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.747+0000 7fa065717700 1 --2- 172.21.15.49:0/2504245023 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0601013f0 0x7fa060101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:56.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.747+0000 7fa065717700 1 --2- 172.21.15.49:0/2504245023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0601025f0 0x7fa060102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:56.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.747+0000 7fa065717700 1 -- 172.21.15.49:0/2504245023 >> 172.21.15.49:0/2504245023 conn(0x7fa0600fc990 msgr2=0x7fa0600fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:56.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.747+0000 7fa065717700 1 -- 172.21.15.49:0/2504245023 shutdown_connections 2024-06-02T23:59:56.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.747+0000 7fa065717700 1 -- 172.21.15.49:0/2504245023 wait complete. 2024-06-02T23:59:56.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.748+0000 7fa065717700 1 Processor -- start 2024-06-02T23:59:56.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.748+0000 7fa065717700 1 -- start start 2024-06-02T23:59:56.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.749+0000 7fa065717700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0601013f0 0x7fa06006b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:56.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.749+0000 7fa065717700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0601025f0 0x7fa06019d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:56.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.749+0000 7fa065717700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa060102f90 0x7fa06019fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:56.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.749+0000 7fa065717700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa06010d0a0 con 0x7fa0601013f0 2024-06-02T23:59:56.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.749+0000 7fa065717700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa06010cf20 con 0x7fa060102f90 2024-06-02T23:59:56.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.749+0000 7fa065717700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa06010d220 con 0x7fa0601025f0 2024-06-02T23:59:56.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.749+0000 7fa05effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0601013f0 0x7fa06006b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:56.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.749+0000 7fa05effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0601013f0 0x7fa06006b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44618/0 (socket says 172.21.15.49:44618) 2024-06-02T23:59:56.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.749+0000 7fa05effd700 1 -- 172.21.15.49:0/4038877483 learned_addr learned my addr 172.21.15.49:0/4038877483 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:56.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.749+0000 7fa05e7fc700 1 --2- 172.21.15.49:0/4038877483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0601025f0 0x7fa06019d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:56.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.749+0000 7fa05f7fe700 1 --2- 172.21.15.49:0/4038877483 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa060102f90 0x7fa06019fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:56.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.749+0000 7fa05effd700 1 -- 172.21.15.49:0/4038877483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0601025f0 msgr2=0x7fa06019d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:56.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.749+0000 7fa05effd700 1 --2- 172.21.15.49:0/4038877483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0601025f0 0x7fa06019d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:56.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.749+0000 7fa05effd700 1 -- 172.21.15.49:0/4038877483 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa060102f90 msgr2=0x7fa06019fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:56.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.749+0000 7fa05effd700 1 --2- 172.21.15.49:0/4038877483 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa060102f90 0x7fa06019fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:56.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.749+0000 7fa05effd700 1 -- 172.21.15.49:0/4038877483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0601a0390 con 0x7fa0601013f0 2024-06-02T23:59:56.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.749+0000 7fa05effd700 1 --2- 172.21.15.49:0/4038877483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0601013f0 0x7fa06006b720 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa05000c8f0 tx=0x7fa05000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:56.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.749+0000 7fa047fff700 1 -- 172.21.15.49:0/4038877483 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa050004220 con 0x7fa0601013f0 2024-06-02T23:59:56.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.750+0000 7fa065717700 1 -- 172.21.15.49:0/4038877483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0601a0680 con 0x7fa0601013f0 2024-06-02T23:59:56.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.750+0000 7fa047fff700 1 -- 172.21.15.49:0/4038877483 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0500043c0 con 0x7fa0601013f0 2024-06-02T23:59:56.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.750+0000 7fa047fff700 1 -- 172.21.15.49:0/4038877483 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa050003c90 con 0x7fa0601013f0 2024-06-02T23:59:56.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.750+0000 7fa065717700 1 -- 172.21.15.49:0/4038877483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0601a0c40 con 0x7fa0601013f0 2024-06-02T23:59:56.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.751+0000 7fa065717700 1 -- 172.21.15.49:0/4038877483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa060069180 con 0x7fa0601013f0 2024-06-02T23:59:56.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.752+0000 7fa047fff700 1 -- 172.21.15.49:0/4038877483 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa0500076d0 con 0x7fa0601013f0 2024-06-02T23:59:56.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.753+0000 7fa047fff700 1 --2- 172.21.15.49:0/4038877483 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa0480a2ca0 0x7fa0480a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:56.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.753+0000 7fa05e7fc700 1 --2- 172.21.15.49:0/4038877483 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa0480a2ca0 0x7fa0480a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:56.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.753+0000 7fa047fff700 1 -- 172.21.15.49:0/4038877483 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fa0500ceb60 con 0x7fa0601013f0 2024-06-02T23:59:56.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.753+0000 7fa05e7fc700 1 --2- 172.21.15.49:0/4038877483 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa0480a2ca0 0x7fa0480a5160 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa06006bca0 tx=0x7fa054009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:56.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.757+0000 7fa047fff700 1 -- 172.21.15.49:0/4038877483 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa050014030 con 0x7fa0601013f0 2024-06-02T23:59:56.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.966+0000 7fa065717700 1 -- 172.21.15.49:0/4038877483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fa0600630a0 con 0x7fa0601013f0 2024-06-02T23:59:56.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.967+0000 7fa047fff700 1 -- 172.21.15.49:0/4038877483 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v90) ==== 56+0+5278 (secure 0 0 0) 0x7fa05009bac0 con 0x7fa0601013f0 2024-06-02T23:59:56.967 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 90 2024-06-02T23:59:56.967 INFO:teuthology.orchestra.run.smithi049.stdout:fsid 890dd222-213a-11ef-bc9b-c7b262605968 2024-06-02T23:59:56.967 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-06-02T23:48:53.323536+0000 2024-06-02T23:59:56.967 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-06-02T23:57:56.520324+0000 2024-06-02T23:59:56.967 INFO:teuthology.orchestra.run.smithi049.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-06-02T23:59:56.967 INFO:teuthology.orchestra.run.smithi049.stdout:crush_version 26 2024-06-02T23:59:56.967 INFO:teuthology.orchestra.run.smithi049.stdout:full_ratio 0.95 2024-06-02T23:59:56.967 INFO:teuthology.orchestra.run.smithi049.stdout:backfillfull_ratio 0.9 2024-06-02T23:59:56.968 INFO:teuthology.orchestra.run.smithi049.stdout:nearfull_ratio 0.85 2024-06-02T23:59:56.968 INFO:teuthology.orchestra.run.smithi049.stdout:require_min_compat_client luminous 2024-06-02T23:59:56.968 INFO:teuthology.orchestra.run.smithi049.stdout:min_compat_client luminous 2024-06-02T23:59:56.968 INFO:teuthology.orchestra.run.smithi049.stdout:require_osd_release squid 2024-06-02T23:59:56.968 INFO:teuthology.orchestra.run.smithi049.stdout:stretch_mode_enabled false 2024-06-02T23:59:56.968 INFO:teuthology.orchestra.run.smithi049.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-06-02T23:59:56.968 INFO:teuthology.orchestra.run.smithi049.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 88 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-06-02T23:59:56.968 INFO:teuthology.orchestra.run.smithi049.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 88 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-06-02T23:59:56.968 INFO:teuthology.orchestra.run.smithi049.stdout:max_osd 12 2024-06-02T23:59:56.968 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 up in weight 1 up_from 8 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.49:6802/811647073,v1:172.21.15.49:6803/811647073] [v2:172.21.15.49:6804/811647073,v1:172.21.15.49:6805/811647073] exists,up e0013e80-07d6-4ad3-87d8-d41988988ef5 2024-06-02T23:59:56.968 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 up in weight 1 up_from 13 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.57:6800/1260507785,v1:172.21.15.57:6801/1260507785] [v2:172.21.15.57:6802/1260507785,v1:172.21.15.57:6803/1260507785] exists,up f37d9f79-e349-4de7-81e7-385ddb905f58 2024-06-02T23:59:56.968 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 up in weight 1 up_from 18 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.107:6800/303899951,v1:172.21.15.107:6801/303899951] [v2:172.21.15.107:6802/303899951,v1:172.21.15.107:6803/303899951] exists,up 94889281-7d45-4e78-9d37-b98e3fbe8494 2024-06-02T23:59:56.968 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 up in weight 1 up_from 25 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.49:6810/60796312,v1:172.21.15.49:6811/60796312] [v2:172.21.15.49:6812/60796312,v1:172.21.15.49:6813/60796312] exists,up 31f4c18c-fbda-400d-8b3b-0955b0c4a6a4 2024-06-02T23:59:56.969 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 up in weight 1 up_from 33 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.57:6808/3106842986,v1:172.21.15.57:6809/3106842986] [v2:172.21.15.57:6810/3106842986,v1:172.21.15.57:6811/3106842986] exists,up 8076c2f3-0138-459e-89b5-c5c4586a14ee 2024-06-02T23:59:56.969 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 up in weight 1 up_from 38 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.107:6808/389294142,v1:172.21.15.107:6809/389294142] [v2:172.21.15.107:6810/389294142,v1:172.21.15.107:6811/389294142] exists,up 68f7abd3-4292-41fa-90ce-4ac34ea2b964 2024-06-02T23:59:56.969 INFO:teuthology.orchestra.run.smithi049.stdout:osd.6 up in weight 1 up_from 46 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.49:6818/894624552,v1:172.21.15.49:6819/894624552] [v2:172.21.15.49:6820/894624552,v1:172.21.15.49:6821/894624552] exists,up c0345dd0-71b7-436d-88f8-fe3d7cb69d8e 2024-06-02T23:59:56.969 INFO:teuthology.orchestra.run.smithi049.stdout:osd.7 up in weight 1 up_from 51 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.57:6816/3126027900,v1:172.21.15.57:6817/3126027900] [v2:172.21.15.57:6818/3126027900,v1:172.21.15.57:6819/3126027900] exists,up 9abd81c7-dcc1-4e14-8ab7-9fa0746067ba 2024-06-02T23:59:56.969 INFO:teuthology.orchestra.run.smithi049.stdout:osd.8 up in weight 1 up_from 59 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.107:6816/3620047229,v1:172.21.15.107:6817/3620047229] [v2:172.21.15.107:6818/3620047229,v1:172.21.15.107:6819/3620047229] exists,up 80532119-5de8-45d2-9cb9-bd8a6194199b 2024-06-02T23:59:56.969 INFO:teuthology.orchestra.run.smithi049.stdout:osd.9 up in weight 1 up_from 67 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.49:6826/3627936526,v1:172.21.15.49:6827/3627936526] [v2:172.21.15.49:6828/3627936526,v1:172.21.15.49:6829/3627936526] exists,up f0b5dcfa-9fd2-4a98-863b-197defa890af 2024-06-02T23:59:56.969 INFO:teuthology.orchestra.run.smithi049.stdout:osd.10 up in weight 1 up_from 72 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.57:6824/3013235811,v1:172.21.15.57:6825/3013235811] [v2:172.21.15.57:6826/3013235811,v1:172.21.15.57:6827/3013235811] exists,up 21a75846-adec-41b8-9e1d-e5c61ba30b12 2024-06-02T23:59:56.969 INFO:teuthology.orchestra.run.smithi049.stdout:osd.11 up in weight 1 up_from 80 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.107:6824/4217534517,v1:172.21.15.107:6825/4217534517] [v2:172.21.15.107:6826/4217534517,v1:172.21.15.107:6827/4217534517] exists,up eb963b63-2c61-4169-b8fe-31c7f5ec919d 2024-06-02T23:59:56.969 INFO:teuthology.orchestra.run.smithi049.stdout:pg_upmap_items 2.6 [8,11] 2024-06-02T23:59:56.969 INFO:teuthology.orchestra.run.smithi049.stdout:pg_upmap_items 2.b [2,4] 2024-06-02T23:59:56.969 INFO:teuthology.orchestra.run.smithi049.stdout:pg_upmap_items 2.e [2,1] 2024-06-02T23:59:56.969 INFO:teuthology.orchestra.run.smithi049.stdout:pg_upmap_items 2.1d [8,11] 2024-06-02T23:59:56.969 INFO:teuthology.orchestra.run.smithi049.stdout:pg_upmap_items 3.0 [4,8] 2024-06-02T23:59:56.970 INFO:teuthology.orchestra.run.smithi049.stdout:pg_upmap_items 3.1 [4,9] 2024-06-02T23:59:56.970 INFO:teuthology.orchestra.run.smithi049.stdout:pg_upmap_items 3.11 [4,6] 2024-06-02T23:59:56.970 INFO:teuthology.orchestra.run.smithi049.stdout:pg_upmap_items 3.21 [5,9] 2024-06-02T23:59:56.970 INFO:teuthology.orchestra.run.smithi049.stdout:pg_upmap_items 3.3b [3,9] 2024-06-02T23:59:56.970 INFO:teuthology.orchestra.run.smithi049.stdout:blocklist 172.21.15.49:0/525944311 expires 2024-06-03T23:49:55.151590+0000 2024-06-02T23:59:56.970 INFO:teuthology.orchestra.run.smithi049.stdout:blocklist 172.21.15.49:0/1841969299 expires 2024-06-03T23:49:55.151590+0000 2024-06-02T23:59:56.970 INFO:teuthology.orchestra.run.smithi049.stdout:blocklist 172.21.15.49:0/1880506696 expires 2024-06-03T23:49:55.151590+0000 2024-06-02T23:59:56.970 INFO:teuthology.orchestra.run.smithi049.stdout:blocklist 172.21.15.49:6801/1206062338 expires 2024-06-03T23:49:55.151590+0000 2024-06-02T23:59:56.970 INFO:teuthology.orchestra.run.smithi049.stdout:blocklist 172.21.15.49:6800/549058216 expires 2024-06-03T23:49:29.042670+0000 2024-06-02T23:59:56.970 INFO:teuthology.orchestra.run.smithi049.stdout:blocklist 172.21.15.49:0/2112783954 expires 2024-06-03T23:49:29.042670+0000 2024-06-02T23:59:56.970 INFO:teuthology.orchestra.run.smithi049.stdout:blocklist 172.21.15.49:0/2183920213 expires 2024-06-03T23:49:29.042670+0000 2024-06-02T23:59:56.970 INFO:teuthology.orchestra.run.smithi049.stdout:blocklist 172.21.15.49:6801/549058216 expires 2024-06-03T23:49:29.042670+0000 2024-06-02T23:59:56.970 INFO:teuthology.orchestra.run.smithi049.stdout:blocklist 172.21.15.49:0/3350970308 expires 2024-06-03T23:49:29.042670+0000 2024-06-02T23:59:56.970 INFO:teuthology.orchestra.run.smithi049.stdout:blocklist 172.21.15.49:6800/1206062338 expires 2024-06-03T23:49:55.151590+0000 2024-06-02T23:59:56.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.969+0000 7fa065717700 1 -- 172.21.15.49:0/4038877483 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa0480a2ca0 msgr2=0x7fa0480a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:56.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.969+0000 7fa065717700 1 --2- 172.21.15.49:0/4038877483 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa0480a2ca0 0x7fa0480a5160 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa06006bca0 tx=0x7fa054009190 comp rx=0 tx=0).stop 2024-06-02T23:59:56.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.969+0000 7fa065717700 1 -- 172.21.15.49:0/4038877483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0601013f0 msgr2=0x7fa06006b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:56.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.969+0000 7fa065717700 1 --2- 172.21.15.49:0/4038877483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0601013f0 0x7fa06006b720 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa05000c8f0 tx=0x7fa05000cc00 comp rx=0 tx=0).stop 2024-06-02T23:59:56.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.969+0000 7fa065717700 1 -- 172.21.15.49:0/4038877483 shutdown_connections 2024-06-02T23:59:56.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.969+0000 7fa065717700 1 --2- 172.21.15.49:0/4038877483 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa0480a2ca0 0x7fa0480a5160 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:56.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.969+0000 7fa065717700 1 --2- 172.21.15.49:0/4038877483 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa060102f90 0x7fa06019fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:56.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.969+0000 7fa065717700 1 --2- 172.21.15.49:0/4038877483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0601013f0 0x7fa06006b720 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:56.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.969+0000 7fa065717700 1 --2- 172.21.15.49:0/4038877483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0601025f0 0x7fa06019d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:56.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.969+0000 7fa065717700 1 -- 172.21.15.49:0/4038877483 >> 172.21.15.49:0/4038877483 conn(0x7fa0600fc990 msgr2=0x7fa060105890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:56.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.970+0000 7fa065717700 1 -- 172.21.15.49:0/4038877483 shutdown_connections 2024-06-02T23:59:56.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:56.970+0000 7fa065717700 1 -- 172.21.15.49:0/4038877483 wait complete. 2024-06-02T23:59:57.214 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:56 smithi049 ceph-mon[32302]: pgmap v380: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-06-02T23:59:57.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:56 smithi107 ceph-mon[37048]: pgmap v380: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-06-02T23:59:57.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:56 smithi057 ceph-mon[36457]: pgmap v380: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-06-02T23:59:57.701 INFO:teuthology.run_tasks:Running task fs.ready... 2024-06-02T23:59:57.712 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T23:59:57.962 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T23:59:58.234 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:57 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/4038877483' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-06-02T23:59:58.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:57 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/4038877483' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-06-02T23:59:58.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:57 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/4038877483' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-06-02T23:59:59.226 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:58 smithi049 ceph-mon[32302]: pgmap v381: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-06-02T23:59:59.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:58 smithi107 ceph-mon[37048]: pgmap v381: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-06-02T23:59:59.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:58 smithi057 ceph-mon[36457]: pgmap v381: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-06-02T23:59:59.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.602+0000 7f3e1ff90700 1 -- 172.21.15.49:0/2122826952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e18102770 msgr2=0x7f3e18102b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:59.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.602+0000 7f3e1ff90700 1 --2- 172.21.15.49:0/2122826952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e18102770 0x7f3e18102b50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3e140099c0 tx=0x7f3e14009cd0 comp rx=0 tx=0).stop 2024-06-02T23:59:59.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.602+0000 7f3e1ff90700 1 -- 172.21.15.49:0/2122826952 shutdown_connections 2024-06-02T23:59:59.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.602+0000 7f3e1ff90700 1 --2- 172.21.15.49:0/2122826952 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e18107860 0x7f3e1810f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:59.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.602+0000 7f3e1ff90700 1 --2- 172.21.15.49:0/2122826952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e18102770 0x7f3e18102b50 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:59.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.602+0000 7f3e1ff90700 1 --2- 172.21.15.49:0/2122826952 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e18103120 0x7f3e18107130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:59.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.602+0000 7f3e1ff90700 1 -- 172.21.15.49:0/2122826952 >> 172.21.15.49:0/2122826952 conn(0x7f3e18079600 msgr2=0x7f3e18079a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:59.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.603+0000 7f3e1ff90700 1 -- 172.21.15.49:0/2122826952 shutdown_connections 2024-06-02T23:59:59.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.603+0000 7f3e1ff90700 1 -- 172.21.15.49:0/2122826952 wait complete. 2024-06-02T23:59:59.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.603+0000 7f3e1ff90700 1 Processor -- start 2024-06-02T23:59:59.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.603+0000 7f3e1ff90700 1 -- start start 2024-06-02T23:59:59.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.603+0000 7f3e1ff90700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e18102770 0x7f3e1819e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:59.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.603+0000 7f3e1ff90700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e18103120 0x7f3e1819ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:59.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.603+0000 7f3e1ff90700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e18107860 0x7f3e18198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:59.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.603+0000 7f3e1ff90700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3e18112870 con 0x7f3e18102770 2024-06-02T23:59:59.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.603+0000 7f3e1ff90700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3e181126f0 con 0x7f3e18103120 2024-06-02T23:59:59.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.603+0000 7f3e1ff90700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3e181129f0 con 0x7f3e18107860 2024-06-02T23:59:59.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.603+0000 7f3e1dd2c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e18102770 0x7f3e1819e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:59.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.603+0000 7f3e1dd2c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e18102770 0x7f3e1819e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44650/0 (socket says 172.21.15.49:44650) 2024-06-02T23:59:59.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.603+0000 7f3e1dd2c700 1 -- 172.21.15.49:0/1066501386 learned_addr learned my addr 172.21.15.49:0/1066501386 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-02T23:59:59.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.604+0000 7f3e1e52d700 1 --2- 172.21.15.49:0/1066501386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e18107860 0x7f3e18198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:59.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.604+0000 7f3e1d52b700 1 --2- 172.21.15.49:0/1066501386 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e18103120 0x7f3e1819ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:59.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.604+0000 7f3e1dd2c700 1 -- 172.21.15.49:0/1066501386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e18107860 msgr2=0x7f3e18198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:59.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.604+0000 7f3e1dd2c700 1 --2- 172.21.15.49:0/1066501386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e18107860 0x7f3e18198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:59.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.604+0000 7f3e1dd2c700 1 -- 172.21.15.49:0/1066501386 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e18103120 msgr2=0x7f3e1819ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:59.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.604+0000 7f3e1dd2c700 1 --2- 172.21.15.49:0/1066501386 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e18103120 0x7f3e1819ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:59.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.604+0000 7f3e1dd2c700 1 -- 172.21.15.49:0/1066501386 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e18199210 con 0x7f3e18102770 2024-06-02T23:59:59.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.604+0000 7f3e1dd2c700 1 --2- 172.21.15.49:0/1066501386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e18102770 0x7f3e1819e8f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3e14009990 tx=0x7f3e14009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:59.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.604+0000 7f3e0effd700 1 -- 172.21.15.49:0/1066501386 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e14026070 con 0x7f3e18102770 2024-06-02T23:59:59.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.604+0000 7f3e0effd700 1 -- 172.21.15.49:0/1066501386 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e14003780 con 0x7f3e18102770 2024-06-02T23:59:59.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.604+0000 7f3e1ff90700 1 -- 172.21.15.49:0/1066501386 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e181994a0 con 0x7f3e18102770 2024-06-02T23:59:59.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.604+0000 7f3e0effd700 1 -- 172.21.15.49:0/1066501386 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1400fc90 con 0x7f3e18102770 2024-06-02T23:59:59.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.604+0000 7f3e1ff90700 1 -- 172.21.15.49:0/1066501386 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e181a57c0 con 0x7f3e18102770 2024-06-02T23:59:59.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.605+0000 7f3e1ff90700 1 -- 172.21.15.49:0/1066501386 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e18069180 con 0x7f3e18102770 2024-06-02T23:59:59.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.606+0000 7f3e0effd700 1 -- 172.21.15.49:0/1066501386 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3e14029070 con 0x7f3e18102770 2024-06-02T23:59:59.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.607+0000 7f3e0effd700 1 --2- 172.21.15.49:0/1066501386 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3e040a2ca0 0x7f3e040a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:59.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.607+0000 7f3e1d52b700 1 --2- 172.21.15.49:0/1066501386 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3e040a2ca0 0x7f3e040a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:59.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.607+0000 7f3e0effd700 1 -- 172.21.15.49:0/1066501386 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f3e140cfa10 con 0x7f3e18102770 2024-06-02T23:59:59.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.608+0000 7f3e1d52b700 1 --2- 172.21.15.49:0/1066501386 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3e040a2ca0 0x7f3e040a5160 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3e08005950 tx=0x7f3e080058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:59.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.611+0000 7f3e0effd700 1 -- 172.21.15.49:0/1066501386 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3e1405d850 con 0x7f3e18102770 2024-06-02T23:59:59.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.865+0000 7f3e1ff90700 1 -- 172.21.15.49:0/1066501386 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e18199fe0 con 0x7f3e18102770 2024-06-02T23:59:59.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.865+0000 7f3e0effd700 1 -- 172.21.15.49:0/1066501386 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11929 (secure 0 0 0) 0x7f3e14013070 con 0x7f3e18102770 2024-06-02T23:59:59.866 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-02T23:59:59.866 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1553264866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1553264866},{"type":"v1","addr":"172.21.15.49:6835","nonce":1553264866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2266285252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2266285252},{"type":"v1","addr":"172.21.15.49:6837","nonce":2266285252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T23:57:16.991201+0000","modified":"2024-06-02T23:57:35.219435+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24485,"mds_2":24466,"mds_3":24464,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6839/1729124617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":1729124617},{"type":"v1","addr":"172.21.15.49:6839","nonce":1729124617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6841/1902772235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":1902772235},{"type":"v1","addr":"172.21.15.49:6841","nonce":1902772235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6833/1633534002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1633534002},{"type":"v1","addr":"172.21.15.57:6833","nonce":1633534002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6835/2254905671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2254905671},{"type":"v1","addr":"172.21.15.57:6835","nonce":2254905671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.107:6835/3693542801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3693542801},{"type":"v1","addr":"172.21.15.107:6835","nonce":3693542801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.57:6837/230452144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":230452144},{"type":"v1","addr":"172.21.15.57:6837","nonce":230452144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.107:6837/3700593315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":3700593315},{"type":"v1","addr":"172.21.15.107:6837","nonce":3700593315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6839/249825195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":249825195},{"type":"v1","addr":"172.21.15.57:6839","nonce":249825195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6839/1986600681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1986600681},{"type":"v1","addr":"172.21.15.107:6839","nonce":1986600681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24466,24487,24460,24464,24485]},"id":1}]} 2024-06-02T23:59:59.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.867+0000 7f3e1ff90700 1 -- 172.21.15.49:0/1066501386 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3e040a2ca0 msgr2=0x7f3e040a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:59.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.867+0000 7f3e1ff90700 1 --2- 172.21.15.49:0/1066501386 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3e040a2ca0 0x7f3e040a5160 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3e08005950 tx=0x7f3e080058e0 comp rx=0 tx=0).stop 2024-06-02T23:59:59.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.867+0000 7f3e1ff90700 1 -- 172.21.15.49:0/1066501386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e18102770 msgr2=0x7f3e1819e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:59.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.867+0000 7f3e1ff90700 1 --2- 172.21.15.49:0/1066501386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e18102770 0x7f3e1819e8f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3e14009990 tx=0x7f3e14009f80 comp rx=0 tx=0).stop 2024-06-02T23:59:59.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.868+0000 7f3e1ff90700 1 -- 172.21.15.49:0/1066501386 shutdown_connections 2024-06-02T23:59:59.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.868+0000 7f3e1ff90700 1 --2- 172.21.15.49:0/1066501386 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3e040a2ca0 0x7f3e040a5160 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:59.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.868+0000 7f3e1ff90700 1 --2- 172.21.15.49:0/1066501386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e18107860 0x7f3e18198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:59.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.868+0000 7f3e1ff90700 1 --2- 172.21.15.49:0/1066501386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3e18102770 0x7f3e1819e8f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:59.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.868+0000 7f3e1ff90700 1 --2- 172.21.15.49:0/1066501386 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e18103120 0x7f3e1819ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:59.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.868+0000 7f3e1ff90700 1 -- 172.21.15.49:0/1066501386 >> 172.21.15.49:0/1066501386 conn(0x7f3e18079600 msgr2=0x7f3e18101c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:59.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.868+0000 7f3e1ff90700 1 -- 172.21.15.49:0/1066501386 shutdown_connections 2024-06-02T23:59:59.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-02T23:59:59.868+0000 7f3e1ff90700 1 -- 172.21.15.49:0/1066501386 wait complete. 2024-06-02T23:59:59.870 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-06-03T00:00:00.131 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 02 23:59:59 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/1066501386' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:00:00.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 02 23:59:59 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/1066501386' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:00:00.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 02 23:59:59 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/1066501386' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:00:01.000 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-03T00:00:01.259 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:00:01.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:00 smithi107 ceph-mon[37048]: pgmap v382: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-03T00:00:01.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:00 smithi107 ceph-mon[37048]: overall HEALTH_OK 2024-06-03T00:00:01.382 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:00 smithi049 ceph-mon[32302]: pgmap v382: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-03T00:00:01.382 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:00 smithi049 ceph-mon[32302]: overall HEALTH_OK 2024-06-03T00:00:01.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:00 smithi057 ceph-mon[36457]: pgmap v382: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-03T00:00:01.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:00 smithi057 ceph-mon[36457]: overall HEALTH_OK 2024-06-03T00:00:03.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.056+0000 7f50e310f700 1 -- 172.21.15.49:0/2147112044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50dc06a170 msgr2=0x7f50dc06a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:03.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.056+0000 7f50e310f700 1 --2- 172.21.15.49:0/2147112044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50dc06a170 0x7f50dc06a5f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f50d8009990 tx=0x7f50d8009ca0 comp rx=0 tx=0).stop 2024-06-03T00:00:03.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.056+0000 7f50e310f700 1 -- 172.21.15.49:0/2147112044 shutdown_connections 2024-06-03T00:00:03.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.056+0000 7f50e310f700 1 --2- 172.21.15.49:0/2147112044 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50dc06ab30 0x7f50dc10f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:03.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.056+0000 7f50e310f700 1 --2- 172.21.15.49:0/2147112044 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50dc108500 0x7f50dc1088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:03.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.056+0000 7f50e310f700 1 --2- 172.21.15.49:0/2147112044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50dc06a170 0x7f50dc06a5f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:03.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.056+0000 7f50e310f700 1 -- 172.21.15.49:0/2147112044 >> 172.21.15.49:0/2147112044 conn(0x7f50dc078340 msgr2=0x7f50dc078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:03.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.057+0000 7f50e310f700 1 -- 172.21.15.49:0/2147112044 shutdown_connections 2024-06-03T00:00:03.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.057+0000 7f50e310f700 1 -- 172.21.15.49:0/2147112044 wait complete. 2024-06-03T00:00:03.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.057+0000 7f50e310f700 1 Processor -- start 2024-06-03T00:00:03.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.057+0000 7f50e310f700 1 -- start start 2024-06-03T00:00:03.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.057+0000 7f50e310f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50dc06a170 0x7f50dc19e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:03.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.057+0000 7f50e310f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50dc06ab30 0x7f50dc19ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:03.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.057+0000 7f50e310f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50dc108500 0x7f50dc198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:03.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.057+0000 7f50e310f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f50dc112760 con 0x7f50dc06ab30 2024-06-03T00:00:03.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.057+0000 7f50e310f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f50dc1125e0 con 0x7f50dc06a170 2024-06-03T00:00:03.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.057+0000 7f50e310f700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f50dc1128e0 con 0x7f50dc108500 2024-06-03T00:00:03.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.058+0000 7f50d3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50dc06ab30 0x7f50dc19ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:03.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.058+0000 7f50d3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50dc06ab30 0x7f50dc19ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54456/0 (socket says 172.21.15.49:54456) 2024-06-03T00:00:03.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.058+0000 7f50d3fff700 1 -- 172.21.15.49:0/2372469852 learned_addr learned my addr 172.21.15.49:0/2372469852 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:03.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.058+0000 7f50e16ac700 1 --2- 172.21.15.49:0/2372469852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50dc108500 0x7f50dc198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:03.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.058+0000 7f50e0eab700 1 --2- 172.21.15.49:0/2372469852 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50dc06a170 0x7f50dc19e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:03.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.058+0000 7f50d3fff700 1 -- 172.21.15.49:0/2372469852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50dc108500 msgr2=0x7f50dc198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:03.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.058+0000 7f50d3fff700 1 --2- 172.21.15.49:0/2372469852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50dc108500 0x7f50dc198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:03.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.058+0000 7f50d3fff700 1 -- 172.21.15.49:0/2372469852 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50dc06a170 msgr2=0x7f50dc19e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:03.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.058+0000 7f50d3fff700 1 --2- 172.21.15.49:0/2372469852 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50dc06a170 0x7f50dc19e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:03.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.058+0000 7f50d3fff700 1 -- 172.21.15.49:0/2372469852 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50dc1991c0 con 0x7f50dc06ab30 2024-06-03T00:00:03.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.058+0000 7f50e0eab700 1 --2- 172.21.15.49:0/2372469852 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50dc06a170 0x7f50dc19e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:00:03.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.058+0000 7f50d3fff700 1 --2- 172.21.15.49:0/2372469852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50dc06ab30 0x7f50dc19ede0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f50d8000c00 tx=0x7f50d80047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:03.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.058+0000 7f50d1ffb700 1 -- 172.21.15.49:0/2372469852 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d8027070 con 0x7f50dc06ab30 2024-06-03T00:00:03.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.058+0000 7f50d1ffb700 1 -- 172.21.15.49:0/2372469852 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50d8003780 con 0x7f50dc06ab30 2024-06-03T00:00:03.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.058+0000 7f50e310f700 1 -- 172.21.15.49:0/2372469852 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50dc199450 con 0x7f50dc06ab30 2024-06-03T00:00:03.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.058+0000 7f50d1ffb700 1 -- 172.21.15.49:0/2372469852 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d8022dd0 con 0x7f50dc06ab30 2024-06-03T00:00:03.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.059+0000 7f50e310f700 1 -- 172.21.15.49:0/2372469852 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50dc1a5770 con 0x7f50dc06ab30 2024-06-03T00:00:03.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.059+0000 7f50e310f700 1 -- 172.21.15.49:0/2372469852 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50dc069180 con 0x7f50dc06ab30 2024-06-03T00:00:03.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.061+0000 7f50d1ffb700 1 -- 172.21.15.49:0/2372469852 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f50d802a070 con 0x7f50dc06ab30 2024-06-03T00:00:03.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.061+0000 7f50d1ffb700 1 --2- 172.21.15.49:0/2372469852 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f50c40a2c20 0x7f50c40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:03.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.061+0000 7f50e0eab700 1 --2- 172.21.15.49:0/2372469852 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f50c40a2c20 0x7f50c40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:03.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.062+0000 7f50d1ffb700 1 -- 172.21.15.49:0/2372469852 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f50d80d00c0 con 0x7f50dc06ab30 2024-06-03T00:00:03.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.062+0000 7f50e0eab700 1 --2- 172.21.15.49:0/2372469852 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f50c40a2c20 0x7f50c40a50e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f50cc005e10 tx=0x7f50cc005d60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:03.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.065+0000 7f50d1ffb700 1 -- 172.21.15.49:0/2372469852 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f50d8013070 con 0x7f50dc06ab30 2024-06-03T00:00:03.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:02 smithi049 ceph-mon[32302]: pgmap v383: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-03T00:00:03.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.328+0000 7f50e310f700 1 -- 172.21.15.49:0/2372469852 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50dc02dca0 con 0x7f50dc06ab30 2024-06-03T00:00:03.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.328+0000 7f50d1ffb700 1 -- 172.21.15.49:0/2372469852 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11929 (secure 0 0 0) 0x7f50d809d140 con 0x7f50dc06ab30 2024-06-03T00:00:03.329 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:00:03.329 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1553264866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1553264866},{"type":"v1","addr":"172.21.15.49:6835","nonce":1553264866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2266285252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2266285252},{"type":"v1","addr":"172.21.15.49:6837","nonce":2266285252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T23:57:16.991201+0000","modified":"2024-06-02T23:57:35.219435+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24485,"mds_2":24466,"mds_3":24464,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6839/1729124617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":1729124617},{"type":"v1","addr":"172.21.15.49:6839","nonce":1729124617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6841/1902772235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":1902772235},{"type":"v1","addr":"172.21.15.49:6841","nonce":1902772235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6833/1633534002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1633534002},{"type":"v1","addr":"172.21.15.57:6833","nonce":1633534002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6835/2254905671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2254905671},{"type":"v1","addr":"172.21.15.57:6835","nonce":2254905671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.107:6835/3693542801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3693542801},{"type":"v1","addr":"172.21.15.107:6835","nonce":3693542801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.57:6837/230452144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":230452144},{"type":"v1","addr":"172.21.15.57:6837","nonce":230452144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.107:6837/3700593315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":3700593315},{"type":"v1","addr":"172.21.15.107:6837","nonce":3700593315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6839/249825195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":249825195},{"type":"v1","addr":"172.21.15.57:6839","nonce":249825195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6839/1986600681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1986600681},{"type":"v1","addr":"172.21.15.107:6839","nonce":1986600681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24466,24487,24460,24464,24485]},"id":1}]} 2024-06-03T00:00:03.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.331+0000 7f50e310f700 1 -- 172.21.15.49:0/2372469852 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f50c40a2c20 msgr2=0x7f50c40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:03.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.331+0000 7f50e310f700 1 --2- 172.21.15.49:0/2372469852 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f50c40a2c20 0x7f50c40a50e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f50cc005e10 tx=0x7f50cc005d60 comp rx=0 tx=0).stop 2024-06-03T00:00:03.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.331+0000 7f50e310f700 1 -- 172.21.15.49:0/2372469852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50dc06ab30 msgr2=0x7f50dc19ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:03.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.331+0000 7f50e310f700 1 --2- 172.21.15.49:0/2372469852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50dc06ab30 0x7f50dc19ede0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f50d8000c00 tx=0x7f50d80047b0 comp rx=0 tx=0).stop 2024-06-03T00:00:03.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.331+0000 7f50e310f700 1 -- 172.21.15.49:0/2372469852 shutdown_connections 2024-06-03T00:00:03.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.331+0000 7f50e310f700 1 --2- 172.21.15.49:0/2372469852 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f50c40a2c20 0x7f50c40a50e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:03.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.331+0000 7f50e310f700 1 --2- 172.21.15.49:0/2372469852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50dc108500 0x7f50dc198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:03.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.331+0000 7f50e310f700 1 --2- 172.21.15.49:0/2372469852 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50dc06a170 0x7f50dc19e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:03.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.331+0000 7f50e310f700 1 --2- 172.21.15.49:0/2372469852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50dc06ab30 0x7f50dc19ede0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:03.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.331+0000 7f50e310f700 1 -- 172.21.15.49:0/2372469852 >> 172.21.15.49:0/2372469852 conn(0x7f50dc078340 msgr2=0x7f50dc100000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:03.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.331+0000 7f50e310f700 1 -- 172.21.15.49:0/2372469852 shutdown_connections 2024-06-03T00:00:03.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:03.331+0000 7f50e310f700 1 -- 172.21.15.49:0/2372469852 wait complete. 2024-06-03T00:00:03.333 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-06-03T00:00:03.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:02 smithi107 ceph-mon[37048]: pgmap v383: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-03T00:00:03.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:02 smithi057 ceph-mon[36457]: pgmap v383: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-03T00:00:03.935 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-03T00:00:04.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:03 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/2372469852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:00:04.216 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:00:04.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:03 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/2372469852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:00:04.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:03 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/2372469852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:00:05.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:04 smithi107 ceph-mon[37048]: pgmap v384: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-03T00:00:05.438 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:04 smithi049 ceph-mon[32302]: pgmap v384: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-03T00:00:05.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:04 smithi057 ceph-mon[36457]: pgmap v384: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-03T00:00:06.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.097+0000 7f7b2fd75700 1 -- 172.21.15.49:0/192733749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b2806b810 msgr2=0x7f7b281070d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:06.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.097+0000 7f7b2fd75700 1 --2- 172.21.15.49:0/192733749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b2806b810 0x7f7b281070d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7b180099c0 tx=0x7f7b18009cd0 comp rx=0 tx=0).stop 2024-06-03T00:00:06.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.097+0000 7f7b2fd75700 1 -- 172.21.15.49:0/192733749 shutdown_connections 2024-06-03T00:00:06.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.097+0000 7f7b2fd75700 1 --2- 172.21.15.49:0/192733749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b281077b0 0x7f7b2810f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:06.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.097+0000 7f7b2fd75700 1 --2- 172.21.15.49:0/192733749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b2806ae60 0x7f7b2806b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:06.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.097+0000 7f7b2fd75700 1 --2- 172.21.15.49:0/192733749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b2806b810 0x7f7b281070d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:06.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.097+0000 7f7b2fd75700 1 -- 172.21.15.49:0/192733749 >> 172.21.15.49:0/192733749 conn(0x7f7b280773e0 msgr2=0x7f7b280777f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:06.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.097+0000 7f7b2fd75700 1 -- 172.21.15.49:0/192733749 shutdown_connections 2024-06-03T00:00:06.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.097+0000 7f7b2fd75700 1 -- 172.21.15.49:0/192733749 wait complete. 2024-06-03T00:00:06.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.098+0000 7f7b2fd75700 1 Processor -- start 2024-06-03T00:00:06.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.098+0000 7f7b2fd75700 1 -- start start 2024-06-03T00:00:06.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.098+0000 7f7b2fd75700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b2806ae60 0x7f7b2819ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:06.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.098+0000 7f7b2fd75700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b2806b810 0x7f7b2819efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:06.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.098+0000 7f7b2fd75700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b281077b0 0x7f7b28198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:06.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.098+0000 7f7b2fd75700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7b28112830 con 0x7f7b2806ae60 2024-06-03T00:00:06.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.098+0000 7f7b2fd75700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f7b281126b0 con 0x7f7b281077b0 2024-06-03T00:00:06.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.098+0000 7f7b2fd75700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7b281129b0 con 0x7f7b2806b810 2024-06-03T00:00:06.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.098+0000 7f7b2db11700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b2806ae60 0x7f7b2819ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:06.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.098+0000 7f7b2db11700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b2806ae60 0x7f7b2819ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54474/0 (socket says 172.21.15.49:54474) 2024-06-03T00:00:06.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.098+0000 7f7b2db11700 1 -- 172.21.15.49:0/1477753246 learned_addr learned my addr 172.21.15.49:0/1477753246 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:06.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.099+0000 7f7b2d310700 1 --2- 172.21.15.49:0/1477753246 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b2806b810 0x7f7b2819efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:06.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.099+0000 7f7b2db11700 1 -- 172.21.15.49:0/1477753246 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b2806b810 msgr2=0x7f7b2819efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:06.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.099+0000 7f7b2e312700 1 --2- 172.21.15.49:0/1477753246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b281077b0 0x7f7b28198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:06.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.099+0000 7f7b2db11700 1 --2- 172.21.15.49:0/1477753246 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b2806b810 0x7f7b2819efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:06.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.099+0000 7f7b2db11700 1 -- 172.21.15.49:0/1477753246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b281077b0 msgr2=0x7f7b28198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:06.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.099+0000 7f7b2db11700 1 --2- 172.21.15.49:0/1477753246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b281077b0 0x7f7b28198b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:06.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.099+0000 7f7b2db11700 1 -- 172.21.15.49:0/1477753246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b28199410 con 0x7f7b2806ae60 2024-06-03T00:00:06.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.099+0000 7f7b2d310700 1 --2- 172.21.15.49:0/1477753246 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b2806b810 0x7f7b2819efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:00:06.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.099+0000 7f7b2db11700 1 --2- 172.21.15.49:0/1477753246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b2806ae60 0x7f7b2819ea60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400b530 tx=0x7f7b2400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:06.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.099+0000 7f7b1effd700 1 -- 172.21.15.49:0/1477753246 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b24015020 con 0x7f7b2806ae60 2024-06-03T00:00:06.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.099+0000 7f7b2fd75700 1 -- 172.21.15.49:0/1477753246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b28199700 con 0x7f7b2806ae60 2024-06-03T00:00:06.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.099+0000 7f7b2fd75700 1 -- 172.21.15.49:0/1477753246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b281a59e0 con 0x7f7b2806ae60 2024-06-03T00:00:06.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.099+0000 7f7b1effd700 1 -- 172.21.15.49:0/1477753246 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b24011d10 con 0x7f7b2806ae60 2024-06-03T00:00:06.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.099+0000 7f7b1effd700 1 -- 172.21.15.49:0/1477753246 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b2401ae20 con 0x7f7b2806ae60 2024-06-03T00:00:06.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.100+0000 7f7b2fd75700 1 -- 172.21.15.49:0/1477753246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b0c005330 con 0x7f7b2806ae60 2024-06-03T00:00:06.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.101+0000 7f7b1effd700 1 -- 172.21.15.49:0/1477753246 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7b24018020 con 0x7f7b2806ae60 2024-06-03T00:00:06.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.102+0000 7f7b1effd700 1 --2- 172.21.15.49:0/1477753246 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7b140a2c20 0x7f7b140a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:06.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.102+0000 7f7b2d310700 1 --2- 172.21.15.49:0/1477753246 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7b140a2c20 0x7f7b140a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:06.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.102+0000 7f7b1effd700 1 -- 172.21.15.49:0/1477753246 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f7b240ce790 con 0x7f7b2806ae60 2024-06-03T00:00:06.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.103+0000 7f7b2d310700 1 --2- 172.21.15.49:0/1477753246 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7b140a2c20 0x7f7b140a50e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7b18000c00 tx=0x7f7b18009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:06.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.107+0000 7f7b1effd700 1 -- 172.21.15.49:0/1477753246 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7b2401f020 con 0x7f7b2806ae60 2024-06-03T00:00:06.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.315+0000 7f7b2fd75700 1 -- 172.21.15.49:0/1477753246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7b0c005620 con 0x7f7b2806ae60 2024-06-03T00:00:06.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.317+0000 7f7b1effd700 1 -- 172.21.15.49:0/1477753246 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+22612 (secure 0 0 0) 0x7f7b2409b6f0 con 0x7f7b2806ae60 2024-06-03T00:00:06.318 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:00:06.318 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":90,"fsid":"890dd222-213a-11ef-bc9b-c7b262605968","created":"2024-06-02T23:48:53.323536+0000","modified":"2024-06-02T23:57:56.520324+0000","last_up_change":"2024-06-02T23:56:12.156697+0000","last_in_change":"2024-06-02T23:55:51.667118+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:52:23.676079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:57:10.753178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T23:57:14.240610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e0013e80-07d6-4ad3-87d8-d41988988ef5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6803","nonce":811647073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6805","nonce":811647073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6809","nonce":811647073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6807","nonce":811647073}]},"public_addr":"172.21.15.49:6803/811647073","cluster_addr":"172.21.15.49:6805/811647073","heartbeat_back_addr":"172.21.15.49:6809/811647073","heartbeat_front_addr":"172.21.15.49:6807/811647073","state":["exists","up"]},{"osd":1,"uuid":"f37d9f79-e349-4de7-81e7-385ddb905f58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6801","nonce":1260507785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6803","nonce":1260507785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6807","nonce":1260507785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6805","nonce":1260507785}]},"public_addr":"172.21.15.57:6801/1260507785","cluster_addr":"172.21.15.57:6803/1260507785","heartbeat_back_addr":"172.21.15.57:6807/1260507785","heartbeat_front_addr":"172.21.15.57:6805/1260507785","state":["exists","up"]},{"osd":2,"uuid":"94889281-7d45-4e78-9d37-b98e3fbe8494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6801","nonce":303899951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6803","nonce":303899951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6807","nonce":303899951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6805","nonce":303899951}]},"public_addr":"172.21.15.107:6801/303899951","cluster_addr":"172.21.15.107:6803/303899951","heartbeat_back_addr":"172.21.15.107:6807/303899951","heartbeat_front_addr":"172.21.15.107:6805/303899951","state":["exists","up"]},{"osd":3,"uuid":"31f4c18c-fbda-400d-8b3b-0955b0c4a6a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6811","nonce":60796312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6813","nonce":60796312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6817","nonce":60796312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6815","nonce":60796312}]},"public_addr":"172.21.15.49:6811/60796312","cluster_addr":"172.21.15.49:6813/60796312","heartbeat_back_addr":"172.21.15.49:6817/60796312","heartbeat_front_addr":"172.21.15.49:6815/60796312","state":["exists","up"]},{"osd":4,"uuid":"8076c2f3-0138-459e-89b5-c5c4586a14ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6809","nonce":3106842986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6811","nonce":3106842986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6815","nonce":3106842986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6813","nonce":3106842986}]},"public_addr":"172.21.15.57:6809/3106842986","cluster_addr":"172.21.15.57:6811/3106842986","heartbeat_back_addr":"172.21.15.57:6815/3106842986","heartbeat_front_addr":"172.21.15.57:6813/3106842986","state":["exists","up"]},{"osd":5,"uuid":"68f7abd3-4292-41fa-90ce-4ac34ea2b964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6809","nonce":389294142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6811","nonce":389294142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6815","nonce":389294142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6813","nonce":389294142}]},"public_addr":"172.21.15.107:6809/389294142","cluster_addr":"172.21.15.107:6811/389294142","heartbeat_back_addr":"172.21.15.107:6815/389294142","heartbeat_front_addr":"172.21.15.107:6813/389294142","state":["exists","up"]},{"osd":6,"uuid":"c0345dd0-71b7-436d-88f8-fe3d7cb69d8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6819","nonce":894624552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6821","nonce":894624552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6825","nonce":894624552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6823","nonce":894624552}]},"public_addr":"172.21.15.49:6819/894624552","cluster_addr":"172.21.15.49:6821/894624552","heartbeat_back_addr":"172.21.15.49:6825/894624552","heartbeat_front_addr":"172.21.15.49:6823/894624552","state":["exists","up"]},{"osd":7,"uuid":"9abd81c7-dcc1-4e14-8ab7-9fa0746067ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6817","nonce":3126027900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6819","nonce":3126027900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6823","nonce":3126027900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6821","nonce":3126027900}]},"public_addr":"172.21.15.57:6817/3126027900","cluster_addr":"172.21.15.57:6819/3126027900","heartbeat_back_addr":"172.21.15.57:6823/3126027900","heartbeat_front_addr":"172.21.15.57:6821/3126027900","state":["exists","up"]},{"osd":8,"uuid":"80532119-5de8-45d2-9cb9-bd8a6194199b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6817","nonce":3620047229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6819","nonce":3620047229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6823","nonce":3620047229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6821","nonce":3620047229}]},"public_addr":"172.21.15.107:6817/3620047229","cluster_addr":"172.21.15.107:6819/3620047229","heartbeat_back_addr":"172.21.15.107:6823/3620047229","heartbeat_front_addr":"172.21.15.107:6821/3620047229","state":["exists","up"]},{"osd":9,"uuid":"f0b5dcfa-9fd2-4a98-863b-197defa890af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6827","nonce":3627936526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6829","nonce":3627936526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6833","nonce":3627936526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6831","nonce":3627936526}]},"public_addr":"172.21.15.49:6827/3627936526","cluster_addr":"172.21.15.49:6829/3627936526","heartbeat_back_addr":"172.21.15.49:6833/3627936526","heartbeat_front_addr":"172.21.15.49:6831/3627936526","state":["exists","up"]},{"osd":10,"uuid":"21a75846-adec-41b8-9e1d-e5c61ba30b12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6825","nonce":3013235811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6827","nonce":3013235811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6831","nonce":3013235811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6829","nonce":3013235811}]},"public_addr":"172.21.15.57:6825/3013235811","cluster_addr":"172.21.15.57:6827/3013235811","heartbeat_back_addr":"172.21.15.57:6831/3013235811","heartbeat_front_addr":"172.21.15.57:6829/3013235811","state":["exists","up"]},{"osd":11,"uuid":"eb963b63-2c61-4169-b8fe-31c7f5ec919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6825","nonce":4217534517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6827","nonce":4217534517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6831","nonce":4217534517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6829","nonce":4217534517}]},"public_addr":"172.21.15.107:6825/4217534517","cluster_addr":"172.21.15.107:6827/4217534517","heartbeat_back_addr":"172.21.15.107:6831/4217534517","heartbeat_front_addr":"172.21.15.107:6829/4217534517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:51:31.067312+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:51:56.088456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:52:20.539941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:52:45.055717+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:53:11.178438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:53:35.794217+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:00.775674+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:27.574752+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:52.177634+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:55:17.118854+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:55:44.217535+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:56:10.500970+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/525944311":"2024-06-03T23:49:55.151590+0000","172.21.15.49:0/1841969299":"2024-06-03T23:49:55.151590+0000","172.21.15.49:0/1880506696":"2024-06-03T23:49:55.151590+0000","172.21.15.49:6801/1206062338":"2024-06-03T23:49:55.151590+0000","172.21.15.49:6800/549058216":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/2112783954":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/2183920213":"2024-06-03T23:49:29.042670+0000","172.21.15.49:6801/549058216":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/3350970308":"2024-06-03T23:49:29.042670+0000","172.21.15.49:6800/1206062338":"2024-06-03T23:49:55.151590+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-03T00:00:06.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.319+0000 7f7b2fd75700 1 -- 172.21.15.49:0/1477753246 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7b140a2c20 msgr2=0x7f7b140a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:06.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.319+0000 7f7b2fd75700 1 --2- 172.21.15.49:0/1477753246 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7b140a2c20 0x7f7b140a50e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7b18000c00 tx=0x7f7b18009f10 comp rx=0 tx=0).stop 2024-06-03T00:00:06.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.319+0000 7f7b2fd75700 1 -- 172.21.15.49:0/1477753246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b2806ae60 msgr2=0x7f7b2819ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:06.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.319+0000 7f7b2fd75700 1 --2- 172.21.15.49:0/1477753246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b2806ae60 0x7f7b2819ea60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400b530 tx=0x7f7b2400b8f0 comp rx=0 tx=0).stop 2024-06-03T00:00:06.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.319+0000 7f7b2fd75700 1 -- 172.21.15.49:0/1477753246 shutdown_connections 2024-06-03T00:00:06.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.319+0000 7f7b2fd75700 1 --2- 172.21.15.49:0/1477753246 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7b140a2c20 0x7f7b140a50e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:06.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.319+0000 7f7b2fd75700 1 --2- 172.21.15.49:0/1477753246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b281077b0 0x7f7b28198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:06.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.319+0000 7f7b2fd75700 1 --2- 172.21.15.49:0/1477753246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b2806ae60 0x7f7b2819ea60 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:06.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.319+0000 7f7b2fd75700 1 --2- 172.21.15.49:0/1477753246 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b2806b810 0x7f7b2819efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:06.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.319+0000 7f7b2fd75700 1 -- 172.21.15.49:0/1477753246 >> 172.21.15.49:0/1477753246 conn(0x7f7b280773e0 msgr2=0x7f7b281063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:06.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.319+0000 7f7b2fd75700 1 -- 172.21.15.49:0/1477753246 shutdown_connections 2024-06-03T00:00:06.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:06.319+0000 7f7b2fd75700 1 -- 172.21.15.49:0/1477753246 wait complete. 2024-06-03T00:00:06.942 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-06-02T23:57:16.991201+0000', 'modified': '2024-06-02T23:57:35.219435+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24487, 'mds_1': 24485, 'mds_2': 24466, 'mds_3': 24464, 'mds_4': 24460}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14598': {'gid': 14598, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.49:6839/1729124617', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6838', 'nonce': 1729124617}, {'type': 'v1', 'addr': '172.21.15.49:6839', 'nonce': 1729124617}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14610': {'gid': 14610, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.49:6841/1902772235', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6840', 'nonce': 1902772235}, {'type': 'v1', 'addr': '172.21.15.49:6841', 'nonce': 1902772235}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24416': {'gid': 24416, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.57:6833/1633534002', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 1633534002}, {'type': 'v1', 'addr': '172.21.15.57:6833', 'nonce': 1633534002}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24418': {'gid': 24418, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.107:6833/2662998293', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6832', 'nonce': 2662998293}, {'type': 'v1', 'addr': '172.21.15.107:6833', 'nonce': 2662998293}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24440': {'gid': 24440, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.57:6835/2254905671', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 2254905671}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 2254905671}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24460': {'gid': 24460, 'name': 'f', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.107:6835/3693542801', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6834', 'nonce': 3693542801}, {'type': 'v1', 'addr': '172.21.15.107:6835', 'nonce': 3693542801}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24464': {'gid': 24464, 'name': 'h', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.57:6837/230452144', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6836', 'nonce': 230452144}, {'type': 'v1', 'addr': '172.21.15.57:6837', 'nonce': 230452144}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'c', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.107:6837/3700593315', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6836', 'nonce': 3700593315}, {'type': 'v1', 'addr': '172.21.15.107:6837', 'nonce': 3700593315}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24485': {'gid': 24485, 'name': 'b', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.57:6839/249825195', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6838', 'nonce': 249825195}, {'type': 'v1', 'addr': '172.21.15.57:6839', 'nonce': 249825195}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24487': {'gid': 24487, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.107:6839/1986600681', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6838', 'nonce': 1986600681}, {'type': 'v1', 'addr': '172.21.15.107:6839', 'nonce': 1986600681}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24487, 'qdb_cluster': [24466, 24487, 24460, 24464, 24485]} 2024-06-03T00:00:06.942 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-06-03T00:00:06.942 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.f status 2024-06-03T00:00:07.193 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:00:07.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:06 smithi049 ceph-mon[32302]: pgmap v385: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-06-03T00:00:07.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:06 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/1477753246' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-03T00:00:07.252 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:06 smithi057 ceph-mon[36457]: pgmap v385: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-06-03T00:00:07.252 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:06 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/1477753246' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-03T00:00:07.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:06 smithi107 ceph-mon[37048]: pgmap v385: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-06-03T00:00:07.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:06 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/1477753246' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-03T00:00:08.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.897+0000 7f06e5bc5700 1 -- 172.21.15.49:0/1527508092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06e01066b0 msgr2=0x7f06e010e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:08.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.897+0000 7f06e5bc5700 1 --2- 172.21.15.49:0/1527508092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06e01066b0 0x7f06e010e280 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f06d800b0d0 tx=0x7f06d800b3e0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.897+0000 7f06e5bc5700 1 -- 172.21.15.49:0/1527508092 shutdown_connections 2024-06-03T00:00:08.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.897+0000 7f06e5bc5700 1 --2- 172.21.15.49:0/1527508092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06e01066b0 0x7f06e010e280 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.897+0000 7f06e5bc5700 1 --2- 172.21.15.49:0/1527508092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06e0101620 0x7f06e0101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.897+0000 7f06e5bc5700 1 --2- 172.21.15.49:0/1527508092 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06e0101fd0 0x7f06e0105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.897+0000 7f06e5bc5700 1 -- 172.21.15.49:0/1527508092 >> 172.21.15.49:0/1527508092 conn(0x7f06e0078340 msgr2=0x7f06e0078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:08.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.897+0000 7f06e5bc5700 1 -- 172.21.15.49:0/1527508092 shutdown_connections 2024-06-03T00:00:08.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.897+0000 7f06e5bc5700 1 -- 172.21.15.49:0/1527508092 wait complete. 2024-06-03T00:00:08.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.898+0000 7f06e5bc5700 1 Processor -- start 2024-06-03T00:00:08.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.898+0000 7f06e5bc5700 1 -- start start 2024-06-03T00:00:08.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.898+0000 7f06e5bc5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06e0101620 0x7f06e0103070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:08.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.898+0000 7f06e5bc5700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06e0101fd0 0x7f06e01035b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:08.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.898+0000 7f06e5bc5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06e01066b0 0x7f06e0103af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:08.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.898+0000 7f06e5bc5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f06e01116a0 con 0x7f06e01066b0 2024-06-03T00:00:08.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.898+0000 7f06e5bc5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f06e0111520 con 0x7f06e0101620 2024-06-03T00:00:08.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.898+0000 7f06e5bc5700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f06e0111820 con 0x7f06e0101fd0 2024-06-03T00:00:08.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.898+0000 7f06dffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06e01066b0 0x7f06e0103af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:08.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.898+0000 7f06df7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06e0101620 0x7f06e0103070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:08.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.898+0000 7f06dffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06e01066b0 0x7f06e0103af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54486/0 (socket says 172.21.15.49:54486) 2024-06-03T00:00:08.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.898+0000 7f06dffff700 1 -- 172.21.15.49:0/1073677009 learned_addr learned my addr 172.21.15.49:0/1073677009 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:08.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.898+0000 7f06d6ffd700 1 --2- 172.21.15.49:0/1073677009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06e0101fd0 0x7f06e01035b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:08.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.899+0000 7f06dffff700 1 -- 172.21.15.49:0/1073677009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06e0101fd0 msgr2=0x7f06e01035b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:08.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.899+0000 7f06dffff700 1 --2- 172.21.15.49:0/1073677009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06e0101fd0 0x7f06e01035b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.899+0000 7f06dffff700 1 -- 172.21.15.49:0/1073677009 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06e0101620 msgr2=0x7f06e0103070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:08.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.899+0000 7f06dffff700 1 --2- 172.21.15.49:0/1073677009 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06e0101620 0x7f06e0103070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.899+0000 7f06dffff700 1 -- 172.21.15.49:0/1073677009 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e01a70c0 con 0x7f06e01066b0 2024-06-03T00:00:08.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.899+0000 7f06d6ffd700 1 --2- 172.21.15.49:0/1073677009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06e0101fd0 0x7f06e01035b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:00:08.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.899+0000 7f06dffff700 1 --2- 172.21.15.49:0/1073677009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06e01066b0 0x7f06e0103af0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f06d8006070 tx=0x7f06d8004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:08.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.899+0000 7f06dd7fa700 1 -- 172.21.15.49:0/1073677009 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d8021070 con 0x7f06e01066b0 2024-06-03T00:00:08.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.899+0000 7f06e5bc5700 1 -- 172.21.15.49:0/1073677009 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e01a7350 con 0x7f06e01066b0 2024-06-03T00:00:08.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.899+0000 7f06dd7fa700 1 -- 172.21.15.49:0/1073677009 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06d8007b80 con 0x7f06e01066b0 2024-06-03T00:00:08.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.899+0000 7f06dd7fa700 1 -- 172.21.15.49:0/1073677009 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d8005330 con 0x7f06e01066b0 2024-06-03T00:00:08.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.899+0000 7f06e5bc5700 1 -- 172.21.15.49:0/1073677009 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e01a7850 con 0x7f06e01066b0 2024-06-03T00:00:08.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.901+0000 7f06dd7fa700 1 -- 172.21.15.49:0/1073677009 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f06d8024070 con 0x7f06e01066b0 2024-06-03T00:00:08.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.902+0000 7f06dd7fa700 1 --2- 172.21.15.49:0/1073677009 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f06cc0a2c20 0x7f06cc0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:08.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.903+0000 7f06df7fe700 1 --2- 172.21.15.49:0/1073677009 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f06cc0a2c20 0x7f06cc0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:08.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.903+0000 7f06dd7fa700 1 -- 172.21.15.49:0/1073677009 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f06d800f020 con 0x7f06e01066b0 2024-06-03T00:00:08.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.903+0000 7f06df7fe700 1 --2- 172.21.15.49:0/1073677009 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f06cc0a2c20 0x7f06cc0a50e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f06d0005950 tx=0x7f06d000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:08.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.903+0000 7f06f0448b80 1 Processor -- start 2024-06-03T00:00:08.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.903+0000 7f06f0448b80 1 -- start start 2024-06-03T00:00:08.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.903+0000 7f06f0448b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55af1cc835f0 0x55af1cc839d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:08.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.903+0000 7f06f0448b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55af1cc83f10 0x55af1cc7d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:08.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.903+0000 7f06f0448b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55af1cc7ded0 0x55af1cc7e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:08.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.903+0000 7f06f0448b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55af1cbcf7c0 con 0x55af1cc835f0 2024-06-03T00:00:08.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.903+0000 7f06f0448b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55af1cb776d0 con 0x55af1cc7ded0 2024-06-03T00:00:08.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.903+0000 7f06f0448b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55af1cbcb780 con 0x55af1cc83f10 2024-06-03T00:00:08.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.903+0000 7f06df7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55af1cc835f0 0x55af1cc839d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:08.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.903+0000 7f06df7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55af1cc835f0 0x55af1cc839d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54498/0 (socket says 172.21.15.49:54498) 2024-06-03T00:00:08.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.903+0000 7f06df7fe700 1 -- 172.21.15.49:0/1325954930 learned_addr learned my addr 172.21.15.49:0/1325954930 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:08.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.904+0000 7f06d6ffd700 1 --2- 172.21.15.49:0/1325954930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55af1cc83f10 0x55af1cc7d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:08.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.904+0000 7f06dffff700 1 --2- 172.21.15.49:0/1325954930 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55af1cc7ded0 0x55af1cc7e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:08.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.904+0000 7f06df7fe700 1 -- 172.21.15.49:0/1325954930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55af1cc83f10 msgr2=0x55af1cc7d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:08.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.904+0000 7f06df7fe700 1 --2- 172.21.15.49:0/1325954930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55af1cc83f10 0x55af1cc7d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.904+0000 7f06df7fe700 1 -- 172.21.15.49:0/1325954930 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55af1cc7ded0 msgr2=0x55af1cc7e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:08.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.904+0000 7f06df7fe700 1 --2- 172.21.15.49:0/1325954930 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55af1cc7ded0 0x55af1cc7e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.904+0000 7f06df7fe700 1 -- 172.21.15.49:0/1325954930 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af1cb6df00 con 0x55af1cc835f0 2024-06-03T00:00:08.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.904+0000 7f06df7fe700 1 --2- 172.21.15.49:0/1325954930 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55af1cc835f0 0x55af1cc839d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f06d0010fa0 tx=0x7f06d0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24097cdac5a28eec server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:08.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.904+0000 7f06d5ffb700 1 -- 172.21.15.49:0/1325954930 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d000be60 con 0x55af1cc835f0 2024-06-03T00:00:08.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.904+0000 7f06d5ffb700 1 -- 172.21.15.49:0/1325954930 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06d0011db0 con 0x55af1cc835f0 2024-06-03T00:00:08.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.904+0000 7f06d5ffb700 1 -- 172.21.15.49:0/1325954930 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d001c7e0 con 0x55af1cc835f0 2024-06-03T00:00:08.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.905+0000 7f06f0448b80 1 -- 172.21.15.49:0/1325954930 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55af1cc835f0 msgr2=0x55af1cc839d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:08.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.905+0000 7f06f0448b80 1 --2- 172.21.15.49:0/1325954930 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55af1cc835f0 0x55af1cc839d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f06d0010fa0 tx=0x7f06d0013000 comp rx=0 tx=0).stop 2024-06-03T00:00:08.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.905+0000 7f06f0448b80 1 -- 172.21.15.49:0/1325954930 shutdown_connections 2024-06-03T00:00:08.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.905+0000 7f06f0448b80 1 --2- 172.21.15.49:0/1325954930 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55af1cc7ded0 0x55af1cc7e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.905+0000 7f06f0448b80 1 --2- 172.21.15.49:0/1325954930 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55af1cc835f0 0x55af1cc839d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.905+0000 7f06f0448b80 1 --2- 172.21.15.49:0/1325954930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55af1cc83f10 0x55af1cc7d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.905+0000 7f06f0448b80 1 -- 172.21.15.49:0/1325954930 >> 172.21.15.49:0/1325954930 conn(0x55af1cba8c70 msgr2=0x55af1cc78800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:08.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.905+0000 7f06f0448b80 1 -- 172.21.15.49:0/1325954930 shutdown_connections 2024-06-03T00:00:08.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.905+0000 7f06f0448b80 1 -- 172.21.15.49:0/1325954930 wait complete. 2024-06-03T00:00:08.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.905+0000 7f06f0448b80 1 -- start start 2024-06-03T00:00:08.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.906+0000 7f06f0448b80 1 Processor -- start 2024-06-03T00:00:08.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.906+0000 7f06f0448b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55af1cc7ded0 0x55af1cc89c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:08.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.906+0000 7f06f0448b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55af1cc835f0 0x55af1cc86f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:08.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.906+0000 7f06f0448b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55af1cc83f10 0x55af1cc874b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:08.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.906+0000 7f06f0448b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55af1cc8a980 con 0x55af1cc835f0 2024-06-03T00:00:08.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.906+0000 7f06f0448b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55af1cb6fba0 con 0x55af1cc7ded0 2024-06-03T00:00:08.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.906+0000 7f06f0448b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55af1cc8ab00 con 0x55af1cc83f10 2024-06-03T00:00:08.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.906+0000 7f06f0448b80 10 client.0 _ll_register_callbacks cb 0x55af1cb698d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:00:08.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.906+0000 7f06d6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55af1cc835f0 0x55af1cc86f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:08.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.906+0000 7f06d6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55af1cc835f0 0x55af1cc86f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54514/0 (socket says 172.21.15.49:54514) 2024-06-03T00:00:08.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.906+0000 7f06d6ffd700 1 -- 172.21.15.49:0/1213566199 learned_addr learned my addr 172.21.15.49:0/1213566199 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:08.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.906+0000 7f06dffff700 1 --2- 172.21.15.49:0/1213566199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55af1cc83f10 0x55af1cc874b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:08.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.906+0000 7f06df7fe700 1 --2- 172.21.15.49:0/1213566199 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55af1cc7ded0 0x55af1cc89c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:08.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.906+0000 7f06d6ffd700 1 -- 172.21.15.49:0/1213566199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55af1cc83f10 msgr2=0x55af1cc874b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:08.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.906+0000 7f06d6ffd700 1 --2- 172.21.15.49:0/1213566199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55af1cc83f10 0x55af1cc874b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.906+0000 7f06d6ffd700 1 -- 172.21.15.49:0/1213566199 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55af1cc7ded0 msgr2=0x55af1cc89c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:08.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.906+0000 7f06d6ffd700 1 --2- 172.21.15.49:0/1213566199 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55af1cc7ded0 0x55af1cc89c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.906+0000 7f06d6ffd700 1 -- 172.21.15.49:0/1213566199 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af1cb1e880 con 0x55af1cc835f0 2024-06-03T00:00:08.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.906+0000 7f06d6ffd700 1 --2- 172.21.15.49:0/1213566199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55af1cc835f0 0x55af1cc86f70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f06c8011830 tx=0x7f06c8011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b434d3829f83b142 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:08.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.906+0000 7f06beffd700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:00:08.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.907+0000 7f06beffd700 1 -- 172.21.15.49:0/1213566199 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c8004500 con 0x55af1cc835f0 2024-06-03T00:00:08.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.907+0000 7f06beffd700 1 -- 172.21.15.49:0/1213566199 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f06c8004830 con 0x55af1cc835f0 2024-06-03T00:00:08.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.907+0000 7f06f0448b80 1 -- 172.21.15.49:0/1213566199 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06d0011db0 con 0x55af1cc835f0 2024-06-03T00:00:08.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.907+0000 7f06beffd700 1 -- 172.21.15.49:0/1213566199 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f06c8004a30 con 0x55af1cc835f0 2024-06-03T00:00:08.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.907+0000 7f06f0448b80 10 client.15114 fetch_fsmap learned FSMap version 26 2024-06-03T00:00:08.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.907+0000 7f06f0448b80 1 -- 172.21.15.49:0/1213566199 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55af1cc952e0 con 0x55af1cc835f0 2024-06-03T00:00:08.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.907+0000 7f06beffd700 1 -- 172.21.15.49:0/1213566199 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06d0011db0 con 0x55af1cc835f0 2024-06-03T00:00:08.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.907+0000 7f06beffd700 1 -- 172.21.15.49:0/1213566199 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f06c8018070 con 0x55af1cc835f0 2024-06-03T00:00:08.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.907+0000 7f06f0448b80 10 client.15114 fetch_fsmap finished waiting for FSMap version 26 2024-06-03T00:00:08.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.907+0000 7f06f0448b80 10 client.15114 resolve_mds: resolved name 'f' to daemon mds.f 2024-06-03T00:00:08.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.907+0000 7f06f0448b80 20 client.15114 populate_metadata read hostname 'smithi049' 2024-06-03T00:00:08.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.907+0000 7f06f0448b80 1 --2- 172.21.15.49:0/1213566199 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x55af1cc97910 0x55af1cc98d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:08.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.907+0000 7f06f0448b80 4 client.15114 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:00:08.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.907+0000 7f06f0448b80 1 -- 172.21.15.49:0/1213566199 --> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af1cbdccc0 con 0x55af1cc97910 2024-06-03T00:00:08.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.908+0000 7f06df7fe700 1 --2- 172.21.15.49:0/1213566199 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x55af1cc97910 0x55af1cc98d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:08.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.908+0000 7f06beffd700 10 client.15114 ms_handle_connect on v2:172.21.15.107:6834/3693542801 2024-06-03T00:00:08.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.908+0000 7f06df7fe700 1 --2- 172.21.15.49:0/1213566199 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x55af1cc97910 0x55af1cc98d80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b2c577d0b96759fb server_cookie=a54e9572ff33c2ff in_seq=0 out_seq=0 2024-06-03T00:00:08.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.909+0000 7f06beffd700 1 -- 172.21.15.49:0/1213566199 <== mds.4 v2:172.21.15.107:6834/3693542801 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55af1cbdccc0 con 0x55af1cc97910 2024-06-03T00:00:08.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.909+0000 7f06beffd700 10 client.15114 handle_command_reply: tid=0 2024-06-03T00:00:08.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.909+0000 7f06f0448b80 1 client.15114 shutdown 2024-06-03T00:00:08.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.909+0000 7f06f0448b80 1 -- 172.21.15.49:0/1213566199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55af1cc835f0 msgr2=0x55af1cc86f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:08.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.909+0000 7f06f0448b80 1 --2- 172.21.15.49:0/1213566199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55af1cc835f0 0x55af1cc86f70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f06c8011830 tx=0x7f06c8011b40 comp rx=0 tx=0).stop 2024-06-03T00:00:08.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.909+0000 7f06f0448b80 1 -- 172.21.15.49:0/1213566199 shutdown_connections 2024-06-03T00:00:08.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.909+0000 7f06f0448b80 1 --2- 172.21.15.49:0/1213566199 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x55af1cc97910 0x55af1cc98d80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.909+0000 7f06f0448b80 1 --2- 172.21.15.49:0/1213566199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55af1cc83f10 0x55af1cc874b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.909+0000 7f06f0448b80 1 --2- 172.21.15.49:0/1213566199 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55af1cc7ded0 0x55af1cc89c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.909+0000 7f06f0448b80 1 --2- 172.21.15.49:0/1213566199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55af1cc835f0 0x55af1cc86f70 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.909+0000 7f06f0448b80 1 -- 172.21.15.49:0/1213566199 >> 172.21.15.49:0/1213566199 conn(0x55af1cba8c70 msgr2=0x55af1cc7c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:08.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.909+0000 7f06beffd700 0 client.15114 ms_handle_reset on v2:172.21.15.107:6834/3693542801 2024-06-03T00:00:08.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.909+0000 7f06f0448b80 1 -- 172.21.15.49:0/1213566199 shutdown_connections 2024-06-03T00:00:08.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.909+0000 7f06f0448b80 1 -- 172.21.15.49:0/1213566199 wait complete. 2024-06-03T00:00:08.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.909+0000 7f06f0448b80 20 client.15114 trim_cache size 0 max 16384 2024-06-03T00:00:08.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.931+0000 7f06f0448b80 1 Processor -- start 2024-06-03T00:00:08.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.931+0000 7f06f0448b80 1 -- start start 2024-06-03T00:00:08.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.931+0000 7f06f0448b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55af1cc7ded0 0x55af1cc7d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:08.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.931+0000 7f06f0448b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55af1cc835f0 0x55af1cc724c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:08.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.931+0000 7f06f0448b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55af1cc83f10 0x55af1cc842f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:08.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.931+0000 7f06f0448b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55af1cc970c0 con 0x55af1cc7ded0 2024-06-03T00:00:08.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.931+0000 7f06f0448b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55af1cc97790 con 0x55af1cc835f0 2024-06-03T00:00:08.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.931+0000 7f06f0448b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55af1cc97e60 con 0x55af1cc83f10 2024-06-03T00:00:08.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.931+0000 7f06df7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55af1cc7ded0 0x55af1cc7d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:08.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.931+0000 7f06df7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55af1cc7ded0 0x55af1cc7d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54526/0 (socket says 172.21.15.49:54526) 2024-06-03T00:00:08.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.931+0000 7f06df7fe700 1 -- 172.21.15.49:0/572873224 learned_addr learned my addr 172.21.15.49:0/572873224 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:08.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.931+0000 7f06d6ffd700 1 --2- 172.21.15.49:0/572873224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55af1cc835f0 0x55af1cc724c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:08.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.931+0000 7f06dffff700 1 --2- 172.21.15.49:0/572873224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55af1cc83f10 0x55af1cc842f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:08.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.931+0000 7f06df7fe700 1 -- 172.21.15.49:0/572873224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55af1cc83f10 msgr2=0x55af1cc842f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:08.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.931+0000 7f06df7fe700 1 --2- 172.21.15.49:0/572873224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55af1cc83f10 0x55af1cc842f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.931+0000 7f06df7fe700 1 -- 172.21.15.49:0/572873224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55af1cc835f0 msgr2=0x55af1cc724c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:08.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.931+0000 7f06df7fe700 1 --2- 172.21.15.49:0/572873224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55af1cc835f0 0x55af1cc724c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.931+0000 7f06df7fe700 1 -- 172.21.15.49:0/572873224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af1cc7a250 con 0x55af1cc7ded0 2024-06-03T00:00:08.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.931+0000 7f06d6ffd700 1 --2- 172.21.15.49:0/572873224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55af1cc835f0 0x55af1cc724c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:00:08.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.931+0000 7f06dffff700 1 --2- 172.21.15.49:0/572873224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55af1cc83f10 0x55af1cc842f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:00:08.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.931+0000 7f06df7fe700 1 --2- 172.21.15.49:0/572873224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55af1cc7ded0 0x55af1cc7d990 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f06d0010f40 tx=0x7f06d001eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5473c56da77f7760 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:08.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.931+0000 7f06d57fa700 1 -- 172.21.15.49:0/572873224 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d0005040 con 0x55af1cc7ded0 2024-06-03T00:00:08.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.932+0000 7f06d57fa700 1 -- 172.21.15.49:0/572873224 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06d00056c0 con 0x55af1cc7ded0 2024-06-03T00:00:08.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.932+0000 7f06d57fa700 1 -- 172.21.15.49:0/572873224 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d001e680 con 0x55af1cc7ded0 2024-06-03T00:00:08.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.932+0000 7f06f0448b80 1 -- 172.21.15.49:0/572873224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55af1cc7ded0 msgr2=0x55af1cc7d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:08.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.932+0000 7f06f0448b80 1 --2- 172.21.15.49:0/572873224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55af1cc7ded0 0x55af1cc7d990 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f06d0010f40 tx=0x7f06d001eee0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.932+0000 7f06f0448b80 1 -- 172.21.15.49:0/572873224 shutdown_connections 2024-06-03T00:00:08.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.932+0000 7f06f0448b80 1 --2- 172.21.15.49:0/572873224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55af1cc83f10 0x55af1cc842f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.932+0000 7f06f0448b80 1 --2- 172.21.15.49:0/572873224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55af1cc7ded0 0x55af1cc7d990 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.932+0000 7f06f0448b80 1 --2- 172.21.15.49:0/572873224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55af1cc835f0 0x55af1cc724c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.932+0000 7f06f0448b80 1 -- 172.21.15.49:0/572873224 >> 172.21.15.49:0/572873224 conn(0x55af1cba8c70 msgr2=0x55af1cc71db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:08.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.932+0000 7f06f0448b80 1 -- 172.21.15.49:0/572873224 shutdown_connections 2024-06-03T00:00:08.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.932+0000 7f06f0448b80 1 -- 172.21.15.49:0/572873224 wait complete. 2024-06-03T00:00:08.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.933+0000 7f06f0448b80 1 -- start start 2024-06-03T00:00:08.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.933+0000 7f06f0448b80 1 Processor -- start 2024-06-03T00:00:08.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.933+0000 7f06f0448b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55af1cc7ded0 0x55af1cc9c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:08.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.933+0000 7f06f0448b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55af1cc835f0 0x55af1cc9c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:08.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.933+0000 7f06f0448b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55af1cc83f10 0x55af1cca0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:08.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.933+0000 7f06f0448b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55af1cc98c00 con 0x55af1cc835f0 2024-06-03T00:00:08.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.933+0000 7f06f0448b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55af1cc98530 con 0x55af1cc83f10 2024-06-03T00:00:08.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.933+0000 7f06f0448b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55af1cc992d0 con 0x55af1cc7ded0 2024-06-03T00:00:08.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.933+0000 7f06f0448b80 10 client.0 _ll_register_callbacks cb 0x55af1cb698d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:00:08.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.933+0000 7f06d6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55af1cc835f0 0x55af1cc9c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:08.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.933+0000 7f06d6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55af1cc835f0 0x55af1cc9c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54534/0 (socket says 172.21.15.49:54534) 2024-06-03T00:00:08.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.933+0000 7f06d6ffd700 1 -- 172.21.15.49:0/2522344643 learned_addr learned my addr 172.21.15.49:0/2522344643 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:08.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.933+0000 7f06df7fe700 1 --2- 172.21.15.49:0/2522344643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55af1cc7ded0 0x55af1cc9c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:08.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.933+0000 7f06dffff700 1 --2- 172.21.15.49:0/2522344643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55af1cc83f10 0x55af1cca0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:08.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.934+0000 7f06d6ffd700 1 -- 172.21.15.49:0/2522344643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55af1cc7ded0 msgr2=0x55af1cc9c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:08.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.934+0000 7f06d6ffd700 1 --2- 172.21.15.49:0/2522344643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55af1cc7ded0 0x55af1cc9c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.934+0000 7f06d6ffd700 1 -- 172.21.15.49:0/2522344643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55af1cc83f10 msgr2=0x55af1cca0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:08.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.934+0000 7f06d6ffd700 1 --2- 172.21.15.49:0/2522344643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55af1cc83f10 0x55af1cca0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.934+0000 7f06d6ffd700 1 -- 172.21.15.49:0/2522344643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af1cca0f80 con 0x55af1cc835f0 2024-06-03T00:00:08.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.934+0000 7f06df7fe700 1 --2- 172.21.15.49:0/2522344643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55af1cc7ded0 0x55af1cc9c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:00:08.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.934+0000 7f06dffff700 1 --2- 172.21.15.49:0/2522344643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55af1cc83f10 0x55af1cca0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:00:08.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.934+0000 7f06d6ffd700 1 --2- 172.21.15.49:0/2522344643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55af1cc835f0 0x55af1cc9c7c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f06c8008d60 tx=0x7f06c8008780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9801fed275fbc7d0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:08.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.934+0000 7f06beffd700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:00:08.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.934+0000 7f06beffd700 1 -- 172.21.15.49:0/2522344643 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c8004de0 con 0x55af1cc835f0 2024-06-03T00:00:08.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.934+0000 7f06f0448b80 1 -- 172.21.15.49:0/2522344643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55af1cbd7240 con 0x55af1cc835f0 2024-06-03T00:00:08.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.934+0000 7f06beffd700 1 -- 172.21.15.49:0/2522344643 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f06c8004300 con 0x55af1cc835f0 2024-06-03T00:00:08.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.934+0000 7f06beffd700 1 -- 172.21.15.49:0/2522344643 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f06c8004560 con 0x55af1cc835f0 2024-06-03T00:00:08.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.934+0000 7f06f0448b80 10 client.15120 fetch_fsmap learned FSMap version 26 2024-06-03T00:00:08.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.934+0000 7f06f0448b80 1 -- 172.21.15.49:0/2522344643 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55af1cd03830 con 0x55af1cc835f0 2024-06-03T00:00:08.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.934+0000 7f06beffd700 1 -- 172.21.15.49:0/2522344643 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55af1cbd7240 con 0x55af1cc835f0 2024-06-03T00:00:08.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.934+0000 7f06beffd700 1 -- 172.21.15.49:0/2522344643 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f06c8018040 con 0x55af1cc835f0 2024-06-03T00:00:08.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.934+0000 7f06f0448b80 10 client.15120 fetch_fsmap finished waiting for FSMap version 26 2024-06-03T00:00:08.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.935+0000 7f06f0448b80 10 client.15120 resolve_mds: resolved name 'f' to daemon mds.f 2024-06-03T00:00:08.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.935+0000 7f06f0448b80 20 client.15120 populate_metadata read hostname 'smithi049' 2024-06-03T00:00:08.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.935+0000 7f06f0448b80 1 --2- 172.21.15.49:0/2522344643 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x55af1cd083e0 0x55af1cd070f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:08.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.935+0000 7f06f0448b80 4 client.15120 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-03T00:00:08.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.935+0000 7f06f0448b80 1 -- 172.21.15.49:0/2522344643 --> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] -- command(tid 0: {"prefix": "status"}) -- 0x55af1ca51200 con 0x55af1cd083e0 2024-06-03T00:00:08.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.935+0000 7f06df7fe700 1 --2- 172.21.15.49:0/2522344643 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x55af1cd083e0 0x55af1cd070f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:08.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.935+0000 7f06df7fe700 1 --2- 172.21.15.49:0/2522344643 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x55af1cd083e0 0x55af1cd070f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d4c5f93c4fc76bbb server_cookie=a101cb87f5adde02 in_seq=0 out_seq=0 2024-06-03T00:00:08.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.935+0000 7f06beffd700 10 client.15120 ms_handle_connect on v2:172.21.15.107:6834/3693542801 2024-06-03T00:00:08.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.935+0000 7f06beffd700 1 -- 172.21.15.49:0/2522344643 <== mds.4 v2:172.21.15.107:6834/3693542801 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55af1ca51200 con 0x55af1cd083e0 2024-06-03T00:00:08.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.935+0000 7f06beffd700 10 client.15120 handle_command_reply: tid=0 2024-06-03T00:00:08.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.935+0000 7f06f0448b80 1 client.15120 shutdown 2024-06-03T00:00:08.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.935+0000 7f06f0448b80 1 -- 172.21.15.49:0/2522344643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55af1cc835f0 msgr2=0x55af1cc9c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:08.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.935+0000 7f06f0448b80 1 --2- 172.21.15.49:0/2522344643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55af1cc835f0 0x55af1cc9c7c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f06c8008d60 tx=0x7f06c8008780 comp rx=0 tx=0).stop 2024-06-03T00:00:08.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.936+0000 7f06f0448b80 1 -- 172.21.15.49:0/2522344643 shutdown_connections 2024-06-03T00:00:08.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.936+0000 7f06f0448b80 1 --2- 172.21.15.49:0/2522344643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55af1cc83f10 0x55af1cca0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.936+0000 7f06f0448b80 1 --2- 172.21.15.49:0/2522344643 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x55af1cd083e0 0x55af1cd070f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.936+0000 7f06f0448b80 1 --2- 172.21.15.49:0/2522344643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55af1cc7ded0 0x55af1cc9c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.936+0000 7f06f0448b80 1 --2- 172.21.15.49:0/2522344643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55af1cc835f0 0x55af1cc9c7c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.936+0000 7f06f0448b80 1 -- 172.21.15.49:0/2522344643 >> 172.21.15.49:0/2522344643 conn(0x55af1cba8c70 msgr2=0x55af1cc842f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:08.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.936+0000 7f06beffd700 0 client.15120 ms_handle_reset on v2:172.21.15.107:6834/3693542801 2024-06-03T00:00:08.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.936+0000 7f06f0448b80 1 -- 172.21.15.49:0/2522344643 shutdown_connections 2024-06-03T00:00:08.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.936+0000 7f06f0448b80 1 -- 172.21.15.49:0/2522344643 wait complete. 2024-06-03T00:00:08.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.936+0000 7f06f0448b80 20 client.15120 trim_cache size 0 max 16384 2024-06-03T00:00:08.945 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:00:08.945 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "890dd222-213a-11ef-bc9b-c7b262605968", 2024-06-03T00:00:08.945 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 4, 2024-06-03T00:00:08.945 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 24460, 2024-06-03T00:00:08.945 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-06-03T00:00:08.945 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-06-03T00:00:08.945 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-06-03T00:00:08.945 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 156.47765427799999, 2024-06-03T00:00:08.945 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 26, 2024-06-03T00:00:08.945 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 90, 2024-06-03T00:00:08.945 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 88, 2024-06-03T00:00:08.945 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 204.28191106599999 2024-06-03T00:00:08.946 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:00:08.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.936+0000 7f06e5bc5700 1 -- 172.21.15.49:0/1073677009 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f06cc0a2c20 msgr2=0x7f06cc0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:08.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.936+0000 7f06e5bc5700 1 --2- 172.21.15.49:0/1073677009 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f06cc0a2c20 0x7f06cc0a50e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f06d0005950 tx=0x7f06d000b410 comp rx=0 tx=0).stop 2024-06-03T00:00:08.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.936+0000 7f06e5bc5700 1 -- 172.21.15.49:0/1073677009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06e01066b0 msgr2=0x7f06e0103af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:08.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.936+0000 7f06e5bc5700 1 --2- 172.21.15.49:0/1073677009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06e01066b0 0x7f06e0103af0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f06d8006070 tx=0x7f06d8004d00 comp rx=0 tx=0).stop 2024-06-03T00:00:08.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.936+0000 7f06e5bc5700 1 -- 172.21.15.49:0/1073677009 shutdown_connections 2024-06-03T00:00:08.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.936+0000 7f06e5bc5700 1 --2- 172.21.15.49:0/1073677009 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f06cc0a2c20 0x7f06cc0a50e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.936+0000 7f06e5bc5700 1 --2- 172.21.15.49:0/1073677009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06e01066b0 0x7f06e0103af0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.936+0000 7f06e5bc5700 1 --2- 172.21.15.49:0/1073677009 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06e0101620 0x7f06e0103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.936+0000 7f06e5bc5700 1 --2- 172.21.15.49:0/1073677009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06e0101fd0 0x7f06e01035b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:08.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.936+0000 7f06e5bc5700 1 -- 172.21.15.49:0/1073677009 >> 172.21.15.49:0/1073677009 conn(0x7f06e0078340 msgr2=0x7f06e006ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:08.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.936+0000 7f06e5bc5700 1 -- 172.21.15.49:0/1073677009 shutdown_connections 2024-06-03T00:00:08.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:08.937+0000 7f06e5bc5700 1 -- 172.21.15.49:0/1073677009 wait complete. 2024-06-03T00:00:09.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:08 smithi049 ceph-mon[32302]: pgmap v386: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-06-03T00:00:09.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:08 smithi107 ceph-mon[37048]: pgmap v386: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-06-03T00:00:09.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:08 smithi057 ceph-mon[36457]: pgmap v386: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-06-03T00:00:09.640 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.h status 2024-06-03T00:00:09.891 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:00:11.337 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:10 smithi049 ceph-mon[32302]: pgmap v387: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-03T00:00:11.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:10 smithi107 ceph-mon[37048]: pgmap v387: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-03T00:00:11.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:10 smithi057 ceph-mon[36457]: pgmap v387: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-03T00:00:11.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.582+0000 7f762bb2e700 1 -- 172.21.15.49:0/4120462679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7624101a60 msgr2=0x7f7624105820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.582+0000 7f762bb2e700 1 --2- 172.21.15.49:0/4120462679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7624101a60 0x7f7624105820 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f761400aaa0 tx=0x7f761400adb0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.582+0000 7f762bb2e700 1 -- 172.21.15.49:0/4120462679 shutdown_connections 2024-06-03T00:00:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.582+0000 7f762bb2e700 1 --2- 172.21.15.49:0/4120462679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7624105f50 0x7f762410da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.582+0000 7f762bb2e700 1 --2- 172.21.15.49:0/4120462679 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76241010b0 0x7f7624101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.582+0000 7f762bb2e700 1 --2- 172.21.15.49:0/4120462679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7624101a60 0x7f7624105820 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.582+0000 7f762bb2e700 1 -- 172.21.15.49:0/4120462679 >> 172.21.15.49:0/4120462679 conn(0x7f76240766b0 msgr2=0x7f7624076ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:11.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.582+0000 7f762bb2e700 1 -- 172.21.15.49:0/4120462679 shutdown_connections 2024-06-03T00:00:11.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.582+0000 7f762bb2e700 1 -- 172.21.15.49:0/4120462679 wait complete. 2024-06-03T00:00:11.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.582+0000 7f762bb2e700 1 Processor -- start 2024-06-03T00:00:11.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.582+0000 7f762bb2e700 1 -- start start 2024-06-03T00:00:11.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.583+0000 7f762bb2e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76241010b0 0x7f762419e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:11.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.583+0000 7f762bb2e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7624101a60 0x7f762419ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:11.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.583+0000 7f762bb2e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7624105f50 0x7f76241989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:11.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.583+0000 7f762bb2e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f76241105f0 con 0x7f76241010b0 2024-06-03T00:00:11.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.583+0000 7f762bb2e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f7624110470 con 0x7f7624105f50 2024-06-03T00:00:11.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.583+0000 7f762bb2e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7624110770 con 0x7f7624101a60 2024-06-03T00:00:11.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.583+0000 7f76298ca700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76241010b0 0x7f762419e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:11.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.583+0000 7f76298ca700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76241010b0 0x7f762419e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54556/0 (socket says 172.21.15.49:54556) 2024-06-03T00:00:11.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.583+0000 7f76298ca700 1 -- 172.21.15.49:0/1052988982 learned_addr learned my addr 172.21.15.49:0/1052988982 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:11.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.583+0000 7f76290c9700 1 --2- 172.21.15.49:0/1052988982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7624101a60 0x7f762419ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:11.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.583+0000 7f762a0cb700 1 --2- 172.21.15.49:0/1052988982 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7624105f50 0x7f76241989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:11.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.583+0000 7f76298ca700 1 -- 172.21.15.49:0/1052988982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7624101a60 msgr2=0x7f762419ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:11.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.583+0000 7f76298ca700 1 --2- 172.21.15.49:0/1052988982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7624101a60 0x7f762419ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.583+0000 7f76298ca700 1 -- 172.21.15.49:0/1052988982 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7624105f50 msgr2=0x7f76241989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:11.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.583+0000 7f76298ca700 1 --2- 172.21.15.49:0/1052988982 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7624105f50 0x7f76241989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.583+0000 7f76298ca700 1 -- 172.21.15.49:0/1052988982 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7624199150 con 0x7f76241010b0 2024-06-03T00:00:11.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.583+0000 7f76298ca700 1 --2- 172.21.15.49:0/1052988982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76241010b0 0x7f762419e7e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f762000c9b0 tx=0x7f762000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:11.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.583+0000 7f761affd700 1 -- 172.21.15.49:0/1052988982 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7620007b00 con 0x7f76241010b0 2024-06-03T00:00:11.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.583+0000 7f761affd700 1 -- 172.21.15.49:0/1052988982 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7620007ca0 con 0x7f76241010b0 2024-06-03T00:00:11.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.583+0000 7f762bb2e700 1 -- 172.21.15.49:0/1052988982 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7624199440 con 0x7f76241010b0 2024-06-03T00:00:11.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.584+0000 7f761affd700 1 -- 172.21.15.49:0/1052988982 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7620018730 con 0x7f76241010b0 2024-06-03T00:00:11.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.584+0000 7f762bb2e700 1 -- 172.21.15.49:0/1052988982 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76241a56b0 con 0x7f76241010b0 2024-06-03T00:00:11.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.586+0000 7f761affd700 1 -- 172.21.15.49:0/1052988982 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f76200188d0 con 0x7f76241010b0 2024-06-03T00:00:11.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.586+0000 7f761affd700 1 --2- 172.21.15.49:0/1052988982 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f76100a2ca0 0x7f76100a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:11.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.586+0000 7f76290c9700 1 --2- 172.21.15.49:0/1052988982 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f76100a2ca0 0x7f76100a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:11.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.587+0000 7f761affd700 1 -- 172.21.15.49:0/1052988982 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f76200cefd0 con 0x7f76241010b0 2024-06-03T00:00:11.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.587+0000 7f76290c9700 1 --2- 172.21.15.49:0/1052988982 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f76100a2ca0 0x7f76100a5160 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7614006010 tx=0x7f761400c690 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:11.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.587+0000 7f76363b1b80 1 Processor -- start 2024-06-03T00:00:11.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.588+0000 7f76363b1b80 1 -- start start 2024-06-03T00:00:11.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.588+0000 7f76363b1b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556d7c40b5f0 0x556d7c40b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:11.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.588+0000 7f76363b1b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556d7c40bf10 0x556d7c405990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:11.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.588+0000 7f76363b1b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d7c405ed0 0x556d7c4062f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:11.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.588+0000 7f76363b1b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556d7c3577c0 con 0x556d7c40bf10 2024-06-03T00:00:11.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.588+0000 7f76363b1b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x556d7c2ff6d0 con 0x556d7c40b5f0 2024-06-03T00:00:11.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.588+0000 7f76363b1b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556d7c353780 con 0x556d7c405ed0 2024-06-03T00:00:11.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.588+0000 7f76290c9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556d7c40bf10 0x556d7c405990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:11.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.588+0000 7f76290c9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556d7c40bf10 0x556d7c405990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54570/0 (socket says 172.21.15.49:54570) 2024-06-03T00:00:11.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.588+0000 7f76290c9700 1 -- 172.21.15.49:0/1494256579 learned_addr learned my addr 172.21.15.49:0/1494256579 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:11.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.588+0000 7f76298ca700 1 --2- 172.21.15.49:0/1494256579 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556d7c40b5f0 0x556d7c40b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:11.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.588+0000 7f762a0cb700 1 --2- 172.21.15.49:0/1494256579 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d7c405ed0 0x556d7c4062f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:11.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.588+0000 7f76290c9700 1 -- 172.21.15.49:0/1494256579 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d7c405ed0 msgr2=0x556d7c4062f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:11.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.588+0000 7f76290c9700 1 --2- 172.21.15.49:0/1494256579 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d7c405ed0 0x556d7c4062f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.588+0000 7f76290c9700 1 -- 172.21.15.49:0/1494256579 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556d7c40b5f0 msgr2=0x556d7c40b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:11.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.588+0000 7f76290c9700 1 --2- 172.21.15.49:0/1494256579 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556d7c40b5f0 0x556d7c40b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.588+0000 7f76290c9700 1 -- 172.21.15.49:0/1494256579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d7c2f5f00 con 0x556d7c40bf10 2024-06-03T00:00:11.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.588+0000 7f76298ca700 1 --2- 172.21.15.49:0/1494256579 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556d7c40b5f0 0x556d7c40b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:00:11.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.589+0000 7f76290c9700 1 --2- 172.21.15.49:0/1494256579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556d7c40bf10 0x556d7c405990 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7614016000 tx=0x7f7614021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6070b3a18c813c5a server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:11.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.589+0000 7f760ffff700 1 -- 172.21.15.49:0/1494256579 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76140052f0 con 0x556d7c40bf10 2024-06-03T00:00:11.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.589+0000 7f760ffff700 1 -- 172.21.15.49:0/1494256579 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7614031070 con 0x556d7c40bf10 2024-06-03T00:00:11.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.589+0000 7f760ffff700 1 -- 172.21.15.49:0/1494256579 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761400e6b0 con 0x556d7c40bf10 2024-06-03T00:00:11.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.590+0000 7f76363b1b80 1 -- 172.21.15.49:0/1494256579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556d7c40bf10 msgr2=0x556d7c405990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:11.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.590+0000 7f76363b1b80 1 --2- 172.21.15.49:0/1494256579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556d7c40bf10 0x556d7c405990 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7614016000 tx=0x7f7614021000 comp rx=0 tx=0).stop 2024-06-03T00:00:11.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.590+0000 7f76363b1b80 1 -- 172.21.15.49:0/1494256579 shutdown_connections 2024-06-03T00:00:11.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.590+0000 7f76363b1b80 1 --2- 172.21.15.49:0/1494256579 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d7c405ed0 0x556d7c4062f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.590+0000 7f76363b1b80 1 --2- 172.21.15.49:0/1494256579 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556d7c40b5f0 0x556d7c40b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.590+0000 7f76363b1b80 1 --2- 172.21.15.49:0/1494256579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556d7c40bf10 0x556d7c405990 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.590+0000 7f76363b1b80 1 -- 172.21.15.49:0/1494256579 >> 172.21.15.49:0/1494256579 conn(0x556d7c330c70 msgr2=0x556d7c400800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:11.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.590+0000 7f76363b1b80 1 -- 172.21.15.49:0/1494256579 shutdown_connections 2024-06-03T00:00:11.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.590+0000 7f76363b1b80 1 -- 172.21.15.49:0/1494256579 wait complete. 2024-06-03T00:00:11.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.590+0000 7f76363b1b80 1 -- start start 2024-06-03T00:00:11.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.591+0000 7f76363b1b80 1 Processor -- start 2024-06-03T00:00:11.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.591+0000 7f76363b1b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d7c405ed0 0x556d7c411ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:11.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.591+0000 7f76363b1b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556d7c40b5f0 0x556d7c40efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:11.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.591+0000 7f76363b1b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556d7c40bf10 0x556d7c40f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:11.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.591+0000 7f76363b1b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556d7c412920 con 0x556d7c40b5f0 2024-06-03T00:00:11.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.591+0000 7f76363b1b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x556d7c2f7ba0 con 0x556d7c40bf10 2024-06-03T00:00:11.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.591+0000 7f76363b1b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556d7c412aa0 con 0x556d7c405ed0 2024-06-03T00:00:11.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.591+0000 7f76363b1b80 10 client.0 _ll_register_callbacks cb 0x556d7c2f18d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:00:11.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.591+0000 7f76290c9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556d7c40b5f0 0x556d7c40efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:11.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.591+0000 7f76290c9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556d7c40b5f0 0x556d7c40efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54582/0 (socket says 172.21.15.49:54582) 2024-06-03T00:00:11.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.591+0000 7f76290c9700 1 -- 172.21.15.49:0/3281582368 learned_addr learned my addr 172.21.15.49:0/3281582368 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:11.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.591+0000 7f762a0cb700 1 --2- 172.21.15.49:0/3281582368 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556d7c40bf10 0x556d7c40f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:11.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.591+0000 7f76298ca700 1 --2- 172.21.15.49:0/3281582368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d7c405ed0 0x556d7c411ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:11.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.592+0000 7f76290c9700 1 -- 172.21.15.49:0/3281582368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d7c405ed0 msgr2=0x556d7c411ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:11.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.592+0000 7f76290c9700 1 --2- 172.21.15.49:0/3281582368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d7c405ed0 0x556d7c411ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.592+0000 7f76290c9700 1 -- 172.21.15.49:0/3281582368 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556d7c40bf10 msgr2=0x556d7c40f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:11.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.592+0000 7f76290c9700 1 --2- 172.21.15.49:0/3281582368 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556d7c40bf10 0x556d7c40f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.592+0000 7f76290c9700 1 -- 172.21.15.49:0/3281582368 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d7c2a6880 con 0x556d7c40b5f0 2024-06-03T00:00:11.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.592+0000 7f76290c9700 1 --2- 172.21.15.49:0/3281582368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556d7c40b5f0 0x556d7c40efe0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f761400adf0 tx=0x7f7614005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbfbd1845304bf87 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:11.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.592+0000 7f760d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:00:11.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.592+0000 7f760d7fa700 1 -- 172.21.15.49:0/3281582368 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7614021650 con 0x556d7c40b5f0 2024-06-03T00:00:11.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.592+0000 7f760d7fa700 1 -- 172.21.15.49:0/3281582368 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f76140217f0 con 0x556d7c40b5f0 2024-06-03T00:00:11.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.592+0000 7f76363b1b80 1 -- 172.21.15.49:0/3281582368 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7614031070 con 0x556d7c40b5f0 2024-06-03T00:00:11.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.592+0000 7f760d7fa700 1 -- 172.21.15.49:0/3281582368 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f76140219f0 con 0x556d7c40b5f0 2024-06-03T00:00:11.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.592+0000 7f76363b1b80 10 client.15132 fetch_fsmap learned FSMap version 26 2024-06-03T00:00:11.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.592+0000 7f76363b1b80 1 -- 172.21.15.49:0/3281582368 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556d7c41d280 con 0x556d7c40b5f0 2024-06-03T00:00:11.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.592+0000 7f760d7fa700 1 -- 172.21.15.49:0/3281582368 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7614031070 con 0x556d7c40b5f0 2024-06-03T00:00:11.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.593+0000 7f760d7fa700 1 -- 172.21.15.49:0/3281582368 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f761400b040 con 0x556d7c40b5f0 2024-06-03T00:00:11.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.593+0000 7f76363b1b80 10 client.15132 fetch_fsmap finished waiting for FSMap version 26 2024-06-03T00:00:11.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.593+0000 7f76363b1b80 10 client.15132 resolve_mds: resolved name 'h' to daemon mds.h 2024-06-03T00:00:11.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.593+0000 7f76363b1b80 20 client.15132 populate_metadata read hostname 'smithi049' 2024-06-03T00:00:11.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.593+0000 7f76363b1b80 1 --2- 172.21.15.49:0/3281582368 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x556d7c41e5d0 0x556d7c420790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:11.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.593+0000 7f76363b1b80 4 client.15132 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:00:11.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.593+0000 7f76363b1b80 1 -- 172.21.15.49:0/3281582368 --> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d7c364cc0 con 0x556d7c41e5d0 2024-06-03T00:00:11.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.593+0000 7f76298ca700 1 --2- 172.21.15.49:0/3281582368 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x556d7c41e5d0 0x556d7c420790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:11.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.593+0000 7f760d7fa700 10 client.15132 ms_handle_connect on v2:172.21.15.57:6836/230452144 2024-06-03T00:00:11.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.593+0000 7f76298ca700 1 --2- 172.21.15.49:0/3281582368 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x556d7c41e5d0 0x556d7c420790 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ccf7d9d8942224d1 server_cookie=51544d79a604eba4 in_seq=0 out_seq=0 2024-06-03T00:00:11.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.594+0000 7f760d7fa700 1 -- 172.21.15.49:0/3281582368 <== mds.3 v2:172.21.15.57:6836/230452144 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x556d7c364cc0 con 0x556d7c41e5d0 2024-06-03T00:00:11.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.594+0000 7f760d7fa700 10 client.15132 handle_command_reply: tid=0 2024-06-03T00:00:11.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.594+0000 7f76363b1b80 1 client.15132 shutdown 2024-06-03T00:00:11.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.594+0000 7f76363b1b80 1 -- 172.21.15.49:0/3281582368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556d7c40b5f0 msgr2=0x556d7c40efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:11.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.594+0000 7f76363b1b80 1 --2- 172.21.15.49:0/3281582368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556d7c40b5f0 0x556d7c40efe0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f761400adf0 tx=0x7f7614005620 comp rx=0 tx=0).stop 2024-06-03T00:00:11.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.594+0000 7f76363b1b80 1 -- 172.21.15.49:0/3281582368 shutdown_connections 2024-06-03T00:00:11.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.594+0000 7f76363b1b80 1 --2- 172.21.15.49:0/3281582368 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x556d7c41e5d0 0x556d7c420790 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.594+0000 7f76363b1b80 1 --2- 172.21.15.49:0/3281582368 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556d7c40bf10 0x556d7c40f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.594+0000 7f76363b1b80 1 --2- 172.21.15.49:0/3281582368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d7c405ed0 0x556d7c411ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.594+0000 7f760d7fa700 0 client.15132 ms_handle_reset on v2:172.21.15.57:6836/230452144 2024-06-03T00:00:11.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.594+0000 7f76363b1b80 1 --2- 172.21.15.49:0/3281582368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556d7c40b5f0 0x556d7c40efe0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.594+0000 7f76363b1b80 1 -- 172.21.15.49:0/3281582368 >> 172.21.15.49:0/3281582368 conn(0x556d7c330c70 msgr2=0x556d7c4005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:11.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.594+0000 7f76363b1b80 1 -- 172.21.15.49:0/3281582368 shutdown_connections 2024-06-03T00:00:11.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.594+0000 7f76363b1b80 1 -- 172.21.15.49:0/3281582368 wait complete. 2024-06-03T00:00:11.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.595+0000 7f76363b1b80 20 client.15132 trim_cache size 0 max 16384 2024-06-03T00:00:11.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.616+0000 7f76363b1b80 1 Processor -- start 2024-06-03T00:00:11.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.616+0000 7f76363b1b80 1 -- start start 2024-06-03T00:00:11.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.616+0000 7f76363b1b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556d7c405ed0 0x556d7c405990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:11.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.616+0000 7f76363b1b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d7c40b5f0 0x556d7c40c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:11.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.616+0000 7f76363b1b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556d7c40bf10 0x556d7c40c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:11.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.616+0000 7f76363b1b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556d7c41ead0 con 0x556d7c40bf10 2024-06-03T00:00:11.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.616+0000 7f76363b1b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x556d7c41f1a0 con 0x556d7c405ed0 2024-06-03T00:00:11.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.616+0000 7f76363b1b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556d7c41f870 con 0x556d7c40b5f0 2024-06-03T00:00:11.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.617+0000 7f762a0cb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556d7c40bf10 0x556d7c40c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:11.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.617+0000 7f762a0cb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556d7c40bf10 0x556d7c40c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54592/0 (socket says 172.21.15.49:54592) 2024-06-03T00:00:11.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.617+0000 7f762a0cb700 1 -- 172.21.15.49:0/2513675902 learned_addr learned my addr 172.21.15.49:0/2513675902 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:11.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.617+0000 7f76298ca700 1 --2- 172.21.15.49:0/2513675902 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556d7c405ed0 0x556d7c405990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:11.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.617+0000 7f76290c9700 1 --2- 172.21.15.49:0/2513675902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d7c40b5f0 0x556d7c40c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:11.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.617+0000 7f762a0cb700 1 -- 172.21.15.49:0/2513675902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d7c40b5f0 msgr2=0x556d7c40c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:11.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.617+0000 7f762a0cb700 1 --2- 172.21.15.49:0/2513675902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d7c40b5f0 0x556d7c40c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.617+0000 7f762a0cb700 1 -- 172.21.15.49:0/2513675902 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556d7c405ed0 msgr2=0x556d7c405990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:11.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.617+0000 7f762a0cb700 1 --2- 172.21.15.49:0/2513675902 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556d7c405ed0 0x556d7c405990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.617+0000 7f762a0cb700 1 -- 172.21.15.49:0/2513675902 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d7c4014b0 con 0x556d7c40bf10 2024-06-03T00:00:11.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.617+0000 7f76290c9700 1 --2- 172.21.15.49:0/2513675902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d7c40b5f0 0x556d7c40c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:00:11.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.617+0000 7f762a0cb700 1 --2- 172.21.15.49:0/2513675902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556d7c40bf10 0x556d7c40c8f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f761c013300 tx=0x7f761c013610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f8250088adb3b9 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:11.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.617+0000 7f760f7fe700 1 -- 172.21.15.49:0/2513675902 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c01a030 con 0x556d7c40bf10 2024-06-03T00:00:11.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.617+0000 7f760f7fe700 1 -- 172.21.15.49:0/2513675902 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f761c013c80 con 0x556d7c40bf10 2024-06-03T00:00:11.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.617+0000 7f760f7fe700 1 -- 172.21.15.49:0/2513675902 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c01e540 con 0x556d7c40bf10 2024-06-03T00:00:11.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.618+0000 7f76363b1b80 1 -- 172.21.15.49:0/2513675902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556d7c40bf10 msgr2=0x556d7c40c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:11.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.618+0000 7f76363b1b80 1 --2- 172.21.15.49:0/2513675902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556d7c40bf10 0x556d7c40c8f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f761c013300 tx=0x7f761c013610 comp rx=0 tx=0).stop 2024-06-03T00:00:11.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.618+0000 7f76363b1b80 1 -- 172.21.15.49:0/2513675902 shutdown_connections 2024-06-03T00:00:11.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.618+0000 7f76363b1b80 1 --2- 172.21.15.49:0/2513675902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556d7c40bf10 0x556d7c40c8f0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.618+0000 7f76363b1b80 1 --2- 172.21.15.49:0/2513675902 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556d7c405ed0 0x556d7c405990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.618+0000 7f76363b1b80 1 --2- 172.21.15.49:0/2513675902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d7c40b5f0 0x556d7c40c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.618+0000 7f76363b1b80 1 -- 172.21.15.49:0/2513675902 >> 172.21.15.49:0/2513675902 conn(0x556d7c330c70 msgr2=0x556d7c40d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:11.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.618+0000 7f76363b1b80 1 -- 172.21.15.49:0/2513675902 shutdown_connections 2024-06-03T00:00:11.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.618+0000 7f76363b1b80 1 -- 172.21.15.49:0/2513675902 wait complete. 2024-06-03T00:00:11.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.618+0000 7f76363b1b80 1 -- start start 2024-06-03T00:00:11.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.619+0000 7f76363b1b80 1 Processor -- start 2024-06-03T00:00:11.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.619+0000 7f76363b1b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d7c405ed0 0x556d7c429c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:11.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.619+0000 7f76363b1b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556d7c40b5f0 0x556d7c42a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:11.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.619+0000 7f76363b1b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556d7c40bf10 0x556d7c424bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:11.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.619+0000 7f76363b1b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556d7c420610 con 0x556d7c40bf10 2024-06-03T00:00:11.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.619+0000 7f76363b1b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x556d7c41ff40 con 0x556d7c40b5f0 2024-06-03T00:00:11.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.619+0000 7f76363b1b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556d7c420ce0 con 0x556d7c405ed0 2024-06-03T00:00:11.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.619+0000 7f76363b1b80 10 client.0 _ll_register_callbacks cb 0x556d7c2f18d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:00:11.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.619+0000 7f762a0cb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556d7c40bf10 0x556d7c424bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:11.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.619+0000 7f76298ca700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d7c405ed0 0x556d7c429c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:11.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.619+0000 7f762a0cb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556d7c40bf10 0x556d7c424bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54596/0 (socket says 172.21.15.49:54596) 2024-06-03T00:00:11.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.619+0000 7f76298ca700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d7c405ed0 0x556d7c429c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:34646/0 (socket says 172.21.15.49:34646) 2024-06-03T00:00:11.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.619+0000 7f762a0cb700 1 -- 172.21.15.49:0/1626368611 learned_addr learned my addr 172.21.15.49:0/1626368611 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:11.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.619+0000 7f76290c9700 1 --2- 172.21.15.49:0/1626368611 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556d7c40b5f0 0x556d7c42a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:11.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.619+0000 7f762a0cb700 1 -- 172.21.15.49:0/1626368611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d7c405ed0 msgr2=0x556d7c429c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:11.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.619+0000 7f762a0cb700 1 --2- 172.21.15.49:0/1626368611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d7c405ed0 0x556d7c429c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.619+0000 7f762a0cb700 1 -- 172.21.15.49:0/1626368611 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556d7c40b5f0 msgr2=0x556d7c42a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:11.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.619+0000 7f762a0cb700 1 --2- 172.21.15.49:0/1626368611 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556d7c40b5f0 0x556d7c42a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.619+0000 7f762a0cb700 1 -- 172.21.15.49:0/1626368611 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d7c405ad0 con 0x556d7c40bf10 2024-06-03T00:00:11.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.620+0000 7f762a0cb700 1 --2- 172.21.15.49:0/1626368611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556d7c40bf10 0x556d7c424bc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f761c007da0 tx=0x7f761c016be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4252bce60295971d server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:11.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.620+0000 7f760d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:00:11.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.620+0000 7f760d7fa700 1 -- 172.21.15.49:0/1626368611 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c01a030 con 0x556d7c40bf10 2024-06-03T00:00:11.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.620+0000 7f760d7fa700 1 -- 172.21.15.49:0/1626368611 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f761c004ce0 con 0x556d7c40bf10 2024-06-03T00:00:11.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.620+0000 7f76363b1b80 1 -- 172.21.15.49:0/1626368611 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f761c013c80 con 0x556d7c40bf10 2024-06-03T00:00:11.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.620+0000 7f760d7fa700 1 -- 172.21.15.49:0/1626368611 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f761c013e30 con 0x556d7c40bf10 2024-06-03T00:00:11.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.620+0000 7f76363b1b80 10 client.15138 fetch_fsmap learned FSMap version 26 2024-06-03T00:00:11.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.620+0000 7f76363b1b80 1 -- 172.21.15.49:0/1626368611 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556d7c48af30 con 0x556d7c40bf10 2024-06-03T00:00:11.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.620+0000 7f760d7fa700 1 -- 172.21.15.49:0/1626368611 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f761c013c80 con 0x556d7c40bf10 2024-06-03T00:00:11.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.620+0000 7f760d7fa700 1 -- 172.21.15.49:0/1626368611 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f761c005220 con 0x556d7c40bf10 2024-06-03T00:00:11.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.620+0000 7f76363b1b80 10 client.15138 fetch_fsmap finished waiting for FSMap version 26 2024-06-03T00:00:11.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.620+0000 7f76363b1b80 10 client.15138 resolve_mds: resolved name 'h' to daemon mds.h 2024-06-03T00:00:11.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.620+0000 7f76363b1b80 20 client.15138 populate_metadata read hostname 'smithi049' 2024-06-03T00:00:11.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.620+0000 7f76363b1b80 1 --2- 172.21.15.49:0/1626368611 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x556d7c48f930 0x556d7c48e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:11.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.621+0000 7f76363b1b80 4 client.15138 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-03T00:00:11.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.621+0000 7f76363b1b80 1 -- 172.21.15.49:0/1626368611 --> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] -- command(tid 0: {"prefix": "status"}) -- 0x556d7c35f240 con 0x556d7c48f930 2024-06-03T00:00:11.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.621+0000 7f76298ca700 1 --2- 172.21.15.49:0/1626368611 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x556d7c48f930 0x556d7c48e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:11.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.621+0000 7f76298ca700 1 --2- 172.21.15.49:0/1626368611 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x556d7c48f930 0x556d7c48e640 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=49a8efdc3d943bbf server_cookie=c541162053262012 in_seq=0 out_seq=0 2024-06-03T00:00:11.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.621+0000 7f760d7fa700 10 client.15138 ms_handle_connect on v2:172.21.15.57:6836/230452144 2024-06-03T00:00:11.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.621+0000 7f760d7fa700 1 -- 172.21.15.49:0/1626368611 <== mds.3 v2:172.21.15.57:6836/230452144 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x556d7c35f240 con 0x556d7c48f930 2024-06-03T00:00:11.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.621+0000 7f760d7fa700 10 client.15138 handle_command_reply: tid=0 2024-06-03T00:00:11.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.622+0000 7f76363b1b80 1 client.15138 shutdown 2024-06-03T00:00:11.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.622+0000 7f76363b1b80 1 -- 172.21.15.49:0/1626368611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556d7c40bf10 msgr2=0x556d7c424bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:11.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.622+0000 7f76363b1b80 1 --2- 172.21.15.49:0/1626368611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556d7c40bf10 0x556d7c424bc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f761c007da0 tx=0x7f761c016be0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.622+0000 7f76363b1b80 1 -- 172.21.15.49:0/1626368611 shutdown_connections 2024-06-03T00:00:11.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.622+0000 7f76363b1b80 1 --2- 172.21.15.49:0/1626368611 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x556d7c48f930 0x556d7c48e640 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.622+0000 7f76363b1b80 1 --2- 172.21.15.49:0/1626368611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556d7c40bf10 0x556d7c424bc0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.622+0000 7f76363b1b80 1 --2- 172.21.15.49:0/1626368611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556d7c405ed0 0x556d7c429c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.622+0000 7f76363b1b80 1 --2- 172.21.15.49:0/1626368611 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556d7c40b5f0 0x556d7c42a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.622+0000 7f760d7fa700 0 client.15138 ms_handle_reset on v2:172.21.15.57:6836/230452144 2024-06-03T00:00:11.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.622+0000 7f76363b1b80 1 -- 172.21.15.49:0/1626368611 >> 172.21.15.49:0/1626368611 conn(0x556d7c330c70 msgr2=0x556d7c3f9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:11.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.622+0000 7f76363b1b80 1 -- 172.21.15.49:0/1626368611 shutdown_connections 2024-06-03T00:00:11.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.622+0000 7f76363b1b80 1 -- 172.21.15.49:0/1626368611 wait complete. 2024-06-03T00:00:11.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.622+0000 7f76363b1b80 20 client.15138 trim_cache size 0 max 16384 2024-06-03T00:00:11.627 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:00:11.628 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "890dd222-213a-11ef-bc9b-c7b262605968", 2024-06-03T00:00:11.628 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 3, 2024-06-03T00:00:11.628 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 24464, 2024-06-03T00:00:11.628 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-06-03T00:00:11.628 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-06-03T00:00:11.628 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-06-03T00:00:11.628 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 160.17203432299999, 2024-06-03T00:00:11.628 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 26, 2024-06-03T00:00:11.628 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 90, 2024-06-03T00:00:11.628 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 88, 2024-06-03T00:00:11.628 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 201.33284861499999 2024-06-03T00:00:11.628 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:00:11.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.622+0000 7f762bb2e700 1 -- 172.21.15.49:0/1052988982 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f76100a2ca0 msgr2=0x7f76100a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:11.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.622+0000 7f762bb2e700 1 --2- 172.21.15.49:0/1052988982 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f76100a2ca0 0x7f76100a5160 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7614006010 tx=0x7f761400c690 comp rx=0 tx=0).stop 2024-06-03T00:00:11.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.622+0000 7f762bb2e700 1 -- 172.21.15.49:0/1052988982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76241010b0 msgr2=0x7f762419e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:11.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.623+0000 7f762bb2e700 1 --2- 172.21.15.49:0/1052988982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76241010b0 0x7f762419e7e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f762000c9b0 tx=0x7f762000ccc0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.623+0000 7f762bb2e700 1 -- 172.21.15.49:0/1052988982 shutdown_connections 2024-06-03T00:00:11.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.623+0000 7f762bb2e700 1 --2- 172.21.15.49:0/1052988982 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f76100a2ca0 0x7f76100a5160 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.623+0000 7f762bb2e700 1 --2- 172.21.15.49:0/1052988982 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7624105f50 0x7f76241989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.623+0000 7f762bb2e700 1 --2- 172.21.15.49:0/1052988982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76241010b0 0x7f762419e7e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.623+0000 7f762bb2e700 1 --2- 172.21.15.49:0/1052988982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7624101a60 0x7f762419ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:11.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.623+0000 7f762bb2e700 1 -- 172.21.15.49:0/1052988982 >> 172.21.15.49:0/1052988982 conn(0x7f76240766b0 msgr2=0x7f7624104d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:11.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.623+0000 7f762bb2e700 1 -- 172.21.15.49:0/1052988982 shutdown_connections 2024-06-03T00:00:11.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:11.623+0000 7f762bb2e700 1 -- 172.21.15.49:0/1052988982 wait complete. 2024-06-03T00:00:12.283 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.c status 2024-06-03T00:00:12.533 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:00:13.343 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:12 smithi049 ceph-mon[32302]: pgmap v388: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-03T00:00:13.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:12 smithi107 ceph-mon[37048]: pgmap v388: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-03T00:00:13.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:13 smithi057 ceph-mon[36457]: pgmap v388: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-03T00:00:14.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.246+0000 7f9010bf7700 1 -- 172.21.15.49:0/3440400292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f900c103120 msgr2=0x7f900c107130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:14.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.246+0000 7f9010bf7700 1 --2- 172.21.15.49:0/3440400292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f900c103120 0x7f900c107130 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f90000099c0 tx=0x7f9000009cd0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.247+0000 7f9010bf7700 1 -- 172.21.15.49:0/3440400292 shutdown_connections 2024-06-03T00:00:14.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.247+0000 7f9010bf7700 1 --2- 172.21.15.49:0/3440400292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f900c107860 0x7f900c10f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.247+0000 7f9010bf7700 1 --2- 172.21.15.49:0/3440400292 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f900c102770 0x7f900c102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.247+0000 7f9010bf7700 1 --2- 172.21.15.49:0/3440400292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f900c103120 0x7f900c107130 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.247+0000 7f9010bf7700 1 -- 172.21.15.49:0/3440400292 >> 172.21.15.49:0/3440400292 conn(0x7f900c079600 msgr2=0x7f900c079a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:14.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.247+0000 7f9010bf7700 1 -- 172.21.15.49:0/3440400292 shutdown_connections 2024-06-03T00:00:14.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.247+0000 7f9010bf7700 1 -- 172.21.15.49:0/3440400292 wait complete. 2024-06-03T00:00:14.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.247+0000 7f9010bf7700 1 Processor -- start 2024-06-03T00:00:14.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.247+0000 7f9010bf7700 1 -- start start 2024-06-03T00:00:14.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.248+0000 7f9010bf7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f900c102770 0x7f900c19e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:14.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.248+0000 7f9010bf7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f900c103120 0x7f900c19ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:14.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.248+0000 7f9010bf7700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f900c107860 0x7f900c198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:14.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.248+0000 7f9010bf7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f900c112770 con 0x7f900c103120 2024-06-03T00:00:14.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.248+0000 7f9010bf7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f900c1125f0 con 0x7f900c102770 2024-06-03T00:00:14.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.248+0000 7f9010bf7700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f900c1128f0 con 0x7f900c107860 2024-06-03T00:00:14.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.248+0000 7f9009d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f900c103120 0x7f900c19ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:14.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.248+0000 7f9009d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f900c103120 0x7f900c19ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35448/0 (socket says 172.21.15.49:35448) 2024-06-03T00:00:14.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.248+0000 7f9009d9b700 1 -- 172.21.15.49:0/2301466430 learned_addr learned my addr 172.21.15.49:0/2301466430 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:14.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.248+0000 7f900a59c700 1 --2- 172.21.15.49:0/2301466430 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f900c102770 0x7f900c19e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:14.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.248+0000 7f900ad9d700 1 --2- 172.21.15.49:0/2301466430 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f900c107860 0x7f900c198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:14.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.248+0000 7f9009d9b700 1 -- 172.21.15.49:0/2301466430 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f900c107860 msgr2=0x7f900c198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:14.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.248+0000 7f9009d9b700 1 --2- 172.21.15.49:0/2301466430 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f900c107860 0x7f900c198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.248+0000 7f9009d9b700 1 -- 172.21.15.49:0/2301466430 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f900c102770 msgr2=0x7f900c19e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:14.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.248+0000 7f9009d9b700 1 --2- 172.21.15.49:0/2301466430 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f900c102770 0x7f900c19e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.248+0000 7f9009d9b700 1 -- 172.21.15.49:0/2301466430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f900c1990f0 con 0x7f900c103120 2024-06-03T00:00:14.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.248+0000 7f9009d9b700 1 --2- 172.21.15.49:0/2301466430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f900c103120 0x7f900c19ecc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9000006010 tx=0x7f90000038b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:14.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.249+0000 7f8ffb7fe700 1 -- 172.21.15.49:0/2301466430 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9000027070 con 0x7f900c103120 2024-06-03T00:00:14.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.249+0000 7f8ffb7fe700 1 -- 172.21.15.49:0/2301466430 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9000004050 con 0x7f900c103120 2024-06-03T00:00:14.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.249+0000 7f9010bf7700 1 -- 172.21.15.49:0/2301466430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f900c199380 con 0x7f900c103120 2024-06-03T00:00:14.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.249+0000 7f8ffb7fe700 1 -- 172.21.15.49:0/2301466430 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9000022d40 con 0x7f900c103120 2024-06-03T00:00:14.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.249+0000 7f9010bf7700 1 -- 172.21.15.49:0/2301466430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f900c1a5650 con 0x7f900c103120 2024-06-03T00:00:14.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.251+0000 7f8ffb7fe700 1 -- 172.21.15.49:0/2301466430 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f900002a070 con 0x7f900c103120 2024-06-03T00:00:14.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.252+0000 7f8ffb7fe700 1 --2- 172.21.15.49:0/2301466430 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8ff40a2c20 0x7f8ff40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:14.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.252+0000 7f900a59c700 1 --2- 172.21.15.49:0/2301466430 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8ff40a2c20 0x7f8ff40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:14.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.252+0000 7f8ffb7fe700 1 -- 172.21.15.49:0/2301466430 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f90000cfee0 con 0x7f900c103120 2024-06-03T00:00:14.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.252+0000 7f901b47ab80 1 Processor -- start 2024-06-03T00:00:14.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.252+0000 7f900a59c700 1 --2- 172.21.15.49:0/2301466430 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8ff40a2c20 0x7f8ff40a50e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f900c1072d0 tx=0x7f8ffc00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:14.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.253+0000 7f901b47ab80 1 -- start start 2024-06-03T00:00:14.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.253+0000 7f901b47ab80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b11fca3f10 0x55b11fca42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:14.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.253+0000 7f901b47ab80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b11fca4830 0x55b11fc9e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:14.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.253+0000 7f901b47ab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b11fc9e750 0x55b11fc9eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:14.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.253+0000 7f901b47ab80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55b11fb90f10 con 0x55b11fca4830 2024-06-03T00:00:14.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.253+0000 7f901b47ab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55b11fbef800 con 0x55b11fc9e750 2024-06-03T00:00:14.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.253+0000 7f901b47ab80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b11fb57410 con 0x55b11fca3f10 2024-06-03T00:00:14.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.253+0000 7f9009d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b11fca4830 0x55b11fc9e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:14.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.253+0000 7f9009d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b11fca4830 0x55b11fc9e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35452/0 (socket says 172.21.15.49:35452) 2024-06-03T00:00:14.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.253+0000 7f9009d9b700 1 -- 172.21.15.49:0/4040918406 learned_addr learned my addr 172.21.15.49:0/4040918406 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:14.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.253+0000 7f900a59c700 1 --2- 172.21.15.49:0/4040918406 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b11fca3f10 0x55b11fca42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:14.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.253+0000 7f900ad9d700 1 --2- 172.21.15.49:0/4040918406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b11fc9e750 0x55b11fc9eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:14.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.253+0000 7f9009d9b700 1 -- 172.21.15.49:0/4040918406 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b11fca3f10 msgr2=0x55b11fca42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:14.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.253+0000 7f9009d9b700 1 --2- 172.21.15.49:0/4040918406 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b11fca3f10 0x55b11fca42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.253+0000 7f9009d9b700 1 -- 172.21.15.49:0/4040918406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b11fc9e750 msgr2=0x55b11fc9eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:14.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.253+0000 7f9009d9b700 1 --2- 172.21.15.49:0/4040918406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b11fc9e750 0x55b11fc9eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.253+0000 7f9009d9b700 1 -- 172.21.15.49:0/4040918406 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b11fb3e880 con 0x55b11fca4830 2024-06-03T00:00:14.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.253+0000 7f9009d9b700 1 --2- 172.21.15.49:0/4040918406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b11fca4830 0x55b11fc9e210 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f90000991a0 tx=0x7f9000009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d6e0016cbfee47 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:14.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.253+0000 7f8ff8ff9700 1 -- 172.21.15.49:0/4040918406 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900009ced0 con 0x55b11fca4830 2024-06-03T00:00:14.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.254+0000 7f8ff8ff9700 1 -- 172.21.15.49:0/4040918406 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f900009c7d0 con 0x55b11fca4830 2024-06-03T00:00:14.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.254+0000 7f8ff8ff9700 1 -- 172.21.15.49:0/4040918406 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90000a4f20 con 0x55b11fca4830 2024-06-03T00:00:14.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.254+0000 7f901b47ab80 1 -- 172.21.15.49:0/4040918406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b11fca4830 msgr2=0x55b11fc9e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:14.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.254+0000 7f901b47ab80 1 --2- 172.21.15.49:0/4040918406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b11fca4830 0x55b11fc9e210 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f90000991a0 tx=0x7f9000009cd0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.254+0000 7f901b47ab80 1 -- 172.21.15.49:0/4040918406 shutdown_connections 2024-06-03T00:00:14.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.254+0000 7f901b47ab80 1 --2- 172.21.15.49:0/4040918406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b11fc9e750 0x55b11fc9eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.254+0000 7f901b47ab80 1 --2- 172.21.15.49:0/4040918406 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b11fca3f10 0x55b11fca42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.254+0000 7f901b47ab80 1 --2- 172.21.15.49:0/4040918406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b11fca4830 0x55b11fc9e210 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.254+0000 7f901b47ab80 1 -- 172.21.15.49:0/4040918406 >> 172.21.15.49:0/4040918406 conn(0x55b11fbcb030 msgr2=0x55b11fc991d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:14.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.254+0000 7f901b47ab80 1 -- 172.21.15.49:0/4040918406 shutdown_connections 2024-06-03T00:00:14.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.254+0000 7f901b47ab80 1 -- 172.21.15.49:0/4040918406 wait complete. 2024-06-03T00:00:14.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.255+0000 7f901b47ab80 1 -- start start 2024-06-03T00:00:14.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.255+0000 7f901b47ab80 1 Processor -- start 2024-06-03T00:00:14.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.255+0000 7f901b47ab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b11fc9e750 0x55b11fcaa5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:14.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.255+0000 7f901b47ab80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b11fca3f10 0x55b11fca78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:14.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.255+0000 7f901b47ab80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b11fca4830 0x55b11fca7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:14.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.255+0000 7f901b47ab80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55b11fb8ff70 con 0x55b11fca4830 2024-06-03T00:00:14.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.255+0000 7f901b47ab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55b11fbeb7c0 con 0x55b11fc9e750 2024-06-03T00:00:14.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.255+0000 7f901b47ab80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b11fcaf3d0 con 0x55b11fca3f10 2024-06-03T00:00:14.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.255+0000 7f901b47ab80 10 client.0 _ll_register_callbacks cb 0x55b11fb85560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:00:14.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.255+0000 7f900ad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b11fca4830 0x55b11fca7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:14.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.255+0000 7f900ad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b11fca4830 0x55b11fca7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35460/0 (socket says 172.21.15.49:35460) 2024-06-03T00:00:14.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.255+0000 7f900a59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b11fc9e750 0x55b11fcaa5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:14.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.255+0000 7f900ad9d700 1 -- 172.21.15.49:0/1708087578 learned_addr learned my addr 172.21.15.49:0/1708087578 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:14.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.255+0000 7f9009d9b700 1 --2- 172.21.15.49:0/1708087578 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b11fca3f10 0x55b11fca78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:14.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.256+0000 7f900ad9d700 1 -- 172.21.15.49:0/1708087578 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b11fca3f10 msgr2=0x55b11fca78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:14.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.256+0000 7f900ad9d700 1 --2- 172.21.15.49:0/1708087578 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b11fca3f10 0x55b11fca78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.256+0000 7f900ad9d700 1 -- 172.21.15.49:0/1708087578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b11fc9e750 msgr2=0x55b11fcaa5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:14.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.256+0000 7f900ad9d700 1 --2- 172.21.15.49:0/1708087578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b11fc9e750 0x55b11fcaa5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.256+0000 7f900ad9d700 1 -- 172.21.15.49:0/1708087578 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b11fbb5700 con 0x55b11fca4830 2024-06-03T00:00:14.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.256+0000 7f9009d9b700 1 --2- 172.21.15.49:0/1708087578 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b11fca3f10 0x55b11fca78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:00:14.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.256+0000 7f900ad9d700 1 --2- 172.21.15.49:0/1708087578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b11fca4830 0x55b11fca7e30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9004008e60 tx=0x7f90040114a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bef1d448f1a3a42 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:14.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.256+0000 7f8ff1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:00:14.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.256+0000 7f8ff1ffb700 1 -- 172.21.15.49:0/1708087578 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9004011d90 con 0x55b11fca4830 2024-06-03T00:00:14.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.256+0000 7f8ff1ffb700 1 -- 172.21.15.49:0/1708087578 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f9004016480 con 0x55b11fca4830 2024-06-03T00:00:14.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.256+0000 7f901b47ab80 1 -- 172.21.15.49:0/1708087578 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f900009c7d0 con 0x55b11fca4830 2024-06-03T00:00:14.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.256+0000 7f8ff1ffb700 1 -- 172.21.15.49:0/1708087578 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9004016680 con 0x55b11fca4830 2024-06-03T00:00:14.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.256+0000 7f901b47ab80 10 client.15150 fetch_fsmap learned FSMap version 26 2024-06-03T00:00:14.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.256+0000 7f901b47ab80 1 -- 172.21.15.49:0/1708087578 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b11fcb9b20 con 0x55b11fca4830 2024-06-03T00:00:14.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.256+0000 7f8ff1ffb700 1 -- 172.21.15.49:0/1708087578 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f900009c7d0 con 0x55b11fca4830 2024-06-03T00:00:14.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.256+0000 7f8ff1ffb700 1 -- 172.21.15.49:0/1708087578 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f900401f930 con 0x55b11fca4830 2024-06-03T00:00:14.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.257+0000 7f901b47ab80 10 client.15150 fetch_fsmap finished waiting for FSMap version 26 2024-06-03T00:00:14.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.257+0000 7f901b47ab80 10 client.15150 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-03T00:00:14.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.257+0000 7f901b47ab80 20 client.15150 populate_metadata read hostname 'smithi049' 2024-06-03T00:00:14.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.257+0000 7f901b47ab80 1 --2- 172.21.15.49:0/1708087578 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x55b11fcbc160 0x55b11fcbd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:14.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.257+0000 7f901b47ab80 4 client.15150 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:00:14.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.257+0000 7f901b47ab80 1 -- 172.21.15.49:0/1708087578 --> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b11fbfcd00 con 0x55b11fcbc160 2024-06-03T00:00:14.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.257+0000 7f900a59c700 1 --2- 172.21.15.49:0/1708087578 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x55b11fcbc160 0x55b11fcbd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:14.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.257+0000 7f900a59c700 1 --2- 172.21.15.49:0/1708087578 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x55b11fcbc160 0x55b11fcbd5d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ad7856f03948b080 server_cookie=c3cbf66bf811d88c in_seq=0 out_seq=0 2024-06-03T00:00:14.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.257+0000 7f8ff1ffb700 10 client.15150 ms_handle_connect on v2:172.21.15.107:6836/3700593315 2024-06-03T00:00:14.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.258+0000 7f8ff1ffb700 1 -- 172.21.15.49:0/1708087578 <== mds.2 v2:172.21.15.107:6836/3700593315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55b11fbfcd00 con 0x55b11fcbc160 2024-06-03T00:00:14.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.258+0000 7f8ff1ffb700 10 client.15150 handle_command_reply: tid=0 2024-06-03T00:00:14.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.258+0000 7f901b47ab80 1 client.15150 shutdown 2024-06-03T00:00:14.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.258+0000 7f901b47ab80 1 -- 172.21.15.49:0/1708087578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b11fca4830 msgr2=0x55b11fca7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:14.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.258+0000 7f901b47ab80 1 --2- 172.21.15.49:0/1708087578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b11fca4830 0x55b11fca7e30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9004008e60 tx=0x7f90040114a0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.258+0000 7f901b47ab80 1 -- 172.21.15.49:0/1708087578 shutdown_connections 2024-06-03T00:00:14.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.258+0000 7f901b47ab80 1 --2- 172.21.15.49:0/1708087578 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x55b11fcbc160 0x55b11fcbd5d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.258+0000 7f8ff1ffb700 0 client.15150 ms_handle_reset on v2:172.21.15.107:6836/3700593315 2024-06-03T00:00:14.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.258+0000 7f901b47ab80 1 --2- 172.21.15.49:0/1708087578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b11fca4830 0x55b11fca7e30 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.258+0000 7f901b47ab80 1 --2- 172.21.15.49:0/1708087578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b11fc9e750 0x55b11fcaa5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.258+0000 7f901b47ab80 1 --2- 172.21.15.49:0/1708087578 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b11fca3f10 0x55b11fca78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.258+0000 7f901b47ab80 1 -- 172.21.15.49:0/1708087578 >> 172.21.15.49:0/1708087578 conn(0x55b11fbcb030 msgr2=0x55b11fc986b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:14.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.258+0000 7f901b47ab80 1 -- 172.21.15.49:0/1708087578 shutdown_connections 2024-06-03T00:00:14.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.258+0000 7f901b47ab80 1 -- 172.21.15.49:0/1708087578 wait complete. 2024-06-03T00:00:14.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.259+0000 7f901b47ab80 20 client.15150 trim_cache size 0 max 16384 2024-06-03T00:00:14.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.280+0000 7f901b47ab80 1 Processor -- start 2024-06-03T00:00:14.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.280+0000 7f901b47ab80 1 -- start start 2024-06-03T00:00:14.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.280+0000 7f901b47ab80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b11fc9e750 0x55b11fc9e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:14.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.280+0000 7f901b47ab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b11fca3f10 0x55b11fca7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:14.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.280+0000 7f901b47ab80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b11fca4830 0x55b11fca53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:14.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.280+0000 7f901b47ab80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55b11fcbb910 con 0x55b11fca4830 2024-06-03T00:00:14.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.280+0000 7f901b47ab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55b11fcbbfe0 con 0x55b11fca3f10 2024-06-03T00:00:14.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.280+0000 7f901b47ab80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b11fcbc6b0 con 0x55b11fc9e750 2024-06-03T00:00:14.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.280+0000 7f900ad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b11fca4830 0x55b11fca53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:14.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.280+0000 7f900ad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b11fca4830 0x55b11fca53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35468/0 (socket says 172.21.15.49:35468) 2024-06-03T00:00:14.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.280+0000 7f900ad9d700 1 -- 172.21.15.49:0/2994017366 learned_addr learned my addr 172.21.15.49:0/2994017366 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:14.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.281+0000 7f900a59c700 1 --2- 172.21.15.49:0/2994017366 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b11fc9e750 0x55b11fc9e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:14.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.281+0000 7f900ad9d700 1 -- 172.21.15.49:0/2994017366 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b11fc9e750 msgr2=0x55b11fc9e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:14.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.281+0000 7f900ad9d700 1 --2- 172.21.15.49:0/2994017366 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b11fc9e750 0x55b11fc9e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.281+0000 7f900ad9d700 1 -- 172.21.15.49:0/2994017366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b11fca3f10 msgr2=0x55b11fca7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:14.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.281+0000 7f900ad9d700 1 --2- 172.21.15.49:0/2994017366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b11fca3f10 0x55b11fca7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.281+0000 7f900ad9d700 1 -- 172.21.15.49:0/2994017366 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b11fca5e60 con 0x55b11fca4830 2024-06-03T00:00:14.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.281+0000 7f900a59c700 1 --2- 172.21.15.49:0/2994017366 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b11fc9e750 0x55b11fc9e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:00:14.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.281+0000 7f900ad9d700 1 --2- 172.21.15.49:0/2994017366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b11fca4830 0x55b11fca53a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9004000f80 tx=0x7f9004007400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd096b8976c447ef server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:14.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.281+0000 7f8ff3fff700 1 -- 172.21.15.49:0/2994017366 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9004011b90 con 0x55b11fca4830 2024-06-03T00:00:14.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.281+0000 7f8ff3fff700 1 -- 172.21.15.49:0/2994017366 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f900401b070 con 0x55b11fca4830 2024-06-03T00:00:14.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.281+0000 7f8ff3fff700 1 -- 172.21.15.49:0/2994017366 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9004016e50 con 0x55b11fca4830 2024-06-03T00:00:14.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.282+0000 7f901b47ab80 1 -- 172.21.15.49:0/2994017366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b11fca4830 msgr2=0x55b11fca53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:14.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.282+0000 7f901b47ab80 1 --2- 172.21.15.49:0/2994017366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b11fca4830 0x55b11fca53a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9004000f80 tx=0x7f9004007400 comp rx=0 tx=0).stop 2024-06-03T00:00:14.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.282+0000 7f901b47ab80 1 -- 172.21.15.49:0/2994017366 shutdown_connections 2024-06-03T00:00:14.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.282+0000 7f901b47ab80 1 --2- 172.21.15.49:0/2994017366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b11fca4830 0x55b11fca53a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.282+0000 7f901b47ab80 1 --2- 172.21.15.49:0/2994017366 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b11fc9e750 0x55b11fc9e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.282+0000 7f901b47ab80 1 --2- 172.21.15.49:0/2994017366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b11fca3f10 0x55b11fca7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.282+0000 7f901b47ab80 1 -- 172.21.15.49:0/2994017366 >> 172.21.15.49:0/2994017366 conn(0x55b11fbcb030 msgr2=0x55b11fca4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:14.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.282+0000 7f901b47ab80 1 -- 172.21.15.49:0/2994017366 shutdown_connections 2024-06-03T00:00:14.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.282+0000 7f901b47ab80 1 -- 172.21.15.49:0/2994017366 wait complete. 2024-06-03T00:00:14.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.282+0000 7f901b47ab80 1 -- start start 2024-06-03T00:00:14.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.282+0000 7f901b47ab80 1 Processor -- start 2024-06-03T00:00:14.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.283+0000 7f901b47ab80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b11fc9e750 0x55b11fcc71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:14.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.283+0000 7f901b47ab80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b11fca3f10 0x55b11fc983e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:14.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.283+0000 7f901b47ab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b11fca4830 0x55b11fc98920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:14.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.283+0000 7f901b47ab80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55b11fcbd450 con 0x55b11fc9e750 2024-06-03T00:00:14.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.283+0000 7f901b47ab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55b11fcbcd80 con 0x55b11fca4830 2024-06-03T00:00:14.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.283+0000 7f901b47ab80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b11fcbdb20 con 0x55b11fca3f10 2024-06-03T00:00:14.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.283+0000 7f901b47ab80 10 client.0 _ll_register_callbacks cb 0x55b11fb85560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:00:14.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.283+0000 7f900a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b11fc9e750 0x55b11fcc71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:14.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.283+0000 7f900a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b11fc9e750 0x55b11fcc71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35482/0 (socket says 172.21.15.49:35482) 2024-06-03T00:00:14.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.283+0000 7f900a59c700 1 -- 172.21.15.49:0/4113462436 learned_addr learned my addr 172.21.15.49:0/4113462436 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:14.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.283+0000 7f9009d9b700 1 --2- 172.21.15.49:0/4113462436 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b11fca3f10 0x55b11fc983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:14.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.283+0000 7f900a59c700 1 -- 172.21.15.49:0/4113462436 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b11fca3f10 msgr2=0x55b11fc983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:14.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.283+0000 7f900a59c700 1 --2- 172.21.15.49:0/4113462436 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b11fca3f10 0x55b11fc983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.283+0000 7f900ad9d700 1 --2- 172.21.15.49:0/4113462436 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b11fca4830 0x55b11fc98920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:14.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.283+0000 7f900a59c700 1 -- 172.21.15.49:0/4113462436 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b11fca4830 msgr2=0x55b11fc98920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:14.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.283+0000 7f900a59c700 1 --2- 172.21.15.49:0/4113462436 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b11fca4830 0x55b11fc98920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.283+0000 7f900a59c700 1 -- 172.21.15.49:0/4113462436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b11fc99180 con 0x55b11fc9e750 2024-06-03T00:00:14.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.283+0000 7f900a59c700 1 --2- 172.21.15.49:0/4113462436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b11fc9e750 0x55b11fcc71d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc005d40 tx=0x7f8ffc012070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc353c2a2567562 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:14.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.283+0000 7f8ff1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:00:14.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.283+0000 7f8ff1ffb700 1 -- 172.21.15.49:0/4113462436 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc02c060 con 0x55b11fc9e750 2024-06-03T00:00:14.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.283+0000 7f8ff1ffb700 1 -- 172.21.15.49:0/4113462436 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f8ffc027380 con 0x55b11fc9e750 2024-06-03T00:00:14.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.283+0000 7f901b47ab80 1 -- 172.21.15.49:0/4113462436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f900401b070 con 0x55b11fc9e750 2024-06-03T00:00:14.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.284+0000 7f8ff1ffb700 1 -- 172.21.15.49:0/4113462436 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8ffc016070 con 0x55b11fc9e750 2024-06-03T00:00:14.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.284+0000 7f901b47ab80 10 client.15156 fetch_fsmap learned FSMap version 26 2024-06-03T00:00:14.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.284+0000 7f901b47ab80 1 -- 172.21.15.49:0/4113462436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b11fd27a50 con 0x55b11fc9e750 2024-06-03T00:00:14.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.284+0000 7f8ff1ffb700 1 -- 172.21.15.49:0/4113462436 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f900401b070 con 0x55b11fc9e750 2024-06-03T00:00:14.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.284+0000 7f8ff1ffb700 1 -- 172.21.15.49:0/4113462436 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f8ffc031070 con 0x55b11fc9e750 2024-06-03T00:00:14.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.284+0000 7f901b47ab80 10 client.15156 fetch_fsmap finished waiting for FSMap version 26 2024-06-03T00:00:14.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.284+0000 7f901b47ab80 10 client.15156 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-03T00:00:14.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.284+0000 7f901b47ab80 20 client.15156 populate_metadata read hostname 'smithi049' 2024-06-03T00:00:14.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.284+0000 7f901b47ab80 1 --2- 172.21.15.49:0/4113462436 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x55b11fcbc160 0x55b11fd2b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:14.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.284+0000 7f901b47ab80 4 client.15156 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-03T00:00:14.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.284+0000 7f901b47ab80 1 -- 172.21.15.49:0/4113462436 --> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] -- command(tid 0: {"prefix": "status"}) -- 0x55b11fbf7280 con 0x55b11fcbc160 2024-06-03T00:00:14.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.284+0000 7f9009d9b700 1 --2- 172.21.15.49:0/4113462436 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x55b11fcbc160 0x55b11fd2b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:14.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.285+0000 7f9009d9b700 1 --2- 172.21.15.49:0/4113462436 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x55b11fcbc160 0x55b11fd2b350 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=187083ed240905e0 server_cookie=92af54131eb6687f in_seq=0 out_seq=0 2024-06-03T00:00:14.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.285+0000 7f8ff1ffb700 10 client.15156 ms_handle_connect on v2:172.21.15.107:6836/3700593315 2024-06-03T00:00:14.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.285+0000 7f8ff1ffb700 1 -- 172.21.15.49:0/4113462436 <== mds.2 v2:172.21.15.107:6836/3700593315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55b11fbf7280 con 0x55b11fcbc160 2024-06-03T00:00:14.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.285+0000 7f8ff1ffb700 10 client.15156 handle_command_reply: tid=0 2024-06-03T00:00:14.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.285+0000 7f901b47ab80 1 client.15156 shutdown 2024-06-03T00:00:14.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.285+0000 7f901b47ab80 1 -- 172.21.15.49:0/4113462436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b11fc9e750 msgr2=0x55b11fcc71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:14.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.285+0000 7f901b47ab80 1 --2- 172.21.15.49:0/4113462436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b11fc9e750 0x55b11fcc71d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc005d40 tx=0x7f8ffc012070 comp rx=0 tx=0).stop 2024-06-03T00:00:14.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.285+0000 7f901b47ab80 1 -- 172.21.15.49:0/4113462436 shutdown_connections 2024-06-03T00:00:14.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.285+0000 7f901b47ab80 1 --2- 172.21.15.49:0/4113462436 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x55b11fcbc160 0x55b11fd2b350 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.285+0000 7f901b47ab80 1 --2- 172.21.15.49:0/4113462436 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b11fca4830 0x55b11fc98920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.285+0000 7f901b47ab80 1 --2- 172.21.15.49:0/4113462436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b11fc9e750 0x55b11fcc71d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.285+0000 7f8ff1ffb700 0 client.15156 ms_handle_reset on v2:172.21.15.107:6836/3700593315 2024-06-03T00:00:14.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.285+0000 7f901b47ab80 1 --2- 172.21.15.49:0/4113462436 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b11fca3f10 0x55b11fc983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.285+0000 7f901b47ab80 1 -- 172.21.15.49:0/4113462436 >> 172.21.15.49:0/4113462436 conn(0x55b11fbcb030 msgr2=0x55b11fca9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:14.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.285+0000 7f901b47ab80 1 -- 172.21.15.49:0/4113462436 shutdown_connections 2024-06-03T00:00:14.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.285+0000 7f901b47ab80 1 -- 172.21.15.49:0/4113462436 wait complete. 2024-06-03T00:00:14.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.285+0000 7f901b47ab80 20 client.15156 trim_cache size 0 max 16384 2024-06-03T00:00:14.291 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:00:14.291 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "890dd222-213a-11ef-bc9b-c7b262605968", 2024-06-03T00:00:14.291 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 2, 2024-06-03T00:00:14.292 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 24466, 2024-06-03T00:00:14.292 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-06-03T00:00:14.292 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-06-03T00:00:14.292 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-06-03T00:00:14.292 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 163.84500735399999, 2024-06-03T00:00:14.292 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 26, 2024-06-03T00:00:14.292 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 90, 2024-06-03T00:00:14.292 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 88, 2024-06-03T00:00:14.292 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 206.871764138 2024-06-03T00:00:14.292 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:00:14.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.286+0000 7f9010bf7700 1 -- 172.21.15.49:0/2301466430 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8ff40a2c20 msgr2=0x7f8ff40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:14.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.286+0000 7f9010bf7700 1 --2- 172.21.15.49:0/2301466430 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8ff40a2c20 0x7f8ff40a50e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f900c1072d0 tx=0x7f8ffc00a380 comp rx=0 tx=0).stop 2024-06-03T00:00:14.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.286+0000 7f9010bf7700 1 -- 172.21.15.49:0/2301466430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f900c103120 msgr2=0x7f900c19ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:14.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.286+0000 7f9010bf7700 1 --2- 172.21.15.49:0/2301466430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f900c103120 0x7f900c19ecc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9000006010 tx=0x7f90000038b0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.286+0000 7f9010bf7700 1 -- 172.21.15.49:0/2301466430 shutdown_connections 2024-06-03T00:00:14.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.286+0000 7f9010bf7700 1 --2- 172.21.15.49:0/2301466430 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8ff40a2c20 0x7f8ff40a50e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.286+0000 7f9010bf7700 1 --2- 172.21.15.49:0/2301466430 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f900c107860 0x7f900c198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.286+0000 7f9010bf7700 1 --2- 172.21.15.49:0/2301466430 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f900c102770 0x7f900c19e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.286+0000 7f9010bf7700 1 --2- 172.21.15.49:0/2301466430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f900c103120 0x7f900c19ecc0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:14.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.286+0000 7f9010bf7700 1 -- 172.21.15.49:0/2301466430 >> 172.21.15.49:0/2301466430 conn(0x7f900c079600 msgr2=0x7f900c1004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:14.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.286+0000 7f9010bf7700 1 -- 172.21.15.49:0/2301466430 shutdown_connections 2024-06-03T00:00:14.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:14.286+0000 7f9010bf7700 1 -- 172.21.15.49:0/2301466430 wait complete. 2024-06-03T00:00:15.049 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.b status 2024-06-03T00:00:15.300 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:00:15.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:15 smithi107 ceph-mon[37048]: pgmap v389: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-03T00:00:15.420 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:15 smithi049 ceph-mon[32302]: pgmap v389: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-03T00:00:15.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:15 smithi057 ceph-mon[36457]: pgmap v389: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-03T00:00:17.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.078+0000 7f22ac6fd700 1 -- 172.21.15.49:0/2392420794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22a406a170 msgr2=0x7f22a406a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:17.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.078+0000 7f22ac6fd700 1 --2- 172.21.15.49:0/2392420794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22a406a170 0x7f22a406a5f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2294009990 tx=0x7f2294009ca0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.078+0000 7f22ac6fd700 1 -- 172.21.15.49:0/2392420794 shutdown_connections 2024-06-03T00:00:17.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.078+0000 7f22ac6fd700 1 --2- 172.21.15.49:0/2392420794 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22a406ab30 0x7f22a410f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.078+0000 7f22ac6fd700 1 --2- 172.21.15.49:0/2392420794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22a4108500 0x7f22a41088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.078+0000 7f22ac6fd700 1 --2- 172.21.15.49:0/2392420794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22a406a170 0x7f22a406a5f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.078+0000 7f22ac6fd700 1 -- 172.21.15.49:0/2392420794 >> 172.21.15.49:0/2392420794 conn(0x7f22a4078340 msgr2=0x7f22a4078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:17.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.078+0000 7f22ac6fd700 1 -- 172.21.15.49:0/2392420794 shutdown_connections 2024-06-03T00:00:17.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.078+0000 7f22ac6fd700 1 -- 172.21.15.49:0/2392420794 wait complete. 2024-06-03T00:00:17.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.079+0000 7f22ac6fd700 1 Processor -- start 2024-06-03T00:00:17.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.079+0000 7f22ac6fd700 1 -- start start 2024-06-03T00:00:17.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.079+0000 7f22ac6fd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22a406a170 0x7f22a4101460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:17.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.079+0000 7f22ac6fd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22a406ab30 0x7f22a41019a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:17.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.079+0000 7f22ac6fd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22a4108500 0x7f22a4101ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:17.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.079+0000 7f22ac6fd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f22a4112860 con 0x7f22a4108500 2024-06-03T00:00:17.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.079+0000 7f22ac6fd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f22a41126e0 con 0x7f22a406ab30 2024-06-03T00:00:17.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.079+0000 7f22ac6fd700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f22a41129e0 con 0x7f22a406a170 2024-06-03T00:00:17.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.079+0000 7f22aac9a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22a4108500 0x7f22a4101ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:17.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.079+0000 7f22aac9a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22a4108500 0x7f22a4101ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35486/0 (socket says 172.21.15.49:35486) 2024-06-03T00:00:17.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.079+0000 7f22aac9a700 1 -- 172.21.15.49:0/3652717743 learned_addr learned my addr 172.21.15.49:0/3652717743 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:17.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.079+0000 7f22a9c98700 1 --2- 172.21.15.49:0/3652717743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22a406ab30 0x7f22a41019a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:17.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.079+0000 7f22aa499700 1 --2- 172.21.15.49:0/3652717743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22a406a170 0x7f22a4101460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:17.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.080+0000 7f22aac9a700 1 -- 172.21.15.49:0/3652717743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22a406a170 msgr2=0x7f22a4101460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:17.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.080+0000 7f22aac9a700 1 --2- 172.21.15.49:0/3652717743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22a406a170 0x7f22a4101460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.080+0000 7f22aac9a700 1 -- 172.21.15.49:0/3652717743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22a406ab30 msgr2=0x7f22a41019a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:17.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.080+0000 7f22aac9a700 1 --2- 172.21.15.49:0/3652717743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22a406ab30 0x7f22a41019a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.080+0000 7f22aac9a700 1 -- 172.21.15.49:0/3652717743 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a41a72e0 con 0x7f22a4108500 2024-06-03T00:00:17.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.080+0000 7f22aac9a700 1 --2- 172.21.15.49:0/3652717743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22a4108500 0x7f22a4101ee0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f229c00b970 tx=0x7f229c00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:17.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.080+0000 7f229b7fe700 1 -- 172.21.15.49:0/3652717743 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229c00d860 con 0x7f22a4108500 2024-06-03T00:00:17.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.080+0000 7f229b7fe700 1 -- 172.21.15.49:0/3652717743 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f229c00e430 con 0x7f22a4108500 2024-06-03T00:00:17.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.080+0000 7f22ac6fd700 1 -- 172.21.15.49:0/3652717743 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22a41a75d0 con 0x7f22a4108500 2024-06-03T00:00:17.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.080+0000 7f229b7fe700 1 -- 172.21.15.49:0/3652717743 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229c017660 con 0x7f22a4108500 2024-06-03T00:00:17.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.080+0000 7f22ac6fd700 1 -- 172.21.15.49:0/3652717743 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22a41a7ae0 con 0x7f22a4108500 2024-06-03T00:00:17.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.083+0000 7f229b7fe700 1 -- 172.21.15.49:0/3652717743 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f229c00e5e0 con 0x7f22a4108500 2024-06-03T00:00:17.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.084+0000 7f229b7fe700 1 --2- 172.21.15.49:0/3652717743 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f22900a2c20 0x7f22900a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:17.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.084+0000 7f22aa499700 1 --2- 172.21.15.49:0/3652717743 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f22900a2c20 0x7f22900a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:17.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.084+0000 7f229b7fe700 1 -- 172.21.15.49:0/3652717743 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f229c0cec00 con 0x7f22a4108500 2024-06-03T00:00:17.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.084+0000 7f22b6f80b80 1 Processor -- start 2024-06-03T00:00:17.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.084+0000 7f22aa499700 1 --2- 172.21.15.49:0/3652717743 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f22900a2c20 0x7f22900a50e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f22a0009a10 tx=0x7f22a0009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:17.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.084+0000 7f22b6f80b80 1 -- start start 2024-06-03T00:00:17.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.085+0000 7f22b6f80b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce6c6fef10 0x55ce6c6ff2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:17.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.085+0000 7f22b6f80b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce6c6ff830 0x55ce6c6f9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:17.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.085+0000 7f22b6f80b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce6c6f9750 0x55ce6c6f9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:17.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.085+0000 7f22b6f80b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ce6c5ebf10 con 0x55ce6c6f9750 2024-06-03T00:00:17.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.085+0000 7f22b6f80b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55ce6c64a800 con 0x55ce6c6ff830 2024-06-03T00:00:17.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.085+0000 7f22b6f80b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ce6c5b2410 con 0x55ce6c6fef10 2024-06-03T00:00:17.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.085+0000 7f22aac9a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce6c6f9750 0x55ce6c6f9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:17.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.085+0000 7f22aac9a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce6c6f9750 0x55ce6c6f9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35490/0 (socket says 172.21.15.49:35490) 2024-06-03T00:00:17.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.085+0000 7f22aac9a700 1 -- 172.21.15.49:0/2077741367 learned_addr learned my addr 172.21.15.49:0/2077741367 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:17.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.085+0000 7f22a9c98700 1 --2- 172.21.15.49:0/2077741367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce6c6ff830 0x55ce6c6f9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:17.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.085+0000 7f22aa499700 1 --2- 172.21.15.49:0/2077741367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce6c6fef10 0x55ce6c6ff2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:17.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.085+0000 7f22aac9a700 1 -- 172.21.15.49:0/2077741367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce6c6fef10 msgr2=0x55ce6c6ff2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:17.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.085+0000 7f22aac9a700 1 --2- 172.21.15.49:0/2077741367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce6c6fef10 0x55ce6c6ff2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.085+0000 7f22aac9a700 1 -- 172.21.15.49:0/2077741367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce6c6ff830 msgr2=0x55ce6c6f9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:17.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.085+0000 7f22aac9a700 1 --2- 172.21.15.49:0/2077741367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce6c6ff830 0x55ce6c6f9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.085+0000 7f22aac9a700 1 -- 172.21.15.49:0/2077741367 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce6c599880 con 0x55ce6c6f9750 2024-06-03T00:00:17.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.085+0000 7f22aac9a700 1 --2- 172.21.15.49:0/2077741367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce6c6f9750 0x55ce6c6f9b70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f229c0a3b60 tx=0x7f229c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e08fb1fa71a018be server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:17.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.085+0000 7f2298ff9700 1 -- 172.21.15.49:0/2077741367 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229c0b3020 con 0x55ce6c6f9750 2024-06-03T00:00:17.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.086+0000 7f2298ff9700 1 -- 172.21.15.49:0/2077741367 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f229c09f7d0 con 0x55ce6c6f9750 2024-06-03T00:00:17.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.086+0000 7f2298ff9700 1 -- 172.21.15.49:0/2077741367 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229c0b4420 con 0x55ce6c6f9750 2024-06-03T00:00:17.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.086+0000 7f22b6f80b80 1 -- 172.21.15.49:0/2077741367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce6c6f9750 msgr2=0x55ce6c6f9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:17.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.086+0000 7f22b6f80b80 1 --2- 172.21.15.49:0/2077741367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce6c6f9750 0x55ce6c6f9b70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f229c0a3b60 tx=0x7f229c004ad0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.086+0000 7f22b6f80b80 1 -- 172.21.15.49:0/2077741367 shutdown_connections 2024-06-03T00:00:17.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.086+0000 7f22b6f80b80 1 --2- 172.21.15.49:0/2077741367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce6c6f9750 0x55ce6c6f9b70 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.086+0000 7f22b6f80b80 1 --2- 172.21.15.49:0/2077741367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce6c6fef10 0x55ce6c6ff2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.086+0000 7f22b6f80b80 1 --2- 172.21.15.49:0/2077741367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce6c6ff830 0x55ce6c6f9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.086+0000 7f22b6f80b80 1 -- 172.21.15.49:0/2077741367 >> 172.21.15.49:0/2077741367 conn(0x55ce6c626030 msgr2=0x55ce6c6f41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:17.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.086+0000 7f22b6f80b80 1 -- 172.21.15.49:0/2077741367 shutdown_connections 2024-06-03T00:00:17.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.086+0000 7f22b6f80b80 1 -- 172.21.15.49:0/2077741367 wait complete. 2024-06-03T00:00:17.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.087+0000 7f22b6f80b80 1 -- start start 2024-06-03T00:00:17.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.087+0000 7f22b6f80b80 1 Processor -- start 2024-06-03T00:00:17.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.087+0000 7f22b6f80b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce6c6f9750 0x55ce6c705530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:17.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.087+0000 7f22b6f80b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce6c6fef10 0x55ce6c702830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.087+0000 7f22b6f80b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce6c6ff830 0x55ce6c702d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.087+0000 7f22b6f80b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ce6c5eaf70 con 0x55ce6c6f9750 2024-06-03T00:00:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.087+0000 7f22b6f80b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55ce6c6467c0 con 0x55ce6c6ff830 2024-06-03T00:00:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.087+0000 7f22b6f80b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ce6c706210 con 0x55ce6c6fef10 2024-06-03T00:00:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.087+0000 7f22b6f80b80 10 client.0 _ll_register_callbacks cb 0x55ce6c5e0560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:00:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.087+0000 7f22aa499700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce6c6f9750 0x55ce6c705530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.087+0000 7f22aa499700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce6c6f9750 0x55ce6c705530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35506/0 (socket says 172.21.15.49:35506) 2024-06-03T00:00:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.087+0000 7f22aa499700 1 -- 172.21.15.49:0/3733025021 learned_addr learned my addr 172.21.15.49:0/3733025021 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.088+0000 7f22a9c98700 1 --2- 172.21.15.49:0/3733025021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce6c6fef10 0x55ce6c702830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.088+0000 7f22aac9a700 1 --2- 172.21.15.49:0/3733025021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce6c6ff830 0x55ce6c702d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.088+0000 7f22aa499700 1 -- 172.21.15.49:0/3733025021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce6c6fef10 msgr2=0x55ce6c702830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.088+0000 7f22aa499700 1 --2- 172.21.15.49:0/3733025021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce6c6fef10 0x55ce6c702830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.088+0000 7f22aa499700 1 -- 172.21.15.49:0/3733025021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce6c6ff830 msgr2=0x55ce6c702d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:17.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.088+0000 7f22aa499700 1 --2- 172.21.15.49:0/3733025021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce6c6ff830 0x55ce6c702d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.088+0000 7f22aa499700 1 -- 172.21.15.49:0/3733025021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce6c610700 con 0x55ce6c6f9750 2024-06-03T00:00:17.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.088+0000 7f22aac9a700 1 --2- 172.21.15.49:0/3733025021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce6c6ff830 0x55ce6c702d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:00:17.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.088+0000 7f22aa499700 1 --2- 172.21.15.49:0/3733025021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce6c6f9750 0x55ce6c705530 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f22a0015500 tx=0x7f22a0004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5168bd80a140e2bf server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:17.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.088+0000 7f228dffb700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:00:17.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.088+0000 7f228dffb700 1 -- 172.21.15.49:0/3733025021 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a0025070 con 0x55ce6c6f9750 2024-06-03T00:00:17.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.088+0000 7f228dffb700 1 -- 172.21.15.49:0/3733025021 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f22a0015d30 con 0x55ce6c6f9750 2024-06-03T00:00:17.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.088+0000 7f22b6f80b80 1 -- 172.21.15.49:0/3733025021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f229c09f7d0 con 0x55ce6c6f9750 2024-06-03T00:00:17.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.088+0000 7f228dffb700 1 -- 172.21.15.49:0/3733025021 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f22a001b040 con 0x55ce6c6f9750 2024-06-03T00:00:17.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.088+0000 7f22b6f80b80 10 client.15168 fetch_fsmap learned FSMap version 26 2024-06-03T00:00:17.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.088+0000 7f22b6f80b80 1 -- 172.21.15.49:0/3733025021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ce6c7109d0 con 0x55ce6c6f9750 2024-06-03T00:00:17.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.088+0000 7f228dffb700 1 -- 172.21.15.49:0/3733025021 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f229c09f7d0 con 0x55ce6c6f9750 2024-06-03T00:00:17.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.089+0000 7f228dffb700 1 -- 172.21.15.49:0/3733025021 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f22a0021440 con 0x55ce6c6f9750 2024-06-03T00:00:17.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.089+0000 7f22b6f80b80 10 client.15168 fetch_fsmap finished waiting for FSMap version 26 2024-06-03T00:00:17.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.089+0000 7f22b6f80b80 10 client.15168 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-03T00:00:17.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.089+0000 7f22b6f80b80 20 client.15168 populate_metadata read hostname 'smithi049' 2024-06-03T00:00:17.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.089+0000 7f22b6f80b80 1 --2- 172.21.15.49:0/3733025021 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x55ce6c713040 0x55ce6c7144b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:17.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.089+0000 7f22b6f80b80 4 client.15168 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:00:17.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.089+0000 7f22b6f80b80 1 -- 172.21.15.49:0/3733025021 --> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce6c657d00 con 0x55ce6c713040 2024-06-03T00:00:17.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.089+0000 7f22a9c98700 1 --2- 172.21.15.49:0/3733025021 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x55ce6c713040 0x55ce6c7144b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:17.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.089+0000 7f22a9c98700 1 --2- 172.21.15.49:0/3733025021 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x55ce6c713040 0x55ce6c7144b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f23c86a57e6966f3 server_cookie=81609efa574a3284 in_seq=0 out_seq=0 2024-06-03T00:00:17.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.089+0000 7f228dffb700 10 client.15168 ms_handle_connect on v2:172.21.15.57:6838/249825195 2024-06-03T00:00:17.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.090+0000 7f228dffb700 1 -- 172.21.15.49:0/3733025021 <== mds.1 v2:172.21.15.57:6838/249825195 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55ce6c657d00 con 0x55ce6c713040 2024-06-03T00:00:17.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.090+0000 7f228dffb700 10 client.15168 handle_command_reply: tid=0 2024-06-03T00:00:17.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.090+0000 7f22b6f80b80 1 client.15168 shutdown 2024-06-03T00:00:17.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.090+0000 7f22b6f80b80 1 -- 172.21.15.49:0/3733025021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce6c6f9750 msgr2=0x55ce6c705530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:17.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.090+0000 7f22b6f80b80 1 --2- 172.21.15.49:0/3733025021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce6c6f9750 0x55ce6c705530 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f22a0015500 tx=0x7f22a0004860 comp rx=0 tx=0).stop 2024-06-03T00:00:17.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.090+0000 7f22b6f80b80 1 -- 172.21.15.49:0/3733025021 shutdown_connections 2024-06-03T00:00:17.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.090+0000 7f22b6f80b80 1 --2- 172.21.15.49:0/3733025021 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x55ce6c713040 0x55ce6c7144b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.090+0000 7f22b6f80b80 1 --2- 172.21.15.49:0/3733025021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce6c6ff830 0x55ce6c702d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.090+0000 7f22b6f80b80 1 --2- 172.21.15.49:0/3733025021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce6c6f9750 0x55ce6c705530 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.090+0000 7f228dffb700 0 client.15168 ms_handle_reset on v2:172.21.15.57:6838/249825195 2024-06-03T00:00:17.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.090+0000 7f22b6f80b80 1 --2- 172.21.15.49:0/3733025021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce6c6fef10 0x55ce6c702830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.090+0000 7f22b6f80b80 1 -- 172.21.15.49:0/3733025021 >> 172.21.15.49:0/3733025021 conn(0x55ce6c626030 msgr2=0x55ce6c6f36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:17.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.090+0000 7f22b6f80b80 1 -- 172.21.15.49:0/3733025021 shutdown_connections 2024-06-03T00:00:17.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.090+0000 7f22b6f80b80 1 -- 172.21.15.49:0/3733025021 wait complete. 2024-06-03T00:00:17.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.090+0000 7f22b6f80b80 20 client.15168 trim_cache size 0 max 16384 2024-06-03T00:00:17.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.111+0000 7f22b6f80b80 1 Processor -- start 2024-06-03T00:00:17.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.112+0000 7f22b6f80b80 1 -- start start 2024-06-03T00:00:17.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.112+0000 7f22b6f80b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce6c6f9750 0x55ce6c6f9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:17.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.112+0000 7f22b6f80b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce6c6fef10 0x55ce6c7019b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:17.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.112+0000 7f22b6f80b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce6c6ff830 0x55ce6c705070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:17.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.112+0000 7f22b6f80b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ce6c7127f0 con 0x55ce6c6f9750 2024-06-03T00:00:17.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.112+0000 7f22b6f80b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55ce6c712ec0 con 0x55ce6c6fef10 2024-06-03T00:00:17.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.112+0000 7f22b6f80b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ce6c713590 con 0x55ce6c6ff830 2024-06-03T00:00:17.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.112+0000 7f22aa499700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce6c6f9750 0x55ce6c6f9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:17.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.112+0000 7f22aa499700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce6c6f9750 0x55ce6c6f9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35520/0 (socket says 172.21.15.49:35520) 2024-06-03T00:00:17.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.112+0000 7f22aa499700 1 -- 172.21.15.49:0/3672160755 learned_addr learned my addr 172.21.15.49:0/3672160755 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:17.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.112+0000 7f22a9c98700 1 --2- 172.21.15.49:0/3672160755 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce6c6fef10 0x55ce6c7019b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:17.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.112+0000 7f22aa499700 1 -- 172.21.15.49:0/3672160755 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce6c6ff830 msgr2=0x55ce6c705070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:17.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.112+0000 7f22aa499700 1 --2- 172.21.15.49:0/3672160755 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce6c6ff830 0x55ce6c705070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.112+0000 7f22aa499700 1 -- 172.21.15.49:0/3672160755 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce6c6fef10 msgr2=0x55ce6c7019b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:17.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.112+0000 7f22aa499700 1 --2- 172.21.15.49:0/3672160755 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce6c6fef10 0x55ce6c7019b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.112+0000 7f22aa499700 1 -- 172.21.15.49:0/3672160755 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce6c6f58f0 con 0x55ce6c6f9750 2024-06-03T00:00:17.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.112+0000 7f22aa499700 1 --2- 172.21.15.49:0/3672160755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce6c6f9750 0x55ce6c6f9210 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f22a0010010 tx=0x7f22a0015970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb087db54905eec server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:17.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.113+0000 7f228ffff700 1 -- 172.21.15.49:0/3672160755 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a0025040 con 0x55ce6c6f9750 2024-06-03T00:00:17.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.113+0000 7f228ffff700 1 -- 172.21.15.49:0/3672160755 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22a0021aa0 con 0x55ce6c6f9750 2024-06-03T00:00:17.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.113+0000 7f228ffff700 1 -- 172.21.15.49:0/3672160755 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a00066f0 con 0x55ce6c6f9750 2024-06-03T00:00:17.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.113+0000 7f22b6f80b80 1 -- 172.21.15.49:0/3672160755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce6c6f9750 msgr2=0x55ce6c6f9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:17.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.113+0000 7f22b6f80b80 1 --2- 172.21.15.49:0/3672160755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce6c6f9750 0x55ce6c6f9210 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f22a0010010 tx=0x7f22a0015970 comp rx=0 tx=0).stop 2024-06-03T00:00:17.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.113+0000 7f22b6f80b80 1 -- 172.21.15.49:0/3672160755 shutdown_connections 2024-06-03T00:00:17.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.113+0000 7f22b6f80b80 1 --2- 172.21.15.49:0/3672160755 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce6c6ff830 0x55ce6c705070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.113+0000 7f22b6f80b80 1 --2- 172.21.15.49:0/3672160755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce6c6f9750 0x55ce6c6f9210 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.113+0000 7f22b6f80b80 1 --2- 172.21.15.49:0/3672160755 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce6c6fef10 0x55ce6c7019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.113+0000 7f22b6f80b80 1 -- 172.21.15.49:0/3672160755 >> 172.21.15.49:0/3672160755 conn(0x55ce6c626030 msgr2=0x55ce6c700280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:17.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.113+0000 7f22b6f80b80 1 -- 172.21.15.49:0/3672160755 shutdown_connections 2024-06-03T00:00:17.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.113+0000 7f22b6f80b80 1 -- 172.21.15.49:0/3672160755 wait complete. 2024-06-03T00:00:17.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.114+0000 7f22b6f80b80 1 -- start start 2024-06-03T00:00:17.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.114+0000 7f22b6f80b80 1 Processor -- start 2024-06-03T00:00:17.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.114+0000 7f22b6f80b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce6c6f9750 0x55ce6c717ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:17.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.114+0000 7f22b6f80b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce6c6fef10 0x55ce6c718420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:17.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.114+0000 7f22b6f80b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce6c6ff830 0x55ce6c71c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:17.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.114+0000 7f22b6f80b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ce6c714330 con 0x55ce6c6ff830 2024-06-03T00:00:17.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.114+0000 7f22b6f80b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55ce6c713c60 con 0x55ce6c6fef10 2024-06-03T00:00:17.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.114+0000 7f22b6f80b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ce6c714a00 con 0x55ce6c6f9750 2024-06-03T00:00:17.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.114+0000 7f22b6f80b80 10 client.0 _ll_register_callbacks cb 0x55ce6c5e0560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:00:17.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.114+0000 7f22a9c98700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce6c6fef10 0x55ce6c718420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:17.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.114+0000 7f22a9c98700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce6c6fef10 0x55ce6c718420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.49:42380/0 (socket says 172.21.15.49:42380) 2024-06-03T00:00:17.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.114+0000 7f22a9c98700 1 -- 172.21.15.49:0/2982616206 learned_addr learned my addr 172.21.15.49:0/2982616206 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:17.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.114+0000 7f22aa499700 1 --2- 172.21.15.49:0/2982616206 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce6c6f9750 0x55ce6c717ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:17.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.114+0000 7f22aac9a700 1 --2- 172.21.15.49:0/2982616206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce6c6ff830 0x55ce6c71c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:17.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.114+0000 7f22a9c98700 1 -- 172.21.15.49:0/2982616206 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce6c6f9750 msgr2=0x55ce6c717ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:17.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.114+0000 7f22a9c98700 1 --2- 172.21.15.49:0/2982616206 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce6c6f9750 0x55ce6c717ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.114+0000 7f22a9c98700 1 -- 172.21.15.49:0/2982616206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce6c6ff830 msgr2=0x55ce6c71c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:17.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.114+0000 7f22a9c98700 1 --2- 172.21.15.49:0/2982616206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce6c6ff830 0x55ce6c71c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.115+0000 7f22a9c98700 1 -- 172.21.15.49:0/2982616206 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce6c71cbe0 con 0x55ce6c6fef10 2024-06-03T00:00:17.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.115+0000 7f22a9c98700 1 --2- 172.21.15.49:0/2982616206 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce6c6fef10 0x55ce6c718420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f229400b5c0 tx=0x7f2294003860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8632be53c21213d5 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:17.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.115+0000 7f228dffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2024-06-03T00:00:17.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.115+0000 7f228dffb700 1 -- 172.21.15.49:0/2982616206 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2294003d70 con 0x55ce6c6fef10 2024-06-03T00:00:17.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.115+0000 7f22b6f80b80 1 -- 172.21.15.49:0/2982616206 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22a0021aa0 con 0x55ce6c6fef10 2024-06-03T00:00:17.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.115+0000 7f228dffb700 1 -- 172.21.15.49:0/2982616206 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f229400b8d0 con 0x55ce6c6fef10 2024-06-03T00:00:17.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.115+0000 7f228dffb700 1 -- 172.21.15.49:0/2982616206 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f229400bad0 con 0x55ce6c6fef10 2024-06-03T00:00:17.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.115+0000 7f22b6f80b80 10 client.24863 fetch_fsmap learned FSMap version 26 2024-06-03T00:00:17.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.115+0000 7f22b6f80b80 1 -- 172.21.15.49:0/2982616206 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ce6c77f2f0 con 0x55ce6c6fef10 2024-06-03T00:00:17.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.115+0000 7f228dffb700 1 -- 172.21.15.49:0/2982616206 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22a0021aa0 con 0x55ce6c6fef10 2024-06-03T00:00:17.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.115+0000 7f228dffb700 1 -- 172.21.15.49:0/2982616206 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f229400f620 con 0x55ce6c6fef10 2024-06-03T00:00:17.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.116+0000 7f22b6f80b80 10 client.24863 fetch_fsmap finished waiting for FSMap version 26 2024-06-03T00:00:17.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.116+0000 7f22b6f80b80 10 client.24863 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-03T00:00:17.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.116+0000 7f22b6f80b80 20 client.24863 populate_metadata read hostname 'smithi049' 2024-06-03T00:00:17.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.116+0000 7f22b6f80b80 1 --2- 172.21.15.49:0/2982616206 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x55ce6c783e60 0x55ce6c782b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:17.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.116+0000 7f22b6f80b80 4 client.24863 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-03T00:00:17.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.116+0000 7f22b6f80b80 1 -- 172.21.15.49:0/2982616206 --> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] -- command(tid 0: {"prefix": "status"}) -- 0x55ce6c652280 con 0x55ce6c783e60 2024-06-03T00:00:17.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.116+0000 7f22aa499700 1 --2- 172.21.15.49:0/2982616206 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x55ce6c783e60 0x55ce6c782b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:17.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.116+0000 7f22aa499700 1 --2- 172.21.15.49:0/2982616206 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x55ce6c783e60 0x55ce6c782b70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c3c6ffef6c82aea server_cookie=2eb1b4f76ef9a93d in_seq=0 out_seq=0 2024-06-03T00:00:17.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.116+0000 7f228dffb700 10 client.24863 ms_handle_connect on v2:172.21.15.57:6838/249825195 2024-06-03T00:00:17.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.116+0000 7f228dffb700 1 -- 172.21.15.49:0/2982616206 <== mds.1 v2:172.21.15.57:6838/249825195 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55ce6c652280 con 0x55ce6c783e60 2024-06-03T00:00:17.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.116+0000 7f228dffb700 10 client.24863 handle_command_reply: tid=0 2024-06-03T00:00:17.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.116+0000 7f22b6f80b80 1 client.24863 shutdown 2024-06-03T00:00:17.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.116+0000 7f22b6f80b80 1 -- 172.21.15.49:0/2982616206 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce6c6fef10 msgr2=0x55ce6c718420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:17.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.117+0000 7f22b6f80b80 1 --2- 172.21.15.49:0/2982616206 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce6c6fef10 0x55ce6c718420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f229400b5c0 tx=0x7f2294003860 comp rx=0 tx=0).stop 2024-06-03T00:00:17.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.117+0000 7f22b6f80b80 1 -- 172.21.15.49:0/2982616206 shutdown_connections 2024-06-03T00:00:17.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.117+0000 7f22b6f80b80 1 --2- 172.21.15.49:0/2982616206 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x55ce6c783e60 0x55ce6c782b70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.117+0000 7f22b6f80b80 1 --2- 172.21.15.49:0/2982616206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ce6c6ff830 0x55ce6c71c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.117+0000 7f22b6f80b80 1 --2- 172.21.15.49:0/2982616206 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ce6c6f9750 0x55ce6c717ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.117+0000 7f22b6f80b80 1 --2- 172.21.15.49:0/2982616206 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ce6c6fef10 0x55ce6c718420 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.117+0000 7f228dffb700 0 client.24863 ms_handle_reset on v2:172.21.15.57:6838/249825195 2024-06-03T00:00:17.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.117+0000 7f22b6f80b80 1 -- 172.21.15.49:0/2982616206 >> 172.21.15.49:0/2982616206 conn(0x55ce6c626030 msgr2=0x55ce6c6fe210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:17.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.117+0000 7f22b6f80b80 1 -- 172.21.15.49:0/2982616206 shutdown_connections 2024-06-03T00:00:17.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.117+0000 7f22b6f80b80 1 -- 172.21.15.49:0/2982616206 wait complete. 2024-06-03T00:00:17.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.117+0000 7f22b6f80b80 20 client.24863 trim_cache size 0 max 16384 2024-06-03T00:00:17.122 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:00:17.122 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "890dd222-213a-11ef-bc9b-c7b262605968", 2024-06-03T00:00:17.122 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 1, 2024-06-03T00:00:17.122 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 24485, 2024-06-03T00:00:17.122 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-06-03T00:00:17.122 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-06-03T00:00:17.122 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-06-03T00:00:17.122 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 167.678353738, 2024-06-03T00:00:17.122 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 26, 2024-06-03T00:00:17.122 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 90, 2024-06-03T00:00:17.122 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 88, 2024-06-03T00:00:17.122 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 194.797103222 2024-06-03T00:00:17.123 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:00:17.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.117+0000 7f22ac6fd700 1 -- 172.21.15.49:0/3652717743 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f22900a2c20 msgr2=0x7f22900a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:17.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.117+0000 7f22ac6fd700 1 --2- 172.21.15.49:0/3652717743 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f22900a2c20 0x7f22900a50e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f22a0009a10 tx=0x7f22a0009190 comp rx=0 tx=0).stop 2024-06-03T00:00:17.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.117+0000 7f22ac6fd700 1 -- 172.21.15.49:0/3652717743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22a4108500 msgr2=0x7f22a4101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:17.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.117+0000 7f22ac6fd700 1 --2- 172.21.15.49:0/3652717743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22a4108500 0x7f22a4101ee0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f229c00b970 tx=0x7f229c00bc80 comp rx=0 tx=0).stop 2024-06-03T00:00:17.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.117+0000 7f22ac6fd700 1 -- 172.21.15.49:0/3652717743 shutdown_connections 2024-06-03T00:00:17.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.117+0000 7f22ac6fd700 1 --2- 172.21.15.49:0/3652717743 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f22900a2c20 0x7f22900a50e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.117+0000 7f22ac6fd700 1 --2- 172.21.15.49:0/3652717743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22a4108500 0x7f22a4101ee0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.117+0000 7f22ac6fd700 1 --2- 172.21.15.49:0/3652717743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22a406a170 0x7f22a4101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.117+0000 7f22ac6fd700 1 --2- 172.21.15.49:0/3652717743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22a406ab30 0x7f22a41019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:17.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.117+0000 7f22ac6fd700 1 -- 172.21.15.49:0/3652717743 >> 172.21.15.49:0/3652717743 conn(0x7f22a4078340 msgr2=0x7f22a4100160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:17.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.117+0000 7f22ac6fd700 1 -- 172.21.15.49:0/3652717743 shutdown_connections 2024-06-03T00:00:17.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:17.117+0000 7f22ac6fd700 1 -- 172.21.15.49:0/3652717743 wait complete. 2024-06-03T00:00:17.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:17 smithi107 ceph-mon[37048]: pgmap v390: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-06-03T00:00:17.428 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:17 smithi049 ceph-mon[32302]: pgmap v390: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-06-03T00:00:17.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:17 smithi057 ceph-mon[36457]: pgmap v390: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-06-03T00:00:17.916 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.i status 2024-06-03T00:00:18.172 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:00:19.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:19 smithi107 ceph-mon[37048]: pgmap v391: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-06-03T00:00:19.430 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:19 smithi049 ceph-mon[32302]: pgmap v391: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-06-03T00:00:19.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:19 smithi057 ceph-mon[36457]: pgmap v391: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-06-03T00:00:19.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.932+0000 7fcd7d430700 1 -- 172.21.15.49:0/2062256480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd78102740 msgr2=0x7fcd78102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:19.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.932+0000 7fcd7d430700 1 --2- 172.21.15.49:0/2062256480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd78102740 0x7fcd78102b20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcd680099c0 tx=0x7fcd68009cd0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.932+0000 7fcd7d430700 1 -- 172.21.15.49:0/2062256480 shutdown_connections 2024-06-03T00:00:19.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.932+0000 7fcd7d430700 1 --2- 172.21.15.49:0/2062256480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd78107840 0x7fcd7810f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.933+0000 7fcd7d430700 1 --2- 172.21.15.49:0/2062256480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd78102740 0x7fcd78102b20 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.933+0000 7fcd7d430700 1 --2- 172.21.15.49:0/2062256480 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd781030f0 0x7fcd78107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.933+0000 7fcd7d430700 1 -- 172.21.15.49:0/2062256480 >> 172.21.15.49:0/2062256480 conn(0x7fcd780795f0 msgr2=0x7fcd78079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:19.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.933+0000 7fcd7d430700 1 -- 172.21.15.49:0/2062256480 shutdown_connections 2024-06-03T00:00:19.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.933+0000 7fcd7d430700 1 -- 172.21.15.49:0/2062256480 wait complete. 2024-06-03T00:00:19.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.933+0000 7fcd7d430700 1 Processor -- start 2024-06-03T00:00:19.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.933+0000 7fcd7d430700 1 -- start start 2024-06-03T00:00:19.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.934+0000 7fcd7d430700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd78102740 0x7fcd78074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:19.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.934+0000 7fcd7d430700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd781030f0 0x7fcd78074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:19.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.934+0000 7fcd7d430700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd78107840 0x7fcd78075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:19.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.934+0000 7fcd7d430700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcd781127d0 con 0x7fcd78107840 2024-06-03T00:00:19.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.934+0000 7fcd7d430700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fcd78112650 con 0x7fcd78102740 2024-06-03T00:00:19.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.934+0000 7fcd7d430700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcd78112950 con 0x7fcd781030f0 2024-06-03T00:00:19.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.934+0000 7fcd777fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd78107840 0x7fcd78075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:19.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.934+0000 7fcd76ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd78102740 0x7fcd78074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:19.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.934+0000 7fcd777fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd78107840 0x7fcd78075210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35546/0 (socket says 172.21.15.49:35546) 2024-06-03T00:00:19.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.934+0000 7fcd777fe700 1 -- 172.21.15.49:0/3238371966 learned_addr learned my addr 172.21.15.49:0/3238371966 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:19.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.934+0000 7fcd767fc700 1 --2- 172.21.15.49:0/3238371966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd781030f0 0x7fcd78074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:19.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.934+0000 7fcd777fe700 1 -- 172.21.15.49:0/3238371966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd781030f0 msgr2=0x7fcd78074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:19.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.934+0000 7fcd777fe700 1 --2- 172.21.15.49:0/3238371966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd781030f0 0x7fcd78074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.934+0000 7fcd777fe700 1 -- 172.21.15.49:0/3238371966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd78102740 msgr2=0x7fcd78074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:19.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.934+0000 7fcd777fe700 1 --2- 172.21.15.49:0/3238371966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd78102740 0x7fcd78074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.934+0000 7fcd777fe700 1 -- 172.21.15.49:0/3238371966 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd781a7150 con 0x7fcd78107840 2024-06-03T00:00:19.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.934+0000 7fcd777fe700 1 --2- 172.21.15.49:0/3238371966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd78107840 0x7fcd78075210 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcd7000ada0 tx=0x7fcd7000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:19.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.934+0000 7fcd5ffff700 1 -- 172.21.15.49:0/3238371966 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd70017020 con 0x7fcd78107840 2024-06-03T00:00:19.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.934+0000 7fcd5ffff700 1 -- 172.21.15.49:0/3238371966 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd7000cdb0 con 0x7fcd78107840 2024-06-03T00:00:19.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.934+0000 7fcd7d430700 1 -- 172.21.15.49:0/3238371966 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd781a7440 con 0x7fcd78107840 2024-06-03T00:00:19.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.935+0000 7fcd5ffff700 1 -- 172.21.15.49:0/3238371966 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd700053e0 con 0x7fcd78107840 2024-06-03T00:00:19.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.935+0000 7fcd7d430700 1 -- 172.21.15.49:0/3238371966 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd781a7980 con 0x7fcd78107840 2024-06-03T00:00:19.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.937+0000 7fcd5ffff700 1 -- 172.21.15.49:0/3238371966 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fcd7000c8d0 con 0x7fcd78107840 2024-06-03T00:00:19.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.938+0000 7fcd5ffff700 1 --2- 172.21.15.49:0/3238371966 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fcd600a2c20 0x7fcd600a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:19.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.938+0000 7fcd76ffd700 1 --2- 172.21.15.49:0/3238371966 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fcd600a2c20 0x7fcd600a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:19.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.938+0000 7fcd5ffff700 1 -- 172.21.15.49:0/3238371966 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fcd700ce6b0 con 0x7fcd78107840 2024-06-03T00:00:19.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.938+0000 7fcd87cb3b80 1 Processor -- start 2024-06-03T00:00:19.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.938+0000 7fcd76ffd700 1 --2- 172.21.15.49:0/3238371966 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fcd600a2c20 0x7fcd600a50e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcd68000c00 tx=0x7fcd68005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:19.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.938+0000 7fcd87cb3b80 1 -- start start 2024-06-03T00:00:19.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.938+0000 7fcd87cb3b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649668275f0 0x5649668279d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:19.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.939+0000 7fcd87cb3b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564966827f10 0x564966821990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:19.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.939+0000 7fcd87cb3b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564966821ed0 0x5649668222f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:19.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.939+0000 7fcd87cb3b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5649667737c0 con 0x564966821ed0 2024-06-03T00:00:19.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.939+0000 7fcd87cb3b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x56496671b6d0 con 0x564966827f10 2024-06-03T00:00:19.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.939+0000 7fcd87cb3b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56496676f780 con 0x5649668275f0 2024-06-03T00:00:19.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.939+0000 7fcd777fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564966821ed0 0x5649668222f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:19.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.939+0000 7fcd777fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564966821ed0 0x5649668222f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35548/0 (socket says 172.21.15.49:35548) 2024-06-03T00:00:19.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.939+0000 7fcd777fe700 1 -- 172.21.15.49:0/2009616086 learned_addr learned my addr 172.21.15.49:0/2009616086 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:19.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.939+0000 7fcd76ffd700 1 --2- 172.21.15.49:0/2009616086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649668275f0 0x5649668279d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:19.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.939+0000 7fcd767fc700 1 --2- 172.21.15.49:0/2009616086 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564966827f10 0x564966821990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:19.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.939+0000 7fcd777fe700 1 -- 172.21.15.49:0/2009616086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649668275f0 msgr2=0x5649668279d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:19.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.939+0000 7fcd777fe700 1 --2- 172.21.15.49:0/2009616086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649668275f0 0x5649668279d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.939+0000 7fcd777fe700 1 -- 172.21.15.49:0/2009616086 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564966827f10 msgr2=0x564966821990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:19.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.939+0000 7fcd777fe700 1 --2- 172.21.15.49:0/2009616086 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564966827f10 0x564966821990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.939+0000 7fcd777fe700 1 -- 172.21.15.49:0/2009616086 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564966711f00 con 0x564966821ed0 2024-06-03T00:00:19.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.939+0000 7fcd767fc700 1 --2- 172.21.15.49:0/2009616086 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564966827f10 0x564966821990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:00:19.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.939+0000 7fcd777fe700 1 --2- 172.21.15.49:0/2009616086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564966821ed0 0x5649668222f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fcd7009af30 tx=0x7fcd7009ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84c89c970a4bafb server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:19.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.939+0000 7fcd5d7fa700 1 -- 172.21.15.49:0/2009616086 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7009b6a0 con 0x564966821ed0 2024-06-03T00:00:19.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.939+0000 7fcd5d7fa700 1 -- 172.21.15.49:0/2009616086 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd7009afa0 con 0x564966821ed0 2024-06-03T00:00:19.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.939+0000 7fcd5d7fa700 1 -- 172.21.15.49:0/2009616086 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7009b200 con 0x564966821ed0 2024-06-03T00:00:19.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.940+0000 7fcd87cb3b80 1 -- 172.21.15.49:0/2009616086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564966821ed0 msgr2=0x5649668222f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:19.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.940+0000 7fcd87cb3b80 1 --2- 172.21.15.49:0/2009616086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564966821ed0 0x5649668222f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fcd7009af30 tx=0x7fcd7009ab60 comp rx=0 tx=0).stop 2024-06-03T00:00:19.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.940+0000 7fcd87cb3b80 1 -- 172.21.15.49:0/2009616086 shutdown_connections 2024-06-03T00:00:19.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.940+0000 7fcd87cb3b80 1 --2- 172.21.15.49:0/2009616086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564966821ed0 0x5649668222f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.940+0000 7fcd87cb3b80 1 --2- 172.21.15.49:0/2009616086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649668275f0 0x5649668279d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.940+0000 7fcd87cb3b80 1 --2- 172.21.15.49:0/2009616086 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564966827f10 0x564966821990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.940+0000 7fcd87cb3b80 1 -- 172.21.15.49:0/2009616086 >> 172.21.15.49:0/2009616086 conn(0x56496674cc70 msgr2=0x56496681c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:19.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.940+0000 7fcd87cb3b80 1 -- 172.21.15.49:0/2009616086 shutdown_connections 2024-06-03T00:00:19.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.940+0000 7fcd87cb3b80 1 -- 172.21.15.49:0/2009616086 wait complete. 2024-06-03T00:00:19.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.940+0000 7fcd87cb3b80 1 -- start start 2024-06-03T00:00:19.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.941+0000 7fcd87cb3b80 1 Processor -- start 2024-06-03T00:00:19.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.941+0000 7fcd87cb3b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564966821ed0 0x56496682dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:19.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.941+0000 7fcd87cb3b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5649668275f0 0x56496682afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:19.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.941+0000 7fcd87cb3b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564966827f10 0x56496682b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:19.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.941+0000 7fcd87cb3b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56496682e920 con 0x5649668275f0 2024-06-03T00:00:19.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.941+0000 7fcd87cb3b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x564966713ba0 con 0x564966827f10 2024-06-03T00:00:19.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.941+0000 7fcd87cb3b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56496682eaa0 con 0x564966821ed0 2024-06-03T00:00:19.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.941+0000 7fcd767fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5649668275f0 0x56496682afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:19.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.941+0000 7fcd767fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5649668275f0 0x56496682afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35564/0 (socket says 172.21.15.49:35564) 2024-06-03T00:00:19.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.941+0000 7fcd87cb3b80 10 client.0 _ll_register_callbacks cb 0x56496670d8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:00:19.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.941+0000 7fcd767fc700 1 -- 172.21.15.49:0/1276246057 learned_addr learned my addr 172.21.15.49:0/1276246057 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:19.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.941+0000 7fcd76ffd700 1 --2- 172.21.15.49:0/1276246057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564966821ed0 0x56496682dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:19.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.941+0000 7fcd777fe700 1 --2- 172.21.15.49:0/1276246057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564966827f10 0x56496682b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:19.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.941+0000 7fcd767fc700 1 -- 172.21.15.49:0/1276246057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564966821ed0 msgr2=0x56496682dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:19.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.941+0000 7fcd767fc700 1 --2- 172.21.15.49:0/1276246057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564966821ed0 0x56496682dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.941+0000 7fcd767fc700 1 -- 172.21.15.49:0/1276246057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564966827f10 msgr2=0x56496682b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:19.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.941+0000 7fcd767fc700 1 --2- 172.21.15.49:0/1276246057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564966827f10 0x56496682b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.941+0000 7fcd767fc700 1 -- 172.21.15.49:0/1276246057 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649666c2880 con 0x5649668275f0 2024-06-03T00:00:19.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.941+0000 7fcd777fe700 1 --2- 172.21.15.49:0/1276246057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564966827f10 0x56496682b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:00:19.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.941+0000 7fcd767fc700 1 --2- 172.21.15.49:0/1276246057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5649668275f0 0x56496682afb0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c0117d0 tx=0x7fcd6c011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad89e1dab870d7db server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:19.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.941+0000 7fcd5aff5700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:00:19.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.942+0000 7fcd5aff5700 1 -- 172.21.15.49:0/1276246057 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c004220 con 0x5649668275f0 2024-06-03T00:00:19.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.942+0000 7fcd5aff5700 1 -- 172.21.15.49:0/1276246057 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fcd6c0043c0 con 0x5649668275f0 2024-06-03T00:00:19.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.942+0000 7fcd87cb3b80 1 -- 172.21.15.49:0/1276246057 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd7009afa0 con 0x5649668275f0 2024-06-03T00:00:19.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.942+0000 7fcd5aff5700 1 -- 172.21.15.49:0/1276246057 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fcd6c012720 con 0x5649668275f0 2024-06-03T00:00:19.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.942+0000 7fcd87cb3b80 10 client.15186 fetch_fsmap learned FSMap version 26 2024-06-03T00:00:19.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.942+0000 7fcd87cb3b80 1 -- 172.21.15.49:0/1276246057 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564966839280 con 0x5649668275f0 2024-06-03T00:00:19.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.942+0000 7fcd5aff5700 1 -- 172.21.15.49:0/1276246057 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd7009afa0 con 0x5649668275f0 2024-06-03T00:00:19.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.942+0000 7fcd5aff5700 1 -- 172.21.15.49:0/1276246057 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fcd6c003cd0 con 0x5649668275f0 2024-06-03T00:00:19.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.942+0000 7fcd87cb3b80 10 client.15186 fetch_fsmap finished waiting for FSMap version 26 2024-06-03T00:00:19.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.942+0000 7fcd87cb3b80 10 client.15186 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-03T00:00:19.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.942+0000 7fcd87cb3b80 20 client.15186 populate_metadata read hostname 'smithi049' 2024-06-03T00:00:19.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.942+0000 7fcd87cb3b80 1 --2- 172.21.15.49:0/1276246057 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x56496683b900 0x56496683cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:19.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.942+0000 7fcd87cb3b80 4 client.15186 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:00:19.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.942+0000 7fcd87cb3b80 1 -- 172.21.15.49:0/1276246057 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564966780cc0 con 0x56496683b900 2024-06-03T00:00:19.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.943+0000 7fcd76ffd700 1 --2- 172.21.15.49:0/1276246057 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x56496683b900 0x56496683cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:19.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.943+0000 7fcd76ffd700 1 --2- 172.21.15.49:0/1276246057 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x56496683b900 0x56496683cd70 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b1527a4e767a499 server_cookie=395b9491f1806656 in_seq=0 out_seq=0 2024-06-03T00:00:19.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.943+0000 7fcd5aff5700 10 client.15186 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:00:19.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.944+0000 7fcd5aff5700 1 -- 172.21.15.49:0/1276246057 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x564966780cc0 con 0x56496683b900 2024-06-03T00:00:19.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.944+0000 7fcd5aff5700 10 client.15186 handle_command_reply: tid=0 2024-06-03T00:00:19.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.944+0000 7fcd87cb3b80 1 client.15186 shutdown 2024-06-03T00:00:19.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.944+0000 7fcd87cb3b80 1 -- 172.21.15.49:0/1276246057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5649668275f0 msgr2=0x56496682afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:19.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.944+0000 7fcd87cb3b80 1 --2- 172.21.15.49:0/1276246057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5649668275f0 0x56496682afb0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c0117d0 tx=0x7fcd6c011ae0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.944+0000 7fcd87cb3b80 1 -- 172.21.15.49:0/1276246057 shutdown_connections 2024-06-03T00:00:19.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.944+0000 7fcd87cb3b80 1 --2- 172.21.15.49:0/1276246057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564966827f10 0x56496682b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.944+0000 7fcd87cb3b80 1 --2- 172.21.15.49:0/1276246057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564966821ed0 0x56496682dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.944+0000 7fcd87cb3b80 1 --2- 172.21.15.49:0/1276246057 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x56496683b900 0x56496683cd70 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.944+0000 7fcd87cb3b80 1 --2- 172.21.15.49:0/1276246057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5649668275f0 0x56496682afb0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.944+0000 7fcd87cb3b80 1 -- 172.21.15.49:0/1276246057 >> 172.21.15.49:0/1276246057 conn(0x56496674cc70 msgr2=0x564966820980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:19.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.944+0000 7fcd5aff5700 0 client.15186 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:00:19.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.944+0000 7fcd87cb3b80 1 -- 172.21.15.49:0/1276246057 shutdown_connections 2024-06-03T00:00:19.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.944+0000 7fcd87cb3b80 1 -- 172.21.15.49:0/1276246057 wait complete. 2024-06-03T00:00:19.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.944+0000 7fcd87cb3b80 20 client.15186 trim_cache size 0 max 16384 2024-06-03T00:00:19.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.971+0000 7fcd87cb3b80 1 Processor -- start 2024-06-03T00:00:19.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.971+0000 7fcd87cb3b80 1 -- start start 2024-06-03T00:00:19.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.971+0000 7fcd87cb3b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564966821ed0 0x564966821990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:19.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.971+0000 7fcd87cb3b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649668275f0 0x5649668298c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:19.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.971+0000 7fcd87cb3b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564966827f10 0x564966829e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:19.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.971+0000 7fcd87cb3b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56496683b0b0 con 0x564966821ed0 2024-06-03T00:00:19.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.971+0000 7fcd87cb3b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x56496683b780 con 0x564966827f10 2024-06-03T00:00:19.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.971+0000 7fcd87cb3b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56496683be50 con 0x5649668275f0 2024-06-03T00:00:19.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.971+0000 7fcd76ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564966821ed0 0x564966821990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:19.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.971+0000 7fcd76ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564966821ed0 0x564966821990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35578/0 (socket says 172.21.15.49:35578) 2024-06-03T00:00:19.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.971+0000 7fcd76ffd700 1 -- 172.21.15.49:0/3935929026 learned_addr learned my addr 172.21.15.49:0/3935929026 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:19.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.971+0000 7fcd767fc700 1 --2- 172.21.15.49:0/3935929026 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649668275f0 0x5649668298c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:19.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.972+0000 7fcd777fe700 1 --2- 172.21.15.49:0/3935929026 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564966827f10 0x564966829e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:19.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.972+0000 7fcd76ffd700 1 -- 172.21.15.49:0/3935929026 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649668275f0 msgr2=0x5649668298c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:19.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.972+0000 7fcd76ffd700 1 --2- 172.21.15.49:0/3935929026 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649668275f0 0x5649668298c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.972+0000 7fcd76ffd700 1 -- 172.21.15.49:0/3935929026 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564966827f10 msgr2=0x564966829e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:19.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.972+0000 7fcd76ffd700 1 --2- 172.21.15.49:0/3935929026 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564966827f10 0x564966829e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.972+0000 7fcd76ffd700 1 -- 172.21.15.49:0/3935929026 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56496683dcd0 con 0x564966821ed0 2024-06-03T00:00:19.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.972+0000 7fcd777fe700 1 --2- 172.21.15.49:0/3935929026 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564966827f10 0x564966829e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:00:19.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.972+0000 7fcd767fc700 1 --2- 172.21.15.49:0/3935929026 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649668275f0 0x5649668298c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:00:19.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.972+0000 7fcd76ffd700 1 --2- 172.21.15.49:0/3935929026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564966821ed0 0x564966821990 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcd68009750 tx=0x7fcd68023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc1bcd4b1a32eb server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:19.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.972+0000 7fcd5cff9700 1 -- 172.21.15.49:0/3935929026 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6800f9c0 con 0x564966821ed0 2024-06-03T00:00:19.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.972+0000 7fcd5cff9700 1 -- 172.21.15.49:0/3935929026 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd6800fb60 con 0x564966821ed0 2024-06-03T00:00:19.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.972+0000 7fcd5cff9700 1 -- 172.21.15.49:0/3935929026 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd68033430 con 0x564966821ed0 2024-06-03T00:00:19.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.973+0000 7fcd87cb3b80 1 -- 172.21.15.49:0/3935929026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564966821ed0 msgr2=0x564966821990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:19.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.973+0000 7fcd87cb3b80 1 --2- 172.21.15.49:0/3935929026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564966821ed0 0x564966821990 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcd68009750 tx=0x7fcd68023000 comp rx=0 tx=0).stop 2024-06-03T00:00:19.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.973+0000 7fcd87cb3b80 1 -- 172.21.15.49:0/3935929026 shutdown_connections 2024-06-03T00:00:19.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.973+0000 7fcd87cb3b80 1 --2- 172.21.15.49:0/3935929026 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564966827f10 0x564966829e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.973+0000 7fcd87cb3b80 1 --2- 172.21.15.49:0/3935929026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564966821ed0 0x564966821990 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.973+0000 7fcd87cb3b80 1 --2- 172.21.15.49:0/3935929026 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5649668275f0 0x5649668298c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.973+0000 7fcd87cb3b80 1 -- 172.21.15.49:0/3935929026 >> 172.21.15.49:0/3935929026 conn(0x56496674cc70 msgr2=0x56496681c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:19.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.973+0000 7fcd87cb3b80 1 -- 172.21.15.49:0/3935929026 shutdown_connections 2024-06-03T00:00:19.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.973+0000 7fcd87cb3b80 1 -- 172.21.15.49:0/3935929026 wait complete. 2024-06-03T00:00:19.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.974+0000 7fcd87cb3b80 1 -- start start 2024-06-03T00:00:19.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.974+0000 7fcd87cb3b80 1 Processor -- start 2024-06-03T00:00:19.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.974+0000 7fcd87cb3b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564966821ed0 0x5649668469d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:19.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.974+0000 7fcd87cb3b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5649668275f0 0x564966820a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:19.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.974+0000 7fcd87cb3b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564966827f10 0x564966821020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:19.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.974+0000 7fcd87cb3b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56496683cbf0 con 0x5649668275f0 2024-06-03T00:00:19.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.974+0000 7fcd87cb3b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x56496683c520 con 0x564966821ed0 2024-06-03T00:00:19.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.974+0000 7fcd87cb3b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56496683d2c0 con 0x564966827f10 2024-06-03T00:00:19.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.974+0000 7fcd87cb3b80 10 client.0 _ll_register_callbacks cb 0x56496670d8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:00:19.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.974+0000 7fcd767fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5649668275f0 0x564966820a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:19.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.974+0000 7fcd767fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5649668275f0 0x564966820a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35584/0 (socket says 172.21.15.49:35584) 2024-06-03T00:00:19.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.974+0000 7fcd767fc700 1 -- 172.21.15.49:0/221232273 learned_addr learned my addr 172.21.15.49:0/221232273 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:19.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.974+0000 7fcd777fe700 1 --2- 172.21.15.49:0/221232273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564966827f10 0x564966821020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:19.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.974+0000 7fcd76ffd700 1 --2- 172.21.15.49:0/221232273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564966821ed0 0x5649668469d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:19.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.975+0000 7fcd767fc700 1 -- 172.21.15.49:0/221232273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564966827f10 msgr2=0x564966821020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:19.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.975+0000 7fcd767fc700 1 --2- 172.21.15.49:0/221232273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564966827f10 0x564966821020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.975+0000 7fcd767fc700 1 -- 172.21.15.49:0/221232273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564966821ed0 msgr2=0x5649668469d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:19.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.975+0000 7fcd767fc700 1 --2- 172.21.15.49:0/221232273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564966821ed0 0x5649668469d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.975+0000 7fcd767fc700 1 -- 172.21.15.49:0/221232273 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564966821860 con 0x5649668275f0 2024-06-03T00:00:19.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.975+0000 7fcd767fc700 1 --2- 172.21.15.49:0/221232273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5649668275f0 0x564966820a60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c015020 tx=0x7fcd6c01bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8546634d0b2b6f82 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:19.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.975+0000 7fcd5aff5700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:00:19.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.975+0000 7fcd5aff5700 1 -- 172.21.15.49:0/221232273 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c032020 con 0x5649668275f0 2024-06-03T00:00:19.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.975+0000 7fcd5aff5700 1 -- 172.21.15.49:0/221232273 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fcd6c005040 con 0x5649668275f0 2024-06-03T00:00:19.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.975+0000 7fcd87cb3b80 1 -- 172.21.15.49:0/221232273 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd6800fb60 con 0x5649668275f0 2024-06-03T00:00:19.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.975+0000 7fcd5aff5700 1 -- 172.21.15.49:0/221232273 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fcd6c029040 con 0x5649668275f0 2024-06-03T00:00:19.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.975+0000 7fcd87cb3b80 10 client.15192 fetch_fsmap learned FSMap version 26 2024-06-03T00:00:19.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.975+0000 7fcd87cb3b80 1 -- 172.21.15.49:0/221232273 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5649668a71f0 con 0x5649668275f0 2024-06-03T00:00:19.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.975+0000 7fcd5aff5700 1 -- 172.21.15.49:0/221232273 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd6800fb60 con 0x5649668275f0 2024-06-03T00:00:19.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.976+0000 7fcd5aff5700 1 -- 172.21.15.49:0/221232273 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fcd6c004c20 con 0x5649668275f0 2024-06-03T00:00:19.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.976+0000 7fcd87cb3b80 10 client.15192 fetch_fsmap finished waiting for FSMap version 26 2024-06-03T00:00:19.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.976+0000 7fcd87cb3b80 10 client.15192 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-03T00:00:19.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.976+0000 7fcd87cb3b80 20 client.15192 populate_metadata read hostname 'smithi049' 2024-06-03T00:00:19.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.976+0000 7fcd87cb3b80 1 --2- 172.21.15.49:0/221232273 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5649668abe20 0x5649668aaf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:19.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.976+0000 7fcd87cb3b80 4 client.15192 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-03T00:00:19.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.976+0000 7fcd87cb3b80 1 -- 172.21.15.49:0/221232273 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "status"}) -- 0x56496677b240 con 0x5649668abe20 2024-06-03T00:00:19.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.976+0000 7fcd76ffd700 1 --2- 172.21.15.49:0/221232273 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5649668abe20 0x5649668aaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:19.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.976+0000 7fcd76ffd700 1 --2- 172.21.15.49:0/221232273 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5649668abe20 0x5649668aaf90 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a906a1cac0b81e9a server_cookie=e6dfb26534f6ff26 in_seq=0 out_seq=0 2024-06-03T00:00:19.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.976+0000 7fcd5aff5700 10 client.15192 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:00:19.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.977+0000 7fcd5aff5700 1 -- 172.21.15.49:0/221232273 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56496677b240 con 0x5649668abe20 2024-06-03T00:00:19.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.977+0000 7fcd5aff5700 10 client.15192 handle_command_reply: tid=0 2024-06-03T00:00:19.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.977+0000 7fcd87cb3b80 1 client.15192 shutdown 2024-06-03T00:00:19.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.977+0000 7fcd87cb3b80 1 -- 172.21.15.49:0/221232273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5649668275f0 msgr2=0x564966820a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:19.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.977+0000 7fcd87cb3b80 1 --2- 172.21.15.49:0/221232273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5649668275f0 0x564966820a60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c015020 tx=0x7fcd6c01bbe0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.977+0000 7fcd87cb3b80 1 -- 172.21.15.49:0/221232273 shutdown_connections 2024-06-03T00:00:19.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.977+0000 7fcd87cb3b80 1 --2- 172.21.15.49:0/221232273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564966827f10 0x564966821020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.977+0000 7fcd87cb3b80 1 --2- 172.21.15.49:0/221232273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564966821ed0 0x5649668469d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.977+0000 7fcd87cb3b80 1 --2- 172.21.15.49:0/221232273 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5649668abe20 0x5649668aaf90 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.977+0000 7fcd87cb3b80 1 --2- 172.21.15.49:0/221232273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5649668275f0 0x564966820a60 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.977+0000 7fcd87cb3b80 1 -- 172.21.15.49:0/221232273 >> 172.21.15.49:0/221232273 conn(0x56496674cc70 msgr2=0x564966815db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:19.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.977+0000 7fcd5aff5700 0 client.15192 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:00:19.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.977+0000 7fcd87cb3b80 1 -- 172.21.15.49:0/221232273 shutdown_connections 2024-06-03T00:00:19.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.977+0000 7fcd87cb3b80 1 -- 172.21.15.49:0/221232273 wait complete. 2024-06-03T00:00:19.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.977+0000 7fcd87cb3b80 20 client.15192 trim_cache size 0 max 16384 2024-06-03T00:00:19.982 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:00:19.982 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "890dd222-213a-11ef-bc9b-c7b262605968", 2024-06-03T00:00:19.982 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-06-03T00:00:19.982 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 24487, 2024-06-03T00:00:19.982 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-06-03T00:00:19.982 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-06-03T00:00:19.982 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-06-03T00:00:19.982 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 182.653185839, 2024-06-03T00:00:19.982 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 26, 2024-06-03T00:00:19.982 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 90, 2024-06-03T00:00:19.982 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 88, 2024-06-03T00:00:19.982 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 207.05955040399999 2024-06-03T00:00:19.983 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:00:19.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.978+0000 7fcd7d430700 1 -- 172.21.15.49:0/3238371966 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fcd600a2c20 msgr2=0x7fcd600a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:19.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.978+0000 7fcd7d430700 1 --2- 172.21.15.49:0/3238371966 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fcd600a2c20 0x7fcd600a50e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcd68000c00 tx=0x7fcd68005fb0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.978+0000 7fcd7d430700 1 -- 172.21.15.49:0/3238371966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd78107840 msgr2=0x7fcd78075210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:19.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.978+0000 7fcd7d430700 1 --2- 172.21.15.49:0/3238371966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd78107840 0x7fcd78075210 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcd7000ada0 tx=0x7fcd7000c330 comp rx=0 tx=0).stop 2024-06-03T00:00:19.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.978+0000 7fcd7d430700 1 -- 172.21.15.49:0/3238371966 shutdown_connections 2024-06-03T00:00:19.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.978+0000 7fcd7d430700 1 --2- 172.21.15.49:0/3238371966 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fcd600a2c20 0x7fcd600a50e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.978+0000 7fcd7d430700 1 --2- 172.21.15.49:0/3238371966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd78107840 0x7fcd78075210 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.978+0000 7fcd7d430700 1 --2- 172.21.15.49:0/3238371966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd78102740 0x7fcd78074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.978+0000 7fcd7d430700 1 --2- 172.21.15.49:0/3238371966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcd781030f0 0x7fcd78074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:19.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.978+0000 7fcd7d430700 1 -- 172.21.15.49:0/3238371966 >> 172.21.15.49:0/3238371966 conn(0x7fcd780795f0 msgr2=0x7fcd78100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:19.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.978+0000 7fcd7d430700 1 -- 172.21.15.49:0/3238371966 shutdown_connections 2024-06-03T00:00:19.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:19.978+0000 7fcd7d430700 1 -- 172.21.15.49:0/3238371966 wait complete. 2024-06-03T00:00:20.667 INFO:teuthology.run_tasks:Running task sequential... 2024-06-03T00:00:20.692 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-06-03T00:00:20.692 INFO:teuthology.task.sequential:In sequential, running task print... 2024-06-03T00:00:20.692 INFO:teuthology.task.print:Enabling mgr modules 2024-06-03T00:00:20.692 INFO:teuthology.run_tasks:Running task kclient... 2024-06-03T00:00:21.298 INFO:tasks.kclient:Mounting kernel clients... 2024-06-03T00:00:21.298 INFO:tasks.kclient:config is {'client.0': {}} 2024-06-03T00:00:21.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-03T00:00:21.298 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-06-03T00:00:21.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-03T00:00:21.320 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2024-06-03T00:00:21.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:21 smithi107 ceph-mon[37048]: pgmap v392: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-03T00:00:21.386 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:21 smithi049 ceph-mon[32302]: pgmap v392: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-03T00:00:21.395 INFO:teuthology.orchestra.run.smithi049.stderr:Cannot find device "ceph-brx" 2024-06-03T00:00:21.396 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-03T00:00:21.397 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-06-03T00:00:21.397 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-03T00:00:21.397 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-03T00:00:21.397 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs ls 2024-06-03T00:00:21.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:21 smithi057 ceph-mon[36457]: pgmap v392: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-03T00:00:21.697 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:00:23.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.270+0000 7efcb93cd700 1 -- 172.21.15.49:0/503846309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcb41084f0 msgr2=0x7efcb41088d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:23.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.270+0000 7efcb93cd700 1 --2- 172.21.15.49:0/503846309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcb41084f0 0x7efcb41088d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7efca4009990 tx=0x7efca4009ca0 comp rx=0 tx=0).stop 2024-06-03T00:00:23.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.270+0000 7efcb93cd700 1 -- 172.21.15.49:0/503846309 shutdown_connections 2024-06-03T00:00:23.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.270+0000 7efcb93cd700 1 --2- 172.21.15.49:0/503846309 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcb4102e80 0x7efcb410f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:23.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.270+0000 7efcb93cd700 1 --2- 172.21.15.49:0/503846309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcb41084f0 0x7efcb41088d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:23.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.270+0000 7efcb93cd700 1 --2- 172.21.15.49:0/503846309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcb41024e0 0x7efcb4102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:23.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.270+0000 7efcb93cd700 1 -- 172.21.15.49:0/503846309 >> 172.21.15.49:0/503846309 conn(0x7efcb4079530 msgr2=0x7efcb4079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:23.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.270+0000 7efcb93cd700 1 -- 172.21.15.49:0/503846309 shutdown_connections 2024-06-03T00:00:23.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.270+0000 7efcb93cd700 1 -- 172.21.15.49:0/503846309 wait complete. 2024-06-03T00:00:23.272 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:23 smithi049 ceph-mon[32302]: pgmap v393: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-03T00:00:23.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.271+0000 7efcb93cd700 1 Processor -- start 2024-06-03T00:00:23.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.271+0000 7efcb93cd700 1 -- start start 2024-06-03T00:00:23.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.271+0000 7efcb93cd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcb41024e0 0x7efcb410e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:23.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.271+0000 7efcb93cd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcb4102e80 0x7efcb410eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:23.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.271+0000 7efcb93cd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcb41084f0 0x7efcb41a3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:23.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.271+0000 7efcb93cd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7efcb41127d0 con 0x7efcb41084f0 2024-06-03T00:00:23.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.271+0000 7efcb93cd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7efcb4112650 con 0x7efcb4102e80 2024-06-03T00:00:23.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.271+0000 7efcb93cd700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7efcb4112950 con 0x7efcb41024e0 2024-06-03T00:00:23.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.272+0000 7efcb37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcb41084f0 0x7efcb41a3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:23.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.272+0000 7efcb37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcb41084f0 0x7efcb41a3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55236/0 (socket says 172.21.15.49:55236) 2024-06-03T00:00:23.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.272+0000 7efcb37fe700 1 -- 172.21.15.49:0/2346491070 learned_addr learned my addr 172.21.15.49:0/2346491070 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:23.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.272+0000 7efcb27fc700 1 --2- 172.21.15.49:0/2346491070 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcb4102e80 0x7efcb410eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:23.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.272+0000 7efcb2ffd700 1 --2- 172.21.15.49:0/2346491070 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcb41024e0 0x7efcb410e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:23.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.272+0000 7efcb37fe700 1 -- 172.21.15.49:0/2346491070 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcb41024e0 msgr2=0x7efcb410e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:23.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.272+0000 7efcb37fe700 1 --2- 172.21.15.49:0/2346491070 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcb41024e0 0x7efcb410e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:23.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.272+0000 7efcb37fe700 1 -- 172.21.15.49:0/2346491070 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcb4102e80 msgr2=0x7efcb410eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:23.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.272+0000 7efcb37fe700 1 --2- 172.21.15.49:0/2346491070 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcb4102e80 0x7efcb410eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:23.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.272+0000 7efcb37fe700 1 -- 172.21.15.49:0/2346491070 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb41a4240 con 0x7efcb41084f0 2024-06-03T00:00:23.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.272+0000 7efcb27fc700 1 --2- 172.21.15.49:0/2346491070 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcb4102e80 0x7efcb410eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:00:23.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.272+0000 7efcb37fe700 1 --2- 172.21.15.49:0/2346491070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcb41084f0 0x7efcb41a3b00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efcac007ee0 tx=0x7efcac00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:23.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.273+0000 7efc9bfff700 1 -- 172.21.15.49:0/2346491070 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcac004bb0 con 0x7efcb41084f0 2024-06-03T00:00:23.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.273+0000 7efc9bfff700 1 -- 172.21.15.49:0/2346491070 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcac004d50 con 0x7efcb41084f0 2024-06-03T00:00:23.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.273+0000 7efcb93cd700 1 -- 172.21.15.49:0/2346491070 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcb41a4530 con 0x7efcb41084f0 2024-06-03T00:00:23.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.273+0000 7efc9bfff700 1 -- 172.21.15.49:0/2346491070 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcac005960 con 0x7efcb41084f0 2024-06-03T00:00:23.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.273+0000 7efcb93cd700 1 -- 172.21.15.49:0/2346491070 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcb41abdb0 con 0x7efcb41084f0 2024-06-03T00:00:23.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.274+0000 7efcb93cd700 1 -- 172.21.15.49:0/2346491070 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcb4069180 con 0x7efcb41084f0 2024-06-03T00:00:23.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.275+0000 7efc9bfff700 1 -- 172.21.15.49:0/2346491070 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7efcac01a020 con 0x7efcb41084f0 2024-06-03T00:00:23.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.276+0000 7efc9bfff700 1 --2- 172.21.15.49:0/2346491070 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7efc9c0a2ca0 0x7efc9c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:23.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.276+0000 7efcb2ffd700 1 --2- 172.21.15.49:0/2346491070 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7efc9c0a2ca0 0x7efc9c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:23.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.276+0000 7efc9bfff700 1 -- 172.21.15.49:0/2346491070 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7efcac0ce6c0 con 0x7efcb41084f0 2024-06-03T00:00:23.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.276+0000 7efcb2ffd700 1 --2- 172.21.15.49:0/2346491070 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7efc9c0a2ca0 0x7efc9c0a5160 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efca400b5c0 tx=0x7efca4005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:23.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.281+0000 7efc9bfff700 1 -- 172.21.15.49:0/2346491070 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7efcac010070 con 0x7efcb41084f0 2024-06-03T00:00:23.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:23 smithi107 ceph-mon[37048]: pgmap v393: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-03T00:00:23.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:23 smithi057 ceph-mon[36457]: pgmap v393: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-03T00:00:23.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.533+0000 7efcb93cd700 1 -- 172.21.15.49:0/2346491070 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efcb41abf80 con 0x7efcb41084f0 2024-06-03T00:00:23.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.533+0000 7efc9bfff700 1 -- 172.21.15.49:0/2346491070 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) ==== 53+0+73 (secure 0 0 0) 0x7efcac09b620 con 0x7efcb41084f0 2024-06-03T00:00:23.533 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-03T00:00:23.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.535+0000 7efcb93cd700 1 -- 172.21.15.49:0/2346491070 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7efc9c0a2ca0 msgr2=0x7efc9c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:23.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.535+0000 7efcb93cd700 1 --2- 172.21.15.49:0/2346491070 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7efc9c0a2ca0 0x7efc9c0a5160 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efca400b5c0 tx=0x7efca4005960 comp rx=0 tx=0).stop 2024-06-03T00:00:23.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.535+0000 7efcb93cd700 1 -- 172.21.15.49:0/2346491070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcb41084f0 msgr2=0x7efcb41a3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:23.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.535+0000 7efcb93cd700 1 --2- 172.21.15.49:0/2346491070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcb41084f0 0x7efcb41a3b00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efcac007ee0 tx=0x7efcac00d3b0 comp rx=0 tx=0).stop 2024-06-03T00:00:23.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.535+0000 7efcb93cd700 1 -- 172.21.15.49:0/2346491070 shutdown_connections 2024-06-03T00:00:23.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.535+0000 7efcb93cd700 1 --2- 172.21.15.49:0/2346491070 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7efc9c0a2ca0 0x7efc9c0a5160 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:23.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.535+0000 7efcb93cd700 1 --2- 172.21.15.49:0/2346491070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcb41084f0 0x7efcb41a3b00 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:23.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.535+0000 7efcb93cd700 1 --2- 172.21.15.49:0/2346491070 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcb41024e0 0x7efcb410e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:23.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.535+0000 7efcb93cd700 1 --2- 172.21.15.49:0/2346491070 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcb4102e80 0x7efcb410eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:23.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.535+0000 7efcb93cd700 1 -- 172.21.15.49:0/2346491070 >> 172.21.15.49:0/2346491070 conn(0x7efcb4079530 msgr2=0x7efcb4100350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:23.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.536+0000 7efcb93cd700 1 -- 172.21.15.49:0/2346491070 shutdown_connections 2024-06-03T00:00:23.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:23.536+0000 7efcb93cd700 1 -- 172.21.15.49:0/2346491070 wait complete. 2024-06-03T00:00:24.180 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:24 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/2346491070' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-03T00:00:24.181 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-03T00:00:24.181 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-03T00:00:24.181 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-06-03T00:00:24.181 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-03T00:00:24.181 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-03T00:00:24.181 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-03T00:00:24.182 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-03T00:00:24.182 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-03T00:00:24.182 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-03T00:00:24.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-03T00:00:24.182 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-06-03T00:00:24.201 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-03T00:00:24.201 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-03T00:00:24.201 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-06-03T00:00:24.201 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-06-03T00:00:24.201 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-06-03T00:00:24.201 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-06-03T00:00:24.201 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-03T00:00:24.202 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-06-03T00:00:24.202 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-06-03T00:00:24.202 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-03T00:00:24.202 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-06-03T00:00:24.202 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-06-03T00:00:24.202 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-03T00:00:24.202 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-06-03T00:00:24.202 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-06-03T00:00:24.203 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-06-03T00:00:24.203 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42014sec preferred_lft 42014sec 2024-06-03T00:00:24.203 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link noprefixroute 2024-06-03T00:00:24.203 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-06-03T00:00:24.203 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-03T00:00:24.204 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-06-03T00:00:24.204 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-06-03T00:00:24.204 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-06-03T00:00:24.204 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-03T00:00:24.205 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-06-03T00:00:24.205 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add name ceph-brx type bridge 2024-06-03T00:00:24.205 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr flush dev ceph-brx 2024-06-03T00:00:24.205 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set ceph-brx up 2024-06-03T00:00:24.205 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-06-03T00:00:24.205 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-06-03T00:00:24.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-03T00:00:24.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:24 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/2346491070' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-03T00:00:24.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-03T00:00:24.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-03T00:00:24.401 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-03T00:00:24.428 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-06-03T00:00:24.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-03T00:00:24.430 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-06-03T00:00:24.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:24 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/2346491070' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-03T00:00:24.502 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-06-03T00:00:24.502 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-03T00:00:24.502 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-06-03T00:00:24.502 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-06-03T00:00:24.502 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-03T00:00:24.503 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-03T00:00:24.503 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-06-03T00:00:24.503 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-06-03T00:00:24.503 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-06-03T00:00:24.503 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-06-03T00:00:24.503 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-06-03T00:00:24.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-03T00:00:24.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-03T00:00:24.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-03T00:00:24.800 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-06-03T00:00:24.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-03T00:00:24.817 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list-id 2024-06-03T00:00:24.875 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-03T00:00:24.875 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-06-03T00:00:24.875 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-03T00:00:24.875 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-06-03T00:00:24.875 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-06-03T00:00:24.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-03T00:00:24.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-03T00:00:24.996 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-06-03T00:00:24.997 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-03T00:00:24.997 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-06-03T00:00:24.997 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-06-03T00:00:24.997 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-06-03T00:00:24.997 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-06-03T00:00:24.997 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-06-03T00:00:24.997 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-06-03T00:00:24.997 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-06-03T00:00:25.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-03T00:00:25.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-03T00:00:25.135 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-03T00:00:25.135 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-06-03T00:00:25.135 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-06-03T00:00:25.135 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set dev brx.0 master ceph-brx 2024-06-03T00:00:25.136 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-06-03T00:00:25.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-03T00:00:25.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-03T00:00:25.218 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-03T00:00:25.218 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-03T00:00:25.234 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-03T00:00:25.234 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-03T00:00:25.235 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-03T00:00:25.290 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-06-03T00:00:25.290 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-06-03T00:00:25.290 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8 2024-06-03T00:00:25.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-03T00:00:25.291 DEBUG:teuthology.orchestra.run.smithi049:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,nofallback 2024-06-03T00:00:25.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:25 smithi107 ceph-mon[37048]: pgmap v394: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-03T00:00:25.353 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:25 smithi049 ceph-mon[32302]: pgmap v394: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-03T00:00:25.391 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,nofallback 2024-06-03T00:00:25.391 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync". 2024-06-03T00:00:25.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:25 smithi057 ceph-mon[36457]: pgmap v394: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-03T00:00:25.524 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,nofallback 2024-06-03T00:00:25.525 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync". 2024-06-03T00:00:25.525 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: resolved to: "172.21.15.49:6789,172.21.15.57:6789,172.21.15.107:6789" 2024-06-03T00:00:25.525 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: trying mount with new device syntax: 0@890dd222-213a-11ef-bc9b-c7b262605968.cephfs=/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8 2024-06-03T00:00:25.525 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync,name=0,key=0,mon_addr=172.21.15.49:6789/172.21.15.57:6789/172.21.15.107:6789" will pass to kernel 2024-06-03T00:00:25.526 INFO:teuthology.orchestra.run.smithi049.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-06-03T00:00:25.526 INFO:teuthology.orchestra.run.smithi049.stdout: You just mounted a file system that supports labels which does not 2024-06-03T00:00:25.526 INFO:teuthology.orchestra.run.smithi049.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-06-03T00:00:25.526 INFO:teuthology.orchestra.run.smithi049.stdout: applications will generate AVC messages and not be allowed access to 2024-06-03T00:00:25.526 INFO:teuthology.orchestra.run.smithi049.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-06-03T00:00:25.527 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-06-03T00:00:25.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-03T00:00:25.528 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-03T00:00:25.599 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-03T00:00:25.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-03T00:00:25.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-03T00:00:25.699 INFO:teuthology.orchestra.run.smithi049.stdout:client24895 2024-06-03T00:00:25.699 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-06-03T00:00:25.699 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-03T00:00:25.717 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-03T00:00:25.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-03T00:00:25.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-03T00:00:25.817 INFO:teuthology.orchestra.run.smithi049.stdout:client24895 2024-06-03T00:00:25.818 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-03T00:00:25.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-03T00:00:25.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-03T00:00:25.876 INFO:teuthology.orchestra.run.smithi049.stdout:client24895 2024-06-03T00:00:25.876 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/890dd222-213a-11ef-bc9b-c7b262605968.client24895/status') 2024-06-03T00:00:25.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-03T00:00:25.937 INFO:teuthology.orchestra.run.smithi049.stdout:instance: client.24895 (3)172.21.15.49:0/265482336 2024-06-03T00:00:25.937 INFO:teuthology.orchestra.run.smithi049.stdout:blocklisted: false 2024-06-03T00:00:25.937 INFO:teuthology.orchestra.run.smithi049.stderr:0+1 records in 2024-06-03T00:00:25.937 INFO:teuthology.orchestra.run.smithi049.stderr:0+1 records out 2024-06-03T00:00:25.938 INFO:teuthology.orchestra.run.smithi049.stderr:70 bytes copied, 2.9695e-05 s, 2.4 MB/s 2024-06-03T00:00:25.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-03T00:00:25.945 INFO:teuthology.run_tasks:Running task exec... 2024-06-03T00:00:25.962 INFO:teuthology.task.exec:Executing custom commands... 2024-06-03T00:00:25.962 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi049.front.sepia.ceph.com 2024-06-03T00:00:25.962 DEBUG:teuthology.orchestra.run.smithi049:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-06-03T00:00:26.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.069+0000 7f818da53640 1 -- 172.21.15.49:0/228108186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8188104ec0 msgr2=0x7f81881072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:26.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.069+0000 7f818da53640 1 --2- 172.21.15.49:0/228108186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8188104ec0 0x7f81881072b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f817c009900 tx=0x7f817c02a410 comp rx=0 tx=0).stop 2024-06-03T00:00:26.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.069+0000 7f818da53640 1 -- 172.21.15.49:0/228108186 shutdown_connections 2024-06-03T00:00:26.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.069+0000 7f818da53640 1 --2- 172.21.15.49:0/228108186 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81881077f0 0x7f8188109be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:26.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.069+0000 7f818da53640 1 --2- 172.21.15.49:0/228108186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8188104ec0 0x7f81881072b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:26.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.069+0000 7f818da53640 1 --2- 172.21.15.49:0/228108186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8188102590 0x7f8188104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:26.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.069+0000 7f818da53640 1 -- 172.21.15.49:0/228108186 >> 172.21.15.49:0/228108186 conn(0x7f81880fbf20 msgr2=0x7f81880fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:26.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.069+0000 7f818da53640 1 -- 172.21.15.49:0/228108186 shutdown_connections 2024-06-03T00:00:26.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.069+0000 7f818da53640 1 -- 172.21.15.49:0/228108186 wait complete. 2024-06-03T00:00:26.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.070+0000 7f818da53640 1 Processor -- start 2024-06-03T00:00:26.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.070+0000 7f818da53640 1 -- start start 2024-06-03T00:00:26.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.070+0000 7f818da53640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8188102590 0x7f8188197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:26.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.070+0000 7f818da53640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8188104ec0 0x7f81881981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:26.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.070+0000 7f818da53640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81881077f0 0x7f818819f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:26.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.070+0000 7f818da53640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f818810d690 con 0x7f8188102590 2024-06-03T00:00:26.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.070+0000 7f818da53640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f818810d510 con 0x7f81881077f0 2024-06-03T00:00:26.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.070+0000 7f818da53640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f818810d810 con 0x7f8188104ec0 2024-06-03T00:00:26.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.070+0000 7f8186ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8188102590 0x7f8188197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:26.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.070+0000 7f8186ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8188102590 0x7f8188197c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55246/0 (socket says 172.21.15.49:55246) 2024-06-03T00:00:26.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.070+0000 7f8186ffd640 1 -- 172.21.15.49:0/3960437965 learned_addr learned my addr 172.21.15.49:0/3960437965 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:26.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.070+0000 7f81867fc640 1 --2- 172.21.15.49:0/3960437965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8188104ec0 0x7f81881981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:26.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.071+0000 7f81877fe640 1 --2- 172.21.15.49:0/3960437965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81881077f0 0x7f818819f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:26.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.071+0000 7f8186ffd640 1 -- 172.21.15.49:0/3960437965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8188104ec0 msgr2=0x7f81881981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:26.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.071+0000 7f8186ffd640 1 --2- 172.21.15.49:0/3960437965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8188104ec0 0x7f81881981b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:26.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.071+0000 7f8186ffd640 1 -- 172.21.15.49:0/3960437965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81881077f0 msgr2=0x7f818819f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:26.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.071+0000 7f8186ffd640 1 --2- 172.21.15.49:0/3960437965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81881077f0 0x7f818819f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:26.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.071+0000 7f8186ffd640 1 -- 172.21.15.49:0/3960437965 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f818819f880 con 0x7f8188102590 2024-06-03T00:00:26.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.071+0000 7f8186ffd640 1 --2- 172.21.15.49:0/3960437965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8188102590 0x7f8188197c70 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f817800d950 tx=0x7f817800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:26.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.071+0000 7f818ca51640 1 -- 172.21.15.49:0/3960437965 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8178017070 con 0x7f8188102590 2024-06-03T00:00:26.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.071+0000 7f818ca51640 1 -- 172.21.15.49:0/3960437965 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8178009c30 con 0x7f8188102590 2024-06-03T00:00:26.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.071+0000 7f818da53640 1 -- 172.21.15.49:0/3960437965 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f818819fb70 con 0x7f8188102590 2024-06-03T00:00:26.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.071+0000 7f818ca51640 1 -- 172.21.15.49:0/3960437965 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817800f6b0 con 0x7f8188102590 2024-06-03T00:00:26.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.071+0000 7f818da53640 1 -- 172.21.15.49:0/3960437965 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81881a00c0 con 0x7f8188102590 2024-06-03T00:00:26.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.072+0000 7f818da53640 1 -- 172.21.15.49:0/3960437965 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81880fda10 con 0x7f8188102590 2024-06-03T00:00:26.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.073+0000 7f818ca51640 1 -- 172.21.15.49:0/3960437965 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f81780109d0 con 0x7f8188102590 2024-06-03T00:00:26.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.074+0000 7f818ca51640 1 --2- 172.21.15.49:0/3960437965 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f81700a2c30 0x7f81700a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:26.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.074+0000 7f81867fc640 1 --2- 172.21.15.49:0/3960437965 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f81700a2c30 0x7f81700a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:26.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.074+0000 7f818ca51640 1 -- 172.21.15.49:0/3960437965 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f81780ced20 con 0x7f8188102590 2024-06-03T00:00:26.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.075+0000 7f81867fc640 1 --2- 172.21.15.49:0/3960437965 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f81700a2c30 0x7f81700a50f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f817c005ab0 tx=0x7f817c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:26.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.079+0000 7f818ca51640 1 -- 172.21.15.49:0/3960437965 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8178009de0 con 0x7f8188102590 2024-06-03T00:00:26.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:26.304+0000 7f818da53640 1 -- 172.21.15.49:0/3960437965 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f81880625d0 con 0x7f8188102590 2024-06-03T00:00:27.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.029+0000 7f818ca51640 1 -- 172.21.15.49:0/3960437965 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v27) ==== 117+0+0 (secure 0 0 0) 0x7f817809bc80 con 0x7f8188102590 2024-06-03T00:00:27.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.032+0000 7f818da53640 1 -- 172.21.15.49:0/3960437965 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f81700a2c30 msgr2=0x7f81700a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:27.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.032+0000 7f818da53640 1 --2- 172.21.15.49:0/3960437965 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f81700a2c30 0x7f81700a50f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f817c005ab0 tx=0x7f817c000bc0 comp rx=0 tx=0).stop 2024-06-03T00:00:27.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.032+0000 7f818da53640 1 -- 172.21.15.49:0/3960437965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8188102590 msgr2=0x7f8188197c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:27.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.032+0000 7f818da53640 1 --2- 172.21.15.49:0/3960437965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8188102590 0x7f8188197c70 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f817800d950 tx=0x7f817800de10 comp rx=0 tx=0).stop 2024-06-03T00:00:27.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.033+0000 7f818da53640 1 -- 172.21.15.49:0/3960437965 shutdown_connections 2024-06-03T00:00:27.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.033+0000 7f818da53640 1 --2- 172.21.15.49:0/3960437965 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f81700a2c30 0x7f81700a50f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:27.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.033+0000 7f818da53640 1 --2- 172.21.15.49:0/3960437965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81881077f0 0x7f818819f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:27.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.033+0000 7f818da53640 1 --2- 172.21.15.49:0/3960437965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8188104ec0 0x7f81881981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:27.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.033+0000 7f818da53640 1 --2- 172.21.15.49:0/3960437965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8188102590 0x7f8188197c70 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:27.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.033+0000 7f818da53640 1 -- 172.21.15.49:0/3960437965 >> 172.21.15.49:0/3960437965 conn(0x7f81880fbf20 msgr2=0x7f8188102ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:27.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.033+0000 7f818da53640 1 -- 172.21.15.49:0/3960437965 shutdown_connections 2024-06-03T00:00:27.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.033+0000 7f818da53640 1 -- 172.21.15.49:0/3960437965 wait complete. 2024-06-03T00:00:27.047 INFO:teuthology.run_tasks:Running task check-counter... 2024-06-03T00:00:27.059 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-06-03T00:00:27.112 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-03T00:00:27.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.225+0000 7f1719645640 1 -- 172.21.15.49:0/2349362588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17141024a0 msgr2=0x7f1714108d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:27.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.225+0000 7f1719645640 1 --2- 172.21.15.49:0/2349362588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17141024a0 0x7f1714108d30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f170c009ca0 tx=0x7f170c02a8c0 comp rx=0 tx=0).stop 2024-06-03T00:00:27.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.225+0000 7f1719645640 1 -- 172.21.15.49:0/2349362588 shutdown_connections 2024-06-03T00:00:27.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.225+0000 7f1719645640 1 --2- 172.21.15.49:0/2349362588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17141024a0 0x7f1714108d30 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:27.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.225+0000 7f1719645640 1 --2- 172.21.15.49:0/2349362588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1714101ae0 0x7f1714101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:27.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.225+0000 7f1719645640 1 --2- 172.21.15.49:0/2349362588 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17141008f0 0x7f1714100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:27.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.225+0000 7f1719645640 1 -- 172.21.15.49:0/2349362588 >> 172.21.15.49:0/2349362588 conn(0x7f17140fbea0 msgr2=0x7f17140fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:27.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.226+0000 7f1719645640 1 -- 172.21.15.49:0/2349362588 shutdown_connections 2024-06-03T00:00:27.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.226+0000 7f1719645640 1 -- 172.21.15.49:0/2349362588 wait complete. 2024-06-03T00:00:27.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.226+0000 7f1719645640 1 Processor -- start 2024-06-03T00:00:27.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.226+0000 7f1719645640 1 -- start start 2024-06-03T00:00:27.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.226+0000 7f1719645640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17141008f0 0x7f1714197c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:27.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.226+0000 7f1719645640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1714101ae0 0x7f1714198180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:27.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.226+0000 7f1719645640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17141024a0 0x7f171419f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:27.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.227+0000 7f1719645640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f171410c5a0 con 0x7f1714101ae0 2024-06-03T00:00:27.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.227+0000 7f1719645640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f171410c420 con 0x7f17141008f0 2024-06-03T00:00:27.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.227+0000 7f1719645640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f171410c720 con 0x7f17141024a0 2024-06-03T00:00:27.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.227+0000 7f17127fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1714101ae0 0x7f1714198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:27.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.227+0000 7f17127fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1714101ae0 0x7f1714198180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55276/0 (socket says 172.21.15.49:55276) 2024-06-03T00:00:27.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.227+0000 7f17127fc640 1 -- 172.21.15.49:0/492896846 learned_addr learned my addr 172.21.15.49:0/492896846 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:27.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.227+0000 7f1712ffd640 1 --2- 172.21.15.49:0/492896846 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17141008f0 0x7f1714197c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:27.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.227+0000 7f17137fe640 1 --2- 172.21.15.49:0/492896846 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17141024a0 0x7f171419f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:27.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.227+0000 7f17127fc640 1 -- 172.21.15.49:0/492896846 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17141024a0 msgr2=0x7f171419f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:27.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.227+0000 7f17127fc640 1 --2- 172.21.15.49:0/492896846 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17141024a0 0x7f171419f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:27.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.227+0000 7f17127fc640 1 -- 172.21.15.49:0/492896846 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17141008f0 msgr2=0x7f1714197c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:27.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.227+0000 7f17127fc640 1 --2- 172.21.15.49:0/492896846 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17141008f0 0x7f1714197c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:27.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.227+0000 7f17127fc640 1 -- 172.21.15.49:0/492896846 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f171419f850 con 0x7f1714101ae0 2024-06-03T00:00:27.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.227+0000 7f17127fc640 1 --2- 172.21.15.49:0/492896846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1714101ae0 0x7f1714198180 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f170800d950 tx=0x7f170800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:27.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.227+0000 7f16fbfff640 1 -- 172.21.15.49:0/492896846 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1708017070 con 0x7f1714101ae0 2024-06-03T00:00:27.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.227+0000 7f1719645640 1 -- 172.21.15.49:0/492896846 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f171419fb40 con 0x7f1714101ae0 2024-06-03T00:00:27.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.227+0000 7f16fbfff640 1 -- 172.21.15.49:0/492896846 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1708009c30 con 0x7f1714101ae0 2024-06-03T00:00:27.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.227+0000 7f16fbfff640 1 -- 172.21.15.49:0/492896846 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170800f6b0 con 0x7f1714101ae0 2024-06-03T00:00:27.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.227+0000 7f1719645640 1 -- 172.21.15.49:0/492896846 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17141a0090 con 0x7f1714101ae0 2024-06-03T00:00:27.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.228+0000 7f1719645640 1 -- 172.21.15.49:0/492896846 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17141a0260 con 0x7f1714101ae0 2024-06-03T00:00:27.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.230+0000 7f16fbfff640 1 -- 172.21.15.49:0/492896846 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f17080109d0 con 0x7f1714101ae0 2024-06-03T00:00:27.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.230+0000 7f16fbfff640 1 --2- 172.21.15.49:0/492896846 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f16fc0a2b90 0x7f16fc0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:27.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.230+0000 7f1712ffd640 1 --2- 172.21.15.49:0/492896846 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f16fc0a2b90 0x7f16fc0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:27.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.230+0000 7f16fbfff640 1 -- 172.21.15.49:0/492896846 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f17080ced40 con 0x7f1714101ae0 2024-06-03T00:00:27.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.231+0000 7f1712ffd640 1 --2- 172.21.15.49:0/492896846 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f16fc0a2b90 0x7f16fc0a5050 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1714199110 tx=0x7f1704005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:27.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.235+0000 7f16fbfff640 1 -- 172.21.15.49:0/492896846 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1708009de0 con 0x7f1714101ae0 2024-06-03T00:00:27.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:27 smithi107 ceph-mon[37048]: pgmap v395: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-06-03T00:00:27.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:27 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/3960437965' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-06-03T00:00:27.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.424+0000 7f1719645640 1 -- 172.21.15.49:0/492896846 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f17141a05f0 con 0x7f1714101ae0 2024-06-03T00:00:27.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.426+0000 7f16fbfff640 1 -- 172.21.15.49:0/492896846 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+22612 (secure 0 0 0) 0x7f170809bca0 con 0x7f1714101ae0 2024-06-03T00:00:27.426 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:00:27.426 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":90,"fsid":"890dd222-213a-11ef-bc9b-c7b262605968","created":"2024-06-02T23:48:53.323536+0000","modified":"2024-06-02T23:57:56.520324+0000","last_up_change":"2024-06-02T23:56:12.156697+0000","last_in_change":"2024-06-02T23:55:51.667118+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:52:23.676079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:57:10.753178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T23:57:14.240610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e0013e80-07d6-4ad3-87d8-d41988988ef5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6803","nonce":811647073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6805","nonce":811647073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6809","nonce":811647073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6807","nonce":811647073}]},"public_addr":"172.21.15.49:6803/811647073","cluster_addr":"172.21.15.49:6805/811647073","heartbeat_back_addr":"172.21.15.49:6809/811647073","heartbeat_front_addr":"172.21.15.49:6807/811647073","state":["exists","up"]},{"osd":1,"uuid":"f37d9f79-e349-4de7-81e7-385ddb905f58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6801","nonce":1260507785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6803","nonce":1260507785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6807","nonce":1260507785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6805","nonce":1260507785}]},"public_addr":"172.21.15.57:6801/1260507785","cluster_addr":"172.21.15.57:6803/1260507785","heartbeat_back_addr":"172.21.15.57:6807/1260507785","heartbeat_front_addr":"172.21.15.57:6805/1260507785","state":["exists","up"]},{"osd":2,"uuid":"94889281-7d45-4e78-9d37-b98e3fbe8494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6801","nonce":303899951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6803","nonce":303899951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6807","nonce":303899951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6805","nonce":303899951}]},"public_addr":"172.21.15.107:6801/303899951","cluster_addr":"172.21.15.107:6803/303899951","heartbeat_back_addr":"172.21.15.107:6807/303899951","heartbeat_front_addr":"172.21.15.107:6805/303899951","state":["exists","up"]},{"osd":3,"uuid":"31f4c18c-fbda-400d-8b3b-0955b0c4a6a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6811","nonce":60796312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6813","nonce":60796312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6817","nonce":60796312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6815","nonce":60796312}]},"public_addr":"172.21.15.49:6811/60796312","cluster_addr":"172.21.15.49:6813/60796312","heartbeat_back_addr":"172.21.15.49:6817/60796312","heartbeat_front_addr":"172.21.15.49:6815/60796312","state":["exists","up"]},{"osd":4,"uuid":"8076c2f3-0138-459e-89b5-c5c4586a14ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6809","nonce":3106842986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6811","nonce":3106842986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6815","nonce":3106842986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6813","nonce":3106842986}]},"public_addr":"172.21.15.57:6809/3106842986","cluster_addr":"172.21.15.57:6811/3106842986","heartbeat_back_addr":"172.21.15.57:6815/3106842986","heartbeat_front_addr":"172.21.15.57:6813/3106842986","state":["exists","up"]},{"osd":5,"uuid":"68f7abd3-4292-41fa-90ce-4ac34ea2b964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6809","nonce":389294142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6811","nonce":389294142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6815","nonce":389294142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6813","nonce":389294142}]},"public_addr":"172.21.15.107:6809/389294142","cluster_addr":"172.21.15.107:6811/389294142","heartbeat_back_addr":"172.21.15.107:6815/389294142","heartbeat_front_addr":"172.21.15.107:6813/389294142","state":["exists","up"]},{"osd":6,"uuid":"c0345dd0-71b7-436d-88f8-fe3d7cb69d8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6819","nonce":894624552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6821","nonce":894624552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6825","nonce":894624552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6823","nonce":894624552}]},"public_addr":"172.21.15.49:6819/894624552","cluster_addr":"172.21.15.49:6821/894624552","heartbeat_back_addr":"172.21.15.49:6825/894624552","heartbeat_front_addr":"172.21.15.49:6823/894624552","state":["exists","up"]},{"osd":7,"uuid":"9abd81c7-dcc1-4e14-8ab7-9fa0746067ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6817","nonce":3126027900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6819","nonce":3126027900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6823","nonce":3126027900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6821","nonce":3126027900}]},"public_addr":"172.21.15.57:6817/3126027900","cluster_addr":"172.21.15.57:6819/3126027900","heartbeat_back_addr":"172.21.15.57:6823/3126027900","heartbeat_front_addr":"172.21.15.57:6821/3126027900","state":["exists","up"]},{"osd":8,"uuid":"80532119-5de8-45d2-9cb9-bd8a6194199b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6817","nonce":3620047229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6819","nonce":3620047229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6823","nonce":3620047229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6821","nonce":3620047229}]},"public_addr":"172.21.15.107:6817/3620047229","cluster_addr":"172.21.15.107:6819/3620047229","heartbeat_back_addr":"172.21.15.107:6823/3620047229","heartbeat_front_addr":"172.21.15.107:6821/3620047229","state":["exists","up"]},{"osd":9,"uuid":"f0b5dcfa-9fd2-4a98-863b-197defa890af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6827","nonce":3627936526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6829","nonce":3627936526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6833","nonce":3627936526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6831","nonce":3627936526}]},"public_addr":"172.21.15.49:6827/3627936526","cluster_addr":"172.21.15.49:6829/3627936526","heartbeat_back_addr":"172.21.15.49:6833/3627936526","heartbeat_front_addr":"172.21.15.49:6831/3627936526","state":["exists","up"]},{"osd":10,"uuid":"21a75846-adec-41b8-9e1d-e5c61ba30b12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6825","nonce":3013235811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6827","nonce":3013235811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6831","nonce":3013235811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6829","nonce":3013235811}]},"public_addr":"172.21.15.57:6825/3013235811","cluster_addr":"172.21.15.57:6827/3013235811","heartbeat_back_addr":"172.21.15.57:6831/3013235811","heartbeat_front_addr":"172.21.15.57:6829/3013235811","state":["exists","up"]},{"osd":11,"uuid":"eb963b63-2c61-4169-b8fe-31c7f5ec919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6825","nonce":4217534517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6827","nonce":4217534517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6831","nonce":4217534517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6829","nonce":4217534517}]},"public_addr":"172.21.15.107:6825/4217534517","cluster_addr":"172.21.15.107:6827/4217534517","heartbeat_back_addr":"172.21.15.107:6831/4217534517","heartbeat_front_addr":"172.21.15.107:6829/4217534517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:51:31.067312+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:51:56.088456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:52:20.539941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:52:45.055717+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:53:11.178438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:53:35.794217+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:00.775674+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:27.574752+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:52.177634+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:55:17.118854+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:55:44.217535+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:56:10.500970+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/525944311":"2024-06-03T23:49:55.151590+0000","172.21.15.49:0/1841969299":"2024-06-03T23:49:55.151590+0000","172.21.15.49:0/1880506696":"2024-06-03T23:49:55.151590+0000","172.21.15.49:6801/1206062338":"2024-06-03T23:49:55.151590+0000","172.21.15.49:6800/549058216":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/2112783954":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/2183920213":"2024-06-03T23:49:29.042670+0000","172.21.15.49:6801/549058216":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/3350970308":"2024-06-03T23:49:29.042670+0000","172.21.15.49:6800/1206062338":"2024-06-03T23:49:55.151590+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-03T00:00:27.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.428+0000 7f1719645640 1 -- 172.21.15.49:0/492896846 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f16fc0a2b90 msgr2=0x7f16fc0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:27.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.428+0000 7f1719645640 1 --2- 172.21.15.49:0/492896846 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f16fc0a2b90 0x7f16fc0a5050 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1714199110 tx=0x7f1704005f90 comp rx=0 tx=0).stop 2024-06-03T00:00:27.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.428+0000 7f1719645640 1 -- 172.21.15.49:0/492896846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1714101ae0 msgr2=0x7f1714198180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:27.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.428+0000 7f1719645640 1 --2- 172.21.15.49:0/492896846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1714101ae0 0x7f1714198180 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f170800d950 tx=0x7f170800de10 comp rx=0 tx=0).stop 2024-06-03T00:00:27.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.428+0000 7f1719645640 1 -- 172.21.15.49:0/492896846 shutdown_connections 2024-06-03T00:00:27.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.428+0000 7f1719645640 1 --2- 172.21.15.49:0/492896846 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f16fc0a2b90 0x7f16fc0a5050 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:27.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.428+0000 7f1719645640 1 --2- 172.21.15.49:0/492896846 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17141024a0 0x7f171419f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:27.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.428+0000 7f1719645640 1 --2- 172.21.15.49:0/492896846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1714101ae0 0x7f1714198180 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:27.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.428+0000 7f1719645640 1 --2- 172.21.15.49:0/492896846 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17141008f0 0x7f1714197c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:27.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.428+0000 7f1719645640 1 -- 172.21.15.49:0/492896846 >> 172.21.15.49:0/492896846 conn(0x7f17140fbea0 msgr2=0x7f17140fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:27.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.428+0000 7f1719645640 1 -- 172.21.15.49:0/492896846 shutdown_connections 2024-06-03T00:00:27.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.428+0000 7f1719645640 1 -- 172.21.15.49:0/492896846 wait complete. 2024-06-03T00:00:27.437 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:27 smithi049 ceph-mon[32302]: pgmap v395: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-06-03T00:00:27.437 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:27 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3960437965' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-06-03T00:00:27.439 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T23:52:23.676079+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-02T23:57:10.753178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-02T23:57:14.240610+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-03T00:00:27.440 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-03T00:00:27.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:27 smithi057 ceph-mon[36457]: pgmap v395: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-06-03T00:00:27.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:27 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/3960437965' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-06-03T00:00:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.547+0000 7f08c4d09640 1 -- 172.21.15.49:0/3338064232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c01008e0 msgr2=0x7f08c0100d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.547+0000 7f08c4d09640 1 --2- 172.21.15.49:0/3338064232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c01008e0 0x7f08c0100d00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f08b0009900 tx=0x7f08b002a410 comp rx=0 tx=0).stop 2024-06-03T00:00:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.548+0000 7f08c4d09640 1 -- 172.21.15.49:0/3338064232 shutdown_connections 2024-06-03T00:00:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.548+0000 7f08c4d09640 1 --2- 172.21.15.49:0/3338064232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08c0101ad0 0x7f08c0101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.548+0000 7f08c4d09640 1 --2- 172.21.15.49:0/3338064232 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08c0102490 0x7f08c0108d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.548+0000 7f08c4d09640 1 --2- 172.21.15.49:0/3338064232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c01008e0 0x7f08c0100d00 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.548+0000 7f08c4d09640 1 -- 172.21.15.49:0/3338064232 >> 172.21.15.49:0/3338064232 conn(0x7f08c00fbe50 msgr2=0x7f08c00fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.548+0000 7f08c4d09640 1 -- 172.21.15.49:0/3338064232 shutdown_connections 2024-06-03T00:00:27.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.548+0000 7f08c4d09640 1 -- 172.21.15.49:0/3338064232 wait complete. 2024-06-03T00:00:27.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.548+0000 7f08c4d09640 1 Processor -- start 2024-06-03T00:00:27.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.548+0000 7f08c4d09640 1 -- start start 2024-06-03T00:00:27.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.549+0000 7f08c4d09640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08c01008e0 0x7f08c0196c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:27.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.549+0000 7f08c4d09640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08c0101ad0 0x7f08c0197190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:27.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.549+0000 7f08c4d09640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c0102490 0x7f08c019e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:27.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.549+0000 7f08c4d09640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f08c010c560 con 0x7f08c0102490 2024-06-03T00:00:27.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.549+0000 7f08c4d09640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f08c010c3e0 con 0x7f08c01008e0 2024-06-03T00:00:27.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.549+0000 7f08c4d09640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f08c010c6e0 con 0x7f08c0101ad0 2024-06-03T00:00:27.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.549+0000 7f08bed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c0102490 0x7f08c019e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:27.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.549+0000 7f08bed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c0102490 0x7f08c019e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55302/0 (socket says 172.21.15.49:55302) 2024-06-03T00:00:27.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.549+0000 7f08bed9d640 1 -- 172.21.15.49:0/3088921138 learned_addr learned my addr 172.21.15.49:0/3088921138 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:27.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.549+0000 7f08bdd9b640 1 --2- 172.21.15.49:0/3088921138 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08c0101ad0 0x7f08c0197190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:27.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.549+0000 7f08be59c640 1 --2- 172.21.15.49:0/3088921138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08c01008e0 0x7f08c0196c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:27.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.549+0000 7f08bed9d640 1 -- 172.21.15.49:0/3088921138 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08c0101ad0 msgr2=0x7f08c0197190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:27.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.549+0000 7f08bed9d640 1 --2- 172.21.15.49:0/3088921138 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08c0101ad0 0x7f08c0197190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:27.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.549+0000 7f08bed9d640 1 -- 172.21.15.49:0/3088921138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08c01008e0 msgr2=0x7f08c0196c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:27.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.549+0000 7f08bed9d640 1 --2- 172.21.15.49:0/3088921138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08c01008e0 0x7f08c0196c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:27.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.549+0000 7f08bed9d640 1 -- 172.21.15.49:0/3088921138 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08c019e860 con 0x7f08c0102490 2024-06-03T00:00:27.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.549+0000 7f08be59c640 1 --2- 172.21.15.49:0/3088921138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08c01008e0 0x7f08c0196c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:00:27.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.549+0000 7f08bed9d640 1 --2- 172.21.15.49:0/3088921138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c0102490 0x7f08c019e1c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f08b800ebb0 tx=0x7f08b8007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:27.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.549+0000 7f08af7fe640 1 -- 172.21.15.49:0/3088921138 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b8007ca0 con 0x7f08c0102490 2024-06-03T00:00:27.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.549+0000 7f08af7fe640 1 -- 172.21.15.49:0/3088921138 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08b8007e40 con 0x7f08c0102490 2024-06-03T00:00:27.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.549+0000 7f08c4d09640 1 -- 172.21.15.49:0/3088921138 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08c0068b30 con 0x7f08c0102490 2024-06-03T00:00:27.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.549+0000 7f08af7fe640 1 -- 172.21.15.49:0/3088921138 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b80058a0 con 0x7f08c0102490 2024-06-03T00:00:27.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.549+0000 7f08c4d09640 1 -- 172.21.15.49:0/3088921138 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08c0069080 con 0x7f08c0102490 2024-06-03T00:00:27.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.550+0000 7f08c4d09640 1 -- 172.21.15.49:0/3088921138 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08c00687c0 con 0x7f08c0102490 2024-06-03T00:00:27.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.552+0000 7f08af7fe640 1 -- 172.21.15.49:0/3088921138 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f08b8004a40 con 0x7f08c0102490 2024-06-03T00:00:27.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.552+0000 7f08af7fe640 1 --2- 172.21.15.49:0/3088921138 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f08a80a2b90 0x7f08a80a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:27.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.552+0000 7f08be59c640 1 --2- 172.21.15.49:0/3088921138 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f08a80a2b90 0x7f08a80a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:27.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.552+0000 7f08af7fe640 1 -- 172.21.15.49:0/3088921138 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f08b80d0690 con 0x7f08c0102490 2024-06-03T00:00:27.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.553+0000 7f08be59c640 1 --2- 172.21.15.49:0/3088921138 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f08a80a2b90 0x7f08a80a5050 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f08b00314e0 tx=0x7f08b0032dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:27.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.557+0000 7f08af7fe640 1 -- 172.21.15.49:0/3088921138 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f08b809d5f0 con 0x7f08c0102490 2024-06-03T00:00:27.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.742+0000 7f08c4d09640 1 -- 172.21.15.49:0/3088921138 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f08c019ea90 con 0x7f08c0102490 2024-06-03T00:00:27.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.742+0000 7f08af7fe640 1 -- 172.21.15.49:0/3088921138 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) ==== 93+0+10 (secure 0 0 0) 0x7f08b809cef0 con 0x7f08c0102490 2024-06-03T00:00:27.742 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-06-03T00:00:27.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.744+0000 7f08c4d09640 1 -- 172.21.15.49:0/3088921138 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f08a80a2b90 msgr2=0x7f08a80a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:27.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.744+0000 7f08c4d09640 1 --2- 172.21.15.49:0/3088921138 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f08a80a2b90 0x7f08a80a5050 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f08b00314e0 tx=0x7f08b0032dd0 comp rx=0 tx=0).stop 2024-06-03T00:00:27.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.744+0000 7f08c4d09640 1 -- 172.21.15.49:0/3088921138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c0102490 msgr2=0x7f08c019e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:27.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.744+0000 7f08c4d09640 1 --2- 172.21.15.49:0/3088921138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c0102490 0x7f08c019e1c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f08b800ebb0 tx=0x7f08b8007590 comp rx=0 tx=0).stop 2024-06-03T00:00:27.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.744+0000 7f08c4d09640 1 -- 172.21.15.49:0/3088921138 shutdown_connections 2024-06-03T00:00:27.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.744+0000 7f08c4d09640 1 --2- 172.21.15.49:0/3088921138 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f08a80a2b90 0x7f08a80a5050 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:27.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.744+0000 7f08c4d09640 1 --2- 172.21.15.49:0/3088921138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08c0102490 0x7f08c019e1c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:27.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.744+0000 7f08c4d09640 1 --2- 172.21.15.49:0/3088921138 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08c0101ad0 0x7f08c0197190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:27.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.744+0000 7f08c4d09640 1 --2- 172.21.15.49:0/3088921138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08c01008e0 0x7f08c0196c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:27.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.744+0000 7f08c4d09640 1 -- 172.21.15.49:0/3088921138 >> 172.21.15.49:0/3088921138 conn(0x7f08c00fbe50 msgr2=0x7f08c0104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:27.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.744+0000 7f08c4d09640 1 -- 172.21.15.49:0/3088921138 shutdown_connections 2024-06-03T00:00:27.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.744+0000 7f08c4d09640 1 -- 172.21.15.49:0/3088921138 wait complete. 2024-06-03T00:00:27.755 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-03T00:00:27.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.864+0000 7f6f0c6da640 1 -- 172.21.15.49:0/863403025 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f041035b0 msgr2=0x7f6f04109e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:27.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.864+0000 7f6f0c6da640 1 --2- 172.21.15.49:0/863403025 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f041035b0 0x7f6f04109e40 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6efc009ca0 tx=0x7f6efc02a8c0 comp rx=0 tx=0).stop 2024-06-03T00:00:27.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.864+0000 7f6f0c6da640 1 -- 172.21.15.49:0/863403025 shutdown_connections 2024-06-03T00:00:27.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.864+0000 7f6f0c6da640 1 --2- 172.21.15.49:0/863403025 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f04102bf0 0x7f6f04103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:27.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.864+0000 7f6f0c6da640 1 --2- 172.21.15.49:0/863403025 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f041035b0 0x7f6f04109e40 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:27.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.864+0000 7f6f0c6da640 1 --2- 172.21.15.49:0/863403025 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6f04101a00 0x7f6f04101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:27.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.864+0000 7f6f0c6da640 1 -- 172.21.15.49:0/863403025 >> 172.21.15.49:0/863403025 conn(0x7f6f040fcf70 msgr2=0x7f6f040ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:27.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.864+0000 7f6f0c6da640 1 -- 172.21.15.49:0/863403025 shutdown_connections 2024-06-03T00:00:27.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.864+0000 7f6f0c6da640 1 -- 172.21.15.49:0/863403025 wait complete. 2024-06-03T00:00:27.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.864+0000 7f6f0c6da640 1 Processor -- start 2024-06-03T00:00:27.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.864+0000 7f6f0c6da640 1 -- start start 2024-06-03T00:00:27.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.865+0000 7f6f0c6da640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f04101a00 0x7f6f04075750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:27.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.865+0000 7f6f0c6da640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f04102bf0 0x7f6f04073d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:27.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.865+0000 7f6f0c6da640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6f041035b0 0x7f6f040742d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:27.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.865+0000 7f6f0c6da640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0410d6b0 con 0x7f6f04101a00 2024-06-03T00:00:27.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.865+0000 7f6f0c6da640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0410d530 con 0x7f6f04102bf0 2024-06-03T00:00:27.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.865+0000 7f6f0c6da640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0410d830 con 0x7f6f041035b0 2024-06-03T00:00:27.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.865+0000 7f6f0a476640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f04101a00 0x7f6f04075750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:27.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.865+0000 7f6f0a476640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f04101a00 0x7f6f04075750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55310/0 (socket says 172.21.15.49:55310) 2024-06-03T00:00:27.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.865+0000 7f6f0a476640 1 -- 172.21.15.49:0/2959405743 learned_addr learned my addr 172.21.15.49:0/2959405743 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:27.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.865+0000 7f6f09c75640 1 --2- 172.21.15.49:0/2959405743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f04102bf0 0x7f6f04073d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:27.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.865+0000 7f6f0ac77640 1 --2- 172.21.15.49:0/2959405743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6f041035b0 0x7f6f040742d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:27.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.865+0000 7f6f0a476640 1 -- 172.21.15.49:0/2959405743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6f041035b0 msgr2=0x7f6f040742d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:27.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.865+0000 7f6f0a476640 1 --2- 172.21.15.49:0/2959405743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6f041035b0 0x7f6f040742d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:27.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.865+0000 7f6f0a476640 1 -- 172.21.15.49:0/2959405743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f04102bf0 msgr2=0x7f6f04073d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:27.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.865+0000 7f6f0a476640 1 --2- 172.21.15.49:0/2959405743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f04102bf0 0x7f6f04073d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:27.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.865+0000 7f6f0a476640 1 -- 172.21.15.49:0/2959405743 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f04074b60 con 0x7f6f04101a00 2024-06-03T00:00:27.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.865+0000 7f6f09c75640 1 --2- 172.21.15.49:0/2959405743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f04102bf0 0x7f6f04073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:00:27.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.865+0000 7f6f0a476640 1 --2- 172.21.15.49:0/2959405743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f04101a00 0x7f6f04075750 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000c970 tx=0x7f6f0000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:27.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.865+0000 7f6efb7fe640 1 -- 172.21.15.49:0/2959405743 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f00007c10 con 0x7f6f04101a00 2024-06-03T00:00:27.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.865+0000 7f6f0c6da640 1 -- 172.21.15.49:0/2959405743 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f041a1d50 con 0x7f6f04101a00 2024-06-03T00:00:27.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.865+0000 7f6efb7fe640 1 -- 172.21.15.49:0/2959405743 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f00007db0 con 0x7f6f04101a00 2024-06-03T00:00:27.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.865+0000 7f6efb7fe640 1 -- 172.21.15.49:0/2959405743 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0000f8a0 con 0x7f6f04101a00 2024-06-03T00:00:27.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.865+0000 7f6f0c6da640 1 -- 172.21.15.49:0/2959405743 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f041a21b0 con 0x7f6f04101a00 2024-06-03T00:00:27.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.866+0000 7f6f0c6da640 1 -- 172.21.15.49:0/2959405743 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f04108c50 con 0x7f6f04101a00 2024-06-03T00:00:27.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.867+0000 7f6efb7fe640 1 -- 172.21.15.49:0/2959405743 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6f0000fa60 con 0x7f6f04101a00 2024-06-03T00:00:27.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.868+0000 7f6efb7fe640 1 --2- 172.21.15.49:0/2959405743 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6ef00a2b90 0x7f6ef00a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:27.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.869+0000 7f6f09c75640 1 --2- 172.21.15.49:0/2959405743 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6ef00a2b90 0x7f6ef00a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:27.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.869+0000 7f6efb7fe640 1 -- 172.21.15.49:0/2959405743 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f6f000cf480 con 0x7f6f04101a00 2024-06-03T00:00:27.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.869+0000 7f6f09c75640 1 --2- 172.21.15.49:0/2959405743 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6ef00a2b90 0x7f6ef00a5050 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6ef40058c0 tx=0x7f6ef4005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:27.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:27.873+0000 7f6efb7fe640 1 -- 172.21.15.49:0/2959405743 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6f0009c470 con 0x7f6f04101a00 2024-06-03T00:00:28.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.058+0000 7f6f0c6da640 1 -- 172.21.15.49:0/2959405743 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6f04062640 con 0x7f6f04101a00 2024-06-03T00:00:28.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.059+0000 7f6efb7fe640 1 -- 172.21.15.49:0/2959405743 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) ==== 104+0+11 (secure 0 0 0) 0x7f6f0009bd70 con 0x7f6f04101a00 2024-06-03T00:00:28.058 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-06-03T00:00:28.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.060+0000 7f6f0c6da640 1 -- 172.21.15.49:0/2959405743 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6ef00a2b90 msgr2=0x7f6ef00a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:28.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.060+0000 7f6f0c6da640 1 --2- 172.21.15.49:0/2959405743 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6ef00a2b90 0x7f6ef00a5050 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6ef40058c0 tx=0x7f6ef4005850 comp rx=0 tx=0).stop 2024-06-03T00:00:28.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.060+0000 7f6f0c6da640 1 -- 172.21.15.49:0/2959405743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f04101a00 msgr2=0x7f6f04075750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:28.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.060+0000 7f6f0c6da640 1 --2- 172.21.15.49:0/2959405743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f04101a00 0x7f6f04075750 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000c970 tx=0x7f6f0000ce30 comp rx=0 tx=0).stop 2024-06-03T00:00:28.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.060+0000 7f6f0c6da640 1 -- 172.21.15.49:0/2959405743 shutdown_connections 2024-06-03T00:00:28.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.060+0000 7f6f0c6da640 1 --2- 172.21.15.49:0/2959405743 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6ef00a2b90 0x7f6ef00a5050 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:28.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.060+0000 7f6f0c6da640 1 --2- 172.21.15.49:0/2959405743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f04102bf0 0x7f6f04073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:28.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.060+0000 7f6f0c6da640 1 --2- 172.21.15.49:0/2959405743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6f041035b0 0x7f6f040742d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:28.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.060+0000 7f6f0c6da640 1 --2- 172.21.15.49:0/2959405743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f04101a00 0x7f6f04075750 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:28.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.060+0000 7f6f0c6da640 1 -- 172.21.15.49:0/2959405743 >> 172.21.15.49:0/2959405743 conn(0x7f6f040fcf70 msgr2=0x7f6f04105e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:28.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.061+0000 7f6f0c6da640 1 -- 172.21.15.49:0/2959405743 shutdown_connections 2024-06-03T00:00:28.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.061+0000 7f6f0c6da640 1 -- 172.21.15.49:0/2959405743 wait complete. 2024-06-03T00:00:28.071 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-03T00:00:28.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.179+0000 7f07388dd640 1 -- 172.21.15.49:0/3431008363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07341024b0 msgr2=0x7f0734108d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:28.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.179+0000 7f07388dd640 1 --2- 172.21.15.49:0/3431008363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07341024b0 0x7f0734108d40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f072c009ca0 tx=0x7f072c02a8c0 comp rx=0 tx=0).stop 2024-06-03T00:00:28.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.179+0000 7f07388dd640 1 -- 172.21.15.49:0/3431008363 shutdown_connections 2024-06-03T00:00:28.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.179+0000 7f07388dd640 1 --2- 172.21.15.49:0/3431008363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07341024b0 0x7f0734108d40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:28.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.179+0000 7f07388dd640 1 --2- 172.21.15.49:0/3431008363 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0734101af0 0x7f0734101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:28.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.179+0000 7f07388dd640 1 --2- 172.21.15.49:0/3431008363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0734100900 0x7f0734100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:28.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.179+0000 7f07388dd640 1 -- 172.21.15.49:0/3431008363 >> 172.21.15.49:0/3431008363 conn(0x7f07340fbe90 msgr2=0x7f07340fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:28.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.179+0000 7f07388dd640 1 -- 172.21.15.49:0/3431008363 shutdown_connections 2024-06-03T00:00:28.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.179+0000 7f07388dd640 1 -- 172.21.15.49:0/3431008363 wait complete. 2024-06-03T00:00:28.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.179+0000 7f07388dd640 1 Processor -- start 2024-06-03T00:00:28.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.180+0000 7f07388dd640 1 -- start start 2024-06-03T00:00:28.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.180+0000 7f07388dd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0734100900 0x7f0734197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:28.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.180+0000 7f07388dd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0734101af0 0x7f07341981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:28.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.180+0000 7f07388dd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07341024b0 0x7f073419f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:28.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.180+0000 7f07388dd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f073410d660 con 0x7f0734101af0 2024-06-03T00:00:28.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.180+0000 7f07388dd640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f073410d4e0 con 0x7f0734100900 2024-06-03T00:00:28.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.180+0000 7f07388dd640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f073410d7e0 con 0x7f07341024b0 2024-06-03T00:00:28.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.180+0000 7f0729d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0734101af0 0x7f07341981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:28.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.180+0000 7f0729d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0734101af0 0x7f07341981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55338/0 (socket says 172.21.15.49:55338) 2024-06-03T00:00:28.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.180+0000 7f0729d9b640 1 -- 172.21.15.49:0/1145952998 learned_addr learned my addr 172.21.15.49:0/1145952998 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:28.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.180+0000 7f0732d9d640 1 --2- 172.21.15.49:0/1145952998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07341024b0 0x7f073419f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:28.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.180+0000 7f073259c640 1 --2- 172.21.15.49:0/1145952998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0734100900 0x7f0734197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:28.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.180+0000 7f0729d9b640 1 -- 172.21.15.49:0/1145952998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07341024b0 msgr2=0x7f073419f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:28.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.180+0000 7f0729d9b640 1 --2- 172.21.15.49:0/1145952998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07341024b0 0x7f073419f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:28.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.180+0000 7f0729d9b640 1 -- 172.21.15.49:0/1145952998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0734100900 msgr2=0x7f0734197ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:28.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.180+0000 7f0729d9b640 1 --2- 172.21.15.49:0/1145952998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0734100900 0x7f0734197ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:28.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.180+0000 7f0729d9b640 1 -- 172.21.15.49:0/1145952998 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f073419f8e0 con 0x7f0734101af0 2024-06-03T00:00:28.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.180+0000 7f073259c640 1 --2- 172.21.15.49:0/1145952998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0734100900 0x7f0734197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:00:28.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.180+0000 7f0729d9b640 1 --2- 172.21.15.49:0/1145952998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0734101af0 0x7f07341981e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f071c00d950 tx=0x7f071c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:28.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.181+0000 7f072bfff640 1 -- 172.21.15.49:0/1145952998 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071c017070 con 0x7f0734101af0 2024-06-03T00:00:28.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.181+0000 7f07388dd640 1 -- 172.21.15.49:0/1145952998 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f073419fbd0 con 0x7f0734101af0 2024-06-03T00:00:28.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.181+0000 7f072bfff640 1 -- 172.21.15.49:0/1145952998 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f071c009c30 con 0x7f0734101af0 2024-06-03T00:00:28.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.181+0000 7f072bfff640 1 -- 172.21.15.49:0/1145952998 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071c00f6b0 con 0x7f0734101af0 2024-06-03T00:00:28.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.181+0000 7f07388dd640 1 -- 172.21.15.49:0/1145952998 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07341a0170 con 0x7f0734101af0 2024-06-03T00:00:28.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.182+0000 7f07388dd640 1 -- 172.21.15.49:0/1145952998 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0734107c20 con 0x7f0734101af0 2024-06-03T00:00:28.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.183+0000 7f072bfff640 1 -- 172.21.15.49:0/1145952998 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f071c0109d0 con 0x7f0734101af0 2024-06-03T00:00:28.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.184+0000 7f072bfff640 1 --2- 172.21.15.49:0/1145952998 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f07200a2b90 0x7f07200a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:28.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.184+0000 7f072bfff640 1 -- 172.21.15.49:0/1145952998 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f071c0ced10 con 0x7f0734101af0 2024-06-03T00:00:28.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.184+0000 7f073259c640 1 --2- 172.21.15.49:0/1145952998 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f07200a2b90 0x7f07200a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:28.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.184+0000 7f073259c640 1 --2- 172.21.15.49:0/1145952998 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f07200a2b90 0x7f07200a5050 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0724005fd0 tx=0x7f0724005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:28.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.187+0000 7f072bfff640 1 -- 172.21.15.49:0/1145952998 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f071c009de0 con 0x7f0734101af0 2024-06-03T00:00:28.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:28 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/3960437965' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-06-03T00:00:28.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:28 smithi107 ceph-mon[37048]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:00:28.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:28 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/492896846' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-03T00:00:28.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:28 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/3088921138' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-03T00:00:28.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.371+0000 7f07388dd640 1 -- 172.21.15.49:0/1145952998 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f073402d380 con 0x7f0734101af0 2024-06-03T00:00:28.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.371+0000 7f072bfff640 1 -- 172.21.15.49:0/1145952998 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) ==== 100+0+11 (secure 0 0 0) 0x7f071c0bb070 con 0x7f0734101af0 2024-06-03T00:00:28.371 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-06-03T00:00:28.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.373+0000 7f07388dd640 1 -- 172.21.15.49:0/1145952998 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f07200a2b90 msgr2=0x7f07200a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:28.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.373+0000 7f07388dd640 1 --2- 172.21.15.49:0/1145952998 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f07200a2b90 0x7f07200a5050 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0724005fd0 tx=0x7f0724005ee0 comp rx=0 tx=0).stop 2024-06-03T00:00:28.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.373+0000 7f07388dd640 1 -- 172.21.15.49:0/1145952998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0734101af0 msgr2=0x7f07341981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:28.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.373+0000 7f07388dd640 1 --2- 172.21.15.49:0/1145952998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0734101af0 0x7f07341981e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f071c00d950 tx=0x7f071c00de10 comp rx=0 tx=0).stop 2024-06-03T00:00:28.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.373+0000 7f07388dd640 1 -- 172.21.15.49:0/1145952998 shutdown_connections 2024-06-03T00:00:28.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.373+0000 7f07388dd640 1 --2- 172.21.15.49:0/1145952998 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f07200a2b90 0x7f07200a5050 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:28.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.373+0000 7f07388dd640 1 --2- 172.21.15.49:0/1145952998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07341024b0 0x7f073419f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:28.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.373+0000 7f07388dd640 1 --2- 172.21.15.49:0/1145952998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0734101af0 0x7f07341981e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:28.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.373+0000 7f07388dd640 1 --2- 172.21.15.49:0/1145952998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0734100900 0x7f0734197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:28.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.373+0000 7f07388dd640 1 -- 172.21.15.49:0/1145952998 >> 172.21.15.49:0/1145952998 conn(0x7f07340fbe90 msgr2=0x7f0734104df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:28.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.373+0000 7f07388dd640 1 -- 172.21.15.49:0/1145952998 shutdown_connections 2024-06-03T00:00:28.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:28.373+0000 7f07388dd640 1 -- 172.21.15.49:0/1145952998 wait complete. 2024-06-03T00:00:28.382 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:28 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3960437965' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-06-03T00:00:28.383 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:28 smithi049 ceph-mon[32302]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:00:28.383 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:28 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/492896846' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-03T00:00:28.383 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:28 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3088921138' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-03T00:00:28.384 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-06-03T00:00:28.384 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-03T00:00:28.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:28 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/3960437965' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-06-03T00:00:28.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:28 smithi057 ceph-mon[36457]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:00:28.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:28 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/492896846' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-03T00:00:28.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:28 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/3088921138' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-03T00:00:28.634 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:00:29.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:29 smithi107 ceph-mon[37048]: pgmap v396: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 10 op/s 2024-06-03T00:00:29.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:29 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/2959405743' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-03T00:00:29.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:29 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/1145952998' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-03T00:00:29.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:29 smithi057 ceph-mon[36457]: pgmap v396: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 10 op/s 2024-06-03T00:00:29.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:29 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/2959405743' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-03T00:00:29.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:29 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/1145952998' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-03T00:00:29.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:29 smithi049 ceph-mon[32302]: pgmap v396: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 10 op/s 2024-06-03T00:00:29.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:29 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/2959405743' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-03T00:00:29.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:29 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/1145952998' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-03T00:00:30.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.298+0000 7fcaf044d700 1 -- 172.21.15.49:0/3296090300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcae8102740 msgr2=0x7fcae8102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:30.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.298+0000 7fcaf044d700 1 --2- 172.21.15.49:0/3296090300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcae8102740 0x7fcae8102b20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fcae40099c0 tx=0x7fcae4009cd0 comp rx=0 tx=0).stop 2024-06-03T00:00:30.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.298+0000 7fcaf044d700 1 -- 172.21.15.49:0/3296090300 shutdown_connections 2024-06-03T00:00:30.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.298+0000 7fcaf044d700 1 --2- 172.21.15.49:0/3296090300 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcae8107840 0x7fcae810f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:30.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.298+0000 7fcaf044d700 1 --2- 172.21.15.49:0/3296090300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcae8102740 0x7fcae8102b20 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:30.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.298+0000 7fcaf044d700 1 --2- 172.21.15.49:0/3296090300 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcae81030f0 0x7fcae8107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:30.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.298+0000 7fcaf044d700 1 -- 172.21.15.49:0/3296090300 >> 172.21.15.49:0/3296090300 conn(0x7fcae80795f0 msgr2=0x7fcae8079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:30.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.298+0000 7fcaf044d700 1 -- 172.21.15.49:0/3296090300 shutdown_connections 2024-06-03T00:00:30.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.298+0000 7fcaf044d700 1 -- 172.21.15.49:0/3296090300 wait complete. 2024-06-03T00:00:30.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.299+0000 7fcaf044d700 1 Processor -- start 2024-06-03T00:00:30.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.299+0000 7fcaf044d700 1 -- start start 2024-06-03T00:00:30.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.299+0000 7fcaf044d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcae8102740 0x7fcae819e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:30.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.299+0000 7fcaf044d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcae81030f0 0x7fcae819ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:30.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.299+0000 7fcaf044d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcae8107840 0x7fcae8198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:30.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.299+0000 7fcaf044d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcae8112760 con 0x7fcae8107840 2024-06-03T00:00:30.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.299+0000 7fcaf044d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fcae81125e0 con 0x7fcae8102740 2024-06-03T00:00:30.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.299+0000 7fcaf044d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcae81128e0 con 0x7fcae81030f0 2024-06-03T00:00:30.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.299+0000 7fcaee9ea700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcae8107840 0x7fcae8198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:30.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.299+0000 7fcaed9e8700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcae81030f0 0x7fcae819ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:30.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.299+0000 7fcaee9ea700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcae8107840 0x7fcae8198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55364/0 (socket says 172.21.15.49:55364) 2024-06-03T00:00:30.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.299+0000 7fcaee9ea700 1 -- 172.21.15.49:0/1297537727 learned_addr learned my addr 172.21.15.49:0/1297537727 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:30.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.299+0000 7fcaee1e9700 1 --2- 172.21.15.49:0/1297537727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcae8102740 0x7fcae819e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:30.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.299+0000 7fcaee9ea700 1 -- 172.21.15.49:0/1297537727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcae81030f0 msgr2=0x7fcae819ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:30.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.299+0000 7fcaee9ea700 1 --2- 172.21.15.49:0/1297537727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcae81030f0 0x7fcae819ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:30.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.299+0000 7fcaee9ea700 1 -- 172.21.15.49:0/1297537727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcae8102740 msgr2=0x7fcae819e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:30.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.299+0000 7fcaee9ea700 1 --2- 172.21.15.49:0/1297537727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcae8102740 0x7fcae819e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:30.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.299+0000 7fcaee9ea700 1 -- 172.21.15.49:0/1297537727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcae81990c0 con 0x7fcae8107840 2024-06-03T00:00:30.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.300+0000 7fcaee9ea700 1 --2- 172.21.15.49:0/1297537727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcae8107840 0x7fcae8198960 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fcae0007ee0 tx=0x7fcae000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:30.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.300+0000 7fcadf7fe700 1 -- 172.21.15.49:0/1297537727 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae000dbd0 con 0x7fcae8107840 2024-06-03T00:00:30.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.300+0000 7fcadf7fe700 1 -- 172.21.15.49:0/1297537727 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcae000dd70 con 0x7fcae8107840 2024-06-03T00:00:30.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.300+0000 7fcaf044d700 1 -- 172.21.15.49:0/1297537727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcae81993b0 con 0x7fcae8107840 2024-06-03T00:00:30.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.300+0000 7fcadf7fe700 1 -- 172.21.15.49:0/1297537727 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae0005a60 con 0x7fcae8107840 2024-06-03T00:00:30.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.300+0000 7fcaf044d700 1 -- 172.21.15.49:0/1297537727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcae81a5670 con 0x7fcae8107840 2024-06-03T00:00:30.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.301+0000 7fcaf044d700 1 -- 172.21.15.49:0/1297537727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcae8069180 con 0x7fcae8107840 2024-06-03T00:00:30.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.302+0000 7fcadf7fe700 1 -- 172.21.15.49:0/1297537727 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fcae001a020 con 0x7fcae8107840 2024-06-03T00:00:30.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.303+0000 7fcadf7fe700 1 --2- 172.21.15.49:0/1297537727 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fcad40a2ca0 0x7fcad40a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:30.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.303+0000 7fcaee1e9700 1 --2- 172.21.15.49:0/1297537727 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fcad40a2ca0 0x7fcad40a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:30.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.303+0000 7fcadf7fe700 1 -- 172.21.15.49:0/1297537727 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fcae00ced80 con 0x7fcae8107840 2024-06-03T00:00:30.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.303+0000 7fcaee1e9700 1 --2- 172.21.15.49:0/1297537727 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fcad40a2ca0 0x7fcad40a5160 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcae4000c00 tx=0x7fcae4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:30.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.306+0000 7fcadf7fe700 1 -- 172.21.15.49:0/1297537727 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fcae0010070 con 0x7fcae8107840 2024-06-03T00:00:30.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.557+0000 7fcaf044d700 1 -- 172.21.15.49:0/1297537727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcae81a58a0 con 0x7fcae8107840 2024-06-03T00:00:30.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.558+0000 7fcadf7fe700 1 -- 172.21.15.49:0/1297537727 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11929 (secure 0 0 0) 0x7fcae009bce0 con 0x7fcae8107840 2024-06-03T00:00:30.558 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:00:30.558 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1553264866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1553264866},{"type":"v1","addr":"172.21.15.49:6835","nonce":1553264866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2266285252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2266285252},{"type":"v1","addr":"172.21.15.49:6837","nonce":2266285252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T23:57:16.991201+0000","modified":"2024-06-03T00:00:26.305285+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24485,"mds_2":24466,"mds_3":24464,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6839/1729124617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":1729124617},{"type":"v1","addr":"172.21.15.49:6839","nonce":1729124617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6841/1902772235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":1902772235},{"type":"v1","addr":"172.21.15.49:6841","nonce":1902772235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6833/1633534002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1633534002},{"type":"v1","addr":"172.21.15.57:6833","nonce":1633534002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6835/2254905671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2254905671},{"type":"v1","addr":"172.21.15.57:6835","nonce":2254905671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.107:6835/3693542801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3693542801},{"type":"v1","addr":"172.21.15.107:6835","nonce":3693542801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.57:6837/230452144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":230452144},{"type":"v1","addr":"172.21.15.57:6837","nonce":230452144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.107:6837/3700593315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":3700593315},{"type":"v1","addr":"172.21.15.107:6837","nonce":3700593315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6839/249825195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":249825195},{"type":"v1","addr":"172.21.15.57:6839","nonce":249825195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6839/1986600681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1986600681},{"type":"v1","addr":"172.21.15.107:6839","nonce":1986600681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24485,24464,24460,24466,24487]},"id":1}]} 2024-06-03T00:00:30.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.560+0000 7fcaf044d700 1 -- 172.21.15.49:0/1297537727 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fcad40a2ca0 msgr2=0x7fcad40a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:30.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.560+0000 7fcaf044d700 1 --2- 172.21.15.49:0/1297537727 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fcad40a2ca0 0x7fcad40a5160 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcae4000c00 tx=0x7fcae4005fb0 comp rx=0 tx=0).stop 2024-06-03T00:00:30.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.560+0000 7fcaf044d700 1 -- 172.21.15.49:0/1297537727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcae8107840 msgr2=0x7fcae8198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:30.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.560+0000 7fcaf044d700 1 --2- 172.21.15.49:0/1297537727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcae8107840 0x7fcae8198960 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fcae0007ee0 tx=0x7fcae000d3b0 comp rx=0 tx=0).stop 2024-06-03T00:00:30.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.560+0000 7fcaf044d700 1 -- 172.21.15.49:0/1297537727 shutdown_connections 2024-06-03T00:00:30.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.560+0000 7fcaf044d700 1 --2- 172.21.15.49:0/1297537727 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fcad40a2ca0 0x7fcad40a5160 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:30.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.560+0000 7fcaf044d700 1 --2- 172.21.15.49:0/1297537727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcae8107840 0x7fcae8198960 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:30.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.560+0000 7fcaf044d700 1 --2- 172.21.15.49:0/1297537727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcae8102740 0x7fcae819e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:30.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.560+0000 7fcaf044d700 1 --2- 172.21.15.49:0/1297537727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcae81030f0 0x7fcae819ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:30.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.560+0000 7fcaf044d700 1 -- 172.21.15.49:0/1297537727 >> 172.21.15.49:0/1297537727 conn(0x7fcae80795f0 msgr2=0x7fcae8100450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:30.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.561+0000 7fcaf044d700 1 -- 172.21.15.49:0/1297537727 shutdown_connections 2024-06-03T00:00:30.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:30.561+0000 7fcaf044d700 1 -- 172.21.15.49:0/1297537727 wait complete. 2024-06-03T00:00:30.561 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 27 2024-06-03T00:00:31.178 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:31 smithi049 ceph-mon[32302]: pgmap v397: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-06-03T00:00:31.179 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:31 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/1297537727' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:00:31.208 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-06-03T00:00:31.209 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-06-03T00:00:31.209 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-03T00:00:31.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.320+0000 7f3df97c1640 1 -- 172.21.15.49:0/285055455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3df41035c0 msgr2=0x7f3df4109e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:31.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.320+0000 7f3df97c1640 1 --2- 172.21.15.49:0/285055455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3df41035c0 0x7f3df4109e50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3dec009ca0 tx=0x7f3dec02a8c0 comp rx=0 tx=0).stop 2024-06-03T00:00:31.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.320+0000 7f3df97c1640 1 -- 172.21.15.49:0/285055455 shutdown_connections 2024-06-03T00:00:31.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.320+0000 7f3df97c1640 1 --2- 172.21.15.49:0/285055455 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3df4102c00 0x7f3df4103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:31.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.320+0000 7f3df97c1640 1 --2- 172.21.15.49:0/285055455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3df41035c0 0x7f3df4109e50 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:31.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.320+0000 7f3df97c1640 1 --2- 172.21.15.49:0/285055455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3df4101a10 0x7f3df4101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:31.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.320+0000 7f3df97c1640 1 -- 172.21.15.49:0/285055455 >> 172.21.15.49:0/285055455 conn(0x7f3df40fcfa0 msgr2=0x7f3df40ff3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:31.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.320+0000 7f3df97c1640 1 -- 172.21.15.49:0/285055455 shutdown_connections 2024-06-03T00:00:31.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.320+0000 7f3df97c1640 1 -- 172.21.15.49:0/285055455 wait complete. 2024-06-03T00:00:31.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.321+0000 7f3df97c1640 1 Processor -- start 2024-06-03T00:00:31.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.321+0000 7f3df97c1640 1 -- start start 2024-06-03T00:00:31.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.321+0000 7f3df97c1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3df4101a10 0x7f3df4197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:31.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.321+0000 7f3df97c1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3df4102c00 0x7f3df4198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:31.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.321+0000 7f3df97c1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3df41035c0 0x7f3df419f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:31.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.321+0000 7f3df97c1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3df410d690 con 0x7f3df41035c0 2024-06-03T00:00:31.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.321+0000 7f3df97c1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3df410d510 con 0x7f3df4102c00 2024-06-03T00:00:31.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.321+0000 7f3df97c1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3df410d810 con 0x7f3df4101a10 2024-06-03T00:00:31.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.321+0000 7f3df37fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3df41035c0 0x7f3df419f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:31.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.321+0000 7f3df37fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3df41035c0 0x7f3df419f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55378/0 (socket says 172.21.15.49:55378) 2024-06-03T00:00:31.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.321+0000 7f3df37fe640 1 -- 172.21.15.49:0/3499302143 learned_addr learned my addr 172.21.15.49:0/3499302143 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:31.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.321+0000 7f3df27fc640 1 --2- 172.21.15.49:0/3499302143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3df4102c00 0x7f3df4198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:31.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.321+0000 7f3df2ffd640 1 --2- 172.21.15.49:0/3499302143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3df4101a10 0x7f3df4197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:31.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.322+0000 7f3df37fe640 1 -- 172.21.15.49:0/3499302143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3df4101a10 msgr2=0x7f3df4197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:31.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.322+0000 7f3df37fe640 1 --2- 172.21.15.49:0/3499302143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3df4101a10 0x7f3df4197d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:31.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.322+0000 7f3df37fe640 1 -- 172.21.15.49:0/3499302143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3df4102c00 msgr2=0x7f3df4198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:31.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.322+0000 7f3df37fe640 1 --2- 172.21.15.49:0/3499302143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3df4102c00 0x7f3df4198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:31.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.322+0000 7f3df37fe640 1 -- 172.21.15.49:0/3499302143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df419f960 con 0x7f3df41035c0 2024-06-03T00:00:31.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.322+0000 7f3df37fe640 1 --2- 172.21.15.49:0/3499302143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3df41035c0 0x7f3df419f2f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3dec005e30 tx=0x7f3dec031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:31.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.322+0000 7f3debfff640 1 -- 172.21.15.49:0/3499302143 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec003b70 con 0x7f3df41035c0 2024-06-03T00:00:31.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.322+0000 7f3debfff640 1 -- 172.21.15.49:0/3499302143 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dec003d10 con 0x7f3df41035c0 2024-06-03T00:00:31.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.322+0000 7f3df97c1640 1 -- 172.21.15.49:0/3499302143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3df419fbf0 con 0x7f3df41035c0 2024-06-03T00:00:31.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.322+0000 7f3debfff640 1 -- 172.21.15.49:0/3499302143 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec02fb70 con 0x7f3df41035c0 2024-06-03T00:00:31.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.322+0000 7f3df97c1640 1 -- 172.21.15.49:0/3499302143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3df41a0140 con 0x7f3df41035c0 2024-06-03T00:00:31.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.323+0000 7f3df97c1640 1 -- 172.21.15.49:0/3499302143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3df4108cd0 con 0x7f3df41035c0 2024-06-03T00:00:31.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.324+0000 7f3debfff640 1 -- 172.21.15.49:0/3499302143 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3dec02fd10 con 0x7f3df41035c0 2024-06-03T00:00:31.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.325+0000 7f3debfff640 1 --2- 172.21.15.49:0/3499302143 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3de00a2b90 0x7f3de00a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:31.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.325+0000 7f3df2ffd640 1 --2- 172.21.15.49:0/3499302143 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3de00a2b90 0x7f3de00a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:31.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.325+0000 7f3debfff640 1 -- 172.21.15.49:0/3499302143 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f3dec0f0190 con 0x7f3df41035c0 2024-06-03T00:00:31.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.325+0000 7f3df2ffd640 1 --2- 172.21.15.49:0/3499302143 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3de00a2b90 0x7f3de00a5050 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3df4102a60 tx=0x7f3de4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:31.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.329+0000 7f3debfff640 1 -- 172.21.15.49:0/3499302143 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3dec0bd0f0 con 0x7f3df41035c0 2024-06-03T00:00:31.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:31 smithi107 ceph-mon[37048]: pgmap v397: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-06-03T00:00:31.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:31 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/1297537727' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:00:31.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:31 smithi057 ceph-mon[36457]: pgmap v397: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-06-03T00:00:31.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:31 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/1297537727' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:00:31.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.511+0000 7f3df97c1640 1 -- 172.21.15.49:0/3499302143 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3df4061de0 con 0x7f3de00a2b90 2024-06-03T00:00:31.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.518+0000 7f3debfff640 1 -- 172.21.15.49:0/3499302143 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258894 (secure 0 0 0) 0x7f3df4061de0 con 0x7f3de00a2b90 2024-06-03T00:00:31.521 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:00:31.522 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-06-03T00:00:31.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.521+0000 7f3df97c1640 1 -- 172.21.15.49:0/3499302143 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3de00a2b90 msgr2=0x7f3de00a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:31.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.521+0000 7f3df97c1640 1 --2- 172.21.15.49:0/3499302143 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3de00a2b90 0x7f3de00a5050 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3df4102a60 tx=0x7f3de4005f90 comp rx=0 tx=0).stop 2024-06-03T00:00:31.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.521+0000 7f3df97c1640 1 -- 172.21.15.49:0/3499302143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3df41035c0 msgr2=0x7f3df419f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:31.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.521+0000 7f3df97c1640 1 --2- 172.21.15.49:0/3499302143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3df41035c0 0x7f3df419f2f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3dec005e30 tx=0x7f3dec031ee0 comp rx=0 tx=0).stop 2024-06-03T00:00:31.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.521+0000 7f3df97c1640 1 -- 172.21.15.49:0/3499302143 shutdown_connections 2024-06-03T00:00:31.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.521+0000 7f3df97c1640 1 --2- 172.21.15.49:0/3499302143 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3de00a2b90 0x7f3de00a5050 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:31.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.521+0000 7f3df97c1640 1 --2- 172.21.15.49:0/3499302143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3df4102c00 0x7f3df4198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:31.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.521+0000 7f3df97c1640 1 --2- 172.21.15.49:0/3499302143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3df41035c0 0x7f3df419f2f0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:31.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.521+0000 7f3df97c1640 1 --2- 172.21.15.49:0/3499302143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3df4101a10 0x7f3df4197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:31.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.521+0000 7f3df97c1640 1 -- 172.21.15.49:0/3499302143 >> 172.21.15.49:0/3499302143 conn(0x7f3df40fcfa0 msgr2=0x7f3df4105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:31.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.522+0000 7f3df97c1640 1 -- 172.21.15.49:0/3499302143 shutdown_connections 2024-06-03T00:00:31.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.522+0000 7f3df97c1640 1 -- 172.21.15.49:0/3499302143 wait complete. 2024-06-03T00:00:31.532 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":398,"stamp":"2024-06-03T00:00:31.286965+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660727,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1923,"num_read_kb":1083,"num_write":445,"num_write_kb":3089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":1180736,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":863,"ondisk_log_size":863,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375484,"kb_used_data":13852,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124566340,"statfs":{"total":1151940427776,"available":1151555932160,"internally_reserved":0,"allocated":14184448,"data_stored":7739223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":57,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003136"},"pg_stats":[{"pgid":"3.3f","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.275149+0000","last_change":"2024-06-02T23:57:15.321542+0000","last_active":"2024-06-02T23:58:55.275149+0000","last_peered":"2024-06-02T23:58:55.275149+0000","last_clean":"2024-06-02T23:58:55.275149+0000","last_became_active":"2024-06-02T23:57:15.321129+0000","last_became_peered":"2024-06-02T23:57:15.321129+0000","last_unstale":"2024-06-02T23:58:55.275149+0000","last_undegraded":"2024-06-02T23:58:55.275149+0000","last_fullsized":"2024-06-02T23:58:55.275149+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:35:50.218316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272859+0000","last_change":"2024-06-02T23:57:15.327432+0000","last_active":"2024-06-02T23:58:55.272859+0000","last_peered":"2024-06-02T23:58:55.272859+0000","last_clean":"2024-06-02T23:58:55.272859+0000","last_became_active":"2024-06-02T23:57:15.326759+0000","last_became_peered":"2024-06-02T23:57:15.326759+0000","last_unstale":"2024-06-02T23:58:55.272859+0000","last_undegraded":"2024-06-02T23:58:55.272859+0000","last_fullsized":"2024-06-02T23:58:55.272859+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:42:20.473216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.274694+0000","last_change":"2024-06-02T23:57:15.323721+0000","last_active":"2024-06-02T23:58:55.274694+0000","last_peered":"2024-06-02T23:58:55.274694+0000","last_clean":"2024-06-02T23:58:55.274694+0000","last_became_active":"2024-06-02T23:57:15.321277+0000","last_became_peered":"2024-06-02T23:57:15.321277+0000","last_unstale":"2024-06-02T23:58:55.274694+0000","last_undegraded":"2024-06-02T23:58:55.274694+0000","last_fullsized":"2024-06-02T23:58:55.274694+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:34:31.667999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.258319+0000","last_change":"2024-06-02T23:57:15.323769+0000","last_active":"2024-06-02T23:58:55.258319+0000","last_peered":"2024-06-02T23:58:55.258319+0000","last_clean":"2024-06-02T23:58:55.258319+0000","last_became_active":"2024-06-02T23:57:15.323406+0000","last_became_peered":"2024-06-02T23:57:15.323406+0000","last_unstale":"2024-06-02T23:58:55.258319+0000","last_undegraded":"2024-06-02T23:58:55.258319+0000","last_fullsized":"2024-06-02T23:58:55.258319+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:51:27.456210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.258510+0000","last_change":"2024-06-02T23:57:56.531404+0000","last_active":"2024-06-02T23:58:55.258510+0000","last_peered":"2024-06-02T23:58:55.258510+0000","last_clean":"2024-06-02T23:58:55.258510+0000","last_became_active":"2024-06-02T23:57:56.530952+0000","last_became_peered":"2024-06-02T23:57:56.530952+0000","last_unstale":"2024-06-02T23:58:55.258510+0000","last_undegraded":"2024-06-02T23:58:55.258510+0000","last_fullsized":"2024-06-02T23:58:55.258510+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:39:30.405113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268533+0000","last_change":"2024-06-02T23:57:15.320843+0000","last_active":"2024-06-02T23:58:55.268533+0000","last_peered":"2024-06-02T23:58:55.268533+0000","last_clean":"2024-06-02T23:58:55.268533+0000","last_became_active":"2024-06-02T23:57:15.320472+0000","last_became_peered":"2024-06-02T23:57:15.320472+0000","last_unstale":"2024-06-02T23:58:55.268533+0000","last_undegraded":"2024-06-02T23:58:55.268533+0000","last_fullsized":"2024-06-02T23:58:55.268533+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:49:02.620777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.271511+0000","last_change":"2024-06-02T23:57:15.321799+0000","last_active":"2024-06-02T23:58:55.271511+0000","last_peered":"2024-06-02T23:58:55.271511+0000","last_clean":"2024-06-02T23:58:55.271511+0000","last_became_active":"2024-06-02T23:57:15.321379+0000","last_became_peered":"2024-06-02T23:57:15.321379+0000","last_unstale":"2024-06-02T23:58:55.271511+0000","last_undegraded":"2024-06-02T23:58:55.271511+0000","last_fullsized":"2024-06-02T23:58:55.271511+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:36:56.404936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268859+0000","last_change":"2024-06-02T23:57:15.318771+0000","last_active":"2024-06-02T23:58:55.268859+0000","last_peered":"2024-06-02T23:58:55.268859+0000","last_clean":"2024-06-02T23:58:55.268859+0000","last_became_active":"2024-06-02T23:57:15.318420+0000","last_became_peered":"2024-06-02T23:57:15.318420+0000","last_unstale":"2024-06-02T23:58:55.268859+0000","last_undegraded":"2024-06-02T23:58:55.268859+0000","last_fullsized":"2024-06-02T23:58:55.268859+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:07:53.769443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.274516+0000","last_change":"2024-06-02T23:57:15.318989+0000","last_active":"2024-06-02T23:58:55.274516+0000","last_peered":"2024-06-02T23:58:55.274516+0000","last_clean":"2024-06-02T23:58:55.274516+0000","last_became_active":"2024-06-02T23:57:15.318424+0000","last_became_peered":"2024-06-02T23:57:15.318424+0000","last_unstale":"2024-06-02T23:58:55.274516+0000","last_undegraded":"2024-06-02T23:58:55.274516+0000","last_fullsized":"2024-06-02T23:58:55.274516+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:30:47.634662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265217+0000","last_change":"2024-06-02T23:57:15.326251+0000","last_active":"2024-06-02T23:58:55.265217+0000","last_peered":"2024-06-02T23:58:55.265217+0000","last_clean":"2024-06-02T23:58:55.265217+0000","last_became_active":"2024-06-02T23:57:15.325890+0000","last_became_peered":"2024-06-02T23:57:15.325890+0000","last_unstale":"2024-06-02T23:58:55.265217+0000","last_undegraded":"2024-06-02T23:58:55.265217+0000","last_fullsized":"2024-06-02T23:58:55.265217+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:18:54.871410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.274001+0000","last_change":"2024-06-02T23:57:15.325364+0000","last_active":"2024-06-02T23:58:55.274001+0000","last_peered":"2024-06-02T23:58:55.274001+0000","last_clean":"2024-06-02T23:58:55.274001+0000","last_became_active":"2024-06-02T23:57:15.324987+0000","last_became_peered":"2024-06-02T23:57:15.324987+0000","last_unstale":"2024-06-02T23:58:55.274001+0000","last_undegraded":"2024-06-02T23:58:55.274001+0000","last_fullsized":"2024-06-02T23:58:55.274001+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:59:11.827263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265434+0000","last_change":"2024-06-02T23:57:15.328027+0000","last_active":"2024-06-02T23:58:55.265434+0000","last_peered":"2024-06-02T23:58:55.265434+0000","last_clean":"2024-06-02T23:58:55.265434+0000","last_became_active":"2024-06-02T23:57:15.327608+0000","last_became_peered":"2024-06-02T23:57:15.327608+0000","last_unstale":"2024-06-02T23:58:55.265434+0000","last_undegraded":"2024-06-02T23:58:55.265434+0000","last_fullsized":"2024-06-02T23:58:55.265434+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:09:42.152689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262861+0000","last_change":"2024-06-02T23:57:15.323095+0000","last_active":"2024-06-02T23:58:55.262861+0000","last_peered":"2024-06-02T23:58:55.262861+0000","last_clean":"2024-06-02T23:58:55.262861+0000","last_became_active":"2024-06-02T23:57:15.322755+0000","last_became_peered":"2024-06-02T23:57:15.322755+0000","last_unstale":"2024-06-02T23:58:55.262861+0000","last_undegraded":"2024-06-02T23:58:55.262861+0000","last_fullsized":"2024-06-02T23:58:55.262861+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:43:53.195192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272339+0000","last_change":"2024-06-02T23:57:15.327437+0000","last_active":"2024-06-02T23:58:55.272339+0000","last_peered":"2024-06-02T23:58:55.272339+0000","last_clean":"2024-06-02T23:58:55.272339+0000","last_became_active":"2024-06-02T23:57:15.326974+0000","last_became_peered":"2024-06-02T23:57:15.326974+0000","last_unstale":"2024-06-02T23:58:55.272339+0000","last_undegraded":"2024-06-02T23:58:55.272339+0000","last_fullsized":"2024-06-02T23:58:55.272339+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:20:44.978213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273334+0000","last_change":"2024-06-02T23:57:15.325414+0000","last_active":"2024-06-02T23:58:55.273334+0000","last_peered":"2024-06-02T23:58:55.273334+0000","last_clean":"2024-06-02T23:58:55.273334+0000","last_became_active":"2024-06-02T23:57:15.325033+0000","last_became_peered":"2024-06-02T23:57:15.325033+0000","last_unstale":"2024-06-02T23:58:55.273334+0000","last_undegraded":"2024-06-02T23:58:55.273334+0000","last_fullsized":"2024-06-02T23:58:55.273334+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:27:14.536646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272688+0000","last_change":"2024-06-02T23:57:15.315833+0000","last_active":"2024-06-02T23:58:55.272688+0000","last_peered":"2024-06-02T23:58:55.272688+0000","last_clean":"2024-06-02T23:58:55.272688+0000","last_became_active":"2024-06-02T23:57:15.315355+0000","last_became_peered":"2024-06-02T23:57:15.315355+0000","last_unstale":"2024-06-02T23:58:55.272688+0000","last_undegraded":"2024-06-02T23:58:55.272688+0000","last_fullsized":"2024-06-02T23:58:55.272688+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:52:05.915828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.275143+0000","last_change":"2024-06-02T23:57:15.322407+0000","last_active":"2024-06-02T23:58:55.275143+0000","last_peered":"2024-06-02T23:58:55.275143+0000","last_clean":"2024-06-02T23:58:55.275143+0000","last_became_active":"2024-06-02T23:57:15.322090+0000","last_became_peered":"2024-06-02T23:57:15.322090+0000","last_unstale":"2024-06-02T23:58:55.275143+0000","last_undegraded":"2024-06-02T23:58:55.275143+0000","last_fullsized":"2024-06-02T23:58:55.275143+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:08:48.071192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268594+0000","last_change":"2024-06-02T23:57:15.327331+0000","last_active":"2024-06-02T23:58:55.268594+0000","last_peered":"2024-06-02T23:58:55.268594+0000","last_clean":"2024-06-02T23:58:55.268594+0000","last_became_active":"2024-06-02T23:57:15.326863+0000","last_became_peered":"2024-06-02T23:57:15.326863+0000","last_unstale":"2024-06-02T23:58:55.268594+0000","last_undegraded":"2024-06-02T23:58:55.268594+0000","last_fullsized":"2024-06-02T23:58:55.268594+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:45:05.443751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.261047+0000","last_change":"2024-06-02T23:57:15.313008+0000","last_active":"2024-06-02T23:58:55.261047+0000","last_peered":"2024-06-02T23:58:55.261047+0000","last_clean":"2024-06-02T23:58:55.261047+0000","last_became_active":"2024-06-02T23:57:15.312322+0000","last_became_peered":"2024-06-02T23:57:15.312322+0000","last_unstale":"2024-06-02T23:58:55.261047+0000","last_undegraded":"2024-06-02T23:58:55.261047+0000","last_fullsized":"2024-06-02T23:58:55.261047+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:54:03.744964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":217,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:28.407878+0000","last_change":"2024-06-02T23:57:12.153410+0000","last_active":"2024-06-03T00:00:28.407878+0000","last_peered":"2024-06-03T00:00:28.407878+0000","last_clean":"2024-06-03T00:00:28.407878+0000","last_became_active":"2024-06-02T23:57:12.153065+0000","last_became_peered":"2024-06-02T23:57:12.153065+0000","last_unstale":"2024-06-03T00:00:28.407878+0000","last_undegraded":"2024-06-03T00:00:28.407878+0000","last_fullsized":"2024-06-03T00:00:28.407878+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:45:30.058961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.258496+0000","last_change":"2024-06-02T23:57:15.314168+0000","last_active":"2024-06-02T23:58:55.258496+0000","last_peered":"2024-06-02T23:58:55.258496+0000","last_clean":"2024-06-02T23:58:55.258496+0000","last_became_active":"2024-06-02T23:57:15.313838+0000","last_became_peered":"2024-06-02T23:57:15.313838+0000","last_unstale":"2024-06-02T23:58:55.258496+0000","last_undegraded":"2024-06-02T23:58:55.258496+0000","last_fullsized":"2024-06-02T23:58:55.258496+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:56:14.137471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526742+0000","last_change":"2024-06-02T23:57:12.305448+0000","last_active":"2024-06-02T23:57:56.526742+0000","last_peered":"2024-06-02T23:57:56.526742+0000","last_clean":"2024-06-02T23:57:56.526742+0000","last_became_active":"2024-06-02T23:57:12.305080+0000","last_became_peered":"2024-06-02T23:57:12.305080+0000","last_unstale":"2024-06-02T23:57:56.526742+0000","last_undegraded":"2024-06-02T23:57:56.526742+0000","last_fullsized":"2024-06-02T23:57:56.526742+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:20:18.660943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.275386+0000","last_change":"2024-06-02T23:57:15.321660+0000","last_active":"2024-06-02T23:58:55.275386+0000","last_peered":"2024-06-02T23:58:55.275386+0000","last_clean":"2024-06-02T23:58:55.275386+0000","last_became_active":"2024-06-02T23:57:15.321304+0000","last_became_peered":"2024-06-02T23:57:15.321304+0000","last_unstale":"2024-06-02T23:58:55.275386+0000","last_undegraded":"2024-06-02T23:58:55.275386+0000","last_fullsized":"2024-06-02T23:58:55.275386+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:10:10.933291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:58.169787+0000","last_change":"2024-06-02T23:57:56.544458+0000","last_active":"2024-06-02T23:57:58.169787+0000","last_peered":"2024-06-02T23:57:58.169787+0000","last_clean":"2024-06-02T23:57:58.169787+0000","last_became_active":"2024-06-02T23:57:56.532838+0000","last_became_peered":"2024-06-02T23:57:56.532838+0000","last_unstale":"2024-06-02T23:57:58.169787+0000","last_undegraded":"2024-06-02T23:57:58.169787+0000","last_fullsized":"2024-06-02T23:57:58.169787+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:27:44.700493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272537+0000","last_change":"2024-06-02T23:57:15.328944+0000","last_active":"2024-06-02T23:58:55.272537+0000","last_peered":"2024-06-02T23:58:55.272537+0000","last_clean":"2024-06-02T23:58:55.272537+0000","last_became_active":"2024-06-02T23:57:15.328531+0000","last_became_peered":"2024-06-02T23:57:15.328531+0000","last_unstale":"2024-06-02T23:58:55.272537+0000","last_undegraded":"2024-06-02T23:58:55.272537+0000","last_fullsized":"2024-06-02T23:58:55.272537+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:48:19.709989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528536+0000","last_change":"2024-06-02T23:57:12.153967+0000","last_active":"2024-06-02T23:57:56.528536+0000","last_peered":"2024-06-02T23:57:56.528536+0000","last_clean":"2024-06-02T23:57:56.528536+0000","last_became_active":"2024-06-02T23:57:12.153600+0000","last_became_peered":"2024-06-02T23:57:12.153600+0000","last_unstale":"2024-06-02T23:57:56.528536+0000","last_undegraded":"2024-06-02T23:57:56.528536+0000","last_fullsized":"2024-06-02T23:57:56.528536+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:47:58.761573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267401+0000","last_change":"2024-06-02T23:57:15.318089+0000","last_active":"2024-06-02T23:58:55.267401+0000","last_peered":"2024-06-02T23:58:55.267401+0000","last_clean":"2024-06-02T23:58:55.267401+0000","last_became_active":"2024-06-02T23:57:15.316494+0000","last_became_peered":"2024-06-02T23:57:15.316494+0000","last_unstale":"2024-06-02T23:58:55.267401+0000","last_undegraded":"2024-06-02T23:58:55.267401+0000","last_fullsized":"2024-06-02T23:58:55.267401+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:21:15.839255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"90'7","reported_seq":214,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:27.400352+0000","last_change":"2024-06-02T23:57:12.153624+0000","last_active":"2024-06-03T00:00:27.400352+0000","last_peered":"2024-06-03T00:00:27.400352+0000","last_clean":"2024-06-03T00:00:27.400352+0000","last_became_active":"2024-06-02T23:57:12.152712+0000","last_became_peered":"2024-06-02T23:57:12.152712+0000","last_unstale":"2024-06-03T00:00:27.400352+0000","last_undegraded":"2024-06-03T00:00:27.400352+0000","last_fullsized":"2024-06-03T00:00:27.400352+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:14:50.236213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":180,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259432+0000","last_change":"2024-06-02T23:57:15.325293+0000","last_active":"2024-06-02T23:58:55.259432+0000","last_peered":"2024-06-02T23:58:55.259432+0000","last_clean":"2024-06-02T23:58:55.259432+0000","last_became_active":"2024-06-02T23:57:15.324967+0000","last_became_peered":"2024-06-02T23:57:15.324967+0000","last_unstale":"2024-06-02T23:58:55.259432+0000","last_undegraded":"2024-06-02T23:58:55.259432+0000","last_fullsized":"2024-06-02T23:58:55.259432+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:21:23.634118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.735981+0000","last_change":"2024-06-02T23:57:12.155927+0000","last_active":"2024-06-02T23:57:56.735981+0000","last_peered":"2024-06-02T23:57:56.735981+0000","last_clean":"2024-06-02T23:57:56.735981+0000","last_became_active":"2024-06-02T23:57:12.155505+0000","last_became_peered":"2024-06-02T23:57:12.155505+0000","last_unstale":"2024-06-02T23:57:56.735981+0000","last_undegraded":"2024-06-02T23:57:56.735981+0000","last_fullsized":"2024-06-02T23:57:56.735981+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:47.555747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262458+0000","last_change":"2024-06-02T23:57:15.321796+0000","last_active":"2024-06-02T23:58:55.262458+0000","last_peered":"2024-06-02T23:58:55.262458+0000","last_clean":"2024-06-02T23:58:55.262458+0000","last_became_active":"2024-06-02T23:57:15.320850+0000","last_became_peered":"2024-06-02T23:57:15.320850+0000","last_unstale":"2024-06-02T23:58:55.262458+0000","last_undegraded":"2024-06-02T23:58:55.262458+0000","last_fullsized":"2024-06-02T23:58:55.262458+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:04:10.991920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.523859+0000","last_change":"2024-06-02T23:57:12.146589+0000","last_active":"2024-06-02T23:57:56.523859+0000","last_peered":"2024-06-02T23:57:56.523859+0000","last_clean":"2024-06-02T23:57:56.523859+0000","last_became_active":"2024-06-02T23:57:12.146224+0000","last_became_peered":"2024-06-02T23:57:12.146224+0000","last_unstale":"2024-06-02T23:57:56.523859+0000","last_undegraded":"2024-06-02T23:57:56.523859+0000","last_fullsized":"2024-06-02T23:57:56.523859+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:17:31.250585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268843+0000","last_change":"2024-06-02T23:57:15.315553+0000","last_active":"2024-06-02T23:58:55.268843+0000","last_peered":"2024-06-02T23:58:55.268843+0000","last_clean":"2024-06-02T23:58:55.268843+0000","last_became_active":"2024-06-02T23:57:15.315217+0000","last_became_peered":"2024-06-02T23:57:15.315217+0000","last_unstale":"2024-06-02T23:58:55.268843+0000","last_undegraded":"2024-06-02T23:58:55.268843+0000","last_fullsized":"2024-06-02T23:58:55.268843+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:00:23.097949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.525158+0000","last_change":"2024-06-02T23:57:12.156971+0000","last_active":"2024-06-02T23:57:56.525158+0000","last_peered":"2024-06-02T23:57:56.525158+0000","last_clean":"2024-06-02T23:57:56.525158+0000","last_became_active":"2024-06-02T23:57:12.156379+0000","last_became_peered":"2024-06-02T23:57:12.156379+0000","last_unstale":"2024-06-02T23:57:56.525158+0000","last_undegraded":"2024-06-02T23:57:56.525158+0000","last_fullsized":"2024-06-02T23:57:56.525158+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:28:50.057736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.266692+0000","last_change":"2024-06-02T23:57:15.313985+0000","last_active":"2024-06-02T23:58:55.266692+0000","last_peered":"2024-06-02T23:58:55.266692+0000","last_clean":"2024-06-02T23:58:55.266692+0000","last_became_active":"2024-06-02T23:57:15.313668+0000","last_became_peered":"2024-06-02T23:57:15.313668+0000","last_unstale":"2024-06-02T23:58:55.266692+0000","last_undegraded":"2024-06-02T23:58:55.266692+0000","last_fullsized":"2024-06-02T23:58:55.266692+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:10:56.560660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"90'5","reported_seq":380,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:26.397977+0000","last_change":"2024-06-02T23:57:12.156025+0000","last_active":"2024-06-03T00:00:26.397977+0000","last_peered":"2024-06-03T00:00:26.397977+0000","last_clean":"2024-06-03T00:00:26.397977+0000","last_became_active":"2024-06-02T23:57:12.155609+0000","last_became_peered":"2024-06-02T23:57:12.155609+0000","last_unstale":"2024-06-03T00:00:26.397977+0000","last_undegraded":"2024-06-03T00:00:26.397977+0000","last_fullsized":"2024-06-03T00:00:26.397977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:27:48.953456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":348,"num_read_kb":348,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272606+0000","last_change":"2024-06-02T23:57:15.329711+0000","last_active":"2024-06-02T23:58:55.272606+0000","last_peered":"2024-06-02T23:58:55.272606+0000","last_clean":"2024-06-02T23:58:55.272606+0000","last_became_active":"2024-06-02T23:57:15.329284+0000","last_became_peered":"2024-06-02T23:57:15.329284+0000","last_unstale":"2024-06-02T23:58:55.272606+0000","last_undegraded":"2024-06-02T23:58:55.272606+0000","last_fullsized":"2024-06-02T23:58:55.272606+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:58:06.165152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.529073+0000","last_change":"2024-06-02T23:57:12.156949+0000","last_active":"2024-06-02T23:57:56.529073+0000","last_peered":"2024-06-02T23:57:56.529073+0000","last_clean":"2024-06-02T23:57:56.529073+0000","last_became_active":"2024-06-02T23:57:12.156558+0000","last_became_peered":"2024-06-02T23:57:12.156558+0000","last_unstale":"2024-06-02T23:57:56.529073+0000","last_undegraded":"2024-06-02T23:57:56.529073+0000","last_fullsized":"2024-06-02T23:57:56.529073+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:05:57.658900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273919+0000","last_change":"2024-06-02T23:57:15.318638+0000","last_active":"2024-06-02T23:58:55.273919+0000","last_peered":"2024-06-02T23:58:55.273919+0000","last_clean":"2024-06-02T23:58:55.273919+0000","last_became_active":"2024-06-02T23:57:15.318321+0000","last_became_peered":"2024-06-02T23:57:15.318321+0000","last_unstale":"2024-06-02T23:58:55.273919+0000","last_undegraded":"2024-06-02T23:58:55.273919+0000","last_fullsized":"2024-06-02T23:58:55.273919+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:21:57.877235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526151+0000","last_change":"2024-06-02T23:57:12.306278+0000","last_active":"2024-06-02T23:57:56.526151+0000","last_peered":"2024-06-02T23:57:56.526151+0000","last_clean":"2024-06-02T23:57:56.526151+0000","last_became_active":"2024-06-02T23:57:12.305885+0000","last_became_peered":"2024-06-02T23:57:12.305885+0000","last_unstale":"2024-06-02T23:57:56.526151+0000","last_undegraded":"2024-06-02T23:57:56.526151+0000","last_fullsized":"2024-06-02T23:57:56.526151+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:05:07.723501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.266773+0000","last_change":"2024-06-02T23:57:15.322489+0000","last_active":"2024-06-02T23:58:55.266773+0000","last_peered":"2024-06-02T23:58:55.266773+0000","last_clean":"2024-06-02T23:58:55.266773+0000","last_became_active":"2024-06-02T23:57:15.322131+0000","last_became_peered":"2024-06-02T23:57:15.322131+0000","last_unstale":"2024-06-02T23:58:55.266773+0000","last_undegraded":"2024-06-02T23:58:55.266773+0000","last_fullsized":"2024-06-02T23:58:55.266773+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:34:43.362338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"90'38","reported_seq":426,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:26.398377+0000","last_change":"2024-06-02T23:57:12.156920+0000","last_active":"2024-06-03T00:00:26.398377+0000","last_peered":"2024-06-03T00:00:26.398377+0000","last_clean":"2024-06-03T00:00:26.398377+0000","last_became_active":"2024-06-02T23:57:12.156494+0000","last_became_peered":"2024-06-02T23:57:12.156494+0000","last_unstale":"2024-06-03T00:00:26.398377+0000","last_undegraded":"2024-06-03T00:00:26.398377+0000","last_fullsized":"2024-06-03T00:00:26.398377+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:49:56.458730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62864,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":361,"num_read_kb":242,"num_write":40,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265549+0000","last_change":"2024-06-02T23:57:15.328502+0000","last_active":"2024-06-02T23:58:55.265549+0000","last_peered":"2024-06-02T23:58:55.265549+0000","last_clean":"2024-06-02T23:58:55.265549+0000","last_became_active":"2024-06-02T23:57:15.328174+0000","last_became_peered":"2024-06-02T23:57:15.328174+0000","last_unstale":"2024-06-02T23:58:55.265549+0000","last_undegraded":"2024-06-02T23:58:55.265549+0000","last_fullsized":"2024-06-02T23:58:55.265549+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:58:33.355397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527385+0000","last_change":"2024-06-02T23:57:12.154204+0000","last_active":"2024-06-02T23:57:56.527385+0000","last_peered":"2024-06-02T23:57:56.527385+0000","last_clean":"2024-06-02T23:57:56.527385+0000","last_became_active":"2024-06-02T23:57:12.153412+0000","last_became_peered":"2024-06-02T23:57:12.153412+0000","last_unstale":"2024-06-02T23:57:56.527385+0000","last_undegraded":"2024-06-02T23:57:56.527385+0000","last_fullsized":"2024-06-02T23:57:56.527385+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:15.472279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262255+0000","last_change":"2024-06-02T23:57:15.314274+0000","last_active":"2024-06-02T23:58:55.262255+0000","last_peered":"2024-06-02T23:58:55.262255+0000","last_clean":"2024-06-02T23:58:55.262255+0000","last_became_active":"2024-06-02T23:57:15.313946+0000","last_became_peered":"2024-06-02T23:57:15.313946+0000","last_unstale":"2024-06-02T23:58:55.262255+0000","last_undegraded":"2024-06-02T23:58:55.262255+0000","last_fullsized":"2024-06-02T23:58:55.262255+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:07.909977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.525241+0000","last_change":"2024-06-02T23:57:12.156767+0000","last_active":"2024-06-02T23:57:56.525241+0000","last_peered":"2024-06-02T23:57:56.525241+0000","last_clean":"2024-06-02T23:57:56.525241+0000","last_became_active":"2024-06-02T23:57:12.156346+0000","last_became_peered":"2024-06-02T23:57:12.156346+0000","last_unstale":"2024-06-02T23:57:56.525241+0000","last_undegraded":"2024-06-02T23:57:56.525241+0000","last_fullsized":"2024-06-02T23:57:56.525241+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:29:45.801904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267668+0000","last_change":"2024-06-02T23:57:15.322676+0000","last_active":"2024-06-02T23:58:55.267668+0000","last_peered":"2024-06-02T23:58:55.267668+0000","last_clean":"2024-06-02T23:58:55.267668+0000","last_became_active":"2024-06-02T23:57:15.319429+0000","last_became_peered":"2024-06-02T23:57:15.319429+0000","last_unstale":"2024-06-02T23:58:55.267668+0000","last_undegraded":"2024-06-02T23:58:55.267668+0000","last_fullsized":"2024-06-02T23:58:55.267668+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:48:15.984818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'6","reported_seq":212,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:27.440240+0000","last_change":"2024-06-02T23:57:12.153925+0000","last_active":"2024-06-03T00:00:27.440240+0000","last_peered":"2024-06-03T00:00:27.440240+0000","last_clean":"2024-06-03T00:00:27.440240+0000","last_became_active":"2024-06-02T23:57:12.152990+0000","last_became_peered":"2024-06-02T23:57:12.152990+0000","last_unstale":"2024-06-03T00:00:27.440240+0000","last_undegraded":"2024-06-03T00:00:27.440240+0000","last_fullsized":"2024-06-03T00:00:27.440240+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:32:21.845946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":896,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":180,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.270077+0000","last_change":"2024-06-02T23:57:15.327662+0000","last_active":"2024-06-02T23:58:55.270077+0000","last_peered":"2024-06-02T23:58:55.270077+0000","last_clean":"2024-06-02T23:58:55.270077+0000","last_became_active":"2024-06-02T23:57:15.327320+0000","last_became_peered":"2024-06-02T23:57:15.327320+0000","last_unstale":"2024-06-02T23:58:55.270077+0000","last_undegraded":"2024-06-02T23:58:55.270077+0000","last_fullsized":"2024-06-02T23:58:55.270077+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:44:37.561533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528426+0000","last_change":"2024-06-02T23:57:12.306856+0000","last_active":"2024-06-02T23:57:56.528426+0000","last_peered":"2024-06-02T23:57:56.528426+0000","last_clean":"2024-06-02T23:57:56.528426+0000","last_became_active":"2024-06-02T23:57:12.306476+0000","last_became_peered":"2024-06-02T23:57:12.306476+0000","last_unstale":"2024-06-02T23:57:56.528426+0000","last_undegraded":"2024-06-02T23:57:56.528426+0000","last_fullsized":"2024-06-02T23:57:56.528426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:30:22.839589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.266843+0000","last_change":"2024-06-02T23:57:56.890015+0000","last_active":"2024-06-02T23:58:55.266843+0000","last_peered":"2024-06-02T23:58:55.266843+0000","last_clean":"2024-06-02T23:58:55.266843+0000","last_became_active":"2024-06-02T23:57:56.889591+0000","last_became_peered":"2024-06-02T23:57:56.889591+0000","last_unstale":"2024-06-02T23:58:55.266843+0000","last_undegraded":"2024-06-02T23:58:55.266843+0000","last_fullsized":"2024-06-02T23:58:55.266843+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:14:37.851207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'3","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:59:28.633344+0000","last_change":"2024-06-02T23:57:12.146690+0000","last_active":"2024-06-02T23:59:28.633344+0000","last_peered":"2024-06-02T23:59:28.633344+0000","last_clean":"2024-06-02T23:59:28.633344+0000","last_became_active":"2024-06-02T23:57:12.146372+0000","last_became_peered":"2024-06-02T23:57:12.146372+0000","last_unstale":"2024-06-02T23:59:28.633344+0000","last_undegraded":"2024-06-02T23:59:28.633344+0000","last_fullsized":"2024-06-02T23:59:28.633344+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:45:04.421365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267278+0000","last_change":"2024-06-02T23:57:15.320938+0000","last_active":"2024-06-02T23:58:55.267278+0000","last_peered":"2024-06-02T23:58:55.267278+0000","last_clean":"2024-06-02T23:58:55.267278+0000","last_became_active":"2024-06-02T23:57:15.320567+0000","last_became_peered":"2024-06-02T23:57:15.320567+0000","last_unstale":"2024-06-02T23:58:55.267278+0000","last_undegraded":"2024-06-02T23:58:55.267278+0000","last_fullsized":"2024-06-02T23:58:55.267278+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:04:29.736387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"88'1","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527764+0000","last_change":"2024-06-02T23:57:12.307020+0000","last_active":"2024-06-02T23:57:56.527764+0000","last_peered":"2024-06-02T23:57:56.527764+0000","last_clean":"2024-06-02T23:57:56.527764+0000","last_became_active":"2024-06-02T23:57:12.306650+0000","last_became_peered":"2024-06-02T23:57:12.306650+0000","last_unstale":"2024-06-02T23:57:56.527764+0000","last_undegraded":"2024-06-02T23:57:56.527764+0000","last_fullsized":"2024-06-02T23:57:56.527764+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:18:03.679704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265006+0000","last_change":"2024-06-02T23:57:15.319300+0000","last_active":"2024-06-02T23:58:55.265006+0000","last_peered":"2024-06-02T23:58:55.265006+0000","last_clean":"2024-06-02T23:58:55.265006+0000","last_became_active":"2024-06-02T23:57:15.318903+0000","last_became_peered":"2024-06-02T23:57:15.318903+0000","last_unstale":"2024-06-02T23:58:55.265006+0000","last_undegraded":"2024-06-02T23:58:55.265006+0000","last_fullsized":"2024-06-02T23:58:55.265006+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:38:25.521337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":210,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:28.408443+0000","last_change":"2024-06-02T23:57:12.155260+0000","last_active":"2024-06-03T00:00:28.408443+0000","last_peered":"2024-06-03T00:00:28.408443+0000","last_clean":"2024-06-03T00:00:28.408443+0000","last_became_active":"2024-06-02T23:57:12.154884+0000","last_became_peered":"2024-06-02T23:57:12.154884+0000","last_unstale":"2024-06-03T00:00:28.408443+0000","last_undegraded":"2024-06-03T00:00:28.408443+0000","last_fullsized":"2024-06-03T00:00:28.408443+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:34:52.390752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.269861+0000","last_change":"2024-06-02T23:57:15.323490+0000","last_active":"2024-06-02T23:58:55.269861+0000","last_peered":"2024-06-02T23:58:55.269861+0000","last_clean":"2024-06-02T23:58:55.269861+0000","last_became_active":"2024-06-02T23:57:15.323142+0000","last_became_peered":"2024-06-02T23:57:15.323142+0000","last_unstale":"2024-06-02T23:58:55.269861+0000","last_undegraded":"2024-06-02T23:58:55.269861+0000","last_fullsized":"2024-06-02T23:58:55.269861+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:32:32.445823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.261770+0000","last_change":"2024-06-02T23:57:56.531715+0000","last_active":"2024-06-02T23:58:55.261770+0000","last_peered":"2024-06-02T23:58:55.261770+0000","last_clean":"2024-06-02T23:58:55.261770+0000","last_became_active":"2024-06-02T23:57:56.531304+0000","last_became_peered":"2024-06-02T23:57:56.531304+0000","last_unstale":"2024-06-02T23:58:55.261770+0000","last_undegraded":"2024-06-02T23:58:55.261770+0000","last_fullsized":"2024-06-02T23:58:55.261770+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:58:02.532206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'6","reported_seq":210,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:27.439664+0000","last_change":"2024-06-02T23:57:12.305475+0000","last_active":"2024-06-03T00:00:27.439664+0000","last_peered":"2024-06-03T00:00:27.439664+0000","last_clean":"2024-06-03T00:00:27.439664+0000","last_became_active":"2024-06-02T23:57:12.305071+0000","last_became_peered":"2024-06-02T23:57:12.305071+0000","last_unstale":"2024-06-03T00:00:27.439664+0000","last_undegraded":"2024-06-03T00:00:27.439664+0000","last_fullsized":"2024-06-03T00:00:27.439664+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:08:29.024447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":177,"num_read_kb":177,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.264368+0000","last_change":"2024-06-02T23:57:15.308629+0000","last_active":"2024-06-02T23:58:55.264368+0000","last_peered":"2024-06-02T23:58:55.264368+0000","last_clean":"2024-06-02T23:58:55.264368+0000","last_became_active":"2024-06-02T23:57:15.307981+0000","last_became_peered":"2024-06-02T23:57:15.307981+0000","last_unstale":"2024-06-02T23:58:55.264368+0000","last_undegraded":"2024-06-02T23:58:55.264368+0000","last_fullsized":"2024-06-02T23:58:55.264368+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:14:22.446599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.652578+0000","last_change":"2024-06-02T23:57:12.155968+0000","last_active":"2024-06-02T23:57:56.652578+0000","last_peered":"2024-06-02T23:57:56.652578+0000","last_clean":"2024-06-02T23:57:56.652578+0000","last_became_active":"2024-06-02T23:57:12.155521+0000","last_became_peered":"2024-06-02T23:57:12.155521+0000","last_unstale":"2024-06-02T23:57:56.652578+0000","last_undegraded":"2024-06-02T23:57:56.652578+0000","last_fullsized":"2024-06-02T23:57:56.652578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:45:00.397317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":349,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528775+0000","last_change":"2024-06-02T23:55:50.081978+0000","last_active":"2024-06-02T23:57:56.528775+0000","last_peered":"2024-06-02T23:57:56.528775+0000","last_clean":"2024-06-02T23:57:56.528775+0000","last_became_active":"2024-06-02T23:55:50.081431+0000","last_became_peered":"2024-06-02T23:55:50.081431+0000","last_unstale":"2024-06-02T23:57:56.528775+0000","last_undegraded":"2024-06-02T23:57:56.528775+0000","last_fullsized":"2024-06-02T23:57:56.528775+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:52:23.676206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:52:23.676206+0000","last_clean_scrub_stamp":"2024-06-02T23:52:23.676206+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:29:59.979935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262458+0000","last_change":"2024-06-02T23:57:56.529633+0000","last_active":"2024-06-02T23:58:55.262458+0000","last_peered":"2024-06-02T23:58:55.262458+0000","last_clean":"2024-06-02T23:58:55.262458+0000","last_became_active":"2024-06-02T23:57:56.529210+0000","last_became_peered":"2024-06-02T23:57:56.529210+0000","last_unstale":"2024-06-02T23:58:55.262458+0000","last_undegraded":"2024-06-02T23:58:55.262458+0000","last_fullsized":"2024-06-02T23:58:55.262458+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:51:31.807162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.529339+0000","last_change":"2024-06-02T23:57:12.155897+0000","last_active":"2024-06-02T23:57:56.529339+0000","last_peered":"2024-06-02T23:57:56.529339+0000","last_clean":"2024-06-02T23:57:56.529339+0000","last_became_active":"2024-06-02T23:57:12.155461+0000","last_became_peered":"2024-06-02T23:57:12.155461+0000","last_unstale":"2024-06-02T23:57:56.529339+0000","last_undegraded":"2024-06-02T23:57:56.529339+0000","last_fullsized":"2024-06-02T23:57:56.529339+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:19:22.104104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528035+0000","last_change":"2024-06-02T23:57:12.306363+0000","last_active":"2024-06-02T23:57:56.528035+0000","last_peered":"2024-06-02T23:57:56.528035+0000","last_clean":"2024-06-02T23:57:56.528035+0000","last_became_active":"2024-06-02T23:57:12.305920+0000","last_became_peered":"2024-06-02T23:57:12.305920+0000","last_unstale":"2024-06-02T23:57:56.528035+0000","last_undegraded":"2024-06-02T23:57:56.528035+0000","last_fullsized":"2024-06-02T23:57:56.528035+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:31:01.787879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262436+0000","last_change":"2024-06-02T23:57:15.316038+0000","last_active":"2024-06-02T23:58:55.262436+0000","last_peered":"2024-06-02T23:58:55.262436+0000","last_clean":"2024-06-02T23:58:55.262436+0000","last_became_active":"2024-06-02T23:57:15.315715+0000","last_became_peered":"2024-06-02T23:57:15.315715+0000","last_unstale":"2024-06-02T23:58:55.262436+0000","last_undegraded":"2024-06-02T23:58:55.262436+0000","last_fullsized":"2024-06-02T23:58:55.262436+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:34:36.014251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"90'18","reported_seq":60,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:59:25.049042+0000","last_change":"2024-06-02T23:57:56.539596+0000","last_active":"2024-06-02T23:59:25.049042+0000","last_peered":"2024-06-02T23:59:25.049042+0000","last_clean":"2024-06-02T23:59:25.049042+0000","last_became_active":"2024-06-02T23:57:56.532686+0000","last_became_peered":"2024-06-02T23:57:56.532686+0000","last_unstale":"2024-06-02T23:59:25.049042+0000","last_undegraded":"2024-06-02T23:59:25.049042+0000","last_fullsized":"2024-06-02T23:59:25.049042+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:29:24.691941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267369+0000","last_change":"2024-06-02T23:57:15.315657+0000","last_active":"2024-06-02T23:58:55.267369+0000","last_peered":"2024-06-02T23:58:55.267369+0000","last_clean":"2024-06-02T23:58:55.267369+0000","last_became_active":"2024-06-02T23:57:15.315293+0000","last_became_peered":"2024-06-02T23:57:15.315293+0000","last_unstale":"2024-06-02T23:58:55.267369+0000","last_undegraded":"2024-06-02T23:58:55.267369+0000","last_fullsized":"2024-06-02T23:58:55.267369+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:52:55.241379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.652229+0000","last_change":"2024-06-02T23:57:12.405664+0000","last_active":"2024-06-02T23:57:56.652229+0000","last_peered":"2024-06-02T23:57:56.652229+0000","last_clean":"2024-06-02T23:57:56.652229+0000","last_became_active":"2024-06-02T23:57:12.405281+0000","last_became_peered":"2024-06-02T23:57:12.405281+0000","last_unstale":"2024-06-02T23:57:56.652229+0000","last_undegraded":"2024-06-02T23:57:56.652229+0000","last_fullsized":"2024-06-02T23:57:56.652229+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:46:50.119466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273696+0000","last_change":"2024-06-02T23:57:15.318136+0000","last_active":"2024-06-02T23:58:55.273696+0000","last_peered":"2024-06-02T23:58:55.273696+0000","last_clean":"2024-06-02T23:58:55.273696+0000","last_became_active":"2024-06-02T23:57:15.317753+0000","last_became_peered":"2024-06-02T23:57:15.317753+0000","last_unstale":"2024-06-02T23:58:55.273696+0000","last_undegraded":"2024-06-02T23:58:55.273696+0000","last_fullsized":"2024-06-02T23:58:55.273696+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:35:11.025266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.887947+0000","last_change":"2024-06-02T23:57:12.305954+0000","last_active":"2024-06-02T23:57:56.887947+0000","last_peered":"2024-06-02T23:57:56.887947+0000","last_clean":"2024-06-02T23:57:56.887947+0000","last_became_active":"2024-06-02T23:57:12.305589+0000","last_became_peered":"2024-06-02T23:57:12.305589+0000","last_unstale":"2024-06-02T23:57:56.887947+0000","last_undegraded":"2024-06-02T23:57:56.887947+0000","last_fullsized":"2024-06-02T23:57:56.887947+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:34:34.178446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.243742+0000","last_change":"2024-06-02T23:57:15.327115+0000","last_active":"2024-06-02T23:58:55.243742+0000","last_peered":"2024-06-02T23:58:55.243742+0000","last_clean":"2024-06-02T23:58:55.243742+0000","last_became_active":"2024-06-02T23:57:15.326746+0000","last_became_peered":"2024-06-02T23:57:15.326746+0000","last_unstale":"2024-06-02T23:58:55.243742+0000","last_undegraded":"2024-06-02T23:58:55.243742+0000","last_fullsized":"2024-06-02T23:58:55.243742+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:08:04.340517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526250+0000","last_change":"2024-06-02T23:57:12.152933+0000","last_active":"2024-06-02T23:57:56.526250+0000","last_peered":"2024-06-02T23:57:56.526250+0000","last_clean":"2024-06-02T23:57:56.526250+0000","last_became_active":"2024-06-02T23:57:12.152453+0000","last_became_peered":"2024-06-02T23:57:12.152453+0000","last_unstale":"2024-06-02T23:57:56.526250+0000","last_undegraded":"2024-06-02T23:57:56.526250+0000","last_fullsized":"2024-06-02T23:57:56.526250+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:47:05.144374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272469+0000","last_change":"2024-06-02T23:57:15.326042+0000","last_active":"2024-06-02T23:58:55.272469+0000","last_peered":"2024-06-02T23:58:55.272469+0000","last_clean":"2024-06-02T23:58:55.272469+0000","last_became_active":"2024-06-02T23:57:15.325585+0000","last_became_peered":"2024-06-02T23:57:15.325585+0000","last_unstale":"2024-06-02T23:58:55.272469+0000","last_undegraded":"2024-06-02T23:58:55.272469+0000","last_fullsized":"2024-06-02T23:58:55.272469+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:40:37.305875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"88'3","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527211+0000","last_change":"2024-06-02T23:57:12.139155+0000","last_active":"2024-06-02T23:57:56.527211+0000","last_peered":"2024-06-02T23:57:56.527211+0000","last_clean":"2024-06-02T23:57:56.527211+0000","last_became_active":"2024-06-02T23:57:12.138732+0000","last_became_peered":"2024-06-02T23:57:12.138732+0000","last_unstale":"2024-06-02T23:57:56.527211+0000","last_undegraded":"2024-06-02T23:57:56.527211+0000","last_fullsized":"2024-06-02T23:57:56.527211+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:18:29.148439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265509+0000","last_change":"2024-06-02T23:57:15.319510+0000","last_active":"2024-06-02T23:58:55.265509+0000","last_peered":"2024-06-02T23:58:55.265509+0000","last_clean":"2024-06-02T23:58:55.265509+0000","last_became_active":"2024-06-02T23:57:15.319192+0000","last_became_peered":"2024-06-02T23:57:15.319192+0000","last_unstale":"2024-06-02T23:58:55.265509+0000","last_undegraded":"2024-06-02T23:58:55.265509+0000","last_fullsized":"2024-06-02T23:58:55.265509+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:04:04.241833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.658192+0000","last_change":"2024-06-02T23:57:56.657766+0000","last_active":"2024-06-02T23:57:56.658192+0000","last_peered":"2024-06-02T23:57:56.658192+0000","last_clean":"2024-06-02T23:57:56.658192+0000","last_became_active":"2024-06-02T23:57:56.653435+0000","last_became_peered":"2024-06-02T23:57:56.653435+0000","last_unstale":"2024-06-02T23:57:56.658192+0000","last_undegraded":"2024-06-02T23:57:56.658192+0000","last_fullsized":"2024-06-02T23:57:56.658192+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:03:23.594470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273925+0000","last_change":"2024-06-02T23:57:15.320837+0000","last_active":"2024-06-02T23:58:55.273925+0000","last_peered":"2024-06-02T23:58:55.273925+0000","last_clean":"2024-06-02T23:58:55.273925+0000","last_became_active":"2024-06-02T23:57:15.320257+0000","last_became_peered":"2024-06-02T23:57:15.320257+0000","last_unstale":"2024-06-02T23:58:55.273925+0000","last_undegraded":"2024-06-02T23:58:55.273925+0000","last_fullsized":"2024-06-02T23:58:55.273925+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:18:29.638614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'5","reported_seq":209,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:26.398559+0000","last_change":"2024-06-02T23:57:12.405175+0000","last_active":"2024-06-03T00:00:26.398559+0000","last_peered":"2024-06-03T00:00:26.398559+0000","last_clean":"2024-06-03T00:00:26.398559+0000","last_became_active":"2024-06-02T23:57:12.404767+0000","last_became_peered":"2024-06-02T23:57:12.404767+0000","last_unstale":"2024-06-03T00:00:26.398559+0000","last_undegraded":"2024-06-03T00:00:26.398559+0000","last_fullsized":"2024-06-03T00:00:26.398559+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:46:57.421288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":177,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273764+0000","last_change":"2024-06-02T23:57:15.322888+0000","last_active":"2024-06-02T23:58:55.273764+0000","last_peered":"2024-06-02T23:58:55.273764+0000","last_clean":"2024-06-02T23:58:55.273764+0000","last_became_active":"2024-06-02T23:57:15.321982+0000","last_became_peered":"2024-06-02T23:57:15.321982+0000","last_unstale":"2024-06-02T23:58:55.273764+0000","last_undegraded":"2024-06-02T23:58:55.273764+0000","last_fullsized":"2024-06-02T23:58:55.273764+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:51:57.253824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526189+0000","last_change":"2024-06-02T23:57:12.153715+0000","last_active":"2024-06-02T23:57:56.526189+0000","last_peered":"2024-06-02T23:57:56.526189+0000","last_clean":"2024-06-02T23:57:56.526189+0000","last_became_active":"2024-06-02T23:57:12.152544+0000","last_became_peered":"2024-06-02T23:57:12.152544+0000","last_unstale":"2024-06-02T23:57:56.526189+0000","last_undegraded":"2024-06-02T23:57:56.526189+0000","last_fullsized":"2024-06-02T23:57:56.526189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:51:05.874962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.271354+0000","last_change":"2024-06-02T23:57:15.318759+0000","last_active":"2024-06-02T23:58:55.271354+0000","last_peered":"2024-06-02T23:58:55.271354+0000","last_clean":"2024-06-02T23:58:55.271354+0000","last_became_active":"2024-06-02T23:57:15.317942+0000","last_became_peered":"2024-06-02T23:57:15.317942+0000","last_unstale":"2024-06-02T23:58:55.271354+0000","last_undegraded":"2024-06-02T23:58:55.271354+0000","last_fullsized":"2024-06-02T23:58:55.271354+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:39:44.142890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.894529+0000","last_change":"2024-06-02T23:57:56.894131+0000","last_active":"2024-06-02T23:57:56.894529+0000","last_peered":"2024-06-02T23:57:56.894529+0000","last_clean":"2024-06-02T23:57:56.894529+0000","last_became_active":"2024-06-02T23:57:56.889794+0000","last_became_peered":"2024-06-02T23:57:56.889794+0000","last_unstale":"2024-06-02T23:57:56.894529+0000","last_undegraded":"2024-06-02T23:57:56.894529+0000","last_fullsized":"2024-06-02T23:57:56.894529+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:02:41.670419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.266582+0000","last_change":"2024-06-02T23:57:15.324355+0000","last_active":"2024-06-02T23:58:55.266582+0000","last_peered":"2024-06-02T23:58:55.266582+0000","last_clean":"2024-06-02T23:58:55.266582+0000","last_became_active":"2024-06-02T23:57:15.324019+0000","last_became_peered":"2024-06-02T23:57:15.324019+0000","last_unstale":"2024-06-02T23:58:55.266582+0000","last_undegraded":"2024-06-02T23:58:55.266582+0000","last_fullsized":"2024-06-02T23:58:55.266582+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:27:01.927109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267246+0000","last_change":"2024-06-02T23:57:15.326420+0000","last_active":"2024-06-02T23:58:55.267246+0000","last_peered":"2024-06-02T23:58:55.267246+0000","last_clean":"2024-06-02T23:58:55.267246+0000","last_became_active":"2024-06-02T23:57:15.326091+0000","last_became_peered":"2024-06-02T23:57:15.326091+0000","last_unstale":"2024-06-02T23:58:55.267246+0000","last_undegraded":"2024-06-02T23:58:55.267246+0000","last_fullsized":"2024-06-02T23:58:55.267246+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:54:05.355352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.252717+0000","last_change":"2024-06-02T23:57:56.653297+0000","last_active":"2024-06-02T23:58:55.252717+0000","last_peered":"2024-06-02T23:58:55.252717+0000","last_clean":"2024-06-02T23:58:55.252717+0000","last_became_active":"2024-06-02T23:57:56.652874+0000","last_became_peered":"2024-06-02T23:57:56.652874+0000","last_unstale":"2024-06-02T23:58:55.252717+0000","last_undegraded":"2024-06-02T23:58:55.252717+0000","last_fullsized":"2024-06-02T23:58:55.252717+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:27:55.486382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.260044+0000","last_change":"2024-06-02T23:57:15.319266+0000","last_active":"2024-06-02T23:58:55.260044+0000","last_peered":"2024-06-02T23:58:55.260044+0000","last_clean":"2024-06-02T23:58:55.260044+0000","last_became_active":"2024-06-02T23:57:15.317468+0000","last_became_peered":"2024-06-02T23:57:15.317468+0000","last_unstale":"2024-06-02T23:58:55.260044+0000","last_undegraded":"2024-06-02T23:58:55.260044+0000","last_fullsized":"2024-06-02T23:58:55.260044+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:49:53.675524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273976+0000","last_change":"2024-06-02T23:57:15.315798+0000","last_active":"2024-06-02T23:58:55.273976+0000","last_peered":"2024-06-02T23:58:55.273976+0000","last_clean":"2024-06-02T23:58:55.273976+0000","last_became_active":"2024-06-02T23:57:15.314886+0000","last_became_peered":"2024-06-02T23:57:15.314886+0000","last_unstale":"2024-06-02T23:58:55.273976+0000","last_undegraded":"2024-06-02T23:58:55.273976+0000","last_fullsized":"2024-06-02T23:58:55.273976+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:23.042226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259255+0000","last_change":"2024-06-02T23:57:15.315081+0000","last_active":"2024-06-02T23:58:55.259255+0000","last_peered":"2024-06-02T23:58:55.259255+0000","last_clean":"2024-06-02T23:58:55.259255+0000","last_became_active":"2024-06-02T23:57:15.314745+0000","last_became_peered":"2024-06-02T23:57:15.314745+0000","last_unstale":"2024-06-02T23:58:55.259255+0000","last_undegraded":"2024-06-02T23:58:55.259255+0000","last_fullsized":"2024-06-02T23:58:55.259255+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:17:49.506950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.261978+0000","last_change":"2024-06-02T23:57:15.323687+0000","last_active":"2024-06-02T23:58:55.261978+0000","last_peered":"2024-06-02T23:58:55.261978+0000","last_clean":"2024-06-02T23:58:55.261978+0000","last_became_active":"2024-06-02T23:57:15.323345+0000","last_became_peered":"2024-06-02T23:57:15.323345+0000","last_unstale":"2024-06-02T23:58:55.261978+0000","last_undegraded":"2024-06-02T23:58:55.261978+0000","last_fullsized":"2024-06-02T23:58:55.261978+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:47:40.234811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265429+0000","last_change":"2024-06-02T23:57:15.320632+0000","last_active":"2024-06-02T23:58:55.265429+0000","last_peered":"2024-06-02T23:58:55.265429+0000","last_clean":"2024-06-02T23:58:55.265429+0000","last_became_active":"2024-06-02T23:57:15.318427+0000","last_became_peered":"2024-06-02T23:57:15.318427+0000","last_unstale":"2024-06-02T23:58:55.265429+0000","last_undegraded":"2024-06-02T23:58:55.265429+0000","last_fullsized":"2024-06-02T23:58:55.265429+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:04:51.729326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259261+0000","last_change":"2024-06-02T23:57:15.312039+0000","last_active":"2024-06-02T23:58:55.259261+0000","last_peered":"2024-06-02T23:58:55.259261+0000","last_clean":"2024-06-02T23:58:55.259261+0000","last_became_active":"2024-06-02T23:57:15.311275+0000","last_became_peered":"2024-06-02T23:57:15.311275+0000","last_unstale":"2024-06-02T23:58:55.259261+0000","last_undegraded":"2024-06-02T23:58:55.259261+0000","last_fullsized":"2024-06-02T23:58:55.259261+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:50:25.509550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259813+0000","last_change":"2024-06-02T23:57:15.311927+0000","last_active":"2024-06-02T23:58:55.259813+0000","last_peered":"2024-06-02T23:58:55.259813+0000","last_clean":"2024-06-02T23:58:55.259813+0000","last_became_active":"2024-06-02T23:57:15.311484+0000","last_became_peered":"2024-06-02T23:57:15.311484+0000","last_unstale":"2024-06-02T23:58:55.259813+0000","last_undegraded":"2024-06-02T23:58:55.259813+0000","last_fullsized":"2024-06-02T23:58:55.259813+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:29:27.789219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268648+0000","last_change":"2024-06-02T23:57:15.321218+0000","last_active":"2024-06-02T23:58:55.268648+0000","last_peered":"2024-06-02T23:58:55.268648+0000","last_clean":"2024-06-02T23:58:55.268648+0000","last_became_active":"2024-06-02T23:57:15.320884+0000","last_became_peered":"2024-06-02T23:57:15.320884+0000","last_unstale":"2024-06-02T23:58:55.268648+0000","last_undegraded":"2024-06-02T23:58:55.268648+0000","last_fullsized":"2024-06-02T23:58:55.268648+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:57:20.583655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.270664+0000","last_change":"2024-06-02T23:57:15.315213+0000","last_active":"2024-06-02T23:58:55.270664+0000","last_peered":"2024-06-02T23:58:55.270664+0000","last_clean":"2024-06-02T23:58:55.270664+0000","last_became_active":"2024-06-02T23:57:15.314050+0000","last_became_peered":"2024-06-02T23:57:15.314050+0000","last_unstale":"2024-06-02T23:58:55.270664+0000","last_undegraded":"2024-06-02T23:58:55.270664+0000","last_fullsized":"2024-06-02T23:58:55.270664+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:35.214351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265435+0000","last_change":"2024-06-02T23:57:15.313901+0000","last_active":"2024-06-02T23:58:55.265435+0000","last_peered":"2024-06-02T23:58:55.265435+0000","last_clean":"2024-06-02T23:58:55.265435+0000","last_became_active":"2024-06-02T23:57:15.313452+0000","last_became_peered":"2024-06-02T23:57:15.313452+0000","last_unstale":"2024-06-02T23:58:55.265435+0000","last_undegraded":"2024-06-02T23:58:55.265435+0000","last_fullsized":"2024-06-02T23:58:55.265435+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:41:38.366741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.263989+0000","last_change":"2024-06-02T23:57:15.323660+0000","last_active":"2024-06-02T23:58:55.263989+0000","last_peered":"2024-06-02T23:58:55.263989+0000","last_clean":"2024-06-02T23:58:55.263989+0000","last_became_active":"2024-06-02T23:57:15.323316+0000","last_became_peered":"2024-06-02T23:57:15.323316+0000","last_unstale":"2024-06-02T23:58:55.263989+0000","last_undegraded":"2024-06-02T23:58:55.263989+0000","last_fullsized":"2024-06-02T23:58:55.263989+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:33:10.245563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70125,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1797,"num_read_kb":974,"num_write":262,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":214689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383735,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":480586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645372,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28676,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716476,"statfs":{"total":95995035648,"available":95965671424,"internally_reserved":0,"allocated":1699840,"data_stored":1134787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808898,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1019904,"data_stored":480516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070534,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":480894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332171,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28592,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716560,"statfs":{"total":95995035648,"available":95965757440,"internally_reserved":0,"allocated":1613824,"data_stored":1073860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495697,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":1003520,"data_stored":480233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574954,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1073152,"data_stored":548324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738479,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40496,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704656,"statfs":{"total":95995035648,"available":95953567744,"internally_reserved":0,"allocated":1024000,"data_stored":481572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411429,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1089536,"data_stored":544761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182496,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":480058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920859,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":480402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757334,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28604,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716548,"statfs":{"total":95995035648,"available":95965745152,"internally_reserved":0,"allocated":1626112,"data_stored":1073230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-03T00:00:31.537 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-03T00:00:31.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.678+0000 7f4664389640 1 -- 172.21.15.49:0/1084263737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f465c101ad0 msgr2=0x7f465c101f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:31.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.678+0000 7f4664389640 1 --2- 172.21.15.49:0/1084263737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f465c101ad0 0x7f465c101f50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4650009900 tx=0x7f465002a410 comp rx=0 tx=0).stop 2024-06-03T00:00:31.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.678+0000 7f4664389640 1 -- 172.21.15.49:0/1084263737 shutdown_connections 2024-06-03T00:00:31.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.678+0000 7f4664389640 1 --2- 172.21.15.49:0/1084263737 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f465c102490 0x7f465c108d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:31.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.678+0000 7f4664389640 1 --2- 172.21.15.49:0/1084263737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f465c101ad0 0x7f465c101f50 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:31.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.678+0000 7f4664389640 1 --2- 172.21.15.49:0/1084263737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f465c1008e0 0x7f465c100d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:31.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.678+0000 7f4664389640 1 -- 172.21.15.49:0/1084263737 >> 172.21.15.49:0/1084263737 conn(0x7f465c0fbe50 msgr2=0x7f465c0fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:31.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.678+0000 7f4664389640 1 -- 172.21.15.49:0/1084263737 shutdown_connections 2024-06-03T00:00:31.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.678+0000 7f4664389640 1 -- 172.21.15.49:0/1084263737 wait complete. 2024-06-03T00:00:31.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.678+0000 7f4664389640 1 Processor -- start 2024-06-03T00:00:31.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.678+0000 7f4664389640 1 -- start start 2024-06-03T00:00:31.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.678+0000 7f4664389640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f465c1008e0 0x7f465c197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:31.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.678+0000 7f4664389640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f465c101ad0 0x7f465c1981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:31.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.678+0000 7f4664389640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f465c102490 0x7f465c19f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:31.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.678+0000 7f4664389640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f465c10d680 con 0x7f465c102490 2024-06-03T00:00:31.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.678+0000 7f4664389640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f465c10d500 con 0x7f465c101ad0 2024-06-03T00:00:31.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.679+0000 7f4664389640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f465c10d800 con 0x7f465c1008e0 2024-06-03T00:00:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.679+0000 7f4662926640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f465c102490 0x7f465c19f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.679+0000 7f4662926640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f465c102490 0x7f465c19f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55388/0 (socket says 172.21.15.49:55388) 2024-06-03T00:00:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.679+0000 7f4662926640 1 -- 172.21.15.49:0/1780403801 learned_addr learned my addr 172.21.15.49:0/1780403801 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.679+0000 7f4662125640 1 --2- 172.21.15.49:0/1780403801 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f465c1008e0 0x7f465c197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.679+0000 7f4661924640 1 --2- 172.21.15.49:0/1780403801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f465c101ad0 0x7f465c1981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.679+0000 7f4662926640 1 -- 172.21.15.49:0/1780403801 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f465c1008e0 msgr2=0x7f465c197c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.679+0000 7f4662926640 1 --2- 172.21.15.49:0/1780403801 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f465c1008e0 0x7f465c197c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.679+0000 7f4662926640 1 -- 172.21.15.49:0/1780403801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f465c101ad0 msgr2=0x7f465c1981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.679+0000 7f4662926640 1 --2- 172.21.15.49:0/1780403801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f465c101ad0 0x7f465c1981c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.679+0000 7f4662926640 1 -- 172.21.15.49:0/1780403801 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f465c19f8c0 con 0x7f465c102490 2024-06-03T00:00:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.679+0000 7f4662926640 1 --2- 172.21.15.49:0/1780403801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f465c102490 0x7f465c19f220 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f465400c970 tx=0x7f465400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.679+0000 7f465b7fe640 1 -- 172.21.15.49:0/1780403801 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4654007bb0 con 0x7f465c102490 2024-06-03T00:00:31.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.679+0000 7f4664389640 1 -- 172.21.15.49:0/1780403801 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f465c19fbb0 con 0x7f465c102490 2024-06-03T00:00:31.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.679+0000 7f465b7fe640 1 -- 172.21.15.49:0/1780403801 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4654007d50 con 0x7f465c102490 2024-06-03T00:00:31.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.679+0000 7f465b7fe640 1 -- 172.21.15.49:0/1780403801 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4654018800 con 0x7f465c102490 2024-06-03T00:00:31.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.679+0000 7f4664389640 1 -- 172.21.15.49:0/1780403801 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f465c1a00b0 con 0x7f465c102490 2024-06-03T00:00:31.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.680+0000 7f4664389640 1 -- 172.21.15.49:0/1780403801 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f465c107ba0 con 0x7f465c102490 2024-06-03T00:00:31.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.682+0000 7f465b7fe640 1 -- 172.21.15.49:0/1780403801 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f465400fa50 con 0x7f465c102490 2024-06-03T00:00:31.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.682+0000 7f465b7fe640 1 --2- 172.21.15.49:0/1780403801 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f46440a2b90 0x7f46440a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:31.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.682+0000 7f4662125640 1 --2- 172.21.15.49:0/1780403801 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f46440a2b90 0x7f46440a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:31.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.682+0000 7f465b7fe640 1 -- 172.21.15.49:0/1780403801 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f46540cf2b0 con 0x7f465c102490 2024-06-03T00:00:31.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.683+0000 7f4662125640 1 --2- 172.21.15.49:0/1780403801 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f46440a2b90 0x7f46440a5050 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f465c198b50 tx=0x7f464c009520 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:31.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.686+0000 7f465b7fe640 1 -- 172.21.15.49:0/1780403801 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4654014030 con 0x7f465c102490 2024-06-03T00:00:31.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.866+0000 7f4664389640 1 -- 172.21.15.49:0/1780403801 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f465c061de0 con 0x7f46440a2b90 2024-06-03T00:00:31.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.874+0000 7f465b7fe640 1 -- 172.21.15.49:0/1780403801 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258894 (secure 0 0 0) 0x7f465c061de0 con 0x7f46440a2b90 2024-06-03T00:00:31.876 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:00:31.877 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-06-03T00:00:31.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.877+0000 7f4664389640 1 -- 172.21.15.49:0/1780403801 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f46440a2b90 msgr2=0x7f46440a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:31.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.877+0000 7f4664389640 1 --2- 172.21.15.49:0/1780403801 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f46440a2b90 0x7f46440a5050 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f465c198b50 tx=0x7f464c009520 comp rx=0 tx=0).stop 2024-06-03T00:00:31.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.877+0000 7f4664389640 1 -- 172.21.15.49:0/1780403801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f465c102490 msgr2=0x7f465c19f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:31.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.877+0000 7f4664389640 1 --2- 172.21.15.49:0/1780403801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f465c102490 0x7f465c19f220 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f465400c970 tx=0x7f465400ce30 comp rx=0 tx=0).stop 2024-06-03T00:00:31.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.877+0000 7f4664389640 1 -- 172.21.15.49:0/1780403801 shutdown_connections 2024-06-03T00:00:31.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.877+0000 7f4664389640 1 --2- 172.21.15.49:0/1780403801 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f46440a2b90 0x7f46440a5050 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:31.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.877+0000 7f4664389640 1 --2- 172.21.15.49:0/1780403801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f465c101ad0 0x7f465c1981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:31.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.877+0000 7f4664389640 1 --2- 172.21.15.49:0/1780403801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f465c102490 0x7f465c19f220 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:31.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.877+0000 7f4664389640 1 --2- 172.21.15.49:0/1780403801 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f465c1008e0 0x7f465c197c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:31.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.877+0000 7f4664389640 1 -- 172.21.15.49:0/1780403801 >> 172.21.15.49:0/1780403801 conn(0x7f465c0fbe50 msgr2=0x7f465c104d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:31.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.877+0000 7f4664389640 1 -- 172.21.15.49:0/1780403801 shutdown_connections 2024-06-03T00:00:31.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:31.877+0000 7f4664389640 1 -- 172.21.15.49:0/1780403801 wait complete. 2024-06-03T00:00:31.888 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":398,"stamp":"2024-06-03T00:00:31.286965+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660727,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1923,"num_read_kb":1083,"num_write":445,"num_write_kb":3089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":1180736,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":863,"ondisk_log_size":863,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375484,"kb_used_data":13852,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124566340,"statfs":{"total":1151940427776,"available":1151555932160,"internally_reserved":0,"allocated":14184448,"data_stored":7739223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":57,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003136"},"pg_stats":[{"pgid":"3.3f","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.275149+0000","last_change":"2024-06-02T23:57:15.321542+0000","last_active":"2024-06-02T23:58:55.275149+0000","last_peered":"2024-06-02T23:58:55.275149+0000","last_clean":"2024-06-02T23:58:55.275149+0000","last_became_active":"2024-06-02T23:57:15.321129+0000","last_became_peered":"2024-06-02T23:57:15.321129+0000","last_unstale":"2024-06-02T23:58:55.275149+0000","last_undegraded":"2024-06-02T23:58:55.275149+0000","last_fullsized":"2024-06-02T23:58:55.275149+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:35:50.218316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272859+0000","last_change":"2024-06-02T23:57:15.327432+0000","last_active":"2024-06-02T23:58:55.272859+0000","last_peered":"2024-06-02T23:58:55.272859+0000","last_clean":"2024-06-02T23:58:55.272859+0000","last_became_active":"2024-06-02T23:57:15.326759+0000","last_became_peered":"2024-06-02T23:57:15.326759+0000","last_unstale":"2024-06-02T23:58:55.272859+0000","last_undegraded":"2024-06-02T23:58:55.272859+0000","last_fullsized":"2024-06-02T23:58:55.272859+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:42:20.473216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.274694+0000","last_change":"2024-06-02T23:57:15.323721+0000","last_active":"2024-06-02T23:58:55.274694+0000","last_peered":"2024-06-02T23:58:55.274694+0000","last_clean":"2024-06-02T23:58:55.274694+0000","last_became_active":"2024-06-02T23:57:15.321277+0000","last_became_peered":"2024-06-02T23:57:15.321277+0000","last_unstale":"2024-06-02T23:58:55.274694+0000","last_undegraded":"2024-06-02T23:58:55.274694+0000","last_fullsized":"2024-06-02T23:58:55.274694+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:34:31.667999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.258319+0000","last_change":"2024-06-02T23:57:15.323769+0000","last_active":"2024-06-02T23:58:55.258319+0000","last_peered":"2024-06-02T23:58:55.258319+0000","last_clean":"2024-06-02T23:58:55.258319+0000","last_became_active":"2024-06-02T23:57:15.323406+0000","last_became_peered":"2024-06-02T23:57:15.323406+0000","last_unstale":"2024-06-02T23:58:55.258319+0000","last_undegraded":"2024-06-02T23:58:55.258319+0000","last_fullsized":"2024-06-02T23:58:55.258319+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:51:27.456210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.258510+0000","last_change":"2024-06-02T23:57:56.531404+0000","last_active":"2024-06-02T23:58:55.258510+0000","last_peered":"2024-06-02T23:58:55.258510+0000","last_clean":"2024-06-02T23:58:55.258510+0000","last_became_active":"2024-06-02T23:57:56.530952+0000","last_became_peered":"2024-06-02T23:57:56.530952+0000","last_unstale":"2024-06-02T23:58:55.258510+0000","last_undegraded":"2024-06-02T23:58:55.258510+0000","last_fullsized":"2024-06-02T23:58:55.258510+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:39:30.405113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268533+0000","last_change":"2024-06-02T23:57:15.320843+0000","last_active":"2024-06-02T23:58:55.268533+0000","last_peered":"2024-06-02T23:58:55.268533+0000","last_clean":"2024-06-02T23:58:55.268533+0000","last_became_active":"2024-06-02T23:57:15.320472+0000","last_became_peered":"2024-06-02T23:57:15.320472+0000","last_unstale":"2024-06-02T23:58:55.268533+0000","last_undegraded":"2024-06-02T23:58:55.268533+0000","last_fullsized":"2024-06-02T23:58:55.268533+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:49:02.620777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.271511+0000","last_change":"2024-06-02T23:57:15.321799+0000","last_active":"2024-06-02T23:58:55.271511+0000","last_peered":"2024-06-02T23:58:55.271511+0000","last_clean":"2024-06-02T23:58:55.271511+0000","last_became_active":"2024-06-02T23:57:15.321379+0000","last_became_peered":"2024-06-02T23:57:15.321379+0000","last_unstale":"2024-06-02T23:58:55.271511+0000","last_undegraded":"2024-06-02T23:58:55.271511+0000","last_fullsized":"2024-06-02T23:58:55.271511+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:36:56.404936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268859+0000","last_change":"2024-06-02T23:57:15.318771+0000","last_active":"2024-06-02T23:58:55.268859+0000","last_peered":"2024-06-02T23:58:55.268859+0000","last_clean":"2024-06-02T23:58:55.268859+0000","last_became_active":"2024-06-02T23:57:15.318420+0000","last_became_peered":"2024-06-02T23:57:15.318420+0000","last_unstale":"2024-06-02T23:58:55.268859+0000","last_undegraded":"2024-06-02T23:58:55.268859+0000","last_fullsized":"2024-06-02T23:58:55.268859+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:07:53.769443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.274516+0000","last_change":"2024-06-02T23:57:15.318989+0000","last_active":"2024-06-02T23:58:55.274516+0000","last_peered":"2024-06-02T23:58:55.274516+0000","last_clean":"2024-06-02T23:58:55.274516+0000","last_became_active":"2024-06-02T23:57:15.318424+0000","last_became_peered":"2024-06-02T23:57:15.318424+0000","last_unstale":"2024-06-02T23:58:55.274516+0000","last_undegraded":"2024-06-02T23:58:55.274516+0000","last_fullsized":"2024-06-02T23:58:55.274516+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:30:47.634662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265217+0000","last_change":"2024-06-02T23:57:15.326251+0000","last_active":"2024-06-02T23:58:55.265217+0000","last_peered":"2024-06-02T23:58:55.265217+0000","last_clean":"2024-06-02T23:58:55.265217+0000","last_became_active":"2024-06-02T23:57:15.325890+0000","last_became_peered":"2024-06-02T23:57:15.325890+0000","last_unstale":"2024-06-02T23:58:55.265217+0000","last_undegraded":"2024-06-02T23:58:55.265217+0000","last_fullsized":"2024-06-02T23:58:55.265217+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:18:54.871410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.274001+0000","last_change":"2024-06-02T23:57:15.325364+0000","last_active":"2024-06-02T23:58:55.274001+0000","last_peered":"2024-06-02T23:58:55.274001+0000","last_clean":"2024-06-02T23:58:55.274001+0000","last_became_active":"2024-06-02T23:57:15.324987+0000","last_became_peered":"2024-06-02T23:57:15.324987+0000","last_unstale":"2024-06-02T23:58:55.274001+0000","last_undegraded":"2024-06-02T23:58:55.274001+0000","last_fullsized":"2024-06-02T23:58:55.274001+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:59:11.827263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265434+0000","last_change":"2024-06-02T23:57:15.328027+0000","last_active":"2024-06-02T23:58:55.265434+0000","last_peered":"2024-06-02T23:58:55.265434+0000","last_clean":"2024-06-02T23:58:55.265434+0000","last_became_active":"2024-06-02T23:57:15.327608+0000","last_became_peered":"2024-06-02T23:57:15.327608+0000","last_unstale":"2024-06-02T23:58:55.265434+0000","last_undegraded":"2024-06-02T23:58:55.265434+0000","last_fullsized":"2024-06-02T23:58:55.265434+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:09:42.152689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262861+0000","last_change":"2024-06-02T23:57:15.323095+0000","last_active":"2024-06-02T23:58:55.262861+0000","last_peered":"2024-06-02T23:58:55.262861+0000","last_clean":"2024-06-02T23:58:55.262861+0000","last_became_active":"2024-06-02T23:57:15.322755+0000","last_became_peered":"2024-06-02T23:57:15.322755+0000","last_unstale":"2024-06-02T23:58:55.262861+0000","last_undegraded":"2024-06-02T23:58:55.262861+0000","last_fullsized":"2024-06-02T23:58:55.262861+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:43:53.195192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272339+0000","last_change":"2024-06-02T23:57:15.327437+0000","last_active":"2024-06-02T23:58:55.272339+0000","last_peered":"2024-06-02T23:58:55.272339+0000","last_clean":"2024-06-02T23:58:55.272339+0000","last_became_active":"2024-06-02T23:57:15.326974+0000","last_became_peered":"2024-06-02T23:57:15.326974+0000","last_unstale":"2024-06-02T23:58:55.272339+0000","last_undegraded":"2024-06-02T23:58:55.272339+0000","last_fullsized":"2024-06-02T23:58:55.272339+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:20:44.978213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273334+0000","last_change":"2024-06-02T23:57:15.325414+0000","last_active":"2024-06-02T23:58:55.273334+0000","last_peered":"2024-06-02T23:58:55.273334+0000","last_clean":"2024-06-02T23:58:55.273334+0000","last_became_active":"2024-06-02T23:57:15.325033+0000","last_became_peered":"2024-06-02T23:57:15.325033+0000","last_unstale":"2024-06-02T23:58:55.273334+0000","last_undegraded":"2024-06-02T23:58:55.273334+0000","last_fullsized":"2024-06-02T23:58:55.273334+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:27:14.536646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272688+0000","last_change":"2024-06-02T23:57:15.315833+0000","last_active":"2024-06-02T23:58:55.272688+0000","last_peered":"2024-06-02T23:58:55.272688+0000","last_clean":"2024-06-02T23:58:55.272688+0000","last_became_active":"2024-06-02T23:57:15.315355+0000","last_became_peered":"2024-06-02T23:57:15.315355+0000","last_unstale":"2024-06-02T23:58:55.272688+0000","last_undegraded":"2024-06-02T23:58:55.272688+0000","last_fullsized":"2024-06-02T23:58:55.272688+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:52:05.915828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.275143+0000","last_change":"2024-06-02T23:57:15.322407+0000","last_active":"2024-06-02T23:58:55.275143+0000","last_peered":"2024-06-02T23:58:55.275143+0000","last_clean":"2024-06-02T23:58:55.275143+0000","last_became_active":"2024-06-02T23:57:15.322090+0000","last_became_peered":"2024-06-02T23:57:15.322090+0000","last_unstale":"2024-06-02T23:58:55.275143+0000","last_undegraded":"2024-06-02T23:58:55.275143+0000","last_fullsized":"2024-06-02T23:58:55.275143+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:08:48.071192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268594+0000","last_change":"2024-06-02T23:57:15.327331+0000","last_active":"2024-06-02T23:58:55.268594+0000","last_peered":"2024-06-02T23:58:55.268594+0000","last_clean":"2024-06-02T23:58:55.268594+0000","last_became_active":"2024-06-02T23:57:15.326863+0000","last_became_peered":"2024-06-02T23:57:15.326863+0000","last_unstale":"2024-06-02T23:58:55.268594+0000","last_undegraded":"2024-06-02T23:58:55.268594+0000","last_fullsized":"2024-06-02T23:58:55.268594+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:45:05.443751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.261047+0000","last_change":"2024-06-02T23:57:15.313008+0000","last_active":"2024-06-02T23:58:55.261047+0000","last_peered":"2024-06-02T23:58:55.261047+0000","last_clean":"2024-06-02T23:58:55.261047+0000","last_became_active":"2024-06-02T23:57:15.312322+0000","last_became_peered":"2024-06-02T23:57:15.312322+0000","last_unstale":"2024-06-02T23:58:55.261047+0000","last_undegraded":"2024-06-02T23:58:55.261047+0000","last_fullsized":"2024-06-02T23:58:55.261047+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:54:03.744964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":217,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:28.407878+0000","last_change":"2024-06-02T23:57:12.153410+0000","last_active":"2024-06-03T00:00:28.407878+0000","last_peered":"2024-06-03T00:00:28.407878+0000","last_clean":"2024-06-03T00:00:28.407878+0000","last_became_active":"2024-06-02T23:57:12.153065+0000","last_became_peered":"2024-06-02T23:57:12.153065+0000","last_unstale":"2024-06-03T00:00:28.407878+0000","last_undegraded":"2024-06-03T00:00:28.407878+0000","last_fullsized":"2024-06-03T00:00:28.407878+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:45:30.058961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.258496+0000","last_change":"2024-06-02T23:57:15.314168+0000","last_active":"2024-06-02T23:58:55.258496+0000","last_peered":"2024-06-02T23:58:55.258496+0000","last_clean":"2024-06-02T23:58:55.258496+0000","last_became_active":"2024-06-02T23:57:15.313838+0000","last_became_peered":"2024-06-02T23:57:15.313838+0000","last_unstale":"2024-06-02T23:58:55.258496+0000","last_undegraded":"2024-06-02T23:58:55.258496+0000","last_fullsized":"2024-06-02T23:58:55.258496+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:56:14.137471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526742+0000","last_change":"2024-06-02T23:57:12.305448+0000","last_active":"2024-06-02T23:57:56.526742+0000","last_peered":"2024-06-02T23:57:56.526742+0000","last_clean":"2024-06-02T23:57:56.526742+0000","last_became_active":"2024-06-02T23:57:12.305080+0000","last_became_peered":"2024-06-02T23:57:12.305080+0000","last_unstale":"2024-06-02T23:57:56.526742+0000","last_undegraded":"2024-06-02T23:57:56.526742+0000","last_fullsized":"2024-06-02T23:57:56.526742+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:20:18.660943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.275386+0000","last_change":"2024-06-02T23:57:15.321660+0000","last_active":"2024-06-02T23:58:55.275386+0000","last_peered":"2024-06-02T23:58:55.275386+0000","last_clean":"2024-06-02T23:58:55.275386+0000","last_became_active":"2024-06-02T23:57:15.321304+0000","last_became_peered":"2024-06-02T23:57:15.321304+0000","last_unstale":"2024-06-02T23:58:55.275386+0000","last_undegraded":"2024-06-02T23:58:55.275386+0000","last_fullsized":"2024-06-02T23:58:55.275386+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:10:10.933291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:58.169787+0000","last_change":"2024-06-02T23:57:56.544458+0000","last_active":"2024-06-02T23:57:58.169787+0000","last_peered":"2024-06-02T23:57:58.169787+0000","last_clean":"2024-06-02T23:57:58.169787+0000","last_became_active":"2024-06-02T23:57:56.532838+0000","last_became_peered":"2024-06-02T23:57:56.532838+0000","last_unstale":"2024-06-02T23:57:58.169787+0000","last_undegraded":"2024-06-02T23:57:58.169787+0000","last_fullsized":"2024-06-02T23:57:58.169787+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:27:44.700493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272537+0000","last_change":"2024-06-02T23:57:15.328944+0000","last_active":"2024-06-02T23:58:55.272537+0000","last_peered":"2024-06-02T23:58:55.272537+0000","last_clean":"2024-06-02T23:58:55.272537+0000","last_became_active":"2024-06-02T23:57:15.328531+0000","last_became_peered":"2024-06-02T23:57:15.328531+0000","last_unstale":"2024-06-02T23:58:55.272537+0000","last_undegraded":"2024-06-02T23:58:55.272537+0000","last_fullsized":"2024-06-02T23:58:55.272537+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:48:19.709989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528536+0000","last_change":"2024-06-02T23:57:12.153967+0000","last_active":"2024-06-02T23:57:56.528536+0000","last_peered":"2024-06-02T23:57:56.528536+0000","last_clean":"2024-06-02T23:57:56.528536+0000","last_became_active":"2024-06-02T23:57:12.153600+0000","last_became_peered":"2024-06-02T23:57:12.153600+0000","last_unstale":"2024-06-02T23:57:56.528536+0000","last_undegraded":"2024-06-02T23:57:56.528536+0000","last_fullsized":"2024-06-02T23:57:56.528536+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:47:58.761573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267401+0000","last_change":"2024-06-02T23:57:15.318089+0000","last_active":"2024-06-02T23:58:55.267401+0000","last_peered":"2024-06-02T23:58:55.267401+0000","last_clean":"2024-06-02T23:58:55.267401+0000","last_became_active":"2024-06-02T23:57:15.316494+0000","last_became_peered":"2024-06-02T23:57:15.316494+0000","last_unstale":"2024-06-02T23:58:55.267401+0000","last_undegraded":"2024-06-02T23:58:55.267401+0000","last_fullsized":"2024-06-02T23:58:55.267401+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:21:15.839255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"90'7","reported_seq":214,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:27.400352+0000","last_change":"2024-06-02T23:57:12.153624+0000","last_active":"2024-06-03T00:00:27.400352+0000","last_peered":"2024-06-03T00:00:27.400352+0000","last_clean":"2024-06-03T00:00:27.400352+0000","last_became_active":"2024-06-02T23:57:12.152712+0000","last_became_peered":"2024-06-02T23:57:12.152712+0000","last_unstale":"2024-06-03T00:00:27.400352+0000","last_undegraded":"2024-06-03T00:00:27.400352+0000","last_fullsized":"2024-06-03T00:00:27.400352+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:14:50.236213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":180,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259432+0000","last_change":"2024-06-02T23:57:15.325293+0000","last_active":"2024-06-02T23:58:55.259432+0000","last_peered":"2024-06-02T23:58:55.259432+0000","last_clean":"2024-06-02T23:58:55.259432+0000","last_became_active":"2024-06-02T23:57:15.324967+0000","last_became_peered":"2024-06-02T23:57:15.324967+0000","last_unstale":"2024-06-02T23:58:55.259432+0000","last_undegraded":"2024-06-02T23:58:55.259432+0000","last_fullsized":"2024-06-02T23:58:55.259432+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:21:23.634118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.735981+0000","last_change":"2024-06-02T23:57:12.155927+0000","last_active":"2024-06-02T23:57:56.735981+0000","last_peered":"2024-06-02T23:57:56.735981+0000","last_clean":"2024-06-02T23:57:56.735981+0000","last_became_active":"2024-06-02T23:57:12.155505+0000","last_became_peered":"2024-06-02T23:57:12.155505+0000","last_unstale":"2024-06-02T23:57:56.735981+0000","last_undegraded":"2024-06-02T23:57:56.735981+0000","last_fullsized":"2024-06-02T23:57:56.735981+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:47.555747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262458+0000","last_change":"2024-06-02T23:57:15.321796+0000","last_active":"2024-06-02T23:58:55.262458+0000","last_peered":"2024-06-02T23:58:55.262458+0000","last_clean":"2024-06-02T23:58:55.262458+0000","last_became_active":"2024-06-02T23:57:15.320850+0000","last_became_peered":"2024-06-02T23:57:15.320850+0000","last_unstale":"2024-06-02T23:58:55.262458+0000","last_undegraded":"2024-06-02T23:58:55.262458+0000","last_fullsized":"2024-06-02T23:58:55.262458+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:04:10.991920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.523859+0000","last_change":"2024-06-02T23:57:12.146589+0000","last_active":"2024-06-02T23:57:56.523859+0000","last_peered":"2024-06-02T23:57:56.523859+0000","last_clean":"2024-06-02T23:57:56.523859+0000","last_became_active":"2024-06-02T23:57:12.146224+0000","last_became_peered":"2024-06-02T23:57:12.146224+0000","last_unstale":"2024-06-02T23:57:56.523859+0000","last_undegraded":"2024-06-02T23:57:56.523859+0000","last_fullsized":"2024-06-02T23:57:56.523859+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:17:31.250585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268843+0000","last_change":"2024-06-02T23:57:15.315553+0000","last_active":"2024-06-02T23:58:55.268843+0000","last_peered":"2024-06-02T23:58:55.268843+0000","last_clean":"2024-06-02T23:58:55.268843+0000","last_became_active":"2024-06-02T23:57:15.315217+0000","last_became_peered":"2024-06-02T23:57:15.315217+0000","last_unstale":"2024-06-02T23:58:55.268843+0000","last_undegraded":"2024-06-02T23:58:55.268843+0000","last_fullsized":"2024-06-02T23:58:55.268843+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:00:23.097949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.525158+0000","last_change":"2024-06-02T23:57:12.156971+0000","last_active":"2024-06-02T23:57:56.525158+0000","last_peered":"2024-06-02T23:57:56.525158+0000","last_clean":"2024-06-02T23:57:56.525158+0000","last_became_active":"2024-06-02T23:57:12.156379+0000","last_became_peered":"2024-06-02T23:57:12.156379+0000","last_unstale":"2024-06-02T23:57:56.525158+0000","last_undegraded":"2024-06-02T23:57:56.525158+0000","last_fullsized":"2024-06-02T23:57:56.525158+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:28:50.057736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.266692+0000","last_change":"2024-06-02T23:57:15.313985+0000","last_active":"2024-06-02T23:58:55.266692+0000","last_peered":"2024-06-02T23:58:55.266692+0000","last_clean":"2024-06-02T23:58:55.266692+0000","last_became_active":"2024-06-02T23:57:15.313668+0000","last_became_peered":"2024-06-02T23:57:15.313668+0000","last_unstale":"2024-06-02T23:58:55.266692+0000","last_undegraded":"2024-06-02T23:58:55.266692+0000","last_fullsized":"2024-06-02T23:58:55.266692+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:10:56.560660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"90'5","reported_seq":380,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:26.397977+0000","last_change":"2024-06-02T23:57:12.156025+0000","last_active":"2024-06-03T00:00:26.397977+0000","last_peered":"2024-06-03T00:00:26.397977+0000","last_clean":"2024-06-03T00:00:26.397977+0000","last_became_active":"2024-06-02T23:57:12.155609+0000","last_became_peered":"2024-06-02T23:57:12.155609+0000","last_unstale":"2024-06-03T00:00:26.397977+0000","last_undegraded":"2024-06-03T00:00:26.397977+0000","last_fullsized":"2024-06-03T00:00:26.397977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:27:48.953456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":348,"num_read_kb":348,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272606+0000","last_change":"2024-06-02T23:57:15.329711+0000","last_active":"2024-06-02T23:58:55.272606+0000","last_peered":"2024-06-02T23:58:55.272606+0000","last_clean":"2024-06-02T23:58:55.272606+0000","last_became_active":"2024-06-02T23:57:15.329284+0000","last_became_peered":"2024-06-02T23:57:15.329284+0000","last_unstale":"2024-06-02T23:58:55.272606+0000","last_undegraded":"2024-06-02T23:58:55.272606+0000","last_fullsized":"2024-06-02T23:58:55.272606+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:58:06.165152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.529073+0000","last_change":"2024-06-02T23:57:12.156949+0000","last_active":"2024-06-02T23:57:56.529073+0000","last_peered":"2024-06-02T23:57:56.529073+0000","last_clean":"2024-06-02T23:57:56.529073+0000","last_became_active":"2024-06-02T23:57:12.156558+0000","last_became_peered":"2024-06-02T23:57:12.156558+0000","last_unstale":"2024-06-02T23:57:56.529073+0000","last_undegraded":"2024-06-02T23:57:56.529073+0000","last_fullsized":"2024-06-02T23:57:56.529073+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:05:57.658900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273919+0000","last_change":"2024-06-02T23:57:15.318638+0000","last_active":"2024-06-02T23:58:55.273919+0000","last_peered":"2024-06-02T23:58:55.273919+0000","last_clean":"2024-06-02T23:58:55.273919+0000","last_became_active":"2024-06-02T23:57:15.318321+0000","last_became_peered":"2024-06-02T23:57:15.318321+0000","last_unstale":"2024-06-02T23:58:55.273919+0000","last_undegraded":"2024-06-02T23:58:55.273919+0000","last_fullsized":"2024-06-02T23:58:55.273919+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:21:57.877235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526151+0000","last_change":"2024-06-02T23:57:12.306278+0000","last_active":"2024-06-02T23:57:56.526151+0000","last_peered":"2024-06-02T23:57:56.526151+0000","last_clean":"2024-06-02T23:57:56.526151+0000","last_became_active":"2024-06-02T23:57:12.305885+0000","last_became_peered":"2024-06-02T23:57:12.305885+0000","last_unstale":"2024-06-02T23:57:56.526151+0000","last_undegraded":"2024-06-02T23:57:56.526151+0000","last_fullsized":"2024-06-02T23:57:56.526151+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:05:07.723501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.266773+0000","last_change":"2024-06-02T23:57:15.322489+0000","last_active":"2024-06-02T23:58:55.266773+0000","last_peered":"2024-06-02T23:58:55.266773+0000","last_clean":"2024-06-02T23:58:55.266773+0000","last_became_active":"2024-06-02T23:57:15.322131+0000","last_became_peered":"2024-06-02T23:57:15.322131+0000","last_unstale":"2024-06-02T23:58:55.266773+0000","last_undegraded":"2024-06-02T23:58:55.266773+0000","last_fullsized":"2024-06-02T23:58:55.266773+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:34:43.362338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"90'38","reported_seq":426,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:26.398377+0000","last_change":"2024-06-02T23:57:12.156920+0000","last_active":"2024-06-03T00:00:26.398377+0000","last_peered":"2024-06-03T00:00:26.398377+0000","last_clean":"2024-06-03T00:00:26.398377+0000","last_became_active":"2024-06-02T23:57:12.156494+0000","last_became_peered":"2024-06-02T23:57:12.156494+0000","last_unstale":"2024-06-03T00:00:26.398377+0000","last_undegraded":"2024-06-03T00:00:26.398377+0000","last_fullsized":"2024-06-03T00:00:26.398377+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:49:56.458730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62864,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":361,"num_read_kb":242,"num_write":40,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265549+0000","last_change":"2024-06-02T23:57:15.328502+0000","last_active":"2024-06-02T23:58:55.265549+0000","last_peered":"2024-06-02T23:58:55.265549+0000","last_clean":"2024-06-02T23:58:55.265549+0000","last_became_active":"2024-06-02T23:57:15.328174+0000","last_became_peered":"2024-06-02T23:57:15.328174+0000","last_unstale":"2024-06-02T23:58:55.265549+0000","last_undegraded":"2024-06-02T23:58:55.265549+0000","last_fullsized":"2024-06-02T23:58:55.265549+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:58:33.355397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527385+0000","last_change":"2024-06-02T23:57:12.154204+0000","last_active":"2024-06-02T23:57:56.527385+0000","last_peered":"2024-06-02T23:57:56.527385+0000","last_clean":"2024-06-02T23:57:56.527385+0000","last_became_active":"2024-06-02T23:57:12.153412+0000","last_became_peered":"2024-06-02T23:57:12.153412+0000","last_unstale":"2024-06-02T23:57:56.527385+0000","last_undegraded":"2024-06-02T23:57:56.527385+0000","last_fullsized":"2024-06-02T23:57:56.527385+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:15.472279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262255+0000","last_change":"2024-06-02T23:57:15.314274+0000","last_active":"2024-06-02T23:58:55.262255+0000","last_peered":"2024-06-02T23:58:55.262255+0000","last_clean":"2024-06-02T23:58:55.262255+0000","last_became_active":"2024-06-02T23:57:15.313946+0000","last_became_peered":"2024-06-02T23:57:15.313946+0000","last_unstale":"2024-06-02T23:58:55.262255+0000","last_undegraded":"2024-06-02T23:58:55.262255+0000","last_fullsized":"2024-06-02T23:58:55.262255+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:07.909977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.525241+0000","last_change":"2024-06-02T23:57:12.156767+0000","last_active":"2024-06-02T23:57:56.525241+0000","last_peered":"2024-06-02T23:57:56.525241+0000","last_clean":"2024-06-02T23:57:56.525241+0000","last_became_active":"2024-06-02T23:57:12.156346+0000","last_became_peered":"2024-06-02T23:57:12.156346+0000","last_unstale":"2024-06-02T23:57:56.525241+0000","last_undegraded":"2024-06-02T23:57:56.525241+0000","last_fullsized":"2024-06-02T23:57:56.525241+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:29:45.801904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267668+0000","last_change":"2024-06-02T23:57:15.322676+0000","last_active":"2024-06-02T23:58:55.267668+0000","last_peered":"2024-06-02T23:58:55.267668+0000","last_clean":"2024-06-02T23:58:55.267668+0000","last_became_active":"2024-06-02T23:57:15.319429+0000","last_became_peered":"2024-06-02T23:57:15.319429+0000","last_unstale":"2024-06-02T23:58:55.267668+0000","last_undegraded":"2024-06-02T23:58:55.267668+0000","last_fullsized":"2024-06-02T23:58:55.267668+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:48:15.984818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'6","reported_seq":212,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:27.440240+0000","last_change":"2024-06-02T23:57:12.153925+0000","last_active":"2024-06-03T00:00:27.440240+0000","last_peered":"2024-06-03T00:00:27.440240+0000","last_clean":"2024-06-03T00:00:27.440240+0000","last_became_active":"2024-06-02T23:57:12.152990+0000","last_became_peered":"2024-06-02T23:57:12.152990+0000","last_unstale":"2024-06-03T00:00:27.440240+0000","last_undegraded":"2024-06-03T00:00:27.440240+0000","last_fullsized":"2024-06-03T00:00:27.440240+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:32:21.845946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":896,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":180,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.270077+0000","last_change":"2024-06-02T23:57:15.327662+0000","last_active":"2024-06-02T23:58:55.270077+0000","last_peered":"2024-06-02T23:58:55.270077+0000","last_clean":"2024-06-02T23:58:55.270077+0000","last_became_active":"2024-06-02T23:57:15.327320+0000","last_became_peered":"2024-06-02T23:57:15.327320+0000","last_unstale":"2024-06-02T23:58:55.270077+0000","last_undegraded":"2024-06-02T23:58:55.270077+0000","last_fullsized":"2024-06-02T23:58:55.270077+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:44:37.561533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528426+0000","last_change":"2024-06-02T23:57:12.306856+0000","last_active":"2024-06-02T23:57:56.528426+0000","last_peered":"2024-06-02T23:57:56.528426+0000","last_clean":"2024-06-02T23:57:56.528426+0000","last_became_active":"2024-06-02T23:57:12.306476+0000","last_became_peered":"2024-06-02T23:57:12.306476+0000","last_unstale":"2024-06-02T23:57:56.528426+0000","last_undegraded":"2024-06-02T23:57:56.528426+0000","last_fullsized":"2024-06-02T23:57:56.528426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:30:22.839589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.266843+0000","last_change":"2024-06-02T23:57:56.890015+0000","last_active":"2024-06-02T23:58:55.266843+0000","last_peered":"2024-06-02T23:58:55.266843+0000","last_clean":"2024-06-02T23:58:55.266843+0000","last_became_active":"2024-06-02T23:57:56.889591+0000","last_became_peered":"2024-06-02T23:57:56.889591+0000","last_unstale":"2024-06-02T23:58:55.266843+0000","last_undegraded":"2024-06-02T23:58:55.266843+0000","last_fullsized":"2024-06-02T23:58:55.266843+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:14:37.851207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'3","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:59:28.633344+0000","last_change":"2024-06-02T23:57:12.146690+0000","last_active":"2024-06-02T23:59:28.633344+0000","last_peered":"2024-06-02T23:59:28.633344+0000","last_clean":"2024-06-02T23:59:28.633344+0000","last_became_active":"2024-06-02T23:57:12.146372+0000","last_became_peered":"2024-06-02T23:57:12.146372+0000","last_unstale":"2024-06-02T23:59:28.633344+0000","last_undegraded":"2024-06-02T23:59:28.633344+0000","last_fullsized":"2024-06-02T23:59:28.633344+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:45:04.421365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267278+0000","last_change":"2024-06-02T23:57:15.320938+0000","last_active":"2024-06-02T23:58:55.267278+0000","last_peered":"2024-06-02T23:58:55.267278+0000","last_clean":"2024-06-02T23:58:55.267278+0000","last_became_active":"2024-06-02T23:57:15.320567+0000","last_became_peered":"2024-06-02T23:57:15.320567+0000","last_unstale":"2024-06-02T23:58:55.267278+0000","last_undegraded":"2024-06-02T23:58:55.267278+0000","last_fullsized":"2024-06-02T23:58:55.267278+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:04:29.736387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"88'1","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527764+0000","last_change":"2024-06-02T23:57:12.307020+0000","last_active":"2024-06-02T23:57:56.527764+0000","last_peered":"2024-06-02T23:57:56.527764+0000","last_clean":"2024-06-02T23:57:56.527764+0000","last_became_active":"2024-06-02T23:57:12.306650+0000","last_became_peered":"2024-06-02T23:57:12.306650+0000","last_unstale":"2024-06-02T23:57:56.527764+0000","last_undegraded":"2024-06-02T23:57:56.527764+0000","last_fullsized":"2024-06-02T23:57:56.527764+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:18:03.679704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265006+0000","last_change":"2024-06-02T23:57:15.319300+0000","last_active":"2024-06-02T23:58:55.265006+0000","last_peered":"2024-06-02T23:58:55.265006+0000","last_clean":"2024-06-02T23:58:55.265006+0000","last_became_active":"2024-06-02T23:57:15.318903+0000","last_became_peered":"2024-06-02T23:57:15.318903+0000","last_unstale":"2024-06-02T23:58:55.265006+0000","last_undegraded":"2024-06-02T23:58:55.265006+0000","last_fullsized":"2024-06-02T23:58:55.265006+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:38:25.521337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":210,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:28.408443+0000","last_change":"2024-06-02T23:57:12.155260+0000","last_active":"2024-06-03T00:00:28.408443+0000","last_peered":"2024-06-03T00:00:28.408443+0000","last_clean":"2024-06-03T00:00:28.408443+0000","last_became_active":"2024-06-02T23:57:12.154884+0000","last_became_peered":"2024-06-02T23:57:12.154884+0000","last_unstale":"2024-06-03T00:00:28.408443+0000","last_undegraded":"2024-06-03T00:00:28.408443+0000","last_fullsized":"2024-06-03T00:00:28.408443+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:34:52.390752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.269861+0000","last_change":"2024-06-02T23:57:15.323490+0000","last_active":"2024-06-02T23:58:55.269861+0000","last_peered":"2024-06-02T23:58:55.269861+0000","last_clean":"2024-06-02T23:58:55.269861+0000","last_became_active":"2024-06-02T23:57:15.323142+0000","last_became_peered":"2024-06-02T23:57:15.323142+0000","last_unstale":"2024-06-02T23:58:55.269861+0000","last_undegraded":"2024-06-02T23:58:55.269861+0000","last_fullsized":"2024-06-02T23:58:55.269861+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:32:32.445823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.261770+0000","last_change":"2024-06-02T23:57:56.531715+0000","last_active":"2024-06-02T23:58:55.261770+0000","last_peered":"2024-06-02T23:58:55.261770+0000","last_clean":"2024-06-02T23:58:55.261770+0000","last_became_active":"2024-06-02T23:57:56.531304+0000","last_became_peered":"2024-06-02T23:57:56.531304+0000","last_unstale":"2024-06-02T23:58:55.261770+0000","last_undegraded":"2024-06-02T23:58:55.261770+0000","last_fullsized":"2024-06-02T23:58:55.261770+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:58:02.532206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'6","reported_seq":210,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:27.439664+0000","last_change":"2024-06-02T23:57:12.305475+0000","last_active":"2024-06-03T00:00:27.439664+0000","last_peered":"2024-06-03T00:00:27.439664+0000","last_clean":"2024-06-03T00:00:27.439664+0000","last_became_active":"2024-06-02T23:57:12.305071+0000","last_became_peered":"2024-06-02T23:57:12.305071+0000","last_unstale":"2024-06-03T00:00:27.439664+0000","last_undegraded":"2024-06-03T00:00:27.439664+0000","last_fullsized":"2024-06-03T00:00:27.439664+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:08:29.024447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":177,"num_read_kb":177,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.264368+0000","last_change":"2024-06-02T23:57:15.308629+0000","last_active":"2024-06-02T23:58:55.264368+0000","last_peered":"2024-06-02T23:58:55.264368+0000","last_clean":"2024-06-02T23:58:55.264368+0000","last_became_active":"2024-06-02T23:57:15.307981+0000","last_became_peered":"2024-06-02T23:57:15.307981+0000","last_unstale":"2024-06-02T23:58:55.264368+0000","last_undegraded":"2024-06-02T23:58:55.264368+0000","last_fullsized":"2024-06-02T23:58:55.264368+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:14:22.446599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.652578+0000","last_change":"2024-06-02T23:57:12.155968+0000","last_active":"2024-06-02T23:57:56.652578+0000","last_peered":"2024-06-02T23:57:56.652578+0000","last_clean":"2024-06-02T23:57:56.652578+0000","last_became_active":"2024-06-02T23:57:12.155521+0000","last_became_peered":"2024-06-02T23:57:12.155521+0000","last_unstale":"2024-06-02T23:57:56.652578+0000","last_undegraded":"2024-06-02T23:57:56.652578+0000","last_fullsized":"2024-06-02T23:57:56.652578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:45:00.397317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":349,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528775+0000","last_change":"2024-06-02T23:55:50.081978+0000","last_active":"2024-06-02T23:57:56.528775+0000","last_peered":"2024-06-02T23:57:56.528775+0000","last_clean":"2024-06-02T23:57:56.528775+0000","last_became_active":"2024-06-02T23:55:50.081431+0000","last_became_peered":"2024-06-02T23:55:50.081431+0000","last_unstale":"2024-06-02T23:57:56.528775+0000","last_undegraded":"2024-06-02T23:57:56.528775+0000","last_fullsized":"2024-06-02T23:57:56.528775+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:52:23.676206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:52:23.676206+0000","last_clean_scrub_stamp":"2024-06-02T23:52:23.676206+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:29:59.979935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262458+0000","last_change":"2024-06-02T23:57:56.529633+0000","last_active":"2024-06-02T23:58:55.262458+0000","last_peered":"2024-06-02T23:58:55.262458+0000","last_clean":"2024-06-02T23:58:55.262458+0000","last_became_active":"2024-06-02T23:57:56.529210+0000","last_became_peered":"2024-06-02T23:57:56.529210+0000","last_unstale":"2024-06-02T23:58:55.262458+0000","last_undegraded":"2024-06-02T23:58:55.262458+0000","last_fullsized":"2024-06-02T23:58:55.262458+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:51:31.807162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.529339+0000","last_change":"2024-06-02T23:57:12.155897+0000","last_active":"2024-06-02T23:57:56.529339+0000","last_peered":"2024-06-02T23:57:56.529339+0000","last_clean":"2024-06-02T23:57:56.529339+0000","last_became_active":"2024-06-02T23:57:12.155461+0000","last_became_peered":"2024-06-02T23:57:12.155461+0000","last_unstale":"2024-06-02T23:57:56.529339+0000","last_undegraded":"2024-06-02T23:57:56.529339+0000","last_fullsized":"2024-06-02T23:57:56.529339+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:19:22.104104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528035+0000","last_change":"2024-06-02T23:57:12.306363+0000","last_active":"2024-06-02T23:57:56.528035+0000","last_peered":"2024-06-02T23:57:56.528035+0000","last_clean":"2024-06-02T23:57:56.528035+0000","last_became_active":"2024-06-02T23:57:12.305920+0000","last_became_peered":"2024-06-02T23:57:12.305920+0000","last_unstale":"2024-06-02T23:57:56.528035+0000","last_undegraded":"2024-06-02T23:57:56.528035+0000","last_fullsized":"2024-06-02T23:57:56.528035+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:31:01.787879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262436+0000","last_change":"2024-06-02T23:57:15.316038+0000","last_active":"2024-06-02T23:58:55.262436+0000","last_peered":"2024-06-02T23:58:55.262436+0000","last_clean":"2024-06-02T23:58:55.262436+0000","last_became_active":"2024-06-02T23:57:15.315715+0000","last_became_peered":"2024-06-02T23:57:15.315715+0000","last_unstale":"2024-06-02T23:58:55.262436+0000","last_undegraded":"2024-06-02T23:58:55.262436+0000","last_fullsized":"2024-06-02T23:58:55.262436+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:34:36.014251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"90'18","reported_seq":60,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:59:25.049042+0000","last_change":"2024-06-02T23:57:56.539596+0000","last_active":"2024-06-02T23:59:25.049042+0000","last_peered":"2024-06-02T23:59:25.049042+0000","last_clean":"2024-06-02T23:59:25.049042+0000","last_became_active":"2024-06-02T23:57:56.532686+0000","last_became_peered":"2024-06-02T23:57:56.532686+0000","last_unstale":"2024-06-02T23:59:25.049042+0000","last_undegraded":"2024-06-02T23:59:25.049042+0000","last_fullsized":"2024-06-02T23:59:25.049042+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:29:24.691941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267369+0000","last_change":"2024-06-02T23:57:15.315657+0000","last_active":"2024-06-02T23:58:55.267369+0000","last_peered":"2024-06-02T23:58:55.267369+0000","last_clean":"2024-06-02T23:58:55.267369+0000","last_became_active":"2024-06-02T23:57:15.315293+0000","last_became_peered":"2024-06-02T23:57:15.315293+0000","last_unstale":"2024-06-02T23:58:55.267369+0000","last_undegraded":"2024-06-02T23:58:55.267369+0000","last_fullsized":"2024-06-02T23:58:55.267369+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:52:55.241379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.652229+0000","last_change":"2024-06-02T23:57:12.405664+0000","last_active":"2024-06-02T23:57:56.652229+0000","last_peered":"2024-06-02T23:57:56.652229+0000","last_clean":"2024-06-02T23:57:56.652229+0000","last_became_active":"2024-06-02T23:57:12.405281+0000","last_became_peered":"2024-06-02T23:57:12.405281+0000","last_unstale":"2024-06-02T23:57:56.652229+0000","last_undegraded":"2024-06-02T23:57:56.652229+0000","last_fullsized":"2024-06-02T23:57:56.652229+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:46:50.119466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273696+0000","last_change":"2024-06-02T23:57:15.318136+0000","last_active":"2024-06-02T23:58:55.273696+0000","last_peered":"2024-06-02T23:58:55.273696+0000","last_clean":"2024-06-02T23:58:55.273696+0000","last_became_active":"2024-06-02T23:57:15.317753+0000","last_became_peered":"2024-06-02T23:57:15.317753+0000","last_unstale":"2024-06-02T23:58:55.273696+0000","last_undegraded":"2024-06-02T23:58:55.273696+0000","last_fullsized":"2024-06-02T23:58:55.273696+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:35:11.025266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.887947+0000","last_change":"2024-06-02T23:57:12.305954+0000","last_active":"2024-06-02T23:57:56.887947+0000","last_peered":"2024-06-02T23:57:56.887947+0000","last_clean":"2024-06-02T23:57:56.887947+0000","last_became_active":"2024-06-02T23:57:12.305589+0000","last_became_peered":"2024-06-02T23:57:12.305589+0000","last_unstale":"2024-06-02T23:57:56.887947+0000","last_undegraded":"2024-06-02T23:57:56.887947+0000","last_fullsized":"2024-06-02T23:57:56.887947+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:34:34.178446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.243742+0000","last_change":"2024-06-02T23:57:15.327115+0000","last_active":"2024-06-02T23:58:55.243742+0000","last_peered":"2024-06-02T23:58:55.243742+0000","last_clean":"2024-06-02T23:58:55.243742+0000","last_became_active":"2024-06-02T23:57:15.326746+0000","last_became_peered":"2024-06-02T23:57:15.326746+0000","last_unstale":"2024-06-02T23:58:55.243742+0000","last_undegraded":"2024-06-02T23:58:55.243742+0000","last_fullsized":"2024-06-02T23:58:55.243742+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:08:04.340517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526250+0000","last_change":"2024-06-02T23:57:12.152933+0000","last_active":"2024-06-02T23:57:56.526250+0000","last_peered":"2024-06-02T23:57:56.526250+0000","last_clean":"2024-06-02T23:57:56.526250+0000","last_became_active":"2024-06-02T23:57:12.152453+0000","last_became_peered":"2024-06-02T23:57:12.152453+0000","last_unstale":"2024-06-02T23:57:56.526250+0000","last_undegraded":"2024-06-02T23:57:56.526250+0000","last_fullsized":"2024-06-02T23:57:56.526250+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:47:05.144374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272469+0000","last_change":"2024-06-02T23:57:15.326042+0000","last_active":"2024-06-02T23:58:55.272469+0000","last_peered":"2024-06-02T23:58:55.272469+0000","last_clean":"2024-06-02T23:58:55.272469+0000","last_became_active":"2024-06-02T23:57:15.325585+0000","last_became_peered":"2024-06-02T23:57:15.325585+0000","last_unstale":"2024-06-02T23:58:55.272469+0000","last_undegraded":"2024-06-02T23:58:55.272469+0000","last_fullsized":"2024-06-02T23:58:55.272469+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:40:37.305875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"88'3","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527211+0000","last_change":"2024-06-02T23:57:12.139155+0000","last_active":"2024-06-02T23:57:56.527211+0000","last_peered":"2024-06-02T23:57:56.527211+0000","last_clean":"2024-06-02T23:57:56.527211+0000","last_became_active":"2024-06-02T23:57:12.138732+0000","last_became_peered":"2024-06-02T23:57:12.138732+0000","last_unstale":"2024-06-02T23:57:56.527211+0000","last_undegraded":"2024-06-02T23:57:56.527211+0000","last_fullsized":"2024-06-02T23:57:56.527211+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:18:29.148439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265509+0000","last_change":"2024-06-02T23:57:15.319510+0000","last_active":"2024-06-02T23:58:55.265509+0000","last_peered":"2024-06-02T23:58:55.265509+0000","last_clean":"2024-06-02T23:58:55.265509+0000","last_became_active":"2024-06-02T23:57:15.319192+0000","last_became_peered":"2024-06-02T23:57:15.319192+0000","last_unstale":"2024-06-02T23:58:55.265509+0000","last_undegraded":"2024-06-02T23:58:55.265509+0000","last_fullsized":"2024-06-02T23:58:55.265509+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:04:04.241833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.658192+0000","last_change":"2024-06-02T23:57:56.657766+0000","last_active":"2024-06-02T23:57:56.658192+0000","last_peered":"2024-06-02T23:57:56.658192+0000","last_clean":"2024-06-02T23:57:56.658192+0000","last_became_active":"2024-06-02T23:57:56.653435+0000","last_became_peered":"2024-06-02T23:57:56.653435+0000","last_unstale":"2024-06-02T23:57:56.658192+0000","last_undegraded":"2024-06-02T23:57:56.658192+0000","last_fullsized":"2024-06-02T23:57:56.658192+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:03:23.594470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273925+0000","last_change":"2024-06-02T23:57:15.320837+0000","last_active":"2024-06-02T23:58:55.273925+0000","last_peered":"2024-06-02T23:58:55.273925+0000","last_clean":"2024-06-02T23:58:55.273925+0000","last_became_active":"2024-06-02T23:57:15.320257+0000","last_became_peered":"2024-06-02T23:57:15.320257+0000","last_unstale":"2024-06-02T23:58:55.273925+0000","last_undegraded":"2024-06-02T23:58:55.273925+0000","last_fullsized":"2024-06-02T23:58:55.273925+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:18:29.638614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'5","reported_seq":209,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:26.398559+0000","last_change":"2024-06-02T23:57:12.405175+0000","last_active":"2024-06-03T00:00:26.398559+0000","last_peered":"2024-06-03T00:00:26.398559+0000","last_clean":"2024-06-03T00:00:26.398559+0000","last_became_active":"2024-06-02T23:57:12.404767+0000","last_became_peered":"2024-06-02T23:57:12.404767+0000","last_unstale":"2024-06-03T00:00:26.398559+0000","last_undegraded":"2024-06-03T00:00:26.398559+0000","last_fullsized":"2024-06-03T00:00:26.398559+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:46:57.421288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":177,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273764+0000","last_change":"2024-06-02T23:57:15.322888+0000","last_active":"2024-06-02T23:58:55.273764+0000","last_peered":"2024-06-02T23:58:55.273764+0000","last_clean":"2024-06-02T23:58:55.273764+0000","last_became_active":"2024-06-02T23:57:15.321982+0000","last_became_peered":"2024-06-02T23:57:15.321982+0000","last_unstale":"2024-06-02T23:58:55.273764+0000","last_undegraded":"2024-06-02T23:58:55.273764+0000","last_fullsized":"2024-06-02T23:58:55.273764+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:51:57.253824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526189+0000","last_change":"2024-06-02T23:57:12.153715+0000","last_active":"2024-06-02T23:57:56.526189+0000","last_peered":"2024-06-02T23:57:56.526189+0000","last_clean":"2024-06-02T23:57:56.526189+0000","last_became_active":"2024-06-02T23:57:12.152544+0000","last_became_peered":"2024-06-02T23:57:12.152544+0000","last_unstale":"2024-06-02T23:57:56.526189+0000","last_undegraded":"2024-06-02T23:57:56.526189+0000","last_fullsized":"2024-06-02T23:57:56.526189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:51:05.874962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.271354+0000","last_change":"2024-06-02T23:57:15.318759+0000","last_active":"2024-06-02T23:58:55.271354+0000","last_peered":"2024-06-02T23:58:55.271354+0000","last_clean":"2024-06-02T23:58:55.271354+0000","last_became_active":"2024-06-02T23:57:15.317942+0000","last_became_peered":"2024-06-02T23:57:15.317942+0000","last_unstale":"2024-06-02T23:58:55.271354+0000","last_undegraded":"2024-06-02T23:58:55.271354+0000","last_fullsized":"2024-06-02T23:58:55.271354+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:39:44.142890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.894529+0000","last_change":"2024-06-02T23:57:56.894131+0000","last_active":"2024-06-02T23:57:56.894529+0000","last_peered":"2024-06-02T23:57:56.894529+0000","last_clean":"2024-06-02T23:57:56.894529+0000","last_became_active":"2024-06-02T23:57:56.889794+0000","last_became_peered":"2024-06-02T23:57:56.889794+0000","last_unstale":"2024-06-02T23:57:56.894529+0000","last_undegraded":"2024-06-02T23:57:56.894529+0000","last_fullsized":"2024-06-02T23:57:56.894529+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:02:41.670419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.266582+0000","last_change":"2024-06-02T23:57:15.324355+0000","last_active":"2024-06-02T23:58:55.266582+0000","last_peered":"2024-06-02T23:58:55.266582+0000","last_clean":"2024-06-02T23:58:55.266582+0000","last_became_active":"2024-06-02T23:57:15.324019+0000","last_became_peered":"2024-06-02T23:57:15.324019+0000","last_unstale":"2024-06-02T23:58:55.266582+0000","last_undegraded":"2024-06-02T23:58:55.266582+0000","last_fullsized":"2024-06-02T23:58:55.266582+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:27:01.927109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267246+0000","last_change":"2024-06-02T23:57:15.326420+0000","last_active":"2024-06-02T23:58:55.267246+0000","last_peered":"2024-06-02T23:58:55.267246+0000","last_clean":"2024-06-02T23:58:55.267246+0000","last_became_active":"2024-06-02T23:57:15.326091+0000","last_became_peered":"2024-06-02T23:57:15.326091+0000","last_unstale":"2024-06-02T23:58:55.267246+0000","last_undegraded":"2024-06-02T23:58:55.267246+0000","last_fullsized":"2024-06-02T23:58:55.267246+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:54:05.355352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.252717+0000","last_change":"2024-06-02T23:57:56.653297+0000","last_active":"2024-06-02T23:58:55.252717+0000","last_peered":"2024-06-02T23:58:55.252717+0000","last_clean":"2024-06-02T23:58:55.252717+0000","last_became_active":"2024-06-02T23:57:56.652874+0000","last_became_peered":"2024-06-02T23:57:56.652874+0000","last_unstale":"2024-06-02T23:58:55.252717+0000","last_undegraded":"2024-06-02T23:58:55.252717+0000","last_fullsized":"2024-06-02T23:58:55.252717+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:27:55.486382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.260044+0000","last_change":"2024-06-02T23:57:15.319266+0000","last_active":"2024-06-02T23:58:55.260044+0000","last_peered":"2024-06-02T23:58:55.260044+0000","last_clean":"2024-06-02T23:58:55.260044+0000","last_became_active":"2024-06-02T23:57:15.317468+0000","last_became_peered":"2024-06-02T23:57:15.317468+0000","last_unstale":"2024-06-02T23:58:55.260044+0000","last_undegraded":"2024-06-02T23:58:55.260044+0000","last_fullsized":"2024-06-02T23:58:55.260044+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:49:53.675524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273976+0000","last_change":"2024-06-02T23:57:15.315798+0000","last_active":"2024-06-02T23:58:55.273976+0000","last_peered":"2024-06-02T23:58:55.273976+0000","last_clean":"2024-06-02T23:58:55.273976+0000","last_became_active":"2024-06-02T23:57:15.314886+0000","last_became_peered":"2024-06-02T23:57:15.314886+0000","last_unstale":"2024-06-02T23:58:55.273976+0000","last_undegraded":"2024-06-02T23:58:55.273976+0000","last_fullsized":"2024-06-02T23:58:55.273976+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:23.042226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259255+0000","last_change":"2024-06-02T23:57:15.315081+0000","last_active":"2024-06-02T23:58:55.259255+0000","last_peered":"2024-06-02T23:58:55.259255+0000","last_clean":"2024-06-02T23:58:55.259255+0000","last_became_active":"2024-06-02T23:57:15.314745+0000","last_became_peered":"2024-06-02T23:57:15.314745+0000","last_unstale":"2024-06-02T23:58:55.259255+0000","last_undegraded":"2024-06-02T23:58:55.259255+0000","last_fullsized":"2024-06-02T23:58:55.259255+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:17:49.506950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.261978+0000","last_change":"2024-06-02T23:57:15.323687+0000","last_active":"2024-06-02T23:58:55.261978+0000","last_peered":"2024-06-02T23:58:55.261978+0000","last_clean":"2024-06-02T23:58:55.261978+0000","last_became_active":"2024-06-02T23:57:15.323345+0000","last_became_peered":"2024-06-02T23:57:15.323345+0000","last_unstale":"2024-06-02T23:58:55.261978+0000","last_undegraded":"2024-06-02T23:58:55.261978+0000","last_fullsized":"2024-06-02T23:58:55.261978+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:47:40.234811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265429+0000","last_change":"2024-06-02T23:57:15.320632+0000","last_active":"2024-06-02T23:58:55.265429+0000","last_peered":"2024-06-02T23:58:55.265429+0000","last_clean":"2024-06-02T23:58:55.265429+0000","last_became_active":"2024-06-02T23:57:15.318427+0000","last_became_peered":"2024-06-02T23:57:15.318427+0000","last_unstale":"2024-06-02T23:58:55.265429+0000","last_undegraded":"2024-06-02T23:58:55.265429+0000","last_fullsized":"2024-06-02T23:58:55.265429+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:04:51.729326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259261+0000","last_change":"2024-06-02T23:57:15.312039+0000","last_active":"2024-06-02T23:58:55.259261+0000","last_peered":"2024-06-02T23:58:55.259261+0000","last_clean":"2024-06-02T23:58:55.259261+0000","last_became_active":"2024-06-02T23:57:15.311275+0000","last_became_peered":"2024-06-02T23:57:15.311275+0000","last_unstale":"2024-06-02T23:58:55.259261+0000","last_undegraded":"2024-06-02T23:58:55.259261+0000","last_fullsized":"2024-06-02T23:58:55.259261+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:50:25.509550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259813+0000","last_change":"2024-06-02T23:57:15.311927+0000","last_active":"2024-06-02T23:58:55.259813+0000","last_peered":"2024-06-02T23:58:55.259813+0000","last_clean":"2024-06-02T23:58:55.259813+0000","last_became_active":"2024-06-02T23:57:15.311484+0000","last_became_peered":"2024-06-02T23:57:15.311484+0000","last_unstale":"2024-06-02T23:58:55.259813+0000","last_undegraded":"2024-06-02T23:58:55.259813+0000","last_fullsized":"2024-06-02T23:58:55.259813+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:29:27.789219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268648+0000","last_change":"2024-06-02T23:57:15.321218+0000","last_active":"2024-06-02T23:58:55.268648+0000","last_peered":"2024-06-02T23:58:55.268648+0000","last_clean":"2024-06-02T23:58:55.268648+0000","last_became_active":"2024-06-02T23:57:15.320884+0000","last_became_peered":"2024-06-02T23:57:15.320884+0000","last_unstale":"2024-06-02T23:58:55.268648+0000","last_undegraded":"2024-06-02T23:58:55.268648+0000","last_fullsized":"2024-06-02T23:58:55.268648+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:57:20.583655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.270664+0000","last_change":"2024-06-02T23:57:15.315213+0000","last_active":"2024-06-02T23:58:55.270664+0000","last_peered":"2024-06-02T23:58:55.270664+0000","last_clean":"2024-06-02T23:58:55.270664+0000","last_became_active":"2024-06-02T23:57:15.314050+0000","last_became_peered":"2024-06-02T23:57:15.314050+0000","last_unstale":"2024-06-02T23:58:55.270664+0000","last_undegraded":"2024-06-02T23:58:55.270664+0000","last_fullsized":"2024-06-02T23:58:55.270664+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:35.214351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265435+0000","last_change":"2024-06-02T23:57:15.313901+0000","last_active":"2024-06-02T23:58:55.265435+0000","last_peered":"2024-06-02T23:58:55.265435+0000","last_clean":"2024-06-02T23:58:55.265435+0000","last_became_active":"2024-06-02T23:57:15.313452+0000","last_became_peered":"2024-06-02T23:57:15.313452+0000","last_unstale":"2024-06-02T23:58:55.265435+0000","last_undegraded":"2024-06-02T23:58:55.265435+0000","last_fullsized":"2024-06-02T23:58:55.265435+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:41:38.366741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.263989+0000","last_change":"2024-06-02T23:57:15.323660+0000","last_active":"2024-06-02T23:58:55.263989+0000","last_peered":"2024-06-02T23:58:55.263989+0000","last_clean":"2024-06-02T23:58:55.263989+0000","last_became_active":"2024-06-02T23:57:15.323316+0000","last_became_peered":"2024-06-02T23:57:15.323316+0000","last_unstale":"2024-06-02T23:58:55.263989+0000","last_undegraded":"2024-06-02T23:58:55.263989+0000","last_fullsized":"2024-06-02T23:58:55.263989+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:33:10.245563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70125,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1797,"num_read_kb":974,"num_write":262,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":214689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383735,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":480586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645372,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28676,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716476,"statfs":{"total":95995035648,"available":95965671424,"internally_reserved":0,"allocated":1699840,"data_stored":1134787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808898,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1019904,"data_stored":480516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070534,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":480894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332171,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28592,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716560,"statfs":{"total":95995035648,"available":95965757440,"internally_reserved":0,"allocated":1613824,"data_stored":1073860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495697,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":1003520,"data_stored":480233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574954,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1073152,"data_stored":548324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738479,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40496,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704656,"statfs":{"total":95995035648,"available":95953567744,"internally_reserved":0,"allocated":1024000,"data_stored":481572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411429,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1089536,"data_stored":544761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182496,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":480058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920859,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":480402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757334,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28604,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716548,"statfs":{"total":95995035648,"available":95965745152,"internally_reserved":0,"allocated":1626112,"data_stored":1073230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-03T00:00:31.892 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-06-03T00:00:31.892 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-03T00:00:32.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.033+0000 7f54e9761640 1 -- 172.21.15.49:0/1275664249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54e41076e0 msgr2=0x7f54e4109b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:32.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.033+0000 7f54e9761640 1 --2- 172.21.15.49:0/1275664249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54e41076e0 0x7f54e4109b30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f54dc009ca0 tx=0x7f54dc02a8c0 comp rx=0 tx=0).stop 2024-06-03T00:00:32.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.033+0000 7f54e9761640 1 -- 172.21.15.49:0/1275664249 shutdown_connections 2024-06-03T00:00:32.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.033+0000 7f54e9761640 1 --2- 172.21.15.49:0/1275664249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54e41076e0 0x7f54e4109b30 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:32.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.033+0000 7f54e9761640 1 --2- 172.21.15.49:0/1275664249 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54e4104db0 0x7f54e41071a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:32.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.033+0000 7f54e9761640 1 --2- 172.21.15.49:0/1275664249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54e4102480 0x7f54e4104870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:32.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.033+0000 7f54e9761640 1 -- 172.21.15.49:0/1275664249 >> 172.21.15.49:0/1275664249 conn(0x7f54e40fbe90 msgr2=0x7f54e40fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:32.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.033+0000 7f54e9761640 1 -- 172.21.15.49:0/1275664249 shutdown_connections 2024-06-03T00:00:32.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.033+0000 7f54e9761640 1 -- 172.21.15.49:0/1275664249 wait complete. 2024-06-03T00:00:32.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.034+0000 7f54e9761640 1 Processor -- start 2024-06-03T00:00:32.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.034+0000 7f54e9761640 1 -- start start 2024-06-03T00:00:32.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.034+0000 7f54e9761640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54e4102480 0x7f54e4199ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:32.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.034+0000 7f54e9761640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54e4104db0 0x7f54e419a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:32.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.034+0000 7f54e9761640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54e41076e0 0x7f54e41a14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:32.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.034+0000 7f54e9761640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f54e410d680 con 0x7f54e4102480 2024-06-03T00:00:32.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.034+0000 7f54e9761640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f54e410d500 con 0x7f54e41076e0 2024-06-03T00:00:32.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.034+0000 7f54e9761640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f54e410d800 con 0x7f54e4104db0 2024-06-03T00:00:32.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.034+0000 7f54e2ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54e4102480 0x7f54e4199ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:32.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.034+0000 7f54e2ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54e4102480 0x7f54e4199ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55406/0 (socket says 172.21.15.49:55406) 2024-06-03T00:00:32.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.034+0000 7f54e2ffd640 1 -- 172.21.15.49:0/1168768540 learned_addr learned my addr 172.21.15.49:0/1168768540 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:32.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.034+0000 7f54e37fe640 1 --2- 172.21.15.49:0/1168768540 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54e41076e0 0x7f54e41a14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:32.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.035+0000 7f54e27fc640 1 --2- 172.21.15.49:0/1168768540 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54e4104db0 0x7f54e419a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:32.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.035+0000 7f54e2ffd640 1 -- 172.21.15.49:0/1168768540 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54e4104db0 msgr2=0x7f54e419a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:32.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.035+0000 7f54e2ffd640 1 --2- 172.21.15.49:0/1168768540 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54e4104db0 0x7f54e419a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:32.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.035+0000 7f54e2ffd640 1 -- 172.21.15.49:0/1168768540 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54e41076e0 msgr2=0x7f54e41a14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:32.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.035+0000 7f54e2ffd640 1 --2- 172.21.15.49:0/1168768540 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54e41076e0 0x7f54e41a14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:32.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.035+0000 7f54e2ffd640 1 -- 172.21.15.49:0/1168768540 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54e41a1b10 con 0x7f54e4102480 2024-06-03T00:00:32.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.035+0000 7f54e2ffd640 1 --2- 172.21.15.49:0/1168768540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54e4102480 0x7f54e4199ef0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f54d400d950 tx=0x7f54d400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:32.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.035+0000 7f54cbfff640 1 -- 172.21.15.49:0/1168768540 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d4017070 con 0x7f54e4102480 2024-06-03T00:00:32.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.035+0000 7f54e9761640 1 -- 172.21.15.49:0/1168768540 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54e41a1e00 con 0x7f54e4102480 2024-06-03T00:00:32.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.035+0000 7f54cbfff640 1 -- 172.21.15.49:0/1168768540 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54d4009c30 con 0x7f54e4102480 2024-06-03T00:00:32.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.035+0000 7f54cbfff640 1 -- 172.21.15.49:0/1168768540 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d400f6b0 con 0x7f54e4102480 2024-06-03T00:00:32.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.035+0000 7f54e9761640 1 -- 172.21.15.49:0/1168768540 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54e41a22c0 con 0x7f54e4102480 2024-06-03T00:00:32.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.036+0000 7f54e9761640 1 -- 172.21.15.49:0/1168768540 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54e41091d0 con 0x7f54e4102480 2024-06-03T00:00:32.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.037+0000 7f54cbfff640 1 -- 172.21.15.49:0/1168768540 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f54d40109d0 con 0x7f54e4102480 2024-06-03T00:00:32.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.038+0000 7f54cbfff640 1 --2- 172.21.15.49:0/1168768540 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f54cc0a2b90 0x7f54cc0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:32.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.038+0000 7f54e27fc640 1 --2- 172.21.15.49:0/1168768540 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f54cc0a2b90 0x7f54cc0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:32.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.038+0000 7f54cbfff640 1 -- 172.21.15.49:0/1168768540 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f54d40cecd0 con 0x7f54e4102480 2024-06-03T00:00:32.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.038+0000 7f54e27fc640 1 --2- 172.21.15.49:0/1168768540 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f54cc0a2b90 0x7f54cc0a5050 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f54d8005fd0 tx=0x7f54d8005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:32.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.042+0000 7f54cbfff640 1 -- 172.21.15.49:0/1168768540 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f54d40d4020 con 0x7f54e4102480 2024-06-03T00:00:32.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.226+0000 7f54e9761640 1 -- 172.21.15.49:0/1168768540 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f54e4061de0 con 0x7f54cc0a2b90 2024-06-03T00:00:32.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.234+0000 7f54cbfff640 1 -- 172.21.15.49:0/1168768540 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258894 (secure 0 0 0) 0x7f54e4061de0 con 0x7f54cc0a2b90 2024-06-03T00:00:32.237 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:00:32.239 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-06-03T00:00:32.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.237+0000 7f54e9761640 1 -- 172.21.15.49:0/1168768540 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f54cc0a2b90 msgr2=0x7f54cc0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:32.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.237+0000 7f54e9761640 1 --2- 172.21.15.49:0/1168768540 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f54cc0a2b90 0x7f54cc0a5050 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f54d8005fd0 tx=0x7f54d8005850 comp rx=0 tx=0).stop 2024-06-03T00:00:32.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.237+0000 7f54e9761640 1 -- 172.21.15.49:0/1168768540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54e4102480 msgr2=0x7f54e4199ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:32.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.237+0000 7f54e9761640 1 --2- 172.21.15.49:0/1168768540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54e4102480 0x7f54e4199ef0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f54d400d950 tx=0x7f54d400de10 comp rx=0 tx=0).stop 2024-06-03T00:00:32.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.237+0000 7f54e9761640 1 -- 172.21.15.49:0/1168768540 shutdown_connections 2024-06-03T00:00:32.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.237+0000 7f54e9761640 1 --2- 172.21.15.49:0/1168768540 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f54cc0a2b90 0x7f54cc0a5050 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:32.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.237+0000 7f54e9761640 1 --2- 172.21.15.49:0/1168768540 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54e41076e0 0x7f54e41a14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:32.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.237+0000 7f54e9761640 1 --2- 172.21.15.49:0/1168768540 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54e4104db0 0x7f54e419a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:32.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.237+0000 7f54e9761640 1 --2- 172.21.15.49:0/1168768540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54e4102480 0x7f54e4199ef0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:32.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.237+0000 7f54e9761640 1 -- 172.21.15.49:0/1168768540 >> 172.21.15.49:0/1168768540 conn(0x7f54e40fbe90 msgr2=0x7f54e4101ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:32.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.237+0000 7f54e9761640 1 -- 172.21.15.49:0/1168768540 shutdown_connections 2024-06-03T00:00:32.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:32.237+0000 7f54e9761640 1 -- 172.21.15.49:0/1168768540 wait complete. 2024-06-03T00:00:32.247 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":398,"stamp":"2024-06-03T00:00:31.286965+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660727,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1923,"num_read_kb":1083,"num_write":445,"num_write_kb":3089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":1180736,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":863,"ondisk_log_size":863,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375484,"kb_used_data":13852,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124566340,"statfs":{"total":1151940427776,"available":1151555932160,"internally_reserved":0,"allocated":14184448,"data_stored":7739223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":57,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003136"},"pg_stats":[{"pgid":"3.3f","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.275149+0000","last_change":"2024-06-02T23:57:15.321542+0000","last_active":"2024-06-02T23:58:55.275149+0000","last_peered":"2024-06-02T23:58:55.275149+0000","last_clean":"2024-06-02T23:58:55.275149+0000","last_became_active":"2024-06-02T23:57:15.321129+0000","last_became_peered":"2024-06-02T23:57:15.321129+0000","last_unstale":"2024-06-02T23:58:55.275149+0000","last_undegraded":"2024-06-02T23:58:55.275149+0000","last_fullsized":"2024-06-02T23:58:55.275149+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:35:50.218316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272859+0000","last_change":"2024-06-02T23:57:15.327432+0000","last_active":"2024-06-02T23:58:55.272859+0000","last_peered":"2024-06-02T23:58:55.272859+0000","last_clean":"2024-06-02T23:58:55.272859+0000","last_became_active":"2024-06-02T23:57:15.326759+0000","last_became_peered":"2024-06-02T23:57:15.326759+0000","last_unstale":"2024-06-02T23:58:55.272859+0000","last_undegraded":"2024-06-02T23:58:55.272859+0000","last_fullsized":"2024-06-02T23:58:55.272859+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:42:20.473216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.274694+0000","last_change":"2024-06-02T23:57:15.323721+0000","last_active":"2024-06-02T23:58:55.274694+0000","last_peered":"2024-06-02T23:58:55.274694+0000","last_clean":"2024-06-02T23:58:55.274694+0000","last_became_active":"2024-06-02T23:57:15.321277+0000","last_became_peered":"2024-06-02T23:57:15.321277+0000","last_unstale":"2024-06-02T23:58:55.274694+0000","last_undegraded":"2024-06-02T23:58:55.274694+0000","last_fullsized":"2024-06-02T23:58:55.274694+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:34:31.667999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.258319+0000","last_change":"2024-06-02T23:57:15.323769+0000","last_active":"2024-06-02T23:58:55.258319+0000","last_peered":"2024-06-02T23:58:55.258319+0000","last_clean":"2024-06-02T23:58:55.258319+0000","last_became_active":"2024-06-02T23:57:15.323406+0000","last_became_peered":"2024-06-02T23:57:15.323406+0000","last_unstale":"2024-06-02T23:58:55.258319+0000","last_undegraded":"2024-06-02T23:58:55.258319+0000","last_fullsized":"2024-06-02T23:58:55.258319+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:51:27.456210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.258510+0000","last_change":"2024-06-02T23:57:56.531404+0000","last_active":"2024-06-02T23:58:55.258510+0000","last_peered":"2024-06-02T23:58:55.258510+0000","last_clean":"2024-06-02T23:58:55.258510+0000","last_became_active":"2024-06-02T23:57:56.530952+0000","last_became_peered":"2024-06-02T23:57:56.530952+0000","last_unstale":"2024-06-02T23:58:55.258510+0000","last_undegraded":"2024-06-02T23:58:55.258510+0000","last_fullsized":"2024-06-02T23:58:55.258510+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:39:30.405113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268533+0000","last_change":"2024-06-02T23:57:15.320843+0000","last_active":"2024-06-02T23:58:55.268533+0000","last_peered":"2024-06-02T23:58:55.268533+0000","last_clean":"2024-06-02T23:58:55.268533+0000","last_became_active":"2024-06-02T23:57:15.320472+0000","last_became_peered":"2024-06-02T23:57:15.320472+0000","last_unstale":"2024-06-02T23:58:55.268533+0000","last_undegraded":"2024-06-02T23:58:55.268533+0000","last_fullsized":"2024-06-02T23:58:55.268533+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:49:02.620777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.271511+0000","last_change":"2024-06-02T23:57:15.321799+0000","last_active":"2024-06-02T23:58:55.271511+0000","last_peered":"2024-06-02T23:58:55.271511+0000","last_clean":"2024-06-02T23:58:55.271511+0000","last_became_active":"2024-06-02T23:57:15.321379+0000","last_became_peered":"2024-06-02T23:57:15.321379+0000","last_unstale":"2024-06-02T23:58:55.271511+0000","last_undegraded":"2024-06-02T23:58:55.271511+0000","last_fullsized":"2024-06-02T23:58:55.271511+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:36:56.404936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268859+0000","last_change":"2024-06-02T23:57:15.318771+0000","last_active":"2024-06-02T23:58:55.268859+0000","last_peered":"2024-06-02T23:58:55.268859+0000","last_clean":"2024-06-02T23:58:55.268859+0000","last_became_active":"2024-06-02T23:57:15.318420+0000","last_became_peered":"2024-06-02T23:57:15.318420+0000","last_unstale":"2024-06-02T23:58:55.268859+0000","last_undegraded":"2024-06-02T23:58:55.268859+0000","last_fullsized":"2024-06-02T23:58:55.268859+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:07:53.769443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.274516+0000","last_change":"2024-06-02T23:57:15.318989+0000","last_active":"2024-06-02T23:58:55.274516+0000","last_peered":"2024-06-02T23:58:55.274516+0000","last_clean":"2024-06-02T23:58:55.274516+0000","last_became_active":"2024-06-02T23:57:15.318424+0000","last_became_peered":"2024-06-02T23:57:15.318424+0000","last_unstale":"2024-06-02T23:58:55.274516+0000","last_undegraded":"2024-06-02T23:58:55.274516+0000","last_fullsized":"2024-06-02T23:58:55.274516+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:30:47.634662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265217+0000","last_change":"2024-06-02T23:57:15.326251+0000","last_active":"2024-06-02T23:58:55.265217+0000","last_peered":"2024-06-02T23:58:55.265217+0000","last_clean":"2024-06-02T23:58:55.265217+0000","last_became_active":"2024-06-02T23:57:15.325890+0000","last_became_peered":"2024-06-02T23:57:15.325890+0000","last_unstale":"2024-06-02T23:58:55.265217+0000","last_undegraded":"2024-06-02T23:58:55.265217+0000","last_fullsized":"2024-06-02T23:58:55.265217+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:18:54.871410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.274001+0000","last_change":"2024-06-02T23:57:15.325364+0000","last_active":"2024-06-02T23:58:55.274001+0000","last_peered":"2024-06-02T23:58:55.274001+0000","last_clean":"2024-06-02T23:58:55.274001+0000","last_became_active":"2024-06-02T23:57:15.324987+0000","last_became_peered":"2024-06-02T23:57:15.324987+0000","last_unstale":"2024-06-02T23:58:55.274001+0000","last_undegraded":"2024-06-02T23:58:55.274001+0000","last_fullsized":"2024-06-02T23:58:55.274001+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:59:11.827263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265434+0000","last_change":"2024-06-02T23:57:15.328027+0000","last_active":"2024-06-02T23:58:55.265434+0000","last_peered":"2024-06-02T23:58:55.265434+0000","last_clean":"2024-06-02T23:58:55.265434+0000","last_became_active":"2024-06-02T23:57:15.327608+0000","last_became_peered":"2024-06-02T23:57:15.327608+0000","last_unstale":"2024-06-02T23:58:55.265434+0000","last_undegraded":"2024-06-02T23:58:55.265434+0000","last_fullsized":"2024-06-02T23:58:55.265434+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:09:42.152689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262861+0000","last_change":"2024-06-02T23:57:15.323095+0000","last_active":"2024-06-02T23:58:55.262861+0000","last_peered":"2024-06-02T23:58:55.262861+0000","last_clean":"2024-06-02T23:58:55.262861+0000","last_became_active":"2024-06-02T23:57:15.322755+0000","last_became_peered":"2024-06-02T23:57:15.322755+0000","last_unstale":"2024-06-02T23:58:55.262861+0000","last_undegraded":"2024-06-02T23:58:55.262861+0000","last_fullsized":"2024-06-02T23:58:55.262861+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:43:53.195192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272339+0000","last_change":"2024-06-02T23:57:15.327437+0000","last_active":"2024-06-02T23:58:55.272339+0000","last_peered":"2024-06-02T23:58:55.272339+0000","last_clean":"2024-06-02T23:58:55.272339+0000","last_became_active":"2024-06-02T23:57:15.326974+0000","last_became_peered":"2024-06-02T23:57:15.326974+0000","last_unstale":"2024-06-02T23:58:55.272339+0000","last_undegraded":"2024-06-02T23:58:55.272339+0000","last_fullsized":"2024-06-02T23:58:55.272339+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:20:44.978213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273334+0000","last_change":"2024-06-02T23:57:15.325414+0000","last_active":"2024-06-02T23:58:55.273334+0000","last_peered":"2024-06-02T23:58:55.273334+0000","last_clean":"2024-06-02T23:58:55.273334+0000","last_became_active":"2024-06-02T23:57:15.325033+0000","last_became_peered":"2024-06-02T23:57:15.325033+0000","last_unstale":"2024-06-02T23:58:55.273334+0000","last_undegraded":"2024-06-02T23:58:55.273334+0000","last_fullsized":"2024-06-02T23:58:55.273334+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:27:14.536646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272688+0000","last_change":"2024-06-02T23:57:15.315833+0000","last_active":"2024-06-02T23:58:55.272688+0000","last_peered":"2024-06-02T23:58:55.272688+0000","last_clean":"2024-06-02T23:58:55.272688+0000","last_became_active":"2024-06-02T23:57:15.315355+0000","last_became_peered":"2024-06-02T23:57:15.315355+0000","last_unstale":"2024-06-02T23:58:55.272688+0000","last_undegraded":"2024-06-02T23:58:55.272688+0000","last_fullsized":"2024-06-02T23:58:55.272688+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:52:05.915828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.275143+0000","last_change":"2024-06-02T23:57:15.322407+0000","last_active":"2024-06-02T23:58:55.275143+0000","last_peered":"2024-06-02T23:58:55.275143+0000","last_clean":"2024-06-02T23:58:55.275143+0000","last_became_active":"2024-06-02T23:57:15.322090+0000","last_became_peered":"2024-06-02T23:57:15.322090+0000","last_unstale":"2024-06-02T23:58:55.275143+0000","last_undegraded":"2024-06-02T23:58:55.275143+0000","last_fullsized":"2024-06-02T23:58:55.275143+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:08:48.071192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268594+0000","last_change":"2024-06-02T23:57:15.327331+0000","last_active":"2024-06-02T23:58:55.268594+0000","last_peered":"2024-06-02T23:58:55.268594+0000","last_clean":"2024-06-02T23:58:55.268594+0000","last_became_active":"2024-06-02T23:57:15.326863+0000","last_became_peered":"2024-06-02T23:57:15.326863+0000","last_unstale":"2024-06-02T23:58:55.268594+0000","last_undegraded":"2024-06-02T23:58:55.268594+0000","last_fullsized":"2024-06-02T23:58:55.268594+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:45:05.443751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.261047+0000","last_change":"2024-06-02T23:57:15.313008+0000","last_active":"2024-06-02T23:58:55.261047+0000","last_peered":"2024-06-02T23:58:55.261047+0000","last_clean":"2024-06-02T23:58:55.261047+0000","last_became_active":"2024-06-02T23:57:15.312322+0000","last_became_peered":"2024-06-02T23:57:15.312322+0000","last_unstale":"2024-06-02T23:58:55.261047+0000","last_undegraded":"2024-06-02T23:58:55.261047+0000","last_fullsized":"2024-06-02T23:58:55.261047+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:54:03.744964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":217,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:28.407878+0000","last_change":"2024-06-02T23:57:12.153410+0000","last_active":"2024-06-03T00:00:28.407878+0000","last_peered":"2024-06-03T00:00:28.407878+0000","last_clean":"2024-06-03T00:00:28.407878+0000","last_became_active":"2024-06-02T23:57:12.153065+0000","last_became_peered":"2024-06-02T23:57:12.153065+0000","last_unstale":"2024-06-03T00:00:28.407878+0000","last_undegraded":"2024-06-03T00:00:28.407878+0000","last_fullsized":"2024-06-03T00:00:28.407878+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:45:30.058961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.258496+0000","last_change":"2024-06-02T23:57:15.314168+0000","last_active":"2024-06-02T23:58:55.258496+0000","last_peered":"2024-06-02T23:58:55.258496+0000","last_clean":"2024-06-02T23:58:55.258496+0000","last_became_active":"2024-06-02T23:57:15.313838+0000","last_became_peered":"2024-06-02T23:57:15.313838+0000","last_unstale":"2024-06-02T23:58:55.258496+0000","last_undegraded":"2024-06-02T23:58:55.258496+0000","last_fullsized":"2024-06-02T23:58:55.258496+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:56:14.137471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526742+0000","last_change":"2024-06-02T23:57:12.305448+0000","last_active":"2024-06-02T23:57:56.526742+0000","last_peered":"2024-06-02T23:57:56.526742+0000","last_clean":"2024-06-02T23:57:56.526742+0000","last_became_active":"2024-06-02T23:57:12.305080+0000","last_became_peered":"2024-06-02T23:57:12.305080+0000","last_unstale":"2024-06-02T23:57:56.526742+0000","last_undegraded":"2024-06-02T23:57:56.526742+0000","last_fullsized":"2024-06-02T23:57:56.526742+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:20:18.660943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.275386+0000","last_change":"2024-06-02T23:57:15.321660+0000","last_active":"2024-06-02T23:58:55.275386+0000","last_peered":"2024-06-02T23:58:55.275386+0000","last_clean":"2024-06-02T23:58:55.275386+0000","last_became_active":"2024-06-02T23:57:15.321304+0000","last_became_peered":"2024-06-02T23:57:15.321304+0000","last_unstale":"2024-06-02T23:58:55.275386+0000","last_undegraded":"2024-06-02T23:58:55.275386+0000","last_fullsized":"2024-06-02T23:58:55.275386+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:10:10.933291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:58.169787+0000","last_change":"2024-06-02T23:57:56.544458+0000","last_active":"2024-06-02T23:57:58.169787+0000","last_peered":"2024-06-02T23:57:58.169787+0000","last_clean":"2024-06-02T23:57:58.169787+0000","last_became_active":"2024-06-02T23:57:56.532838+0000","last_became_peered":"2024-06-02T23:57:56.532838+0000","last_unstale":"2024-06-02T23:57:58.169787+0000","last_undegraded":"2024-06-02T23:57:58.169787+0000","last_fullsized":"2024-06-02T23:57:58.169787+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:27:44.700493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272537+0000","last_change":"2024-06-02T23:57:15.328944+0000","last_active":"2024-06-02T23:58:55.272537+0000","last_peered":"2024-06-02T23:58:55.272537+0000","last_clean":"2024-06-02T23:58:55.272537+0000","last_became_active":"2024-06-02T23:57:15.328531+0000","last_became_peered":"2024-06-02T23:57:15.328531+0000","last_unstale":"2024-06-02T23:58:55.272537+0000","last_undegraded":"2024-06-02T23:58:55.272537+0000","last_fullsized":"2024-06-02T23:58:55.272537+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:48:19.709989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528536+0000","last_change":"2024-06-02T23:57:12.153967+0000","last_active":"2024-06-02T23:57:56.528536+0000","last_peered":"2024-06-02T23:57:56.528536+0000","last_clean":"2024-06-02T23:57:56.528536+0000","last_became_active":"2024-06-02T23:57:12.153600+0000","last_became_peered":"2024-06-02T23:57:12.153600+0000","last_unstale":"2024-06-02T23:57:56.528536+0000","last_undegraded":"2024-06-02T23:57:56.528536+0000","last_fullsized":"2024-06-02T23:57:56.528536+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:47:58.761573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267401+0000","last_change":"2024-06-02T23:57:15.318089+0000","last_active":"2024-06-02T23:58:55.267401+0000","last_peered":"2024-06-02T23:58:55.267401+0000","last_clean":"2024-06-02T23:58:55.267401+0000","last_became_active":"2024-06-02T23:57:15.316494+0000","last_became_peered":"2024-06-02T23:57:15.316494+0000","last_unstale":"2024-06-02T23:58:55.267401+0000","last_undegraded":"2024-06-02T23:58:55.267401+0000","last_fullsized":"2024-06-02T23:58:55.267401+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:21:15.839255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"90'7","reported_seq":214,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:27.400352+0000","last_change":"2024-06-02T23:57:12.153624+0000","last_active":"2024-06-03T00:00:27.400352+0000","last_peered":"2024-06-03T00:00:27.400352+0000","last_clean":"2024-06-03T00:00:27.400352+0000","last_became_active":"2024-06-02T23:57:12.152712+0000","last_became_peered":"2024-06-02T23:57:12.152712+0000","last_unstale":"2024-06-03T00:00:27.400352+0000","last_undegraded":"2024-06-03T00:00:27.400352+0000","last_fullsized":"2024-06-03T00:00:27.400352+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:14:50.236213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":180,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259432+0000","last_change":"2024-06-02T23:57:15.325293+0000","last_active":"2024-06-02T23:58:55.259432+0000","last_peered":"2024-06-02T23:58:55.259432+0000","last_clean":"2024-06-02T23:58:55.259432+0000","last_became_active":"2024-06-02T23:57:15.324967+0000","last_became_peered":"2024-06-02T23:57:15.324967+0000","last_unstale":"2024-06-02T23:58:55.259432+0000","last_undegraded":"2024-06-02T23:58:55.259432+0000","last_fullsized":"2024-06-02T23:58:55.259432+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:21:23.634118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.735981+0000","last_change":"2024-06-02T23:57:12.155927+0000","last_active":"2024-06-02T23:57:56.735981+0000","last_peered":"2024-06-02T23:57:56.735981+0000","last_clean":"2024-06-02T23:57:56.735981+0000","last_became_active":"2024-06-02T23:57:12.155505+0000","last_became_peered":"2024-06-02T23:57:12.155505+0000","last_unstale":"2024-06-02T23:57:56.735981+0000","last_undegraded":"2024-06-02T23:57:56.735981+0000","last_fullsized":"2024-06-02T23:57:56.735981+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:47.555747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262458+0000","last_change":"2024-06-02T23:57:15.321796+0000","last_active":"2024-06-02T23:58:55.262458+0000","last_peered":"2024-06-02T23:58:55.262458+0000","last_clean":"2024-06-02T23:58:55.262458+0000","last_became_active":"2024-06-02T23:57:15.320850+0000","last_became_peered":"2024-06-02T23:57:15.320850+0000","last_unstale":"2024-06-02T23:58:55.262458+0000","last_undegraded":"2024-06-02T23:58:55.262458+0000","last_fullsized":"2024-06-02T23:58:55.262458+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:04:10.991920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.523859+0000","last_change":"2024-06-02T23:57:12.146589+0000","last_active":"2024-06-02T23:57:56.523859+0000","last_peered":"2024-06-02T23:57:56.523859+0000","last_clean":"2024-06-02T23:57:56.523859+0000","last_became_active":"2024-06-02T23:57:12.146224+0000","last_became_peered":"2024-06-02T23:57:12.146224+0000","last_unstale":"2024-06-02T23:57:56.523859+0000","last_undegraded":"2024-06-02T23:57:56.523859+0000","last_fullsized":"2024-06-02T23:57:56.523859+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:17:31.250585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268843+0000","last_change":"2024-06-02T23:57:15.315553+0000","last_active":"2024-06-02T23:58:55.268843+0000","last_peered":"2024-06-02T23:58:55.268843+0000","last_clean":"2024-06-02T23:58:55.268843+0000","last_became_active":"2024-06-02T23:57:15.315217+0000","last_became_peered":"2024-06-02T23:57:15.315217+0000","last_unstale":"2024-06-02T23:58:55.268843+0000","last_undegraded":"2024-06-02T23:58:55.268843+0000","last_fullsized":"2024-06-02T23:58:55.268843+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:00:23.097949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.525158+0000","last_change":"2024-06-02T23:57:12.156971+0000","last_active":"2024-06-02T23:57:56.525158+0000","last_peered":"2024-06-02T23:57:56.525158+0000","last_clean":"2024-06-02T23:57:56.525158+0000","last_became_active":"2024-06-02T23:57:12.156379+0000","last_became_peered":"2024-06-02T23:57:12.156379+0000","last_unstale":"2024-06-02T23:57:56.525158+0000","last_undegraded":"2024-06-02T23:57:56.525158+0000","last_fullsized":"2024-06-02T23:57:56.525158+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:28:50.057736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.266692+0000","last_change":"2024-06-02T23:57:15.313985+0000","last_active":"2024-06-02T23:58:55.266692+0000","last_peered":"2024-06-02T23:58:55.266692+0000","last_clean":"2024-06-02T23:58:55.266692+0000","last_became_active":"2024-06-02T23:57:15.313668+0000","last_became_peered":"2024-06-02T23:57:15.313668+0000","last_unstale":"2024-06-02T23:58:55.266692+0000","last_undegraded":"2024-06-02T23:58:55.266692+0000","last_fullsized":"2024-06-02T23:58:55.266692+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:10:56.560660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"90'5","reported_seq":380,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:26.397977+0000","last_change":"2024-06-02T23:57:12.156025+0000","last_active":"2024-06-03T00:00:26.397977+0000","last_peered":"2024-06-03T00:00:26.397977+0000","last_clean":"2024-06-03T00:00:26.397977+0000","last_became_active":"2024-06-02T23:57:12.155609+0000","last_became_peered":"2024-06-02T23:57:12.155609+0000","last_unstale":"2024-06-03T00:00:26.397977+0000","last_undegraded":"2024-06-03T00:00:26.397977+0000","last_fullsized":"2024-06-03T00:00:26.397977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:27:48.953456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":348,"num_read_kb":348,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272606+0000","last_change":"2024-06-02T23:57:15.329711+0000","last_active":"2024-06-02T23:58:55.272606+0000","last_peered":"2024-06-02T23:58:55.272606+0000","last_clean":"2024-06-02T23:58:55.272606+0000","last_became_active":"2024-06-02T23:57:15.329284+0000","last_became_peered":"2024-06-02T23:57:15.329284+0000","last_unstale":"2024-06-02T23:58:55.272606+0000","last_undegraded":"2024-06-02T23:58:55.272606+0000","last_fullsized":"2024-06-02T23:58:55.272606+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:58:06.165152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.529073+0000","last_change":"2024-06-02T23:57:12.156949+0000","last_active":"2024-06-02T23:57:56.529073+0000","last_peered":"2024-06-02T23:57:56.529073+0000","last_clean":"2024-06-02T23:57:56.529073+0000","last_became_active":"2024-06-02T23:57:12.156558+0000","last_became_peered":"2024-06-02T23:57:12.156558+0000","last_unstale":"2024-06-02T23:57:56.529073+0000","last_undegraded":"2024-06-02T23:57:56.529073+0000","last_fullsized":"2024-06-02T23:57:56.529073+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:05:57.658900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273919+0000","last_change":"2024-06-02T23:57:15.318638+0000","last_active":"2024-06-02T23:58:55.273919+0000","last_peered":"2024-06-02T23:58:55.273919+0000","last_clean":"2024-06-02T23:58:55.273919+0000","last_became_active":"2024-06-02T23:57:15.318321+0000","last_became_peered":"2024-06-02T23:57:15.318321+0000","last_unstale":"2024-06-02T23:58:55.273919+0000","last_undegraded":"2024-06-02T23:58:55.273919+0000","last_fullsized":"2024-06-02T23:58:55.273919+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:21:57.877235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526151+0000","last_change":"2024-06-02T23:57:12.306278+0000","last_active":"2024-06-02T23:57:56.526151+0000","last_peered":"2024-06-02T23:57:56.526151+0000","last_clean":"2024-06-02T23:57:56.526151+0000","last_became_active":"2024-06-02T23:57:12.305885+0000","last_became_peered":"2024-06-02T23:57:12.305885+0000","last_unstale":"2024-06-02T23:57:56.526151+0000","last_undegraded":"2024-06-02T23:57:56.526151+0000","last_fullsized":"2024-06-02T23:57:56.526151+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:05:07.723501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.266773+0000","last_change":"2024-06-02T23:57:15.322489+0000","last_active":"2024-06-02T23:58:55.266773+0000","last_peered":"2024-06-02T23:58:55.266773+0000","last_clean":"2024-06-02T23:58:55.266773+0000","last_became_active":"2024-06-02T23:57:15.322131+0000","last_became_peered":"2024-06-02T23:57:15.322131+0000","last_unstale":"2024-06-02T23:58:55.266773+0000","last_undegraded":"2024-06-02T23:58:55.266773+0000","last_fullsized":"2024-06-02T23:58:55.266773+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:34:43.362338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"90'38","reported_seq":426,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:26.398377+0000","last_change":"2024-06-02T23:57:12.156920+0000","last_active":"2024-06-03T00:00:26.398377+0000","last_peered":"2024-06-03T00:00:26.398377+0000","last_clean":"2024-06-03T00:00:26.398377+0000","last_became_active":"2024-06-02T23:57:12.156494+0000","last_became_peered":"2024-06-02T23:57:12.156494+0000","last_unstale":"2024-06-03T00:00:26.398377+0000","last_undegraded":"2024-06-03T00:00:26.398377+0000","last_fullsized":"2024-06-03T00:00:26.398377+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:49:56.458730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62864,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":361,"num_read_kb":242,"num_write":40,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265549+0000","last_change":"2024-06-02T23:57:15.328502+0000","last_active":"2024-06-02T23:58:55.265549+0000","last_peered":"2024-06-02T23:58:55.265549+0000","last_clean":"2024-06-02T23:58:55.265549+0000","last_became_active":"2024-06-02T23:57:15.328174+0000","last_became_peered":"2024-06-02T23:57:15.328174+0000","last_unstale":"2024-06-02T23:58:55.265549+0000","last_undegraded":"2024-06-02T23:58:55.265549+0000","last_fullsized":"2024-06-02T23:58:55.265549+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:58:33.355397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527385+0000","last_change":"2024-06-02T23:57:12.154204+0000","last_active":"2024-06-02T23:57:56.527385+0000","last_peered":"2024-06-02T23:57:56.527385+0000","last_clean":"2024-06-02T23:57:56.527385+0000","last_became_active":"2024-06-02T23:57:12.153412+0000","last_became_peered":"2024-06-02T23:57:12.153412+0000","last_unstale":"2024-06-02T23:57:56.527385+0000","last_undegraded":"2024-06-02T23:57:56.527385+0000","last_fullsized":"2024-06-02T23:57:56.527385+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:15.472279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262255+0000","last_change":"2024-06-02T23:57:15.314274+0000","last_active":"2024-06-02T23:58:55.262255+0000","last_peered":"2024-06-02T23:58:55.262255+0000","last_clean":"2024-06-02T23:58:55.262255+0000","last_became_active":"2024-06-02T23:57:15.313946+0000","last_became_peered":"2024-06-02T23:57:15.313946+0000","last_unstale":"2024-06-02T23:58:55.262255+0000","last_undegraded":"2024-06-02T23:58:55.262255+0000","last_fullsized":"2024-06-02T23:58:55.262255+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:07.909977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.525241+0000","last_change":"2024-06-02T23:57:12.156767+0000","last_active":"2024-06-02T23:57:56.525241+0000","last_peered":"2024-06-02T23:57:56.525241+0000","last_clean":"2024-06-02T23:57:56.525241+0000","last_became_active":"2024-06-02T23:57:12.156346+0000","last_became_peered":"2024-06-02T23:57:12.156346+0000","last_unstale":"2024-06-02T23:57:56.525241+0000","last_undegraded":"2024-06-02T23:57:56.525241+0000","last_fullsized":"2024-06-02T23:57:56.525241+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:29:45.801904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267668+0000","last_change":"2024-06-02T23:57:15.322676+0000","last_active":"2024-06-02T23:58:55.267668+0000","last_peered":"2024-06-02T23:58:55.267668+0000","last_clean":"2024-06-02T23:58:55.267668+0000","last_became_active":"2024-06-02T23:57:15.319429+0000","last_became_peered":"2024-06-02T23:57:15.319429+0000","last_unstale":"2024-06-02T23:58:55.267668+0000","last_undegraded":"2024-06-02T23:58:55.267668+0000","last_fullsized":"2024-06-02T23:58:55.267668+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:48:15.984818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'6","reported_seq":212,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:27.440240+0000","last_change":"2024-06-02T23:57:12.153925+0000","last_active":"2024-06-03T00:00:27.440240+0000","last_peered":"2024-06-03T00:00:27.440240+0000","last_clean":"2024-06-03T00:00:27.440240+0000","last_became_active":"2024-06-02T23:57:12.152990+0000","last_became_peered":"2024-06-02T23:57:12.152990+0000","last_unstale":"2024-06-03T00:00:27.440240+0000","last_undegraded":"2024-06-03T00:00:27.440240+0000","last_fullsized":"2024-06-03T00:00:27.440240+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:32:21.845946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":896,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":180,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.270077+0000","last_change":"2024-06-02T23:57:15.327662+0000","last_active":"2024-06-02T23:58:55.270077+0000","last_peered":"2024-06-02T23:58:55.270077+0000","last_clean":"2024-06-02T23:58:55.270077+0000","last_became_active":"2024-06-02T23:57:15.327320+0000","last_became_peered":"2024-06-02T23:57:15.327320+0000","last_unstale":"2024-06-02T23:58:55.270077+0000","last_undegraded":"2024-06-02T23:58:55.270077+0000","last_fullsized":"2024-06-02T23:58:55.270077+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:44:37.561533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528426+0000","last_change":"2024-06-02T23:57:12.306856+0000","last_active":"2024-06-02T23:57:56.528426+0000","last_peered":"2024-06-02T23:57:56.528426+0000","last_clean":"2024-06-02T23:57:56.528426+0000","last_became_active":"2024-06-02T23:57:12.306476+0000","last_became_peered":"2024-06-02T23:57:12.306476+0000","last_unstale":"2024-06-02T23:57:56.528426+0000","last_undegraded":"2024-06-02T23:57:56.528426+0000","last_fullsized":"2024-06-02T23:57:56.528426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:30:22.839589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.266843+0000","last_change":"2024-06-02T23:57:56.890015+0000","last_active":"2024-06-02T23:58:55.266843+0000","last_peered":"2024-06-02T23:58:55.266843+0000","last_clean":"2024-06-02T23:58:55.266843+0000","last_became_active":"2024-06-02T23:57:56.889591+0000","last_became_peered":"2024-06-02T23:57:56.889591+0000","last_unstale":"2024-06-02T23:58:55.266843+0000","last_undegraded":"2024-06-02T23:58:55.266843+0000","last_fullsized":"2024-06-02T23:58:55.266843+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:14:37.851207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'3","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:59:28.633344+0000","last_change":"2024-06-02T23:57:12.146690+0000","last_active":"2024-06-02T23:59:28.633344+0000","last_peered":"2024-06-02T23:59:28.633344+0000","last_clean":"2024-06-02T23:59:28.633344+0000","last_became_active":"2024-06-02T23:57:12.146372+0000","last_became_peered":"2024-06-02T23:57:12.146372+0000","last_unstale":"2024-06-02T23:59:28.633344+0000","last_undegraded":"2024-06-02T23:59:28.633344+0000","last_fullsized":"2024-06-02T23:59:28.633344+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:45:04.421365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267278+0000","last_change":"2024-06-02T23:57:15.320938+0000","last_active":"2024-06-02T23:58:55.267278+0000","last_peered":"2024-06-02T23:58:55.267278+0000","last_clean":"2024-06-02T23:58:55.267278+0000","last_became_active":"2024-06-02T23:57:15.320567+0000","last_became_peered":"2024-06-02T23:57:15.320567+0000","last_unstale":"2024-06-02T23:58:55.267278+0000","last_undegraded":"2024-06-02T23:58:55.267278+0000","last_fullsized":"2024-06-02T23:58:55.267278+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:04:29.736387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"88'1","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527764+0000","last_change":"2024-06-02T23:57:12.307020+0000","last_active":"2024-06-02T23:57:56.527764+0000","last_peered":"2024-06-02T23:57:56.527764+0000","last_clean":"2024-06-02T23:57:56.527764+0000","last_became_active":"2024-06-02T23:57:12.306650+0000","last_became_peered":"2024-06-02T23:57:12.306650+0000","last_unstale":"2024-06-02T23:57:56.527764+0000","last_undegraded":"2024-06-02T23:57:56.527764+0000","last_fullsized":"2024-06-02T23:57:56.527764+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:18:03.679704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265006+0000","last_change":"2024-06-02T23:57:15.319300+0000","last_active":"2024-06-02T23:58:55.265006+0000","last_peered":"2024-06-02T23:58:55.265006+0000","last_clean":"2024-06-02T23:58:55.265006+0000","last_became_active":"2024-06-02T23:57:15.318903+0000","last_became_peered":"2024-06-02T23:57:15.318903+0000","last_unstale":"2024-06-02T23:58:55.265006+0000","last_undegraded":"2024-06-02T23:58:55.265006+0000","last_fullsized":"2024-06-02T23:58:55.265006+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:38:25.521337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":210,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:28.408443+0000","last_change":"2024-06-02T23:57:12.155260+0000","last_active":"2024-06-03T00:00:28.408443+0000","last_peered":"2024-06-03T00:00:28.408443+0000","last_clean":"2024-06-03T00:00:28.408443+0000","last_became_active":"2024-06-02T23:57:12.154884+0000","last_became_peered":"2024-06-02T23:57:12.154884+0000","last_unstale":"2024-06-03T00:00:28.408443+0000","last_undegraded":"2024-06-03T00:00:28.408443+0000","last_fullsized":"2024-06-03T00:00:28.408443+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:34:52.390752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.269861+0000","last_change":"2024-06-02T23:57:15.323490+0000","last_active":"2024-06-02T23:58:55.269861+0000","last_peered":"2024-06-02T23:58:55.269861+0000","last_clean":"2024-06-02T23:58:55.269861+0000","last_became_active":"2024-06-02T23:57:15.323142+0000","last_became_peered":"2024-06-02T23:57:15.323142+0000","last_unstale":"2024-06-02T23:58:55.269861+0000","last_undegraded":"2024-06-02T23:58:55.269861+0000","last_fullsized":"2024-06-02T23:58:55.269861+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:32:32.445823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.261770+0000","last_change":"2024-06-02T23:57:56.531715+0000","last_active":"2024-06-02T23:58:55.261770+0000","last_peered":"2024-06-02T23:58:55.261770+0000","last_clean":"2024-06-02T23:58:55.261770+0000","last_became_active":"2024-06-02T23:57:56.531304+0000","last_became_peered":"2024-06-02T23:57:56.531304+0000","last_unstale":"2024-06-02T23:58:55.261770+0000","last_undegraded":"2024-06-02T23:58:55.261770+0000","last_fullsized":"2024-06-02T23:58:55.261770+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:58:02.532206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'6","reported_seq":210,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:27.439664+0000","last_change":"2024-06-02T23:57:12.305475+0000","last_active":"2024-06-03T00:00:27.439664+0000","last_peered":"2024-06-03T00:00:27.439664+0000","last_clean":"2024-06-03T00:00:27.439664+0000","last_became_active":"2024-06-02T23:57:12.305071+0000","last_became_peered":"2024-06-02T23:57:12.305071+0000","last_unstale":"2024-06-03T00:00:27.439664+0000","last_undegraded":"2024-06-03T00:00:27.439664+0000","last_fullsized":"2024-06-03T00:00:27.439664+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:08:29.024447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":177,"num_read_kb":177,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.264368+0000","last_change":"2024-06-02T23:57:15.308629+0000","last_active":"2024-06-02T23:58:55.264368+0000","last_peered":"2024-06-02T23:58:55.264368+0000","last_clean":"2024-06-02T23:58:55.264368+0000","last_became_active":"2024-06-02T23:57:15.307981+0000","last_became_peered":"2024-06-02T23:57:15.307981+0000","last_unstale":"2024-06-02T23:58:55.264368+0000","last_undegraded":"2024-06-02T23:58:55.264368+0000","last_fullsized":"2024-06-02T23:58:55.264368+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:14:22.446599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.652578+0000","last_change":"2024-06-02T23:57:12.155968+0000","last_active":"2024-06-02T23:57:56.652578+0000","last_peered":"2024-06-02T23:57:56.652578+0000","last_clean":"2024-06-02T23:57:56.652578+0000","last_became_active":"2024-06-02T23:57:12.155521+0000","last_became_peered":"2024-06-02T23:57:12.155521+0000","last_unstale":"2024-06-02T23:57:56.652578+0000","last_undegraded":"2024-06-02T23:57:56.652578+0000","last_fullsized":"2024-06-02T23:57:56.652578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:45:00.397317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":349,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528775+0000","last_change":"2024-06-02T23:55:50.081978+0000","last_active":"2024-06-02T23:57:56.528775+0000","last_peered":"2024-06-02T23:57:56.528775+0000","last_clean":"2024-06-02T23:57:56.528775+0000","last_became_active":"2024-06-02T23:55:50.081431+0000","last_became_peered":"2024-06-02T23:55:50.081431+0000","last_unstale":"2024-06-02T23:57:56.528775+0000","last_undegraded":"2024-06-02T23:57:56.528775+0000","last_fullsized":"2024-06-02T23:57:56.528775+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:52:23.676206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:52:23.676206+0000","last_clean_scrub_stamp":"2024-06-02T23:52:23.676206+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:29:59.979935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262458+0000","last_change":"2024-06-02T23:57:56.529633+0000","last_active":"2024-06-02T23:58:55.262458+0000","last_peered":"2024-06-02T23:58:55.262458+0000","last_clean":"2024-06-02T23:58:55.262458+0000","last_became_active":"2024-06-02T23:57:56.529210+0000","last_became_peered":"2024-06-02T23:57:56.529210+0000","last_unstale":"2024-06-02T23:58:55.262458+0000","last_undegraded":"2024-06-02T23:58:55.262458+0000","last_fullsized":"2024-06-02T23:58:55.262458+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:51:31.807162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.529339+0000","last_change":"2024-06-02T23:57:12.155897+0000","last_active":"2024-06-02T23:57:56.529339+0000","last_peered":"2024-06-02T23:57:56.529339+0000","last_clean":"2024-06-02T23:57:56.529339+0000","last_became_active":"2024-06-02T23:57:12.155461+0000","last_became_peered":"2024-06-02T23:57:12.155461+0000","last_unstale":"2024-06-02T23:57:56.529339+0000","last_undegraded":"2024-06-02T23:57:56.529339+0000","last_fullsized":"2024-06-02T23:57:56.529339+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:19:22.104104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528035+0000","last_change":"2024-06-02T23:57:12.306363+0000","last_active":"2024-06-02T23:57:56.528035+0000","last_peered":"2024-06-02T23:57:56.528035+0000","last_clean":"2024-06-02T23:57:56.528035+0000","last_became_active":"2024-06-02T23:57:12.305920+0000","last_became_peered":"2024-06-02T23:57:12.305920+0000","last_unstale":"2024-06-02T23:57:56.528035+0000","last_undegraded":"2024-06-02T23:57:56.528035+0000","last_fullsized":"2024-06-02T23:57:56.528035+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:31:01.787879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262436+0000","last_change":"2024-06-02T23:57:15.316038+0000","last_active":"2024-06-02T23:58:55.262436+0000","last_peered":"2024-06-02T23:58:55.262436+0000","last_clean":"2024-06-02T23:58:55.262436+0000","last_became_active":"2024-06-02T23:57:15.315715+0000","last_became_peered":"2024-06-02T23:57:15.315715+0000","last_unstale":"2024-06-02T23:58:55.262436+0000","last_undegraded":"2024-06-02T23:58:55.262436+0000","last_fullsized":"2024-06-02T23:58:55.262436+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:34:36.014251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"90'18","reported_seq":60,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:59:25.049042+0000","last_change":"2024-06-02T23:57:56.539596+0000","last_active":"2024-06-02T23:59:25.049042+0000","last_peered":"2024-06-02T23:59:25.049042+0000","last_clean":"2024-06-02T23:59:25.049042+0000","last_became_active":"2024-06-02T23:57:56.532686+0000","last_became_peered":"2024-06-02T23:57:56.532686+0000","last_unstale":"2024-06-02T23:59:25.049042+0000","last_undegraded":"2024-06-02T23:59:25.049042+0000","last_fullsized":"2024-06-02T23:59:25.049042+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:29:24.691941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267369+0000","last_change":"2024-06-02T23:57:15.315657+0000","last_active":"2024-06-02T23:58:55.267369+0000","last_peered":"2024-06-02T23:58:55.267369+0000","last_clean":"2024-06-02T23:58:55.267369+0000","last_became_active":"2024-06-02T23:57:15.315293+0000","last_became_peered":"2024-06-02T23:57:15.315293+0000","last_unstale":"2024-06-02T23:58:55.267369+0000","last_undegraded":"2024-06-02T23:58:55.267369+0000","last_fullsized":"2024-06-02T23:58:55.267369+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:52:55.241379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.652229+0000","last_change":"2024-06-02T23:57:12.405664+0000","last_active":"2024-06-02T23:57:56.652229+0000","last_peered":"2024-06-02T23:57:56.652229+0000","last_clean":"2024-06-02T23:57:56.652229+0000","last_became_active":"2024-06-02T23:57:12.405281+0000","last_became_peered":"2024-06-02T23:57:12.405281+0000","last_unstale":"2024-06-02T23:57:56.652229+0000","last_undegraded":"2024-06-02T23:57:56.652229+0000","last_fullsized":"2024-06-02T23:57:56.652229+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:46:50.119466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273696+0000","last_change":"2024-06-02T23:57:15.318136+0000","last_active":"2024-06-02T23:58:55.273696+0000","last_peered":"2024-06-02T23:58:55.273696+0000","last_clean":"2024-06-02T23:58:55.273696+0000","last_became_active":"2024-06-02T23:57:15.317753+0000","last_became_peered":"2024-06-02T23:57:15.317753+0000","last_unstale":"2024-06-02T23:58:55.273696+0000","last_undegraded":"2024-06-02T23:58:55.273696+0000","last_fullsized":"2024-06-02T23:58:55.273696+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:35:11.025266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.887947+0000","last_change":"2024-06-02T23:57:12.305954+0000","last_active":"2024-06-02T23:57:56.887947+0000","last_peered":"2024-06-02T23:57:56.887947+0000","last_clean":"2024-06-02T23:57:56.887947+0000","last_became_active":"2024-06-02T23:57:12.305589+0000","last_became_peered":"2024-06-02T23:57:12.305589+0000","last_unstale":"2024-06-02T23:57:56.887947+0000","last_undegraded":"2024-06-02T23:57:56.887947+0000","last_fullsized":"2024-06-02T23:57:56.887947+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:34:34.178446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.243742+0000","last_change":"2024-06-02T23:57:15.327115+0000","last_active":"2024-06-02T23:58:55.243742+0000","last_peered":"2024-06-02T23:58:55.243742+0000","last_clean":"2024-06-02T23:58:55.243742+0000","last_became_active":"2024-06-02T23:57:15.326746+0000","last_became_peered":"2024-06-02T23:57:15.326746+0000","last_unstale":"2024-06-02T23:58:55.243742+0000","last_undegraded":"2024-06-02T23:58:55.243742+0000","last_fullsized":"2024-06-02T23:58:55.243742+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:08:04.340517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526250+0000","last_change":"2024-06-02T23:57:12.152933+0000","last_active":"2024-06-02T23:57:56.526250+0000","last_peered":"2024-06-02T23:57:56.526250+0000","last_clean":"2024-06-02T23:57:56.526250+0000","last_became_active":"2024-06-02T23:57:12.152453+0000","last_became_peered":"2024-06-02T23:57:12.152453+0000","last_unstale":"2024-06-02T23:57:56.526250+0000","last_undegraded":"2024-06-02T23:57:56.526250+0000","last_fullsized":"2024-06-02T23:57:56.526250+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:47:05.144374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272469+0000","last_change":"2024-06-02T23:57:15.326042+0000","last_active":"2024-06-02T23:58:55.272469+0000","last_peered":"2024-06-02T23:58:55.272469+0000","last_clean":"2024-06-02T23:58:55.272469+0000","last_became_active":"2024-06-02T23:57:15.325585+0000","last_became_peered":"2024-06-02T23:57:15.325585+0000","last_unstale":"2024-06-02T23:58:55.272469+0000","last_undegraded":"2024-06-02T23:58:55.272469+0000","last_fullsized":"2024-06-02T23:58:55.272469+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:40:37.305875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"88'3","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527211+0000","last_change":"2024-06-02T23:57:12.139155+0000","last_active":"2024-06-02T23:57:56.527211+0000","last_peered":"2024-06-02T23:57:56.527211+0000","last_clean":"2024-06-02T23:57:56.527211+0000","last_became_active":"2024-06-02T23:57:12.138732+0000","last_became_peered":"2024-06-02T23:57:12.138732+0000","last_unstale":"2024-06-02T23:57:56.527211+0000","last_undegraded":"2024-06-02T23:57:56.527211+0000","last_fullsized":"2024-06-02T23:57:56.527211+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:18:29.148439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265509+0000","last_change":"2024-06-02T23:57:15.319510+0000","last_active":"2024-06-02T23:58:55.265509+0000","last_peered":"2024-06-02T23:58:55.265509+0000","last_clean":"2024-06-02T23:58:55.265509+0000","last_became_active":"2024-06-02T23:57:15.319192+0000","last_became_peered":"2024-06-02T23:57:15.319192+0000","last_unstale":"2024-06-02T23:58:55.265509+0000","last_undegraded":"2024-06-02T23:58:55.265509+0000","last_fullsized":"2024-06-02T23:58:55.265509+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:04:04.241833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.658192+0000","last_change":"2024-06-02T23:57:56.657766+0000","last_active":"2024-06-02T23:57:56.658192+0000","last_peered":"2024-06-02T23:57:56.658192+0000","last_clean":"2024-06-02T23:57:56.658192+0000","last_became_active":"2024-06-02T23:57:56.653435+0000","last_became_peered":"2024-06-02T23:57:56.653435+0000","last_unstale":"2024-06-02T23:57:56.658192+0000","last_undegraded":"2024-06-02T23:57:56.658192+0000","last_fullsized":"2024-06-02T23:57:56.658192+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:03:23.594470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273925+0000","last_change":"2024-06-02T23:57:15.320837+0000","last_active":"2024-06-02T23:58:55.273925+0000","last_peered":"2024-06-02T23:58:55.273925+0000","last_clean":"2024-06-02T23:58:55.273925+0000","last_became_active":"2024-06-02T23:57:15.320257+0000","last_became_peered":"2024-06-02T23:57:15.320257+0000","last_unstale":"2024-06-02T23:58:55.273925+0000","last_undegraded":"2024-06-02T23:58:55.273925+0000","last_fullsized":"2024-06-02T23:58:55.273925+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:18:29.638614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'5","reported_seq":209,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:26.398559+0000","last_change":"2024-06-02T23:57:12.405175+0000","last_active":"2024-06-03T00:00:26.398559+0000","last_peered":"2024-06-03T00:00:26.398559+0000","last_clean":"2024-06-03T00:00:26.398559+0000","last_became_active":"2024-06-02T23:57:12.404767+0000","last_became_peered":"2024-06-02T23:57:12.404767+0000","last_unstale":"2024-06-03T00:00:26.398559+0000","last_undegraded":"2024-06-03T00:00:26.398559+0000","last_fullsized":"2024-06-03T00:00:26.398559+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:46:57.421288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":177,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273764+0000","last_change":"2024-06-02T23:57:15.322888+0000","last_active":"2024-06-02T23:58:55.273764+0000","last_peered":"2024-06-02T23:58:55.273764+0000","last_clean":"2024-06-02T23:58:55.273764+0000","last_became_active":"2024-06-02T23:57:15.321982+0000","last_became_peered":"2024-06-02T23:57:15.321982+0000","last_unstale":"2024-06-02T23:58:55.273764+0000","last_undegraded":"2024-06-02T23:58:55.273764+0000","last_fullsized":"2024-06-02T23:58:55.273764+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:51:57.253824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526189+0000","last_change":"2024-06-02T23:57:12.153715+0000","last_active":"2024-06-02T23:57:56.526189+0000","last_peered":"2024-06-02T23:57:56.526189+0000","last_clean":"2024-06-02T23:57:56.526189+0000","last_became_active":"2024-06-02T23:57:12.152544+0000","last_became_peered":"2024-06-02T23:57:12.152544+0000","last_unstale":"2024-06-02T23:57:56.526189+0000","last_undegraded":"2024-06-02T23:57:56.526189+0000","last_fullsized":"2024-06-02T23:57:56.526189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:51:05.874962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.271354+0000","last_change":"2024-06-02T23:57:15.318759+0000","last_active":"2024-06-02T23:58:55.271354+0000","last_peered":"2024-06-02T23:58:55.271354+0000","last_clean":"2024-06-02T23:58:55.271354+0000","last_became_active":"2024-06-02T23:57:15.317942+0000","last_became_peered":"2024-06-02T23:57:15.317942+0000","last_unstale":"2024-06-02T23:58:55.271354+0000","last_undegraded":"2024-06-02T23:58:55.271354+0000","last_fullsized":"2024-06-02T23:58:55.271354+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:39:44.142890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.894529+0000","last_change":"2024-06-02T23:57:56.894131+0000","last_active":"2024-06-02T23:57:56.894529+0000","last_peered":"2024-06-02T23:57:56.894529+0000","last_clean":"2024-06-02T23:57:56.894529+0000","last_became_active":"2024-06-02T23:57:56.889794+0000","last_became_peered":"2024-06-02T23:57:56.889794+0000","last_unstale":"2024-06-02T23:57:56.894529+0000","last_undegraded":"2024-06-02T23:57:56.894529+0000","last_fullsized":"2024-06-02T23:57:56.894529+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:02:41.670419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.266582+0000","last_change":"2024-06-02T23:57:15.324355+0000","last_active":"2024-06-02T23:58:55.266582+0000","last_peered":"2024-06-02T23:58:55.266582+0000","last_clean":"2024-06-02T23:58:55.266582+0000","last_became_active":"2024-06-02T23:57:15.324019+0000","last_became_peered":"2024-06-02T23:57:15.324019+0000","last_unstale":"2024-06-02T23:58:55.266582+0000","last_undegraded":"2024-06-02T23:58:55.266582+0000","last_fullsized":"2024-06-02T23:58:55.266582+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:27:01.927109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267246+0000","last_change":"2024-06-02T23:57:15.326420+0000","last_active":"2024-06-02T23:58:55.267246+0000","last_peered":"2024-06-02T23:58:55.267246+0000","last_clean":"2024-06-02T23:58:55.267246+0000","last_became_active":"2024-06-02T23:57:15.326091+0000","last_became_peered":"2024-06-02T23:57:15.326091+0000","last_unstale":"2024-06-02T23:58:55.267246+0000","last_undegraded":"2024-06-02T23:58:55.267246+0000","last_fullsized":"2024-06-02T23:58:55.267246+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:54:05.355352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.252717+0000","last_change":"2024-06-02T23:57:56.653297+0000","last_active":"2024-06-02T23:58:55.252717+0000","last_peered":"2024-06-02T23:58:55.252717+0000","last_clean":"2024-06-02T23:58:55.252717+0000","last_became_active":"2024-06-02T23:57:56.652874+0000","last_became_peered":"2024-06-02T23:57:56.652874+0000","last_unstale":"2024-06-02T23:58:55.252717+0000","last_undegraded":"2024-06-02T23:58:55.252717+0000","last_fullsized":"2024-06-02T23:58:55.252717+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:27:55.486382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.260044+0000","last_change":"2024-06-02T23:57:15.319266+0000","last_active":"2024-06-02T23:58:55.260044+0000","last_peered":"2024-06-02T23:58:55.260044+0000","last_clean":"2024-06-02T23:58:55.260044+0000","last_became_active":"2024-06-02T23:57:15.317468+0000","last_became_peered":"2024-06-02T23:57:15.317468+0000","last_unstale":"2024-06-02T23:58:55.260044+0000","last_undegraded":"2024-06-02T23:58:55.260044+0000","last_fullsized":"2024-06-02T23:58:55.260044+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:49:53.675524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273976+0000","last_change":"2024-06-02T23:57:15.315798+0000","last_active":"2024-06-02T23:58:55.273976+0000","last_peered":"2024-06-02T23:58:55.273976+0000","last_clean":"2024-06-02T23:58:55.273976+0000","last_became_active":"2024-06-02T23:57:15.314886+0000","last_became_peered":"2024-06-02T23:57:15.314886+0000","last_unstale":"2024-06-02T23:58:55.273976+0000","last_undegraded":"2024-06-02T23:58:55.273976+0000","last_fullsized":"2024-06-02T23:58:55.273976+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:23.042226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259255+0000","last_change":"2024-06-02T23:57:15.315081+0000","last_active":"2024-06-02T23:58:55.259255+0000","last_peered":"2024-06-02T23:58:55.259255+0000","last_clean":"2024-06-02T23:58:55.259255+0000","last_became_active":"2024-06-02T23:57:15.314745+0000","last_became_peered":"2024-06-02T23:57:15.314745+0000","last_unstale":"2024-06-02T23:58:55.259255+0000","last_undegraded":"2024-06-02T23:58:55.259255+0000","last_fullsized":"2024-06-02T23:58:55.259255+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:17:49.506950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.261978+0000","last_change":"2024-06-02T23:57:15.323687+0000","last_active":"2024-06-02T23:58:55.261978+0000","last_peered":"2024-06-02T23:58:55.261978+0000","last_clean":"2024-06-02T23:58:55.261978+0000","last_became_active":"2024-06-02T23:57:15.323345+0000","last_became_peered":"2024-06-02T23:57:15.323345+0000","last_unstale":"2024-06-02T23:58:55.261978+0000","last_undegraded":"2024-06-02T23:58:55.261978+0000","last_fullsized":"2024-06-02T23:58:55.261978+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:47:40.234811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265429+0000","last_change":"2024-06-02T23:57:15.320632+0000","last_active":"2024-06-02T23:58:55.265429+0000","last_peered":"2024-06-02T23:58:55.265429+0000","last_clean":"2024-06-02T23:58:55.265429+0000","last_became_active":"2024-06-02T23:57:15.318427+0000","last_became_peered":"2024-06-02T23:57:15.318427+0000","last_unstale":"2024-06-02T23:58:55.265429+0000","last_undegraded":"2024-06-02T23:58:55.265429+0000","last_fullsized":"2024-06-02T23:58:55.265429+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:04:51.729326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259261+0000","last_change":"2024-06-02T23:57:15.312039+0000","last_active":"2024-06-02T23:58:55.259261+0000","last_peered":"2024-06-02T23:58:55.259261+0000","last_clean":"2024-06-02T23:58:55.259261+0000","last_became_active":"2024-06-02T23:57:15.311275+0000","last_became_peered":"2024-06-02T23:57:15.311275+0000","last_unstale":"2024-06-02T23:58:55.259261+0000","last_undegraded":"2024-06-02T23:58:55.259261+0000","last_fullsized":"2024-06-02T23:58:55.259261+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:50:25.509550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259813+0000","last_change":"2024-06-02T23:57:15.311927+0000","last_active":"2024-06-02T23:58:55.259813+0000","last_peered":"2024-06-02T23:58:55.259813+0000","last_clean":"2024-06-02T23:58:55.259813+0000","last_became_active":"2024-06-02T23:57:15.311484+0000","last_became_peered":"2024-06-02T23:57:15.311484+0000","last_unstale":"2024-06-02T23:58:55.259813+0000","last_undegraded":"2024-06-02T23:58:55.259813+0000","last_fullsized":"2024-06-02T23:58:55.259813+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:29:27.789219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268648+0000","last_change":"2024-06-02T23:57:15.321218+0000","last_active":"2024-06-02T23:58:55.268648+0000","last_peered":"2024-06-02T23:58:55.268648+0000","last_clean":"2024-06-02T23:58:55.268648+0000","last_became_active":"2024-06-02T23:57:15.320884+0000","last_became_peered":"2024-06-02T23:57:15.320884+0000","last_unstale":"2024-06-02T23:58:55.268648+0000","last_undegraded":"2024-06-02T23:58:55.268648+0000","last_fullsized":"2024-06-02T23:58:55.268648+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:57:20.583655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.270664+0000","last_change":"2024-06-02T23:57:15.315213+0000","last_active":"2024-06-02T23:58:55.270664+0000","last_peered":"2024-06-02T23:58:55.270664+0000","last_clean":"2024-06-02T23:58:55.270664+0000","last_became_active":"2024-06-02T23:57:15.314050+0000","last_became_peered":"2024-06-02T23:57:15.314050+0000","last_unstale":"2024-06-02T23:58:55.270664+0000","last_undegraded":"2024-06-02T23:58:55.270664+0000","last_fullsized":"2024-06-02T23:58:55.270664+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:35.214351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265435+0000","last_change":"2024-06-02T23:57:15.313901+0000","last_active":"2024-06-02T23:58:55.265435+0000","last_peered":"2024-06-02T23:58:55.265435+0000","last_clean":"2024-06-02T23:58:55.265435+0000","last_became_active":"2024-06-02T23:57:15.313452+0000","last_became_peered":"2024-06-02T23:57:15.313452+0000","last_unstale":"2024-06-02T23:58:55.265435+0000","last_undegraded":"2024-06-02T23:58:55.265435+0000","last_fullsized":"2024-06-02T23:58:55.265435+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:41:38.366741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.263989+0000","last_change":"2024-06-02T23:57:15.323660+0000","last_active":"2024-06-02T23:58:55.263989+0000","last_peered":"2024-06-02T23:58:55.263989+0000","last_clean":"2024-06-02T23:58:55.263989+0000","last_became_active":"2024-06-02T23:57:15.323316+0000","last_became_peered":"2024-06-02T23:57:15.323316+0000","last_unstale":"2024-06-02T23:58:55.263989+0000","last_undegraded":"2024-06-02T23:58:55.263989+0000","last_fullsized":"2024-06-02T23:58:55.263989+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:33:10.245563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70125,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1797,"num_read_kb":974,"num_write":262,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":214689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383735,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":480586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645372,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28676,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716476,"statfs":{"total":95995035648,"available":95965671424,"internally_reserved":0,"allocated":1699840,"data_stored":1134787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808898,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1019904,"data_stored":480516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070534,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":480894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332171,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28592,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716560,"statfs":{"total":95995035648,"available":95965757440,"internally_reserved":0,"allocated":1613824,"data_stored":1073860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495697,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":1003520,"data_stored":480233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574954,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1073152,"data_stored":548324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738479,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40496,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704656,"statfs":{"total":95995035648,"available":95953567744,"internally_reserved":0,"allocated":1024000,"data_stored":481572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411429,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1089536,"data_stored":544761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182496,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":480058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920859,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":480402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757334,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28604,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716548,"statfs":{"total":95995035648,"available":95965745152,"internally_reserved":0,"allocated":1626112,"data_stored":1073230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-03T00:00:32.252 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-03T00:00:32.537 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:00:33.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:33 smithi049 ceph-mon[32302]: pgmap v398: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 9 op/s 2024-06-03T00:00:33.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:33 smithi049 ceph-mon[32302]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-03T00:00:33.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:33 smithi049 ceph-mon[32302]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-03T00:00:33.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:33 smithi107 ceph-mon[37048]: pgmap v398: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 9 op/s 2024-06-03T00:00:33.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:33 smithi107 ceph-mon[37048]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-03T00:00:33.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:33 smithi107 ceph-mon[37048]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-03T00:00:33.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:33 smithi057 ceph-mon[36457]: pgmap v398: 97 pgs: 97 active+clean; 645 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 9 op/s 2024-06-03T00:00:33.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:33 smithi057 ceph-mon[36457]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-03T00:00:33.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:33 smithi057 ceph-mon[36457]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-03T00:00:34.156 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:34 smithi049 ceph-mon[32302]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-03T00:00:34.156 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:34 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-03T00:00:34.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.189+0000 7f0e892a4700 1 -- 172.21.15.49:0/14900500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e841030f0 msgr2=0x7f0e84107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:34.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.189+0000 7f0e892a4700 1 --2- 172.21.15.49:0/14900500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e841030f0 0x7f0e84107110 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c0099c0 tx=0x7f0e6c009cd0 comp rx=0 tx=0).stop 2024-06-03T00:00:34.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.189+0000 7f0e892a4700 1 -- 172.21.15.49:0/14900500 shutdown_connections 2024-06-03T00:00:34.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.189+0000 7f0e892a4700 1 --2- 172.21.15.49:0/14900500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e84107840 0x7f0e8410f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:34.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.189+0000 7f0e892a4700 1 --2- 172.21.15.49:0/14900500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e84102740 0x7f0e84102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:34.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.189+0000 7f0e892a4700 1 --2- 172.21.15.49:0/14900500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e841030f0 0x7f0e84107110 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:34.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.189+0000 7f0e892a4700 1 -- 172.21.15.49:0/14900500 >> 172.21.15.49:0/14900500 conn(0x7f0e840795f0 msgr2=0x7f0e84079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:34.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.189+0000 7f0e892a4700 1 -- 172.21.15.49:0/14900500 shutdown_connections 2024-06-03T00:00:34.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.189+0000 7f0e892a4700 1 -- 172.21.15.49:0/14900500 wait complete. 2024-06-03T00:00:34.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.190+0000 7f0e892a4700 1 Processor -- start 2024-06-03T00:00:34.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.190+0000 7f0e892a4700 1 -- start start 2024-06-03T00:00:34.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.190+0000 7f0e892a4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e84102740 0x7f0e84074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:34.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.190+0000 7f0e892a4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e841030f0 0x7f0e84074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:34.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.190+0000 7f0e892a4700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e84107840 0x7f0e84075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:34.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.191+0000 7f0e892a4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0e84112750 con 0x7f0e841030f0 2024-06-03T00:00:34.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.191+0000 7f0e892a4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0e841125d0 con 0x7f0e84102740 2024-06-03T00:00:34.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.191+0000 7f0e892a4700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0e841128d0 con 0x7f0e84107840 2024-06-03T00:00:34.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.191+0000 7f0e827fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e841030f0 0x7f0e84074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:34.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.191+0000 7f0e82ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e84102740 0x7f0e84074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:34.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.191+0000 7f0e827fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e841030f0 0x7f0e84074cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40978/0 (socket says 172.21.15.49:40978) 2024-06-03T00:00:34.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.191+0000 7f0e82ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e84102740 0x7f0e84074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.49:33372/0 (socket says 172.21.15.49:33372) 2024-06-03T00:00:34.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.191+0000 7f0e827fc700 1 -- 172.21.15.49:0/3370980597 learned_addr learned my addr 172.21.15.49:0/3370980597 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:34.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.191+0000 7f0e837fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e84107840 0x7f0e84075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:34.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.191+0000 7f0e82ffd700 1 -- 172.21.15.49:0/3370980597 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e84107840 msgr2=0x7f0e84075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:34.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.191+0000 7f0e82ffd700 1 --2- 172.21.15.49:0/3370980597 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e84107840 0x7f0e84075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:34.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.191+0000 7f0e82ffd700 1 -- 172.21.15.49:0/3370980597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e841030f0 msgr2=0x7f0e84074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:34.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.191+0000 7f0e82ffd700 1 --2- 172.21.15.49:0/3370980597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e841030f0 0x7f0e84074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:34.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.191+0000 7f0e82ffd700 1 -- 172.21.15.49:0/3370980597 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e841a70f0 con 0x7f0e84102740 2024-06-03T00:00:34.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.191+0000 7f0e827fc700 1 --2- 172.21.15.49:0/3370980597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e841030f0 0x7f0e84074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:00:34.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.191+0000 7f0e82ffd700 1 --2- 172.21.15.49:0/3370980597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e84102740 0x7f0e84074790 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0e7400e9f0 tx=0x7f0e7400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:34.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.191+0000 7f0e7bfff700 1 -- 172.21.15.49:0/3370980597 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e7400c9c0 con 0x7f0e84102740 2024-06-03T00:00:34.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.191+0000 7f0e892a4700 1 -- 172.21.15.49:0/3370980597 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e841a73e0 con 0x7f0e84102740 2024-06-03T00:00:34.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.191+0000 7f0e7bfff700 1 -- 172.21.15.49:0/3370980597 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e7400cb60 con 0x7f0e84102740 2024-06-03T00:00:34.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.191+0000 7f0e7bfff700 1 -- 172.21.15.49:0/3370980597 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e74018680 con 0x7f0e84102740 2024-06-03T00:00:34.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.192+0000 7f0e892a4700 1 -- 172.21.15.49:0/3370980597 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e841a7940 con 0x7f0e84102740 2024-06-03T00:00:34.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.193+0000 7f0e892a4700 1 -- 172.21.15.49:0/3370980597 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e84069180 con 0x7f0e84102740 2024-06-03T00:00:34.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.194+0000 7f0e7bfff700 1 -- 172.21.15.49:0/3370980597 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0e74010430 con 0x7f0e84102740 2024-06-03T00:00:34.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.194+0000 7f0e7bfff700 1 --2- 172.21.15.49:0/3370980597 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f0e700a2c20 0x7f0e700a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:34.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.194+0000 7f0e827fc700 1 --2- 172.21.15.49:0/3370980597 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f0e700a2c20 0x7f0e700a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:34.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.194+0000 7f0e7bfff700 1 -- 172.21.15.49:0/3370980597 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f0e740cf150 con 0x7f0e84102740 2024-06-03T00:00:34.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.195+0000 7f0e827fc700 1 --2- 172.21.15.49:0/3370980597 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f0e700a2c20 0x7f0e700a50e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0e84076220 tx=0x7f0e6c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:34.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.199+0000 7f0e7bfff700 1 -- 172.21.15.49:0/3370980597 <== mon.2 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f0e7409c0b0 con 0x7f0e84102740 2024-06-03T00:00:34.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:34 smithi107 ceph-mon[37048]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-03T00:00:34.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:34 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-03T00:00:34.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:34 smithi057 ceph-mon[36457]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-03T00:00:34.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:34 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-03T00:00:34.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.459+0000 7f0e892a4700 1 -- 172.21.15.49:0/3370980597 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e8402dca0 con 0x7f0e84102740 2024-06-03T00:00:34.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.459+0000 7f0e7bfff700 1 -- 172.21.15.49:0/3370980597 <== mon.2 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11929 (secure 0 0 0) 0x7f0e7409b9b0 con 0x7f0e84102740 2024-06-03T00:00:34.463 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:00:34.463 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1553264866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1553264866},{"type":"v1","addr":"172.21.15.49:6835","nonce":1553264866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2266285252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2266285252},{"type":"v1","addr":"172.21.15.49:6837","nonce":2266285252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T23:57:16.991201+0000","modified":"2024-06-03T00:00:26.305285+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24485,"mds_2":24466,"mds_3":24464,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6839/1729124617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":1729124617},{"type":"v1","addr":"172.21.15.49:6839","nonce":1729124617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6841/1902772235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":1902772235},{"type":"v1","addr":"172.21.15.49:6841","nonce":1902772235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6833/1633534002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1633534002},{"type":"v1","addr":"172.21.15.57:6833","nonce":1633534002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6835/2254905671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2254905671},{"type":"v1","addr":"172.21.15.57:6835","nonce":2254905671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.107:6835/3693542801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3693542801},{"type":"v1","addr":"172.21.15.107:6835","nonce":3693542801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.57:6837/230452144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":230452144},{"type":"v1","addr":"172.21.15.57:6837","nonce":230452144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.107:6837/3700593315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":3700593315},{"type":"v1","addr":"172.21.15.107:6837","nonce":3700593315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6839/249825195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":249825195},{"type":"v1","addr":"172.21.15.57:6839","nonce":249825195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6839/1986600681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1986600681},{"type":"v1","addr":"172.21.15.107:6839","nonce":1986600681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24485,24464,24460,24466,24487]},"id":1}]} 2024-06-03T00:00:34.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.462+0000 7f0e892a4700 1 -- 172.21.15.49:0/3370980597 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f0e700a2c20 msgr2=0x7f0e700a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:34.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.462+0000 7f0e892a4700 1 --2- 172.21.15.49:0/3370980597 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f0e700a2c20 0x7f0e700a50e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0e84076220 tx=0x7f0e6c005960 comp rx=0 tx=0).stop 2024-06-03T00:00:34.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.462+0000 7f0e892a4700 1 -- 172.21.15.49:0/3370980597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e84102740 msgr2=0x7f0e84074790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:34.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.462+0000 7f0e892a4700 1 --2- 172.21.15.49:0/3370980597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e84102740 0x7f0e84074790 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0e7400e9f0 tx=0x7f0e7400ed00 comp rx=0 tx=0).stop 2024-06-03T00:00:34.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.462+0000 7f0e892a4700 1 -- 172.21.15.49:0/3370980597 shutdown_connections 2024-06-03T00:00:34.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.462+0000 7f0e892a4700 1 --2- 172.21.15.49:0/3370980597 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f0e700a2c20 0x7f0e700a50e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:34.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.462+0000 7f0e892a4700 1 --2- 172.21.15.49:0/3370980597 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e84107840 0x7f0e84075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:34.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.462+0000 7f0e892a4700 1 --2- 172.21.15.49:0/3370980597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e84102740 0x7f0e84074790 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:34.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.462+0000 7f0e892a4700 1 --2- 172.21.15.49:0/3370980597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e841030f0 0x7f0e84074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:34.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.462+0000 7f0e892a4700 1 -- 172.21.15.49:0/3370980597 >> 172.21.15.49:0/3370980597 conn(0x7f0e840795f0 msgr2=0x7f0e84100570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:34.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.462+0000 7f0e892a4700 1 -- 172.21.15.49:0/3370980597 shutdown_connections 2024-06-03T00:00:34.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:34.462+0000 7f0e892a4700 1 -- 172.21.15.49:0/3370980597 wait complete. 2024-06-03T00:00:34.465 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 27 2024-06-03T00:00:35.138 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-03T00:00:35.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:35 smithi107 ceph-mon[37048]: pgmap v399: 97 pgs: 97 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 938 B/s wr, 11 op/s 2024-06-03T00:00:35.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:35 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/3370980597' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:00:35.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:35 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:00:35.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:35 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:00:35.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:35 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:00:35.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:35 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:00:35.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:35 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:00:35.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:35 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:00:35.418 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:00:35.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:35 smithi057 ceph-mon[36457]: pgmap v399: 97 pgs: 97 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 938 B/s wr, 11 op/s 2024-06-03T00:00:35.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:35 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/3370980597' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:00:35.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:35 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:00:35.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:35 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:00:35.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:35 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:00:35.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:35 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:00:35.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:35 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:00:35.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:35 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:00:35.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:35 smithi049 ceph-mon[32302]: pgmap v399: 97 pgs: 97 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 938 B/s wr, 11 op/s 2024-06-03T00:00:35.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:35 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3370980597' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:00:35.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:35 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:00:35.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:35 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:00:35.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:35 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:00:35.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:35 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:00:35.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:35 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:00:35.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:35 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:00:36.209 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:36 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-03T00:00:36.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:36 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-03T00:00:36.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:36 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:00:36.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:36 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-03T00:00:36.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:36 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-03T00:00:36.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:36 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:00:36.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:36 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-03T00:00:36.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:36 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-03T00:00:36.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:36 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:00:37.080 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:37 smithi049 ceph-mon[32302]: pgmap v400: 97 pgs: 97 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 938 B/s wr, 11 op/s 2024-06-03T00:00:37.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.079+0000 7f498c6ff700 1 -- 172.21.15.49:0/2444531168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4984107840 msgr2=0x7f498410f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:37.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.079+0000 7f498c6ff700 1 --2- 172.21.15.49:0/2444531168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4984107840 0x7f498410f3c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f497c00b0d0 tx=0x7f497c00b3e0 comp rx=0 tx=0).stop 2024-06-03T00:00:37.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.079+0000 7f498c6ff700 1 -- 172.21.15.49:0/2444531168 shutdown_connections 2024-06-03T00:00:37.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.079+0000 7f498c6ff700 1 --2- 172.21.15.49:0/2444531168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4984107840 0x7f498410f3c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:37.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.079+0000 7f498c6ff700 1 --2- 172.21.15.49:0/2444531168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4984102740 0x7f4984102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:37.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.079+0000 7f498c6ff700 1 --2- 172.21.15.49:0/2444531168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49841030f0 0x7f4984107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:37.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.079+0000 7f498c6ff700 1 -- 172.21.15.49:0/2444531168 >> 172.21.15.49:0/2444531168 conn(0x7f49840795f0 msgr2=0x7f4984079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:37.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.079+0000 7f498c6ff700 1 -- 172.21.15.49:0/2444531168 shutdown_connections 2024-06-03T00:00:37.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.079+0000 7f498c6ff700 1 -- 172.21.15.49:0/2444531168 wait complete. 2024-06-03T00:00:37.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.080+0000 7f498c6ff700 1 Processor -- start 2024-06-03T00:00:37.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.080+0000 7f498c6ff700 1 -- start start 2024-06-03T00:00:37.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.080+0000 7f498c6ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4984102740 0x7f4984074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:37.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.080+0000 7f498c6ff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49841030f0 0x7f4984074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:37.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.080+0000 7f498c6ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4984107840 0x7f4984075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:37.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.080+0000 7f498c6ff700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f49841127d0 con 0x7f49841030f0 2024-06-03T00:00:37.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.080+0000 7f498c6ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f4984112650 con 0x7f4984107840 2024-06-03T00:00:37.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.080+0000 7f498c6ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4984112950 con 0x7f4984102740 2024-06-03T00:00:37.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.081+0000 7f4989c9a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49841030f0 0x7f4984074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:37.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.081+0000 7f498a49b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4984102740 0x7f4984074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:37.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.081+0000 7f4989c9a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49841030f0 0x7f4984074cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40984/0 (socket says 172.21.15.49:40984) 2024-06-03T00:00:37.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.081+0000 7f4989c9a700 1 -- 172.21.15.49:0/2794370703 learned_addr learned my addr 172.21.15.49:0/2794370703 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:37.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.081+0000 7f498ac9c700 1 --2- 172.21.15.49:0/2794370703 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4984107840 0x7f4984075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:37.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.081+0000 7f4989c9a700 1 -- 172.21.15.49:0/2794370703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4984102740 msgr2=0x7f4984074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:37.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.081+0000 7f4989c9a700 1 --2- 172.21.15.49:0/2794370703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4984102740 0x7f4984074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:37.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.081+0000 7f4989c9a700 1 -- 172.21.15.49:0/2794370703 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4984107840 msgr2=0x7f4984075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:37.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.081+0000 7f4989c9a700 1 --2- 172.21.15.49:0/2794370703 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4984107840 0x7f4984075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:37.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.081+0000 7f4989c9a700 1 -- 172.21.15.49:0/2794370703 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49841a70b0 con 0x7f49841030f0 2024-06-03T00:00:37.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.081+0000 7f4989c9a700 1 --2- 172.21.15.49:0/2794370703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49841030f0 0x7f4984074cd0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f497400d950 tx=0x7f497400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:37.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.081+0000 7f497b7fe700 1 -- 172.21.15.49:0/2794370703 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4974016070 con 0x7f49841030f0 2024-06-03T00:00:37.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.082+0000 7f498c6ff700 1 -- 172.21.15.49:0/2794370703 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49841a73a0 con 0x7f49841030f0 2024-06-03T00:00:37.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.082+0000 7f497b7fe700 1 -- 172.21.15.49:0/2794370703 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f497400fd70 con 0x7f49841030f0 2024-06-03T00:00:37.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.082+0000 7f497b7fe700 1 -- 172.21.15.49:0/2794370703 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497400e610 con 0x7f49841030f0 2024-06-03T00:00:37.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.082+0000 7f498c6ff700 1 -- 172.21.15.49:0/2794370703 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49841a7930 con 0x7f49841030f0 2024-06-03T00:00:37.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.083+0000 7f498c6ff700 1 -- 172.21.15.49:0/2794370703 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4984069180 con 0x7f49841030f0 2024-06-03T00:00:37.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.084+0000 7f497b7fe700 1 -- 172.21.15.49:0/2794370703 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4974019070 con 0x7f49841030f0 2024-06-03T00:00:37.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.085+0000 7f497b7fe700 1 --2- 172.21.15.49:0/2794370703 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f49700a2c20 0x7f49700a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:37.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.085+0000 7f498a49b700 1 --2- 172.21.15.49:0/2794370703 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f49700a2c20 0x7f49700a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:37.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.085+0000 7f497b7fe700 1 -- 172.21.15.49:0/2794370703 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f49740cea80 con 0x7f49841030f0 2024-06-03T00:00:37.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.085+0000 7f498a49b700 1 --2- 172.21.15.49:0/2794370703 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f49700a2c20 0x7f49700a50e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4980004630 tx=0x7f498000b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:37.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.089+0000 7f497b7fe700 1 -- 172.21.15.49:0/2794370703 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f497409b9a0 con 0x7f49841030f0 2024-06-03T00:00:37.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.294+0000 7f498c6ff700 1 -- 172.21.15.49:0/2794370703 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f498402dca0 con 0x7f49841030f0 2024-06-03T00:00:37.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.296+0000 7f497b7fe700 1 -- 172.21.15.49:0/2794370703 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+22612 (secure 0 0 0) 0x7f497409b2a0 con 0x7f49841030f0 2024-06-03T00:00:37.297 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:00:37.297 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":90,"fsid":"890dd222-213a-11ef-bc9b-c7b262605968","created":"2024-06-02T23:48:53.323536+0000","modified":"2024-06-02T23:57:56.520324+0000","last_up_change":"2024-06-02T23:56:12.156697+0000","last_in_change":"2024-06-02T23:55:51.667118+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:52:23.676079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:57:10.753178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T23:57:14.240610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e0013e80-07d6-4ad3-87d8-d41988988ef5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6803","nonce":811647073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6805","nonce":811647073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6809","nonce":811647073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6807","nonce":811647073}]},"public_addr":"172.21.15.49:6803/811647073","cluster_addr":"172.21.15.49:6805/811647073","heartbeat_back_addr":"172.21.15.49:6809/811647073","heartbeat_front_addr":"172.21.15.49:6807/811647073","state":["exists","up"]},{"osd":1,"uuid":"f37d9f79-e349-4de7-81e7-385ddb905f58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6801","nonce":1260507785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6803","nonce":1260507785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6807","nonce":1260507785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6805","nonce":1260507785}]},"public_addr":"172.21.15.57:6801/1260507785","cluster_addr":"172.21.15.57:6803/1260507785","heartbeat_back_addr":"172.21.15.57:6807/1260507785","heartbeat_front_addr":"172.21.15.57:6805/1260507785","state":["exists","up"]},{"osd":2,"uuid":"94889281-7d45-4e78-9d37-b98e3fbe8494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6801","nonce":303899951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6803","nonce":303899951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6807","nonce":303899951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6805","nonce":303899951}]},"public_addr":"172.21.15.107:6801/303899951","cluster_addr":"172.21.15.107:6803/303899951","heartbeat_back_addr":"172.21.15.107:6807/303899951","heartbeat_front_addr":"172.21.15.107:6805/303899951","state":["exists","up"]},{"osd":3,"uuid":"31f4c18c-fbda-400d-8b3b-0955b0c4a6a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6811","nonce":60796312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6813","nonce":60796312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6817","nonce":60796312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6815","nonce":60796312}]},"public_addr":"172.21.15.49:6811/60796312","cluster_addr":"172.21.15.49:6813/60796312","heartbeat_back_addr":"172.21.15.49:6817/60796312","heartbeat_front_addr":"172.21.15.49:6815/60796312","state":["exists","up"]},{"osd":4,"uuid":"8076c2f3-0138-459e-89b5-c5c4586a14ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6809","nonce":3106842986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6811","nonce":3106842986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6815","nonce":3106842986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6813","nonce":3106842986}]},"public_addr":"172.21.15.57:6809/3106842986","cluster_addr":"172.21.15.57:6811/3106842986","heartbeat_back_addr":"172.21.15.57:6815/3106842986","heartbeat_front_addr":"172.21.15.57:6813/3106842986","state":["exists","up"]},{"osd":5,"uuid":"68f7abd3-4292-41fa-90ce-4ac34ea2b964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6809","nonce":389294142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6811","nonce":389294142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6815","nonce":389294142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6813","nonce":389294142}]},"public_addr":"172.21.15.107:6809/389294142","cluster_addr":"172.21.15.107:6811/389294142","heartbeat_back_addr":"172.21.15.107:6815/389294142","heartbeat_front_addr":"172.21.15.107:6813/389294142","state":["exists","up"]},{"osd":6,"uuid":"c0345dd0-71b7-436d-88f8-fe3d7cb69d8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6819","nonce":894624552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6821","nonce":894624552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6825","nonce":894624552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6823","nonce":894624552}]},"public_addr":"172.21.15.49:6819/894624552","cluster_addr":"172.21.15.49:6821/894624552","heartbeat_back_addr":"172.21.15.49:6825/894624552","heartbeat_front_addr":"172.21.15.49:6823/894624552","state":["exists","up"]},{"osd":7,"uuid":"9abd81c7-dcc1-4e14-8ab7-9fa0746067ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6817","nonce":3126027900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6819","nonce":3126027900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6823","nonce":3126027900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6821","nonce":3126027900}]},"public_addr":"172.21.15.57:6817/3126027900","cluster_addr":"172.21.15.57:6819/3126027900","heartbeat_back_addr":"172.21.15.57:6823/3126027900","heartbeat_front_addr":"172.21.15.57:6821/3126027900","state":["exists","up"]},{"osd":8,"uuid":"80532119-5de8-45d2-9cb9-bd8a6194199b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6817","nonce":3620047229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6819","nonce":3620047229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6823","nonce":3620047229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6821","nonce":3620047229}]},"public_addr":"172.21.15.107:6817/3620047229","cluster_addr":"172.21.15.107:6819/3620047229","heartbeat_back_addr":"172.21.15.107:6823/3620047229","heartbeat_front_addr":"172.21.15.107:6821/3620047229","state":["exists","up"]},{"osd":9,"uuid":"f0b5dcfa-9fd2-4a98-863b-197defa890af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6827","nonce":3627936526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6829","nonce":3627936526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6833","nonce":3627936526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6831","nonce":3627936526}]},"public_addr":"172.21.15.49:6827/3627936526","cluster_addr":"172.21.15.49:6829/3627936526","heartbeat_back_addr":"172.21.15.49:6833/3627936526","heartbeat_front_addr":"172.21.15.49:6831/3627936526","state":["exists","up"]},{"osd":10,"uuid":"21a75846-adec-41b8-9e1d-e5c61ba30b12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6825","nonce":3013235811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6827","nonce":3013235811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6831","nonce":3013235811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6829","nonce":3013235811}]},"public_addr":"172.21.15.57:6825/3013235811","cluster_addr":"172.21.15.57:6827/3013235811","heartbeat_back_addr":"172.21.15.57:6831/3013235811","heartbeat_front_addr":"172.21.15.57:6829/3013235811","state":["exists","up"]},{"osd":11,"uuid":"eb963b63-2c61-4169-b8fe-31c7f5ec919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6825","nonce":4217534517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6827","nonce":4217534517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6831","nonce":4217534517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6829","nonce":4217534517}]},"public_addr":"172.21.15.107:6825/4217534517","cluster_addr":"172.21.15.107:6827/4217534517","heartbeat_back_addr":"172.21.15.107:6831/4217534517","heartbeat_front_addr":"172.21.15.107:6829/4217534517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:51:31.067312+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:51:56.088456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:52:20.539941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:52:45.055717+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:53:11.178438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:53:35.794217+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:00.775674+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:27.574752+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:52.177634+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:55:17.118854+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:55:44.217535+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:56:10.500970+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/525944311":"2024-06-03T23:49:55.151590+0000","172.21.15.49:0/1841969299":"2024-06-03T23:49:55.151590+0000","172.21.15.49:0/1880506696":"2024-06-03T23:49:55.151590+0000","172.21.15.49:6801/1206062338":"2024-06-03T23:49:55.151590+0000","172.21.15.49:6800/549058216":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/2112783954":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/2183920213":"2024-06-03T23:49:29.042670+0000","172.21.15.49:6801/549058216":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/3350970308":"2024-06-03T23:49:29.042670+0000","172.21.15.49:6800/1206062338":"2024-06-03T23:49:55.151590+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-03T00:00:37.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.298+0000 7f498c6ff700 1 -- 172.21.15.49:0/2794370703 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f49700a2c20 msgr2=0x7f49700a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.298+0000 7f498c6ff700 1 --2- 172.21.15.49:0/2794370703 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f49700a2c20 0x7f49700a50e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4980004630 tx=0x7f498000b3c0 comp rx=0 tx=0).stop 2024-06-03T00:00:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.298+0000 7f498c6ff700 1 -- 172.21.15.49:0/2794370703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49841030f0 msgr2=0x7f4984074cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.298+0000 7f498c6ff700 1 --2- 172.21.15.49:0/2794370703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49841030f0 0x7f4984074cd0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f497400d950 tx=0x7f497400dc60 comp rx=0 tx=0).stop 2024-06-03T00:00:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.298+0000 7f498c6ff700 1 -- 172.21.15.49:0/2794370703 shutdown_connections 2024-06-03T00:00:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.298+0000 7f498c6ff700 1 --2- 172.21.15.49:0/2794370703 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f49700a2c20 0x7f49700a50e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.298+0000 7f498c6ff700 1 --2- 172.21.15.49:0/2794370703 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4984107840 0x7f4984075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.298+0000 7f498c6ff700 1 --2- 172.21.15.49:0/2794370703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4984102740 0x7f4984074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.298+0000 7f498c6ff700 1 --2- 172.21.15.49:0/2794370703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49841030f0 0x7f4984074cd0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.298+0000 7f498c6ff700 1 -- 172.21.15.49:0/2794370703 >> 172.21.15.49:0/2794370703 conn(0x7f49840795f0 msgr2=0x7f4984100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.298+0000 7f498c6ff700 1 -- 172.21.15.49:0/2794370703 shutdown_connections 2024-06-03T00:00:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:37.298+0000 7f498c6ff700 1 -- 172.21.15.49:0/2794370703 wait complete. 2024-06-03T00:00:37.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:37 smithi107 ceph-mon[37048]: pgmap v400: 97 pgs: 97 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 938 B/s wr, 11 op/s 2024-06-03T00:00:37.351 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:37 smithi057 ceph-mon[36457]: pgmap v400: 97 pgs: 97 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 938 B/s wr, 11 op/s 2024-06-03T00:00:37.946 DEBUG:tasks.fwd_scrub:Yielding 2024-06-03T00:00:37.946 INFO:teuthology.run_tasks:Running task background_exec... 2024-06-03T00:00:38.029 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi049.front.sepia.ceph.com 2024-06-03T00:00:38.030 DEBUG:teuthology.orchestra.run.smithi049:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-06-03T00:00:38.030 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-06-03T00:00:38.030 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-06-03T00:00:38.030 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-06-03T00:00:38.033 INFO:teuthology.run_tasks:Running task quiescer... 2024-06-03T00:00:38.045 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-06-03T00:00:38.045 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-06-03T00:00:38.309 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:00:38.314 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:00:38.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:38 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/2794370703' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-03T00:00:38.366 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:38 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/2794370703' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-03T00:00:38.437 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:38 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/2794370703' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-03T00:00:39.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:39 smithi107 ceph-mon[37048]: pgmap v401: 97 pgs: 97 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 938 B/s wr, 10 op/s 2024-06-03T00:00:39.404 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:39 smithi049 ceph-mon[32302]: pgmap v401: 97 pgs: 97 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 938 B/s wr, 10 op/s 2024-06-03T00:00:39.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:39 smithi057 ceph-mon[36457]: pgmap v401: 97 pgs: 97 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 938 B/s wr, 10 op/s 2024-06-03T00:00:40.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.911+0000 7f239a40e700 1 -- 172.21.15.49:0/4262938839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23941084f0 msgr2=0x7f23941088d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:40.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.911+0000 7f239a40e700 1 --2- 172.21.15.49:0/4262938839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23941084f0 0x7f23941088d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2384009990 tx=0x7f2384009ca0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.911+0000 7f239a40e700 1 -- 172.21.15.49:0/4262938839 shutdown_connections 2024-06-03T00:00:40.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.911+0000 7f239a40e700 1 --2- 172.21.15.49:0/4262938839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2394102e80 0x7f239410f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.911+0000 7f239a40e700 1 --2- 172.21.15.49:0/4262938839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23941084f0 0x7f23941088d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.911+0000 7f239a40e700 1 --2- 172.21.15.49:0/4262938839 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23941024e0 0x7f2394102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.911+0000 7f239a40e700 1 -- 172.21.15.49:0/4262938839 >> 172.21.15.49:0/4262938839 conn(0x7f2394079530 msgr2=0x7f2394079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:40.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.911+0000 7f239a40e700 1 -- 172.21.15.49:0/4262938839 shutdown_connections 2024-06-03T00:00:40.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.912+0000 7f239a40e700 1 -- 172.21.15.49:0/4262938839 wait complete. 2024-06-03T00:00:40.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.912+0000 7f239a40e700 1 Processor -- start 2024-06-03T00:00:40.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.912+0000 7f239a40e700 1 -- start start 2024-06-03T00:00:40.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.913+0000 7f239a40e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23941024e0 0x7f239419ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:40.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.913+0000 7f239a40e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2394102e80 0x7f239419ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:40.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.913+0000 7f239a40e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23941084f0 0x7f2394198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:40.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.913+0000 7f239a40e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f23941127d0 con 0x7f2394102e80 2024-06-03T00:00:40.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.913+0000 7f239a40e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f2394112650 con 0x7f23941024e0 2024-06-03T00:00:40.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.913+0000 7f239a40e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2394112950 con 0x7f23941084f0 2024-06-03T00:00:40.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.913+0000 7f2393fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23941024e0 0x7f239419ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:40.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.913+0000 7f2393fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23941024e0 0x7f239419ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.49:33412/0 (socket says 172.21.15.49:33412) 2024-06-03T00:00:40.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.913+0000 7f23937fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2394102e80 0x7f239419ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:40.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.913+0000 7f2393fff700 1 -- 172.21.15.49:0/3974199226 learned_addr learned my addr 172.21.15.49:0/3974199226 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:40.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.913+0000 7f23989ab700 1 --2- 172.21.15.49:0/3974199226 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23941084f0 0x7f2394198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:40.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.913+0000 7f2393fff700 1 -- 172.21.15.49:0/3974199226 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23941084f0 msgr2=0x7f2394198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:40.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.913+0000 7f2393fff700 1 --2- 172.21.15.49:0/3974199226 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23941084f0 0x7f2394198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.913+0000 7f2393fff700 1 -- 172.21.15.49:0/3974199226 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2394102e80 msgr2=0x7f239419ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:40.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.913+0000 7f2393fff700 1 --2- 172.21.15.49:0/3974199226 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2394102e80 0x7f239419ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.913+0000 7f2393fff700 1 -- 172.21.15.49:0/3974199226 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23941993f0 con 0x7f23941024e0 2024-06-03T00:00:40.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.913+0000 7f23937fe700 1 --2- 172.21.15.49:0/3974199226 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2394102e80 0x7f239419ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:00:40.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.914+0000 7f2393fff700 1 --2- 172.21.15.49:0/3974199226 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23941024e0 0x7f239419ea40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2384000c00 tx=0x7f2384003680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:40.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.914+0000 7f23917fa700 1 -- 172.21.15.49:0/3974199226 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2384027070 con 0x7f23941024e0 2024-06-03T00:00:40.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.914+0000 7f239a40e700 1 -- 172.21.15.49:0/3974199226 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2394199680 con 0x7f23941024e0 2024-06-03T00:00:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.914+0000 7f23917fa700 1 -- 172.21.15.49:0/3974199226 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2384004050 con 0x7f23941024e0 2024-06-03T00:00:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.914+0000 7f23917fa700 1 -- 172.21.15.49:0/3974199226 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238400f460 con 0x7f23941024e0 2024-06-03T00:00:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.914+0000 7f239a40e700 1 -- 172.21.15.49:0/3974199226 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23941a59c0 con 0x7f23941024e0 2024-06-03T00:00:40.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.916+0000 7f23917fa700 1 -- 172.21.15.49:0/3974199226 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f238402a070 con 0x7f23941024e0 2024-06-03T00:00:40.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.917+0000 7f23917fa700 1 --2- 172.21.15.49:0/3974199226 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f237c0a2ca0 0x7f237c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:40.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.917+0000 7f23937fe700 1 --2- 172.21.15.49:0/3974199226 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f237c0a2ca0 0x7f237c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:40.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.917+0000 7f23917fa700 1 -- 172.21.15.49:0/3974199226 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f23840cffb0 con 0x7f23941024e0 2024-06-03T00:00:40.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.918+0000 7f23a4c91b80 1 Processor -- start 2024-06-03T00:00:40.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.918+0000 7f23a4c91b80 1 -- start start 2024-06-03T00:00:40.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.918+0000 7f23937fe700 1 --2- 172.21.15.49:0/3974199226 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f237c0a2ca0 0x7f237c0a5160 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f239419a260 tx=0x7f238800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:40.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.918+0000 7f23a4c91b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d565606c0 0x557d56560aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:40.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.918+0000 7f23a4c91b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557d56560fe0 0x557d5655aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:40.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.918+0000 7f23a4c91b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557d5655afa0 0x557d5655b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:40.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.918+0000 7f23a4c91b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x557d564ac890 con 0x557d5655afa0 2024-06-03T00:00:40.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.918+0000 7f23a4c91b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x557d564547a0 con 0x557d56560fe0 2024-06-03T00:00:40.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.918+0000 7f23a4c91b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x557d564a8850 con 0x557d565606c0 2024-06-03T00:00:40.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.918+0000 7f23989ab700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557d5655afa0 0x557d5655b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:40.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.918+0000 7f2393fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d565606c0 0x557d56560aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:40.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.918+0000 7f23989ab700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557d5655afa0 0x557d5655b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41008/0 (socket says 172.21.15.49:41008) 2024-06-03T00:00:40.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.918+0000 7f23989ab700 1 -- 172.21.15.49:0/879096358 learned_addr learned my addr 172.21.15.49:0/879096358 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:40.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.918+0000 7f23937fe700 1 --2- 172.21.15.49:0/879096358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557d56560fe0 0x557d5655aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:40.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.918+0000 7f23989ab700 1 -- 172.21.15.49:0/879096358 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d565606c0 msgr2=0x557d56560aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:40.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.918+0000 7f23989ab700 1 --2- 172.21.15.49:0/879096358 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d565606c0 0x557d56560aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.918+0000 7f23989ab700 1 -- 172.21.15.49:0/879096358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557d56560fe0 msgr2=0x557d5655aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:40.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.918+0000 7f23989ab700 1 --2- 172.21.15.49:0/879096358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557d56560fe0 0x557d5655aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.918+0000 7f23989ab700 1 -- 172.21.15.49:0/879096358 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d5644afd0 con 0x557d5655afa0 2024-06-03T00:00:40.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.918+0000 7f2393fff700 1 --2- 172.21.15.49:0/879096358 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d565606c0 0x557d56560aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:00:40.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.918+0000 7f23937fe700 1 --2- 172.21.15.49:0/879096358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557d56560fe0 0x557d5655aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:00:40.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.919+0000 7f23989ab700 1 --2- 172.21.15.49:0/879096358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557d5655afa0 0x557d5655b3c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f238c00a430 tx=0x7f238c009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f203615dafd0c7e8 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:40.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.919+0000 7f237a7fc700 1 -- 172.21.15.49:0/879096358 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c014620 con 0x557d5655afa0 2024-06-03T00:00:40.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.919+0000 7f237a7fc700 1 -- 172.21.15.49:0/879096358 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f238c019070 con 0x557d5655afa0 2024-06-03T00:00:40.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.919+0000 7f237a7fc700 1 -- 172.21.15.49:0/879096358 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c013bd0 con 0x557d5655afa0 2024-06-03T00:00:40.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.919+0000 7f23a4c91b80 1 -- 172.21.15.49:0/879096358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557d5655afa0 msgr2=0x557d5655b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:40.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.919+0000 7f23a4c91b80 1 --2- 172.21.15.49:0/879096358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557d5655afa0 0x557d5655b3c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f238c00a430 tx=0x7f238c009650 comp rx=0 tx=0).stop 2024-06-03T00:00:40.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.920+0000 7f23a4c91b80 1 -- 172.21.15.49:0/879096358 shutdown_connections 2024-06-03T00:00:40.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.920+0000 7f23a4c91b80 1 --2- 172.21.15.49:0/879096358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557d5655afa0 0x557d5655b3c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.920+0000 7f23a4c91b80 1 --2- 172.21.15.49:0/879096358 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d565606c0 0x557d56560aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.920+0000 7f23a4c91b80 1 --2- 172.21.15.49:0/879096358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557d56560fe0 0x557d5655aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.920+0000 7f23a4c91b80 1 -- 172.21.15.49:0/879096358 >> 172.21.15.49:0/879096358 conn(0x557d56485d40 msgr2=0x557d565558d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:40.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.920+0000 7f23a4c91b80 1 -- 172.21.15.49:0/879096358 shutdown_connections 2024-06-03T00:00:40.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.920+0000 7f23a4c91b80 1 -- 172.21.15.49:0/879096358 wait complete. 2024-06-03T00:00:40.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.920+0000 7f23a4c91b80 1 -- start start 2024-06-03T00:00:40.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.920+0000 7f23a4c91b80 1 Processor -- start 2024-06-03T00:00:40.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.921+0000 7f23a4c91b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557d5655afa0 0x557d56566cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:40.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.921+0000 7f23a4c91b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d565606c0 0x557d56563ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:40.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.921+0000 7f23a4c91b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557d56560fe0 0x557d56564530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:40.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.921+0000 7f23a4c91b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x557d56567a50 con 0x557d5655afa0 2024-06-03T00:00:40.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.921+0000 7f23a4c91b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x557d5644cc70 con 0x557d56560fe0 2024-06-03T00:00:40.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.921+0000 7f23a4c91b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x557d56567bd0 con 0x557d565606c0 2024-06-03T00:00:40.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.921+0000 7f23a4c91b80 10 client.0 _ll_register_callbacks cb 0x557d564469a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:00:40.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.921+0000 7f2393fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557d5655afa0 0x557d56566cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:40.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.921+0000 7f2393fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557d5655afa0 0x557d56566cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41010/0 (socket says 172.21.15.49:41010) 2024-06-03T00:00:40.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.921+0000 7f2393fff700 1 -- 172.21.15.49:0/1058688924 learned_addr learned my addr 172.21.15.49:0/1058688924 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:40.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.921+0000 7f23989ab700 1 --2- 172.21.15.49:0/1058688924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557d56560fe0 0x557d56564530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:40.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.921+0000 7f23937fe700 1 --2- 172.21.15.49:0/1058688924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d565606c0 0x557d56563ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:40.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.921+0000 7f2393fff700 1 -- 172.21.15.49:0/1058688924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d565606c0 msgr2=0x557d56563ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:40.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.921+0000 7f2393fff700 1 --2- 172.21.15.49:0/1058688924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d565606c0 0x557d56563ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.921+0000 7f2393fff700 1 -- 172.21.15.49:0/1058688924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557d56560fe0 msgr2=0x557d56564530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:40.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.921+0000 7f2393fff700 1 --2- 172.21.15.49:0/1058688924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557d56560fe0 0x557d56564530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.921+0000 7f2393fff700 1 -- 172.21.15.49:0/1058688924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d563fb950 con 0x557d5655afa0 2024-06-03T00:00:40.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.921+0000 7f23989ab700 1 --2- 172.21.15.49:0/1058688924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557d56560fe0 0x557d56564530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:00:40.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.921+0000 7f2393fff700 1 --2- 172.21.15.49:0/1058688924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557d5655afa0 0x557d56566cf0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2384009350 tx=0x7f238409c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a57a444368aba server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:40.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.921+0000 7f23737fe700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:00:40.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.921+0000 7f23737fe700 1 -- 172.21.15.49:0/1058688924 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23840b5060 con 0x557d5655afa0 2024-06-03T00:00:40.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.921+0000 7f23737fe700 1 -- 172.21.15.49:0/1058688924 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f238409cda0 con 0x557d5655afa0 2024-06-03T00:00:40.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.921+0000 7f23a4c91b80 1 -- 172.21.15.49:0/1058688924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f238c019070 con 0x557d5655afa0 2024-06-03T00:00:40.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.922+0000 7f23737fe700 1 -- 172.21.15.49:0/1058688924 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f238409d040 con 0x557d5655afa0 2024-06-03T00:00:40.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.922+0000 7f23a4c91b80 10 client.15276 fetch_fsmap learned FSMap version 27 2024-06-03T00:00:40.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.922+0000 7f23a4c91b80 1 -- 172.21.15.49:0/1058688924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557d56567a50 con 0x557d5655afa0 2024-06-03T00:00:40.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.922+0000 7f23737fe700 1 -- 172.21.15.49:0/1058688924 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f238c019070 con 0x557d5655afa0 2024-06-03T00:00:40.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.922+0000 7f23737fe700 1 -- 172.21.15.49:0/1058688924 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f23840a5090 con 0x557d5655afa0 2024-06-03T00:00:40.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.922+0000 7f23a4c91b80 10 client.15276 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:00:40.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.922+0000 7f23a4c91b80 10 client.15276 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-03T00:00:40.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.922+0000 7f23a4c91b80 20 client.15276 populate_metadata read hostname 'smithi049' 2024-06-03T00:00:40.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.922+0000 7f23a4c91b80 1 --2- 172.21.15.49:0/1058688924 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x557d56574850 0x557d56576c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:40.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.922+0000 7f23a4c91b80 4 client.15276 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:00:40.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.922+0000 7f23a4c91b80 1 -- 172.21.15.49:0/1058688924 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d564b9d90 con 0x557d56574850 2024-06-03T00:00:40.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.922+0000 7f23937fe700 1 --2- 172.21.15.49:0/1058688924 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x557d56574850 0x557d56576c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:40.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.923+0000 7f23937fe700 1 --2- 172.21.15.49:0/1058688924 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x557d56574850 0x557d56576c90 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25a6de36c5f2c92c server_cookie=e8125ba57a37ee86 in_seq=0 out_seq=0 2024-06-03T00:00:40.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.923+0000 7f23737fe700 10 client.15276 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:00:40.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.923+0000 7f23737fe700 1 -- 172.21.15.49:0/1058688924 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x557d564b9d90 con 0x557d56574850 2024-06-03T00:00:40.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.923+0000 7f23737fe700 10 client.15276 handle_command_reply: tid=0 2024-06-03T00:00:40.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.924+0000 7f23a4c91b80 1 client.15276 shutdown 2024-06-03T00:00:40.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.924+0000 7f23a4c91b80 1 -- 172.21.15.49:0/1058688924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557d5655afa0 msgr2=0x557d56566cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:40.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.924+0000 7f23a4c91b80 1 --2- 172.21.15.49:0/1058688924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557d5655afa0 0x557d56566cf0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2384009350 tx=0x7f238409c820 comp rx=0 tx=0).stop 2024-06-03T00:00:40.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.924+0000 7f23a4c91b80 1 -- 172.21.15.49:0/1058688924 shutdown_connections 2024-06-03T00:00:40.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.924+0000 7f23a4c91b80 1 --2- 172.21.15.49:0/1058688924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557d56560fe0 0x557d56564530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.924+0000 7f23a4c91b80 1 --2- 172.21.15.49:0/1058688924 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x557d56574850 0x557d56576c90 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.924+0000 7f23737fe700 0 client.15276 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:00:40.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.924+0000 7f23a4c91b80 1 --2- 172.21.15.49:0/1058688924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557d5655afa0 0x557d56566cf0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.924+0000 7f23a4c91b80 1 --2- 172.21.15.49:0/1058688924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d565606c0 0x557d56563ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.924+0000 7f23a4c91b80 1 -- 172.21.15.49:0/1058688924 >> 172.21.15.49:0/1058688924 conn(0x557d56485d40 msgr2=0x557d56559a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:40.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.924+0000 7f23a4c91b80 1 -- 172.21.15.49:0/1058688924 shutdown_connections 2024-06-03T00:00:40.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.924+0000 7f23a4c91b80 1 -- 172.21.15.49:0/1058688924 wait complete. 2024-06-03T00:00:40.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.924+0000 7f23a4c91b80 20 client.15276 trim_cache size 0 max 16384 2024-06-03T00:00:40.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.945+0000 7f23a4c91b80 1 Processor -- start 2024-06-03T00:00:40.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.945+0000 7f23a4c91b80 1 -- start start 2024-06-03T00:00:40.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.946+0000 7f23a4c91b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d5655afa0 0x557d5655aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:40.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.946+0000 7f23a4c91b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557d565606c0 0x557d56561c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:40.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.946+0000 7f23a4c91b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557d56560fe0 0x557d5654f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:40.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.946+0000 7f23a4c91b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f23941acc10 con 0x557d56560fe0 2024-06-03T00:00:40.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.946+0000 7f23a4c91b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f23941ae750 con 0x557d565606c0 2024-06-03T00:00:40.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.946+0000 7f23a4c91b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f23941ad2e0 con 0x557d5655afa0 2024-06-03T00:00:40.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.946+0000 7f23989ab700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557d56560fe0 0x557d5654f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:40.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.946+0000 7f23989ab700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557d56560fe0 0x557d5654f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41018/0 (socket says 172.21.15.49:41018) 2024-06-03T00:00:40.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.946+0000 7f23989ab700 1 -- 172.21.15.49:0/4224701262 learned_addr learned my addr 172.21.15.49:0/4224701262 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:40.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.946+0000 7f23937fe700 1 --2- 172.21.15.49:0/4224701262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557d565606c0 0x557d56561c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:40.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.946+0000 7f2393fff700 1 --2- 172.21.15.49:0/4224701262 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d5655afa0 0x557d5655aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:40.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.946+0000 7f23989ab700 1 -- 172.21.15.49:0/4224701262 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d5655afa0 msgr2=0x557d5655aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:40.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.946+0000 7f23989ab700 1 --2- 172.21.15.49:0/4224701262 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d5655afa0 0x557d5655aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.946+0000 7f23989ab700 1 -- 172.21.15.49:0/4224701262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557d565606c0 msgr2=0x557d56561c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:40.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.946+0000 7f23989ab700 1 --2- 172.21.15.49:0/4224701262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557d565606c0 0x557d56561c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.946+0000 7f23989ab700 1 -- 172.21.15.49:0/4224701262 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d56577310 con 0x557d56560fe0 2024-06-03T00:00:40.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.946+0000 7f23989ab700 1 --2- 172.21.15.49:0/4224701262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557d56560fe0 0x557d5654f590 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f238c018000 tx=0x7f238c009be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e216761ad926c5 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:40.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.947+0000 7f2379ffb700 1 -- 172.21.15.49:0/4224701262 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c0146a0 con 0x557d56560fe0 2024-06-03T00:00:40.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.947+0000 7f2379ffb700 1 -- 172.21.15.49:0/4224701262 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f238c019070 con 0x557d56560fe0 2024-06-03T00:00:40.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.947+0000 7f2379ffb700 1 -- 172.21.15.49:0/4224701262 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c027df0 con 0x557d56560fe0 2024-06-03T00:00:40.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.947+0000 7f23a4c91b80 1 -- 172.21.15.49:0/4224701262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557d56560fe0 msgr2=0x557d5654f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:40.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.947+0000 7f23a4c91b80 1 --2- 172.21.15.49:0/4224701262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557d56560fe0 0x557d5654f590 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f238c018000 tx=0x7f238c009be0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.947+0000 7f23a4c91b80 1 -- 172.21.15.49:0/4224701262 shutdown_connections 2024-06-03T00:00:40.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.947+0000 7f23a4c91b80 1 --2- 172.21.15.49:0/4224701262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557d56560fe0 0x557d5654f590 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.947+0000 7f23a4c91b80 1 --2- 172.21.15.49:0/4224701262 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d5655afa0 0x557d5655aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.947+0000 7f23a4c91b80 1 --2- 172.21.15.49:0/4224701262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557d565606c0 0x557d56561c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.947+0000 7f23a4c91b80 1 -- 172.21.15.49:0/4224701262 >> 172.21.15.49:0/4224701262 conn(0x557d56485d40 msgr2=0x557d5654ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:40.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.947+0000 7f23a4c91b80 1 -- 172.21.15.49:0/4224701262 shutdown_connections 2024-06-03T00:00:40.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.947+0000 7f23a4c91b80 1 -- 172.21.15.49:0/4224701262 wait complete. 2024-06-03T00:00:40.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.948+0000 7f23a4c91b80 1 -- start start 2024-06-03T00:00:40.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.948+0000 7f23a4c91b80 1 Processor -- start 2024-06-03T00:00:40.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.948+0000 7f23a4c91b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557d5655afa0 0x557d5656d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:40.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.948+0000 7f23a4c91b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557d565606c0 0x557d56569e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:40.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.948+0000 7f23a4c91b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d56560fe0 0x557d5656a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:40.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.948+0000 7f23a4c91b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f23941ae080 con 0x557d5655afa0 2024-06-03T00:00:40.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.948+0000 7f23a4c91b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f23941ad9b0 con 0x557d565606c0 2024-06-03T00:00:40.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.948+0000 7f23a4c91b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f23941aab90 con 0x557d56560fe0 2024-06-03T00:00:40.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.948+0000 7f23a4c91b80 10 client.0 _ll_register_callbacks cb 0x557d564469a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:00:40.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.948+0000 7f2393fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557d5655afa0 0x557d5656d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:40.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.948+0000 7f2393fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557d5655afa0 0x557d5656d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41032/0 (socket says 172.21.15.49:41032) 2024-06-03T00:00:40.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.948+0000 7f2393fff700 1 -- 172.21.15.49:0/4138436802 learned_addr learned my addr 172.21.15.49:0/4138436802 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:40.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.949+0000 7f23989ab700 1 --2- 172.21.15.49:0/4138436802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d56560fe0 0x557d5656a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:40.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.949+0000 7f23937fe700 1 --2- 172.21.15.49:0/4138436802 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557d565606c0 0x557d56569e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:40.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.949+0000 7f2393fff700 1 -- 172.21.15.49:0/4138436802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d56560fe0 msgr2=0x557d5656a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:40.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.949+0000 7f2393fff700 1 --2- 172.21.15.49:0/4138436802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d56560fe0 0x557d5656a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.949+0000 7f2393fff700 1 -- 172.21.15.49:0/4138436802 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557d565606c0 msgr2=0x557d56569e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:40.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.949+0000 7f2393fff700 1 --2- 172.21.15.49:0/4138436802 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557d565606c0 0x557d56569e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.949+0000 7f2393fff700 1 -- 172.21.15.49:0/4138436802 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d5656a9c0 con 0x557d5655afa0 2024-06-03T00:00:40.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.949+0000 7f23937fe700 1 --2- 172.21.15.49:0/4138436802 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557d565606c0 0x557d56569e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:00:40.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.949+0000 7f23989ab700 1 --2- 172.21.15.49:0/4138436802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d56560fe0 0x557d5656a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:00:40.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.949+0000 7f2393fff700 1 --2- 172.21.15.49:0/4138436802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557d5655afa0 0x557d5656d3b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2384022520 tx=0x7f238409ae50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0a40f18434b686 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:40.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.949+0000 7f23737fe700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:00:40.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.949+0000 7f23737fe700 1 -- 172.21.15.49:0/4138436802 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2384087230 con 0x557d5655afa0 2024-06-03T00:00:40.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.949+0000 7f23737fe700 1 -- 172.21.15.49:0/4138436802 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f238409bd90 con 0x557d5655afa0 2024-06-03T00:00:40.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.949+0000 7f23a4c91b80 1 -- 172.21.15.49:0/4138436802 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f238c019070 con 0x557d5655afa0 2024-06-03T00:00:40.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.949+0000 7f23737fe700 1 -- 172.21.15.49:0/4138436802 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f23840a0cf0 con 0x557d5655afa0 2024-06-03T00:00:40.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.949+0000 7f23a4c91b80 10 client.15282 fetch_fsmap learned FSMap version 27 2024-06-03T00:00:40.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.949+0000 7f23a4c91b80 1 -- 172.21.15.49:0/4138436802 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557d565e03c0 con 0x557d5655afa0 2024-06-03T00:00:40.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.949+0000 7f23737fe700 1 -- 172.21.15.49:0/4138436802 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f238c019070 con 0x557d5655afa0 2024-06-03T00:00:40.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.950+0000 7f23737fe700 1 -- 172.21.15.49:0/4138436802 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f2384082020 con 0x557d5655afa0 2024-06-03T00:00:40.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.950+0000 7f23a4c91b80 10 client.15282 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:00:40.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.950+0000 7f23a4c91b80 10 client.15282 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-03T00:00:40.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.950+0000 7f23a4c91b80 20 client.15282 populate_metadata read hostname 'smithi049' 2024-06-03T00:00:40.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.950+0000 7f23a4c91b80 1 --2- 172.21.15.49:0/4138436802 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x557d565e0990 0x557d565e2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:40.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.950+0000 7f23a4c91b80 4 client.15282 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-06-03T00:00:40.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.950+0000 7f23a4c91b80 1 -- 172.21.15.49:0/4138436802 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557d564b4310 con 0x557d565e0990 2024-06-03T00:00:40.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.950+0000 7f23937fe700 1 --2- 172.21.15.49:0/4138436802 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x557d565e0990 0x557d565e2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:40.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.950+0000 7f23937fe700 1 --2- 172.21.15.49:0/4138436802 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x557d565e0990 0x557d565e2db0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9e9165283d07dd4 server_cookie=63be6052c053bde7 in_seq=0 out_seq=0 2024-06-03T00:00:40.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.950+0000 7f23737fe700 10 client.15282 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:00:40.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.951+0000 7f23737fe700 1 -- 172.21.15.49:0/4138436802 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557d564b4310 con 0x557d565e0990 2024-06-03T00:00:40.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.951+0000 7f23737fe700 10 client.15282 handle_command_reply: tid=0 2024-06-03T00:00:40.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.951+0000 7f23a4c91b80 1 client.15282 shutdown 2024-06-03T00:00:40.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.952+0000 7f23a4c91b80 1 -- 172.21.15.49:0/4138436802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557d5655afa0 msgr2=0x557d5656d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:40.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.952+0000 7f23a4c91b80 1 --2- 172.21.15.49:0/4138436802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557d5655afa0 0x557d5656d3b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2384022520 tx=0x7f238409ae50 comp rx=0 tx=0).stop 2024-06-03T00:00:40.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.952+0000 7f23a4c91b80 1 -- 172.21.15.49:0/4138436802 shutdown_connections 2024-06-03T00:00:40.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.952+0000 7f23a4c91b80 1 --2- 172.21.15.49:0/4138436802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557d56560fe0 0x557d5656a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.952+0000 7f23a4c91b80 1 --2- 172.21.15.49:0/4138436802 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x557d565e0990 0x557d565e2db0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.952+0000 7f23a4c91b80 1 --2- 172.21.15.49:0/4138436802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557d5655afa0 0x557d5656d3b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.952+0000 7f23a4c91b80 1 --2- 172.21.15.49:0/4138436802 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557d565606c0 0x557d56569e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.952+0000 7f23a4c91b80 1 -- 172.21.15.49:0/4138436802 >> 172.21.15.49:0/4138436802 conn(0x557d56485d40 msgr2=0x557d5654f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:40.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.952+0000 7f23737fe700 0 client.15282 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:00:40.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.952+0000 7f23a4c91b80 1 -- 172.21.15.49:0/4138436802 shutdown_connections 2024-06-03T00:00:40.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.952+0000 7f23a4c91b80 1 -- 172.21.15.49:0/4138436802 wait complete. 2024-06-03T00:00:40.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.952+0000 7f23a4c91b80 20 client.15282 trim_cache size 0 max 16384 2024-06-03T00:00:40.964 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:00:40.965 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-06-03T00:00:40.965 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "e39d2e89-16ad-4792-afeb-08f797e5c6e0", 2024-06-03T00:00:40.965 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-06-03T00:00:40.965 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:00:40.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.953+0000 7f239a40e700 1 -- 172.21.15.49:0/3974199226 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f237c0a2ca0 msgr2=0x7f237c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:40.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.953+0000 7f239a40e700 1 --2- 172.21.15.49:0/3974199226 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f237c0a2ca0 0x7f237c0a5160 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f239419a260 tx=0x7f238800a300 comp rx=0 tx=0).stop 2024-06-03T00:00:40.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.953+0000 7f239a40e700 1 -- 172.21.15.49:0/3974199226 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23941024e0 msgr2=0x7f239419ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:40.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.953+0000 7f239a40e700 1 --2- 172.21.15.49:0/3974199226 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23941024e0 0x7f239419ea40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2384000c00 tx=0x7f2384003680 comp rx=0 tx=0).stop 2024-06-03T00:00:40.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.953+0000 7f239a40e700 1 -- 172.21.15.49:0/3974199226 shutdown_connections 2024-06-03T00:00:40.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.953+0000 7f239a40e700 1 --2- 172.21.15.49:0/3974199226 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f237c0a2ca0 0x7f237c0a5160 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.953+0000 7f239a40e700 1 --2- 172.21.15.49:0/3974199226 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23941084f0 0x7f2394198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.953+0000 7f239a40e700 1 --2- 172.21.15.49:0/3974199226 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23941024e0 0x7f239419ea40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.953+0000 7f239a40e700 1 --2- 172.21.15.49:0/3974199226 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2394102e80 0x7f239419ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:40.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.953+0000 7f239a40e700 1 -- 172.21.15.49:0/3974199226 >> 172.21.15.49:0/3974199226 conn(0x7f2394079530 msgr2=0x7f2394100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:40.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.953+0000 7f239a40e700 1 -- 172.21.15.49:0/3974199226 shutdown_connections 2024-06-03T00:00:40.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:40.953+0000 7f239a40e700 1 -- 172.21.15.49:0/3974199226 wait complete. 2024-06-03T00:00:41.197 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:41 smithi049 ceph-mon[32302]: pgmap v402: 97 pgs: 97 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 767 B/s wr, 10 op/s 2024-06-03T00:00:41.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:41 smithi107 ceph-mon[37048]: pgmap v402: 97 pgs: 97 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 767 B/s wr, 10 op/s 2024-06-03T00:00:41.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:41 smithi057 ceph-mon[36457]: pgmap v402: 97 pgs: 97 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 767 B/s wr, 10 op/s 2024-06-03T00:00:41.918 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-03T00:00:42.136 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:42 smithi049 ceph-mon[32302]: scrub queued for path: / 2024-06-03T00:00:42.136 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:42 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:00:42.136 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:42 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:00:42.136 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:42 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:00:42.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.154+0000 7f753c149700 1 -- 172.21.15.49:0/2833306424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7534108510 msgr2=0x7f75341088f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:42.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.154+0000 7f753c149700 1 --2- 172.21.15.49:0/2833306424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7534108510 0x7f75341088f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7530009990 tx=0x7f7530009ca0 comp rx=0 tx=0).stop 2024-06-03T00:00:42.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.154+0000 7f753c149700 1 -- 172.21.15.49:0/2833306424 shutdown_connections 2024-06-03T00:00:42.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.154+0000 7f753c149700 1 --2- 172.21.15.49:0/2833306424 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7534102ed0 0x7f753410f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:42.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.154+0000 7f753c149700 1 --2- 172.21.15.49:0/2833306424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7534108510 0x7f75341088f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:42.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.154+0000 7f753c149700 1 --2- 172.21.15.49:0/2833306424 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7534102510 0x7f7534102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:42.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.154+0000 7f753c149700 1 -- 172.21.15.49:0/2833306424 >> 172.21.15.49:0/2833306424 conn(0x7f7534079560 msgr2=0x7f7534079970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:42.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.154+0000 7f753c149700 1 -- 172.21.15.49:0/2833306424 shutdown_connections 2024-06-03T00:00:42.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.155+0000 7f753c149700 1 -- 172.21.15.49:0/2833306424 wait complete. 2024-06-03T00:00:42.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.155+0000 7f753c149700 1 Processor -- start 2024-06-03T00:00:42.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.155+0000 7f753c149700 1 -- start start 2024-06-03T00:00:42.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.155+0000 7f753c149700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7534102510 0x7f753419e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:42.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.155+0000 7f753c149700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7534102ed0 0x7f753419ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:42.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.155+0000 7f753c149700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7534108510 0x7f7534198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:42.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.155+0000 7f753c149700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f75341127f0 con 0x7f7534102ed0 2024-06-03T00:00:42.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.155+0000 7f753c149700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f7534112670 con 0x7f7534102510 2024-06-03T00:00:42.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.155+0000 7f753c149700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7534112970 con 0x7f7534108510 2024-06-03T00:00:42.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.156+0000 7f75396e4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7534102ed0 0x7f753419ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:42.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.156+0000 7f75396e4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7534102ed0 0x7f753419ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41044/0 (socket says 172.21.15.49:41044) 2024-06-03T00:00:42.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.156+0000 7f75396e4700 1 -- 172.21.15.49:0/203023471 learned_addr learned my addr 172.21.15.49:0/203023471 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:42.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.156+0000 7f7539ee5700 1 --2- 172.21.15.49:0/203023471 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7534102510 0x7f753419e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:42.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.156+0000 7f753a6e6700 1 --2- 172.21.15.49:0/203023471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7534108510 0x7f7534198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:42.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.156+0000 7f75396e4700 1 -- 172.21.15.49:0/203023471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7534108510 msgr2=0x7f7534198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:42.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.156+0000 7f75396e4700 1 --2- 172.21.15.49:0/203023471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7534108510 0x7f7534198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:42.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.156+0000 7f75396e4700 1 -- 172.21.15.49:0/203023471 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7534102510 msgr2=0x7f753419e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:42.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.156+0000 7f75396e4700 1 --2- 172.21.15.49:0/203023471 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7534102510 0x7f753419e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:42.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.156+0000 7f75396e4700 1 -- 172.21.15.49:0/203023471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7534199290 con 0x7f7534102ed0 2024-06-03T00:00:42.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.156+0000 7f75396e4700 1 --2- 172.21.15.49:0/203023471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7534102ed0 0x7f753419ee60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f752800c920 tx=0x7f752800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:42.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.156+0000 7f7526ffd700 1 -- 172.21.15.49:0/203023471 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7528007b00 con 0x7f7534102ed0 2024-06-03T00:00:42.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.156+0000 7f7526ffd700 1 -- 172.21.15.49:0/203023471 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7528004d10 con 0x7f7534102ed0 2024-06-03T00:00:42.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.157+0000 7f753c149700 1 -- 172.21.15.49:0/203023471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7534199580 con 0x7f7534102ed0 2024-06-03T00:00:42.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.157+0000 7f7526ffd700 1 -- 172.21.15.49:0/203023471 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7528005680 con 0x7f7534102ed0 2024-06-03T00:00:42.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.157+0000 7f753c149700 1 -- 172.21.15.49:0/203023471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75341a57f0 con 0x7f7534102ed0 2024-06-03T00:00:42.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.158+0000 7f753c149700 1 -- 172.21.15.49:0/203023471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f753410a9f0 con 0x7f7534102ed0 2024-06-03T00:00:42.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.159+0000 7f7526ffd700 1 -- 172.21.15.49:0/203023471 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f752800f450 con 0x7f7534102ed0 2024-06-03T00:00:42.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.160+0000 7f7526ffd700 1 --2- 172.21.15.49:0/203023471 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f75200a2ca0 0x7f75200a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:42.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.160+0000 7f7539ee5700 1 --2- 172.21.15.49:0/203023471 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f75200a2ca0 0x7f75200a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:42.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.160+0000 7f7526ffd700 1 -- 172.21.15.49:0/203023471 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f75280ceb50 con 0x7f7534102ed0 2024-06-03T00:00:42.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.160+0000 7f7539ee5700 1 --2- 172.21.15.49:0/203023471 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f75200a2ca0 0x7f75200a5160 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f753000b5c0 tx=0x7f7530005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:42.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.164+0000 7f7526ffd700 1 -- 172.21.15.49:0/203023471 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7528014030 con 0x7f7534102ed0 2024-06-03T00:00:42.217 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:00:42.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:42 smithi107 ceph-mon[37048]: scrub queued for path: / 2024-06-03T00:00:42.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:42 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:00:42.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:42 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:00:42.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:42 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:00:42.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.378+0000 7f753c149700 1 -- 172.21.15.49:0/203023471 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7534199fd0 con 0x7f75200a2ca0 2024-06-03T00:00:42.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.385+0000 7f7526ffd700 1 -- 172.21.15.49:0/203023471 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258896 (secure 0 0 0) 0x7f7534199fd0 con 0x7f75200a2ca0 2024-06-03T00:00:42.390 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:00:42.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.390+0000 7f753c149700 1 -- 172.21.15.49:0/203023471 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f75200a2ca0 msgr2=0x7f75200a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:42.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.390+0000 7f753c149700 1 --2- 172.21.15.49:0/203023471 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f75200a2ca0 0x7f75200a5160 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f753000b5c0 tx=0x7f7530005960 comp rx=0 tx=0).stop 2024-06-03T00:00:42.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.390+0000 7f753c149700 1 -- 172.21.15.49:0/203023471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7534102ed0 msgr2=0x7f753419ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:42.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.390+0000 7f753c149700 1 --2- 172.21.15.49:0/203023471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7534102ed0 0x7f753419ee60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f752800c920 tx=0x7f752800cc30 comp rx=0 tx=0).stop 2024-06-03T00:00:42.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.390+0000 7f753c149700 1 -- 172.21.15.49:0/203023471 shutdown_connections 2024-06-03T00:00:42.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.390+0000 7f753c149700 1 --2- 172.21.15.49:0/203023471 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f75200a2ca0 0x7f75200a5160 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:42.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.390+0000 7f753c149700 1 --2- 172.21.15.49:0/203023471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7534108510 0x7f7534198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:42.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.390+0000 7f753c149700 1 --2- 172.21.15.49:0/203023471 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7534102510 0x7f753419e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:42.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.390+0000 7f753c149700 1 --2- 172.21.15.49:0/203023471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7534102ed0 0x7f753419ee60 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:42.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.390+0000 7f753c149700 1 -- 172.21.15.49:0/203023471 >> 172.21.15.49:0/203023471 conn(0x7f7534079560 msgr2=0x7f75341011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:42.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.390+0000 7f753c149700 1 -- 172.21.15.49:0/203023471 shutdown_connections 2024-06-03T00:00:42.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:42.390+0000 7f753c149700 1 -- 172.21.15.49:0/203023471 wait complete. 2024-06-03T00:00:42.393 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-06-03T00:00:42.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:42 smithi057 ceph-mon[36457]: scrub queued for path: / 2024-06-03T00:00:42.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:42 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:00:42.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:42 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:00:42.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:42 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:00:43.139 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":403,"stamp":"2024-06-03T00:00:41.289319+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665041,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":2024,"num_read_kb":1138,"num_write":446,"num_write_kb":3094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":1180736,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":864,"ondisk_log_size":864,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375492,"kb_used_data":13860,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124566332,"statfs":{"total":1151940427776,"available":1151555923968,"internally_reserved":0,"allocated":14192640,"data_stored":7747851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4314,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":60,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003067"},"pg_stats":[{"pgid":"3.3f","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.275149+0000","last_change":"2024-06-02T23:57:15.321542+0000","last_active":"2024-06-02T23:58:55.275149+0000","last_peered":"2024-06-02T23:58:55.275149+0000","last_clean":"2024-06-02T23:58:55.275149+0000","last_became_active":"2024-06-02T23:57:15.321129+0000","last_became_peered":"2024-06-02T23:57:15.321129+0000","last_unstale":"2024-06-02T23:58:55.275149+0000","last_undegraded":"2024-06-02T23:58:55.275149+0000","last_fullsized":"2024-06-02T23:58:55.275149+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:35:50.218316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272859+0000","last_change":"2024-06-02T23:57:15.327432+0000","last_active":"2024-06-02T23:58:55.272859+0000","last_peered":"2024-06-02T23:58:55.272859+0000","last_clean":"2024-06-02T23:58:55.272859+0000","last_became_active":"2024-06-02T23:57:15.326759+0000","last_became_peered":"2024-06-02T23:57:15.326759+0000","last_unstale":"2024-06-02T23:58:55.272859+0000","last_undegraded":"2024-06-02T23:58:55.272859+0000","last_fullsized":"2024-06-02T23:58:55.272859+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:42:20.473216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.274694+0000","last_change":"2024-06-02T23:57:15.323721+0000","last_active":"2024-06-02T23:58:55.274694+0000","last_peered":"2024-06-02T23:58:55.274694+0000","last_clean":"2024-06-02T23:58:55.274694+0000","last_became_active":"2024-06-02T23:57:15.321277+0000","last_became_peered":"2024-06-02T23:57:15.321277+0000","last_unstale":"2024-06-02T23:58:55.274694+0000","last_undegraded":"2024-06-02T23:58:55.274694+0000","last_fullsized":"2024-06-02T23:58:55.274694+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:34:31.667999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.258319+0000","last_change":"2024-06-02T23:57:15.323769+0000","last_active":"2024-06-02T23:58:55.258319+0000","last_peered":"2024-06-02T23:58:55.258319+0000","last_clean":"2024-06-02T23:58:55.258319+0000","last_became_active":"2024-06-02T23:57:15.323406+0000","last_became_peered":"2024-06-02T23:57:15.323406+0000","last_unstale":"2024-06-02T23:58:55.258319+0000","last_undegraded":"2024-06-02T23:58:55.258319+0000","last_fullsized":"2024-06-02T23:58:55.258319+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:51:27.456210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.258510+0000","last_change":"2024-06-02T23:57:56.531404+0000","last_active":"2024-06-02T23:58:55.258510+0000","last_peered":"2024-06-02T23:58:55.258510+0000","last_clean":"2024-06-02T23:58:55.258510+0000","last_became_active":"2024-06-02T23:57:56.530952+0000","last_became_peered":"2024-06-02T23:57:56.530952+0000","last_unstale":"2024-06-02T23:58:55.258510+0000","last_undegraded":"2024-06-02T23:58:55.258510+0000","last_fullsized":"2024-06-02T23:58:55.258510+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:39:30.405113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268533+0000","last_change":"2024-06-02T23:57:15.320843+0000","last_active":"2024-06-02T23:58:55.268533+0000","last_peered":"2024-06-02T23:58:55.268533+0000","last_clean":"2024-06-02T23:58:55.268533+0000","last_became_active":"2024-06-02T23:57:15.320472+0000","last_became_peered":"2024-06-02T23:57:15.320472+0000","last_unstale":"2024-06-02T23:58:55.268533+0000","last_undegraded":"2024-06-02T23:58:55.268533+0000","last_fullsized":"2024-06-02T23:58:55.268533+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:49:02.620777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.271511+0000","last_change":"2024-06-02T23:57:15.321799+0000","last_active":"2024-06-02T23:58:55.271511+0000","last_peered":"2024-06-02T23:58:55.271511+0000","last_clean":"2024-06-02T23:58:55.271511+0000","last_became_active":"2024-06-02T23:57:15.321379+0000","last_became_peered":"2024-06-02T23:57:15.321379+0000","last_unstale":"2024-06-02T23:58:55.271511+0000","last_undegraded":"2024-06-02T23:58:55.271511+0000","last_fullsized":"2024-06-02T23:58:55.271511+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:36:56.404936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268859+0000","last_change":"2024-06-02T23:57:15.318771+0000","last_active":"2024-06-02T23:58:55.268859+0000","last_peered":"2024-06-02T23:58:55.268859+0000","last_clean":"2024-06-02T23:58:55.268859+0000","last_became_active":"2024-06-02T23:57:15.318420+0000","last_became_peered":"2024-06-02T23:57:15.318420+0000","last_unstale":"2024-06-02T23:58:55.268859+0000","last_undegraded":"2024-06-02T23:58:55.268859+0000","last_fullsized":"2024-06-02T23:58:55.268859+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:07:53.769443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.274516+0000","last_change":"2024-06-02T23:57:15.318989+0000","last_active":"2024-06-02T23:58:55.274516+0000","last_peered":"2024-06-02T23:58:55.274516+0000","last_clean":"2024-06-02T23:58:55.274516+0000","last_became_active":"2024-06-02T23:57:15.318424+0000","last_became_peered":"2024-06-02T23:57:15.318424+0000","last_unstale":"2024-06-02T23:58:55.274516+0000","last_undegraded":"2024-06-02T23:58:55.274516+0000","last_fullsized":"2024-06-02T23:58:55.274516+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:30:47.634662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265217+0000","last_change":"2024-06-02T23:57:15.326251+0000","last_active":"2024-06-02T23:58:55.265217+0000","last_peered":"2024-06-02T23:58:55.265217+0000","last_clean":"2024-06-02T23:58:55.265217+0000","last_became_active":"2024-06-02T23:57:15.325890+0000","last_became_peered":"2024-06-02T23:57:15.325890+0000","last_unstale":"2024-06-02T23:58:55.265217+0000","last_undegraded":"2024-06-02T23:58:55.265217+0000","last_fullsized":"2024-06-02T23:58:55.265217+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:18:54.871410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.274001+0000","last_change":"2024-06-02T23:57:15.325364+0000","last_active":"2024-06-02T23:58:55.274001+0000","last_peered":"2024-06-02T23:58:55.274001+0000","last_clean":"2024-06-02T23:58:55.274001+0000","last_became_active":"2024-06-02T23:57:15.324987+0000","last_became_peered":"2024-06-02T23:57:15.324987+0000","last_unstale":"2024-06-02T23:58:55.274001+0000","last_undegraded":"2024-06-02T23:58:55.274001+0000","last_fullsized":"2024-06-02T23:58:55.274001+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:59:11.827263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265434+0000","last_change":"2024-06-02T23:57:15.328027+0000","last_active":"2024-06-02T23:58:55.265434+0000","last_peered":"2024-06-02T23:58:55.265434+0000","last_clean":"2024-06-02T23:58:55.265434+0000","last_became_active":"2024-06-02T23:57:15.327608+0000","last_became_peered":"2024-06-02T23:57:15.327608+0000","last_unstale":"2024-06-02T23:58:55.265434+0000","last_undegraded":"2024-06-02T23:58:55.265434+0000","last_fullsized":"2024-06-02T23:58:55.265434+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:09:42.152689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262861+0000","last_change":"2024-06-02T23:57:15.323095+0000","last_active":"2024-06-02T23:58:55.262861+0000","last_peered":"2024-06-02T23:58:55.262861+0000","last_clean":"2024-06-02T23:58:55.262861+0000","last_became_active":"2024-06-02T23:57:15.322755+0000","last_became_peered":"2024-06-02T23:57:15.322755+0000","last_unstale":"2024-06-02T23:58:55.262861+0000","last_undegraded":"2024-06-02T23:58:55.262861+0000","last_fullsized":"2024-06-02T23:58:55.262861+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:43:53.195192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272339+0000","last_change":"2024-06-02T23:57:15.327437+0000","last_active":"2024-06-02T23:58:55.272339+0000","last_peered":"2024-06-02T23:58:55.272339+0000","last_clean":"2024-06-02T23:58:55.272339+0000","last_became_active":"2024-06-02T23:57:15.326974+0000","last_became_peered":"2024-06-02T23:57:15.326974+0000","last_unstale":"2024-06-02T23:58:55.272339+0000","last_undegraded":"2024-06-02T23:58:55.272339+0000","last_fullsized":"2024-06-02T23:58:55.272339+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:20:44.978213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273334+0000","last_change":"2024-06-02T23:57:15.325414+0000","last_active":"2024-06-02T23:58:55.273334+0000","last_peered":"2024-06-02T23:58:55.273334+0000","last_clean":"2024-06-02T23:58:55.273334+0000","last_became_active":"2024-06-02T23:57:15.325033+0000","last_became_peered":"2024-06-02T23:57:15.325033+0000","last_unstale":"2024-06-02T23:58:55.273334+0000","last_undegraded":"2024-06-02T23:58:55.273334+0000","last_fullsized":"2024-06-02T23:58:55.273334+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:27:14.536646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272688+0000","last_change":"2024-06-02T23:57:15.315833+0000","last_active":"2024-06-02T23:58:55.272688+0000","last_peered":"2024-06-02T23:58:55.272688+0000","last_clean":"2024-06-02T23:58:55.272688+0000","last_became_active":"2024-06-02T23:57:15.315355+0000","last_became_peered":"2024-06-02T23:57:15.315355+0000","last_unstale":"2024-06-02T23:58:55.272688+0000","last_undegraded":"2024-06-02T23:58:55.272688+0000","last_fullsized":"2024-06-02T23:58:55.272688+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:52:05.915828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.275143+0000","last_change":"2024-06-02T23:57:15.322407+0000","last_active":"2024-06-02T23:58:55.275143+0000","last_peered":"2024-06-02T23:58:55.275143+0000","last_clean":"2024-06-02T23:58:55.275143+0000","last_became_active":"2024-06-02T23:57:15.322090+0000","last_became_peered":"2024-06-02T23:57:15.322090+0000","last_unstale":"2024-06-02T23:58:55.275143+0000","last_undegraded":"2024-06-02T23:58:55.275143+0000","last_fullsized":"2024-06-02T23:58:55.275143+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:08:48.071192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268594+0000","last_change":"2024-06-02T23:57:15.327331+0000","last_active":"2024-06-02T23:58:55.268594+0000","last_peered":"2024-06-02T23:58:55.268594+0000","last_clean":"2024-06-02T23:58:55.268594+0000","last_became_active":"2024-06-02T23:57:15.326863+0000","last_became_peered":"2024-06-02T23:57:15.326863+0000","last_unstale":"2024-06-02T23:58:55.268594+0000","last_undegraded":"2024-06-02T23:58:55.268594+0000","last_fullsized":"2024-06-02T23:58:55.268594+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:45:05.443751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.261047+0000","last_change":"2024-06-02T23:57:15.313008+0000","last_active":"2024-06-02T23:58:55.261047+0000","last_peered":"2024-06-02T23:58:55.261047+0000","last_clean":"2024-06-02T23:58:55.261047+0000","last_became_active":"2024-06-02T23:57:15.312322+0000","last_became_peered":"2024-06-02T23:57:15.312322+0000","last_unstale":"2024-06-02T23:58:55.261047+0000","last_undegraded":"2024-06-02T23:58:55.261047+0000","last_fullsized":"2024-06-02T23:58:55.261047+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:54:03.744964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":227,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:38.420648+0000","last_change":"2024-06-02T23:57:12.153410+0000","last_active":"2024-06-03T00:00:38.420648+0000","last_peered":"2024-06-03T00:00:38.420648+0000","last_clean":"2024-06-03T00:00:38.420648+0000","last_became_active":"2024-06-02T23:57:12.153065+0000","last_became_peered":"2024-06-02T23:57:12.153065+0000","last_unstale":"2024-06-03T00:00:38.420648+0000","last_undegraded":"2024-06-03T00:00:38.420648+0000","last_fullsized":"2024-06-03T00:00:38.420648+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:45:30.058961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":188,"num_read_kb":188,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.258496+0000","last_change":"2024-06-02T23:57:15.314168+0000","last_active":"2024-06-02T23:58:55.258496+0000","last_peered":"2024-06-02T23:58:55.258496+0000","last_clean":"2024-06-02T23:58:55.258496+0000","last_became_active":"2024-06-02T23:57:15.313838+0000","last_became_peered":"2024-06-02T23:57:15.313838+0000","last_unstale":"2024-06-02T23:58:55.258496+0000","last_undegraded":"2024-06-02T23:58:55.258496+0000","last_fullsized":"2024-06-02T23:58:55.258496+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:56:14.137471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526742+0000","last_change":"2024-06-02T23:57:12.305448+0000","last_active":"2024-06-02T23:57:56.526742+0000","last_peered":"2024-06-02T23:57:56.526742+0000","last_clean":"2024-06-02T23:57:56.526742+0000","last_became_active":"2024-06-02T23:57:12.305080+0000","last_became_peered":"2024-06-02T23:57:12.305080+0000","last_unstale":"2024-06-02T23:57:56.526742+0000","last_undegraded":"2024-06-02T23:57:56.526742+0000","last_fullsized":"2024-06-02T23:57:56.526742+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:20:18.660943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.275386+0000","last_change":"2024-06-02T23:57:15.321660+0000","last_active":"2024-06-02T23:58:55.275386+0000","last_peered":"2024-06-02T23:58:55.275386+0000","last_clean":"2024-06-02T23:58:55.275386+0000","last_became_active":"2024-06-02T23:57:15.321304+0000","last_became_peered":"2024-06-02T23:57:15.321304+0000","last_unstale":"2024-06-02T23:58:55.275386+0000","last_undegraded":"2024-06-02T23:58:55.275386+0000","last_fullsized":"2024-06-02T23:58:55.275386+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:10:10.933291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:58.169787+0000","last_change":"2024-06-02T23:57:56.544458+0000","last_active":"2024-06-02T23:57:58.169787+0000","last_peered":"2024-06-02T23:57:58.169787+0000","last_clean":"2024-06-02T23:57:58.169787+0000","last_became_active":"2024-06-02T23:57:56.532838+0000","last_became_peered":"2024-06-02T23:57:56.532838+0000","last_unstale":"2024-06-02T23:57:58.169787+0000","last_undegraded":"2024-06-02T23:57:58.169787+0000","last_fullsized":"2024-06-02T23:57:58.169787+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:27:44.700493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272537+0000","last_change":"2024-06-02T23:57:15.328944+0000","last_active":"2024-06-02T23:58:55.272537+0000","last_peered":"2024-06-02T23:58:55.272537+0000","last_clean":"2024-06-02T23:58:55.272537+0000","last_became_active":"2024-06-02T23:57:15.328531+0000","last_became_peered":"2024-06-02T23:57:15.328531+0000","last_unstale":"2024-06-02T23:58:55.272537+0000","last_undegraded":"2024-06-02T23:58:55.272537+0000","last_fullsized":"2024-06-02T23:58:55.272537+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:48:19.709989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528536+0000","last_change":"2024-06-02T23:57:12.153967+0000","last_active":"2024-06-02T23:57:56.528536+0000","last_peered":"2024-06-02T23:57:56.528536+0000","last_clean":"2024-06-02T23:57:56.528536+0000","last_became_active":"2024-06-02T23:57:12.153600+0000","last_became_peered":"2024-06-02T23:57:12.153600+0000","last_unstale":"2024-06-02T23:57:56.528536+0000","last_undegraded":"2024-06-02T23:57:56.528536+0000","last_fullsized":"2024-06-02T23:57:56.528536+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:47:58.761573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267401+0000","last_change":"2024-06-02T23:57:15.318089+0000","last_active":"2024-06-02T23:58:55.267401+0000","last_peered":"2024-06-02T23:58:55.267401+0000","last_clean":"2024-06-02T23:58:55.267401+0000","last_became_active":"2024-06-02T23:57:15.316494+0000","last_became_peered":"2024-06-02T23:57:15.316494+0000","last_unstale":"2024-06-02T23:58:55.267401+0000","last_undegraded":"2024-06-02T23:58:55.267401+0000","last_fullsized":"2024-06-02T23:58:55.267401+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:21:15.839255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"90'7","reported_seq":224,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:37.415354+0000","last_change":"2024-06-02T23:57:12.153624+0000","last_active":"2024-06-03T00:00:37.415354+0000","last_peered":"2024-06-03T00:00:37.415354+0000","last_clean":"2024-06-03T00:00:37.415354+0000","last_became_active":"2024-06-02T23:57:12.152712+0000","last_became_peered":"2024-06-02T23:57:12.152712+0000","last_unstale":"2024-06-03T00:00:37.415354+0000","last_undegraded":"2024-06-03T00:00:37.415354+0000","last_fullsized":"2024-06-03T00:00:37.415354+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:14:50.236213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":190,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259432+0000","last_change":"2024-06-02T23:57:15.325293+0000","last_active":"2024-06-02T23:58:55.259432+0000","last_peered":"2024-06-02T23:58:55.259432+0000","last_clean":"2024-06-02T23:58:55.259432+0000","last_became_active":"2024-06-02T23:57:15.324967+0000","last_became_peered":"2024-06-02T23:57:15.324967+0000","last_unstale":"2024-06-02T23:58:55.259432+0000","last_undegraded":"2024-06-02T23:58:55.259432+0000","last_fullsized":"2024-06-02T23:58:55.259432+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:21:23.634118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.735981+0000","last_change":"2024-06-02T23:57:12.155927+0000","last_active":"2024-06-02T23:57:56.735981+0000","last_peered":"2024-06-02T23:57:56.735981+0000","last_clean":"2024-06-02T23:57:56.735981+0000","last_became_active":"2024-06-02T23:57:12.155505+0000","last_became_peered":"2024-06-02T23:57:12.155505+0000","last_unstale":"2024-06-02T23:57:56.735981+0000","last_undegraded":"2024-06-02T23:57:56.735981+0000","last_fullsized":"2024-06-02T23:57:56.735981+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:47.555747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262458+0000","last_change":"2024-06-02T23:57:15.321796+0000","last_active":"2024-06-02T23:58:55.262458+0000","last_peered":"2024-06-02T23:58:55.262458+0000","last_clean":"2024-06-02T23:58:55.262458+0000","last_became_active":"2024-06-02T23:57:15.320850+0000","last_became_peered":"2024-06-02T23:57:15.320850+0000","last_unstale":"2024-06-02T23:58:55.262458+0000","last_undegraded":"2024-06-02T23:58:55.262458+0000","last_fullsized":"2024-06-02T23:58:55.262458+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:04:10.991920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.523859+0000","last_change":"2024-06-02T23:57:12.146589+0000","last_active":"2024-06-02T23:57:56.523859+0000","last_peered":"2024-06-02T23:57:56.523859+0000","last_clean":"2024-06-02T23:57:56.523859+0000","last_became_active":"2024-06-02T23:57:12.146224+0000","last_became_peered":"2024-06-02T23:57:12.146224+0000","last_unstale":"2024-06-02T23:57:56.523859+0000","last_undegraded":"2024-06-02T23:57:56.523859+0000","last_fullsized":"2024-06-02T23:57:56.523859+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:17:31.250585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268843+0000","last_change":"2024-06-02T23:57:15.315553+0000","last_active":"2024-06-02T23:58:55.268843+0000","last_peered":"2024-06-02T23:58:55.268843+0000","last_clean":"2024-06-02T23:58:55.268843+0000","last_became_active":"2024-06-02T23:57:15.315217+0000","last_became_peered":"2024-06-02T23:57:15.315217+0000","last_unstale":"2024-06-02T23:58:55.268843+0000","last_undegraded":"2024-06-02T23:58:55.268843+0000","last_fullsized":"2024-06-02T23:58:55.268843+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:00:23.097949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.525158+0000","last_change":"2024-06-02T23:57:12.156971+0000","last_active":"2024-06-02T23:57:56.525158+0000","last_peered":"2024-06-02T23:57:56.525158+0000","last_clean":"2024-06-02T23:57:56.525158+0000","last_became_active":"2024-06-02T23:57:12.156379+0000","last_became_peered":"2024-06-02T23:57:12.156379+0000","last_unstale":"2024-06-02T23:57:56.525158+0000","last_undegraded":"2024-06-02T23:57:56.525158+0000","last_fullsized":"2024-06-02T23:57:56.525158+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:28:50.057736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.266692+0000","last_change":"2024-06-02T23:57:15.313985+0000","last_active":"2024-06-02T23:58:55.266692+0000","last_peered":"2024-06-02T23:58:55.266692+0000","last_clean":"2024-06-02T23:58:55.266692+0000","last_became_active":"2024-06-02T23:57:15.313668+0000","last_became_peered":"2024-06-02T23:57:15.313668+0000","last_unstale":"2024-06-02T23:58:55.266692+0000","last_undegraded":"2024-06-02T23:58:55.266692+0000","last_fullsized":"2024-06-02T23:58:55.266692+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:10:56.560660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"90'5","reported_seq":400,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:36.413172+0000","last_change":"2024-06-02T23:57:12.156025+0000","last_active":"2024-06-03T00:00:36.413172+0000","last_peered":"2024-06-03T00:00:36.413172+0000","last_clean":"2024-06-03T00:00:36.413172+0000","last_became_active":"2024-06-02T23:57:12.155609+0000","last_became_peered":"2024-06-02T23:57:12.155609+0000","last_unstale":"2024-06-03T00:00:36.413172+0000","last_undegraded":"2024-06-03T00:00:36.413172+0000","last_fullsized":"2024-06-03T00:00:36.413172+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:27:48.953456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":368,"num_read_kb":368,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272606+0000","last_change":"2024-06-02T23:57:15.329711+0000","last_active":"2024-06-02T23:58:55.272606+0000","last_peered":"2024-06-02T23:58:55.272606+0000","last_clean":"2024-06-02T23:58:55.272606+0000","last_became_active":"2024-06-02T23:57:15.329284+0000","last_became_peered":"2024-06-02T23:57:15.329284+0000","last_unstale":"2024-06-02T23:58:55.272606+0000","last_undegraded":"2024-06-02T23:58:55.272606+0000","last_fullsized":"2024-06-02T23:58:55.272606+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:58:06.165152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.529073+0000","last_change":"2024-06-02T23:57:12.156949+0000","last_active":"2024-06-02T23:57:56.529073+0000","last_peered":"2024-06-02T23:57:56.529073+0000","last_clean":"2024-06-02T23:57:56.529073+0000","last_became_active":"2024-06-02T23:57:12.156558+0000","last_became_peered":"2024-06-02T23:57:12.156558+0000","last_unstale":"2024-06-02T23:57:56.529073+0000","last_undegraded":"2024-06-02T23:57:56.529073+0000","last_fullsized":"2024-06-02T23:57:56.529073+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:05:57.658900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273919+0000","last_change":"2024-06-02T23:57:15.318638+0000","last_active":"2024-06-02T23:58:55.273919+0000","last_peered":"2024-06-02T23:58:55.273919+0000","last_clean":"2024-06-02T23:58:55.273919+0000","last_became_active":"2024-06-02T23:57:15.318321+0000","last_became_peered":"2024-06-02T23:57:15.318321+0000","last_unstale":"2024-06-02T23:58:55.273919+0000","last_undegraded":"2024-06-02T23:58:55.273919+0000","last_fullsized":"2024-06-02T23:58:55.273919+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:21:57.877235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526151+0000","last_change":"2024-06-02T23:57:12.306278+0000","last_active":"2024-06-02T23:57:56.526151+0000","last_peered":"2024-06-02T23:57:56.526151+0000","last_clean":"2024-06-02T23:57:56.526151+0000","last_became_active":"2024-06-02T23:57:12.305885+0000","last_became_peered":"2024-06-02T23:57:12.305885+0000","last_unstale":"2024-06-02T23:57:56.526151+0000","last_undegraded":"2024-06-02T23:57:56.526151+0000","last_fullsized":"2024-06-02T23:57:56.526151+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:05:07.723501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.266773+0000","last_change":"2024-06-02T23:57:15.322489+0000","last_active":"2024-06-02T23:58:55.266773+0000","last_peered":"2024-06-02T23:58:55.266773+0000","last_clean":"2024-06-02T23:58:55.266773+0000","last_became_active":"2024-06-02T23:57:15.322131+0000","last_became_peered":"2024-06-02T23:57:15.322131+0000","last_unstale":"2024-06-02T23:58:55.266773+0000","last_undegraded":"2024-06-02T23:58:55.266773+0000","last_fullsized":"2024-06-02T23:58:55.266773+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:34:43.362338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"90'39","reported_seq":448,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:36.413201+0000","last_change":"2024-06-02T23:57:12.156920+0000","last_active":"2024-06-03T00:00:36.413201+0000","last_peered":"2024-06-03T00:00:36.413201+0000","last_clean":"2024-06-03T00:00:36.413201+0000","last_became_active":"2024-06-02T23:57:12.156494+0000","last_became_peered":"2024-06-02T23:57:12.156494+0000","last_unstale":"2024-06-03T00:00:36.413201+0000","last_undegraded":"2024-06-03T00:00:36.413201+0000","last_fullsized":"2024-06-03T00:00:36.413201+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:49:56.458730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67178,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":382,"num_read_kb":257,"num_write":41,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265549+0000","last_change":"2024-06-02T23:57:15.328502+0000","last_active":"2024-06-02T23:58:55.265549+0000","last_peered":"2024-06-02T23:58:55.265549+0000","last_clean":"2024-06-02T23:58:55.265549+0000","last_became_active":"2024-06-02T23:57:15.328174+0000","last_became_peered":"2024-06-02T23:57:15.328174+0000","last_unstale":"2024-06-02T23:58:55.265549+0000","last_undegraded":"2024-06-02T23:58:55.265549+0000","last_fullsized":"2024-06-02T23:58:55.265549+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:58:33.355397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527385+0000","last_change":"2024-06-02T23:57:12.154204+0000","last_active":"2024-06-02T23:57:56.527385+0000","last_peered":"2024-06-02T23:57:56.527385+0000","last_clean":"2024-06-02T23:57:56.527385+0000","last_became_active":"2024-06-02T23:57:12.153412+0000","last_became_peered":"2024-06-02T23:57:12.153412+0000","last_unstale":"2024-06-02T23:57:56.527385+0000","last_undegraded":"2024-06-02T23:57:56.527385+0000","last_fullsized":"2024-06-02T23:57:56.527385+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:15.472279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262255+0000","last_change":"2024-06-02T23:57:15.314274+0000","last_active":"2024-06-02T23:58:55.262255+0000","last_peered":"2024-06-02T23:58:55.262255+0000","last_clean":"2024-06-02T23:58:55.262255+0000","last_became_active":"2024-06-02T23:57:15.313946+0000","last_became_peered":"2024-06-02T23:57:15.313946+0000","last_unstale":"2024-06-02T23:58:55.262255+0000","last_undegraded":"2024-06-02T23:58:55.262255+0000","last_fullsized":"2024-06-02T23:58:55.262255+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:07.909977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.525241+0000","last_change":"2024-06-02T23:57:12.156767+0000","last_active":"2024-06-02T23:57:56.525241+0000","last_peered":"2024-06-02T23:57:56.525241+0000","last_clean":"2024-06-02T23:57:56.525241+0000","last_became_active":"2024-06-02T23:57:12.156346+0000","last_became_peered":"2024-06-02T23:57:12.156346+0000","last_unstale":"2024-06-02T23:57:56.525241+0000","last_undegraded":"2024-06-02T23:57:56.525241+0000","last_fullsized":"2024-06-02T23:57:56.525241+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:29:45.801904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267668+0000","last_change":"2024-06-02T23:57:15.322676+0000","last_active":"2024-06-02T23:58:55.267668+0000","last_peered":"2024-06-02T23:58:55.267668+0000","last_clean":"2024-06-02T23:58:55.267668+0000","last_became_active":"2024-06-02T23:57:15.319429+0000","last_became_peered":"2024-06-02T23:57:15.319429+0000","last_unstale":"2024-06-02T23:58:55.267668+0000","last_undegraded":"2024-06-02T23:58:55.267668+0000","last_fullsized":"2024-06-02T23:58:55.267668+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:48:15.984818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'6","reported_seq":222,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:37.454598+0000","last_change":"2024-06-02T23:57:12.153925+0000","last_active":"2024-06-03T00:00:37.454598+0000","last_peered":"2024-06-03T00:00:37.454598+0000","last_clean":"2024-06-03T00:00:37.454598+0000","last_became_active":"2024-06-02T23:57:12.152990+0000","last_became_peered":"2024-06-02T23:57:12.152990+0000","last_unstale":"2024-06-03T00:00:37.454598+0000","last_undegraded":"2024-06-03T00:00:37.454598+0000","last_fullsized":"2024-06-03T00:00:37.454598+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:32:21.845946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":896,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":190,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.270077+0000","last_change":"2024-06-02T23:57:15.327662+0000","last_active":"2024-06-02T23:58:55.270077+0000","last_peered":"2024-06-02T23:58:55.270077+0000","last_clean":"2024-06-02T23:58:55.270077+0000","last_became_active":"2024-06-02T23:57:15.327320+0000","last_became_peered":"2024-06-02T23:57:15.327320+0000","last_unstale":"2024-06-02T23:58:55.270077+0000","last_undegraded":"2024-06-02T23:58:55.270077+0000","last_fullsized":"2024-06-02T23:58:55.270077+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:44:37.561533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528426+0000","last_change":"2024-06-02T23:57:12.306856+0000","last_active":"2024-06-02T23:57:56.528426+0000","last_peered":"2024-06-02T23:57:56.528426+0000","last_clean":"2024-06-02T23:57:56.528426+0000","last_became_active":"2024-06-02T23:57:12.306476+0000","last_became_peered":"2024-06-02T23:57:12.306476+0000","last_unstale":"2024-06-02T23:57:56.528426+0000","last_undegraded":"2024-06-02T23:57:56.528426+0000","last_fullsized":"2024-06-02T23:57:56.528426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:30:22.839589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.266843+0000","last_change":"2024-06-02T23:57:56.890015+0000","last_active":"2024-06-02T23:58:55.266843+0000","last_peered":"2024-06-02T23:58:55.266843+0000","last_clean":"2024-06-02T23:58:55.266843+0000","last_became_active":"2024-06-02T23:57:56.889591+0000","last_became_peered":"2024-06-02T23:57:56.889591+0000","last_unstale":"2024-06-02T23:58:55.266843+0000","last_undegraded":"2024-06-02T23:58:55.266843+0000","last_fullsized":"2024-06-02T23:58:55.266843+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:14:37.851207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'3","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:59:28.633344+0000","last_change":"2024-06-02T23:57:12.146690+0000","last_active":"2024-06-02T23:59:28.633344+0000","last_peered":"2024-06-02T23:59:28.633344+0000","last_clean":"2024-06-02T23:59:28.633344+0000","last_became_active":"2024-06-02T23:57:12.146372+0000","last_became_peered":"2024-06-02T23:57:12.146372+0000","last_unstale":"2024-06-02T23:59:28.633344+0000","last_undegraded":"2024-06-02T23:59:28.633344+0000","last_fullsized":"2024-06-02T23:59:28.633344+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:45:04.421365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267278+0000","last_change":"2024-06-02T23:57:15.320938+0000","last_active":"2024-06-02T23:58:55.267278+0000","last_peered":"2024-06-02T23:58:55.267278+0000","last_clean":"2024-06-02T23:58:55.267278+0000","last_became_active":"2024-06-02T23:57:15.320567+0000","last_became_peered":"2024-06-02T23:57:15.320567+0000","last_unstale":"2024-06-02T23:58:55.267278+0000","last_undegraded":"2024-06-02T23:58:55.267278+0000","last_fullsized":"2024-06-02T23:58:55.267278+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:04:29.736387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"88'1","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527764+0000","last_change":"2024-06-02T23:57:12.307020+0000","last_active":"2024-06-02T23:57:56.527764+0000","last_peered":"2024-06-02T23:57:56.527764+0000","last_clean":"2024-06-02T23:57:56.527764+0000","last_became_active":"2024-06-02T23:57:12.306650+0000","last_became_peered":"2024-06-02T23:57:12.306650+0000","last_unstale":"2024-06-02T23:57:56.527764+0000","last_undegraded":"2024-06-02T23:57:56.527764+0000","last_fullsized":"2024-06-02T23:57:56.527764+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:18:03.679704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265006+0000","last_change":"2024-06-02T23:57:15.319300+0000","last_active":"2024-06-02T23:58:55.265006+0000","last_peered":"2024-06-02T23:58:55.265006+0000","last_clean":"2024-06-02T23:58:55.265006+0000","last_became_active":"2024-06-02T23:57:15.318903+0000","last_became_peered":"2024-06-02T23:57:15.318903+0000","last_unstale":"2024-06-02T23:58:55.265006+0000","last_undegraded":"2024-06-02T23:58:55.265006+0000","last_fullsized":"2024-06-02T23:58:55.265006+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:38:25.521337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":220,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:38.421103+0000","last_change":"2024-06-02T23:57:12.155260+0000","last_active":"2024-06-03T00:00:38.421103+0000","last_peered":"2024-06-03T00:00:38.421103+0000","last_clean":"2024-06-03T00:00:38.421103+0000","last_became_active":"2024-06-02T23:57:12.154884+0000","last_became_peered":"2024-06-02T23:57:12.154884+0000","last_unstale":"2024-06-03T00:00:38.421103+0000","last_undegraded":"2024-06-03T00:00:38.421103+0000","last_fullsized":"2024-06-03T00:00:38.421103+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:34:52.390752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":188,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.269861+0000","last_change":"2024-06-02T23:57:15.323490+0000","last_active":"2024-06-02T23:58:55.269861+0000","last_peered":"2024-06-02T23:58:55.269861+0000","last_clean":"2024-06-02T23:58:55.269861+0000","last_became_active":"2024-06-02T23:57:15.323142+0000","last_became_peered":"2024-06-02T23:57:15.323142+0000","last_unstale":"2024-06-02T23:58:55.269861+0000","last_undegraded":"2024-06-02T23:58:55.269861+0000","last_fullsized":"2024-06-02T23:58:55.269861+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:32:32.445823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.261770+0000","last_change":"2024-06-02T23:57:56.531715+0000","last_active":"2024-06-02T23:58:55.261770+0000","last_peered":"2024-06-02T23:58:55.261770+0000","last_clean":"2024-06-02T23:58:55.261770+0000","last_became_active":"2024-06-02T23:57:56.531304+0000","last_became_peered":"2024-06-02T23:57:56.531304+0000","last_unstale":"2024-06-02T23:58:55.261770+0000","last_undegraded":"2024-06-02T23:58:55.261770+0000","last_fullsized":"2024-06-02T23:58:55.261770+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:58:02.532206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'6","reported_seq":220,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:37.453874+0000","last_change":"2024-06-02T23:57:12.305475+0000","last_active":"2024-06-03T00:00:37.453874+0000","last_peered":"2024-06-03T00:00:37.453874+0000","last_clean":"2024-06-03T00:00:37.453874+0000","last_became_active":"2024-06-02T23:57:12.305071+0000","last_became_peered":"2024-06-02T23:57:12.305071+0000","last_unstale":"2024-06-03T00:00:37.453874+0000","last_undegraded":"2024-06-03T00:00:37.453874+0000","last_fullsized":"2024-06-03T00:00:37.453874+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:08:29.024447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":187,"num_read_kb":187,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.264368+0000","last_change":"2024-06-02T23:57:15.308629+0000","last_active":"2024-06-02T23:58:55.264368+0000","last_peered":"2024-06-02T23:58:55.264368+0000","last_clean":"2024-06-02T23:58:55.264368+0000","last_became_active":"2024-06-02T23:57:15.307981+0000","last_became_peered":"2024-06-02T23:57:15.307981+0000","last_unstale":"2024-06-02T23:58:55.264368+0000","last_undegraded":"2024-06-02T23:58:55.264368+0000","last_fullsized":"2024-06-02T23:58:55.264368+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:14:22.446599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.652578+0000","last_change":"2024-06-02T23:57:12.155968+0000","last_active":"2024-06-02T23:57:56.652578+0000","last_peered":"2024-06-02T23:57:56.652578+0000","last_clean":"2024-06-02T23:57:56.652578+0000","last_became_active":"2024-06-02T23:57:12.155521+0000","last_became_peered":"2024-06-02T23:57:12.155521+0000","last_unstale":"2024-06-02T23:57:56.652578+0000","last_undegraded":"2024-06-02T23:57:56.652578+0000","last_fullsized":"2024-06-02T23:57:56.652578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:45:00.397317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":350,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:34.488628+0000","last_change":"2024-06-02T23:55:50.081978+0000","last_active":"2024-06-02T23:58:34.488628+0000","last_peered":"2024-06-02T23:58:34.488628+0000","last_clean":"2024-06-02T23:58:34.488628+0000","last_became_active":"2024-06-02T23:55:50.081431+0000","last_became_peered":"2024-06-02T23:55:50.081431+0000","last_unstale":"2024-06-02T23:58:34.488628+0000","last_undegraded":"2024-06-02T23:58:34.488628+0000","last_fullsized":"2024-06-02T23:58:34.488628+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:52:23.676206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:52:23.676206+0000","last_clean_scrub_stamp":"2024-06-02T23:52:23.676206+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:29:59.979935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262458+0000","last_change":"2024-06-02T23:57:56.529633+0000","last_active":"2024-06-02T23:58:55.262458+0000","last_peered":"2024-06-02T23:58:55.262458+0000","last_clean":"2024-06-02T23:58:55.262458+0000","last_became_active":"2024-06-02T23:57:56.529210+0000","last_became_peered":"2024-06-02T23:57:56.529210+0000","last_unstale":"2024-06-02T23:58:55.262458+0000","last_undegraded":"2024-06-02T23:58:55.262458+0000","last_fullsized":"2024-06-02T23:58:55.262458+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:51:31.807162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.529339+0000","last_change":"2024-06-02T23:57:12.155897+0000","last_active":"2024-06-02T23:57:56.529339+0000","last_peered":"2024-06-02T23:57:56.529339+0000","last_clean":"2024-06-02T23:57:56.529339+0000","last_became_active":"2024-06-02T23:57:12.155461+0000","last_became_peered":"2024-06-02T23:57:12.155461+0000","last_unstale":"2024-06-02T23:57:56.529339+0000","last_undegraded":"2024-06-02T23:57:56.529339+0000","last_fullsized":"2024-06-02T23:57:56.529339+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:19:22.104104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528035+0000","last_change":"2024-06-02T23:57:12.306363+0000","last_active":"2024-06-02T23:57:56.528035+0000","last_peered":"2024-06-02T23:57:56.528035+0000","last_clean":"2024-06-02T23:57:56.528035+0000","last_became_active":"2024-06-02T23:57:12.305920+0000","last_became_peered":"2024-06-02T23:57:12.305920+0000","last_unstale":"2024-06-02T23:57:56.528035+0000","last_undegraded":"2024-06-02T23:57:56.528035+0000","last_fullsized":"2024-06-02T23:57:56.528035+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:31:01.787879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262436+0000","last_change":"2024-06-02T23:57:15.316038+0000","last_active":"2024-06-02T23:58:55.262436+0000","last_peered":"2024-06-02T23:58:55.262436+0000","last_clean":"2024-06-02T23:58:55.262436+0000","last_became_active":"2024-06-02T23:57:15.315715+0000","last_became_peered":"2024-06-02T23:57:15.315715+0000","last_unstale":"2024-06-02T23:58:55.262436+0000","last_undegraded":"2024-06-02T23:58:55.262436+0000","last_fullsized":"2024-06-02T23:58:55.262436+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:34:36.014251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"90'18","reported_seq":60,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:59:25.049042+0000","last_change":"2024-06-02T23:57:56.539596+0000","last_active":"2024-06-02T23:59:25.049042+0000","last_peered":"2024-06-02T23:59:25.049042+0000","last_clean":"2024-06-02T23:59:25.049042+0000","last_became_active":"2024-06-02T23:57:56.532686+0000","last_became_peered":"2024-06-02T23:57:56.532686+0000","last_unstale":"2024-06-02T23:59:25.049042+0000","last_undegraded":"2024-06-02T23:59:25.049042+0000","last_fullsized":"2024-06-02T23:59:25.049042+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:29:24.691941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267369+0000","last_change":"2024-06-02T23:57:15.315657+0000","last_active":"2024-06-02T23:58:55.267369+0000","last_peered":"2024-06-02T23:58:55.267369+0000","last_clean":"2024-06-02T23:58:55.267369+0000","last_became_active":"2024-06-02T23:57:15.315293+0000","last_became_peered":"2024-06-02T23:57:15.315293+0000","last_unstale":"2024-06-02T23:58:55.267369+0000","last_undegraded":"2024-06-02T23:58:55.267369+0000","last_fullsized":"2024-06-02T23:58:55.267369+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:52:55.241379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.652229+0000","last_change":"2024-06-02T23:57:12.405664+0000","last_active":"2024-06-02T23:57:56.652229+0000","last_peered":"2024-06-02T23:57:56.652229+0000","last_clean":"2024-06-02T23:57:56.652229+0000","last_became_active":"2024-06-02T23:57:12.405281+0000","last_became_peered":"2024-06-02T23:57:12.405281+0000","last_unstale":"2024-06-02T23:57:56.652229+0000","last_undegraded":"2024-06-02T23:57:56.652229+0000","last_fullsized":"2024-06-02T23:57:56.652229+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:46:50.119466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273696+0000","last_change":"2024-06-02T23:57:15.318136+0000","last_active":"2024-06-02T23:58:55.273696+0000","last_peered":"2024-06-02T23:58:55.273696+0000","last_clean":"2024-06-02T23:58:55.273696+0000","last_became_active":"2024-06-02T23:57:15.317753+0000","last_became_peered":"2024-06-02T23:57:15.317753+0000","last_unstale":"2024-06-02T23:58:55.273696+0000","last_undegraded":"2024-06-02T23:58:55.273696+0000","last_fullsized":"2024-06-02T23:58:55.273696+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:35:11.025266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.887947+0000","last_change":"2024-06-02T23:57:12.305954+0000","last_active":"2024-06-02T23:57:56.887947+0000","last_peered":"2024-06-02T23:57:56.887947+0000","last_clean":"2024-06-02T23:57:56.887947+0000","last_became_active":"2024-06-02T23:57:12.305589+0000","last_became_peered":"2024-06-02T23:57:12.305589+0000","last_unstale":"2024-06-02T23:57:56.887947+0000","last_undegraded":"2024-06-02T23:57:56.887947+0000","last_fullsized":"2024-06-02T23:57:56.887947+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:34:34.178446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.243742+0000","last_change":"2024-06-02T23:57:15.327115+0000","last_active":"2024-06-02T23:58:55.243742+0000","last_peered":"2024-06-02T23:58:55.243742+0000","last_clean":"2024-06-02T23:58:55.243742+0000","last_became_active":"2024-06-02T23:57:15.326746+0000","last_became_peered":"2024-06-02T23:57:15.326746+0000","last_unstale":"2024-06-02T23:58:55.243742+0000","last_undegraded":"2024-06-02T23:58:55.243742+0000","last_fullsized":"2024-06-02T23:58:55.243742+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:08:04.340517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526250+0000","last_change":"2024-06-02T23:57:12.152933+0000","last_active":"2024-06-02T23:57:56.526250+0000","last_peered":"2024-06-02T23:57:56.526250+0000","last_clean":"2024-06-02T23:57:56.526250+0000","last_became_active":"2024-06-02T23:57:12.152453+0000","last_became_peered":"2024-06-02T23:57:12.152453+0000","last_unstale":"2024-06-02T23:57:56.526250+0000","last_undegraded":"2024-06-02T23:57:56.526250+0000","last_fullsized":"2024-06-02T23:57:56.526250+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:47:05.144374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272469+0000","last_change":"2024-06-02T23:57:15.326042+0000","last_active":"2024-06-02T23:58:55.272469+0000","last_peered":"2024-06-02T23:58:55.272469+0000","last_clean":"2024-06-02T23:58:55.272469+0000","last_became_active":"2024-06-02T23:57:15.325585+0000","last_became_peered":"2024-06-02T23:57:15.325585+0000","last_unstale":"2024-06-02T23:58:55.272469+0000","last_undegraded":"2024-06-02T23:58:55.272469+0000","last_fullsized":"2024-06-02T23:58:55.272469+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:40:37.305875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"88'3","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527211+0000","last_change":"2024-06-02T23:57:12.139155+0000","last_active":"2024-06-02T23:57:56.527211+0000","last_peered":"2024-06-02T23:57:56.527211+0000","last_clean":"2024-06-02T23:57:56.527211+0000","last_became_active":"2024-06-02T23:57:12.138732+0000","last_became_peered":"2024-06-02T23:57:12.138732+0000","last_unstale":"2024-06-02T23:57:56.527211+0000","last_undegraded":"2024-06-02T23:57:56.527211+0000","last_fullsized":"2024-06-02T23:57:56.527211+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:18:29.148439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265509+0000","last_change":"2024-06-02T23:57:15.319510+0000","last_active":"2024-06-02T23:58:55.265509+0000","last_peered":"2024-06-02T23:58:55.265509+0000","last_clean":"2024-06-02T23:58:55.265509+0000","last_became_active":"2024-06-02T23:57:15.319192+0000","last_became_peered":"2024-06-02T23:57:15.319192+0000","last_unstale":"2024-06-02T23:58:55.265509+0000","last_undegraded":"2024-06-02T23:58:55.265509+0000","last_fullsized":"2024-06-02T23:58:55.265509+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:04:04.241833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.658192+0000","last_change":"2024-06-02T23:57:56.657766+0000","last_active":"2024-06-02T23:57:56.658192+0000","last_peered":"2024-06-02T23:57:56.658192+0000","last_clean":"2024-06-02T23:57:56.658192+0000","last_became_active":"2024-06-02T23:57:56.653435+0000","last_became_peered":"2024-06-02T23:57:56.653435+0000","last_unstale":"2024-06-02T23:57:56.658192+0000","last_undegraded":"2024-06-02T23:57:56.658192+0000","last_fullsized":"2024-06-02T23:57:56.658192+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:03:23.594470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273925+0000","last_change":"2024-06-02T23:57:15.320837+0000","last_active":"2024-06-02T23:58:55.273925+0000","last_peered":"2024-06-02T23:58:55.273925+0000","last_clean":"2024-06-02T23:58:55.273925+0000","last_became_active":"2024-06-02T23:57:15.320257+0000","last_became_peered":"2024-06-02T23:57:15.320257+0000","last_unstale":"2024-06-02T23:58:55.273925+0000","last_undegraded":"2024-06-02T23:58:55.273925+0000","last_fullsized":"2024-06-02T23:58:55.273925+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:18:29.638614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'5","reported_seq":219,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:36.414087+0000","last_change":"2024-06-02T23:57:12.405175+0000","last_active":"2024-06-03T00:00:36.414087+0000","last_peered":"2024-06-03T00:00:36.414087+0000","last_clean":"2024-06-03T00:00:36.414087+0000","last_became_active":"2024-06-02T23:57:12.404767+0000","last_became_peered":"2024-06-02T23:57:12.404767+0000","last_unstale":"2024-06-03T00:00:36.414087+0000","last_undegraded":"2024-06-03T00:00:36.414087+0000","last_fullsized":"2024-06-03T00:00:36.414087+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:46:57.421288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":187,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273764+0000","last_change":"2024-06-02T23:57:15.322888+0000","last_active":"2024-06-02T23:58:55.273764+0000","last_peered":"2024-06-02T23:58:55.273764+0000","last_clean":"2024-06-02T23:58:55.273764+0000","last_became_active":"2024-06-02T23:57:15.321982+0000","last_became_peered":"2024-06-02T23:57:15.321982+0000","last_unstale":"2024-06-02T23:58:55.273764+0000","last_undegraded":"2024-06-02T23:58:55.273764+0000","last_fullsized":"2024-06-02T23:58:55.273764+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:51:57.253824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526189+0000","last_change":"2024-06-02T23:57:12.153715+0000","last_active":"2024-06-02T23:57:56.526189+0000","last_peered":"2024-06-02T23:57:56.526189+0000","last_clean":"2024-06-02T23:57:56.526189+0000","last_became_active":"2024-06-02T23:57:12.152544+0000","last_became_peered":"2024-06-02T23:57:12.152544+0000","last_unstale":"2024-06-02T23:57:56.526189+0000","last_undegraded":"2024-06-02T23:57:56.526189+0000","last_fullsized":"2024-06-02T23:57:56.526189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:51:05.874962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.271354+0000","last_change":"2024-06-02T23:57:15.318759+0000","last_active":"2024-06-02T23:58:55.271354+0000","last_peered":"2024-06-02T23:58:55.271354+0000","last_clean":"2024-06-02T23:58:55.271354+0000","last_became_active":"2024-06-02T23:57:15.317942+0000","last_became_peered":"2024-06-02T23:57:15.317942+0000","last_unstale":"2024-06-02T23:58:55.271354+0000","last_undegraded":"2024-06-02T23:58:55.271354+0000","last_fullsized":"2024-06-02T23:58:55.271354+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:39:44.142890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.894529+0000","last_change":"2024-06-02T23:57:56.894131+0000","last_active":"2024-06-02T23:57:56.894529+0000","last_peered":"2024-06-02T23:57:56.894529+0000","last_clean":"2024-06-02T23:57:56.894529+0000","last_became_active":"2024-06-02T23:57:56.889794+0000","last_became_peered":"2024-06-02T23:57:56.889794+0000","last_unstale":"2024-06-02T23:57:56.894529+0000","last_undegraded":"2024-06-02T23:57:56.894529+0000","last_fullsized":"2024-06-02T23:57:56.894529+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:02:41.670419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.266582+0000","last_change":"2024-06-02T23:57:15.324355+0000","last_active":"2024-06-02T23:58:55.266582+0000","last_peered":"2024-06-02T23:58:55.266582+0000","last_clean":"2024-06-02T23:58:55.266582+0000","last_became_active":"2024-06-02T23:57:15.324019+0000","last_became_peered":"2024-06-02T23:57:15.324019+0000","last_unstale":"2024-06-02T23:58:55.266582+0000","last_undegraded":"2024-06-02T23:58:55.266582+0000","last_fullsized":"2024-06-02T23:58:55.266582+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:27:01.927109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267246+0000","last_change":"2024-06-02T23:57:15.326420+0000","last_active":"2024-06-02T23:58:55.267246+0000","last_peered":"2024-06-02T23:58:55.267246+0000","last_clean":"2024-06-02T23:58:55.267246+0000","last_became_active":"2024-06-02T23:57:15.326091+0000","last_became_peered":"2024-06-02T23:57:15.326091+0000","last_unstale":"2024-06-02T23:58:55.267246+0000","last_undegraded":"2024-06-02T23:58:55.267246+0000","last_fullsized":"2024-06-02T23:58:55.267246+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:54:05.355352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.252717+0000","last_change":"2024-06-02T23:57:56.653297+0000","last_active":"2024-06-02T23:58:55.252717+0000","last_peered":"2024-06-02T23:58:55.252717+0000","last_clean":"2024-06-02T23:58:55.252717+0000","last_became_active":"2024-06-02T23:57:56.652874+0000","last_became_peered":"2024-06-02T23:57:56.652874+0000","last_unstale":"2024-06-02T23:58:55.252717+0000","last_undegraded":"2024-06-02T23:58:55.252717+0000","last_fullsized":"2024-06-02T23:58:55.252717+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:27:55.486382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.260044+0000","last_change":"2024-06-02T23:57:15.319266+0000","last_active":"2024-06-02T23:58:55.260044+0000","last_peered":"2024-06-02T23:58:55.260044+0000","last_clean":"2024-06-02T23:58:55.260044+0000","last_became_active":"2024-06-02T23:57:15.317468+0000","last_became_peered":"2024-06-02T23:57:15.317468+0000","last_unstale":"2024-06-02T23:58:55.260044+0000","last_undegraded":"2024-06-02T23:58:55.260044+0000","last_fullsized":"2024-06-02T23:58:55.260044+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:49:53.675524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273976+0000","last_change":"2024-06-02T23:57:15.315798+0000","last_active":"2024-06-02T23:58:55.273976+0000","last_peered":"2024-06-02T23:58:55.273976+0000","last_clean":"2024-06-02T23:58:55.273976+0000","last_became_active":"2024-06-02T23:57:15.314886+0000","last_became_peered":"2024-06-02T23:57:15.314886+0000","last_unstale":"2024-06-02T23:58:55.273976+0000","last_undegraded":"2024-06-02T23:58:55.273976+0000","last_fullsized":"2024-06-02T23:58:55.273976+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:23.042226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259255+0000","last_change":"2024-06-02T23:57:15.315081+0000","last_active":"2024-06-02T23:58:55.259255+0000","last_peered":"2024-06-02T23:58:55.259255+0000","last_clean":"2024-06-02T23:58:55.259255+0000","last_became_active":"2024-06-02T23:57:15.314745+0000","last_became_peered":"2024-06-02T23:57:15.314745+0000","last_unstale":"2024-06-02T23:58:55.259255+0000","last_undegraded":"2024-06-02T23:58:55.259255+0000","last_fullsized":"2024-06-02T23:58:55.259255+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:17:49.506950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.261978+0000","last_change":"2024-06-02T23:57:15.323687+0000","last_active":"2024-06-02T23:58:55.261978+0000","last_peered":"2024-06-02T23:58:55.261978+0000","last_clean":"2024-06-02T23:58:55.261978+0000","last_became_active":"2024-06-02T23:57:15.323345+0000","last_became_peered":"2024-06-02T23:57:15.323345+0000","last_unstale":"2024-06-02T23:58:55.261978+0000","last_undegraded":"2024-06-02T23:58:55.261978+0000","last_fullsized":"2024-06-02T23:58:55.261978+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:47:40.234811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265429+0000","last_change":"2024-06-02T23:57:15.320632+0000","last_active":"2024-06-02T23:58:55.265429+0000","last_peered":"2024-06-02T23:58:55.265429+0000","last_clean":"2024-06-02T23:58:55.265429+0000","last_became_active":"2024-06-02T23:57:15.318427+0000","last_became_peered":"2024-06-02T23:57:15.318427+0000","last_unstale":"2024-06-02T23:58:55.265429+0000","last_undegraded":"2024-06-02T23:58:55.265429+0000","last_fullsized":"2024-06-02T23:58:55.265429+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:04:51.729326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259261+0000","last_change":"2024-06-02T23:57:15.312039+0000","last_active":"2024-06-02T23:58:55.259261+0000","last_peered":"2024-06-02T23:58:55.259261+0000","last_clean":"2024-06-02T23:58:55.259261+0000","last_became_active":"2024-06-02T23:57:15.311275+0000","last_became_peered":"2024-06-02T23:57:15.311275+0000","last_unstale":"2024-06-02T23:58:55.259261+0000","last_undegraded":"2024-06-02T23:58:55.259261+0000","last_fullsized":"2024-06-02T23:58:55.259261+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:50:25.509550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259813+0000","last_change":"2024-06-02T23:57:15.311927+0000","last_active":"2024-06-02T23:58:55.259813+0000","last_peered":"2024-06-02T23:58:55.259813+0000","last_clean":"2024-06-02T23:58:55.259813+0000","last_became_active":"2024-06-02T23:57:15.311484+0000","last_became_peered":"2024-06-02T23:57:15.311484+0000","last_unstale":"2024-06-02T23:58:55.259813+0000","last_undegraded":"2024-06-02T23:58:55.259813+0000","last_fullsized":"2024-06-02T23:58:55.259813+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:29:27.789219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268648+0000","last_change":"2024-06-02T23:57:15.321218+0000","last_active":"2024-06-02T23:58:55.268648+0000","last_peered":"2024-06-02T23:58:55.268648+0000","last_clean":"2024-06-02T23:58:55.268648+0000","last_became_active":"2024-06-02T23:57:15.320884+0000","last_became_peered":"2024-06-02T23:57:15.320884+0000","last_unstale":"2024-06-02T23:58:55.268648+0000","last_undegraded":"2024-06-02T23:58:55.268648+0000","last_fullsized":"2024-06-02T23:58:55.268648+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:57:20.583655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.270664+0000","last_change":"2024-06-02T23:57:15.315213+0000","last_active":"2024-06-02T23:58:55.270664+0000","last_peered":"2024-06-02T23:58:55.270664+0000","last_clean":"2024-06-02T23:58:55.270664+0000","last_became_active":"2024-06-02T23:57:15.314050+0000","last_became_peered":"2024-06-02T23:57:15.314050+0000","last_unstale":"2024-06-02T23:58:55.270664+0000","last_undegraded":"2024-06-02T23:58:55.270664+0000","last_fullsized":"2024-06-02T23:58:55.270664+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:35.214351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265435+0000","last_change":"2024-06-02T23:57:15.313901+0000","last_active":"2024-06-02T23:58:55.265435+0000","last_peered":"2024-06-02T23:58:55.265435+0000","last_clean":"2024-06-02T23:58:55.265435+0000","last_became_active":"2024-06-02T23:57:15.313452+0000","last_became_peered":"2024-06-02T23:57:15.313452+0000","last_unstale":"2024-06-02T23:58:55.265435+0000","last_undegraded":"2024-06-02T23:58:55.265435+0000","last_fullsized":"2024-06-02T23:58:55.265435+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:41:38.366741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.263989+0000","last_change":"2024-06-02T23:57:15.323660+0000","last_active":"2024-06-02T23:58:55.263989+0000","last_peered":"2024-06-02T23:58:55.263989+0000","last_clean":"2024-06-02T23:58:55.263989+0000","last_became_active":"2024-06-02T23:57:15.323316+0000","last_became_peered":"2024-06-02T23:57:15.323316+0000","last_unstale":"2024-06-02T23:58:55.263989+0000","last_undegraded":"2024-06-02T23:58:55.263989+0000","last_fullsized":"2024-06-02T23:58:55.263989+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:33:10.245563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74439,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1898,"num_read_kb":1029,"num_write":263,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":223317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383737,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":480586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645374,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28680,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716472,"statfs":{"total":95995035648,"available":95965667328,"internally_reserved":0,"allocated":1703936,"data_stored":1139101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808900,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1019904,"data_stored":480516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070536,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":480894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332173,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28592,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716560,"statfs":{"total":95995035648,"available":95965757440,"internally_reserved":0,"allocated":1613824,"data_stored":1073860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495699,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":1003520,"data_stored":480233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574956,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1073152,"data_stored":548324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738481,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40496,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704656,"statfs":{"total":95995035648,"available":95953567744,"internally_reserved":0,"allocated":1024000,"data_stored":481572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411431,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32244,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712908,"statfs":{"total":95995035648,"available":95962017792,"internally_reserved":0,"allocated":1093632,"data_stored":549075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182498,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":480058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920861,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":480402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757336,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28604,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716548,"statfs":{"total":95995035648,"available":95965745152,"internally_reserved":0,"allocated":1626112,"data_stored":1073230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":69222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-03T00:00:43.143 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-06-03T00:00:43.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:43 smithi107 ceph-mon[37048]: pgmap v403: 97 pgs: 97 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 511 B/s wr, 9 op/s 2024-06-03T00:00:43.369 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:43 smithi049 ceph-mon[32302]: pgmap v403: 97 pgs: 97 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 511 B/s wr, 9 op/s 2024-06-03T00:00:43.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:43 smithi057 ceph-mon[36457]: pgmap v403: 97 pgs: 97 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 511 B/s wr, 9 op/s 2024-06-03T00:00:43.633 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:00:44.336 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:44 smithi049 ceph-mon[32302]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-03T00:00:44.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:44 smithi107 ceph-mon[37048]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-03T00:00:44.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:44 smithi057 ceph-mon[36457]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-03T00:00:45.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:45 smithi049 ceph-mon[32302]: pgmap v404: 97 pgs: 97 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 10 op/s 2024-06-03T00:00:45.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:45 smithi107 ceph-mon[37048]: pgmap v404: 97 pgs: 97 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 10 op/s 2024-06-03T00:00:45.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:45 smithi057 ceph-mon[36457]: pgmap v404: 97 pgs: 97 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 10 op/s 2024-06-03T00:00:45.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.767+0000 7f8dbe7da700 1 -- 172.21.15.49:0/4257659829 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8db8107860 msgr2=0x7f8db810f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:45.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.767+0000 7f8dbe7da700 1 --2- 172.21.15.49:0/4257659829 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8db8107860 0x7f8db810f3e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8db000b0d0 tx=0x7f8db000b3e0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.767+0000 7f8dbe7da700 1 -- 172.21.15.49:0/4257659829 shutdown_connections 2024-06-03T00:00:45.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.767+0000 7f8dbe7da700 1 --2- 172.21.15.49:0/4257659829 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8db8107860 0x7f8db810f3e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.767+0000 7f8dbe7da700 1 --2- 172.21.15.49:0/4257659829 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8db806adc0 0x7f8db806b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.767+0000 7f8dbe7da700 1 --2- 172.21.15.49:0/4257659829 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8db806b770 0x7f8db8107130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.767+0000 7f8dbe7da700 1 -- 172.21.15.49:0/4257659829 >> 172.21.15.49:0/4257659829 conn(0x7f8db8078340 msgr2=0x7f8db8078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:45.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.767+0000 7f8dbe7da700 1 -- 172.21.15.49:0/4257659829 shutdown_connections 2024-06-03T00:00:45.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.767+0000 7f8dbe7da700 1 -- 172.21.15.49:0/4257659829 wait complete. 2024-06-03T00:00:45.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.768+0000 7f8dbe7da700 1 Processor -- start 2024-06-03T00:00:45.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.768+0000 7f8dbe7da700 1 -- start start 2024-06-03T00:00:45.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.769+0000 7f8dbe7da700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8db806adc0 0x7f8db8101840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:45.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.769+0000 7f8dbe7da700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8db806b770 0x7f8db8101d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:45.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.769+0000 7f8dbe7da700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8db8107860 0x7f8db81022c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:45.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.769+0000 7f8dbe7da700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8db81127f0 con 0x7f8db806adc0 2024-06-03T00:00:45.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.769+0000 7f8dbe7da700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8db8112670 con 0x7f8db806b770 2024-06-03T00:00:45.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.769+0000 7f8dbe7da700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8db8112970 con 0x7f8db8107860 2024-06-03T00:00:45.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.769+0000 7f8db7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8db806adc0 0x7f8db8101840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:45.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.769+0000 7f8db7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8db806adc0 0x7f8db8101840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50278/0 (socket says 172.21.15.49:50278) 2024-06-03T00:00:45.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.769+0000 7f8db7fff700 1 -- 172.21.15.49:0/1238532275 learned_addr learned my addr 172.21.15.49:0/1238532275 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:45.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.769+0000 7f8db77fe700 1 --2- 172.21.15.49:0/1238532275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8db806b770 0x7f8db8101d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:45.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.769+0000 7f8dbcd77700 1 --2- 172.21.15.49:0/1238532275 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8db8107860 0x7f8db81022c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:45.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.769+0000 7f8db7fff700 1 -- 172.21.15.49:0/1238532275 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8db8107860 msgr2=0x7f8db81022c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:45.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.769+0000 7f8db7fff700 1 --2- 172.21.15.49:0/1238532275 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8db8107860 0x7f8db81022c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.769+0000 7f8db7fff700 1 -- 172.21.15.49:0/1238532275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8db806b770 msgr2=0x7f8db8101d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:45.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.769+0000 7f8db7fff700 1 --2- 172.21.15.49:0/1238532275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8db806b770 0x7f8db8101d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.769+0000 7f8db7fff700 1 -- 172.21.15.49:0/1238532275 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db81a7130 con 0x7f8db806adc0 2024-06-03T00:00:45.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.769+0000 7f8db7fff700 1 --2- 172.21.15.49:0/1238532275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8db806adc0 0x7f8db8101840 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8da800d950 tx=0x7f8da800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:45.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.770+0000 7f8db57fa700 1 -- 172.21.15.49:0/1238532275 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da8016070 con 0x7f8db806adc0 2024-06-03T00:00:45.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.770+0000 7f8dbe7da700 1 -- 172.21.15.49:0/1238532275 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8db81a7420 con 0x7f8db806adc0 2024-06-03T00:00:45.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.770+0000 7f8dbe7da700 1 -- 172.21.15.49:0/1238532275 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8db81a79b0 con 0x7f8db806adc0 2024-06-03T00:00:45.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.770+0000 7f8db57fa700 1 -- 172.21.15.49:0/1238532275 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8da8009e20 con 0x7f8db806adc0 2024-06-03T00:00:45.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.770+0000 7f8db57fa700 1 -- 172.21.15.49:0/1238532275 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da800f620 con 0x7f8db806adc0 2024-06-03T00:00:45.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.772+0000 7f8db57fa700 1 -- 172.21.15.49:0/1238532275 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8da8019070 con 0x7f8db806adc0 2024-06-03T00:00:45.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.773+0000 7f8db57fa700 1 --2- 172.21.15.49:0/1238532275 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8da00a2ca0 0x7f8da00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:45.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.773+0000 7f8db77fe700 1 --2- 172.21.15.49:0/1238532275 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8da00a2ca0 0x7f8da00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:45.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.773+0000 7f8db57fa700 1 -- 172.21.15.49:0/1238532275 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f8da80cee00 con 0x7f8db806adc0 2024-06-03T00:00:45.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.774+0000 7f8db77fe700 1 --2- 172.21.15.49:0/1238532275 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8da00a2ca0 0x7f8da00a5160 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8db8107200 tx=0x7f8dac009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:45.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.774+0000 7f8dc905db80 1 Processor -- start 2024-06-03T00:00:45.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.774+0000 7f8dc905db80 1 -- start start 2024-06-03T00:00:45.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.774+0000 7f8dc905db80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ffa576f60 0x562ffa577340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:45.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.774+0000 7f8dc905db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562ffa577880 0x562ffa571260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:45.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.774+0000 7f8dc905db80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ffa5717a0 0x562ffa571bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:45.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.774+0000 7f8dc905db80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562ffa463f60 con 0x562ffa576f60 2024-06-03T00:00:45.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.774+0000 7f8dc905db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x562ffa4c2850 con 0x562ffa577880 2024-06-03T00:00:45.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.774+0000 7f8dc905db80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x562ffa42a460 con 0x562ffa5717a0 2024-06-03T00:00:45.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.774+0000 7f8db7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ffa576f60 0x562ffa577340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:45.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.774+0000 7f8db7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ffa576f60 0x562ffa577340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50290/0 (socket says 172.21.15.49:50290) 2024-06-03T00:00:45.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.774+0000 7f8db7fff700 1 -- 172.21.15.49:0/957518509 learned_addr learned my addr 172.21.15.49:0/957518509 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:45.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.774+0000 7f8db77fe700 1 --2- 172.21.15.49:0/957518509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562ffa577880 0x562ffa571260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:45.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.774+0000 7f8dbcd77700 1 --2- 172.21.15.49:0/957518509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ffa5717a0 0x562ffa571bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:45.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.775+0000 7f8db7fff700 1 -- 172.21.15.49:0/957518509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ffa5717a0 msgr2=0x562ffa571bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:45.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.775+0000 7f8db7fff700 1 --2- 172.21.15.49:0/957518509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ffa5717a0 0x562ffa571bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.775+0000 7f8db7fff700 1 -- 172.21.15.49:0/957518509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562ffa577880 msgr2=0x562ffa571260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:45.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.775+0000 7f8db7fff700 1 --2- 172.21.15.49:0/957518509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562ffa577880 0x562ffa571260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.775+0000 7f8db7fff700 1 -- 172.21.15.49:0/957518509 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ffa4118d0 con 0x562ffa576f60 2024-06-03T00:00:45.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.775+0000 7f8db7fff700 1 --2- 172.21.15.49:0/957518509 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ffa576f60 0x562ffa577340 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8da809b5f0 tx=0x7f8da809b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe5f45a2486ca49 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:45.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.775+0000 7f8d9e7fc700 1 -- 172.21.15.49:0/957518509 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da8020070 con 0x562ffa576f60 2024-06-03T00:00:45.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.775+0000 7f8d9e7fc700 1 -- 172.21.15.49:0/957518509 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8da8099700 con 0x562ffa576f60 2024-06-03T00:00:45.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.775+0000 7f8d9e7fc700 1 -- 172.21.15.49:0/957518509 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da809bb20 con 0x562ffa576f60 2024-06-03T00:00:45.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.776+0000 7f8dc905db80 1 -- 172.21.15.49:0/957518509 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ffa576f60 msgr2=0x562ffa577340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:45.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.776+0000 7f8dc905db80 1 --2- 172.21.15.49:0/957518509 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ffa576f60 0x562ffa577340 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8da809b5f0 tx=0x7f8da809b6e0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.776+0000 7f8dc905db80 1 -- 172.21.15.49:0/957518509 shutdown_connections 2024-06-03T00:00:45.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.776+0000 7f8dc905db80 1 --2- 172.21.15.49:0/957518509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ffa5717a0 0x562ffa571bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.776+0000 7f8dc905db80 1 --2- 172.21.15.49:0/957518509 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ffa576f60 0x562ffa577340 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.776+0000 7f8dc905db80 1 --2- 172.21.15.49:0/957518509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562ffa577880 0x562ffa571260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.776+0000 7f8dc905db80 1 -- 172.21.15.49:0/957518509 >> 172.21.15.49:0/957518509 conn(0x562ffa49e080 msgr2=0x562ffa56c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:45.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.776+0000 7f8dc905db80 1 -- 172.21.15.49:0/957518509 shutdown_connections 2024-06-03T00:00:45.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.776+0000 7f8dc905db80 1 -- 172.21.15.49:0/957518509 wait complete. 2024-06-03T00:00:45.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.776+0000 7f8dc905db80 1 -- start start 2024-06-03T00:00:45.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.777+0000 7f8dc905db80 1 Processor -- start 2024-06-03T00:00:45.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.777+0000 7f8dc905db80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ffa5717a0 0x562ffa57d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:45.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.777+0000 7f8dc905db80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ffa576f60 0x562ffa57a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:45.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.777+0000 7f8dc905db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562ffa577880 0x562ffa57adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:45.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.777+0000 7f8dc905db80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562ffa462fc0 con 0x562ffa576f60 2024-06-03T00:00:45.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.777+0000 7f8dc905db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x562ffa4be810 con 0x562ffa577880 2024-06-03T00:00:45.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.777+0000 7f8dc905db80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x562ffa57e200 con 0x562ffa5717a0 2024-06-03T00:00:45.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.777+0000 7f8dc905db80 10 client.0 _ll_register_callbacks cb 0x562ffa4585b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:00:45.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.777+0000 7f8db77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ffa576f60 0x562ffa57a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:45.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.777+0000 7f8db77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ffa576f60 0x562ffa57a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50306/0 (socket says 172.21.15.49:50306) 2024-06-03T00:00:45.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.777+0000 7f8db77fe700 1 -- 172.21.15.49:0/2124810904 learned_addr learned my addr 172.21.15.49:0/2124810904 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:45.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.778+0000 7f8db7fff700 1 --2- 172.21.15.49:0/2124810904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ffa5717a0 0x562ffa57d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:45.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.778+0000 7f8dbcd77700 1 --2- 172.21.15.49:0/2124810904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562ffa577880 0x562ffa57adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:45.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.778+0000 7f8db77fe700 1 -- 172.21.15.49:0/2124810904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ffa5717a0 msgr2=0x562ffa57d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:45.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.778+0000 7f8db77fe700 1 --2- 172.21.15.49:0/2124810904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ffa5717a0 0x562ffa57d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.778+0000 7f8db77fe700 1 -- 172.21.15.49:0/2124810904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562ffa577880 msgr2=0x562ffa57adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:45.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.778+0000 7f8db77fe700 1 --2- 172.21.15.49:0/2124810904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562ffa577880 0x562ffa57adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.778+0000 7f8db77fe700 1 -- 172.21.15.49:0/2124810904 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ffa488750 con 0x562ffa576f60 2024-06-03T00:00:45.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.778+0000 7f8db7fff700 1 --2- 172.21.15.49:0/2124810904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ffa5717a0 0x562ffa57d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:00:45.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.778+0000 7f8dbcd77700 1 --2- 172.21.15.49:0/2124810904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562ffa577880 0x562ffa57adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:00:45.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.778+0000 7f8db77fe700 1 --2- 172.21.15.49:0/2124810904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ffa576f60 0x562ffa57a8b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8dac009ee0 tx=0x7f8dac004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5e758b5f74894fb server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:45.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.778+0000 7f8d977fe700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:00:45.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.778+0000 7f8d977fe700 1 -- 172.21.15.49:0/2124810904 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac025070 con 0x562ffa576f60 2024-06-03T00:00:45.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.778+0000 7f8d977fe700 1 -- 172.21.15.49:0/2124810904 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f8dac015b20 con 0x562ffa576f60 2024-06-03T00:00:45.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.778+0000 7f8dc905db80 1 -- 172.21.15.49:0/2124810904 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8da8099700 con 0x562ffa576f60 2024-06-03T00:00:45.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.779+0000 7f8d977fe700 1 -- 172.21.15.49:0/2124810904 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8dac01b040 con 0x562ffa576f60 2024-06-03T00:00:45.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.779+0000 7f8dc905db80 10 client.15300 fetch_fsmap learned FSMap version 27 2024-06-03T00:00:45.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.779+0000 7f8dc905db80 1 -- 172.21.15.49:0/2124810904 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562ffa588a40 con 0x562ffa576f60 2024-06-03T00:00:45.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.779+0000 7f8d977fe700 1 -- 172.21.15.49:0/2124810904 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8da8099700 con 0x562ffa576f60 2024-06-03T00:00:45.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.779+0000 7f8d977fe700 1 -- 172.21.15.49:0/2124810904 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f8dac0065f0 con 0x562ffa576f60 2024-06-03T00:00:45.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.779+0000 7f8dc905db80 10 client.15300 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:00:45.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.779+0000 7f8dc905db80 10 client.15300 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-03T00:00:45.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.779+0000 7f8dc905db80 20 client.15300 populate_metadata read hostname 'smithi049' 2024-06-03T00:00:45.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.779+0000 7f8dc905db80 1 --2- 172.21.15.49:0/2124810904 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x562ffa58b070 0x562ffa58d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:45.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.779+0000 7f8dc905db80 4 client.15300 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:00:45.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.779+0000 7f8dc905db80 1 -- 172.21.15.49:0/2124810904 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ffa4cfd50 con 0x562ffa58b070 2024-06-03T00:00:45.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.780+0000 7f8db7fff700 1 --2- 172.21.15.49:0/2124810904 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x562ffa58b070 0x562ffa58d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:45.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.780+0000 7f8d977fe700 10 client.15300 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:00:45.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.780+0000 7f8db7fff700 1 --2- 172.21.15.49:0/2124810904 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x562ffa58b070 0x562ffa58d460 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b008ac9ad2d7f790 server_cookie=fd39ad2436498fef in_seq=0 out_seq=0 2024-06-03T00:00:45.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.781+0000 7f8d977fe700 1 -- 172.21.15.49:0/2124810904 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x562ffa4cfd50 con 0x562ffa58b070 2024-06-03T00:00:45.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.781+0000 7f8d977fe700 10 client.15300 handle_command_reply: tid=0 2024-06-03T00:00:45.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.781+0000 7f8dc905db80 1 client.15300 shutdown 2024-06-03T00:00:45.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.781+0000 7f8dc905db80 1 -- 172.21.15.49:0/2124810904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ffa576f60 msgr2=0x562ffa57a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:45.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.781+0000 7f8dc905db80 1 --2- 172.21.15.49:0/2124810904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ffa576f60 0x562ffa57a8b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8dac009ee0 tx=0x7f8dac004860 comp rx=0 tx=0).stop 2024-06-03T00:00:45.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.781+0000 7f8dc905db80 1 -- 172.21.15.49:0/2124810904 shutdown_connections 2024-06-03T00:00:45.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.781+0000 7f8dc905db80 1 --2- 172.21.15.49:0/2124810904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562ffa577880 0x562ffa57adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.781+0000 7f8dc905db80 1 --2- 172.21.15.49:0/2124810904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ffa5717a0 0x562ffa57d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.781+0000 7f8dc905db80 1 --2- 172.21.15.49:0/2124810904 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x562ffa58b070 0x562ffa58d460 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.781+0000 7f8dc905db80 1 --2- 172.21.15.49:0/2124810904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ffa576f60 0x562ffa57a8b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.781+0000 7f8dc905db80 1 -- 172.21.15.49:0/2124810904 >> 172.21.15.49:0/2124810904 conn(0x562ffa49e080 msgr2=0x562ffa56b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:45.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.781+0000 7f8d977fe700 0 client.15300 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:00:45.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.781+0000 7f8dc905db80 1 -- 172.21.15.49:0/2124810904 shutdown_connections 2024-06-03T00:00:45.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.781+0000 7f8dc905db80 1 -- 172.21.15.49:0/2124810904 wait complete. 2024-06-03T00:00:45.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.781+0000 7f8dc905db80 20 client.15300 trim_cache size 0 max 16384 2024-06-03T00:00:45.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.802+0000 7f8dc905db80 1 Processor -- start 2024-06-03T00:00:45.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.802+0000 7f8dc905db80 1 -- start start 2024-06-03T00:00:45.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.802+0000 7f8dc905db80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ffa5717a0 0x562ffa571260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:45.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.802+0000 7f8dc905db80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ffa576f60 0x562ffa57ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:45.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.802+0000 7f8dc905db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562ffa577880 0x562ffa5749e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:45.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.802+0000 7f8dc905db80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8da400d410 con 0x562ffa576f60 2024-06-03T00:00:45.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.802+0000 7f8dc905db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8da400ef50 con 0x562ffa577880 2024-06-03T00:00:45.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.802+0000 7f8dc905db80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8da400dae0 con 0x562ffa5717a0 2024-06-03T00:00:45.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.803+0000 7f8db77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ffa576f60 0x562ffa57ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:45.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.803+0000 7f8db77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ffa576f60 0x562ffa57ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50320/0 (socket says 172.21.15.49:50320) 2024-06-03T00:00:45.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.803+0000 7f8db77fe700 1 -- 172.21.15.49:0/401166886 learned_addr learned my addr 172.21.15.49:0/401166886 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:45.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.803+0000 7f8db7fff700 1 --2- 172.21.15.49:0/401166886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ffa5717a0 0x562ffa571260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:45.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.803+0000 7f8dbcd77700 1 --2- 172.21.15.49:0/401166886 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562ffa577880 0x562ffa5749e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:45.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.803+0000 7f8db77fe700 1 -- 172.21.15.49:0/401166886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ffa5717a0 msgr2=0x562ffa571260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:45.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.803+0000 7f8db77fe700 1 --2- 172.21.15.49:0/401166886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ffa5717a0 0x562ffa571260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.803+0000 7f8db77fe700 1 -- 172.21.15.49:0/401166886 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562ffa577880 msgr2=0x562ffa5749e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:45.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.803+0000 7f8db77fe700 1 --2- 172.21.15.49:0/401166886 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562ffa577880 0x562ffa5749e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.803+0000 7f8db77fe700 1 -- 172.21.15.49:0/401166886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ffa568810 con 0x562ffa576f60 2024-06-03T00:00:45.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.803+0000 7f8db77fe700 1 --2- 172.21.15.49:0/401166886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ffa576f60 0x562ffa57ae20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8dac006d20 tx=0x7f8dac006df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a89c408cb24b97b server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:45.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.803+0000 7f8d9dffb700 1 -- 172.21.15.49:0/401166886 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac03c070 con 0x562ffa576f60 2024-06-03T00:00:45.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.803+0000 7f8d9dffb700 1 -- 172.21.15.49:0/401166886 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8dac015d20 con 0x562ffa576f60 2024-06-03T00:00:45.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.803+0000 7f8d9dffb700 1 -- 172.21.15.49:0/401166886 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac025040 con 0x562ffa576f60 2024-06-03T00:00:45.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.804+0000 7f8dc905db80 1 -- 172.21.15.49:0/401166886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ffa576f60 msgr2=0x562ffa57ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:45.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.804+0000 7f8dc905db80 1 --2- 172.21.15.49:0/401166886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ffa576f60 0x562ffa57ae20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8dac006d20 tx=0x7f8dac006df0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.804+0000 7f8dc905db80 1 -- 172.21.15.49:0/401166886 shutdown_connections 2024-06-03T00:00:45.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.804+0000 7f8dc905db80 1 --2- 172.21.15.49:0/401166886 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562ffa577880 0x562ffa5749e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.804+0000 7f8dc905db80 1 --2- 172.21.15.49:0/401166886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ffa5717a0 0x562ffa571260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.804+0000 7f8dc905db80 1 --2- 172.21.15.49:0/401166886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ffa576f60 0x562ffa57ae20 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.804+0000 7f8dc905db80 1 -- 172.21.15.49:0/401166886 >> 172.21.15.49:0/401166886 conn(0x562ffa49e080 msgr2=0x562ffa57c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:45.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.804+0000 7f8dc905db80 1 -- 172.21.15.49:0/401166886 shutdown_connections 2024-06-03T00:00:45.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.804+0000 7f8dc905db80 1 -- 172.21.15.49:0/401166886 wait complete. 2024-06-03T00:00:45.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.805+0000 7f8dc905db80 1 -- start start 2024-06-03T00:00:45.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.805+0000 7f8dc905db80 1 Processor -- start 2024-06-03T00:00:45.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.805+0000 7f8dc905db80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ffa5717a0 0x562ffa5834f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:45.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.805+0000 7f8dc905db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562ffa576f60 0x562ffa583a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:45.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.805+0000 7f8dc905db80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ffa577880 0x562ffa591d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:45.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.805+0000 7f8dc905db80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8da400e880 con 0x562ffa5717a0 2024-06-03T00:00:45.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.805+0000 7f8dc905db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8da400e1b0 con 0x562ffa576f60 2024-06-03T00:00:45.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.805+0000 7f8dc905db80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8da400b390 con 0x562ffa577880 2024-06-03T00:00:45.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.805+0000 7f8dc905db80 10 client.0 _ll_register_callbacks cb 0x562ffa4585b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:00:45.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.805+0000 7f8db7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ffa5717a0 0x562ffa5834f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:45.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.805+0000 7f8db7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ffa5717a0 0x562ffa5834f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50336/0 (socket says 172.21.15.49:50336) 2024-06-03T00:00:45.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.805+0000 7f8db7fff700 1 -- 172.21.15.49:0/702525603 learned_addr learned my addr 172.21.15.49:0/702525603 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:45.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.805+0000 7f8dbcd77700 1 --2- 172.21.15.49:0/702525603 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ffa577880 0x562ffa591d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:45.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.805+0000 7f8db77fe700 1 --2- 172.21.15.49:0/702525603 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562ffa576f60 0x562ffa583a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:45.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.806+0000 7f8db7fff700 1 -- 172.21.15.49:0/702525603 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ffa577880 msgr2=0x562ffa591d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:45.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.806+0000 7f8db7fff700 1 --2- 172.21.15.49:0/702525603 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ffa577880 0x562ffa591d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.806+0000 7f8db7fff700 1 -- 172.21.15.49:0/702525603 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562ffa576f60 msgr2=0x562ffa583a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:45.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.806+0000 7f8db7fff700 1 --2- 172.21.15.49:0/702525603 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562ffa576f60 0x562ffa583a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.806+0000 7f8db7fff700 1 -- 172.21.15.49:0/702525603 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ffa592270 con 0x562ffa5717a0 2024-06-03T00:00:45.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.806+0000 7f8db7fff700 1 --2- 172.21.15.49:0/702525603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ffa5717a0 0x562ffa5834f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8da809bf10 tx=0x7f8da809b2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feebc3b0554dba24 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:45.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.806+0000 7f8d977fe700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:00:45.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.806+0000 7f8d977fe700 1 -- 172.21.15.49:0/702525603 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da8020040 con 0x562ffa5717a0 2024-06-03T00:00:45.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.806+0000 7f8d977fe700 1 -- 172.21.15.49:0/702525603 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f8da8097040 con 0x562ffa5717a0 2024-06-03T00:00:45.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.806+0000 7f8dc905db80 1 -- 172.21.15.49:0/702525603 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8dac015d20 con 0x562ffa5717a0 2024-06-03T00:00:45.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.806+0000 7f8d977fe700 1 -- 172.21.15.49:0/702525603 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8da8082050 con 0x562ffa5717a0 2024-06-03T00:00:45.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.806+0000 7f8dc905db80 10 client.15306 fetch_fsmap learned FSMap version 27 2024-06-03T00:00:45.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.806+0000 7f8dc905db80 1 -- 172.21.15.49:0/702525603 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562ffa5f5440 con 0x562ffa5717a0 2024-06-03T00:00:45.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.806+0000 7f8d977fe700 1 -- 172.21.15.49:0/702525603 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8dac015d20 con 0x562ffa5717a0 2024-06-03T00:00:45.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.806+0000 7f8d977fe700 1 -- 172.21.15.49:0/702525603 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f8da80a3e40 con 0x562ffa5717a0 2024-06-03T00:00:45.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.806+0000 7f8dc905db80 10 client.15306 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:00:45.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.806+0000 7f8dc905db80 10 client.15306 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-03T00:00:45.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.806+0000 7f8dc905db80 20 client.15306 populate_metadata read hostname 'smithi049' 2024-06-03T00:00:45.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.807+0000 7f8dc905db80 1 --2- 172.21.15.49:0/702525603 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x562ffa5f5820 0x562ffa5f7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:45.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.807+0000 7f8dc905db80 4 client.15306 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-03T00:00:45.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.807+0000 7f8dc905db80 1 -- 172.21.15.49:0/702525603 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562ffa4ca2d0 con 0x562ffa5f5820 2024-06-03T00:00:45.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.807+0000 7f8db77fe700 1 --2- 172.21.15.49:0/702525603 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x562ffa5f5820 0x562ffa5f7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:45.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.807+0000 7f8d977fe700 10 client.15306 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:00:45.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.807+0000 7f8db77fe700 1 --2- 172.21.15.49:0/702525603 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x562ffa5f5820 0x562ffa5f7c10 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4bf1864e8bc3752 server_cookie=e605f46a09cea2b9 in_seq=0 out_seq=0 2024-06-03T00:00:45.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.808+0000 7f8d977fe700 1 -- 172.21.15.49:0/702525603 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x562ffa4ca2d0 con 0x562ffa5f5820 2024-06-03T00:00:45.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.808+0000 7f8d977fe700 10 client.15306 handle_command_reply: tid=0 2024-06-03T00:00:45.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.808+0000 7f8dc905db80 1 client.15306 shutdown 2024-06-03T00:00:45.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.808+0000 7f8dc905db80 1 -- 172.21.15.49:0/702525603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ffa5717a0 msgr2=0x562ffa5834f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:45.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.808+0000 7f8dc905db80 1 --2- 172.21.15.49:0/702525603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ffa5717a0 0x562ffa5834f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8da809bf10 tx=0x7f8da809b2d0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.808+0000 7f8dc905db80 1 -- 172.21.15.49:0/702525603 shutdown_connections 2024-06-03T00:00:45.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.808+0000 7f8dc905db80 1 --2- 172.21.15.49:0/702525603 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ffa577880 0x562ffa591d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.808+0000 7f8dc905db80 1 --2- 172.21.15.49:0/702525603 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x562ffa5f5820 0x562ffa5f7c10 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.808+0000 7f8d977fe700 0 client.15306 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:00:45.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.808+0000 7f8dc905db80 1 --2- 172.21.15.49:0/702525603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ffa5717a0 0x562ffa5834f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.808+0000 7f8dc905db80 1 --2- 172.21.15.49:0/702525603 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562ffa576f60 0x562ffa583a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.808+0000 7f8dc905db80 1 -- 172.21.15.49:0/702525603 >> 172.21.15.49:0/702525603 conn(0x562ffa49e080 msgr2=0x562ffa57c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:45.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.808+0000 7f8dc905db80 1 -- 172.21.15.49:0/702525603 shutdown_connections 2024-06-03T00:00:45.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.808+0000 7f8dc905db80 1 -- 172.21.15.49:0/702525603 wait complete. 2024-06-03T00:00:45.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.808+0000 7f8dc905db80 20 client.15306 trim_cache size 0 max 16384 2024-06-03T00:00:45.818 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:00:45.818 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-03T00:00:45.818 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": { 2024-06-03T00:00:45.818 INFO:teuthology.orchestra.run.smithi049.stdout: "e39d2e89-16ad-4792-afeb-08f797e5c6e0": { 2024-06-03T00:00:45.818 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-06-03T00:00:45.818 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "e39d2e89-16ad-4792-afeb-08f797e5c6e0", 2024-06-03T00:00:45.818 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "recursive,force" 2024-06-03T00:00:45.818 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:00:45.818 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:00:45.818 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:00:45.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.808+0000 7f8dbe7da700 1 -- 172.21.15.49:0/1238532275 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8da00a2ca0 msgr2=0x7f8da00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:45.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.808+0000 7f8dbe7da700 1 --2- 172.21.15.49:0/1238532275 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8da00a2ca0 0x7f8da00a5160 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8db8107200 tx=0x7f8dac009190 comp rx=0 tx=0).stop 2024-06-03T00:00:45.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.808+0000 7f8dbe7da700 1 -- 172.21.15.49:0/1238532275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8db806adc0 msgr2=0x7f8db8101840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:45.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.808+0000 7f8dbe7da700 1 --2- 172.21.15.49:0/1238532275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8db806adc0 0x7f8db8101840 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8da800d950 tx=0x7f8da800dc60 comp rx=0 tx=0).stop 2024-06-03T00:00:45.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.809+0000 7f8dbe7da700 1 -- 172.21.15.49:0/1238532275 shutdown_connections 2024-06-03T00:00:45.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.809+0000 7f8dbe7da700 1 --2- 172.21.15.49:0/1238532275 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8da00a2ca0 0x7f8da00a5160 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.809+0000 7f8dbe7da700 1 --2- 172.21.15.49:0/1238532275 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8db8107860 0x7f8db81022c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.809+0000 7f8dbe7da700 1 --2- 172.21.15.49:0/1238532275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8db806adc0 0x7f8db8101840 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.809+0000 7f8dbe7da700 1 --2- 172.21.15.49:0/1238532275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8db806b770 0x7f8db8101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:45.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.809+0000 7f8dbe7da700 1 -- 172.21.15.49:0/1238532275 >> 172.21.15.49:0/1238532275 conn(0x7f8db8078340 msgr2=0x7f8db80ff720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:45.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.809+0000 7f8dbe7da700 1 -- 172.21.15.49:0/1238532275 shutdown_connections 2024-06-03T00:00:45.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:45.809+0000 7f8dbe7da700 1 -- 172.21.15.49:0/1238532275 wait complete. 2024-06-03T00:00:46.828 INFO:tasks.cephfs.filesystem:scrub status for tag:e39d2e89-16ad-4792-afeb-08f797e5c6e0 - {'path': '/', 'tag': 'e39d2e89-16ad-4792-afeb-08f797e5c6e0', 'options': 'recursive,force'} 2024-06-03T00:00:47.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.470+0000 7f1307baa700 1 -- 172.21.15.49:0/1253231985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1300101380 msgr2=0x7f1300101800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:47.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.470+0000 7f1307baa700 1 --2- 172.21.15.49:0/1253231985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1300101380 0x7f1300101800 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f12f4009990 tx=0x7f12f4009ca0 comp rx=0 tx=0).stop 2024-06-03T00:00:47.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.470+0000 7f1307baa700 1 -- 172.21.15.49:0/1253231985 shutdown_connections 2024-06-03T00:00:47.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.470+0000 7f1307baa700 1 --2- 172.21.15.49:0/1253231985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1300101d40 0x7f130010e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:47.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.470+0000 7f1307baa700 1 --2- 172.21.15.49:0/1253231985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13001073f0 0x7f13001077d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:47.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.470+0000 7f1307baa700 1 --2- 172.21.15.49:0/1253231985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1300101380 0x7f1300101800 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:47.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.470+0000 7f1307baa700 1 -- 172.21.15.49:0/1253231985 >> 172.21.15.49:0/1253231985 conn(0x7f1300078300 msgr2=0x7f1300078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:47.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.470+0000 7f1307baa700 1 -- 172.21.15.49:0/1253231985 shutdown_connections 2024-06-03T00:00:47.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.470+0000 7f1307baa700 1 -- 172.21.15.49:0/1253231985 wait complete. 2024-06-03T00:00:47.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.471+0000 7f1307baa700 1 Processor -- start 2024-06-03T00:00:47.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.471+0000 7f1307baa700 1 -- start start 2024-06-03T00:00:47.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.471+0000 7f1307baa700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1300101380 0x7f130019e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:47.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.471+0000 7f1307baa700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1300101d40 0x7f130019ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:47.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.471+0000 7f1307baa700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13001073f0 0x7f13001989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:47.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.471+0000 7f1307baa700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1300111660 con 0x7f1300101d40 2024-06-03T00:00:47.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.471+0000 7f1307baa700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f13001114e0 con 0x7f13001073f0 2024-06-03T00:00:47.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.471+0000 7f1307baa700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f13001117e0 con 0x7f1300101380 2024-06-03T00:00:47.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.471+0000 7f1305145700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1300101d40 0x7f130019ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:47.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.471+0000 7f1305145700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1300101d40 0x7f130019ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50352/0 (socket says 172.21.15.49:50352) 2024-06-03T00:00:47.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.471+0000 7f1305145700 1 -- 172.21.15.49:0/619367939 learned_addr learned my addr 172.21.15.49:0/619367939 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:47.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.471+0000 7f1306147700 1 --2- 172.21.15.49:0/619367939 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13001073f0 0x7f13001989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:47.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.471+0000 7f1305946700 1 --2- 172.21.15.49:0/619367939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1300101380 0x7f130019e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:47.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.472+0000 7f1305145700 1 -- 172.21.15.49:0/619367939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1300101380 msgr2=0x7f130019e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:47.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.472+0000 7f1305145700 1 --2- 172.21.15.49:0/619367939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1300101380 0x7f130019e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:47.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.472+0000 7f1305145700 1 -- 172.21.15.49:0/619367939 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13001073f0 msgr2=0x7f13001989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:47.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.472+0000 7f1305145700 1 --2- 172.21.15.49:0/619367939 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13001073f0 0x7f13001989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:47.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.472+0000 7f1305145700 1 -- 172.21.15.49:0/619367939 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1300199140 con 0x7f1300101d40 2024-06-03T00:00:47.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.472+0000 7f1306147700 1 --2- 172.21.15.49:0/619367939 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13001073f0 0x7f13001989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:00:47.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.472+0000 7f1305145700 1 --2- 172.21.15.49:0/619367939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1300101d40 0x7f130019ed60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f12f400bae0 tx=0x7f12f400bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:47.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.472+0000 7f12feffd700 1 -- 172.21.15.49:0/619367939 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f4026070 con 0x7f1300101d40 2024-06-03T00:00:47.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.472+0000 7f12feffd700 1 -- 172.21.15.49:0/619367939 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12f400f460 con 0x7f1300101d40 2024-06-03T00:00:47.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.472+0000 7f1307baa700 1 -- 172.21.15.49:0/619367939 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13001993d0 con 0x7f1300101d40 2024-06-03T00:00:47.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.472+0000 7f12feffd700 1 -- 172.21.15.49:0/619367939 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f4021670 con 0x7f1300101d40 2024-06-03T00:00:47.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.472+0000 7f1307baa700 1 -- 172.21.15.49:0/619367939 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13001a56f0 con 0x7f1300101d40 2024-06-03T00:00:47.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.473+0000 7f1307baa700 1 -- 172.21.15.49:0/619367939 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1300069180 con 0x7f1300101d40 2024-06-03T00:00:47.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.474+0000 7f12feffd700 1 -- 172.21.15.49:0/619367939 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f12f4029070 con 0x7f1300101d40 2024-06-03T00:00:47.035 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:00:47.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.475+0000 7f12feffd700 1 --2- 172.21.15.49:0/619367939 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f12e80a2c20 0x7f12e80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:47.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.475+0000 7f1305946700 1 --2- 172.21.15.49:0/619367939 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f12e80a2c20 0x7f12e80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:47.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.475+0000 7f12feffd700 1 -- 172.21.15.49:0/619367939 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f12f40cfed0 con 0x7f1300101d40 2024-06-03T00:00:47.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.475+0000 7f1305946700 1 --2- 172.21.15.49:0/619367939 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f12e80a2c20 0x7f12e80a50e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1300199b20 tx=0x7f12f0009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:47.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.479+0000 7f12feffd700 1 -- 172.21.15.49:0/619367939 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f12f405d850 con 0x7f1300101d40 2024-06-03T00:00:47.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.681+0000 7f1307baa700 1 -- 172.21.15.49:0/619367939 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1300105280 con 0x7f12e80a2c20 2024-06-03T00:00:47.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:46.689+0000 7f12feffd700 1 -- 172.21.15.49:0/619367939 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258893 (secure 0 0 0) 0x7f1300105280 con 0x7f12e80a2c20 2024-06-03T00:00:47.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:47.029+0000 7f1307baa700 1 -- 172.21.15.49:0/619367939 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f12e80a2c20 msgr2=0x7f12e80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:47.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:47.029+0000 7f1307baa700 1 --2- 172.21.15.49:0/619367939 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f12e80a2c20 0x7f12e80a50e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1300199b20 tx=0x7f12f0009040 comp rx=0 tx=0).stop 2024-06-03T00:00:47.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:47.029+0000 7f1307baa700 1 -- 172.21.15.49:0/619367939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1300101d40 msgr2=0x7f130019ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:47.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:47.029+0000 7f1307baa700 1 --2- 172.21.15.49:0/619367939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1300101d40 0x7f130019ed60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f12f400bae0 tx=0x7f12f400bb10 comp rx=0 tx=0).stop 2024-06-03T00:00:47.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:47.030+0000 7f1307baa700 1 -- 172.21.15.49:0/619367939 shutdown_connections 2024-06-03T00:00:47.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:47.030+0000 7f1307baa700 1 --2- 172.21.15.49:0/619367939 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f12e80a2c20 0x7f12e80a50e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:47.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:47.030+0000 7f1307baa700 1 --2- 172.21.15.49:0/619367939 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13001073f0 0x7f13001989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:47.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:47.030+0000 7f1307baa700 1 --2- 172.21.15.49:0/619367939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1300101380 0x7f130019e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:47.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:47.030+0000 7f1307baa700 1 --2- 172.21.15.49:0/619367939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1300101d40 0x7f130019ed60 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:47.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:47.030+0000 7f1307baa700 1 -- 172.21.15.49:0/619367939 >> 172.21.15.49:0/619367939 conn(0x7f1300078300 msgr2=0x7f130006ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:47.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:47.030+0000 7f1307baa700 1 -- 172.21.15.49:0/619367939 shutdown_connections 2024-06-03T00:00:47.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:47.030+0000 7f1307baa700 1 -- 172.21.15.49:0/619367939 wait complete. 2024-06-03T00:00:47.047 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-06-03T00:00:47.323 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:47 smithi049 ceph-mon[32302]: pgmap v405: 97 pgs: 97 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-06-03T00:00:47.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:47 smithi057 ceph-mon[36457]: pgmap v405: 97 pgs: 97 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-06-03T00:00:47.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:47 smithi107 ceph-mon[37048]: pgmap v405: 97 pgs: 97 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-06-03T00:00:47.660 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":405,"stamp":"2024-06-03T00:00:45.290323+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665041,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":2076,"num_read_kb":1165,"num_write":446,"num_write_kb":3094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":1180736,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":864,"ondisk_log_size":864,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375492,"kb_used_data":13860,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124566332,"statfs":{"total":1151940427776,"available":1151555923968,"internally_reserved":0,"allocated":14192640,"data_stored":7747851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":62,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002917"},"pg_stats":[{"pgid":"3.3f","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.275149+0000","last_change":"2024-06-02T23:57:15.321542+0000","last_active":"2024-06-02T23:58:55.275149+0000","last_peered":"2024-06-02T23:58:55.275149+0000","last_clean":"2024-06-02T23:58:55.275149+0000","last_became_active":"2024-06-02T23:57:15.321129+0000","last_became_peered":"2024-06-02T23:57:15.321129+0000","last_unstale":"2024-06-02T23:58:55.275149+0000","last_undegraded":"2024-06-02T23:58:55.275149+0000","last_fullsized":"2024-06-02T23:58:55.275149+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:35:50.218316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272859+0000","last_change":"2024-06-02T23:57:15.327432+0000","last_active":"2024-06-02T23:58:55.272859+0000","last_peered":"2024-06-02T23:58:55.272859+0000","last_clean":"2024-06-02T23:58:55.272859+0000","last_became_active":"2024-06-02T23:57:15.326759+0000","last_became_peered":"2024-06-02T23:57:15.326759+0000","last_unstale":"2024-06-02T23:58:55.272859+0000","last_undegraded":"2024-06-02T23:58:55.272859+0000","last_fullsized":"2024-06-02T23:58:55.272859+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:42:20.473216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.274694+0000","last_change":"2024-06-02T23:57:15.323721+0000","last_active":"2024-06-02T23:58:55.274694+0000","last_peered":"2024-06-02T23:58:55.274694+0000","last_clean":"2024-06-02T23:58:55.274694+0000","last_became_active":"2024-06-02T23:57:15.321277+0000","last_became_peered":"2024-06-02T23:57:15.321277+0000","last_unstale":"2024-06-02T23:58:55.274694+0000","last_undegraded":"2024-06-02T23:58:55.274694+0000","last_fullsized":"2024-06-02T23:58:55.274694+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:34:31.667999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.258319+0000","last_change":"2024-06-02T23:57:15.323769+0000","last_active":"2024-06-02T23:58:55.258319+0000","last_peered":"2024-06-02T23:58:55.258319+0000","last_clean":"2024-06-02T23:58:55.258319+0000","last_became_active":"2024-06-02T23:57:15.323406+0000","last_became_peered":"2024-06-02T23:57:15.323406+0000","last_unstale":"2024-06-02T23:58:55.258319+0000","last_undegraded":"2024-06-02T23:58:55.258319+0000","last_fullsized":"2024-06-02T23:58:55.258319+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:51:27.456210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.258510+0000","last_change":"2024-06-02T23:57:56.531404+0000","last_active":"2024-06-02T23:58:55.258510+0000","last_peered":"2024-06-02T23:58:55.258510+0000","last_clean":"2024-06-02T23:58:55.258510+0000","last_became_active":"2024-06-02T23:57:56.530952+0000","last_became_peered":"2024-06-02T23:57:56.530952+0000","last_unstale":"2024-06-02T23:58:55.258510+0000","last_undegraded":"2024-06-02T23:58:55.258510+0000","last_fullsized":"2024-06-02T23:58:55.258510+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:39:30.405113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268533+0000","last_change":"2024-06-02T23:57:15.320843+0000","last_active":"2024-06-02T23:58:55.268533+0000","last_peered":"2024-06-02T23:58:55.268533+0000","last_clean":"2024-06-02T23:58:55.268533+0000","last_became_active":"2024-06-02T23:57:15.320472+0000","last_became_peered":"2024-06-02T23:57:15.320472+0000","last_unstale":"2024-06-02T23:58:55.268533+0000","last_undegraded":"2024-06-02T23:58:55.268533+0000","last_fullsized":"2024-06-02T23:58:55.268533+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:49:02.620777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.271511+0000","last_change":"2024-06-02T23:57:15.321799+0000","last_active":"2024-06-02T23:58:55.271511+0000","last_peered":"2024-06-02T23:58:55.271511+0000","last_clean":"2024-06-02T23:58:55.271511+0000","last_became_active":"2024-06-02T23:57:15.321379+0000","last_became_peered":"2024-06-02T23:57:15.321379+0000","last_unstale":"2024-06-02T23:58:55.271511+0000","last_undegraded":"2024-06-02T23:58:55.271511+0000","last_fullsized":"2024-06-02T23:58:55.271511+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:36:56.404936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268859+0000","last_change":"2024-06-02T23:57:15.318771+0000","last_active":"2024-06-02T23:58:55.268859+0000","last_peered":"2024-06-02T23:58:55.268859+0000","last_clean":"2024-06-02T23:58:55.268859+0000","last_became_active":"2024-06-02T23:57:15.318420+0000","last_became_peered":"2024-06-02T23:57:15.318420+0000","last_unstale":"2024-06-02T23:58:55.268859+0000","last_undegraded":"2024-06-02T23:58:55.268859+0000","last_fullsized":"2024-06-02T23:58:55.268859+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:07:53.769443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.274516+0000","last_change":"2024-06-02T23:57:15.318989+0000","last_active":"2024-06-02T23:58:55.274516+0000","last_peered":"2024-06-02T23:58:55.274516+0000","last_clean":"2024-06-02T23:58:55.274516+0000","last_became_active":"2024-06-02T23:57:15.318424+0000","last_became_peered":"2024-06-02T23:57:15.318424+0000","last_unstale":"2024-06-02T23:58:55.274516+0000","last_undegraded":"2024-06-02T23:58:55.274516+0000","last_fullsized":"2024-06-02T23:58:55.274516+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:30:47.634662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265217+0000","last_change":"2024-06-02T23:57:15.326251+0000","last_active":"2024-06-02T23:58:55.265217+0000","last_peered":"2024-06-02T23:58:55.265217+0000","last_clean":"2024-06-02T23:58:55.265217+0000","last_became_active":"2024-06-02T23:57:15.325890+0000","last_became_peered":"2024-06-02T23:57:15.325890+0000","last_unstale":"2024-06-02T23:58:55.265217+0000","last_undegraded":"2024-06-02T23:58:55.265217+0000","last_fullsized":"2024-06-02T23:58:55.265217+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:18:54.871410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.274001+0000","last_change":"2024-06-02T23:57:15.325364+0000","last_active":"2024-06-02T23:58:55.274001+0000","last_peered":"2024-06-02T23:58:55.274001+0000","last_clean":"2024-06-02T23:58:55.274001+0000","last_became_active":"2024-06-02T23:57:15.324987+0000","last_became_peered":"2024-06-02T23:57:15.324987+0000","last_unstale":"2024-06-02T23:58:55.274001+0000","last_undegraded":"2024-06-02T23:58:55.274001+0000","last_fullsized":"2024-06-02T23:58:55.274001+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:59:11.827263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265434+0000","last_change":"2024-06-02T23:57:15.328027+0000","last_active":"2024-06-02T23:58:55.265434+0000","last_peered":"2024-06-02T23:58:55.265434+0000","last_clean":"2024-06-02T23:58:55.265434+0000","last_became_active":"2024-06-02T23:57:15.327608+0000","last_became_peered":"2024-06-02T23:57:15.327608+0000","last_unstale":"2024-06-02T23:58:55.265434+0000","last_undegraded":"2024-06-02T23:58:55.265434+0000","last_fullsized":"2024-06-02T23:58:55.265434+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:09:42.152689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262861+0000","last_change":"2024-06-02T23:57:15.323095+0000","last_active":"2024-06-02T23:58:55.262861+0000","last_peered":"2024-06-02T23:58:55.262861+0000","last_clean":"2024-06-02T23:58:55.262861+0000","last_became_active":"2024-06-02T23:57:15.322755+0000","last_became_peered":"2024-06-02T23:57:15.322755+0000","last_unstale":"2024-06-02T23:58:55.262861+0000","last_undegraded":"2024-06-02T23:58:55.262861+0000","last_fullsized":"2024-06-02T23:58:55.262861+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:43:53.195192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272339+0000","last_change":"2024-06-02T23:57:15.327437+0000","last_active":"2024-06-02T23:58:55.272339+0000","last_peered":"2024-06-02T23:58:55.272339+0000","last_clean":"2024-06-02T23:58:55.272339+0000","last_became_active":"2024-06-02T23:57:15.326974+0000","last_became_peered":"2024-06-02T23:57:15.326974+0000","last_unstale":"2024-06-02T23:58:55.272339+0000","last_undegraded":"2024-06-02T23:58:55.272339+0000","last_fullsized":"2024-06-02T23:58:55.272339+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:20:44.978213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273334+0000","last_change":"2024-06-02T23:57:15.325414+0000","last_active":"2024-06-02T23:58:55.273334+0000","last_peered":"2024-06-02T23:58:55.273334+0000","last_clean":"2024-06-02T23:58:55.273334+0000","last_became_active":"2024-06-02T23:57:15.325033+0000","last_became_peered":"2024-06-02T23:57:15.325033+0000","last_unstale":"2024-06-02T23:58:55.273334+0000","last_undegraded":"2024-06-02T23:58:55.273334+0000","last_fullsized":"2024-06-02T23:58:55.273334+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:27:14.536646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272688+0000","last_change":"2024-06-02T23:57:15.315833+0000","last_active":"2024-06-02T23:58:55.272688+0000","last_peered":"2024-06-02T23:58:55.272688+0000","last_clean":"2024-06-02T23:58:55.272688+0000","last_became_active":"2024-06-02T23:57:15.315355+0000","last_became_peered":"2024-06-02T23:57:15.315355+0000","last_unstale":"2024-06-02T23:58:55.272688+0000","last_undegraded":"2024-06-02T23:58:55.272688+0000","last_fullsized":"2024-06-02T23:58:55.272688+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:52:05.915828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.275143+0000","last_change":"2024-06-02T23:57:15.322407+0000","last_active":"2024-06-02T23:58:55.275143+0000","last_peered":"2024-06-02T23:58:55.275143+0000","last_clean":"2024-06-02T23:58:55.275143+0000","last_became_active":"2024-06-02T23:57:15.322090+0000","last_became_peered":"2024-06-02T23:57:15.322090+0000","last_unstale":"2024-06-02T23:58:55.275143+0000","last_undegraded":"2024-06-02T23:58:55.275143+0000","last_fullsized":"2024-06-02T23:58:55.275143+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:08:48.071192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268594+0000","last_change":"2024-06-02T23:57:15.327331+0000","last_active":"2024-06-02T23:58:55.268594+0000","last_peered":"2024-06-02T23:58:55.268594+0000","last_clean":"2024-06-02T23:58:55.268594+0000","last_became_active":"2024-06-02T23:57:15.326863+0000","last_became_peered":"2024-06-02T23:57:15.326863+0000","last_unstale":"2024-06-02T23:58:55.268594+0000","last_undegraded":"2024-06-02T23:58:55.268594+0000","last_fullsized":"2024-06-02T23:58:55.268594+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:45:05.443751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.261047+0000","last_change":"2024-06-02T23:57:15.313008+0000","last_active":"2024-06-02T23:58:55.261047+0000","last_peered":"2024-06-02T23:58:55.261047+0000","last_clean":"2024-06-02T23:58:55.261047+0000","last_became_active":"2024-06-02T23:57:15.312322+0000","last_became_peered":"2024-06-02T23:57:15.312322+0000","last_unstale":"2024-06-02T23:58:55.261047+0000","last_undegraded":"2024-06-02T23:58:55.261047+0000","last_fullsized":"2024-06-02T23:58:55.261047+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:54:03.744964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":233,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:43.426945+0000","last_change":"2024-06-02T23:57:12.153410+0000","last_active":"2024-06-03T00:00:43.426945+0000","last_peered":"2024-06-03T00:00:43.426945+0000","last_clean":"2024-06-03T00:00:43.426945+0000","last_became_active":"2024-06-02T23:57:12.153065+0000","last_became_peered":"2024-06-02T23:57:12.153065+0000","last_unstale":"2024-06-03T00:00:43.426945+0000","last_undegraded":"2024-06-03T00:00:43.426945+0000","last_fullsized":"2024-06-03T00:00:43.426945+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:45:30.058961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":194,"num_read_kb":194,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.258496+0000","last_change":"2024-06-02T23:57:15.314168+0000","last_active":"2024-06-02T23:58:55.258496+0000","last_peered":"2024-06-02T23:58:55.258496+0000","last_clean":"2024-06-02T23:58:55.258496+0000","last_became_active":"2024-06-02T23:57:15.313838+0000","last_became_peered":"2024-06-02T23:57:15.313838+0000","last_unstale":"2024-06-02T23:58:55.258496+0000","last_undegraded":"2024-06-02T23:58:55.258496+0000","last_fullsized":"2024-06-02T23:58:55.258496+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:56:14.137471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526742+0000","last_change":"2024-06-02T23:57:12.305448+0000","last_active":"2024-06-02T23:57:56.526742+0000","last_peered":"2024-06-02T23:57:56.526742+0000","last_clean":"2024-06-02T23:57:56.526742+0000","last_became_active":"2024-06-02T23:57:12.305080+0000","last_became_peered":"2024-06-02T23:57:12.305080+0000","last_unstale":"2024-06-02T23:57:56.526742+0000","last_undegraded":"2024-06-02T23:57:56.526742+0000","last_fullsized":"2024-06-02T23:57:56.526742+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:20:18.660943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.275386+0000","last_change":"2024-06-02T23:57:15.321660+0000","last_active":"2024-06-02T23:58:55.275386+0000","last_peered":"2024-06-02T23:58:55.275386+0000","last_clean":"2024-06-02T23:58:55.275386+0000","last_became_active":"2024-06-02T23:57:15.321304+0000","last_became_peered":"2024-06-02T23:57:15.321304+0000","last_unstale":"2024-06-02T23:58:55.275386+0000","last_undegraded":"2024-06-02T23:58:55.275386+0000","last_fullsized":"2024-06-02T23:58:55.275386+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:10:10.933291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:58.169787+0000","last_change":"2024-06-02T23:57:56.544458+0000","last_active":"2024-06-02T23:57:58.169787+0000","last_peered":"2024-06-02T23:57:58.169787+0000","last_clean":"2024-06-02T23:57:58.169787+0000","last_became_active":"2024-06-02T23:57:56.532838+0000","last_became_peered":"2024-06-02T23:57:56.532838+0000","last_unstale":"2024-06-02T23:57:58.169787+0000","last_undegraded":"2024-06-02T23:57:58.169787+0000","last_fullsized":"2024-06-02T23:57:58.169787+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:27:44.700493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272537+0000","last_change":"2024-06-02T23:57:15.328944+0000","last_active":"2024-06-02T23:58:55.272537+0000","last_peered":"2024-06-02T23:58:55.272537+0000","last_clean":"2024-06-02T23:58:55.272537+0000","last_became_active":"2024-06-02T23:57:15.328531+0000","last_became_peered":"2024-06-02T23:57:15.328531+0000","last_unstale":"2024-06-02T23:58:55.272537+0000","last_undegraded":"2024-06-02T23:58:55.272537+0000","last_fullsized":"2024-06-02T23:58:55.272537+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:48:19.709989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528536+0000","last_change":"2024-06-02T23:57:12.153967+0000","last_active":"2024-06-02T23:57:56.528536+0000","last_peered":"2024-06-02T23:57:56.528536+0000","last_clean":"2024-06-02T23:57:56.528536+0000","last_became_active":"2024-06-02T23:57:12.153600+0000","last_became_peered":"2024-06-02T23:57:12.153600+0000","last_unstale":"2024-06-02T23:57:56.528536+0000","last_undegraded":"2024-06-02T23:57:56.528536+0000","last_fullsized":"2024-06-02T23:57:56.528536+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:47:58.761573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267401+0000","last_change":"2024-06-02T23:57:15.318089+0000","last_active":"2024-06-02T23:58:55.267401+0000","last_peered":"2024-06-02T23:58:55.267401+0000","last_clean":"2024-06-02T23:58:55.267401+0000","last_became_active":"2024-06-02T23:57:15.316494+0000","last_became_peered":"2024-06-02T23:57:15.316494+0000","last_unstale":"2024-06-02T23:58:55.267401+0000","last_undegraded":"2024-06-02T23:58:55.267401+0000","last_fullsized":"2024-06-02T23:58:55.267401+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:21:15.839255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"90'7","reported_seq":229,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:42.421852+0000","last_change":"2024-06-02T23:57:12.153624+0000","last_active":"2024-06-03T00:00:42.421852+0000","last_peered":"2024-06-03T00:00:42.421852+0000","last_clean":"2024-06-03T00:00:42.421852+0000","last_became_active":"2024-06-02T23:57:12.152712+0000","last_became_peered":"2024-06-02T23:57:12.152712+0000","last_unstale":"2024-06-03T00:00:42.421852+0000","last_undegraded":"2024-06-03T00:00:42.421852+0000","last_fullsized":"2024-06-03T00:00:42.421852+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:14:50.236213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":195,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259432+0000","last_change":"2024-06-02T23:57:15.325293+0000","last_active":"2024-06-02T23:58:55.259432+0000","last_peered":"2024-06-02T23:58:55.259432+0000","last_clean":"2024-06-02T23:58:55.259432+0000","last_became_active":"2024-06-02T23:57:15.324967+0000","last_became_peered":"2024-06-02T23:57:15.324967+0000","last_unstale":"2024-06-02T23:58:55.259432+0000","last_undegraded":"2024-06-02T23:58:55.259432+0000","last_fullsized":"2024-06-02T23:58:55.259432+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:21:23.634118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.735981+0000","last_change":"2024-06-02T23:57:12.155927+0000","last_active":"2024-06-02T23:57:56.735981+0000","last_peered":"2024-06-02T23:57:56.735981+0000","last_clean":"2024-06-02T23:57:56.735981+0000","last_became_active":"2024-06-02T23:57:12.155505+0000","last_became_peered":"2024-06-02T23:57:12.155505+0000","last_unstale":"2024-06-02T23:57:56.735981+0000","last_undegraded":"2024-06-02T23:57:56.735981+0000","last_fullsized":"2024-06-02T23:57:56.735981+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:47.555747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262458+0000","last_change":"2024-06-02T23:57:15.321796+0000","last_active":"2024-06-02T23:58:55.262458+0000","last_peered":"2024-06-02T23:58:55.262458+0000","last_clean":"2024-06-02T23:58:55.262458+0000","last_became_active":"2024-06-02T23:57:15.320850+0000","last_became_peered":"2024-06-02T23:57:15.320850+0000","last_unstale":"2024-06-02T23:58:55.262458+0000","last_undegraded":"2024-06-02T23:58:55.262458+0000","last_fullsized":"2024-06-02T23:58:55.262458+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:04:10.991920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.523859+0000","last_change":"2024-06-02T23:57:12.146589+0000","last_active":"2024-06-02T23:57:56.523859+0000","last_peered":"2024-06-02T23:57:56.523859+0000","last_clean":"2024-06-02T23:57:56.523859+0000","last_became_active":"2024-06-02T23:57:12.146224+0000","last_became_peered":"2024-06-02T23:57:12.146224+0000","last_unstale":"2024-06-02T23:57:56.523859+0000","last_undegraded":"2024-06-02T23:57:56.523859+0000","last_fullsized":"2024-06-02T23:57:56.523859+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:17:31.250585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268843+0000","last_change":"2024-06-02T23:57:15.315553+0000","last_active":"2024-06-02T23:58:55.268843+0000","last_peered":"2024-06-02T23:58:55.268843+0000","last_clean":"2024-06-02T23:58:55.268843+0000","last_became_active":"2024-06-02T23:57:15.315217+0000","last_became_peered":"2024-06-02T23:57:15.315217+0000","last_unstale":"2024-06-02T23:58:55.268843+0000","last_undegraded":"2024-06-02T23:58:55.268843+0000","last_fullsized":"2024-06-02T23:58:55.268843+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:00:23.097949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.525158+0000","last_change":"2024-06-02T23:57:12.156971+0000","last_active":"2024-06-02T23:57:56.525158+0000","last_peered":"2024-06-02T23:57:56.525158+0000","last_clean":"2024-06-02T23:57:56.525158+0000","last_became_active":"2024-06-02T23:57:12.156379+0000","last_became_peered":"2024-06-02T23:57:12.156379+0000","last_unstale":"2024-06-02T23:57:56.525158+0000","last_undegraded":"2024-06-02T23:57:56.525158+0000","last_fullsized":"2024-06-02T23:57:56.525158+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:28:50.057736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.266692+0000","last_change":"2024-06-02T23:57:15.313985+0000","last_active":"2024-06-02T23:58:55.266692+0000","last_peered":"2024-06-02T23:58:55.266692+0000","last_clean":"2024-06-02T23:58:55.266692+0000","last_became_active":"2024-06-02T23:57:15.313668+0000","last_became_peered":"2024-06-02T23:57:15.313668+0000","last_unstale":"2024-06-02T23:58:55.266692+0000","last_undegraded":"2024-06-02T23:58:55.266692+0000","last_fullsized":"2024-06-02T23:58:55.266692+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:10:56.560660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"90'5","reported_seq":410,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:41.420069+0000","last_change":"2024-06-02T23:57:12.156025+0000","last_active":"2024-06-03T00:00:41.420069+0000","last_peered":"2024-06-03T00:00:41.420069+0000","last_clean":"2024-06-03T00:00:41.420069+0000","last_became_active":"2024-06-02T23:57:12.155609+0000","last_became_peered":"2024-06-02T23:57:12.155609+0000","last_unstale":"2024-06-03T00:00:41.420069+0000","last_undegraded":"2024-06-03T00:00:41.420069+0000","last_fullsized":"2024-06-03T00:00:41.420069+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:27:48.953456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":378,"num_read_kb":378,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272606+0000","last_change":"2024-06-02T23:57:15.329711+0000","last_active":"2024-06-02T23:58:55.272606+0000","last_peered":"2024-06-02T23:58:55.272606+0000","last_clean":"2024-06-02T23:58:55.272606+0000","last_became_active":"2024-06-02T23:57:15.329284+0000","last_became_peered":"2024-06-02T23:57:15.329284+0000","last_unstale":"2024-06-02T23:58:55.272606+0000","last_undegraded":"2024-06-02T23:58:55.272606+0000","last_fullsized":"2024-06-02T23:58:55.272606+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:58:06.165152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.529073+0000","last_change":"2024-06-02T23:57:12.156949+0000","last_active":"2024-06-02T23:57:56.529073+0000","last_peered":"2024-06-02T23:57:56.529073+0000","last_clean":"2024-06-02T23:57:56.529073+0000","last_became_active":"2024-06-02T23:57:12.156558+0000","last_became_peered":"2024-06-02T23:57:12.156558+0000","last_unstale":"2024-06-02T23:57:56.529073+0000","last_undegraded":"2024-06-02T23:57:56.529073+0000","last_fullsized":"2024-06-02T23:57:56.529073+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:05:57.658900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273919+0000","last_change":"2024-06-02T23:57:15.318638+0000","last_active":"2024-06-02T23:58:55.273919+0000","last_peered":"2024-06-02T23:58:55.273919+0000","last_clean":"2024-06-02T23:58:55.273919+0000","last_became_active":"2024-06-02T23:57:15.318321+0000","last_became_peered":"2024-06-02T23:57:15.318321+0000","last_unstale":"2024-06-02T23:58:55.273919+0000","last_undegraded":"2024-06-02T23:58:55.273919+0000","last_fullsized":"2024-06-02T23:58:55.273919+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:21:57.877235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526151+0000","last_change":"2024-06-02T23:57:12.306278+0000","last_active":"2024-06-02T23:57:56.526151+0000","last_peered":"2024-06-02T23:57:56.526151+0000","last_clean":"2024-06-02T23:57:56.526151+0000","last_became_active":"2024-06-02T23:57:12.305885+0000","last_became_peered":"2024-06-02T23:57:12.305885+0000","last_unstale":"2024-06-02T23:57:56.526151+0000","last_undegraded":"2024-06-02T23:57:56.526151+0000","last_fullsized":"2024-06-02T23:57:56.526151+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:05:07.723501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.266773+0000","last_change":"2024-06-02T23:57:15.322489+0000","last_active":"2024-06-02T23:58:55.266773+0000","last_peered":"2024-06-02T23:58:55.266773+0000","last_clean":"2024-06-02T23:58:55.266773+0000","last_became_active":"2024-06-02T23:57:15.322131+0000","last_became_peered":"2024-06-02T23:57:15.322131+0000","last_unstale":"2024-06-02T23:58:55.266773+0000","last_undegraded":"2024-06-02T23:58:55.266773+0000","last_fullsized":"2024-06-02T23:58:55.266773+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:34:43.362338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"90'39","reported_seq":459,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:41.419599+0000","last_change":"2024-06-02T23:57:12.156920+0000","last_active":"2024-06-03T00:00:41.419599+0000","last_peered":"2024-06-03T00:00:41.419599+0000","last_clean":"2024-06-03T00:00:41.419599+0000","last_became_active":"2024-06-02T23:57:12.156494+0000","last_became_peered":"2024-06-02T23:57:12.156494+0000","last_unstale":"2024-06-03T00:00:41.419599+0000","last_undegraded":"2024-06-03T00:00:41.419599+0000","last_fullsized":"2024-06-03T00:00:41.419599+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:49:56.458730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67178,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":393,"num_read_kb":263,"num_write":41,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265549+0000","last_change":"2024-06-02T23:57:15.328502+0000","last_active":"2024-06-02T23:58:55.265549+0000","last_peered":"2024-06-02T23:58:55.265549+0000","last_clean":"2024-06-02T23:58:55.265549+0000","last_became_active":"2024-06-02T23:57:15.328174+0000","last_became_peered":"2024-06-02T23:57:15.328174+0000","last_unstale":"2024-06-02T23:58:55.265549+0000","last_undegraded":"2024-06-02T23:58:55.265549+0000","last_fullsized":"2024-06-02T23:58:55.265549+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:58:33.355397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527385+0000","last_change":"2024-06-02T23:57:12.154204+0000","last_active":"2024-06-02T23:57:56.527385+0000","last_peered":"2024-06-02T23:57:56.527385+0000","last_clean":"2024-06-02T23:57:56.527385+0000","last_became_active":"2024-06-02T23:57:12.153412+0000","last_became_peered":"2024-06-02T23:57:12.153412+0000","last_unstale":"2024-06-02T23:57:56.527385+0000","last_undegraded":"2024-06-02T23:57:56.527385+0000","last_fullsized":"2024-06-02T23:57:56.527385+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:15.472279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262255+0000","last_change":"2024-06-02T23:57:15.314274+0000","last_active":"2024-06-02T23:58:55.262255+0000","last_peered":"2024-06-02T23:58:55.262255+0000","last_clean":"2024-06-02T23:58:55.262255+0000","last_became_active":"2024-06-02T23:57:15.313946+0000","last_became_peered":"2024-06-02T23:57:15.313946+0000","last_unstale":"2024-06-02T23:58:55.262255+0000","last_undegraded":"2024-06-02T23:58:55.262255+0000","last_fullsized":"2024-06-02T23:58:55.262255+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:07.909977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.525241+0000","last_change":"2024-06-02T23:57:12.156767+0000","last_active":"2024-06-02T23:57:56.525241+0000","last_peered":"2024-06-02T23:57:56.525241+0000","last_clean":"2024-06-02T23:57:56.525241+0000","last_became_active":"2024-06-02T23:57:12.156346+0000","last_became_peered":"2024-06-02T23:57:12.156346+0000","last_unstale":"2024-06-02T23:57:56.525241+0000","last_undegraded":"2024-06-02T23:57:56.525241+0000","last_fullsized":"2024-06-02T23:57:56.525241+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:29:45.801904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267668+0000","last_change":"2024-06-02T23:57:15.322676+0000","last_active":"2024-06-02T23:58:55.267668+0000","last_peered":"2024-06-02T23:58:55.267668+0000","last_clean":"2024-06-02T23:58:55.267668+0000","last_became_active":"2024-06-02T23:57:15.319429+0000","last_became_peered":"2024-06-02T23:57:15.319429+0000","last_unstale":"2024-06-02T23:58:55.267668+0000","last_undegraded":"2024-06-02T23:58:55.267668+0000","last_fullsized":"2024-06-02T23:58:55.267668+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:48:15.984818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'6","reported_seq":227,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:42.460858+0000","last_change":"2024-06-02T23:57:12.153925+0000","last_active":"2024-06-03T00:00:42.460858+0000","last_peered":"2024-06-03T00:00:42.460858+0000","last_clean":"2024-06-03T00:00:42.460858+0000","last_became_active":"2024-06-02T23:57:12.152990+0000","last_became_peered":"2024-06-02T23:57:12.152990+0000","last_unstale":"2024-06-03T00:00:42.460858+0000","last_undegraded":"2024-06-03T00:00:42.460858+0000","last_fullsized":"2024-06-03T00:00:42.460858+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:32:21.845946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":896,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":195,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.270077+0000","last_change":"2024-06-02T23:57:15.327662+0000","last_active":"2024-06-02T23:58:55.270077+0000","last_peered":"2024-06-02T23:58:55.270077+0000","last_clean":"2024-06-02T23:58:55.270077+0000","last_became_active":"2024-06-02T23:57:15.327320+0000","last_became_peered":"2024-06-02T23:57:15.327320+0000","last_unstale":"2024-06-02T23:58:55.270077+0000","last_undegraded":"2024-06-02T23:58:55.270077+0000","last_fullsized":"2024-06-02T23:58:55.270077+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:44:37.561533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528426+0000","last_change":"2024-06-02T23:57:12.306856+0000","last_active":"2024-06-02T23:57:56.528426+0000","last_peered":"2024-06-02T23:57:56.528426+0000","last_clean":"2024-06-02T23:57:56.528426+0000","last_became_active":"2024-06-02T23:57:12.306476+0000","last_became_peered":"2024-06-02T23:57:12.306476+0000","last_unstale":"2024-06-02T23:57:56.528426+0000","last_undegraded":"2024-06-02T23:57:56.528426+0000","last_fullsized":"2024-06-02T23:57:56.528426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:30:22.839589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.266843+0000","last_change":"2024-06-02T23:57:56.890015+0000","last_active":"2024-06-02T23:58:55.266843+0000","last_peered":"2024-06-02T23:58:55.266843+0000","last_clean":"2024-06-02T23:58:55.266843+0000","last_became_active":"2024-06-02T23:57:56.889591+0000","last_became_peered":"2024-06-02T23:57:56.889591+0000","last_unstale":"2024-06-02T23:58:55.266843+0000","last_undegraded":"2024-06-02T23:58:55.266843+0000","last_fullsized":"2024-06-02T23:58:55.266843+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:14:37.851207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'3","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:59:28.633344+0000","last_change":"2024-06-02T23:57:12.146690+0000","last_active":"2024-06-02T23:59:28.633344+0000","last_peered":"2024-06-02T23:59:28.633344+0000","last_clean":"2024-06-02T23:59:28.633344+0000","last_became_active":"2024-06-02T23:57:12.146372+0000","last_became_peered":"2024-06-02T23:57:12.146372+0000","last_unstale":"2024-06-02T23:59:28.633344+0000","last_undegraded":"2024-06-02T23:59:28.633344+0000","last_fullsized":"2024-06-02T23:59:28.633344+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:45:04.421365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267278+0000","last_change":"2024-06-02T23:57:15.320938+0000","last_active":"2024-06-02T23:58:55.267278+0000","last_peered":"2024-06-02T23:58:55.267278+0000","last_clean":"2024-06-02T23:58:55.267278+0000","last_became_active":"2024-06-02T23:57:15.320567+0000","last_became_peered":"2024-06-02T23:57:15.320567+0000","last_unstale":"2024-06-02T23:58:55.267278+0000","last_undegraded":"2024-06-02T23:58:55.267278+0000","last_fullsized":"2024-06-02T23:58:55.267278+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:04:29.736387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"88'1","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527764+0000","last_change":"2024-06-02T23:57:12.307020+0000","last_active":"2024-06-02T23:57:56.527764+0000","last_peered":"2024-06-02T23:57:56.527764+0000","last_clean":"2024-06-02T23:57:56.527764+0000","last_became_active":"2024-06-02T23:57:12.306650+0000","last_became_peered":"2024-06-02T23:57:12.306650+0000","last_unstale":"2024-06-02T23:57:56.527764+0000","last_undegraded":"2024-06-02T23:57:56.527764+0000","last_fullsized":"2024-06-02T23:57:56.527764+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:18:03.679704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265006+0000","last_change":"2024-06-02T23:57:15.319300+0000","last_active":"2024-06-02T23:58:55.265006+0000","last_peered":"2024-06-02T23:58:55.265006+0000","last_clean":"2024-06-02T23:58:55.265006+0000","last_became_active":"2024-06-02T23:57:15.318903+0000","last_became_peered":"2024-06-02T23:57:15.318903+0000","last_unstale":"2024-06-02T23:58:55.265006+0000","last_undegraded":"2024-06-02T23:58:55.265006+0000","last_fullsized":"2024-06-02T23:58:55.265006+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:38:25.521337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":225,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:43.427424+0000","last_change":"2024-06-02T23:57:12.155260+0000","last_active":"2024-06-03T00:00:43.427424+0000","last_peered":"2024-06-03T00:00:43.427424+0000","last_clean":"2024-06-03T00:00:43.427424+0000","last_became_active":"2024-06-02T23:57:12.154884+0000","last_became_peered":"2024-06-02T23:57:12.154884+0000","last_unstale":"2024-06-03T00:00:43.427424+0000","last_undegraded":"2024-06-03T00:00:43.427424+0000","last_fullsized":"2024-06-03T00:00:43.427424+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:34:52.390752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":193,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.269861+0000","last_change":"2024-06-02T23:57:15.323490+0000","last_active":"2024-06-02T23:58:55.269861+0000","last_peered":"2024-06-02T23:58:55.269861+0000","last_clean":"2024-06-02T23:58:55.269861+0000","last_became_active":"2024-06-02T23:57:15.323142+0000","last_became_peered":"2024-06-02T23:57:15.323142+0000","last_unstale":"2024-06-02T23:58:55.269861+0000","last_undegraded":"2024-06-02T23:58:55.269861+0000","last_fullsized":"2024-06-02T23:58:55.269861+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:32:32.445823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.261770+0000","last_change":"2024-06-02T23:57:56.531715+0000","last_active":"2024-06-02T23:58:55.261770+0000","last_peered":"2024-06-02T23:58:55.261770+0000","last_clean":"2024-06-02T23:58:55.261770+0000","last_became_active":"2024-06-02T23:57:56.531304+0000","last_became_peered":"2024-06-02T23:57:56.531304+0000","last_unstale":"2024-06-02T23:58:55.261770+0000","last_undegraded":"2024-06-02T23:58:55.261770+0000","last_fullsized":"2024-06-02T23:58:55.261770+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:58:02.532206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'6","reported_seq":225,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:42.460271+0000","last_change":"2024-06-02T23:57:12.305475+0000","last_active":"2024-06-03T00:00:42.460271+0000","last_peered":"2024-06-03T00:00:42.460271+0000","last_clean":"2024-06-03T00:00:42.460271+0000","last_became_active":"2024-06-02T23:57:12.305071+0000","last_became_peered":"2024-06-02T23:57:12.305071+0000","last_unstale":"2024-06-03T00:00:42.460271+0000","last_undegraded":"2024-06-03T00:00:42.460271+0000","last_fullsized":"2024-06-03T00:00:42.460271+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:08:29.024447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":192,"num_read_kb":192,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.264368+0000","last_change":"2024-06-02T23:57:15.308629+0000","last_active":"2024-06-02T23:58:55.264368+0000","last_peered":"2024-06-02T23:58:55.264368+0000","last_clean":"2024-06-02T23:58:55.264368+0000","last_became_active":"2024-06-02T23:57:15.307981+0000","last_became_peered":"2024-06-02T23:57:15.307981+0000","last_unstale":"2024-06-02T23:58:55.264368+0000","last_undegraded":"2024-06-02T23:58:55.264368+0000","last_fullsized":"2024-06-02T23:58:55.264368+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:14:22.446599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.652578+0000","last_change":"2024-06-02T23:57:12.155968+0000","last_active":"2024-06-02T23:57:56.652578+0000","last_peered":"2024-06-02T23:57:56.652578+0000","last_clean":"2024-06-02T23:57:56.652578+0000","last_became_active":"2024-06-02T23:57:12.155521+0000","last_became_peered":"2024-06-02T23:57:12.155521+0000","last_unstale":"2024-06-02T23:57:56.652578+0000","last_undegraded":"2024-06-02T23:57:56.652578+0000","last_fullsized":"2024-06-02T23:57:56.652578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:45:00.397317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":350,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:34.488628+0000","last_change":"2024-06-02T23:55:50.081978+0000","last_active":"2024-06-02T23:58:34.488628+0000","last_peered":"2024-06-02T23:58:34.488628+0000","last_clean":"2024-06-02T23:58:34.488628+0000","last_became_active":"2024-06-02T23:55:50.081431+0000","last_became_peered":"2024-06-02T23:55:50.081431+0000","last_unstale":"2024-06-02T23:58:34.488628+0000","last_undegraded":"2024-06-02T23:58:34.488628+0000","last_fullsized":"2024-06-02T23:58:34.488628+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:52:23.676206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:52:23.676206+0000","last_clean_scrub_stamp":"2024-06-02T23:52:23.676206+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:29:59.979935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262458+0000","last_change":"2024-06-02T23:57:56.529633+0000","last_active":"2024-06-02T23:58:55.262458+0000","last_peered":"2024-06-02T23:58:55.262458+0000","last_clean":"2024-06-02T23:58:55.262458+0000","last_became_active":"2024-06-02T23:57:56.529210+0000","last_became_peered":"2024-06-02T23:57:56.529210+0000","last_unstale":"2024-06-02T23:58:55.262458+0000","last_undegraded":"2024-06-02T23:58:55.262458+0000","last_fullsized":"2024-06-02T23:58:55.262458+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:51:31.807162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.529339+0000","last_change":"2024-06-02T23:57:12.155897+0000","last_active":"2024-06-02T23:57:56.529339+0000","last_peered":"2024-06-02T23:57:56.529339+0000","last_clean":"2024-06-02T23:57:56.529339+0000","last_became_active":"2024-06-02T23:57:12.155461+0000","last_became_peered":"2024-06-02T23:57:12.155461+0000","last_unstale":"2024-06-02T23:57:56.529339+0000","last_undegraded":"2024-06-02T23:57:56.529339+0000","last_fullsized":"2024-06-02T23:57:56.529339+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:19:22.104104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528035+0000","last_change":"2024-06-02T23:57:12.306363+0000","last_active":"2024-06-02T23:57:56.528035+0000","last_peered":"2024-06-02T23:57:56.528035+0000","last_clean":"2024-06-02T23:57:56.528035+0000","last_became_active":"2024-06-02T23:57:12.305920+0000","last_became_peered":"2024-06-02T23:57:12.305920+0000","last_unstale":"2024-06-02T23:57:56.528035+0000","last_undegraded":"2024-06-02T23:57:56.528035+0000","last_fullsized":"2024-06-02T23:57:56.528035+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:31:01.787879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262436+0000","last_change":"2024-06-02T23:57:15.316038+0000","last_active":"2024-06-02T23:58:55.262436+0000","last_peered":"2024-06-02T23:58:55.262436+0000","last_clean":"2024-06-02T23:58:55.262436+0000","last_became_active":"2024-06-02T23:57:15.315715+0000","last_became_peered":"2024-06-02T23:57:15.315715+0000","last_unstale":"2024-06-02T23:58:55.262436+0000","last_undegraded":"2024-06-02T23:58:55.262436+0000","last_fullsized":"2024-06-02T23:58:55.262436+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:34:36.014251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"90'18","reported_seq":60,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:59:25.049042+0000","last_change":"2024-06-02T23:57:56.539596+0000","last_active":"2024-06-02T23:59:25.049042+0000","last_peered":"2024-06-02T23:59:25.049042+0000","last_clean":"2024-06-02T23:59:25.049042+0000","last_became_active":"2024-06-02T23:57:56.532686+0000","last_became_peered":"2024-06-02T23:57:56.532686+0000","last_unstale":"2024-06-02T23:59:25.049042+0000","last_undegraded":"2024-06-02T23:59:25.049042+0000","last_fullsized":"2024-06-02T23:59:25.049042+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:29:24.691941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267369+0000","last_change":"2024-06-02T23:57:15.315657+0000","last_active":"2024-06-02T23:58:55.267369+0000","last_peered":"2024-06-02T23:58:55.267369+0000","last_clean":"2024-06-02T23:58:55.267369+0000","last_became_active":"2024-06-02T23:57:15.315293+0000","last_became_peered":"2024-06-02T23:57:15.315293+0000","last_unstale":"2024-06-02T23:58:55.267369+0000","last_undegraded":"2024-06-02T23:58:55.267369+0000","last_fullsized":"2024-06-02T23:58:55.267369+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:52:55.241379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.652229+0000","last_change":"2024-06-02T23:57:12.405664+0000","last_active":"2024-06-02T23:57:56.652229+0000","last_peered":"2024-06-02T23:57:56.652229+0000","last_clean":"2024-06-02T23:57:56.652229+0000","last_became_active":"2024-06-02T23:57:12.405281+0000","last_became_peered":"2024-06-02T23:57:12.405281+0000","last_unstale":"2024-06-02T23:57:56.652229+0000","last_undegraded":"2024-06-02T23:57:56.652229+0000","last_fullsized":"2024-06-02T23:57:56.652229+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:46:50.119466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273696+0000","last_change":"2024-06-02T23:57:15.318136+0000","last_active":"2024-06-02T23:58:55.273696+0000","last_peered":"2024-06-02T23:58:55.273696+0000","last_clean":"2024-06-02T23:58:55.273696+0000","last_became_active":"2024-06-02T23:57:15.317753+0000","last_became_peered":"2024-06-02T23:57:15.317753+0000","last_unstale":"2024-06-02T23:58:55.273696+0000","last_undegraded":"2024-06-02T23:58:55.273696+0000","last_fullsized":"2024-06-02T23:58:55.273696+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:35:11.025266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.887947+0000","last_change":"2024-06-02T23:57:12.305954+0000","last_active":"2024-06-02T23:57:56.887947+0000","last_peered":"2024-06-02T23:57:56.887947+0000","last_clean":"2024-06-02T23:57:56.887947+0000","last_became_active":"2024-06-02T23:57:12.305589+0000","last_became_peered":"2024-06-02T23:57:12.305589+0000","last_unstale":"2024-06-02T23:57:56.887947+0000","last_undegraded":"2024-06-02T23:57:56.887947+0000","last_fullsized":"2024-06-02T23:57:56.887947+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:34:34.178446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.243742+0000","last_change":"2024-06-02T23:57:15.327115+0000","last_active":"2024-06-02T23:58:55.243742+0000","last_peered":"2024-06-02T23:58:55.243742+0000","last_clean":"2024-06-02T23:58:55.243742+0000","last_became_active":"2024-06-02T23:57:15.326746+0000","last_became_peered":"2024-06-02T23:57:15.326746+0000","last_unstale":"2024-06-02T23:58:55.243742+0000","last_undegraded":"2024-06-02T23:58:55.243742+0000","last_fullsized":"2024-06-02T23:58:55.243742+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:08:04.340517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526250+0000","last_change":"2024-06-02T23:57:12.152933+0000","last_active":"2024-06-02T23:57:56.526250+0000","last_peered":"2024-06-02T23:57:56.526250+0000","last_clean":"2024-06-02T23:57:56.526250+0000","last_became_active":"2024-06-02T23:57:12.152453+0000","last_became_peered":"2024-06-02T23:57:12.152453+0000","last_unstale":"2024-06-02T23:57:56.526250+0000","last_undegraded":"2024-06-02T23:57:56.526250+0000","last_fullsized":"2024-06-02T23:57:56.526250+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:47:05.144374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272469+0000","last_change":"2024-06-02T23:57:15.326042+0000","last_active":"2024-06-02T23:58:55.272469+0000","last_peered":"2024-06-02T23:58:55.272469+0000","last_clean":"2024-06-02T23:58:55.272469+0000","last_became_active":"2024-06-02T23:57:15.325585+0000","last_became_peered":"2024-06-02T23:57:15.325585+0000","last_unstale":"2024-06-02T23:58:55.272469+0000","last_undegraded":"2024-06-02T23:58:55.272469+0000","last_fullsized":"2024-06-02T23:58:55.272469+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:40:37.305875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"88'3","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527211+0000","last_change":"2024-06-02T23:57:12.139155+0000","last_active":"2024-06-02T23:57:56.527211+0000","last_peered":"2024-06-02T23:57:56.527211+0000","last_clean":"2024-06-02T23:57:56.527211+0000","last_became_active":"2024-06-02T23:57:12.138732+0000","last_became_peered":"2024-06-02T23:57:12.138732+0000","last_unstale":"2024-06-02T23:57:56.527211+0000","last_undegraded":"2024-06-02T23:57:56.527211+0000","last_fullsized":"2024-06-02T23:57:56.527211+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:18:29.148439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265509+0000","last_change":"2024-06-02T23:57:15.319510+0000","last_active":"2024-06-02T23:58:55.265509+0000","last_peered":"2024-06-02T23:58:55.265509+0000","last_clean":"2024-06-02T23:58:55.265509+0000","last_became_active":"2024-06-02T23:57:15.319192+0000","last_became_peered":"2024-06-02T23:57:15.319192+0000","last_unstale":"2024-06-02T23:58:55.265509+0000","last_undegraded":"2024-06-02T23:58:55.265509+0000","last_fullsized":"2024-06-02T23:58:55.265509+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:04:04.241833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.658192+0000","last_change":"2024-06-02T23:57:56.657766+0000","last_active":"2024-06-02T23:57:56.658192+0000","last_peered":"2024-06-02T23:57:56.658192+0000","last_clean":"2024-06-02T23:57:56.658192+0000","last_became_active":"2024-06-02T23:57:56.653435+0000","last_became_peered":"2024-06-02T23:57:56.653435+0000","last_unstale":"2024-06-02T23:57:56.658192+0000","last_undegraded":"2024-06-02T23:57:56.658192+0000","last_fullsized":"2024-06-02T23:57:56.658192+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:03:23.594470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273925+0000","last_change":"2024-06-02T23:57:15.320837+0000","last_active":"2024-06-02T23:58:55.273925+0000","last_peered":"2024-06-02T23:58:55.273925+0000","last_clean":"2024-06-02T23:58:55.273925+0000","last_became_active":"2024-06-02T23:57:15.320257+0000","last_became_peered":"2024-06-02T23:57:15.320257+0000","last_unstale":"2024-06-02T23:58:55.273925+0000","last_undegraded":"2024-06-02T23:58:55.273925+0000","last_fullsized":"2024-06-02T23:58:55.273925+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:18:29.638614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'5","reported_seq":224,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:41.420775+0000","last_change":"2024-06-02T23:57:12.405175+0000","last_active":"2024-06-03T00:00:41.420775+0000","last_peered":"2024-06-03T00:00:41.420775+0000","last_clean":"2024-06-03T00:00:41.420775+0000","last_became_active":"2024-06-02T23:57:12.404767+0000","last_became_peered":"2024-06-02T23:57:12.404767+0000","last_unstale":"2024-06-03T00:00:41.420775+0000","last_undegraded":"2024-06-03T00:00:41.420775+0000","last_fullsized":"2024-06-03T00:00:41.420775+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:46:57.421288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":192,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273764+0000","last_change":"2024-06-02T23:57:15.322888+0000","last_active":"2024-06-02T23:58:55.273764+0000","last_peered":"2024-06-02T23:58:55.273764+0000","last_clean":"2024-06-02T23:58:55.273764+0000","last_became_active":"2024-06-02T23:57:15.321982+0000","last_became_peered":"2024-06-02T23:57:15.321982+0000","last_unstale":"2024-06-02T23:58:55.273764+0000","last_undegraded":"2024-06-02T23:58:55.273764+0000","last_fullsized":"2024-06-02T23:58:55.273764+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:51:57.253824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526189+0000","last_change":"2024-06-02T23:57:12.153715+0000","last_active":"2024-06-02T23:57:56.526189+0000","last_peered":"2024-06-02T23:57:56.526189+0000","last_clean":"2024-06-02T23:57:56.526189+0000","last_became_active":"2024-06-02T23:57:12.152544+0000","last_became_peered":"2024-06-02T23:57:12.152544+0000","last_unstale":"2024-06-02T23:57:56.526189+0000","last_undegraded":"2024-06-02T23:57:56.526189+0000","last_fullsized":"2024-06-02T23:57:56.526189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:51:05.874962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.271354+0000","last_change":"2024-06-02T23:57:15.318759+0000","last_active":"2024-06-02T23:58:55.271354+0000","last_peered":"2024-06-02T23:58:55.271354+0000","last_clean":"2024-06-02T23:58:55.271354+0000","last_became_active":"2024-06-02T23:57:15.317942+0000","last_became_peered":"2024-06-02T23:57:15.317942+0000","last_unstale":"2024-06-02T23:58:55.271354+0000","last_undegraded":"2024-06-02T23:58:55.271354+0000","last_fullsized":"2024-06-02T23:58:55.271354+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:39:44.142890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.894529+0000","last_change":"2024-06-02T23:57:56.894131+0000","last_active":"2024-06-02T23:57:56.894529+0000","last_peered":"2024-06-02T23:57:56.894529+0000","last_clean":"2024-06-02T23:57:56.894529+0000","last_became_active":"2024-06-02T23:57:56.889794+0000","last_became_peered":"2024-06-02T23:57:56.889794+0000","last_unstale":"2024-06-02T23:57:56.894529+0000","last_undegraded":"2024-06-02T23:57:56.894529+0000","last_fullsized":"2024-06-02T23:57:56.894529+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:02:41.670419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.266582+0000","last_change":"2024-06-02T23:57:15.324355+0000","last_active":"2024-06-02T23:58:55.266582+0000","last_peered":"2024-06-02T23:58:55.266582+0000","last_clean":"2024-06-02T23:58:55.266582+0000","last_became_active":"2024-06-02T23:57:15.324019+0000","last_became_peered":"2024-06-02T23:57:15.324019+0000","last_unstale":"2024-06-02T23:58:55.266582+0000","last_undegraded":"2024-06-02T23:58:55.266582+0000","last_fullsized":"2024-06-02T23:58:55.266582+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:27:01.927109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267246+0000","last_change":"2024-06-02T23:57:15.326420+0000","last_active":"2024-06-02T23:58:55.267246+0000","last_peered":"2024-06-02T23:58:55.267246+0000","last_clean":"2024-06-02T23:58:55.267246+0000","last_became_active":"2024-06-02T23:57:15.326091+0000","last_became_peered":"2024-06-02T23:57:15.326091+0000","last_unstale":"2024-06-02T23:58:55.267246+0000","last_undegraded":"2024-06-02T23:58:55.267246+0000","last_fullsized":"2024-06-02T23:58:55.267246+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:54:05.355352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.252717+0000","last_change":"2024-06-02T23:57:56.653297+0000","last_active":"2024-06-02T23:58:55.252717+0000","last_peered":"2024-06-02T23:58:55.252717+0000","last_clean":"2024-06-02T23:58:55.252717+0000","last_became_active":"2024-06-02T23:57:56.652874+0000","last_became_peered":"2024-06-02T23:57:56.652874+0000","last_unstale":"2024-06-02T23:58:55.252717+0000","last_undegraded":"2024-06-02T23:58:55.252717+0000","last_fullsized":"2024-06-02T23:58:55.252717+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:27:55.486382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.260044+0000","last_change":"2024-06-02T23:57:15.319266+0000","last_active":"2024-06-02T23:58:55.260044+0000","last_peered":"2024-06-02T23:58:55.260044+0000","last_clean":"2024-06-02T23:58:55.260044+0000","last_became_active":"2024-06-02T23:57:15.317468+0000","last_became_peered":"2024-06-02T23:57:15.317468+0000","last_unstale":"2024-06-02T23:58:55.260044+0000","last_undegraded":"2024-06-02T23:58:55.260044+0000","last_fullsized":"2024-06-02T23:58:55.260044+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:49:53.675524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273976+0000","last_change":"2024-06-02T23:57:15.315798+0000","last_active":"2024-06-02T23:58:55.273976+0000","last_peered":"2024-06-02T23:58:55.273976+0000","last_clean":"2024-06-02T23:58:55.273976+0000","last_became_active":"2024-06-02T23:57:15.314886+0000","last_became_peered":"2024-06-02T23:57:15.314886+0000","last_unstale":"2024-06-02T23:58:55.273976+0000","last_undegraded":"2024-06-02T23:58:55.273976+0000","last_fullsized":"2024-06-02T23:58:55.273976+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:23.042226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259255+0000","last_change":"2024-06-02T23:57:15.315081+0000","last_active":"2024-06-02T23:58:55.259255+0000","last_peered":"2024-06-02T23:58:55.259255+0000","last_clean":"2024-06-02T23:58:55.259255+0000","last_became_active":"2024-06-02T23:57:15.314745+0000","last_became_peered":"2024-06-02T23:57:15.314745+0000","last_unstale":"2024-06-02T23:58:55.259255+0000","last_undegraded":"2024-06-02T23:58:55.259255+0000","last_fullsized":"2024-06-02T23:58:55.259255+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:17:49.506950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.261978+0000","last_change":"2024-06-02T23:57:15.323687+0000","last_active":"2024-06-02T23:58:55.261978+0000","last_peered":"2024-06-02T23:58:55.261978+0000","last_clean":"2024-06-02T23:58:55.261978+0000","last_became_active":"2024-06-02T23:57:15.323345+0000","last_became_peered":"2024-06-02T23:57:15.323345+0000","last_unstale":"2024-06-02T23:58:55.261978+0000","last_undegraded":"2024-06-02T23:58:55.261978+0000","last_fullsized":"2024-06-02T23:58:55.261978+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:47:40.234811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265429+0000","last_change":"2024-06-02T23:57:15.320632+0000","last_active":"2024-06-02T23:58:55.265429+0000","last_peered":"2024-06-02T23:58:55.265429+0000","last_clean":"2024-06-02T23:58:55.265429+0000","last_became_active":"2024-06-02T23:57:15.318427+0000","last_became_peered":"2024-06-02T23:57:15.318427+0000","last_unstale":"2024-06-02T23:58:55.265429+0000","last_undegraded":"2024-06-02T23:58:55.265429+0000","last_fullsized":"2024-06-02T23:58:55.265429+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:04:51.729326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259261+0000","last_change":"2024-06-02T23:57:15.312039+0000","last_active":"2024-06-02T23:58:55.259261+0000","last_peered":"2024-06-02T23:58:55.259261+0000","last_clean":"2024-06-02T23:58:55.259261+0000","last_became_active":"2024-06-02T23:57:15.311275+0000","last_became_peered":"2024-06-02T23:57:15.311275+0000","last_unstale":"2024-06-02T23:58:55.259261+0000","last_undegraded":"2024-06-02T23:58:55.259261+0000","last_fullsized":"2024-06-02T23:58:55.259261+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:50:25.509550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259813+0000","last_change":"2024-06-02T23:57:15.311927+0000","last_active":"2024-06-02T23:58:55.259813+0000","last_peered":"2024-06-02T23:58:55.259813+0000","last_clean":"2024-06-02T23:58:55.259813+0000","last_became_active":"2024-06-02T23:57:15.311484+0000","last_became_peered":"2024-06-02T23:57:15.311484+0000","last_unstale":"2024-06-02T23:58:55.259813+0000","last_undegraded":"2024-06-02T23:58:55.259813+0000","last_fullsized":"2024-06-02T23:58:55.259813+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:29:27.789219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268648+0000","last_change":"2024-06-02T23:57:15.321218+0000","last_active":"2024-06-02T23:58:55.268648+0000","last_peered":"2024-06-02T23:58:55.268648+0000","last_clean":"2024-06-02T23:58:55.268648+0000","last_became_active":"2024-06-02T23:57:15.320884+0000","last_became_peered":"2024-06-02T23:57:15.320884+0000","last_unstale":"2024-06-02T23:58:55.268648+0000","last_undegraded":"2024-06-02T23:58:55.268648+0000","last_fullsized":"2024-06-02T23:58:55.268648+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:57:20.583655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.270664+0000","last_change":"2024-06-02T23:57:15.315213+0000","last_active":"2024-06-02T23:58:55.270664+0000","last_peered":"2024-06-02T23:58:55.270664+0000","last_clean":"2024-06-02T23:58:55.270664+0000","last_became_active":"2024-06-02T23:57:15.314050+0000","last_became_peered":"2024-06-02T23:57:15.314050+0000","last_unstale":"2024-06-02T23:58:55.270664+0000","last_undegraded":"2024-06-02T23:58:55.270664+0000","last_fullsized":"2024-06-02T23:58:55.270664+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:35.214351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265435+0000","last_change":"2024-06-02T23:57:15.313901+0000","last_active":"2024-06-02T23:58:55.265435+0000","last_peered":"2024-06-02T23:58:55.265435+0000","last_clean":"2024-06-02T23:58:55.265435+0000","last_became_active":"2024-06-02T23:57:15.313452+0000","last_became_peered":"2024-06-02T23:57:15.313452+0000","last_unstale":"2024-06-02T23:58:55.265435+0000","last_undegraded":"2024-06-02T23:58:55.265435+0000","last_fullsized":"2024-06-02T23:58:55.265435+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:41:38.366741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.263989+0000","last_change":"2024-06-02T23:57:15.323660+0000","last_active":"2024-06-02T23:58:55.263989+0000","last_peered":"2024-06-02T23:58:55.263989+0000","last_clean":"2024-06-02T23:58:55.263989+0000","last_became_active":"2024-06-02T23:57:15.323316+0000","last_became_peered":"2024-06-02T23:57:15.323316+0000","last_unstale":"2024-06-02T23:58:55.263989+0000","last_undegraded":"2024-06-02T23:58:55.263989+0000","last_fullsized":"2024-06-02T23:58:55.263989+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:33:10.245563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74439,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1950,"num_read_kb":1056,"num_write":263,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":223317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383738,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":480586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645375,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28680,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716472,"statfs":{"total":95995035648,"available":95965667328,"internally_reserved":0,"allocated":1703936,"data_stored":1139101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808901,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1019904,"data_stored":480516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070537,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":480894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332174,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28592,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716560,"statfs":{"total":95995035648,"available":95965757440,"internally_reserved":0,"allocated":1613824,"data_stored":1073860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495700,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":1003520,"data_stored":480233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574957,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1073152,"data_stored":548324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738482,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40496,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704656,"statfs":{"total":95995035648,"available":95953567744,"internally_reserved":0,"allocated":1024000,"data_stored":481572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411432,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32244,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712908,"statfs":{"total":95995035648,"available":95962017792,"internally_reserved":0,"allocated":1093632,"data_stored":549075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182499,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":480058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":480402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757337,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28604,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716548,"statfs":{"total":95995035648,"available":95965745152,"internally_reserved":0,"allocated":1626112,"data_stored":1073230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":69222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-03T00:00:47.665 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-06-03T00:00:47.665 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-06-03T00:00:47.915 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:00:48.289 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:48 smithi049 ceph-mon[32302]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-03T00:00:48.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:48 smithi057 ceph-mon[36457]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-03T00:00:48.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:48 smithi107 ceph-mon[37048]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-03T00:00:49.343 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:49 smithi049 ceph-mon[32302]: pgmap v406: 97 pgs: 97 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-06-03T00:00:49.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:49 smithi057 ceph-mon[36457]: pgmap v406: 97 pgs: 97 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-06-03T00:00:49.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.591+0000 7f484bd8f700 1 -- 172.21.15.49:0/4000150845 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4844101d50 msgr2=0x7f484410e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:49.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.591+0000 7f484bd8f700 1 --2- 172.21.15.49:0/4000150845 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4844101d50 0x7f484410e240 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f483c00b0a0 tx=0x7f483c00b3b0 comp rx=0 tx=0).stop 2024-06-03T00:00:49.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.591+0000 7f484bd8f700 1 -- 172.21.15.49:0/4000150845 shutdown_connections 2024-06-03T00:00:49.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.591+0000 7f484bd8f700 1 --2- 172.21.15.49:0/4000150845 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4844101d50 0x7f484410e240 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:49.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.591+0000 7f484bd8f700 1 --2- 172.21.15.49:0/4000150845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4844107400 0x7f48441077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:49.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.591+0000 7f484bd8f700 1 --2- 172.21.15.49:0/4000150845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4844101390 0x7f4844101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:49.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.591+0000 7f484bd8f700 1 -- 172.21.15.49:0/4000150845 >> 172.21.15.49:0/4000150845 conn(0x7f4844078340 msgr2=0x7f4844078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:49.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.591+0000 7f484bd8f700 1 -- 172.21.15.49:0/4000150845 shutdown_connections 2024-06-03T00:00:49.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.591+0000 7f484bd8f700 1 -- 172.21.15.49:0/4000150845 wait complete. 2024-06-03T00:00:49.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.592+0000 7f484bd8f700 1 Processor -- start 2024-06-03T00:00:49.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.592+0000 7f484bd8f700 1 -- start start 2024-06-03T00:00:49.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.592+0000 7f484bd8f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4844101390 0x7f484419e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:49.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.592+0000 7f484bd8f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4844101d50 0x7f484419ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:49.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.592+0000 7f484bd8f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4844107400 0x7f4844198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:49.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.592+0000 7f484bd8f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f48441127f0 con 0x7f4844101d50 2024-06-03T00:00:49.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.592+0000 7f484bd8f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f4844112670 con 0x7f4844101390 2024-06-03T00:00:49.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.592+0000 7f484bd8f700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4844112970 con 0x7f4844107400 2024-06-03T00:00:49.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.592+0000 7f484932a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4844101d50 0x7f484419ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:49.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.592+0000 7f484932a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4844101d50 0x7f484419ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50370/0 (socket says 172.21.15.49:50370) 2024-06-03T00:00:49.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.592+0000 7f484932a700 1 -- 172.21.15.49:0/1044718390 learned_addr learned my addr 172.21.15.49:0/1044718390 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:49.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.592+0000 7f4849b2b700 1 --2- 172.21.15.49:0/1044718390 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4844101390 0x7f484419e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:49.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.592+0000 7f484a32c700 1 --2- 172.21.15.49:0/1044718390 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4844107400 0x7f4844198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:49.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.593+0000 7f484932a700 1 -- 172.21.15.49:0/1044718390 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4844107400 msgr2=0x7f4844198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:49.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.593+0000 7f484932a700 1 --2- 172.21.15.49:0/1044718390 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4844107400 0x7f4844198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:49.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.593+0000 7f484932a700 1 -- 172.21.15.49:0/1044718390 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4844101390 msgr2=0x7f484419e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:49.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.593+0000 7f484932a700 1 --2- 172.21.15.49:0/1044718390 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4844101390 0x7f484419e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:49.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.593+0000 7f484932a700 1 -- 172.21.15.49:0/1044718390 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4844199170 con 0x7f4844101d50 2024-06-03T00:00:49.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.593+0000 7f484932a700 1 --2- 172.21.15.49:0/1044718390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4844101d50 0x7f484419ed90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f483400d950 tx=0x7f483400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:49.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.593+0000 7f483affd700 1 -- 172.21.15.49:0/1044718390 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4834016070 con 0x7f4844101d50 2024-06-03T00:00:49.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.593+0000 7f484bd8f700 1 -- 172.21.15.49:0/1044718390 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4844199460 con 0x7f4844101d50 2024-06-03T00:00:49.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.593+0000 7f483affd700 1 -- 172.21.15.49:0/1044718390 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f483400fd70 con 0x7f4844101d50 2024-06-03T00:00:49.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.593+0000 7f483affd700 1 -- 172.21.15.49:0/1044718390 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483400e610 con 0x7f4844101d50 2024-06-03T00:00:49.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.593+0000 7f484bd8f700 1 -- 172.21.15.49:0/1044718390 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48441a5720 con 0x7f4844101d50 2024-06-03T00:00:49.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.594+0000 7f484bd8f700 1 -- 172.21.15.49:0/1044718390 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4844102ab0 con 0x7f4844101d50 2024-06-03T00:00:49.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.596+0000 7f483affd700 1 -- 172.21.15.49:0/1044718390 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4834019070 con 0x7f4844101d50 2024-06-03T00:00:49.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.597+0000 7f483affd700 1 --2- 172.21.15.49:0/1044718390 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f48300a2ca0 0x7f48300a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:49.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.597+0000 7f4849b2b700 1 --2- 172.21.15.49:0/1044718390 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f48300a2ca0 0x7f48300a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:49.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.597+0000 7f483affd700 1 -- 172.21.15.49:0/1044718390 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f48340ceb30 con 0x7f4844101d50 2024-06-03T00:00:49.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.597+0000 7f4849b2b700 1 --2- 172.21.15.49:0/1044718390 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f48300a2ca0 0x7f48300a5160 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4844199b50 tx=0x7f484000b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:49.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:49 smithi107 ceph-mon[37048]: pgmap v406: 97 pgs: 97 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-06-03T00:00:49.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.600+0000 7f483affd700 1 -- 172.21.15.49:0/1044718390 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f483409ba90 con 0x7f4844101d50 2024-06-03T00:00:49.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.803+0000 7f484bd8f700 1 -- 172.21.15.49:0/1044718390 --> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f48440628d0 con 0x7f48300a2ca0 2024-06-03T00:00:49.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.810+0000 7f483affd700 1 -- 172.21.15.49:0/1044718390 <== mgr.14152 v2:172.21.15.49:6800/2948657177 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258893 (secure 0 0 0) 0x7f48440628d0 con 0x7f48300a2ca0 2024-06-03T00:00:49.814 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:00:49.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.814+0000 7f484bd8f700 1 -- 172.21.15.49:0/1044718390 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f48300a2ca0 msgr2=0x7f48300a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:49.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.814+0000 7f484bd8f700 1 --2- 172.21.15.49:0/1044718390 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f48300a2ca0 0x7f48300a5160 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4844199b50 tx=0x7f484000b3c0 comp rx=0 tx=0).stop 2024-06-03T00:00:49.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.814+0000 7f484bd8f700 1 -- 172.21.15.49:0/1044718390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4844101d50 msgr2=0x7f484419ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:49.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.814+0000 7f484bd8f700 1 --2- 172.21.15.49:0/1044718390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4844101d50 0x7f484419ed90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f483400d950 tx=0x7f483400dc60 comp rx=0 tx=0).stop 2024-06-03T00:00:49.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.814+0000 7f484bd8f700 1 -- 172.21.15.49:0/1044718390 shutdown_connections 2024-06-03T00:00:49.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.814+0000 7f484bd8f700 1 --2- 172.21.15.49:0/1044718390 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f48300a2ca0 0x7f48300a5160 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:49.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.814+0000 7f484bd8f700 1 --2- 172.21.15.49:0/1044718390 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4844107400 0x7f4844198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:49.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.814+0000 7f484bd8f700 1 --2- 172.21.15.49:0/1044718390 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4844101390 0x7f484419e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:49.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.814+0000 7f484bd8f700 1 --2- 172.21.15.49:0/1044718390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4844101d50 0x7f484419ed90 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:49.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.814+0000 7f484bd8f700 1 -- 172.21.15.49:0/1044718390 >> 172.21.15.49:0/1044718390 conn(0x7f4844078340 msgr2=0x7f4844100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:49.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.815+0000 7f484bd8f700 1 -- 172.21.15.49:0/1044718390 shutdown_connections 2024-06-03T00:00:49.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:49.815+0000 7f484bd8f700 1 -- 172.21.15.49:0/1044718390 wait complete. 2024-06-03T00:00:49.817 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-06-03T00:00:50.504 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":407,"stamp":"2024-06-03T00:00:49.291517+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665041,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":2116,"num_read_kb":1185,"num_write":446,"num_write_kb":3094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":1180736,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":864,"ondisk_log_size":864,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375492,"kb_used_data":13860,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124566332,"statfs":{"total":1151940427776,"available":1151555923968,"internally_reserved":0,"allocated":14192640,"data_stored":7747851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":57,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003140"},"pg_stats":[{"pgid":"3.3f","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.275149+0000","last_change":"2024-06-02T23:57:15.321542+0000","last_active":"2024-06-02T23:58:55.275149+0000","last_peered":"2024-06-02T23:58:55.275149+0000","last_clean":"2024-06-02T23:58:55.275149+0000","last_became_active":"2024-06-02T23:57:15.321129+0000","last_became_peered":"2024-06-02T23:57:15.321129+0000","last_unstale":"2024-06-02T23:58:55.275149+0000","last_undegraded":"2024-06-02T23:58:55.275149+0000","last_fullsized":"2024-06-02T23:58:55.275149+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:35:50.218316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272859+0000","last_change":"2024-06-02T23:57:15.327432+0000","last_active":"2024-06-02T23:58:55.272859+0000","last_peered":"2024-06-02T23:58:55.272859+0000","last_clean":"2024-06-02T23:58:55.272859+0000","last_became_active":"2024-06-02T23:57:15.326759+0000","last_became_peered":"2024-06-02T23:57:15.326759+0000","last_unstale":"2024-06-02T23:58:55.272859+0000","last_undegraded":"2024-06-02T23:58:55.272859+0000","last_fullsized":"2024-06-02T23:58:55.272859+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:42:20.473216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.274694+0000","last_change":"2024-06-02T23:57:15.323721+0000","last_active":"2024-06-02T23:58:55.274694+0000","last_peered":"2024-06-02T23:58:55.274694+0000","last_clean":"2024-06-02T23:58:55.274694+0000","last_became_active":"2024-06-02T23:57:15.321277+0000","last_became_peered":"2024-06-02T23:57:15.321277+0000","last_unstale":"2024-06-02T23:58:55.274694+0000","last_undegraded":"2024-06-02T23:58:55.274694+0000","last_fullsized":"2024-06-02T23:58:55.274694+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:34:31.667999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.258319+0000","last_change":"2024-06-02T23:57:15.323769+0000","last_active":"2024-06-02T23:58:55.258319+0000","last_peered":"2024-06-02T23:58:55.258319+0000","last_clean":"2024-06-02T23:58:55.258319+0000","last_became_active":"2024-06-02T23:57:15.323406+0000","last_became_peered":"2024-06-02T23:57:15.323406+0000","last_unstale":"2024-06-02T23:58:55.258319+0000","last_undegraded":"2024-06-02T23:58:55.258319+0000","last_fullsized":"2024-06-02T23:58:55.258319+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:51:27.456210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.258510+0000","last_change":"2024-06-02T23:57:56.531404+0000","last_active":"2024-06-02T23:58:55.258510+0000","last_peered":"2024-06-02T23:58:55.258510+0000","last_clean":"2024-06-02T23:58:55.258510+0000","last_became_active":"2024-06-02T23:57:56.530952+0000","last_became_peered":"2024-06-02T23:57:56.530952+0000","last_unstale":"2024-06-02T23:58:55.258510+0000","last_undegraded":"2024-06-02T23:58:55.258510+0000","last_fullsized":"2024-06-02T23:58:55.258510+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:39:30.405113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268533+0000","last_change":"2024-06-02T23:57:15.320843+0000","last_active":"2024-06-02T23:58:55.268533+0000","last_peered":"2024-06-02T23:58:55.268533+0000","last_clean":"2024-06-02T23:58:55.268533+0000","last_became_active":"2024-06-02T23:57:15.320472+0000","last_became_peered":"2024-06-02T23:57:15.320472+0000","last_unstale":"2024-06-02T23:58:55.268533+0000","last_undegraded":"2024-06-02T23:58:55.268533+0000","last_fullsized":"2024-06-02T23:58:55.268533+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:49:02.620777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.271511+0000","last_change":"2024-06-02T23:57:15.321799+0000","last_active":"2024-06-02T23:58:55.271511+0000","last_peered":"2024-06-02T23:58:55.271511+0000","last_clean":"2024-06-02T23:58:55.271511+0000","last_became_active":"2024-06-02T23:57:15.321379+0000","last_became_peered":"2024-06-02T23:57:15.321379+0000","last_unstale":"2024-06-02T23:58:55.271511+0000","last_undegraded":"2024-06-02T23:58:55.271511+0000","last_fullsized":"2024-06-02T23:58:55.271511+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:36:56.404936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268859+0000","last_change":"2024-06-02T23:57:15.318771+0000","last_active":"2024-06-02T23:58:55.268859+0000","last_peered":"2024-06-02T23:58:55.268859+0000","last_clean":"2024-06-02T23:58:55.268859+0000","last_became_active":"2024-06-02T23:57:15.318420+0000","last_became_peered":"2024-06-02T23:57:15.318420+0000","last_unstale":"2024-06-02T23:58:55.268859+0000","last_undegraded":"2024-06-02T23:58:55.268859+0000","last_fullsized":"2024-06-02T23:58:55.268859+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:07:53.769443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.274516+0000","last_change":"2024-06-02T23:57:15.318989+0000","last_active":"2024-06-02T23:58:55.274516+0000","last_peered":"2024-06-02T23:58:55.274516+0000","last_clean":"2024-06-02T23:58:55.274516+0000","last_became_active":"2024-06-02T23:57:15.318424+0000","last_became_peered":"2024-06-02T23:57:15.318424+0000","last_unstale":"2024-06-02T23:58:55.274516+0000","last_undegraded":"2024-06-02T23:58:55.274516+0000","last_fullsized":"2024-06-02T23:58:55.274516+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:30:47.634662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265217+0000","last_change":"2024-06-02T23:57:15.326251+0000","last_active":"2024-06-02T23:58:55.265217+0000","last_peered":"2024-06-02T23:58:55.265217+0000","last_clean":"2024-06-02T23:58:55.265217+0000","last_became_active":"2024-06-02T23:57:15.325890+0000","last_became_peered":"2024-06-02T23:57:15.325890+0000","last_unstale":"2024-06-02T23:58:55.265217+0000","last_undegraded":"2024-06-02T23:58:55.265217+0000","last_fullsized":"2024-06-02T23:58:55.265217+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:18:54.871410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.274001+0000","last_change":"2024-06-02T23:57:15.325364+0000","last_active":"2024-06-02T23:58:55.274001+0000","last_peered":"2024-06-02T23:58:55.274001+0000","last_clean":"2024-06-02T23:58:55.274001+0000","last_became_active":"2024-06-02T23:57:15.324987+0000","last_became_peered":"2024-06-02T23:57:15.324987+0000","last_unstale":"2024-06-02T23:58:55.274001+0000","last_undegraded":"2024-06-02T23:58:55.274001+0000","last_fullsized":"2024-06-02T23:58:55.274001+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:59:11.827263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265434+0000","last_change":"2024-06-02T23:57:15.328027+0000","last_active":"2024-06-02T23:58:55.265434+0000","last_peered":"2024-06-02T23:58:55.265434+0000","last_clean":"2024-06-02T23:58:55.265434+0000","last_became_active":"2024-06-02T23:57:15.327608+0000","last_became_peered":"2024-06-02T23:57:15.327608+0000","last_unstale":"2024-06-02T23:58:55.265434+0000","last_undegraded":"2024-06-02T23:58:55.265434+0000","last_fullsized":"2024-06-02T23:58:55.265434+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:09:42.152689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262861+0000","last_change":"2024-06-02T23:57:15.323095+0000","last_active":"2024-06-02T23:58:55.262861+0000","last_peered":"2024-06-02T23:58:55.262861+0000","last_clean":"2024-06-02T23:58:55.262861+0000","last_became_active":"2024-06-02T23:57:15.322755+0000","last_became_peered":"2024-06-02T23:57:15.322755+0000","last_unstale":"2024-06-02T23:58:55.262861+0000","last_undegraded":"2024-06-02T23:58:55.262861+0000","last_fullsized":"2024-06-02T23:58:55.262861+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:43:53.195192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272339+0000","last_change":"2024-06-02T23:57:15.327437+0000","last_active":"2024-06-02T23:58:55.272339+0000","last_peered":"2024-06-02T23:58:55.272339+0000","last_clean":"2024-06-02T23:58:55.272339+0000","last_became_active":"2024-06-02T23:57:15.326974+0000","last_became_peered":"2024-06-02T23:57:15.326974+0000","last_unstale":"2024-06-02T23:58:55.272339+0000","last_undegraded":"2024-06-02T23:58:55.272339+0000","last_fullsized":"2024-06-02T23:58:55.272339+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:20:44.978213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273334+0000","last_change":"2024-06-02T23:57:15.325414+0000","last_active":"2024-06-02T23:58:55.273334+0000","last_peered":"2024-06-02T23:58:55.273334+0000","last_clean":"2024-06-02T23:58:55.273334+0000","last_became_active":"2024-06-02T23:57:15.325033+0000","last_became_peered":"2024-06-02T23:57:15.325033+0000","last_unstale":"2024-06-02T23:58:55.273334+0000","last_undegraded":"2024-06-02T23:58:55.273334+0000","last_fullsized":"2024-06-02T23:58:55.273334+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:27:14.536646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272688+0000","last_change":"2024-06-02T23:57:15.315833+0000","last_active":"2024-06-02T23:58:55.272688+0000","last_peered":"2024-06-02T23:58:55.272688+0000","last_clean":"2024-06-02T23:58:55.272688+0000","last_became_active":"2024-06-02T23:57:15.315355+0000","last_became_peered":"2024-06-02T23:57:15.315355+0000","last_unstale":"2024-06-02T23:58:55.272688+0000","last_undegraded":"2024-06-02T23:58:55.272688+0000","last_fullsized":"2024-06-02T23:58:55.272688+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:52:05.915828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.275143+0000","last_change":"2024-06-02T23:57:15.322407+0000","last_active":"2024-06-02T23:58:55.275143+0000","last_peered":"2024-06-02T23:58:55.275143+0000","last_clean":"2024-06-02T23:58:55.275143+0000","last_became_active":"2024-06-02T23:57:15.322090+0000","last_became_peered":"2024-06-02T23:57:15.322090+0000","last_unstale":"2024-06-02T23:58:55.275143+0000","last_undegraded":"2024-06-02T23:58:55.275143+0000","last_fullsized":"2024-06-02T23:58:55.275143+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:08:48.071192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268594+0000","last_change":"2024-06-02T23:57:15.327331+0000","last_active":"2024-06-02T23:58:55.268594+0000","last_peered":"2024-06-02T23:58:55.268594+0000","last_clean":"2024-06-02T23:58:55.268594+0000","last_became_active":"2024-06-02T23:57:15.326863+0000","last_became_peered":"2024-06-02T23:57:15.326863+0000","last_unstale":"2024-06-02T23:58:55.268594+0000","last_undegraded":"2024-06-02T23:58:55.268594+0000","last_fullsized":"2024-06-02T23:58:55.268594+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:45:05.443751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.261047+0000","last_change":"2024-06-02T23:57:15.313008+0000","last_active":"2024-06-02T23:58:55.261047+0000","last_peered":"2024-06-02T23:58:55.261047+0000","last_clean":"2024-06-02T23:58:55.261047+0000","last_became_active":"2024-06-02T23:57:15.312322+0000","last_became_peered":"2024-06-02T23:57:15.312322+0000","last_unstale":"2024-06-02T23:58:55.261047+0000","last_undegraded":"2024-06-02T23:58:55.261047+0000","last_fullsized":"2024-06-02T23:58:55.261047+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:54:03.744964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":233,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:43.426945+0000","last_change":"2024-06-02T23:57:12.153410+0000","last_active":"2024-06-03T00:00:43.426945+0000","last_peered":"2024-06-03T00:00:43.426945+0000","last_clean":"2024-06-03T00:00:43.426945+0000","last_became_active":"2024-06-02T23:57:12.153065+0000","last_became_peered":"2024-06-02T23:57:12.153065+0000","last_unstale":"2024-06-03T00:00:43.426945+0000","last_undegraded":"2024-06-03T00:00:43.426945+0000","last_fullsized":"2024-06-03T00:00:43.426945+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:45:30.058961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":194,"num_read_kb":194,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.258496+0000","last_change":"2024-06-02T23:57:15.314168+0000","last_active":"2024-06-02T23:58:55.258496+0000","last_peered":"2024-06-02T23:58:55.258496+0000","last_clean":"2024-06-02T23:58:55.258496+0000","last_became_active":"2024-06-02T23:57:15.313838+0000","last_became_peered":"2024-06-02T23:57:15.313838+0000","last_unstale":"2024-06-02T23:58:55.258496+0000","last_undegraded":"2024-06-02T23:58:55.258496+0000","last_fullsized":"2024-06-02T23:58:55.258496+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:56:14.137471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526742+0000","last_change":"2024-06-02T23:57:12.305448+0000","last_active":"2024-06-02T23:57:56.526742+0000","last_peered":"2024-06-02T23:57:56.526742+0000","last_clean":"2024-06-02T23:57:56.526742+0000","last_became_active":"2024-06-02T23:57:12.305080+0000","last_became_peered":"2024-06-02T23:57:12.305080+0000","last_unstale":"2024-06-02T23:57:56.526742+0000","last_undegraded":"2024-06-02T23:57:56.526742+0000","last_fullsized":"2024-06-02T23:57:56.526742+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:20:18.660943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.275386+0000","last_change":"2024-06-02T23:57:15.321660+0000","last_active":"2024-06-02T23:58:55.275386+0000","last_peered":"2024-06-02T23:58:55.275386+0000","last_clean":"2024-06-02T23:58:55.275386+0000","last_became_active":"2024-06-02T23:57:15.321304+0000","last_became_peered":"2024-06-02T23:57:15.321304+0000","last_unstale":"2024-06-02T23:58:55.275386+0000","last_undegraded":"2024-06-02T23:58:55.275386+0000","last_fullsized":"2024-06-02T23:58:55.275386+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:10:10.933291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:58.169787+0000","last_change":"2024-06-02T23:57:56.544458+0000","last_active":"2024-06-02T23:57:58.169787+0000","last_peered":"2024-06-02T23:57:58.169787+0000","last_clean":"2024-06-02T23:57:58.169787+0000","last_became_active":"2024-06-02T23:57:56.532838+0000","last_became_peered":"2024-06-02T23:57:56.532838+0000","last_unstale":"2024-06-02T23:57:58.169787+0000","last_undegraded":"2024-06-02T23:57:58.169787+0000","last_fullsized":"2024-06-02T23:57:58.169787+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:27:44.700493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272537+0000","last_change":"2024-06-02T23:57:15.328944+0000","last_active":"2024-06-02T23:58:55.272537+0000","last_peered":"2024-06-02T23:58:55.272537+0000","last_clean":"2024-06-02T23:58:55.272537+0000","last_became_active":"2024-06-02T23:57:15.328531+0000","last_became_peered":"2024-06-02T23:57:15.328531+0000","last_unstale":"2024-06-02T23:58:55.272537+0000","last_undegraded":"2024-06-02T23:58:55.272537+0000","last_fullsized":"2024-06-02T23:58:55.272537+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:48:19.709989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528536+0000","last_change":"2024-06-02T23:57:12.153967+0000","last_active":"2024-06-02T23:57:56.528536+0000","last_peered":"2024-06-02T23:57:56.528536+0000","last_clean":"2024-06-02T23:57:56.528536+0000","last_became_active":"2024-06-02T23:57:12.153600+0000","last_became_peered":"2024-06-02T23:57:12.153600+0000","last_unstale":"2024-06-02T23:57:56.528536+0000","last_undegraded":"2024-06-02T23:57:56.528536+0000","last_fullsized":"2024-06-02T23:57:56.528536+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:47:58.761573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267401+0000","last_change":"2024-06-02T23:57:15.318089+0000","last_active":"2024-06-02T23:58:55.267401+0000","last_peered":"2024-06-02T23:58:55.267401+0000","last_clean":"2024-06-02T23:58:55.267401+0000","last_became_active":"2024-06-02T23:57:15.316494+0000","last_became_peered":"2024-06-02T23:57:15.316494+0000","last_unstale":"2024-06-02T23:58:55.267401+0000","last_undegraded":"2024-06-02T23:58:55.267401+0000","last_fullsized":"2024-06-02T23:58:55.267401+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:21:15.839255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"90'7","reported_seq":234,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:47.428932+0000","last_change":"2024-06-02T23:57:12.153624+0000","last_active":"2024-06-03T00:00:47.428932+0000","last_peered":"2024-06-03T00:00:47.428932+0000","last_clean":"2024-06-03T00:00:47.428932+0000","last_became_active":"2024-06-02T23:57:12.152712+0000","last_became_peered":"2024-06-02T23:57:12.152712+0000","last_unstale":"2024-06-03T00:00:47.428932+0000","last_undegraded":"2024-06-03T00:00:47.428932+0000","last_fullsized":"2024-06-03T00:00:47.428932+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:14:50.236213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":200,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259432+0000","last_change":"2024-06-02T23:57:15.325293+0000","last_active":"2024-06-02T23:58:55.259432+0000","last_peered":"2024-06-02T23:58:55.259432+0000","last_clean":"2024-06-02T23:58:55.259432+0000","last_became_active":"2024-06-02T23:57:15.324967+0000","last_became_peered":"2024-06-02T23:57:15.324967+0000","last_unstale":"2024-06-02T23:58:55.259432+0000","last_undegraded":"2024-06-02T23:58:55.259432+0000","last_fullsized":"2024-06-02T23:58:55.259432+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:21:23.634118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.735981+0000","last_change":"2024-06-02T23:57:12.155927+0000","last_active":"2024-06-02T23:57:56.735981+0000","last_peered":"2024-06-02T23:57:56.735981+0000","last_clean":"2024-06-02T23:57:56.735981+0000","last_became_active":"2024-06-02T23:57:12.155505+0000","last_became_peered":"2024-06-02T23:57:12.155505+0000","last_unstale":"2024-06-02T23:57:56.735981+0000","last_undegraded":"2024-06-02T23:57:56.735981+0000","last_fullsized":"2024-06-02T23:57:56.735981+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:47.555747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262458+0000","last_change":"2024-06-02T23:57:15.321796+0000","last_active":"2024-06-02T23:58:55.262458+0000","last_peered":"2024-06-02T23:58:55.262458+0000","last_clean":"2024-06-02T23:58:55.262458+0000","last_became_active":"2024-06-02T23:57:15.320850+0000","last_became_peered":"2024-06-02T23:57:15.320850+0000","last_unstale":"2024-06-02T23:58:55.262458+0000","last_undegraded":"2024-06-02T23:58:55.262458+0000","last_fullsized":"2024-06-02T23:58:55.262458+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:04:10.991920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.523859+0000","last_change":"2024-06-02T23:57:12.146589+0000","last_active":"2024-06-02T23:57:56.523859+0000","last_peered":"2024-06-02T23:57:56.523859+0000","last_clean":"2024-06-02T23:57:56.523859+0000","last_became_active":"2024-06-02T23:57:12.146224+0000","last_became_peered":"2024-06-02T23:57:12.146224+0000","last_unstale":"2024-06-02T23:57:56.523859+0000","last_undegraded":"2024-06-02T23:57:56.523859+0000","last_fullsized":"2024-06-02T23:57:56.523859+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:17:31.250585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268843+0000","last_change":"2024-06-02T23:57:15.315553+0000","last_active":"2024-06-02T23:58:55.268843+0000","last_peered":"2024-06-02T23:58:55.268843+0000","last_clean":"2024-06-02T23:58:55.268843+0000","last_became_active":"2024-06-02T23:57:15.315217+0000","last_became_peered":"2024-06-02T23:57:15.315217+0000","last_unstale":"2024-06-02T23:58:55.268843+0000","last_undegraded":"2024-06-02T23:58:55.268843+0000","last_fullsized":"2024-06-02T23:58:55.268843+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:00:23.097949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.525158+0000","last_change":"2024-06-02T23:57:12.156971+0000","last_active":"2024-06-02T23:57:56.525158+0000","last_peered":"2024-06-02T23:57:56.525158+0000","last_clean":"2024-06-02T23:57:56.525158+0000","last_became_active":"2024-06-02T23:57:12.156379+0000","last_became_peered":"2024-06-02T23:57:12.156379+0000","last_unstale":"2024-06-02T23:57:56.525158+0000","last_undegraded":"2024-06-02T23:57:56.525158+0000","last_fullsized":"2024-06-02T23:57:56.525158+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:28:50.057736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.266692+0000","last_change":"2024-06-02T23:57:15.313985+0000","last_active":"2024-06-02T23:58:55.266692+0000","last_peered":"2024-06-02T23:58:55.266692+0000","last_clean":"2024-06-02T23:58:55.266692+0000","last_became_active":"2024-06-02T23:57:15.313668+0000","last_became_peered":"2024-06-02T23:57:15.313668+0000","last_unstale":"2024-06-02T23:58:55.266692+0000","last_undegraded":"2024-06-02T23:58:55.266692+0000","last_fullsized":"2024-06-02T23:58:55.266692+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:10:56.560660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"90'5","reported_seq":420,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.427025+0000","last_change":"2024-06-02T23:57:12.156025+0000","last_active":"2024-06-03T00:00:46.427025+0000","last_peered":"2024-06-03T00:00:46.427025+0000","last_clean":"2024-06-03T00:00:46.427025+0000","last_became_active":"2024-06-02T23:57:12.155609+0000","last_became_peered":"2024-06-02T23:57:12.155609+0000","last_unstale":"2024-06-03T00:00:46.427025+0000","last_undegraded":"2024-06-03T00:00:46.427025+0000","last_fullsized":"2024-06-03T00:00:46.427025+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:27:48.953456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":388,"num_read_kb":388,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272606+0000","last_change":"2024-06-02T23:57:15.329711+0000","last_active":"2024-06-02T23:58:55.272606+0000","last_peered":"2024-06-02T23:58:55.272606+0000","last_clean":"2024-06-02T23:58:55.272606+0000","last_became_active":"2024-06-02T23:57:15.329284+0000","last_became_peered":"2024-06-02T23:57:15.329284+0000","last_unstale":"2024-06-02T23:58:55.272606+0000","last_undegraded":"2024-06-02T23:58:55.272606+0000","last_fullsized":"2024-06-02T23:58:55.272606+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:58:06.165152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.529073+0000","last_change":"2024-06-02T23:57:12.156949+0000","last_active":"2024-06-02T23:57:56.529073+0000","last_peered":"2024-06-02T23:57:56.529073+0000","last_clean":"2024-06-02T23:57:56.529073+0000","last_became_active":"2024-06-02T23:57:12.156558+0000","last_became_peered":"2024-06-02T23:57:12.156558+0000","last_unstale":"2024-06-02T23:57:56.529073+0000","last_undegraded":"2024-06-02T23:57:56.529073+0000","last_fullsized":"2024-06-02T23:57:56.529073+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:05:57.658900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273919+0000","last_change":"2024-06-02T23:57:15.318638+0000","last_active":"2024-06-02T23:58:55.273919+0000","last_peered":"2024-06-02T23:58:55.273919+0000","last_clean":"2024-06-02T23:58:55.273919+0000","last_became_active":"2024-06-02T23:57:15.318321+0000","last_became_peered":"2024-06-02T23:57:15.318321+0000","last_unstale":"2024-06-02T23:58:55.273919+0000","last_undegraded":"2024-06-02T23:58:55.273919+0000","last_fullsized":"2024-06-02T23:58:55.273919+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:21:57.877235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526151+0000","last_change":"2024-06-02T23:57:12.306278+0000","last_active":"2024-06-02T23:57:56.526151+0000","last_peered":"2024-06-02T23:57:56.526151+0000","last_clean":"2024-06-02T23:57:56.526151+0000","last_became_active":"2024-06-02T23:57:12.305885+0000","last_became_peered":"2024-06-02T23:57:12.305885+0000","last_unstale":"2024-06-02T23:57:56.526151+0000","last_undegraded":"2024-06-02T23:57:56.526151+0000","last_fullsized":"2024-06-02T23:57:56.526151+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:05:07.723501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.266773+0000","last_change":"2024-06-02T23:57:15.322489+0000","last_active":"2024-06-02T23:58:55.266773+0000","last_peered":"2024-06-02T23:58:55.266773+0000","last_clean":"2024-06-02T23:58:55.266773+0000","last_became_active":"2024-06-02T23:57:15.322131+0000","last_became_peered":"2024-06-02T23:57:15.322131+0000","last_unstale":"2024-06-02T23:58:55.266773+0000","last_undegraded":"2024-06-02T23:58:55.266773+0000","last_fullsized":"2024-06-02T23:58:55.266773+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:34:43.362338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"90'39","reported_seq":469,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.426675+0000","last_change":"2024-06-02T23:57:12.156920+0000","last_active":"2024-06-03T00:00:46.426675+0000","last_peered":"2024-06-03T00:00:46.426675+0000","last_clean":"2024-06-03T00:00:46.426675+0000","last_became_active":"2024-06-02T23:57:12.156494+0000","last_became_peered":"2024-06-02T23:57:12.156494+0000","last_unstale":"2024-06-03T00:00:46.426675+0000","last_undegraded":"2024-06-03T00:00:46.426675+0000","last_fullsized":"2024-06-03T00:00:46.426675+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:49:56.458730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67178,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":403,"num_read_kb":268,"num_write":41,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265549+0000","last_change":"2024-06-02T23:57:15.328502+0000","last_active":"2024-06-02T23:58:55.265549+0000","last_peered":"2024-06-02T23:58:55.265549+0000","last_clean":"2024-06-02T23:58:55.265549+0000","last_became_active":"2024-06-02T23:57:15.328174+0000","last_became_peered":"2024-06-02T23:57:15.328174+0000","last_unstale":"2024-06-02T23:58:55.265549+0000","last_undegraded":"2024-06-02T23:58:55.265549+0000","last_fullsized":"2024-06-02T23:58:55.265549+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:58:33.355397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527385+0000","last_change":"2024-06-02T23:57:12.154204+0000","last_active":"2024-06-02T23:57:56.527385+0000","last_peered":"2024-06-02T23:57:56.527385+0000","last_clean":"2024-06-02T23:57:56.527385+0000","last_became_active":"2024-06-02T23:57:12.153412+0000","last_became_peered":"2024-06-02T23:57:12.153412+0000","last_unstale":"2024-06-02T23:57:56.527385+0000","last_undegraded":"2024-06-02T23:57:56.527385+0000","last_fullsized":"2024-06-02T23:57:56.527385+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:15.472279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262255+0000","last_change":"2024-06-02T23:57:15.314274+0000","last_active":"2024-06-02T23:58:55.262255+0000","last_peered":"2024-06-02T23:58:55.262255+0000","last_clean":"2024-06-02T23:58:55.262255+0000","last_became_active":"2024-06-02T23:57:15.313946+0000","last_became_peered":"2024-06-02T23:57:15.313946+0000","last_unstale":"2024-06-02T23:58:55.262255+0000","last_undegraded":"2024-06-02T23:58:55.262255+0000","last_fullsized":"2024-06-02T23:58:55.262255+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:07.909977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.525241+0000","last_change":"2024-06-02T23:57:12.156767+0000","last_active":"2024-06-02T23:57:56.525241+0000","last_peered":"2024-06-02T23:57:56.525241+0000","last_clean":"2024-06-02T23:57:56.525241+0000","last_became_active":"2024-06-02T23:57:12.156346+0000","last_became_peered":"2024-06-02T23:57:12.156346+0000","last_unstale":"2024-06-02T23:57:56.525241+0000","last_undegraded":"2024-06-02T23:57:56.525241+0000","last_fullsized":"2024-06-02T23:57:56.525241+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:29:45.801904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267668+0000","last_change":"2024-06-02T23:57:15.322676+0000","last_active":"2024-06-02T23:58:55.267668+0000","last_peered":"2024-06-02T23:58:55.267668+0000","last_clean":"2024-06-02T23:58:55.267668+0000","last_became_active":"2024-06-02T23:57:15.319429+0000","last_became_peered":"2024-06-02T23:57:15.319429+0000","last_unstale":"2024-06-02T23:58:55.267668+0000","last_undegraded":"2024-06-02T23:58:55.267668+0000","last_fullsized":"2024-06-02T23:58:55.267668+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:48:15.984818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'6","reported_seq":232,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:47.467550+0000","last_change":"2024-06-02T23:57:12.153925+0000","last_active":"2024-06-03T00:00:47.467550+0000","last_peered":"2024-06-03T00:00:47.467550+0000","last_clean":"2024-06-03T00:00:47.467550+0000","last_became_active":"2024-06-02T23:57:12.152990+0000","last_became_peered":"2024-06-02T23:57:12.152990+0000","last_unstale":"2024-06-03T00:00:47.467550+0000","last_undegraded":"2024-06-03T00:00:47.467550+0000","last_fullsized":"2024-06-03T00:00:47.467550+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:32:21.845946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":896,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":200,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.270077+0000","last_change":"2024-06-02T23:57:15.327662+0000","last_active":"2024-06-02T23:58:55.270077+0000","last_peered":"2024-06-02T23:58:55.270077+0000","last_clean":"2024-06-02T23:58:55.270077+0000","last_became_active":"2024-06-02T23:57:15.327320+0000","last_became_peered":"2024-06-02T23:57:15.327320+0000","last_unstale":"2024-06-02T23:58:55.270077+0000","last_undegraded":"2024-06-02T23:58:55.270077+0000","last_fullsized":"2024-06-02T23:58:55.270077+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:44:37.561533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528426+0000","last_change":"2024-06-02T23:57:12.306856+0000","last_active":"2024-06-02T23:57:56.528426+0000","last_peered":"2024-06-02T23:57:56.528426+0000","last_clean":"2024-06-02T23:57:56.528426+0000","last_became_active":"2024-06-02T23:57:12.306476+0000","last_became_peered":"2024-06-02T23:57:12.306476+0000","last_unstale":"2024-06-02T23:57:56.528426+0000","last_undegraded":"2024-06-02T23:57:56.528426+0000","last_fullsized":"2024-06-02T23:57:56.528426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:30:22.839589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.266843+0000","last_change":"2024-06-02T23:57:56.890015+0000","last_active":"2024-06-02T23:58:55.266843+0000","last_peered":"2024-06-02T23:58:55.266843+0000","last_clean":"2024-06-02T23:58:55.266843+0000","last_became_active":"2024-06-02T23:57:56.889591+0000","last_became_peered":"2024-06-02T23:57:56.889591+0000","last_unstale":"2024-06-02T23:58:55.266843+0000","last_undegraded":"2024-06-02T23:58:55.266843+0000","last_fullsized":"2024-06-02T23:58:55.266843+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:14:37.851207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'3","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:59:28.633344+0000","last_change":"2024-06-02T23:57:12.146690+0000","last_active":"2024-06-02T23:59:28.633344+0000","last_peered":"2024-06-02T23:59:28.633344+0000","last_clean":"2024-06-02T23:59:28.633344+0000","last_became_active":"2024-06-02T23:57:12.146372+0000","last_became_peered":"2024-06-02T23:57:12.146372+0000","last_unstale":"2024-06-02T23:59:28.633344+0000","last_undegraded":"2024-06-02T23:59:28.633344+0000","last_fullsized":"2024-06-02T23:59:28.633344+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:45:04.421365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267278+0000","last_change":"2024-06-02T23:57:15.320938+0000","last_active":"2024-06-02T23:58:55.267278+0000","last_peered":"2024-06-02T23:58:55.267278+0000","last_clean":"2024-06-02T23:58:55.267278+0000","last_became_active":"2024-06-02T23:57:15.320567+0000","last_became_peered":"2024-06-02T23:57:15.320567+0000","last_unstale":"2024-06-02T23:58:55.267278+0000","last_undegraded":"2024-06-02T23:58:55.267278+0000","last_fullsized":"2024-06-02T23:58:55.267278+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:04:29.736387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"88'1","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527764+0000","last_change":"2024-06-02T23:57:12.307020+0000","last_active":"2024-06-02T23:57:56.527764+0000","last_peered":"2024-06-02T23:57:56.527764+0000","last_clean":"2024-06-02T23:57:56.527764+0000","last_became_active":"2024-06-02T23:57:12.306650+0000","last_became_peered":"2024-06-02T23:57:12.306650+0000","last_unstale":"2024-06-02T23:57:56.527764+0000","last_undegraded":"2024-06-02T23:57:56.527764+0000","last_fullsized":"2024-06-02T23:57:56.527764+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:18:03.679704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265006+0000","last_change":"2024-06-02T23:57:15.319300+0000","last_active":"2024-06-02T23:58:55.265006+0000","last_peered":"2024-06-02T23:58:55.265006+0000","last_clean":"2024-06-02T23:58:55.265006+0000","last_became_active":"2024-06-02T23:57:15.318903+0000","last_became_peered":"2024-06-02T23:57:15.318903+0000","last_unstale":"2024-06-02T23:58:55.265006+0000","last_undegraded":"2024-06-02T23:58:55.265006+0000","last_fullsized":"2024-06-02T23:58:55.265006+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:38:25.521337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":225,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:43.427424+0000","last_change":"2024-06-02T23:57:12.155260+0000","last_active":"2024-06-03T00:00:43.427424+0000","last_peered":"2024-06-03T00:00:43.427424+0000","last_clean":"2024-06-03T00:00:43.427424+0000","last_became_active":"2024-06-02T23:57:12.154884+0000","last_became_peered":"2024-06-02T23:57:12.154884+0000","last_unstale":"2024-06-03T00:00:43.427424+0000","last_undegraded":"2024-06-03T00:00:43.427424+0000","last_fullsized":"2024-06-03T00:00:43.427424+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:34:52.390752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":193,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.269861+0000","last_change":"2024-06-02T23:57:15.323490+0000","last_active":"2024-06-02T23:58:55.269861+0000","last_peered":"2024-06-02T23:58:55.269861+0000","last_clean":"2024-06-02T23:58:55.269861+0000","last_became_active":"2024-06-02T23:57:15.323142+0000","last_became_peered":"2024-06-02T23:57:15.323142+0000","last_unstale":"2024-06-02T23:58:55.269861+0000","last_undegraded":"2024-06-02T23:58:55.269861+0000","last_fullsized":"2024-06-02T23:58:55.269861+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:32:32.445823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.261770+0000","last_change":"2024-06-02T23:57:56.531715+0000","last_active":"2024-06-02T23:58:55.261770+0000","last_peered":"2024-06-02T23:58:55.261770+0000","last_clean":"2024-06-02T23:58:55.261770+0000","last_became_active":"2024-06-02T23:57:56.531304+0000","last_became_peered":"2024-06-02T23:57:56.531304+0000","last_unstale":"2024-06-02T23:58:55.261770+0000","last_undegraded":"2024-06-02T23:58:55.261770+0000","last_fullsized":"2024-06-02T23:58:55.261770+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:58:02.532206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'6","reported_seq":230,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:47.466971+0000","last_change":"2024-06-02T23:57:12.305475+0000","last_active":"2024-06-03T00:00:47.466971+0000","last_peered":"2024-06-03T00:00:47.466971+0000","last_clean":"2024-06-03T00:00:47.466971+0000","last_became_active":"2024-06-02T23:57:12.305071+0000","last_became_peered":"2024-06-02T23:57:12.305071+0000","last_unstale":"2024-06-03T00:00:47.466971+0000","last_undegraded":"2024-06-03T00:00:47.466971+0000","last_fullsized":"2024-06-03T00:00:47.466971+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:08:29.024447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":197,"num_read_kb":197,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.264368+0000","last_change":"2024-06-02T23:57:15.308629+0000","last_active":"2024-06-02T23:58:55.264368+0000","last_peered":"2024-06-02T23:58:55.264368+0000","last_clean":"2024-06-02T23:58:55.264368+0000","last_became_active":"2024-06-02T23:57:15.307981+0000","last_became_peered":"2024-06-02T23:57:15.307981+0000","last_unstale":"2024-06-02T23:58:55.264368+0000","last_undegraded":"2024-06-02T23:58:55.264368+0000","last_fullsized":"2024-06-02T23:58:55.264368+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:14:22.446599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.652578+0000","last_change":"2024-06-02T23:57:12.155968+0000","last_active":"2024-06-02T23:57:56.652578+0000","last_peered":"2024-06-02T23:57:56.652578+0000","last_clean":"2024-06-02T23:57:56.652578+0000","last_became_active":"2024-06-02T23:57:12.155521+0000","last_became_peered":"2024-06-02T23:57:12.155521+0000","last_unstale":"2024-06-02T23:57:56.652578+0000","last_undegraded":"2024-06-02T23:57:56.652578+0000","last_fullsized":"2024-06-02T23:57:56.652578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:45:00.397317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":350,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:34.488628+0000","last_change":"2024-06-02T23:55:50.081978+0000","last_active":"2024-06-02T23:58:34.488628+0000","last_peered":"2024-06-02T23:58:34.488628+0000","last_clean":"2024-06-02T23:58:34.488628+0000","last_became_active":"2024-06-02T23:55:50.081431+0000","last_became_peered":"2024-06-02T23:55:50.081431+0000","last_unstale":"2024-06-02T23:58:34.488628+0000","last_undegraded":"2024-06-02T23:58:34.488628+0000","last_fullsized":"2024-06-02T23:58:34.488628+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:52:23.676206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:52:23.676206+0000","last_clean_scrub_stamp":"2024-06-02T23:52:23.676206+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:29:59.979935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262458+0000","last_change":"2024-06-02T23:57:56.529633+0000","last_active":"2024-06-02T23:58:55.262458+0000","last_peered":"2024-06-02T23:58:55.262458+0000","last_clean":"2024-06-02T23:58:55.262458+0000","last_became_active":"2024-06-02T23:57:56.529210+0000","last_became_peered":"2024-06-02T23:57:56.529210+0000","last_unstale":"2024-06-02T23:58:55.262458+0000","last_undegraded":"2024-06-02T23:58:55.262458+0000","last_fullsized":"2024-06-02T23:58:55.262458+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:51:31.807162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.529339+0000","last_change":"2024-06-02T23:57:12.155897+0000","last_active":"2024-06-02T23:57:56.529339+0000","last_peered":"2024-06-02T23:57:56.529339+0000","last_clean":"2024-06-02T23:57:56.529339+0000","last_became_active":"2024-06-02T23:57:12.155461+0000","last_became_peered":"2024-06-02T23:57:12.155461+0000","last_unstale":"2024-06-02T23:57:56.529339+0000","last_undegraded":"2024-06-02T23:57:56.529339+0000","last_fullsized":"2024-06-02T23:57:56.529339+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:19:22.104104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.528035+0000","last_change":"2024-06-02T23:57:12.306363+0000","last_active":"2024-06-02T23:57:56.528035+0000","last_peered":"2024-06-02T23:57:56.528035+0000","last_clean":"2024-06-02T23:57:56.528035+0000","last_became_active":"2024-06-02T23:57:12.305920+0000","last_became_peered":"2024-06-02T23:57:12.305920+0000","last_unstale":"2024-06-02T23:57:56.528035+0000","last_undegraded":"2024-06-02T23:57:56.528035+0000","last_fullsized":"2024-06-02T23:57:56.528035+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:31:01.787879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.262436+0000","last_change":"2024-06-02T23:57:15.316038+0000","last_active":"2024-06-02T23:58:55.262436+0000","last_peered":"2024-06-02T23:58:55.262436+0000","last_clean":"2024-06-02T23:58:55.262436+0000","last_became_active":"2024-06-02T23:57:15.315715+0000","last_became_peered":"2024-06-02T23:57:15.315715+0000","last_unstale":"2024-06-02T23:58:55.262436+0000","last_undegraded":"2024-06-02T23:58:55.262436+0000","last_fullsized":"2024-06-02T23:58:55.262436+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:34:36.014251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"90'18","reported_seq":60,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:59:25.049042+0000","last_change":"2024-06-02T23:57:56.539596+0000","last_active":"2024-06-02T23:59:25.049042+0000","last_peered":"2024-06-02T23:59:25.049042+0000","last_clean":"2024-06-02T23:59:25.049042+0000","last_became_active":"2024-06-02T23:57:56.532686+0000","last_became_peered":"2024-06-02T23:57:56.532686+0000","last_unstale":"2024-06-02T23:59:25.049042+0000","last_undegraded":"2024-06-02T23:59:25.049042+0000","last_fullsized":"2024-06-02T23:59:25.049042+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:29:24.691941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267369+0000","last_change":"2024-06-02T23:57:15.315657+0000","last_active":"2024-06-02T23:58:55.267369+0000","last_peered":"2024-06-02T23:58:55.267369+0000","last_clean":"2024-06-02T23:58:55.267369+0000","last_became_active":"2024-06-02T23:57:15.315293+0000","last_became_peered":"2024-06-02T23:57:15.315293+0000","last_unstale":"2024-06-02T23:58:55.267369+0000","last_undegraded":"2024-06-02T23:58:55.267369+0000","last_fullsized":"2024-06-02T23:58:55.267369+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:52:55.241379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.652229+0000","last_change":"2024-06-02T23:57:12.405664+0000","last_active":"2024-06-02T23:57:56.652229+0000","last_peered":"2024-06-02T23:57:56.652229+0000","last_clean":"2024-06-02T23:57:56.652229+0000","last_became_active":"2024-06-02T23:57:12.405281+0000","last_became_peered":"2024-06-02T23:57:12.405281+0000","last_unstale":"2024-06-02T23:57:56.652229+0000","last_undegraded":"2024-06-02T23:57:56.652229+0000","last_fullsized":"2024-06-02T23:57:56.652229+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:46:50.119466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273696+0000","last_change":"2024-06-02T23:57:15.318136+0000","last_active":"2024-06-02T23:58:55.273696+0000","last_peered":"2024-06-02T23:58:55.273696+0000","last_clean":"2024-06-02T23:58:55.273696+0000","last_became_active":"2024-06-02T23:57:15.317753+0000","last_became_peered":"2024-06-02T23:57:15.317753+0000","last_unstale":"2024-06-02T23:58:55.273696+0000","last_undegraded":"2024-06-02T23:58:55.273696+0000","last_fullsized":"2024-06-02T23:58:55.273696+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:35:11.025266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.887947+0000","last_change":"2024-06-02T23:57:12.305954+0000","last_active":"2024-06-02T23:57:56.887947+0000","last_peered":"2024-06-02T23:57:56.887947+0000","last_clean":"2024-06-02T23:57:56.887947+0000","last_became_active":"2024-06-02T23:57:12.305589+0000","last_became_peered":"2024-06-02T23:57:12.305589+0000","last_unstale":"2024-06-02T23:57:56.887947+0000","last_undegraded":"2024-06-02T23:57:56.887947+0000","last_fullsized":"2024-06-02T23:57:56.887947+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:34:34.178446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.243742+0000","last_change":"2024-06-02T23:57:15.327115+0000","last_active":"2024-06-02T23:58:55.243742+0000","last_peered":"2024-06-02T23:58:55.243742+0000","last_clean":"2024-06-02T23:58:55.243742+0000","last_became_active":"2024-06-02T23:57:15.326746+0000","last_became_peered":"2024-06-02T23:57:15.326746+0000","last_unstale":"2024-06-02T23:58:55.243742+0000","last_undegraded":"2024-06-02T23:58:55.243742+0000","last_fullsized":"2024-06-02T23:58:55.243742+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:08:04.340517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526250+0000","last_change":"2024-06-02T23:57:12.152933+0000","last_active":"2024-06-02T23:57:56.526250+0000","last_peered":"2024-06-02T23:57:56.526250+0000","last_clean":"2024-06-02T23:57:56.526250+0000","last_became_active":"2024-06-02T23:57:12.152453+0000","last_became_peered":"2024-06-02T23:57:12.152453+0000","last_unstale":"2024-06-02T23:57:56.526250+0000","last_undegraded":"2024-06-02T23:57:56.526250+0000","last_fullsized":"2024-06-02T23:57:56.526250+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:47:05.144374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.272469+0000","last_change":"2024-06-02T23:57:15.326042+0000","last_active":"2024-06-02T23:58:55.272469+0000","last_peered":"2024-06-02T23:58:55.272469+0000","last_clean":"2024-06-02T23:58:55.272469+0000","last_became_active":"2024-06-02T23:57:15.325585+0000","last_became_peered":"2024-06-02T23:57:15.325585+0000","last_unstale":"2024-06-02T23:58:55.272469+0000","last_undegraded":"2024-06-02T23:58:55.272469+0000","last_fullsized":"2024-06-02T23:58:55.272469+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:40:37.305875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"88'3","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.527211+0000","last_change":"2024-06-02T23:57:12.139155+0000","last_active":"2024-06-02T23:57:56.527211+0000","last_peered":"2024-06-02T23:57:56.527211+0000","last_clean":"2024-06-02T23:57:56.527211+0000","last_became_active":"2024-06-02T23:57:12.138732+0000","last_became_peered":"2024-06-02T23:57:12.138732+0000","last_unstale":"2024-06-02T23:57:56.527211+0000","last_undegraded":"2024-06-02T23:57:56.527211+0000","last_fullsized":"2024-06-02T23:57:56.527211+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:18:29.148439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265509+0000","last_change":"2024-06-02T23:57:15.319510+0000","last_active":"2024-06-02T23:58:55.265509+0000","last_peered":"2024-06-02T23:58:55.265509+0000","last_clean":"2024-06-02T23:58:55.265509+0000","last_became_active":"2024-06-02T23:57:15.319192+0000","last_became_peered":"2024-06-02T23:57:15.319192+0000","last_unstale":"2024-06-02T23:58:55.265509+0000","last_undegraded":"2024-06-02T23:58:55.265509+0000","last_fullsized":"2024-06-02T23:58:55.265509+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:04:04.241833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.658192+0000","last_change":"2024-06-02T23:57:56.657766+0000","last_active":"2024-06-02T23:57:56.658192+0000","last_peered":"2024-06-02T23:57:56.658192+0000","last_clean":"2024-06-02T23:57:56.658192+0000","last_became_active":"2024-06-02T23:57:56.653435+0000","last_became_peered":"2024-06-02T23:57:56.653435+0000","last_unstale":"2024-06-02T23:57:56.658192+0000","last_undegraded":"2024-06-02T23:57:56.658192+0000","last_fullsized":"2024-06-02T23:57:56.658192+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:03:23.594470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273925+0000","last_change":"2024-06-02T23:57:15.320837+0000","last_active":"2024-06-02T23:58:55.273925+0000","last_peered":"2024-06-02T23:58:55.273925+0000","last_clean":"2024-06-02T23:58:55.273925+0000","last_became_active":"2024-06-02T23:57:15.320257+0000","last_became_peered":"2024-06-02T23:57:15.320257+0000","last_unstale":"2024-06-02T23:58:55.273925+0000","last_undegraded":"2024-06-02T23:58:55.273925+0000","last_fullsized":"2024-06-02T23:58:55.273925+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:18:29.638614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'5","reported_seq":229,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.427774+0000","last_change":"2024-06-02T23:57:12.405175+0000","last_active":"2024-06-03T00:00:46.427774+0000","last_peered":"2024-06-03T00:00:46.427774+0000","last_clean":"2024-06-03T00:00:46.427774+0000","last_became_active":"2024-06-02T23:57:12.404767+0000","last_became_peered":"2024-06-02T23:57:12.404767+0000","last_unstale":"2024-06-03T00:00:46.427774+0000","last_undegraded":"2024-06-03T00:00:46.427774+0000","last_fullsized":"2024-06-03T00:00:46.427774+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:46:57.421288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":197,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273764+0000","last_change":"2024-06-02T23:57:15.322888+0000","last_active":"2024-06-02T23:58:55.273764+0000","last_peered":"2024-06-02T23:58:55.273764+0000","last_clean":"2024-06-02T23:58:55.273764+0000","last_became_active":"2024-06-02T23:57:15.321982+0000","last_became_peered":"2024-06-02T23:57:15.321982+0000","last_unstale":"2024-06-02T23:58:55.273764+0000","last_undegraded":"2024-06-02T23:58:55.273764+0000","last_fullsized":"2024-06-02T23:58:55.273764+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:51:57.253824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.526189+0000","last_change":"2024-06-02T23:57:12.153715+0000","last_active":"2024-06-02T23:57:56.526189+0000","last_peered":"2024-06-02T23:57:56.526189+0000","last_clean":"2024-06-02T23:57:56.526189+0000","last_became_active":"2024-06-02T23:57:12.152544+0000","last_became_peered":"2024-06-02T23:57:12.152544+0000","last_unstale":"2024-06-02T23:57:56.526189+0000","last_undegraded":"2024-06-02T23:57:56.526189+0000","last_fullsized":"2024-06-02T23:57:56.526189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:51:05.874962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.271354+0000","last_change":"2024-06-02T23:57:15.318759+0000","last_active":"2024-06-02T23:58:55.271354+0000","last_peered":"2024-06-02T23:58:55.271354+0000","last_clean":"2024-06-02T23:58:55.271354+0000","last_became_active":"2024-06-02T23:57:15.317942+0000","last_became_peered":"2024-06-02T23:57:15.317942+0000","last_unstale":"2024-06-02T23:58:55.271354+0000","last_undegraded":"2024-06-02T23:58:55.271354+0000","last_fullsized":"2024-06-02T23:58:55.271354+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:39:44.142890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:57:56.894529+0000","last_change":"2024-06-02T23:57:56.894131+0000","last_active":"2024-06-02T23:57:56.894529+0000","last_peered":"2024-06-02T23:57:56.894529+0000","last_clean":"2024-06-02T23:57:56.894529+0000","last_became_active":"2024-06-02T23:57:56.889794+0000","last_became_peered":"2024-06-02T23:57:56.889794+0000","last_unstale":"2024-06-02T23:57:56.894529+0000","last_undegraded":"2024-06-02T23:57:56.894529+0000","last_fullsized":"2024-06-02T23:57:56.894529+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:11.110705+0000","last_clean_scrub_stamp":"2024-06-02T23:57:11.110705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:02:41.670419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.266582+0000","last_change":"2024-06-02T23:57:15.324355+0000","last_active":"2024-06-02T23:58:55.266582+0000","last_peered":"2024-06-02T23:58:55.266582+0000","last_clean":"2024-06-02T23:58:55.266582+0000","last_became_active":"2024-06-02T23:57:15.324019+0000","last_became_peered":"2024-06-02T23:57:15.324019+0000","last_unstale":"2024-06-02T23:58:55.266582+0000","last_undegraded":"2024-06-02T23:58:55.266582+0000","last_fullsized":"2024-06-02T23:58:55.266582+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:27:01.927109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.267246+0000","last_change":"2024-06-02T23:57:15.326420+0000","last_active":"2024-06-02T23:58:55.267246+0000","last_peered":"2024-06-02T23:58:55.267246+0000","last_clean":"2024-06-02T23:58:55.267246+0000","last_became_active":"2024-06-02T23:57:15.326091+0000","last_became_peered":"2024-06-02T23:57:15.326091+0000","last_unstale":"2024-06-02T23:58:55.267246+0000","last_undegraded":"2024-06-02T23:58:55.267246+0000","last_fullsized":"2024-06-02T23:58:55.267246+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:54:05.355352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.252717+0000","last_change":"2024-06-02T23:57:56.653297+0000","last_active":"2024-06-02T23:58:55.252717+0000","last_peered":"2024-06-02T23:58:55.252717+0000","last_clean":"2024-06-02T23:58:55.252717+0000","last_became_active":"2024-06-02T23:57:56.652874+0000","last_became_peered":"2024-06-02T23:57:56.652874+0000","last_unstale":"2024-06-02T23:58:55.252717+0000","last_undegraded":"2024-06-02T23:58:55.252717+0000","last_fullsized":"2024-06-02T23:58:55.252717+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:27:55.486382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.260044+0000","last_change":"2024-06-02T23:57:15.319266+0000","last_active":"2024-06-02T23:58:55.260044+0000","last_peered":"2024-06-02T23:58:55.260044+0000","last_clean":"2024-06-02T23:58:55.260044+0000","last_became_active":"2024-06-02T23:57:15.317468+0000","last_became_peered":"2024-06-02T23:57:15.317468+0000","last_unstale":"2024-06-02T23:58:55.260044+0000","last_undegraded":"2024-06-02T23:58:55.260044+0000","last_fullsized":"2024-06-02T23:58:55.260044+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:49:53.675524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.273976+0000","last_change":"2024-06-02T23:57:15.315798+0000","last_active":"2024-06-02T23:58:55.273976+0000","last_peered":"2024-06-02T23:58:55.273976+0000","last_clean":"2024-06-02T23:58:55.273976+0000","last_became_active":"2024-06-02T23:57:15.314886+0000","last_became_peered":"2024-06-02T23:57:15.314886+0000","last_unstale":"2024-06-02T23:58:55.273976+0000","last_undegraded":"2024-06-02T23:58:55.273976+0000","last_fullsized":"2024-06-02T23:58:55.273976+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:23.042226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259255+0000","last_change":"2024-06-02T23:57:15.315081+0000","last_active":"2024-06-02T23:58:55.259255+0000","last_peered":"2024-06-02T23:58:55.259255+0000","last_clean":"2024-06-02T23:58:55.259255+0000","last_became_active":"2024-06-02T23:57:15.314745+0000","last_became_peered":"2024-06-02T23:57:15.314745+0000","last_unstale":"2024-06-02T23:58:55.259255+0000","last_undegraded":"2024-06-02T23:58:55.259255+0000","last_fullsized":"2024-06-02T23:58:55.259255+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:17:49.506950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.261978+0000","last_change":"2024-06-02T23:57:15.323687+0000","last_active":"2024-06-02T23:58:55.261978+0000","last_peered":"2024-06-02T23:58:55.261978+0000","last_clean":"2024-06-02T23:58:55.261978+0000","last_became_active":"2024-06-02T23:57:15.323345+0000","last_became_peered":"2024-06-02T23:57:15.323345+0000","last_unstale":"2024-06-02T23:58:55.261978+0000","last_undegraded":"2024-06-02T23:58:55.261978+0000","last_fullsized":"2024-06-02T23:58:55.261978+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:47:40.234811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265429+0000","last_change":"2024-06-02T23:57:15.320632+0000","last_active":"2024-06-02T23:58:55.265429+0000","last_peered":"2024-06-02T23:58:55.265429+0000","last_clean":"2024-06-02T23:58:55.265429+0000","last_became_active":"2024-06-02T23:57:15.318427+0000","last_became_peered":"2024-06-02T23:57:15.318427+0000","last_unstale":"2024-06-02T23:58:55.265429+0000","last_undegraded":"2024-06-02T23:58:55.265429+0000","last_fullsized":"2024-06-02T23:58:55.265429+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:04:51.729326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259261+0000","last_change":"2024-06-02T23:57:15.312039+0000","last_active":"2024-06-02T23:58:55.259261+0000","last_peered":"2024-06-02T23:58:55.259261+0000","last_clean":"2024-06-02T23:58:55.259261+0000","last_became_active":"2024-06-02T23:57:15.311275+0000","last_became_peered":"2024-06-02T23:57:15.311275+0000","last_unstale":"2024-06-02T23:58:55.259261+0000","last_undegraded":"2024-06-02T23:58:55.259261+0000","last_fullsized":"2024-06-02T23:58:55.259261+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:50:25.509550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.259813+0000","last_change":"2024-06-02T23:57:15.311927+0000","last_active":"2024-06-02T23:58:55.259813+0000","last_peered":"2024-06-02T23:58:55.259813+0000","last_clean":"2024-06-02T23:58:55.259813+0000","last_became_active":"2024-06-02T23:57:15.311484+0000","last_became_peered":"2024-06-02T23:57:15.311484+0000","last_unstale":"2024-06-02T23:58:55.259813+0000","last_undegraded":"2024-06-02T23:58:55.259813+0000","last_fullsized":"2024-06-02T23:58:55.259813+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:29:27.789219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.268648+0000","last_change":"2024-06-02T23:57:15.321218+0000","last_active":"2024-06-02T23:58:55.268648+0000","last_peered":"2024-06-02T23:58:55.268648+0000","last_clean":"2024-06-02T23:58:55.268648+0000","last_became_active":"2024-06-02T23:57:15.320884+0000","last_became_peered":"2024-06-02T23:57:15.320884+0000","last_unstale":"2024-06-02T23:58:55.268648+0000","last_undegraded":"2024-06-02T23:58:55.268648+0000","last_fullsized":"2024-06-02T23:58:55.268648+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:57:20.583655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.270664+0000","last_change":"2024-06-02T23:57:15.315213+0000","last_active":"2024-06-02T23:58:55.270664+0000","last_peered":"2024-06-02T23:58:55.270664+0000","last_clean":"2024-06-02T23:58:55.270664+0000","last_became_active":"2024-06-02T23:57:15.314050+0000","last_became_peered":"2024-06-02T23:57:15.314050+0000","last_unstale":"2024-06-02T23:58:55.270664+0000","last_undegraded":"2024-06-02T23:58:55.270664+0000","last_fullsized":"2024-06-02T23:58:55.270664+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:35.214351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.265435+0000","last_change":"2024-06-02T23:57:15.313901+0000","last_active":"2024-06-02T23:58:55.265435+0000","last_peered":"2024-06-02T23:58:55.265435+0000","last_clean":"2024-06-02T23:58:55.265435+0000","last_became_active":"2024-06-02T23:57:15.313452+0000","last_became_peered":"2024-06-02T23:57:15.313452+0000","last_unstale":"2024-06-02T23:58:55.265435+0000","last_undegraded":"2024-06-02T23:58:55.265435+0000","last_fullsized":"2024-06-02T23:58:55.265435+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:41:38.366741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-02T23:58:55.263989+0000","last_change":"2024-06-02T23:57:15.323660+0000","last_active":"2024-06-02T23:58:55.263989+0000","last_peered":"2024-06-02T23:58:55.263989+0000","last_clean":"2024-06-02T23:58:55.263989+0000","last_became_active":"2024-06-02T23:57:15.323316+0000","last_became_peered":"2024-06-02T23:57:15.323316+0000","last_unstale":"2024-06-02T23:58:55.263989+0000","last_undegraded":"2024-06-02T23:58:55.263989+0000","last_fullsized":"2024-06-02T23:58:55.263989+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:57:14.290790+0000","last_clean_scrub_stamp":"2024-06-02T23:57:14.290790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:33:10.245563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74439,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1990,"num_read_kb":1076,"num_write":263,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":223317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383739,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":480586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645376,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28680,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716472,"statfs":{"total":95995035648,"available":95965667328,"internally_reserved":0,"allocated":1703936,"data_stored":1139101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808901,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1019904,"data_stored":480516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070538,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":480894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332174,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28592,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716560,"statfs":{"total":95995035648,"available":95965757440,"internally_reserved":0,"allocated":1613824,"data_stored":1073860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495701,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":1003520,"data_stored":480233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574958,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1073152,"data_stored":548324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738483,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40496,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704656,"statfs":{"total":95995035648,"available":95953567744,"internally_reserved":0,"allocated":1024000,"data_stored":481572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411433,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32244,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712908,"statfs":{"total":95995035648,"available":95962017792,"internally_reserved":0,"allocated":1093632,"data_stored":549075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182500,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":480058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":480402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757338,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28604,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716548,"statfs":{"total":95995035648,"available":95965745152,"internally_reserved":0,"allocated":1626112,"data_stored":1073230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":69222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-03T00:00:50.509 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-03T00:00:50.796 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:00:51.168 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:51 smithi049 ceph-mon[32302]: pgmap v407: 97 pgs: 97 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s 2024-06-03T00:00:51.169 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:51 smithi049 ceph-mon[32302]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-03T00:00:51.178 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.176+0000 7f39871b0640 1 -- 172.21.15.49:0/3164870112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3980107740 msgr2=0x7f3980109b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.176+0000 7f39871b0640 1 --2- 172.21.15.49:0/3164870112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3980107740 0x7f3980109b30 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3978009ca0 tx=0x7f397802a8c0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.176+0000 7f39871b0640 1 -- 172.21.15.49:0/3164870112 shutdown_connections 2024-06-03T00:00:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.176+0000 7f39871b0640 1 --2- 172.21.15.49:0/3164870112 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3980104e10 0x7f3980107200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.176+0000 7f39871b0640 1 --2- 172.21.15.49:0/3164870112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3980107740 0x7f3980109b30 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.176+0000 7f39871b0640 1 --2- 172.21.15.49:0/3164870112 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39801024e0 0x7f39801048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.176+0000 7f39871b0640 1 -- 172.21.15.49:0/3164870112 >> 172.21.15.49:0/3164870112 conn(0x7f39800fbe70 msgr2=0x7f39800fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.176+0000 7f39871b0640 1 -- 172.21.15.49:0/3164870112 shutdown_connections 2024-06-03T00:00:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.176+0000 7f39871b0640 1 -- 172.21.15.49:0/3164870112 wait complete. 2024-06-03T00:00:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.176+0000 7f39871b0640 1 Processor -- start 2024-06-03T00:00:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.176+0000 7f39871b0640 1 -- start start 2024-06-03T00:00:51.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.177+0000 7f39871b0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39801024e0 0x7f3980101e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:51.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.177+0000 7f39871b0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3980104e10 0x7f3980100490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:51.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.177+0000 7f39871b0640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3980107740 0x7f39801009d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:51.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.177+0000 7f39871b0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f398010d6a0 con 0x7f3980104e10 2024-06-03T00:00:51.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.177+0000 7f39871b0640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f398010d520 con 0x7f3980107740 2024-06-03T00:00:51.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.177+0000 7f39871b0640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f398010d820 con 0x7f39801024e0 2024-06-03T00:00:51.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.177+0000 7f397ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3980104e10 0x7f3980100490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:51.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.177+0000 7f397ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3980104e10 0x7f3980100490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50376/0 (socket says 172.21.15.49:50376) 2024-06-03T00:00:51.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.177+0000 7f397ffff640 1 -- 172.21.15.49:0/749710312 learned_addr learned my addr 172.21.15.49:0/749710312 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:51.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.177+0000 7f398574d640 1 --2- 172.21.15.49:0/749710312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3980107740 0x7f39801009d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:51.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.177+0000 7f3984f4c640 1 --2- 172.21.15.49:0/749710312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39801024e0 0x7f3980101e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:51.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.177+0000 7f397ffff640 1 -- 172.21.15.49:0/749710312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39801024e0 msgr2=0x7f3980101e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:51.181 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.177+0000 7f397ffff640 1 --2- 172.21.15.49:0/749710312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39801024e0 0x7f3980101e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.181 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.177+0000 7f397ffff640 1 -- 172.21.15.49:0/749710312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3980107740 msgr2=0x7f39801009d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:51.181 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.177+0000 7f397ffff640 1 --2- 172.21.15.49:0/749710312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3980107740 0x7f39801009d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.181 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.177+0000 7f397ffff640 1 -- 172.21.15.49:0/749710312 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3980101260 con 0x7f3980104e10 2024-06-03T00:00:51.181 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.177+0000 7f397ffff640 1 --2- 172.21.15.49:0/749710312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3980104e10 0x7f3980100490 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f396c00e9c0 tx=0x7f396c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:51.181 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.177+0000 7f397dffb640 1 -- 172.21.15.49:0/749710312 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396c00cd80 con 0x7f3980104e10 2024-06-03T00:00:51.181 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.177+0000 7f39871b0640 1 -- 172.21.15.49:0/749710312 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39801a1d20 con 0x7f3980104e10 2024-06-03T00:00:51.181 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.178+0000 7f397dffb640 1 -- 172.21.15.49:0/749710312 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f396c005500 con 0x7f3980104e10 2024-06-03T00:00:51.181 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.178+0000 7f397dffb640 1 -- 172.21.15.49:0/749710312 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396c010690 con 0x7f3980104e10 2024-06-03T00:00:51.181 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.178+0000 7f39871b0640 1 -- 172.21.15.49:0/749710312 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39801a2200 con 0x7f3980104e10 2024-06-03T00:00:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.180+0000 7f397dffb640 1 -- 172.21.15.49:0/749710312 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f396c0046c0 con 0x7f3980104e10 2024-06-03T00:00:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.180+0000 7f3989f9f740 1 Processor -- start 2024-06-03T00:00:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.180+0000 7f3989f9f740 1 -- start start 2024-06-03T00:00:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.181+0000 7f3989f9f740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d352e96010 0x55d352e96430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.181+0000 7f3989f9f740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d352e96a00 0x55d352e9b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.181+0000 7f3989f9f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d352e9bb70 0x55d352e9e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.181+0000 7f3989f9f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55d352df94f0 con 0x55d352e9bb70 2024-06-03T00:00:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.181+0000 7f3989f9f740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55d352d97870 con 0x55d352e96a00 2024-06-03T00:00:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.181+0000 7f3989f9f740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d352df54b0 con 0x55d352e96010 2024-06-03T00:00:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.181+0000 7f397ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d352e9bb70 0x55d352e9e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.181+0000 7f397ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d352e9bb70 0x55d352e9e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50382/0 (socket says 172.21.15.49:50382) 2024-06-03T00:00:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.181+0000 7f397ffff640 1 -- 172.21.15.49:0/3169384654 learned_addr learned my addr 172.21.15.49:0/3169384654 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.181+0000 7f3984f4c640 1 --2- 172.21.15.49:0/3169384654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d352e96a00 0x55d352e9b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.181+0000 7f398574d640 1 --2- 172.21.15.49:0/3169384654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d352e96010 0x55d352e96430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.181+0000 7f397dffb640 1 --2- 172.21.15.49:0/749710312 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f39700a2c30 0x7f39700a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.181+0000 7f3984f4c640 1 -- 172.21.15.49:0/3169384654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d352e96010 msgr2=0x55d352e96430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.181+0000 7f3984f4c640 1 --2- 172.21.15.49:0/3169384654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d352e96010 0x55d352e96430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.181+0000 7f3984f4c640 1 -- 172.21.15.49:0/3169384654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d352e9bb70 msgr2=0x55d352e9e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.181+0000 7f3984f4c640 1 --2- 172.21.15.49:0/3169384654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d352e9bb70 0x55d352e9e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.181+0000 7f3984f4c640 1 -- 172.21.15.49:0/3169384654 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d352db39b0 con 0x55d352e96a00 2024-06-03T00:00:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.181+0000 7f398574d640 1 --2- 172.21.15.49:0/749710312 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f39700a2c30 0x7f39700a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.182+0000 7f397dffb640 1 -- 172.21.15.49:0/749710312 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f396c0cf420 con 0x7f3980104e10 2024-06-03T00:00:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.182+0000 7f3984f4c640 1 --2- 172.21.15.49:0/3169384654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d352e96a00 0x55d352e9b500 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3974009c00 tx=0x7f3974011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98ab4d4d4a15690c server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:51.191 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.182+0000 7f396affd640 1 -- 172.21.15.49:0/3169384654 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3974004230 con 0x55d352e96a00 2024-06-03T00:00:51.191 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.182+0000 7f396affd640 1 -- 172.21.15.49:0/3169384654 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39740043d0 con 0x55d352e96a00 2024-06-03T00:00:51.191 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.182+0000 7f396affd640 1 -- 172.21.15.49:0/3169384654 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3974004dd0 con 0x55d352e96a00 2024-06-03T00:00:51.191 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.183+0000 7f3989f9f740 1 -- 172.21.15.49:0/3169384654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d352e96a00 msgr2=0x55d352e9b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:51.191 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.183+0000 7f3989f9f740 1 --2- 172.21.15.49:0/3169384654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d352e96a00 0x55d352e9b500 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3974009c00 tx=0x7f3974011810 comp rx=0 tx=0).stop 2024-06-03T00:00:51.191 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.183+0000 7f398574d640 1 --2- 172.21.15.49:0/749710312 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f39700a2c30 0x7f39700a50f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3978005e30 tx=0x7f39780095c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:51.191 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.183+0000 7f3989f9f740 1 -- 172.21.15.49:0/3169384654 shutdown_connections 2024-06-03T00:00:51.191 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.183+0000 7f3989f9f740 1 --2- 172.21.15.49:0/3169384654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d352e96a00 0x55d352e9b500 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.191 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.183+0000 7f3989f9f740 1 --2- 172.21.15.49:0/3169384654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d352e9bb70 0x55d352e9e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.191 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.183+0000 7f3989f9f740 1 --2- 172.21.15.49:0/3169384654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d352e96010 0x55d352e96430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.191 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.183+0000 7f3989f9f740 1 -- 172.21.15.49:0/3169384654 >> 172.21.15.49:0/3169384654 conn(0x55d352e91680 msgr2=0x55d352e91a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:51.191 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.183+0000 7f3989f9f740 1 -- 172.21.15.49:0/3169384654 shutdown_connections 2024-06-03T00:00:51.191 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.183+0000 7f3989f9f740 1 -- 172.21.15.49:0/3169384654 wait complete. 2024-06-03T00:00:51.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.183+0000 7f3989f9f740 1 -- start start 2024-06-03T00:00:51.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.183+0000 7f3989f9f740 1 Processor -- start 2024-06-03T00:00:51.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.184+0000 7f3989f9f740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d352e96010 0x55d352ea0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:51.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.184+0000 7f3989f9f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d352e96a00 0x55d352ea07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:51.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.184+0000 7f3989f9f740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d352e9bb70 0x55d352ea7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:51.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.184+0000 7f3989f9f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55d352e9eb20 con 0x55d352e96a00 2024-06-03T00:00:51.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.184+0000 7f3989f9f740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55d352d82ae0 con 0x55d352e9bb70 2024-06-03T00:00:51.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.184+0000 7f3989f9f740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d352e9eca0 con 0x55d352e96010 2024-06-03T00:00:51.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.184+0000 7f3989f9f740 10 client.0 _ll_register_callbacks cb 0x55d352dbb9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:00:51.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.184+0000 7f397ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d352e96a00 0x55d352ea07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:51.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.184+0000 7f397ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d352e96a00 0x55d352ea07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50390/0 (socket says 172.21.15.49:50390) 2024-06-03T00:00:51.193 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.184+0000 7f397ffff640 1 -- 172.21.15.49:0/2912904052 learned_addr learned my addr 172.21.15.49:0/2912904052 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:51.193 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.184+0000 7f398574d640 1 --2- 172.21.15.49:0/2912904052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d352e9bb70 0x55d352ea7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:51.193 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.184+0000 7f3984f4c640 1 --2- 172.21.15.49:0/2912904052 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d352e96010 0x55d352ea0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:51.193 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.184+0000 7f397ffff640 1 -- 172.21.15.49:0/2912904052 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d352e96010 msgr2=0x55d352ea0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:51.193 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.184+0000 7f397ffff640 1 --2- 172.21.15.49:0/2912904052 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d352e96010 0x55d352ea0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.193 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.184+0000 7f397ffff640 1 -- 172.21.15.49:0/2912904052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d352e9bb70 msgr2=0x55d352ea7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:51.193 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.184+0000 7f397ffff640 1 --2- 172.21.15.49:0/2912904052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d352e9bb70 0x55d352ea7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.193 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.184+0000 7f397ffff640 1 -- 172.21.15.49:0/2912904052 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d352b0d210 con 0x55d352e96a00 2024-06-03T00:00:51.193 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.184+0000 7f398574d640 1 --2- 172.21.15.49:0/2912904052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d352e9bb70 0x55d352ea7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:00:51.193 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.184+0000 7f397ffff640 1 --2- 172.21.15.49:0/2912904052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d352e96a00 0x55d352ea07c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f396c0058c0 tx=0x7f396c0d29d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896a6094282dff47 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:51.194 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.184+0000 7f395ffff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:00:51.194 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.185+0000 7f395ffff640 1 -- 172.21.15.49:0/2912904052 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396c09b7c0 con 0x55d352e96a00 2024-06-03T00:00:51.194 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.185+0000 7f395ffff640 1 -- 172.21.15.49:0/2912904052 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f396c0a4660 con 0x55d352e96a00 2024-06-03T00:00:51.194 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.185+0000 7f3989f9f740 1 -- 172.21.15.49:0/2912904052 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39740043d0 con 0x55d352e96a00 2024-06-03T00:00:51.194 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.185+0000 7f395ffff640 1 -- 172.21.15.49:0/2912904052 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f396c09b5e0 con 0x55d352e96a00 2024-06-03T00:00:51.194 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.185+0000 7f3989f9f740 10 client.15330 fetch_fsmap learned FSMap version 27 2024-06-03T00:00:51.194 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.185+0000 7f3989f9f740 1 -- 172.21.15.49:0/2912904052 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d352bd9620 con 0x55d352e96a00 2024-06-03T00:00:51.195 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.185+0000 7f395ffff640 1 -- 172.21.15.49:0/2912904052 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39740043d0 con 0x55d352e96a00 2024-06-03T00:00:51.195 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.185+0000 7f395ffff640 1 -- 172.21.15.49:0/2912904052 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f396c0b4060 con 0x55d352e96a00 2024-06-03T00:00:51.195 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.185+0000 7f3989f9f740 10 client.15330 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:00:51.195 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.185+0000 7f3989f9f740 10 client.15330 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:00:51.195 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.185+0000 7f3989f9f740 20 client.15330 populate_metadata read hostname 'smithi049' 2024-06-03T00:00:51.195 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.185+0000 7f3989f9f740 1 --2- 172.21.15.49:0/2912904052 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55d352eac1b0 0x55d352eae5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:51.195 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.185+0000 7f3989f9f740 4 client.15330 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:00:51.195 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.185+0000 7f3989f9f740 1 -- 172.21.15.49:0/2912904052 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d352e0cf10 con 0x55d352eac1b0 2024-06-03T00:00:51.195 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.186+0000 7f3984f4c640 1 --2- 172.21.15.49:0/2912904052 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55d352eac1b0 0x55d352eae5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:51.195 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.186+0000 7f395ffff640 10 client.15330 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:00:51.195 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.186+0000 7f3984f4c640 1 --2- 172.21.15.49:0/2912904052 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55d352eac1b0 0x55d352eae5a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2ff07263e63896d server_cookie=74ca26f6346126cc in_seq=0 out_seq=0 2024-06-03T00:00:51.195 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.187+0000 7f395ffff640 1 -- 172.21.15.49:0/2912904052 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55d352e0cf10 con 0x55d352eac1b0 2024-06-03T00:00:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.187+0000 7f395ffff640 10 client.15330 handle_command_reply: tid=0 2024-06-03T00:00:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.187+0000 7f3989f9f740 1 client.15330 shutdown 2024-06-03T00:00:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.187+0000 7f3989f9f740 1 -- 172.21.15.49:0/2912904052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d352e96a00 msgr2=0x55d352ea07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.187+0000 7f3989f9f740 1 --2- 172.21.15.49:0/2912904052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d352e96a00 0x55d352ea07c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f396c0058c0 tx=0x7f396c0d29d0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.187+0000 7f3989f9f740 1 -- 172.21.15.49:0/2912904052 shutdown_connections 2024-06-03T00:00:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.187+0000 7f3989f9f740 1 --2- 172.21.15.49:0/2912904052 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55d352eac1b0 0x55d352eae5a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.187+0000 7f395ffff640 0 client.15330 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:00:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.187+0000 7f3989f9f740 1 --2- 172.21.15.49:0/2912904052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d352e9bb70 0x55d352ea7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.187+0000 7f3989f9f740 1 --2- 172.21.15.49:0/2912904052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d352e96a00 0x55d352ea07c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.187+0000 7f3989f9f740 1 --2- 172.21.15.49:0/2912904052 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d352e96010 0x55d352ea0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.187+0000 7f3989f9f740 1 -- 172.21.15.49:0/2912904052 >> 172.21.15.49:0/2912904052 conn(0x55d352e91680 msgr2=0x55d352e907e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.187+0000 7f3989f9f740 1 -- 172.21.15.49:0/2912904052 shutdown_connections 2024-06-03T00:00:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.187+0000 7f3989f9f740 1 -- 172.21.15.49:0/2912904052 wait complete. 2024-06-03T00:00:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.187+0000 7f3989f9f740 20 client.15330 trim_cache size 0 max 16384 2024-06-03T00:00:51.213 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.207+0000 7f3989f9f740 1 Processor -- start 2024-06-03T00:00:51.213 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.207+0000 7f3989f9f740 1 -- start start 2024-06-03T00:00:51.213 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.207+0000 7f3989f9f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d352e96010 0x55d352e94590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:51.213 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.207+0000 7f3989f9f740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d352e96a00 0x55d352ea77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:51.213 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.207+0000 7f3989f9f740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d352e9bb70 0x55d352e94ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:51.213 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.207+0000 7f3989f9f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f39801aafd0 con 0x55d352e96010 2024-06-03T00:00:51.213 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.207+0000 7f3989f9f740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f39801acb10 con 0x55d352e9bb70 2024-06-03T00:00:51.213 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.207+0000 7f3989f9f740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f39801ab6a0 con 0x55d352e96a00 2024-06-03T00:00:51.213 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.207+0000 7f3984f4c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d352e96010 0x55d352e94590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:51.214 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.207+0000 7f3984f4c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d352e96010 0x55d352e94590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50400/0 (socket says 172.21.15.49:50400) 2024-06-03T00:00:51.214 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.208+0000 7f3984f4c640 1 -- 172.21.15.49:0/3152209334 learned_addr learned my addr 172.21.15.49:0/3152209334 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:51.214 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.208+0000 7f397ffff640 1 --2- 172.21.15.49:0/3152209334 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d352e96a00 0x55d352ea77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:51.214 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.208+0000 7f398574d640 1 --2- 172.21.15.49:0/3152209334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d352e9bb70 0x55d352e94ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:51.214 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.208+0000 7f3984f4c640 1 -- 172.21.15.49:0/3152209334 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d352e96a00 msgr2=0x55d352ea77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:51.214 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.208+0000 7f3984f4c640 1 --2- 172.21.15.49:0/3152209334 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d352e96a00 0x55d352ea77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.214 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.208+0000 7f3984f4c640 1 -- 172.21.15.49:0/3152209334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d352e9bb70 msgr2=0x55d352e94ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:51.214 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.208+0000 7f3984f4c640 1 --2- 172.21.15.49:0/3152209334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d352e9bb70 0x55d352e94ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.214 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.208+0000 7f3984f4c640 1 -- 172.21.15.49:0/3152209334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d352e914b0 con 0x55d352e96010 2024-06-03T00:00:51.214 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.208+0000 7f3984f4c640 1 --2- 172.21.15.49:0/3152209334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d352e96010 0x55d352e94590 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3974009c00 tx=0x7f3974004580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9d1bdb10ab63a8d server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:51.214 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.208+0000 7f396a7fc640 1 -- 172.21.15.49:0/3152209334 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3974032070 con 0x55d352e96010 2024-06-03T00:00:51.214 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.208+0000 7f396a7fc640 1 -- 172.21.15.49:0/3152209334 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f397402a070 con 0x55d352e96010 2024-06-03T00:00:51.215 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.208+0000 7f396a7fc640 1 -- 172.21.15.49:0/3152209334 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397401e040 con 0x55d352e96010 2024-06-03T00:00:51.215 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.209+0000 7f3989f9f740 1 -- 172.21.15.49:0/3152209334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d352e96010 msgr2=0x55d352e94590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:51.215 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.209+0000 7f3989f9f740 1 --2- 172.21.15.49:0/3152209334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d352e96010 0x55d352e94590 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3974009c00 tx=0x7f3974004580 comp rx=0 tx=0).stop 2024-06-03T00:00:51.215 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.209+0000 7f3989f9f740 1 -- 172.21.15.49:0/3152209334 shutdown_connections 2024-06-03T00:00:51.215 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.209+0000 7f3989f9f740 1 --2- 172.21.15.49:0/3152209334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d352e9bb70 0x55d352e94ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.215 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.209+0000 7f3989f9f740 1 --2- 172.21.15.49:0/3152209334 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d352e96a00 0x55d352ea77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.215 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.209+0000 7f3989f9f740 1 --2- 172.21.15.49:0/3152209334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d352e96010 0x55d352e94590 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.215 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.209+0000 7f3989f9f740 1 -- 172.21.15.49:0/3152209334 >> 172.21.15.49:0/3152209334 conn(0x55d352e91680 msgr2=0x55d352e97c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:51.215 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.209+0000 7f3989f9f740 1 -- 172.21.15.49:0/3152209334 shutdown_connections 2024-06-03T00:00:51.215 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.209+0000 7f3989f9f740 1 -- 172.21.15.49:0/3152209334 wait complete. 2024-06-03T00:00:51.215 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.209+0000 7f3989f9f740 1 -- start start 2024-06-03T00:00:51.215 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.209+0000 7f3989f9f740 1 Processor -- start 2024-06-03T00:00:51.215 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.210+0000 7f3989f9f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d352e96010 0x55d352ea4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.210+0000 7f3989f9f740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d352e96a00 0x55d352ea4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.210+0000 7f3989f9f740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d352e9bb70 0x55d352f14e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.210+0000 7f3989f9f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f39801ac440 con 0x55d352e96010 2024-06-03T00:00:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.210+0000 7f3989f9f740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f39801abd70 con 0x55d352e96a00 2024-06-03T00:00:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.210+0000 7f3989f9f740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f39801a8f90 con 0x55d352e9bb70 2024-06-03T00:00:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.210+0000 7f3984f4c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d352e96010 0x55d352ea4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.210+0000 7f3989f9f740 10 client.0 _ll_register_callbacks cb 0x7f396c009790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:00:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.210+0000 7f3984f4c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d352e96010 0x55d352ea4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50408/0 (socket says 172.21.15.49:50408) 2024-06-03T00:00:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.210+0000 7f3984f4c640 1 -- 172.21.15.49:0/903746642 learned_addr learned my addr 172.21.15.49:0/903746642 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.210+0000 7f397ffff640 1 --2- 172.21.15.49:0/903746642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d352e96a00 0x55d352ea4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.210+0000 7f398574d640 1 --2- 172.21.15.49:0/903746642 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d352e9bb70 0x55d352f14e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.210+0000 7f3984f4c640 1 -- 172.21.15.49:0/903746642 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d352e9bb70 msgr2=0x55d352f14e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.210+0000 7f3984f4c640 1 --2- 172.21.15.49:0/903746642 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d352e9bb70 0x55d352f14e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.210+0000 7f3984f4c640 1 -- 172.21.15.49:0/903746642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d352e96a00 msgr2=0x55d352ea4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:00:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.210+0000 7f3984f4c640 1 --2- 172.21.15.49:0/903746642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d352e96a00 0x55d352ea4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.210+0000 7f3984f4c640 1 -- 172.21.15.49:0/903746642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d352f153b0 con 0x55d352e96010 2024-06-03T00:00:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.210+0000 7f3984f4c640 1 --2- 172.21.15.49:0/903746642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d352e96010 0x55d352ea4690 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3974030040 tx=0x7f3974005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a663e1e3b5796e20 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.210+0000 7f395ffff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:00:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.211+0000 7f395ffff640 1 -- 172.21.15.49:0/903746642 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3974032040 con 0x55d352e96010 2024-06-03T00:00:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.211+0000 7f395ffff640 1 -- 172.21.15.49:0/903746642 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f397402c320 con 0x55d352e96010 2024-06-03T00:00:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.211+0000 7f3989f9f740 1 -- 172.21.15.49:0/903746642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f397402a070 con 0x55d352e96010 2024-06-03T00:00:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.211+0000 7f395ffff640 1 -- 172.21.15.49:0/903746642 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f397402c540 con 0x55d352e96010 2024-06-03T00:00:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.211+0000 7f3989f9f740 10 client.15336 fetch_fsmap learned FSMap version 27 2024-06-03T00:00:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.211+0000 7f3989f9f740 1 -- 172.21.15.49:0/903746642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d352f165c0 con 0x55d352e96010 2024-06-03T00:00:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.211+0000 7f395ffff640 1 -- 172.21.15.49:0/903746642 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f397402a070 con 0x55d352e96010 2024-06-03T00:00:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.211+0000 7f395ffff640 1 -- 172.21.15.49:0/903746642 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f3974024040 con 0x55d352e96010 2024-06-03T00:00:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.211+0000 7f3989f9f740 10 client.15336 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:00:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.211+0000 7f3989f9f740 10 client.15336 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:00:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.211+0000 7f3989f9f740 20 client.15336 populate_metadata read hostname 'smithi049' 2024-06-03T00:00:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.211+0000 7f3989f9f740 1 --2- 172.21.15.49:0/903746642 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55d352eac1b0 0x55d352f18d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.211+0000 7f3989f9f740 4 client.15336 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-03T00:00:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.211+0000 7f3989f9f740 1 -- 172.21.15.49:0/903746642 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d352e06c20 con 0x55d352eac1b0 2024-06-03T00:00:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.212+0000 7f397ffff640 1 --2- 172.21.15.49:0/903746642 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55d352eac1b0 0x55d352f18d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.212+0000 7f397ffff640 1 --2- 172.21.15.49:0/903746642 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55d352eac1b0 0x55d352f18d30 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fec005bae6743080 server_cookie=e5c888fe8a1592e7 in_seq=0 out_seq=0 2024-06-03T00:00:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.212+0000 7f395ffff640 10 client.15336 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:00:51.226 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.223+0000 7f395ffff640 1 -- 172.21.15.49:0/903746642 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55d352e06c20 con 0x55d352eac1b0 2024-06-03T00:00:51.226 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.223+0000 7f395ffff640 10 client.15336 handle_command_reply: tid=0 2024-06-03T00:00:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.223+0000 7f3989f9f740 1 client.15336 shutdown 2024-06-03T00:00:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.223+0000 7f3989f9f740 1 -- 172.21.15.49:0/903746642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d352e96010 msgr2=0x55d352ea4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.223+0000 7f3989f9f740 1 --2- 172.21.15.49:0/903746642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d352e96010 0x55d352ea4690 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3974030040 tx=0x7f3974005db0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.223+0000 7f3989f9f740 1 -- 172.21.15.49:0/903746642 shutdown_connections 2024-06-03T00:00:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.223+0000 7f3989f9f740 1 --2- 172.21.15.49:0/903746642 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55d352eac1b0 0x55d352f18d30 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.223+0000 7f3989f9f740 1 --2- 172.21.15.49:0/903746642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d352e96a00 0x55d352ea4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.223+0000 7f3989f9f740 1 --2- 172.21.15.49:0/903746642 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d352e9bb70 0x55d352f14e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.223+0000 7f395ffff640 0 client.15336 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:00:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.223+0000 7f3989f9f740 1 --2- 172.21.15.49:0/903746642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d352e96010 0x55d352ea4690 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.223+0000 7f3989f9f740 1 -- 172.21.15.49:0/903746642 >> 172.21.15.49:0/903746642 conn(0x55d352e91680 msgr2=0x55d352e97c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.224+0000 7f3989f9f740 1 -- 172.21.15.49:0/903746642 shutdown_connections 2024-06-03T00:00:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.224+0000 7f3989f9f740 1 -- 172.21.15.49:0/903746642 wait complete. 2024-06-03T00:00:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.224+0000 7f3989f9f740 20 client.15336 trim_cache size 0 max 16384 2024-06-03T00:00:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-06-03T00:00:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-06-03T00:00:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-06-03T00:00:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.224+0000 7f39871b0640 1 -- 172.21.15.49:0/749710312 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f39700a2c30 msgr2=0x7f39700a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.224+0000 7f39871b0640 1 --2- 172.21.15.49:0/749710312 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f39700a2c30 0x7f39700a50f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3978005e30 tx=0x7f39780095c0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.224+0000 7f39871b0640 1 -- 172.21.15.49:0/749710312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3980104e10 msgr2=0x7f3980100490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.224+0000 7f39871b0640 1 --2- 172.21.15.49:0/749710312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3980104e10 0x7f3980100490 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f396c00e9c0 tx=0x7f396c00ee80 comp rx=0 tx=0).stop 2024-06-03T00:00:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.224+0000 7f39871b0640 1 -- 172.21.15.49:0/749710312 shutdown_connections 2024-06-03T00:00:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.224+0000 7f39871b0640 1 --2- 172.21.15.49:0/749710312 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f39700a2c30 0x7f39700a50f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.224+0000 7f39871b0640 1 --2- 172.21.15.49:0/749710312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3980107740 0x7f39801009d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.224+0000 7f39871b0640 1 --2- 172.21.15.49:0/749710312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3980104e10 0x7f3980100490 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.224+0000 7f39871b0640 1 --2- 172.21.15.49:0/749710312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39801024e0 0x7f3980101e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.224+0000 7f39871b0640 1 -- 172.21.15.49:0/749710312 >> 172.21.15.49:0/749710312 conn(0x7f39800fbe70 msgr2=0x7f3980102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.224+0000 7f39871b0640 1 -- 172.21.15.49:0/749710312 shutdown_connections 2024-06-03T00:00:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:00:51.224+0000 7f39871b0640 1 -- 172.21.15.49:0/749710312 wait complete. 2024-06-03T00:00:51.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:51 smithi057 ceph-mon[36457]: pgmap v407: 97 pgs: 97 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s 2024-06-03T00:00:51.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:51 smithi057 ceph-mon[36457]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-03T00:00:51.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:51 smithi107 ceph-mon[37048]: pgmap v407: 97 pgs: 97 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s 2024-06-03T00:00:51.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:51 smithi107 ceph-mon[37048]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-03T00:00:52.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.474+0000 7f50475a5700 1 -- 172.21.15.49:0/2048499576 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5040102740 msgr2=0x7f5040102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:52.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.474+0000 7f50475a5700 1 --2- 172.21.15.49:0/2048499576 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5040102740 0x7f5040102b20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f503c0099c0 tx=0x7f503c009cd0 comp rx=0 tx=0).stop 2024-06-03T00:00:52.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.475+0000 7f50475a5700 1 -- 172.21.15.49:0/2048499576 shutdown_connections 2024-06-03T00:00:52.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.475+0000 7f50475a5700 1 --2- 172.21.15.49:0/2048499576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5040107840 0x7f504010f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:52.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.475+0000 7f50475a5700 1 --2- 172.21.15.49:0/2048499576 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5040102740 0x7f5040102b20 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:52.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.475+0000 7f50475a5700 1 --2- 172.21.15.49:0/2048499576 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50401030f0 0x7f5040107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:52.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.475+0000 7f50475a5700 1 -- 172.21.15.49:0/2048499576 >> 172.21.15.49:0/2048499576 conn(0x7f50400795f0 msgr2=0x7f5040079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:52.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.475+0000 7f50475a5700 1 -- 172.21.15.49:0/2048499576 shutdown_connections 2024-06-03T00:00:52.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.475+0000 7f50475a5700 1 -- 172.21.15.49:0/2048499576 wait complete. 2024-06-03T00:00:52.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.475+0000 7f50475a5700 1 Processor -- start 2024-06-03T00:00:52.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.475+0000 7f50475a5700 1 -- start start 2024-06-03T00:00:52.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.476+0000 7f50475a5700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5040102740 0x7f504019ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:52.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.476+0000 7f50475a5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50401030f0 0x7f504019b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:52.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.476+0000 7f50475a5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5040107840 0x7f504019f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:52.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.476+0000 7f50475a5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5040112760 con 0x7f50401030f0 2024-06-03T00:00:52.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.476+0000 7f50475a5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f50401125e0 con 0x7f5040107840 2024-06-03T00:00:52.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.476+0000 7f50475a5700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f50401128e0 con 0x7f5040102740 2024-06-03T00:00:52.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.476+0000 7f5044b40700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50401030f0 0x7f504019b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:52.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.476+0000 7f5044b40700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50401030f0 0x7f504019b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50424/0 (socket says 172.21.15.49:50424) 2024-06-03T00:00:52.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.476+0000 7f5044b40700 1 -- 172.21.15.49:0/3926051968 learned_addr learned my addr 172.21.15.49:0/3926051968 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:52.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.476+0000 7f5045b42700 1 --2- 172.21.15.49:0/3926051968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5040107840 0x7f504019f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:52.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.476+0000 7f5045341700 1 --2- 172.21.15.49:0/3926051968 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5040102740 0x7f504019ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:52.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.476+0000 7f5044b40700 1 -- 172.21.15.49:0/3926051968 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5040102740 msgr2=0x7f504019ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:52.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.476+0000 7f5044b40700 1 --2- 172.21.15.49:0/3926051968 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5040102740 0x7f504019ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:52.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.476+0000 7f5044b40700 1 -- 172.21.15.49:0/3926051968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5040107840 msgr2=0x7f504019f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:52.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.476+0000 7f5044b40700 1 --2- 172.21.15.49:0/3926051968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5040107840 0x7f504019f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:52.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.476+0000 7f5044b40700 1 -- 172.21.15.49:0/3926051968 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f504019fd70 con 0x7f50401030f0 2024-06-03T00:00:52.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.476+0000 7f5045b42700 1 --2- 172.21.15.49:0/3926051968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5040107840 0x7f504019f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:00:52.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.476+0000 7f5044b40700 1 --2- 172.21.15.49:0/3926051968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50401030f0 0x7f504019b2a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f503000d980 tx=0x7f503000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:52.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.476+0000 7f50367fc700 1 -- 172.21.15.49:0/3926051968 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5030016070 con 0x7f50401030f0 2024-06-03T00:00:52.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.476+0000 7f50367fc700 1 -- 172.21.15.49:0/3926051968 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5030004500 con 0x7f50401030f0 2024-06-03T00:00:52.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.476+0000 7f50367fc700 1 -- 172.21.15.49:0/3926051968 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5030004d00 con 0x7f50401030f0 2024-06-03T00:00:52.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.476+0000 7f50475a5700 1 -- 172.21.15.49:0/3926051968 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50401a0060 con 0x7f50401030f0 2024-06-03T00:00:52.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.477+0000 7f50475a5700 1 -- 172.21.15.49:0/3926051968 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50401a78e0 con 0x7f50401030f0 2024-06-03T00:00:52.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.478+0000 7f50475a5700 1 -- 172.21.15.49:0/3926051968 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5040069180 con 0x7f50401030f0 2024-06-03T00:00:52.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.479+0000 7f50367fc700 1 -- 172.21.15.49:0/3926051968 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f503000bbf0 con 0x7f50401030f0 2024-06-03T00:00:52.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.479+0000 7f50367fc700 1 --2- 172.21.15.49:0/3926051968 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f502c0a2c20 0x7f502c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:52.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.479+0000 7f5045341700 1 --2- 172.21.15.49:0/3926051968 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f502c0a2c20 0x7f502c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:52.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.479+0000 7f50367fc700 1 -- 172.21.15.49:0/3926051968 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f50300cef10 con 0x7f50401030f0 2024-06-03T00:00:52.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.480+0000 7f5045341700 1 --2- 172.21.15.49:0/3926051968 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f502c0a2c20 0x7f502c0a50e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f503c000c00 tx=0x7f503c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:52.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.484+0000 7f50367fc700 1 -- 172.21.15.49:0/3926051968 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f503001f020 con 0x7f50401030f0 2024-06-03T00:00:52.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.734+0000 7f50475a5700 1 -- 172.21.15.49:0/3926051968 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50401a7b10 con 0x7f50401030f0 2024-06-03T00:00:52.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.734+0000 7f50367fc700 1 -- 172.21.15.49:0/3926051968 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11929 (secure 0 0 0) 0x7f503000f3c0 con 0x7f50401030f0 2024-06-03T00:00:52.735 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:00:52.735 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1553264866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1553264866},{"type":"v1","addr":"172.21.15.49:6835","nonce":1553264866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2266285252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2266285252},{"type":"v1","addr":"172.21.15.49:6837","nonce":2266285252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T23:57:16.991201+0000","modified":"2024-06-03T00:00:26.305285+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24485,"mds_2":24466,"mds_3":24464,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6839/1729124617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":1729124617},{"type":"v1","addr":"172.21.15.49:6839","nonce":1729124617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6841/1902772235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":1902772235},{"type":"v1","addr":"172.21.15.49:6841","nonce":1902772235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6833/1633534002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1633534002},{"type":"v1","addr":"172.21.15.57:6833","nonce":1633534002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6835/2254905671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2254905671},{"type":"v1","addr":"172.21.15.57:6835","nonce":2254905671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.107:6835/3693542801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3693542801},{"type":"v1","addr":"172.21.15.107:6835","nonce":3693542801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.57:6837/230452144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":230452144},{"type":"v1","addr":"172.21.15.57:6837","nonce":230452144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.107:6837/3700593315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":3700593315},{"type":"v1","addr":"172.21.15.107:6837","nonce":3700593315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6839/249825195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":249825195},{"type":"v1","addr":"172.21.15.57:6839","nonce":249825195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6839/1986600681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1986600681},{"type":"v1","addr":"172.21.15.107:6839","nonce":1986600681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24485,24464,24460,24466,24487]},"id":1}]} 2024-06-03T00:00:52.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.736+0000 7f50475a5700 1 -- 172.21.15.49:0/3926051968 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f502c0a2c20 msgr2=0x7f502c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:52.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.736+0000 7f50475a5700 1 --2- 172.21.15.49:0/3926051968 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f502c0a2c20 0x7f502c0a50e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f503c000c00 tx=0x7f503c005fd0 comp rx=0 tx=0).stop 2024-06-03T00:00:52.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.736+0000 7f50475a5700 1 -- 172.21.15.49:0/3926051968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50401030f0 msgr2=0x7f504019b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:52.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.736+0000 7f50475a5700 1 --2- 172.21.15.49:0/3926051968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50401030f0 0x7f504019b2a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f503000d980 tx=0x7f503000dd40 comp rx=0 tx=0).stop 2024-06-03T00:00:52.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.736+0000 7f50475a5700 1 -- 172.21.15.49:0/3926051968 shutdown_connections 2024-06-03T00:00:52.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.736+0000 7f50475a5700 1 --2- 172.21.15.49:0/3926051968 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f502c0a2c20 0x7f502c0a50e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:52.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.736+0000 7f50475a5700 1 --2- 172.21.15.49:0/3926051968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5040107840 0x7f504019f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:52.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.736+0000 7f50475a5700 1 --2- 172.21.15.49:0/3926051968 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5040102740 0x7f504019ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:52.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.736+0000 7f50475a5700 1 --2- 172.21.15.49:0/3926051968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50401030f0 0x7f504019b2a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:52.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.737+0000 7f50475a5700 1 -- 172.21.15.49:0/3926051968 >> 172.21.15.49:0/3926051968 conn(0x7f50400795f0 msgr2=0x7f50401006f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:52.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.737+0000 7f50475a5700 1 -- 172.21.15.49:0/3926051968 shutdown_connections 2024-06-03T00:00:52.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:52.737+0000 7f50475a5700 1 -- 172.21.15.49:0/3926051968 wait complete. 2024-06-03T00:00:52.738 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 27 2024-06-03T00:00:53.382 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:53 smithi049 ceph-mon[32302]: pgmap v408: 97 pgs: 97 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-06-03T00:00:53.382 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:53 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3926051968' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:00:53.382 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:53 smithi049 ceph-mon[32302]: scrub summary: idle 2024-06-03T00:00:53.412 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-03T00:00:53.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:53 smithi057 ceph-mon[36457]: pgmap v408: 97 pgs: 97 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-06-03T00:00:53.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:53 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/3926051968' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:00:53.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:53 smithi057 ceph-mon[36457]: scrub summary: idle 2024-06-03T00:00:53.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:53 smithi107 ceph-mon[37048]: pgmap v408: 97 pgs: 97 active+clean; 649 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-06-03T00:00:53.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:53 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/3926051968' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:00:53.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:53 smithi107 ceph-mon[37048]: scrub summary: idle 2024-06-03T00:00:53.666 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:00:55.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.343+0000 7fef355dc700 1 -- 172.21.15.49:0/495333189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef30103120 msgr2=0x7fef30107130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:55.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.343+0000 7fef355dc700 1 --2- 172.21.15.49:0/495333189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef30103120 0x7fef30107130 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fef180099c0 tx=0x7fef18009cd0 comp rx=0 tx=0).stop 2024-06-03T00:00:55.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.343+0000 7fef355dc700 1 -- 172.21.15.49:0/495333189 shutdown_connections 2024-06-03T00:00:55.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.343+0000 7fef355dc700 1 --2- 172.21.15.49:0/495333189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef30107860 0x7fef3010f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:55.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.343+0000 7fef355dc700 1 --2- 172.21.15.49:0/495333189 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef30102770 0x7fef30102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:55.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.343+0000 7fef355dc700 1 --2- 172.21.15.49:0/495333189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef30103120 0x7fef30107130 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:55.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.343+0000 7fef355dc700 1 -- 172.21.15.49:0/495333189 >> 172.21.15.49:0/495333189 conn(0x7fef30079600 msgr2=0x7fef30079a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:55.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.343+0000 7fef355dc700 1 -- 172.21.15.49:0/495333189 shutdown_connections 2024-06-03T00:00:55.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.343+0000 7fef355dc700 1 -- 172.21.15.49:0/495333189 wait complete. 2024-06-03T00:00:55.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.344+0000 7fef355dc700 1 Processor -- start 2024-06-03T00:00:55.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.344+0000 7fef355dc700 1 -- start start 2024-06-03T00:00:55.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.344+0000 7fef355dc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef30102770 0x7fef3019e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:55.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.344+0000 7fef355dc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef30103120 0x7fef3019ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:55.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.344+0000 7fef355dc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef30107860 0x7fef30198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:55.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.344+0000 7fef355dc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fef301127c0 con 0x7fef30102770 2024-06-03T00:00:55.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.344+0000 7fef355dc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fef30112640 con 0x7fef30103120 2024-06-03T00:00:55.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.344+0000 7fef355dc700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fef30112940 con 0x7fef30107860 2024-06-03T00:00:55.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.344+0000 7fef2effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef30102770 0x7fef3019e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:55.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.344+0000 7fef2effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef30102770 0x7fef3019e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39804/0 (socket says 172.21.15.49:39804) 2024-06-03T00:00:55.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.345+0000 7fef2effd700 1 -- 172.21.15.49:0/670412335 learned_addr learned my addr 172.21.15.49:0/670412335 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:55.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.345+0000 7fef2e7fc700 1 --2- 172.21.15.49:0/670412335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef30103120 0x7fef3019ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:55.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.345+0000 7fef2f7fe700 1 --2- 172.21.15.49:0/670412335 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef30107860 0x7fef30198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:55.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.345+0000 7fef2effd700 1 -- 172.21.15.49:0/670412335 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef30107860 msgr2=0x7fef30198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:55.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.345+0000 7fef2effd700 1 --2- 172.21.15.49:0/670412335 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef30107860 0x7fef30198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:55.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.345+0000 7fef2effd700 1 -- 172.21.15.49:0/670412335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef30103120 msgr2=0x7fef3019ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:55.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.345+0000 7fef2effd700 1 --2- 172.21.15.49:0/670412335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef30103120 0x7fef3019ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:55.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.345+0000 7fef2effd700 1 -- 172.21.15.49:0/670412335 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef30199160 con 0x7fef30102770 2024-06-03T00:00:55.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.345+0000 7fef2f7fe700 1 --2- 172.21.15.49:0/670412335 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef30107860 0x7fef30198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:00:55.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.345+0000 7fef2effd700 1 --2- 172.21.15.49:0/670412335 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef30102770 0x7fef3019e840 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fef2000d950 tx=0x7fef2000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:55.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.345+0000 7fef27fff700 1 -- 172.21.15.49:0/670412335 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef20016070 con 0x7fef30102770 2024-06-03T00:00:55.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.345+0000 7fef355dc700 1 -- 172.21.15.49:0/670412335 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef30199450 con 0x7fef30102770 2024-06-03T00:00:55.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.345+0000 7fef27fff700 1 -- 172.21.15.49:0/670412335 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef20009e20 con 0x7fef30102770 2024-06-03T00:00:55.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.345+0000 7fef27fff700 1 -- 172.21.15.49:0/670412335 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2000f620 con 0x7fef30102770 2024-06-03T00:00:55.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.345+0000 7fef355dc700 1 -- 172.21.15.49:0/670412335 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef301a5710 con 0x7fef30102770 2024-06-03T00:00:55.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.346+0000 7fef355dc700 1 -- 172.21.15.49:0/670412335 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef30069180 con 0x7fef30102770 2024-06-03T00:00:55.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.348+0000 7fef27fff700 1 -- 172.21.15.49:0/670412335 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fef20019070 con 0x7fef30102770 2024-06-03T00:00:55.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.349+0000 7fef27fff700 1 --2- 172.21.15.49:0/670412335 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fef1c0a2c20 0x7fef1c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:55.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.349+0000 7fef27fff700 1 -- 172.21.15.49:0/670412335 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fef200cec10 con 0x7fef30102770 2024-06-03T00:00:55.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.349+0000 7fef2e7fc700 1 --2- 172.21.15.49:0/670412335 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fef1c0a2c20 0x7fef1c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:55.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.349+0000 7fef2e7fc700 1 --2- 172.21.15.49:0/670412335 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fef1c0a2c20 0x7fef1c0a50e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fef18009f50 tx=0x7fef18005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:55.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.354+0000 7fef27fff700 1 -- 172.21.15.49:0/670412335 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fef2009bb70 con 0x7fef30102770 2024-06-03T00:00:55.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:55 smithi057 ceph-mon[36457]: pgmap v409: 97 pgs: 97 active+clean; 650 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-06-03T00:00:55.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:55 smithi049 ceph-mon[32302]: pgmap v409: 97 pgs: 97 active+clean; 650 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-06-03T00:00:55.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:55 smithi107 ceph-mon[37048]: pgmap v409: 97 pgs: 97 active+clean; 650 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-06-03T00:00:55.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.607+0000 7fef355dc700 1 -- 172.21.15.49:0/670412335 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef30199f30 con 0x7fef30102770 2024-06-03T00:00:55.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.607+0000 7fef27fff700 1 -- 172.21.15.49:0/670412335 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11929 (secure 0 0 0) 0x7fef2009b470 con 0x7fef30102770 2024-06-03T00:00:55.607 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:00:55.607 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1553264866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1553264866},{"type":"v1","addr":"172.21.15.49:6835","nonce":1553264866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2266285252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2266285252},{"type":"v1","addr":"172.21.15.49:6837","nonce":2266285252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T23:57:16.991201+0000","modified":"2024-06-03T00:00:26.305285+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24485,"mds_2":24466,"mds_3":24464,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6839/1729124617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":1729124617},{"type":"v1","addr":"172.21.15.49:6839","nonce":1729124617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6841/1902772235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":1902772235},{"type":"v1","addr":"172.21.15.49:6841","nonce":1902772235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6833/1633534002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1633534002},{"type":"v1","addr":"172.21.15.57:6833","nonce":1633534002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6835/2254905671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2254905671},{"type":"v1","addr":"172.21.15.57:6835","nonce":2254905671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.107:6835/3693542801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3693542801},{"type":"v1","addr":"172.21.15.107:6835","nonce":3693542801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.57:6837/230452144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":230452144},{"type":"v1","addr":"172.21.15.57:6837","nonce":230452144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.107:6837/3700593315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":3700593315},{"type":"v1","addr":"172.21.15.107:6837","nonce":3700593315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6839/249825195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":249825195},{"type":"v1","addr":"172.21.15.57:6839","nonce":249825195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6839/1986600681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1986600681},{"type":"v1","addr":"172.21.15.107:6839","nonce":1986600681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24485,24464,24460,24466,24487]},"id":1}]} 2024-06-03T00:00:55.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.610+0000 7fef355dc700 1 -- 172.21.15.49:0/670412335 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fef1c0a2c20 msgr2=0x7fef1c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:55.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.610+0000 7fef355dc700 1 --2- 172.21.15.49:0/670412335 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fef1c0a2c20 0x7fef1c0a50e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fef18009f50 tx=0x7fef18005fb0 comp rx=0 tx=0).stop 2024-06-03T00:00:55.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.610+0000 7fef355dc700 1 -- 172.21.15.49:0/670412335 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef30102770 msgr2=0x7fef3019e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:55.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.610+0000 7fef355dc700 1 --2- 172.21.15.49:0/670412335 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef30102770 0x7fef3019e840 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fef2000d950 tx=0x7fef2000dc60 comp rx=0 tx=0).stop 2024-06-03T00:00:55.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.610+0000 7fef355dc700 1 -- 172.21.15.49:0/670412335 shutdown_connections 2024-06-03T00:00:55.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.610+0000 7fef355dc700 1 --2- 172.21.15.49:0/670412335 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fef1c0a2c20 0x7fef1c0a50e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:55.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.610+0000 7fef355dc700 1 --2- 172.21.15.49:0/670412335 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef30107860 0x7fef30198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:55.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.610+0000 7fef355dc700 1 --2- 172.21.15.49:0/670412335 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef30102770 0x7fef3019e840 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:55.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.610+0000 7fef355dc700 1 --2- 172.21.15.49:0/670412335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef30103120 0x7fef3019ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:55.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.610+0000 7fef355dc700 1 -- 172.21.15.49:0/670412335 >> 172.21.15.49:0/670412335 conn(0x7fef30079600 msgr2=0x7fef30100520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:55.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.610+0000 7fef355dc700 1 -- 172.21.15.49:0/670412335 shutdown_connections 2024-06-03T00:00:55.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:55.610+0000 7fef355dc700 1 -- 172.21.15.49:0/670412335 wait complete. 2024-06-03T00:00:55.611 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 27 2024-06-03T00:00:56.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:56 smithi049 ceph-mon[32302]: pgmap v410: 97 pgs: 97 active+clean; 650 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.4 KiB/s wr, 14 op/s 2024-06-03T00:00:56.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:56 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/670412335' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:00:56.261 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-03T00:00:56.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:56 smithi057 ceph-mon[36457]: pgmap v410: 97 pgs: 97 active+clean; 650 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.4 KiB/s wr, 14 op/s 2024-06-03T00:00:56.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:56 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/670412335' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:00:56.528 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:00:56.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:56 smithi107 ceph-mon[37048]: pgmap v410: 97 pgs: 97 active+clean; 650 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.4 KiB/s wr, 14 op/s 2024-06-03T00:00:56.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:56 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/670412335' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:00:58.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.142+0000 7fd20942b700 1 -- 172.21.15.49:0/1034469144 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd204102740 msgr2=0x7fd204102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:58.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.142+0000 7fd20942b700 1 --2- 172.21.15.49:0/1034469144 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd204102740 0x7fd204102b20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd1f400b0d0 tx=0x7fd1f400b3e0 comp rx=0 tx=0).stop 2024-06-03T00:00:58.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.142+0000 7fd20942b700 1 -- 172.21.15.49:0/1034469144 shutdown_connections 2024-06-03T00:00:58.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.142+0000 7fd20942b700 1 --2- 172.21.15.49:0/1034469144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd204107840 0x7fd20410f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:58.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.142+0000 7fd20942b700 1 --2- 172.21.15.49:0/1034469144 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd204102740 0x7fd204102b20 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:58.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.142+0000 7fd20942b700 1 --2- 172.21.15.49:0/1034469144 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2041030f0 0x7fd204107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:58.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.142+0000 7fd20942b700 1 -- 172.21.15.49:0/1034469144 >> 172.21.15.49:0/1034469144 conn(0x7fd2040795f0 msgr2=0x7fd204079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:58.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.142+0000 7fd20942b700 1 -- 172.21.15.49:0/1034469144 shutdown_connections 2024-06-03T00:00:58.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.142+0000 7fd20942b700 1 -- 172.21.15.49:0/1034469144 wait complete. 2024-06-03T00:00:58.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.143+0000 7fd20942b700 1 Processor -- start 2024-06-03T00:00:58.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.143+0000 7fd20942b700 1 -- start start 2024-06-03T00:00:58.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.143+0000 7fd20942b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd204102740 0x7fd204074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:58.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.143+0000 7fd20942b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2041030f0 0x7fd204074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:58.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.143+0000 7fd20942b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd204107840 0x7fd204075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:58.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.143+0000 7fd20942b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd204112850 con 0x7fd204107840 2024-06-03T00:00:58.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.143+0000 7fd20942b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd2041126d0 con 0x7fd204102740 2024-06-03T00:00:58.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.143+0000 7fd20942b700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd2041129d0 con 0x7fd2041030f0 2024-06-03T00:00:58.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.144+0000 7fd2037fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd204107840 0x7fd204075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:58.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.144+0000 7fd2037fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd204107840 0x7fd204075210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39820/0 (socket says 172.21.15.49:39820) 2024-06-03T00:00:58.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.144+0000 7fd2037fe700 1 -- 172.21.15.49:0/2881342337 learned_addr learned my addr 172.21.15.49:0/2881342337 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:00:58.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.144+0000 7fd202ffd700 1 --2- 172.21.15.49:0/2881342337 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd204102740 0x7fd204074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:58.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.144+0000 7fd2027fc700 1 --2- 172.21.15.49:0/2881342337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2041030f0 0x7fd204074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:58.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.144+0000 7fd2037fe700 1 -- 172.21.15.49:0/2881342337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2041030f0 msgr2=0x7fd204074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:58.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.144+0000 7fd2037fe700 1 --2- 172.21.15.49:0/2881342337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2041030f0 0x7fd204074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:58.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.144+0000 7fd2037fe700 1 -- 172.21.15.49:0/2881342337 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd204102740 msgr2=0x7fd204074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:58.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.144+0000 7fd2037fe700 1 --2- 172.21.15.49:0/2881342337 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd204102740 0x7fd204074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:58.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.144+0000 7fd2037fe700 1 -- 172.21.15.49:0/2881342337 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2041a7260 con 0x7fd204107840 2024-06-03T00:00:58.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.144+0000 7fd2037fe700 1 --2- 172.21.15.49:0/2881342337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd204107840 0x7fd204075210 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00b550 tx=0x7fd1fc00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:58.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.144+0000 7fd1fbfff700 1 -- 172.21.15.49:0/2881342337 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc015020 con 0x7fd204107840 2024-06-03T00:00:58.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.144+0000 7fd1fbfff700 1 -- 172.21.15.49:0/2881342337 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1fc011d10 con 0x7fd204107840 2024-06-03T00:00:58.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.144+0000 7fd20942b700 1 -- 172.21.15.49:0/2881342337 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2041a7550 con 0x7fd204107840 2024-06-03T00:00:58.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.144+0000 7fd1fbfff700 1 -- 172.21.15.49:0/2881342337 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc010e00 con 0x7fd204107840 2024-06-03T00:00:58.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.145+0000 7fd20942b700 1 -- 172.21.15.49:0/2881342337 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2041a7a90 con 0x7fd204107840 2024-06-03T00:00:58.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.146+0000 7fd20942b700 1 -- 172.21.15.49:0/2881342337 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd20410aa80 con 0x7fd204107840 2024-06-03T00:00:58.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.147+0000 7fd1fbfff700 1 -- 172.21.15.49:0/2881342337 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd1fc018020 con 0x7fd204107840 2024-06-03T00:00:58.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.147+0000 7fd1fbfff700 1 --2- 172.21.15.49:0/2881342337 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fd1f00a2ca0 0x7fd1f00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:00:58.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.148+0000 7fd202ffd700 1 --2- 172.21.15.49:0/2881342337 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fd1f00a2ca0 0x7fd1f00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:00:58.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.148+0000 7fd1fbfff700 1 -- 172.21.15.49:0/2881342337 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fd1fc0cebf0 con 0x7fd204107840 2024-06-03T00:00:58.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.148+0000 7fd202ffd700 1 --2- 172.21.15.49:0/2881342337 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fd1f00a2ca0 0x7fd1f00a5160 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4009fd0 tx=0x7fd1f400b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:00:58.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.151+0000 7fd1fbfff700 1 -- 172.21.15.49:0/2881342337 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd1fc01f020 con 0x7fd204107840 2024-06-03T00:00:58.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.360+0000 7fd20942b700 1 -- 172.21.15.49:0/2881342337 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd20410a460 con 0x7fd204107840 2024-06-03T00:00:58.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.362+0000 7fd1fbfff700 1 -- 172.21.15.49:0/2881342337 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+22612 (secure 0 0 0) 0x7fd1fc09bb50 con 0x7fd204107840 2024-06-03T00:00:58.362 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:00:58.362 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":90,"fsid":"890dd222-213a-11ef-bc9b-c7b262605968","created":"2024-06-02T23:48:53.323536+0000","modified":"2024-06-02T23:57:56.520324+0000","last_up_change":"2024-06-02T23:56:12.156697+0000","last_in_change":"2024-06-02T23:55:51.667118+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:52:23.676079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:57:10.753178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T23:57:14.240610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e0013e80-07d6-4ad3-87d8-d41988988ef5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6803","nonce":811647073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6805","nonce":811647073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6809","nonce":811647073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6807","nonce":811647073}]},"public_addr":"172.21.15.49:6803/811647073","cluster_addr":"172.21.15.49:6805/811647073","heartbeat_back_addr":"172.21.15.49:6809/811647073","heartbeat_front_addr":"172.21.15.49:6807/811647073","state":["exists","up"]},{"osd":1,"uuid":"f37d9f79-e349-4de7-81e7-385ddb905f58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6801","nonce":1260507785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6803","nonce":1260507785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6807","nonce":1260507785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6805","nonce":1260507785}]},"public_addr":"172.21.15.57:6801/1260507785","cluster_addr":"172.21.15.57:6803/1260507785","heartbeat_back_addr":"172.21.15.57:6807/1260507785","heartbeat_front_addr":"172.21.15.57:6805/1260507785","state":["exists","up"]},{"osd":2,"uuid":"94889281-7d45-4e78-9d37-b98e3fbe8494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6801","nonce":303899951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6803","nonce":303899951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6807","nonce":303899951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6805","nonce":303899951}]},"public_addr":"172.21.15.107:6801/303899951","cluster_addr":"172.21.15.107:6803/303899951","heartbeat_back_addr":"172.21.15.107:6807/303899951","heartbeat_front_addr":"172.21.15.107:6805/303899951","state":["exists","up"]},{"osd":3,"uuid":"31f4c18c-fbda-400d-8b3b-0955b0c4a6a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6811","nonce":60796312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6813","nonce":60796312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6817","nonce":60796312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6815","nonce":60796312}]},"public_addr":"172.21.15.49:6811/60796312","cluster_addr":"172.21.15.49:6813/60796312","heartbeat_back_addr":"172.21.15.49:6817/60796312","heartbeat_front_addr":"172.21.15.49:6815/60796312","state":["exists","up"]},{"osd":4,"uuid":"8076c2f3-0138-459e-89b5-c5c4586a14ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6809","nonce":3106842986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6811","nonce":3106842986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6815","nonce":3106842986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6813","nonce":3106842986}]},"public_addr":"172.21.15.57:6809/3106842986","cluster_addr":"172.21.15.57:6811/3106842986","heartbeat_back_addr":"172.21.15.57:6815/3106842986","heartbeat_front_addr":"172.21.15.57:6813/3106842986","state":["exists","up"]},{"osd":5,"uuid":"68f7abd3-4292-41fa-90ce-4ac34ea2b964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6809","nonce":389294142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6811","nonce":389294142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6815","nonce":389294142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6813","nonce":389294142}]},"public_addr":"172.21.15.107:6809/389294142","cluster_addr":"172.21.15.107:6811/389294142","heartbeat_back_addr":"172.21.15.107:6815/389294142","heartbeat_front_addr":"172.21.15.107:6813/389294142","state":["exists","up"]},{"osd":6,"uuid":"c0345dd0-71b7-436d-88f8-fe3d7cb69d8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6819","nonce":894624552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6821","nonce":894624552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6825","nonce":894624552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6823","nonce":894624552}]},"public_addr":"172.21.15.49:6819/894624552","cluster_addr":"172.21.15.49:6821/894624552","heartbeat_back_addr":"172.21.15.49:6825/894624552","heartbeat_front_addr":"172.21.15.49:6823/894624552","state":["exists","up"]},{"osd":7,"uuid":"9abd81c7-dcc1-4e14-8ab7-9fa0746067ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6817","nonce":3126027900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6819","nonce":3126027900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6823","nonce":3126027900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6821","nonce":3126027900}]},"public_addr":"172.21.15.57:6817/3126027900","cluster_addr":"172.21.15.57:6819/3126027900","heartbeat_back_addr":"172.21.15.57:6823/3126027900","heartbeat_front_addr":"172.21.15.57:6821/3126027900","state":["exists","up"]},{"osd":8,"uuid":"80532119-5de8-45d2-9cb9-bd8a6194199b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6817","nonce":3620047229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6819","nonce":3620047229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6823","nonce":3620047229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6821","nonce":3620047229}]},"public_addr":"172.21.15.107:6817/3620047229","cluster_addr":"172.21.15.107:6819/3620047229","heartbeat_back_addr":"172.21.15.107:6823/3620047229","heartbeat_front_addr":"172.21.15.107:6821/3620047229","state":["exists","up"]},{"osd":9,"uuid":"f0b5dcfa-9fd2-4a98-863b-197defa890af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6827","nonce":3627936526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6829","nonce":3627936526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6833","nonce":3627936526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6831","nonce":3627936526}]},"public_addr":"172.21.15.49:6827/3627936526","cluster_addr":"172.21.15.49:6829/3627936526","heartbeat_back_addr":"172.21.15.49:6833/3627936526","heartbeat_front_addr":"172.21.15.49:6831/3627936526","state":["exists","up"]},{"osd":10,"uuid":"21a75846-adec-41b8-9e1d-e5c61ba30b12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6825","nonce":3013235811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6827","nonce":3013235811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6831","nonce":3013235811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6829","nonce":3013235811}]},"public_addr":"172.21.15.57:6825/3013235811","cluster_addr":"172.21.15.57:6827/3013235811","heartbeat_back_addr":"172.21.15.57:6831/3013235811","heartbeat_front_addr":"172.21.15.57:6829/3013235811","state":["exists","up"]},{"osd":11,"uuid":"eb963b63-2c61-4169-b8fe-31c7f5ec919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6825","nonce":4217534517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6827","nonce":4217534517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6831","nonce":4217534517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6829","nonce":4217534517}]},"public_addr":"172.21.15.107:6825/4217534517","cluster_addr":"172.21.15.107:6827/4217534517","heartbeat_back_addr":"172.21.15.107:6831/4217534517","heartbeat_front_addr":"172.21.15.107:6829/4217534517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:51:31.067312+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:51:56.088456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:52:20.539941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:52:45.055717+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:53:11.178438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:53:35.794217+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:00.775674+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:27.574752+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:52.177634+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:55:17.118854+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:55:44.217535+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:56:10.500970+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/525944311":"2024-06-03T23:49:55.151590+0000","172.21.15.49:0/1841969299":"2024-06-03T23:49:55.151590+0000","172.21.15.49:0/1880506696":"2024-06-03T23:49:55.151590+0000","172.21.15.49:6801/1206062338":"2024-06-03T23:49:55.151590+0000","172.21.15.49:6800/549058216":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/2112783954":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/2183920213":"2024-06-03T23:49:29.042670+0000","172.21.15.49:6801/549058216":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/3350970308":"2024-06-03T23:49:29.042670+0000","172.21.15.49:6800/1206062338":"2024-06-03T23:49:55.151590+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-03T00:00:58.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.364+0000 7fd20942b700 1 -- 172.21.15.49:0/2881342337 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fd1f00a2ca0 msgr2=0x7fd1f00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:58.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.364+0000 7fd20942b700 1 --2- 172.21.15.49:0/2881342337 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fd1f00a2ca0 0x7fd1f00a5160 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4009fd0 tx=0x7fd1f400b040 comp rx=0 tx=0).stop 2024-06-03T00:00:58.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.364+0000 7fd20942b700 1 -- 172.21.15.49:0/2881342337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd204107840 msgr2=0x7fd204075210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:00:58.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.364+0000 7fd20942b700 1 --2- 172.21.15.49:0/2881342337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd204107840 0x7fd204075210 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00b550 tx=0x7fd1fc00b860 comp rx=0 tx=0).stop 2024-06-03T00:00:58.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.364+0000 7fd20942b700 1 -- 172.21.15.49:0/2881342337 shutdown_connections 2024-06-03T00:00:58.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.364+0000 7fd20942b700 1 --2- 172.21.15.49:0/2881342337 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fd1f00a2ca0 0x7fd1f00a5160 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:58.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.364+0000 7fd20942b700 1 --2- 172.21.15.49:0/2881342337 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd204107840 0x7fd204075210 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:58.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.364+0000 7fd20942b700 1 --2- 172.21.15.49:0/2881342337 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd204102740 0x7fd204074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:58.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.364+0000 7fd20942b700 1 --2- 172.21.15.49:0/2881342337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2041030f0 0x7fd204074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:00:58.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.364+0000 7fd20942b700 1 -- 172.21.15.49:0/2881342337 >> 172.21.15.49:0/2881342337 conn(0x7fd2040795f0 msgr2=0x7fd204108990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:00:58.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.364+0000 7fd20942b700 1 -- 172.21.15.49:0/2881342337 shutdown_connections 2024-06-03T00:00:58.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:00:58.364+0000 7fd20942b700 1 -- 172.21.15.49:0/2881342337 wait complete. 2024-06-03T00:00:58.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:58 smithi107 ceph-mon[37048]: pgmap v411: 97 pgs: 97 active+clean; 650 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.4 KiB/s wr, 14 op/s 2024-06-03T00:00:58.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:58 smithi057 ceph-mon[36457]: pgmap v411: 97 pgs: 97 active+clean; 650 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.4 KiB/s wr, 14 op/s 2024-06-03T00:00:58.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:58 smithi049 ceph-mon[32302]: pgmap v411: 97 pgs: 97 active+clean; 650 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.4 KiB/s wr, 14 op/s 2024-06-03T00:00:59.035 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-06-03T00:00:59.284 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:00:59.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:00:59 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/2881342337' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-03T00:00:59.651 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:00:59 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/2881342337' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-03T00:00:59.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:00:59 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/2881342337' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-03T00:01:00.582 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:00 smithi049 ceph-mon[32302]: pgmap v412: 97 pgs: 97 active+clean; 650 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 14 op/s 2024-06-03T00:01:00.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:00 smithi057 ceph-mon[36457]: pgmap v412: 97 pgs: 97 active+clean; 650 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 14 op/s 2024-06-03T00:01:00.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:00 smithi107 ceph-mon[37048]: pgmap v412: 97 pgs: 97 active+clean; 650 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 14 op/s 2024-06-03T00:01:01.484 INFO:teuthology.orchestra.run.smithi049.stdout:{"run_dir":"/var/run/ceph"} 2024-06-03T00:01:01.485 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-06-03T00:01:01.485 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 2064 2024-06-03T00:01:01.485 DEBUG:tasks.quiescer:Yielding 2024-06-03T00:01:01.485 INFO:teuthology.run_tasks:Running task workunit... 2024-06-03T00:01:01.502 INFO:tasks.workunit:Pulling workunits from ref dfcc4b3c2c55532c4c04fa47551c9df1dffdf746 2024-06-03T00:01:01.502 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-06-03T00:01:01.502 INFO:tasks.workunit:timeout=6h 2024-06-03T00:01:01.502 INFO:tasks.workunit:cleanup=True 2024-06-03T00:01:01.503 DEBUG:teuthology.orchestra.run.smithi049:> stat -- /home/ubuntu/cephtest/mnt.0 2024-06-03T00:01:01.503 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-03T00:01:01.521 INFO:teuthology.orchestra.run.smithi049.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-06-03T00:01:01.522 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-06-03T00:01:01.522 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 6bh/107d Inode: 1099511628283 Links: 2 2024-06-03T00:01:01.522 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-03T00:01:01.522 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-06-03T00:01:01.522 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-06-02 23:57:46.559509860 +0000 2024-06-03T00:01:01.522 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-06-02 23:57:46.559509860 +0000 2024-06-03T00:01:01.522 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-06-03 00:00:25.592287859 +0000 2024-06-03T00:01:01.522 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2024-06-02 23:57:46.559509860 +0000 2024-06-03T00:01:01.522 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-06-03T00:01:01.522 DEBUG:teuthology.orchestra.run.smithi049:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-06-03T00:01:01.594 DEBUG:teuthology.orchestra.run.smithi049:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout dfcc4b3c2c55532c4c04fa47551c9df1dffdf746 2024-06-03T00:01:01.651 INFO:tasks.workunit.client.0.smithi049.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-06-03T00:01:01.756 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:01:02.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:02 smithi049 ceph-mon[32302]: pgmap v413: 97 pgs: 97 active+clean; 650 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-06-03T00:01:02.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:02 smithi057 ceph-mon[36457]: pgmap v413: 97 pgs: 97 active+clean; 650 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-06-03T00:01:02.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:02 smithi107 ceph-mon[37048]: pgmap v413: 97 pgs: 97 active+clean; 650 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-06-03T00:01:03.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.438+0000 7fc3ea63a700 1 -- 172.21.15.49:0/4227798490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3e4108580 msgr2=0x7fc3e4108960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:03.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.438+0000 7fc3ea63a700 1 --2- 172.21.15.49:0/4227798490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3e4108580 0x7fc3e4108960 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc3d40099c0 tx=0x7fc3d4009cd0 comp rx=0 tx=0).stop 2024-06-03T00:01:03.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.438+0000 7fc3ea63a700 1 -- 172.21.15.49:0/4227798490 shutdown_connections 2024-06-03T00:01:03.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.438+0000 7fc3ea63a700 1 --2- 172.21.15.49:0/4227798490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3e406b620 0x7fc3e410f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:03.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.438+0000 7fc3ea63a700 1 --2- 172.21.15.49:0/4227798490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3e4108580 0x7fc3e4108960 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:03.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.438+0000 7fc3ea63a700 1 --2- 172.21.15.49:0/4227798490 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3e406ac60 0x7fc3e406b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:03.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.438+0000 7fc3ea63a700 1 -- 172.21.15.49:0/4227798490 >> 172.21.15.49:0/4227798490 conn(0x7fc3e4078430 msgr2=0x7fc3e4078840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:03.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.438+0000 7fc3ea63a700 1 -- 172.21.15.49:0/4227798490 shutdown_connections 2024-06-03T00:01:03.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.438+0000 7fc3ea63a700 1 -- 172.21.15.49:0/4227798490 wait complete. 2024-06-03T00:01:03.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.438+0000 7fc3ea63a700 1 Processor -- start 2024-06-03T00:01:03.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.438+0000 7fc3ea63a700 1 -- start start 2024-06-03T00:01:03.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.439+0000 7fc3ea63a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3e406ac60 0x7fc3e419e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:03.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.439+0000 7fc3ea63a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3e406b620 0x7fc3e419ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:03.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.439+0000 7fc3ea63a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3e4108580 0x7fc3e41989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:03.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.439+0000 7fc3ea63a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e41127d0 con 0x7fc3e4108580 2024-06-03T00:01:03.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.439+0000 7fc3ea63a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e4112650 con 0x7fc3e406b620 2024-06-03T00:01:03.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.439+0000 7fc3ea63a700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e4112950 con 0x7fc3e406ac60 2024-06-03T00:01:03.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.439+0000 7fc3e8bd7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3e4108580 0x7fc3e41989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:03.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.439+0000 7fc3dbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3e406b620 0x7fc3e419ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:03.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.439+0000 7fc3e8bd7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3e4108580 0x7fc3e41989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41862/0 (socket says 172.21.15.49:41862) 2024-06-03T00:01:03.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.439+0000 7fc3e8bd7700 1 -- 172.21.15.49:0/264720050 learned_addr learned my addr 172.21.15.49:0/264720050 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:03.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.439+0000 7fc3e3fff700 1 --2- 172.21.15.49:0/264720050 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3e406ac60 0x7fc3e419e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:03.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.439+0000 7fc3e8bd7700 1 -- 172.21.15.49:0/264720050 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3e406ac60 msgr2=0x7fc3e419e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:03.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.439+0000 7fc3e8bd7700 1 --2- 172.21.15.49:0/264720050 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3e406ac60 0x7fc3e419e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:03.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.439+0000 7fc3e8bd7700 1 -- 172.21.15.49:0/264720050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3e406b620 msgr2=0x7fc3e419ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:03.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.439+0000 7fc3e8bd7700 1 --2- 172.21.15.49:0/264720050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3e406b620 0x7fc3e419ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:03.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.439+0000 7fc3e8bd7700 1 -- 172.21.15.49:0/264720050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e4199110 con 0x7fc3e4108580 2024-06-03T00:01:03.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.439+0000 7fc3e8bd7700 1 --2- 172.21.15.49:0/264720050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3e4108580 0x7fc3e41989b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc00ef30 tx=0x7fc3dc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:03.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.440+0000 7fc3e1ffb700 1 -- 172.21.15.49:0/264720050 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc0092e0 con 0x7fc3e4108580 2024-06-03T00:01:03.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.440+0000 7fc3e1ffb700 1 -- 172.21.15.49:0/264720050 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3dc004bb0 con 0x7fc3e4108580 2024-06-03T00:01:03.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.440+0000 7fc3ea63a700 1 -- 172.21.15.49:0/264720050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3e41993a0 con 0x7fc3e4108580 2024-06-03T00:01:03.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.440+0000 7fc3e1ffb700 1 -- 172.21.15.49:0/264720050 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc004280 con 0x7fc3e4108580 2024-06-03T00:01:03.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.440+0000 7fc3ea63a700 1 -- 172.21.15.49:0/264720050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3e41a56c0 con 0x7fc3e4108580 2024-06-03T00:01:03.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.441+0000 7fc3ea63a700 1 -- 172.21.15.49:0/264720050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3e410aa10 con 0x7fc3e4108580 2024-06-03T00:01:03.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.442+0000 7fc3e1ffb700 1 -- 172.21.15.49:0/264720050 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc3dc01b030 con 0x7fc3e4108580 2024-06-03T00:01:03.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.443+0000 7fc3e1ffb700 1 --2- 172.21.15.49:0/264720050 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc3d00a2c20 0x7fc3d00a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:03.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.443+0000 7fc3e3fff700 1 --2- 172.21.15.49:0/264720050 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc3d00a2c20 0x7fc3d00a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:03.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.443+0000 7fc3e1ffb700 1 -- 172.21.15.49:0/264720050 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fc3dc0ceb50 con 0x7fc3e4108580 2024-06-03T00:01:03.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.443+0000 7fc3e3fff700 1 --2- 172.21.15.49:0/264720050 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc3d00a2c20 0x7fc3d00a50e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4000c00 tx=0x7fc3d4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:03.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.447+0000 7fc3e1ffb700 1 -- 172.21.15.49:0/264720050 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc3dc022020 con 0x7fc3e4108580 2024-06-03T00:01:03.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.700+0000 7fc3ea63a700 1 -- 172.21.15.49:0/264720050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3e4199f10 con 0x7fc3e4108580 2024-06-03T00:01:03.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.701+0000 7fc3e1ffb700 1 -- 172.21.15.49:0/264720050 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11929 (secure 0 0 0) 0x7fc3e4199f10 con 0x7fc3e4108580 2024-06-03T00:01:03.701 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:01:03.701 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1553264866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1553264866},{"type":"v1","addr":"172.21.15.49:6835","nonce":1553264866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2266285252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2266285252},{"type":"v1","addr":"172.21.15.49:6837","nonce":2266285252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T23:57:16.991201+0000","modified":"2024-06-03T00:00:26.305285+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24485,"mds_2":24466,"mds_3":24464,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6839/1729124617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":1729124617},{"type":"v1","addr":"172.21.15.49:6839","nonce":1729124617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6841/1902772235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":1902772235},{"type":"v1","addr":"172.21.15.49:6841","nonce":1902772235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6833/1633534002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1633534002},{"type":"v1","addr":"172.21.15.57:6833","nonce":1633534002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6835/2254905671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2254905671},{"type":"v1","addr":"172.21.15.57:6835","nonce":2254905671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.107:6835/3693542801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3693542801},{"type":"v1","addr":"172.21.15.107:6835","nonce":3693542801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.57:6837/230452144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":230452144},{"type":"v1","addr":"172.21.15.57:6837","nonce":230452144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.107:6837/3700593315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":3700593315},{"type":"v1","addr":"172.21.15.107:6837","nonce":3700593315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6839/249825195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":249825195},{"type":"v1","addr":"172.21.15.57:6839","nonce":249825195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6839/1986600681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1986600681},{"type":"v1","addr":"172.21.15.107:6839","nonce":1986600681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24485,24464,24460,24466,24487]},"id":1}]} 2024-06-03T00:01:03.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.703+0000 7fc3ea63a700 1 -- 172.21.15.49:0/264720050 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc3d00a2c20 msgr2=0x7fc3d00a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:03.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.703+0000 7fc3ea63a700 1 --2- 172.21.15.49:0/264720050 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc3d00a2c20 0x7fc3d00a50e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4000c00 tx=0x7fc3d4005fb0 comp rx=0 tx=0).stop 2024-06-03T00:01:03.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.703+0000 7fc3ea63a700 1 -- 172.21.15.49:0/264720050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3e4108580 msgr2=0x7fc3e41989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:03.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.703+0000 7fc3ea63a700 1 --2- 172.21.15.49:0/264720050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3e4108580 0x7fc3e41989b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc00ef30 tx=0x7fc3dc00c3a0 comp rx=0 tx=0).stop 2024-06-03T00:01:03.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.703+0000 7fc3ea63a700 1 -- 172.21.15.49:0/264720050 shutdown_connections 2024-06-03T00:01:03.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.703+0000 7fc3ea63a700 1 --2- 172.21.15.49:0/264720050 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc3d00a2c20 0x7fc3d00a50e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:03.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.703+0000 7fc3ea63a700 1 --2- 172.21.15.49:0/264720050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3e4108580 0x7fc3e41989b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:03.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.703+0000 7fc3ea63a700 1 --2- 172.21.15.49:0/264720050 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3e406ac60 0x7fc3e419e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:03.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.703+0000 7fc3ea63a700 1 --2- 172.21.15.49:0/264720050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3e406b620 0x7fc3e419ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:03.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.703+0000 7fc3ea63a700 1 -- 172.21.15.49:0/264720050 >> 172.21.15.49:0/264720050 conn(0x7fc3e4078430 msgr2=0x7fc3e40ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:03.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.703+0000 7fc3ea63a700 1 -- 172.21.15.49:0/264720050 shutdown_connections 2024-06-03T00:01:03.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:03.703+0000 7fc3ea63a700 1 -- 172.21.15.49:0/264720050 wait complete. 2024-06-03T00:01:03.705 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 27 2024-06-03T00:01:04.320 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-06-02T23:57:16.991201+0000', 'modified': '2024-06-03T00:00:26.305285+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24487, 'mds_1': 24485, 'mds_2': 24466, 'mds_3': 24464, 'mds_4': 24460}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14598': {'gid': 14598, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.49:6839/1729124617', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6838', 'nonce': 1729124617}, {'type': 'v1', 'addr': '172.21.15.49:6839', 'nonce': 1729124617}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14610': {'gid': 14610, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.49:6841/1902772235', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6840', 'nonce': 1902772235}, {'type': 'v1', 'addr': '172.21.15.49:6841', 'nonce': 1902772235}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24416': {'gid': 24416, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.57:6833/1633534002', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 1633534002}, {'type': 'v1', 'addr': '172.21.15.57:6833', 'nonce': 1633534002}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24418': {'gid': 24418, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.107:6833/2662998293', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6832', 'nonce': 2662998293}, {'type': 'v1', 'addr': '172.21.15.107:6833', 'nonce': 2662998293}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24440': {'gid': 24440, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.57:6835/2254905671', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 2254905671}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 2254905671}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24460': {'gid': 24460, 'name': 'f', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.107:6835/3693542801', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6834', 'nonce': 3693542801}, {'type': 'v1', 'addr': '172.21.15.107:6835', 'nonce': 3693542801}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24464': {'gid': 24464, 'name': 'h', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.57:6837/230452144', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6836', 'nonce': 230452144}, {'type': 'v1', 'addr': '172.21.15.57:6837', 'nonce': 230452144}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'c', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.107:6837/3700593315', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6836', 'nonce': 3700593315}, {'type': 'v1', 'addr': '172.21.15.107:6837', 'nonce': 3700593315}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24485': {'gid': 24485, 'name': 'b', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.57:6839/249825195', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6838', 'nonce': 249825195}, {'type': 'v1', 'addr': '172.21.15.57:6839', 'nonce': 249825195}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24487': {'gid': 24487, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.107:6839/1986600681', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6838', 'nonce': 1986600681}, {'type': 'v1', 'addr': '172.21.15.107:6839', 'nonce': 1986600681}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24487, 'qdb_cluster': [24485, 24464, 24460, 24466, 24487]} 2024-06-03T00:01:04.320 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-06-03T00:01:04.321 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.f status 2024-06-03T00:01:04.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.320+0000 7f5092f5a640 1 -- 172.21.15.49:0/154068760 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f508c100920 msgr2=0x7f508c100d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:04.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.320+0000 7f5092f5a640 1 --2- 172.21.15.49:0/154068760 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f508c100920 0x7f508c100d40 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5080009900 tx=0x7f508002a3f0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.320+0000 7f5092f5a640 1 -- 172.21.15.49:0/154068760 shutdown_connections 2024-06-03T00:01:04.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.320+0000 7f5092f5a640 1 --2- 172.21.15.49:0/154068760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f508c101b10 0x7f508c101f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.320+0000 7f5092f5a640 1 --2- 172.21.15.49:0/154068760 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f508c1024d0 0x7f508c108d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.320+0000 7f5092f5a640 1 --2- 172.21.15.49:0/154068760 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f508c100920 0x7f508c100d40 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.320+0000 7f5092f5a640 1 -- 172.21.15.49:0/154068760 >> 172.21.15.49:0/154068760 conn(0x7f508c0fbe90 msgr2=0x7f508c0fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:04.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.320+0000 7f5092f5a640 1 -- 172.21.15.49:0/154068760 shutdown_connections 2024-06-03T00:01:04.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.320+0000 7f5092f5a640 1 -- 172.21.15.49:0/154068760 wait complete. 2024-06-03T00:01:04.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.321+0000 7f5092f5a640 1 Processor -- start 2024-06-03T00:01:04.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.321+0000 7f5092f5a640 1 -- start start 2024-06-03T00:01:04.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.321+0000 7f5092f5a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f508c100920 0x7f508c196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:04.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.321+0000 7f5092f5a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f508c101b10 0x7f508c196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:04.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.321+0000 7f5092f5a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f508c1024d0 0x7f508c19e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.321+0000 7f5092f5a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f508c10c570 con 0x7f508c101b10 2024-06-03T00:01:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.321+0000 7f5092f5a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f508c10c3f0 con 0x7f508c100920 2024-06-03T00:01:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.321+0000 7f5092f5a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f508c10c6f0 con 0x7f508c1024d0 2024-06-03T00:01:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.321+0000 7f508bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f508c101b10 0x7f508c196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.321+0000 7f508bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f508c101b10 0x7f508c196fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41880/0 (socket says 172.21.15.49:41880) 2024-06-03T00:01:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.321+0000 7f508bfff640 1 -- 172.21.15.49:0/3283027056 learned_addr learned my addr 172.21.15.49:0/3283027056 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.321+0000 7f5090cf6640 1 --2- 172.21.15.49:0/3283027056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f508c100920 0x7f508c196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.321+0000 7f50914f7640 1 --2- 172.21.15.49:0/3283027056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f508c1024d0 0x7f508c19e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.321+0000 7f508bfff640 1 -- 172.21.15.49:0/3283027056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f508c1024d0 msgr2=0x7f508c19e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.321+0000 7f508bfff640 1 --2- 172.21.15.49:0/3283027056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f508c1024d0 0x7f508c19e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.321+0000 7f508bfff640 1 -- 172.21.15.49:0/3283027056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f508c100920 msgr2=0x7f508c196a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.321+0000 7f508bfff640 1 --2- 172.21.15.49:0/3283027056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f508c100920 0x7f508c196a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.321+0000 7f508bfff640 1 -- 172.21.15.49:0/3283027056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f508c19e6b0 con 0x7f508c101b10 2024-06-03T00:01:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.321+0000 7f5090cf6640 1 --2- 172.21.15.49:0/3283027056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f508c100920 0x7f508c196a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.321+0000 7f50914f7640 1 --2- 172.21.15.49:0/3283027056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f508c1024d0 0x7f508c19e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.321+0000 7f508bfff640 1 --2- 172.21.15.49:0/3283027056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f508c101b10 0x7f508c196fd0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f507800c920 tx=0x7f507800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.322+0000 7f5089ffb640 1 -- 172.21.15.49:0/3283027056 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5078007c70 con 0x7f508c101b10 2024-06-03T00:01:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.322+0000 7f5089ffb640 1 -- 172.21.15.49:0/3283027056 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5078007e10 con 0x7f508c101b10 2024-06-03T00:01:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.322+0000 7f5089ffb640 1 -- 172.21.15.49:0/3283027056 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5078018890 con 0x7f508c101b10 2024-06-03T00:01:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.322+0000 7f5092f5a640 1 -- 172.21.15.49:0/3283027056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f508c19e9a0 con 0x7f508c101b10 2024-06-03T00:01:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.322+0000 7f5092f5a640 1 -- 172.21.15.49:0/3283027056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f508c19ef40 con 0x7f508c101b10 2024-06-03T00:01:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.325+0000 7f5089ffb640 1 -- 172.21.15.49:0/3283027056 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5078018a70 con 0x7f508c101b10 2024-06-03T00:01:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.325+0000 7f5095c63740 1 Processor -- start 2024-06-03T00:01:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.325+0000 7f5095c63740 1 -- start start 2024-06-03T00:01:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.325+0000 7f5095c63740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558d9492f220 0x558d9492f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.325+0000 7f5095c63740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d9492fc10 0x558d94934710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.325+0000 7f5095c63740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d94934d80 0x558d94937210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.325+0000 7f5095c63740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x558d948904f0 con 0x558d9492f220 2024-06-03T00:01:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.325+0000 7f5095c63740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x558d9482e870 con 0x558d94934d80 2024-06-03T00:01:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.325+0000 7f5095c63740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x558d9488c4b0 con 0x558d9492fc10 2024-06-03T00:01:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.325+0000 7f50914f7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558d9492f220 0x558d9492f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.325+0000 7f50914f7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558d9492f220 0x558d9492f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41894/0 (socket says 172.21.15.49:41894) 2024-06-03T00:01:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.325+0000 7f50914f7640 1 -- 172.21.15.49:0/2544349032 learned_addr learned my addr 172.21.15.49:0/2544349032 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.326+0000 7f5089ffb640 1 --2- 172.21.15.49:0/3283027056 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f507c0a2cb0 0x7f507c0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.326+0000 7f5090cf6640 1 --2- 172.21.15.49:0/2544349032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d9492fc10 0x558d94934710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.326+0000 7f508bfff640 1 --2- 172.21.15.49:0/2544349032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d94934d80 0x558d94937210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.326+0000 7f50914f7640 1 -- 172.21.15.49:0/2544349032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d9492fc10 msgr2=0x558d94934710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.326+0000 7f50914f7640 1 --2- 172.21.15.49:0/2544349032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d9492fc10 0x558d94934710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.331 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.326+0000 7f50914f7640 1 -- 172.21.15.49:0/2544349032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d94934d80 msgr2=0x558d94937210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:04.331 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.326+0000 7f50914f7640 1 --2- 172.21.15.49:0/2544349032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d94934d80 0x558d94937210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.331 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.326+0000 7f50914f7640 1 -- 172.21.15.49:0/2544349032 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d9484a9b0 con 0x558d9492f220 2024-06-03T00:01:04.331 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.326+0000 7f5090cf6640 1 --2- 172.21.15.49:0/2544349032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d9492fc10 0x558d94934710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:01:04.331 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.326+0000 7f5089ffb640 1 -- 172.21.15.49:0/3283027056 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f50780cf1a0 con 0x7f508c101b10 2024-06-03T00:01:04.331 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.326+0000 7f50914f7640 1 --2- 172.21.15.49:0/3283027056 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f507c0a2cb0 0x7f507c0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:04.331 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.326+0000 7f50914f7640 1 --2- 172.21.15.49:0/2544349032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558d9492f220 0x558d9492f640 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f508400e450 tx=0x7f508400e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba777a570a61a9c server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:04.331 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.326+0000 7f5076ffd640 1 -- 172.21.15.49:0/2544349032 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5084022070 con 0x558d9492f220 2024-06-03T00:01:04.331 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.326+0000 7f5076ffd640 1 -- 172.21.15.49:0/2544349032 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5084018070 con 0x558d9492f220 2024-06-03T00:01:04.331 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.326+0000 7f50914f7640 1 --2- 172.21.15.49:0/3283027056 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f507c0a2cb0 0x7f507c0a5170 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f508401f000 tx=0x7f5084020000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:04.331 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.326+0000 7f5076ffd640 1 -- 172.21.15.49:0/2544349032 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508400f3c0 con 0x558d9492f220 2024-06-03T00:01:04.331 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.327+0000 7f5095c63740 1 -- 172.21.15.49:0/2544349032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558d9492f220 msgr2=0x558d9492f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:04.331 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.327+0000 7f5095c63740 1 --2- 172.21.15.49:0/2544349032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558d9492f220 0x558d9492f640 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f508400e450 tx=0x7f508400e910 comp rx=0 tx=0).stop 2024-06-03T00:01:04.332 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.327+0000 7f5095c63740 1 -- 172.21.15.49:0/2544349032 shutdown_connections 2024-06-03T00:01:04.332 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.327+0000 7f5095c63740 1 --2- 172.21.15.49:0/2544349032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d94934d80 0x558d94937210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.332 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.327+0000 7f5095c63740 1 --2- 172.21.15.49:0/2544349032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d9492fc10 0x558d94934710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.332 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.327+0000 7f5095c63740 1 --2- 172.21.15.49:0/2544349032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558d9492f220 0x558d9492f640 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.332 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.327+0000 7f5095c63740 1 -- 172.21.15.49:0/2544349032 >> 172.21.15.49:0/2544349032 conn(0x558d9492a890 msgr2=0x558d9492ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:04.332 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.327+0000 7f5095c63740 1 -- 172.21.15.49:0/2544349032 shutdown_connections 2024-06-03T00:01:04.332 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.327+0000 7f5095c63740 1 -- 172.21.15.49:0/2544349032 wait complete. 2024-06-03T00:01:04.332 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.327+0000 7f5095c63740 1 -- start start 2024-06-03T00:01:04.332 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.327+0000 7f5095c63740 1 Processor -- start 2024-06-03T00:01:04.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.328+0000 7f5095c63740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d9492f220 0x558d94939730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:04.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.328+0000 7f5095c63740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558d9492fc10 0x558d94939c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:04.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.328+0000 7f5095c63740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d94934d80 0x558d94940cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:04.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.328+0000 7f5095c63740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x558d94937d30 con 0x558d9492fc10 2024-06-03T00:01:04.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.328+0000 7f5095c63740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x558d94819ae0 con 0x558d9492f220 2024-06-03T00:01:04.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.328+0000 7f5095c63740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x558d94937eb0 con 0x558d94934d80 2024-06-03T00:01:04.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.328+0000 7f5095c63740 10 client.0 _ll_register_callbacks cb 0x558d948529b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:04.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.328+0000 7f508bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558d9492fc10 0x558d94939c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:04.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.328+0000 7f508bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558d9492fc10 0x558d94939c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41910/0 (socket says 172.21.15.49:41910) 2024-06-03T00:01:04.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.328+0000 7f508bfff640 1 -- 172.21.15.49:0/1743206219 learned_addr learned my addr 172.21.15.49:0/1743206219 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:04.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.328+0000 7f5090cf6640 1 --2- 172.21.15.49:0/1743206219 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d9492f220 0x558d94939730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:04.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.328+0000 7f50914f7640 1 --2- 172.21.15.49:0/1743206219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d94934d80 0x558d94940cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:04.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.328+0000 7f508bfff640 1 -- 172.21.15.49:0/1743206219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d94934d80 msgr2=0x558d94940cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:04.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.328+0000 7f508bfff640 1 --2- 172.21.15.49:0/1743206219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d94934d80 0x558d94940cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.328+0000 7f508bfff640 1 -- 172.21.15.49:0/1743206219 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d9492f220 msgr2=0x558d94939730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:04.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.328+0000 7f508bfff640 1 --2- 172.21.15.49:0/1743206219 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d9492f220 0x558d94939730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.328+0000 7f508bfff640 1 -- 172.21.15.49:0/1743206219 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d945a4210 con 0x558d9492fc10 2024-06-03T00:01:04.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.329+0000 7f506bfff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:01:04.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.329+0000 7f508bfff640 1 --2- 172.21.15.49:0/1743206219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558d9492fc10 0x558d94939c70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f507806ea90 tx=0x7f507806b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1447afa40b9a07dc server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:04.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.329+0000 7f506bfff640 1 -- 172.21.15.49:0/1743206219 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507809c100 con 0x558d9492fc10 2024-06-03T00:01:04.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.329+0000 7f506bfff640 1 -- 172.21.15.49:0/1743206219 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f5078018d60 con 0x558d9492fc10 2024-06-03T00:01:04.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.329+0000 7f5095c63740 1 -- 172.21.15.49:0/1743206219 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5084018070 con 0x558d9492fc10 2024-06-03T00:01:04.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.329+0000 7f506bfff640 1 -- 172.21.15.49:0/1743206219 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f507809ba00 con 0x558d9492fc10 2024-06-03T00:01:04.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.329+0000 7f5095c63740 10 client.15372 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:04.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.329+0000 7f5095c63740 1 -- 172.21.15.49:0/1743206219 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558d94670620 con 0x558d9492fc10 2024-06-03T00:01:04.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.329+0000 7f506bfff640 1 -- 172.21.15.49:0/1743206219 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5084018070 con 0x558d9492fc10 2024-06-03T00:01:04.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.329+0000 7f506bfff640 1 -- 172.21.15.49:0/1743206219 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f50780a41e0 con 0x558d9492fc10 2024-06-03T00:01:04.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.329+0000 7f5095c63740 10 client.15372 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:04.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.329+0000 7f5095c63740 10 client.15372 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:01:04.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.329+0000 7f5095c63740 20 client.15372 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:04.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.329+0000 7f5095c63740 1 --2- 172.21.15.49:0/1743206219 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x558d949454c0 0x558d949478f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:04.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.329+0000 7f5095c63740 4 client.15372 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:01:04.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.329+0000 7f5095c63740 1 -- 172.21.15.49:0/1743206219 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d948a3f10 con 0x558d949454c0 2024-06-03T00:01:04.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.330+0000 7f5090cf6640 1 --2- 172.21.15.49:0/1743206219 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x558d949454c0 0x558d949478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:04.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.330+0000 7f506bfff640 10 client.15372 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:04.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.330+0000 7f5090cf6640 1 --2- 172.21.15.49:0/1743206219 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x558d949454c0 0x558d949478f0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a10efc8939a3c07 server_cookie=e286f6200af93fbf in_seq=0 out_seq=0 2024-06-03T00:01:04.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.331+0000 7f506bfff640 1 -- 172.21.15.49:0/1743206219 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x558d948a3f10 con 0x558d949454c0 2024-06-03T00:01:04.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.331+0000 7f506bfff640 10 client.15372 handle_command_reply: tid=0 2024-06-03T00:01:04.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.331+0000 7f5095c63740 1 client.15372 shutdown 2024-06-03T00:01:04.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.331+0000 7f5095c63740 1 -- 172.21.15.49:0/1743206219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558d9492fc10 msgr2=0x558d94939c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:04.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.331+0000 7f5095c63740 1 --2- 172.21.15.49:0/1743206219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558d9492fc10 0x558d94939c70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f507806ea90 tx=0x7f507806b8b0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.331+0000 7f5095c63740 1 -- 172.21.15.49:0/1743206219 shutdown_connections 2024-06-03T00:01:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.331+0000 7f5095c63740 1 --2- 172.21.15.49:0/1743206219 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x558d949454c0 0x558d949478f0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.331+0000 7f5095c63740 1 --2- 172.21.15.49:0/1743206219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d94934d80 0x558d94940cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.331+0000 7f5095c63740 1 --2- 172.21.15.49:0/1743206219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558d9492fc10 0x558d94939c70 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.331+0000 7f506bfff640 0 client.15372 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.331+0000 7f5095c63740 1 --2- 172.21.15.49:0/1743206219 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d9492f220 0x558d94939730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.331+0000 7f5095c63740 1 -- 172.21.15.49:0/1743206219 >> 172.21.15.49:0/1743206219 conn(0x558d9492a890 msgr2=0x558d949277e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.331+0000 7f5095c63740 1 -- 172.21.15.49:0/1743206219 shutdown_connections 2024-06-03T00:01:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.331+0000 7f5095c63740 1 -- 172.21.15.49:0/1743206219 wait complete. 2024-06-03T00:01:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.331+0000 7f5095c63740 20 client.15372 trim_cache size 0 max 16384 2024-06-03T00:01:04.349 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.349+0000 7f5095c63740 1 Processor -- start 2024-06-03T00:01:04.349 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.349+0000 7f5095c63740 1 -- start start 2024-06-03T00:01:04.349 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.349+0000 7f5095c63740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d9492f220 0x558d9492d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:04.350 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.349+0000 7f5095c63740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d9492fc10 0x558d94940c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:04.350 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.349+0000 7f5095c63740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558d94934d80 0x558d9492dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:04.350 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.349+0000 7f5095c63740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f508c1a6c20 con 0x558d94934d80 2024-06-03T00:01:04.350 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.349+0000 7f5095c63740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f508c1a8760 con 0x558d9492f220 2024-06-03T00:01:04.350 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.349+0000 7f5095c63740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f508c1a72f0 con 0x558d9492fc10 2024-06-03T00:01:04.350 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.349+0000 7f50914f7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558d94934d80 0x558d9492dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:04.350 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.349+0000 7f50914f7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558d94934d80 0x558d9492dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41922/0 (socket says 172.21.15.49:41922) 2024-06-03T00:01:04.350 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.349+0000 7f50914f7640 1 -- 172.21.15.49:0/2681498433 learned_addr learned my addr 172.21.15.49:0/2681498433 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:04.350 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.349+0000 7f508bfff640 1 --2- 172.21.15.49:0/2681498433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d9492fc10 0x558d94940c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:04.350 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.349+0000 7f5090cf6640 1 --2- 172.21.15.49:0/2681498433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d9492f220 0x558d9492d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:04.350 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.349+0000 7f50914f7640 1 -- 172.21.15.49:0/2681498433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d9492fc10 msgr2=0x558d94940c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:04.350 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.349+0000 7f50914f7640 1 --2- 172.21.15.49:0/2681498433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d9492fc10 0x558d94940c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.350 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.349+0000 7f50914f7640 1 -- 172.21.15.49:0/2681498433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d9492f220 msgr2=0x558d9492d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:04.351 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.349+0000 7f50914f7640 1 --2- 172.21.15.49:0/2681498433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d9492f220 0x558d9492d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.351 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.349+0000 7f50914f7640 1 -- 172.21.15.49:0/2681498433 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d9492fff0 con 0x558d94934d80 2024-06-03T00:01:04.351 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.350+0000 7f50914f7640 1 --2- 172.21.15.49:0/2681498433 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558d94934d80 0x558d9492dab0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f50840076d0 tx=0x7f5084007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc2b904daf726ec1 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:04.351 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.350+0000 7f50767fc640 1 -- 172.21.15.49:0/2681498433 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5084022070 con 0x558d94934d80 2024-06-03T00:01:04.351 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.350+0000 7f50767fc640 1 -- 172.21.15.49:0/2681498433 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5084018030 con 0x558d94934d80 2024-06-03T00:01:04.351 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.350+0000 7f50767fc640 1 -- 172.21.15.49:0/2681498433 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508400fa80 con 0x558d94934d80 2024-06-03T00:01:04.354 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.350+0000 7f5095c63740 1 -- 172.21.15.49:0/2681498433 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558d94934d80 msgr2=0x558d9492dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:04.354 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.351+0000 7f5095c63740 1 --2- 172.21.15.49:0/2681498433 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558d94934d80 0x558d9492dab0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f50840076d0 tx=0x7f5084007700 comp rx=0 tx=0).stop 2024-06-03T00:01:04.355 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.351+0000 7f5095c63740 1 -- 172.21.15.49:0/2681498433 shutdown_connections 2024-06-03T00:01:04.355 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.351+0000 7f5095c63740 1 --2- 172.21.15.49:0/2681498433 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558d94934d80 0x558d9492dab0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.355 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.351+0000 7f5095c63740 1 --2- 172.21.15.49:0/2681498433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d9492fc10 0x558d94940c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.355 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.351+0000 7f5095c63740 1 --2- 172.21.15.49:0/2681498433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d9492f220 0x558d9492d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.355 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.351+0000 7f5095c63740 1 -- 172.21.15.49:0/2681498433 >> 172.21.15.49:0/2681498433 conn(0x558d9492a890 msgr2=0x558d9492ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:04.355 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.351+0000 7f5095c63740 1 -- 172.21.15.49:0/2681498433 shutdown_connections 2024-06-03T00:01:04.355 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.351+0000 7f5095c63740 1 -- 172.21.15.49:0/2681498433 wait complete. 2024-06-03T00:01:04.355 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.351+0000 7f5095c63740 1 -- start start 2024-06-03T00:01:04.355 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.351+0000 7f5095c63740 1 Processor -- start 2024-06-03T00:01:04.355 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.351+0000 7f5095c63740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d9492f220 0x558d9493e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:04.355 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.351+0000 7f5095c63740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558d9492fc10 0x558d9493ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:04.356 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.351+0000 7f5095c63740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d94934d80 0x558d9493fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:04.356 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.351+0000 7f5095c63740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f508c1a8090 con 0x558d9492fc10 2024-06-03T00:01:04.356 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.351+0000 7f5095c63740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f508c1a79c0 con 0x558d94934d80 2024-06-03T00:01:04.356 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.351+0000 7f5095c63740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f508c1a4be0 con 0x558d9492f220 2024-06-03T00:01:04.356 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.352+0000 7f5095c63740 10 client.0 _ll_register_callbacks cb 0x7f507800cf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:04.356 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.352+0000 7f508bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558d9492fc10 0x558d9493ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:04.356 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.352+0000 7f508bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558d9492fc10 0x558d9493ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41926/0 (socket says 172.21.15.49:41926) 2024-06-03T00:01:04.356 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.352+0000 7f508bfff640 1 -- 172.21.15.49:0/1882029977 learned_addr learned my addr 172.21.15.49:0/1882029977 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:04.356 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.352+0000 7f50914f7640 1 --2- 172.21.15.49:0/1882029977 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d94934d80 0x558d9493fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:04.356 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.352+0000 7f5090cf6640 1 --2- 172.21.15.49:0/1882029977 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d9492f220 0x558d9493e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:04.356 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.352+0000 7f508bfff640 1 -- 172.21.15.49:0/1882029977 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d9492f220 msgr2=0x558d9493e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:04.356 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.352+0000 7f508bfff640 1 --2- 172.21.15.49:0/1882029977 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d9492f220 0x558d9493e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.356 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.352+0000 7f508bfff640 1 -- 172.21.15.49:0/1882029977 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d94934d80 msgr2=0x558d9493fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:04.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.352+0000 7f508bfff640 1 --2- 172.21.15.49:0/1882029977 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d94934d80 0x558d9493fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.352+0000 7f508bfff640 1 -- 172.21.15.49:0/1882029977 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d94940000 con 0x558d9492fc10 2024-06-03T00:01:04.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.352+0000 7f508bfff640 1 --2- 172.21.15.49:0/1882029977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558d9492fc10 0x558d9493ea00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f507809b700 tx=0x7f5078000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3743fb66c34d1cc3 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:04.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.352+0000 7f506bfff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:01:04.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.352+0000 7f506bfff640 1 -- 172.21.15.49:0/1882029977 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507809c100 con 0x558d9492fc10 2024-06-03T00:01:04.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.352+0000 7f506bfff640 1 -- 172.21.15.49:0/1882029977 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f507800de00 con 0x558d9492fc10 2024-06-03T00:01:04.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.352+0000 7f5095c63740 1 -- 172.21.15.49:0/1882029977 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5084018030 con 0x558d9492fc10 2024-06-03T00:01:04.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.353+0000 7f506bfff640 1 -- 172.21.15.49:0/1882029977 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f50780a4670 con 0x558d9492fc10 2024-06-03T00:01:04.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.353+0000 7f5095c63740 10 client.15378 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:04.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.353+0000 7f5095c63740 1 -- 172.21.15.49:0/1882029977 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558d949b0380 con 0x558d9492fc10 2024-06-03T00:01:04.358 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.353+0000 7f506bfff640 1 -- 172.21.15.49:0/1882029977 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5084018030 con 0x558d9492fc10 2024-06-03T00:01:04.358 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.353+0000 7f506bfff640 1 -- 172.21.15.49:0/1882029977 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f507809af70 con 0x558d9492fc10 2024-06-03T00:01:04.358 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.353+0000 7f5095c63740 10 client.15378 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:04.358 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.353+0000 7f5095c63740 10 client.15378 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:01:04.358 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.353+0000 7f5095c63740 20 client.15378 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:04.358 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.353+0000 7f5095c63740 1 --2- 172.21.15.49:0/1882029977 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x558d949b0da0 0x558d949b3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:04.358 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.353+0000 7f5095c63740 4 client.15378 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-03T00:01:04.358 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.353+0000 7f5095c63740 1 -- 172.21.15.49:0/1882029977 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558d9489dc20 con 0x558d949b0da0 2024-06-03T00:01:04.358 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.353+0000 7f5090cf6640 1 --2- 172.21.15.49:0/1882029977 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x558d949b0da0 0x558d949b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:04.358 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.354+0000 7f506bfff640 10 client.15378 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:04.358 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.354+0000 7f5090cf6640 1 --2- 172.21.15.49:0/1882029977 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x558d949b0da0 0x558d949b3190 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f4bf104c84a9262 server_cookie=61c09f3d532beb25 in_seq=0 out_seq=0 2024-06-03T00:01:04.362 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.362+0000 7f506bfff640 1 -- 172.21.15.49:0/1882029977 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x558d9489dc20 con 0x558d949b0da0 2024-06-03T00:01:04.362 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.362+0000 7f506bfff640 10 client.15378 handle_command_reply: tid=0 2024-06-03T00:01:04.362 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.362+0000 7f5095c63740 1 client.15378 shutdown 2024-06-03T00:01:04.362 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.362+0000 7f5095c63740 1 -- 172.21.15.49:0/1882029977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558d9492fc10 msgr2=0x558d9493ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:04.362 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.362+0000 7f5095c63740 1 --2- 172.21.15.49:0/1882029977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558d9492fc10 0x558d9493ea00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f507809b700 tx=0x7f5078000bc0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.362 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.362+0000 7f5095c63740 1 -- 172.21.15.49:0/1882029977 shutdown_connections 2024-06-03T00:01:04.362 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.362+0000 7f5095c63740 1 --2- 172.21.15.49:0/1882029977 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x558d949b0da0 0x558d949b3190 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.362 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.362+0000 7f5095c63740 1 --2- 172.21.15.49:0/1882029977 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558d94934d80 0x558d9493fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.362 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.362+0000 7f506bfff640 0 client.15378 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:04.362 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.362+0000 7f5095c63740 1 --2- 172.21.15.49:0/1882029977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558d9492fc10 0x558d9493ea00 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.363 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.362+0000 7f5095c63740 1 --2- 172.21.15.49:0/1882029977 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558d9492f220 0x558d9493e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.363 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.362+0000 7f5095c63740 1 -- 172.21.15.49:0/1882029977 >> 172.21.15.49:0/1882029977 conn(0x558d9492a890 msgr2=0x558d94926f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:04.363 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.362+0000 7f5095c63740 1 -- 172.21.15.49:0/1882029977 shutdown_connections 2024-06-03T00:01:04.363 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.362+0000 7f5095c63740 1 -- 172.21.15.49:0/1882029977 wait complete. 2024-06-03T00:01:04.363 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.362+0000 7f5095c63740 20 client.15378 trim_cache size 0 max 16384 2024-06-03T00:01:04.363 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-06-03T00:01:04.363 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-06-03T00:01:04.363 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-06-03T00:01:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.363+0000 7f5092f5a640 1 -- 172.21.15.49:0/3283027056 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f507c0a2cb0 msgr2=0x7f507c0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.363+0000 7f5092f5a640 1 --2- 172.21.15.49:0/3283027056 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f507c0a2cb0 0x7f507c0a5170 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f508401f000 tx=0x7f5084020000 comp rx=0 tx=0).stop 2024-06-03T00:01:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.363+0000 7f5092f5a640 1 -- 172.21.15.49:0/3283027056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f508c101b10 msgr2=0x7f508c196fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.363+0000 7f5092f5a640 1 --2- 172.21.15.49:0/3283027056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f508c101b10 0x7f508c196fd0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f507800c920 tx=0x7f507800cde0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.363+0000 7f5092f5a640 1 -- 172.21.15.49:0/3283027056 shutdown_connections 2024-06-03T00:01:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.363+0000 7f5092f5a640 1 --2- 172.21.15.49:0/3283027056 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f507c0a2cb0 0x7f507c0a5170 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.363+0000 7f5092f5a640 1 --2- 172.21.15.49:0/3283027056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f508c1024d0 0x7f508c19e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.363+0000 7f5092f5a640 1 --2- 172.21.15.49:0/3283027056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f508c101b10 0x7f508c196fd0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.363+0000 7f5092f5a640 1 --2- 172.21.15.49:0/3283027056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f508c100920 0x7f508c196a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.363+0000 7f5092f5a640 1 -- 172.21.15.49:0/3283027056 >> 172.21.15.49:0/3283027056 conn(0x7f508c0fbe90 msgr2=0x7f508c104d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.363+0000 7f5092f5a640 1 -- 172.21.15.49:0/3283027056 shutdown_connections 2024-06-03T00:01:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:04.363+0000 7f5092f5a640 1 -- 172.21.15.49:0/3283027056 wait complete. 2024-06-03T00:01:04.587 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:01:04.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:04 smithi057 ceph-mon[36457]: pgmap v414: 97 pgs: 97 active+clean; 659 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-06-03T00:01:04.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:04 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/264720050' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:01:04.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:04 smithi049 ceph-mon[32302]: pgmap v414: 97 pgs: 97 active+clean; 659 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-06-03T00:01:04.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:04 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/264720050' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:01:04.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:04 smithi107 ceph-mon[37048]: pgmap v414: 97 pgs: 97 active+clean; 659 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-06-03T00:01:04.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:04 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/264720050' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:01:06.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.287+0000 7f95cd193700 1 -- 172.21.15.49:0/111549709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95c8101620 msgr2=0x7f95c8101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:06.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.287+0000 7f95cd193700 1 --2- 172.21.15.49:0/111549709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95c8101620 0x7f95c8101a00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f95b80099c0 tx=0x7f95b8009cd0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.287+0000 7f95cd193700 1 -- 172.21.15.49:0/111549709 shutdown_connections 2024-06-03T00:01:06.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.287+0000 7f95cd193700 1 --2- 172.21.15.49:0/111549709 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95c81066b0 0x7f95c810e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.287+0000 7f95cd193700 1 --2- 172.21.15.49:0/111549709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95c8101620 0x7f95c8101a00 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.287+0000 7f95cd193700 1 --2- 172.21.15.49:0/111549709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95c8101fd0 0x7f95c8105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.287+0000 7f95cd193700 1 -- 172.21.15.49:0/111549709 >> 172.21.15.49:0/111549709 conn(0x7f95c8078340 msgr2=0x7f95c8078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:06.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.287+0000 7f95cd193700 1 -- 172.21.15.49:0/111549709 shutdown_connections 2024-06-03T00:01:06.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.288+0000 7f95cd193700 1 -- 172.21.15.49:0/111549709 wait complete. 2024-06-03T00:01:06.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.288+0000 7f95cd193700 1 Processor -- start 2024-06-03T00:01:06.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.289+0000 7f95cd193700 1 -- start start 2024-06-03T00:01:06.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.289+0000 7f95cd193700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95c8101620 0x7f95c8199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:06.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.289+0000 7f95cd193700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95c8101fd0 0x7f95c819a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:06.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.289+0000 7f95cd193700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95c81066b0 0x7f95c81a4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:06.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.289+0000 7f95cd193700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f95c81116e0 con 0x7f95c8101620 2024-06-03T00:01:06.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.289+0000 7f95cd193700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f95c8111560 con 0x7f95c81066b0 2024-06-03T00:01:06.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.289+0000 7f95cd193700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f95c8111860 con 0x7f95c8101fd0 2024-06-03T00:01:06.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.289+0000 7f95c6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95c8101620 0x7f95c8199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:06.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.289+0000 7f95c6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95c8101620 0x7f95c8199ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41958/0 (socket says 172.21.15.49:41958) 2024-06-03T00:01:06.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.289+0000 7f95c6d9d700 1 -- 172.21.15.49:0/496568415 learned_addr learned my addr 172.21.15.49:0/496568415 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:06.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.289+0000 7f95be59c700 1 --2- 172.21.15.49:0/496568415 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95c8101fd0 0x7f95c819a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:06.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.289+0000 7f95c6d9d700 1 -- 172.21.15.49:0/496568415 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95c8101fd0 msgr2=0x7f95c819a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:06.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.289+0000 7f95c6d9d700 1 --2- 172.21.15.49:0/496568415 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95c8101fd0 0x7f95c819a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.289+0000 7f95c759e700 1 --2- 172.21.15.49:0/496568415 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95c81066b0 0x7f95c81a4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:06.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.289+0000 7f95c6d9d700 1 -- 172.21.15.49:0/496568415 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95c81066b0 msgr2=0x7f95c81a4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:06.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.289+0000 7f95c6d9d700 1 --2- 172.21.15.49:0/496568415 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95c81066b0 0x7f95c81a4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.289+0000 7f95c6d9d700 1 -- 172.21.15.49:0/496568415 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c81a5080 con 0x7f95c8101620 2024-06-03T00:01:06.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.289+0000 7f95be59c700 1 --2- 172.21.15.49:0/496568415 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95c8101fd0 0x7f95c819a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:06.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.290+0000 7f95c6d9d700 1 --2- 172.21.15.49:0/496568415 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95c8101620 0x7f95c8199ac0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f95b8006010 tx=0x7f95b8005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:06.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.290+0000 7f95c4d99700 1 -- 172.21.15.49:0/496568415 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b8027070 con 0x7f95c8101620 2024-06-03T00:01:06.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.290+0000 7f95cd193700 1 -- 172.21.15.49:0/496568415 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95c81a5250 con 0x7f95c8101620 2024-06-03T00:01:06.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.290+0000 7f95c4d99700 1 -- 172.21.15.49:0/496568415 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95b80040d0 con 0x7f95c8101620 2024-06-03T00:01:06.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.290+0000 7f95c4d99700 1 -- 172.21.15.49:0/496568415 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b800f460 con 0x7f95c8101620 2024-06-03T00:01:06.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.290+0000 7f95cd193700 1 -- 172.21.15.49:0/496568415 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95c81a56a0 con 0x7f95c8101620 2024-06-03T00:01:06.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.292+0000 7f95c4d99700 1 -- 172.21.15.49:0/496568415 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f95b802a070 con 0x7f95c8101620 2024-06-03T00:01:06.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.293+0000 7f95c4d99700 1 --2- 172.21.15.49:0/496568415 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f95b40a2c20 0x7f95b40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:06.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.293+0000 7f95c4d99700 1 -- 172.21.15.49:0/496568415 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f95b80cfeb0 con 0x7f95c8101620 2024-06-03T00:01:06.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.293+0000 7f95be59c700 1 --2- 172.21.15.49:0/496568415 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f95b40a2c20 0x7f95b40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:06.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.293+0000 7f95be59c700 1 --2- 172.21.15.49:0/496568415 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f95b40a2c20 0x7f95b40a50e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f95c8107b80 tx=0x7f95b0005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:06.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.294+0000 7f95d7a16b80 1 Processor -- start 2024-06-03T00:01:06.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.294+0000 7f95d7a16b80 1 -- start start 2024-06-03T00:01:06.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.294+0000 7f95d7a16b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff7363d5f0 0x55ff7363d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:06.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.294+0000 7f95d7a16b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ff7363df10 0x55ff73637990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:06.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.294+0000 7f95d7a16b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ff73637ed0 0x55ff736382f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:06.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.294+0000 7f95d7a16b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ff735897c0 con 0x55ff7363d5f0 2024-06-03T00:01:06.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.294+0000 7f95d7a16b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55ff735316d0 con 0x55ff73637ed0 2024-06-03T00:01:06.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.294+0000 7f95d7a16b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ff73585780 con 0x55ff7363df10 2024-06-03T00:01:06.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.294+0000 7f95c6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff7363d5f0 0x55ff7363d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:06.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.294+0000 7f95c6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff7363d5f0 0x55ff7363d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41970/0 (socket says 172.21.15.49:41970) 2024-06-03T00:01:06.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.294+0000 7f95c6d9d700 1 -- 172.21.15.49:0/1617868166 learned_addr learned my addr 172.21.15.49:0/1617868166 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:06.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.294+0000 7f95be59c700 1 --2- 172.21.15.49:0/1617868166 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ff7363df10 0x55ff73637990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:06.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.295+0000 7f95c759e700 1 --2- 172.21.15.49:0/1617868166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ff73637ed0 0x55ff736382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:06.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.295+0000 7f95c6d9d700 1 -- 172.21.15.49:0/1617868166 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ff7363df10 msgr2=0x55ff73637990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:06.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.295+0000 7f95c6d9d700 1 --2- 172.21.15.49:0/1617868166 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ff7363df10 0x55ff73637990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.295+0000 7f95c6d9d700 1 -- 172.21.15.49:0/1617868166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ff73637ed0 msgr2=0x55ff736382f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:06.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.295+0000 7f95c6d9d700 1 --2- 172.21.15.49:0/1617868166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ff73637ed0 0x55ff736382f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.295+0000 7f95c6d9d700 1 -- 172.21.15.49:0/1617868166 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff73527f00 con 0x55ff7363d5f0 2024-06-03T00:01:06.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.295+0000 7f95c759e700 1 --2- 172.21.15.49:0/1617868166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ff73637ed0 0x55ff736382f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:01:06.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.295+0000 7f95c6d9d700 1 --2- 172.21.15.49:0/1617868166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff7363d5f0 0x55ff7363d9d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f95b80a4e50 tx=0x7f95b8009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b981d75f10d5b2 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:06.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.295+0000 7f95bd59a700 1 -- 172.21.15.49:0/1617868166 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b8022470 con 0x55ff7363d5f0 2024-06-03T00:01:06.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.295+0000 7f95bd59a700 1 -- 172.21.15.49:0/1617868166 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95b80a3070 con 0x55ff7363d5f0 2024-06-03T00:01:06.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.295+0000 7f95bd59a700 1 -- 172.21.15.49:0/1617868166 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b809ca00 con 0x55ff7363d5f0 2024-06-03T00:01:06.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.296+0000 7f95d7a16b80 1 -- 172.21.15.49:0/1617868166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff7363d5f0 msgr2=0x55ff7363d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:06.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.296+0000 7f95d7a16b80 1 --2- 172.21.15.49:0/1617868166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff7363d5f0 0x55ff7363d9d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f95b80a4e50 tx=0x7f95b8009cd0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.296+0000 7f95d7a16b80 1 -- 172.21.15.49:0/1617868166 shutdown_connections 2024-06-03T00:01:06.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.296+0000 7f95d7a16b80 1 --2- 172.21.15.49:0/1617868166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ff73637ed0 0x55ff736382f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.296+0000 7f95d7a16b80 1 --2- 172.21.15.49:0/1617868166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff7363d5f0 0x55ff7363d9d0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.296+0000 7f95d7a16b80 1 --2- 172.21.15.49:0/1617868166 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ff7363df10 0x55ff73637990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.296+0000 7f95d7a16b80 1 -- 172.21.15.49:0/1617868166 >> 172.21.15.49:0/1617868166 conn(0x55ff73562c70 msgr2=0x55ff73632800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:06.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.296+0000 7f95d7a16b80 1 -- 172.21.15.49:0/1617868166 shutdown_connections 2024-06-03T00:01:06.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.296+0000 7f95d7a16b80 1 -- 172.21.15.49:0/1617868166 wait complete. 2024-06-03T00:01:06.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.296+0000 7f95d7a16b80 1 -- start start 2024-06-03T00:01:06.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.296+0000 7f95d7a16b80 1 Processor -- start 2024-06-03T00:01:06.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.297+0000 7f95d7a16b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff73637ed0 0x55ff73643d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:06.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.297+0000 7f95d7a16b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ff7363d5f0 0x55ff73641010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:06.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.297+0000 7f95d7a16b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ff7363df10 0x55ff73641550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:06.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.297+0000 7f95d7a16b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ff736446a0 con 0x55ff73637ed0 2024-06-03T00:01:06.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.297+0000 7f95d7a16b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55ff73529ba0 con 0x55ff7363df10 2024-06-03T00:01:06.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.297+0000 7f95d7a16b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ff73644820 con 0x55ff7363d5f0 2024-06-03T00:01:06.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.297+0000 7f95d7a16b80 10 client.0 _ll_register_callbacks cb 0x55ff735238d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:06.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.297+0000 7f95c6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff73637ed0 0x55ff73643d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:06.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.297+0000 7f95c6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff73637ed0 0x55ff73643d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41978/0 (socket says 172.21.15.49:41978) 2024-06-03T00:01:06.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.297+0000 7f95c6d9d700 1 -- 172.21.15.49:0/2362896404 learned_addr learned my addr 172.21.15.49:0/2362896404 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:06.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.297+0000 7f95be59c700 1 --2- 172.21.15.49:0/2362896404 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ff7363d5f0 0x55ff73641010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:06.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.297+0000 7f95c759e700 1 --2- 172.21.15.49:0/2362896404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ff7363df10 0x55ff73641550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:06.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.297+0000 7f95c6d9d700 1 -- 172.21.15.49:0/2362896404 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ff7363d5f0 msgr2=0x55ff73641010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:06.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.297+0000 7f95c6d9d700 1 --2- 172.21.15.49:0/2362896404 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ff7363d5f0 0x55ff73641010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.297+0000 7f95c6d9d700 1 -- 172.21.15.49:0/2362896404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ff7363df10 msgr2=0x55ff73641550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:06.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.297+0000 7f95c6d9d700 1 --2- 172.21.15.49:0/2362896404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ff7363df10 0x55ff73641550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.297+0000 7f95c6d9d700 1 -- 172.21.15.49:0/2362896404 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff734d8880 con 0x55ff73637ed0 2024-06-03T00:01:06.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.297+0000 7f95c759e700 1 --2- 172.21.15.49:0/2362896404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ff7363df10 0x55ff73641550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:01:06.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.297+0000 7f95c6d9d700 1 --2- 172.21.15.49:0/2362896404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff73637ed0 0x55ff73643d10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f95b800b580 tx=0x7f95b809d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9804e3eef20f9790 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:06.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.297+0000 7f95ae7fc700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:01:06.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.297+0000 7f95ae7fc700 1 -- 172.21.15.49:0/2362896404 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b8022470 con 0x55ff73637ed0 2024-06-03T00:01:06.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.297+0000 7f95ae7fc700 1 -- 172.21.15.49:0/2362896404 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f95b80a4ef0 con 0x55ff73637ed0 2024-06-03T00:01:06.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.297+0000 7f95d7a16b80 1 -- 172.21.15.49:0/2362896404 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95b80a3070 con 0x55ff73637ed0 2024-06-03T00:01:06.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.298+0000 7f95ae7fc700 1 -- 172.21.15.49:0/2362896404 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f95b80a0b50 con 0x55ff73637ed0 2024-06-03T00:01:06.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.298+0000 7f95d7a16b80 10 client.15390 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:06.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.298+0000 7f95d7a16b80 1 -- 172.21.15.49:0/2362896404 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ff736446a0 con 0x55ff73637ed0 2024-06-03T00:01:06.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.298+0000 7f95ae7fc700 1 -- 172.21.15.49:0/2362896404 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95b80a3070 con 0x55ff73637ed0 2024-06-03T00:01:06.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.298+0000 7f95ae7fc700 1 -- 172.21.15.49:0/2362896404 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f95b80a1ce0 con 0x55ff73637ed0 2024-06-03T00:01:06.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.298+0000 7f95d7a16b80 10 client.15390 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:06.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.298+0000 7f95d7a16b80 10 client.15390 resolve_mds: resolved name 'f' to daemon mds.f 2024-06-03T00:01:06.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.298+0000 7f95d7a16b80 20 client.15390 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:06.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.298+0000 7f95d7a16b80 1 --2- 172.21.15.49:0/2362896404 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x55ff73651370 0x55ff736527e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:06.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.298+0000 7f95d7a16b80 4 client.15390 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:01:06.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.298+0000 7f95d7a16b80 1 -- 172.21.15.49:0/2362896404 --> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff73596cc0 con 0x55ff73651370 2024-06-03T00:01:06.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.298+0000 7f95be59c700 1 --2- 172.21.15.49:0/2362896404 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x55ff73651370 0x55ff736527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:06.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.299+0000 7f95ae7fc700 10 client.15390 ms_handle_connect on v2:172.21.15.107:6834/3693542801 2024-06-03T00:01:06.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.299+0000 7f95be59c700 1 --2- 172.21.15.49:0/2362896404 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x55ff73651370 0x55ff736527e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8563fb153864a770 server_cookie=bb41d3c5506814dc in_seq=0 out_seq=0 2024-06-03T00:01:06.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.299+0000 7f95ae7fc700 1 -- 172.21.15.49:0/2362896404 <== mds.4 v2:172.21.15.107:6834/3693542801 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55ff73596cc0 con 0x55ff73651370 2024-06-03T00:01:06.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.299+0000 7f95ae7fc700 10 client.15390 handle_command_reply: tid=0 2024-06-03T00:01:06.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.299+0000 7f95d7a16b80 1 client.15390 shutdown 2024-06-03T00:01:06.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.300+0000 7f95d7a16b80 1 -- 172.21.15.49:0/2362896404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff73637ed0 msgr2=0x55ff73643d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:06.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.300+0000 7f95d7a16b80 1 --2- 172.21.15.49:0/2362896404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff73637ed0 0x55ff73643d10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f95b800b580 tx=0x7f95b809d010 comp rx=0 tx=0).stop 2024-06-03T00:01:06.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.300+0000 7f95d7a16b80 1 -- 172.21.15.49:0/2362896404 shutdown_connections 2024-06-03T00:01:06.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.300+0000 7f95d7a16b80 1 --2- 172.21.15.49:0/2362896404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ff7363df10 0x55ff73641550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.300+0000 7f95d7a16b80 1 --2- 172.21.15.49:0/2362896404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff73637ed0 0x55ff73643d10 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.300+0000 7f95d7a16b80 1 --2- 172.21.15.49:0/2362896404 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x55ff73651370 0x55ff736527e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.300+0000 7f95d7a16b80 1 --2- 172.21.15.49:0/2362896404 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ff7363d5f0 0x55ff73641010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.300+0000 7f95d7a16b80 1 -- 172.21.15.49:0/2362896404 >> 172.21.15.49:0/2362896404 conn(0x55ff73562c70 msgr2=0x55ff73636980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:06.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.300+0000 7f95ae7fc700 0 client.15390 ms_handle_reset on v2:172.21.15.107:6834/3693542801 2024-06-03T00:01:06.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.300+0000 7f95d7a16b80 1 -- 172.21.15.49:0/2362896404 shutdown_connections 2024-06-03T00:01:06.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.300+0000 7f95d7a16b80 1 -- 172.21.15.49:0/2362896404 wait complete. 2024-06-03T00:01:06.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.300+0000 7f95d7a16b80 20 client.15390 trim_cache size 0 max 16384 2024-06-03T00:01:06.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.322+0000 7f95d7a16b80 1 Processor -- start 2024-06-03T00:01:06.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.322+0000 7f95d7a16b80 1 -- start start 2024-06-03T00:01:06.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.322+0000 7f95d7a16b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ff73637ed0 0x55ff73637990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:06.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.322+0000 7f95d7a16b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ff7363d5f0 0x55ff7362c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:06.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.322+0000 7f95d7a16b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff7363df10 0x55ff7363b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:06.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.322+0000 7f95d7a16b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ff73650b20 con 0x55ff7363df10 2024-06-03T00:01:06.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.322+0000 7f95d7a16b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55ff736511f0 con 0x55ff73637ed0 2024-06-03T00:01:06.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.322+0000 7f95d7a16b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ff736518c0 con 0x55ff7363d5f0 2024-06-03T00:01:06.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.322+0000 7f95c759e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff7363df10 0x55ff7363b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:06.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.322+0000 7f95c759e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff7363df10 0x55ff7363b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41992/0 (socket says 172.21.15.49:41992) 2024-06-03T00:01:06.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.322+0000 7f95c759e700 1 -- 172.21.15.49:0/791708825 learned_addr learned my addr 172.21.15.49:0/791708825 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:06.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.322+0000 7f95be59c700 1 --2- 172.21.15.49:0/791708825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ff7363d5f0 0x55ff7362c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:06.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.322+0000 7f95c6d9d700 1 --2- 172.21.15.49:0/791708825 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ff73637ed0 0x55ff73637990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:06.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.322+0000 7f95c759e700 1 -- 172.21.15.49:0/791708825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ff7363d5f0 msgr2=0x55ff7362c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:06.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.322+0000 7f95c759e700 1 --2- 172.21.15.49:0/791708825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ff7363d5f0 0x55ff7362c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.322+0000 7f95c759e700 1 -- 172.21.15.49:0/791708825 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ff73637ed0 msgr2=0x55ff73637990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:06.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.322+0000 7f95c759e700 1 --2- 172.21.15.49:0/791708825 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ff73637ed0 0x55ff73637990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.323+0000 7f95c759e700 1 -- 172.21.15.49:0/791708825 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff73644410 con 0x55ff7363df10 2024-06-03T00:01:06.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.323+0000 7f95c6d9d700 1 --2- 172.21.15.49:0/791708825 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ff73637ed0 0x55ff73637990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:06.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.323+0000 7f95c759e700 1 --2- 172.21.15.49:0/791708825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff7363df10 0x55ff7363b6e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f95c0007f70 tx=0x7f95c000f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b1d718b07a6192 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:06.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.323+0000 7f95bcd99700 1 -- 172.21.15.49:0/791708825 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c0017070 con 0x55ff7363df10 2024-06-03T00:01:06.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.323+0000 7f95bcd99700 1 -- 172.21.15.49:0/791708825 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95c0004bb0 con 0x55ff7363df10 2024-06-03T00:01:06.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.323+0000 7f95bcd99700 1 -- 172.21.15.49:0/791708825 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c0005280 con 0x55ff7363df10 2024-06-03T00:01:06.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.324+0000 7f95d7a16b80 1 -- 172.21.15.49:0/791708825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff7363df10 msgr2=0x55ff7363b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:06.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.324+0000 7f95d7a16b80 1 --2- 172.21.15.49:0/791708825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff7363df10 0x55ff7363b6e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f95c0007f70 tx=0x7f95c000f510 comp rx=0 tx=0).stop 2024-06-03T00:01:06.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.324+0000 7f95d7a16b80 1 -- 172.21.15.49:0/791708825 shutdown_connections 2024-06-03T00:01:06.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.324+0000 7f95d7a16b80 1 --2- 172.21.15.49:0/791708825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff7363df10 0x55ff7363b6e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.324+0000 7f95d7a16b80 1 --2- 172.21.15.49:0/791708825 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ff73637ed0 0x55ff73637990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.324+0000 7f95d7a16b80 1 --2- 172.21.15.49:0/791708825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ff7363d5f0 0x55ff7362c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.324+0000 7f95d7a16b80 1 -- 172.21.15.49:0/791708825 >> 172.21.15.49:0/791708825 conn(0x55ff73562c70 msgr2=0x55ff7363e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:06.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.324+0000 7f95d7a16b80 1 -- 172.21.15.49:0/791708825 shutdown_connections 2024-06-03T00:01:06.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.324+0000 7f95d7a16b80 1 -- 172.21.15.49:0/791708825 wait complete. 2024-06-03T00:01:06.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.324+0000 7f95d7a16b80 1 -- start start 2024-06-03T00:01:06.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.324+0000 7f95d7a16b80 1 Processor -- start 2024-06-03T00:01:06.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.325+0000 7f95d7a16b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ff73637ed0 0x55ff7365c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:06.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.325+0000 7f95d7a16b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ff7363d5f0 0x55ff73657710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:06.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.325+0000 7f95d7a16b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff7363df10 0x55ff73657c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:06.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.325+0000 7f95d7a16b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ff73652660 con 0x55ff7363df10 2024-06-03T00:01:06.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.325+0000 7f95d7a16b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55ff73651f90 con 0x55ff7363d5f0 2024-06-03T00:01:06.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.325+0000 7f95d7a16b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ff73652d30 con 0x55ff73637ed0 2024-06-03T00:01:06.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.325+0000 7f95d7a16b80 10 client.0 _ll_register_callbacks cb 0x55ff735238d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:06.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.325+0000 7f95c759e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff7363df10 0x55ff73657c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:06.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.325+0000 7f95c759e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff7363df10 0x55ff73657c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42004/0 (socket says 172.21.15.49:42004) 2024-06-03T00:01:06.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.325+0000 7f95c759e700 1 -- 172.21.15.49:0/997927813 learned_addr learned my addr 172.21.15.49:0/997927813 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:06.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.325+0000 7f95c6d9d700 1 --2- 172.21.15.49:0/997927813 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ff73637ed0 0x55ff7365c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:06.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.325+0000 7f95be59c700 1 --2- 172.21.15.49:0/997927813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ff7363d5f0 0x55ff73657710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:06.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.325+0000 7f95c759e700 1 -- 172.21.15.49:0/997927813 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ff73637ed0 msgr2=0x55ff7365c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:06.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.325+0000 7f95c759e700 1 --2- 172.21.15.49:0/997927813 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ff73637ed0 0x55ff7365c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.325+0000 7f95c759e700 1 -- 172.21.15.49:0/997927813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ff7363d5f0 msgr2=0x55ff73657710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:06.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.325+0000 7f95c759e700 1 --2- 172.21.15.49:0/997927813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ff7363d5f0 0x55ff73657710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.325+0000 7f95c759e700 1 -- 172.21.15.49:0/997927813 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff73658490 con 0x55ff7363df10 2024-06-03T00:01:06.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.325+0000 7f95c759e700 1 --2- 172.21.15.49:0/997927813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff7363df10 0x55ff73657c50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f95c0013c70 tx=0x7f95c0013990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492dbc708ea75bae server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:06.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.325+0000 7f95ae7fc700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:01:06.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.325+0000 7f95ae7fc700 1 -- 172.21.15.49:0/997927813 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c0017050 con 0x55ff7363df10 2024-06-03T00:01:06.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.326+0000 7f95ae7fc700 1 -- 172.21.15.49:0/997927813 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f95c0005020 con 0x55ff7363df10 2024-06-03T00:01:06.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.326+0000 7f95d7a16b80 1 -- 172.21.15.49:0/997927813 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95c0004bb0 con 0x55ff7363df10 2024-06-03T00:01:06.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.326+0000 7f95ae7fc700 1 -- 172.21.15.49:0/997927813 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f95c0025640 con 0x55ff7363df10 2024-06-03T00:01:06.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.326+0000 7f95d7a16b80 10 client.15396 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:06.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.326+0000 7f95d7a16b80 1 -- 172.21.15.49:0/997927813 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ff736bcc10 con 0x55ff7363df10 2024-06-03T00:01:06.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.326+0000 7f95ae7fc700 1 -- 172.21.15.49:0/997927813 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95c0004bb0 con 0x55ff7363df10 2024-06-03T00:01:06.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.326+0000 7f95ae7fc700 1 -- 172.21.15.49:0/997927813 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f95c0023070 con 0x55ff7363df10 2024-06-03T00:01:06.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.326+0000 7f95d7a16b80 10 client.15396 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:06.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.326+0000 7f95d7a16b80 10 client.15396 resolve_mds: resolved name 'f' to daemon mds.f 2024-06-03T00:01:06.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.326+0000 7f95d7a16b80 20 client.15396 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:06.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.326+0000 7f95d7a16b80 1 --2- 172.21.15.49:0/997927813 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x55ff736c15a0 0x55ff736c02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:06.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.326+0000 7f95d7a16b80 4 client.15396 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-03T00:01:06.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.326+0000 7f95d7a16b80 1 -- 172.21.15.49:0/997927813 --> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] -- command(tid 0: {"prefix": "status"}) -- 0x55ff73591240 con 0x55ff736c15a0 2024-06-03T00:01:06.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.327+0000 7f95c6d9d700 1 --2- 172.21.15.49:0/997927813 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x55ff736c15a0 0x55ff736c02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:06.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.327+0000 7f95c6d9d700 1 --2- 172.21.15.49:0/997927813 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x55ff736c15a0 0x55ff736c02b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6ce6cc5e954d26c4 server_cookie=f7a07b98b3a6d55e in_seq=0 out_seq=0 2024-06-03T00:01:06.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.327+0000 7f95ae7fc700 10 client.15396 ms_handle_connect on v2:172.21.15.107:6834/3693542801 2024-06-03T00:01:06.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.327+0000 7f95ae7fc700 1 -- 172.21.15.49:0/997927813 <== mds.4 v2:172.21.15.107:6834/3693542801 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55ff73591240 con 0x55ff736c15a0 2024-06-03T00:01:06.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.327+0000 7f95ae7fc700 10 client.15396 handle_command_reply: tid=0 2024-06-03T00:01:06.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.327+0000 7f95d7a16b80 1 client.15396 shutdown 2024-06-03T00:01:06.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.327+0000 7f95d7a16b80 1 -- 172.21.15.49:0/997927813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff7363df10 msgr2=0x55ff73657c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:06.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.327+0000 7f95d7a16b80 1 --2- 172.21.15.49:0/997927813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff7363df10 0x55ff73657c50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f95c0013c70 tx=0x7f95c0013990 comp rx=0 tx=0).stop 2024-06-03T00:01:06.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.327+0000 7f95d7a16b80 1 -- 172.21.15.49:0/997927813 shutdown_connections 2024-06-03T00:01:06.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.327+0000 7f95d7a16b80 1 --2- 172.21.15.49:0/997927813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ff7363df10 0x55ff73657c50 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.327+0000 7f95d7a16b80 1 --2- 172.21.15.49:0/997927813 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x55ff736c15a0 0x55ff736c02b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.327+0000 7f95d7a16b80 1 --2- 172.21.15.49:0/997927813 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ff73637ed0 0x55ff7365c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.327+0000 7f95d7a16b80 1 --2- 172.21.15.49:0/997927813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ff7363d5f0 0x55ff73657710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.327+0000 7f95ae7fc700 0 client.15396 ms_handle_reset on v2:172.21.15.107:6834/3693542801 2024-06-03T00:01:06.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.327+0000 7f95d7a16b80 1 -- 172.21.15.49:0/997927813 >> 172.21.15.49:0/997927813 conn(0x55ff73562c70 msgr2=0x55ff7362c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:06.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.327+0000 7f95d7a16b80 1 -- 172.21.15.49:0/997927813 shutdown_connections 2024-06-03T00:01:06.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.327+0000 7f95d7a16b80 1 -- 172.21.15.49:0/997927813 wait complete. 2024-06-03T00:01:06.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.328+0000 7f95d7a16b80 20 client.15396 trim_cache size 0 max 16384 2024-06-03T00:01:06.335 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:01:06.336 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "890dd222-213a-11ef-bc9b-c7b262605968", 2024-06-03T00:01:06.336 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 4, 2024-06-03T00:01:06.336 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 24460, 2024-06-03T00:01:06.336 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-06-03T00:01:06.336 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-06-03T00:01:06.336 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-06-03T00:01:06.336 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 213.868501581, 2024-06-03T00:01:06.336 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 27, 2024-06-03T00:01:06.336 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 90, 2024-06-03T00:01:06.336 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 90, 2024-06-03T00:01:06.336 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 261.67275987300002 2024-06-03T00:01:06.337 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:01:06.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.328+0000 7f95cd193700 1 -- 172.21.15.49:0/496568415 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f95b40a2c20 msgr2=0x7f95b40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:06.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.328+0000 7f95cd193700 1 --2- 172.21.15.49:0/496568415 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f95b40a2c20 0x7f95b40a50e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f95c8107b80 tx=0x7f95b0005f50 comp rx=0 tx=0).stop 2024-06-03T00:01:06.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.328+0000 7f95cd193700 1 -- 172.21.15.49:0/496568415 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95c8101620 msgr2=0x7f95c8199ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:06.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.328+0000 7f95cd193700 1 --2- 172.21.15.49:0/496568415 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95c8101620 0x7f95c8199ac0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f95b8006010 tx=0x7f95b8005640 comp rx=0 tx=0).stop 2024-06-03T00:01:06.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.328+0000 7f95cd193700 1 -- 172.21.15.49:0/496568415 shutdown_connections 2024-06-03T00:01:06.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.328+0000 7f95cd193700 1 --2- 172.21.15.49:0/496568415 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f95b40a2c20 0x7f95b40a50e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.328+0000 7f95cd193700 1 --2- 172.21.15.49:0/496568415 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95c81066b0 0x7f95c81a4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.328+0000 7f95cd193700 1 --2- 172.21.15.49:0/496568415 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95c8101620 0x7f95c8199ac0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.328+0000 7f95cd193700 1 --2- 172.21.15.49:0/496568415 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95c8101fd0 0x7f95c819a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:06.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.328+0000 7f95cd193700 1 -- 172.21.15.49:0/496568415 >> 172.21.15.49:0/496568415 conn(0x7f95c8078340 msgr2=0x7f95c80ff450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:06.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.328+0000 7f95cd193700 1 -- 172.21.15.49:0/496568415 shutdown_connections 2024-06-03T00:01:06.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:06.328+0000 7f95cd193700 1 -- 172.21.15.49:0/496568415 wait complete. 2024-06-03T00:01:06.675 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:06 smithi049 ceph-mon[32302]: pgmap v415: 97 pgs: 97 active+clean; 659 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.0 KiB/s wr, 14 op/s 2024-06-03T00:01:06.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:06 smithi057 ceph-mon[36457]: pgmap v415: 97 pgs: 97 active+clean; 659 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.0 KiB/s wr, 14 op/s 2024-06-03T00:01:06.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:06 smithi107 ceph-mon[37048]: pgmap v415: 97 pgs: 97 active+clean; 659 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.0 KiB/s wr, 14 op/s 2024-06-03T00:01:07.023 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.h status 2024-06-03T00:01:07.315 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:01:08.654 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:08 smithi107 ceph-mon[37048]: pgmap v416: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-06-03T00:01:08.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:08 smithi057 ceph-mon[36457]: pgmap v416: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-06-03T00:01:08.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:08 smithi049 ceph-mon[32302]: pgmap v416: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-06-03T00:01:09.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.105+0000 7f1717961700 1 -- 172.21.15.49:0/2514782479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1710107400 msgr2=0x7f17101077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:09.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.105+0000 7f1717961700 1 --2- 172.21.15.49:0/2514782479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1710107400 0x7f17101077e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f170000b0a0 tx=0x7f170000b3b0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.105+0000 7f1717961700 1 -- 172.21.15.49:0/2514782479 shutdown_connections 2024-06-03T00:01:09.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.105+0000 7f1717961700 1 --2- 172.21.15.49:0/2514782479 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1710101d50 0x7f171010e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.105+0000 7f1717961700 1 --2- 172.21.15.49:0/2514782479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1710107400 0x7f17101077e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.105+0000 7f1717961700 1 --2- 172.21.15.49:0/2514782479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1710101390 0x7f1710101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.105+0000 7f1717961700 1 -- 172.21.15.49:0/2514782479 >> 172.21.15.49:0/2514782479 conn(0x7f1710078340 msgr2=0x7f1710078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:09.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.105+0000 7f1717961700 1 -- 172.21.15.49:0/2514782479 shutdown_connections 2024-06-03T00:01:09.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.105+0000 7f1717961700 1 -- 172.21.15.49:0/2514782479 wait complete. 2024-06-03T00:01:09.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.106+0000 7f1717961700 1 Processor -- start 2024-06-03T00:01:09.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.106+0000 7f1717961700 1 -- start start 2024-06-03T00:01:09.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.106+0000 7f1717961700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1710101390 0x7f1710103070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:09.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.106+0000 7f1717961700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1710101d50 0x7f17101035b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:09.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.106+0000 7f1717961700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1710107400 0x7f1710103af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:09.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.106+0000 7f1717961700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f17101116a0 con 0x7f1710101390 2024-06-03T00:01:09.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.106+0000 7f1717961700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1710111520 con 0x7f1710101d50 2024-06-03T00:01:09.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.106+0000 7f17156fd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1710101390 0x7f1710103070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:09.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.106+0000 7f1717961700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1710111820 con 0x7f1710107400 2024-06-03T00:01:09.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.106+0000 7f17156fd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1710101390 0x7f1710103070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42028/0 (socket says 172.21.15.49:42028) 2024-06-03T00:01:09.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.106+0000 7f17156fd700 1 -- 172.21.15.49:0/60995876 learned_addr learned my addr 172.21.15.49:0/60995876 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:09.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.107+0000 7f1715efe700 1 --2- 172.21.15.49:0/60995876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1710107400 0x7f1710103af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:09.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.107+0000 7f17156fd700 1 -- 172.21.15.49:0/60995876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1710107400 msgr2=0x7f1710103af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:09.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.107+0000 7f17156fd700 1 --2- 172.21.15.49:0/60995876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1710107400 0x7f1710103af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.107+0000 7f17156fd700 1 -- 172.21.15.49:0/60995876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1710101d50 msgr2=0x7f17101035b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:09.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.107+0000 7f1714efc700 1 --2- 172.21.15.49:0/60995876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1710101d50 0x7f17101035b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:09.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.107+0000 7f17156fd700 1 --2- 172.21.15.49:0/60995876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1710101d50 0x7f17101035b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.107+0000 7f17156fd700 1 -- 172.21.15.49:0/60995876 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17101a7140 con 0x7f1710101390 2024-06-03T00:01:09.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.107+0000 7f1715efe700 1 --2- 172.21.15.49:0/60995876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1710107400 0x7f1710103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:01:09.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.107+0000 7f1714efc700 1 --2- 172.21.15.49:0/60995876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1710101d50 0x7f17101035b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:01:09.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.107+0000 7f17156fd700 1 --2- 172.21.15.49:0/60995876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1710101390 0x7f1710103070 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f17000062a0 tx=0x7f1700004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:09.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.107+0000 7f170e7fc700 1 -- 172.21.15.49:0/60995876 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1700021070 con 0x7f1710101390 2024-06-03T00:01:09.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.107+0000 7f170e7fc700 1 -- 172.21.15.49:0/60995876 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1700007c80 con 0x7f1710101390 2024-06-03T00:01:09.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.107+0000 7f1717961700 1 -- 172.21.15.49:0/60995876 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17101a73d0 con 0x7f1710101390 2024-06-03T00:01:09.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.107+0000 7f170e7fc700 1 -- 172.21.15.49:0/60995876 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17000053d0 con 0x7f1710101390 2024-06-03T00:01:09.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.107+0000 7f1717961700 1 -- 172.21.15.49:0/60995876 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17101a78d0 con 0x7f1710101390 2024-06-03T00:01:09.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.109+0000 7f170e7fc700 1 -- 172.21.15.49:0/60995876 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1700024070 con 0x7f1710101390 2024-06-03T00:01:09.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.110+0000 7f170e7fc700 1 --2- 172.21.15.49:0/60995876 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f16f80a2ca0 0x7f16f80a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:09.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.110+0000 7f1714efc700 1 --2- 172.21.15.49:0/60995876 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f16f80a2ca0 0x7f16f80a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:09.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.110+0000 7f170e7fc700 1 -- 172.21.15.49:0/60995876 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f170000f020 con 0x7f1710101390 2024-06-03T00:01:09.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.111+0000 7f1714efc700 1 --2- 172.21.15.49:0/60995876 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f16f80a2ca0 0x7f16f80a5160 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1704005fd0 tx=0x7f1704005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:09.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.111+0000 7f17221e4b80 1 Processor -- start 2024-06-03T00:01:09.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.111+0000 7f17221e4b80 1 -- start start 2024-06-03T00:01:09.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.111+0000 7f17221e4b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5613414565f0 0x5613414569d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:09.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.111+0000 7f17221e4b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561341456f10 0x561341450990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:09.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.111+0000 7f17221e4b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561341450ed0 0x5613414512f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:09.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.111+0000 7f17221e4b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5613413a27c0 con 0x5613414565f0 2024-06-03T00:01:09.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.111+0000 7f17221e4b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x56134134a6d0 con 0x561341456f10 2024-06-03T00:01:09.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.111+0000 7f17221e4b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56134139e780 con 0x561341450ed0 2024-06-03T00:01:09.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.111+0000 7f17156fd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5613414565f0 0x5613414569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:09.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.111+0000 7f17156fd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5613414565f0 0x5613414569d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42036/0 (socket says 172.21.15.49:42036) 2024-06-03T00:01:09.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.111+0000 7f17156fd700 1 -- 172.21.15.49:0/2784425798 learned_addr learned my addr 172.21.15.49:0/2784425798 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:09.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.112+0000 7f17156fd700 1 -- 172.21.15.49:0/2784425798 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561341450ed0 msgr2=0x5613414512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:09.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.112+0000 7f17156fd700 1 --2- 172.21.15.49:0/2784425798 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561341450ed0 0x5613414512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.112+0000 7f17156fd700 1 -- 172.21.15.49:0/2784425798 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561341456f10 msgr2=0x561341450990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:09.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.112+0000 7f1714efc700 1 --2- 172.21.15.49:0/2784425798 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561341456f10 0x561341450990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:09.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.112+0000 7f17156fd700 1 --2- 172.21.15.49:0/2784425798 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561341456f10 0x561341450990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.112+0000 7f17156fd700 1 -- 172.21.15.49:0/2784425798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561341340f00 con 0x5613414565f0 2024-06-03T00:01:09.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.112+0000 7f17156fd700 1 --2- 172.21.15.49:0/2784425798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5613414565f0 0x5613414569d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1700099550 tx=0x7f170009cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61d158f4e70a80c1 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:09.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.112+0000 7f16f77fe700 1 -- 172.21.15.49:0/2784425798 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17000a14a0 con 0x5613414565f0 2024-06-03T00:01:09.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.112+0000 7f16f77fe700 1 -- 172.21.15.49:0/2784425798 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17000a5cd0 con 0x5613414565f0 2024-06-03T00:01:09.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.112+0000 7f16f77fe700 1 -- 172.21.15.49:0/2784425798 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17000a1120 con 0x5613414565f0 2024-06-03T00:01:09.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.113+0000 7f17221e4b80 1 -- 172.21.15.49:0/2784425798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5613414565f0 msgr2=0x5613414569d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:09.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.113+0000 7f17221e4b80 1 --2- 172.21.15.49:0/2784425798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5613414565f0 0x5613414569d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1700099550 tx=0x7f170009cb50 comp rx=0 tx=0).stop 2024-06-03T00:01:09.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.113+0000 7f17221e4b80 1 -- 172.21.15.49:0/2784425798 shutdown_connections 2024-06-03T00:01:09.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.113+0000 7f17221e4b80 1 --2- 172.21.15.49:0/2784425798 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561341450ed0 0x5613414512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.113+0000 7f17221e4b80 1 --2- 172.21.15.49:0/2784425798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5613414565f0 0x5613414569d0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.113+0000 7f17221e4b80 1 --2- 172.21.15.49:0/2784425798 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561341456f10 0x561341450990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.113+0000 7f17221e4b80 1 -- 172.21.15.49:0/2784425798 >> 172.21.15.49:0/2784425798 conn(0x56134137bc70 msgr2=0x56134144b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:09.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.113+0000 7f17221e4b80 1 -- 172.21.15.49:0/2784425798 shutdown_connections 2024-06-03T00:01:09.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.113+0000 7f17221e4b80 1 -- 172.21.15.49:0/2784425798 wait complete. 2024-06-03T00:01:09.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.113+0000 7f17221e4b80 1 -- start start 2024-06-03T00:01:09.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.113+0000 7f17221e4b80 1 Processor -- start 2024-06-03T00:01:09.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.114+0000 7f17221e4b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561341450ed0 0x56134145cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:09.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.114+0000 7f17221e4b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5613414565f0 0x561341459f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:09.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.114+0000 7f17221e4b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561341456f10 0x56134145a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:09.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.114+0000 7f17221e4b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56134145d6a0 con 0x561341450ed0 2024-06-03T00:01:09.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.114+0000 7f17221e4b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x561341342ba0 con 0x5613414565f0 2024-06-03T00:01:09.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.114+0000 7f17221e4b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56134145d820 con 0x561341456f10 2024-06-03T00:01:09.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.114+0000 7f17221e4b80 10 client.0 _ll_register_callbacks cb 0x56134133c8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:09.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.114+0000 7f17156fd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561341450ed0 0x56134145cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:09.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.114+0000 7f17156fd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561341450ed0 0x56134145cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42044/0 (socket says 172.21.15.49:42044) 2024-06-03T00:01:09.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.114+0000 7f17156fd700 1 -- 172.21.15.49:0/3537932059 learned_addr learned my addr 172.21.15.49:0/3537932059 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:09.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.114+0000 7f1714efc700 1 --2- 172.21.15.49:0/3537932059 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5613414565f0 0x561341459f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:09.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.114+0000 7f1715efe700 1 --2- 172.21.15.49:0/3537932059 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561341456f10 0x56134145a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:09.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.114+0000 7f17156fd700 1 -- 172.21.15.49:0/3537932059 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561341456f10 msgr2=0x56134145a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:09.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.114+0000 7f17156fd700 1 --2- 172.21.15.49:0/3537932059 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561341456f10 0x56134145a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.114+0000 7f17156fd700 1 -- 172.21.15.49:0/3537932059 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5613414565f0 msgr2=0x561341459f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:09.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.114+0000 7f17156fd700 1 --2- 172.21.15.49:0/3537932059 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5613414565f0 0x561341459f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.114+0000 7f17156fd700 1 -- 172.21.15.49:0/3537932059 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613412f1880 con 0x561341450ed0 2024-06-03T00:01:09.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.114+0000 7f17156fd700 1 --2- 172.21.15.49:0/3537932059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561341450ed0 0x56134145cc30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f170009cdf0 tx=0x7f170009b2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e084df68e4bec624 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:09.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.115+0000 7f16f4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:01:09.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.115+0000 7f16f4ff9700 1 -- 172.21.15.49:0/3537932059 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17000b5070 con 0x561341450ed0 2024-06-03T00:01:09.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.115+0000 7f16f4ff9700 1 -- 172.21.15.49:0/3537932059 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f17000074e0 con 0x561341450ed0 2024-06-03T00:01:09.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.115+0000 7f17221e4b80 1 -- 172.21.15.49:0/3537932059 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17000a5cd0 con 0x561341450ed0 2024-06-03T00:01:09.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.115+0000 7f16f4ff9700 1 -- 172.21.15.49:0/3537932059 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f170009d350 con 0x561341450ed0 2024-06-03T00:01:09.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.115+0000 7f17221e4b80 10 client.15408 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:09.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.115+0000 7f17221e4b80 1 -- 172.21.15.49:0/3537932059 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56134145d6a0 con 0x561341450ed0 2024-06-03T00:01:09.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.115+0000 7f16f4ff9700 1 -- 172.21.15.49:0/3537932059 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17000a5cd0 con 0x561341450ed0 2024-06-03T00:01:09.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.115+0000 7f16f4ff9700 1 -- 172.21.15.49:0/3537932059 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f1700011070 con 0x561341450ed0 2024-06-03T00:01:09.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.115+0000 7f17221e4b80 10 client.15408 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:09.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.115+0000 7f17221e4b80 10 client.15408 resolve_mds: resolved name 'h' to daemon mds.h 2024-06-03T00:01:09.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.115+0000 7f17221e4b80 20 client.15408 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:09.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.115+0000 7f17221e4b80 1 --2- 172.21.15.49:0/3537932059 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x56134146a190 0x56134146b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:09.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.115+0000 7f17221e4b80 4 client.15408 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:01:09.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.115+0000 7f17221e4b80 1 -- 172.21.15.49:0/3537932059 --> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5613413afcc0 con 0x56134146a190 2024-06-03T00:01:09.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.116+0000 7f1714efc700 1 --2- 172.21.15.49:0/3537932059 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x56134146a190 0x56134146b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:09.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.116+0000 7f1714efc700 1 --2- 172.21.15.49:0/3537932059 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x56134146a190 0x56134146b600 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=bbba851136053950 server_cookie=c3c39bee2f593617 in_seq=0 out_seq=0 2024-06-03T00:01:09.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.116+0000 7f16f4ff9700 10 client.15408 ms_handle_connect on v2:172.21.15.57:6836/230452144 2024-06-03T00:01:09.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.117+0000 7f16f4ff9700 1 -- 172.21.15.49:0/3537932059 <== mds.3 v2:172.21.15.57:6836/230452144 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5613413afcc0 con 0x56134146a190 2024-06-03T00:01:09.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.117+0000 7f16f4ff9700 10 client.15408 handle_command_reply: tid=0 2024-06-03T00:01:09.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.117+0000 7f17221e4b80 1 client.15408 shutdown 2024-06-03T00:01:09.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.117+0000 7f17221e4b80 1 -- 172.21.15.49:0/3537932059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561341450ed0 msgr2=0x56134145cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:09.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.117+0000 7f17221e4b80 1 --2- 172.21.15.49:0/3537932059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561341450ed0 0x56134145cc30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f170009cdf0 tx=0x7f170009b2d0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.117+0000 7f17221e4b80 1 -- 172.21.15.49:0/3537932059 shutdown_connections 2024-06-03T00:01:09.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.117+0000 7f17221e4b80 1 --2- 172.21.15.49:0/3537932059 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x56134146a190 0x56134146b600 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.117+0000 7f17221e4b80 1 --2- 172.21.15.49:0/3537932059 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561341456f10 0x56134145a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.117+0000 7f17221e4b80 1 --2- 172.21.15.49:0/3537932059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561341450ed0 0x56134145cc30 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.117+0000 7f17221e4b80 1 --2- 172.21.15.49:0/3537932059 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5613414565f0 0x561341459f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.117+0000 7f17221e4b80 1 -- 172.21.15.49:0/3537932059 >> 172.21.15.49:0/3537932059 conn(0x56134137bc70 msgr2=0x56134144f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:09.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.117+0000 7f16f4ff9700 0 client.15408 ms_handle_reset on v2:172.21.15.57:6836/230452144 2024-06-03T00:01:09.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.117+0000 7f17221e4b80 1 -- 172.21.15.49:0/3537932059 shutdown_connections 2024-06-03T00:01:09.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.117+0000 7f17221e4b80 1 -- 172.21.15.49:0/3537932059 wait complete. 2024-06-03T00:01:09.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.117+0000 7f17221e4b80 20 client.15408 trim_cache size 0 max 16384 2024-06-03T00:01:09.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.139+0000 7f17221e4b80 1 Processor -- start 2024-06-03T00:01:09.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.139+0000 7f17221e4b80 1 -- start start 2024-06-03T00:01:09.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.139+0000 7f17221e4b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561341450ed0 0x561341450990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:09.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.139+0000 7f17221e4b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5613414565f0 0x5613414572f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:09.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.139+0000 7f17221e4b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561341456f10 0x561341457830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:09.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.139+0000 7f17221e4b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x561341469940 con 0x561341450ed0 2024-06-03T00:01:09.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.139+0000 7f17221e4b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x56134146a010 con 0x561341456f10 2024-06-03T00:01:09.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.139+0000 7f17221e4b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56134146a6e0 con 0x5613414565f0 2024-06-03T00:01:09.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.139+0000 7f17156fd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561341450ed0 0x561341450990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:09.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.139+0000 7f17156fd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561341450ed0 0x561341450990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42050/0 (socket says 172.21.15.49:42050) 2024-06-03T00:01:09.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.139+0000 7f17156fd700 1 -- 172.21.15.49:0/119389462 learned_addr learned my addr 172.21.15.49:0/119389462 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:09.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.139+0000 7f1715efe700 1 --2- 172.21.15.49:0/119389462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561341456f10 0x561341457830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:09.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.139+0000 7f1714efc700 1 --2- 172.21.15.49:0/119389462 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5613414565f0 0x5613414572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:09.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.140+0000 7f17156fd700 1 -- 172.21.15.49:0/119389462 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5613414565f0 msgr2=0x5613414572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:09.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.140+0000 7f17156fd700 1 --2- 172.21.15.49:0/119389462 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5613414565f0 0x5613414572f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.140+0000 7f17156fd700 1 -- 172.21.15.49:0/119389462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561341456f10 msgr2=0x561341457830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:09.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.140+0000 7f17156fd700 1 --2- 172.21.15.49:0/119389462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561341456f10 0x561341457830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.140+0000 7f17156fd700 1 -- 172.21.15.49:0/119389462 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613414584c0 con 0x561341450ed0 2024-06-03T00:01:09.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.140+0000 7f17156fd700 1 --2- 172.21.15.49:0/119389462 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561341450ed0 0x561341450990 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1700000f80 tx=0x7f170000b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9981927cad6cb823 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:09.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.140+0000 7f16f6ffd700 1 -- 172.21.15.49:0/119389462 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1700099390 con 0x561341450ed0 2024-06-03T00:01:09.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.140+0000 7f16f6ffd700 1 -- 172.21.15.49:0/119389462 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17000a5cd0 con 0x561341450ed0 2024-06-03T00:01:09.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.140+0000 7f16f6ffd700 1 -- 172.21.15.49:0/119389462 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17000074e0 con 0x561341450ed0 2024-06-03T00:01:09.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.141+0000 7f17221e4b80 1 -- 172.21.15.49:0/119389462 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561341450ed0 msgr2=0x561341450990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:09.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.141+0000 7f17221e4b80 1 --2- 172.21.15.49:0/119389462 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561341450ed0 0x561341450990 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1700000f80 tx=0x7f170000b3b0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.141+0000 7f17221e4b80 1 -- 172.21.15.49:0/119389462 shutdown_connections 2024-06-03T00:01:09.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.141+0000 7f17221e4b80 1 --2- 172.21.15.49:0/119389462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561341456f10 0x561341457830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.141+0000 7f17221e4b80 1 --2- 172.21.15.49:0/119389462 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561341450ed0 0x561341450990 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.141+0000 7f17221e4b80 1 --2- 172.21.15.49:0/119389462 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5613414565f0 0x5613414572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.141+0000 7f17221e4b80 1 -- 172.21.15.49:0/119389462 >> 172.21.15.49:0/119389462 conn(0x56134137bc70 msgr2=0x5613414690d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:09.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.141+0000 7f17221e4b80 1 -- 172.21.15.49:0/119389462 shutdown_connections 2024-06-03T00:01:09.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.141+0000 7f17221e4b80 1 -- 172.21.15.49:0/119389462 wait complete. 2024-06-03T00:01:09.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.141+0000 7f17221e4b80 1 -- start start 2024-06-03T00:01:09.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.141+0000 7f17221e4b80 1 Processor -- start 2024-06-03T00:01:09.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.142+0000 7f17221e4b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561341450ed0 0x561341475320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:09.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.142+0000 7f17221e4b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5613414565f0 0x5613414706a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:09.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.142+0000 7f17221e4b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561341456f10 0x561341470d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:09.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.142+0000 7f17221e4b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56134146b480 con 0x5613414565f0 2024-06-03T00:01:09.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.142+0000 7f17221e4b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x56134146adb0 con 0x561341456f10 2024-06-03T00:01:09.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.142+0000 7f17221e4b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56134146bb50 con 0x561341450ed0 2024-06-03T00:01:09.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.142+0000 7f17221e4b80 10 client.0 _ll_register_callbacks cb 0x56134133c8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:09.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.142+0000 7f1714efc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5613414565f0 0x5613414706a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:09.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.142+0000 7f1714efc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5613414565f0 0x5613414706a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42066/0 (socket says 172.21.15.49:42066) 2024-06-03T00:01:09.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.142+0000 7f1714efc700 1 -- 172.21.15.49:0/2984983013 learned_addr learned my addr 172.21.15.49:0/2984983013 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:09.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.142+0000 7f1715efe700 1 --2- 172.21.15.49:0/2984983013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561341456f10 0x561341470d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:09.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.142+0000 7f17156fd700 1 --2- 172.21.15.49:0/2984983013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561341450ed0 0x561341475320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:09.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.142+0000 7f1714efc700 1 -- 172.21.15.49:0/2984983013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561341450ed0 msgr2=0x561341475320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:09.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.142+0000 7f1714efc700 1 --2- 172.21.15.49:0/2984983013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561341450ed0 0x561341475320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.142+0000 7f1714efc700 1 -- 172.21.15.49:0/2984983013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561341456f10 msgr2=0x561341470d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:09.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.142+0000 7f1714efc700 1 --2- 172.21.15.49:0/2984983013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561341456f10 0x561341470d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.142+0000 7f1714efc700 1 -- 172.21.15.49:0/2984983013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613414d4a20 con 0x5613414565f0 2024-06-03T00:01:09.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.142+0000 7f1714efc700 1 --2- 172.21.15.49:0/2984983013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5613414565f0 0x5613414706a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1704009410 tx=0x7f17040047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e32ac1aa0b79b44b server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:09.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.142+0000 7f16f4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:01:09.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.142+0000 7f16f4ff9700 1 -- 172.21.15.49:0/2984983013 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170402c070 con 0x5613414565f0 2024-06-03T00:01:09.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.142+0000 7f16f4ff9700 1 -- 172.21.15.49:0/2984983013 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f1704004020 con 0x5613414565f0 2024-06-03T00:01:09.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.142+0000 7f17221e4b80 1 -- 172.21.15.49:0/2984983013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17000a5cd0 con 0x5613414565f0 2024-06-03T00:01:09.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.143+0000 7f16f4ff9700 1 -- 172.21.15.49:0/2984983013 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1704004220 con 0x5613414565f0 2024-06-03T00:01:09.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.143+0000 7f17221e4b80 10 client.15414 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:09.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.143+0000 7f17221e4b80 1 -- 172.21.15.49:0/2984983013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5613414d5c70 con 0x5613414565f0 2024-06-03T00:01:09.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.143+0000 7f16f4ff9700 1 -- 172.21.15.49:0/2984983013 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17000a5cd0 con 0x5613414565f0 2024-06-03T00:01:09.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.143+0000 7f16f4ff9700 1 -- 172.21.15.49:0/2984983013 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f17000a1120 con 0x5613414565f0 2024-06-03T00:01:09.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.143+0000 7f17221e4b80 10 client.15414 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:09.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.143+0000 7f17221e4b80 10 client.15414 resolve_mds: resolved name 'h' to daemon mds.h 2024-06-03T00:01:09.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.143+0000 7f17221e4b80 20 client.15414 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:09.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.143+0000 7f17221e4b80 1 --2- 172.21.15.49:0/2984983013 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x5613414da860 0x5613414d9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:09.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.143+0000 7f17221e4b80 4 client.15414 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-03T00:01:09.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.143+0000 7f17221e4b80 1 -- 172.21.15.49:0/2984983013 --> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] -- command(tid 0: {"prefix": "status"}) -- 0x5613413aa240 con 0x5613414da860 2024-06-03T00:01:09.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.143+0000 7f17156fd700 1 --2- 172.21.15.49:0/2984983013 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x5613414da860 0x5613414d9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:09.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.144+0000 7f17156fd700 1 --2- 172.21.15.49:0/2984983013 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x5613414da860 0x5613414d9570 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cb1c79514852e53e server_cookie=c3713f5b722b3a5 in_seq=0 out_seq=0 2024-06-03T00:01:09.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.144+0000 7f16f4ff9700 10 client.15414 ms_handle_connect on v2:172.21.15.57:6836/230452144 2024-06-03T00:01:09.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.144+0000 7f16f4ff9700 1 -- 172.21.15.49:0/2984983013 <== mds.3 v2:172.21.15.57:6836/230452144 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5613413aa240 con 0x5613414da860 2024-06-03T00:01:09.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.144+0000 7f16f4ff9700 10 client.15414 handle_command_reply: tid=0 2024-06-03T00:01:09.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.144+0000 7f17221e4b80 1 client.15414 shutdown 2024-06-03T00:01:09.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.144+0000 7f17221e4b80 1 -- 172.21.15.49:0/2984983013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5613414565f0 msgr2=0x5613414706a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:09.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.144+0000 7f17221e4b80 1 --2- 172.21.15.49:0/2984983013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5613414565f0 0x5613414706a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1704009410 tx=0x7f17040047c0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.144+0000 7f17221e4b80 1 -- 172.21.15.49:0/2984983013 shutdown_connections 2024-06-03T00:01:09.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.144+0000 7f17221e4b80 1 --2- 172.21.15.49:0/2984983013 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x5613414da860 0x5613414d9570 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.144+0000 7f17221e4b80 1 --2- 172.21.15.49:0/2984983013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561341456f10 0x561341470d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.144+0000 7f17221e4b80 1 --2- 172.21.15.49:0/2984983013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561341450ed0 0x561341475320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.144+0000 7f17221e4b80 1 --2- 172.21.15.49:0/2984983013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5613414565f0 0x5613414706a0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.144+0000 7f16f4ff9700 0 client.15414 ms_handle_reset on v2:172.21.15.57:6836/230452144 2024-06-03T00:01:09.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.144+0000 7f17221e4b80 1 -- 172.21.15.49:0/2984983013 >> 172.21.15.49:0/2984983013 conn(0x56134137bc70 msgr2=0x5613414572f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:09.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.144+0000 7f17221e4b80 1 -- 172.21.15.49:0/2984983013 shutdown_connections 2024-06-03T00:01:09.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.144+0000 7f17221e4b80 1 -- 172.21.15.49:0/2984983013 wait complete. 2024-06-03T00:01:09.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.145+0000 7f17221e4b80 20 client.15414 trim_cache size 0 max 16384 2024-06-03T00:01:09.150 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:01:09.151 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "890dd222-213a-11ef-bc9b-c7b262605968", 2024-06-03T00:01:09.151 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 3, 2024-06-03T00:01:09.151 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 24464, 2024-06-03T00:01:09.151 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-06-03T00:01:09.151 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-06-03T00:01:09.151 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-06-03T00:01:09.151 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 217.69368561300001, 2024-06-03T00:01:09.151 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 27, 2024-06-03T00:01:09.151 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 90, 2024-06-03T00:01:09.151 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 90, 2024-06-03T00:01:09.151 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 258.85449996800003 2024-06-03T00:01:09.151 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:01:09.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.145+0000 7f1717961700 1 -- 172.21.15.49:0/60995876 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f16f80a2ca0 msgr2=0x7f16f80a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:09.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.145+0000 7f1717961700 1 --2- 172.21.15.49:0/60995876 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f16f80a2ca0 0x7f16f80a5160 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1704005fd0 tx=0x7f1704005ee0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.145+0000 7f1717961700 1 -- 172.21.15.49:0/60995876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1710101390 msgr2=0x7f1710103070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:09.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.145+0000 7f1717961700 1 --2- 172.21.15.49:0/60995876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1710101390 0x7f1710103070 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f17000062a0 tx=0x7f1700004e20 comp rx=0 tx=0).stop 2024-06-03T00:01:09.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.145+0000 7f1717961700 1 -- 172.21.15.49:0/60995876 shutdown_connections 2024-06-03T00:01:09.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.145+0000 7f1717961700 1 --2- 172.21.15.49:0/60995876 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f16f80a2ca0 0x7f16f80a5160 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.145+0000 7f1717961700 1 --2- 172.21.15.49:0/60995876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1710107400 0x7f1710103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.145+0000 7f1717961700 1 --2- 172.21.15.49:0/60995876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1710101390 0x7f1710103070 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.145+0000 7f1717961700 1 --2- 172.21.15.49:0/60995876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1710101d50 0x7f17101035b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:09.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.145+0000 7f1717961700 1 -- 172.21.15.49:0/60995876 >> 172.21.15.49:0/60995876 conn(0x7f1710078340 msgr2=0x7f1710100650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:09.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.145+0000 7f1717961700 1 -- 172.21.15.49:0/60995876 shutdown_connections 2024-06-03T00:01:09.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:09.145+0000 7f1717961700 1 -- 172.21.15.49:0/60995876 wait complete. 2024-06-03T00:01:09.916 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.c status 2024-06-03T00:01:10.168 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:01:10.571 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:10 smithi049 ceph-mon[32302]: pgmap v417: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-06-03T00:01:10.702 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:10 smithi057 ceph-mon[36457]: pgmap v417: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-06-03T00:01:10.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:10 smithi107 ceph-mon[37048]: pgmap v417: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-06-03T00:01:11.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.978+0000 7ffba8c30700 1 -- 172.21.15.49:0/708328047 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffba4102740 msgr2=0x7ffba4102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:11.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.978+0000 7ffba8c30700 1 --2- 172.21.15.49:0/708328047 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffba4102740 0x7ffba4102b20 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ffb940099c0 tx=0x7ffb94009cd0 comp rx=0 tx=0).stop 2024-06-03T00:01:11.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.978+0000 7ffba8c30700 1 -- 172.21.15.49:0/708328047 shutdown_connections 2024-06-03T00:01:11.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.978+0000 7ffba8c30700 1 --2- 172.21.15.49:0/708328047 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffba4107840 0x7ffba410f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:11.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.978+0000 7ffba8c30700 1 --2- 172.21.15.49:0/708328047 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffba4102740 0x7ffba4102b20 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:11.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.978+0000 7ffba8c30700 1 --2- 172.21.15.49:0/708328047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffba41030f0 0x7ffba4107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:11.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.978+0000 7ffba8c30700 1 -- 172.21.15.49:0/708328047 >> 172.21.15.49:0/708328047 conn(0x7ffba40795f0 msgr2=0x7ffba4079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:11.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.978+0000 7ffba8c30700 1 -- 172.21.15.49:0/708328047 shutdown_connections 2024-06-03T00:01:11.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.978+0000 7ffba8c30700 1 -- 172.21.15.49:0/708328047 wait complete. 2024-06-03T00:01:11.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.979+0000 7ffba8c30700 1 Processor -- start 2024-06-03T00:01:11.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.979+0000 7ffba8c30700 1 -- start start 2024-06-03T00:01:11.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.979+0000 7ffba8c30700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffba4102740 0x7ffba419e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:11.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.979+0000 7ffba8c30700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffba41030f0 0x7ffba419ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:11.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.979+0000 7ffba8c30700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffba4107840 0x7ffba4198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:11.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.979+0000 7ffba8c30700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ffba4112780 con 0x7ffba4102740 2024-06-03T00:01:11.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.979+0000 7ffba8c30700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ffba4112600 con 0x7ffba41030f0 2024-06-03T00:01:11.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.979+0000 7ffba8c30700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ffba4112900 con 0x7ffba4107840 2024-06-03T00:01:11.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.979+0000 7ffba259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffba4102740 0x7ffba419e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:11.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.979+0000 7ffba259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffba4102740 0x7ffba419e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42092/0 (socket says 172.21.15.49:42092) 2024-06-03T00:01:11.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.979+0000 7ffba259c700 1 -- 172.21.15.49:0/2315045095 learned_addr learned my addr 172.21.15.49:0/2315045095 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:11.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.980+0000 7ffba1d9b700 1 --2- 172.21.15.49:0/2315045095 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffba41030f0 0x7ffba419ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:11.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.980+0000 7ffba2d9d700 1 --2- 172.21.15.49:0/2315045095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffba4107840 0x7ffba4198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:11.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.980+0000 7ffba259c700 1 -- 172.21.15.49:0/2315045095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffba4107840 msgr2=0x7ffba4198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:11.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.980+0000 7ffba259c700 1 --2- 172.21.15.49:0/2315045095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffba4107840 0x7ffba4198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:11.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.980+0000 7ffba259c700 1 -- 172.21.15.49:0/2315045095 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffba41030f0 msgr2=0x7ffba419ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:11.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.980+0000 7ffba259c700 1 --2- 172.21.15.49:0/2315045095 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffba41030f0 0x7ffba419ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:11.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.980+0000 7ffba259c700 1 -- 172.21.15.49:0/2315045095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba41990e0 con 0x7ffba4102740 2024-06-03T00:01:11.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.980+0000 7ffba259c700 1 --2- 172.21.15.49:0/2315045095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffba4102740 0x7ffba419e7c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ffb940059d0 tx=0x7ffb9400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:11.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.980+0000 7ffb937fe700 1 -- 172.21.15.49:0/2315045095 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb94027070 con 0x7ffba4102740 2024-06-03T00:01:11.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.980+0000 7ffb937fe700 1 -- 172.21.15.49:0/2315045095 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb94003680 con 0x7ffba4102740 2024-06-03T00:01:11.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.980+0000 7ffba8c30700 1 -- 172.21.15.49:0/2315045095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffba4199370 con 0x7ffba4102740 2024-06-03T00:01:11.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.980+0000 7ffb937fe700 1 -- 172.21.15.49:0/2315045095 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb94017650 con 0x7ffba4102740 2024-06-03T00:01:11.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.980+0000 7ffba8c30700 1 -- 172.21.15.49:0/2315045095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffba41a5690 con 0x7ffba4102740 2024-06-03T00:01:11.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.983+0000 7ffb937fe700 1 -- 172.21.15.49:0/2315045095 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ffb9402a070 con 0x7ffba4102740 2024-06-03T00:01:11.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.984+0000 7ffb937fe700 1 --2- 172.21.15.49:0/2315045095 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ffb8c0a2c20 0x7ffb8c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:11.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.984+0000 7ffba1d9b700 1 --2- 172.21.15.49:0/2315045095 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ffb8c0a2c20 0x7ffb8c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:11.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.984+0000 7ffb937fe700 1 -- 172.21.15.49:0/2315045095 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7ffb940cfd10 con 0x7ffba4102740 2024-06-03T00:01:11.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.984+0000 7ffba1d9b700 1 --2- 172.21.15.49:0/2315045095 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ffb8c0a2c20 0x7ffb8c0a50e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ffba407a090 tx=0x7ffb98009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:11.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.984+0000 7ffbb34b3b80 1 Processor -- start 2024-06-03T00:01:11.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.985+0000 7ffbb34b3b80 1 -- start start 2024-06-03T00:01:11.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.985+0000 7ffbb34b3b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c812dd7f80 0x55c812dd8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:11.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.985+0000 7ffbb34b3b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c812dd88a0 0x55c812ddc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:11.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.985+0000 7ffbb34b3b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c812ddcbe0 0x55c812ddd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:11.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.985+0000 7ffbb34b3b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c812d257c0 con 0x55c812dd7f80 2024-06-03T00:01:11.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.985+0000 7ffbb34b3b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55c812ccd6d0 con 0x55c812dd88a0 2024-06-03T00:01:11.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.985+0000 7ffbb34b3b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55c812d21780 con 0x55c812ddcbe0 2024-06-03T00:01:11.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.985+0000 7ffba259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c812dd7f80 0x55c812dd8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:11.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.985+0000 7ffba259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c812dd7f80 0x55c812dd8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42100/0 (socket says 172.21.15.49:42100) 2024-06-03T00:01:11.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.985+0000 7ffba259c700 1 -- 172.21.15.49:0/1296426601 learned_addr learned my addr 172.21.15.49:0/1296426601 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:11.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.985+0000 7ffba1d9b700 1 --2- 172.21.15.49:0/1296426601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c812dd88a0 0x55c812ddc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:11.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.985+0000 7ffba2d9d700 1 --2- 172.21.15.49:0/1296426601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c812ddcbe0 0x55c812ddd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:11.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.985+0000 7ffba259c700 1 -- 172.21.15.49:0/1296426601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c812ddcbe0 msgr2=0x55c812ddd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:11.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.985+0000 7ffba259c700 1 --2- 172.21.15.49:0/1296426601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c812ddcbe0 0x55c812ddd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:11.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.985+0000 7ffba259c700 1 -- 172.21.15.49:0/1296426601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c812dd88a0 msgr2=0x55c812ddc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:11.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.985+0000 7ffba259c700 1 --2- 172.21.15.49:0/1296426601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c812dd88a0 0x55c812ddc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:11.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.985+0000 7ffba259c700 1 -- 172.21.15.49:0/1296426601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c812cc3f00 con 0x55c812dd7f80 2024-06-03T00:01:11.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.985+0000 7ffba259c700 1 --2- 172.21.15.49:0/1296426601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c812dd7f80 0x55c812dd8360 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ffb9409c300 tx=0x7ffb9409c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=710d46dbf91acbcd server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:11.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.986+0000 7ffb90ff9700 1 -- 172.21.15.49:0/1296426601 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb94098040 con 0x55c812dd7f80 2024-06-03T00:01:11.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.986+0000 7ffb90ff9700 1 -- 172.21.15.49:0/1296426601 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb9409cd00 con 0x55c812dd7f80 2024-06-03T00:01:11.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.986+0000 7ffb90ff9700 1 -- 172.21.15.49:0/1296426601 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb940a4d50 con 0x55c812dd7f80 2024-06-03T00:01:11.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.986+0000 7ffbb34b3b80 1 -- 172.21.15.49:0/1296426601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c812dd7f80 msgr2=0x55c812dd8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:11.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.986+0000 7ffbb34b3b80 1 --2- 172.21.15.49:0/1296426601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c812dd7f80 0x55c812dd8360 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ffb9409c300 tx=0x7ffb9409c3d0 comp rx=0 tx=0).stop 2024-06-03T00:01:11.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.986+0000 7ffbb34b3b80 1 -- 172.21.15.49:0/1296426601 shutdown_connections 2024-06-03T00:01:11.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.986+0000 7ffbb34b3b80 1 --2- 172.21.15.49:0/1296426601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c812ddcbe0 0x55c812ddd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:11.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.986+0000 7ffbb34b3b80 1 --2- 172.21.15.49:0/1296426601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c812dd7f80 0x55c812dd8360 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:11.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.986+0000 7ffbb34b3b80 1 --2- 172.21.15.49:0/1296426601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c812dd88a0 0x55c812ddc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:11.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.986+0000 7ffbb34b3b80 1 -- 172.21.15.49:0/1296426601 >> 172.21.15.49:0/1296426601 conn(0x55c812cfec70 msgr2=0x55c812dce800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:11.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.987+0000 7ffbb34b3b80 1 -- 172.21.15.49:0/1296426601 shutdown_connections 2024-06-03T00:01:11.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.987+0000 7ffbb34b3b80 1 -- 172.21.15.49:0/1296426601 wait complete. 2024-06-03T00:01:11.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.987+0000 7ffbb34b3b80 1 -- start start 2024-06-03T00:01:11.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.987+0000 7ffbb34b3b80 1 Processor -- start 2024-06-03T00:01:11.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.987+0000 7ffbb34b3b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c812dd7f80 0x55c812de4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:11.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.987+0000 7ffbb34b3b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c812dd88a0 0x55c812de1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:11.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.987+0000 7ffbb34b3b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c812ddcbe0 0x55c812de1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:11.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.987+0000 7ffbb34b3b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c812de4aa0 con 0x55c812dd7f80 2024-06-03T00:01:11.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.987+0000 7ffbb34b3b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55c812cc5ba0 con 0x55c812dd88a0 2024-06-03T00:01:11.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.987+0000 7ffbb34b3b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55c812de4c20 con 0x55c812ddcbe0 2024-06-03T00:01:11.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.988+0000 7ffbb34b3b80 10 client.0 _ll_register_callbacks cb 0x55c812cbf8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:11.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.988+0000 7ffba259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c812dd7f80 0x55c812de4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:11.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.988+0000 7ffba259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c812dd7f80 0x55c812de4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42104/0 (socket says 172.21.15.49:42104) 2024-06-03T00:01:11.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.988+0000 7ffba259c700 1 -- 172.21.15.49:0/2136238489 learned_addr learned my addr 172.21.15.49:0/2136238489 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:11.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.988+0000 7ffba2d9d700 1 --2- 172.21.15.49:0/2136238489 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c812ddcbe0 0x55c812de1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:11.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.988+0000 7ffba259c700 1 -- 172.21.15.49:0/2136238489 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c812ddcbe0 msgr2=0x55c812de1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:11.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.988+0000 7ffba259c700 1 --2- 172.21.15.49:0/2136238489 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c812ddcbe0 0x55c812de1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:11.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.988+0000 7ffba1d9b700 1 --2- 172.21.15.49:0/2136238489 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c812dd88a0 0x55c812de1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:11.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.988+0000 7ffba259c700 1 -- 172.21.15.49:0/2136238489 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c812dd88a0 msgr2=0x55c812de1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:11.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.988+0000 7ffba259c700 1 --2- 172.21.15.49:0/2136238489 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c812dd88a0 0x55c812de1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:11.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.988+0000 7ffba259c700 1 -- 172.21.15.49:0/2136238489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c812c74880 con 0x55c812dd7f80 2024-06-03T00:01:11.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.988+0000 7ffba2d9d700 1 --2- 172.21.15.49:0/2136238489 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c812ddcbe0 0x55c812de1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:01:11.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.988+0000 7ffba1d9b700 1 --2- 172.21.15.49:0/2136238489 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c812dd88a0 0x55c812de1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:01:11.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.988+0000 7ffba259c700 1 --2- 172.21.15.49:0/2136238489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c812dd7f80 0x55c812de4140 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ffb940a4cb0 tx=0x7ffb940a5290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b0cc2bdb974cc3 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:11.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.988+0000 7ffb89ffb700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:01:11.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.988+0000 7ffb89ffb700 1 -- 172.21.15.49:0/2136238489 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb940b4070 con 0x55c812dd7f80 2024-06-03T00:01:11.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.988+0000 7ffb89ffb700 1 -- 172.21.15.49:0/2136238489 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7ffb94085b90 con 0x55c812dd7f80 2024-06-03T00:01:11.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.988+0000 7ffbb34b3b80 1 -- 172.21.15.49:0/2136238489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb9409cd00 con 0x55c812dd7f80 2024-06-03T00:01:11.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.988+0000 7ffb89ffb700 1 -- 172.21.15.49:0/2136238489 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ffb94098040 con 0x55c812dd7f80 2024-06-03T00:01:11.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.988+0000 7ffbb34b3b80 10 client.15426 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:11.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.988+0000 7ffbb34b3b80 1 -- 172.21.15.49:0/2136238489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c812de4aa0 con 0x55c812dd7f80 2024-06-03T00:01:11.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.989+0000 7ffb89ffb700 1 -- 172.21.15.49:0/2136238489 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb9409cd00 con 0x55c812dd7f80 2024-06-03T00:01:11.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.989+0000 7ffb89ffb700 1 -- 172.21.15.49:0/2136238489 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ffb940a1b40 con 0x55c812dd7f80 2024-06-03T00:01:11.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.989+0000 7ffbb34b3b80 10 client.15426 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:11.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.989+0000 7ffbb34b3b80 10 client.15426 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-03T00:01:11.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.989+0000 7ffbb34b3b80 20 client.15426 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:11.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.989+0000 7ffbb34b3b80 1 --2- 172.21.15.49:0/2136238489 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x55c812df1160 0x55c812df2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:11.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.989+0000 7ffbb34b3b80 4 client.15426 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:01:11.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.989+0000 7ffbb34b3b80 1 -- 172.21.15.49:0/2136238489 --> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c812d32cc0 con 0x55c812df1160 2024-06-03T00:01:11.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.989+0000 7ffba1d9b700 1 --2- 172.21.15.49:0/2136238489 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x55c812df1160 0x55c812df2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:11.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.990+0000 7ffb89ffb700 10 client.15426 ms_handle_connect on v2:172.21.15.107:6836/3700593315 2024-06-03T00:01:11.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.990+0000 7ffba1d9b700 1 --2- 172.21.15.49:0/2136238489 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x55c812df1160 0x55c812df2c50 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7d027ff4ea35244b server_cookie=f53a0fe198ecc95c in_seq=0 out_seq=0 2024-06-03T00:01:11.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.990+0000 7ffb89ffb700 1 -- 172.21.15.49:0/2136238489 <== mds.2 v2:172.21.15.107:6836/3700593315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55c812d32cc0 con 0x55c812df1160 2024-06-03T00:01:11.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.990+0000 7ffb89ffb700 10 client.15426 handle_command_reply: tid=0 2024-06-03T00:01:11.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.990+0000 7ffbb34b3b80 1 client.15426 shutdown 2024-06-03T00:01:11.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.991+0000 7ffbb34b3b80 1 -- 172.21.15.49:0/2136238489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c812dd7f80 msgr2=0x55c812de4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:11.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.991+0000 7ffbb34b3b80 1 --2- 172.21.15.49:0/2136238489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c812dd7f80 0x55c812de4140 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ffb940a4cb0 tx=0x7ffb940a5290 comp rx=0 tx=0).stop 2024-06-03T00:01:11.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.991+0000 7ffbb34b3b80 1 -- 172.21.15.49:0/2136238489 shutdown_connections 2024-06-03T00:01:11.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.991+0000 7ffbb34b3b80 1 --2- 172.21.15.49:0/2136238489 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x55c812df1160 0x55c812df2c50 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:11.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.991+0000 7ffbb34b3b80 1 --2- 172.21.15.49:0/2136238489 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c812ddcbe0 0x55c812de1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:11.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.991+0000 7ffbb34b3b80 1 --2- 172.21.15.49:0/2136238489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c812dd7f80 0x55c812de4140 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:11.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.991+0000 7ffbb34b3b80 1 --2- 172.21.15.49:0/2136238489 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c812dd88a0 0x55c812de1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:11.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.991+0000 7ffbb34b3b80 1 -- 172.21.15.49:0/2136238489 >> 172.21.15.49:0/2136238489 conn(0x55c812cfec70 msgr2=0x55c812dd2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:11.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.991+0000 7ffb89ffb700 0 client.15426 ms_handle_reset on v2:172.21.15.107:6836/3700593315 2024-06-03T00:01:11.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.991+0000 7ffbb34b3b80 1 -- 172.21.15.49:0/2136238489 shutdown_connections 2024-06-03T00:01:11.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.991+0000 7ffbb34b3b80 1 -- 172.21.15.49:0/2136238489 wait complete. 2024-06-03T00:01:11.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:11.991+0000 7ffbb34b3b80 20 client.15426 trim_cache size 0 max 16384 2024-06-03T00:01:12.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.012+0000 7ffbb34b3b80 1 Processor -- start 2024-06-03T00:01:12.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.012+0000 7ffbb34b3b80 1 -- start start 2024-06-03T00:01:12.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.012+0000 7ffbb34b3b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c812dd7f80 0x55c812de19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:12.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.013+0000 7ffbb34b3b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c812dd88a0 0x55c812ddfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:12.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.013+0000 7ffbb34b3b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c812ddcbe0 0x55c812de0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:12.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.013+0000 7ffbb34b3b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c812df0fe0 con 0x55c812dd7f80 2024-06-03T00:01:12.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.013+0000 7ffbb34b3b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55c812df1660 con 0x55c812dd88a0 2024-06-03T00:01:12.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.013+0000 7ffbb34b3b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55c812df1d30 con 0x55c812ddcbe0 2024-06-03T00:01:12.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.013+0000 7ffba259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c812dd7f80 0x55c812de19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:12.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.013+0000 7ffba259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c812dd7f80 0x55c812de19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42118/0 (socket says 172.21.15.49:42118) 2024-06-03T00:01:12.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.013+0000 7ffba259c700 1 -- 172.21.15.49:0/3220065785 learned_addr learned my addr 172.21.15.49:0/3220065785 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:12.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.013+0000 7ffba1d9b700 1 --2- 172.21.15.49:0/3220065785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c812dd88a0 0x55c812ddfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:12.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.013+0000 7ffba259c700 1 -- 172.21.15.49:0/3220065785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c812ddcbe0 msgr2=0x55c812de0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:12.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.013+0000 7ffba259c700 1 --2- 172.21.15.49:0/3220065785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c812ddcbe0 0x55c812de0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:12.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.013+0000 7ffba259c700 1 -- 172.21.15.49:0/3220065785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c812dd88a0 msgr2=0x55c812ddfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:12.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.013+0000 7ffba259c700 1 --2- 172.21.15.49:0/3220065785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c812dd88a0 0x55c812ddfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:12.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.013+0000 7ffba259c700 1 -- 172.21.15.49:0/3220065785 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c812de2380 con 0x55c812dd7f80 2024-06-03T00:01:12.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.013+0000 7ffba259c700 1 --2- 172.21.15.49:0/3220065785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c812dd7f80 0x55c812de19b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ffb94009990 tx=0x7ffb94005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9183408cb9fb3090 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:12.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.013+0000 7ffb8bfff700 1 -- 172.21.15.49:0/3220065785 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb940b4070 con 0x55c812dd7f80 2024-06-03T00:01:12.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.013+0000 7ffb8bfff700 1 -- 172.21.15.49:0/3220065785 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb9407f070 con 0x55c812dd7f80 2024-06-03T00:01:12.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.013+0000 7ffb8bfff700 1 -- 172.21.15.49:0/3220065785 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb940a09b0 con 0x55c812dd7f80 2024-06-03T00:01:12.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.014+0000 7ffbb34b3b80 1 -- 172.21.15.49:0/3220065785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c812dd7f80 msgr2=0x55c812de19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:12.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.014+0000 7ffbb34b3b80 1 --2- 172.21.15.49:0/3220065785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c812dd7f80 0x55c812de19b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ffb94009990 tx=0x7ffb94005fb0 comp rx=0 tx=0).stop 2024-06-03T00:01:12.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.014+0000 7ffbb34b3b80 1 -- 172.21.15.49:0/3220065785 shutdown_connections 2024-06-03T00:01:12.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.014+0000 7ffbb34b3b80 1 --2- 172.21.15.49:0/3220065785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c812ddcbe0 0x55c812de0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:12.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.014+0000 7ffbb34b3b80 1 --2- 172.21.15.49:0/3220065785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c812dd7f80 0x55c812de19b0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:12.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.014+0000 7ffbb34b3b80 1 --2- 172.21.15.49:0/3220065785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c812dd88a0 0x55c812ddfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:12.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.014+0000 7ffbb34b3b80 1 -- 172.21.15.49:0/3220065785 >> 172.21.15.49:0/3220065785 conn(0x55c812cfec70 msgr2=0x55c812dce330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:12.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.014+0000 7ffbb34b3b80 1 -- 172.21.15.49:0/3220065785 shutdown_connections 2024-06-03T00:01:12.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.014+0000 7ffbb34b3b80 1 -- 172.21.15.49:0/3220065785 wait complete. 2024-06-03T00:01:12.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.014+0000 7ffbb34b3b80 1 -- start start 2024-06-03T00:01:12.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.014+0000 7ffbb34b3b80 1 Processor -- start 2024-06-03T00:01:12.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.015+0000 7ffbb34b3b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c812dd7f80 0x55c812dfc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:12.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.015+0000 7ffbb34b3b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c812dd88a0 0x55c812df5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:12.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.015+0000 7ffbb34b3b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c812ddcbe0 0x55c812df5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:12.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.015+0000 7ffbb34b3b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c812df2ad0 con 0x55c812dd88a0 2024-06-03T00:01:12.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.015+0000 7ffbb34b3b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55c812df2400 con 0x55c812dd7f80 2024-06-03T00:01:12.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.015+0000 7ffbb34b3b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55c812df31a0 con 0x55c812ddcbe0 2024-06-03T00:01:12.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.015+0000 7ffbb34b3b80 10 client.0 _ll_register_callbacks cb 0x55c812cbf8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:12.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.015+0000 7ffba1d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c812dd88a0 0x55c812df5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:12.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.015+0000 7ffba1d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c812dd88a0 0x55c812df5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42132/0 (socket says 172.21.15.49:42132) 2024-06-03T00:01:12.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.015+0000 7ffba1d9b700 1 -- 172.21.15.49:0/3644948970 learned_addr learned my addr 172.21.15.49:0/3644948970 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:12.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.015+0000 7ffba259c700 1 --2- 172.21.15.49:0/3644948970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c812dd7f80 0x55c812dfc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:12.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.015+0000 7ffba2d9d700 1 --2- 172.21.15.49:0/3644948970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c812ddcbe0 0x55c812df5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:12.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.015+0000 7ffba1d9b700 1 -- 172.21.15.49:0/3644948970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c812ddcbe0 msgr2=0x55c812df5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:12.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.015+0000 7ffba1d9b700 1 --2- 172.21.15.49:0/3644948970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c812ddcbe0 0x55c812df5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:12.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.015+0000 7ffba1d9b700 1 -- 172.21.15.49:0/3644948970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c812dd7f80 msgr2=0x55c812dfc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:12.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.015+0000 7ffba1d9b700 1 --2- 172.21.15.49:0/3644948970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c812dd7f80 0x55c812dfc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:12.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.015+0000 7ffba1d9b700 1 -- 172.21.15.49:0/3644948970 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c812df6520 con 0x55c812dd88a0 2024-06-03T00:01:12.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.015+0000 7ffba259c700 1 --2- 172.21.15.49:0/3644948970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c812dd7f80 0x55c812dfc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:01:12.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.015+0000 7ffba1d9b700 1 --2- 172.21.15.49:0/3644948970 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c812dd88a0 0x55c812df5960 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ffb980097d0 tx=0x7ffb980047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3818fa227f38b250 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:12.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.015+0000 7ffb89ffb700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:01:12.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.016+0000 7ffb89ffb700 1 -- 172.21.15.49:0/3644948970 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9802c070 con 0x55c812dd88a0 2024-06-03T00:01:12.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.016+0000 7ffbb34b3b80 1 -- 172.21.15.49:0/3644948970 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb9407f070 con 0x55c812dd88a0 2024-06-03T00:01:12.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.016+0000 7ffb89ffb700 1 -- 172.21.15.49:0/3644948970 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7ffb98012d70 con 0x55c812dd88a0 2024-06-03T00:01:12.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.016+0000 7ffb89ffb700 1 -- 172.21.15.49:0/3644948970 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ffb98038050 con 0x55c812dd88a0 2024-06-03T00:01:12.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.016+0000 7ffbb34b3b80 10 client.15432 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:12.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.016+0000 7ffbb34b3b80 1 -- 172.21.15.49:0/3644948970 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c812e5d070 con 0x55c812dd88a0 2024-06-03T00:01:12.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.016+0000 7ffb89ffb700 1 -- 172.21.15.49:0/3644948970 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb9407f070 con 0x55c812dd88a0 2024-06-03T00:01:12.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.016+0000 7ffb89ffb700 1 -- 172.21.15.49:0/3644948970 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ffb9801f680 con 0x55c812dd88a0 2024-06-03T00:01:12.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.016+0000 7ffbb34b3b80 10 client.15432 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:12.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.016+0000 7ffbb34b3b80 10 client.15432 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-03T00:01:12.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.016+0000 7ffbb34b3b80 20 client.15432 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:12.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.016+0000 7ffbb34b3b80 1 --2- 172.21.15.49:0/3644948970 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x55c812e61b60 0x55c812e60870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:12.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.016+0000 7ffbb34b3b80 4 client.15432 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-03T00:01:12.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.016+0000 7ffbb34b3b80 1 -- 172.21.15.49:0/3644948970 --> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] -- command(tid 0: {"prefix": "status"}) -- 0x55c812d2d240 con 0x55c812e61b60 2024-06-03T00:01:12.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.017+0000 7ffba259c700 1 --2- 172.21.15.49:0/3644948970 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x55c812e61b60 0x55c812e60870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:12.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.017+0000 7ffba259c700 1 --2- 172.21.15.49:0/3644948970 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x55c812e61b60 0x55c812e60870 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=24c4fee06f5f3769 server_cookie=98531ee190d6b979 in_seq=0 out_seq=0 2024-06-03T00:01:12.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.017+0000 7ffb89ffb700 10 client.15432 ms_handle_connect on v2:172.21.15.107:6836/3700593315 2024-06-03T00:01:12.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.017+0000 7ffb89ffb700 1 -- 172.21.15.49:0/3644948970 <== mds.2 v2:172.21.15.107:6836/3700593315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55c812d2d240 con 0x55c812e61b60 2024-06-03T00:01:12.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.017+0000 7ffb89ffb700 10 client.15432 handle_command_reply: tid=0 2024-06-03T00:01:12.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.017+0000 7ffbb34b3b80 1 client.15432 shutdown 2024-06-03T00:01:12.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.017+0000 7ffbb34b3b80 1 -- 172.21.15.49:0/3644948970 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c812dd88a0 msgr2=0x55c812df5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:12.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.017+0000 7ffbb34b3b80 1 --2- 172.21.15.49:0/3644948970 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c812dd88a0 0x55c812df5960 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ffb980097d0 tx=0x7ffb980047c0 comp rx=0 tx=0).stop 2024-06-03T00:01:12.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.017+0000 7ffbb34b3b80 1 -- 172.21.15.49:0/3644948970 shutdown_connections 2024-06-03T00:01:12.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.017+0000 7ffbb34b3b80 1 --2- 172.21.15.49:0/3644948970 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x55c812e61b60 0x55c812e60870 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:12.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.017+0000 7ffbb34b3b80 1 --2- 172.21.15.49:0/3644948970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c812ddcbe0 0x55c812df5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:12.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.017+0000 7ffbb34b3b80 1 --2- 172.21.15.49:0/3644948970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c812dd7f80 0x55c812dfc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:12.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.017+0000 7ffb89ffb700 0 client.15432 ms_handle_reset on v2:172.21.15.107:6836/3700593315 2024-06-03T00:01:12.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.017+0000 7ffbb34b3b80 1 --2- 172.21.15.49:0/3644948970 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c812dd88a0 0x55c812df5960 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:12.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.017+0000 7ffbb34b3b80 1 -- 172.21.15.49:0/3644948970 >> 172.21.15.49:0/3644948970 conn(0x55c812cfec70 msgr2=0x55c812dc7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:12.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.018+0000 7ffbb34b3b80 1 -- 172.21.15.49:0/3644948970 shutdown_connections 2024-06-03T00:01:12.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.018+0000 7ffbb34b3b80 1 -- 172.21.15.49:0/3644948970 wait complete. 2024-06-03T00:01:12.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.018+0000 7ffbb34b3b80 20 client.15432 trim_cache size 0 max 16384 2024-06-03T00:01:12.023 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:01:12.024 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "890dd222-213a-11ef-bc9b-c7b262605968", 2024-06-03T00:01:12.024 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 2, 2024-06-03T00:01:12.024 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 24466, 2024-06-03T00:01:12.024 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-06-03T00:01:12.024 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-06-03T00:01:12.024 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-06-03T00:01:12.024 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 221.57644880399999, 2024-06-03T00:01:12.024 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 27, 2024-06-03T00:01:12.024 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 90, 2024-06-03T00:01:12.024 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 90, 2024-06-03T00:01:12.024 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 264.60320281600002 2024-06-03T00:01:12.024 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:01:12.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.018+0000 7ffba8c30700 1 -- 172.21.15.49:0/2315045095 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ffb8c0a2c20 msgr2=0x7ffb8c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:12.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.018+0000 7ffba8c30700 1 --2- 172.21.15.49:0/2315045095 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ffb8c0a2c20 0x7ffb8c0a50e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ffba407a090 tx=0x7ffb98009260 comp rx=0 tx=0).stop 2024-06-03T00:01:12.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.018+0000 7ffba8c30700 1 -- 172.21.15.49:0/2315045095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffba4102740 msgr2=0x7ffba419e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:12.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.018+0000 7ffba8c30700 1 --2- 172.21.15.49:0/2315045095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffba4102740 0x7ffba419e7c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ffb940059d0 tx=0x7ffb9400fab0 comp rx=0 tx=0).stop 2024-06-03T00:01:12.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.018+0000 7ffba8c30700 1 -- 172.21.15.49:0/2315045095 shutdown_connections 2024-06-03T00:01:12.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.018+0000 7ffba8c30700 1 --2- 172.21.15.49:0/2315045095 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ffb8c0a2c20 0x7ffb8c0a50e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:12.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.018+0000 7ffba8c30700 1 --2- 172.21.15.49:0/2315045095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffba4107840 0x7ffba4198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:12.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.018+0000 7ffba8c30700 1 --2- 172.21.15.49:0/2315045095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffba4102740 0x7ffba419e7c0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:12.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.018+0000 7ffba8c30700 1 --2- 172.21.15.49:0/2315045095 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffba41030f0 0x7ffba419ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:12.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.018+0000 7ffba8c30700 1 -- 172.21.15.49:0/2315045095 >> 172.21.15.49:0/2315045095 conn(0x7ffba40795f0 msgr2=0x7ffba4100450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:12.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.018+0000 7ffba8c30700 1 -- 172.21.15.49:0/2315045095 shutdown_connections 2024-06-03T00:01:12.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:12.018+0000 7ffba8c30700 1 -- 172.21.15.49:0/2315045095 wait complete. 2024-06-03T00:01:12.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:12 smithi057 ceph-mon[36457]: pgmap v418: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-06-03T00:01:12.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:12 smithi049 ceph-mon[32302]: pgmap v418: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-06-03T00:01:12.787 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.b status 2024-06-03T00:01:12.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:12 smithi107 ceph-mon[37048]: pgmap v418: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-06-03T00:01:13.037 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:01:14.428 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:14 smithi049 ceph-mon[32302]: pgmap v419: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2024-06-03T00:01:14.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.676+0000 7fc8fec37700 1 -- 172.21.15.49:0/1624708306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8f81073f0 msgr2=0x7fc8f81077d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:14.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.676+0000 7fc8fec37700 1 --2- 172.21.15.49:0/1624708306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8f81073f0 0x7fc8f81077d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec009990 tx=0x7fc8ec009ca0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.676+0000 7fc8fec37700 1 -- 172.21.15.49:0/1624708306 shutdown_connections 2024-06-03T00:01:14.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.676+0000 7fc8fec37700 1 --2- 172.21.15.49:0/1624708306 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8f8101d40 0x7fc8f810e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.676+0000 7fc8fec37700 1 --2- 172.21.15.49:0/1624708306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8f81073f0 0x7fc8f81077d0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.676+0000 7fc8fec37700 1 --2- 172.21.15.49:0/1624708306 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8f8101380 0x7fc8f8101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.676+0000 7fc8fec37700 1 -- 172.21.15.49:0/1624708306 >> 172.21.15.49:0/1624708306 conn(0x7fc8f8078300 msgr2=0x7fc8f8078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:14.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.676+0000 7fc8fec37700 1 -- 172.21.15.49:0/1624708306 shutdown_connections 2024-06-03T00:01:14.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.676+0000 7fc8fec37700 1 -- 172.21.15.49:0/1624708306 wait complete. 2024-06-03T00:01:14.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.677+0000 7fc8fec37700 1 Processor -- start 2024-06-03T00:01:14.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.677+0000 7fc8fec37700 1 -- start start 2024-06-03T00:01:14.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.677+0000 7fc8fec37700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8f8101380 0x7fc8f8199a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:14.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.677+0000 7fc8fec37700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8f8101d40 0x7fc8f8199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:14.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.677+0000 7fc8fec37700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8f81073f0 0x7fc8f81a4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:14.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.677+0000 7fc8fec37700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f81116e0 con 0x7fc8f8101d40 2024-06-03T00:01:14.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.677+0000 7fc8fec37700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f8111560 con 0x7fc8f8101380 2024-06-03T00:01:14.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.677+0000 7fc8fec37700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f8111860 con 0x7fc8f81073f0 2024-06-03T00:01:14.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.678+0000 7fc8f7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8f8101d40 0x7fc8f8199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:14.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.678+0000 7fc8f7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8f8101d40 0x7fc8f8199f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39590/0 (socket says 172.21.15.49:39590) 2024-06-03T00:01:14.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.678+0000 7fc8f7fff700 1 -- 172.21.15.49:0/3637830441 learned_addr learned my addr 172.21.15.49:0/3637830441 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:14.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.678+0000 7fc8fd1d4700 1 --2- 172.21.15.49:0/3637830441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8f81073f0 0x7fc8f81a4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:14.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.678+0000 7fc8fc9d3700 1 --2- 172.21.15.49:0/3637830441 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8f8101380 0x7fc8f8199a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:14.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.678+0000 7fc8f7fff700 1 -- 172.21.15.49:0/3637830441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8f81073f0 msgr2=0x7fc8f81a4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:14.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.678+0000 7fc8f7fff700 1 --2- 172.21.15.49:0/3637830441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8f81073f0 0x7fc8f81a4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.678+0000 7fc8f7fff700 1 -- 172.21.15.49:0/3637830441 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8f8101380 msgr2=0x7fc8f8199a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:14.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.678+0000 7fc8f7fff700 1 --2- 172.21.15.49:0/3637830441 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8f8101380 0x7fc8f8199a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.678+0000 7fc8f7fff700 1 -- 172.21.15.49:0/3637830441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f81a5000 con 0x7fc8f8101d40 2024-06-03T00:01:14.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.678+0000 7fc8f7fff700 1 --2- 172.21.15.49:0/3637830441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8f8101d40 0x7fc8f8199f80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc8e400c970 tx=0x7fc8e400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:14.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.679+0000 7fc8f5ffb700 1 -- 172.21.15.49:0/3637830441 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e40078d0 con 0x7fc8f8101d40 2024-06-03T00:01:14.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.679+0000 7fc8fec37700 1 -- 172.21.15.49:0/3637830441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8f81a5230 con 0x7fc8f8101d40 2024-06-03T00:01:14.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.679+0000 7fc8f5ffb700 1 -- 172.21.15.49:0/3637830441 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8e4018480 con 0x7fc8f8101d40 2024-06-03T00:01:14.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.679+0000 7fc8f5ffb700 1 -- 172.21.15.49:0/3637830441 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e400f6b0 con 0x7fc8f8101d40 2024-06-03T00:01:14.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.679+0000 7fc8fec37700 1 -- 172.21.15.49:0/3637830441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8f81a5720 con 0x7fc8f8101d40 2024-06-03T00:01:14.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.681+0000 7fc8f5ffb700 1 -- 172.21.15.49:0/3637830441 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc8e4018630 con 0x7fc8f8101d40 2024-06-03T00:01:14.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.682+0000 7fc8f5ffb700 1 --2- 172.21.15.49:0/3637830441 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc8e80a2c20 0x7fc8e80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:14.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.682+0000 7fc8fc9d3700 1 --2- 172.21.15.49:0/3637830441 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc8e80a2c20 0x7fc8e80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:14.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.682+0000 7fc8f5ffb700 1 -- 172.21.15.49:0/3637830441 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fc8e40cf1a0 con 0x7fc8f8101d40 2024-06-03T00:01:14.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.682+0000 7fc9094bab80 1 Processor -- start 2024-06-03T00:01:14.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.683+0000 7fc9094bab80 1 -- start start 2024-06-03T00:01:14.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.683+0000 7fc8fc9d3700 1 --2- 172.21.15.49:0/3637830441 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc8e80a2c20 0x7fc8e80a50e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec009750 tx=0x7fc8ec005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:14.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.683+0000 7fc9094bab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557b489de5f0 0x557b489de9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:14.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.683+0000 7fc9094bab80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557b489def10 0x557b489d8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:14.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.683+0000 7fc9094bab80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b489d8ed0 0x557b489d92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:14.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.683+0000 7fc9094bab80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x557b4892a7c0 con 0x557b489def10 2024-06-03T00:01:14.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.683+0000 7fc9094bab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x557b488d26d0 con 0x557b489de5f0 2024-06-03T00:01:14.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.683+0000 7fc9094bab80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x557b48926780 con 0x557b489d8ed0 2024-06-03T00:01:14.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.683+0000 7fc8f7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557b489def10 0x557b489d8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:14.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.683+0000 7fc8f7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557b489def10 0x557b489d8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39594/0 (socket says 172.21.15.49:39594) 2024-06-03T00:01:14.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.683+0000 7fc8f7fff700 1 -- 172.21.15.49:0/531785874 learned_addr learned my addr 172.21.15.49:0/531785874 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:14.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.683+0000 7fc8fc9d3700 1 --2- 172.21.15.49:0/531785874 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557b489de5f0 0x557b489de9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:14.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.683+0000 7fc8fd1d4700 1 --2- 172.21.15.49:0/531785874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b489d8ed0 0x557b489d92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:14.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.683+0000 7fc8f7fff700 1 -- 172.21.15.49:0/531785874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b489d8ed0 msgr2=0x557b489d92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:14.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.683+0000 7fc8f7fff700 1 --2- 172.21.15.49:0/531785874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b489d8ed0 0x557b489d92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.683+0000 7fc8f7fff700 1 -- 172.21.15.49:0/531785874 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557b489de5f0 msgr2=0x557b489de9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:14.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.683+0000 7fc8f7fff700 1 --2- 172.21.15.49:0/531785874 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557b489de5f0 0x557b489de9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.683+0000 7fc8f7fff700 1 -- 172.21.15.49:0/531785874 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b488c8f00 con 0x557b489def10 2024-06-03T00:01:14.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.683+0000 7fc8fd1d4700 1 --2- 172.21.15.49:0/531785874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b489d8ed0 0x557b489d92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:01:14.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.683+0000 7fc8f7fff700 1 --2- 172.21.15.49:0/531785874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557b489def10 0x557b489d8990 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc8e400cfd0 tx=0x7fc8e4097e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f37e6dac14b3e64 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:14.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.684+0000 7fc8e2ffd700 1 -- 172.21.15.49:0/531785874 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e40b4070 con 0x557b489def10 2024-06-03T00:01:14.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.684+0000 7fc8e2ffd700 1 -- 172.21.15.49:0/531785874 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8e409fe00 con 0x557b489def10 2024-06-03T00:01:14.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.684+0000 7fc8e2ffd700 1 -- 172.21.15.49:0/531785874 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e40a20b0 con 0x557b489def10 2024-06-03T00:01:14.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.684+0000 7fc9094bab80 1 -- 172.21.15.49:0/531785874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557b489def10 msgr2=0x557b489d8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:14.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.684+0000 7fc9094bab80 1 --2- 172.21.15.49:0/531785874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557b489def10 0x557b489d8990 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc8e400cfd0 tx=0x7fc8e4097e20 comp rx=0 tx=0).stop 2024-06-03T00:01:14.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.684+0000 7fc9094bab80 1 -- 172.21.15.49:0/531785874 shutdown_connections 2024-06-03T00:01:14.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.684+0000 7fc9094bab80 1 --2- 172.21.15.49:0/531785874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b489d8ed0 0x557b489d92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.684+0000 7fc9094bab80 1 --2- 172.21.15.49:0/531785874 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557b489de5f0 0x557b489de9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.684+0000 7fc9094bab80 1 --2- 172.21.15.49:0/531785874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557b489def10 0x557b489d8990 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.684+0000 7fc9094bab80 1 -- 172.21.15.49:0/531785874 >> 172.21.15.49:0/531785874 conn(0x557b48903c70 msgr2=0x557b489d3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:14.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.685+0000 7fc9094bab80 1 -- 172.21.15.49:0/531785874 shutdown_connections 2024-06-03T00:01:14.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.685+0000 7fc9094bab80 1 -- 172.21.15.49:0/531785874 wait complete. 2024-06-03T00:01:14.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.685+0000 7fc9094bab80 1 -- start start 2024-06-03T00:01:14.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.685+0000 7fc9094bab80 1 Processor -- start 2024-06-03T00:01:14.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.685+0000 7fc9094bab80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b489d8ed0 0x557b489e4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:14.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.685+0000 7fc9094bab80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557b489de5f0 0x557b489e1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:14.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.685+0000 7fc9094bab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557b489def10 0x557b489e2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:14.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.686+0000 7fc9094bab80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x557b489e5980 con 0x557b489de5f0 2024-06-03T00:01:14.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.686+0000 7fc9094bab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x557b488caba0 con 0x557b489def10 2024-06-03T00:01:14.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.686+0000 7fc9094bab80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x557b489e5b00 con 0x557b489d8ed0 2024-06-03T00:01:14.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.686+0000 7fc9094bab80 10 client.0 _ll_register_callbacks cb 0x557b488c48d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:14.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.686+0000 7fc8f7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557b489de5f0 0x557b489e1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:14.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.686+0000 7fc8f7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557b489de5f0 0x557b489e1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39608/0 (socket says 172.21.15.49:39608) 2024-06-03T00:01:14.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.686+0000 7fc8f7fff700 1 -- 172.21.15.49:0/128466383 learned_addr learned my addr 172.21.15.49:0/128466383 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:14.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.686+0000 7fc8fd1d4700 1 --2- 172.21.15.49:0/128466383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557b489def10 0x557b489e2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:14.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.686+0000 7fc8fc9d3700 1 --2- 172.21.15.49:0/128466383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b489d8ed0 0x557b489e4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:14.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.686+0000 7fc8f7fff700 1 -- 172.21.15.49:0/128466383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b489d8ed0 msgr2=0x557b489e4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:14.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.686+0000 7fc8f7fff700 1 --2- 172.21.15.49:0/128466383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b489d8ed0 0x557b489e4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.686+0000 7fc8f7fff700 1 -- 172.21.15.49:0/128466383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557b489def10 msgr2=0x557b489e2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:14.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.686+0000 7fc8f7fff700 1 --2- 172.21.15.49:0/128466383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557b489def10 0x557b489e2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.686+0000 7fc8f7fff700 1 -- 172.21.15.49:0/128466383 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b48879880 con 0x557b489de5f0 2024-06-03T00:01:14.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.686+0000 7fc8f7fff700 1 --2- 172.21.15.49:0/128466383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557b489de5f0 0x557b489e1fc0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc8e400c940 tx=0x7fc8e4018ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33bf084e36794a92 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:14.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.686+0000 7fc8d7fff700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:01:14.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.686+0000 7fc8d7fff700 1 -- 172.21.15.49:0/128466383 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e40b8020 con 0x557b489de5f0 2024-06-03T00:01:14.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.686+0000 7fc8d7fff700 1 -- 172.21.15.49:0/128466383 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fc8e40b4bc0 con 0x557b489de5f0 2024-06-03T00:01:14.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.686+0000 7fc9094bab80 1 -- 172.21.15.49:0/128466383 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8e409fe00 con 0x557b489de5f0 2024-06-03T00:01:14.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.687+0000 7fc8d7fff700 1 -- 172.21.15.49:0/128466383 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc8e40b4070 con 0x557b489de5f0 2024-06-03T00:01:14.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.687+0000 7fc9094bab80 10 client.15444 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:14.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.687+0000 7fc9094bab80 1 -- 172.21.15.49:0/128466383 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557b489f02a0 con 0x557b489de5f0 2024-06-03T00:01:14.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.687+0000 7fc8d7fff700 1 -- 172.21.15.49:0/128466383 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8e409fe00 con 0x557b489de5f0 2024-06-03T00:01:14.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.687+0000 7fc8d7fff700 1 -- 172.21.15.49:0/128466383 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fc8e409afc0 con 0x557b489de5f0 2024-06-03T00:01:14.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.687+0000 7fc9094bab80 10 client.15444 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:14.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.687+0000 7fc9094bab80 10 client.15444 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-03T00:01:14.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.687+0000 7fc9094bab80 20 client.15444 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:14.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.687+0000 7fc9094bab80 1 --2- 172.21.15.49:0/128466383 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x557b489f15f0 0x557b489f36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:14.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.687+0000 7fc9094bab80 4 client.15444 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:01:14.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.687+0000 7fc9094bab80 1 -- 172.21.15.49:0/128466383 --> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b48937cc0 con 0x557b489f15f0 2024-06-03T00:01:14.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.687+0000 7fc8fc9d3700 1 --2- 172.21.15.49:0/128466383 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x557b489f15f0 0x557b489f36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:14.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.688+0000 7fc8fc9d3700 1 --2- 172.21.15.49:0/128466383 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x557b489f15f0 0x557b489f36f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=42c01ead9b3cf1b8 server_cookie=6b25257a7aec3b0f in_seq=0 out_seq=0 2024-06-03T00:01:14.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.688+0000 7fc8d7fff700 10 client.15444 ms_handle_connect on v2:172.21.15.57:6838/249825195 2024-06-03T00:01:14.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.688+0000 7fc8d7fff700 1 -- 172.21.15.49:0/128466383 <== mds.1 v2:172.21.15.57:6838/249825195 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x557b48937cc0 con 0x557b489f15f0 2024-06-03T00:01:14.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.688+0000 7fc8d7fff700 10 client.15444 handle_command_reply: tid=0 2024-06-03T00:01:14.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.688+0000 7fc9094bab80 1 client.15444 shutdown 2024-06-03T00:01:14.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.689+0000 7fc9094bab80 1 -- 172.21.15.49:0/128466383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557b489de5f0 msgr2=0x557b489e1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:14.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.689+0000 7fc9094bab80 1 --2- 172.21.15.49:0/128466383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557b489de5f0 0x557b489e1fc0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc8e400c940 tx=0x7fc8e4018ce0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.689+0000 7fc9094bab80 1 -- 172.21.15.49:0/128466383 shutdown_connections 2024-06-03T00:01:14.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.689+0000 7fc9094bab80 1 --2- 172.21.15.49:0/128466383 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x557b489f15f0 0x557b489f36f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.689+0000 7fc9094bab80 1 --2- 172.21.15.49:0/128466383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557b489def10 0x557b489e2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.689+0000 7fc9094bab80 1 --2- 172.21.15.49:0/128466383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b489d8ed0 0x557b489e4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.689+0000 7fc9094bab80 1 --2- 172.21.15.49:0/128466383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557b489de5f0 0x557b489e1fc0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.689+0000 7fc9094bab80 1 -- 172.21.15.49:0/128466383 >> 172.21.15.49:0/128466383 conn(0x557b48903c70 msgr2=0x557b489d7980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:14.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.689+0000 7fc8d7fff700 0 client.15444 ms_handle_reset on v2:172.21.15.57:6838/249825195 2024-06-03T00:01:14.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.689+0000 7fc9094bab80 1 -- 172.21.15.49:0/128466383 shutdown_connections 2024-06-03T00:01:14.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.689+0000 7fc9094bab80 1 -- 172.21.15.49:0/128466383 wait complete. 2024-06-03T00:01:14.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.689+0000 7fc9094bab80 20 client.15444 trim_cache size 0 max 16384 2024-06-03T00:01:14.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:14 smithi057 ceph-mon[36457]: pgmap v419: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2024-06-03T00:01:14.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.711+0000 7fc9094bab80 1 Processor -- start 2024-06-03T00:01:14.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.711+0000 7fc9094bab80 1 -- start start 2024-06-03T00:01:14.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.711+0000 7fc9094bab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557b489d8ed0 0x557b489d8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:14.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.711+0000 7fc9094bab80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b489de5f0 0x557b489e1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:14.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.711+0000 7fc9094bab80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557b489def10 0x557b489e1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:14.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.711+0000 7fc9094bab80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x557b489f1a30 con 0x557b489def10 2024-06-03T00:01:14.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.711+0000 7fc9094bab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x557b489f2100 con 0x557b489d8ed0 2024-06-03T00:01:14.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.711+0000 7fc9094bab80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x557b489f27d0 con 0x557b489de5f0 2024-06-03T00:01:14.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.711+0000 7fc8fd1d4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557b489def10 0x557b489e1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:14.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.711+0000 7fc8fd1d4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557b489def10 0x557b489e1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39622/0 (socket says 172.21.15.49:39622) 2024-06-03T00:01:14.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.711+0000 7fc8fd1d4700 1 -- 172.21.15.49:0/941620954 learned_addr learned my addr 172.21.15.49:0/941620954 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:14.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.711+0000 7fc8fc9d3700 1 --2- 172.21.15.49:0/941620954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557b489d8ed0 0x557b489d8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:14.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.711+0000 7fc8f7fff700 1 --2- 172.21.15.49:0/941620954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b489de5f0 0x557b489e1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:14.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.711+0000 7fc8fd1d4700 1 -- 172.21.15.49:0/941620954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b489de5f0 msgr2=0x557b489e1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:14.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.711+0000 7fc8fd1d4700 1 --2- 172.21.15.49:0/941620954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b489de5f0 0x557b489e1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.711+0000 7fc8fd1d4700 1 -- 172.21.15.49:0/941620954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557b489d8ed0 msgr2=0x557b489d8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:14.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.711+0000 7fc8fd1d4700 1 --2- 172.21.15.49:0/941620954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557b489d8ed0 0x557b489d8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.711+0000 7fc8fd1d4700 1 -- 172.21.15.49:0/941620954 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b489f3390 con 0x557b489def10 2024-06-03T00:01:14.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.711+0000 7fc8fc9d3700 1 --2- 172.21.15.49:0/941620954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557b489d8ed0 0x557b489d8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:14.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.712+0000 7fc8fd1d4700 1 --2- 172.21.15.49:0/941620954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557b489def10 0x557b489e1f80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0013400 tx=0x7fc8f0007950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c635a420c28165 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:14.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.712+0000 7fc8e27fc700 1 -- 172.21.15.49:0/941620954 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f001a030 con 0x557b489def10 2024-06-03T00:01:14.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.712+0000 7fc8e27fc700 1 -- 172.21.15.49:0/941620954 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8f0013ca0 con 0x557b489def10 2024-06-03T00:01:14.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.712+0000 7fc8e27fc700 1 -- 172.21.15.49:0/941620954 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0004740 con 0x557b489def10 2024-06-03T00:01:14.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.712+0000 7fc9094bab80 1 -- 172.21.15.49:0/941620954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557b489def10 msgr2=0x557b489e1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:14.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.712+0000 7fc9094bab80 1 --2- 172.21.15.49:0/941620954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557b489def10 0x557b489e1f80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0013400 tx=0x7fc8f0007950 comp rx=0 tx=0).stop 2024-06-03T00:01:14.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.712+0000 7fc9094bab80 1 -- 172.21.15.49:0/941620954 shutdown_connections 2024-06-03T00:01:14.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.712+0000 7fc9094bab80 1 --2- 172.21.15.49:0/941620954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557b489def10 0x557b489e1f80 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.712+0000 7fc9094bab80 1 --2- 172.21.15.49:0/941620954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557b489d8ed0 0x557b489d8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.712+0000 7fc9094bab80 1 --2- 172.21.15.49:0/941620954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b489de5f0 0x557b489e1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.712+0000 7fc9094bab80 1 -- 172.21.15.49:0/941620954 >> 172.21.15.49:0/941620954 conn(0x557b48903c70 msgr2=0x557b489e08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:14.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.712+0000 7fc9094bab80 1 -- 172.21.15.49:0/941620954 shutdown_connections 2024-06-03T00:01:14.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.712+0000 7fc9094bab80 1 -- 172.21.15.49:0/941620954 wait complete. 2024-06-03T00:01:14.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.713+0000 7fc9094bab80 1 -- start start 2024-06-03T00:01:14.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.713+0000 7fc9094bab80 1 Processor -- start 2024-06-03T00:01:14.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.713+0000 7fc9094bab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557b489d8ed0 0x557b489fcb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:14.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.713+0000 7fc9094bab80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557b489de5f0 0x557b489fd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:14.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.713+0000 7fc9094bab80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b489def10 0x557b489f7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:14.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.713+0000 7fc9094bab80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x557b489f3570 con 0x557b489de5f0 2024-06-03T00:01:14.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.713+0000 7fc9094bab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x557b489f2ea0 con 0x557b489d8ed0 2024-06-03T00:01:14.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.713+0000 7fc9094bab80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x557b489f3c40 con 0x557b489def10 2024-06-03T00:01:14.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.713+0000 7fc9094bab80 10 client.0 _ll_register_callbacks cb 0x557b488c48d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:14.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.713+0000 7fc8f7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557b489de5f0 0x557b489fd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:14.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.713+0000 7fc8f7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557b489de5f0 0x557b489fd0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39638/0 (socket says 172.21.15.49:39638) 2024-06-03T00:01:14.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.713+0000 7fc8f7fff700 1 -- 172.21.15.49:0/93474188 learned_addr learned my addr 172.21.15.49:0/93474188 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:14.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.714+0000 7fc8fd1d4700 1 --2- 172.21.15.49:0/93474188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b489def10 0x557b489f7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:14.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.714+0000 7fc8fc9d3700 1 --2- 172.21.15.49:0/93474188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557b489d8ed0 0x557b489fcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:14.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.714+0000 7fc8f7fff700 1 -- 172.21.15.49:0/93474188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b489def10 msgr2=0x557b489f7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:14.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.714+0000 7fc8f7fff700 1 --2- 172.21.15.49:0/93474188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b489def10 0x557b489f7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.714+0000 7fc8f7fff700 1 -- 172.21.15.49:0/93474188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557b489d8ed0 msgr2=0x557b489fcb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:14.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.714+0000 7fc8f7fff700 1 --2- 172.21.15.49:0/93474188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557b489d8ed0 0x557b489fcb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.714+0000 7fc8f7fff700 1 -- 172.21.15.49:0/93474188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b489d8be0 con 0x557b489de5f0 2024-06-03T00:01:14.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.714+0000 7fc8fd1d4700 1 --2- 172.21.15.49:0/93474188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b489def10 0x557b489f7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:14.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.714+0000 7fc8f7fff700 1 --2- 172.21.15.49:0/93474188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557b489de5f0 0x557b489fd0b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4097970 tx=0x7fc8e4018bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5922eea6243991a9 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:14.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.714+0000 7fc8d7fff700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:01:14.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.714+0000 7fc8d7fff700 1 -- 172.21.15.49:0/93474188 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e40b8070 con 0x557b489de5f0 2024-06-03T00:01:14.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.714+0000 7fc8d7fff700 1 -- 172.21.15.49:0/93474188 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fc8e409b0a0 con 0x557b489de5f0 2024-06-03T00:01:14.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.714+0000 7fc9094bab80 1 -- 172.21.15.49:0/93474188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8f0013ca0 con 0x557b489de5f0 2024-06-03T00:01:14.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.714+0000 7fc8d7fff700 1 -- 172.21.15.49:0/93474188 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc8e4097cf0 con 0x557b489de5f0 2024-06-03T00:01:14.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.714+0000 7fc9094bab80 10 client.15450 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:14.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.714+0000 7fc9094bab80 1 -- 172.21.15.49:0/93474188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557b489d8be0 con 0x557b489de5f0 2024-06-03T00:01:14.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.714+0000 7fc8d7fff700 1 -- 172.21.15.49:0/93474188 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8f0013ca0 con 0x557b489de5f0 2024-06-03T00:01:14.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.715+0000 7fc8d7fff700 1 -- 172.21.15.49:0/93474188 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fc8e409a910 con 0x557b489de5f0 2024-06-03T00:01:14.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.715+0000 7fc9094bab80 10 client.15450 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:14.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.715+0000 7fc9094bab80 10 client.15450 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-03T00:01:14.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.715+0000 7fc9094bab80 20 client.15450 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:14.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.715+0000 7fc9094bab80 1 --2- 172.21.15.49:0/93474188 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x557b48a62860 0x557b48a61570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:14.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.715+0000 7fc9094bab80 4 client.15450 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-03T00:01:14.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.715+0000 7fc9094bab80 1 -- 172.21.15.49:0/93474188 --> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] -- command(tid 0: {"prefix": "status"}) -- 0x557b48932240 con 0x557b48a62860 2024-06-03T00:01:14.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.715+0000 7fc8fc9d3700 1 --2- 172.21.15.49:0/93474188 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x557b48a62860 0x557b48a61570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:14.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.715+0000 7fc8fc9d3700 1 --2- 172.21.15.49:0/93474188 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x557b48a62860 0x557b48a61570 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1b5c4c95a3df4314 server_cookie=50abbe36b3fc3899 in_seq=0 out_seq=0 2024-06-03T00:01:14.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.715+0000 7fc8d7fff700 10 client.15450 ms_handle_connect on v2:172.21.15.57:6838/249825195 2024-06-03T00:01:14.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.715+0000 7fc8d7fff700 1 -- 172.21.15.49:0/93474188 <== mds.1 v2:172.21.15.57:6838/249825195 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x557b48932240 con 0x557b48a62860 2024-06-03T00:01:14.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.716+0000 7fc8d7fff700 10 client.15450 handle_command_reply: tid=0 2024-06-03T00:01:14.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.716+0000 7fc9094bab80 1 client.15450 shutdown 2024-06-03T00:01:14.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.716+0000 7fc9094bab80 1 -- 172.21.15.49:0/93474188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557b489de5f0 msgr2=0x557b489fd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:14.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.716+0000 7fc9094bab80 1 --2- 172.21.15.49:0/93474188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557b489de5f0 0x557b489fd0b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4097970 tx=0x7fc8e4018bb0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.716+0000 7fc9094bab80 1 -- 172.21.15.49:0/93474188 shutdown_connections 2024-06-03T00:01:14.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.716+0000 7fc9094bab80 1 --2- 172.21.15.49:0/93474188 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x557b48a62860 0x557b48a61570 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.716+0000 7fc9094bab80 1 --2- 172.21.15.49:0/93474188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557b489def10 0x557b489f7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.716+0000 7fc9094bab80 1 --2- 172.21.15.49:0/93474188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557b489d8ed0 0x557b489fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.716+0000 7fc9094bab80 1 --2- 172.21.15.49:0/93474188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557b489de5f0 0x557b489fd0b0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.716+0000 7fc9094bab80 1 -- 172.21.15.49:0/93474188 >> 172.21.15.49:0/93474188 conn(0x557b48903c70 msgr2=0x557b489df350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:14.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.716+0000 7fc8d7fff700 0 client.15450 ms_handle_reset on v2:172.21.15.57:6838/249825195 2024-06-03T00:01:14.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.716+0000 7fc9094bab80 1 -- 172.21.15.49:0/93474188 shutdown_connections 2024-06-03T00:01:14.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.716+0000 7fc9094bab80 1 -- 172.21.15.49:0/93474188 wait complete. 2024-06-03T00:01:14.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.716+0000 7fc9094bab80 20 client.15450 trim_cache size 0 max 16384 2024-06-03T00:01:14.721 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:01:14.721 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "890dd222-213a-11ef-bc9b-c7b262605968", 2024-06-03T00:01:14.722 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 1, 2024-06-03T00:01:14.722 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 24485, 2024-06-03T00:01:14.722 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-06-03T00:01:14.722 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-06-03T00:01:14.722 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-06-03T00:01:14.722 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 225.27750134300001, 2024-06-03T00:01:14.722 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 27, 2024-06-03T00:01:14.722 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 90, 2024-06-03T00:01:14.722 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 90, 2024-06-03T00:01:14.722 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 252.39624917899999 2024-06-03T00:01:14.722 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:01:14.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.717+0000 7fc8fec37700 1 -- 172.21.15.49:0/3637830441 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc8e80a2c20 msgr2=0x7fc8e80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:14.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.717+0000 7fc8fec37700 1 --2- 172.21.15.49:0/3637830441 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc8e80a2c20 0x7fc8e80a50e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec009750 tx=0x7fc8ec005fd0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.717+0000 7fc8fec37700 1 -- 172.21.15.49:0/3637830441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8f8101d40 msgr2=0x7fc8f8199f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:14.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.717+0000 7fc8fec37700 1 --2- 172.21.15.49:0/3637830441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8f8101d40 0x7fc8f8199f80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc8e400c970 tx=0x7fc8e400cc80 comp rx=0 tx=0).stop 2024-06-03T00:01:14.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.717+0000 7fc8fec37700 1 -- 172.21.15.49:0/3637830441 shutdown_connections 2024-06-03T00:01:14.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.717+0000 7fc8fec37700 1 --2- 172.21.15.49:0/3637830441 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc8e80a2c20 0x7fc8e80a50e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.717+0000 7fc8fec37700 1 --2- 172.21.15.49:0/3637830441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8f81073f0 0x7fc8f81a4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.717+0000 7fc8fec37700 1 --2- 172.21.15.49:0/3637830441 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8f8101380 0x7fc8f8199a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.717+0000 7fc8fec37700 1 --2- 172.21.15.49:0/3637830441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8f8101d40 0x7fc8f8199f80 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.717+0000 7fc8fec37700 1 -- 172.21.15.49:0/3637830441 >> 172.21.15.49:0/3637830441 conn(0x7fc8f8078300 msgr2=0x7fc8f80ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:14.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.717+0000 7fc8fec37700 1 -- 172.21.15.49:0/3637830441 shutdown_connections 2024-06-03T00:01:14.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:14.717+0000 7fc8fec37700 1 -- 172.21.15.49:0/3637830441 wait complete. 2024-06-03T00:01:14.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:14 smithi107 ceph-mon[37048]: pgmap v419: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2024-06-03T00:01:15.439 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.i status 2024-06-03T00:01:15.690 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:01:16.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:16 smithi057 ceph-mon[36457]: pgmap v420: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-06-03T00:01:16.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:16 smithi049 ceph-mon[32302]: pgmap v420: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-06-03T00:01:16.830 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-03T00:01:16.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:16 smithi107 ceph-mon[37048]: pgmap v420: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-06-03T00:01:17.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.453+0000 7f8bd68d2700 1 -- 172.21.15.49:0/3906034005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bd0101d50 msgr2=0x7f8bd010e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.453+0000 7f8bd68d2700 1 --2- 172.21.15.49:0/3906034005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bd0101d50 0x7f8bd010e240 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8bc800b0a0 tx=0x7f8bc800b3b0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.453+0000 7f8bd68d2700 1 -- 172.21.15.49:0/3906034005 shutdown_connections 2024-06-03T00:01:17.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.453+0000 7f8bd68d2700 1 --2- 172.21.15.49:0/3906034005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bd0101d50 0x7f8bd010e240 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.453+0000 7f8bd68d2700 1 --2- 172.21.15.49:0/3906034005 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bd0107400 0x7f8bd01077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.453+0000 7f8bd68d2700 1 --2- 172.21.15.49:0/3906034005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bd0101390 0x7f8bd0101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.453+0000 7f8bd68d2700 1 -- 172.21.15.49:0/3906034005 >> 172.21.15.49:0/3906034005 conn(0x7f8bd0078340 msgr2=0x7f8bd0078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:17.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.453+0000 7f8bd68d2700 1 -- 172.21.15.49:0/3906034005 shutdown_connections 2024-06-03T00:01:17.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.453+0000 7f8bd68d2700 1 -- 172.21.15.49:0/3906034005 wait complete. 2024-06-03T00:01:17.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.454+0000 7f8bd68d2700 1 Processor -- start 2024-06-03T00:01:17.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.454+0000 7f8bd68d2700 1 -- start start 2024-06-03T00:01:17.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.455+0000 7f8bd68d2700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bd0101390 0x7f8bd019d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.455+0000 7f8bd68d2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bd0101d50 0x7f8bd019dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.455+0000 7f8bd68d2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bd0107400 0x7f8bd0197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.455+0000 7f8bd68d2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd0111690 con 0x7f8bd0107400 2024-06-03T00:01:17.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.455+0000 7f8bd68d2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd0111510 con 0x7f8bd0101d50 2024-06-03T00:01:17.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.455+0000 7f8bd68d2700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd0111810 con 0x7f8bd0101390 2024-06-03T00:01:17.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.455+0000 7f8bd4e6f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bd0107400 0x7f8bd0197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.455+0000 7f8bcf7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bd0101d50 0x7f8bd019dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.455+0000 7f8bcf7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bd0101d50 0x7f8bd019dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.49:43822/0 (socket says 172.21.15.49:43822) 2024-06-03T00:01:17.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.455+0000 7f8bcf7fe700 1 -- 172.21.15.49:0/1258350400 learned_addr learned my addr 172.21.15.49:0/1258350400 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:17.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.455+0000 7f8bcffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bd0101390 0x7f8bd019d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.455+0000 7f8bcf7fe700 1 -- 172.21.15.49:0/1258350400 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bd0101390 msgr2=0x7f8bd019d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.455+0000 7f8bcf7fe700 1 --2- 172.21.15.49:0/1258350400 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bd0101390 0x7f8bd019d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.455+0000 7f8bcf7fe700 1 -- 172.21.15.49:0/1258350400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bd0107400 msgr2=0x7f8bd0197950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.455+0000 7f8bcf7fe700 1 --2- 172.21.15.49:0/1258350400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bd0107400 0x7f8bd0197950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.455+0000 7f8bcf7fe700 1 -- 172.21.15.49:0/1258350400 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bd01980b0 con 0x7f8bd0101d50 2024-06-03T00:01:17.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.455+0000 7f8bd4e6f700 1 --2- 172.21.15.49:0/1258350400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bd0107400 0x7f8bd0197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:01:17.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.456+0000 7f8bcf7fe700 1 --2- 172.21.15.49:0/1258350400 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bd0101d50 0x7f8bd019dc80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4007860 tx=0x7f8bc4007b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:17.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.456+0000 7f8bcd7fa700 1 -- 172.21.15.49:0/1258350400 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc4019070 con 0x7f8bd0101d50 2024-06-03T00:01:17.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.456+0000 7f8bcd7fa700 1 -- 172.21.15.49:0/1258350400 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bc400c280 con 0x7f8bd0101d50 2024-06-03T00:01:17.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.456+0000 7f8bd68d2700 1 -- 172.21.15.49:0/1258350400 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bd01983a0 con 0x7f8bd0101d50 2024-06-03T00:01:17.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.456+0000 7f8bcd7fa700 1 -- 172.21.15.49:0/1258350400 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc4014ad0 con 0x7f8bd0101d50 2024-06-03T00:01:17.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.456+0000 7f8bd68d2700 1 -- 172.21.15.49:0/1258350400 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bd006a170 con 0x7f8bd0101d50 2024-06-03T00:01:17.459 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.457+0000 7fef91c2a640 1 -- 172.21.15.49:0/11801343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef8c1076e0 msgr2=0x7fef8c109b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.459 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.457+0000 7fef91c2a640 1 --2- 172.21.15.49:0/11801343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef8c1076e0 0x7fef8c109b30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fef84009ca0 tx=0x7fef8402a8c0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.459 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.458+0000 7fef91c2a640 1 -- 172.21.15.49:0/11801343 shutdown_connections 2024-06-03T00:01:17.460 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.458+0000 7fef91c2a640 1 --2- 172.21.15.49:0/11801343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef8c1076e0 0x7fef8c109b30 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.460 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.458+0000 7fef91c2a640 1 --2- 172.21.15.49:0/11801343 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef8c104db0 0x7fef8c1071a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.460 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.458+0000 7fef91c2a640 1 --2- 172.21.15.49:0/11801343 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef8c102480 0x7fef8c104870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.460 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.458+0000 7fef91c2a640 1 -- 172.21.15.49:0/11801343 >> 172.21.15.49:0/11801343 conn(0x7fef8c0fbe70 msgr2=0x7fef8c0fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:17.460 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.458+0000 7fef91c2a640 1 -- 172.21.15.49:0/11801343 shutdown_connections 2024-06-03T00:01:17.460 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.458+0000 7fef91c2a640 1 -- 172.21.15.49:0/11801343 wait complete. 2024-06-03T00:01:17.460 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.458+0000 7fef91c2a640 1 Processor -- start 2024-06-03T00:01:17.460 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.459+0000 7fef91c2a640 1 -- start start 2024-06-03T00:01:17.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.458+0000 7f8bcd7fa700 1 -- 172.21.15.49:0/1258350400 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8bc401c070 con 0x7f8bd0101d50 2024-06-03T00:01:17.462 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.459+0000 7fef91c2a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef8c102480 0x7fef8c197c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.462 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.459+0000 7fef91c2a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef8c104db0 0x7fef8c198180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.462 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.459+0000 7fef91c2a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef8c1076e0 0x7fef8c19f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.462 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.459+0000 7fef91c2a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c10d6d0 con 0x7fef8c102480 2024-06-03T00:01:17.462 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.459+0000 7fef91c2a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c10d550 con 0x7fef8c1076e0 2024-06-03T00:01:17.462 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.459+0000 7fef91c2a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c10d850 con 0x7fef8c104db0 2024-06-03T00:01:17.462 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.459+0000 7fef8b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef8c102480 0x7fef8c197c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.462 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.459+0000 7fef8b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef8c102480 0x7fef8c197c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39668/0 (socket says 172.21.15.49:39668) 2024-06-03T00:01:17.462 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.459+0000 7fef8b7fe640 1 -- 172.21.15.49:0/1625601992 learned_addr learned my addr 172.21.15.49:0/1625601992 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:17.462 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.459+0000 7fef8bfff640 1 --2- 172.21.15.49:0/1625601992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef8c1076e0 0x7fef8c19f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.462 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.459+0000 7fef8affd640 1 --2- 172.21.15.49:0/1625601992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef8c104db0 0x7fef8c198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.459+0000 7fef8b7fe640 1 -- 172.21.15.49:0/1625601992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef8c104db0 msgr2=0x7fef8c198180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.459+0000 7fef8b7fe640 1 --2- 172.21.15.49:0/1625601992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef8c104db0 0x7fef8c198180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.459+0000 7fef8b7fe640 1 -- 172.21.15.49:0/1625601992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef8c1076e0 msgr2=0x7fef8c19f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.459+0000 7fef8b7fe640 1 --2- 172.21.15.49:0/1625601992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef8c1076e0 0x7fef8c19f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.459+0000 7fef8b7fe640 1 -- 172.21.15.49:0/1625601992 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef8c19f850 con 0x7fef8c102480 2024-06-03T00:01:17.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.459+0000 7fef8bfff640 1 --2- 172.21.15.49:0/1625601992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef8c1076e0 0x7fef8c19f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:17.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.460+0000 7f8bcd7fa700 1 --2- 172.21.15.49:0/1258350400 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8bb80a2ca0 0x7f8bb80a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.460+0000 7fef8b7fe640 1 --2- 172.21.15.49:0/1625601992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef8c102480 0x7fef8c197c40 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fef7c00e9f0 tx=0x7fef7c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:17.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.460+0000 7f8bcffff700 1 --2- 172.21.15.49:0/1258350400 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8bb80a2ca0 0x7f8bb80a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.460+0000 7f8be1155b80 1 Processor -- start 2024-06-03T00:01:17.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.460+0000 7fef88ff9640 1 -- 172.21.15.49:0/1625601992 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c00cd80 con 0x7fef8c102480 2024-06-03T00:01:17.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.460+0000 7f8bcd7fa700 1 -- 172.21.15.49:0/1258350400 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f8bc40cde00 con 0x7f8bd0101d50 2024-06-03T00:01:17.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.460+0000 7fef91c2a640 1 -- 172.21.15.49:0/1625601992 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef8c19fb40 con 0x7fef8c102480 2024-06-03T00:01:17.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.460+0000 7fef88ff9640 1 -- 172.21.15.49:0/1625601992 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef7c010910 con 0x7fef8c102480 2024-06-03T00:01:17.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.460+0000 7fef88ff9640 1 -- 172.21.15.49:0/1625601992 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c0188f0 con 0x7fef8c102480 2024-06-03T00:01:17.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.460+0000 7f8be1155b80 1 -- start start 2024-06-03T00:01:17.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.460+0000 7fef91c2a640 1 -- 172.21.15.49:0/1625601992 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef8c1a00e0 con 0x7fef8c102480 2024-06-03T00:01:17.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.460+0000 7f8bcffff700 1 --2- 172.21.15.49:0/1258350400 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8bb80a2ca0 0x7f8bb80a5160 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8bd00ffb00 tx=0x7f8bc000f7d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:17.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.460+0000 7f8be1155b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5580e2c145f0 0x5580e2c149d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.461+0000 7f8be1155b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5580e2c14f10 0x5580e2c0e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.461+0000 7f8be1155b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580e2c0eed0 0x5580e2c0f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.461+0000 7f8be1155b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5580e2b607c0 con 0x5580e2c14f10 2024-06-03T00:01:17.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.461+0000 7f8be1155b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5580e2b086d0 con 0x5580e2c0eed0 2024-06-03T00:01:17.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.461+0000 7f8be1155b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5580e2b5c780 con 0x5580e2c145f0 2024-06-03T00:01:17.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.461+0000 7f8bcffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5580e2c145f0 0x5580e2c149d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.461+0000 7f8bcffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5580e2c145f0 0x5580e2c149d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:53010/0 (socket says 172.21.15.49:53010) 2024-06-03T00:01:17.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.461+0000 7f8bcffff700 1 -- 172.21.15.49:0/1607540872 learned_addr learned my addr 172.21.15.49:0/1607540872 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:17.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.461+0000 7f8bd4e6f700 1 --2- 172.21.15.49:0/1607540872 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580e2c0eed0 0x5580e2c0f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.462+0000 7f8bcffff700 1 -- 172.21.15.49:0/1607540872 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580e2c0eed0 msgr2=0x5580e2c0f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:17.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.462+0000 7f8bcffff700 1 --2- 172.21.15.49:0/1607540872 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580e2c0eed0 0x5580e2c0f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.462+0000 7f8bcffff700 1 -- 172.21.15.49:0/1607540872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5580e2c14f10 msgr2=0x5580e2c0e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:17.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.462+0000 7f8bcffff700 1 --2- 172.21.15.49:0/1607540872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5580e2c14f10 0x5580e2c0e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.462+0000 7f8bcffff700 1 -- 172.21.15.49:0/1607540872 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580e2afef00 con 0x5580e2c145f0 2024-06-03T00:01:17.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.462+0000 7f8bcffff700 1 --2- 172.21.15.49:0/1607540872 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5580e2c145f0 0x5580e2c149d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0005e10 tx=0x7f8bc0017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b2c57238b68b849 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:17.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.462+0000 7f8bb67fc700 1 -- 172.21.15.49:0/1607540872 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc002b070 con 0x5580e2c145f0 2024-06-03T00:01:17.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.462+0000 7f8bb67fc700 1 -- 172.21.15.49:0/1607540872 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bc001bc30 con 0x5580e2c145f0 2024-06-03T00:01:17.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.462+0000 7f8bb67fc700 1 -- 172.21.15.49:0/1607540872 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0019620 con 0x5580e2c145f0 2024-06-03T00:01:17.472 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.463+0000 7fef88ff9640 1 -- 172.21.15.49:0/1625601992 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fef7c010ac0 con 0x7fef8c102480 2024-06-03T00:01:17.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.463+0000 7f8be1155b80 1 -- 172.21.15.49:0/1607540872 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5580e2c145f0 msgr2=0x5580e2c149d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.463+0000 7f8be1155b80 1 --2- 172.21.15.49:0/1607540872 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5580e2c145f0 0x5580e2c149d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0005e10 tx=0x7f8bc0017000 comp rx=0 tx=0).stop 2024-06-03T00:01:17.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.463+0000 7f8be1155b80 1 -- 172.21.15.49:0/1607540872 shutdown_connections 2024-06-03T00:01:17.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.463+0000 7f8be1155b80 1 --2- 172.21.15.49:0/1607540872 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580e2c0eed0 0x5580e2c0f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.463+0000 7f8be1155b80 1 --2- 172.21.15.49:0/1607540872 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5580e2c145f0 0x5580e2c149d0 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0005e10 tx=0x7f8bc0017000 comp rx=0 tx=0).stop 2024-06-03T00:01:17.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.463+0000 7f8be1155b80 1 --2- 172.21.15.49:0/1607540872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5580e2c14f10 0x5580e2c0e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.463+0000 7f8be1155b80 1 -- 172.21.15.49:0/1607540872 >> 172.21.15.49:0/1607540872 conn(0x5580e2b39c70 msgr2=0x5580e2c09800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:17.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.463+0000 7f8be1155b80 1 -- 172.21.15.49:0/1607540872 shutdown_connections 2024-06-03T00:01:17.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.463+0000 7f8be1155b80 1 -- 172.21.15.49:0/1607540872 wait complete. 2024-06-03T00:01:17.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.464+0000 7fef94a13740 1 Processor -- start 2024-06-03T00:01:17.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.464+0000 7fef94a13740 1 -- start start 2024-06-03T00:01:17.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.464+0000 7fef94a13740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9ea154420 0x55d9ea154840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.464+0000 7fef94a13740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d9ea154e10 0x55d9ea159910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.464+0000 7fef94a13740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d9ea159f80 0x55d9ea15c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.464+0000 7fef94a13740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55d9ea0b34f0 con 0x55d9ea159f80 2024-06-03T00:01:17.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.464+0000 7fef94a13740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55d9ea051870 con 0x55d9ea154420 2024-06-03T00:01:17.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.464+0000 7fef94a13740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d9ea0af4b0 con 0x55d9ea154e10 2024-06-03T00:01:17.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.464+0000 7fef88ff9640 1 --2- 172.21.15.49:0/1625601992 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fef740a2cb0 0x7fef740a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.464+0000 7f8be1155b80 1 -- start start 2024-06-03T00:01:17.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.464+0000 7fef8affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d9ea159f80 0x55d9ea15c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.464+0000 7fef8b7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d9ea154e10 0x55d9ea159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.464+0000 7fef8bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9ea154420 0x55d9ea154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.464+0000 7fef8affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d9ea159f80 0x55d9ea15c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39680/0 (socket says 172.21.15.49:39680) 2024-06-03T00:01:17.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.464+0000 7fef8affd640 1 -- 172.21.15.49:0/1643769497 learned_addr learned my addr 172.21.15.49:0/1643769497 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:17.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.464+0000 7fef88ff9640 1 -- 172.21.15.49:0/1625601992 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fef7c0cf560 con 0x7fef8c102480 2024-06-03T00:01:17.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.464+0000 7fef8bfff640 1 --2- 172.21.15.49:0/1625601992 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fef740a2cb0 0x7fef740a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.464+0000 7f8be1155b80 1 Processor -- start 2024-06-03T00:01:17.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.464+0000 7fef8affd640 1 -- 172.21.15.49:0/1643769497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d9ea154e10 msgr2=0x55d9ea159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:17.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.464+0000 7fef8affd640 1 --2- 172.21.15.49:0/1643769497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d9ea154e10 0x55d9ea159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.464+0000 7fef8affd640 1 -- 172.21.15.49:0/1643769497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9ea154420 msgr2=0x55d9ea154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:17.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.464+0000 7fef8affd640 1 --2- 172.21.15.49:0/1643769497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9ea154420 0x55d9ea154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.464+0000 7fef8affd640 1 -- 172.21.15.49:0/1643769497 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9ea06d9b0 con 0x55d9ea159f80 2024-06-03T00:01:17.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.464+0000 7fef8bfff640 1 --2- 172.21.15.49:0/1643769497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9ea154420 0x55d9ea154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:17.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.465+0000 7fef8affd640 1 --2- 172.21.15.49:0/1643769497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d9ea159f80 0x55d9ea15c410 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fef8000bc80 tx=0x7fef8000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5e32fb3352806f server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:17.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.465+0000 7f8be1155b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5580e2c0eed0 0x5580e2c1af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.465+0000 7f8be1155b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580e2c14f10 0x5580e2c18230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.465+0000 7f8be1155b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5580e2c188d0 0x5580e2c24e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.465+0000 7f8be1155b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5580e2c1b980 con 0x5580e2c0eed0 2024-06-03T00:01:17.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.465+0000 7f8be1155b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5580e2b00ba0 con 0x5580e2c14f10 2024-06-03T00:01:17.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.465+0000 7f8be1155b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5580e2c1bb00 con 0x5580e2c188d0 2024-06-03T00:01:17.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.465+0000 7f8be1155b80 10 client.0 _ll_register_callbacks cb 0x5580e2afa8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:17.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.465+0000 7f8bcf7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580e2c14f10 0x5580e2c18230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.465+0000 7f8bd4e6f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5580e2c188d0 0x5580e2c24e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.465+0000 7f8bd4e6f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5580e2c188d0 0x5580e2c24e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:53022/0 (socket says 172.21.15.49:53022) 2024-06-03T00:01:17.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.465+0000 7fef71ffb640 1 -- 172.21.15.49:0/1643769497 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef80015070 con 0x55d9ea159f80 2024-06-03T00:01:17.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.465+0000 7f8bd4e6f700 1 -- 172.21.15.49:0/1613228507 learned_addr learned my addr 172.21.15.49:0/1613228507 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:17.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.465+0000 7f8bcf7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580e2c14f10 0x5580e2c18230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.49:43856/0 (socket says 172.21.15.49:43856) 2024-06-03T00:01:17.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.465+0000 7fef8bfff640 1 --2- 172.21.15.49:0/1625601992 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fef740a2cb0 0x7fef740a5170 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fef84031c10 tx=0x7fef840095c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:17.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.465+0000 7f8bcffff700 1 --2- 172.21.15.49:0/1613228507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5580e2c0eed0 0x5580e2c1af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.465+0000 7fef71ffb640 1 -- 172.21.15.49:0/1643769497 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef80011920 con 0x55d9ea159f80 2024-06-03T00:01:17.482 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.465+0000 7fef71ffb640 1 -- 172.21.15.49:0/1643769497 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef80010870 con 0x55d9ea159f80 2024-06-03T00:01:17.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.465+0000 7f8bd4e6f700 1 -- 172.21.15.49:0/1613228507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580e2c14f10 msgr2=0x5580e2c18230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:17.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.465+0000 7f8bd4e6f700 1 --2- 172.21.15.49:0/1613228507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580e2c14f10 0x5580e2c18230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.465+0000 7f8bd4e6f700 1 -- 172.21.15.49:0/1613228507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5580e2c0eed0 msgr2=0x5580e2c1af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:17.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.465+0000 7f8bd4e6f700 1 --2- 172.21.15.49:0/1613228507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5580e2c0eed0 0x5580e2c1af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.465+0000 7f8bd4e6f700 1 -- 172.21.15.49:0/1613228507 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580e2aaf880 con 0x5580e2c188d0 2024-06-03T00:01:17.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.465+0000 7f8bcffff700 1 --2- 172.21.15.49:0/1613228507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5580e2c0eed0 0x5580e2c1af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:01:17.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.466+0000 7f8bd4e6f700 1 --2- 172.21.15.49:0/1613228507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5580e2c188d0 0x5580e2c24e90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8009dd0 tx=0x7f8bc8003f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93f33021b5efb322 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:17.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.466+0000 7f8baf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-06-03T00:01:17.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.466+0000 7f8baf7fe700 1 -- 172.21.15.49:0/1613228507 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc8007940 con 0x5580e2c188d0 2024-06-03T00:01:17.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.466+0000 7f8baf7fe700 1 -- 172.21.15.49:0/1613228507 <== mon.1 v2:172.21.15.107:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f8bc8007ae0 con 0x5580e2c188d0 2024-06-03T00:01:17.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.466+0000 7f8be1155b80 1 -- 172.21.15.49:0/1613228507 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bc001bc30 con 0x5580e2c188d0 2024-06-03T00:01:17.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.466+0000 7f8baf7fe700 1 -- 172.21.15.49:0/1613228507 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8bc8007ce0 con 0x5580e2c188d0 2024-06-03T00:01:17.485 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.466+0000 7fef94a13740 1 -- 172.21.15.49:0/1643769497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d9ea159f80 msgr2=0x55d9ea15c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.486 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.466+0000 7fef94a13740 1 --2- 172.21.15.49:0/1643769497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d9ea159f80 0x55d9ea15c410 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fef8000bc80 tx=0x7fef8000f730 comp rx=0 tx=0).stop 2024-06-03T00:01:17.486 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.466+0000 7fef94a13740 1 -- 172.21.15.49:0/1643769497 shutdown_connections 2024-06-03T00:01:17.486 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.466+0000 7fef94a13740 1 --2- 172.21.15.49:0/1643769497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d9ea159f80 0x55d9ea15c410 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.486 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.466+0000 7fef94a13740 1 --2- 172.21.15.49:0/1643769497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d9ea154e10 0x55d9ea159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.486 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.466+0000 7fef94a13740 1 --2- 172.21.15.49:0/1643769497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9ea154420 0x55d9ea154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.486 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.466+0000 7fef94a13740 1 -- 172.21.15.49:0/1643769497 >> 172.21.15.49:0/1643769497 conn(0x55d9ea14fa90 msgr2=0x55d9ea14fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:17.486 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.466+0000 7fef94a13740 1 -- 172.21.15.49:0/1643769497 shutdown_connections 2024-06-03T00:01:17.486 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.466+0000 7fef94a13740 1 -- 172.21.15.49:0/1643769497 wait complete. 2024-06-03T00:01:17.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.466+0000 7f8be1155b80 10 client.25114 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:17.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.466+0000 7f8be1155b80 1 -- 172.21.15.49:0/1613228507 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5580e2c26960 con 0x5580e2c188d0 2024-06-03T00:01:17.487 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.467+0000 7fef94a13740 1 -- start start 2024-06-03T00:01:17.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.467+0000 7f8baf7fe700 1 -- 172.21.15.49:0/1613228507 <== mon.1 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bc001bc30 con 0x5580e2c188d0 2024-06-03T00:01:17.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.467+0000 7f8baf7fe700 1 -- 172.21.15.49:0/1613228507 <== mon.1 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f8bc8011070 con 0x5580e2c188d0 2024-06-03T00:01:17.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.467+0000 7f8be1155b80 10 client.25114 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.467+0000 7fef94a13740 1 Processor -- start 2024-06-03T00:01:17.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.467+0000 7f8be1155b80 10 client.25114 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-03T00:01:17.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.467+0000 7f8be1155b80 20 client.25114 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:17.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.467+0000 7f8be1155b80 1 --2- 172.21.15.49:0/1613228507 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5580e2c28f30 0x5580e2c2a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.467+0000 7f8be1155b80 4 client.25114 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:01:17.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.467+0000 7f8be1155b80 1 -- 172.21.15.49:0/1613228507 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5580e2b6dcc0 con 0x5580e2c28f30 2024-06-03T00:01:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.467+0000 7fef94a13740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d9ea154420 0x55d9ea15e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.467+0000 7fef94a13740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9ea154e10 0x55d9ea15eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.490 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.467+0000 7fef94a13740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d9ea159f80 0x55d9ea165bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.490 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.468+0000 7fef94a13740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55d9ea15cf30 con 0x55d9ea154420 2024-06-03T00:01:17.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.468+0000 7f8bcffff700 1 --2- 172.21.15.49:0/1613228507 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5580e2c28f30 0x5580e2c2a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.468+0000 7fef8b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d9ea154420 0x55d9ea15e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.468+0000 7fef94a13740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55d9ea03cae0 con 0x55d9ea154e10 2024-06-03T00:01:17.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.468+0000 7fef94a13740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d9ea15d0b0 con 0x55d9ea159f80 2024-06-03T00:01:17.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.468+0000 7fef8b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d9ea154420 0x55d9ea15e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39704/0 (socket says 172.21.15.49:39704) 2024-06-03T00:01:17.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.468+0000 7fef8b7fe640 1 -- 172.21.15.49:0/179087600 learned_addr learned my addr 172.21.15.49:0/179087600 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:17.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.468+0000 7fef8bfff640 1 --2- 172.21.15.49:0/179087600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d9ea159f80 0x55d9ea165bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.468+0000 7fef94a13740 10 client.0 _ll_register_callbacks cb 0x55d9ea0759b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:17.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.468+0000 7fef8affd640 1 --2- 172.21.15.49:0/179087600 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9ea154e10 0x55d9ea15eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.468+0000 7fef8b7fe640 1 -- 172.21.15.49:0/179087600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d9ea159f80 msgr2=0x55d9ea165bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:17.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.468+0000 7fef8b7fe640 1 --2- 172.21.15.49:0/179087600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d9ea159f80 0x55d9ea165bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.468+0000 7fef8b7fe640 1 -- 172.21.15.49:0/179087600 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9ea154e10 msgr2=0x55d9ea15eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:17.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.468+0000 7fef8b7fe640 1 --2- 172.21.15.49:0/179087600 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9ea154e10 0x55d9ea15eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.468+0000 7fef8b7fe640 1 -- 172.21.15.49:0/179087600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9e9dc7210 con 0x55d9ea154420 2024-06-03T00:01:17.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.468+0000 7f8baf7fe700 10 client.25114 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:17.492 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.468+0000 7fef8b7fe640 1 --2- 172.21.15.49:0/179087600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d9ea154420 0x55d9ea15e630 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fef7c09bd50 tx=0x7fef7c09b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5655bfded62ec64 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:17.492 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.468+0000 7fef6affd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:01:17.493 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.468+0000 7fef6affd640 1 -- 172.21.15.49:0/179087600 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c09bdc0 con 0x55d9ea154420 2024-06-03T00:01:17.493 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.468+0000 7fef6affd640 1 -- 172.21.15.49:0/179087600 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fef7c0cf0b0 con 0x55d9ea154420 2024-06-03T00:01:17.493 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.468+0000 7fef94a13740 1 -- 172.21.15.49:0/179087600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef80011920 con 0x55d9ea154420 2024-06-03T00:01:17.493 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.469+0000 7fef6affd640 1 -- 172.21.15.49:0/179087600 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fef7c0a0170 con 0x55d9ea154420 2024-06-03T00:01:17.493 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.469+0000 7fef94a13740 10 client.15468 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:17.493 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.469+0000 7fef94a13740 1 -- 172.21.15.49:0/179087600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d9e9e93620 con 0x55d9ea154420 2024-06-03T00:01:17.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.469+0000 7f8bcffff700 1 --2- 172.21.15.49:0/1613228507 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5580e2c28f30 0x5580e2c2a3a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b2d187d4e93656f server_cookie=7786e3a4937cbde6 in_seq=0 out_seq=0 2024-06-03T00:01:17.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.469+0000 7fef6affd640 1 -- 172.21.15.49:0/179087600 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef80011920 con 0x55d9ea154420 2024-06-03T00:01:17.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.469+0000 7fef6affd640 1 -- 172.21.15.49:0/179087600 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fef7c018af0 con 0x55d9ea154420 2024-06-03T00:01:17.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.469+0000 7f8baf7fe700 1 -- 172.21.15.49:0/1613228507 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5580e2b6dcc0 con 0x5580e2c28f30 2024-06-03T00:01:17.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.469+0000 7f8baf7fe700 10 client.25114 handle_command_reply: tid=0 2024-06-03T00:01:17.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.470+0000 7fef94a13740 10 client.15468 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:17.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.470+0000 7fef94a13740 10 client.15468 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:01:17.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.470+0000 7fef94a13740 20 client.15468 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:17.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.469+0000 7f8be1155b80 1 client.25114 shutdown 2024-06-03T00:01:17.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.470+0000 7fef94a13740 1 --2- 172.21.15.49:0/179087600 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55d9ea16a550 0x55d9ea16c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.470+0000 7fef94a13740 4 client.15468 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:01:17.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.470+0000 7fef94a13740 1 -- 172.21.15.49:0/179087600 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9ea0c6f10 con 0x55d9ea16a550 2024-06-03T00:01:17.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.470+0000 7fef8affd640 1 --2- 172.21.15.49:0/179087600 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55d9ea16a550 0x55d9ea16c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.470+0000 7f8be1155b80 1 -- 172.21.15.49:0/1613228507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5580e2c188d0 msgr2=0x5580e2c24e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.470+0000 7f8be1155b80 1 --2- 172.21.15.49:0/1613228507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5580e2c188d0 0x5580e2c24e90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8009dd0 tx=0x7f8bc8003f90 comp rx=0 tx=0).stop 2024-06-03T00:01:17.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.470+0000 7f8be1155b80 1 -- 172.21.15.49:0/1613228507 shutdown_connections 2024-06-03T00:01:17.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.470+0000 7f8be1155b80 1 --2- 172.21.15.49:0/1613228507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5580e2c188d0 0x5580e2c24e90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.470+0000 7f8be1155b80 1 --2- 172.21.15.49:0/1613228507 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5580e2c28f30 0x5580e2c2a3a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.470+0000 7f8be1155b80 1 --2- 172.21.15.49:0/1613228507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5580e2c0eed0 0x5580e2c1af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.470+0000 7f8be1155b80 1 --2- 172.21.15.49:0/1613228507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580e2c14f10 0x5580e2c18230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.470+0000 7f8baf7fe700 0 client.25114 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:17.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.470+0000 7f8be1155b80 1 -- 172.21.15.49:0/1613228507 >> 172.21.15.49:0/1613228507 conn(0x5580e2b39c70 msgr2=0x5580e2c095a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:17.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.470+0000 7f8be1155b80 1 -- 172.21.15.49:0/1613228507 shutdown_connections 2024-06-03T00:01:17.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.470+0000 7f8be1155b80 1 -- 172.21.15.49:0/1613228507 wait complete. 2024-06-03T00:01:17.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.470+0000 7f8be1155b80 20 client.25114 trim_cache size 0 max 16384 2024-06-03T00:01:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.470+0000 7fef8affd640 1 --2- 172.21.15.49:0/179087600 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55d9ea16a550 0x55d9ea16c9e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e60ed89699235d1f server_cookie=b12305849ff528b0 in_seq=0 out_seq=0 2024-06-03T00:01:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.470+0000 7fef6affd640 10 client.15468 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.471+0000 7fef6affd640 1 -- 172.21.15.49:0/179087600 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55d9ea0c6f10 con 0x55d9ea16a550 2024-06-03T00:01:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.471+0000 7fef6affd640 10 client.15468 handle_command_reply: tid=0 2024-06-03T00:01:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.471+0000 7fef94a13740 1 client.15468 shutdown 2024-06-03T00:01:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.471+0000 7fef94a13740 1 -- 172.21.15.49:0/179087600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d9ea154420 msgr2=0x55d9ea15e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.471+0000 7fef94a13740 1 --2- 172.21.15.49:0/179087600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d9ea154420 0x55d9ea15e630 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fef7c09bd50 tx=0x7fef7c09b7e0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.471+0000 7fef94a13740 1 -- 172.21.15.49:0/179087600 shutdown_connections 2024-06-03T00:01:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.471+0000 7fef94a13740 1 --2- 172.21.15.49:0/179087600 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55d9ea16a550 0x55d9ea16c9e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.471+0000 7fef94a13740 1 --2- 172.21.15.49:0/179087600 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9ea154e10 0x55d9ea15eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.471+0000 7fef94a13740 1 --2- 172.21.15.49:0/179087600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d9ea159f80 0x55d9ea165bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.471+0000 7fef6affd640 0 client.15468 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.471+0000 7fef94a13740 1 --2- 172.21.15.49:0/179087600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d9ea154420 0x55d9ea15e630 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.471+0000 7fef94a13740 1 -- 172.21.15.49:0/179087600 >> 172.21.15.49:0/179087600 conn(0x55d9ea14fa90 msgr2=0x55d9ea14a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.471+0000 7fef94a13740 1 -- 172.21.15.49:0/179087600 shutdown_connections 2024-06-03T00:01:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.471+0000 7fef94a13740 1 -- 172.21.15.49:0/179087600 wait complete. 2024-06-03T00:01:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.472+0000 7fef94a13740 20 client.15468 trim_cache size 0 max 16384 2024-06-03T00:01:17.506 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.504+0000 7fef94a13740 1 Processor -- start 2024-06-03T00:01:17.507 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.504+0000 7fef94a13740 1 -- start start 2024-06-03T00:01:17.507 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.505+0000 7fef94a13740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d9ea154420 0x55d9ea146840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.507 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.505+0000 7fef94a13740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d9ea154e10 0x55d9ea165b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.507 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.505+0000 7fef94a13740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9ea159f80 0x55d9ea14fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.507 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.505+0000 7fef94a13740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c1a6be0 con 0x55d9ea154420 2024-06-03T00:01:17.507 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.505+0000 7fef94a13740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c1a8720 con 0x55d9ea159f80 2024-06-03T00:01:17.507 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.505+0000 7fef94a13740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c1a72b0 con 0x55d9ea154e10 2024-06-03T00:01:17.507 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.505+0000 7fef8b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d9ea154420 0x55d9ea146840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.507 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.505+0000 7fef8b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d9ea154420 0x55d9ea146840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39718/0 (socket says 172.21.15.49:39718) 2024-06-03T00:01:17.507 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.505+0000 7fef8b7fe640 1 -- 172.21.15.49:0/355415635 learned_addr learned my addr 172.21.15.49:0/355415635 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:17.507 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.505+0000 7fef8affd640 1 --2- 172.21.15.49:0/355415635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d9ea154e10 0x55d9ea165b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.507 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.505+0000 7fef8bfff640 1 --2- 172.21.15.49:0/355415635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9ea159f80 0x55d9ea14fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.508 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.505+0000 7fef8affd640 1 -- 172.21.15.49:0/355415635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9ea159f80 msgr2=0x55d9ea14fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:17.508 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.505+0000 7fef8affd640 1 --2- 172.21.15.49:0/355415635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9ea159f80 0x55d9ea14fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.508 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.505+0000 7fef8affd640 1 -- 172.21.15.49:0/355415635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d9ea154420 msgr2=0x55d9ea146840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:17.508 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.505+0000 7fef8affd640 1 --2- 172.21.15.49:0/355415635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d9ea154420 0x55d9ea146840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.508 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.505+0000 7fef8affd640 1 -- 172.21.15.49:0/355415635 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9ea14f8c0 con 0x55d9ea154e10 2024-06-03T00:01:17.508 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.505+0000 7fef8b7fe640 1 --2- 172.21.15.49:0/355415635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d9ea154420 0x55d9ea146840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:01:17.508 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.505+0000 7fef8affd640 1 --2- 172.21.15.49:0/355415635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d9ea154e10 0x55d9ea165b70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fef80006010 tx=0x7fef8000b5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7615a329b4c16983 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:17.508 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.506+0000 7fef717fa640 1 -- 172.21.15.49:0/355415635 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef80015040 con 0x55d9ea154e10 2024-06-03T00:01:17.508 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.506+0000 7fef717fa640 1 -- 172.21.15.49:0/355415635 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef80005500 con 0x55d9ea154e10 2024-06-03T00:01:17.508 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.506+0000 7fef717fa640 1 -- 172.21.15.49:0/355415635 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef80011720 con 0x55d9ea154e10 2024-06-03T00:01:17.514 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.507+0000 7fef94a13740 1 -- 172.21.15.49:0/355415635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d9ea154e10 msgr2=0x55d9ea165b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.515 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.507+0000 7fef94a13740 1 --2- 172.21.15.49:0/355415635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d9ea154e10 0x55d9ea165b70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fef80006010 tx=0x7fef8000b5a0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.515 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.507+0000 7fef94a13740 1 -- 172.21.15.49:0/355415635 shutdown_connections 2024-06-03T00:01:17.515 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.507+0000 7fef94a13740 1 --2- 172.21.15.49:0/355415635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9ea159f80 0x55d9ea14fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.515 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.507+0000 7fef94a13740 1 --2- 172.21.15.49:0/355415635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d9ea154e10 0x55d9ea165b70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.515 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.507+0000 7fef94a13740 1 --2- 172.21.15.49:0/355415635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d9ea154420 0x55d9ea146840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.515 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.507+0000 7fef94a13740 1 -- 172.21.15.49:0/355415635 >> 172.21.15.49:0/355415635 conn(0x55d9ea14fa90 msgr2=0x55d9ea155500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:17.516 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.507+0000 7fef94a13740 1 -- 172.21.15.49:0/355415635 shutdown_connections 2024-06-03T00:01:17.516 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.507+0000 7fef94a13740 1 -- 172.21.15.49:0/355415635 wait complete. 2024-06-03T00:01:17.516 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.508+0000 7fef94a13740 1 -- start start 2024-06-03T00:01:17.516 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.508+0000 7fef94a13740 1 Processor -- start 2024-06-03T00:01:17.516 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.508+0000 7fef94a13740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d9ea154420 0x55d9ea165af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.516 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.509+0000 7fef94a13740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d9ea154e10 0x55d9ea162590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.516 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.509+0000 7fef94a13740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9ea159f80 0x55d9ea162b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.516 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.509+0000 7fef94a13740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c1a8050 con 0x55d9ea154e10 2024-06-03T00:01:17.516 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.509+0000 7fef8b7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d9ea154420 0x55d9ea165af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.516 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.509+0000 7fef94a13740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c1a7980 con 0x55d9ea159f80 2024-06-03T00:01:17.516 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.509+0000 7fef94a13740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c1a4ba0 con 0x55d9ea154420 2024-06-03T00:01:17.516 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.509+0000 7fef8b7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d9ea154420 0x55d9ea165af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:53044/0 (socket says 172.21.15.49:53044) 2024-06-03T00:01:17.516 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.509+0000 7fef8b7fe640 1 -- 172.21.15.49:0/3855674739 learned_addr learned my addr 172.21.15.49:0/3855674739 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:17.517 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.509+0000 7fef8affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d9ea154e10 0x55d9ea162590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.517 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.509+0000 7fef8bfff640 1 --2- 172.21.15.49:0/3855674739 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9ea159f80 0x55d9ea162b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.517 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.509+0000 7fef8b7fe640 1 -- 172.21.15.49:0/3855674739 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9ea159f80 msgr2=0x55d9ea162b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:17.517 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.509+0000 7fef8b7fe640 1 --2- 172.21.15.49:0/3855674739 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9ea159f80 0x55d9ea162b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.517 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.509+0000 7fef8b7fe640 1 -- 172.21.15.49:0/3855674739 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d9ea154e10 msgr2=0x55d9ea162590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:17.517 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.509+0000 7fef8b7fe640 1 --2- 172.21.15.49:0/3855674739 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d9ea154e10 0x55d9ea162590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.517 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.509+0000 7fef8b7fe640 1 -- 172.21.15.49:0/3855674739 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9ea1d32e0 con 0x55d9ea154420 2024-06-03T00:01:17.517 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.510+0000 7fef8affd640 1 --2- 172.21.15.49:0/3855674739 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d9ea154e10 0x55d9ea162590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:01:17.517 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.510+0000 7fef94a13740 10 client.0 _ll_register_callbacks cb 0x7fef7c097940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:17.517 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.510+0000 7fef94a13740 1 -- 172.21.15.49:0/3855674739 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef80005500 con 0x55d9ea154420 2024-06-03T00:01:17.517 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.510+0000 7fef8bfff640 1 --2- 172.21.15.49:0/3855674739 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9ea159f80 0x55d9ea162b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:01:17.517 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.510+0000 7fef8b7fe640 1 --2- 172.21.15.49:0/3855674739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d9ea154420 0x55d9ea165af0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fef7c09bd50 tx=0x7fef7c097d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23050015ae7dadef server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:17.518 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.510+0000 7fef6affd640 10 client.25123 ms_handle_connect on v2:172.21.15.107:3300/0 2024-06-03T00:01:17.518 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.510+0000 7fef6affd640 1 -- 172.21.15.49:0/3855674739 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c09b410 con 0x55d9ea154420 2024-06-03T00:01:17.518 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.510+0000 7fef6affd640 1 -- 172.21.15.49:0/3855674739 <== mon.1 v2:172.21.15.107:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fef7c0cf0d0 con 0x55d9ea154420 2024-06-03T00:01:17.518 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.511+0000 7fef6affd640 1 -- 172.21.15.49:0/3855674739 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fef7c0cf310 con 0x55d9ea154420 2024-06-03T00:01:17.518 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.511+0000 7fef94a13740 10 client.25123 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:17.518 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.511+0000 7fef94a13740 1 -- 172.21.15.49:0/3855674739 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55d9ea14aff0 con 0x55d9ea154420 2024-06-03T00:01:17.518 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.511+0000 7fef6affd640 1 -- 172.21.15.49:0/3855674739 <== mon.1 v2:172.21.15.107:3300/0 4 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fef7c010430 con 0x55d9ea154420 2024-06-03T00:01:17.518 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.511+0000 7fef94a13740 10 client.25123 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:17.518 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.511+0000 7fef94a13740 10 client.25123 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:01:17.518 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.511+0000 7fef94a13740 20 client.25123 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:17.518 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.511+0000 7fef94a13740 1 --2- 172.21.15.49:0/3855674739 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55d9ea14b6d0 0x55d9ea14db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.519 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.511+0000 7fef94a13740 4 client.25123 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-03T00:01:17.519 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.511+0000 7fef94a13740 1 -- 172.21.15.49:0/3855674739 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d9ea0c0c20 con 0x55d9ea14b6d0 2024-06-03T00:01:17.519 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.511+0000 7fef8affd640 1 --2- 172.21.15.49:0/3855674739 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55d9ea14b6d0 0x55d9ea14db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.519 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.512+0000 7fef8affd640 1 --2- 172.21.15.49:0/3855674739 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55d9ea14b6d0 0x55d9ea14db50 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a62ccc31f5735419 server_cookie=a8fcdb893d714b21 in_seq=0 out_seq=0 2024-06-03T00:01:17.519 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.512+0000 7fef6affd640 10 client.25123 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:17.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.514+0000 7f8be1155b80 1 Processor -- start 2024-06-03T00:01:17.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.514+0000 7f8be1155b80 1 -- start start 2024-06-03T00:01:17.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.514+0000 7f8be1155b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580e2c0eed0 0x5580e2c0e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.514+0000 7f8be1155b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5580e2c14f10 0x5580e2c181f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.514+0000 7f8be1155b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5580e2c188d0 0x5580e2c24e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.514+0000 7f8be1155b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5580e2c286e0 con 0x5580e2c188d0 2024-06-03T00:01:17.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.514+0000 7f8be1155b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5580e2c28db0 con 0x5580e2c0eed0 2024-06-03T00:01:17.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.514+0000 7f8be1155b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5580e2c29480 con 0x5580e2c14f10 2024-06-03T00:01:17.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.514+0000 7f8bcffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580e2c0eed0 0x5580e2c0e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.514+0000 7f8bcffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580e2c0eed0 0x5580e2c0e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.49:43894/0 (socket says 172.21.15.49:43894) 2024-06-03T00:01:17.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.514+0000 7f8bcffff700 1 -- 172.21.15.49:0/3286094458 learned_addr learned my addr 172.21.15.49:0/3286094458 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:17.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.514+0000 7f8bcffff700 1 -- 172.21.15.49:0/3286094458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5580e2c14f10 msgr2=0x5580e2c181f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-03T00:01:17.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.514+0000 7f8bcffff700 1 --2- 172.21.15.49:0/3286094458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5580e2c14f10 0x5580e2c181f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.514+0000 7f8bcffff700 1 -- 172.21.15.49:0/3286094458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5580e2c188d0 msgr2=0x5580e2c24e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:17.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.514+0000 7f8bcffff700 1 --2- 172.21.15.49:0/3286094458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5580e2c188d0 0x5580e2c24e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.514+0000 7f8bcffff700 1 -- 172.21.15.49:0/3286094458 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580e2c0b030 con 0x5580e2c0eed0 2024-06-03T00:01:17.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.515+0000 7f8bcffff700 1 --2- 172.21.15.49:0/3286094458 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580e2c0eed0 0x5580e2c0e990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8bc000ffd0 tx=0x7f8bc0026d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2194e2bee511ac4f server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:17.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.515+0000 7f8bb5ffb700 1 -- 172.21.15.49:0/3286094458 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc002b040 con 0x5580e2c0eed0 2024-06-03T00:01:17.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.515+0000 7f8bb5ffb700 1 -- 172.21.15.49:0/3286094458 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bc0035070 con 0x5580e2c0eed0 2024-06-03T00:01:17.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.515+0000 7f8bb5ffb700 1 -- 172.21.15.49:0/3286094458 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0004590 con 0x5580e2c0eed0 2024-06-03T00:01:17.524 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.515+0000 7fef6affd640 1 -- 172.21.15.49:0/3855674739 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55d9ea0c0c20 con 0x55d9ea14b6d0 2024-06-03T00:01:17.524 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.515+0000 7fef6affd640 10 client.25123 handle_command_reply: tid=0 2024-06-03T00:01:17.524 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.515+0000 7fef94a13740 1 client.25123 shutdown 2024-06-03T00:01:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.516+0000 7fef94a13740 1 -- 172.21.15.49:0/3855674739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d9ea154420 msgr2=0x55d9ea165af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.516+0000 7fef94a13740 1 --2- 172.21.15.49:0/3855674739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d9ea154420 0x55d9ea165af0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fef7c09bd50 tx=0x7fef7c097d30 comp rx=0 tx=0).stop 2024-06-03T00:01:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.516+0000 7fef94a13740 1 -- 172.21.15.49:0/3855674739 shutdown_connections 2024-06-03T00:01:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.516+0000 7fef94a13740 1 --2- 172.21.15.49:0/3855674739 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55d9ea14b6d0 0x55d9ea14db50 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.516+0000 7fef94a13740 1 --2- 172.21.15.49:0/3855674739 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9ea159f80 0x55d9ea162b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.516+0000 7fef6affd640 0 client.25123 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.516+0000 7fef94a13740 1 --2- 172.21.15.49:0/3855674739 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d9ea154e10 0x55d9ea162590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.516+0000 7fef94a13740 1 --2- 172.21.15.49:0/3855674739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d9ea154420 0x55d9ea165af0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.516+0000 7fef94a13740 1 -- 172.21.15.49:0/3855674739 >> 172.21.15.49:0/3855674739 conn(0x55d9ea14fa90 msgr2=0x55d9ea14fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.516+0000 7fef94a13740 1 -- 172.21.15.49:0/3855674739 shutdown_connections 2024-06-03T00:01:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.516+0000 7fef94a13740 1 -- 172.21.15.49:0/3855674739 wait complete. 2024-06-03T00:01:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.516+0000 7fef94a13740 20 client.25123 trim_cache size 0 max 16384 2024-06-03T00:01:17.526 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-06-03T00:01:17.526 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-06-03T00:01:17.526 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-06-03T00:01:17.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.516+0000 7f8be1155b80 1 -- 172.21.15.49:0/3286094458 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580e2c0eed0 msgr2=0x5580e2c0e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.516+0000 7f8be1155b80 1 --2- 172.21.15.49:0/3286094458 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580e2c0eed0 0x5580e2c0e990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8bc000ffd0 tx=0x7f8bc0026d30 comp rx=0 tx=0).stop 2024-06-03T00:01:17.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.516+0000 7f8be1155b80 1 -- 172.21.15.49:0/3286094458 shutdown_connections 2024-06-03T00:01:17.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.516+0000 7f8be1155b80 1 --2- 172.21.15.49:0/3286094458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5580e2c188d0 0x5580e2c24e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.516+0000 7f8be1155b80 1 --2- 172.21.15.49:0/3286094458 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580e2c0eed0 0x5580e2c0e990 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.516+0000 7f8be1155b80 1 --2- 172.21.15.49:0/3286094458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5580e2c14f10 0x5580e2c181f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.516+0000 7f8be1155b80 1 -- 172.21.15.49:0/3286094458 >> 172.21.15.49:0/3286094458 conn(0x5580e2b39c70 msgr2=0x5580e2c17ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:17.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.516+0000 7f8be1155b80 1 -- 172.21.15.49:0/3286094458 shutdown_connections 2024-06-03T00:01:17.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.516+0000 7f8be1155b80 1 -- 172.21.15.49:0/3286094458 wait complete. 2024-06-03T00:01:17.527 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:01:17.528 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.517+0000 7fef91c2a640 1 -- 172.21.15.49:0/1625601992 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fef740a2cb0 msgr2=0x7fef740a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.528 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.517+0000 7fef91c2a640 1 --2- 172.21.15.49:0/1625601992 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fef740a2cb0 0x7fef740a5170 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fef84031c10 tx=0x7fef840095c0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.528 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.517+0000 7fef91c2a640 1 -- 172.21.15.49:0/1625601992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef8c102480 msgr2=0x7fef8c197c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.528 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.517+0000 7fef91c2a640 1 --2- 172.21.15.49:0/1625601992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef8c102480 0x7fef8c197c40 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fef7c00e9f0 tx=0x7fef7c00eeb0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.528 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.517+0000 7fef91c2a640 1 -- 172.21.15.49:0/1625601992 shutdown_connections 2024-06-03T00:01:17.528 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.517+0000 7fef91c2a640 1 --2- 172.21.15.49:0/1625601992 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fef740a2cb0 0x7fef740a5170 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.529 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.517+0000 7fef91c2a640 1 --2- 172.21.15.49:0/1625601992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef8c1076e0 0x7fef8c19f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.529 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.517+0000 7fef91c2a640 1 --2- 172.21.15.49:0/1625601992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef8c104db0 0x7fef8c198180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.529 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.517+0000 7fef91c2a640 1 --2- 172.21.15.49:0/1625601992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef8c102480 0x7fef8c197c40 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.529 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.517+0000 7fef91c2a640 1 -- 172.21.15.49:0/1625601992 >> 172.21.15.49:0/1625601992 conn(0x7fef8c0fbe70 msgr2=0x7fef8c102da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:17.529 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.517+0000 7fef91c2a640 1 -- 172.21.15.49:0/1625601992 shutdown_connections 2024-06-03T00:01:17.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.517+0000 7f8be1155b80 1 -- start start 2024-06-03T00:01:17.529 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:17.517+0000 7fef91c2a640 1 -- 172.21.15.49:0/1625601992 wait complete. 2024-06-03T00:01:17.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.517+0000 7f8be1155b80 1 Processor -- start 2024-06-03T00:01:17.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.517+0000 7f8be1155b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580e2c0eed0 0x5580e2c33ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.517+0000 7f8be1155b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5580e2c14f10 0x5580e2c24390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.517+0000 7f8be1155b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5580e2c188d0 0x5580e2c248d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.518+0000 7f8be1155b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5580e2c2a220 con 0x5580e2c14f10 2024-06-03T00:01:17.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.518+0000 7f8be1155b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5580e2c29b50 con 0x5580e2c0eed0 2024-06-03T00:01:17.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.518+0000 7f8be1155b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5580e2c2a8f0 con 0x5580e2c188d0 2024-06-03T00:01:17.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.518+0000 7f8be1155b80 10 client.0 _ll_register_callbacks cb 0x5580e2afa8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:17.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.518+0000 7f8bcf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5580e2c14f10 0x5580e2c24390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.518+0000 7f8bcffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580e2c0eed0 0x5580e2c33ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.518+0000 7f8bcf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5580e2c14f10 0x5580e2c24390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39750/0 (socket says 172.21.15.49:39750) 2024-06-03T00:01:17.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.518+0000 7f8bcf7fe700 1 -- 172.21.15.49:0/309988973 learned_addr learned my addr 172.21.15.49:0/309988973 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:17.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.518+0000 7f8bd4e6f700 1 --2- 172.21.15.49:0/309988973 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5580e2c188d0 0x5580e2c248d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.518+0000 7f8bcffff700 1 -- 172.21.15.49:0/309988973 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5580e2c188d0 msgr2=0x5580e2c248d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:17.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.518+0000 7f8bcffff700 1 --2- 172.21.15.49:0/309988973 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5580e2c188d0 0x5580e2c248d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.518+0000 7f8bcffff700 1 -- 172.21.15.49:0/309988973 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5580e2c14f10 msgr2=0x5580e2c24390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:17.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.518+0000 7f8bcffff700 1 --2- 172.21.15.49:0/309988973 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5580e2c14f10 0x5580e2c24390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.518+0000 7f8bcffff700 1 -- 172.21.15.49:0/309988973 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580e2c25140 con 0x5580e2c0eed0 2024-06-03T00:01:17.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.518+0000 7f8bd4e6f700 1 --2- 172.21.15.49:0/309988973 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5580e2c188d0 0x5580e2c248d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:17.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.518+0000 7f8bcffff700 1 --2- 172.21.15.49:0/309988973 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580e2c0eed0 0x5580e2c33ee0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8bc000fe60 tx=0x7f8bc0003f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f3f9693f2709aab server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:17.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.518+0000 7f8baf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2024-06-03T00:01:17.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.518+0000 7f8baf7fe700 1 -- 172.21.15.49:0/309988973 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc002b070 con 0x5580e2c0eed0 2024-06-03T00:01:17.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.518+0000 7f8baf7fe700 1 -- 172.21.15.49:0/309988973 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f8bc00053f0 con 0x5580e2c0eed0 2024-06-03T00:01:17.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.518+0000 7f8be1155b80 1 -- 172.21.15.49:0/309988973 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bc0035070 con 0x5580e2c0eed0 2024-06-03T00:01:17.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.519+0000 7f8baf7fe700 1 -- 172.21.15.49:0/309988973 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8bc000f0d0 con 0x5580e2c0eed0 2024-06-03T00:01:17.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.519+0000 7f8be1155b80 10 client.25088 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:17.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.519+0000 7f8be1155b80 1 -- 172.21.15.49:0/309988973 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5580e2c9cfd0 con 0x5580e2c0eed0 2024-06-03T00:01:17.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.519+0000 7f8baf7fe700 1 -- 172.21.15.49:0/309988973 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bc0035070 con 0x5580e2c0eed0 2024-06-03T00:01:17.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.519+0000 7f8baf7fe700 1 -- 172.21.15.49:0/309988973 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f8bc0004640 con 0x5580e2c0eed0 2024-06-03T00:01:17.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.519+0000 7f8be1155b80 10 client.25088 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:17.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.519+0000 7f8be1155b80 10 client.25088 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-03T00:01:17.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.519+0000 7f8be1155b80 20 client.25088 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:17.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.519+0000 7f8be1155b80 1 --2- 172.21.15.49:0/309988973 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5580e2ca13b0 0x5580e2ca00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.519+0000 7f8be1155b80 4 client.25088 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-03T00:01:17.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.519+0000 7f8be1155b80 1 -- 172.21.15.49:0/309988973 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "status"}) -- 0x5580e2b68240 con 0x5580e2ca13b0 2024-06-03T00:01:17.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.520+0000 7f8bcf7fe700 1 --2- 172.21.15.49:0/309988973 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5580e2ca13b0 0x5580e2ca00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.520+0000 7f8baf7fe700 10 client.25088 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:17.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.520+0000 7f8bcf7fe700 1 --2- 172.21.15.49:0/309988973 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5580e2ca13b0 0x5580e2ca00c0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a83e5a028a1805fd server_cookie=7353f8e04ea290f0 in_seq=0 out_seq=0 2024-06-03T00:01:17.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.520+0000 7f8baf7fe700 1 -- 172.21.15.49:0/309988973 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5580e2b68240 con 0x5580e2ca13b0 2024-06-03T00:01:17.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.520+0000 7f8baf7fe700 10 client.25088 handle_command_reply: tid=0 2024-06-03T00:01:17.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.520+0000 7f8be1155b80 1 client.25088 shutdown 2024-06-03T00:01:17.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.521+0000 7f8be1155b80 1 -- 172.21.15.49:0/309988973 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580e2c0eed0 msgr2=0x5580e2c33ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.521+0000 7f8be1155b80 1 --2- 172.21.15.49:0/309988973 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580e2c0eed0 0x5580e2c33ee0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8bc000fe60 tx=0x7f8bc0003f30 comp rx=0 tx=0).stop 2024-06-03T00:01:17.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.521+0000 7f8be1155b80 1 -- 172.21.15.49:0/309988973 shutdown_connections 2024-06-03T00:01:17.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.521+0000 7f8be1155b80 1 --2- 172.21.15.49:0/309988973 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5580e2c188d0 0x5580e2c248d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.521+0000 7f8be1155b80 1 --2- 172.21.15.49:0/309988973 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580e2c0eed0 0x5580e2c33ee0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.521+0000 7f8be1155b80 1 --2- 172.21.15.49:0/309988973 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5580e2ca13b0 0x5580e2ca00c0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.521+0000 7f8be1155b80 1 --2- 172.21.15.49:0/309988973 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5580e2c14f10 0x5580e2c24390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.521+0000 7f8baf7fe700 0 client.25088 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:17.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.521+0000 7f8be1155b80 1 -- 172.21.15.49:0/309988973 >> 172.21.15.49:0/309988973 conn(0x5580e2b39c70 msgr2=0x5580e2c12070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:17.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.521+0000 7f8be1155b80 1 -- 172.21.15.49:0/309988973 shutdown_connections 2024-06-03T00:01:17.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.521+0000 7f8be1155b80 1 -- 172.21.15.49:0/309988973 wait complete. 2024-06-03T00:01:17.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.521+0000 7f8be1155b80 20 client.25088 trim_cache size 0 max 16384 2024-06-03T00:01:17.537 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:01:17.537 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "890dd222-213a-11ef-bc9b-c7b262605968", 2024-06-03T00:01:17.537 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-06-03T00:01:17.537 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 24487, 2024-06-03T00:01:17.537 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-06-03T00:01:17.537 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-06-03T00:01:17.537 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-06-03T00:01:17.537 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 240.19784960000001, 2024-06-03T00:01:17.537 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 27, 2024-06-03T00:01:17.537 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 90, 2024-06-03T00:01:17.537 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 90, 2024-06-03T00:01:17.537 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 264.60421601199999 2024-06-03T00:01:17.538 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:01:17.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.522+0000 7f8bd68d2700 1 -- 172.21.15.49:0/1258350400 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8bb80a2ca0 msgr2=0x7f8bb80a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.522+0000 7f8bd68d2700 1 --2- 172.21.15.49:0/1258350400 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8bb80a2ca0 0x7f8bb80a5160 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8bd00ffb00 tx=0x7f8bc000f7d0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.522+0000 7f8bd68d2700 1 -- 172.21.15.49:0/1258350400 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bd0101d50 msgr2=0x7f8bd019dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.522+0000 7f8bd68d2700 1 --2- 172.21.15.49:0/1258350400 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bd0101d50 0x7f8bd019dc80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4007860 tx=0x7f8bc4007b70 comp rx=0 tx=0).stop 2024-06-03T00:01:17.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.522+0000 7f8bd68d2700 1 -- 172.21.15.49:0/1258350400 shutdown_connections 2024-06-03T00:01:17.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.522+0000 7f8bd68d2700 1 --2- 172.21.15.49:0/1258350400 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8bb80a2ca0 0x7f8bb80a5160 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.522+0000 7f8bd68d2700 1 --2- 172.21.15.49:0/1258350400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bd0107400 0x7f8bd0197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.522+0000 7f8bd68d2700 1 --2- 172.21.15.49:0/1258350400 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bd0101390 0x7f8bd019d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.522+0000 7f8bd68d2700 1 --2- 172.21.15.49:0/1258350400 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bd0101d50 0x7f8bd019dc80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.522+0000 7f8bd68d2700 1 -- 172.21.15.49:0/1258350400 >> 172.21.15.49:0/1258350400 conn(0x7f8bd0078340 msgr2=0x7f8bd00ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:17.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.522+0000 7f8bd68d2700 1 -- 172.21.15.49:0/1258350400 shutdown_connections 2024-06-03T00:01:17.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:17.522+0000 7f8bd68d2700 1 -- 172.21.15.49:0/1258350400 wait complete. 2024-06-03T00:01:18.630 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:18 smithi049 ceph-mon[32302]: pgmap v421: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 11 op/s 2024-06-03T00:01:18.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:18 smithi057 ceph-mon[36457]: pgmap v421: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 11 op/s 2024-06-03T00:01:18.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:18 smithi107 ceph-mon[37048]: pgmap v421: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 11 op/s 2024-06-03T00:01:19.453 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-06-03T00:01:19.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.897+0000 7f1ae1645700 1 -- 172.21.15.49:0/811122851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1adc101390 msgr2=0x7f1adc101810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.897+0000 7f1ae1645700 1 --2- 172.21.15.49:0/811122851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1adc101390 0x7f1adc101810 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4009990 tx=0x7f1ac4009ca0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.897+0000 7f1ae1645700 1 -- 172.21.15.49:0/811122851 shutdown_connections 2024-06-03T00:01:19.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.897+0000 7f1ae1645700 1 --2- 172.21.15.49:0/811122851 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1adc101d50 0x7f1adc10e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.897+0000 7f1ae1645700 1 --2- 172.21.15.49:0/811122851 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1adc107400 0x7f1adc1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.897+0000 7f1ae1645700 1 --2- 172.21.15.49:0/811122851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1adc101390 0x7f1adc101810 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.897+0000 7f1ae1645700 1 -- 172.21.15.49:0/811122851 >> 172.21.15.49:0/811122851 conn(0x7f1adc078340 msgr2=0x7f1adc078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:19.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.897+0000 7f1ae1645700 1 -- 172.21.15.49:0/811122851 shutdown_connections 2024-06-03T00:01:19.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.897+0000 7f1ae1645700 1 -- 172.21.15.49:0/811122851 wait complete. 2024-06-03T00:01:19.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.898+0000 7f1ae1645700 1 Processor -- start 2024-06-03T00:01:19.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.898+0000 7f1ae1645700 1 -- start start 2024-06-03T00:01:19.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.898+0000 7f1ae1645700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1adc101390 0x7f1adc199b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.899+0000 7f1ae1645700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1adc101d50 0x7f1adc19a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.899+0000 7f1ae1645700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1adc107400 0x7f1adc1a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.899+0000 7f1ae1645700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc111710 con 0x7f1adc101d50 2024-06-03T00:01:19.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.899+0000 7f1ae1645700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc111590 con 0x7f1adc101390 2024-06-03T00:01:19.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.899+0000 7f1ae1645700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc111890 con 0x7f1adc107400 2024-06-03T00:01:19.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.899+0000 7f1ada7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1adc101d50 0x7f1adc19a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.899+0000 7f1ada7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1adc101d50 0x7f1adc19a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39776/0 (socket says 172.21.15.49:39776) 2024-06-03T00:01:19.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.899+0000 7f1ada7fc700 1 -- 172.21.15.49:0/1365750208 learned_addr learned my addr 172.21.15.49:0/1365750208 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:19.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.899+0000 7f1adaffd700 1 --2- 172.21.15.49:0/1365750208 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1adc101390 0x7f1adc199b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.899+0000 7f1adb7fe700 1 --2- 172.21.15.49:0/1365750208 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1adc107400 0x7f1adc1a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.899+0000 7f1ada7fc700 1 -- 172.21.15.49:0/1365750208 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1adc107400 msgr2=0x7f1adc1a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.899+0000 7f1ada7fc700 1 --2- 172.21.15.49:0/1365750208 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1adc107400 0x7f1adc1a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.899+0000 7f1ada7fc700 1 -- 172.21.15.49:0/1365750208 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1adc101390 msgr2=0x7f1adc199b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.899+0000 7f1ada7fc700 1 --2- 172.21.15.49:0/1365750208 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1adc101390 0x7f1adc199b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.899+0000 7f1ada7fc700 1 -- 172.21.15.49:0/1365750208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1adc1a5150 con 0x7f1adc101d50 2024-06-03T00:01:19.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.899+0000 7f1ada7fc700 1 --2- 172.21.15.49:0/1365750208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1adc101d50 0x7f1adc19a0d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400bff0 tx=0x7f1ac4005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:19.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.899+0000 7f1ad3fff700 1 -- 172.21.15.49:0/1365750208 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac4027070 con 0x7f1adc101d50 2024-06-03T00:01:19.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.899+0000 7f1ae1645700 1 -- 172.21.15.49:0/1365750208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1adc1a5320 con 0x7f1adc101d50 2024-06-03T00:01:19.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.899+0000 7f1ad3fff700 1 -- 172.21.15.49:0/1365750208 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ac4004150 con 0x7f1adc101d50 2024-06-03T00:01:19.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.899+0000 7f1ad3fff700 1 -- 172.21.15.49:0/1365750208 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac400f460 con 0x7f1adc101d50 2024-06-03T00:01:19.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.900+0000 7f1ae1645700 1 -- 172.21.15.49:0/1365750208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1adc1a57d0 con 0x7f1adc101d50 2024-06-03T00:01:19.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.902+0000 7f1ad3fff700 1 -- 172.21.15.49:0/1365750208 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1ac402a070 con 0x7f1adc101d50 2024-06-03T00:01:19.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.903+0000 7f1ad3fff700 1 --2- 172.21.15.49:0/1365750208 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1ac80a2c20 0x7f1ac80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.903+0000 7f1adaffd700 1 --2- 172.21.15.49:0/1365750208 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1ac80a2c20 0x7f1ac80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.903+0000 7f1ad3fff700 1 -- 172.21.15.49:0/1365750208 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f1ac40cffc0 con 0x7f1adc101d50 2024-06-03T00:01:19.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.904+0000 7f1adaffd700 1 --2- 172.21.15.49:0/1365750208 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1ac80a2c20 0x7f1ac80a50e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1acc0060b0 tx=0x7f1acc007790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:19.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.904+0000 7f1aebec8b80 1 Processor -- start 2024-06-03T00:01:19.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.904+0000 7f1aebec8b80 1 -- start start 2024-06-03T00:01:19.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.904+0000 7f1aebec8b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dde08ee640 0x55dde08eea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.904+0000 7f1aebec8b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dde08eef60 0x55dde08e89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.904+0000 7f1aebec8b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dde08e8f20 0x55dde08e9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.904+0000 7f1aebec8b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55dde083a810 con 0x55dde08ee640 2024-06-03T00:01:19.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.904+0000 7f1aebec8b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55dde07e2720 con 0x55dde08e8f20 2024-06-03T00:01:19.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.904+0000 7f1aebec8b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55dde08367d0 con 0x55dde08eef60 2024-06-03T00:01:19.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.904+0000 7f1adaffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dde08ee640 0x55dde08eea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.904+0000 7f1adaffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dde08ee640 0x55dde08eea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39784/0 (socket says 172.21.15.49:39784) 2024-06-03T00:01:19.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.904+0000 7f1adaffd700 1 -- 172.21.15.49:0/998366122 learned_addr learned my addr 172.21.15.49:0/998366122 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:19.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.905+0000 7f1ada7fc700 1 --2- 172.21.15.49:0/998366122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dde08eef60 0x55dde08e89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.905+0000 7f1adb7fe700 1 --2- 172.21.15.49:0/998366122 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dde08e8f20 0x55dde08e9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.905+0000 7f1adaffd700 1 -- 172.21.15.49:0/998366122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dde08eef60 msgr2=0x55dde08e89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:19.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.905+0000 7f1adaffd700 1 --2- 172.21.15.49:0/998366122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dde08eef60 0x55dde08e89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.905+0000 7f1adaffd700 1 -- 172.21.15.49:0/998366122 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dde08e8f20 msgr2=0x55dde08e9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:19.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.905+0000 7f1adaffd700 1 --2- 172.21.15.49:0/998366122 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dde08e8f20 0x55dde08e9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.905+0000 7f1adaffd700 1 -- 172.21.15.49:0/998366122 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dde07d8f50 con 0x55dde08ee640 2024-06-03T00:01:19.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.905+0000 7f1adaffd700 1 --2- 172.21.15.49:0/998366122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dde08ee640 0x55dde08eea20 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1acc018770 tx=0x7f1acc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f21bb95f2be2fcf0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:19.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.905+0000 7f1ad17fa700 1 -- 172.21.15.49:0/998366122 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1acc026070 con 0x55dde08ee640 2024-06-03T00:01:19.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.905+0000 7f1ad17fa700 1 -- 172.21.15.49:0/998366122 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1acc018bb0 con 0x55dde08ee640 2024-06-03T00:01:19.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.905+0000 7f1ad17fa700 1 -- 172.21.15.49:0/998366122 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1acc016450 con 0x55dde08ee640 2024-06-03T00:01:19.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.906+0000 7f1aebec8b80 1 -- 172.21.15.49:0/998366122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dde08ee640 msgr2=0x55dde08eea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.906+0000 7f1aebec8b80 1 --2- 172.21.15.49:0/998366122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dde08ee640 0x55dde08eea20 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1acc018770 tx=0x7f1acc011000 comp rx=0 tx=0).stop 2024-06-03T00:01:19.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.906+0000 7f1aebec8b80 1 -- 172.21.15.49:0/998366122 shutdown_connections 2024-06-03T00:01:19.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.906+0000 7f1aebec8b80 1 --2- 172.21.15.49:0/998366122 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dde08e8f20 0x55dde08e9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.906+0000 7f1aebec8b80 1 --2- 172.21.15.49:0/998366122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dde08ee640 0x55dde08eea20 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.906+0000 7f1aebec8b80 1 --2- 172.21.15.49:0/998366122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dde08eef60 0x55dde08e89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.906+0000 7f1aebec8b80 1 -- 172.21.15.49:0/998366122 >> 172.21.15.49:0/998366122 conn(0x55dde0813cc0 msgr2=0x55dde08e3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:19.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.906+0000 7f1aebec8b80 1 -- 172.21.15.49:0/998366122 shutdown_connections 2024-06-03T00:01:19.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.906+0000 7f1aebec8b80 1 -- 172.21.15.49:0/998366122 wait complete. 2024-06-03T00:01:19.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.906+0000 7f1aebec8b80 1 -- start start 2024-06-03T00:01:19.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.907+0000 7f1aebec8b80 1 Processor -- start 2024-06-03T00:01:19.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.907+0000 7f1aebec8b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dde08e8f20 0x55dde08f4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.907+0000 7f1aebec8b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dde08ee640 0x55dde08f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.907+0000 7f1aebec8b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dde08eef60 0x55dde08f2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.907+0000 7f1aebec8b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55dde08f59d0 con 0x55dde08e8f20 2024-06-03T00:01:19.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.907+0000 7f1aebec8b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55dde07dabf0 con 0x55dde08eef60 2024-06-03T00:01:19.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.907+0000 7f1aebec8b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55dde08f5b50 con 0x55dde08ee640 2024-06-03T00:01:19.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.907+0000 7f1aebec8b80 10 client.0 _ll_register_callbacks cb 0x55dde07d4920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:19.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.907+0000 7f1adaffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dde08e8f20 0x55dde08f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.907+0000 7f1adaffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dde08e8f20 0x55dde08f4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39800/0 (socket says 172.21.15.49:39800) 2024-06-03T00:01:19.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.907+0000 7f1adaffd700 1 -- 172.21.15.49:0/4232169091 learned_addr learned my addr 172.21.15.49:0/4232169091 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:19.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.907+0000 7f1ada7fc700 1 --2- 172.21.15.49:0/4232169091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dde08ee640 0x55dde08f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.907+0000 7f1adb7fe700 1 --2- 172.21.15.49:0/4232169091 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dde08eef60 0x55dde08f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.907+0000 7f1adaffd700 1 -- 172.21.15.49:0/4232169091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dde08ee640 msgr2=0x55dde08f1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:19.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.907+0000 7f1adaffd700 1 --2- 172.21.15.49:0/4232169091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dde08ee640 0x55dde08f1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.907+0000 7f1adaffd700 1 -- 172.21.15.49:0/4232169091 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dde08eef60 msgr2=0x55dde08f2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:19.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.907+0000 7f1adaffd700 1 --2- 172.21.15.49:0/4232169091 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dde08eef60 0x55dde08f2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.907+0000 7f1adaffd700 1 -- 172.21.15.49:0/4232169091 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dde07898d0 con 0x55dde08e8f20 2024-06-03T00:01:19.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.908+0000 7f1adaffd700 1 --2- 172.21.15.49:0/4232169091 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dde08e8f20 0x55dde08f4cd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1acc018f90 tx=0x7f1acc021a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce6732a278f2ace server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:19.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.908+0000 7f1ac27fc700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:01:19.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.908+0000 7f1ac27fc700 1 -- 172.21.15.49:0/4232169091 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1acc026070 con 0x55dde08e8f20 2024-06-03T00:01:19.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.908+0000 7f1ac27fc700 1 -- 172.21.15.49:0/4232169091 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f1acc021410 con 0x55dde08e8f20 2024-06-03T00:01:19.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.908+0000 7f1aebec8b80 1 -- 172.21.15.49:0/4232169091 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1acc018bb0 con 0x55dde08e8f20 2024-06-03T00:01:19.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.908+0000 7f1ac27fc700 1 -- 172.21.15.49:0/4232169091 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1acc021610 con 0x55dde08e8f20 2024-06-03T00:01:19.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.908+0000 7f1aebec8b80 10 client.15489 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:19.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.908+0000 7f1aebec8b80 1 -- 172.21.15.49:0/4232169091 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55dde09002d0 con 0x55dde08e8f20 2024-06-03T00:01:19.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.908+0000 7f1ac27fc700 1 -- 172.21.15.49:0/4232169091 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1acc018bb0 con 0x55dde08e8f20 2024-06-03T00:01:19.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.908+0000 7f1ac27fc700 1 -- 172.21.15.49:0/4232169091 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f1acc032030 con 0x55dde08e8f20 2024-06-03T00:01:19.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.908+0000 7f1aebec8b80 10 client.15489 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:19.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.908+0000 7f1aebec8b80 10 client.15489 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-03T00:01:19.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.908+0000 7f1aebec8b80 20 client.15489 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:19.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.908+0000 7f1aebec8b80 1 --2- 172.21.15.49:0/4232169091 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55dde09028b0 0x55dde0904ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.908+0000 7f1aebec8b80 4 client.15489 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:01:19.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.908+0000 7f1aebec8b80 1 -- 172.21.15.49:0/4232169091 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dde0847d10 con 0x55dde09028b0 2024-06-03T00:01:19.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.909+0000 7f1ada7fc700 1 --2- 172.21.15.49:0/4232169091 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55dde09028b0 0x55dde0904ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.909+0000 7f1ac27fc700 10 client.15489 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:19.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.909+0000 7f1ada7fc700 1 --2- 172.21.15.49:0/4232169091 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55dde09028b0 0x55dde0904ca0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12d548059581f70f server_cookie=8ecff4dbb26b77fb in_seq=0 out_seq=0 2024-06-03T00:01:19.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.910+0000 7f1ac27fc700 1 -- 172.21.15.49:0/4232169091 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55dde0847d10 con 0x55dde09028b0 2024-06-03T00:01:19.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.910+0000 7f1ac27fc700 10 client.15489 handle_command_reply: tid=0 2024-06-03T00:01:19.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.910+0000 7f1aebec8b80 1 client.15489 shutdown 2024-06-03T00:01:19.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.910+0000 7f1aebec8b80 1 -- 172.21.15.49:0/4232169091 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dde08e8f20 msgr2=0x55dde08f4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.910+0000 7f1aebec8b80 1 --2- 172.21.15.49:0/4232169091 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dde08e8f20 0x55dde08f4cd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1acc018f90 tx=0x7f1acc021a70 comp rx=0 tx=0).stop 2024-06-03T00:01:19.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.910+0000 7f1aebec8b80 1 -- 172.21.15.49:0/4232169091 shutdown_connections 2024-06-03T00:01:19.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.910+0000 7f1aebec8b80 1 --2- 172.21.15.49:0/4232169091 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dde08eef60 0x55dde08f2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.910+0000 7f1aebec8b80 1 --2- 172.21.15.49:0/4232169091 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55dde09028b0 0x55dde0904ca0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.910+0000 7f1aebec8b80 1 --2- 172.21.15.49:0/4232169091 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dde08e8f20 0x55dde08f4cd0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.910+0000 7f1aebec8b80 1 --2- 172.21.15.49:0/4232169091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dde08ee640 0x55dde08f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.910+0000 7f1aebec8b80 1 -- 172.21.15.49:0/4232169091 >> 172.21.15.49:0/4232169091 conn(0x55dde0813cc0 msgr2=0x55dde08e35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:19.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.910+0000 7f1ac27fc700 0 client.15489 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:19.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.910+0000 7f1aebec8b80 1 -- 172.21.15.49:0/4232169091 shutdown_connections 2024-06-03T00:01:19.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.910+0000 7f1aebec8b80 1 -- 172.21.15.49:0/4232169091 wait complete. 2024-06-03T00:01:19.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.911+0000 7f1aebec8b80 20 client.15489 trim_cache size 0 max 16384 2024-06-03T00:01:19.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.931+0000 7f1aebec8b80 1 Processor -- start 2024-06-03T00:01:19.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.931+0000 7f1aebec8b80 1 -- start start 2024-06-03T00:01:19.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.932+0000 7f1aebec8b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dde08e8f20 0x55dde08e89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.932+0000 7f1aebec8b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dde08ee640 0x55dde08efbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.932+0000 7f1aebec8b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dde08eef60 0x55dde08dd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.932+0000 7f1aebec8b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc1acc90 con 0x55dde08eef60 2024-06-03T00:01:19.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.932+0000 7f1aebec8b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc1ae7d0 con 0x55dde08e8f20 2024-06-03T00:01:19.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.932+0000 7f1aebec8b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc1ad360 con 0x55dde08ee640 2024-06-03T00:01:19.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.932+0000 7f1adb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dde08eef60 0x55dde08dd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.932+0000 7f1adb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dde08eef60 0x55dde08dd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39802/0 (socket says 172.21.15.49:39802) 2024-06-03T00:01:19.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.932+0000 7f1adb7fe700 1 -- 172.21.15.49:0/2839187993 learned_addr learned my addr 172.21.15.49:0/2839187993 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:19.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.932+0000 7f1adaffd700 1 --2- 172.21.15.49:0/2839187993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dde08e8f20 0x55dde08e89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.932+0000 7f1ada7fc700 1 --2- 172.21.15.49:0/2839187993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dde08ee640 0x55dde08efbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.932+0000 7f1adb7fe700 1 -- 172.21.15.49:0/2839187993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dde08ee640 msgr2=0x55dde08efbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:19.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.932+0000 7f1adb7fe700 1 --2- 172.21.15.49:0/2839187993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dde08ee640 0x55dde08efbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.932+0000 7f1adb7fe700 1 -- 172.21.15.49:0/2839187993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dde08e8f20 msgr2=0x55dde08e89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:19.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.932+0000 7f1adb7fe700 1 --2- 172.21.15.49:0/2839187993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dde08e8f20 0x55dde08e89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.932+0000 7f1adb7fe700 1 -- 172.21.15.49:0/2839187993 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dde08f0560 con 0x55dde08eef60 2024-06-03T00:01:19.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.932+0000 7f1adb7fe700 1 --2- 172.21.15.49:0/2839187993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dde08eef60 0x55dde08dd510 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1ad400b8a0 tx=0x7f1ad400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa5a0b4571cfa586 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:19.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.932+0000 7f1ad0ff9700 1 -- 172.21.15.49:0/2839187993 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4019030 con 0x55dde08eef60 2024-06-03T00:01:19.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.933+0000 7f1ad0ff9700 1 -- 172.21.15.49:0/2839187993 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ad4012ab0 con 0x55dde08eef60 2024-06-03T00:01:19.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.933+0000 7f1ad0ff9700 1 -- 172.21.15.49:0/2839187993 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4015aa0 con 0x55dde08eef60 2024-06-03T00:01:19.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.933+0000 7f1aebec8b80 1 -- 172.21.15.49:0/2839187993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dde08eef60 msgr2=0x55dde08dd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.933+0000 7f1aebec8b80 1 --2- 172.21.15.49:0/2839187993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dde08eef60 0x55dde08dd510 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1ad400b8a0 tx=0x7f1ad400bbb0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.933+0000 7f1aebec8b80 1 -- 172.21.15.49:0/2839187993 shutdown_connections 2024-06-03T00:01:19.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.933+0000 7f1aebec8b80 1 --2- 172.21.15.49:0/2839187993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dde08eef60 0x55dde08dd510 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.933+0000 7f1aebec8b80 1 --2- 172.21.15.49:0/2839187993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dde08e8f20 0x55dde08e89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.933+0000 7f1aebec8b80 1 --2- 172.21.15.49:0/2839187993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dde08ee640 0x55dde08efbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.933+0000 7f1aebec8b80 1 -- 172.21.15.49:0/2839187993 >> 172.21.15.49:0/2839187993 conn(0x55dde0813cc0 msgr2=0x55dde08dce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:19.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.933+0000 7f1aebec8b80 1 -- 172.21.15.49:0/2839187993 shutdown_connections 2024-06-03T00:01:19.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.933+0000 7f1aebec8b80 1 -- 172.21.15.49:0/2839187993 wait complete. 2024-06-03T00:01:19.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.934+0000 7f1aebec8b80 1 -- start start 2024-06-03T00:01:19.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.934+0000 7f1aebec8b80 1 Processor -- start 2024-06-03T00:01:19.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.934+0000 7f1aebec8b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dde08e8f20 0x55dde0969a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.934+0000 7f1aebec8b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dde08ee640 0x55dde0969f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.934+0000 7f1aebec8b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dde08eef60 0x55dde0963e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.934+0000 7f1aebec8b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc1ae100 con 0x55dde08e8f20 2024-06-03T00:01:19.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.934+0000 7f1aebec8b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc1ada30 con 0x55dde08eef60 2024-06-03T00:01:19.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.934+0000 7f1aebec8b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc1aac10 con 0x55dde08ee640 2024-06-03T00:01:19.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.934+0000 7f1aebec8b80 10 client.0 _ll_register_callbacks cb 0x55dde07d4920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:19.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.934+0000 7f1adaffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dde08e8f20 0x55dde0969a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.934+0000 7f1adaffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dde08e8f20 0x55dde0969a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39806/0 (socket says 172.21.15.49:39806) 2024-06-03T00:01:19.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.934+0000 7f1adaffd700 1 -- 172.21.15.49:0/1957165490 learned_addr learned my addr 172.21.15.49:0/1957165490 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:19.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.934+0000 7f1adb7fe700 1 --2- 172.21.15.49:0/1957165490 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dde08eef60 0x55dde0963e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.934+0000 7f1ada7fc700 1 --2- 172.21.15.49:0/1957165490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dde08ee640 0x55dde0969f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.934+0000 7f1adaffd700 1 -- 172.21.15.49:0/1957165490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dde08ee640 msgr2=0x55dde0969f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:19.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.934+0000 7f1adaffd700 1 --2- 172.21.15.49:0/1957165490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dde08ee640 0x55dde0969f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.934+0000 7f1adaffd700 1 -- 172.21.15.49:0/1957165490 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dde08eef60 msgr2=0x55dde0963e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:19.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.934+0000 7f1adaffd700 1 --2- 172.21.15.49:0/1957165490 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dde08eef60 0x55dde0963e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.934+0000 7f1adaffd700 1 -- 172.21.15.49:0/1957165490 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dde0964550 con 0x55dde08e8f20 2024-06-03T00:01:19.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.934+0000 7f1ada7fc700 1 --2- 172.21.15.49:0/1957165490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dde08ee640 0x55dde0969f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:01:19.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.935+0000 7f1adaffd700 1 --2- 172.21.15.49:0/1957165490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dde08e8f20 0x55dde0969a30 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1acc035ee0 tx=0x7f1acc018c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d7694b2128247c server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:19.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.935+0000 7f1ac27fc700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:01:19.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.935+0000 7f1ac27fc700 1 -- 172.21.15.49:0/1957165490 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1acc026070 con 0x55dde08e8f20 2024-06-03T00:01:19.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.935+0000 7f1aebec8b80 1 -- 172.21.15.49:0/1957165490 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ad4012ab0 con 0x55dde08e8f20 2024-06-03T00:01:19.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.935+0000 7f1ac27fc700 1 -- 172.21.15.49:0/1957165490 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f1acc02a580 con 0x55dde08e8f20 2024-06-03T00:01:19.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.935+0000 7f1ac27fc700 1 -- 172.21.15.49:0/1957165490 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1acc021ae0 con 0x55dde08e8f20 2024-06-03T00:01:19.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.935+0000 7f1aebec8b80 10 client.15495 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:19.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.935+0000 7f1aebec8b80 1 -- 172.21.15.49:0/1957165490 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55dde0971270 con 0x55dde08e8f20 2024-06-03T00:01:19.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.935+0000 7f1ac27fc700 1 -- 172.21.15.49:0/1957165490 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ad4012ab0 con 0x55dde08e8f20 2024-06-03T00:01:19.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.935+0000 7f1ac27fc700 1 -- 172.21.15.49:0/1957165490 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f1acc032040 con 0x55dde08e8f20 2024-06-03T00:01:19.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.935+0000 7f1aebec8b80 10 client.15495 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:19.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.935+0000 7f1aebec8b80 10 client.15495 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-03T00:01:19.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.935+0000 7f1aebec8b80 20 client.15495 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:19.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.935+0000 7f1aebec8b80 1 --2- 172.21.15.49:0/1957165490 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55dde09718c0 0x55dde0973ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.935+0000 7f1aebec8b80 4 client.15495 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-03T00:01:19.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.935+0000 7f1aebec8b80 1 -- 172.21.15.49:0/1957165490 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dde0842290 con 0x55dde09718c0 2024-06-03T00:01:19.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.936+0000 7f1ada7fc700 1 --2- 172.21.15.49:0/1957165490 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55dde09718c0 0x55dde0973ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.936+0000 7f1ada7fc700 1 --2- 172.21.15.49:0/1957165490 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55dde09718c0 0x55dde0973ce0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8db3117197b27c33 server_cookie=1e1e4ad7b50e8afc in_seq=0 out_seq=0 2024-06-03T00:01:19.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.936+0000 7f1ac27fc700 10 client.15495 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:19.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.936+0000 7f1ac27fc700 1 -- 172.21.15.49:0/1957165490 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55dde0842290 con 0x55dde09718c0 2024-06-03T00:01:19.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.936+0000 7f1ac27fc700 10 client.15495 handle_command_reply: tid=0 2024-06-03T00:01:19.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.936+0000 7f1aebec8b80 1 client.15495 shutdown 2024-06-03T00:01:19.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.936+0000 7f1aebec8b80 1 -- 172.21.15.49:0/1957165490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dde08e8f20 msgr2=0x55dde0969a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.936+0000 7f1aebec8b80 1 --2- 172.21.15.49:0/1957165490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dde08e8f20 0x55dde0969a30 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1acc035ee0 tx=0x7f1acc018c60 comp rx=0 tx=0).stop 2024-06-03T00:01:19.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.936+0000 7f1aebec8b80 1 -- 172.21.15.49:0/1957165490 shutdown_connections 2024-06-03T00:01:19.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.937+0000 7f1aebec8b80 1 --2- 172.21.15.49:0/1957165490 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dde08eef60 0x55dde0963e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.937+0000 7f1aebec8b80 1 --2- 172.21.15.49:0/1957165490 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55dde09718c0 0x55dde0973ce0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.937+0000 7f1aebec8b80 1 --2- 172.21.15.49:0/1957165490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dde08e8f20 0x55dde0969a30 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.937+0000 7f1aebec8b80 1 --2- 172.21.15.49:0/1957165490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dde08ee640 0x55dde0969f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.937+0000 7f1aebec8b80 1 -- 172.21.15.49:0/1957165490 >> 172.21.15.49:0/1957165490 conn(0x55dde0813cc0 msgr2=0x55dde08f3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:19.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.937+0000 7f1ac27fc700 0 client.15495 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:19.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.937+0000 7f1aebec8b80 1 -- 172.21.15.49:0/1957165490 shutdown_connections 2024-06-03T00:01:19.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.937+0000 7f1aebec8b80 1 -- 172.21.15.49:0/1957165490 wait complete. 2024-06-03T00:01:19.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.937+0000 7f1aebec8b80 20 client.15495 trim_cache size 0 max 16384 2024-06-03T00:01:19.943 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:01:19.943 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "no active scrubs running", 2024-06-03T00:01:19.943 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {} 2024-06-03T00:01:19.943 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:01:19.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.937+0000 7f1ae1645700 1 -- 172.21.15.49:0/1365750208 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1ac80a2c20 msgr2=0x7f1ac80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.937+0000 7f1ae1645700 1 --2- 172.21.15.49:0/1365750208 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1ac80a2c20 0x7f1ac80a50e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1acc0060b0 tx=0x7f1acc007790 comp rx=0 tx=0).stop 2024-06-03T00:01:19.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.937+0000 7f1ae1645700 1 -- 172.21.15.49:0/1365750208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1adc101d50 msgr2=0x7f1adc19a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.937+0000 7f1ae1645700 1 --2- 172.21.15.49:0/1365750208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1adc101d50 0x7f1adc19a0d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400bff0 tx=0x7f1ac4005640 comp rx=0 tx=0).stop 2024-06-03T00:01:19.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.937+0000 7f1ae1645700 1 -- 172.21.15.49:0/1365750208 shutdown_connections 2024-06-03T00:01:19.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.937+0000 7f1ae1645700 1 --2- 172.21.15.49:0/1365750208 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1ac80a2c20 0x7f1ac80a50e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.937+0000 7f1ae1645700 1 --2- 172.21.15.49:0/1365750208 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1adc107400 0x7f1adc1a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.937+0000 7f1ae1645700 1 --2- 172.21.15.49:0/1365750208 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1adc101390 0x7f1adc199b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.937+0000 7f1ae1645700 1 --2- 172.21.15.49:0/1365750208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1adc101d50 0x7f1adc19a0d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.937+0000 7f1ae1645700 1 -- 172.21.15.49:0/1365750208 >> 172.21.15.49:0/1365750208 conn(0x7f1adc078340 msgr2=0x7f1adc0ffea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:19.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.937+0000 7f1ae1645700 1 -- 172.21.15.49:0/1365750208 shutdown_connections 2024-06-03T00:01:19.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:19.938+0000 7f1ae1645700 1 -- 172.21.15.49:0/1365750208 wait complete. 2024-06-03T00:01:20.691 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:20 smithi049 ceph-mon[32302]: pgmap v422: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-06-03T00:01:20.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:20 smithi057 ceph-mon[36457]: pgmap v422: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-06-03T00:01:20.721 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-03T00:01:20.722 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-03T00:01:20.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:20 smithi107 ceph-mon[37048]: pgmap v422: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-06-03T00:01:20.976 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:01:22.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.623+0000 7fbad78d0700 1 -- 172.21.15.49:0/1987955756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbad0103120 msgr2=0x7fbad0107130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:22.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.623+0000 7fbad78d0700 1 --2- 172.21.15.49:0/1987955756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbad0103120 0x7fbad0107130 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fbac00099c0 tx=0x7fbac0009cd0 comp rx=0 tx=0).stop 2024-06-03T00:01:22.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.623+0000 7fbad78d0700 1 -- 172.21.15.49:0/1987955756 shutdown_connections 2024-06-03T00:01:22.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.623+0000 7fbad78d0700 1 --2- 172.21.15.49:0/1987955756 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbad0107860 0x7fbad010f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:22.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.623+0000 7fbad78d0700 1 --2- 172.21.15.49:0/1987955756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbad0102770 0x7fbad0102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:22.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.623+0000 7fbad78d0700 1 --2- 172.21.15.49:0/1987955756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbad0103120 0x7fbad0107130 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:22.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.623+0000 7fbad78d0700 1 -- 172.21.15.49:0/1987955756 >> 172.21.15.49:0/1987955756 conn(0x7fbad0079600 msgr2=0x7fbad0079a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:22.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.623+0000 7fbad78d0700 1 -- 172.21.15.49:0/1987955756 shutdown_connections 2024-06-03T00:01:22.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.623+0000 7fbad78d0700 1 -- 172.21.15.49:0/1987955756 wait complete. 2024-06-03T00:01:22.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.623+0000 7fbad78d0700 1 Processor -- start 2024-06-03T00:01:22.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.623+0000 7fbad78d0700 1 -- start start 2024-06-03T00:01:22.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.624+0000 7fbad78d0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbad0102770 0x7fbad019e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:22.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.624+0000 7fbad78d0700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbad0103120 0x7fbad019ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:22.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.624+0000 7fbad78d0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbad0107860 0x7fbad01989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:22.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.624+0000 7fbad78d0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbad0112790 con 0x7fbad0107860 2024-06-03T00:01:22.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.624+0000 7fbad78d0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fbad0112610 con 0x7fbad0102770 2024-06-03T00:01:22.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.624+0000 7fbad78d0700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbad0112910 con 0x7fbad0103120 2024-06-03T00:01:22.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.624+0000 7fbad5e6d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbad0107860 0x7fbad01989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:22.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.624+0000 7fbad5e6d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbad0107860 0x7fbad01989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39812/0 (socket says 172.21.15.49:39812) 2024-06-03T00:01:22.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.624+0000 7fbad5e6d700 1 -- 172.21.15.49:0/2550718856 learned_addr learned my addr 172.21.15.49:0/2550718856 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:22.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.624+0000 7fbad4e6b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbad0103120 0x7fbad019ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:22.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.624+0000 7fbad566c700 1 --2- 172.21.15.49:0/2550718856 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbad0102770 0x7fbad019e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:22.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.624+0000 7fbad5e6d700 1 -- 172.21.15.49:0/2550718856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbad0103120 msgr2=0x7fbad019ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:22.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.624+0000 7fbad5e6d700 1 --2- 172.21.15.49:0/2550718856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbad0103120 0x7fbad019ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:22.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.624+0000 7fbad5e6d700 1 -- 172.21.15.49:0/2550718856 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbad0102770 msgr2=0x7fbad019e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:22.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.624+0000 7fbad5e6d700 1 --2- 172.21.15.49:0/2550718856 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbad0102770 0x7fbad019e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:22.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.624+0000 7fbad5e6d700 1 -- 172.21.15.49:0/2550718856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad0199150 con 0x7fbad0107860 2024-06-03T00:01:22.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.624+0000 7fbad5e6d700 1 --2- 172.21.15.49:0/2550718856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbad0107860 0x7fbad01989f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fbac8007ee0 tx=0x7fbac800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:22.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.625+0000 7fbac67fc700 1 -- 172.21.15.49:0/2550718856 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac8004bb0 con 0x7fbad0107860 2024-06-03T00:01:22.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.625+0000 7fbad78d0700 1 -- 172.21.15.49:0/2550718856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbad0199440 con 0x7fbad0107860 2024-06-03T00:01:22.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.625+0000 7fbac67fc700 1 -- 172.21.15.49:0/2550718856 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbac8004d50 con 0x7fbad0107860 2024-06-03T00:01:22.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.625+0000 7fbac67fc700 1 -- 172.21.15.49:0/2550718856 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac8005960 con 0x7fbad0107860 2024-06-03T00:01:22.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.625+0000 7fbad78d0700 1 -- 172.21.15.49:0/2550718856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbad01a56b0 con 0x7fbad0107860 2024-06-03T00:01:22.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.626+0000 7fbad78d0700 1 -- 172.21.15.49:0/2550718856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbad0069180 con 0x7fbad0107860 2024-06-03T00:01:22.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.627+0000 7fbac67fc700 1 -- 172.21.15.49:0/2550718856 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbac801a020 con 0x7fbad0107860 2024-06-03T00:01:22.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.628+0000 7fbac67fc700 1 --2- 172.21.15.49:0/2550718856 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbabc0a2c20 0x7fbabc0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:22.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.628+0000 7fbad566c700 1 --2- 172.21.15.49:0/2550718856 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbabc0a2c20 0x7fbabc0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:22.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.628+0000 7fbac67fc700 1 -- 172.21.15.49:0/2550718856 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fbac80cee30 con 0x7fbad0107860 2024-06-03T00:01:22.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.628+0000 7fbad566c700 1 --2- 172.21.15.49:0/2550718856 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbabc0a2c20 0x7fbabc0a50e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbad0107460 tx=0x7fbacc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:22.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.631+0000 7fbac67fc700 1 -- 172.21.15.49:0/2550718856 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fbac8010070 con 0x7fbad0107860 2024-06-03T00:01:22.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:22 smithi057 ceph-mon[36457]: pgmap v423: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-06-03T00:01:22.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:22 smithi049 ceph-mon[32302]: pgmap v423: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-06-03T00:01:22.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:22 smithi107 ceph-mon[37048]: pgmap v423: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-06-03T00:01:22.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.883+0000 7fbad78d0700 1 -- 172.21.15.49:0/2550718856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbad0199ed0 con 0x7fbad0107860 2024-06-03T00:01:22.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.884+0000 7fbac67fc700 1 -- 172.21.15.49:0/2550718856 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11929 (secure 0 0 0) 0x7fbac809bd90 con 0x7fbad0107860 2024-06-03T00:01:22.885 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:01:22.885 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1553264866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1553264866},{"type":"v1","addr":"172.21.15.49:6835","nonce":1553264866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2266285252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2266285252},{"type":"v1","addr":"172.21.15.49:6837","nonce":2266285252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T23:57:16.991201+0000","modified":"2024-06-03T00:00:26.305285+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24485,"mds_2":24466,"mds_3":24464,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6839/1729124617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":1729124617},{"type":"v1","addr":"172.21.15.49:6839","nonce":1729124617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6841/1902772235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":1902772235},{"type":"v1","addr":"172.21.15.49:6841","nonce":1902772235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6833/1633534002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1633534002},{"type":"v1","addr":"172.21.15.57:6833","nonce":1633534002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6835/2254905671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2254905671},{"type":"v1","addr":"172.21.15.57:6835","nonce":2254905671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.107:6835/3693542801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3693542801},{"type":"v1","addr":"172.21.15.107:6835","nonce":3693542801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.57:6837/230452144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":230452144},{"type":"v1","addr":"172.21.15.57:6837","nonce":230452144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.107:6837/3700593315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":3700593315},{"type":"v1","addr":"172.21.15.107:6837","nonce":3700593315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6839/249825195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":249825195},{"type":"v1","addr":"172.21.15.57:6839","nonce":249825195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6839/1986600681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1986600681},{"type":"v1","addr":"172.21.15.107:6839","nonce":1986600681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24485,24464,24460,24466,24487]},"id":1}]} 2024-06-03T00:01:22.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.886+0000 7fbad78d0700 1 -- 172.21.15.49:0/2550718856 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbabc0a2c20 msgr2=0x7fbabc0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:22.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.886+0000 7fbad78d0700 1 --2- 172.21.15.49:0/2550718856 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbabc0a2c20 0x7fbabc0a50e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbad0107460 tx=0x7fbacc00b410 comp rx=0 tx=0).stop 2024-06-03T00:01:22.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.886+0000 7fbad78d0700 1 -- 172.21.15.49:0/2550718856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbad0107860 msgr2=0x7fbad01989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:22.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.886+0000 7fbad78d0700 1 --2- 172.21.15.49:0/2550718856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbad0107860 0x7fbad01989f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fbac8007ee0 tx=0x7fbac800d3b0 comp rx=0 tx=0).stop 2024-06-03T00:01:22.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.886+0000 7fbad78d0700 1 -- 172.21.15.49:0/2550718856 shutdown_connections 2024-06-03T00:01:22.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.886+0000 7fbad78d0700 1 --2- 172.21.15.49:0/2550718856 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbabc0a2c20 0x7fbabc0a50e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:22.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.886+0000 7fbad78d0700 1 --2- 172.21.15.49:0/2550718856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbad0107860 0x7fbad01989f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:22.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.886+0000 7fbad78d0700 1 --2- 172.21.15.49:0/2550718856 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbad0102770 0x7fbad019e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:22.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.886+0000 7fbad78d0700 1 --2- 172.21.15.49:0/2550718856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbad0103120 0x7fbad019ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:22.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.886+0000 7fbad78d0700 1 -- 172.21.15.49:0/2550718856 >> 172.21.15.49:0/2550718856 conn(0x7fbad0079600 msgr2=0x7fbad0100560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:22.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.886+0000 7fbad78d0700 1 -- 172.21.15.49:0/2550718856 shutdown_connections 2024-06-03T00:01:22.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:22.886+0000 7fbad78d0700 1 -- 172.21.15.49:0/2550718856 wait complete. 2024-06-03T00:01:22.887 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 27 2024-06-03T00:01:23.489 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:23 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/2550718856' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:01:23.520 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-06-03T00:01:23.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:23 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/2550718856' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:01:23.774 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:01:23.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:23 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/2550718856' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:01:24.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:24 smithi049 ceph-mon[32302]: pgmap v424: 97 pgs: 97 active+clean; 661 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:01:24.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:24 smithi057 ceph-mon[36457]: pgmap v424: 97 pgs: 97 active+clean; 661 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:01:24.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:24 smithi107 ceph-mon[37048]: pgmap v424: 97 pgs: 97 active+clean; 661 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:01:25.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.478+0000 7ff9df0cd700 1 -- 172.21.15.49:0/1839347709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9d8102740 msgr2=0x7ff9d8102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:25.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.478+0000 7ff9df0cd700 1 --2- 172.21.15.49:0/1839347709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9d8102740 0x7ff9d8102b20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc0099c0 tx=0x7ff9cc009cd0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.478+0000 7ff9df0cd700 1 -- 172.21.15.49:0/1839347709 shutdown_connections 2024-06-03T00:01:25.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.478+0000 7ff9df0cd700 1 --2- 172.21.15.49:0/1839347709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9d8107840 0x7ff9d810f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.478+0000 7ff9df0cd700 1 --2- 172.21.15.49:0/1839347709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9d8102740 0x7ff9d8102b20 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.478+0000 7ff9df0cd700 1 --2- 172.21.15.49:0/1839347709 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9d81030f0 0x7ff9d8107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.478+0000 7ff9df0cd700 1 -- 172.21.15.49:0/1839347709 >> 172.21.15.49:0/1839347709 conn(0x7ff9d80795f0 msgr2=0x7ff9d8079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:25.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.478+0000 7ff9df0cd700 1 -- 172.21.15.49:0/1839347709 shutdown_connections 2024-06-03T00:01:25.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.478+0000 7ff9df0cd700 1 -- 172.21.15.49:0/1839347709 wait complete. 2024-06-03T00:01:25.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.479+0000 7ff9df0cd700 1 Processor -- start 2024-06-03T00:01:25.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.479+0000 7ff9df0cd700 1 -- start start 2024-06-03T00:01:25.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.479+0000 7ff9df0cd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9d8102740 0x7ff9d8074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:25.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.479+0000 7ff9df0cd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9d81030f0 0x7ff9d8074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:25.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.479+0000 7ff9df0cd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9d8107840 0x7ff9d8075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:25.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.479+0000 7ff9df0cd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d8112760 con 0x7ff9d8107840 2024-06-03T00:01:25.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.479+0000 7ff9df0cd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d81125e0 con 0x7ff9d8102740 2024-06-03T00:01:25.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.479+0000 7ff9df0cd700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d81128e0 con 0x7ff9d81030f0 2024-06-03T00:01:25.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.479+0000 7ff9dd66a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9d8107840 0x7ff9d8075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:25.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.479+0000 7ff9dd66a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9d8107840 0x7ff9d8075210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48940/0 (socket says 172.21.15.49:48940) 2024-06-03T00:01:25.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.479+0000 7ff9dd66a700 1 -- 172.21.15.49:0/2655707497 learned_addr learned my addr 172.21.15.49:0/2655707497 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:25.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.479+0000 7ff9dce69700 1 --2- 172.21.15.49:0/2655707497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9d8102740 0x7ff9d8074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:25.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.479+0000 7ff9d7fff700 1 --2- 172.21.15.49:0/2655707497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9d81030f0 0x7ff9d8074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:25.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.479+0000 7ff9dd66a700 1 -- 172.21.15.49:0/2655707497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9d81030f0 msgr2=0x7ff9d8074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:25.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.479+0000 7ff9dd66a700 1 --2- 172.21.15.49:0/2655707497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9d81030f0 0x7ff9d8074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.479+0000 7ff9dd66a700 1 -- 172.21.15.49:0/2655707497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9d8102740 msgr2=0x7ff9d8074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:25.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.479+0000 7ff9dd66a700 1 --2- 172.21.15.49:0/2655707497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9d8102740 0x7ff9d8074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.479+0000 7ff9dd66a700 1 -- 172.21.15.49:0/2655707497 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d81a7050 con 0x7ff9d8107840 2024-06-03T00:01:25.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.480+0000 7ff9dd66a700 1 --2- 172.21.15.49:0/2655707497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9d8107840 0x7ff9d8075210 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000ada0 tx=0x7ff9d000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:25.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.480+0000 7ff9d5ffb700 1 -- 172.21.15.49:0/2655707497 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0017020 con 0x7ff9d8107840 2024-06-03T00:01:25.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.480+0000 7ff9df0cd700 1 -- 172.21.15.49:0/2655707497 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9d81a7340 con 0x7ff9d8107840 2024-06-03T00:01:25.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.480+0000 7ff9d5ffb700 1 -- 172.21.15.49:0/2655707497 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9d000cdb0 con 0x7ff9d8107840 2024-06-03T00:01:25.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.480+0000 7ff9d5ffb700 1 -- 172.21.15.49:0/2655707497 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d00053e0 con 0x7ff9d8107840 2024-06-03T00:01:25.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.480+0000 7ff9df0cd700 1 -- 172.21.15.49:0/2655707497 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9d81a7880 con 0x7ff9d8107840 2024-06-03T00:01:25.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.482+0000 7ff9d5ffb700 1 -- 172.21.15.49:0/2655707497 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff9d000c8d0 con 0x7ff9d8107840 2024-06-03T00:01:25.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.483+0000 7ff9d5ffb700 1 --2- 172.21.15.49:0/2655707497 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff9c80a2ca0 0x7ff9c80a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:25.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.483+0000 7ff9d5ffb700 1 -- 172.21.15.49:0/2655707497 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7ff9d00ce680 con 0x7ff9d8107840 2024-06-03T00:01:25.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.483+0000 7ff9dce69700 1 --2- 172.21.15.49:0/2655707497 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff9c80a2ca0 0x7ff9c80a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:25.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.484+0000 7ff9dce69700 1 --2- 172.21.15.49:0/2655707497 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff9c80a2ca0 0x7ff9c80a5160 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc009fd0 tx=0x7ff9cc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:25.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.484+0000 7ff9e9950b80 1 Processor -- start 2024-06-03T00:01:25.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.484+0000 7ff9e9950b80 1 -- start start 2024-06-03T00:01:25.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.484+0000 7ff9e9950b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562a6a3b7f60 0x562a6a3b8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:25.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.484+0000 7ff9e9950b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a6a3b8880 0x562a6a3b2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:25.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.484+0000 7ff9e9950b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a6a3b27a0 0x562a6a3b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:25.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.484+0000 7ff9e9950b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562a6a2a4f60 con 0x562a6a3b8880 2024-06-03T00:01:25.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.484+0000 7ff9e9950b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x562a6a303850 con 0x562a6a3b7f60 2024-06-03T00:01:25.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.484+0000 7ff9e9950b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x562a6a26b460 con 0x562a6a3b27a0 2024-06-03T00:01:25.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.484+0000 7ff9d7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a6a3b8880 0x562a6a3b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:25.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.484+0000 7ff9d7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a6a3b8880 0x562a6a3b2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48952/0 (socket says 172.21.15.49:48952) 2024-06-03T00:01:25.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.484+0000 7ff9d7fff700 1 -- 172.21.15.49:0/3537383130 learned_addr learned my addr 172.21.15.49:0/3537383130 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:25.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.484+0000 7ff9dd66a700 1 --2- 172.21.15.49:0/3537383130 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a6a3b27a0 0x562a6a3b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:25.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.484+0000 7ff9dce69700 1 --2- 172.21.15.49:0/3537383130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562a6a3b7f60 0x562a6a3b8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:25.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.485+0000 7ff9d7fff700 1 -- 172.21.15.49:0/3537383130 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a6a3b27a0 msgr2=0x562a6a3b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:25.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.485+0000 7ff9d7fff700 1 --2- 172.21.15.49:0/3537383130 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a6a3b27a0 0x562a6a3b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.485+0000 7ff9d7fff700 1 -- 172.21.15.49:0/3537383130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562a6a3b7f60 msgr2=0x562a6a3b8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:25.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.485+0000 7ff9d7fff700 1 --2- 172.21.15.49:0/3537383130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562a6a3b7f60 0x562a6a3b8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.485+0000 7ff9d7fff700 1 -- 172.21.15.49:0/3537383130 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a6a2528d0 con 0x562a6a3b8880 2024-06-03T00:01:25.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.485+0000 7ff9d7fff700 1 --2- 172.21.15.49:0/3537383130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a6a3b8880 0x562a6a3b2260 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400ace0 tx=0x7ff9c400f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d53bd2f34051280 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:25.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.485+0000 7ff9c2ffd700 1 -- 172.21.15.49:0/3537383130 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c400fe50 con 0x562a6a3b8880 2024-06-03T00:01:25.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.485+0000 7ff9c2ffd700 1 -- 172.21.15.49:0/3537383130 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9c4004500 con 0x562a6a3b8880 2024-06-03T00:01:25.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.485+0000 7ff9c2ffd700 1 -- 172.21.15.49:0/3537383130 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c40186a0 con 0x562a6a3b8880 2024-06-03T00:01:25.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.486+0000 7ff9e9950b80 1 -- 172.21.15.49:0/3537383130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a6a3b8880 msgr2=0x562a6a3b2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:25.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.486+0000 7ff9e9950b80 1 --2- 172.21.15.49:0/3537383130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a6a3b8880 0x562a6a3b2260 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400ace0 tx=0x7ff9c400f3c0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.486+0000 7ff9e9950b80 1 -- 172.21.15.49:0/3537383130 shutdown_connections 2024-06-03T00:01:25.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.486+0000 7ff9e9950b80 1 --2- 172.21.15.49:0/3537383130 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a6a3b27a0 0x562a6a3b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.486+0000 7ff9e9950b80 1 --2- 172.21.15.49:0/3537383130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562a6a3b7f60 0x562a6a3b8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.486+0000 7ff9e9950b80 1 --2- 172.21.15.49:0/3537383130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a6a3b8880 0x562a6a3b2260 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.486+0000 7ff9e9950b80 1 -- 172.21.15.49:0/3537383130 >> 172.21.15.49:0/3537383130 conn(0x562a6a2df080 msgr2=0x562a6a3ad220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:25.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.486+0000 7ff9e9950b80 1 -- 172.21.15.49:0/3537383130 shutdown_connections 2024-06-03T00:01:25.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.486+0000 7ff9e9950b80 1 -- 172.21.15.49:0/3537383130 wait complete. 2024-06-03T00:01:25.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.486+0000 7ff9e9950b80 1 -- start start 2024-06-03T00:01:25.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.486+0000 7ff9e9950b80 1 Processor -- start 2024-06-03T00:01:25.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.487+0000 7ff9e9950b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562a6a3b27a0 0x562a6a3be630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:25.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.487+0000 7ff9e9950b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a6a3b7f60 0x562a6a3bb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:25.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.487+0000 7ff9e9950b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a6a3b8880 0x562a6a3bbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:25.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.487+0000 7ff9e9950b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562a6a2a3fc0 con 0x562a6a3b7f60 2024-06-03T00:01:25.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.487+0000 7ff9e9950b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x562a6a2ff810 con 0x562a6a3b27a0 2024-06-03T00:01:25.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.487+0000 7ff9e9950b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x562a6a3bf260 con 0x562a6a3b8880 2024-06-03T00:01:25.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.487+0000 7ff9e9950b80 10 client.0 _ll_register_callbacks cb 0x562a6a2995b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:25.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.487+0000 7ff9d7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a6a3b7f60 0x562a6a3bb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:25.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.487+0000 7ff9d7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a6a3b7f60 0x562a6a3bb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48962/0 (socket says 172.21.15.49:48962) 2024-06-03T00:01:25.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.487+0000 7ff9d7fff700 1 -- 172.21.15.49:0/2870853372 learned_addr learned my addr 172.21.15.49:0/2870853372 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:25.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.487+0000 7ff9dd66a700 1 --2- 172.21.15.49:0/2870853372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a6a3b8880 0x562a6a3bbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:25.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.487+0000 7ff9dce69700 1 --2- 172.21.15.49:0/2870853372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562a6a3b27a0 0x562a6a3be630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:25.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.487+0000 7ff9d7fff700 1 -- 172.21.15.49:0/2870853372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a6a3b8880 msgr2=0x562a6a3bbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:25.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.487+0000 7ff9d7fff700 1 --2- 172.21.15.49:0/2870853372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a6a3b8880 0x562a6a3bbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.487+0000 7ff9d7fff700 1 -- 172.21.15.49:0/2870853372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562a6a3b27a0 msgr2=0x562a6a3be630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:25.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.487+0000 7ff9d7fff700 1 --2- 172.21.15.49:0/2870853372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562a6a3b27a0 0x562a6a3be630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.487+0000 7ff9d7fff700 1 -- 172.21.15.49:0/2870853372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a6a2c9750 con 0x562a6a3b7f60 2024-06-03T00:01:25.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.487+0000 7ff9dce69700 1 --2- 172.21.15.49:0/2870853372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562a6a3b27a0 0x562a6a3be630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:25.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.488+0000 7ff9d7fff700 1 --2- 172.21.15.49:0/2870853372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a6a3b7f60 0x562a6a3bb930 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400f710 tx=0x7ff9c40038b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=149bfdc247f23884 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:25.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.488+0000 7ff9b7fff700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:01:25.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.488+0000 7ff9b7fff700 1 -- 172.21.15.49:0/2870853372 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4026020 con 0x562a6a3b7f60 2024-06-03T00:01:25.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.488+0000 7ff9e9950b80 1 -- 172.21.15.49:0/2870853372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9c4004500 con 0x562a6a3b7f60 2024-06-03T00:01:25.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.488+0000 7ff9b7fff700 1 -- 172.21.15.49:0/2870853372 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7ff9c4005040 con 0x562a6a3b7f60 2024-06-03T00:01:25.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.488+0000 7ff9b7fff700 1 -- 172.21.15.49:0/2870853372 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff9c4005240 con 0x562a6a3b7f60 2024-06-03T00:01:25.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.488+0000 7ff9e9950b80 10 client.15513 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:25.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.488+0000 7ff9e9950b80 1 -- 172.21.15.49:0/2870853372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562a6a3c9a20 con 0x562a6a3b7f60 2024-06-03T00:01:25.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.488+0000 7ff9b7fff700 1 -- 172.21.15.49:0/2870853372 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9c4004500 con 0x562a6a3b7f60 2024-06-03T00:01:25.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.488+0000 7ff9b7fff700 1 -- 172.21.15.49:0/2870853372 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ff9c4022460 con 0x562a6a3b7f60 2024-06-03T00:01:25.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.488+0000 7ff9e9950b80 10 client.15513 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:25.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.488+0000 7ff9e9950b80 10 client.15513 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-06-03T00:01:25.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.488+0000 7ff9e9950b80 20 client.15513 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:25.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.488+0000 7ff9e9950b80 1 --2- 172.21.15.49:0/2870853372 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x562a6a3cbef0 0x562a6a3ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:25.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.488+0000 7ff9e9950b80 4 client.15513 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:01:25.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.488+0000 7ff9e9950b80 1 -- 172.21.15.49:0/2870853372 --> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a6a310d50 con 0x562a6a3cbef0 2024-06-03T00:01:25.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.489+0000 7ff9dce69700 1 --2- 172.21.15.49:0/2870853372 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x562a6a3cbef0 0x562a6a3ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:25.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.489+0000 7ff9b7fff700 10 client.15513 ms_handle_connect on v2:172.21.15.107:6834/3693542801 2024-06-03T00:01:25.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.489+0000 7ff9dce69700 1 --2- 172.21.15.49:0/2870853372 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x562a6a3cbef0 0x562a6a3ce2e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=dc738cdcda7f4180 server_cookie=438079e4c1847563 in_seq=0 out_seq=0 2024-06-03T00:01:25.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.490+0000 7ff9b7fff700 1 -- 172.21.15.49:0/2870853372 <== mds.4 v2:172.21.15.107:6834/3693542801 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x562a6a310d50 con 0x562a6a3cbef0 2024-06-03T00:01:25.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.490+0000 7ff9b7fff700 10 client.15513 handle_command_reply: tid=0 2024-06-03T00:01:25.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.490+0000 7ff9e9950b80 1 client.15513 shutdown 2024-06-03T00:01:25.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.490+0000 7ff9e9950b80 1 -- 172.21.15.49:0/2870853372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a6a3b7f60 msgr2=0x562a6a3bb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:25.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.490+0000 7ff9e9950b80 1 --2- 172.21.15.49:0/2870853372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a6a3b7f60 0x562a6a3bb930 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400f710 tx=0x7ff9c40038b0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.490+0000 7ff9e9950b80 1 -- 172.21.15.49:0/2870853372 shutdown_connections 2024-06-03T00:01:25.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.490+0000 7ff9e9950b80 1 --2- 172.21.15.49:0/2870853372 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x562a6a3cbef0 0x562a6a3ce2e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.491+0000 7ff9e9950b80 1 --2- 172.21.15.49:0/2870853372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a6a3b8880 0x562a6a3bbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.491+0000 7ff9b7fff700 0 client.15513 ms_handle_reset on v2:172.21.15.107:6834/3693542801 2024-06-03T00:01:25.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.491+0000 7ff9e9950b80 1 --2- 172.21.15.49:0/2870853372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562a6a3b27a0 0x562a6a3be630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.491+0000 7ff9e9950b80 1 --2- 172.21.15.49:0/2870853372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a6a3b7f60 0x562a6a3bb930 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.491+0000 7ff9e9950b80 1 -- 172.21.15.49:0/2870853372 >> 172.21.15.49:0/2870853372 conn(0x562a6a2df080 msgr2=0x562a6a3ac700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:25.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.491+0000 7ff9e9950b80 1 -- 172.21.15.49:0/2870853372 shutdown_connections 2024-06-03T00:01:25.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.491+0000 7ff9e9950b80 1 -- 172.21.15.49:0/2870853372 wait complete. 2024-06-03T00:01:25.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.491+0000 7ff9e9950b80 20 client.15513 trim_cache size 0 max 16384 2024-06-03T00:01:25.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.506+0000 7ff9e9950b80 1 Processor -- start 2024-06-03T00:01:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.506+0000 7ff9e9950b80 1 -- start start 2024-06-03T00:01:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.506+0000 7ff9e9950b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a6a3b27a0 0x562a6a3b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.506+0000 7ff9e9950b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a6a3b7f60 0x562a6a3ace80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.506+0000 7ff9e9950b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562a6a3b8880 0x562a6a3ad3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.506+0000 7ff9e9950b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d81aede0 con 0x562a6a3b7f60 2024-06-03T00:01:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.506+0000 7ff9e9950b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d81b0920 con 0x562a6a3b8880 2024-06-03T00:01:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.506+0000 7ff9e9950b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d81af4b0 con 0x562a6a3b27a0 2024-06-03T00:01:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.506+0000 7ff9d7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a6a3b7f60 0x562a6a3ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.506+0000 7ff9d7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a6a3b7f60 0x562a6a3ace80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48970/0 (socket says 172.21.15.49:48970) 2024-06-03T00:01:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.506+0000 7ff9d7fff700 1 -- 172.21.15.49:0/3416916326 learned_addr learned my addr 172.21.15.49:0/3416916326 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.507+0000 7ff9dce69700 1 --2- 172.21.15.49:0/3416916326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a6a3b27a0 0x562a6a3b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.507+0000 7ff9d7fff700 1 -- 172.21.15.49:0/3416916326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a6a3b27a0 msgr2=0x562a6a3b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:25.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.507+0000 7ff9d7fff700 1 --2- 172.21.15.49:0/3416916326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a6a3b27a0 0x562a6a3b60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.507+0000 7ff9d7fff700 1 -- 172.21.15.49:0/3416916326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562a6a3b8880 msgr2=0x562a6a3ad3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.507+0000 7ff9d7fff700 1 --2- 172.21.15.49:0/3416916326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562a6a3b8880 0x562a6a3ad3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.507+0000 7ff9d7fff700 1 -- 172.21.15.49:0/3416916326 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a6a3bc2d0 con 0x562a6a3b7f60 2024-06-03T00:01:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.507+0000 7ff9dce69700 1 --2- 172.21.15.49:0/3416916326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a6a3b27a0 0x562a6a3b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.507+0000 7ff9d7fff700 1 --2- 172.21.15.49:0/3416916326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a6a3b7f60 0x562a6a3ace80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ff9c402f040 tx=0x7ff9c400a4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb0b885ef820d583 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.507+0000 7ff9c27fc700 1 -- 172.21.15.49:0/3416916326 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4026040 con 0x562a6a3b7f60 2024-06-03T00:01:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.507+0000 7ff9c27fc700 1 -- 172.21.15.49:0/3416916326 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9c4003e00 con 0x562a6a3b7f60 2024-06-03T00:01:25.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.507+0000 7ff9c27fc700 1 -- 172.21.15.49:0/3416916326 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4018880 con 0x562a6a3b7f60 2024-06-03T00:01:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.508+0000 7ff9e9950b80 1 -- 172.21.15.49:0/3416916326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a6a3b7f60 msgr2=0x562a6a3ace80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.508+0000 7ff9e9950b80 1 --2- 172.21.15.49:0/3416916326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a6a3b7f60 0x562a6a3ace80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ff9c402f040 tx=0x7ff9c400a4f0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.508+0000 7ff9e9950b80 1 -- 172.21.15.49:0/3416916326 shutdown_connections 2024-06-03T00:01:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.508+0000 7ff9e9950b80 1 --2- 172.21.15.49:0/3416916326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562a6a3b8880 0x562a6a3ad3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.508+0000 7ff9e9950b80 1 --2- 172.21.15.49:0/3416916326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a6a3b27a0 0x562a6a3b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.508+0000 7ff9e9950b80 1 --2- 172.21.15.49:0/3416916326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a6a3b7f60 0x562a6a3ace80 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.508+0000 7ff9e9950b80 1 -- 172.21.15.49:0/3416916326 >> 172.21.15.49:0/3416916326 conn(0x562a6a2df080 msgr2=0x562a6a3b59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.508+0000 7ff9e9950b80 1 -- 172.21.15.49:0/3416916326 shutdown_connections 2024-06-03T00:01:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.508+0000 7ff9e9950b80 1 -- 172.21.15.49:0/3416916326 wait complete. 2024-06-03T00:01:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.508+0000 7ff9e9950b80 1 -- start start 2024-06-03T00:01:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.508+0000 7ff9e9950b80 1 Processor -- start 2024-06-03T00:01:25.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.509+0000 7ff9e9950b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562a6a3b27a0 0x562a6a3c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:25.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.509+0000 7ff9e9950b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a6a3b7f60 0x562a6a3d2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:25.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.509+0000 7ff9e9950b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a6a3b8880 0x562a6a3d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:25.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.509+0000 7ff9e9950b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d81b0250 con 0x562a6a3b7f60 2024-06-03T00:01:25.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.509+0000 7ff9e9950b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d81afb80 con 0x562a6a3b27a0 2024-06-03T00:01:25.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.509+0000 7ff9e9950b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d81acd60 con 0x562a6a3b8880 2024-06-03T00:01:25.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.509+0000 7ff9e9950b80 10 client.0 _ll_register_callbacks cb 0x562a6a2995b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:25.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.509+0000 7ff9d7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a6a3b7f60 0x562a6a3d2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:25.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.509+0000 7ff9d7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a6a3b7f60 0x562a6a3d2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48976/0 (socket says 172.21.15.49:48976) 2024-06-03T00:01:25.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.509+0000 7ff9d7fff700 1 -- 172.21.15.49:0/3178384123 learned_addr learned my addr 172.21.15.49:0/3178384123 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:25.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.509+0000 7ff9dce69700 1 --2- 172.21.15.49:0/3178384123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562a6a3b27a0 0x562a6a3c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:25.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.509+0000 7ff9dd66a700 1 --2- 172.21.15.49:0/3178384123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a6a3b8880 0x562a6a3d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:25.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.509+0000 7ff9d7fff700 1 -- 172.21.15.49:0/3178384123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a6a3b8880 msgr2=0x562a6a3d3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:25.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.509+0000 7ff9d7fff700 1 --2- 172.21.15.49:0/3178384123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a6a3b8880 0x562a6a3d3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.509+0000 7ff9d7fff700 1 -- 172.21.15.49:0/3178384123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562a6a3b27a0 msgr2=0x562a6a3c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:25.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.509+0000 7ff9d7fff700 1 --2- 172.21.15.49:0/3178384123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562a6a3b27a0 0x562a6a3c49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.509+0000 7ff9d7fff700 1 -- 172.21.15.49:0/3178384123 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a6a3d3980 con 0x562a6a3b7f60 2024-06-03T00:01:25.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.509+0000 7ff9d7fff700 1 --2- 172.21.15.49:0/3178384123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a6a3b7f60 0x562a6a3d2f00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4005210 tx=0x7ff9c40226f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d9f7a3a6ba855d server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:25.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.509+0000 7ff9b7fff700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:01:25.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.510+0000 7ff9b7fff700 1 -- 172.21.15.49:0/3178384123 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4026040 con 0x562a6a3b7f60 2024-06-03T00:01:25.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.510+0000 7ff9b7fff700 1 -- 172.21.15.49:0/3178384123 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7ff9c40053e0 con 0x562a6a3b7f60 2024-06-03T00:01:25.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.510+0000 7ff9e9950b80 1 -- 172.21.15.49:0/3178384123 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9c4003e00 con 0x562a6a3b7f60 2024-06-03T00:01:25.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.510+0000 7ff9b7fff700 1 -- 172.21.15.49:0/3178384123 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff9c40055e0 con 0x562a6a3b7f60 2024-06-03T00:01:25.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.510+0000 7ff9e9950b80 10 client.15519 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:25.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.510+0000 7ff9e9950b80 1 -- 172.21.15.49:0/3178384123 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562a6a436550 con 0x562a6a3b7f60 2024-06-03T00:01:25.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.510+0000 7ff9b7fff700 1 -- 172.21.15.49:0/3178384123 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9c4003e00 con 0x562a6a3b7f60 2024-06-03T00:01:25.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.510+0000 7ff9b7fff700 1 -- 172.21.15.49:0/3178384123 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ff9c4034070 con 0x562a6a3b7f60 2024-06-03T00:01:25.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.510+0000 7ff9e9950b80 10 client.15519 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:25.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.510+0000 7ff9e9950b80 10 client.15519 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-06-03T00:01:25.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.510+0000 7ff9e9950b80 20 client.15519 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:25.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.510+0000 7ff9e9950b80 1 --2- 172.21.15.49:0/3178384123 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x562a6a4369e0 0x562a6a438e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:25.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.510+0000 7ff9e9950b80 4 client.15519 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-03T00:01:25.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.510+0000 7ff9e9950b80 1 -- 172.21.15.49:0/3178384123 --> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562a6a30b2d0 con 0x562a6a4369e0 2024-06-03T00:01:25.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.511+0000 7ff9dce69700 1 --2- 172.21.15.49:0/3178384123 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x562a6a4369e0 0x562a6a438e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:25.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.511+0000 7ff9dce69700 1 --2- 172.21.15.49:0/3178384123 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x562a6a4369e0 0x562a6a438e00 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d26bd4ce011455e0 server_cookie=9176a53fc2dde541 in_seq=0 out_seq=0 2024-06-03T00:01:25.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.511+0000 7ff9b7fff700 10 client.15519 ms_handle_connect on v2:172.21.15.107:6834/3693542801 2024-06-03T00:01:25.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.511+0000 7ff9b7fff700 1 -- 172.21.15.49:0/3178384123 <== mds.4 v2:172.21.15.107:6834/3693542801 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562a6a30b2d0 con 0x562a6a4369e0 2024-06-03T00:01:25.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.511+0000 7ff9b7fff700 10 client.15519 handle_command_reply: tid=0 2024-06-03T00:01:25.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.511+0000 7ff9e9950b80 1 client.15519 shutdown 2024-06-03T00:01:25.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.511+0000 7ff9e9950b80 1 -- 172.21.15.49:0/3178384123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a6a3b7f60 msgr2=0x562a6a3d2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:25.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.511+0000 7ff9e9950b80 1 --2- 172.21.15.49:0/3178384123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a6a3b7f60 0x562a6a3d2f00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4005210 tx=0x7ff9c40226f0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.511+0000 7ff9e9950b80 1 -- 172.21.15.49:0/3178384123 shutdown_connections 2024-06-03T00:01:25.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.511+0000 7ff9e9950b80 1 --2- 172.21.15.49:0/3178384123 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x562a6a4369e0 0x562a6a438e00 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.511+0000 7ff9e9950b80 1 --2- 172.21.15.49:0/3178384123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a6a3b8880 0x562a6a3d3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.511+0000 7ff9e9950b80 1 --2- 172.21.15.49:0/3178384123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562a6a3b27a0 0x562a6a3c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.511+0000 7ff9e9950b80 1 --2- 172.21.15.49:0/3178384123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a6a3b7f60 0x562a6a3d2f00 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.511+0000 7ff9b7fff700 0 client.15519 ms_handle_reset on v2:172.21.15.107:6834/3693542801 2024-06-03T00:01:25.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.511+0000 7ff9e9950b80 1 -- 172.21.15.49:0/3178384123 >> 172.21.15.49:0/3178384123 conn(0x562a6a2df080 msgr2=0x562a6a3b8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:25.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.511+0000 7ff9e9950b80 1 -- 172.21.15.49:0/3178384123 shutdown_connections 2024-06-03T00:01:25.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.512+0000 7ff9e9950b80 1 -- 172.21.15.49:0/3178384123 wait complete. 2024-06-03T00:01:25.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.512+0000 7ff9e9950b80 20 client.15519 trim_cache size 0 max 16384 2024-06-03T00:01:25.517 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-06-03T00:01:25.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.512+0000 7ff9df0cd700 1 -- 172.21.15.49:0/2655707497 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff9c80a2ca0 msgr2=0x7ff9c80a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:25.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.512+0000 7ff9df0cd700 1 --2- 172.21.15.49:0/2655707497 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff9c80a2ca0 0x7ff9c80a5160 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc009fd0 tx=0x7ff9cc005fb0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.512+0000 7ff9df0cd700 1 -- 172.21.15.49:0/2655707497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9d8107840 msgr2=0x7ff9d8075210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:25.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.512+0000 7ff9df0cd700 1 --2- 172.21.15.49:0/2655707497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9d8107840 0x7ff9d8075210 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000ada0 tx=0x7ff9d000c330 comp rx=0 tx=0).stop 2024-06-03T00:01:25.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.512+0000 7ff9df0cd700 1 -- 172.21.15.49:0/2655707497 shutdown_connections 2024-06-03T00:01:25.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.512+0000 7ff9df0cd700 1 --2- 172.21.15.49:0/2655707497 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff9c80a2ca0 0x7ff9c80a5160 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.512+0000 7ff9df0cd700 1 --2- 172.21.15.49:0/2655707497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff9d8107840 0x7ff9d8075210 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.512+0000 7ff9df0cd700 1 --2- 172.21.15.49:0/2655707497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9d8102740 0x7ff9d8074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.512+0000 7ff9df0cd700 1 --2- 172.21.15.49:0/2655707497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9d81030f0 0x7ff9d8074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:25.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.512+0000 7ff9df0cd700 1 -- 172.21.15.49:0/2655707497 >> 172.21.15.49:0/2655707497 conn(0x7ff9d80795f0 msgr2=0x7ff9d8100530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:25.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.512+0000 7ff9df0cd700 1 -- 172.21.15.49:0/2655707497 shutdown_connections 2024-06-03T00:01:25.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:25.512+0000 7ff9df0cd700 1 -- 172.21.15.49:0/2655707497 wait complete. 2024-06-03T00:01:26.322 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-06-03T00:01:26.585 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:01:26.618 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:26 smithi049 ceph-mon[32302]: pgmap v425: 97 pgs: 97 active+clean; 661 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:01:26.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:26 smithi057 ceph-mon[36457]: pgmap v425: 97 pgs: 97 active+clean; 661 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:01:26.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:26 smithi107 ceph-mon[37048]: pgmap v425: 97 pgs: 97 active+clean; 661 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:01:28.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.326+0000 7f3deca46700 1 -- 172.21.15.49:0/228997110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3de8107400 msgr2=0x7f3de81077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:28.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.326+0000 7f3deca46700 1 --2- 172.21.15.49:0/228997110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3de8107400 0x7f3de81077e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3dd800b0a0 tx=0x7f3dd800b3b0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.326+0000 7f3deca46700 1 -- 172.21.15.49:0/228997110 shutdown_connections 2024-06-03T00:01:28.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.326+0000 7f3deca46700 1 --2- 172.21.15.49:0/228997110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3de8101d50 0x7f3de810e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.326+0000 7f3deca46700 1 --2- 172.21.15.49:0/228997110 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3de8107400 0x7f3de81077e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.326+0000 7f3deca46700 1 --2- 172.21.15.49:0/228997110 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3de8101390 0x7f3de8101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.326+0000 7f3deca46700 1 -- 172.21.15.49:0/228997110 >> 172.21.15.49:0/228997110 conn(0x7f3de8078340 msgr2=0x7f3de8078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:28.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.326+0000 7f3deca46700 1 -- 172.21.15.49:0/228997110 shutdown_connections 2024-06-03T00:01:28.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.326+0000 7f3deca46700 1 -- 172.21.15.49:0/228997110 wait complete. 2024-06-03T00:01:28.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.327+0000 7f3deca46700 1 Processor -- start 2024-06-03T00:01:28.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.327+0000 7f3deca46700 1 -- start start 2024-06-03T00:01:28.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.327+0000 7f3deca46700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3de8101390 0x7f3de8103070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:28.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.327+0000 7f3deca46700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3de8101d50 0x7f3de81035b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:28.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.327+0000 7f3deca46700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3de8107400 0x7f3de8103af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:28.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.327+0000 7f3deca46700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3de8111670 con 0x7f3de8107400 2024-06-03T00:01:28.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.327+0000 7f3deca46700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3de81114f0 con 0x7f3de8101d50 2024-06-03T00:01:28.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.327+0000 7f3deca46700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3de81117f0 con 0x7f3de8101390 2024-06-03T00:01:28.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.328+0000 7f3de6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3de8107400 0x7f3de8103af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:28.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.328+0000 7f3de6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3de8107400 0x7f3de8103af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48994/0 (socket says 172.21.15.49:48994) 2024-06-03T00:01:28.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.328+0000 7f3de6d9d700 1 -- 172.21.15.49:0/1132214033 learned_addr learned my addr 172.21.15.49:0/1132214033 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:28.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.328+0000 7f3de659c700 1 --2- 172.21.15.49:0/1132214033 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3de8101390 0x7f3de8103070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:28.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.328+0000 7f3de5d9b700 1 --2- 172.21.15.49:0/1132214033 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3de8101d50 0x7f3de81035b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:28.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.328+0000 7f3de6d9d700 1 -- 172.21.15.49:0/1132214033 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3de8101390 msgr2=0x7f3de8103070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:28.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.328+0000 7f3de6d9d700 1 --2- 172.21.15.49:0/1132214033 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3de8101390 0x7f3de8103070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.328+0000 7f3de6d9d700 1 -- 172.21.15.49:0/1132214033 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3de8101d50 msgr2=0x7f3de81035b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:28.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.328+0000 7f3de6d9d700 1 --2- 172.21.15.49:0/1132214033 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3de8101d50 0x7f3de81035b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.328+0000 7f3de6d9d700 1 -- 172.21.15.49:0/1132214033 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de81a7140 con 0x7f3de8107400 2024-06-03T00:01:28.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.328+0000 7f3de5d9b700 1 --2- 172.21.15.49:0/1132214033 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3de8101d50 0x7f3de81035b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:01:28.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.328+0000 7f3de659c700 1 --2- 172.21.15.49:0/1132214033 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3de8101390 0x7f3de8103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:28.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.328+0000 7f3de6d9d700 1 --2- 172.21.15.49:0/1132214033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3de8107400 0x7f3de8103af0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3de000c970 tx=0x7f3de000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:28.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.328+0000 7f3ddf7fe700 1 -- 172.21.15.49:0/1132214033 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de0007b00 con 0x7f3de8107400 2024-06-03T00:01:28.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.328+0000 7f3deca46700 1 -- 172.21.15.49:0/1132214033 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3de81a7430 con 0x7f3de8107400 2024-06-03T00:01:28.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.328+0000 7f3ddf7fe700 1 -- 172.21.15.49:0/1132214033 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3de0004d10 con 0x7f3de8107400 2024-06-03T00:01:28.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.328+0000 7f3ddf7fe700 1 -- 172.21.15.49:0/1132214033 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de00056c0 con 0x7f3de8107400 2024-06-03T00:01:28.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.328+0000 7f3deca46700 1 -- 172.21.15.49:0/1132214033 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3de81a7920 con 0x7f3de8107400 2024-06-03T00:01:28.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.331+0000 7f3ddf7fe700 1 -- 172.21.15.49:0/1132214033 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3de0004750 con 0x7f3de8107400 2024-06-03T00:01:28.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.331+0000 7f3ddf7fe700 1 --2- 172.21.15.49:0/1132214033 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3dd40a2c20 0x7f3dd40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:28.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.331+0000 7f3ddf7fe700 1 -- 172.21.15.49:0/1132214033 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f3de00cec60 con 0x7f3de8107400 2024-06-03T00:01:28.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.331+0000 7f3de659c700 1 --2- 172.21.15.49:0/1132214033 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3dd40a2c20 0x7f3dd40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:28.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.332+0000 7f3de659c700 1 --2- 172.21.15.49:0/1132214033 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3dd40a2c20 0x7f3dd40a50e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3dd800b830 tx=0x7f3dd8009390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:28.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.332+0000 7f3df72c9b80 1 Processor -- start 2024-06-03T00:01:28.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.332+0000 7f3df72c9b80 1 -- start start 2024-06-03T00:01:28.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.332+0000 7f3df72c9b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb57e59640 0x55fb57e59a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:28.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.332+0000 7f3df72c9b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb57e59f60 0x55fb57e539e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:28.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.332+0000 7f3df72c9b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb57e53f20 0x55fb57e54340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:28.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.332+0000 7f3df72c9b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55fb57da5810 con 0x55fb57e53f20 2024-06-03T00:01:28.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.332+0000 7f3df72c9b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55fb57d4d720 con 0x55fb57e59f60 2024-06-03T00:01:28.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.332+0000 7f3df72c9b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55fb57da17d0 con 0x55fb57e59640 2024-06-03T00:01:28.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.333+0000 7f3de6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb57e53f20 0x55fb57e54340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:28.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.333+0000 7f3de6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb57e53f20 0x55fb57e54340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49010/0 (socket says 172.21.15.49:49010) 2024-06-03T00:01:28.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.333+0000 7f3de6d9d700 1 -- 172.21.15.49:0/586272426 learned_addr learned my addr 172.21.15.49:0/586272426 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:28.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.333+0000 7f3de659c700 1 --2- 172.21.15.49:0/586272426 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb57e59640 0x55fb57e59a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:28.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.333+0000 7f3de5d9b700 1 --2- 172.21.15.49:0/586272426 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb57e59f60 0x55fb57e539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:28.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.333+0000 7f3de6d9d700 1 -- 172.21.15.49:0/586272426 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb57e59640 msgr2=0x55fb57e59a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:28.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.333+0000 7f3de6d9d700 1 --2- 172.21.15.49:0/586272426 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb57e59640 0x55fb57e59a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.333+0000 7f3de6d9d700 1 -- 172.21.15.49:0/586272426 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb57e59f60 msgr2=0x55fb57e539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:28.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.333+0000 7f3de6d9d700 1 --2- 172.21.15.49:0/586272426 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb57e59f60 0x55fb57e539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.333+0000 7f3de6d9d700 1 -- 172.21.15.49:0/586272426 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb57d43f50 con 0x55fb57e53f20 2024-06-03T00:01:28.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.333+0000 7f3de659c700 1 --2- 172.21.15.49:0/586272426 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb57e59640 0x55fb57e59a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:28.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.333+0000 7f3de6d9d700 1 --2- 172.21.15.49:0/586272426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb57e53f20 0x55fb57e54340 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f3de0097e90 tx=0x7f3de009b0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b86160a0a09b1bdc server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:28.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.333+0000 7f3ddcff9700 1 -- 172.21.15.49:0/586272426 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de001d040 con 0x55fb57e53f20 2024-06-03T00:01:28.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.333+0000 7f3ddcff9700 1 -- 172.21.15.49:0/586272426 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3de009f870 con 0x55fb57e53f20 2024-06-03T00:01:28.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.333+0000 7f3ddcff9700 1 -- 172.21.15.49:0/586272426 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de009b960 con 0x55fb57e53f20 2024-06-03T00:01:28.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.334+0000 7f3df72c9b80 1 -- 172.21.15.49:0/586272426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb57e53f20 msgr2=0x55fb57e54340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:28.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.334+0000 7f3df72c9b80 1 --2- 172.21.15.49:0/586272426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb57e53f20 0x55fb57e54340 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f3de0097e90 tx=0x7f3de009b0d0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.334+0000 7f3df72c9b80 1 -- 172.21.15.49:0/586272426 shutdown_connections 2024-06-03T00:01:28.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.334+0000 7f3df72c9b80 1 --2- 172.21.15.49:0/586272426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb57e53f20 0x55fb57e54340 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.334+0000 7f3df72c9b80 1 --2- 172.21.15.49:0/586272426 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb57e59640 0x55fb57e59a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.334+0000 7f3df72c9b80 1 --2- 172.21.15.49:0/586272426 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb57e59f60 0x55fb57e539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.334+0000 7f3df72c9b80 1 -- 172.21.15.49:0/586272426 >> 172.21.15.49:0/586272426 conn(0x55fb57d7ecc0 msgr2=0x55fb57e4e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:28.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.334+0000 7f3df72c9b80 1 -- 172.21.15.49:0/586272426 shutdown_connections 2024-06-03T00:01:28.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.334+0000 7f3df72c9b80 1 -- 172.21.15.49:0/586272426 wait complete. 2024-06-03T00:01:28.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.335+0000 7f3df72c9b80 1 -- start start 2024-06-03T00:01:28.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.335+0000 7f3df72c9b80 1 Processor -- start 2024-06-03T00:01:28.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.335+0000 7f3df72c9b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb57e53f20 0x55fb57e5fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:28.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.335+0000 7f3df72c9b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb57e59640 0x55fb57e5d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:28.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.335+0000 7f3df72c9b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb57e59f60 0x55fb57e5d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:28.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.335+0000 7f3df72c9b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55fb57e609d0 con 0x55fb57e53f20 2024-06-03T00:01:28.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.335+0000 7f3df72c9b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55fb57d45bf0 con 0x55fb57e59640 2024-06-03T00:01:28.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.335+0000 7f3df72c9b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55fb57e60b50 con 0x55fb57e59f60 2024-06-03T00:01:28.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.335+0000 7f3df72c9b80 10 client.0 _ll_register_callbacks cb 0x55fb57d3f920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:28.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.335+0000 7f3de659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb57e53f20 0x55fb57e5fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:28.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.335+0000 7f3de659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb57e53f20 0x55fb57e5fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49026/0 (socket says 172.21.15.49:49026) 2024-06-03T00:01:28.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.335+0000 7f3de659c700 1 -- 172.21.15.49:0/3261865727 learned_addr learned my addr 172.21.15.49:0/3261865727 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:28.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.335+0000 7f3de5d9b700 1 --2- 172.21.15.49:0/3261865727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb57e59640 0x55fb57e5d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:28.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.336+0000 7f3de6d9d700 1 --2- 172.21.15.49:0/3261865727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb57e59f60 0x55fb57e5d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:28.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.336+0000 7f3de659c700 1 -- 172.21.15.49:0/3261865727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb57e59f60 msgr2=0x55fb57e5d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:28.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.336+0000 7f3de659c700 1 --2- 172.21.15.49:0/3261865727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb57e59f60 0x55fb57e5d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.336+0000 7f3de659c700 1 -- 172.21.15.49:0/3261865727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb57e59640 msgr2=0x55fb57e5d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:28.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.336+0000 7f3de659c700 1 --2- 172.21.15.49:0/3261865727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb57e59640 0x55fb57e5d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.336+0000 7f3de659c700 1 -- 172.21.15.49:0/3261865727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb57cf48d0 con 0x55fb57e53f20 2024-06-03T00:01:28.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.336+0000 7f3de6d9d700 1 --2- 172.21.15.49:0/3261865727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb57e59f60 0x55fb57e5d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:28.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.336+0000 7f3de659c700 1 --2- 172.21.15.49:0/3261865727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb57e53f20 0x55fb57e5fd50 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3dd800b0a0 tx=0x7f3dd80099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd7ffe3ac61a7da0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:28.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.336+0000 7f3dcdffb700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:01:28.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.336+0000 7f3dcdffb700 1 -- 172.21.15.49:0/3261865727 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd802e070 con 0x55fb57e53f20 2024-06-03T00:01:28.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.336+0000 7f3dcdffb700 1 -- 172.21.15.49:0/3261865727 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f3dd801c850 con 0x55fb57e53f20 2024-06-03T00:01:28.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.336+0000 7f3df72c9b80 1 -- 172.21.15.49:0/3261865727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3de009f870 con 0x55fb57e53f20 2024-06-03T00:01:28.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.336+0000 7f3dcdffb700 1 -- 172.21.15.49:0/3261865727 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3dd801ca90 con 0x55fb57e53f20 2024-06-03T00:01:28.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.336+0000 7f3df72c9b80 10 client.15531 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:28.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.336+0000 7f3df72c9b80 1 -- 172.21.15.49:0/3261865727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fb57e6b380 con 0x55fb57e53f20 2024-06-03T00:01:28.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.337+0000 7f3dcdffb700 1 -- 172.21.15.49:0/3261865727 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3de009f870 con 0x55fb57e53f20 2024-06-03T00:01:28.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.337+0000 7f3dcdffb700 1 -- 172.21.15.49:0/3261865727 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f3dd8011070 con 0x55fb57e53f20 2024-06-03T00:01:28.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.337+0000 7f3df72c9b80 10 client.15531 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:28.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.337+0000 7f3df72c9b80 10 client.15531 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-06-03T00:01:28.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.337+0000 7f3df72c9b80 20 client.15531 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:28.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.337+0000 7f3df72c9b80 1 --2- 172.21.15.49:0/3261865727 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x55fb57e6da10 0x55fb57e6fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:28.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.337+0000 7f3df72c9b80 4 client.15531 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:01:28.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.337+0000 7f3df72c9b80 1 -- 172.21.15.49:0/3261865727 --> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb57db2d10 con 0x55fb57e6da10 2024-06-03T00:01:28.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.337+0000 7f3de5d9b700 1 --2- 172.21.15.49:0/3261865727 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x55fb57e6da10 0x55fb57e6fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:28.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.338+0000 7f3dcdffb700 10 client.15531 ms_handle_connect on v2:172.21.15.57:6836/230452144 2024-06-03T00:01:28.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.338+0000 7f3de5d9b700 1 --2- 172.21.15.49:0/3261865727 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x55fb57e6da10 0x55fb57e6fe70 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ea1d1df812c453f7 server_cookie=2a2e09bac049edf9 in_seq=0 out_seq=0 2024-06-03T00:01:28.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.339+0000 7f3dcdffb700 1 -- 172.21.15.49:0/3261865727 <== mds.3 v2:172.21.15.57:6836/230452144 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55fb57db2d10 con 0x55fb57e6da10 2024-06-03T00:01:28.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.339+0000 7f3dcdffb700 10 client.15531 handle_command_reply: tid=0 2024-06-03T00:01:28.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.339+0000 7f3df72c9b80 1 client.15531 shutdown 2024-06-03T00:01:28.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.339+0000 7f3df72c9b80 1 -- 172.21.15.49:0/3261865727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb57e53f20 msgr2=0x55fb57e5fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:28.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.339+0000 7f3df72c9b80 1 --2- 172.21.15.49:0/3261865727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb57e53f20 0x55fb57e5fd50 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3dd800b0a0 tx=0x7f3dd80099e0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.339+0000 7f3df72c9b80 1 -- 172.21.15.49:0/3261865727 shutdown_connections 2024-06-03T00:01:28.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.339+0000 7f3df72c9b80 1 --2- 172.21.15.49:0/3261865727 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x55fb57e6da10 0x55fb57e6fe70 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.339+0000 7f3df72c9b80 1 --2- 172.21.15.49:0/3261865727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb57e59f60 0x55fb57e5d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.339+0000 7f3df72c9b80 1 --2- 172.21.15.49:0/3261865727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb57e53f20 0x55fb57e5fd50 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.339+0000 7f3df72c9b80 1 --2- 172.21.15.49:0/3261865727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb57e59640 0x55fb57e5d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.339+0000 7f3df72c9b80 1 -- 172.21.15.49:0/3261865727 >> 172.21.15.49:0/3261865727 conn(0x55fb57d7ecc0 msgr2=0x55fb57e529d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:28.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.339+0000 7f3dcdffb700 0 client.15531 ms_handle_reset on v2:172.21.15.57:6836/230452144 2024-06-03T00:01:28.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.339+0000 7f3df72c9b80 1 -- 172.21.15.49:0/3261865727 shutdown_connections 2024-06-03T00:01:28.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.339+0000 7f3df72c9b80 1 -- 172.21.15.49:0/3261865727 wait complete. 2024-06-03T00:01:28.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.339+0000 7f3df72c9b80 20 client.15531 trim_cache size 0 max 16384 2024-06-03T00:01:28.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.354+0000 7f3df72c9b80 1 Processor -- start 2024-06-03T00:01:28.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.355+0000 7f3df72c9b80 1 -- start start 2024-06-03T00:01:28.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.355+0000 7f3df72c9b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb57d7ecc0 0x55fb57e69c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:28.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.355+0000 7f3df72c9b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb57e53f20 0x55fb57e539e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:28.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.355+0000 7f3df72c9b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb57e59640 0x55fb57e5abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:28.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.355+0000 7f3df72c9b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3de81aeee0 con 0x55fb57e59640 2024-06-03T00:01:28.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.355+0000 7f3df72c9b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3de81b0a20 con 0x55fb57d7ecc0 2024-06-03T00:01:28.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.355+0000 7f3df72c9b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3de81af5b0 con 0x55fb57e53f20 2024-06-03T00:01:28.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.355+0000 7f3de6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb57e59640 0x55fb57e5abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:28.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.355+0000 7f3de6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb57e59640 0x55fb57e5abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49030/0 (socket says 172.21.15.49:49030) 2024-06-03T00:01:28.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.355+0000 7f3de6d9d700 1 -- 172.21.15.49:0/1415086843 learned_addr learned my addr 172.21.15.49:0/1415086843 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:28.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.355+0000 7f3de659c700 1 --2- 172.21.15.49:0/1415086843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb57d7ecc0 0x55fb57e69c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:28.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.355+0000 7f3de5d9b700 1 --2- 172.21.15.49:0/1415086843 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb57e53f20 0x55fb57e539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:28.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.355+0000 7f3de6d9d700 1 -- 172.21.15.49:0/1415086843 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb57e53f20 msgr2=0x55fb57e539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:28.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.355+0000 7f3de6d9d700 1 --2- 172.21.15.49:0/1415086843 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb57e53f20 0x55fb57e539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.355+0000 7f3de6d9d700 1 -- 172.21.15.49:0/1415086843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb57d7ecc0 msgr2=0x55fb57e69c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:28.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.355+0000 7f3de6d9d700 1 --2- 172.21.15.49:0/1415086843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb57d7ecc0 0x55fb57e69c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.355+0000 7f3de6d9d700 1 -- 172.21.15.49:0/1415086843 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb57e4f500 con 0x55fb57e59640 2024-06-03T00:01:28.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.355+0000 7f3de5d9b700 1 --2- 172.21.15.49:0/1415086843 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb57e53f20 0x55fb57e539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:01:28.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.355+0000 7f3de6d9d700 1 --2- 172.21.15.49:0/1415086843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb57e59640 0x55fb57e5abd0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3de009b020 tx=0x7f3de000aef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbc80a3ba5127727 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:28.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.356+0000 7f3dcffff700 1 -- 172.21.15.49:0/1415086843 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de00a4130 con 0x55fb57e59640 2024-06-03T00:01:28.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.356+0000 7f3dcffff700 1 -- 172.21.15.49:0/1415086843 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3de00997c0 con 0x55fb57e59640 2024-06-03T00:01:28.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.356+0000 7f3dcffff700 1 -- 172.21.15.49:0/1415086843 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de009b980 con 0x55fb57e59640 2024-06-03T00:01:28.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.356+0000 7f3df72c9b80 1 -- 172.21.15.49:0/1415086843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb57e59640 msgr2=0x55fb57e5abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:28.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.356+0000 7f3df72c9b80 1 --2- 172.21.15.49:0/1415086843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb57e59640 0x55fb57e5abd0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3de009b020 tx=0x7f3de000aef0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.356+0000 7f3df72c9b80 1 -- 172.21.15.49:0/1415086843 shutdown_connections 2024-06-03T00:01:28.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.356+0000 7f3df72c9b80 1 --2- 172.21.15.49:0/1415086843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb57e59640 0x55fb57e5abd0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.356+0000 7f3df72c9b80 1 --2- 172.21.15.49:0/1415086843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb57d7ecc0 0x55fb57e69c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.356+0000 7f3df72c9b80 1 --2- 172.21.15.49:0/1415086843 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb57e53f20 0x55fb57e539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.356+0000 7f3df72c9b80 1 -- 172.21.15.49:0/1415086843 >> 172.21.15.49:0/1415086843 conn(0x55fb57e6ffd0 msgr2=0x55fb57e5b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:28.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.356+0000 7f3df72c9b80 1 -- 172.21.15.49:0/1415086843 shutdown_connections 2024-06-03T00:01:28.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.356+0000 7f3df72c9b80 1 -- 172.21.15.49:0/1415086843 wait complete. 2024-06-03T00:01:28.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.357+0000 7f3df72c9b80 1 -- start start 2024-06-03T00:01:28.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.357+0000 7f3df72c9b80 1 Processor -- start 2024-06-03T00:01:28.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.357+0000 7f3df72c9b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb57d7ecc0 0x55fb57e663e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:28.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.357+0000 7f3df72c9b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb57e53f20 0x55fb57e61760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:28.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.357+0000 7f3df72c9b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb57e59640 0x55fb57e61ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:28.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.357+0000 7f3df72c9b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3de81b0350 con 0x55fb57e53f20 2024-06-03T00:01:28.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.357+0000 7f3df72c9b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3de81afc80 con 0x55fb57d7ecc0 2024-06-03T00:01:28.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.357+0000 7f3df72c9b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3de81ace60 con 0x55fb57e59640 2024-06-03T00:01:28.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.357+0000 7f3df72c9b80 10 client.0 _ll_register_callbacks cb 0x55fb57d3f920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:28.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.357+0000 7f3de5d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb57e53f20 0x55fb57e61760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:28.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.357+0000 7f3de5d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb57e53f20 0x55fb57e61760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49036/0 (socket says 172.21.15.49:49036) 2024-06-03T00:01:28.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.357+0000 7f3de5d9b700 1 -- 172.21.15.49:0/774152589 learned_addr learned my addr 172.21.15.49:0/774152589 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:28.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.357+0000 7f3de659c700 1 --2- 172.21.15.49:0/774152589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb57d7ecc0 0x55fb57e663e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:28.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.357+0000 7f3de6d9d700 1 --2- 172.21.15.49:0/774152589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb57e59640 0x55fb57e61ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:28.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.357+0000 7f3de5d9b700 1 -- 172.21.15.49:0/774152589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb57e59640 msgr2=0x55fb57e61ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:28.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.357+0000 7f3de5d9b700 1 --2- 172.21.15.49:0/774152589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb57e59640 0x55fb57e61ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.357+0000 7f3de5d9b700 1 -- 172.21.15.49:0/774152589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb57d7ecc0 msgr2=0x55fb57e663e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:28.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.357+0000 7f3de5d9b700 1 --2- 172.21.15.49:0/774152589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb57d7ecc0 0x55fb57e663e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.357+0000 7f3de5d9b700 1 -- 172.21.15.49:0/774152589 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb57e62360 con 0x55fb57e53f20 2024-06-03T00:01:28.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.358+0000 7f3de5d9b700 1 --2- 172.21.15.49:0/774152589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb57e53f20 0x55fb57e61760 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3de80ffb40 tx=0x7f3dd0012730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=137d351fb46110e5 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:28.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.358+0000 7f3dcdffb700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:01:28.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.358+0000 7f3dcdffb700 1 -- 172.21.15.49:0/774152589 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd0004220 con 0x55fb57e53f20 2024-06-03T00:01:28.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.358+0000 7f3dcdffb700 1 -- 172.21.15.49:0/774152589 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f3dd00043c0 con 0x55fb57e53f20 2024-06-03T00:01:28.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.358+0000 7f3df72c9b80 1 -- 172.21.15.49:0/774152589 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3de00997c0 con 0x55fb57e53f20 2024-06-03T00:01:28.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.358+0000 7f3dcdffb700 1 -- 172.21.15.49:0/774152589 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3dd0003680 con 0x55fb57e53f20 2024-06-03T00:01:28.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.358+0000 7f3df72c9b80 10 client.15537 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:28.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.358+0000 7f3df72c9b80 1 -- 172.21.15.49:0/774152589 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fb57ed85e0 con 0x55fb57e53f20 2024-06-03T00:01:28.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.358+0000 7f3dcdffb700 1 -- 172.21.15.49:0/774152589 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3de00997c0 con 0x55fb57e53f20 2024-06-03T00:01:28.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.358+0000 7f3dcdffb700 1 -- 172.21.15.49:0/774152589 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f3dd000f040 con 0x55fb57e53f20 2024-06-03T00:01:28.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.358+0000 7f3df72c9b80 10 client.15537 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:28.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.358+0000 7f3df72c9b80 10 client.15537 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-06-03T00:01:28.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.358+0000 7f3df72c9b80 20 client.15537 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:28.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.358+0000 7f3df72c9b80 1 --2- 172.21.15.49:0/774152589 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x55fb57e59f60 0x55fb57edade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:28.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.358+0000 7f3df72c9b80 4 client.15537 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-03T00:01:28.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.358+0000 7f3df72c9b80 1 -- 172.21.15.49:0/774152589 --> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fb57dad290 con 0x55fb57e59f60 2024-06-03T00:01:28.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.359+0000 7f3de659c700 1 --2- 172.21.15.49:0/774152589 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x55fb57e59f60 0x55fb57edade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:28.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.359+0000 7f3de659c700 1 --2- 172.21.15.49:0/774152589 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x55fb57e59f60 0x55fb57edade0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f23a416dd455fe66 server_cookie=1477c802b5f9b084 in_seq=0 out_seq=0 2024-06-03T00:01:28.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.359+0000 7f3dcdffb700 10 client.15537 ms_handle_connect on v2:172.21.15.57:6836/230452144 2024-06-03T00:01:28.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.359+0000 7f3dcdffb700 1 -- 172.21.15.49:0/774152589 <== mds.3 v2:172.21.15.57:6836/230452144 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fb57dad290 con 0x55fb57e59f60 2024-06-03T00:01:28.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.359+0000 7f3dcdffb700 10 client.15537 handle_command_reply: tid=0 2024-06-03T00:01:28.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.359+0000 7f3df72c9b80 1 client.15537 shutdown 2024-06-03T00:01:28.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.359+0000 7f3df72c9b80 1 -- 172.21.15.49:0/774152589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb57e53f20 msgr2=0x55fb57e61760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:28.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.359+0000 7f3df72c9b80 1 --2- 172.21.15.49:0/774152589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb57e53f20 0x55fb57e61760 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3de80ffb40 tx=0x7f3dd0012730 comp rx=0 tx=0).stop 2024-06-03T00:01:28.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.359+0000 7f3df72c9b80 1 -- 172.21.15.49:0/774152589 shutdown_connections 2024-06-03T00:01:28.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.359+0000 7f3df72c9b80 1 --2- 172.21.15.49:0/774152589 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x55fb57e59f60 0x55fb57edade0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.359+0000 7f3df72c9b80 1 --2- 172.21.15.49:0/774152589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb57e59640 0x55fb57e61ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.359+0000 7f3df72c9b80 1 --2- 172.21.15.49:0/774152589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb57d7ecc0 0x55fb57e663e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.359+0000 7f3df72c9b80 1 --2- 172.21.15.49:0/774152589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb57e53f20 0x55fb57e61760 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.359+0000 7f3dcdffb700 0 client.15537 ms_handle_reset on v2:172.21.15.57:6836/230452144 2024-06-03T00:01:28.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.359+0000 7f3df72c9b80 1 -- 172.21.15.49:0/774152589 >> 172.21.15.49:0/774152589 conn(0x55fb57e6ffd0 msgr2=0x55fb57e581d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:28.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.359+0000 7f3df72c9b80 1 -- 172.21.15.49:0/774152589 shutdown_connections 2024-06-03T00:01:28.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.360+0000 7f3df72c9b80 1 -- 172.21.15.49:0/774152589 wait complete. 2024-06-03T00:01:28.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.360+0000 7f3df72c9b80 20 client.15537 trim_cache size 0 max 16384 2024-06-03T00:01:28.374 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-06-03T00:01:28.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.360+0000 7f3deca46700 1 -- 172.21.15.49:0/1132214033 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3dd40a2c20 msgr2=0x7f3dd40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:28.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.360+0000 7f3deca46700 1 --2- 172.21.15.49:0/1132214033 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3dd40a2c20 0x7f3dd40a50e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3dd800b830 tx=0x7f3dd8009390 comp rx=0 tx=0).stop 2024-06-03T00:01:28.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.360+0000 7f3deca46700 1 -- 172.21.15.49:0/1132214033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3de8107400 msgr2=0x7f3de8103af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:28.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.360+0000 7f3deca46700 1 --2- 172.21.15.49:0/1132214033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3de8107400 0x7f3de8103af0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3de000c970 tx=0x7f3de000cd30 comp rx=0 tx=0).stop 2024-06-03T00:01:28.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.360+0000 7f3deca46700 1 -- 172.21.15.49:0/1132214033 shutdown_connections 2024-06-03T00:01:28.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.360+0000 7f3deca46700 1 --2- 172.21.15.49:0/1132214033 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f3dd40a2c20 0x7f3dd40a50e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.360+0000 7f3deca46700 1 --2- 172.21.15.49:0/1132214033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3de8107400 0x7f3de8103af0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.360+0000 7f3deca46700 1 --2- 172.21.15.49:0/1132214033 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3de8101390 0x7f3de8103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.360+0000 7f3deca46700 1 --2- 172.21.15.49:0/1132214033 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3de8101d50 0x7f3de81035b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:28.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.360+0000 7f3deca46700 1 -- 172.21.15.49:0/1132214033 >> 172.21.15.49:0/1132214033 conn(0x7f3de8078340 msgr2=0x7f3de8100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:28.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.360+0000 7f3deca46700 1 -- 172.21.15.49:0/1132214033 shutdown_connections 2024-06-03T00:01:28.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:28.360+0000 7f3deca46700 1 -- 172.21.15.49:0/1132214033 wait complete. 2024-06-03T00:01:28.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:28 smithi057 ceph-mon[36457]: pgmap v426: 97 pgs: 97 active+clean; 661 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:01:28.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:28 smithi049 ceph-mon[32302]: pgmap v426: 97 pgs: 97 active+clean; 661 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:01:28.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:28 smithi107 ceph-mon[37048]: pgmap v426: 97 pgs: 97 active+clean; 661 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:01:29.062 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-06-03T00:01:29.315 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:01:30.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.613+0000 7f51124a5640 1 -- 172.21.15.49:0/3527793876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f510c101af0 msgr2=0x7f510c101f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:30.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.613+0000 7f51124a5640 1 --2- 172.21.15.49:0/3527793876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f510c101af0 0x7f510c101f70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5100009900 tx=0x7f510002a410 comp rx=0 tx=0).stop 2024-06-03T00:01:30.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.613+0000 7f51124a5640 1 -- 172.21.15.49:0/3527793876 shutdown_connections 2024-06-03T00:01:30.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.613+0000 7f51124a5640 1 --2- 172.21.15.49:0/3527793876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f510c1024b0 0x7f510c108d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.613+0000 7f51124a5640 1 --2- 172.21.15.49:0/3527793876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f510c101af0 0x7f510c101f70 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.613+0000 7f51124a5640 1 --2- 172.21.15.49:0/3527793876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f510c100900 0x7f510c100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.613+0000 7f51124a5640 1 -- 172.21.15.49:0/3527793876 >> 172.21.15.49:0/3527793876 conn(0x7f510c0fbe70 msgr2=0x7f510c0fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:30.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.613+0000 7f51124a5640 1 -- 172.21.15.49:0/3527793876 shutdown_connections 2024-06-03T00:01:30.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.613+0000 7f51124a5640 1 -- 172.21.15.49:0/3527793876 wait complete. 2024-06-03T00:01:30.616 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.614+0000 7f51124a5640 1 Processor -- start 2024-06-03T00:01:30.616 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.614+0000 7f51124a5640 1 -- start start 2024-06-03T00:01:30.616 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.614+0000 7f51124a5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f510c100900 0x7f510c10b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:30.616 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.614+0000 7f51124a5640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f510c101af0 0x7f510c1098c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:30.617 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.614+0000 7f51124a5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f510c1024b0 0x7f510c109e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:30.617 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.614+0000 7f51124a5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f510c10d6a0 con 0x7f510c1024b0 2024-06-03T00:01:30.617 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.614+0000 7f51124a5640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f510c10d520 con 0x7f510c101af0 2024-06-03T00:01:30.617 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.614+0000 7f51124a5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f510c10d820 con 0x7f510c100900 2024-06-03T00:01:30.617 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.614+0000 7f5110a42640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f510c1024b0 0x7f510c109e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:30.617 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.614+0000 7f5110a42640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f510c1024b0 0x7f510c109e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49042/0 (socket says 172.21.15.49:49042) 2024-06-03T00:01:30.617 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.614+0000 7f5110a42640 1 -- 172.21.15.49:0/3772252333 learned_addr learned my addr 172.21.15.49:0/3772252333 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:30.617 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.614+0000 7f510b7fe640 1 --2- 172.21.15.49:0/3772252333 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f510c101af0 0x7f510c1098c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:30.617 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.614+0000 7f510bfff640 1 --2- 172.21.15.49:0/3772252333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f510c100900 0x7f510c10b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:30.617 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.615+0000 7f5110a42640 1 -- 172.21.15.49:0/3772252333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f510c100900 msgr2=0x7f510c10b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:30.617 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.615+0000 7f5110a42640 1 --2- 172.21.15.49:0/3772252333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f510c100900 0x7f510c10b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.617 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.615+0000 7f5110a42640 1 -- 172.21.15.49:0/3772252333 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f510c101af0 msgr2=0x7f510c1098c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:30.617 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.615+0000 7f5110a42640 1 --2- 172.21.15.49:0/3772252333 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f510c101af0 0x7f510c1098c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.615+0000 7f5110a42640 1 -- 172.21.15.49:0/3772252333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f510c10a6c0 con 0x7f510c1024b0 2024-06-03T00:01:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.615+0000 7f5110a42640 1 --2- 172.21.15.49:0/3772252333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f510c1024b0 0x7f510c109e00 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f510400eaa0 tx=0x7f510400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.615+0000 7f51097fa640 1 -- 172.21.15.49:0/3772252333 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f510400cdb0 con 0x7f510c1024b0 2024-06-03T00:01:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.615+0000 7f51097fa640 1 -- 172.21.15.49:0/3772252333 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5104005020 con 0x7f510c1024b0 2024-06-03T00:01:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.615+0000 7f51097fa640 1 -- 172.21.15.49:0/3772252333 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51040116b0 con 0x7f510c1024b0 2024-06-03T00:01:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.615+0000 7f51124a5640 1 -- 172.21.15.49:0/3772252333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f510c1a1db0 con 0x7f510c1024b0 2024-06-03T00:01:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.616+0000 7f51124a5640 1 -- 172.21.15.49:0/3772252333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f510c1a22d0 con 0x7f510c1024b0 2024-06-03T00:01:30.619 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.618+0000 7f51097fa640 1 -- 172.21.15.49:0/3772252333 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5104005560 con 0x7f510c1024b0 2024-06-03T00:01:30.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.619+0000 7f51097fa640 1 --2- 172.21.15.49:0/3772252333 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f50f40a2cb0 0x7f50f40a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:30.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.619+0000 7f51097fa640 1 -- 172.21.15.49:0/3772252333 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f51040cf0c0 con 0x7f510c1024b0 2024-06-03T00:01:30.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.619+0000 7f510bfff640 1 --2- 172.21.15.49:0/3772252333 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f50f40a2cb0 0x7f50f40a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:30.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.619+0000 7f51151b1740 1 Processor -- start 2024-06-03T00:01:30.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.619+0000 7f51151b1740 1 -- start start 2024-06-03T00:01:30.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.619+0000 7f51151b1740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629e0290010 0x5629e0290430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:30.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.619+0000 7f51151b1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5629e0290a00 0x5629e0295500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:30.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.619+0000 7f51151b1740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5629e0295b70 0x5629e0298000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:30.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.619+0000 7f51151b1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5629e01f34f0 con 0x5629e0290a00 2024-06-03T00:01:30.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.619+0000 7f51151b1740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5629e0191870 con 0x5629e0295b70 2024-06-03T00:01:30.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.619+0000 7f51151b1740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5629e01ef4b0 con 0x5629e0290010 2024-06-03T00:01:30.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.620+0000 7f510bfff640 1 --2- 172.21.15.49:0/3772252333 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f50f40a2cb0 0x7f50f40a5170 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f50fc005fd0 tx=0x7f50fc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:30.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.620+0000 7f510b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5629e0290a00 0x5629e0295500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:30.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.620+0000 7f510b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5629e0290a00 0x5629e0295500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49050/0 (socket says 172.21.15.49:49050) 2024-06-03T00:01:30.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.620+0000 7f510b7fe640 1 -- 172.21.15.49:0/4013210855 learned_addr learned my addr 172.21.15.49:0/4013210855 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:30.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.620+0000 7f510bfff640 1 --2- 172.21.15.49:0/4013210855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629e0290010 0x5629e0290430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:30.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.620+0000 7f510b7fe640 1 -- 172.21.15.49:0/4013210855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629e0290010 msgr2=0x5629e0290430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:30.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.620+0000 7f5110a42640 1 --2- 172.21.15.49:0/4013210855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5629e0295b70 0x5629e0298000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:30.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.620+0000 7f510b7fe640 1 --2- 172.21.15.49:0/4013210855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629e0290010 0x5629e0290430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.620+0000 7f510b7fe640 1 -- 172.21.15.49:0/4013210855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5629e0295b70 msgr2=0x5629e0298000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:30.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.620+0000 7f510b7fe640 1 --2- 172.21.15.49:0/4013210855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5629e0295b70 0x5629e0298000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.620+0000 7f510b7fe640 1 -- 172.21.15.49:0/4013210855 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629e01ad9b0 con 0x5629e0290a00 2024-06-03T00:01:30.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.620+0000 7f510b7fe640 1 --2- 172.21.15.49:0/4013210855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5629e0290a00 0x5629e0295500 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f510002a930 tx=0x7f5100005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f78228fea69e26bb server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:30.623 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.620+0000 7f50f27fc640 1 -- 172.21.15.49:0/4013210855 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5100040070 con 0x5629e0290a00 2024-06-03T00:01:30.623 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.620+0000 7f50f27fc640 1 -- 172.21.15.49:0/4013210855 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51000318b0 con 0x5629e0290a00 2024-06-03T00:01:30.623 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.620+0000 7f50f27fc640 1 -- 172.21.15.49:0/4013210855 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5100035040 con 0x5629e0290a00 2024-06-03T00:01:30.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.621+0000 7f51151b1740 1 -- 172.21.15.49:0/4013210855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5629e0290a00 msgr2=0x5629e0295500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:30.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.621+0000 7f51151b1740 1 --2- 172.21.15.49:0/4013210855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5629e0290a00 0x5629e0295500 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f510002a930 tx=0x7f5100005c00 comp rx=0 tx=0).stop 2024-06-03T00:01:30.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.621+0000 7f51151b1740 1 -- 172.21.15.49:0/4013210855 shutdown_connections 2024-06-03T00:01:30.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.621+0000 7f51151b1740 1 --2- 172.21.15.49:0/4013210855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5629e0295b70 0x5629e0298000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.621+0000 7f51151b1740 1 --2- 172.21.15.49:0/4013210855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5629e0290a00 0x5629e0295500 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.621+0000 7f51151b1740 1 --2- 172.21.15.49:0/4013210855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629e0290010 0x5629e0290430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.621+0000 7f51151b1740 1 -- 172.21.15.49:0/4013210855 >> 172.21.15.49:0/4013210855 conn(0x5629e028b680 msgr2=0x5629e028ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:30.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.621+0000 7f51151b1740 1 -- 172.21.15.49:0/4013210855 shutdown_connections 2024-06-03T00:01:30.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.621+0000 7f51151b1740 1 -- 172.21.15.49:0/4013210855 wait complete. 2024-06-03T00:01:30.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.621+0000 7f51151b1740 1 -- start start 2024-06-03T00:01:30.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.622+0000 7f51151b1740 1 Processor -- start 2024-06-03T00:01:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.622+0000 7f51151b1740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5629e0290010 0x5629e029a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.622+0000 7f51151b1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5629e0290a00 0x5629e029a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.622+0000 7f51151b1740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629e0295b70 0x5629e02a19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.622+0000 7f51151b1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5629e0298ac0 con 0x5629e0290a00 2024-06-03T00:01:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.622+0000 7f51151b1740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5629e017cae0 con 0x5629e0290010 2024-06-03T00:01:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.622+0000 7f51151b1740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5629e0298c40 con 0x5629e0295b70 2024-06-03T00:01:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.622+0000 7f51151b1740 10 client.0 _ll_register_callbacks cb 0x5629e01b59b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.622+0000 7f510b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5629e0290a00 0x5629e029a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.622+0000 7f510b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5629e0290a00 0x5629e029a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49058/0 (socket says 172.21.15.49:49058) 2024-06-03T00:01:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.622+0000 7f510b7fe640 1 -- 172.21.15.49:0/2381004740 learned_addr learned my addr 172.21.15.49:0/2381004740 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.622+0000 7f510bfff640 1 --2- 172.21.15.49:0/2381004740 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5629e0290010 0x5629e029a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.622+0000 7f5110a42640 1 --2- 172.21.15.49:0/2381004740 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629e0295b70 0x5629e02a19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.622+0000 7f510b7fe640 1 -- 172.21.15.49:0/2381004740 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629e0295b70 msgr2=0x5629e02a19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.622+0000 7f510b7fe640 1 --2- 172.21.15.49:0/2381004740 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629e0295b70 0x5629e02a19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.622+0000 7f510b7fe640 1 -- 172.21.15.49:0/2381004740 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5629e0290010 msgr2=0x5629e029a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.622+0000 7f510b7fe640 1 --2- 172.21.15.49:0/2381004740 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5629e0290010 0x5629e029a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.622+0000 7f510b7fe640 1 -- 172.21.15.49:0/2381004740 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629dff07210 con 0x5629e0290a00 2024-06-03T00:01:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.623+0000 7f510b7fe640 1 --2- 172.21.15.49:0/2381004740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5629e0290a00 0x5629e029a9a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5100031610 tx=0x7f5100032ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eea9aa2fcf27d7b server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.623+0000 7f50eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:01:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.623+0000 7f50eb7fe640 1 -- 172.21.15.49:0/2381004740 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f510004b020 con 0x5629e0290a00 2024-06-03T00:01:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.623+0000 7f50eb7fe640 1 -- 172.21.15.49:0/2381004740 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f5100004450 con 0x5629e0290a00 2024-06-03T00:01:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.623+0000 7f51151b1740 1 -- 172.21.15.49:0/2381004740 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51000318b0 con 0x5629e0290a00 2024-06-03T00:01:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.623+0000 7f50eb7fe640 1 -- 172.21.15.49:0/2381004740 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5100035070 con 0x5629e0290a00 2024-06-03T00:01:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.623+0000 7f51151b1740 10 client.15549 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.623+0000 7f51151b1740 1 -- 172.21.15.49:0/2381004740 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5629dffd3620 con 0x5629e0290a00 2024-06-03T00:01:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.623+0000 7f50eb7fe640 1 -- 172.21.15.49:0/2381004740 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51000318b0 con 0x5629e0290a00 2024-06-03T00:01:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.623+0000 7f50eb7fe640 1 -- 172.21.15.49:0/2381004740 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f5100004b00 con 0x5629e0290a00 2024-06-03T00:01:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.623+0000 7f51151b1740 10 client.15549 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.623+0000 7f51151b1740 10 client.15549 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:01:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.623+0000 7f51151b1740 20 client.15549 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.623+0000 7f51151b1740 1 --2- 172.21.15.49:0/2381004740 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5629e02a5ed0 0x5629e02a82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.623+0000 7f51151b1740 4 client.15549 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:01:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.623+0000 7f51151b1740 1 -- 172.21.15.49:0/2381004740 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629e0206f10 con 0x5629e02a5ed0 2024-06-03T00:01:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.624+0000 7f510bfff640 1 --2- 172.21.15.49:0/2381004740 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5629e02a5ed0 0x5629e02a82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.624+0000 7f510bfff640 1 --2- 172.21.15.49:0/2381004740 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5629e02a5ed0 0x5629e02a82c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45ea3fc6145a0f8c server_cookie=697c579e9ec923c3 in_seq=0 out_seq=0 2024-06-03T00:01:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.624+0000 7f50eb7fe640 10 client.15549 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.625+0000 7f50eb7fe640 1 -- 172.21.15.49:0/2381004740 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5629e0206f10 con 0x5629e02a5ed0 2024-06-03T00:01:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.625+0000 7f50eb7fe640 10 client.15549 handle_command_reply: tid=0 2024-06-03T00:01:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.625+0000 7f51151b1740 1 client.15549 shutdown 2024-06-03T00:01:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.625+0000 7f51151b1740 1 -- 172.21.15.49:0/2381004740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5629e0290a00 msgr2=0x5629e029a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.625+0000 7f51151b1740 1 --2- 172.21.15.49:0/2381004740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5629e0290a00 0x5629e029a9a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5100031610 tx=0x7f5100032ef0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.625+0000 7f51151b1740 1 -- 172.21.15.49:0/2381004740 shutdown_connections 2024-06-03T00:01:30.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.625+0000 7f51151b1740 1 --2- 172.21.15.49:0/2381004740 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5629e02a5ed0 0x5629e02a82c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.625+0000 7f51151b1740 1 --2- 172.21.15.49:0/2381004740 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629e0295b70 0x5629e02a19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.625+0000 7f51151b1740 1 --2- 172.21.15.49:0/2381004740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5629e0290a00 0x5629e029a9a0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.625+0000 7f51151b1740 1 --2- 172.21.15.49:0/2381004740 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5629e0290010 0x5629e029a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.625+0000 7f51151b1740 1 -- 172.21.15.49:0/2381004740 >> 172.21.15.49:0/2381004740 conn(0x5629e028b680 msgr2=0x5629e028a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:30.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.625+0000 7f50eb7fe640 0 client.15549 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:30.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.625+0000 7f51151b1740 1 -- 172.21.15.49:0/2381004740 shutdown_connections 2024-06-03T00:01:30.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.625+0000 7f51151b1740 1 -- 172.21.15.49:0/2381004740 wait complete. 2024-06-03T00:01:30.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.625+0000 7f51151b1740 20 client.15549 trim_cache size 0 max 16384 2024-06-03T00:01:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.640+0000 7f51151b1740 1 Processor -- start 2024-06-03T00:01:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.640+0000 7f51151b1740 1 -- start start 2024-06-03T00:01:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.641+0000 7f51151b1740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5629e0290010 0x5629e0286840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.641+0000 7f51151b1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5629e0290a00 0x5629e02a19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.641+0000 7f51151b1740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629e0295b70 0x5629e0289f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.641+0000 7f51151b1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f510c1ab070 con 0x5629e0290a00 2024-06-03T00:01:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.641+0000 7f51151b1740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f510c1acbb0 con 0x5629e0290010 2024-06-03T00:01:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.641+0000 7f51151b1740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f510c1ab740 con 0x5629e0295b70 2024-06-03T00:01:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.641+0000 7f510b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5629e0290a00 0x5629e02a19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.641+0000 7f510b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5629e0290a00 0x5629e02a19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49074/0 (socket says 172.21.15.49:49074) 2024-06-03T00:01:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.641+0000 7f510b7fe640 1 -- 172.21.15.49:0/2966794813 learned_addr learned my addr 172.21.15.49:0/2966794813 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.641+0000 7f510b7fe640 1 -- 172.21.15.49:0/2966794813 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629e0295b70 msgr2=0x5629e0289f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.641+0000 7f510b7fe640 1 --2- 172.21.15.49:0/2966794813 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629e0295b70 0x5629e0289f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.641+0000 7f510b7fe640 1 -- 172.21.15.49:0/2966794813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5629e0290010 msgr2=0x5629e0286840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.641+0000 7f510b7fe640 1 --2- 172.21.15.49:0/2966794813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5629e0290010 0x5629e0286840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.641+0000 7f510b7fe640 1 -- 172.21.15.49:0/2966794813 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629e02950d0 con 0x5629e0290a00 2024-06-03T00:01:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.641+0000 7f510b7fe640 1 --2- 172.21.15.49:0/2966794813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5629e0290a00 0x5629e02a19a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5100005110 tx=0x7f5100005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42739fbf602c34f8 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.641+0000 7f50f1ffb640 1 -- 172.21.15.49:0/2966794813 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f510004b070 con 0x5629e0290a00 2024-06-03T00:01:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.641+0000 7f50f1ffb640 1 -- 172.21.15.49:0/2966794813 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51000318b0 con 0x5629e0290a00 2024-06-03T00:01:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.641+0000 7f50f1ffb640 1 -- 172.21.15.49:0/2966794813 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5100040040 con 0x5629e0290a00 2024-06-03T00:01:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.642+0000 7f51151b1740 1 -- 172.21.15.49:0/2966794813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5629e0290a00 msgr2=0x5629e02a19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.642+0000 7f51151b1740 1 --2- 172.21.15.49:0/2966794813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5629e0290a00 0x5629e02a19a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5100005110 tx=0x7f5100005fd0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.642+0000 7f51151b1740 1 -- 172.21.15.49:0/2966794813 shutdown_connections 2024-06-03T00:01:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.642+0000 7f51151b1740 1 --2- 172.21.15.49:0/2966794813 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629e0295b70 0x5629e0289f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.642+0000 7f51151b1740 1 --2- 172.21.15.49:0/2966794813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5629e0290a00 0x5629e02a19a0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.645 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.642+0000 7f51151b1740 1 --2- 172.21.15.49:0/2966794813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5629e0290010 0x5629e0286840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.645 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.642+0000 7f51151b1740 1 -- 172.21.15.49:0/2966794813 >> 172.21.15.49:0/2966794813 conn(0x5629e028b680 msgr2=0x5629e0291dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:30.645 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.642+0000 7f51151b1740 1 -- 172.21.15.49:0/2966794813 shutdown_connections 2024-06-03T00:01:30.645 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.642+0000 7f51151b1740 1 -- 172.21.15.49:0/2966794813 wait complete. 2024-06-03T00:01:30.645 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.642+0000 7f51151b1740 1 -- start start 2024-06-03T00:01:30.645 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.642+0000 7f51151b1740 1 Processor -- start 2024-06-03T00:01:30.647 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.643+0000 7f51151b1740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5629e0290010 0x5629e029ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.643+0000 7f51151b1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5629e0290a00 0x5629e029f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.643+0000 7f51151b1740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629e0295b70 0x5629e029ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.643+0000 7f51151b1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f510c1ac4e0 con 0x5629e0290a00 2024-06-03T00:01:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.643+0000 7f51151b1740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f510c1abe10 con 0x5629e0290010 2024-06-03T00:01:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.643+0000 7f51151b1740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f510c1a9030 con 0x5629e0295b70 2024-06-03T00:01:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.643+0000 7f51151b1740 10 client.0 _ll_register_callbacks cb 0x7f5100032c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.643+0000 7f510b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5629e0290a00 0x5629e029f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.643+0000 7f510b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5629e0290a00 0x5629e029f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49078/0 (socket says 172.21.15.49:49078) 2024-06-03T00:01:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.643+0000 7f510b7fe640 1 -- 172.21.15.49:0/2639984371 learned_addr learned my addr 172.21.15.49:0/2639984371 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.643+0000 7f510bfff640 1 --2- 172.21.15.49:0/2639984371 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5629e0290010 0x5629e029ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.643+0000 7f5110a42640 1 --2- 172.21.15.49:0/2639984371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629e0295b70 0x5629e029ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.643+0000 7f510b7fe640 1 -- 172.21.15.49:0/2639984371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629e0295b70 msgr2=0x5629e029ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:30.649 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.643+0000 7f510b7fe640 1 --2- 172.21.15.49:0/2639984371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629e0295b70 0x5629e029ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.649 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.643+0000 7f510b7fe640 1 -- 172.21.15.49:0/2639984371 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5629e0290010 msgr2=0x5629e029ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:30.649 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.643+0000 7f510b7fe640 1 --2- 172.21.15.49:0/2639984371 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5629e0290010 0x5629e029ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.649 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.643+0000 7f510b7fe640 1 -- 172.21.15.49:0/2639984371 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629e02a0570 con 0x5629e0290a00 2024-06-03T00:01:30.649 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.643+0000 7f510b7fe640 1 --2- 172.21.15.49:0/2639984371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5629e0290a00 0x5629e029f010 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f510002a930 tx=0x7f5100005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897202b6125a4323 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:30.649 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.643+0000 7f50eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:01:30.649 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.643+0000 7f50eb7fe640 1 -- 172.21.15.49:0/2639984371 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5100040030 con 0x5629e0290a00 2024-06-03T00:01:30.649 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.643+0000 7f50eb7fe640 1 -- 172.21.15.49:0/2639984371 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f5100004b90 con 0x5629e0290a00 2024-06-03T00:01:30.649 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.643+0000 7f51151b1740 1 -- 172.21.15.49:0/2639984371 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51000318b0 con 0x5629e0290a00 2024-06-03T00:01:30.649 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.644+0000 7f50eb7fe640 1 -- 172.21.15.49:0/2639984371 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f510004b040 con 0x5629e0290a00 2024-06-03T00:01:30.649 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.644+0000 7f51151b1740 10 client.15555 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:30.649 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.644+0000 7f51151b1740 1 -- 172.21.15.49:0/2639984371 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5629e02a1880 con 0x5629e0290a00 2024-06-03T00:01:30.649 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.644+0000 7f50eb7fe640 1 -- 172.21.15.49:0/2639984371 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51000318b0 con 0x5629e0290a00 2024-06-03T00:01:30.649 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.644+0000 7f50eb7fe640 1 -- 172.21.15.49:0/2639984371 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f510003c740 con 0x5629e0290a00 2024-06-03T00:01:30.650 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.644+0000 7f51151b1740 10 client.15555 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:30.650 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.644+0000 7f51151b1740 10 client.15555 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:01:30.650 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.644+0000 7f51151b1740 20 client.15555 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:30.650 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.644+0000 7f51151b1740 1 --2- 172.21.15.49:0/2639984371 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5629e0310d70 0x5629e0313160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:30.650 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.644+0000 7f51151b1740 4 client.15555 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-03T00:01:30.650 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.644+0000 7f51151b1740 1 -- 172.21.15.49:0/2639984371 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5629e0200c20 con 0x5629e0310d70 2024-06-03T00:01:30.650 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.644+0000 7f510bfff640 1 --2- 172.21.15.49:0/2639984371 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5629e0310d70 0x5629e0313160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:30.650 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.645+0000 7f50eb7fe640 10 client.15555 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:30.650 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.645+0000 7f510bfff640 1 --2- 172.21.15.49:0/2639984371 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5629e0310d70 0x5629e0313160 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8272e47280575ca server_cookie=49121366df28a253 in_seq=0 out_seq=0 2024-06-03T00:01:30.651 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.648+0000 7f50eb7fe640 1 -- 172.21.15.49:0/2639984371 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5629e0200c20 con 0x5629e0310d70 2024-06-03T00:01:30.651 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.648+0000 7f50eb7fe640 10 client.15555 handle_command_reply: tid=0 2024-06-03T00:01:30.651 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.649+0000 7f51151b1740 1 client.15555 shutdown 2024-06-03T00:01:30.651 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.649+0000 7f51151b1740 1 -- 172.21.15.49:0/2639984371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5629e0290a00 msgr2=0x5629e029f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:30.651 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.649+0000 7f51151b1740 1 --2- 172.21.15.49:0/2639984371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5629e0290a00 0x5629e029f010 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f510002a930 tx=0x7f5100005bc0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.649+0000 7f51151b1740 1 -- 172.21.15.49:0/2639984371 shutdown_connections 2024-06-03T00:01:30.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.649+0000 7f51151b1740 1 --2- 172.21.15.49:0/2639984371 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5629e0310d70 0x5629e0313160 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.649+0000 7f51151b1740 1 --2- 172.21.15.49:0/2639984371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5629e0295b70 0x5629e029ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.649+0000 7f51151b1740 1 --2- 172.21.15.49:0/2639984371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5629e0290a00 0x5629e029f010 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.649+0000 7f50eb7fe640 0 client.15555 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:30.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.649+0000 7f51151b1740 1 --2- 172.21.15.49:0/2639984371 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5629e0290010 0x5629e029ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.649+0000 7f51151b1740 1 -- 172.21.15.49:0/2639984371 >> 172.21.15.49:0/2639984371 conn(0x5629e028b680 msgr2=0x5629e028e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:30.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.649+0000 7f51151b1740 1 -- 172.21.15.49:0/2639984371 shutdown_connections 2024-06-03T00:01:30.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.649+0000 7f51151b1740 1 -- 172.21.15.49:0/2639984371 wait complete. 2024-06-03T00:01:30.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.649+0000 7f51151b1740 20 client.15555 trim_cache size 0 max 16384 2024-06-03T00:01:30.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-06-03T00:01:30.653 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-06-03T00:01:30.653 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-06-03T00:01:30.654 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.649+0000 7f51124a5640 1 -- 172.21.15.49:0/3772252333 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f50f40a2cb0 msgr2=0x7f50f40a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:30.654 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.649+0000 7f51124a5640 1 --2- 172.21.15.49:0/3772252333 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f50f40a2cb0 0x7f50f40a5170 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f50fc005fd0 tx=0x7f50fc00b410 comp rx=0 tx=0).stop 2024-06-03T00:01:30.654 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.649+0000 7f51124a5640 1 -- 172.21.15.49:0/3772252333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f510c1024b0 msgr2=0x7f510c109e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:30.654 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.649+0000 7f51124a5640 1 --2- 172.21.15.49:0/3772252333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f510c1024b0 0x7f510c109e00 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f510400eaa0 tx=0x7f510400ef60 comp rx=0 tx=0).stop 2024-06-03T00:01:30.654 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.649+0000 7f51124a5640 1 -- 172.21.15.49:0/3772252333 shutdown_connections 2024-06-03T00:01:30.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.649+0000 7f51124a5640 1 --2- 172.21.15.49:0/3772252333 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f50f40a2cb0 0x7f50f40a5170 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.649+0000 7f51124a5640 1 --2- 172.21.15.49:0/3772252333 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f510c101af0 0x7f510c1098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.650+0000 7f51124a5640 1 --2- 172.21.15.49:0/3772252333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f510c1024b0 0x7f510c109e00 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.650+0000 7f51124a5640 1 --2- 172.21.15.49:0/3772252333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f510c100900 0x7f510c10b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.650+0000 7f51124a5640 1 -- 172.21.15.49:0/3772252333 >> 172.21.15.49:0/3772252333 conn(0x7f510c0fbe70 msgr2=0x7f510c104df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:30.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.650+0000 7f51124a5640 1 -- 172.21.15.49:0/3772252333 shutdown_connections 2024-06-03T00:01:30.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:30.650+0000 7f51124a5640 1 -- 172.21.15.49:0/3772252333 wait complete. 2024-06-03T00:01:30.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:30 smithi057 ceph-mon[36457]: pgmap v427: 97 pgs: 97 active+clean; 661 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:01:30.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:30 smithi049 ceph-mon[32302]: pgmap v427: 97 pgs: 97 active+clean; 661 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:01:30.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:30 smithi107 ceph-mon[37048]: pgmap v427: 97 pgs: 97 active+clean; 661 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:01:30.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.973+0000 7f9798d01700 1 -- 172.21.15.49:0/2789206781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97941084f0 msgr2=0x7f97941088d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:30.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.973+0000 7f9798d01700 1 --2- 172.21.15.49:0/2789206781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97941084f0 0x7f97941088d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f978400b0a0 tx=0x7f978400b3b0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.973+0000 7f9798d01700 1 -- 172.21.15.49:0/2789206781 shutdown_connections 2024-06-03T00:01:30.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.973+0000 7f9798d01700 1 --2- 172.21.15.49:0/2789206781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9794102e80 0x7f979410f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.973+0000 7f9798d01700 1 --2- 172.21.15.49:0/2789206781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97941084f0 0x7f97941088d0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.973+0000 7f9798d01700 1 --2- 172.21.15.49:0/2789206781 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97941024e0 0x7f9794102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.973+0000 7f9798d01700 1 -- 172.21.15.49:0/2789206781 >> 172.21.15.49:0/2789206781 conn(0x7f9794079530 msgr2=0x7f9794079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:30.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.973+0000 7f9798d01700 1 -- 172.21.15.49:0/2789206781 shutdown_connections 2024-06-03T00:01:30.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.973+0000 7f9798d01700 1 -- 172.21.15.49:0/2789206781 wait complete. 2024-06-03T00:01:30.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.974+0000 7f9798d01700 1 Processor -- start 2024-06-03T00:01:30.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.974+0000 7f9798d01700 1 -- start start 2024-06-03T00:01:30.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.974+0000 7f9798d01700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97941024e0 0x7f979419e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:30.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.974+0000 7f9798d01700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9794102e80 0x7f979419ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:30.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.974+0000 7f9798d01700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97941084f0 0x7f9794198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:30.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.974+0000 7f9798d01700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9794112780 con 0x7f9794102e80 2024-06-03T00:01:30.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.974+0000 7f9798d01700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9794112600 con 0x7f97941084f0 2024-06-03T00:01:30.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.974+0000 7f9798d01700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9794112900 con 0x7f97941024e0 2024-06-03T00:01:30.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.974+0000 7f9789d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9794102e80 0x7f979419ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:30.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.974+0000 7f9789d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9794102e80 0x7f979419ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49094/0 (socket says 172.21.15.49:49094) 2024-06-03T00:01:30.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.974+0000 7f9789d9b700 1 -- 172.21.15.49:0/4063993725 learned_addr learned my addr 172.21.15.49:0/4063993725 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:30.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.974+0000 7f979259c700 1 --2- 172.21.15.49:0/4063993725 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97941024e0 0x7f979419e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:30.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.974+0000 7f9792d9d700 1 --2- 172.21.15.49:0/4063993725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97941084f0 0x7f9794198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:30.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.975+0000 7f9789d9b700 1 -- 172.21.15.49:0/4063993725 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97941024e0 msgr2=0x7f979419e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:30.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.975+0000 7f9789d9b700 1 --2- 172.21.15.49:0/4063993725 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97941024e0 0x7f979419e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.975+0000 7f9789d9b700 1 -- 172.21.15.49:0/4063993725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97941084f0 msgr2=0x7f9794198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:30.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.975+0000 7f9789d9b700 1 --2- 172.21.15.49:0/4063993725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97941084f0 0x7f9794198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.975+0000 7f9789d9b700 1 -- 172.21.15.49:0/4063993725 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97941991e0 con 0x7f9794102e80 2024-06-03T00:01:30.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.975+0000 7f9792d9d700 1 --2- 172.21.15.49:0/4063993725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97941084f0 0x7f9794198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:30.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.975+0000 7f9789d9b700 1 --2- 172.21.15.49:0/4063993725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9794102e80 0x7f979419ee00 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f977c00e9a0 tx=0x7f977c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:30.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.975+0000 7f978bfff700 1 -- 172.21.15.49:0/4063993725 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977c00cbd0 con 0x7f9794102e80 2024-06-03T00:01:30.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.975+0000 7f978bfff700 1 -- 172.21.15.49:0/4063993725 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f977c00cd70 con 0x7f9794102e80 2024-06-03T00:01:30.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.975+0000 7f9798d01700 1 -- 172.21.15.49:0/4063993725 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97941994d0 con 0x7f9794102e80 2024-06-03T00:01:30.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.975+0000 7f978bfff700 1 -- 172.21.15.49:0/4063993725 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977c018750 con 0x7f9794102e80 2024-06-03T00:01:30.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.975+0000 7f9798d01700 1 -- 172.21.15.49:0/4063993725 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97941a5790 con 0x7f9794102e80 2024-06-03T00:01:30.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.978+0000 7f978bfff700 1 -- 172.21.15.49:0/4063993725 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f977c010430 con 0x7f9794102e80 2024-06-03T00:01:30.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.978+0000 7f978bfff700 1 --2- 172.21.15.49:0/4063993725 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f97800a2ca0 0x7f97800a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:30.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.978+0000 7f979259c700 1 --2- 172.21.15.49:0/4063993725 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f97800a2ca0 0x7f97800a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:30.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.978+0000 7f978bfff700 1 -- 172.21.15.49:0/4063993725 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f977c0cf280 con 0x7f9794102e80 2024-06-03T00:01:30.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.979+0000 7f979259c700 1 --2- 172.21.15.49:0/4063993725 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f97800a2ca0 0x7f97800a5160 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9794199bc0 tx=0x7f9784006210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:30.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.979+0000 7f97a3584b80 1 Processor -- start 2024-06-03T00:01:30.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.979+0000 7f97a3584b80 1 -- start start 2024-06-03T00:01:30.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.979+0000 7f97a3584b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb88955640 0x55fb88955a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:30.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.979+0000 7f97a3584b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb88955f60 0x55fb8894f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:30.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.979+0000 7f97a3584b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb8894ff20 0x55fb88950340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:30.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.979+0000 7f97a3584b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55fb888a1810 con 0x55fb88955640 2024-06-03T00:01:30.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.979+0000 7f97a3584b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55fb88849720 con 0x55fb8894ff20 2024-06-03T00:01:30.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.979+0000 7f97a3584b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55fb8889d7d0 con 0x55fb88955f60 2024-06-03T00:01:30.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.980+0000 7f979259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb88955640 0x55fb88955a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:30.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.980+0000 7f979259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb88955640 0x55fb88955a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49110/0 (socket says 172.21.15.49:49110) 2024-06-03T00:01:30.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.980+0000 7f979259c700 1 -- 172.21.15.49:0/1867712385 learned_addr learned my addr 172.21.15.49:0/1867712385 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:30.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.980+0000 7f9789d9b700 1 --2- 172.21.15.49:0/1867712385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb88955f60 0x55fb8894f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:30.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.980+0000 7f9792d9d700 1 --2- 172.21.15.49:0/1867712385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb8894ff20 0x55fb88950340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:30.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.980+0000 7f979259c700 1 -- 172.21.15.49:0/1867712385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb88955f60 msgr2=0x55fb8894f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:30.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.980+0000 7f979259c700 1 --2- 172.21.15.49:0/1867712385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb88955f60 0x55fb8894f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.980+0000 7f979259c700 1 -- 172.21.15.49:0/1867712385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb8894ff20 msgr2=0x55fb88950340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:30.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.980+0000 7f979259c700 1 --2- 172.21.15.49:0/1867712385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb8894ff20 0x55fb88950340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.980+0000 7f979259c700 1 -- 172.21.15.49:0/1867712385 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb8883ff50 con 0x55fb88955640 2024-06-03T00:01:30.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.980+0000 7f979259c700 1 --2- 172.21.15.49:0/1867712385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb88955640 0x55fb88955a20 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f978400b0a0 tx=0x7f978401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b81255109781de server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:30.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.980+0000 7f9788d99700 1 -- 172.21.15.49:0/1867712385 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9784003e60 con 0x55fb88955640 2024-06-03T00:01:30.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.980+0000 7f9788d99700 1 -- 172.21.15.49:0/1867712385 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f978402e070 con 0x55fb88955640 2024-06-03T00:01:30.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.981+0000 7f9788d99700 1 -- 172.21.15.49:0/1867712385 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9784029960 con 0x55fb88955640 2024-06-03T00:01:30.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.981+0000 7f97a3584b80 1 -- 172.21.15.49:0/1867712385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb88955640 msgr2=0x55fb88955a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:30.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.981+0000 7f97a3584b80 1 --2- 172.21.15.49:0/1867712385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb88955640 0x55fb88955a20 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f978400b0a0 tx=0x7f978401d000 comp rx=0 tx=0).stop 2024-06-03T00:01:30.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.981+0000 7f97a3584b80 1 -- 172.21.15.49:0/1867712385 shutdown_connections 2024-06-03T00:01:30.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.981+0000 7f97a3584b80 1 --2- 172.21.15.49:0/1867712385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb8894ff20 0x55fb88950340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.981+0000 7f97a3584b80 1 --2- 172.21.15.49:0/1867712385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb88955640 0x55fb88955a20 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.981+0000 7f97a3584b80 1 --2- 172.21.15.49:0/1867712385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb88955f60 0x55fb8894f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.981+0000 7f97a3584b80 1 -- 172.21.15.49:0/1867712385 >> 172.21.15.49:0/1867712385 conn(0x55fb8887acc0 msgr2=0x55fb8894a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:30.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.981+0000 7f97a3584b80 1 -- 172.21.15.49:0/1867712385 shutdown_connections 2024-06-03T00:01:30.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.981+0000 7f97a3584b80 1 -- 172.21.15.49:0/1867712385 wait complete. 2024-06-03T00:01:30.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.982+0000 7f97a3584b80 1 -- start start 2024-06-03T00:01:30.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.982+0000 7f97a3584b80 1 Processor -- start 2024-06-03T00:01:30.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.982+0000 7f97a3584b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb8894ff20 0x55fb8895bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:30.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.982+0000 7f97a3584b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb88955640 0x55fb88958fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:30.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.982+0000 7f97a3584b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb88955f60 0x55fb88959500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:30.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.982+0000 7f97a3584b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55fb8895c970 con 0x55fb88955640 2024-06-03T00:01:30.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.982+0000 7f97a3584b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55fb88841bf0 con 0x55fb8894ff20 2024-06-03T00:01:30.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.982+0000 7f97a3584b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55fb8895caf0 con 0x55fb88955f60 2024-06-03T00:01:30.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.982+0000 7f97a3584b80 10 client.0 _ll_register_callbacks cb 0x55fb8883b920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:30.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.982+0000 7f9789d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb88955640 0x55fb88958fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:30.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.982+0000 7f9789d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb88955640 0x55fb88958fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49126/0 (socket says 172.21.15.49:49126) 2024-06-03T00:01:30.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.982+0000 7f9789d9b700 1 -- 172.21.15.49:0/3534110221 learned_addr learned my addr 172.21.15.49:0/3534110221 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:30.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.983+0000 7f979259c700 1 --2- 172.21.15.49:0/3534110221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb8894ff20 0x55fb8895bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:30.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.983+0000 7f9792d9d700 1 --2- 172.21.15.49:0/3534110221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb88955f60 0x55fb88959500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:30.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.983+0000 7f9789d9b700 1 -- 172.21.15.49:0/3534110221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb88955f60 msgr2=0x55fb88959500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:30.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.983+0000 7f9789d9b700 1 --2- 172.21.15.49:0/3534110221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb88955f60 0x55fb88959500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.983+0000 7f9789d9b700 1 -- 172.21.15.49:0/3534110221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb8894ff20 msgr2=0x55fb8895bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:30.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.983+0000 7f9789d9b700 1 --2- 172.21.15.49:0/3534110221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb8894ff20 0x55fb8895bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.983+0000 7f9789d9b700 1 -- 172.21.15.49:0/3534110221 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb887f08d0 con 0x55fb88955640 2024-06-03T00:01:30.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.983+0000 7f9792d9d700 1 --2- 172.21.15.49:0/3534110221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb88955f60 0x55fb88959500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:30.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.983+0000 7f9789d9b700 1 --2- 172.21.15.49:0/3534110221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb88955640 0x55fb88958fc0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f977c00c5b0 tx=0x7f977c09c020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f97e6bf6cfce6c74 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:30.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.983+0000 7f9779ffb700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:01:30.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.983+0000 7f9779ffb700 1 -- 172.21.15.49:0/3534110221 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977c0a4750 con 0x55fb88955640 2024-06-03T00:01:30.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.983+0000 7f9779ffb700 1 -- 172.21.15.49:0/3534110221 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f977c099de0 con 0x55fb88955640 2024-06-03T00:01:30.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.983+0000 7f97a3584b80 1 -- 172.21.15.49:0/3534110221 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f978402e070 con 0x55fb88955640 2024-06-03T00:01:30.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.983+0000 7f9779ffb700 1 -- 172.21.15.49:0/3534110221 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f977c0109a0 con 0x55fb88955640 2024-06-03T00:01:30.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.983+0000 7f97a3584b80 10 client.15567 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:30.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.983+0000 7f97a3584b80 1 -- 172.21.15.49:0/3534110221 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fb889672d0 con 0x55fb88955640 2024-06-03T00:01:30.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.984+0000 7f9779ffb700 1 -- 172.21.15.49:0/3534110221 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f978402e070 con 0x55fb88955640 2024-06-03T00:01:30.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.984+0000 7f9779ffb700 1 -- 172.21.15.49:0/3534110221 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f977c0b4ce0 con 0x55fb88955640 2024-06-03T00:01:30.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.984+0000 7f97a3584b80 10 client.15567 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:30.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.984+0000 7f97a3584b80 10 client.15567 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-03T00:01:30.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.984+0000 7f97a3584b80 20 client.15567 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:30.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.984+0000 7f97a3584b80 1 --2- 172.21.15.49:0/3534110221 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x55fb88969910 0x55fb8896bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:30.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.984+0000 7f97a3584b80 4 client.15567 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:01:30.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.984+0000 7f97a3584b80 1 -- 172.21.15.49:0/3534110221 --> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb888aed10 con 0x55fb88969910 2024-06-03T00:01:30.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.984+0000 7f979259c700 1 --2- 172.21.15.49:0/3534110221 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x55fb88969910 0x55fb8896bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:30.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.985+0000 7f9779ffb700 10 client.15567 ms_handle_connect on v2:172.21.15.107:6836/3700593315 2024-06-03T00:01:30.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.985+0000 7f979259c700 1 --2- 172.21.15.49:0/3534110221 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x55fb88969910 0x55fb8896bd30 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4987e3264a856d01 server_cookie=e002f7cac5abf7f3 in_seq=0 out_seq=0 2024-06-03T00:01:30.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.985+0000 7f9779ffb700 1 -- 172.21.15.49:0/3534110221 <== mds.2 v2:172.21.15.107:6836/3700593315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55fb888aed10 con 0x55fb88969910 2024-06-03T00:01:30.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.985+0000 7f9779ffb700 10 client.15567 handle_command_reply: tid=0 2024-06-03T00:01:30.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.985+0000 7f97a3584b80 1 client.15567 shutdown 2024-06-03T00:01:30.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.986+0000 7f97a3584b80 1 -- 172.21.15.49:0/3534110221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb88955640 msgr2=0x55fb88958fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:30.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.986+0000 7f97a3584b80 1 --2- 172.21.15.49:0/3534110221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb88955640 0x55fb88958fc0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f977c00c5b0 tx=0x7f977c09c020 comp rx=0 tx=0).stop 2024-06-03T00:01:30.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.986+0000 7f97a3584b80 1 -- 172.21.15.49:0/3534110221 shutdown_connections 2024-06-03T00:01:30.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.986+0000 7f97a3584b80 1 --2- 172.21.15.49:0/3534110221 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x55fb88969910 0x55fb8896bd30 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.986+0000 7f97a3584b80 1 --2- 172.21.15.49:0/3534110221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb88955f60 0x55fb88959500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.986+0000 7f97a3584b80 1 --2- 172.21.15.49:0/3534110221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb8894ff20 0x55fb8895bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.986+0000 7f97a3584b80 1 --2- 172.21.15.49:0/3534110221 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb88955640 0x55fb88958fc0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:30.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.986+0000 7f97a3584b80 1 -- 172.21.15.49:0/3534110221 >> 172.21.15.49:0/3534110221 conn(0x55fb8887acc0 msgr2=0x55fb8894a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:30.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.986+0000 7f9779ffb700 0 client.15567 ms_handle_reset on v2:172.21.15.107:6836/3700593315 2024-06-03T00:01:30.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.986+0000 7f97a3584b80 1 -- 172.21.15.49:0/3534110221 shutdown_connections 2024-06-03T00:01:30.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.986+0000 7f97a3584b80 1 -- 172.21.15.49:0/3534110221 wait complete. 2024-06-03T00:01:30.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:30.986+0000 7f97a3584b80 20 client.15567 trim_cache size 0 max 16384 2024-06-03T00:01:31.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.001+0000 7f97a3584b80 1 Processor -- start 2024-06-03T00:01:31.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.001+0000 7f97a3584b80 1 -- start start 2024-06-03T00:01:31.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.001+0000 7f97a3584b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb8894ff20 0x55fb8894f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:31.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.001+0000 7f97a3584b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb88955640 0x55fb88944510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:31.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.001+0000 7f97a3584b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb88955f60 0x55fb8895a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:31.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.001+0000 7f97a3584b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f97941acc90 con 0x55fb8894ff20 2024-06-03T00:01:31.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.001+0000 7f97a3584b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f97941ae7d0 con 0x55fb88955f60 2024-06-03T00:01:31.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.001+0000 7f97a3584b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f97941ad360 con 0x55fb88955640 2024-06-03T00:01:31.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.002+0000 7f979259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb8894ff20 0x55fb8894f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:31.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.002+0000 7f979259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb8894ff20 0x55fb8894f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49140/0 (socket says 172.21.15.49:49140) 2024-06-03T00:01:31.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.002+0000 7f979259c700 1 -- 172.21.15.49:0/1932319831 learned_addr learned my addr 172.21.15.49:0/1932319831 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:31.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.002+0000 7f9792d9d700 1 --2- 172.21.15.49:0/1932319831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb88955f60 0x55fb8895a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:31.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.002+0000 7f9789d9b700 1 --2- 172.21.15.49:0/1932319831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb88955640 0x55fb88944510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:31.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.002+0000 7f979259c700 1 -- 172.21.15.49:0/1932319831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb88955640 msgr2=0x55fb88944510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:31.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.002+0000 7f979259c700 1 --2- 172.21.15.49:0/1932319831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb88955640 0x55fb88944510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:31.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.002+0000 7f979259c700 1 -- 172.21.15.49:0/1932319831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb88955f60 msgr2=0x55fb8895a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:31.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.002+0000 7f979259c700 1 --2- 172.21.15.49:0/1932319831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb88955f60 0x55fb8895a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:31.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.002+0000 7f979259c700 1 -- 172.21.15.49:0/1932319831 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb8896c390 con 0x55fb8894ff20 2024-06-03T00:01:31.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.002+0000 7f9789d9b700 1 --2- 172.21.15.49:0/1932319831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb88955640 0x55fb88944510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:01:31.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.002+0000 7f979259c700 1 --2- 172.21.15.49:0/1932319831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb8894ff20 0x55fb8894f9e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f97840062a0 tx=0x7f9784029520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5082a926a254f1cf server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:31.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.002+0000 7f977bfff700 1 -- 172.21.15.49:0/1932319831 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978403a070 con 0x55fb8894ff20 2024-06-03T00:01:31.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.002+0000 7f977bfff700 1 -- 172.21.15.49:0/1932319831 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f978402e070 con 0x55fb8894ff20 2024-06-03T00:01:31.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.002+0000 7f977bfff700 1 -- 172.21.15.49:0/1932319831 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9784003e60 con 0x55fb8894ff20 2024-06-03T00:01:31.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.003+0000 7f97a3584b80 1 -- 172.21.15.49:0/1932319831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb8894ff20 msgr2=0x55fb8894f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:31.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.003+0000 7f97a3584b80 1 --2- 172.21.15.49:0/1932319831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb8894ff20 0x55fb8894f9e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f97840062a0 tx=0x7f9784029520 comp rx=0 tx=0).stop 2024-06-03T00:01:31.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.003+0000 7f97a3584b80 1 -- 172.21.15.49:0/1932319831 shutdown_connections 2024-06-03T00:01:31.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.003+0000 7f97a3584b80 1 --2- 172.21.15.49:0/1932319831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb88955f60 0x55fb8895a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:31.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.003+0000 7f97a3584b80 1 --2- 172.21.15.49:0/1932319831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb8894ff20 0x55fb8894f9e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:31.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.003+0000 7f97a3584b80 1 --2- 172.21.15.49:0/1932319831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb88955640 0x55fb88944510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:31.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.003+0000 7f97a3584b80 1 -- 172.21.15.49:0/1932319831 >> 172.21.15.49:0/1932319831 conn(0x55fb8887acc0 msgr2=0x55fb88943e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:31.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.003+0000 7f97a3584b80 1 -- 172.21.15.49:0/1932319831 shutdown_connections 2024-06-03T00:01:31.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.003+0000 7f97a3584b80 1 -- 172.21.15.49:0/1932319831 wait complete. 2024-06-03T00:01:31.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.003+0000 7f97a3584b80 1 -- start start 2024-06-03T00:01:31.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.003+0000 7f97a3584b80 1 Processor -- start 2024-06-03T00:01:31.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.004+0000 7f97a3584b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb8894ff20 0x55fb889623f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:31.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.004+0000 7f97a3584b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb88955640 0x55fb88970d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:31.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.004+0000 7f97a3584b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb88955f60 0x55fb889712b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:31.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.004+0000 7f97a3584b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f97941ae100 con 0x55fb88955640 2024-06-03T00:01:31.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.004+0000 7f97a3584b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f97941ada30 con 0x55fb8894ff20 2024-06-03T00:01:31.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.004+0000 7f97a3584b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f97941aac10 con 0x55fb88955f60 2024-06-03T00:01:31.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.004+0000 7f9789d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb88955640 0x55fb88970d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:31.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.004+0000 7f97a3584b80 10 client.0 _ll_register_callbacks cb 0x55fb8883b920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:31.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.004+0000 7f9789d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb88955640 0x55fb88970d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49150/0 (socket says 172.21.15.49:49150) 2024-06-03T00:01:31.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.004+0000 7f9789d9b700 1 -- 172.21.15.49:0/199899013 learned_addr learned my addr 172.21.15.49:0/199899013 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:31.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.004+0000 7f979259c700 1 --2- 172.21.15.49:0/199899013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb8894ff20 0x55fb889623f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:31.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.004+0000 7f9792d9d700 1 --2- 172.21.15.49:0/199899013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb88955f60 0x55fb889712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:31.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.004+0000 7f9789d9b700 1 -- 172.21.15.49:0/199899013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb88955f60 msgr2=0x55fb889712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:31.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.004+0000 7f9789d9b700 1 --2- 172.21.15.49:0/199899013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb88955f60 0x55fb889712b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:31.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.004+0000 7f9789d9b700 1 -- 172.21.15.49:0/199899013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb8894ff20 msgr2=0x55fb889623f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:31.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.004+0000 7f9789d9b700 1 --2- 172.21.15.49:0/199899013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb8894ff20 0x55fb889623f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:31.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.004+0000 7f9789d9b700 1 -- 172.21.15.49:0/199899013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb889718f0 con 0x55fb88955640 2024-06-03T00:01:31.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.004+0000 7f979259c700 1 --2- 172.21.15.49:0/199899013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb8894ff20 0x55fb889623f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:01:31.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.004+0000 7f9789d9b700 1 --2- 172.21.15.49:0/199899013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb88955640 0x55fb88970d70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f977c099d90 tx=0x7f977c010d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f45663ead6343f2 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:31.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.004+0000 7f9779ffb700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:01:31.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.005+0000 7f9779ffb700 1 -- 172.21.15.49:0/199899013 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977c0a4750 con 0x55fb88955640 2024-06-03T00:01:31.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.005+0000 7f9779ffb700 1 -- 172.21.15.49:0/199899013 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f977c09aa90 con 0x55fb88955640 2024-06-03T00:01:31.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.005+0000 7f97a3584b80 1 -- 172.21.15.49:0/199899013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f978402e070 con 0x55fb88955640 2024-06-03T00:01:31.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.005+0000 7f9779ffb700 1 -- 172.21.15.49:0/199899013 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f977c09ac90 con 0x55fb88955640 2024-06-03T00:01:31.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.005+0000 7f97a3584b80 10 client.15573 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:31.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.005+0000 7f97a3584b80 1 -- 172.21.15.49:0/199899013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fb889d8760 con 0x55fb88955640 2024-06-03T00:01:31.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.005+0000 7f9779ffb700 1 -- 172.21.15.49:0/199899013 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f978402e070 con 0x55fb88955640 2024-06-03T00:01:31.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.005+0000 7f9779ffb700 1 -- 172.21.15.49:0/199899013 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f977c0a1020 con 0x55fb88955640 2024-06-03T00:01:31.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.005+0000 7f97a3584b80 10 client.15573 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:31.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.005+0000 7f97a3584b80 10 client.15573 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-03T00:01:31.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.005+0000 7f97a3584b80 20 client.15573 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:31.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.005+0000 7f97a3584b80 1 --2- 172.21.15.49:0/199899013 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x55fb889d8cd0 0x55fb889db0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:31.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.005+0000 7f97a3584b80 4 client.15573 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-03T00:01:31.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.005+0000 7f97a3584b80 1 -- 172.21.15.49:0/199899013 --> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fb888a9290 con 0x55fb889d8cd0 2024-06-03T00:01:31.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.005+0000 7f979259c700 1 --2- 172.21.15.49:0/199899013 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x55fb889d8cd0 0x55fb889db0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:31.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.006+0000 7f9779ffb700 10 client.15573 ms_handle_connect on v2:172.21.15.107:6836/3700593315 2024-06-03T00:01:31.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.006+0000 7f979259c700 1 --2- 172.21.15.49:0/199899013 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x55fb889d8cd0 0x55fb889db0f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=60b4895e567c7a9c server_cookie=6ff77be801f34428 in_seq=0 out_seq=0 2024-06-03T00:01:31.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.006+0000 7f9779ffb700 1 -- 172.21.15.49:0/199899013 <== mds.2 v2:172.21.15.107:6836/3700593315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fb888a9290 con 0x55fb889d8cd0 2024-06-03T00:01:31.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.006+0000 7f9779ffb700 10 client.15573 handle_command_reply: tid=0 2024-06-03T00:01:31.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.006+0000 7f97a3584b80 1 client.15573 shutdown 2024-06-03T00:01:31.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.006+0000 7f97a3584b80 1 -- 172.21.15.49:0/199899013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb88955640 msgr2=0x55fb88970d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:31.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.006+0000 7f97a3584b80 1 --2- 172.21.15.49:0/199899013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb88955640 0x55fb88970d70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f977c099d90 tx=0x7f977c010d10 comp rx=0 tx=0).stop 2024-06-03T00:01:31.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.006+0000 7f97a3584b80 1 -- 172.21.15.49:0/199899013 shutdown_connections 2024-06-03T00:01:31.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.006+0000 7f97a3584b80 1 --2- 172.21.15.49:0/199899013 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x55fb889d8cd0 0x55fb889db0f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:31.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.006+0000 7f97a3584b80 1 --2- 172.21.15.49:0/199899013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fb88955f60 0x55fb889712b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:31.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.006+0000 7f97a3584b80 1 --2- 172.21.15.49:0/199899013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fb8894ff20 0x55fb889623f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:31.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.006+0000 7f97a3584b80 1 --2- 172.21.15.49:0/199899013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fb88955640 0x55fb88970d70 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:31.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.006+0000 7f97a3584b80 1 -- 172.21.15.49:0/199899013 >> 172.21.15.49:0/199899013 conn(0x55fb8887acc0 msgr2=0x55fb88956b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:31.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.006+0000 7f9779ffb700 0 client.15573 ms_handle_reset on v2:172.21.15.107:6836/3700593315 2024-06-03T00:01:31.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.006+0000 7f97a3584b80 1 -- 172.21.15.49:0/199899013 shutdown_connections 2024-06-03T00:01:31.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.006+0000 7f97a3584b80 1 -- 172.21.15.49:0/199899013 wait complete. 2024-06-03T00:01:31.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.006+0000 7f97a3584b80 20 client.15573 trim_cache size 0 max 16384 2024-06-03T00:01:31.014 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-06-03T00:01:31.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.007+0000 7f9798d01700 1 -- 172.21.15.49:0/4063993725 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f97800a2ca0 msgr2=0x7f97800a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:31.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.007+0000 7f9798d01700 1 --2- 172.21.15.49:0/4063993725 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f97800a2ca0 0x7f97800a5160 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9794199bc0 tx=0x7f9784006210 comp rx=0 tx=0).stop 2024-06-03T00:01:31.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.007+0000 7f9798d01700 1 -- 172.21.15.49:0/4063993725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9794102e80 msgr2=0x7f979419ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:31.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.007+0000 7f9798d01700 1 --2- 172.21.15.49:0/4063993725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9794102e80 0x7f979419ee00 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f977c00e9a0 tx=0x7f977c00ecb0 comp rx=0 tx=0).stop 2024-06-03T00:01:31.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.007+0000 7f9798d01700 1 -- 172.21.15.49:0/4063993725 shutdown_connections 2024-06-03T00:01:31.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.007+0000 7f9798d01700 1 --2- 172.21.15.49:0/4063993725 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f97800a2ca0 0x7f97800a5160 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:31.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.007+0000 7f9798d01700 1 --2- 172.21.15.49:0/4063993725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97941084f0 0x7f9794198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:31.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.007+0000 7f9798d01700 1 --2- 172.21.15.49:0/4063993725 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97941024e0 0x7f979419e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:31.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.007+0000 7f9798d01700 1 --2- 172.21.15.49:0/4063993725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9794102e80 0x7f979419ee00 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:31.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.007+0000 7f9798d01700 1 -- 172.21.15.49:0/4063993725 >> 172.21.15.49:0/4063993725 conn(0x7f9794079530 msgr2=0x7f9794100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:31.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.007+0000 7f9798d01700 1 -- 172.21.15.49:0/4063993725 shutdown_connections 2024-06-03T00:01:31.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:31.007+0000 7f9798d01700 1 -- 172.21.15.49:0/4063993725 wait complete. 2024-06-03T00:01:31.751 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-06-03T00:01:31.999 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:01:32.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:32 smithi057 ceph-mon[36457]: pgmap v428: 97 pgs: 97 active+clean; 661 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-06-03T00:01:32.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:32 smithi049 ceph-mon[32302]: pgmap v428: 97 pgs: 97 active+clean; 661 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-06-03T00:01:32.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:32 smithi107 ceph-mon[37048]: pgmap v428: 97 pgs: 97 active+clean; 661 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-06-03T00:01:33.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.771+0000 7fe6eab9e700 1 -- 172.21.15.49:0/2249953181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6e4106600 msgr2=0x7fe6e410e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:33.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.771+0000 7fe6eab9e700 1 --2- 172.21.15.49:0/2249953181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6e4106600 0x7fe6e410e1d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc0099c0 tx=0x7fe6dc009cd0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.771+0000 7fe6eab9e700 1 -- 172.21.15.49:0/2249953181 shutdown_connections 2024-06-03T00:01:33.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.771+0000 7fe6eab9e700 1 --2- 172.21.15.49:0/2249953181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6e4106600 0x7fe6e410e1d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.771+0000 7fe6eab9e700 1 --2- 172.21.15.49:0/2249953181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6e4101520 0x7fe6e4101900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.771+0000 7fe6eab9e700 1 --2- 172.21.15.49:0/2249953181 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6e4101ed0 0x7fe6e4105f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.771+0000 7fe6eab9e700 1 -- 172.21.15.49:0/2249953181 >> 172.21.15.49:0/2249953181 conn(0x7fe6e40fcdb0 msgr2=0x7fe6e40ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:33.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.771+0000 7fe6eab9e700 1 -- 172.21.15.49:0/2249953181 shutdown_connections 2024-06-03T00:01:33.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.771+0000 7fe6eab9e700 1 -- 172.21.15.49:0/2249953181 wait complete. 2024-06-03T00:01:33.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.772+0000 7fe6eab9e700 1 Processor -- start 2024-06-03T00:01:33.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.772+0000 7fe6eab9e700 1 -- start start 2024-06-03T00:01:33.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.772+0000 7fe6eab9e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6e4101520 0x7fe6e419e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:33.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.772+0000 7fe6eab9e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6e4101ed0 0x7fe6e419ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:33.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.772+0000 7fe6eab9e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6e4106600 0x7fe6e41988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:33.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.772+0000 7fe6eab9e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e41115f0 con 0x7fe6e4101ed0 2024-06-03T00:01:33.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.772+0000 7fe6eab9e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e4111470 con 0x7fe6e4106600 2024-06-03T00:01:33.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.772+0000 7fe6eab9e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e4111770 con 0x7fe6e4101520 2024-06-03T00:01:33.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.772+0000 7fe6e939b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6e4101ed0 0x7fe6e419ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:33.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.772+0000 7fe6e939b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6e4101ed0 0x7fe6e419ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45810/0 (socket says 172.21.15.49:45810) 2024-06-03T00:01:33.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.772+0000 7fe6e939b700 1 -- 172.21.15.49:0/2118340040 learned_addr learned my addr 172.21.15.49:0/2118340040 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:33.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.773+0000 7fe6e9b9c700 1 --2- 172.21.15.49:0/2118340040 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6e4101520 0x7fe6e419e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:33.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.773+0000 7fe6e939b700 1 -- 172.21.15.49:0/2118340040 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6e4101520 msgr2=0x7fe6e419e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:33.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.773+0000 7fe6e939b700 1 --2- 172.21.15.49:0/2118340040 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6e4101520 0x7fe6e419e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.773+0000 7fe6e939b700 1 -- 172.21.15.49:0/2118340040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6e4106600 msgr2=0x7fe6e41988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:33.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.773+0000 7fe6e939b700 1 --2- 172.21.15.49:0/2118340040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6e4106600 0x7fe6e41988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.773+0000 7fe6e939b700 1 -- 172.21.15.49:0/2118340040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e4199040 con 0x7fe6e4101ed0 2024-06-03T00:01:33.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.773+0000 7fe6e939b700 1 --2- 172.21.15.49:0/2118340040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6e4101ed0 0x7fe6e419ec60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe6d800c9e0 tx=0x7fe6d800cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:33.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.773+0000 7fe6e2ffd700 1 -- 172.21.15.49:0/2118340040 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8007aa0 con 0x7fe6e4101ed0 2024-06-03T00:01:33.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.773+0000 7fe6e2ffd700 1 -- 172.21.15.49:0/2118340040 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6d8007c40 con 0x7fe6e4101ed0 2024-06-03T00:01:33.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.773+0000 7fe6eab9e700 1 -- 172.21.15.49:0/2118340040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6e4199330 con 0x7fe6e4101ed0 2024-06-03T00:01:33.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.773+0000 7fe6e2ffd700 1 -- 172.21.15.49:0/2118340040 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8018780 con 0x7fe6e4101ed0 2024-06-03T00:01:33.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.773+0000 7fe6eab9e700 1 -- 172.21.15.49:0/2118340040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6e41a55f0 con 0x7fe6e4101ed0 2024-06-03T00:01:33.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.775+0000 7fe6e2ffd700 1 -- 172.21.15.49:0/2118340040 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe6d800f450 con 0x7fe6e4101ed0 2024-06-03T00:01:33.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.776+0000 7fe6e2ffd700 1 --2- 172.21.15.49:0/2118340040 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe6cc0a2c20 0x7fe6cc0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:33.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.776+0000 7fe6e9b9c700 1 --2- 172.21.15.49:0/2118340040 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe6cc0a2c20 0x7fe6cc0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:33.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.776+0000 7fe6e2ffd700 1 -- 172.21.15.49:0/2118340040 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fe6d80cefc0 con 0x7fe6e4101ed0 2024-06-03T00:01:33.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.777+0000 7fe6e9b9c700 1 --2- 172.21.15.49:0/2118340040 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe6cc0a2c20 0x7fe6cc0a50e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4199a20 tx=0x7fe6d4009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:33.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.777+0000 7fe6f6683b80 1 Processor -- start 2024-06-03T00:01:33.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.777+0000 7fe6f6683b80 1 -- start start 2024-06-03T00:01:33.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.777+0000 7fe6f6683b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bbcf030a0 0x559bbcf03480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:33.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.777+0000 7fe6f6683b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559bbcf039c0 0x559bbcefe4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:33.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.777+0000 7fe6f6683b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bbcefe9f0 0x559bbcefee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:33.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.777+0000 7fe6f6683b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559bbcdf0f60 con 0x559bbcefe9f0 2024-06-03T00:01:33.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.777+0000 7fe6f6683b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x559bbce4f850 con 0x559bbcf039c0 2024-06-03T00:01:33.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.777+0000 7fe6f6683b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x559bbcdb7460 con 0x559bbcf030a0 2024-06-03T00:01:33.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.777+0000 7fe6ea39d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bbcefe9f0 0x559bbcefee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:33.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.778+0000 7fe6ea39d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bbcefe9f0 0x559bbcefee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45812/0 (socket says 172.21.15.49:45812) 2024-06-03T00:01:33.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.778+0000 7fe6ea39d700 1 -- 172.21.15.49:0/1111758165 learned_addr learned my addr 172.21.15.49:0/1111758165 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:33.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.778+0000 7fe6e9b9c700 1 --2- 172.21.15.49:0/1111758165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bbcf030a0 0x559bbcf03480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:33.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.778+0000 7fe6e939b700 1 --2- 172.21.15.49:0/1111758165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559bbcf039c0 0x559bbcefe4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:33.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.778+0000 7fe6ea39d700 1 -- 172.21.15.49:0/1111758165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bbcf030a0 msgr2=0x559bbcf03480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:33.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.778+0000 7fe6ea39d700 1 --2- 172.21.15.49:0/1111758165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bbcf030a0 0x559bbcf03480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.778+0000 7fe6ea39d700 1 -- 172.21.15.49:0/1111758165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559bbcf039c0 msgr2=0x559bbcefe4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:33.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.778+0000 7fe6ea39d700 1 --2- 172.21.15.49:0/1111758165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559bbcf039c0 0x559bbcefe4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.778+0000 7fe6ea39d700 1 -- 172.21.15.49:0/1111758165 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bbcd9e8d0 con 0x559bbcefe9f0 2024-06-03T00:01:33.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.778+0000 7fe6e939b700 1 --2- 172.21.15.49:0/1111758165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559bbcf039c0 0x559bbcefe4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:33.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.778+0000 7fe6ea39d700 1 --2- 172.21.15.49:0/1111758165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bbcefe9f0 0x559bbcefee50 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc005910 tx=0x7fe6dc0096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f99360c80f2423f3 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:33.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.778+0000 7fe6cbfff700 1 -- 172.21.15.49:0/1111758165 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc003740 con 0x559bbcefe9f0 2024-06-03T00:01:33.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.778+0000 7fe6cbfff700 1 -- 172.21.15.49:0/1111758165 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6dc003e40 con 0x559bbcefe9f0 2024-06-03T00:01:33.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.778+0000 7fe6cbfff700 1 -- 172.21.15.49:0/1111758165 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc00bac0 con 0x559bbcefe9f0 2024-06-03T00:01:33.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.779+0000 7fe6f6683b80 1 -- 172.21.15.49:0/1111758165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bbcefe9f0 msgr2=0x559bbcefee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:33.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.779+0000 7fe6f6683b80 1 --2- 172.21.15.49:0/1111758165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bbcefe9f0 0x559bbcefee50 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc005910 tx=0x7fe6dc0096a0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.779+0000 7fe6f6683b80 1 -- 172.21.15.49:0/1111758165 shutdown_connections 2024-06-03T00:01:33.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.779+0000 7fe6f6683b80 1 --2- 172.21.15.49:0/1111758165 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bbcefe9f0 0x559bbcefee50 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.779+0000 7fe6f6683b80 1 --2- 172.21.15.49:0/1111758165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bbcf030a0 0x559bbcf03480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.779+0000 7fe6f6683b80 1 --2- 172.21.15.49:0/1111758165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559bbcf039c0 0x559bbcefe4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.779+0000 7fe6f6683b80 1 -- 172.21.15.49:0/1111758165 >> 172.21.15.49:0/1111758165 conn(0x559bbce2b080 msgr2=0x559bbcef9390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:33.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.779+0000 7fe6f6683b80 1 -- 172.21.15.49:0/1111758165 shutdown_connections 2024-06-03T00:01:33.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.779+0000 7fe6f6683b80 1 -- 172.21.15.49:0/1111758165 wait complete. 2024-06-03T00:01:33.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.780+0000 7fe6f6683b80 1 -- start start 2024-06-03T00:01:33.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.780+0000 7fe6f6683b80 1 Processor -- start 2024-06-03T00:01:33.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.780+0000 7fe6f6683b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bbcefe9f0 0x559bbcf0a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:33.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.780+0000 7fe6f6683b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bbcf030a0 0x559bbcf079b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:33.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.780+0000 7fe6f6683b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559bbcf039c0 0x559bbcf07ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:33.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.780+0000 7fe6f6683b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559bbcdeffc0 con 0x559bbcefe9f0 2024-06-03T00:01:33.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.780+0000 7fe6f6683b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x559bbce4b810 con 0x559bbcf039c0 2024-06-03T00:01:33.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.780+0000 7fe6f6683b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x559bbcf0b3f0 con 0x559bbcf030a0 2024-06-03T00:01:33.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.780+0000 7fe6e9b9c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bbcefe9f0 0x559bbcf0a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:33.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.780+0000 7fe6f6683b80 10 client.0 _ll_register_callbacks cb 0x559bbcde55b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:33.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.780+0000 7fe6e9b9c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bbcefe9f0 0x559bbcf0a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45824/0 (socket says 172.21.15.49:45824) 2024-06-03T00:01:33.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.780+0000 7fe6e9b9c700 1 -- 172.21.15.49:0/1957926759 learned_addr learned my addr 172.21.15.49:0/1957926759 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:33.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.780+0000 7fe6e939b700 1 --2- 172.21.15.49:0/1957926759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bbcf030a0 0x559bbcf079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:33.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.780+0000 7fe6ea39d700 1 --2- 172.21.15.49:0/1957926759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559bbcf039c0 0x559bbcf07ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:33.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.781+0000 7fe6e9b9c700 1 -- 172.21.15.49:0/1957926759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bbcf030a0 msgr2=0x559bbcf079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:33.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.781+0000 7fe6e9b9c700 1 --2- 172.21.15.49:0/1957926759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bbcf030a0 0x559bbcf079b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.781+0000 7fe6e9b9c700 1 -- 172.21.15.49:0/1957926759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559bbcf039c0 msgr2=0x559bbcf07ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:33.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.781+0000 7fe6e9b9c700 1 --2- 172.21.15.49:0/1957926759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559bbcf039c0 0x559bbcf07ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.781+0000 7fe6e9b9c700 1 -- 172.21.15.49:0/1957926759 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bbce15750 con 0x559bbcefe9f0 2024-06-03T00:01:33.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.781+0000 7fe6ea39d700 1 --2- 172.21.15.49:0/1957926759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559bbcf039c0 0x559bbcf07ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:33.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.781+0000 7fe6e9b9c700 1 --2- 172.21.15.49:0/1957926759 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bbcefe9f0 0x559bbcf0a6b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe6d40169d0 tx=0x7fe6d4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ff9f3e02621ca1 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:33.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.781+0000 7fe6c97fa700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:01:33.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.781+0000 7fe6c97fa700 1 -- 172.21.15.49:0/1957926759 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d4026020 con 0x559bbcefe9f0 2024-06-03T00:01:33.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.781+0000 7fe6c97fa700 1 -- 172.21.15.49:0/1957926759 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fe6d4014a70 con 0x559bbcefe9f0 2024-06-03T00:01:33.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.781+0000 7fe6f6683b80 1 -- 172.21.15.49:0/1957926759 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559bbce5cd50 con 0x559bbcefe9f0 2024-06-03T00:01:33.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.781+0000 7fe6c97fa700 1 -- 172.21.15.49:0/1957926759 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe6d4016e40 con 0x559bbcefe9f0 2024-06-03T00:01:33.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.781+0000 7fe6f6683b80 10 client.15585 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:33.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.781+0000 7fe6f6683b80 1 -- 172.21.15.49:0/1957926759 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559bbcf15af0 con 0x559bbcefe9f0 2024-06-03T00:01:33.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.781+0000 7fe6c97fa700 1 -- 172.21.15.49:0/1957926759 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x559bbce5cd50 con 0x559bbcefe9f0 2024-06-03T00:01:33.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.782+0000 7fe6c97fa700 1 -- 172.21.15.49:0/1957926759 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fe6d40223f0 con 0x559bbcefe9f0 2024-06-03T00:01:33.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.782+0000 7fe6f6683b80 10 client.15585 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:33.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.782+0000 7fe6f6683b80 10 client.15585 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-06-03T00:01:33.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.782+0000 7fe6f6683b80 20 client.15585 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:33.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.782+0000 7fe6f6683b80 1 --2- 172.21.15.49:0/1957926759 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x559bbcf18130 0x559bbcf1a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:33.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.782+0000 7fe6f6683b80 4 client.15585 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:01:33.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.782+0000 7fe6f6683b80 1 -- 172.21.15.49:0/1957926759 --> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559bbce572d0 con 0x559bbcf18130 2024-06-03T00:01:33.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.782+0000 7fe6e939b700 1 --2- 172.21.15.49:0/1957926759 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x559bbcf18130 0x559bbcf1a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:33.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.782+0000 7fe6e939b700 1 --2- 172.21.15.49:0/1957926759 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x559bbcf18130 0x559bbcf1a520 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c8102c6a1b6af5b server_cookie=ecba4501bf2b7be4 in_seq=0 out_seq=0 2024-06-03T00:01:33.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.782+0000 7fe6c97fa700 10 client.15585 ms_handle_connect on v2:172.21.15.57:6838/249825195 2024-06-03T00:01:33.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.783+0000 7fe6c97fa700 1 -- 172.21.15.49:0/1957926759 <== mds.1 v2:172.21.15.57:6838/249825195 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x559bbce572d0 con 0x559bbcf18130 2024-06-03T00:01:33.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.783+0000 7fe6c97fa700 10 client.15585 handle_command_reply: tid=0 2024-06-03T00:01:33.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.783+0000 7fe6f6683b80 1 client.15585 shutdown 2024-06-03T00:01:33.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.783+0000 7fe6f6683b80 1 -- 172.21.15.49:0/1957926759 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bbcefe9f0 msgr2=0x559bbcf0a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:33.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.783+0000 7fe6f6683b80 1 --2- 172.21.15.49:0/1957926759 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bbcefe9f0 0x559bbcf0a6b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe6d40169d0 tx=0x7fe6d4004ad0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.784+0000 7fe6f6683b80 1 -- 172.21.15.49:0/1957926759 shutdown_connections 2024-06-03T00:01:33.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.784+0000 7fe6f6683b80 1 --2- 172.21.15.49:0/1957926759 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x559bbcf18130 0x559bbcf1a520 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.784+0000 7fe6f6683b80 1 --2- 172.21.15.49:0/1957926759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559bbcf039c0 0x559bbcf07ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.784+0000 7fe6f6683b80 1 --2- 172.21.15.49:0/1957926759 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bbcefe9f0 0x559bbcf0a6b0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.784+0000 7fe6f6683b80 1 --2- 172.21.15.49:0/1957926759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bbcf030a0 0x559bbcf079b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.784+0000 7fe6c97fa700 0 client.15585 ms_handle_reset on v2:172.21.15.57:6838/249825195 2024-06-03T00:01:33.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.784+0000 7fe6f6683b80 1 -- 172.21.15.49:0/1957926759 >> 172.21.15.49:0/1957926759 conn(0x559bbce2b080 msgr2=0x559bbcef8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:33.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.784+0000 7fe6f6683b80 1 -- 172.21.15.49:0/1957926759 shutdown_connections 2024-06-03T00:01:33.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.784+0000 7fe6f6683b80 1 -- 172.21.15.49:0/1957926759 wait complete. 2024-06-03T00:01:33.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.784+0000 7fe6f6683b80 20 client.15585 trim_cache size 0 max 16384 2024-06-03T00:01:33.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.799+0000 7fe6f6683b80 1 Processor -- start 2024-06-03T00:01:33.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.799+0000 7fe6f6683b80 1 -- start start 2024-06-03T00:01:33.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.799+0000 7fe6f6683b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bbcefe9f0 0x559bbcf098f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:33.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.799+0000 7fe6f6683b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559bbcf030a0 0x559bbcef90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:33.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.799+0000 7fe6f6683b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bbcf039c0 0x559bbcefc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:33.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.799+0000 7fe6f6683b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e41ac930 con 0x559bbcf039c0 2024-06-03T00:01:33.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.799+0000 7fe6f6683b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e41ae470 con 0x559bbcf030a0 2024-06-03T00:01:33.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.799+0000 7fe6f6683b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e41ad000 con 0x559bbcefe9f0 2024-06-03T00:01:33.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.799+0000 7fe6ea39d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bbcf039c0 0x559bbcefc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:33.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.799+0000 7fe6ea39d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bbcf039c0 0x559bbcefc4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45826/0 (socket says 172.21.15.49:45826) 2024-06-03T00:01:33.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.799+0000 7fe6ea39d700 1 -- 172.21.15.49:0/26669498 learned_addr learned my addr 172.21.15.49:0/26669498 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:33.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.799+0000 7fe6e9b9c700 1 --2- 172.21.15.49:0/26669498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bbcefe9f0 0x559bbcf098f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:33.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.799+0000 7fe6e939b700 1 --2- 172.21.15.49:0/26669498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559bbcf030a0 0x559bbcef90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:33.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.800+0000 7fe6ea39d700 1 -- 172.21.15.49:0/26669498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bbcefe9f0 msgr2=0x559bbcf098f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:33.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.800+0000 7fe6ea39d700 1 --2- 172.21.15.49:0/26669498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bbcefe9f0 0x559bbcf098f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.800+0000 7fe6ea39d700 1 -- 172.21.15.49:0/26669498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559bbcf030a0 msgr2=0x559bbcef90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:33.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.800+0000 7fe6ea39d700 1 --2- 172.21.15.49:0/26669498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559bbcf030a0 0x559bbcef90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.800+0000 7fe6ea39d700 1 -- 172.21.15.49:0/26669498 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bbcf1aae0 con 0x559bbcf039c0 2024-06-03T00:01:33.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.800+0000 7fe6ea39d700 1 --2- 172.21.15.49:0/26669498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bbcf039c0 0x559bbcefc4a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc009990 tx=0x7fe6dc005c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e25f94885a0032 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:33.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.800+0000 7fe6cb7fe700 1 -- 172.21.15.49:0/26669498 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc02f070 con 0x559bbcf039c0 2024-06-03T00:01:33.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.800+0000 7fe6cb7fe700 1 -- 172.21.15.49:0/26669498 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6dc00bc70 con 0x559bbcf039c0 2024-06-03T00:01:33.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.800+0000 7fe6cb7fe700 1 -- 172.21.15.49:0/26669498 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc00f680 con 0x559bbcf039c0 2024-06-03T00:01:33.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.801+0000 7fe6f6683b80 1 -- 172.21.15.49:0/26669498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bbcf039c0 msgr2=0x559bbcefc4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:33.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.801+0000 7fe6f6683b80 1 --2- 172.21.15.49:0/26669498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bbcf039c0 0x559bbcefc4a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc009990 tx=0x7fe6dc005c60 comp rx=0 tx=0).stop 2024-06-03T00:01:33.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.801+0000 7fe6f6683b80 1 -- 172.21.15.49:0/26669498 shutdown_connections 2024-06-03T00:01:33.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.801+0000 7fe6f6683b80 1 --2- 172.21.15.49:0/26669498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bbcf039c0 0x559bbcefc4a0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.801+0000 7fe6f6683b80 1 --2- 172.21.15.49:0/26669498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bbcefe9f0 0x559bbcf098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.801+0000 7fe6f6683b80 1 --2- 172.21.15.49:0/26669498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559bbcf030a0 0x559bbcef90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.801+0000 7fe6f6683b80 1 -- 172.21.15.49:0/26669498 >> 172.21.15.49:0/26669498 conn(0x559bbce2b080 msgr2=0x559bbcf091e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:33.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.801+0000 7fe6f6683b80 1 -- 172.21.15.49:0/26669498 shutdown_connections 2024-06-03T00:01:33.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.801+0000 7fe6f6683b80 1 -- 172.21.15.49:0/26669498 wait complete. 2024-06-03T00:01:33.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.801+0000 7fe6f6683b80 1 -- start start 2024-06-03T00:01:33.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.801+0000 7fe6f6683b80 1 Processor -- start 2024-06-03T00:01:33.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.801+0000 7fe6f6683b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bbcefe9f0 0x559bbcf106b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:33.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.801+0000 7fe6f6683b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559bbcf030a0 0x559bbcf10bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:33.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.801+0000 7fe6f6683b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bbcf039c0 0x559bbcf04db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:33.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.801+0000 7fe6f6683b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e41adda0 con 0x559bbcefe9f0 2024-06-03T00:01:33.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.801+0000 7fe6f6683b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e41ad6d0 con 0x559bbcf030a0 2024-06-03T00:01:33.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.802+0000 7fe6f6683b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e41aa8b0 con 0x559bbcf039c0 2024-06-03T00:01:33.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.802+0000 7fe6f6683b80 10 client.0 _ll_register_callbacks cb 0x559bbcde55b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:33.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.802+0000 7fe6e9b9c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bbcefe9f0 0x559bbcf106b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:33.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.802+0000 7fe6e9b9c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bbcefe9f0 0x559bbcf106b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45838/0 (socket says 172.21.15.49:45838) 2024-06-03T00:01:33.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.802+0000 7fe6e9b9c700 1 -- 172.21.15.49:0/1827601329 learned_addr learned my addr 172.21.15.49:0/1827601329 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:33.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.802+0000 7fe6e939b700 1 --2- 172.21.15.49:0/1827601329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559bbcf030a0 0x559bbcf10bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:33.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.802+0000 7fe6e9b9c700 1 -- 172.21.15.49:0/1827601329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bbcf039c0 msgr2=0x559bbcf04db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:33.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.802+0000 7fe6ea39d700 1 --2- 172.21.15.49:0/1827601329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bbcf039c0 0x559bbcf04db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:33.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.802+0000 7fe6e9b9c700 1 --2- 172.21.15.49:0/1827601329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bbcf039c0 0x559bbcf04db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.802+0000 7fe6e9b9c700 1 -- 172.21.15.49:0/1827601329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559bbcf030a0 msgr2=0x559bbcf10bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:33.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.802+0000 7fe6e9b9c700 1 --2- 172.21.15.49:0/1827601329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559bbcf030a0 0x559bbcf10bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.802+0000 7fe6e9b9c700 1 -- 172.21.15.49:0/1827601329 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bbcf112f0 con 0x559bbcefe9f0 2024-06-03T00:01:33.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.802+0000 7fe6e939b700 1 --2- 172.21.15.49:0/1827601329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559bbcf030a0 0x559bbcf10bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:33.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.802+0000 7fe6e9b9c700 1 --2- 172.21.15.49:0/1827601329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bbcefe9f0 0x559bbcf106b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe6d40169a0 tx=0x7fe6d4022750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac538f88929ee08 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:33.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.802+0000 7fe6c97fa700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:01:33.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.802+0000 7fe6c97fa700 1 -- 172.21.15.49:0/1827601329 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d403a020 con 0x559bbcefe9f0 2024-06-03T00:01:33.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.802+0000 7fe6f6683b80 1 -- 172.21.15.49:0/1827601329 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6dc00bc70 con 0x559bbcefe9f0 2024-06-03T00:01:33.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.802+0000 7fe6c97fa700 1 -- 172.21.15.49:0/1827601329 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fe6d4014a70 con 0x559bbcefe9f0 2024-06-03T00:01:33.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.802+0000 7fe6c97fa700 1 -- 172.21.15.49:0/1827601329 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe6d4026070 con 0x559bbcefe9f0 2024-06-03T00:01:33.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.802+0000 7fe6f6683b80 10 client.15591 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:33.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.803+0000 7fe6f6683b80 1 -- 172.21.15.49:0/1827601329 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559bbcf1f4e0 con 0x559bbcefe9f0 2024-06-03T00:01:33.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.803+0000 7fe6c97fa700 1 -- 172.21.15.49:0/1827601329 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6dc00bc70 con 0x559bbcefe9f0 2024-06-03T00:01:33.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.803+0000 7fe6c97fa700 1 -- 172.21.15.49:0/1827601329 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fe6d4036a50 con 0x559bbcefe9f0 2024-06-03T00:01:33.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.803+0000 7fe6f6683b80 10 client.15591 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:33.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.803+0000 7fe6f6683b80 10 client.15591 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-06-03T00:01:33.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.803+0000 7fe6f6683b80 20 client.15591 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:33.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.803+0000 7fe6f6683b80 1 --2- 172.21.15.49:0/1827601329 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x559bbcf87110 0x559bbcf89500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:33.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.803+0000 7fe6f6683b80 4 client.15591 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-03T00:01:33.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.803+0000 7fe6f6683b80 1 -- 172.21.15.49:0/1827601329 --> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559bbce0af50 con 0x559bbcf87110 2024-06-03T00:01:33.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.803+0000 7fe6e939b700 1 --2- 172.21.15.49:0/1827601329 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x559bbcf87110 0x559bbcf89500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:33.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.804+0000 7fe6c97fa700 10 client.15591 ms_handle_connect on v2:172.21.15.57:6838/249825195 2024-06-03T00:01:33.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.804+0000 7fe6e939b700 1 --2- 172.21.15.49:0/1827601329 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x559bbcf87110 0x559bbcf89500 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2cecc217a3c2d2ac server_cookie=7b259cac580d55ed in_seq=0 out_seq=0 2024-06-03T00:01:33.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.804+0000 7fe6c97fa700 1 -- 172.21.15.49:0/1827601329 <== mds.1 v2:172.21.15.57:6838/249825195 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559bbce0af50 con 0x559bbcf87110 2024-06-03T00:01:33.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.804+0000 7fe6c97fa700 10 client.15591 handle_command_reply: tid=0 2024-06-03T00:01:33.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.804+0000 7fe6f6683b80 1 client.15591 shutdown 2024-06-03T00:01:33.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.804+0000 7fe6f6683b80 1 -- 172.21.15.49:0/1827601329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bbcefe9f0 msgr2=0x559bbcf106b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:33.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.804+0000 7fe6f6683b80 1 --2- 172.21.15.49:0/1827601329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bbcefe9f0 0x559bbcf106b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe6d40169a0 tx=0x7fe6d4022750 comp rx=0 tx=0).stop 2024-06-03T00:01:33.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.804+0000 7fe6f6683b80 1 -- 172.21.15.49:0/1827601329 shutdown_connections 2024-06-03T00:01:33.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.804+0000 7fe6f6683b80 1 --2- 172.21.15.49:0/1827601329 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x559bbcf87110 0x559bbcf89500 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.804+0000 7fe6f6683b80 1 --2- 172.21.15.49:0/1827601329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bbcf039c0 0x559bbcf04db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.804+0000 7fe6f6683b80 1 --2- 172.21.15.49:0/1827601329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559bbcefe9f0 0x559bbcf106b0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.804+0000 7fe6f6683b80 1 --2- 172.21.15.49:0/1827601329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559bbcf030a0 0x559bbcf10bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.804+0000 7fe6c97fa700 0 client.15591 ms_handle_reset on v2:172.21.15.57:6838/249825195 2024-06-03T00:01:33.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.804+0000 7fe6f6683b80 1 -- 172.21.15.49:0/1827601329 >> 172.21.15.49:0/1827601329 conn(0x559bbce2b080 msgr2=0x559bbcf09a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:33.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.804+0000 7fe6f6683b80 1 -- 172.21.15.49:0/1827601329 shutdown_connections 2024-06-03T00:01:33.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.804+0000 7fe6f6683b80 1 -- 172.21.15.49:0/1827601329 wait complete. 2024-06-03T00:01:33.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.805+0000 7fe6f6683b80 20 client.15591 trim_cache size 0 max 16384 2024-06-03T00:01:33.811 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-06-03T00:01:33.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.805+0000 7fe6eab9e700 1 -- 172.21.15.49:0/2118340040 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe6cc0a2c20 msgr2=0x7fe6cc0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:33.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.805+0000 7fe6eab9e700 1 --2- 172.21.15.49:0/2118340040 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe6cc0a2c20 0x7fe6cc0a50e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4199a20 tx=0x7fe6d4009040 comp rx=0 tx=0).stop 2024-06-03T00:01:33.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.805+0000 7fe6eab9e700 1 -- 172.21.15.49:0/2118340040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6e4101ed0 msgr2=0x7fe6e419ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:33.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.805+0000 7fe6eab9e700 1 --2- 172.21.15.49:0/2118340040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6e4101ed0 0x7fe6e419ec60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe6d800c9e0 tx=0x7fe6d800cda0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.805+0000 7fe6eab9e700 1 -- 172.21.15.49:0/2118340040 shutdown_connections 2024-06-03T00:01:33.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.805+0000 7fe6eab9e700 1 --2- 172.21.15.49:0/2118340040 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe6cc0a2c20 0x7fe6cc0a50e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.805+0000 7fe6eab9e700 1 --2- 172.21.15.49:0/2118340040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6e4106600 0x7fe6e41988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.805+0000 7fe6eab9e700 1 --2- 172.21.15.49:0/2118340040 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6e4101520 0x7fe6e419e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.805+0000 7fe6eab9e700 1 --2- 172.21.15.49:0/2118340040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6e4101ed0 0x7fe6e419ec60 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:33.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.805+0000 7fe6eab9e700 1 -- 172.21.15.49:0/2118340040 >> 172.21.15.49:0/2118340040 conn(0x7fe6e40fcdb0 msgr2=0x7fe6e406a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:33.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.805+0000 7fe6eab9e700 1 -- 172.21.15.49:0/2118340040 shutdown_connections 2024-06-03T00:01:33.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:33.805+0000 7fe6eab9e700 1 -- 172.21.15.49:0/2118340040 wait complete. 2024-06-03T00:01:34.454 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.9 2024-06-03T00:01:34.454 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-03T00:01:34.488 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-06-03T00:01:34.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:34 smithi057 ceph-mon[36457]: pgmap v429: 97 pgs: 97 active+clean; 662 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 511 B/s wr, 11 op/s 2024-06-03T00:01:34.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:34 smithi049 ceph-mon[32302]: pgmap v429: 97 pgs: 97 active+clean; 662 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 511 B/s wr, 11 op/s 2024-06-03T00:01:34.713 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:01:34.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:34 smithi107 ceph-mon[37048]: pgmap v429: 97 pgs: 97 active+clean; 662 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 511 B/s wr, 11 op/s 2024-06-03T00:01:35.461 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:01:36.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:36 smithi057 ceph-mon[36457]: pgmap v430: 97 pgs: 97 active+clean; 662 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:01:36.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:36 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-03T00:01:36.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:36 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-03T00:01:36.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:36 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-03T00:01:36.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:36 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:01:36.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:36 smithi049 ceph-mon[32302]: pgmap v430: 97 pgs: 97 active+clean; 662 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:01:36.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:36 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-03T00:01:36.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:36 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-03T00:01:36.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:36 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-03T00:01:36.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:36 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:01:36.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:36 smithi107 ceph-mon[37048]: pgmap v430: 97 pgs: 97 active+clean; 662 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:01:36.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:36 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-03T00:01:36.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:36 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-03T00:01:36.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:36 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-03T00:01:36.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:36 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:01:37.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.296+0000 7f6b498fe700 1 -- 172.21.15.49:0/514325141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b4410ee90 msgr2=0x7f6b44111280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:37.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.296+0000 7f6b498fe700 1 --2- 172.21.15.49:0/514325141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b4410ee90 0x7f6b44111280 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00b0a0 tx=0x7f6b3c00b3b0 comp rx=0 tx=0).stop 2024-06-03T00:01:37.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.296+0000 7f6b498fe700 1 -- 172.21.15.49:0/514325141 shutdown_connections 2024-06-03T00:01:37.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.297+0000 7f6b498fe700 1 --2- 172.21.15.49:0/514325141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b4410ee90 0x7f6b44111280 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:37.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.297+0000 7f6b498fe700 1 --2- 172.21.15.49:0/514325141 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b440746c0 0x7f6b44074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:37.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.297+0000 7f6b498fe700 1 --2- 172.21.15.49:0/514325141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b44074fe0 0x7f6b4410e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:37.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.297+0000 7f6b498fe700 1 -- 172.21.15.49:0/514325141 >> 172.21.15.49:0/514325141 conn(0x7f6b44079640 msgr2=0x7f6b44079a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:37.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.297+0000 7f6b498fe700 1 -- 172.21.15.49:0/514325141 shutdown_connections 2024-06-03T00:01:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.297+0000 7f6b498fe700 1 -- 172.21.15.49:0/514325141 wait complete. 2024-06-03T00:01:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.297+0000 7f6b498fe700 1 Processor -- start 2024-06-03T00:01:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.297+0000 7f6b498fe700 1 -- start start 2024-06-03T00:01:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.298+0000 7f6b498fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b440746c0 0x7f6b441a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.298+0000 7f6b498fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b44074fe0 0x7f6b4419fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.298+0000 7f6b498fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b4410ee90 0x7f6b441a0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.298+0000 7f6b498fe700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6b44114a20 con 0x7f6b4410ee90 2024-06-03T00:01:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.298+0000 7f6b498fe700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6b441148a0 con 0x7f6b440746c0 2024-06-03T00:01:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.298+0000 7f6b498fe700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6b44114ba0 con 0x7f6b44074fe0 2024-06-03T00:01:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.298+0000 7f6b427fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b44074fe0 0x7f6b4419fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.298+0000 7f6b437fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b4410ee90 0x7f6b441a0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.298+0000 7f6b427fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b44074fe0 0x7f6b4419fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:34344/0 (socket says 172.21.15.49:34344) 2024-06-03T00:01:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.298+0000 7f6b427fc700 1 -- 172.21.15.49:0/740192442 learned_addr learned my addr 172.21.15.49:0/740192442 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:37.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.298+0000 7f6b42ffd700 1 --2- 172.21.15.49:0/740192442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b440746c0 0x7f6b441a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:37.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.298+0000 7f6b427fc700 1 -- 172.21.15.49:0/740192442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b440746c0 msgr2=0x7f6b441a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:37.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.298+0000 7f6b427fc700 1 --2- 172.21.15.49:0/740192442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b440746c0 0x7f6b441a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:37.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.298+0000 7f6b427fc700 1 -- 172.21.15.49:0/740192442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b4410ee90 msgr2=0x7f6b441a0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:37.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.298+0000 7f6b427fc700 1 --2- 172.21.15.49:0/740192442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b4410ee90 0x7f6b441a0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:37.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.298+0000 7f6b427fc700 1 -- 172.21.15.49:0/740192442 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b441a09f0 con 0x7f6b44074fe0 2024-06-03T00:01:37.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.298+0000 7f6b437fe700 1 --2- 172.21.15.49:0/740192442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b4410ee90 0x7f6b441a0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:01:37.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.299+0000 7f6b427fc700 1 --2- 172.21.15.49:0/740192442 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b44074fe0 0x7f6b4419fe10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800c920 tx=0x7f6b3800cc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:37.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.299+0000 7f6b488fc700 1 -- 172.21.15.49:0/740192442 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38004a30 con 0x7f6b44074fe0 2024-06-03T00:01:37.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.299+0000 7f6b498fe700 1 -- 172.21.15.49:0/740192442 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b4410d910 con 0x7f6b44074fe0 2024-06-03T00:01:37.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.299+0000 7f6b488fc700 1 -- 172.21.15.49:0/740192442 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b38005500 con 0x7f6b44074fe0 2024-06-03T00:01:37.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.299+0000 7f6b488fc700 1 -- 172.21.15.49:0/740192442 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38007d00 con 0x7f6b44074fe0 2024-06-03T00:01:37.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.299+0000 7f6b498fe700 1 -- 172.21.15.49:0/740192442 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b4410dea0 con 0x7f6b44074fe0 2024-06-03T00:01:37.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.300+0000 7f6b498fe700 1 -- 172.21.15.49:0/740192442 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b44075de0 con 0x7f6b44074fe0 2024-06-03T00:01:37.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.301+0000 7f6b488fc700 1 -- 172.21.15.49:0/740192442 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6b38005000 con 0x7f6b44074fe0 2024-06-03T00:01:37.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.302+0000 7f6b488fc700 1 --2- 172.21.15.49:0/740192442 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6b2c0a2ca0 0x7f6b2c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:37.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.302+0000 7f6b42ffd700 1 --2- 172.21.15.49:0/740192442 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6b2c0a2ca0 0x7f6b2c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:37.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.302+0000 7f6b488fc700 1 -- 172.21.15.49:0/740192442 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f6b380cea80 con 0x7f6b44074fe0 2024-06-03T00:01:37.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.303+0000 7f6b42ffd700 1 --2- 172.21.15.49:0/740192442 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6b2c0a2ca0 0x7f6b2c0a5160 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6b34005950 tx=0x7f6b3400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:37.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.307+0000 7f6b488fc700 1 -- 172.21.15.49:0/740192442 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6b380d0e20 con 0x7f6b44074fe0 2024-06-03T00:01:37.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.583+0000 7f6b498fe700 1 -- 172.21.15.49:0/740192442 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b4410e160 con 0x7f6b44074fe0 2024-06-03T00:01:37.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.584+0000 7f6b488fc700 1 -- 172.21.15.49:0/740192442 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11929 (secure 0 0 0) 0x7f6b38014030 con 0x7f6b44074fe0 2024-06-03T00:01:37.583 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:01:37.584 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1553264866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1553264866},{"type":"v1","addr":"172.21.15.49:6835","nonce":1553264866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2266285252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2266285252},{"type":"v1","addr":"172.21.15.49:6837","nonce":2266285252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T23:57:16.991201+0000","modified":"2024-06-03T00:00:26.305285+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24485,"mds_2":24466,"mds_3":24464,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6839/1729124617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":1729124617},{"type":"v1","addr":"172.21.15.49:6839","nonce":1729124617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6841/1902772235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":1902772235},{"type":"v1","addr":"172.21.15.49:6841","nonce":1902772235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6833/1633534002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1633534002},{"type":"v1","addr":"172.21.15.57:6833","nonce":1633534002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6835/2254905671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2254905671},{"type":"v1","addr":"172.21.15.57:6835","nonce":2254905671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.107:6835/3693542801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3693542801},{"type":"v1","addr":"172.21.15.107:6835","nonce":3693542801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.57:6837/230452144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":230452144},{"type":"v1","addr":"172.21.15.57:6837","nonce":230452144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.107:6837/3700593315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":3700593315},{"type":"v1","addr":"172.21.15.107:6837","nonce":3700593315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6839/249825195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":249825195},{"type":"v1","addr":"172.21.15.57:6839","nonce":249825195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6839/1986600681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1986600681},{"type":"v1","addr":"172.21.15.107:6839","nonce":1986600681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24485,24464,24460,24466,24487]},"id":1}]} 2024-06-03T00:01:37.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.587+0000 7f6b498fe700 1 -- 172.21.15.49:0/740192442 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6b2c0a2ca0 msgr2=0x7f6b2c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:37.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.587+0000 7f6b498fe700 1 --2- 172.21.15.49:0/740192442 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6b2c0a2ca0 0x7f6b2c0a5160 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6b34005950 tx=0x7f6b3400b410 comp rx=0 tx=0).stop 2024-06-03T00:01:37.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.587+0000 7f6b498fe700 1 -- 172.21.15.49:0/740192442 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b44074fe0 msgr2=0x7f6b4419fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:37.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.587+0000 7f6b498fe700 1 --2- 172.21.15.49:0/740192442 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b44074fe0 0x7f6b4419fe10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800c920 tx=0x7f6b3800cc30 comp rx=0 tx=0).stop 2024-06-03T00:01:37.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.587+0000 7f6b498fe700 1 -- 172.21.15.49:0/740192442 shutdown_connections 2024-06-03T00:01:37.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.587+0000 7f6b498fe700 1 --2- 172.21.15.49:0/740192442 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6b2c0a2ca0 0x7f6b2c0a5160 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:37.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.587+0000 7f6b498fe700 1 --2- 172.21.15.49:0/740192442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b4410ee90 0x7f6b441a0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:37.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.587+0000 7f6b498fe700 1 --2- 172.21.15.49:0/740192442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b440746c0 0x7f6b441a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:37.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.587+0000 7f6b498fe700 1 --2- 172.21.15.49:0/740192442 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b44074fe0 0x7f6b4419fe10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:37.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.587+0000 7f6b498fe700 1 -- 172.21.15.49:0/740192442 >> 172.21.15.49:0/740192442 conn(0x7f6b44079640 msgr2=0x7f6b44104760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:37.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.587+0000 7f6b498fe700 1 -- 172.21.15.49:0/740192442 shutdown_connections 2024-06-03T00:01:37.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:37.587+0000 7f6b498fe700 1 -- 172.21.15.49:0/740192442 wait complete. 2024-06-03T00:01:37.588 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 27 2024-06-03T00:01:38.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:38 smithi057 ceph-mon[36457]: pgmap v431: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-06-03T00:01:38.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:38 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/740192442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:01:38.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:38 smithi049 ceph-mon[32302]: pgmap v431: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-06-03T00:01:38.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:38 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/740192442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:01:38.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:38 smithi107 ceph-mon[37048]: pgmap v431: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-06-03T00:01:38.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:38 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/740192442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:01:39.134 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24487 quiesce db / --timeout 90 --expiration 146.9 --await-for 45.0' 2024-06-03T00:01:39.134 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- timeout 105 ceph tell mds.24487 quiesce db / --timeout 90 --expiration 146.9 --await-for 45.0 2024-06-03T00:01:39.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.336+0000 7f3556592700 1 -- 172.21.15.49:0/697244480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f355006b4e0 msgr2=0x7f355010ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:39.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.336+0000 7f3556592700 1 --2- 172.21.15.49:0/697244480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f355006b4e0 0x7f355010ea30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3544009990 tx=0x7f3544009ca0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.336+0000 7f3556592700 1 -- 172.21.15.49:0/697244480 shutdown_connections 2024-06-03T00:01:39.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.336+0000 7f3556592700 1 --2- 172.21.15.49:0/697244480 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f355010ef70 0x7f3550111360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.336+0000 7f3556592700 1 --2- 172.21.15.49:0/697244480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f355006abc0 0x7f355006afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.336+0000 7f3556592700 1 --2- 172.21.15.49:0/697244480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f355006b4e0 0x7f355010ea30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.336+0000 7f3556592700 1 -- 172.21.15.49:0/697244480 >> 172.21.15.49:0/697244480 conn(0x7f3550078330 msgr2=0x7f3550078740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:39.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.336+0000 7f3556592700 1 -- 172.21.15.49:0/697244480 shutdown_connections 2024-06-03T00:01:39.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.336+0000 7f3556592700 1 -- 172.21.15.49:0/697244480 wait complete. 2024-06-03T00:01:39.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.337+0000 7f3556592700 1 Processor -- start 2024-06-03T00:01:39.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.337+0000 7f3556592700 1 -- start start 2024-06-03T00:01:39.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.337+0000 7f3556592700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f355006abc0 0x7f355019ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:39.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.337+0000 7f3556592700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f355006b4e0 0x7f355019b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:39.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.337+0000 7f3556592700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f355010ef70 0x7f355019f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:39.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.337+0000 7f3556592700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f35501149b0 con 0x7f355006abc0 2024-06-03T00:01:39.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.337+0000 7f3556592700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3550114830 con 0x7f355010ef70 2024-06-03T00:01:39.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.337+0000 7f3556592700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3550114b30 con 0x7f355006b4e0 2024-06-03T00:01:39.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.337+0000 7f354f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f355006b4e0 0x7f355019b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:39.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.337+0000 7f354f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f355006b4e0 0x7f355019b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:34364/0 (socket says 172.21.15.49:34364) 2024-06-03T00:01:39.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.337+0000 7f354f7fe700 1 -- 172.21.15.49:0/1980461673 learned_addr learned my addr 172.21.15.49:0/1980461673 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:39.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.337+0000 7f354ffff700 1 --2- 172.21.15.49:0/1980461673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f355006abc0 0x7f355019ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:39.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.338+0000 7f3554b2f700 1 --2- 172.21.15.49:0/1980461673 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f355010ef70 0x7f355019f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:39.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.338+0000 7f354f7fe700 1 -- 172.21.15.49:0/1980461673 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f355010ef70 msgr2=0x7f355019f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:39.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.338+0000 7f354f7fe700 1 --2- 172.21.15.49:0/1980461673 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f355010ef70 0x7f355019f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.338+0000 7f354f7fe700 1 -- 172.21.15.49:0/1980461673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f355006abc0 msgr2=0x7f355019ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:39.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.338+0000 7f354f7fe700 1 --2- 172.21.15.49:0/1980461673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f355006abc0 0x7f355019ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.338+0000 7f354f7fe700 1 -- 172.21.15.49:0/1980461673 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f355019fe40 con 0x7f355006b4e0 2024-06-03T00:01:39.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.338+0000 7f3554b2f700 1 --2- 172.21.15.49:0/1980461673 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f355010ef70 0x7f355019f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:39.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.338+0000 7f354f7fe700 1 --2- 172.21.15.49:0/1980461673 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f355006b4e0 0x7f355019b3c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f354400b2e0 tx=0x7f354400b610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:39.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.338+0000 7f354d7fa700 1 -- 172.21.15.49:0/1980461673 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3544026070 con 0x7f355006b4e0 2024-06-03T00:01:39.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.338+0000 7f3556592700 1 -- 172.21.15.49:0/1980461673 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35501a00d0 con 0x7f355006b4e0 2024-06-03T00:01:39.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.338+0000 7f3556592700 1 -- 172.21.15.49:0/1980461673 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35501a79b0 con 0x7f355006b4e0 2024-06-03T00:01:39.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.339+0000 7f354d7fa700 1 -- 172.21.15.49:0/1980461673 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3544021410 con 0x7f355006b4e0 2024-06-03T00:01:39.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.339+0000 7f354d7fa700 1 -- 172.21.15.49:0/1980461673 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3544017650 con 0x7f355006b4e0 2024-06-03T00:01:39.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.341+0000 7f354d7fa700 1 -- 172.21.15.49:0/1980461673 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3544029070 con 0x7f355006b4e0 2024-06-03T00:01:39.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.342+0000 7f354d7fa700 1 --2- 172.21.15.49:0/1980461673 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f35380a2ca0 0x7f35380a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:39.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.342+0000 7f354d7fa700 1 -- 172.21.15.49:0/1980461673 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f35440cfb90 con 0x7f355006b4e0 2024-06-03T00:01:39.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.342+0000 7f354ffff700 1 --2- 172.21.15.49:0/1980461673 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f35380a2ca0 0x7f35380a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:39.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.342+0000 7f354ffff700 1 --2- 172.21.15.49:0/1980461673 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f35380a2ca0 0x7f35380a5160 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3540009c60 tx=0x7f3540009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:39.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.343+0000 7f3560e15b80 1 Processor -- start 2024-06-03T00:01:39.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.343+0000 7f3560e15b80 1 -- start start 2024-06-03T00:01:39.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.343+0000 7f3560e15b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558aef979f60 0x558aef97a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:39.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.343+0000 7f3560e15b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558aef97a880 0x558aef974260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:39.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.343+0000 7f3560e15b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558aef9747a0 0x558aef974bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:39.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.343+0000 7f3560e15b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x558aef866f60 con 0x558aef9747a0 2024-06-03T00:01:39.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.343+0000 7f3560e15b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x558aef8c5850 con 0x558aef97a880 2024-06-03T00:01:39.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.343+0000 7f3560e15b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x558aef82d460 con 0x558aef979f60 2024-06-03T00:01:39.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.343+0000 7f354f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558aef97a880 0x558aef974260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:39.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.343+0000 7f3554b2f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558aef9747a0 0x558aef974bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:39.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.344+0000 7f3554b2f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558aef9747a0 0x558aef974bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45880/0 (socket says 172.21.15.49:45880) 2024-06-03T00:01:39.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.344+0000 7f354f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558aef97a880 0x558aef974260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.49:43380/0 (socket says 172.21.15.49:43380) 2024-06-03T00:01:39.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.344+0000 7f3554b2f700 1 -- 172.21.15.49:0/1830062510 learned_addr learned my addr 172.21.15.49:0/1830062510 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:39.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.344+0000 7f354ffff700 1 --2- 172.21.15.49:0/1830062510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558aef979f60 0x558aef97a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:39.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.344+0000 7f3554b2f700 1 -- 172.21.15.49:0/1830062510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558aef979f60 msgr2=0x558aef97a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:39.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.344+0000 7f3554b2f700 1 --2- 172.21.15.49:0/1830062510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558aef979f60 0x558aef97a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.344+0000 7f3554b2f700 1 -- 172.21.15.49:0/1830062510 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558aef97a880 msgr2=0x558aef974260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:39.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.344+0000 7f3554b2f700 1 --2- 172.21.15.49:0/1830062510 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558aef97a880 0x558aef974260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.344+0000 7f3554b2f700 1 -- 172.21.15.49:0/1830062510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558aef8148d0 con 0x558aef9747a0 2024-06-03T00:01:39.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.344+0000 7f354ffff700 1 --2- 172.21.15.49:0/1830062510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558aef979f60 0x558aef97a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:01:39.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.344+0000 7f354f7fe700 1 --2- 172.21.15.49:0/1830062510 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558aef97a880 0x558aef974260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:01:39.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.344+0000 7f3554b2f700 1 --2- 172.21.15.49:0/1830062510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558aef9747a0 0x558aef974bc0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f35480093f0 tx=0x7f3548009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4645cba8876566e3 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:39.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.344+0000 7f35367fc700 1 -- 172.21.15.49:0/1830062510 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3548015680 con 0x558aef9747a0 2024-06-03T00:01:39.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.344+0000 7f35367fc700 1 -- 172.21.15.49:0/1830062510 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f354801a070 con 0x558aef9747a0 2024-06-03T00:01:39.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.345+0000 7f35367fc700 1 -- 172.21.15.49:0/1830062510 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3548014c90 con 0x558aef9747a0 2024-06-03T00:01:39.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.345+0000 7f3560e15b80 1 -- 172.21.15.49:0/1830062510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558aef9747a0 msgr2=0x558aef974bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:39.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.345+0000 7f3560e15b80 1 --2- 172.21.15.49:0/1830062510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558aef9747a0 0x558aef974bc0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f35480093f0 tx=0x7f3548009920 comp rx=0 tx=0).stop 2024-06-03T00:01:39.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.345+0000 7f3560e15b80 1 -- 172.21.15.49:0/1830062510 shutdown_connections 2024-06-03T00:01:39.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.345+0000 7f3560e15b80 1 --2- 172.21.15.49:0/1830062510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558aef9747a0 0x558aef974bc0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.345+0000 7f3560e15b80 1 --2- 172.21.15.49:0/1830062510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558aef979f60 0x558aef97a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.345+0000 7f3560e15b80 1 --2- 172.21.15.49:0/1830062510 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558aef97a880 0x558aef974260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.345+0000 7f3560e15b80 1 -- 172.21.15.49:0/1830062510 >> 172.21.15.49:0/1830062510 conn(0x558aef8a1080 msgr2=0x558aef96f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:39.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.345+0000 7f3560e15b80 1 -- 172.21.15.49:0/1830062510 shutdown_connections 2024-06-03T00:01:39.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.346+0000 7f3560e15b80 1 -- 172.21.15.49:0/1830062510 wait complete. 2024-06-03T00:01:39.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.346+0000 7f3560e15b80 1 -- start start 2024-06-03T00:01:39.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.346+0000 7f3560e15b80 1 Processor -- start 2024-06-03T00:01:39.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.346+0000 7f3560e15b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558aef9747a0 0x558aef9804f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:39.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.346+0000 7f3560e15b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558aef979f60 0x558aef97d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:39.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.346+0000 7f3560e15b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558aef97a880 0x558aef97dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:39.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.347+0000 7f3560e15b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x558aef865fc0 con 0x558aef9747a0 2024-06-03T00:01:39.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.347+0000 7f3560e15b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x558aef8c1810 con 0x558aef979f60 2024-06-03T00:01:39.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.347+0000 7f3560e15b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x558aef9812b0 con 0x558aef97a880 2024-06-03T00:01:39.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.347+0000 7f354ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558aef9747a0 0x558aef9804f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:39.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.347+0000 7f3560e15b80 10 client.0 _ll_register_callbacks cb 0x558aef85b5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:39.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.347+0000 7f354ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558aef9747a0 0x558aef9804f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45886/0 (socket says 172.21.15.49:45886) 2024-06-03T00:01:39.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.347+0000 7f354ffff700 1 -- 172.21.15.49:0/4234771805 learned_addr learned my addr 172.21.15.49:0/4234771805 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:39.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.347+0000 7f354f7fe700 1 --2- 172.21.15.49:0/4234771805 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558aef979f60 0x558aef97d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:39.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.347+0000 7f3554b2f700 1 --2- 172.21.15.49:0/4234771805 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558aef97a880 0x558aef97dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:39.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.347+0000 7f354ffff700 1 -- 172.21.15.49:0/4234771805 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558aef97a880 msgr2=0x558aef97dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:39.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.347+0000 7f354ffff700 1 --2- 172.21.15.49:0/4234771805 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558aef97a880 0x558aef97dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.347+0000 7f354ffff700 1 -- 172.21.15.49:0/4234771805 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558aef979f60 msgr2=0x558aef97d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:39.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.347+0000 7f354ffff700 1 --2- 172.21.15.49:0/4234771805 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558aef979f60 0x558aef97d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.347+0000 7f354ffff700 1 -- 172.21.15.49:0/4234771805 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558aef88b750 con 0x558aef9747a0 2024-06-03T00:01:39.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.347+0000 7f354f7fe700 1 --2- 172.21.15.49:0/4234771805 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558aef979f60 0x558aef97d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:01:39.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.347+0000 7f3554b2f700 1 --2- 172.21.15.49:0/4234771805 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558aef97a880 0x558aef97dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:01:39.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.347+0000 7f354ffff700 1 --2- 172.21.15.49:0/4234771805 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558aef9747a0 0x558aef9804f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f354001dc40 tx=0x7f35400047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c1b8ad2d800ca89 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:39.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.347+0000 7f352f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:01:39.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.348+0000 7f352f7fe700 1 -- 172.21.15.49:0/4234771805 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3540004240 con 0x558aef9747a0 2024-06-03T00:01:39.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.348+0000 7f352f7fe700 1 -- 172.21.15.49:0/4234771805 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f3540009040 con 0x558aef9747a0 2024-06-03T00:01:39.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.348+0000 7f3560e15b80 1 -- 172.21.15.49:0/4234771805 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f354801a070 con 0x558aef9747a0 2024-06-03T00:01:39.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.348+0000 7f352f7fe700 1 -- 172.21.15.49:0/4234771805 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f35400043e0 con 0x558aef9747a0 2024-06-03T00:01:39.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.348+0000 7f3560e15b80 10 client.15609 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:39.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.348+0000 7f3560e15b80 1 -- 172.21.15.49:0/4234771805 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558aef98b7f0 con 0x558aef9747a0 2024-06-03T00:01:39.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.348+0000 7f352f7fe700 1 -- 172.21.15.49:0/4234771805 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f354801a070 con 0x558aef9747a0 2024-06-03T00:01:39.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.349+0000 7f352f7fe700 1 -- 172.21.15.49:0/4234771805 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f3540003bf0 con 0x558aef9747a0 2024-06-03T00:01:39.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.349+0000 7f3560e15b80 10 client.15609 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:39.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.349+0000 7f3560e15b80 10 client.15609 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-03T00:01:39.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.349+0000 7f3560e15b80 20 client.15609 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:39.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.349+0000 7f3560e15b80 1 --2- 172.21.15.49:0/4234771805 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x558aef98de30 0x558aef9902b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:39.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.349+0000 7f3560e15b80 4 client.15609 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:01:39.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.349+0000 7f3560e15b80 1 -- 172.21.15.49:0/4234771805 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558aef8d2d50 con 0x558aef98de30 2024-06-03T00:01:39.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.349+0000 7f354f7fe700 1 --2- 172.21.15.49:0/4234771805 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x558aef98de30 0x558aef9902b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:39.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.349+0000 7f354f7fe700 1 --2- 172.21.15.49:0/4234771805 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x558aef98de30 0x558aef9902b0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50e19e7755504e9b server_cookie=3e4daffc4383d7b2 in_seq=0 out_seq=0 2024-06-03T00:01:39.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.349+0000 7f352f7fe700 10 client.15609 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:39.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.350+0000 7f352f7fe700 1 -- 172.21.15.49:0/4234771805 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x558aef8d2d50 con 0x558aef98de30 2024-06-03T00:01:39.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.350+0000 7f352f7fe700 10 client.15609 handle_command_reply: tid=0 2024-06-03T00:01:39.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.350+0000 7f3560e15b80 1 client.15609 shutdown 2024-06-03T00:01:39.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.350+0000 7f3560e15b80 1 -- 172.21.15.49:0/4234771805 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558aef9747a0 msgr2=0x558aef9804f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:39.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.350+0000 7f3560e15b80 1 --2- 172.21.15.49:0/4234771805 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558aef9747a0 0x558aef9804f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f354001dc40 tx=0x7f35400047c0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.350+0000 7f3560e15b80 1 -- 172.21.15.49:0/4234771805 shutdown_connections 2024-06-03T00:01:39.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.350+0000 7f3560e15b80 1 --2- 172.21.15.49:0/4234771805 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558aef97a880 0x558aef97dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.350+0000 7f3560e15b80 1 --2- 172.21.15.49:0/4234771805 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x558aef98de30 0x558aef9902b0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.350+0000 7f3560e15b80 1 --2- 172.21.15.49:0/4234771805 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558aef9747a0 0x558aef9804f0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.350+0000 7f3560e15b80 1 --2- 172.21.15.49:0/4234771805 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558aef979f60 0x558aef97d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.350+0000 7f3560e15b80 1 -- 172.21.15.49:0/4234771805 >> 172.21.15.49:0/4234771805 conn(0x558aef8a1080 msgr2=0x558aef96e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:39.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.350+0000 7f352f7fe700 0 client.15609 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:39.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.350+0000 7f3560e15b80 1 -- 172.21.15.49:0/4234771805 shutdown_connections 2024-06-03T00:01:39.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.351+0000 7f3560e15b80 1 -- 172.21.15.49:0/4234771805 wait complete. 2024-06-03T00:01:39.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.351+0000 7f3560e15b80 20 client.15609 trim_cache size 0 max 16384 2024-06-03T00:01:39.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.370+0000 7f3560e15b80 1 Processor -- start 2024-06-03T00:01:39.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.371+0000 7f3560e15b80 1 -- start start 2024-06-03T00:01:39.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.371+0000 7f3560e15b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558aef979f60 0x558aef974260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:39.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.371+0000 7f3560e15b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558aef97a880 0x558aef97b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:39.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.371+0000 7f3560e15b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558aef98a460 0x558aef96ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:39.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.371+0000 7f3560e15b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f353c00d3c0 con 0x558aef97a880 2024-06-03T00:01:39.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.371+0000 7f3560e15b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f353c00ef00 con 0x558aef979f60 2024-06-03T00:01:39.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.371+0000 7f3560e15b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f353c00da90 con 0x558aef98a460 2024-06-03T00:01:39.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.371+0000 7f3554b2f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558aef98a460 0x558aef96ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:39.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.371+0000 7f354ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558aef979f60 0x558aef974260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:39.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.371+0000 7f3554b2f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558aef98a460 0x558aef96ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:34406/0 (socket says 172.21.15.49:34406) 2024-06-03T00:01:39.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.371+0000 7f3554b2f700 1 -- 172.21.15.49:0/3877040330 learned_addr learned my addr 172.21.15.49:0/3877040330 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:39.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.371+0000 7f354f7fe700 1 --2- 172.21.15.49:0/3877040330 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558aef97a880 0x558aef97b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:39.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.371+0000 7f3554b2f700 1 -- 172.21.15.49:0/3877040330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558aef979f60 msgr2=0x558aef974260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:39.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.371+0000 7f3554b2f700 1 --2- 172.21.15.49:0/3877040330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558aef979f60 0x558aef974260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.371+0000 7f3554b2f700 1 -- 172.21.15.49:0/3877040330 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558aef97a880 msgr2=0x558aef97b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:39.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.372+0000 7f3554b2f700 1 --2- 172.21.15.49:0/3877040330 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558aef97a880 0x558aef97b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.372+0000 7f3554b2f700 1 -- 172.21.15.49:0/3877040330 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558aef97bd60 con 0x558aef98a460 2024-06-03T00:01:39.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.372+0000 7f354f7fe700 1 --2- 172.21.15.49:0/3877040330 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558aef97a880 0x558aef97b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:01:39.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.372+0000 7f3554b2f700 1 --2- 172.21.15.49:0/3877040330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558aef98a460 0x558aef96ee80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3548009fd0 tx=0x7f3548014790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e69ddc1b71629fe server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:39.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.372+0000 7f3535ffb700 1 -- 172.21.15.49:0/3877040330 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3548014aa0 con 0x558aef98a460 2024-06-03T00:01:39.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.372+0000 7f3535ffb700 1 -- 172.21.15.49:0/3877040330 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f354801a070 con 0x558aef98a460 2024-06-03T00:01:39.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.372+0000 7f3535ffb700 1 -- 172.21.15.49:0/3877040330 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3548015d40 con 0x558aef98a460 2024-06-03T00:01:39.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.373+0000 7f3560e15b80 1 -- 172.21.15.49:0/3877040330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558aef98a460 msgr2=0x558aef96ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:39.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.373+0000 7f3560e15b80 1 --2- 172.21.15.49:0/3877040330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558aef98a460 0x558aef96ee80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3548009fd0 tx=0x7f3548014790 comp rx=0 tx=0).stop 2024-06-03T00:01:39.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.373+0000 7f3560e15b80 1 -- 172.21.15.49:0/3877040330 shutdown_connections 2024-06-03T00:01:39.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.373+0000 7f3560e15b80 1 --2- 172.21.15.49:0/3877040330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558aef98a460 0x558aef96ee80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.373+0000 7f3560e15b80 1 --2- 172.21.15.49:0/3877040330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558aef979f60 0x558aef974260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.373+0000 7f3560e15b80 1 --2- 172.21.15.49:0/3877040330 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558aef97a880 0x558aef97b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.373+0000 7f3560e15b80 1 -- 172.21.15.49:0/3877040330 >> 172.21.15.49:0/3877040330 conn(0x558aef8a1080 msgr2=0x558aef97ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:39.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.373+0000 7f3560e15b80 1 -- 172.21.15.49:0/3877040330 shutdown_connections 2024-06-03T00:01:39.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.373+0000 7f3560e15b80 1 -- 172.21.15.49:0/3877040330 wait complete. 2024-06-03T00:01:39.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.374+0000 7f3560e15b80 1 -- start start 2024-06-03T00:01:39.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.374+0000 7f3560e15b80 1 Processor -- start 2024-06-03T00:01:39.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.374+0000 7f3560e15b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558aef979f60 0x558aef9867b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:39.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.374+0000 7f3560e15b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558aef97a880 0x558aef986cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:39.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.374+0000 7f3560e15b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558aef98a460 0x558aef995000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:39.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.374+0000 7f3560e15b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f353c00e830 con 0x558aef979f60 2024-06-03T00:01:39.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.374+0000 7f3560e15b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f353c00e160 con 0x558aef98a460 2024-06-03T00:01:39.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.374+0000 7f3560e15b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f353c00b340 con 0x558aef97a880 2024-06-03T00:01:39.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.374+0000 7f3560e15b80 10 client.0 _ll_register_callbacks cb 0x558aef85b5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:39.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.374+0000 7f354f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558aef97a880 0x558aef986cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:39.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.375+0000 7f354f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558aef97a880 0x558aef986cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:34410/0 (socket says 172.21.15.49:34410) 2024-06-03T00:01:39.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.375+0000 7f354f7fe700 1 -- 172.21.15.49:0/3057051838 learned_addr learned my addr 172.21.15.49:0/3057051838 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:39.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.375+0000 7f3554b2f700 1 --2- 172.21.15.49:0/3057051838 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558aef98a460 0x558aef995000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:39.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.375+0000 7f354f7fe700 1 -- 172.21.15.49:0/3057051838 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558aef98a460 msgr2=0x558aef995000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:39.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.375+0000 7f354f7fe700 1 --2- 172.21.15.49:0/3057051838 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558aef98a460 0x558aef995000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.375+0000 7f354f7fe700 1 -- 172.21.15.49:0/3057051838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558aef979f60 msgr2=0x558aef9867b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:39.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.375+0000 7f354f7fe700 1 --2- 172.21.15.49:0/3057051838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558aef979f60 0x558aef9867b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.375+0000 7f354f7fe700 1 -- 172.21.15.49:0/3057051838 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558aef995750 con 0x558aef97a880 2024-06-03T00:01:39.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.375+0000 7f354f7fe700 1 --2- 172.21.15.49:0/3057051838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558aef97a880 0x558aef986cf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f35440999f0 tx=0x7f354400b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb03e1fc8bc65582 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:39.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.375+0000 7f352f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-06-03T00:01:39.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.375+0000 7f352f7fe700 1 -- 172.21.15.49:0/3057051838 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35440a6170 con 0x558aef97a880 2024-06-03T00:01:39.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.375+0000 7f352f7fe700 1 -- 172.21.15.49:0/3057051838 <== mon.1 v2:172.21.15.107:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f35440b52b0 con 0x558aef97a880 2024-06-03T00:01:39.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.375+0000 7f3560e15b80 1 -- 172.21.15.49:0/3057051838 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f354801a070 con 0x558aef97a880 2024-06-03T00:01:39.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.376+0000 7f352f7fe700 1 -- 172.21.15.49:0/3057051838 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f35440b0410 con 0x558aef97a880 2024-06-03T00:01:39.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.376+0000 7f3560e15b80 10 client.25240 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:39.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.376+0000 7f3560e15b80 1 -- 172.21.15.49:0/3057051838 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558aef9f8680 con 0x558aef97a880 2024-06-03T00:01:39.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.376+0000 7f352f7fe700 1 -- 172.21.15.49:0/3057051838 <== mon.1 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f354801a070 con 0x558aef97a880 2024-06-03T00:01:39.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.376+0000 7f352f7fe700 1 -- 172.21.15.49:0/3057051838 <== mon.1 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f35440cdb10 con 0x558aef97a880 2024-06-03T00:01:39.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.376+0000 7f3560e15b80 10 client.25240 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:39.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.376+0000 7f3560e15b80 10 client.25240 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-03T00:01:39.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.376+0000 7f3560e15b80 20 client.25240 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:39.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.376+0000 7f3560e15b80 1 --2- 172.21.15.49:0/3057051838 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x558aef9f8d90 0x558aef9fb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:39.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.376+0000 7f3560e15b80 4 client.25240 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-03T00:01:39.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.376+0000 7f3560e15b80 1 -- 172.21.15.49:0/3057051838 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558aef8cd2d0 con 0x558aef9f8d90 2024-06-03T00:01:39.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.376+0000 7f354ffff700 1 --2- 172.21.15.49:0/3057051838 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x558aef9f8d90 0x558aef9fb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:39.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.377+0000 7f352f7fe700 10 client.25240 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:39.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.377+0000 7f354ffff700 1 --2- 172.21.15.49:0/3057051838 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x558aef9f8d90 0x558aef9fb1b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=645d60a9cb765cb0 server_cookie=52f88dc72c672c3a in_seq=0 out_seq=0 2024-06-03T00:01:39.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.377+0000 7f352f7fe700 1 -- 172.21.15.49:0/3057051838 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558aef8cd2d0 con 0x558aef9f8d90 2024-06-03T00:01:39.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.377+0000 7f352f7fe700 10 client.25240 handle_command_reply: tid=0 2024-06-03T00:01:39.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.377+0000 7f3560e15b80 1 client.25240 shutdown 2024-06-03T00:01:39.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.377+0000 7f3560e15b80 1 -- 172.21.15.49:0/3057051838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558aef97a880 msgr2=0x558aef986cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:39.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.377+0000 7f3560e15b80 1 --2- 172.21.15.49:0/3057051838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558aef97a880 0x558aef986cf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f35440999f0 tx=0x7f354400b7b0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.380 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-06-03T00:01:39.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.378+0000 7f3560e15b80 1 -- 172.21.15.49:0/3057051838 shutdown_connections 2024-06-03T00:01:39.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.378+0000 7f3560e15b80 1 --2- 172.21.15.49:0/3057051838 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558aef98a460 0x558aef995000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.378+0000 7f3560e15b80 1 --2- 172.21.15.49:0/3057051838 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x558aef9f8d90 0x558aef9fb1b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.378+0000 7f3560e15b80 1 --2- 172.21.15.49:0/3057051838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558aef979f60 0x558aef9867b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.378+0000 7f3560e15b80 1 --2- 172.21.15.49:0/3057051838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558aef97a880 0x558aef986cf0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.378+0000 7f352f7fe700 0 client.25240 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:39.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.378+0000 7f3560e15b80 1 -- 172.21.15.49:0/3057051838 >> 172.21.15.49:0/3057051838 conn(0x558aef8a1080 msgr2=0x558aef97f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:39.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.378+0000 7f3560e15b80 1 -- 172.21.15.49:0/3057051838 shutdown_connections 2024-06-03T00:01:39.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.378+0000 7f3560e15b80 1 -- 172.21.15.49:0/3057051838 wait complete. 2024-06-03T00:01:39.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.378+0000 7f3560e15b80 20 client.25240 trim_cache size 0 max 16384 2024-06-03T00:01:39.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.379+0000 7f3556592700 1 -- 172.21.15.49:0/1980461673 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f35380a2ca0 msgr2=0x7f35380a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:39.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.379+0000 7f3556592700 1 --2- 172.21.15.49:0/1980461673 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f35380a2ca0 0x7f35380a5160 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3540009c60 tx=0x7f3540009260 comp rx=0 tx=0).stop 2024-06-03T00:01:39.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.379+0000 7f3556592700 1 -- 172.21.15.49:0/1980461673 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f355006b4e0 msgr2=0x7f355019b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:39.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.379+0000 7f3556592700 1 --2- 172.21.15.49:0/1980461673 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f355006b4e0 0x7f355019b3c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f354400b2e0 tx=0x7f354400b610 comp rx=0 tx=0).stop 2024-06-03T00:01:39.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.379+0000 7f3556592700 1 -- 172.21.15.49:0/1980461673 shutdown_connections 2024-06-03T00:01:39.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.379+0000 7f3556592700 1 --2- 172.21.15.49:0/1980461673 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f35380a2ca0 0x7f35380a5160 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.379+0000 7f3556592700 1 --2- 172.21.15.49:0/1980461673 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f355010ef70 0x7f355019f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.379+0000 7f3556592700 1 --2- 172.21.15.49:0/1980461673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f355006abc0 0x7f355019ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.379+0000 7f3556592700 1 --2- 172.21.15.49:0/1980461673 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f355006b4e0 0x7f355019b3c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:39.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.379+0000 7f3556592700 1 -- 172.21.15.49:0/1980461673 >> 172.21.15.49:0/1980461673 conn(0x7f3550078330 msgr2=0x7f35501103c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:39.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.379+0000 7f3556592700 1 -- 172.21.15.49:0/1980461673 shutdown_connections 2024-06-03T00:01:39.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:39.379+0000 7f3556592700 1 -- 172.21.15.49:0/1980461673 wait complete. 2024-06-03T00:01:40.142 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:01:40.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:40 smithi057 ceph-mon[36457]: pgmap v432: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-06-03T00:01:40.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:40 smithi049 ceph-mon[32302]: pgmap v432: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-06-03T00:01:40.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:40 smithi107 ceph-mon[37048]: pgmap v432: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-06-03T00:01:41.074 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-06-03T00:01:41.075 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-06-03T00:01:41.438 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:01:42.688 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:42 smithi049 ceph-mon[32302]: pgmap v433: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-06-03T00:01:42.895 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:42 smithi107 ceph-mon[37048]: pgmap v433: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-06-03T00:01:42.896 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:42 smithi057 ceph-mon[36457]: pgmap v433: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-06-03T00:01:42.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.716+0000 7f5f9b530700 1 -- 172.21.15.49:0/4089989322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f94101440 msgr2=0x7f5f9410f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:42.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.716+0000 7f5f9b530700 1 --2- 172.21.15.49:0/4089989322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f94101440 0x7f5f9410f350 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00b0a0 tx=0x7f5f8c00b3b0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.716+0000 7f5f9b530700 1 -- 172.21.15.49:0/4089989322 shutdown_connections 2024-06-03T00:01:42.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.716+0000 7f5f9b530700 1 --2- 172.21.15.49:0/4089989322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f94101440 0x7f5f9410f350 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.716+0000 7f5f9b530700 1 --2- 172.21.15.49:0/4089989322 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f94108510 0x7f5f941088f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.716+0000 7f5f9b530700 1 --2- 172.21.15.49:0/4089989322 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f94100a80 0x7f5f94100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.716+0000 7f5f9b530700 1 -- 172.21.15.49:0/4089989322 >> 172.21.15.49:0/4089989322 conn(0x7f5f94077a30 msgr2=0x7f5f940fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:42.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.716+0000 7f5f9b530700 1 -- 172.21.15.49:0/4089989322 shutdown_connections 2024-06-03T00:01:42.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.716+0000 7f5f9b530700 1 -- 172.21.15.49:0/4089989322 wait complete. 2024-06-03T00:01:42.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.716+0000 7f5f9b530700 1 Processor -- start 2024-06-03T00:01:42.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.716+0000 7f5f9b530700 1 -- start start 2024-06-03T00:01:42.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.717+0000 7f5f9b530700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f94100a80 0x7f5f9419e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:42.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.717+0000 7f5f9b530700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f94101440 0x7f5f9419ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:42.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.717+0000 7f5f9b530700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f94108510 0x7f5f94198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:42.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.717+0000 7f5f9b530700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5f94112730 con 0x7f5f94108510 2024-06-03T00:01:42.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.717+0000 7f5f9b530700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5f941125b0 con 0x7f5f94100a80 2024-06-03T00:01:42.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.717+0000 7f5f9b530700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5f941128b0 con 0x7f5f94101440 2024-06-03T00:01:42.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.717+0000 7f5f99acd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f94108510 0x7f5f94198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:42.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.717+0000 7f5f99acd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f94108510 0x7f5f94198890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45926/0 (socket says 172.21.15.49:45926) 2024-06-03T00:01:42.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.717+0000 7f5f99acd700 1 -- 172.21.15.49:0/2437003634 learned_addr learned my addr 172.21.15.49:0/2437003634 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:42.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.717+0000 7f5f98acb700 1 --2- 172.21.15.49:0/2437003634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f94101440 0x7f5f9419ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:42.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.717+0000 7f5f992cc700 1 --2- 172.21.15.49:0/2437003634 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f94100a80 0x7f5f9419e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:42.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.717+0000 7f5f99acd700 1 -- 172.21.15.49:0/2437003634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f94101440 msgr2=0x7f5f9419ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:42.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.717+0000 7f5f99acd700 1 --2- 172.21.15.49:0/2437003634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f94101440 0x7f5f9419ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.717+0000 7f5f99acd700 1 -- 172.21.15.49:0/2437003634 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f94100a80 msgr2=0x7f5f9419e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:42.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.717+0000 7f5f99acd700 1 --2- 172.21.15.49:0/2437003634 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f94100a80 0x7f5f9419e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.717+0000 7f5f99acd700 1 -- 172.21.15.49:0/2437003634 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f94199070 con 0x7f5f94108510 2024-06-03T00:01:42.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.717+0000 7f5f992cc700 1 --2- 172.21.15.49:0/2437003634 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f94100a80 0x7f5f9419e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:42.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.717+0000 7f5f99acd700 1 --2- 172.21.15.49:0/2437003634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f94108510 0x7f5f94198890 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c0062a0 tx=0x7f5f8c004d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:42.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.718+0000 7f5f8a7fc700 1 -- 172.21.15.49:0/2437003634 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c021070 con 0x7f5f94108510 2024-06-03T00:01:42.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.718+0000 7f5f9b530700 1 -- 172.21.15.49:0/2437003634 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f94199300 con 0x7f5f94108510 2024-06-03T00:01:42.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.718+0000 7f5f8a7fc700 1 -- 172.21.15.49:0/2437003634 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f8c007c00 con 0x7f5f94108510 2024-06-03T00:01:42.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.718+0000 7f5f8a7fc700 1 -- 172.21.15.49:0/2437003634 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c01d450 con 0x7f5f94108510 2024-06-03T00:01:42.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.718+0000 7f5f9b530700 1 -- 172.21.15.49:0/2437003634 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f941a5520 con 0x7f5f94108510 2024-06-03T00:01:42.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.720+0000 7f5f8a7fc700 1 -- 172.21.15.49:0/2437003634 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5f8c004020 con 0x7f5f94108510 2024-06-03T00:01:42.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.721+0000 7f5f8a7fc700 1 --2- 172.21.15.49:0/2437003634 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f5f800a2cc0 0x7f5f800a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:42.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.721+0000 7f5f8a7fc700 1 -- 172.21.15.49:0/2437003634 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f5f8c0cfda0 con 0x7f5f94108510 2024-06-03T00:01:42.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.721+0000 7f5f992cc700 1 --2- 172.21.15.49:0/2437003634 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f5f800a2cc0 0x7f5f800a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:42.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.721+0000 7f5f992cc700 1 --2- 172.21.15.49:0/2437003634 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f5f800a2cc0 0x7f5f800a5180 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5f90005e10 tx=0x7f5f90005d60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:42.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.723+0000 7f5fa5db3b80 1 Processor -- start 2024-06-03T00:01:42.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.723+0000 7f5fa5db3b80 1 -- start start 2024-06-03T00:01:42.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.723+0000 7f5fa5db3b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aa95329590 0x55aa95329970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:42.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.723+0000 7f5fa5db3b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55aa95329eb0 0x55aa953237a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:42.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.723+0000 7f5fa5db3b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aa95323ce0 0x55aa95324100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:42.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.723+0000 7f5fa5db3b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55aa952160f0 con 0x55aa95323ce0 2024-06-03T00:01:42.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.723+0000 7f5fa5db3b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55aa952749e0 con 0x55aa95329590 2024-06-03T00:01:42.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.723+0000 7f5fa5db3b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55aa951dc5f0 con 0x55aa95329eb0 2024-06-03T00:01:42.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.724+0000 7f5f99acd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aa95323ce0 0x55aa95324100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:42.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.724+0000 7f5f99acd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aa95323ce0 0x55aa95324100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45938/0 (socket says 172.21.15.49:45938) 2024-06-03T00:01:42.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.724+0000 7f5f99acd700 1 -- 172.21.15.49:0/3270735405 learned_addr learned my addr 172.21.15.49:0/3270735405 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:42.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.724+0000 7f5f992cc700 1 --2- 172.21.15.49:0/3270735405 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aa95329590 0x55aa95329970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:42.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.724+0000 7f5f98acb700 1 --2- 172.21.15.49:0/3270735405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55aa95329eb0 0x55aa953237a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:42.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.724+0000 7f5f99acd700 1 -- 172.21.15.49:0/3270735405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55aa95329eb0 msgr2=0x55aa953237a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:42.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.724+0000 7f5f99acd700 1 --2- 172.21.15.49:0/3270735405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55aa95329eb0 0x55aa953237a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.724+0000 7f5f99acd700 1 -- 172.21.15.49:0/3270735405 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aa95329590 msgr2=0x55aa95329970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:42.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.724+0000 7f5f99acd700 1 --2- 172.21.15.49:0/3270735405 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aa95329590 0x55aa95329970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.724+0000 7f5f99acd700 1 -- 172.21.15.49:0/3270735405 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa951c3a60 con 0x55aa95323ce0 2024-06-03T00:01:42.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.724+0000 7f5f99acd700 1 --2- 172.21.15.49:0/3270735405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aa95323ce0 0x55aa95324100 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c099060 tx=0x7f5f8c003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3b78b8cdf7ee10 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:42.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.724+0000 7f5f7f7fe700 1 -- 172.21.15.49:0/3270735405 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c02a070 con 0x55aa95323ce0 2024-06-03T00:01:42.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.724+0000 7f5f7f7fe700 1 -- 172.21.15.49:0/3270735405 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f8c09c690 con 0x55aa95323ce0 2024-06-03T00:01:42.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.724+0000 7f5f7f7fe700 1 -- 172.21.15.49:0/3270735405 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c09aa20 con 0x55aa95323ce0 2024-06-03T00:01:42.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.725+0000 7f5fa5db3b80 1 -- 172.21.15.49:0/3270735405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aa95323ce0 msgr2=0x55aa95324100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:42.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.725+0000 7f5fa5db3b80 1 --2- 172.21.15.49:0/3270735405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aa95323ce0 0x55aa95324100 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c099060 tx=0x7f5f8c003f70 comp rx=0 tx=0).stop 2024-06-03T00:01:42.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.725+0000 7f5fa5db3b80 1 -- 172.21.15.49:0/3270735405 shutdown_connections 2024-06-03T00:01:42.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.725+0000 7f5fa5db3b80 1 --2- 172.21.15.49:0/3270735405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aa95323ce0 0x55aa95324100 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.725+0000 7f5fa5db3b80 1 --2- 172.21.15.49:0/3270735405 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aa95329590 0x55aa95329970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.725+0000 7f5fa5db3b80 1 --2- 172.21.15.49:0/3270735405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55aa95329eb0 0x55aa953237a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.725+0000 7f5fa5db3b80 1 -- 172.21.15.49:0/3270735405 >> 172.21.15.49:0/3270735405 conn(0x55aa95250210 msgr2=0x55aa9531ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:42.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.726+0000 7f5fa5db3b80 1 -- 172.21.15.49:0/3270735405 shutdown_connections 2024-06-03T00:01:42.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.726+0000 7f5fa5db3b80 1 -- 172.21.15.49:0/3270735405 wait complete. 2024-06-03T00:01:42.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.726+0000 7f5fa5db3b80 1 -- start start 2024-06-03T00:01:42.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.726+0000 7f5fa5db3b80 1 Processor -- start 2024-06-03T00:01:42.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.727+0000 7f5fa5db3b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aa95323ce0 0x55aa9532fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:42.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.727+0000 7f5fa5db3b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aa95329590 0x55aa9532cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:42.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.727+0000 7f5fa5db3b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55aa95329eb0 0x55aa9532d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:42.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.727+0000 7f5fa5db3b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55aa95215150 con 0x55aa95323ce0 2024-06-03T00:01:42.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.727+0000 7f5fa5db3b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55aa952709a0 con 0x55aa95329590 2024-06-03T00:01:42.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.727+0000 7f5fa5db3b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55aa95330640 con 0x55aa95329eb0 2024-06-03T00:01:42.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.727+0000 7f5fa5db3b80 10 client.0 _ll_register_callbacks cb 0x55aa9520a740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:42.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.727+0000 7f5f992cc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aa95323ce0 0x55aa9532fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:42.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.727+0000 7f5f992cc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aa95323ce0 0x55aa9532fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45952/0 (socket says 172.21.15.49:45952) 2024-06-03T00:01:42.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.727+0000 7f5f992cc700 1 -- 172.21.15.49:0/1503990345 learned_addr learned my addr 172.21.15.49:0/1503990345 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:42.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.727+0000 7f5f98acb700 1 --2- 172.21.15.49:0/1503990345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aa95329590 0x55aa9532cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:42.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.727+0000 7f5f98acb700 1 -- 172.21.15.49:0/1503990345 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55aa95329eb0 msgr2=0x55aa9532d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:42.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.727+0000 7f5f98acb700 1 --2- 172.21.15.49:0/1503990345 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55aa95329eb0 0x55aa9532d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.727+0000 7f5f98acb700 1 -- 172.21.15.49:0/1503990345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aa95323ce0 msgr2=0x55aa9532fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:42.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.727+0000 7f5f98acb700 1 --2- 172.21.15.49:0/1503990345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aa95323ce0 0x55aa9532fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.727+0000 7f5f98acb700 1 -- 172.21.15.49:0/1503990345 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa9523a8e0 con 0x55aa95329590 2024-06-03T00:01:42.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.727+0000 7f5f992cc700 1 --2- 172.21.15.49:0/1503990345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aa95323ce0 0x55aa9532fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:01:42.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.728+0000 7f5f7cff9700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2024-06-03T00:01:42.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.728+0000 7f5f98acb700 1 --2- 172.21.15.49:0/1503990345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aa95329590 0x55aa9532cf00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5f84012810 tx=0x7f5f84012bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa8b38c6aa5011a8 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:42.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.728+0000 7f5f7cff9700 1 -- 172.21.15.49:0/1503990345 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8401f060 con 0x55aa95329590 2024-06-03T00:01:42.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.728+0000 7f5fa5db3b80 1 -- 172.21.15.49:0/1503990345 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f8c09c690 con 0x55aa95329590 2024-06-03T00:01:42.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.728+0000 7f5f7cff9700 1 -- 172.21.15.49:0/1503990345 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f5f84003680 con 0x55aa95329590 2024-06-03T00:01:42.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.728+0000 7f5f7cff9700 1 -- 172.21.15.49:0/1503990345 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5f84004520 con 0x55aa95329590 2024-06-03T00:01:42.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.728+0000 7f5fa5db3b80 10 client.25208 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:42.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.728+0000 7f5fa5db3b80 1 -- 172.21.15.49:0/1503990345 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55aa9533f1e0 con 0x55aa95329590 2024-06-03T00:01:42.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.728+0000 7f5f7cff9700 1 -- 172.21.15.49:0/1503990345 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f8c09c690 con 0x55aa95329590 2024-06-03T00:01:42.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.729+0000 7f5f7cff9700 1 -- 172.21.15.49:0/1503990345 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f5f84024070 con 0x55aa95329590 2024-06-03T00:01:42.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.729+0000 7f5fa5db3b80 10 client.25208 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:42.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.729+0000 7f5fa5db3b80 10 client.25208 resolve_mds: validated gid 24487 aka daemon mds.i 2024-06-03T00:01:42.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.729+0000 7f5fa5db3b80 20 client.25208 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:42.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.729+0000 7f5fa5db3b80 1 --2- 172.21.15.49:0/1503990345 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55aa953417c0 0x55aa95343c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:42.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.729+0000 7f5fa5db3b80 4 client.25208 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:01:42.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.729+0000 7f5fa5db3b80 1 -- 172.21.15.49:0/1503990345 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa95281ee0 con 0x55aa953417c0 2024-06-03T00:01:42.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.729+0000 7f5f992cc700 1 --2- 172.21.15.49:0/1503990345 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55aa953417c0 0x55aa95343c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:42.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.729+0000 7f5f992cc700 1 --2- 172.21.15.49:0/1503990345 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55aa953417c0 0x55aa95343c10 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2b3cec6caccb115 server_cookie=4d53b51b2fe080b8 in_seq=0 out_seq=0 2024-06-03T00:01:42.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.729+0000 7f5f7cff9700 10 client.25208 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:42.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.730+0000 7f5f7cff9700 1 -- 172.21.15.49:0/1503990345 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55aa95281ee0 con 0x55aa953417c0 2024-06-03T00:01:42.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.730+0000 7f5f7cff9700 10 client.25208 handle_command_reply: tid=0 2024-06-03T00:01:42.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.730+0000 7f5fa5db3b80 1 client.25208 shutdown 2024-06-03T00:01:42.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.730+0000 7f5fa5db3b80 1 -- 172.21.15.49:0/1503990345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aa95329590 msgr2=0x55aa9532cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:42.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.730+0000 7f5fa5db3b80 1 --2- 172.21.15.49:0/1503990345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aa95329590 0x55aa9532cf00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5f84012810 tx=0x7f5f84012bd0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.730+0000 7f5fa5db3b80 1 -- 172.21.15.49:0/1503990345 shutdown_connections 2024-06-03T00:01:42.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.730+0000 7f5fa5db3b80 1 --2- 172.21.15.49:0/1503990345 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55aa95329eb0 0x55aa9532d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.730+0000 7f5fa5db3b80 1 --2- 172.21.15.49:0/1503990345 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55aa953417c0 0x55aa95343c10 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.730+0000 7f5fa5db3b80 1 --2- 172.21.15.49:0/1503990345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aa95323ce0 0x55aa9532fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.730+0000 7f5fa5db3b80 1 --2- 172.21.15.49:0/1503990345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aa95329590 0x55aa9532cf00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.730+0000 7f5fa5db3b80 1 -- 172.21.15.49:0/1503990345 >> 172.21.15.49:0/1503990345 conn(0x55aa95250210 msgr2=0x55aa9531dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:42.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.730+0000 7f5f7cff9700 0 client.25208 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:42.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.731+0000 7f5fa5db3b80 1 -- 172.21.15.49:0/1503990345 shutdown_connections 2024-06-03T00:01:42.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.731+0000 7f5fa5db3b80 1 -- 172.21.15.49:0/1503990345 wait complete. 2024-06-03T00:01:42.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.731+0000 7f5fa5db3b80 20 client.25208 trim_cache size 0 max 16384 2024-06-03T00:01:42.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.765+0000 7f5fa5db3b80 1 Processor -- start 2024-06-03T00:01:42.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.765+0000 7f5fa5db3b80 1 -- start start 2024-06-03T00:01:42.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.766+0000 7f5fa5db3b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55aa95323ce0 0x55aa9532f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:42.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.766+0000 7f5fa5db3b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aa95329590 0x55aa9531e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:42.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.766+0000 7f5fa5db3b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aa95329eb0 0x55aa9531e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:42.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.766+0000 7f5fa5db3b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5f941aa780 con 0x55aa95329eb0 2024-06-03T00:01:42.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.766+0000 7f5fa5db3b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5f941ac2c0 con 0x55aa95329590 2024-06-03T00:01:42.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.766+0000 7f5fa5db3b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5f941aae50 con 0x55aa95323ce0 2024-06-03T00:01:42.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.766+0000 7f5f99acd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aa95329eb0 0x55aa9531e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:42.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.766+0000 7f5f99acd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aa95329eb0 0x55aa9531e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45954/0 (socket says 172.21.15.49:45954) 2024-06-03T00:01:42.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.766+0000 7f5f99acd700 1 -- 172.21.15.49:0/2595699426 learned_addr learned my addr 172.21.15.49:0/2595699426 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:42.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.766+0000 7f5f98acb700 1 --2- 172.21.15.49:0/2595699426 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aa95329590 0x55aa9531e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:42.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.766+0000 7f5f992cc700 1 --2- 172.21.15.49:0/2595699426 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55aa95323ce0 0x55aa9532f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:42.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.766+0000 7f5f99acd700 1 -- 172.21.15.49:0/2595699426 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55aa95323ce0 msgr2=0x55aa9532f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:42.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.766+0000 7f5f99acd700 1 --2- 172.21.15.49:0/2595699426 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55aa95323ce0 0x55aa9532f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.766+0000 7f5f99acd700 1 -- 172.21.15.49:0/2595699426 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aa95329590 msgr2=0x55aa9531e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:42.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.766+0000 7f5f99acd700 1 --2- 172.21.15.49:0/2595699426 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aa95329590 0x55aa9531e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.766+0000 7f5f99acd700 1 -- 172.21.15.49:0/2595699426 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa95344290 con 0x55aa95329eb0 2024-06-03T00:01:42.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.766+0000 7f5f99acd700 1 --2- 172.21.15.49:0/2595699426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aa95329eb0 0x55aa9531e900 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c09c390 tx=0x7f5f8c0a3040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93bfa99bc97520 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:42.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.767+0000 7f5f7effd700 1 -- 172.21.15.49:0/2595699426 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c02a070 con 0x55aa95329eb0 2024-06-03T00:01:42.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.767+0000 7f5f7effd700 1 -- 172.21.15.49:0/2595699426 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f8c0870b0 con 0x55aa95329eb0 2024-06-03T00:01:42.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.767+0000 7f5f7effd700 1 -- 172.21.15.49:0/2595699426 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c0074e0 con 0x55aa95329eb0 2024-06-03T00:01:42.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.767+0000 7f5fa5db3b80 1 -- 172.21.15.49:0/2595699426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aa95329eb0 msgr2=0x55aa9531e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:42.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.767+0000 7f5fa5db3b80 1 --2- 172.21.15.49:0/2595699426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aa95329eb0 0x55aa9531e900 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c09c390 tx=0x7f5f8c0a3040 comp rx=0 tx=0).stop 2024-06-03T00:01:42.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.768+0000 7f5fa5db3b80 1 -- 172.21.15.49:0/2595699426 shutdown_connections 2024-06-03T00:01:42.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.768+0000 7f5fa5db3b80 1 --2- 172.21.15.49:0/2595699426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aa95329eb0 0x55aa9531e900 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.768+0000 7f5fa5db3b80 1 --2- 172.21.15.49:0/2595699426 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55aa95323ce0 0x55aa9532f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.768+0000 7f5fa5db3b80 1 --2- 172.21.15.49:0/2595699426 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aa95329590 0x55aa9531e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.768+0000 7f5fa5db3b80 1 -- 172.21.15.49:0/2595699426 >> 172.21.15.49:0/2595699426 conn(0x55aa95250210 msgr2=0x55aa953288f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:42.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.768+0000 7f5fa5db3b80 1 -- 172.21.15.49:0/2595699426 shutdown_connections 2024-06-03T00:01:42.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.768+0000 7f5fa5db3b80 1 -- 172.21.15.49:0/2595699426 wait complete. 2024-06-03T00:01:42.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.768+0000 7f5fa5db3b80 1 -- start start 2024-06-03T00:01:42.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.768+0000 7f5fa5db3b80 1 Processor -- start 2024-06-03T00:01:42.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.768+0000 7f5fa5db3b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55aa95323ce0 0x55aa95335890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:42.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.769+0000 7f5fa5db3b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aa95329590 0x55aa95335dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:42.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.769+0000 7f5fa5db3b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aa95329eb0 0x55aa95332860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:42.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.769+0000 7f5fa5db3b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5f941abbf0 con 0x55aa95329eb0 2024-06-03T00:01:42.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.769+0000 7f5fa5db3b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5f941ab520 con 0x55aa95329590 2024-06-03T00:01:42.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.769+0000 7f5fa5db3b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5f941a8700 con 0x55aa95323ce0 2024-06-03T00:01:42.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.769+0000 7f5fa5db3b80 10 client.0 _ll_register_callbacks cb 0x55aa9520a740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:42.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.769+0000 7f5f99acd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aa95329eb0 0x55aa95332860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:42.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.769+0000 7f5f99acd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aa95329eb0 0x55aa95332860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45956/0 (socket says 172.21.15.49:45956) 2024-06-03T00:01:42.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.769+0000 7f5f99acd700 1 -- 172.21.15.49:0/3324604459 learned_addr learned my addr 172.21.15.49:0/3324604459 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:42.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.769+0000 7f5f98acb700 1 --2- 172.21.15.49:0/3324604459 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aa95329590 0x55aa95335dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:42.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.769+0000 7f5f992cc700 1 --2- 172.21.15.49:0/3324604459 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55aa95323ce0 0x55aa95335890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:42.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.769+0000 7f5f99acd700 1 -- 172.21.15.49:0/3324604459 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55aa95323ce0 msgr2=0x55aa95335890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:42.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.769+0000 7f5f99acd700 1 --2- 172.21.15.49:0/3324604459 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55aa95323ce0 0x55aa95335890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.769+0000 7f5f99acd700 1 -- 172.21.15.49:0/3324604459 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aa95329590 msgr2=0x55aa95335dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:42.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.769+0000 7f5f99acd700 1 --2- 172.21.15.49:0/3324604459 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aa95329590 0x55aa95335dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.769+0000 7f5f99acd700 1 -- 172.21.15.49:0/3324604459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa95332da0 con 0x55aa95329eb0 2024-06-03T00:01:42.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.769+0000 7f5f99acd700 1 --2- 172.21.15.49:0/3324604459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aa95329eb0 0x55aa95332860 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c09c210 tx=0x7f5f8c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ffa48fa91b35513 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:42.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.769+0000 7f5f7cff9700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:01:42.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.769+0000 7f5f7cff9700 1 -- 172.21.15.49:0/3324604459 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c02a070 con 0x55aa95329eb0 2024-06-03T00:01:42.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.769+0000 7f5f7cff9700 1 -- 172.21.15.49:0/3324604459 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f5f8c0074e0 con 0x55aa95329eb0 2024-06-03T00:01:42.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.770+0000 7f5fa5db3b80 1 -- 172.21.15.49:0/3324604459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f8c0870b0 con 0x55aa95329eb0 2024-06-03T00:01:42.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.770+0000 7f5f7cff9700 1 -- 172.21.15.49:0/3324604459 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5f8c0a5270 con 0x55aa95329eb0 2024-06-03T00:01:42.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.770+0000 7f5fa5db3b80 10 client.15630 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:42.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.770+0000 7f5fa5db3b80 1 -- 172.21.15.49:0/3324604459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55aa953acbe0 con 0x55aa95329eb0 2024-06-03T00:01:42.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.770+0000 7f5f7cff9700 1 -- 172.21.15.49:0/3324604459 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f8c0870b0 con 0x55aa95329eb0 2024-06-03T00:01:42.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.770+0000 7f5f7cff9700 1 -- 172.21.15.49:0/3324604459 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f5f8c02d060 con 0x55aa95329eb0 2024-06-03T00:01:42.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.770+0000 7f5fa5db3b80 10 client.15630 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:42.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.770+0000 7f5fa5db3b80 10 client.15630 resolve_mds: validated gid 24487 aka daemon mds.i 2024-06-03T00:01:42.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.770+0000 7f5fa5db3b80 20 client.15630 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:42.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.770+0000 7f5fa5db3b80 1 --2- 172.21.15.49:0/3324604459 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55aa953acec0 0x55aa953af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:42.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.770+0000 7f5fa5db3b80 4 client.15630 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.9, "await_for": 45.0}] 2024-06-03T00:01:42.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.770+0000 7f5fa5db3b80 1 -- 172.21.15.49:0/3324604459 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.9, "await_for": 45.0}) -- 0x55aa9527c460 con 0x55aa953acec0 2024-06-03T00:01:42.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.771+0000 7f5f992cc700 1 --2- 172.21.15.49:0/3324604459 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55aa953acec0 0x55aa953af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:42.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.771+0000 7f5f7cff9700 10 client.15630 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:42.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.771+0000 7f5f992cc700 1 --2- 172.21.15.49:0/3324604459 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55aa953acec0 0x55aa953af2b0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e133d0fb9ceed456 server_cookie=1bccbf82cf2fc309 in_seq=0 out_seq=0 2024-06-03T00:01:42.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.779+0000 7f5f7cff9700 1 -- 172.21.15.49:0/3324604459 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55aa9527c460 con 0x55aa953acec0 2024-06-03T00:01:42.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.779+0000 7f5f7cff9700 10 client.15630 handle_command_reply: tid=0 2024-06-03T00:01:42.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.779+0000 7f5fa5db3b80 1 client.15630 shutdown 2024-06-03T00:01:42.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.779+0000 7f5fa5db3b80 1 -- 172.21.15.49:0/3324604459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aa95329eb0 msgr2=0x55aa95332860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:42.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.779+0000 7f5fa5db3b80 1 --2- 172.21.15.49:0/3324604459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aa95329eb0 0x55aa95332860 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c09c210 tx=0x7f5f8c01a000 comp rx=0 tx=0).stop 2024-06-03T00:01:42.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.779+0000 7f5fa5db3b80 1 -- 172.21.15.49:0/3324604459 shutdown_connections 2024-06-03T00:01:42.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.779+0000 7f5fa5db3b80 1 --2- 172.21.15.49:0/3324604459 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55aa953acec0 0x55aa953af2b0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.779+0000 7f5fa5db3b80 1 --2- 172.21.15.49:0/3324604459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aa95329eb0 0x55aa95332860 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.779+0000 7f5fa5db3b80 1 --2- 172.21.15.49:0/3324604459 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55aa95323ce0 0x55aa95335890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.779+0000 7f5f7cff9700 0 client.15630 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:42.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.779+0000 7f5fa5db3b80 1 --2- 172.21.15.49:0/3324604459 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aa95329590 0x55aa95335dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.779+0000 7f5fa5db3b80 1 -- 172.21.15.49:0/3324604459 >> 172.21.15.49:0/3324604459 conn(0x55aa95250210 msgr2=0x55aa95322790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:42.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.779+0000 7f5fa5db3b80 1 -- 172.21.15.49:0/3324604459 shutdown_connections 2024-06-03T00:01:42.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.779+0000 7f5fa5db3b80 1 -- 172.21.15.49:0/3324604459 wait complete. 2024-06-03T00:01:42.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.779+0000 7f5fa5db3b80 20 client.15630 trim_cache size 0 max 16384 2024-06-03T00:01:42.930 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:01:42.930 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 27, 2024-06-03T00:01:42.930 INFO:teuthology.orchestra.run.smithi049.stdout: "leader": 24487, 2024-06-03T00:01:42.930 INFO:teuthology.orchestra.run.smithi049.stdout: "set_version": 2, 2024-06-03T00:01:42.930 INFO:teuthology.orchestra.run.smithi049.stdout: "sets": { 2024-06-03T00:01:42.930 INFO:teuthology.orchestra.run.smithi049.stdout: "5715c98c": { 2024-06-03T00:01:42.930 INFO:teuthology.orchestra.run.smithi049.stdout: "version": 2, 2024-06-03T00:01:42.930 INFO:teuthology.orchestra.run.smithi049.stdout: "age_ref": 0.0, 2024-06-03T00:01:42.930 INFO:teuthology.orchestra.run.smithi049.stdout: "state": { 2024-06-03T00:01:42.930 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "QUIESCED", 2024-06-03T00:01:42.931 INFO:teuthology.orchestra.run.smithi049.stdout: "age": 0.0 2024-06-03T00:01:42.931 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:01:42.931 INFO:teuthology.orchestra.run.smithi049.stdout: "timeout": 90.0, 2024-06-03T00:01:42.931 INFO:teuthology.orchestra.run.smithi049.stdout: "expiration": 146.9, 2024-06-03T00:01:42.931 INFO:teuthology.orchestra.run.smithi049.stdout: "members": { 2024-06-03T00:01:42.931 INFO:teuthology.orchestra.run.smithi049.stdout: "file:/": { 2024-06-03T00:01:42.931 INFO:teuthology.orchestra.run.smithi049.stdout: "excluded": false, 2024-06-03T00:01:42.931 INFO:teuthology.orchestra.run.smithi049.stdout: "state": { 2024-06-03T00:01:42.931 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "QUIESCED", 2024-06-03T00:01:42.931 INFO:teuthology.orchestra.run.smithi049.stdout: "age": 0.0 2024-06-03T00:01:42.931 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:01:42.931 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:01:42.932 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:01:42.932 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:01:42.932 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:01:42.932 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:01:42.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.780+0000 7f5f9b530700 1 -- 172.21.15.49:0/2437003634 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f5f800a2cc0 msgr2=0x7f5f800a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:42.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.780+0000 7f5f9b530700 1 --2- 172.21.15.49:0/2437003634 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f5f800a2cc0 0x7f5f800a5180 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5f90005e10 tx=0x7f5f90005d60 comp rx=0 tx=0).stop 2024-06-03T00:01:42.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.780+0000 7f5f9b530700 1 -- 172.21.15.49:0/2437003634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f94108510 msgr2=0x7f5f94198890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:42.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.780+0000 7f5f9b530700 1 --2- 172.21.15.49:0/2437003634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f94108510 0x7f5f94198890 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c0062a0 tx=0x7f5f8c004d70 comp rx=0 tx=0).stop 2024-06-03T00:01:42.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.780+0000 7f5f9b530700 1 -- 172.21.15.49:0/2437003634 shutdown_connections 2024-06-03T00:01:42.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.780+0000 7f5f9b530700 1 --2- 172.21.15.49:0/2437003634 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f5f800a2cc0 0x7f5f800a5180 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.780+0000 7f5f9b530700 1 --2- 172.21.15.49:0/2437003634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f94108510 0x7f5f94198890 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.780+0000 7f5f9b530700 1 --2- 172.21.15.49:0/2437003634 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f94100a80 0x7f5f9419e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.780+0000 7f5f9b530700 1 --2- 172.21.15.49:0/2437003634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f94101440 0x7f5f9419ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.780+0000 7f5f9b530700 1 -- 172.21.15.49:0/2437003634 >> 172.21.15.49:0/2437003634 conn(0x7f5f94077a30 msgr2=0x7f5f940fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:42.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.780+0000 7f5f9b530700 1 -- 172.21.15.49:0/2437003634 shutdown_connections 2024-06-03T00:01:42.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:42.780+0000 7f5f9b530700 1 -- 172.21.15.49:0/2437003634 wait complete. 2024-06-03T00:01:43.751 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.750+0000 7f6a46309640 1 -- 172.21.15.49:0/2066408687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a401024b0 msgr2=0x7f6a40108d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.750+0000 7f6a46309640 1 --2- 172.21.15.49:0/2066408687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a401024b0 0x7f6a40108d40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6a38009ca0 tx=0x7f6a3802a8c0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.750+0000 7f6a46309640 1 -- 172.21.15.49:0/2066408687 shutdown_connections 2024-06-03T00:01:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.750+0000 7f6a46309640 1 --2- 172.21.15.49:0/2066408687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a401024b0 0x7f6a40108d40 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.750+0000 7f6a46309640 1 --2- 172.21.15.49:0/2066408687 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a40101af0 0x7f6a40101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.750+0000 7f6a46309640 1 --2- 172.21.15.49:0/2066408687 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a40100900 0x7f6a40100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.750+0000 7f6a46309640 1 -- 172.21.15.49:0/2066408687 >> 172.21.15.49:0/2066408687 conn(0x7f6a400fbe70 msgr2=0x7f6a400fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.750+0000 7f6a46309640 1 -- 172.21.15.49:0/2066408687 shutdown_connections 2024-06-03T00:01:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.750+0000 7f6a46309640 1 -- 172.21.15.49:0/2066408687 wait complete. 2024-06-03T00:01:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.750+0000 7f6a46309640 1 Processor -- start 2024-06-03T00:01:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.751+0000 7f6a46309640 1 -- start start 2024-06-03T00:01:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.751+0000 7f6a46309640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a40100900 0x7f6a40069c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.751+0000 7f6a46309640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a40101af0 0x7f6a4019c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.751+0000 7f6a46309640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a401024b0 0x7f6a4019ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.751+0000 7f6a46309640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4010c580 con 0x7f6a40100900 2024-06-03T00:01:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.751+0000 7f6a46309640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4010c400 con 0x7f6a40101af0 2024-06-03T00:01:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.751+0000 7f6a46309640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4010c700 con 0x7f6a401024b0 2024-06-03T00:01:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.751+0000 7f6a3ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a40100900 0x7f6a40069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.751+0000 7f6a3ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a40100900 0x7f6a40069c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46026/0 (socket says 172.21.15.49:46026) 2024-06-03T00:01:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.751+0000 7f6a3ffff640 1 -- 172.21.15.49:0/2991811388 learned_addr learned my addr 172.21.15.49:0/2991811388 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.751+0000 7f6a37fff640 1 --2- 172.21.15.49:0/2991811388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a40101af0 0x7f6a4019c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.751+0000 7f6a448a6640 1 --2- 172.21.15.49:0/2991811388 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a401024b0 0x7f6a4019ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.751+0000 7f6a3ffff640 1 -- 172.21.15.49:0/2991811388 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a401024b0 msgr2=0x7f6a4019ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.751+0000 7f6a3ffff640 1 --2- 172.21.15.49:0/2991811388 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a401024b0 0x7f6a4019ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.751+0000 7f6a3ffff640 1 -- 172.21.15.49:0/2991811388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a40101af0 msgr2=0x7f6a4019c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.751+0000 7f6a3ffff640 1 --2- 172.21.15.49:0/2991811388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a40101af0 0x7f6a4019c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.751+0000 7f6a3ffff640 1 -- 172.21.15.49:0/2991811388 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a4019f850 con 0x7f6a40100900 2024-06-03T00:01:43.754 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.751+0000 7f6a37fff640 1 --2- 172.21.15.49:0/2991811388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a40101af0 0x7f6a4019c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:43.754 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.751+0000 7f6a3ffff640 1 --2- 172.21.15.49:0/2991811388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a40100900 0x7f6a40069c20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6a3000e9c0 tx=0x7f6a3000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:43.754 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.751+0000 7f6a3dffb640 1 -- 172.21.15.49:0/2991811388 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3000cd80 con 0x7f6a40100900 2024-06-03T00:01:43.754 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.752+0000 7f6a3dffb640 1 -- 172.21.15.49:0/2991811388 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a300035f0 con 0x7f6a40100900 2024-06-03T00:01:43.754 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.752+0000 7f6a46309640 1 -- 172.21.15.49:0/2991811388 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a4019fb40 con 0x7f6a40100900 2024-06-03T00:01:43.754 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.752+0000 7f6a3dffb640 1 -- 172.21.15.49:0/2991811388 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a30010690 con 0x7f6a40100900 2024-06-03T00:01:43.754 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.752+0000 7f6a46309640 1 -- 172.21.15.49:0/2991811388 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a401a0090 con 0x7f6a40100900 2024-06-03T00:01:43.757 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.754+0000 7f6a3dffb640 1 -- 172.21.15.49:0/2991811388 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6a300037a0 con 0x7f6a40100900 2024-06-03T00:01:43.757 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.754+0000 7f6a3dffb640 1 --2- 172.21.15.49:0/2991811388 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6a2c0a2c30 0x7f6a2c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:43.757 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.755+0000 7f6a3dffb640 1 -- 172.21.15.49:0/2991811388 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f6a300cf5b0 con 0x7f6a40100900 2024-06-03T00:01:43.757 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.755+0000 7f6a37fff640 1 --2- 172.21.15.49:0/2991811388 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6a2c0a2c30 0x7f6a2c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:43.757 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.755+0000 7f6a49010740 1 Processor -- start 2024-06-03T00:01:43.757 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.755+0000 7f6a49010740 1 -- start start 2024-06-03T00:01:43.757 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.755+0000 7f6a37fff640 1 --2- 172.21.15.49:0/2991811388 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6a2c0a2c30 0x7f6a2c0a50f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6a280058c0 tx=0x7f6a28005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:43.757 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.755+0000 7f6a49010740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560b0c98a010 0x560b0c98a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:43.757 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.755+0000 7f6a49010740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560b0c98aa00 0x560b0c98f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:43.757 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.755+0000 7f6a49010740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b0c98fb70 0x560b0c992000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:43.757 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.755+0000 7f6a49010740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x560b0c8ed4f0 con 0x560b0c98fb70 2024-06-03T00:01:43.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.755+0000 7f6a49010740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x560b0c88b870 con 0x560b0c98aa00 2024-06-03T00:01:43.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.755+0000 7f6a49010740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560b0c8e94b0 con 0x560b0c98a010 2024-06-03T00:01:43.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.756+0000 7f6a448a6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b0c98fb70 0x560b0c992000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:43.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.756+0000 7f6a448a6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b0c98fb70 0x560b0c992000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46032/0 (socket says 172.21.15.49:46032) 2024-06-03T00:01:43.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.756+0000 7f6a448a6640 1 -- 172.21.15.49:0/4171230439 learned_addr learned my addr 172.21.15.49:0/4171230439 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:43.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.756+0000 7f6a3ffff640 1 --2- 172.21.15.49:0/4171230439 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560b0c98a010 0x560b0c98a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:43.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.756+0000 7f6a37fff640 1 --2- 172.21.15.49:0/4171230439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560b0c98aa00 0x560b0c98f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:43.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.756+0000 7f6a448a6640 1 -- 172.21.15.49:0/4171230439 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560b0c98a010 msgr2=0x560b0c98a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:43.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.756+0000 7f6a448a6640 1 --2- 172.21.15.49:0/4171230439 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560b0c98a010 0x560b0c98a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.756+0000 7f6a448a6640 1 -- 172.21.15.49:0/4171230439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560b0c98aa00 msgr2=0x560b0c98f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:43.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.756+0000 7f6a448a6640 1 --2- 172.21.15.49:0/4171230439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560b0c98aa00 0x560b0c98f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.756+0000 7f6a448a6640 1 -- 172.21.15.49:0/4171230439 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b0c8a79b0 con 0x560b0c98fb70 2024-06-03T00:01:43.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.756+0000 7f6a448a6640 1 --2- 172.21.15.49:0/4171230439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b0c98fb70 0x560b0c992000 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6a38035000 tx=0x7f6a38009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597b00284ea42797 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:43.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.756+0000 7f6a367fc640 1 -- 172.21.15.49:0/4171230439 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a38031cb0 con 0x560b0c98fb70 2024-06-03T00:01:43.759 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.756+0000 7f6a367fc640 1 -- 172.21.15.49:0/4171230439 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a38036050 con 0x560b0c98fb70 2024-06-03T00:01:43.759 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.756+0000 7f6a367fc640 1 -- 172.21.15.49:0/4171230439 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a38004430 con 0x560b0c98fb70 2024-06-03T00:01:43.759 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.757+0000 7f6a49010740 1 -- 172.21.15.49:0/4171230439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b0c98fb70 msgr2=0x560b0c992000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:43.759 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.757+0000 7f6a49010740 1 --2- 172.21.15.49:0/4171230439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b0c98fb70 0x560b0c992000 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6a38035000 tx=0x7f6a38009360 comp rx=0 tx=0).stop 2024-06-03T00:01:43.759 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.757+0000 7f6a49010740 1 -- 172.21.15.49:0/4171230439 shutdown_connections 2024-06-03T00:01:43.759 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.757+0000 7f6a49010740 1 --2- 172.21.15.49:0/4171230439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560b0c98aa00 0x560b0c98f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.759 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.757+0000 7f6a49010740 1 --2- 172.21.15.49:0/4171230439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b0c98fb70 0x560b0c992000 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.759 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.757+0000 7f6a49010740 1 --2- 172.21.15.49:0/4171230439 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560b0c98a010 0x560b0c98a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.759 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.757+0000 7f6a49010740 1 -- 172.21.15.49:0/4171230439 >> 172.21.15.49:0/4171230439 conn(0x560b0c985680 msgr2=0x560b0c985a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:43.759 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.757+0000 7f6a49010740 1 -- 172.21.15.49:0/4171230439 shutdown_connections 2024-06-03T00:01:43.759 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.757+0000 7f6a49010740 1 -- 172.21.15.49:0/4171230439 wait complete. 2024-06-03T00:01:43.759 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.757+0000 7f6a49010740 1 -- start start 2024-06-03T00:01:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.758+0000 7f6a49010740 1 Processor -- start 2024-06-03T00:01:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.758+0000 7f6a49010740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b0c98a010 0x560b0c994070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.758+0000 7f6a49010740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560b0c98aa00 0x560b0c9945b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.758+0000 7f6a49010740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560b0c98fb70 0x560b0c99b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.758+0000 7f6a49010740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x560b0c992940 con 0x560b0c98a010 2024-06-03T00:01:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.758+0000 7f6a49010740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x560b0c876ae0 con 0x560b0c98aa00 2024-06-03T00:01:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.758+0000 7f6a49010740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560b0c992ac0 con 0x560b0c98fb70 2024-06-03T00:01:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.758+0000 7f6a49010740 10 client.0 _ll_register_callbacks cb 0x560b0c8af9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.758+0000 7f6a3ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b0c98a010 0x560b0c994070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.758+0000 7f6a3ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b0c98a010 0x560b0c994070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46038/0 (socket says 172.21.15.49:46038) 2024-06-03T00:01:43.763 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.758+0000 7f6a3ffff640 1 -- 172.21.15.49:0/4007653711 learned_addr learned my addr 172.21.15.49:0/4007653711 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:43.764 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.758+0000 7f6a37fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560b0c98aa00 0x560b0c9945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:43.764 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.758+0000 7f6a448a6640 1 --2- 172.21.15.49:0/4007653711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560b0c98fb70 0x560b0c99b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:43.764 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.758+0000 7f6a3ffff640 1 -- 172.21.15.49:0/4007653711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560b0c98fb70 msgr2=0x560b0c99b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:43.764 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.758+0000 7f6a3ffff640 1 --2- 172.21.15.49:0/4007653711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560b0c98fb70 0x560b0c99b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.764 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.758+0000 7f6a3ffff640 1 -- 172.21.15.49:0/4007653711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560b0c98aa00 msgr2=0x560b0c9945b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:43.764 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.758+0000 7f6a3ffff640 1 --2- 172.21.15.49:0/4007653711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560b0c98aa00 0x560b0c9945b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.764 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.759+0000 7f6a3ffff640 1 -- 172.21.15.49:0/4007653711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b0c601210 con 0x560b0c98a010 2024-06-03T00:01:43.764 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.759+0000 7f6a37fff640 1 --2- 172.21.15.49:0/4007653711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560b0c98aa00 0x560b0c9945b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:01:43.764 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.759+0000 7f6a3ffff640 1 --2- 172.21.15.49:0/4007653711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b0c98a010 0x560b0c994070 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6a300058c0 tx=0x7f6a3009c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b56498e8e9692fa server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:43.764 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.759+0000 7f6a1f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:01:43.764 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.759+0000 7f6a1f7fe640 1 -- 172.21.15.49:0/4007653711 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a300a4a80 con 0x560b0c98a010 2024-06-03T00:01:43.764 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.759+0000 7f6a1f7fe640 1 -- 172.21.15.49:0/4007653711 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f6a30003b30 con 0x560b0c98a010 2024-06-03T00:01:43.764 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.759+0000 7f6a49010740 1 -- 172.21.15.49:0/4007653711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a38036050 con 0x560b0c98a010 2024-06-03T00:01:43.765 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.759+0000 7f6a1f7fe640 1 -- 172.21.15.49:0/4007653711 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6a300a45f0 con 0x560b0c98a010 2024-06-03T00:01:43.765 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.759+0000 7f6a49010740 10 client.15642 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:43.765 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.759+0000 7f6a49010740 1 -- 172.21.15.49:0/4007653711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560b0c6cd620 con 0x560b0c98a010 2024-06-03T00:01:43.765 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.759+0000 7f6a1f7fe640 1 -- 172.21.15.49:0/4007653711 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a38036050 con 0x560b0c98a010 2024-06-03T00:01:43.765 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.759+0000 7f6a1f7fe640 1 -- 172.21.15.49:0/4007653711 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f6a3009b260 con 0x560b0c98a010 2024-06-03T00:01:43.765 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.759+0000 7f6a49010740 10 client.15642 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:43.765 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.759+0000 7f6a49010740 10 client.15642 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:01:43.765 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.760+0000 7f6a49010740 20 client.15642 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:43.765 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.760+0000 7f6a49010740 1 --2- 172.21.15.49:0/4007653711 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x560b0c99ffa0 0x560b0c9a23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:43.765 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.760+0000 7f6a49010740 4 client.15642 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:01:43.765 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.760+0000 7f6a49010740 1 -- 172.21.15.49:0/4007653711 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b0c900f10 con 0x560b0c99ffa0 2024-06-03T00:01:43.765 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.760+0000 7f6a37fff640 1 --2- 172.21.15.49:0/4007653711 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x560b0c99ffa0 0x560b0c9a23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:43.765 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.760+0000 7f6a1f7fe640 10 client.15642 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:43.765 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.760+0000 7f6a37fff640 1 --2- 172.21.15.49:0/4007653711 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x560b0c99ffa0 0x560b0c9a23f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55998a98504f77fc server_cookie=ad3ca4591ba3cb9d in_seq=0 out_seq=0 2024-06-03T00:01:43.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.761+0000 7f6a1f7fe640 1 -- 172.21.15.49:0/4007653711 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x560b0c900f10 con 0x560b0c99ffa0 2024-06-03T00:01:43.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.761+0000 7f6a1f7fe640 10 client.15642 handle_command_reply: tid=0 2024-06-03T00:01:43.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.761+0000 7f6a49010740 1 client.15642 shutdown 2024-06-03T00:01:43.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.761+0000 7f6a49010740 1 -- 172.21.15.49:0/4007653711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b0c98a010 msgr2=0x560b0c994070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:43.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.761+0000 7f6a49010740 1 --2- 172.21.15.49:0/4007653711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b0c98a010 0x560b0c994070 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6a300058c0 tx=0x7f6a3009c5d0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.761+0000 7f6a49010740 1 -- 172.21.15.49:0/4007653711 shutdown_connections 2024-06-03T00:01:43.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.761+0000 7f6a49010740 1 --2- 172.21.15.49:0/4007653711 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x560b0c99ffa0 0x560b0c9a23f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.761+0000 7f6a49010740 1 --2- 172.21.15.49:0/4007653711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560b0c98aa00 0x560b0c9945b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.761+0000 7f6a49010740 1 --2- 172.21.15.49:0/4007653711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560b0c98fb70 0x560b0c99b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.761+0000 7f6a49010740 1 --2- 172.21.15.49:0/4007653711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b0c98a010 0x560b0c994070 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.761+0000 7f6a1f7fe640 0 client.15642 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:43.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.761+0000 7f6a49010740 1 -- 172.21.15.49:0/4007653711 >> 172.21.15.49:0/4007653711 conn(0x560b0c985680 msgr2=0x560b0c9847e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:43.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.761+0000 7f6a49010740 1 -- 172.21.15.49:0/4007653711 shutdown_connections 2024-06-03T00:01:43.767 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.761+0000 7f6a49010740 1 -- 172.21.15.49:0/4007653711 wait complete. 2024-06-03T00:01:43.767 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.762+0000 7f6a49010740 20 client.15642 trim_cache size 0 max 16384 2024-06-03T00:01:43.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.778+0000 7f6a49010740 1 Processor -- start 2024-06-03T00:01:43.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.778+0000 7f6a49010740 1 -- start start 2024-06-03T00:01:43.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.778+0000 7f6a49010740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560b0c98a010 0x560b0c988ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:43.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.778+0000 7f6a49010740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560b0c98aa00 0x560b0c99b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:43.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.778+0000 7f6a49010740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b0c98fb70 0x560b0c993c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:43.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.778+0000 7f6a49010740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6a401a8e90 con 0x560b0c98fb70 2024-06-03T00:01:43.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.778+0000 7f6a49010740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6a401aa9d0 con 0x560b0c98a010 2024-06-03T00:01:43.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.778+0000 7f6a49010740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6a401a9560 con 0x560b0c98aa00 2024-06-03T00:01:43.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.778+0000 7f6a448a6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b0c98fb70 0x560b0c993c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:43.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.778+0000 7f6a448a6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b0c98fb70 0x560b0c993c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46040/0 (socket says 172.21.15.49:46040) 2024-06-03T00:01:43.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.778+0000 7f6a448a6640 1 -- 172.21.15.49:0/2603170555 learned_addr learned my addr 172.21.15.49:0/2603170555 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:43.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.778+0000 7f6a37fff640 1 --2- 172.21.15.49:0/2603170555 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560b0c98aa00 0x560b0c99b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:43.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.778+0000 7f6a3ffff640 1 --2- 172.21.15.49:0/2603170555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560b0c98a010 0x560b0c988ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:43.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.779+0000 7f6a448a6640 1 -- 172.21.15.49:0/2603170555 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560b0c98aa00 msgr2=0x560b0c99b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:43.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.779+0000 7f6a448a6640 1 --2- 172.21.15.49:0/2603170555 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560b0c98aa00 0x560b0c99b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.779+0000 7f6a448a6640 1 -- 172.21.15.49:0/2603170555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560b0c98a010 msgr2=0x560b0c988ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:43.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.779+0000 7f6a448a6640 1 --2- 172.21.15.49:0/2603170555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560b0c98a010 0x560b0c988ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.779+0000 7f6a448a6640 1 -- 172.21.15.49:0/2603170555 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b0c9a2a70 con 0x560b0c98fb70 2024-06-03T00:01:43.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.779+0000 7f6a37fff640 1 --2- 172.21.15.49:0/2603170555 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560b0c98aa00 0x560b0c99b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:01:43.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.779+0000 7f6a448a6640 1 --2- 172.21.15.49:0/2603170555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b0c98fb70 0x560b0c993c80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6a38009bf0 tx=0x7f6a3802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c58fd475b557df5 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:43.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.779+0000 7f6a35ffb640 1 -- 172.21.15.49:0/2603170555 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3802af40 con 0x560b0c98fb70 2024-06-03T00:01:43.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.779+0000 7f6a35ffb640 1 -- 172.21.15.49:0/2603170555 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a38009880 con 0x560b0c98fb70 2024-06-03T00:01:43.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.779+0000 7f6a35ffb640 1 -- 172.21.15.49:0/2603170555 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a38004240 con 0x560b0c98fb70 2024-06-03T00:01:43.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.780+0000 7f6a49010740 1 -- 172.21.15.49:0/2603170555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b0c98fb70 msgr2=0x560b0c993c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:43.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.780+0000 7f6a49010740 1 --2- 172.21.15.49:0/2603170555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b0c98fb70 0x560b0c993c80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6a38009bf0 tx=0x7f6a3802a8c0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.780+0000 7f6a49010740 1 -- 172.21.15.49:0/2603170555 shutdown_connections 2024-06-03T00:01:43.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.780+0000 7f6a49010740 1 --2- 172.21.15.49:0/2603170555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b0c98fb70 0x560b0c993c80 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.780+0000 7f6a49010740 1 --2- 172.21.15.49:0/2603170555 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560b0c98aa00 0x560b0c99b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.780+0000 7f6a49010740 1 --2- 172.21.15.49:0/2603170555 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560b0c98a010 0x560b0c988ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.780+0000 7f6a49010740 1 -- 172.21.15.49:0/2603170555 >> 172.21.15.49:0/2603170555 conn(0x560b0c985680 msgr2=0x560b0c988590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:43.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.780+0000 7f6a49010740 1 -- 172.21.15.49:0/2603170555 shutdown_connections 2024-06-03T00:01:43.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.780+0000 7f6a49010740 1 -- 172.21.15.49:0/2603170555 wait complete. 2024-06-03T00:01:43.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.780+0000 7f6a49010740 1 -- start start 2024-06-03T00:01:43.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.781+0000 7f6a49010740 1 Processor -- start 2024-06-03T00:01:43.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.781+0000 7f6a49010740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560b0c98a010 0x560b0c998740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:43.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.781+0000 7f6a49010740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560b0c98aa00 0x560b0c998c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:43.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.781+0000 7f6a49010740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b0c98fb70 0x560b0c999c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:43.785 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.781+0000 7f6a49010740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6a401aa300 con 0x560b0c98fb70 2024-06-03T00:01:43.785 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.781+0000 7f6a49010740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6a401a9c30 con 0x560b0c98a010 2024-06-03T00:01:43.785 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.781+0000 7f6a49010740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6a401a6e50 con 0x560b0c98aa00 2024-06-03T00:01:43.785 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.781+0000 7f6a49010740 10 client.0 _ll_register_callbacks cb 0x7f6a300046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:43.785 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.781+0000 7f6a448a6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b0c98fb70 0x560b0c999c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:43.785 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.781+0000 7f6a448a6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b0c98fb70 0x560b0c999c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46048/0 (socket says 172.21.15.49:46048) 2024-06-03T00:01:43.785 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.781+0000 7f6a448a6640 1 -- 172.21.15.49:0/3524690660 learned_addr learned my addr 172.21.15.49:0/3524690660 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:43.785 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.781+0000 7f6a37fff640 1 --2- 172.21.15.49:0/3524690660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560b0c98aa00 0x560b0c998c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:43.785 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.781+0000 7f6a3ffff640 1 --2- 172.21.15.49:0/3524690660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560b0c98a010 0x560b0c998740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:43.785 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.781+0000 7f6a448a6640 1 -- 172.21.15.49:0/3524690660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560b0c98aa00 msgr2=0x560b0c998c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:43.785 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.781+0000 7f6a448a6640 1 --2- 172.21.15.49:0/3524690660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560b0c98aa00 0x560b0c998c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.785 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.781+0000 7f6a448a6640 1 -- 172.21.15.49:0/3524690660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560b0c98a010 msgr2=0x560b0c998740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:43.785 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.781+0000 7f6a448a6640 1 --2- 172.21.15.49:0/3524690660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560b0c98a010 0x560b0c998740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.785 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.781+0000 7f6a448a6640 1 -- 172.21.15.49:0/3524690660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b0c98b6d0 con 0x560b0c98fb70 2024-06-03T00:01:43.786 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.782+0000 7f6a448a6640 1 --2- 172.21.15.49:0/3524690660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b0c98fb70 0x560b0c999c90 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6a38031c10 tx=0x7f6a38003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec287f3ffcd64ce0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:43.786 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.782+0000 7f6a1f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:01:43.786 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.782+0000 7f6a1f7fe640 1 -- 172.21.15.49:0/3524690660 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a38031660 con 0x560b0c98fb70 2024-06-03T00:01:43.786 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.782+0000 7f6a1f7fe640 1 -- 172.21.15.49:0/3524690660 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f6a38031800 con 0x560b0c98fb70 2024-06-03T00:01:43.786 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.782+0000 7f6a49010740 1 -- 172.21.15.49:0/3524690660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a38009880 con 0x560b0c98fb70 2024-06-03T00:01:43.786 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.782+0000 7f6a1f7fe640 1 -- 172.21.15.49:0/3524690660 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6a380041c0 con 0x560b0c98fb70 2024-06-03T00:01:43.786 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.782+0000 7f6a49010740 10 client.15648 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:43.786 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.782+0000 7f6a49010740 1 -- 172.21.15.49:0/3524690660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560b0c9854b0 con 0x560b0c98fb70 2024-06-03T00:01:43.786 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.782+0000 7f6a1f7fe640 1 -- 172.21.15.49:0/3524690660 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a38009880 con 0x560b0c98fb70 2024-06-03T00:01:43.786 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.782+0000 7f6a1f7fe640 1 -- 172.21.15.49:0/3524690660 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f6a38042070 con 0x560b0c98fb70 2024-06-03T00:01:43.786 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.782+0000 7f6a49010740 10 client.15648 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:43.786 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.782+0000 7f6a49010740 10 client.15648 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:01:43.786 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.782+0000 7f6a49010740 20 client.15648 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:43.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.782+0000 7f6a49010740 1 --2- 172.21.15.49:0/3524690660 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x560b0ca0acd0 0x560b0ca0d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:43.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.782+0000 7f6a49010740 4 client.15648 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-03T00:01:43.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.782+0000 7f6a49010740 1 -- 172.21.15.49:0/3524690660 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560b0c8fac20 con 0x560b0ca0acd0 2024-06-03T00:01:43.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.783+0000 7f6a3ffff640 1 --2- 172.21.15.49:0/3524690660 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x560b0ca0acd0 0x560b0ca0d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:43.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.783+0000 7f6a1f7fe640 10 client.15648 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:43.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.783+0000 7f6a3ffff640 1 --2- 172.21.15.49:0/3524690660 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x560b0ca0acd0 0x560b0ca0d0c0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ec0c2da8770d2b1 server_cookie=b836e0b854de28fb in_seq=0 out_seq=0 2024-06-03T00:01:43.790 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.790+0000 7f6a1f7fe640 1 -- 172.21.15.49:0/3524690660 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x560b0c8fac20 con 0x560b0ca0acd0 2024-06-03T00:01:43.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.790+0000 7f6a1f7fe640 10 client.15648 handle_command_reply: tid=0 2024-06-03T00:01:43.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.790+0000 7f6a49010740 1 client.15648 shutdown 2024-06-03T00:01:43.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.791+0000 7f6a49010740 1 -- 172.21.15.49:0/3524690660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b0c98fb70 msgr2=0x560b0c999c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:43.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.791+0000 7f6a49010740 1 --2- 172.21.15.49:0/3524690660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b0c98fb70 0x560b0c999c90 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6a38031c10 tx=0x7f6a38003ba0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.791+0000 7f6a49010740 1 -- 172.21.15.49:0/3524690660 shutdown_connections 2024-06-03T00:01:43.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.791+0000 7f6a49010740 1 --2- 172.21.15.49:0/3524690660 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x560b0ca0acd0 0x560b0ca0d0c0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.791+0000 7f6a49010740 1 --2- 172.21.15.49:0/3524690660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b0c98fb70 0x560b0c999c90 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.791+0000 7f6a1f7fe640 0 client.15648 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:43.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.791+0000 7f6a49010740 1 --2- 172.21.15.49:0/3524690660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560b0c98aa00 0x560b0c998c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.791+0000 7f6a49010740 1 --2- 172.21.15.49:0/3524690660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560b0c98a010 0x560b0c998740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.791+0000 7f6a49010740 1 -- 172.21.15.49:0/3524690660 >> 172.21.15.49:0/3524690660 conn(0x560b0c985680 msgr2=0x560b0c993c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:43.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.791+0000 7f6a49010740 1 -- 172.21.15.49:0/3524690660 shutdown_connections 2024-06-03T00:01:43.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.791+0000 7f6a49010740 1 -- 172.21.15.49:0/3524690660 wait complete. 2024-06-03T00:01:43.792 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.791+0000 7f6a49010740 20 client.15648 trim_cache size 0 max 16384 2024-06-03T00:01:43.792 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-06-03T00:01:43.792 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-06-03T00:01:43.792 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-06-03T00:01:43.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.791+0000 7f6a46309640 1 -- 172.21.15.49:0/2991811388 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6a2c0a2c30 msgr2=0x7f6a2c0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:43.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.791+0000 7f6a46309640 1 --2- 172.21.15.49:0/2991811388 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6a2c0a2c30 0x7f6a2c0a50f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6a280058c0 tx=0x7f6a28005850 comp rx=0 tx=0).stop 2024-06-03T00:01:43.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.791+0000 7f6a46309640 1 -- 172.21.15.49:0/2991811388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a40100900 msgr2=0x7f6a40069c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:43.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.791+0000 7f6a46309640 1 --2- 172.21.15.49:0/2991811388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a40100900 0x7f6a40069c20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6a3000e9c0 tx=0x7f6a3000ee80 comp rx=0 tx=0).stop 2024-06-03T00:01:43.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.791+0000 7f6a46309640 1 -- 172.21.15.49:0/2991811388 shutdown_connections 2024-06-03T00:01:43.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.791+0000 7f6a46309640 1 --2- 172.21.15.49:0/2991811388 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6a2c0a2c30 0x7f6a2c0a50f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.791+0000 7f6a46309640 1 --2- 172.21.15.49:0/2991811388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a40101af0 0x7f6a4019c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.791+0000 7f6a46309640 1 --2- 172.21.15.49:0/2991811388 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a401024b0 0x7f6a4019ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.791+0000 7f6a46309640 1 --2- 172.21.15.49:0/2991811388 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a40100900 0x7f6a40069c20 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:43.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.792+0000 7f6a46309640 1 -- 172.21.15.49:0/2991811388 >> 172.21.15.49:0/2991811388 conn(0x7f6a400fbe70 msgr2=0x7f6a40104d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:43.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.792+0000 7f6a46309640 1 -- 172.21.15.49:0/2991811388 shutdown_connections 2024-06-03T00:01:43.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:43.792+0000 7f6a46309640 1 -- 172.21.15.49:0/2991811388 wait complete. 2024-06-03T00:01:44.505 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '5715c98c', quiesce took 10.1 seconds. Will release after: 16.799999999999997 2024-06-03T00:01:44.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.933+0000 7f9ddc1be700 1 -- 172.21.15.49:0/2901195201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dd41024d0 msgr2=0x7f9dd4102950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:44.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.933+0000 7f9ddc1be700 1 --2- 172.21.15.49:0/2901195201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dd41024d0 0x7f9dd4102950 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f9dc40099c0 tx=0x7f9dc4009cd0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.933+0000 7f9ddc1be700 1 -- 172.21.15.49:0/2901195201 shutdown_connections 2024-06-03T00:01:44.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.933+0000 7f9ddc1be700 1 --2- 172.21.15.49:0/2901195201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9dd4102e90 0x7f9dd410f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.933+0000 7f9ddc1be700 1 --2- 172.21.15.49:0/2901195201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9dd4108580 0x7f9dd4108960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.933+0000 7f9ddc1be700 1 --2- 172.21.15.49:0/2901195201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dd41024d0 0x7f9dd4102950 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.933+0000 7f9ddc1be700 1 -- 172.21.15.49:0/2901195201 >> 172.21.15.49:0/2901195201 conn(0x7f9dd40fdf60 msgr2=0x7f9dd4100380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:44.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.933+0000 7f9ddc1be700 1 -- 172.21.15.49:0/2901195201 shutdown_connections 2024-06-03T00:01:44.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.933+0000 7f9ddc1be700 1 -- 172.21.15.49:0/2901195201 wait complete. 2024-06-03T00:01:44.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.934+0000 7f9ddc1be700 1 Processor -- start 2024-06-03T00:01:44.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.934+0000 7f9ddc1be700 1 -- start start 2024-06-03T00:01:44.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.934+0000 7f9ddc1be700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9dd41024d0 0x7f9dd419e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:44.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.934+0000 7f9ddc1be700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9dd4102e90 0x7f9dd419ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:44.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.934+0000 7f9ddc1be700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dd4108580 0x7f9dd41989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:44.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.934+0000 7f9ddc1be700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd41127d0 con 0x7f9dd4108580 2024-06-03T00:01:44.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.934+0000 7f9ddc1be700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd4112650 con 0x7f9dd4102e90 2024-06-03T00:01:44.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.934+0000 7f9ddc1be700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd4112950 con 0x7f9dd41024d0 2024-06-03T00:01:44.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.934+0000 7f9dda75b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dd4108580 0x7f9dd41989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:44.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.934+0000 7f9dda75b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dd4108580 0x7f9dd41989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46058/0 (socket says 172.21.15.49:46058) 2024-06-03T00:01:44.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.934+0000 7f9dda75b700 1 -- 172.21.15.49:0/1786515905 learned_addr learned my addr 172.21.15.49:0/1786515905 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:44.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.934+0000 7f9dd9f5a700 1 --2- 172.21.15.49:0/1786515905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9dd41024d0 0x7f9dd419e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:44.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.935+0000 7f9dd9759700 1 --2- 172.21.15.49:0/1786515905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9dd4102e90 0x7f9dd419ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:44.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.935+0000 7f9dd9f5a700 1 -- 172.21.15.49:0/1786515905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9dd4102e90 msgr2=0x7f9dd419ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:44.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.935+0000 7f9dd9f5a700 1 --2- 172.21.15.49:0/1786515905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9dd4102e90 0x7f9dd419ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.935+0000 7f9dd9f5a700 1 -- 172.21.15.49:0/1786515905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dd4108580 msgr2=0x7f9dd41989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:44.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.935+0000 7f9dd9f5a700 1 --2- 172.21.15.49:0/1786515905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dd4108580 0x7f9dd41989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.935+0000 7f9dd9f5a700 1 -- 172.21.15.49:0/1786515905 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd4199130 con 0x7f9dd41024d0 2024-06-03T00:01:44.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.935+0000 7f9dda75b700 1 --2- 172.21.15.49:0/1786515905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dd4108580 0x7f9dd41989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:01:44.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.935+0000 7f9dd9f5a700 1 --2- 172.21.15.49:0/1786515905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9dd41024d0 0x7f9dd419e810 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000d950 tx=0x7f9dd000dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:44.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.935+0000 7f9dcaffd700 1 -- 172.21.15.49:0/1786515905 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0016070 con 0x7f9dd41024d0 2024-06-03T00:01:44.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.935+0000 7f9ddc1be700 1 -- 172.21.15.49:0/1786515905 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd4199420 con 0x7f9dd41024d0 2024-06-03T00:01:44.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.935+0000 7f9dcaffd700 1 -- 172.21.15.49:0/1786515905 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dd000fd70 con 0x7f9dd41024d0 2024-06-03T00:01:44.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.936+0000 7f9dcaffd700 1 -- 172.21.15.49:0/1786515905 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd000e3b0 con 0x7f9dd41024d0 2024-06-03T00:01:44.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.936+0000 7f9ddc1be700 1 -- 172.21.15.49:0/1786515905 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd40746c0 con 0x7f9dd41024d0 2024-06-03T00:01:44.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.938+0000 7f9dcaffd700 1 -- 172.21.15.49:0/1786515905 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9dd0019070 con 0x7f9dd41024d0 2024-06-03T00:01:44.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.939+0000 7f9dcaffd700 1 --2- 172.21.15.49:0/1786515905 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9dc00a2c20 0x7f9dc00a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:44.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.939+0000 7f9dd9759700 1 --2- 172.21.15.49:0/1786515905 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9dc00a2c20 0x7f9dc00a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:44.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.939+0000 7f9dcaffd700 1 -- 172.21.15.49:0/1786515905 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f9dd00cea10 con 0x7f9dd41024d0 2024-06-03T00:01:44.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.939+0000 7f9de6a41b80 1 Processor -- start 2024-06-03T00:01:44.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.939+0000 7f9de6a41b80 1 -- start start 2024-06-03T00:01:44.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.939+0000 7f9dd9759700 1 --2- 172.21.15.49:0/1786515905 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9dc00a2c20 0x7f9dc00a50e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4107250 tx=0x7f9dc4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:44.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.940+0000 7f9de6a41b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef22ce76c0 0x55ef22ce7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:44.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.940+0000 7f9de6a41b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef22ce7fe0 0x55ef22ce1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:44.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.940+0000 7f9de6a41b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef22ce1fa0 0x55ef22ce23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:44.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.940+0000 7f9de6a41b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ef22c33890 con 0x55ef22ce1fa0 2024-06-03T00:01:44.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.940+0000 7f9de6a41b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55ef22bdb7a0 con 0x55ef22ce76c0 2024-06-03T00:01:44.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.940+0000 7f9de6a41b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ef22c2f850 con 0x55ef22ce7fe0 2024-06-03T00:01:44.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.940+0000 7f9dda75b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef22ce1fa0 0x55ef22ce23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:44.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.940+0000 7f9dda75b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef22ce1fa0 0x55ef22ce23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46064/0 (socket says 172.21.15.49:46064) 2024-06-03T00:01:44.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.940+0000 7f9dda75b700 1 -- 172.21.15.49:0/237245614 learned_addr learned my addr 172.21.15.49:0/237245614 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:44.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.940+0000 7f9dd9f5a700 1 --2- 172.21.15.49:0/237245614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef22ce76c0 0x55ef22ce7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:44.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.940+0000 7f9dd9759700 1 --2- 172.21.15.49:0/237245614 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef22ce7fe0 0x55ef22ce1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:44.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.940+0000 7f9dda75b700 1 -- 172.21.15.49:0/237245614 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef22ce7fe0 msgr2=0x55ef22ce1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:44.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.940+0000 7f9dda75b700 1 --2- 172.21.15.49:0/237245614 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef22ce7fe0 0x55ef22ce1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.940+0000 7f9dda75b700 1 -- 172.21.15.49:0/237245614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef22ce76c0 msgr2=0x55ef22ce7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:44.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.940+0000 7f9dda75b700 1 --2- 172.21.15.49:0/237245614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef22ce76c0 0x55ef22ce7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.940+0000 7f9dda75b700 1 -- 172.21.15.49:0/237245614 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef22bd1fd0 con 0x55ef22ce1fa0 2024-06-03T00:01:44.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.940+0000 7f9dda75b700 1 --2- 172.21.15.49:0/237245614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef22ce1fa0 0x55ef22ce23c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc0078d0 tx=0x7f9dcc0091b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90de2e1391cfac47 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:44.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.941+0000 7f9dbffff700 1 -- 172.21.15.49:0/237245614 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc019020 con 0x55ef22ce1fa0 2024-06-03T00:01:44.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.941+0000 7f9dbffff700 1 -- 172.21.15.49:0/237245614 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dcc015d30 con 0x55ef22ce1fa0 2024-06-03T00:01:44.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.941+0000 7f9dbffff700 1 -- 172.21.15.49:0/237245614 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc014e40 con 0x55ef22ce1fa0 2024-06-03T00:01:44.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.941+0000 7f9de6a41b80 1 -- 172.21.15.49:0/237245614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef22ce1fa0 msgr2=0x55ef22ce23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:44.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.941+0000 7f9de6a41b80 1 --2- 172.21.15.49:0/237245614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef22ce1fa0 0x55ef22ce23c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc0078d0 tx=0x7f9dcc0091b0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.942+0000 7f9de6a41b80 1 -- 172.21.15.49:0/237245614 shutdown_connections 2024-06-03T00:01:44.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.942+0000 7f9de6a41b80 1 --2- 172.21.15.49:0/237245614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef22ce1fa0 0x55ef22ce23c0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.942+0000 7f9de6a41b80 1 --2- 172.21.15.49:0/237245614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef22ce76c0 0x55ef22ce7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.942+0000 7f9de6a41b80 1 --2- 172.21.15.49:0/237245614 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef22ce7fe0 0x55ef22ce1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.942+0000 7f9de6a41b80 1 -- 172.21.15.49:0/237245614 >> 172.21.15.49:0/237245614 conn(0x55ef22c0cd40 msgr2=0x55ef22cdc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:44.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.942+0000 7f9de6a41b80 1 -- 172.21.15.49:0/237245614 shutdown_connections 2024-06-03T00:01:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.942+0000 7f9de6a41b80 1 -- 172.21.15.49:0/237245614 wait complete. 2024-06-03T00:01:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.942+0000 7f9de6a41b80 1 -- start start 2024-06-03T00:01:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.942+0000 7f9de6a41b80 1 Processor -- start 2024-06-03T00:01:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.943+0000 7f9de6a41b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef22ce1fa0 0x55ef22cedd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.943+0000 7f9de6a41b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef22ce76c0 0x55ef22ceb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.943+0000 7f9de6a41b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef22ce7fe0 0x55ef22ceb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.943+0000 7f9de6a41b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ef22ceea50 con 0x55ef22ce76c0 2024-06-03T00:01:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.943+0000 7f9de6a41b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55ef22bd3c70 con 0x55ef22ce1fa0 2024-06-03T00:01:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.943+0000 7f9de6a41b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ef22ceebd0 con 0x55ef22ce7fe0 2024-06-03T00:01:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.943+0000 7f9de6a41b80 10 client.0 _ll_register_callbacks cb 0x55ef22bcd9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.943+0000 7f9dd9759700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef22ce76c0 0x55ef22ceb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.943+0000 7f9dd9759700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef22ce76c0 0x55ef22ceb020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46072/0 (socket says 172.21.15.49:46072) 2024-06-03T00:01:44.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.943+0000 7f9dd9759700 1 -- 172.21.15.49:0/67133535 learned_addr learned my addr 172.21.15.49:0/67133535 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:44.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.943+0000 7f9dd9f5a700 1 --2- 172.21.15.49:0/67133535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef22ce1fa0 0x55ef22cedd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:44.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.943+0000 7f9dda75b700 1 --2- 172.21.15.49:0/67133535 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef22ce7fe0 0x55ef22ceb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:44.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.943+0000 7f9dd9759700 1 -- 172.21.15.49:0/67133535 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef22ce7fe0 msgr2=0x55ef22ceb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:44.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.943+0000 7f9dd9759700 1 --2- 172.21.15.49:0/67133535 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef22ce7fe0 0x55ef22ceb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.943+0000 7f9dd9759700 1 -- 172.21.15.49:0/67133535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef22ce1fa0 msgr2=0x55ef22cedd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:44.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.943+0000 7f9dd9759700 1 --2- 172.21.15.49:0/67133535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef22ce1fa0 0x55ef22cedd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.943+0000 7f9dd9759700 1 -- 172.21.15.49:0/67133535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef22b82950 con 0x55ef22ce76c0 2024-06-03T00:01:44.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.943+0000 7f9dd9f5a700 1 --2- 172.21.15.49:0/67133535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef22ce1fa0 0x55ef22cedd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:44.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.943+0000 7f9dd9759700 1 --2- 172.21.15.49:0/67133535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef22ce76c0 0x55ef22ceb020 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9dc40098e0 tx=0x7f9dc401a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dac63ddbaef8e67e server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:44.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.943+0000 7f9dbd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:01:44.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.943+0000 7f9dbd7fa700 1 -- 172.21.15.49:0/67133535 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4024610 con 0x55ef22ce76c0 2024-06-03T00:01:44.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.944+0000 7f9dbd7fa700 1 -- 172.21.15.49:0/67133535 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f9dc40247b0 con 0x55ef22ce76c0 2024-06-03T00:01:44.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.944+0000 7f9de6a41b80 1 -- 172.21.15.49:0/67133535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9dcc015d30 con 0x55ef22ce76c0 2024-06-03T00:01:44.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.944+0000 7f9dbd7fa700 1 -- 172.21.15.49:0/67133535 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9dc40249b0 con 0x55ef22ce76c0 2024-06-03T00:01:44.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.944+0000 7f9de6a41b80 10 client.15660 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:44.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.944+0000 7f9de6a41b80 1 -- 172.21.15.49:0/67133535 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ef22cf9330 con 0x55ef22ce76c0 2024-06-03T00:01:44.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.944+0000 7f9dbd7fa700 1 -- 172.21.15.49:0/67133535 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dcc015d30 con 0x55ef22ce76c0 2024-06-03T00:01:44.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.944+0000 7f9dbd7fa700 1 -- 172.21.15.49:0/67133535 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f9dc4039c70 con 0x55ef22ce76c0 2024-06-03T00:01:44.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.944+0000 7f9de6a41b80 10 client.15660 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:44.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.944+0000 7f9de6a41b80 10 client.15660 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-03T00:01:44.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.944+0000 7f9de6a41b80 20 client.15660 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:44.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.944+0000 7f9de6a41b80 1 --2- 172.21.15.49:0/67133535 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55ef22cfb970 0x55ef22cfdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:44.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.944+0000 7f9de6a41b80 4 client.15660 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:01:44.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.944+0000 7f9de6a41b80 1 -- 172.21.15.49:0/67133535 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef22c40d90 con 0x55ef22cfb970 2024-06-03T00:01:44.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.945+0000 7f9dd9f5a700 1 --2- 172.21.15.49:0/67133535 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55ef22cfb970 0x55ef22cfdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:44.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.945+0000 7f9dd9f5a700 1 --2- 172.21.15.49:0/67133535 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55ef22cfb970 0x55ef22cfdda0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1595e8d7737bec96 server_cookie=6774258b56caad8a in_seq=0 out_seq=0 2024-06-03T00:01:44.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.945+0000 7f9dbd7fa700 10 client.15660 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:44.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.946+0000 7f9dbd7fa700 1 -- 172.21.15.49:0/67133535 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55ef22c40d90 con 0x55ef22cfb970 2024-06-03T00:01:44.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.946+0000 7f9dbd7fa700 10 client.15660 handle_command_reply: tid=0 2024-06-03T00:01:44.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.946+0000 7f9de6a41b80 1 client.15660 shutdown 2024-06-03T00:01:44.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.946+0000 7f9de6a41b80 1 -- 172.21.15.49:0/67133535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef22ce76c0 msgr2=0x55ef22ceb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:44.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.946+0000 7f9de6a41b80 1 --2- 172.21.15.49:0/67133535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef22ce76c0 0x55ef22ceb020 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9dc40098e0 tx=0x7f9dc401a050 comp rx=0 tx=0).stop 2024-06-03T00:01:44.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.946+0000 7f9de6a41b80 1 -- 172.21.15.49:0/67133535 shutdown_connections 2024-06-03T00:01:44.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.946+0000 7f9de6a41b80 1 --2- 172.21.15.49:0/67133535 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef22ce7fe0 0x55ef22ceb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.946+0000 7f9de6a41b80 1 --2- 172.21.15.49:0/67133535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef22ce1fa0 0x55ef22cedd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.946+0000 7f9de6a41b80 1 --2- 172.21.15.49:0/67133535 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55ef22cfb970 0x55ef22cfdda0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.946+0000 7f9de6a41b80 1 --2- 172.21.15.49:0/67133535 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef22ce76c0 0x55ef22ceb020 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.946+0000 7f9dbd7fa700 0 client.15660 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:44.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.946+0000 7f9de6a41b80 1 -- 172.21.15.49:0/67133535 >> 172.21.15.49:0/67133535 conn(0x55ef22c0cd40 msgr2=0x55ef22ce0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:44.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.946+0000 7f9de6a41b80 1 -- 172.21.15.49:0/67133535 shutdown_connections 2024-06-03T00:01:44.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.946+0000 7f9de6a41b80 1 -- 172.21.15.49:0/67133535 wait complete. 2024-06-03T00:01:44.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.946+0000 7f9de6a41b80 20 client.15660 trim_cache size 0 max 16384 2024-06-03T00:01:44.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.968+0000 7f9de6a41b80 1 Processor -- start 2024-06-03T00:01:44.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.968+0000 7f9de6a41b80 1 -- start start 2024-06-03T00:01:44.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.968+0000 7f9de6a41b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef22ce1fa0 0x55ef22ce1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:44.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.968+0000 7f9de6a41b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef22ce76c0 0x55ef22cd6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:44.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.968+0000 7f9de6a41b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef22ce7fe0 0x55ef22d03670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:44.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.968+0000 7f9de6a41b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd41aee00 con 0x55ef22ce1fa0 2024-06-03T00:01:44.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.968+0000 7f9de6a41b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd41b0940 con 0x55ef22ce7fe0 2024-06-03T00:01:44.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.968+0000 7f9de6a41b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd41af4d0 con 0x55ef22ce76c0 2024-06-03T00:01:44.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.968+0000 7f9dd9f5a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef22ce1fa0 0x55ef22ce1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:44.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.968+0000 7f9dd9f5a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef22ce1fa0 0x55ef22ce1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46082/0 (socket says 172.21.15.49:46082) 2024-06-03T00:01:44.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.968+0000 7f9dd9f5a700 1 -- 172.21.15.49:0/1691601471 learned_addr learned my addr 172.21.15.49:0/1691601471 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:44.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.968+0000 7f9dd9759700 1 --2- 172.21.15.49:0/1691601471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef22ce76c0 0x55ef22cd6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:44.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.968+0000 7f9dd9f5a700 1 -- 172.21.15.49:0/1691601471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef22ce76c0 msgr2=0x55ef22cd6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:44.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.968+0000 7f9dd9f5a700 1 --2- 172.21.15.49:0/1691601471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef22ce76c0 0x55ef22cd6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.968+0000 7f9dd9f5a700 1 -- 172.21.15.49:0/1691601471 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef22ce7fe0 msgr2=0x55ef22d03670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:44.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.968+0000 7f9dd9f5a700 1 --2- 172.21.15.49:0/1691601471 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef22ce7fe0 0x55ef22d03670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.968+0000 7f9dd9f5a700 1 -- 172.21.15.49:0/1691601471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef22cdd580 con 0x55ef22ce1fa0 2024-06-03T00:01:44.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.968+0000 7f9dd9f5a700 1 --2- 172.21.15.49:0/1691601471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef22ce1fa0 0x55ef22ce1a60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9dd009af70 tx=0x7f9dd00cc3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f2fcb9679014bd5 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:44.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.969+0000 7f9dbf7fe700 1 -- 172.21.15.49:0/1691601471 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd00b4070 con 0x55ef22ce1fa0 2024-06-03T00:01:44.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.969+0000 7f9dbf7fe700 1 -- 172.21.15.49:0/1691601471 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dd00a3ee0 con 0x55ef22ce1fa0 2024-06-03T00:01:44.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.969+0000 7f9dbf7fe700 1 -- 172.21.15.49:0/1691601471 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0020040 con 0x55ef22ce1fa0 2024-06-03T00:01:44.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.969+0000 7f9de6a41b80 1 -- 172.21.15.49:0/1691601471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef22ce1fa0 msgr2=0x55ef22ce1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:44.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.969+0000 7f9de6a41b80 1 --2- 172.21.15.49:0/1691601471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef22ce1fa0 0x55ef22ce1a60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9dd009af70 tx=0x7f9dd00cc3e0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.969+0000 7f9de6a41b80 1 -- 172.21.15.49:0/1691601471 shutdown_connections 2024-06-03T00:01:44.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.969+0000 7f9de6a41b80 1 --2- 172.21.15.49:0/1691601471 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef22ce7fe0 0x55ef22d03670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.969+0000 7f9de6a41b80 1 --2- 172.21.15.49:0/1691601471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef22ce1fa0 0x55ef22ce1a60 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.969+0000 7f9de6a41b80 1 --2- 172.21.15.49:0/1691601471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef22ce76c0 0x55ef22cd6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.969+0000 7f9de6a41b80 1 -- 172.21.15.49:0/1691601471 >> 172.21.15.49:0/1691601471 conn(0x55ef22c0cd40 msgr2=0x55ef22cd5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:44.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.970+0000 7f9de6a41b80 1 -- 172.21.15.49:0/1691601471 shutdown_connections 2024-06-03T00:01:44.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.970+0000 7f9de6a41b80 1 -- 172.21.15.49:0/1691601471 wait complete. 2024-06-03T00:01:44.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.970+0000 7f9de6a41b80 1 -- start start 2024-06-03T00:01:44.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.970+0000 7f9de6a41b80 1 Processor -- start 2024-06-03T00:01:44.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.970+0000 7f9de6a41b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef22ce1fa0 0x55ef22cf46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:44.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.970+0000 7f9de6a41b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef22ce76c0 0x55ef22cf0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:44.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.970+0000 7f9de6a41b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef22ce7fe0 0x55ef22cf1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:44.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.970+0000 7f9de6a41b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd41b0270 con 0x55ef22ce76c0 2024-06-03T00:01:44.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.970+0000 7f9de6a41b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd41afba0 con 0x55ef22ce7fe0 2024-06-03T00:01:44.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.970+0000 7f9de6a41b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd41acd80 con 0x55ef22ce1fa0 2024-06-03T00:01:44.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.970+0000 7f9de6a41b80 10 client.0 _ll_register_callbacks cb 0x55ef22bcd9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:44.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.971+0000 7f9dd9759700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef22ce76c0 0x55ef22cf0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:44.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.971+0000 7f9dd9759700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef22ce76c0 0x55ef22cf0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46088/0 (socket says 172.21.15.49:46088) 2024-06-03T00:01:44.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.971+0000 7f9dd9759700 1 -- 172.21.15.49:0/2167533664 learned_addr learned my addr 172.21.15.49:0/2167533664 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:44.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.971+0000 7f9dd9f5a700 1 --2- 172.21.15.49:0/2167533664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef22ce1fa0 0x55ef22cf46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:44.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.971+0000 7f9dda75b700 1 --2- 172.21.15.49:0/2167533664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef22ce7fe0 0x55ef22cf1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:44.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.971+0000 7f9dd9759700 1 -- 172.21.15.49:0/2167533664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef22ce1fa0 msgr2=0x55ef22cf46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:44.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.971+0000 7f9dd9759700 1 --2- 172.21.15.49:0/2167533664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef22ce1fa0 0x55ef22cf46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.971+0000 7f9dd9759700 1 -- 172.21.15.49:0/2167533664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef22ce7fe0 msgr2=0x55ef22cf1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:44.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.971+0000 7f9dd9759700 1 --2- 172.21.15.49:0/2167533664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef22ce7fe0 0x55ef22cf1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.971+0000 7f9dd9759700 1 -- 172.21.15.49:0/2167533664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef22cf1c60 con 0x55ef22ce76c0 2024-06-03T00:01:44.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.971+0000 7f9dd9f5a700 1 --2- 172.21.15.49:0/2167533664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef22ce1fa0 0x55ef22cf46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:44.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.971+0000 7f9dd9759700 1 --2- 172.21.15.49:0/2167533664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef22ce76c0 0x55ef22cf0e60 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4005b20 tx=0x7f9dc40246c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=babf06863b918320 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:44.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.971+0000 7f9dbd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:01:44.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.971+0000 7f9dbd7fa700 1 -- 172.21.15.49:0/2167533664 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4049060 con 0x55ef22ce76c0 2024-06-03T00:01:44.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.971+0000 7f9dbd7fa700 1 -- 172.21.15.49:0/2167533664 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f9dc4030ad0 con 0x55ef22ce76c0 2024-06-03T00:01:44.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.971+0000 7f9de6a41b80 1 -- 172.21.15.49:0/2167533664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9dd00a3ee0 con 0x55ef22ce76c0 2024-06-03T00:01:44.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.972+0000 7f9dbd7fa700 1 -- 172.21.15.49:0/2167533664 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9dc4005960 con 0x55ef22ce76c0 2024-06-03T00:01:44.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.972+0000 7f9de6a41b80 10 client.15666 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:44.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.972+0000 7f9de6a41b80 1 -- 172.21.15.49:0/2167533664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ef22d67790 con 0x55ef22ce76c0 2024-06-03T00:01:44.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.972+0000 7f9dbd7fa700 1 -- 172.21.15.49:0/2167533664 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dd00a3ee0 con 0x55ef22ce76c0 2024-06-03T00:01:44.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.972+0000 7f9dbd7fa700 1 -- 172.21.15.49:0/2167533664 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f9dc404e070 con 0x55ef22ce76c0 2024-06-03T00:01:44.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.972+0000 7f9de6a41b80 10 client.15666 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:44.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.972+0000 7f9de6a41b80 10 client.15666 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-03T00:01:44.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.972+0000 7f9de6a41b80 20 client.15666 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:44.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.972+0000 7f9de6a41b80 1 --2- 172.21.15.49:0/2167533664 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55ef22d67e40 0x55ef22d6a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:44.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.972+0000 7f9de6a41b80 4 client.15666 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-06-03T00:01:44.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.972+0000 7f9de6a41b80 1 -- 172.21.15.49:0/2167533664 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ef22c3b310 con 0x55ef22d67e40 2024-06-03T00:01:44.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.972+0000 7f9dd9f5a700 1 --2- 172.21.15.49:0/2167533664 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55ef22d67e40 0x55ef22d6a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:44.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.973+0000 7f9dd9f5a700 1 --2- 172.21.15.49:0/2167533664 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55ef22d67e40 0x55ef22d6a260 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fad538739d99259 server_cookie=c8759c1d20e5557e in_seq=0 out_seq=0 2024-06-03T00:01:44.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.973+0000 7f9dbd7fa700 10 client.15666 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:44.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.974+0000 7f9dbd7fa700 1 -- 172.21.15.49:0/2167533664 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ef22c3b310 con 0x55ef22d67e40 2024-06-03T00:01:44.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.974+0000 7f9dbd7fa700 10 client.15666 handle_command_reply: tid=0 2024-06-03T00:01:44.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.974+0000 7f9de6a41b80 1 client.15666 shutdown 2024-06-03T00:01:44.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.974+0000 7f9de6a41b80 1 -- 172.21.15.49:0/2167533664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef22ce76c0 msgr2=0x55ef22cf0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:44.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.974+0000 7f9de6a41b80 1 --2- 172.21.15.49:0/2167533664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef22ce76c0 0x55ef22cf0e60 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4005b20 tx=0x7f9dc40246c0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.974+0000 7f9de6a41b80 1 -- 172.21.15.49:0/2167533664 shutdown_connections 2024-06-03T00:01:44.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.974+0000 7f9de6a41b80 1 --2- 172.21.15.49:0/2167533664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef22ce7fe0 0x55ef22cf1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.974+0000 7f9de6a41b80 1 --2- 172.21.15.49:0/2167533664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef22ce1fa0 0x55ef22cf46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.974+0000 7f9de6a41b80 1 --2- 172.21.15.49:0/2167533664 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55ef22d67e40 0x55ef22d6a260 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.974+0000 7f9de6a41b80 1 --2- 172.21.15.49:0/2167533664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ef22ce76c0 0x55ef22cf0e60 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.974+0000 7f9de6a41b80 1 -- 172.21.15.49:0/2167533664 >> 172.21.15.49:0/2167533664 conn(0x55ef22c0cd40 msgr2=0x55ef22ce9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:44.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.974+0000 7f9dbd7fa700 0 client.15666 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:44.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.975+0000 7f9de6a41b80 1 -- 172.21.15.49:0/2167533664 shutdown_connections 2024-06-03T00:01:44.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.975+0000 7f9de6a41b80 1 -- 172.21.15.49:0/2167533664 wait complete. 2024-06-03T00:01:44.654 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:01:44.654 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-06-03T00:01:44.654 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "7860fcd3-ab59-4bb0-8163-72e144ca06ac", 2024-06-03T00:01:44.654 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-06-03T00:01:44.654 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:01:44.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.975+0000 7f9de6a41b80 20 client.15666 trim_cache size 0 max 16384 2024-06-03T00:01:44.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.975+0000 7f9ddc1be700 1 -- 172.21.15.49:0/1786515905 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9dc00a2c20 msgr2=0x7f9dc00a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:44.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.975+0000 7f9ddc1be700 1 --2- 172.21.15.49:0/1786515905 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9dc00a2c20 0x7f9dc00a50e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4107250 tx=0x7f9dc4005fb0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.975+0000 7f9ddc1be700 1 -- 172.21.15.49:0/1786515905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9dd41024d0 msgr2=0x7f9dd419e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:44.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.975+0000 7f9ddc1be700 1 --2- 172.21.15.49:0/1786515905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9dd41024d0 0x7f9dd419e810 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000d950 tx=0x7f9dd000dc60 comp rx=0 tx=0).stop 2024-06-03T00:01:44.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.975+0000 7f9ddc1be700 1 -- 172.21.15.49:0/1786515905 shutdown_connections 2024-06-03T00:01:44.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.975+0000 7f9ddc1be700 1 --2- 172.21.15.49:0/1786515905 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9dc00a2c20 0x7f9dc00a50e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.975+0000 7f9ddc1be700 1 --2- 172.21.15.49:0/1786515905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dd4108580 0x7f9dd41989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.975+0000 7f9ddc1be700 1 --2- 172.21.15.49:0/1786515905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9dd41024d0 0x7f9dd419e810 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.975+0000 7f9ddc1be700 1 --2- 172.21.15.49:0/1786515905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9dd4102e90 0x7f9dd419ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:44.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.975+0000 7f9ddc1be700 1 -- 172.21.15.49:0/1786515905 >> 172.21.15.49:0/1786515905 conn(0x7f9dd40fdf60 msgr2=0x7f9dd40ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:44.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.975+0000 7f9ddc1be700 1 -- 172.21.15.49:0/1786515905 shutdown_connections 2024-06-03T00:01:44.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:43.975+0000 7f9ddc1be700 1 -- 172.21.15.49:0/1786515905 wait complete. 2024-06-03T00:01:44.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:44 smithi057 ceph-mon[36457]: pgmap v434: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-06-03T00:01:44.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:44 smithi049 ceph-mon[32302]: pgmap v434: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-06-03T00:01:44.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:44 smithi107 ceph-mon[37048]: pgmap v434: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-06-03T00:01:45.285 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-03T00:01:45.548 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:01:45.672 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:45 smithi049 ceph-mon[32302]: scrub queued for path: / 2024-06-03T00:01:45.672 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:45 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:01:45.672 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:45 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:01:45.672 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:45 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:01:45.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:45 smithi057 ceph-mon[36457]: scrub queued for path: / 2024-06-03T00:01:45.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:45 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:01:45.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:45 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:01:45.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:45 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:01:45.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:45 smithi107 ceph-mon[37048]: scrub queued for path: / 2024-06-03T00:01:45.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:45 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:01:45.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:45 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:01:45.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:45 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:01:46.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:46 smithi057 ceph-mon[36457]: pgmap v435: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-06-03T00:01:46.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:46 smithi049 ceph-mon[32302]: pgmap v435: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-06-03T00:01:46.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:46 smithi107 ceph-mon[37048]: pgmap v435: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-06-03T00:01:47.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.547+0000 7f8900add700 1 -- 172.21.15.49:0/544176049 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88fc06aa00 msgr2=0x7f88fc06ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:47.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.547+0000 7f8900add700 1 --2- 172.21.15.49:0/544176049 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88fc06aa00 0x7f88fc06ae80 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f88f0009990 tx=0x7f88f0009ca0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.548+0000 7f8900add700 1 -- 172.21.15.49:0/544176049 shutdown_connections 2024-06-03T00:01:47.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.548+0000 7f8900add700 1 --2- 172.21.15.49:0/544176049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88fc06b3c0 0x7f88fc10f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.548+0000 7f8900add700 1 --2- 172.21.15.49:0/544176049 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88fc1084f0 0x7f88fc1088d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.548+0000 7f8900add700 1 --2- 172.21.15.49:0/544176049 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88fc06aa00 0x7f88fc06ae80 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.548+0000 7f8900add700 1 -- 172.21.15.49:0/544176049 >> 172.21.15.49:0/544176049 conn(0x7f88fc078300 msgr2=0x7f88fc078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:47.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.548+0000 7f8900add700 1 -- 172.21.15.49:0/544176049 shutdown_connections 2024-06-03T00:01:47.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.548+0000 7f8900add700 1 -- 172.21.15.49:0/544176049 wait complete. 2024-06-03T00:01:47.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.549+0000 7f8900add700 1 Processor -- start 2024-06-03T00:01:47.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.549+0000 7f8900add700 1 -- start start 2024-06-03T00:01:47.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.549+0000 7f8900add700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88fc06aa00 0x7f88fc101450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:47.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.549+0000 7f8900add700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88fc06b3c0 0x7f88fc101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:47.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.549+0000 7f8900add700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88fc1084f0 0x7f88fc101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:47.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.549+0000 7f8900add700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc112750 con 0x7f88fc1084f0 2024-06-03T00:01:47.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.549+0000 7f8900add700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc1125d0 con 0x7f88fc06aa00 2024-06-03T00:01:47.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.549+0000 7f8900add700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc1128d0 con 0x7f88fc06b3c0 2024-06-03T00:01:47.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.549+0000 7f88fad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88fc1084f0 0x7f88fc101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:47.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.549+0000 7f88fad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88fc1084f0 0x7f88fc101ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46100/0 (socket says 172.21.15.49:46100) 2024-06-03T00:01:47.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.549+0000 7f88fad9d700 1 -- 172.21.15.49:0/551883280 learned_addr learned my addr 172.21.15.49:0/551883280 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:47.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.549+0000 7f88f9d9b700 1 --2- 172.21.15.49:0/551883280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88fc06b3c0 0x7f88fc101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:47.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.549+0000 7f88fa59c700 1 --2- 172.21.15.49:0/551883280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88fc06aa00 0x7f88fc101450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:47.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.549+0000 7f88fad9d700 1 -- 172.21.15.49:0/551883280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88fc06b3c0 msgr2=0x7f88fc101990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:47.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.549+0000 7f88fad9d700 1 --2- 172.21.15.49:0/551883280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88fc06b3c0 0x7f88fc101990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.549+0000 7f88fad9d700 1 -- 172.21.15.49:0/551883280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88fc06aa00 msgr2=0x7f88fc101450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:47.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.549+0000 7f88fad9d700 1 --2- 172.21.15.49:0/551883280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88fc06aa00 0x7f88fc101450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.549+0000 7f88fad9d700 1 -- 172.21.15.49:0/551883280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88fc1a7020 con 0x7f88fc1084f0 2024-06-03T00:01:47.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.550+0000 7f88fad9d700 1 --2- 172.21.15.49:0/551883280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88fc1084f0 0x7f88fc101ed0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f88f4007d70 tx=0x7f88f400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:47.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.550+0000 7f88eb7fe700 1 -- 172.21.15.49:0/551883280 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f4016020 con 0x7f88fc1084f0 2024-06-03T00:01:47.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.550+0000 7f88eb7fe700 1 -- 172.21.15.49:0/551883280 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88f400ac90 con 0x7f88fc1084f0 2024-06-03T00:01:47.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.550+0000 7f8900add700 1 -- 172.21.15.49:0/551883280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88fc1a7310 con 0x7f88fc1084f0 2024-06-03T00:01:47.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.550+0000 7f88eb7fe700 1 -- 172.21.15.49:0/551883280 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f40115c0 con 0x7f88fc1084f0 2024-06-03T00:01:47.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.550+0000 7f8900add700 1 -- 172.21.15.49:0/551883280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88fc1a7820 con 0x7f88fc1084f0 2024-06-03T00:01:47.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.553+0000 7f88eb7fe700 1 -- 172.21.15.49:0/551883280 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f88f4019020 con 0x7f88fc1084f0 2024-06-03T00:01:47.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.554+0000 7f88eb7fe700 1 --2- 172.21.15.49:0/551883280 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f88e40a2ca0 0x7f88e40a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:47.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.554+0000 7f88fa59c700 1 --2- 172.21.15.49:0/551883280 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f88e40a2ca0 0x7f88e40a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:47.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.554+0000 7f88eb7fe700 1 -- 172.21.15.49:0/551883280 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f88f40cef50 con 0x7f88fc1084f0 2024-06-03T00:01:47.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.554+0000 7f88fa59c700 1 --2- 172.21.15.49:0/551883280 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f88e40a2ca0 0x7f88e40a5160 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00abd0 tx=0x7f88ec00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:47.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.554+0000 7f890b360b80 1 Processor -- start 2024-06-03T00:01:47.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.555+0000 7f890b360b80 1 -- start start 2024-06-03T00:01:47.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.555+0000 7f890b360b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56537e927640 0x56537e927a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:47.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.555+0000 7f890b360b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56537e927f60 0x56537e9219e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:47.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.555+0000 7f890b360b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56537e921f20 0x56537e922340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:47.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.555+0000 7f890b360b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56537e873810 con 0x56537e927f60 2024-06-03T00:01:47.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.555+0000 7f890b360b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x56537e81b720 con 0x56537e927640 2024-06-03T00:01:47.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.555+0000 7f890b360b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56537e86f7d0 con 0x56537e921f20 2024-06-03T00:01:47.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.555+0000 7f88f9d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56537e927f60 0x56537e9219e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:47.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.555+0000 7f88f9d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56537e927f60 0x56537e9219e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46102/0 (socket says 172.21.15.49:46102) 2024-06-03T00:01:47.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.555+0000 7f88f9d9b700 1 -- 172.21.15.49:0/4179075228 learned_addr learned my addr 172.21.15.49:0/4179075228 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:47.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.555+0000 7f88fad9d700 1 --2- 172.21.15.49:0/4179075228 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56537e921f20 0x56537e922340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:47.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.555+0000 7f88fa59c700 1 --2- 172.21.15.49:0/4179075228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56537e927640 0x56537e927a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:47.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.555+0000 7f88f9d9b700 1 -- 172.21.15.49:0/4179075228 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56537e921f20 msgr2=0x56537e922340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:47.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.555+0000 7f88f9d9b700 1 --2- 172.21.15.49:0/4179075228 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56537e921f20 0x56537e922340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.555+0000 7f88f9d9b700 1 -- 172.21.15.49:0/4179075228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56537e927640 msgr2=0x56537e927a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:47.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.555+0000 7f88f9d9b700 1 --2- 172.21.15.49:0/4179075228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56537e927640 0x56537e927a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.555+0000 7f88f9d9b700 1 -- 172.21.15.49:0/4179075228 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56537e811f50 con 0x56537e927f60 2024-06-03T00:01:47.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.556+0000 7f88f9d9b700 1 --2- 172.21.15.49:0/4179075228 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56537e927f60 0x56537e9219e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f88f0009990 tx=0x7f88f0003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e2a83a7f9aa6dc0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:47.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.556+0000 7f88e8ff9700 1 -- 172.21.15.49:0/4179075228 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f0028070 con 0x56537e927f60 2024-06-03T00:01:47.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.556+0000 7f88e8ff9700 1 -- 172.21.15.49:0/4179075228 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88f00055b0 con 0x56537e927f60 2024-06-03T00:01:47.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.556+0000 7f88e8ff9700 1 -- 172.21.15.49:0/4179075228 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f000bd30 con 0x56537e927f60 2024-06-03T00:01:47.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.557+0000 7f890b360b80 1 -- 172.21.15.49:0/4179075228 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56537e927f60 msgr2=0x56537e9219e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:47.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.557+0000 7f890b360b80 1 --2- 172.21.15.49:0/4179075228 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56537e927f60 0x56537e9219e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f88f0009990 tx=0x7f88f0003680 comp rx=0 tx=0).stop 2024-06-03T00:01:47.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.557+0000 7f890b360b80 1 -- 172.21.15.49:0/4179075228 shutdown_connections 2024-06-03T00:01:47.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.557+0000 7f890b360b80 1 --2- 172.21.15.49:0/4179075228 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56537e921f20 0x56537e922340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.557+0000 7f890b360b80 1 --2- 172.21.15.49:0/4179075228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56537e927640 0x56537e927a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.557+0000 7f890b360b80 1 --2- 172.21.15.49:0/4179075228 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56537e927f60 0x56537e9219e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.557+0000 7f890b360b80 1 -- 172.21.15.49:0/4179075228 >> 172.21.15.49:0/4179075228 conn(0x56537e84ccc0 msgr2=0x56537e91c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:47.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.557+0000 7f890b360b80 1 -- 172.21.15.49:0/4179075228 shutdown_connections 2024-06-03T00:01:47.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.557+0000 7f890b360b80 1 -- 172.21.15.49:0/4179075228 wait complete. 2024-06-03T00:01:47.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.558+0000 7f890b360b80 1 -- start start 2024-06-03T00:01:47.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.558+0000 7f890b360b80 1 Processor -- start 2024-06-03T00:01:47.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.558+0000 7f890b360b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56537e921f20 0x56537e92dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:47.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.558+0000 7f890b360b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56537e927640 0x56537e92afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:47.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.558+0000 7f890b360b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56537e927f60 0x56537e92b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:47.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.558+0000 7f890b360b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56537e92e970 con 0x56537e921f20 2024-06-03T00:01:47.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.558+0000 7f88fa59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56537e921f20 0x56537e92dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:47.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.558+0000 7f890b360b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x56537e813bf0 con 0x56537e927f60 2024-06-03T00:01:47.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.558+0000 7f890b360b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56537e92eaf0 con 0x56537e927640 2024-06-03T00:01:47.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.558+0000 7f88fa59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56537e921f20 0x56537e92dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46112/0 (socket says 172.21.15.49:46112) 2024-06-03T00:01:47.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.558+0000 7f88fa59c700 1 -- 172.21.15.49:0/60392111 learned_addr learned my addr 172.21.15.49:0/60392111 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:47.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.558+0000 7f88f9d9b700 1 --2- 172.21.15.49:0/60392111 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56537e927640 0x56537e92afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:47.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.558+0000 7f88fad9d700 1 --2- 172.21.15.49:0/60392111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56537e927f60 0x56537e92b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:47.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.558+0000 7f890b360b80 10 client.0 _ll_register_callbacks cb 0x56537e80d920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:47.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.558+0000 7f88f9d9b700 1 -- 172.21.15.49:0/60392111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56537e927f60 msgr2=0x56537e92b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:47.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.559+0000 7f88f9d9b700 1 --2- 172.21.15.49:0/60392111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56537e927f60 0x56537e92b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.559+0000 7f88f9d9b700 1 -- 172.21.15.49:0/60392111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56537e921f20 msgr2=0x56537e92dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:47.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.559+0000 7f88f9d9b700 1 --2- 172.21.15.49:0/60392111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56537e921f20 0x56537e92dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.559+0000 7f88f9d9b700 1 -- 172.21.15.49:0/60392111 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56537e7c28d0 con 0x56537e927640 2024-06-03T00:01:47.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.559+0000 7f88fa59c700 1 --2- 172.21.15.49:0/60392111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56537e921f20 0x56537e92dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:47.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.559+0000 7f88f9d9b700 1 --2- 172.21.15.49:0/60392111 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56537e927640 0x56537e92afa0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f88f0009ce0 tx=0x7f88f000b7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7eff88e978f0e7c server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:47.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.559+0000 7f88e1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-06-03T00:01:47.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.559+0000 7f88e1ffb700 1 -- 172.21.15.49:0/60392111 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f0028040 con 0x56537e927640 2024-06-03T00:01:47.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.559+0000 7f890b360b80 1 -- 172.21.15.49:0/60392111 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88f00055b0 con 0x56537e927640 2024-06-03T00:01:47.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.559+0000 7f88e1ffb700 1 -- 172.21.15.49:0/60392111 <== mon.1 v2:172.21.15.107:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f88f000b9b0 con 0x56537e927640 2024-06-03T00:01:47.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.559+0000 7f88e1ffb700 1 -- 172.21.15.49:0/60392111 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f88f00059d0 con 0x56537e927640 2024-06-03T00:01:47.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.559+0000 7f890b360b80 10 client.25297 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:47.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.559+0000 7f890b360b80 1 -- 172.21.15.49:0/60392111 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56537e92e970 con 0x56537e927640 2024-06-03T00:01:47.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.560+0000 7f88e1ffb700 1 -- 172.21.15.49:0/60392111 <== mon.1 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88f00055b0 con 0x56537e927640 2024-06-03T00:01:47.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.560+0000 7f88e1ffb700 1 -- 172.21.15.49:0/60392111 <== mon.1 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f88f0037030 con 0x56537e927640 2024-06-03T00:01:47.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.560+0000 7f890b360b80 10 client.25297 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:47.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.560+0000 7f890b360b80 10 client.25297 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-03T00:01:47.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.560+0000 7f890b360b80 20 client.25297 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:47.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.560+0000 7f890b360b80 1 --2- 172.21.15.49:0/60392111 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x56537e93b560 0x56537e93d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:47.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.560+0000 7f890b360b80 4 client.25297 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:01:47.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.560+0000 7f890b360b80 1 -- 172.21.15.49:0/60392111 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56537e880d10 con 0x56537e93b560 2024-06-03T00:01:47.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.560+0000 7f88fa59c700 1 --2- 172.21.15.49:0/60392111 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x56537e93b560 0x56537e93d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:47.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.561+0000 7f88fa59c700 1 --2- 172.21.15.49:0/60392111 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x56537e93b560 0x56537e93d950 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23e4869850ef580d server_cookie=a45e0cbea3b7e05b in_seq=0 out_seq=0 2024-06-03T00:01:47.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.561+0000 7f88e1ffb700 10 client.25297 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:47.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.562+0000 7f88e1ffb700 1 -- 172.21.15.49:0/60392111 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x56537e880d10 con 0x56537e93b560 2024-06-03T00:01:47.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.562+0000 7f88e1ffb700 10 client.25297 handle_command_reply: tid=0 2024-06-03T00:01:47.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.562+0000 7f890b360b80 1 client.25297 shutdown 2024-06-03T00:01:47.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.562+0000 7f890b360b80 1 -- 172.21.15.49:0/60392111 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56537e927640 msgr2=0x56537e92afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:47.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.562+0000 7f890b360b80 1 --2- 172.21.15.49:0/60392111 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56537e927640 0x56537e92afa0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f88f0009ce0 tx=0x7f88f000b7d0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.562+0000 7f890b360b80 1 -- 172.21.15.49:0/60392111 shutdown_connections 2024-06-03T00:01:47.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.562+0000 7f890b360b80 1 --2- 172.21.15.49:0/60392111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56537e927f60 0x56537e92b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.562+0000 7f890b360b80 1 --2- 172.21.15.49:0/60392111 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x56537e93b560 0x56537e93d950 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.562+0000 7f890b360b80 1 --2- 172.21.15.49:0/60392111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56537e921f20 0x56537e92dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.562+0000 7f890b360b80 1 --2- 172.21.15.49:0/60392111 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56537e927640 0x56537e92afa0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.562+0000 7f88e1ffb700 0 client.25297 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:47.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.562+0000 7f890b360b80 1 -- 172.21.15.49:0/60392111 >> 172.21.15.49:0/60392111 conn(0x56537e84ccc0 msgr2=0x56537e9209d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:47.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.562+0000 7f890b360b80 1 -- 172.21.15.49:0/60392111 shutdown_connections 2024-06-03T00:01:47.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.562+0000 7f890b360b80 1 -- 172.21.15.49:0/60392111 wait complete. 2024-06-03T00:01:47.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.562+0000 7f890b360b80 20 client.25297 trim_cache size 0 max 16384 2024-06-03T00:01:47.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.583+0000 7f890b360b80 1 Processor -- start 2024-06-03T00:01:47.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.583+0000 7f890b360b80 1 -- start start 2024-06-03T00:01:47.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.583+0000 7f890b360b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56537e921f20 0x56537e9219e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:47.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.584+0000 7f890b360b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56537e927640 0x56537e92b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:47.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.584+0000 7f890b360b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56537e927f60 0x56537e916510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:47.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.584+0000 7f890b360b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc1aec50 con 0x56537e927640 2024-06-03T00:01:47.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.584+0000 7f890b360b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc1b0790 con 0x56537e921f20 2024-06-03T00:01:47.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.584+0000 7f890b360b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc1af320 con 0x56537e927f60 2024-06-03T00:01:47.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.584+0000 7f88f9d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56537e927640 0x56537e92b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:47.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.584+0000 7f88f9d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56537e927640 0x56537e92b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46128/0 (socket says 172.21.15.49:46128) 2024-06-03T00:01:47.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.584+0000 7f88f9d9b700 1 -- 172.21.15.49:0/3167802285 learned_addr learned my addr 172.21.15.49:0/3167802285 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:47.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.584+0000 7f88fad9d700 1 --2- 172.21.15.49:0/3167802285 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56537e927f60 0x56537e916510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:47.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.584+0000 7f88fa59c700 1 --2- 172.21.15.49:0/3167802285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56537e921f20 0x56537e9219e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:47.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.584+0000 7f88f9d9b700 1 -- 172.21.15.49:0/3167802285 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56537e927f60 msgr2=0x56537e916510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:47.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.584+0000 7f88f9d9b700 1 --2- 172.21.15.49:0/3167802285 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56537e927f60 0x56537e916510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.584+0000 7f88f9d9b700 1 -- 172.21.15.49:0/3167802285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56537e921f20 msgr2=0x56537e9219e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:47.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.584+0000 7f88f9d9b700 1 --2- 172.21.15.49:0/3167802285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56537e921f20 0x56537e9219e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.584+0000 7f88f9d9b700 1 -- 172.21.15.49:0/3167802285 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56537e91d500 con 0x56537e927640 2024-06-03T00:01:47.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.584+0000 7f88f9d9b700 1 --2- 172.21.15.49:0/3167802285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56537e927640 0x56537e92b5d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f88f0003d00 tx=0x7f88f0003d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=863ae0e36e1bc17e server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:47.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.584+0000 7f88e3fff700 1 -- 172.21.15.49:0/3167802285 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f0028040 con 0x56537e927640 2024-06-03T00:01:47.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.585+0000 7f88e3fff700 1 -- 172.21.15.49:0/3167802285 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88f000fc10 con 0x56537e927640 2024-06-03T00:01:47.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.585+0000 7f88e3fff700 1 -- 172.21.15.49:0/3167802285 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f000baa0 con 0x56537e927640 2024-06-03T00:01:47.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.585+0000 7f890b360b80 1 -- 172.21.15.49:0/3167802285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56537e927640 msgr2=0x56537e92b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:47.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.585+0000 7f890b360b80 1 --2- 172.21.15.49:0/3167802285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56537e927640 0x56537e92b5d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f88f0003d00 tx=0x7f88f0003d30 comp rx=0 tx=0).stop 2024-06-03T00:01:47.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.585+0000 7f890b360b80 1 -- 172.21.15.49:0/3167802285 shutdown_connections 2024-06-03T00:01:47.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.585+0000 7f890b360b80 1 --2- 172.21.15.49:0/3167802285 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56537e927f60 0x56537e916510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.585+0000 7f890b360b80 1 --2- 172.21.15.49:0/3167802285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56537e921f20 0x56537e9219e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.585+0000 7f890b360b80 1 --2- 172.21.15.49:0/3167802285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56537e927640 0x56537e92b5d0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.586+0000 7f890b360b80 1 -- 172.21.15.49:0/3167802285 >> 172.21.15.49:0/3167802285 conn(0x56537e84ccc0 msgr2=0x56537e915e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:47.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.586+0000 7f890b360b80 1 -- 172.21.15.49:0/3167802285 shutdown_connections 2024-06-03T00:01:47.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.586+0000 7f890b360b80 1 -- 172.21.15.49:0/3167802285 wait complete. 2024-06-03T00:01:47.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.586+0000 7f890b360b80 1 -- start start 2024-06-03T00:01:47.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.586+0000 7f890b360b80 1 Processor -- start 2024-06-03T00:01:47.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.586+0000 7f890b360b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56537e921f20 0x56537e93ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:47.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.586+0000 7f890b360b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56537e927640 0x56537e93f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:47.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.586+0000 7f890b360b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56537e927f60 0x56537e9a4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:47.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.586+0000 7f890b360b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc1b00c0 con 0x56537e927f60 2024-06-03T00:01:47.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.586+0000 7f890b360b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc1af9f0 con 0x56537e927640 2024-06-03T00:01:47.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.586+0000 7f890b360b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc1acbd0 con 0x56537e921f20 2024-06-03T00:01:47.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.586+0000 7f890b360b80 10 client.0 _ll_register_callbacks cb 0x56537e80d920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:47.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.586+0000 7f88fad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56537e927f60 0x56537e9a4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:47.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.587+0000 7f88fad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56537e927f60 0x56537e9a4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46132/0 (socket says 172.21.15.49:46132) 2024-06-03T00:01:47.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.587+0000 7f88fad9d700 1 -- 172.21.15.49:0/2020291435 learned_addr learned my addr 172.21.15.49:0/2020291435 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:47.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.587+0000 7f88fa59c700 1 --2- 172.21.15.49:0/2020291435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56537e921f20 0x56537e93ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:47.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.587+0000 7f88f9d9b700 1 --2- 172.21.15.49:0/2020291435 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56537e927640 0x56537e93f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:47.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.587+0000 7f88fad9d700 1 -- 172.21.15.49:0/2020291435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56537e921f20 msgr2=0x56537e93ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:47.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.587+0000 7f88fad9d700 1 --2- 172.21.15.49:0/2020291435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56537e921f20 0x56537e93ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.587+0000 7f88fad9d700 1 -- 172.21.15.49:0/2020291435 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56537e927640 msgr2=0x56537e93f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:47.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.587+0000 7f88fad9d700 1 --2- 172.21.15.49:0/2020291435 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56537e927640 0x56537e93f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.587+0000 7f88fad9d700 1 -- 172.21.15.49:0/2020291435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56537e9a53e0 con 0x56537e927f60 2024-06-03T00:01:47.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.587+0000 7f88fad9d700 1 --2- 172.21.15.49:0/2020291435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56537e927f60 0x56537e9a4ea0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f88f400a690 tx=0x7f88f4086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77fed54596cdf9eb server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:47.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.587+0000 7f88e1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:01:47.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.587+0000 7f88e1ffb700 1 -- 172.21.15.49:0/2020291435 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f409fb60 con 0x56537e927f60 2024-06-03T00:01:47.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.587+0000 7f88e1ffb700 1 -- 172.21.15.49:0/2020291435 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f88f4018d60 con 0x56537e927f60 2024-06-03T00:01:47.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.587+0000 7f890b360b80 1 -- 172.21.15.49:0/2020291435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88f000fc10 con 0x56537e927f60 2024-06-03T00:01:47.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.587+0000 7f88e1ffb700 1 -- 172.21.15.49:0/2020291435 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f88f40a4420 con 0x56537e927f60 2024-06-03T00:01:47.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.587+0000 7f890b360b80 10 client.15684 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:47.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.587+0000 7f890b360b80 1 -- 172.21.15.49:0/2020291435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56537e9a6590 con 0x56537e927f60 2024-06-03T00:01:47.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.588+0000 7f88e1ffb700 1 -- 172.21.15.49:0/2020291435 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88f000fc10 con 0x56537e927f60 2024-06-03T00:01:47.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.588+0000 7f88e1ffb700 1 -- 172.21.15.49:0/2020291435 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f88f409ac00 con 0x56537e927f60 2024-06-03T00:01:47.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.588+0000 7f890b360b80 10 client.15684 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:47.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.588+0000 7f890b360b80 10 client.15684 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-03T00:01:47.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.588+0000 7f890b360b80 20 client.15684 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:47.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.588+0000 7f890b360b80 1 --2- 172.21.15.49:0/2020291435 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x56537e9a6bf0 0x56537e9a9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:47.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.588+0000 7f890b360b80 4 client.15684 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-03T00:01:47.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.588+0000 7f890b360b80 1 -- 172.21.15.49:0/2020291435 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56537e87b290 con 0x56537e9a6bf0 2024-06-03T00:01:47.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.588+0000 7f88fa59c700 1 --2- 172.21.15.49:0/2020291435 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x56537e9a6bf0 0x56537e9a9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:47.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.589+0000 7f88fa59c700 1 --2- 172.21.15.49:0/2020291435 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x56537e9a6bf0 0x56537e9a9010 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50995b0645e9fca7 server_cookie=25add2b25710a766 in_seq=0 out_seq=0 2024-06-03T00:01:47.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.589+0000 7f88e1ffb700 10 client.15684 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:47.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.589+0000 7f88e1ffb700 1 -- 172.21.15.49:0/2020291435 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56537e87b290 con 0x56537e9a6bf0 2024-06-03T00:01:47.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.589+0000 7f88e1ffb700 10 client.15684 handle_command_reply: tid=0 2024-06-03T00:01:47.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.589+0000 7f890b360b80 1 client.15684 shutdown 2024-06-03T00:01:47.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.589+0000 7f890b360b80 1 -- 172.21.15.49:0/2020291435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56537e927f60 msgr2=0x56537e9a4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:47.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.589+0000 7f890b360b80 1 --2- 172.21.15.49:0/2020291435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56537e927f60 0x56537e9a4ea0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f88f400a690 tx=0x7f88f4086040 comp rx=0 tx=0).stop 2024-06-03T00:01:47.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.589+0000 7f890b360b80 1 -- 172.21.15.49:0/2020291435 shutdown_connections 2024-06-03T00:01:47.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.589+0000 7f890b360b80 1 --2- 172.21.15.49:0/2020291435 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x56537e9a6bf0 0x56537e9a9010 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.589+0000 7f890b360b80 1 --2- 172.21.15.49:0/2020291435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56537e927f60 0x56537e9a4ea0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.589+0000 7f890b360b80 1 --2- 172.21.15.49:0/2020291435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56537e921f20 0x56537e93ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.589+0000 7f890b360b80 1 --2- 172.21.15.49:0/2020291435 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56537e927640 0x56537e93f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.589+0000 7f88e1ffb700 0 client.15684 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:47.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.589+0000 7f890b360b80 1 -- 172.21.15.49:0/2020291435 >> 172.21.15.49:0/2020291435 conn(0x56537e84ccc0 msgr2=0x56537e928a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:47.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.589+0000 7f890b360b80 1 -- 172.21.15.49:0/2020291435 shutdown_connections 2024-06-03T00:01:47.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.589+0000 7f890b360b80 1 -- 172.21.15.49:0/2020291435 wait complete. 2024-06-03T00:01:47.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.590+0000 7f890b360b80 20 client.15684 trim_cache size 0 max 16384 2024-06-03T00:01:47.594 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:01:47.594 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-03T00:01:47.594 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": { 2024-06-03T00:01:47.594 INFO:teuthology.orchestra.run.smithi049.stdout: "7860fcd3-ab59-4bb0-8163-72e144ca06ac": { 2024-06-03T00:01:47.594 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-06-03T00:01:47.595 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "7860fcd3-ab59-4bb0-8163-72e144ca06ac", 2024-06-03T00:01:47.595 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "recursive,force" 2024-06-03T00:01:47.595 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:01:47.595 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:01:47.595 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:01:47.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.590+0000 7f8900add700 1 -- 172.21.15.49:0/551883280 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f88e40a2ca0 msgr2=0x7f88e40a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:47.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.590+0000 7f8900add700 1 --2- 172.21.15.49:0/551883280 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f88e40a2ca0 0x7f88e40a5160 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00abd0 tx=0x7f88ec00a380 comp rx=0 tx=0).stop 2024-06-03T00:01:47.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.590+0000 7f8900add700 1 -- 172.21.15.49:0/551883280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88fc1084f0 msgr2=0x7f88fc101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:47.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.590+0000 7f8900add700 1 --2- 172.21.15.49:0/551883280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88fc1084f0 0x7f88fc101ed0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f88f4007d70 tx=0x7f88f400a340 comp rx=0 tx=0).stop 2024-06-03T00:01:47.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.590+0000 7f8900add700 1 -- 172.21.15.49:0/551883280 shutdown_connections 2024-06-03T00:01:47.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.590+0000 7f8900add700 1 --2- 172.21.15.49:0/551883280 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f88e40a2ca0 0x7f88e40a5160 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.590+0000 7f8900add700 1 --2- 172.21.15.49:0/551883280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88fc1084f0 0x7f88fc101ed0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.590+0000 7f8900add700 1 --2- 172.21.15.49:0/551883280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88fc06aa00 0x7f88fc101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.590+0000 7f8900add700 1 --2- 172.21.15.49:0/551883280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88fc06b3c0 0x7f88fc101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:47.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.590+0000 7f8900add700 1 -- 172.21.15.49:0/551883280 >> 172.21.15.49:0/551883280 conn(0x7f88fc078300 msgr2=0x7f88fc0ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:47.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.590+0000 7f8900add700 1 -- 172.21.15.49:0/551883280 shutdown_connections 2024-06-03T00:01:47.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:01:47.590+0000 7f8900add700 1 -- 172.21.15.49:0/551883280 wait complete. 2024-06-03T00:01:48.506 INFO:tasks.cephfs.filesystem:scrub status for tag:7860fcd3-ab59-4bb0-8163-72e144ca06ac - {'path': '/', 'tag': '7860fcd3-ab59-4bb0-8163-72e144ca06ac', 'options': 'recursive,force'} 2024-06-03T00:01:48.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:48 smithi057 ceph-mon[36457]: pgmap v436: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-06-03T00:01:48.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:48 smithi057 ceph-mon[36457]: scrub summary: idle 2024-06-03T00:01:48.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:48 smithi049 ceph-mon[32302]: pgmap v436: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-06-03T00:01:48.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:48 smithi049 ceph-mon[32302]: scrub summary: idle 2024-06-03T00:01:48.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:48 smithi107 ceph-mon[37048]: pgmap v436: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-06-03T00:01:48.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:48 smithi107 ceph-mon[37048]: scrub summary: idle 2024-06-03T00:01:50.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:50 smithi057 ceph-mon[36457]: pgmap v437: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 853 B/s wr, 13 op/s 2024-06-03T00:01:50.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:50 smithi049 ceph-mon[32302]: pgmap v437: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 853 B/s wr, 13 op/s 2024-06-03T00:01:50.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:50 smithi107 ceph-mon[37048]: pgmap v437: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 853 B/s wr, 13 op/s 2024-06-03T00:01:52.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:52 smithi057 ceph-mon[36457]: pgmap v438: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 853 B/s wr, 12 op/s 2024-06-03T00:01:52.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:52 smithi049 ceph-mon[32302]: pgmap v438: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 853 B/s wr, 12 op/s 2024-06-03T00:01:52.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:52 smithi107 ceph-mon[37048]: pgmap v438: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 853 B/s wr, 12 op/s 2024-06-03T00:01:54.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:54 smithi049 ceph-mon[32302]: pgmap v439: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 767 B/s wr, 13 op/s 2024-06-03T00:01:54.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:54 smithi107 ceph-mon[37048]: pgmap v439: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 767 B/s wr, 13 op/s 2024-06-03T00:01:54.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:54 smithi057 ceph-mon[36457]: pgmap v439: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 767 B/s wr, 13 op/s 2024-06-03T00:01:56.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:56 smithi049 ceph-mon[32302]: pgmap v440: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 853 B/s wr, 13 op/s 2024-06-03T00:01:56.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:56 smithi107 ceph-mon[37048]: pgmap v440: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 853 B/s wr, 13 op/s 2024-06-03T00:01:56.930 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.929+0000 7fc4d915c640 1 -- 172.21.15.49:0/3602963278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4d4103600 msgr2=0x7fc4d4109e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.929+0000 7fc4d915c640 1 --2- 172.21.15.49:0/3602963278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4d4103600 0x7fc4d4109e90 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc009ca0 tx=0x7fc4cc02a8c0 comp rx=0 tx=0).stop 2024-06-03T00:01:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.929+0000 7fc4d915c640 1 -- 172.21.15.49:0/3602963278 shutdown_connections 2024-06-03T00:01:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.929+0000 7fc4d915c640 1 --2- 172.21.15.49:0/3602963278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4d4103600 0x7fc4d4109e90 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.929+0000 7fc4d915c640 1 --2- 172.21.15.49:0/3602963278 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4d4102c40 0x7fc4d41030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.929+0000 7fc4d915c640 1 --2- 172.21.15.49:0/3602963278 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4d4101a50 0x7fc4d4101e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.929+0000 7fc4d915c640 1 -- 172.21.15.49:0/3602963278 >> 172.21.15.49:0/3602963278 conn(0x7fc4d40fcfc0 msgr2=0x7fc4d40ff400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:56.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.929+0000 7fc4d915c640 1 -- 172.21.15.49:0/3602963278 shutdown_connections 2024-06-03T00:01:56.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.929+0000 7fc4d915c640 1 -- 172.21.15.49:0/3602963278 wait complete. 2024-06-03T00:01:56.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.930+0000 7fc4d915c640 1 Processor -- start 2024-06-03T00:01:56.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.930+0000 7fc4d915c640 1 -- start start 2024-06-03T00:01:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.930+0000 7fc4d915c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4d4101a50 0x7fc4d4197c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.930+0000 7fc4d915c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4d4102c40 0x7fc4d41981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.930+0000 7fc4d915c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4d4103600 0x7fc4d419f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.931+0000 7fc4d2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4d4101a50 0x7fc4d4197c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.931+0000 7fc4d2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4d4101a50 0x7fc4d4197c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38928/0 (socket says 172.21.15.49:38928) 2024-06-03T00:01:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.931+0000 7fc4d2d9d640 1 -- 172.21.15.49:0/2568354463 learned_addr learned my addr 172.21.15.49:0/2568354463 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.931+0000 7fc4d915c640 1 -- 172.21.15.49:0/2568354463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d410d720 con 0x7fc4d4101a50 2024-06-03T00:01:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.931+0000 7fc4d915c640 1 -- 172.21.15.49:0/2568354463 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d410d5a0 con 0x7fc4d4102c40 2024-06-03T00:01:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.931+0000 7fc4d915c640 1 -- 172.21.15.49:0/2568354463 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d410d8a0 con 0x7fc4d4103600 2024-06-03T00:01:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.931+0000 7fc4d259c640 1 --2- 172.21.15.49:0/2568354463 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4d4102c40 0x7fc4d41981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.931+0000 7fc4d359e640 1 --2- 172.21.15.49:0/2568354463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4d4103600 0x7fc4d419f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.931+0000 7fc4d2d9d640 1 -- 172.21.15.49:0/2568354463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4d4103600 msgr2=0x7fc4d419f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.931+0000 7fc4d2d9d640 1 --2- 172.21.15.49:0/2568354463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4d4103600 0x7fc4d419f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.931+0000 7fc4d2d9d640 1 -- 172.21.15.49:0/2568354463 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4d4102c40 msgr2=0x7fc4d41981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.931+0000 7fc4d2d9d640 1 --2- 172.21.15.49:0/2568354463 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4d4102c40 0x7fc4d41981a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.931+0000 7fc4d2d9d640 1 -- 172.21.15.49:0/2568354463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d419f870 con 0x7fc4d4101a50 2024-06-03T00:01:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.931+0000 7fc4d259c640 1 --2- 172.21.15.49:0/2568354463 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4d4102c40 0x7fc4d41981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.931+0000 7fc4d2d9d640 1 --2- 172.21.15.49:0/2568354463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4d4101a50 0x7fc4d4197c60 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc4c400e9c0 tx=0x7fc4c400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.932+0000 7fc4bbfff640 1 -- 172.21.15.49:0/2568354463 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c400cd80 con 0x7fc4d4101a50 2024-06-03T00:01:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.932+0000 7fc4bbfff640 1 -- 172.21.15.49:0/2568354463 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4c40035f0 con 0x7fc4d4101a50 2024-06-03T00:01:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.932+0000 7fc4bbfff640 1 -- 172.21.15.49:0/2568354463 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4010690 con 0x7fc4d4101a50 2024-06-03T00:01:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.932+0000 7fc4d915c640 1 -- 172.21.15.49:0/2568354463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4d419fb60 con 0x7fc4d4101a50 2024-06-03T00:01:56.936 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.933+0000 7fc4d915c640 1 -- 172.21.15.49:0/2568354463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4d41a0060 con 0x7fc4d4101a50 2024-06-03T00:01:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.935+0000 7fc4bbfff640 1 -- 172.21.15.49:0/2568354463 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc4c40037a0 con 0x7fc4d4101a50 2024-06-03T00:01:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.936+0000 7fc4dbe60740 1 Processor -- start 2024-06-03T00:01:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.936+0000 7fc4dbe60740 1 -- start start 2024-06-03T00:01:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.936+0000 7fc4dbe60740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55892ceb5010 0x55892ceb5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.936+0000 7fc4dbe60740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55892ceb5a00 0x55892ceba500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.936+0000 7fc4bbfff640 1 --2- 172.21.15.49:0/2568354463 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc4bc0a2cb0 0x7fc4bc0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.936+0000 7fc4dbe60740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55892cebab70 0x55892cebd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.936+0000 7fc4dbe60740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55892ce184f0 con 0x55892ceb5010 2024-06-03T00:01:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.936+0000 7fc4dbe60740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55892cdb6870 con 0x55892cebab70 2024-06-03T00:01:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.936+0000 7fc4dbe60740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55892ce144b0 con 0x55892ceb5a00 2024-06-03T00:01:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.937+0000 7fc4bbfff640 1 -- 172.21.15.49:0/2568354463 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fc4c40cf4e0 con 0x7fc4d4101a50 2024-06-03T00:01:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.937+0000 7fc4d359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55892ceb5010 0x55892ceb5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.937+0000 7fc4d359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55892ceb5010 0x55892ceb5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38938/0 (socket says 172.21.15.49:38938) 2024-06-03T00:01:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.937+0000 7fc4d359e640 1 -- 172.21.15.49:0/1865608224 learned_addr learned my addr 172.21.15.49:0/1865608224 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.937+0000 7fc4d2d9d640 1 --2- 172.21.15.49:0/1865608224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55892ceb5a00 0x55892ceba500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.937+0000 7fc4d359e640 1 -- 172.21.15.49:0/1865608224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55892ceb5a00 msgr2=0x55892ceba500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.937+0000 7fc4d359e640 1 --2- 172.21.15.49:0/1865608224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55892ceb5a00 0x55892ceba500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.937+0000 7fc4d359e640 1 -- 172.21.15.49:0/1865608224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55892cebab70 msgr2=0x55892cebd000 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-03T00:01:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.937+0000 7fc4d359e640 1 --2- 172.21.15.49:0/1865608224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55892cebab70 0x55892cebd000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.937+0000 7fc4d359e640 1 -- 172.21.15.49:0/1865608224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55892cdd29b0 con 0x55892ceb5010 2024-06-03T00:01:56.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.937+0000 7fc4d2d9d640 1 --2- 172.21.15.49:0/1865608224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55892ceb5a00 0x55892ceba500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:56.940 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.937+0000 7fc4d259c640 1 --2- 172.21.15.49:0/2568354463 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc4bc0a2cb0 0x7fc4bc0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:56.940 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.938+0000 7fc4d359e640 1 --2- 172.21.15.49:0/1865608224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55892ceb5010 0x55892ceb5430 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc031c10 tx=0x7fc4cc005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a342fa4c77743445 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:56.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.938+0000 7fc4b97fa640 1 -- 172.21.15.49:0/1865608224 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc031450 con 0x55892ceb5010 2024-06-03T00:01:56.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.938+0000 7fc4d259c640 1 --2- 172.21.15.49:0/2568354463 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc4bc0a2cb0 0x7fc4bc0a5170 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8009c70 tx=0x7fc4c8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.938+0000 7fc4b97fa640 1 -- 172.21.15.49:0/1865608224 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4cc036040 con 0x55892ceb5010 2024-06-03T00:01:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.939+0000 7fc4b97fa640 1 -- 172.21.15.49:0/1865608224 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc0046b0 con 0x55892ceb5010 2024-06-03T00:01:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.939+0000 7fc4dbe60740 1 -- 172.21.15.49:0/1865608224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55892ceb5010 msgr2=0x55892ceb5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.939+0000 7fc4dbe60740 1 --2- 172.21.15.49:0/1865608224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55892ceb5010 0x55892ceb5430 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc031c10 tx=0x7fc4cc005ef0 comp rx=0 tx=0).stop 2024-06-03T00:01:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.939+0000 7fc4dbe60740 1 -- 172.21.15.49:0/1865608224 shutdown_connections 2024-06-03T00:01:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.939+0000 7fc4dbe60740 1 --2- 172.21.15.49:0/1865608224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55892cebab70 0x55892cebd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.939+0000 7fc4dbe60740 1 --2- 172.21.15.49:0/1865608224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55892ceb5a00 0x55892ceba500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.939+0000 7fc4dbe60740 1 --2- 172.21.15.49:0/1865608224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55892ceb5010 0x55892ceb5430 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.939+0000 7fc4dbe60740 1 -- 172.21.15.49:0/1865608224 >> 172.21.15.49:0/1865608224 conn(0x55892ceb0680 msgr2=0x55892ceb0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.939+0000 7fc4dbe60740 1 -- 172.21.15.49:0/1865608224 shutdown_connections 2024-06-03T00:01:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.939+0000 7fc4dbe60740 1 -- 172.21.15.49:0/1865608224 wait complete. 2024-06-03T00:01:56.943 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.940+0000 7fc4dbe60740 1 -- start start 2024-06-03T00:01:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.940+0000 7fc4dbe60740 1 Processor -- start 2024-06-03T00:01:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.940+0000 7fc4dbe60740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55892ceb5010 0x55892cec3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.940+0000 7fc4d2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55892ceb5010 0x55892cec3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.940+0000 7fc4d2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55892ceb5010 0x55892cec3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38950/0 (socket says 172.21.15.49:38950) 2024-06-03T00:01:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.940+0000 7fc4d2d9d640 1 -- 172.21.15.49:0/3546766366 learned_addr learned my addr 172.21.15.49:0/3546766366 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.940+0000 7fc4dbe60740 1 --2- 172.21.15.49:0/3546766366 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55892ceb5a00 0x55892cec3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.940+0000 7fc4dbe60740 1 --2- 172.21.15.49:0/3546766366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55892cebab70 0x55892cecab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.941+0000 7fc4dbe60740 1 -- 172.21.15.49:0/3546766366 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55892cec1f70 con 0x55892ceb5010 2024-06-03T00:01:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.941+0000 7fc4dbe60740 1 -- 172.21.15.49:0/3546766366 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55892cda1ae0 con 0x55892cebab70 2024-06-03T00:01:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.941+0000 7fc4dbe60740 1 -- 172.21.15.49:0/3546766366 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55892cec20f0 con 0x55892ceb5a00 2024-06-03T00:01:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.941+0000 7fc4d259c640 1 --2- 172.21.15.49:0/3546766366 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55892ceb5a00 0x55892cec3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:56.944 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.941+0000 7fc4d359e640 1 --2- 172.21.15.49:0/3546766366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55892cebab70 0x55892cecab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.941+0000 7fc4dbe60740 10 client.0 _ll_register_callbacks cb 0x55892cdda9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.941+0000 7fc4d2d9d640 1 -- 172.21.15.49:0/3546766366 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55892ceb5a00 msgr2=0x55892cec3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.941+0000 7fc4d2d9d640 1 --2- 172.21.15.49:0/3546766366 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55892ceb5a00 0x55892cec3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.941+0000 7fc4d2d9d640 1 -- 172.21.15.49:0/3546766366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55892cebab70 msgr2=0x55892cecab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.941+0000 7fc4d2d9d640 1 --2- 172.21.15.49:0/3546766366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55892cebab70 0x55892cecab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.941+0000 7fc4d2d9d640 1 -- 172.21.15.49:0/3546766366 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55892cb2c210 con 0x55892ceb5010 2024-06-03T00:01:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.941+0000 7fc4d359e640 1 --2- 172.21.15.49:0/3546766366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55892cebab70 0x55892cecab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.941+0000 7fc4dbe60740 1 -- 172.21.15.49:0/3546766366 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4cc036040 con 0x55892ceb5010 2024-06-03T00:01:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.941+0000 7fc4d2d9d640 1 --2- 172.21.15.49:0/3546766366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55892ceb5010 0x55892cec3610 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc4c400c6a0 tx=0x7fc4c4099f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b666465311015f server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.941+0000 7fc4b6ff5640 10 client.15696 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:01:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.942+0000 7fc4b6ff5640 1 -- 172.21.15.49:0/3546766366 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c409bd40 con 0x55892ceb5010 2024-06-03T00:01:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.942+0000 7fc4b6ff5640 1 -- 172.21.15.49:0/3546766366 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fc4c40b5300 con 0x55892ceb5010 2024-06-03T00:01:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.942+0000 7fc4b6ff5640 1 -- 172.21.15.49:0/3546766366 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc4c40a00f0 con 0x55892ceb5010 2024-06-03T00:01:56.945 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.942+0000 7fc4dbe60740 10 client.15696 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.942+0000 7fc4dbe60740 1 -- 172.21.15.49:0/3546766366 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55892cbf8620 con 0x55892ceb5010 2024-06-03T00:01:56.947 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.942+0000 7fc4b6ff5640 1 -- 172.21.15.49:0/3546766366 <== mon.0 v2:172.21.15.49:3300/0 4 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fc4c40cf0c0 con 0x55892ceb5010 2024-06-03T00:01:56.947 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.942+0000 7fc4dbe60740 10 client.15696 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:56.947 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.942+0000 7fc4dbe60740 10 client.15696 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:01:56.947 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.942+0000 7fc4dbe60740 20 client.15696 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:56.947 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.942+0000 7fc4dbe60740 1 --2- 172.21.15.49:0/3546766366 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55892cecf3a0 0x55892ced17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:56.947 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.942+0000 7fc4dbe60740 4 client.15696 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:01:56.947 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.942+0000 7fc4dbe60740 1 -- 172.21.15.49:0/3546766366 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55892ce2bf10 con 0x55892cecf3a0 2024-06-03T00:01:56.947 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.943+0000 7fc4d259c640 1 --2- 172.21.15.49:0/3546766366 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55892cecf3a0 0x55892ced17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:56.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.943+0000 7fc4b6ff5640 10 client.15696 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:56.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.943+0000 7fc4d259c640 1 --2- 172.21.15.49:0/3546766366 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55892cecf3a0 0x55892ced17b0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be9936df7f610bcd server_cookie=d4554d1f8722d3e5 in_seq=0 out_seq=0 2024-06-03T00:01:56.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.944+0000 7fc4b6ff5640 1 -- 172.21.15.49:0/3546766366 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55892ce2bf10 con 0x55892cecf3a0 2024-06-03T00:01:56.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.944+0000 7fc4b6ff5640 10 client.15696 handle_command_reply: tid=0 2024-06-03T00:01:56.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.944+0000 7fc4dbe60740 1 client.15696 shutdown 2024-06-03T00:01:56.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.944+0000 7fc4dbe60740 1 -- 172.21.15.49:0/3546766366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55892ceb5010 msgr2=0x55892cec3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:56.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.944+0000 7fc4dbe60740 1 --2- 172.21.15.49:0/3546766366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55892ceb5010 0x55892cec3610 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc4c400c6a0 tx=0x7fc4c4099f80 comp rx=0 tx=0).stop 2024-06-03T00:01:56.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.944+0000 7fc4dbe60740 1 -- 172.21.15.49:0/3546766366 shutdown_connections 2024-06-03T00:01:56.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.944+0000 7fc4dbe60740 1 --2- 172.21.15.49:0/3546766366 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55892cecf3a0 0x55892ced17b0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:56.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.944+0000 7fc4dbe60740 1 --2- 172.21.15.49:0/3546766366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55892cebab70 0x55892cecab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:56.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.944+0000 7fc4b6ff5640 0 client.15696 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:56.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.944+0000 7fc4dbe60740 1 --2- 172.21.15.49:0/3546766366 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55892ceb5a00 0x55892cec3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:56.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.944+0000 7fc4dbe60740 1 --2- 172.21.15.49:0/3546766366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55892ceb5010 0x55892cec3610 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:56.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.944+0000 7fc4dbe60740 1 -- 172.21.15.49:0/3546766366 >> 172.21.15.49:0/3546766366 conn(0x55892ceb0680 msgr2=0x55892ceaf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.944+0000 7fc4dbe60740 1 -- 172.21.15.49:0/3546766366 shutdown_connections 2024-06-03T00:01:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.944+0000 7fc4dbe60740 1 -- 172.21.15.49:0/3546766366 wait complete. 2024-06-03T00:01:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.944+0000 7fc4dbe60740 20 client.15696 trim_cache size 0 max 16384 2024-06-03T00:01:56.949 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:56 smithi057 ceph-mon[36457]: pgmap v440: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 853 B/s wr, 13 op/s 2024-06-03T00:01:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.975+0000 7fc4dbe60740 1 Processor -- start 2024-06-03T00:01:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.975+0000 7fc4dbe60740 1 -- start start 2024-06-03T00:01:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.975+0000 7fc4dbe60740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55892ceb5010 0x55892ced1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.975+0000 7fc4dbe60740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55892ceb5a00 0x55892cecab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.975+0000 7fc4dbe60740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55892cebab70 0x55892ceb3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.975+0000 7fc4dbe60740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d41a6d30 con 0x55892ceb5a00 2024-06-03T00:01:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.975+0000 7fc4dbe60740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d41a8870 con 0x55892cebab70 2024-06-03T00:01:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.975+0000 7fc4dbe60740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d41a7400 con 0x55892ceb5010 2024-06-03T00:01:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.975+0000 7fc4d259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55892ceb5a00 0x55892cecab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:56.978 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.975+0000 7fc4d259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55892ceb5a00 0x55892cecab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38964/0 (socket says 172.21.15.49:38964) 2024-06-03T00:01:56.978 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.975+0000 7fc4d259c640 1 -- 172.21.15.49:0/3650247737 learned_addr learned my addr 172.21.15.49:0/3650247737 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:56.978 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.976+0000 7fc4d2d9d640 1 --2- 172.21.15.49:0/3650247737 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55892ceb5010 0x55892ced1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:56.978 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.976+0000 7fc4d259c640 1 -- 172.21.15.49:0/3650247737 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55892ceb5010 msgr2=0x55892ced1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:56.978 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.976+0000 7fc4d259c640 1 --2- 172.21.15.49:0/3650247737 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55892ceb5010 0x55892ced1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:56.978 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.976+0000 7fc4d259c640 1 -- 172.21.15.49:0/3650247737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55892cebab70 msgr2=0x55892ceb3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:56.978 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.976+0000 7fc4d259c640 1 --2- 172.21.15.49:0/3650247737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55892cebab70 0x55892ceb3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:56.978 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.976+0000 7fc4d259c640 1 -- 172.21.15.49:0/3650247737 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55892ced1e30 con 0x55892ceb5a00 2024-06-03T00:01:56.978 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.976+0000 7fc4d259c640 1 --2- 172.21.15.49:0/3650247737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55892ceb5a00 0x55892cecab50 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8000c00 tx=0x7fc4c8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b58155ae263d95aa server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:56.978 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.976+0000 7fc4b8ff9640 1 -- 172.21.15.49:0/3650247737 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c802e070 con 0x55892ceb5a00 2024-06-03T00:01:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.976+0000 7fc4b8ff9640 1 -- 172.21.15.49:0/3650247737 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4c8021110 con 0x55892ceb5a00 2024-06-03T00:01:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.976+0000 7fc4b8ff9640 1 -- 172.21.15.49:0/3650247737 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c80287c0 con 0x55892ceb5a00 2024-06-03T00:01:56.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.977+0000 7fc4dbe60740 1 -- 172.21.15.49:0/3650247737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55892ceb5a00 msgr2=0x55892cecab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:56.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.977+0000 7fc4dbe60740 1 --2- 172.21.15.49:0/3650247737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55892ceb5a00 0x55892cecab50 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8000c00 tx=0x7fc4c8014000 comp rx=0 tx=0).stop 2024-06-03T00:01:56.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.977+0000 7fc4dbe60740 1 -- 172.21.15.49:0/3650247737 shutdown_connections 2024-06-03T00:01:56.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.977+0000 7fc4dbe60740 1 --2- 172.21.15.49:0/3650247737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55892cebab70 0x55892ceb3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:56.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.977+0000 7fc4dbe60740 1 --2- 172.21.15.49:0/3650247737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55892ceb5a00 0x55892cecab50 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:56.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.977+0000 7fc4dbe60740 1 --2- 172.21.15.49:0/3650247737 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55892ceb5010 0x55892ced1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.977+0000 7fc4dbe60740 1 -- 172.21.15.49:0/3650247737 >> 172.21.15.49:0/3650247737 conn(0x55892ceb0680 msgr2=0x55892ceb0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.977+0000 7fc4dbe60740 1 -- 172.21.15.49:0/3650247737 shutdown_connections 2024-06-03T00:01:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.978+0000 7fc4dbe60740 1 -- 172.21.15.49:0/3650247737 wait complete. 2024-06-03T00:01:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.978+0000 7fc4dbe60740 1 -- start start 2024-06-03T00:01:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.978+0000 7fc4dbe60740 1 Processor -- start 2024-06-03T00:01:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.978+0000 7fc4dbe60740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55892ceb5010 0x55892cec8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.978+0000 7fc4dbe60740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55892ceb5a00 0x55892cec89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.979+0000 7fc4dbe60740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55892cebab70 0x55892cec99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.979+0000 7fc4d2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55892ceb5010 0x55892cec8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.979+0000 7fc4d2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55892ceb5010 0x55892cec8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38980/0 (socket says 172.21.15.49:38980) 2024-06-03T00:01:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.979+0000 7fc4d2d9d640 1 -- 172.21.15.49:0/827113257 learned_addr learned my addr 172.21.15.49:0/827113257 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:01:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.979+0000 7fc4d259c640 1 --2- 172.21.15.49:0/827113257 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55892ceb5a00 0x55892cec89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.979+0000 7fc4d359e640 1 --2- 172.21.15.49:0/827113257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55892cebab70 0x55892cec99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.979+0000 7fc4dbe60740 1 -- 172.21.15.49:0/827113257 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d41a81a0 con 0x55892ceb5010 2024-06-03T00:01:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.979+0000 7fc4dbe60740 1 -- 172.21.15.49:0/827113257 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d41a7ad0 con 0x55892cebab70 2024-06-03T00:01:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.979+0000 7fc4dbe60740 1 -- 172.21.15.49:0/827113257 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d41a4cf0 con 0x55892ceb5a00 2024-06-03T00:01:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.979+0000 7fc4dbe60740 10 client.0 _ll_register_callbacks cb 0x7fc4c4097f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:01:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.979+0000 7fc4d2d9d640 1 -- 172.21.15.49:0/827113257 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55892ceb5a00 msgr2=0x55892cec89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.979+0000 7fc4d2d9d640 1 --2- 172.21.15.49:0/827113257 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55892ceb5a00 0x55892cec89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.979+0000 7fc4d2d9d640 1 -- 172.21.15.49:0/827113257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55892cebab70 msgr2=0x55892cec99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:56.988 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.979+0000 7fc4d2d9d640 1 --2- 172.21.15.49:0/827113257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55892cebab70 0x55892cec99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:56.988 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.979+0000 7fc4d2d9d640 1 -- 172.21.15.49:0/827113257 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55892ceb04b0 con 0x55892ceb5010 2024-06-03T00:01:56.988 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.979+0000 7fc4dbe60740 1 -- 172.21.15.49:0/827113257 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4c8021110 con 0x55892ceb5010 2024-06-03T00:01:56.988 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.980+0000 7fc4d2d9d640 1 --2- 172.21.15.49:0/827113257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55892ceb5010 0x55892cec8470 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc4c40a4480 tx=0x7fc4c40b1000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13e112bf6ba7bfe6 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:56.988 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.980+0000 7fc4b6ff5640 10 client.15702 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:01:56.988 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.980+0000 7fc4b6ff5640 1 -- 172.21.15.49:0/827113257 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c409bd40 con 0x55892ceb5010 2024-06-03T00:01:56.988 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.980+0000 7fc4b6ff5640 1 -- 172.21.15.49:0/827113257 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fc4c409b190 con 0x55892ceb5010 2024-06-03T00:01:56.988 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.980+0000 7fc4b6ff5640 1 -- 172.21.15.49:0/827113257 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc4c409b6a0 con 0x55892ceb5010 2024-06-03T00:01:56.988 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.980+0000 7fc4dbe60740 10 client.15702 fetch_fsmap learned FSMap version 27 2024-06-03T00:01:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.980+0000 7fc4dbe60740 1 -- 172.21.15.49:0/827113257 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55892cf3a090 con 0x55892ceb5010 2024-06-03T00:01:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.981+0000 7fc4b6ff5640 1 -- 172.21.15.49:0/827113257 <== mon.0 v2:172.21.15.49:3300/0 4 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fc4c407ab20 con 0x55892ceb5010 2024-06-03T00:01:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.981+0000 7fc4dbe60740 10 client.15702 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:01:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.981+0000 7fc4dbe60740 10 client.15702 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:01:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.981+0000 7fc4dbe60740 20 client.15702 populate_metadata read hostname 'smithi049' 2024-06-03T00:01:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.981+0000 7fc4dbe60740 1 --2- 172.21.15.49:0/827113257 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55892cf3a820 0x55892cf3cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.981+0000 7fc4dbe60740 4 client.15702 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-03T00:01:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.981+0000 7fc4dbe60740 1 -- 172.21.15.49:0/827113257 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55892ce25c20 con 0x55892cf3a820 2024-06-03T00:01:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.981+0000 7fc4d259c640 1 --2- 172.21.15.49:0/827113257 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55892cf3a820 0x55892cf3cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.982+0000 7fc4d259c640 1 --2- 172.21.15.49:0/827113257 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55892cf3a820 0x55892cf3cc10 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1ee8a143f9fcf41 server_cookie=41ab147986ef6194 in_seq=0 out_seq=0 2024-06-03T00:01:56.990 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.982+0000 7fc4b6ff5640 10 client.15702 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:56.991 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.986+0000 7fc4b6ff5640 1 -- 172.21.15.49:0/827113257 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55892ce25c20 con 0x55892cf3a820 2024-06-03T00:01:56.991 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.986+0000 7fc4b6ff5640 10 client.15702 handle_command_reply: tid=0 2024-06-03T00:01:56.991 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.986+0000 7fc4dbe60740 1 client.15702 shutdown 2024-06-03T00:01:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.986+0000 7fc4dbe60740 1 -- 172.21.15.49:0/827113257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55892ceb5010 msgr2=0x55892cec8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.986+0000 7fc4dbe60740 1 --2- 172.21.15.49:0/827113257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55892ceb5010 0x55892cec8470 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc4c40a4480 tx=0x7fc4c40b1000 comp rx=0 tx=0).stop 2024-06-03T00:01:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.986+0000 7fc4dbe60740 1 -- 172.21.15.49:0/827113257 shutdown_connections 2024-06-03T00:01:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.986+0000 7fc4dbe60740 1 --2- 172.21.15.49:0/827113257 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55892cf3a820 0x55892cf3cc10 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.986+0000 7fc4dbe60740 1 --2- 172.21.15.49:0/827113257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55892cebab70 0x55892cec99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.986+0000 7fc4dbe60740 1 --2- 172.21.15.49:0/827113257 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55892ceb5a00 0x55892cec89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.986+0000 7fc4dbe60740 1 --2- 172.21.15.49:0/827113257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55892ceb5010 0x55892cec8470 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.986+0000 7fc4dbe60740 1 -- 172.21.15.49:0/827113257 >> 172.21.15.49:0/827113257 conn(0x55892ceb0680 msgr2=0x55892ceb3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.986+0000 7fc4b6ff5640 0 client.15702 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:01:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.986+0000 7fc4dbe60740 1 -- 172.21.15.49:0/827113257 shutdown_connections 2024-06-03T00:01:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.987+0000 7fc4dbe60740 1 -- 172.21.15.49:0/827113257 wait complete. 2024-06-03T00:01:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.987+0000 7fc4dbe60740 20 client.15702 trim_cache size 0 max 16384 2024-06-03T00:01:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-06-03T00:01:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-06-03T00:01:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-06-03T00:01:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.987+0000 7fc4d915c640 1 -- 172.21.15.49:0/2568354463 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc4bc0a2cb0 msgr2=0x7fc4bc0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.987+0000 7fc4d915c640 1 --2- 172.21.15.49:0/2568354463 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc4bc0a2cb0 0x7fc4bc0a5170 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8009c70 tx=0x7fc4c8005f90 comp rx=0 tx=0).stop 2024-06-03T00:01:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.987+0000 7fc4d915c640 1 -- 172.21.15.49:0/2568354463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4d4101a50 msgr2=0x7fc4d4197c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.987+0000 7fc4d915c640 1 --2- 172.21.15.49:0/2568354463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4d4101a50 0x7fc4d4197c60 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc4c400e9c0 tx=0x7fc4c400ee80 comp rx=0 tx=0).stop 2024-06-03T00:01:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.987+0000 7fc4d915c640 1 -- 172.21.15.49:0/2568354463 shutdown_connections 2024-06-03T00:01:56.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.987+0000 7fc4d915c640 1 --2- 172.21.15.49:0/2568354463 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fc4bc0a2cb0 0x7fc4bc0a5170 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:56.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.987+0000 7fc4d915c640 1 --2- 172.21.15.49:0/2568354463 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4d4102c40 0x7fc4d41981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:56.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.987+0000 7fc4d915c640 1 --2- 172.21.15.49:0/2568354463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4d4103600 0x7fc4d419f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:56.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.987+0000 7fc4d915c640 1 --2- 172.21.15.49:0/2568354463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4d4101a50 0x7fc4d4197c60 secure :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc4c400e9c0 tx=0x7fc4c400ee80 comp rx=0 tx=0).stop 2024-06-03T00:01:56.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.987+0000 7fc4d915c640 1 -- 172.21.15.49:0/2568354463 >> 172.21.15.49:0/2568354463 conn(0x7fc4d40fcfc0 msgr2=0x7fc4d4105e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:56.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.988+0000 7fc4d915c640 1 -- 172.21.15.49:0/2568354463 shutdown_connections 2024-06-03T00:01:56.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:01:56.988+0000 7fc4d915c640 1 -- 172.21.15.49:0/2568354463 wait complete. 2024-06-03T00:01:58.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:01:58 smithi049 ceph-mon[32302]: pgmap v441: 97 pgs: 97 active+clean; 673 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 853 B/s wr, 11 op/s 2024-06-03T00:01:58.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:01:58 smithi107 ceph-mon[37048]: pgmap v441: 97 pgs: 97 active+clean; 673 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 853 B/s wr, 11 op/s 2024-06-03T00:01:58.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:01:58 smithi057 ceph-mon[36457]: pgmap v441: 97 pgs: 97 active+clean; 673 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 853 B/s wr, 11 op/s 2024-06-03T00:02:00.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:00 smithi049 ceph-mon[32302]: pgmap v442: 97 pgs: 97 active+clean; 673 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 511 B/s wr, 11 op/s 2024-06-03T00:02:00.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:00 smithi107 ceph-mon[37048]: pgmap v442: 97 pgs: 97 active+clean; 673 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 511 B/s wr, 11 op/s 2024-06-03T00:02:00.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:00 smithi057 ceph-mon[36457]: pgmap v442: 97 pgs: 97 active+clean; 673 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 511 B/s wr, 11 op/s 2024-06-03T00:02:01.305 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-03T00:02:01.649 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:02:02.806 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:02 smithi049 ceph-mon[32302]: pgmap v443: 97 pgs: 97 active+clean; 673 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 341 B/s wr, 9 op/s 2024-06-03T00:02:02.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:02 smithi107 ceph-mon[37048]: pgmap v443: 97 pgs: 97 active+clean; 673 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 341 B/s wr, 9 op/s 2024-06-03T00:02:02.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:02 smithi057 ceph-mon[36457]: pgmap v443: 97 pgs: 97 active+clean; 673 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 341 B/s wr, 9 op/s 2024-06-03T00:02:03.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.601+0000 7fa762010700 1 -- 172.21.15.49:0/3333582586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa75c101d50 msgr2=0x7fa75c10e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:03.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.601+0000 7fa762010700 1 --2- 172.21.15.49:0/3333582586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa75c101d50 0x7fa75c10e240 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa75400b0a0 tx=0x7fa75400b3b0 comp rx=0 tx=0).stop 2024-06-03T00:02:03.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.601+0000 7fa762010700 1 -- 172.21.15.49:0/3333582586 shutdown_connections 2024-06-03T00:02:03.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.601+0000 7fa762010700 1 --2- 172.21.15.49:0/3333582586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa75c101d50 0x7fa75c10e240 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:03.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.601+0000 7fa762010700 1 --2- 172.21.15.49:0/3333582586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa75c107400 0x7fa75c1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:03.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.601+0000 7fa762010700 1 --2- 172.21.15.49:0/3333582586 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa75c101390 0x7fa75c101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:03.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.601+0000 7fa762010700 1 -- 172.21.15.49:0/3333582586 >> 172.21.15.49:0/3333582586 conn(0x7fa75c078340 msgr2=0x7fa75c078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:03.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.601+0000 7fa762010700 1 -- 172.21.15.49:0/3333582586 shutdown_connections 2024-06-03T00:02:03.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.601+0000 7fa762010700 1 -- 172.21.15.49:0/3333582586 wait complete. 2024-06-03T00:02:03.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.602+0000 7fa762010700 1 Processor -- start 2024-06-03T00:02:03.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.602+0000 7fa762010700 1 -- start start 2024-06-03T00:02:03.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.602+0000 7fa762010700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa75c101390 0x7fa75c19e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:03.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.602+0000 7fa762010700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa75c101d50 0x7fa75c19ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:03.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.602+0000 7fa762010700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa75c107400 0x7fa75c198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:03.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.602+0000 7fa762010700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa75c112820 con 0x7fa75c101390 2024-06-03T00:02:03.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.602+0000 7fa762010700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa75c1126a0 con 0x7fa75c107400 2024-06-03T00:02:03.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.602+0000 7fa762010700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa75c1129a0 con 0x7fa75c101d50 2024-06-03T00:02:03.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.603+0000 7fa75b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa75c101390 0x7fa75c19e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:03.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.603+0000 7fa75b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa75c101390 0x7fa75c19e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45608/0 (socket says 172.21.15.49:45608) 2024-06-03T00:02:03.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.603+0000 7fa75b7fe700 1 -- 172.21.15.49:0/1865297659 learned_addr learned my addr 172.21.15.49:0/1865297659 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:03.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.603+0000 7fa75affd700 1 --2- 172.21.15.49:0/1865297659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa75c101d50 0x7fa75c19ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:03.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.603+0000 7fa75bfff700 1 --2- 172.21.15.49:0/1865297659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa75c107400 0x7fa75c198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:03.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.603+0000 7fa75affd700 1 -- 172.21.15.49:0/1865297659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa75c107400 msgr2=0x7fa75c198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:03.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.603+0000 7fa75affd700 1 --2- 172.21.15.49:0/1865297659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa75c107400 0x7fa75c198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:03.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.603+0000 7fa75affd700 1 -- 172.21.15.49:0/1865297659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa75c101390 msgr2=0x7fa75c19e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:03.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.603+0000 7fa75affd700 1 --2- 172.21.15.49:0/1865297659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa75c101390 0x7fa75c19e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:03.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.603+0000 7fa75affd700 1 -- 172.21.15.49:0/1865297659 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa75c1991e0 con 0x7fa75c101d50 2024-06-03T00:02:03.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.603+0000 7fa75b7fe700 1 --2- 172.21.15.49:0/1865297659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa75c101390 0x7fa75c19e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:02:03.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.604+0000 7fa75affd700 1 --2- 172.21.15.49:0/1865297659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa75c101d50 0x7fa75c19ee00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa75000e9f0 tx=0x7fa75000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:03.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.604+0000 7fa758ff9700 1 -- 172.21.15.49:0/1865297659 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75000cbd0 con 0x7fa75c101d50 2024-06-03T00:02:03.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.604+0000 7fa758ff9700 1 -- 172.21.15.49:0/1865297659 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa750004500 con 0x7fa75c101d50 2024-06-03T00:02:03.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.604+0000 7fa762010700 1 -- 172.21.15.49:0/1865297659 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa75c1994d0 con 0x7fa75c101d50 2024-06-03T00:02:03.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.604+0000 7fa758ff9700 1 -- 172.21.15.49:0/1865297659 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa750005280 con 0x7fa75c101d50 2024-06-03T00:02:03.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.604+0000 7fa762010700 1 -- 172.21.15.49:0/1865297659 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa75c1a5790 con 0x7fa75c101d50 2024-06-03T00:02:03.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.605+0000 7fa762010700 1 -- 172.21.15.49:0/1865297659 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa75c069180 con 0x7fa75c101d50 2024-06-03T00:02:03.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.607+0000 7fa758ff9700 1 -- 172.21.15.49:0/1865297659 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa750005420 con 0x7fa75c101d50 2024-06-03T00:02:03.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.608+0000 7fa758ff9700 1 --2- 172.21.15.49:0/1865297659 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa7440a2ca0 0x7fa7440a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:03.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.608+0000 7fa758ff9700 1 -- 172.21.15.49:0/1865297659 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fa7500cef80 con 0x7fa75c101d50 2024-06-03T00:02:03.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.608+0000 7fa75b7fe700 1 --2- 172.21.15.49:0/1865297659 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa7440a2ca0 0x7fa7440a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:03.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.609+0000 7fa75b7fe700 1 --2- 172.21.15.49:0/1865297659 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa7440a2ca0 0x7fa7440a5160 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa75c199bc0 tx=0x7fa74c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:03.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.613+0000 7fa758ff9700 1 -- 172.21.15.49:0/1865297659 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa75009bea0 con 0x7fa75c101d50 2024-06-03T00:02:03.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.978+0000 7fa762010700 1 -- 172.21.15.49:0/1865297659 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa75c02dca0 con 0x7fa75c101d50 2024-06-03T00:02:03.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.979+0000 7fa758ff9700 1 -- 172.21.15.49:0/1865297659 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11929 (secure 0 0 0) 0x7fa75009b7a0 con 0x7fa75c101d50 2024-06-03T00:02:03.980 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:02:03.980 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1553264866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1553264866},{"type":"v1","addr":"172.21.15.49:6835","nonce":1553264866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2266285252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2266285252},{"type":"v1","addr":"172.21.15.49:6837","nonce":2266285252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T23:57:16.991201+0000","modified":"2024-06-03T00:00:26.305285+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24485,"mds_2":24466,"mds_3":24464,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6839/1729124617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":1729124617},{"type":"v1","addr":"172.21.15.49:6839","nonce":1729124617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6841/1902772235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":1902772235},{"type":"v1","addr":"172.21.15.49:6841","nonce":1902772235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6833/1633534002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1633534002},{"type":"v1","addr":"172.21.15.57:6833","nonce":1633534002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6835/2254905671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2254905671},{"type":"v1","addr":"172.21.15.57:6835","nonce":2254905671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.107:6835/3693542801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3693542801},{"type":"v1","addr":"172.21.15.107:6835","nonce":3693542801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.57:6837/230452144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":230452144},{"type":"v1","addr":"172.21.15.57:6837","nonce":230452144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.107:6837/3700593315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":3700593315},{"type":"v1","addr":"172.21.15.107:6837","nonce":3700593315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6839/249825195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":249825195},{"type":"v1","addr":"172.21.15.57:6839","nonce":249825195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6839/1986600681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1986600681},{"type":"v1","addr":"172.21.15.107:6839","nonce":1986600681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24485,24464,24460,24466,24487]},"id":1}]} 2024-06-03T00:02:03.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.981+0000 7fa762010700 1 -- 172.21.15.49:0/1865297659 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa7440a2ca0 msgr2=0x7fa7440a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:03.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.981+0000 7fa762010700 1 --2- 172.21.15.49:0/1865297659 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa7440a2ca0 0x7fa7440a5160 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa75c199bc0 tx=0x7fa74c009260 comp rx=0 tx=0).stop 2024-06-03T00:02:03.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.981+0000 7fa762010700 1 -- 172.21.15.49:0/1865297659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa75c101d50 msgr2=0x7fa75c19ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:03.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.981+0000 7fa762010700 1 --2- 172.21.15.49:0/1865297659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa75c101d50 0x7fa75c19ee00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa75000e9f0 tx=0x7fa75000ed00 comp rx=0 tx=0).stop 2024-06-03T00:02:03.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.981+0000 7fa762010700 1 -- 172.21.15.49:0/1865297659 shutdown_connections 2024-06-03T00:02:03.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.981+0000 7fa762010700 1 --2- 172.21.15.49:0/1865297659 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa7440a2ca0 0x7fa7440a5160 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:03.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.981+0000 7fa762010700 1 --2- 172.21.15.49:0/1865297659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa75c107400 0x7fa75c198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:03.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.981+0000 7fa762010700 1 --2- 172.21.15.49:0/1865297659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa75c101390 0x7fa75c19e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:03.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.981+0000 7fa762010700 1 --2- 172.21.15.49:0/1865297659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa75c101d50 0x7fa75c19ee00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:03.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.982+0000 7fa762010700 1 -- 172.21.15.49:0/1865297659 >> 172.21.15.49:0/1865297659 conn(0x7fa75c078340 msgr2=0x7fa75c0ffe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:03.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.982+0000 7fa762010700 1 -- 172.21.15.49:0/1865297659 shutdown_connections 2024-06-03T00:02:03.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:03.982+0000 7fa762010700 1 -- 172.21.15.49:0/1865297659 wait complete. 2024-06-03T00:02:03.984 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 27 2024-06-03T00:02:04.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:04 smithi049 ceph-mon[32302]: pgmap v444: 97 pgs: 97 active+clean; 673 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 341 B/s wr, 10 op/s 2024-06-03T00:02:04.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:04 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/1865297659' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:02:04.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:04 smithi107 ceph-mon[37048]: pgmap v444: 97 pgs: 97 active+clean; 673 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 341 B/s wr, 10 op/s 2024-06-03T00:02:04.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:04 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/1865297659' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:02:04.949 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:04 smithi057 ceph-mon[36457]: pgmap v444: 97 pgs: 97 active+clean; 673 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 341 B/s wr, 10 op/s 2024-06-03T00:02:04.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:04 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/1865297659' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:02:06.787 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:06 smithi049 ceph-mon[32302]: pgmap v445: 97 pgs: 97 active+clean; 673 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 341 B/s wr, 10 op/s 2024-06-03T00:02:06.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:06 smithi107 ceph-mon[37048]: pgmap v445: 97 pgs: 97 active+clean; 673 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 341 B/s wr, 10 op/s 2024-06-03T00:02:06.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:06 smithi057 ceph-mon[36457]: pgmap v445: 97 pgs: 97 active+clean; 673 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 341 B/s wr, 10 op/s 2024-06-03T00:02:08.752 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:08 smithi057 ceph-mon[36457]: pgmap v446: 97 pgs: 97 active+clean; 673 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:02:08.848 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:08 smithi049 ceph-mon[32302]: pgmap v446: 97 pgs: 97 active+clean; 673 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:02:08.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:08 smithi107 ceph-mon[37048]: pgmap v446: 97 pgs: 97 active+clean; 673 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:02:08.888 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24487 quiesce db --set-id 5715c98c --release --await' 2024-06-03T00:02:08.888 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- timeout 105 ceph tell mds.24487 quiesce db --set-id 5715c98c --release --await 2024-06-03T00:02:09.278 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:02:10.133 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.129+0000 7f0fce9d5640 1 -- 172.21.15.49:0/932210578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fc81035c0 msgr2=0x7f0fc8109e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:10.133 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.129+0000 7f0fce9d5640 1 --2- 172.21.15.49:0/932210578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fc81035c0 0x7f0fc8109e50 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0009ca0 tx=0x7f0fc002a8c0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.133 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.129+0000 7f0fce9d5640 1 -- 172.21.15.49:0/932210578 shutdown_connections 2024-06-03T00:02:10.134 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.129+0000 7f0fce9d5640 1 --2- 172.21.15.49:0/932210578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fc8102c00 0x7f0fc8103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.134 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.129+0000 7f0fce9d5640 1 --2- 172.21.15.49:0/932210578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fc81035c0 0x7f0fc8109e50 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.134 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.129+0000 7f0fce9d5640 1 --2- 172.21.15.49:0/932210578 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0fc8101a10 0x7f0fc8101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.134 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.129+0000 7f0fce9d5640 1 -- 172.21.15.49:0/932210578 >> 172.21.15.49:0/932210578 conn(0x7f0fc80fcf80 msgr2=0x7f0fc80ff3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:10.134 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.129+0000 7f0fce9d5640 1 -- 172.21.15.49:0/932210578 shutdown_connections 2024-06-03T00:02:10.135 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.129+0000 7f0fce9d5640 1 -- 172.21.15.49:0/932210578 wait complete. 2024-06-03T00:02:10.135 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.130+0000 7f0fce9d5640 1 Processor -- start 2024-06-03T00:02:10.135 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.130+0000 7f0fce9d5640 1 -- start start 2024-06-03T00:02:10.135 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.130+0000 7f0fce9d5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fc8101a10 0x7f0fc8075750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:10.135 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.130+0000 7f0fce9d5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0fc8102c00 0x7f0fc8073d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:10.135 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.130+0000 7f0fce9d5640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fc81035c0 0x7f0fc80742d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:10.136 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.130+0000 7f0fce9d5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc810d700 con 0x7f0fc8101a10 2024-06-03T00:02:10.136 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.130+0000 7f0fce9d5640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc810d580 con 0x7f0fc81035c0 2024-06-03T00:02:10.136 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.130+0000 7f0fce9d5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc810d880 con 0x7f0fc8102c00 2024-06-03T00:02:10.136 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.130+0000 7f0fc7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fc8101a10 0x7f0fc8075750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:10.136 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.130+0000 7f0fc7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fc8101a10 0x7f0fc8075750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45614/0 (socket says 172.21.15.49:45614) 2024-06-03T00:02:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.130+0000 7f0fc7fff640 1 -- 172.21.15.49:0/1357419074 learned_addr learned my addr 172.21.15.49:0/1357419074 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.130+0000 7f0fc77fe640 1 --2- 172.21.15.49:0/1357419074 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0fc8102c00 0x7f0fc8073d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.131+0000 7f0fccf72640 1 --2- 172.21.15.49:0/1357419074 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fc81035c0 0x7f0fc80742d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.131+0000 7f0fc7fff640 1 -- 172.21.15.49:0/1357419074 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0fc8102c00 msgr2=0x7f0fc8073d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.131+0000 7f0fc7fff640 1 --2- 172.21.15.49:0/1357419074 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0fc8102c00 0x7f0fc8073d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.137 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.131+0000 7f0fc7fff640 1 -- 172.21.15.49:0/1357419074 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fc81035c0 msgr2=0x7f0fc80742d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:10.138 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.131+0000 7f0fc7fff640 1 --2- 172.21.15.49:0/1357419074 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fc81035c0 0x7f0fc80742d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.138 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.131+0000 7f0fc7fff640 1 -- 172.21.15.49:0/1357419074 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc8074b60 con 0x7f0fc8101a10 2024-06-03T00:02:10.138 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.131+0000 7f0fccf72640 1 --2- 172.21.15.49:0/1357419074 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fc81035c0 0x7f0fc80742d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:02:10.138 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.131+0000 7f0fc7fff640 1 --2- 172.21.15.49:0/1357419074 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fc8101a10 0x7f0fc8075750 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0fb800b450 tx=0x7f0fb800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:10.138 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.131+0000 7f0fc57fa640 1 -- 172.21.15.49:0/1357419074 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8015020 con 0x7f0fc8101a10 2024-06-03T00:02:10.138 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.131+0000 7f0fce9d5640 1 -- 172.21.15.49:0/1357419074 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fc81a1e50 con 0x7f0fc8101a10 2024-06-03T00:02:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.131+0000 7f0fc57fa640 1 -- 172.21.15.49:0/1357419074 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fb8011d70 con 0x7f0fc8101a10 2024-06-03T00:02:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.131+0000 7f0fc57fa640 1 -- 172.21.15.49:0/1357419074 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb800f340 con 0x7f0fc8101a10 2024-06-03T00:02:10.139 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.131+0000 7f0fce9d5640 1 -- 172.21.15.49:0/1357419074 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fc81a22b0 con 0x7f0fc8101a10 2024-06-03T00:02:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.134+0000 7f0fc57fa640 1 -- 172.21.15.49:0/1357419074 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0fb8018020 con 0x7f0fc8101a10 2024-06-03T00:02:10.152 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.135+0000 7f0fc57fa640 1 --2- 172.21.15.49:0/1357419074 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f0fb00a2cb0 0x7f0fb00a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:10.153 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.135+0000 7f0fc57fa640 1 -- 172.21.15.49:0/1357419074 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f0fb80ceae0 con 0x7f0fc8101a10 2024-06-03T00:02:10.153 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.135+0000 7f0fc77fe640 1 --2- 172.21.15.49:0/1357419074 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f0fb00a2cb0 0x7f0fb00a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:10.153 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.135+0000 7f0fd17bf740 1 Processor -- start 2024-06-03T00:02:10.153 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.135+0000 7f0fd17bf740 1 -- start start 2024-06-03T00:02:10.153 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.136+0000 7f0fc77fe640 1 --2- 172.21.15.49:0/1357419074 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f0fb00a2cb0 0x7f0fb00a5170 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0fc80754c0 tx=0x7f0fbc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:10.153 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.136+0000 7f0fd17bf740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bb87629010 0x55bb87629430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:10.154 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.136+0000 7f0fd17bf740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bb87629a00 0x55bb8762e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:10.154 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.136+0000 7f0fd17bf740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb8762eb70 0x55bb87631000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:10.154 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.136+0000 7f0fd17bf740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55bb8758c4f0 con 0x55bb8762eb70 2024-06-03T00:02:10.154 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.136+0000 7f0fd17bf740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55bb8752a870 con 0x55bb87629a00 2024-06-03T00:02:10.154 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.136+0000 7f0fd17bf740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55bb875884b0 con 0x55bb87629010 2024-06-03T00:02:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.136+0000 7f0fc77fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bb87629a00 0x55bb8762e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.136+0000 7f0fccf72640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb8762eb70 0x55bb87631000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.136+0000 7f0fc77fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bb87629a00 0x55bb8762e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.49:47474/0 (socket says 172.21.15.49:47474) 2024-06-03T00:02:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.136+0000 7f0fc77fe640 1 -- 172.21.15.49:0/1903785637 learned_addr learned my addr 172.21.15.49:0/1903785637 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.136+0000 7f0fc7fff640 1 --2- 172.21.15.49:0/1903785637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bb87629010 0x55bb87629430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:10.155 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.136+0000 7f0fccf72640 1 -- 172.21.15.49:0/1903785637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bb87629010 msgr2=0x55bb87629430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:10.156 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.136+0000 7f0fccf72640 1 --2- 172.21.15.49:0/1903785637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bb87629010 0x55bb87629430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.156 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.136+0000 7f0fccf72640 1 -- 172.21.15.49:0/1903785637 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bb87629a00 msgr2=0x55bb8762e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:10.156 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.136+0000 7f0fccf72640 1 --2- 172.21.15.49:0/1903785637 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bb87629a00 0x55bb8762e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.156 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.136+0000 7f0fccf72640 1 -- 172.21.15.49:0/1903785637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb875469b0 con 0x55bb8762eb70 2024-06-03T00:02:10.157 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.136+0000 7f0fc7fff640 1 --2- 172.21.15.49:0/1903785637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bb87629010 0x55bb87629430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:02:10.157 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.136+0000 7f0fc77fe640 1 --2- 172.21.15.49:0/1903785637 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bb87629a00 0x55bb8762e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:02:10.157 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.137+0000 7f0fccf72640 1 --2- 172.21.15.49:0/1903785637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb8762eb70 0x55bb87631000 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0006010 tx=0x7f0fc0009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6145668ea18c3cb6 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:10.157 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.137+0000 7f0fae7fc640 1 -- 172.21.15.49:0/1903785637 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc0003970 con 0x55bb8762eb70 2024-06-03T00:02:10.157 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.137+0000 7f0fae7fc640 1 -- 172.21.15.49:0/1903785637 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fc0036040 con 0x55bb8762eb70 2024-06-03T00:02:10.158 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.137+0000 7f0fae7fc640 1 -- 172.21.15.49:0/1903785637 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc00305c0 con 0x55bb8762eb70 2024-06-03T00:02:10.158 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.138+0000 7f0fd17bf740 1 -- 172.21.15.49:0/1903785637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb8762eb70 msgr2=0x55bb87631000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:10.158 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.138+0000 7f0fd17bf740 1 --2- 172.21.15.49:0/1903785637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb8762eb70 0x55bb87631000 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0006010 tx=0x7f0fc0009a20 comp rx=0 tx=0).stop 2024-06-03T00:02:10.158 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.138+0000 7f0fd17bf740 1 -- 172.21.15.49:0/1903785637 shutdown_connections 2024-06-03T00:02:10.158 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.138+0000 7f0fd17bf740 1 --2- 172.21.15.49:0/1903785637 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bb87629a00 0x55bb8762e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.158 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.138+0000 7f0fd17bf740 1 --2- 172.21.15.49:0/1903785637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb8762eb70 0x55bb87631000 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.159 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.138+0000 7f0fd17bf740 1 --2- 172.21.15.49:0/1903785637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bb87629010 0x55bb87629430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.159 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.138+0000 7f0fd17bf740 1 -- 172.21.15.49:0/1903785637 >> 172.21.15.49:0/1903785637 conn(0x55bb87624680 msgr2=0x55bb87624a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:10.159 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.138+0000 7f0fd17bf740 1 -- 172.21.15.49:0/1903785637 shutdown_connections 2024-06-03T00:02:10.159 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.138+0000 7f0fd17bf740 1 -- 172.21.15.49:0/1903785637 wait complete. 2024-06-03T00:02:10.159 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.139+0000 7f0fd17bf740 1 -- start start 2024-06-03T00:02:10.159 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.139+0000 7f0fd17bf740 1 Processor -- start 2024-06-03T00:02:10.160 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.139+0000 7f0fd17bf740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb87629010 0x55bb87633190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:10.160 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.139+0000 7f0fd17bf740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bb87629a00 0x55bb876336d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:10.160 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.139+0000 7f0fd17bf740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bb8762eb70 0x55bb8763a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:10.160 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.139+0000 7f0fd17bf740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55bb87631ac0 con 0x55bb87629010 2024-06-03T00:02:10.160 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.139+0000 7f0fd17bf740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55bb87515ae0 con 0x55bb87629a00 2024-06-03T00:02:10.160 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.139+0000 7f0fd17bf740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55bb87631c40 con 0x55bb8762eb70 2024-06-03T00:02:10.161 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.139+0000 7f0fd17bf740 10 client.0 _ll_register_callbacks cb 0x55bb8754e9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:02:10.161 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.139+0000 7f0fc7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb87629010 0x55bb87633190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:10.161 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.139+0000 7f0fc7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb87629010 0x55bb87633190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45632/0 (socket says 172.21.15.49:45632) 2024-06-03T00:02:10.161 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.139+0000 7f0fc7fff640 1 -- 172.21.15.49:0/2318441280 learned_addr learned my addr 172.21.15.49:0/2318441280 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:10.161 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.140+0000 7f0fc77fe640 1 --2- 172.21.15.49:0/2318441280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bb87629a00 0x55bb876336d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:10.161 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.140+0000 7f0fc7fff640 1 -- 172.21.15.49:0/2318441280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bb8762eb70 msgr2=0x55bb8763a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:10.162 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.140+0000 7f0fccf72640 1 --2- 172.21.15.49:0/2318441280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bb8762eb70 0x55bb8763a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:10.162 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.140+0000 7f0fc7fff640 1 --2- 172.21.15.49:0/2318441280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bb8762eb70 0x55bb8763a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.162 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.140+0000 7f0fc7fff640 1 -- 172.21.15.49:0/2318441280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bb87629a00 msgr2=0x55bb876336d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:10.162 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.140+0000 7f0fc7fff640 1 --2- 172.21.15.49:0/2318441280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bb87629a00 0x55bb876336d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.162 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.140+0000 7f0fc7fff640 1 -- 172.21.15.49:0/2318441280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb872a0210 con 0x55bb87629010 2024-06-03T00:02:10.162 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.140+0000 7f0fc77fe640 1 --2- 172.21.15.49:0/2318441280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bb87629a00 0x55bb876336d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:02:10.163 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.140+0000 7f0fccf72640 1 --2- 172.21.15.49:0/2318441280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bb8762eb70 0x55bb8763a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:02:10.163 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.140+0000 7f0fc7fff640 1 --2- 172.21.15.49:0/2318441280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb87629010 0x55bb87633190 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8009fd0 tx=0x7f0fb809ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23151b0ef0f2e4f9 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:10.163 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.140+0000 7f0fa77fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:02:10.163 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.140+0000 7f0fa77fe640 1 -- 172.21.15.49:0/2318441280 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb809f6b0 con 0x55bb87629010 2024-06-03T00:02:10.163 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.140+0000 7f0fa77fe640 1 -- 172.21.15.49:0/2318441280 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f0fb8010570 con 0x55bb87629010 2024-06-03T00:02:10.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.140+0000 7f0fd17bf740 1 -- 172.21.15.49:0/2318441280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0fc0036040 con 0x55bb87629010 2024-06-03T00:02:10.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.141+0000 7f0fa77fe640 1 -- 172.21.15.49:0/2318441280 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0fb80a3f70 con 0x55bb87629010 2024-06-03T00:02:10.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.141+0000 7f0fd17bf740 10 client.15720 fetch_fsmap learned FSMap version 27 2024-06-03T00:02:10.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.141+0000 7f0fd17bf740 1 -- 172.21.15.49:0/2318441280 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bb8736c620 con 0x55bb87629010 2024-06-03T00:02:10.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.141+0000 7f0fa77fe640 1 -- 172.21.15.49:0/2318441280 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fc0036040 con 0x55bb87629010 2024-06-03T00:02:10.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.141+0000 7f0fa77fe640 1 -- 172.21.15.49:0/2318441280 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f0fb8011990 con 0x55bb87629010 2024-06-03T00:02:10.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.141+0000 7f0fd17bf740 10 client.15720 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:02:10.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.141+0000 7f0fd17bf740 10 client.15720 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:02:10.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.141+0000 7f0fd17bf740 20 client.15720 populate_metadata read hostname 'smithi049' 2024-06-03T00:02:10.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.141+0000 7f0fd17bf740 1 --2- 172.21.15.49:0/2318441280 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55bb8763f010 0x55bb876414a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:10.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.141+0000 7f0fd17bf740 4 client.15720 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:02:10.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.141+0000 7f0fd17bf740 1 -- 172.21.15.49:0/2318441280 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb8759ff10 con 0x55bb8763f010 2024-06-03T00:02:10.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.142+0000 7f0fc77fe640 1 --2- 172.21.15.49:0/2318441280 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55bb8763f010 0x55bb876414a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:10.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.142+0000 7f0fc77fe640 1 --2- 172.21.15.49:0/2318441280 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55bb8763f010 0x55bb876414a0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0f2b83f3a753816 server_cookie=812493b78c2be98e in_seq=0 out_seq=0 2024-06-03T00:02:10.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.142+0000 7f0fa77fe640 10 client.15720 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:10.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.143+0000 7f0fa77fe640 1 -- 172.21.15.49:0/2318441280 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55bb8759ff10 con 0x55bb8763f010 2024-06-03T00:02:10.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.143+0000 7f0fa77fe640 10 client.15720 handle_command_reply: tid=0 2024-06-03T00:02:10.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.143+0000 7f0fd17bf740 1 client.15720 shutdown 2024-06-03T00:02:10.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.143+0000 7f0fd17bf740 1 -- 172.21.15.49:0/2318441280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb87629010 msgr2=0x55bb87633190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:10.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.143+0000 7f0fd17bf740 1 --2- 172.21.15.49:0/2318441280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb87629010 0x55bb87633190 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8009fd0 tx=0x7f0fb809ace0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.143+0000 7f0fd17bf740 1 -- 172.21.15.49:0/2318441280 shutdown_connections 2024-06-03T00:02:10.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.143+0000 7f0fd17bf740 1 --2- 172.21.15.49:0/2318441280 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55bb8763f010 0x55bb876414a0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.143+0000 7f0fd17bf740 1 --2- 172.21.15.49:0/2318441280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bb87629a00 0x55bb876336d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.168 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.143+0000 7f0fd17bf740 1 --2- 172.21.15.49:0/2318441280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bb8762eb70 0x55bb8763a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.168 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.143+0000 7f0fd17bf740 1 --2- 172.21.15.49:0/2318441280 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb87629010 0x55bb87633190 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.168 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.143+0000 7f0fd17bf740 1 -- 172.21.15.49:0/2318441280 >> 172.21.15.49:0/2318441280 conn(0x55bb87624680 msgr2=0x55bb876237e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:10.168 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.143+0000 7f0fa77fe640 0 client.15720 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:10.168 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.144+0000 7f0fd17bf740 1 -- 172.21.15.49:0/2318441280 shutdown_connections 2024-06-03T00:02:10.168 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.144+0000 7f0fd17bf740 1 -- 172.21.15.49:0/2318441280 wait complete. 2024-06-03T00:02:10.168 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.144+0000 7f0fd17bf740 20 client.15720 trim_cache size 0 max 16384 2024-06-03T00:02:10.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.174+0000 7f0fd17bf740 1 Processor -- start 2024-06-03T00:02:10.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.174+0000 7f0fd17bf740 1 -- start start 2024-06-03T00:02:10.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.174+0000 7f0fd17bf740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bb87629a00 0x55bb8762e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:10.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.174+0000 7f0fd17bf740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb8762eb70 0x55bb8763a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:10.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.174+0000 7f0fd17bf740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bb87627590 0x55bb87627a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:10.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.174+0000 7f0fc77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb8762eb70 0x55bb8763a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:10.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.174+0000 7f0fc77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb8762eb70 0x55bb8763a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45644/0 (socket says 172.21.15.49:45644) 2024-06-03T00:02:10.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.174+0000 7f0fd17bf740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc81ab230 con 0x55bb8762eb70 2024-06-03T00:02:10.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.174+0000 7f0fc77fe640 1 -- 172.21.15.49:0/1784630458 learned_addr learned my addr 172.21.15.49:0/1784630458 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:10.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.174+0000 7f0fd17bf740 1 -- 172.21.15.49:0/1784630458 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc81acd70 con 0x55bb87627590 2024-06-03T00:02:10.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.174+0000 7f0fd17bf740 1 -- 172.21.15.49:0/1784630458 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc81ab900 con 0x55bb87629a00 2024-06-03T00:02:10.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.174+0000 7f0fc7fff640 1 --2- 172.21.15.49:0/1784630458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bb87629a00 0x55bb8762e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:10.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.174+0000 7f0fccf72640 1 --2- 172.21.15.49:0/1784630458 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bb87627590 0x55bb87627a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:10.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.175+0000 7f0fc77fe640 1 -- 172.21.15.49:0/1784630458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bb87629a00 msgr2=0x55bb8762e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:10.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.175+0000 7f0fc77fe640 1 --2- 172.21.15.49:0/1784630458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bb87629a00 0x55bb8762e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.175+0000 7f0fc77fe640 1 -- 172.21.15.49:0/1784630458 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bb87627590 msgr2=0x55bb87627a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:10.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.175+0000 7f0fc77fe640 1 --2- 172.21.15.49:0/1784630458 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bb87627590 0x55bb87627a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.178 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.175+0000 7f0fc77fe640 1 -- 172.21.15.49:0/1784630458 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb876244b0 con 0x55bb8762eb70 2024-06-03T00:02:10.178 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.175+0000 7f0fc7fff640 1 --2- 172.21.15.49:0/1784630458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bb87629a00 0x55bb8762e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:02:10.178 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.175+0000 7f0fc77fe640 1 --2- 172.21.15.49:0/1784630458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb8762eb70 0x55bb8763a6d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc00ba20 tx=0x7f0fbc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef666ea99e408132 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:10.178 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.175+0000 7f0fadffb640 1 -- 172.21.15.49:0/1784630458 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc02e070 con 0x55bb8762eb70 2024-06-03T00:02:10.178 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.175+0000 7f0fadffb640 1 -- 172.21.15.49:0/1784630458 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fbc020600 con 0x55bb8762eb70 2024-06-03T00:02:10.178 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.175+0000 7f0fadffb640 1 -- 172.21.15.49:0/1784630458 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc028510 con 0x55bb8762eb70 2024-06-03T00:02:10.182 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.176+0000 7f0fd17bf740 1 -- 172.21.15.49:0/1784630458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb8762eb70 msgr2=0x55bb8763a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:10.182 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.176+0000 7f0fd17bf740 1 --2- 172.21.15.49:0/1784630458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb8762eb70 0x55bb8763a6d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc00ba20 tx=0x7f0fbc013000 comp rx=0 tx=0).stop 2024-06-03T00:02:10.182 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.176+0000 7f0fd17bf740 1 -- 172.21.15.49:0/1784630458 shutdown_connections 2024-06-03T00:02:10.182 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.176+0000 7f0fd17bf740 1 --2- 172.21.15.49:0/1784630458 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bb87627590 0x55bb87627a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.182 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.176+0000 7f0fd17bf740 1 --2- 172.21.15.49:0/1784630458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb8762eb70 0x55bb8763a6d0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.182 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.176+0000 7f0fd17bf740 1 --2- 172.21.15.49:0/1784630458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bb87629a00 0x55bb8762e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.182 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.176+0000 7f0fd17bf740 1 -- 172.21.15.49:0/1784630458 >> 172.21.15.49:0/1784630458 conn(0x55bb87624680 msgr2=0x55bb87624a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:10.182 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.176+0000 7f0fd17bf740 1 -- 172.21.15.49:0/1784630458 shutdown_connections 2024-06-03T00:02:10.182 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.176+0000 7f0fd17bf740 1 -- 172.21.15.49:0/1784630458 wait complete. 2024-06-03T00:02:10.182 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.177+0000 7f0fd17bf740 1 -- start start 2024-06-03T00:02:10.183 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.177+0000 7f0fd17bf740 1 Processor -- start 2024-06-03T00:02:10.183 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.177+0000 7f0fd17bf740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb87627590 0x55bb876374d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:10.183 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.177+0000 7f0fd17bf740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bb87629a00 0x55bb87637a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:10.183 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.177+0000 7f0fd17bf740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bb8762eb70 0x55bb876a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:10.183 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.178+0000 7f0fc7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb87627590 0x55bb876374d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:10.183 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.178+0000 7f0fc7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb87627590 0x55bb876374d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45648/0 (socket says 172.21.15.49:45648) 2024-06-03T00:02:10.183 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.178+0000 7f0fc7fff640 1 -- 172.21.15.49:0/1942401485 learned_addr learned my addr 172.21.15.49:0/1942401485 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:10.183 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.178+0000 7f0fd17bf740 1 -- 172.21.15.49:0/1942401485 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc81ac6a0 con 0x55bb87627590 2024-06-03T00:02:10.183 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.178+0000 7f0fd17bf740 1 -- 172.21.15.49:0/1942401485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc81abfd0 con 0x55bb87629a00 2024-06-03T00:02:10.183 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.178+0000 7f0fd17bf740 1 -- 172.21.15.49:0/1942401485 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc81a91f0 con 0x55bb8762eb70 2024-06-03T00:02:10.183 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.178+0000 7f0fc77fe640 1 --2- 172.21.15.49:0/1942401485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bb87629a00 0x55bb87637a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:10.183 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.178+0000 7f0fccf72640 1 --2- 172.21.15.49:0/1942401485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bb8762eb70 0x55bb876a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:10.183 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.178+0000 7f0fd17bf740 10 client.0 _ll_register_callbacks cb 0x7f0fb809b0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:02:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.178+0000 7f0fc7fff640 1 -- 172.21.15.49:0/1942401485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bb8762eb70 msgr2=0x55bb876a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.178+0000 7f0fc7fff640 1 --2- 172.21.15.49:0/1942401485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bb8762eb70 0x55bb876a7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.178+0000 7f0fc7fff640 1 -- 172.21.15.49:0/1942401485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bb87629a00 msgr2=0x55bb87637a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.178+0000 7f0fc7fff640 1 --2- 172.21.15.49:0/1942401485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bb87629a00 0x55bb87637a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.178+0000 7f0fc7fff640 1 -- 172.21.15.49:0/1942401485 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb876a82b0 con 0x55bb87627590 2024-06-03T00:02:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.178+0000 7f0fc77fe640 1 --2- 172.21.15.49:0/1942401485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bb87629a00 0x55bb87637a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:02:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.178+0000 7f0fc7fff640 1 --2- 172.21.15.49:0/1942401485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb87627590 0x55bb876374d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8097cd0 tx=0x7f0fb80047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b0942bfedd6df11 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.178+0000 7f0fa77fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:02:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.178+0000 7f0fa77fe640 1 -- 172.21.15.49:0/1942401485 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb807b030 con 0x55bb87627590 2024-06-03T00:02:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.178+0000 7f0fa77fe640 1 -- 172.21.15.49:0/1942401485 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f0fb80bb1f0 con 0x55bb87627590 2024-06-03T00:02:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.179+0000 7f0fd17bf740 1 -- 172.21.15.49:0/1942401485 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0fbc020600 con 0x55bb87627590 2024-06-03T00:02:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.179+0000 7f0fa77fe640 1 -- 172.21.15.49:0/1942401485 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0fb8065080 con 0x55bb87627590 2024-06-03T00:02:10.184 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.179+0000 7f0fd17bf740 10 client.15726 fetch_fsmap learned FSMap version 27 2024-06-03T00:02:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.179+0000 7f0fd17bf740 1 -- 172.21.15.49:0/1942401485 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bb876a9440 con 0x55bb87627590 2024-06-03T00:02:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.179+0000 7f0fa77fe640 1 -- 172.21.15.49:0/1942401485 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fbc020600 con 0x55bb87627590 2024-06-03T00:02:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.179+0000 7f0fa77fe640 1 -- 172.21.15.49:0/1942401485 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f0fb809f170 con 0x55bb87627590 2024-06-03T00:02:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.179+0000 7f0fd17bf740 10 client.15726 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:02:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.179+0000 7f0fd17bf740 10 client.15726 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:02:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.179+0000 7f0fd17bf740 20 client.15726 populate_metadata read hostname 'smithi049' 2024-06-03T00:02:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.179+0000 7f0fd17bf740 1 --2- 172.21.15.49:0/1942401485 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55bb876a9d90 0x55bb876ac1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.179+0000 7f0fd17bf740 4 client.15726 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-03T00:02:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.179+0000 7f0fd17bf740 1 -- 172.21.15.49:0/1942401485 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bb87599c20 con 0x55bb876a9d90 2024-06-03T00:02:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.180+0000 7f0fc77fe640 1 --2- 172.21.15.49:0/1942401485 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55bb876a9d90 0x55bb876ac1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.180+0000 7f0fa77fe640 10 client.15726 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:10.185 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.180+0000 7f0fc77fe640 1 --2- 172.21.15.49:0/1942401485 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55bb876a9d90 0x55bb876ac1b0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90962aeea362d44b server_cookie=a7849cfa48ac0749 in_seq=0 out_seq=0 2024-06-03T00:02:10.186 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.184+0000 7f0fa77fe640 1 -- 172.21.15.49:0/1942401485 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55bb87599c20 con 0x55bb876a9d90 2024-06-03T00:02:10.186 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.184+0000 7f0fa77fe640 10 client.15726 handle_command_reply: tid=0 2024-06-03T00:02:10.186 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.184+0000 7f0fd17bf740 1 client.15726 shutdown 2024-06-03T00:02:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.184+0000 7f0fd17bf740 1 -- 172.21.15.49:0/1942401485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb87627590 msgr2=0x55bb876374d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.184+0000 7f0fd17bf740 1 --2- 172.21.15.49:0/1942401485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb87627590 0x55bb876374d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8097cd0 tx=0x7f0fb80047d0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.184+0000 7f0fd17bf740 1 -- 172.21.15.49:0/1942401485 shutdown_connections 2024-06-03T00:02:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.184+0000 7f0fd17bf740 1 --2- 172.21.15.49:0/1942401485 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55bb876a9d90 0x55bb876ac1b0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.184+0000 7f0fd17bf740 1 --2- 172.21.15.49:0/1942401485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bb87629a00 0x55bb87637a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.184+0000 7f0fd17bf740 1 --2- 172.21.15.49:0/1942401485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bb8762eb70 0x55bb876a7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.184+0000 7f0fd17bf740 1 --2- 172.21.15.49:0/1942401485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bb87627590 0x55bb876374d0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.184+0000 7f0fd17bf740 1 -- 172.21.15.49:0/1942401485 >> 172.21.15.49:0/1942401485 conn(0x55bb87624680 msgr2=0x55bb8762e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.184+0000 7f0fa77fe640 0 client.15726 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.184+0000 7f0fd17bf740 1 -- 172.21.15.49:0/1942401485 shutdown_connections 2024-06-03T00:02:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.184+0000 7f0fd17bf740 1 -- 172.21.15.49:0/1942401485 wait complete. 2024-06-03T00:02:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.184+0000 7f0fd17bf740 20 client.15726 trim_cache size 0 max 16384 2024-06-03T00:02:10.188 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-06-03T00:02:10.188 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-06-03T00:02:10.188 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-06-03T00:02:10.188 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.185+0000 7f0fce9d5640 1 -- 172.21.15.49:0/1357419074 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f0fb00a2cb0 msgr2=0x7f0fb00a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:10.188 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.185+0000 7f0fce9d5640 1 --2- 172.21.15.49:0/1357419074 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f0fb00a2cb0 0x7f0fb00a5170 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0fc80754c0 tx=0x7f0fbc00b410 comp rx=0 tx=0).stop 2024-06-03T00:02:10.189 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.185+0000 7f0fce9d5640 1 -- 172.21.15.49:0/1357419074 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fc8101a10 msgr2=0x7f0fc8075750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:10.189 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.185+0000 7f0fce9d5640 1 --2- 172.21.15.49:0/1357419074 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fc8101a10 0x7f0fc8075750 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0fb800b450 tx=0x7f0fb800b910 comp rx=0 tx=0).stop 2024-06-03T00:02:10.189 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.185+0000 7f0fce9d5640 1 -- 172.21.15.49:0/1357419074 shutdown_connections 2024-06-03T00:02:10.189 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.185+0000 7f0fce9d5640 1 --2- 172.21.15.49:0/1357419074 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f0fb00a2cb0 0x7f0fb00a5170 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.189 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.185+0000 7f0fce9d5640 1 --2- 172.21.15.49:0/1357419074 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fc81035c0 0x7f0fc80742d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.189 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.185+0000 7f0fce9d5640 1 --2- 172.21.15.49:0/1357419074 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0fc8102c00 0x7f0fc8073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.189 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.185+0000 7f0fce9d5640 1 --2- 172.21.15.49:0/1357419074 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fc8101a10 0x7f0fc8075750 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:10.189 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.185+0000 7f0fce9d5640 1 -- 172.21.15.49:0/1357419074 >> 172.21.15.49:0/1357419074 conn(0x7f0fc80fcf80 msgr2=0x7f0fc8105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:10.189 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.185+0000 7f0fce9d5640 1 -- 172.21.15.49:0/1357419074 shutdown_connections 2024-06-03T00:02:10.189 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:10.185+0000 7f0fce9d5640 1 -- 172.21.15.49:0/1357419074 wait complete. 2024-06-03T00:02:10.697 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:10 smithi049 ceph-mon[32302]: pgmap v447: 97 pgs: 97 active+clean; 673 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 0 B/s wr, 10 op/s 2024-06-03T00:02:10.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:10 smithi107 ceph-mon[37048]: pgmap v447: 97 pgs: 97 active+clean; 673 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 0 B/s wr, 10 op/s 2024-06-03T00:02:10.949 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:10 smithi057 ceph-mon[36457]: pgmap v447: 97 pgs: 97 active+clean; 673 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 0 B/s wr, 10 op/s 2024-06-03T00:02:11.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.094+0000 7ff6877ab700 1 -- 172.21.15.49:0/4027522947 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff680101380 msgr2=0x7ff680101800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:11.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.094+0000 7ff6877ab700 1 --2- 172.21.15.49:0/4027522947 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff680101380 0x7ff680101800 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ff670009990 tx=0x7ff670009ca0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.094+0000 7ff6877ab700 1 -- 172.21.15.49:0/4027522947 shutdown_connections 2024-06-03T00:02:11.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.094+0000 7ff6877ab700 1 --2- 172.21.15.49:0/4027522947 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff680101d40 0x7ff68010e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.094+0000 7ff6877ab700 1 --2- 172.21.15.49:0/4027522947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6801073f0 0x7ff6801077d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.094+0000 7ff6877ab700 1 --2- 172.21.15.49:0/4027522947 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff680101380 0x7ff680101800 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.094+0000 7ff6877ab700 1 -- 172.21.15.49:0/4027522947 >> 172.21.15.49:0/4027522947 conn(0x7ff680078300 msgr2=0x7ff680078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:11.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.094+0000 7ff6877ab700 1 -- 172.21.15.49:0/4027522947 shutdown_connections 2024-06-03T00:02:11.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.094+0000 7ff6877ab700 1 -- 172.21.15.49:0/4027522947 wait complete. 2024-06-03T00:02:11.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.095+0000 7ff6877ab700 1 Processor -- start 2024-06-03T00:02:11.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.095+0000 7ff6877ab700 1 -- start start 2024-06-03T00:02:11.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.095+0000 7ff6877ab700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff680101380 0x7ff68010a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:11.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.095+0000 7ff6877ab700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff680101d40 0x7ff68010aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:11.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.095+0000 7ff684d46700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff680101d40 0x7ff68010aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:11.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.095+0000 7ff684d46700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff680101d40 0x7ff68010aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45658/0 (socket says 172.21.15.49:45658) 2024-06-03T00:02:11.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.095+0000 7ff684d46700 1 -- 172.21.15.49:0/3134835461 learned_addr learned my addr 172.21.15.49:0/3134835461 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:11.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.095+0000 7ff6877ab700 1 --2- 172.21.15.49:0/3134835461 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6801073f0 0x7ff68010af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:11.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.095+0000 7ff685547700 1 --2- 172.21.15.49:0/3134835461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff680101380 0x7ff68010a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:11.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.095+0000 7ff6877ab700 1 -- 172.21.15.49:0/3134835461 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff68010f990 con 0x7ff680101d40 2024-06-03T00:02:11.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.095+0000 7ff6877ab700 1 -- 172.21.15.49:0/3134835461 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff68010f810 con 0x7ff6801073f0 2024-06-03T00:02:11.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.095+0000 7ff6877ab700 1 -- 172.21.15.49:0/3134835461 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff68010fb10 con 0x7ff680101380 2024-06-03T00:02:11.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.096+0000 7ff684d46700 1 -- 172.21.15.49:0/3134835461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff680101380 msgr2=0x7ff68010a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:11.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.096+0000 7ff684d46700 1 --2- 172.21.15.49:0/3134835461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff680101380 0x7ff68010a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.096+0000 7ff684d46700 1 -- 172.21.15.49:0/3134835461 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6801073f0 msgr2=0x7ff68010af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:11.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.096+0000 7ff684d46700 1 --2- 172.21.15.49:0/3134835461 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6801073f0 0x7ff68010af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.096+0000 7ff684d46700 1 -- 172.21.15.49:0/3134835461 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6801ab490 con 0x7ff680101d40 2024-06-03T00:02:11.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.096+0000 7ff684d46700 1 --2- 172.21.15.49:0/3134835461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff680101d40 0x7ff68010aa00 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff670000c00 tx=0x7ff67000bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:11.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.096+0000 7ff6767fc700 1 -- 172.21.15.49:0/3134835461 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff670027070 con 0x7ff680101d40 2024-06-03T00:02:11.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.096+0000 7ff6767fc700 1 -- 172.21.15.49:0/3134835461 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff670003d70 con 0x7ff680101d40 2024-06-03T00:02:11.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.096+0000 7ff6877ab700 1 -- 172.21.15.49:0/3134835461 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6801ab720 con 0x7ff680101d40 2024-06-03T00:02:11.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.097+0000 7ff6767fc700 1 -- 172.21.15.49:0/3134835461 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67000f460 con 0x7ff680101d40 2024-06-03T00:02:11.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.097+0000 7ff6877ab700 1 -- 172.21.15.49:0/3134835461 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6801abac0 con 0x7ff680101d40 2024-06-03T00:02:11.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.100+0000 7ff6767fc700 1 -- 172.21.15.49:0/3134835461 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff67002a070 con 0x7ff680101d40 2024-06-03T00:02:11.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.101+0000 7ff69202eb80 1 Processor -- start 2024-06-03T00:02:11.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.101+0000 7ff6767fc700 1 --2- 172.21.15.49:0/3134835461 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff66c0a2ca0 0x7ff66c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:11.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.101+0000 7ff69202eb80 1 -- start start 2024-06-03T00:02:11.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.102+0000 7ff6767fc700 1 -- 172.21.15.49:0/3134835461 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7ff6700cfca0 con 0x7ff680101d40 2024-06-03T00:02:11.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.102+0000 7ff69202eb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606a3185c40 0x5606a3186020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:11.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.102+0000 7ff69202eb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5606a3186560 0x5606a317fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:11.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.102+0000 7ff69202eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5606a31803d0 0x5606a3180810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:11.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.102+0000 7ff69202eb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5606a30d1910 con 0x5606a3185c40 2024-06-03T00:02:11.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.102+0000 7ff69202eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5606a3079820 con 0x5606a31803d0 2024-06-03T00:02:11.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.102+0000 7ff69202eb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5606a30cd8d0 con 0x5606a3186560 2024-06-03T00:02:11.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.102+0000 7ff685d48700 1 --2- 172.21.15.49:0/3134835461 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff66c0a2ca0 0x7ff66c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:11.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.102+0000 7ff685d48700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5606a31803d0 0x5606a3180810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:11.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.102+0000 7ff685d48700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5606a31803d0 0x5606a3180810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.49:47516/0 (socket says 172.21.15.49:47516) 2024-06-03T00:02:11.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.102+0000 7ff685d48700 1 -- 172.21.15.49:0/68182397 learned_addr learned my addr 172.21.15.49:0/68182397 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:11.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.102+0000 7ff684d46700 1 --2- 172.21.15.49:0/68182397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5606a3186560 0x5606a317fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:11.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.102+0000 7ff685547700 1 --2- 172.21.15.49:0/68182397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606a3185c40 0x5606a3186020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:11.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.103+0000 7ff685d48700 1 --2- 172.21.15.49:0/3134835461 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff66c0a2ca0 0x7ff66c0a5160 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff678010890 tx=0x7ff678009e10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:11.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.103+0000 7ff684d46700 1 -- 172.21.15.49:0/68182397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5606a31803d0 msgr2=0x5606a3180810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:11.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.103+0000 7ff684d46700 1 --2- 172.21.15.49:0/68182397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5606a31803d0 0x5606a3180810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.103+0000 7ff684d46700 1 -- 172.21.15.49:0/68182397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606a3185c40 msgr2=0x5606a3186020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:11.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.103+0000 7ff684d46700 1 --2- 172.21.15.49:0/68182397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606a3185c40 0x5606a3186020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.103+0000 7ff684d46700 1 -- 172.21.15.49:0/68182397 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606a3070050 con 0x5606a3186560 2024-06-03T00:02:11.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.103+0000 7ff685547700 1 --2- 172.21.15.49:0/68182397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606a3185c40 0x5606a3186020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:02:11.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.103+0000 7ff684d46700 1 --2- 172.21.15.49:0/68182397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5606a3186560 0x5606a317fe90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff67009c290 tx=0x7ff670009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1632f0387bd24a8 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:11.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.103+0000 7ff66b7fe700 1 -- 172.21.15.49:0/68182397 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67009bef0 con 0x5606a3186560 2024-06-03T00:02:11.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.104+0000 7ff66b7fe700 1 -- 172.21.15.49:0/68182397 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6700043d0 con 0x5606a3186560 2024-06-03T00:02:11.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.104+0000 7ff66b7fe700 1 -- 172.21.15.49:0/68182397 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67009a890 con 0x5606a3186560 2024-06-03T00:02:11.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.105+0000 7ff69202eb80 1 -- 172.21.15.49:0/68182397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5606a3186560 msgr2=0x5606a317fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:11.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.105+0000 7ff69202eb80 1 --2- 172.21.15.49:0/68182397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5606a3186560 0x5606a317fe90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff67009c290 tx=0x7ff670009310 comp rx=0 tx=0).stop 2024-06-03T00:02:11.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.105+0000 7ff69202eb80 1 -- 172.21.15.49:0/68182397 shutdown_connections 2024-06-03T00:02:11.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.105+0000 7ff69202eb80 1 --2- 172.21.15.49:0/68182397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5606a31803d0 0x5606a3180810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.105+0000 7ff69202eb80 1 --2- 172.21.15.49:0/68182397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606a3185c40 0x5606a3186020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.105+0000 7ff69202eb80 1 --2- 172.21.15.49:0/68182397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5606a3186560 0x5606a317fe90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.105+0000 7ff69202eb80 1 -- 172.21.15.49:0/68182397 >> 172.21.15.49:0/68182397 conn(0x5606a30aadc0 msgr2=0x5606a317b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:11.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.105+0000 7ff69202eb80 1 -- 172.21.15.49:0/68182397 shutdown_connections 2024-06-03T00:02:11.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.105+0000 7ff69202eb80 1 -- 172.21.15.49:0/68182397 wait complete. 2024-06-03T00:02:11.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.106+0000 7ff69202eb80 1 -- start start 2024-06-03T00:02:11.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.106+0000 7ff69202eb80 1 Processor -- start 2024-06-03T00:02:11.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.106+0000 7ff69202eb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5606a31803d0 0x5606a318c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:11.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.106+0000 7ff69202eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5606a3185c40 0x5606a31895f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:11.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.106+0000 7ff69202eb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606a3186560 0x5606a3189b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:11.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.107+0000 7ff685d48700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606a3186560 0x5606a3189b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:11.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.107+0000 7ff685547700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5606a31803d0 0x5606a318c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:11.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.107+0000 7ff685d48700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606a3186560 0x5606a3189b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45676/0 (socket says 172.21.15.49:45676) 2024-06-03T00:02:11.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.107+0000 7ff685d48700 1 -- 172.21.15.49:0/3311428433 learned_addr learned my addr 172.21.15.49:0/3311428433 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:11.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.107+0000 7ff685547700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5606a31803d0 0x5606a318c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:59084/0 (socket says 172.21.15.49:59084) 2024-06-03T00:02:11.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.107+0000 7ff69202eb80 1 -- 172.21.15.49:0/3311428433 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5606a318ccf0 con 0x5606a3186560 2024-06-03T00:02:11.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.107+0000 7ff69202eb80 1 -- 172.21.15.49:0/3311428433 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5606a3071cf0 con 0x5606a3185c40 2024-06-03T00:02:11.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.107+0000 7ff69202eb80 1 -- 172.21.15.49:0/3311428433 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5606a318ce70 con 0x5606a31803d0 2024-06-03T00:02:11.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.107+0000 7ff685d48700 1 -- 172.21.15.49:0/3311428433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5606a31803d0 msgr2=0x5606a318c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:11.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.107+0000 7ff685d48700 1 --2- 172.21.15.49:0/3311428433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5606a31803d0 0x5606a318c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.107+0000 7ff685d48700 1 -- 172.21.15.49:0/3311428433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5606a3185c40 msgr2=0x5606a31895f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:11.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.107+0000 7ff685d48700 1 --2- 172.21.15.49:0/3311428433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5606a3185c40 0x5606a31895f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.107+0000 7ff685d48700 1 -- 172.21.15.49:0/3311428433 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606a30209d0 con 0x5606a3186560 2024-06-03T00:02:11.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.107+0000 7ff69202eb80 10 client.0 _ll_register_callbacks cb 0x5606a306ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:02:11.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.107+0000 7ff685d48700 1 --2- 172.21.15.49:0/3311428433 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606a3186560 0x5606a3189b30 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff678010330 tx=0x7ff678009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea91c46de5aad48b server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:11.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.107+0000 7ff69202eb80 1 -- 172.21.15.49:0/3311428433 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6700043d0 con 0x5606a3186560 2024-06-03T00:02:11.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.107+0000 7ff668ff9700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:02:11.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.108+0000 7ff668ff9700 1 -- 172.21.15.49:0/3311428433 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff678018c10 con 0x5606a3186560 2024-06-03T00:02:11.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.108+0000 7ff668ff9700 1 -- 172.21.15.49:0/3311428433 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7ff678018db0 con 0x5606a3186560 2024-06-03T00:02:11.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.108+0000 7ff668ff9700 1 -- 172.21.15.49:0/3311428433 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff67802e450 con 0x5606a3186560 2024-06-03T00:02:11.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.108+0000 7ff69202eb80 10 client.15738 fetch_fsmap learned FSMap version 27 2024-06-03T00:02:11.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.108+0000 7ff69202eb80 1 -- 172.21.15.49:0/3311428433 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({fsmap=27}) -- 0x5606a31974f0 con 0x5606a3186560 2024-06-03T00:02:11.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.108+0000 7ff668ff9700 1 -- 172.21.15.49:0/3311428433 <== mon.0 v2:172.21.15.49:3300/0 4 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ff678024410 con 0x5606a3186560 2024-06-03T00:02:11.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.109+0000 7ff69202eb80 10 client.15738 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:02:11.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.109+0000 7ff69202eb80 10 client.15738 resolve_mds: validated gid 24487 aka daemon mds.i 2024-06-03T00:02:11.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.109+0000 7ff69202eb80 20 client.15738 populate_metadata read hostname 'smithi049' 2024-06-03T00:02:11.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.109+0000 7ff69202eb80 1 --2- 172.21.15.49:0/3311428433 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5606a3199df0 0x5606a319c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:11.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.109+0000 7ff69202eb80 4 client.15738 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:02:11.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.109+0000 7ff69202eb80 1 -- 172.21.15.49:0/3311428433 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606a30dee10 con 0x5606a3199df0 2024-06-03T00:02:11.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.109+0000 7ff685547700 1 --2- 172.21.15.49:0/3311428433 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5606a3199df0 0x5606a319c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:11.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.110+0000 7ff668ff9700 10 client.15738 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:11.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.110+0000 7ff685547700 1 --2- 172.21.15.49:0/3311428433 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5606a3199df0 0x5606a319c290 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c0a3fc179982980 server_cookie=d10992d552eb1920 in_seq=0 out_seq=0 2024-06-03T00:02:11.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.110+0000 7ff668ff9700 1 -- 172.21.15.49:0/3311428433 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5606a30dee10 con 0x5606a3199df0 2024-06-03T00:02:11.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.110+0000 7ff668ff9700 10 client.15738 handle_command_reply: tid=0 2024-06-03T00:02:11.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.110+0000 7ff69202eb80 1 client.15738 shutdown 2024-06-03T00:02:11.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.111+0000 7ff69202eb80 1 -- 172.21.15.49:0/3311428433 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606a3186560 msgr2=0x5606a3189b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:11.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.111+0000 7ff69202eb80 1 --2- 172.21.15.49:0/3311428433 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606a3186560 0x5606a3189b30 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff678010330 tx=0x7ff678009920 comp rx=0 tx=0).stop 2024-06-03T00:02:11.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.111+0000 7ff69202eb80 1 -- 172.21.15.49:0/3311428433 shutdown_connections 2024-06-03T00:02:11.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.111+0000 7ff69202eb80 1 --2- 172.21.15.49:0/3311428433 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5606a3199df0 0x5606a319c290 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.111+0000 7ff69202eb80 1 --2- 172.21.15.49:0/3311428433 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606a3186560 0x5606a3189b30 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.111+0000 7ff69202eb80 1 --2- 172.21.15.49:0/3311428433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5606a31803d0 0x5606a318c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.111+0000 7ff69202eb80 1 --2- 172.21.15.49:0/3311428433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5606a3185c40 0x5606a31895f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.111+0000 7ff69202eb80 1 -- 172.21.15.49:0/3311428433 >> 172.21.15.49:0/3311428433 conn(0x5606a30aadc0 msgr2=0x5606a317ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:11.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.111+0000 7ff668ff9700 0 client.15738 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:11.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.111+0000 7ff69202eb80 1 -- 172.21.15.49:0/3311428433 shutdown_connections 2024-06-03T00:02:11.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.111+0000 7ff69202eb80 1 -- 172.21.15.49:0/3311428433 wait complete. 2024-06-03T00:02:11.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.111+0000 7ff69202eb80 20 client.15738 trim_cache size 0 max 16384 2024-06-03T00:02:11.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.146+0000 7ff69202eb80 1 Processor -- start 2024-06-03T00:02:11.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.146+0000 7ff69202eb80 1 -- start start 2024-06-03T00:02:11.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.146+0000 7ff69202eb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5606a31803d0 0x5606a3187f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:11.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.146+0000 7ff69202eb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606a3185c40 0x5606a3188440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:11.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.146+0000 7ff69202eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5606a3186560 0x5606a31895b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:11.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.146+0000 7ff69202eb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff6801b3280 con 0x5606a3185c40 2024-06-03T00:02:11.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.146+0000 7ff69202eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff6801b4dc0 con 0x5606a3186560 2024-06-03T00:02:11.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.146+0000 7ff69202eb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff6801b3950 con 0x5606a31803d0 2024-06-03T00:02:11.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.146+0000 7ff684d46700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606a3185c40 0x5606a3188440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:11.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.146+0000 7ff684d46700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606a3185c40 0x5606a3188440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45680/0 (socket says 172.21.15.49:45680) 2024-06-03T00:02:11.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.146+0000 7ff684d46700 1 -- 172.21.15.49:0/1570026275 learned_addr learned my addr 172.21.15.49:0/1570026275 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:11.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.146+0000 7ff685547700 1 --2- 172.21.15.49:0/1570026275 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5606a31803d0 0x5606a3187f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:11.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.147+0000 7ff685d48700 1 --2- 172.21.15.49:0/1570026275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5606a3186560 0x5606a31895b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:11.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.147+0000 7ff684d46700 1 -- 172.21.15.49:0/1570026275 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5606a31803d0 msgr2=0x5606a3187f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:11.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.147+0000 7ff684d46700 1 --2- 172.21.15.49:0/1570026275 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5606a31803d0 0x5606a3187f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.147+0000 7ff684d46700 1 -- 172.21.15.49:0/1570026275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5606a3186560 msgr2=0x5606a31895b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:11.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.147+0000 7ff684d46700 1 --2- 172.21.15.49:0/1570026275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5606a3186560 0x5606a31895b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.147+0000 7ff684d46700 1 -- 172.21.15.49:0/1570026275 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606a317c4b0 con 0x5606a3185c40 2024-06-03T00:02:11.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.147+0000 7ff684d46700 1 --2- 172.21.15.49:0/1570026275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606a3185c40 0x5606a3188440 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff670029000 tx=0x7ff67000bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8d52fb265216c9 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:11.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.147+0000 7ff66affd700 1 -- 172.21.15.49:0/1570026275 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6700b4070 con 0x5606a3185c40 2024-06-03T00:02:11.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.147+0000 7ff66affd700 1 -- 172.21.15.49:0/1570026275 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff67009c590 con 0x5606a3185c40 2024-06-03T00:02:11.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.147+0000 7ff66affd700 1 -- 172.21.15.49:0/1570026275 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6700a4ce0 con 0x5606a3185c40 2024-06-03T00:02:11.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.148+0000 7ff69202eb80 1 -- 172.21.15.49:0/1570026275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606a3185c40 msgr2=0x5606a3188440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:11.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.148+0000 7ff69202eb80 1 --2- 172.21.15.49:0/1570026275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606a3185c40 0x5606a3188440 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff670029000 tx=0x7ff67000bfa0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.148+0000 7ff69202eb80 1 -- 172.21.15.49:0/1570026275 shutdown_connections 2024-06-03T00:02:11.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.148+0000 7ff69202eb80 1 --2- 172.21.15.49:0/1570026275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5606a3186560 0x5606a31895b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.148+0000 7ff69202eb80 1 --2- 172.21.15.49:0/1570026275 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5606a31803d0 0x5606a3187f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.148+0000 7ff69202eb80 1 --2- 172.21.15.49:0/1570026275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606a3185c40 0x5606a3188440 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.148+0000 7ff69202eb80 1 -- 172.21.15.49:0/1570026275 >> 172.21.15.49:0/1570026275 conn(0x5606a30aadc0 msgr2=0x5606a319be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:11.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.149+0000 7ff69202eb80 1 -- 172.21.15.49:0/1570026275 shutdown_connections 2024-06-03T00:02:11.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.149+0000 7ff69202eb80 1 -- 172.21.15.49:0/1570026275 wait complete. 2024-06-03T00:02:11.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.149+0000 7ff69202eb80 1 -- start start 2024-06-03T00:02:11.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.149+0000 7ff69202eb80 1 Processor -- start 2024-06-03T00:02:11.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.150+0000 7ff69202eb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606a31803d0 0x5606a3192610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:11.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.150+0000 7ff69202eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5606a3186560 0x5606a318f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:11.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.150+0000 7ff69202eb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5606a318f610 0x5606a318fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:11.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.150+0000 7ff69202eb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff6801b46f0 con 0x5606a31803d0 2024-06-03T00:02:11.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.150+0000 7ff69202eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff6801b4020 con 0x5606a3186560 2024-06-03T00:02:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.150+0000 7ff69202eb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff6801b1200 con 0x5606a318f610 2024-06-03T00:02:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.150+0000 7ff69202eb80 10 client.0 _ll_register_callbacks cb 0x5606a306ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:02:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.150+0000 7ff685547700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606a31803d0 0x5606a3192610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.150+0000 7ff685d48700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5606a318f610 0x5606a318fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.150+0000 7ff685d48700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5606a318f610 0x5606a318fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:59100/0 (socket says 172.21.15.49:59100) 2024-06-03T00:02:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.150+0000 7ff685d48700 1 -- 172.21.15.49:0/4004696658 learned_addr learned my addr 172.21.15.49:0/4004696658 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.151+0000 7ff684d46700 1 --2- 172.21.15.49:0/4004696658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5606a3186560 0x5606a318f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.151+0000 7ff685d48700 1 -- 172.21.15.49:0/4004696658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5606a3186560 msgr2=0x5606a318f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.151+0000 7ff685d48700 1 --2- 172.21.15.49:0/4004696658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5606a3186560 0x5606a318f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.151+0000 7ff685d48700 1 -- 172.21.15.49:0/4004696658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606a31803d0 msgr2=0x5606a3192610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.151+0000 7ff685d48700 1 --2- 172.21.15.49:0/4004696658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606a31803d0 0x5606a3192610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.151+0000 7ff685d48700 1 -- 172.21.15.49:0/4004696658 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606a3204b80 con 0x5606a318f610 2024-06-03T00:02:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.151+0000 7ff685547700 1 --2- 172.21.15.49:0/4004696658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606a31803d0 0x5606a3192610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:02:11.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.151+0000 7ff685d48700 1 --2- 172.21.15.49:0/4004696658 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5606a318f610 0x5606a318fa90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff678010330 tx=0x7ff67801d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d31b61040891fcf server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:11.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.151+0000 7ff668ff9700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-06-03T00:02:11.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.151+0000 7ff668ff9700 1 -- 172.21.15.49:0/4004696658 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67803e060 con 0x5606a318f610 2024-06-03T00:02:11.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.151+0000 7ff668ff9700 1 -- 172.21.15.49:0/4004696658 <== mon.1 v2:172.21.15.107:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7ff678024070 con 0x5606a318f610 2024-06-03T00:02:11.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.151+0000 7ff69202eb80 1 -- 172.21.15.49:0/4004696658 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5606a30d9390 con 0x5606a318f610 2024-06-03T00:02:11.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.152+0000 7ff668ff9700 1 -- 172.21.15.49:0/4004696658 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff678018e20 con 0x5606a318f610 2024-06-03T00:02:11.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.152+0000 7ff69202eb80 10 client.25357 fetch_fsmap learned FSMap version 27 2024-06-03T00:02:11.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.152+0000 7ff69202eb80 1 -- 172.21.15.49:0/4004696658 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5606a3205d00 con 0x5606a318f610 2024-06-03T00:02:11.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.152+0000 7ff668ff9700 1 -- 172.21.15.49:0/4004696658 <== mon.1 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5606a30d9390 con 0x5606a318f610 2024-06-03T00:02:11.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.153+0000 7ff668ff9700 1 -- 172.21.15.49:0/4004696658 <== mon.1 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ff67802ec70 con 0x5606a318f610 2024-06-03T00:02:11.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.153+0000 7ff69202eb80 10 client.25357 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:02:11.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.153+0000 7ff69202eb80 10 client.25357 resolve_mds: validated gid 24487 aka daemon mds.i 2024-06-03T00:02:11.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.153+0000 7ff69202eb80 20 client.25357 populate_metadata read hostname 'smithi049' 2024-06-03T00:02:11.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.153+0000 7ff69202eb80 1 --2- 172.21.15.49:0/4004696658 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5606a32063c0 0x5606a32087e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:11.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.153+0000 7ff69202eb80 4 client.25357 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "5715c98c", "release": true, "await": true}] 2024-06-03T00:02:11.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.153+0000 7ff69202eb80 1 -- 172.21.15.49:0/4004696658 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "quiesce db", "set_id": "5715c98c", "release": true, "await": true}) -- 0x5606a2f53350 con 0x5606a32063c0 2024-06-03T00:02:11.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.154+0000 7ff685547700 1 --2- 172.21.15.49:0/4004696658 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5606a32063c0 0x5606a32087e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:11.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.154+0000 7ff685547700 1 --2- 172.21.15.49:0/4004696658 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5606a32063c0 0x5606a32087e0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e46757ece80619b server_cookie=51dea0b496982c40 in_seq=0 out_seq=0 2024-06-03T00:02:11.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.154+0000 7ff668ff9700 10 client.25357 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:11.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.156+0000 7ff668ff9700 1 -- 172.21.15.49:0/4004696658 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5606a2f53350 con 0x5606a32063c0 2024-06-03T00:02:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.156+0000 7ff668ff9700 10 client.25357 handle_command_reply: tid=0 2024-06-03T00:02:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.156+0000 7ff69202eb80 1 client.25357 shutdown 2024-06-03T00:02:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.156+0000 7ff69202eb80 1 -- 172.21.15.49:0/4004696658 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5606a318f610 msgr2=0x5606a318fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.156+0000 7ff69202eb80 1 --2- 172.21.15.49:0/4004696658 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5606a318f610 0x5606a318fa90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff678010330 tx=0x7ff67801d000 comp rx=0 tx=0).stop 2024-06-03T00:02:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.156+0000 7ff69202eb80 1 -- 172.21.15.49:0/4004696658 shutdown_connections 2024-06-03T00:02:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.156+0000 7ff69202eb80 1 --2- 172.21.15.49:0/4004696658 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5606a318f610 0x5606a318fa90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.156+0000 7ff69202eb80 1 --2- 172.21.15.49:0/4004696658 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5606a32063c0 0x5606a32087e0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.159 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:02:11.159 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 27, 2024-06-03T00:02:11.160 INFO:teuthology.orchestra.run.smithi049.stdout: "leader": 24487, 2024-06-03T00:02:11.160 INFO:teuthology.orchestra.run.smithi049.stdout: "set_version": 4, 2024-06-03T00:02:11.160 INFO:teuthology.orchestra.run.smithi049.stdout: "sets": { 2024-06-03T00:02:11.160 INFO:teuthology.orchestra.run.smithi049.stdout: "5715c98c": { 2024-06-03T00:02:11.160 INFO:teuthology.orchestra.run.smithi049.stdout: "version": 4, 2024-06-03T00:02:11.160 INFO:teuthology.orchestra.run.smithi049.stdout: "age_ref": 0.0, 2024-06-03T00:02:11.160 INFO:teuthology.orchestra.run.smithi049.stdout: "state": { 2024-06-03T00:02:11.160 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "RELEASED", 2024-06-03T00:02:11.160 INFO:teuthology.orchestra.run.smithi049.stdout: "age": 0.0 2024-06-03T00:02:11.160 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:02:11.160 INFO:teuthology.orchestra.run.smithi049.stdout: "timeout": 90.0, 2024-06-03T00:02:11.160 INFO:teuthology.orchestra.run.smithi049.stdout: "expiration": 146.9, 2024-06-03T00:02:11.160 INFO:teuthology.orchestra.run.smithi049.stdout: "members": { 2024-06-03T00:02:11.160 INFO:teuthology.orchestra.run.smithi049.stdout: "file:/": { 2024-06-03T00:02:11.161 INFO:teuthology.orchestra.run.smithi049.stdout: "excluded": false, 2024-06-03T00:02:11.161 INFO:teuthology.orchestra.run.smithi049.stdout: "state": { 2024-06-03T00:02:11.161 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "RELEASED", 2024-06-03T00:02:11.161 INFO:teuthology.orchestra.run.smithi049.stdout: "age": 0.0 2024-06-03T00:02:11.161 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:02:11.161 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:02:11.161 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:02:11.161 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:02:11.161 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:02:11.161 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:02:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.156+0000 7ff69202eb80 1 --2- 172.21.15.49:0/4004696658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5606a31803d0 0x5606a3192610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.156+0000 7ff668ff9700 0 client.25357 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.156+0000 7ff69202eb80 1 --2- 172.21.15.49:0/4004696658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5606a3186560 0x5606a318f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.156+0000 7ff69202eb80 1 -- 172.21.15.49:0/4004696658 >> 172.21.15.49:0/4004696658 conn(0x5606a30aadc0 msgr2=0x5606a3187ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.157+0000 7ff69202eb80 1 -- 172.21.15.49:0/4004696658 shutdown_connections 2024-06-03T00:02:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.157+0000 7ff69202eb80 1 -- 172.21.15.49:0/4004696658 wait complete. 2024-06-03T00:02:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.157+0000 7ff69202eb80 20 client.25357 trim_cache size 0 max 16384 2024-06-03T00:02:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.157+0000 7ff6877ab700 1 -- 172.21.15.49:0/3134835461 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff66c0a2ca0 msgr2=0x7ff66c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.157+0000 7ff6877ab700 1 --2- 172.21.15.49:0/3134835461 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff66c0a2ca0 0x7ff66c0a5160 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff678010890 tx=0x7ff678009e10 comp rx=0 tx=0).stop 2024-06-03T00:02:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.157+0000 7ff6877ab700 1 -- 172.21.15.49:0/3134835461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff680101d40 msgr2=0x7ff68010aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.157+0000 7ff6877ab700 1 --2- 172.21.15.49:0/3134835461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff680101d40 0x7ff68010aa00 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff670000c00 tx=0x7ff67000bab0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.157+0000 7ff6877ab700 1 -- 172.21.15.49:0/3134835461 shutdown_connections 2024-06-03T00:02:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.157+0000 7ff6877ab700 1 --2- 172.21.15.49:0/3134835461 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff66c0a2ca0 0x7ff66c0a5160 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.157+0000 7ff6877ab700 1 --2- 172.21.15.49:0/3134835461 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6801073f0 0x7ff68010af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.157+0000 7ff6877ab700 1 --2- 172.21.15.49:0/3134835461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff680101380 0x7ff68010a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.157+0000 7ff6877ab700 1 --2- 172.21.15.49:0/3134835461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff680101d40 0x7ff68010aa00 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:11.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.158+0000 7ff6877ab700 1 -- 172.21.15.49:0/3134835461 >> 172.21.15.49:0/3134835461 conn(0x7ff680078300 msgr2=0x7ff680100b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:11.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.158+0000 7ff6877ab700 1 -- 172.21.15.49:0/3134835461 shutdown_connections 2024-06-03T00:02:11.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:11.158+0000 7ff6877ab700 1 -- 172.21.15.49:0/3134835461 wait complete. 2024-06-03T00:02:11.971 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '5715c98c', total seconds elapsed: 37.5 2024-06-03T00:02:12.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:12 smithi107 ceph-mon[37048]: pgmap v448: 97 pgs: 97 active+clean; 673 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-06-03T00:02:12.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:12 smithi057 ceph-mon[36457]: pgmap v448: 97 pgs: 97 active+clean; 673 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-06-03T00:02:12.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:12 smithi049 ceph-mon[32302]: pgmap v448: 97 pgs: 97 active+clean; 673 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-06-03T00:02:14.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:14 smithi107 ceph-mon[37048]: pgmap v449: 97 pgs: 97 active+clean; 674 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:02:14.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:14 smithi057 ceph-mon[36457]: pgmap v449: 97 pgs: 97 active+clean; 674 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:02:14.960 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:14 smithi049 ceph-mon[32302]: pgmap v449: 97 pgs: 97 active+clean; 674 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:02:16.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:16 smithi107 ceph-mon[37048]: pgmap v450: 97 pgs: 97 active+clean; 674 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:02:16.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:16 smithi057 ceph-mon[36457]: pgmap v450: 97 pgs: 97 active+clean; 674 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:02:16.960 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:16 smithi049 ceph-mon[32302]: pgmap v450: 97 pgs: 97 active+clean; 674 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:02:18.506 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-03T00:02:18.758 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:02:18.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:18 smithi107 ceph-mon[37048]: pgmap v451: 97 pgs: 97 active+clean; 674 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:02:18.884 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:18 smithi049 ceph-mon[32302]: pgmap v451: 97 pgs: 97 active+clean; 674 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:02:18.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:18 smithi057 ceph-mon[36457]: pgmap v451: 97 pgs: 97 active+clean; 674 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:02:19.362 INFO:tasks.workunit.client.0.smithi049.stderr:Updating files: 88% (11163/12565) Updating files: 89% (11183/12565) Updating files: 90% (11309/12565) Updating files: 91% (11435/12565) Updating files: 92% (11560/12565) Updating files: 93% (11686/12565) Updating files: 94% (11812/12565) Updating files: 95% (11937/12565) Updating files: 96% (12063/12565) Updating files: 97% (12189/12565) Updating files: 98% (12314/12565) Updating files: 99% (12440/12565) Updating files: 100% (12565/12565) Updating files: 100% (12565/12565), done. 2024-06-03T00:02:19.896 INFO:tasks.workunit.client.0.smithi049.stderr:Note: switching to 'dfcc4b3c2c55532c4c04fa47551c9df1dffdf746'. 2024-06-03T00:02:19.896 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-06-03T00:02:19.896 INFO:tasks.workunit.client.0.smithi049.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-06-03T00:02:19.896 INFO:tasks.workunit.client.0.smithi049.stderr:changes and commit them, and you can discard any commits you make in this 2024-06-03T00:02:19.897 INFO:tasks.workunit.client.0.smithi049.stderr:state without impacting any branches by switching back to a branch. 2024-06-03T00:02:19.897 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-06-03T00:02:19.897 INFO:tasks.workunit.client.0.smithi049.stderr:If you want to create a new branch to retain commits you create, you may 2024-06-03T00:02:19.897 INFO:tasks.workunit.client.0.smithi049.stderr:do so (now or later) by using -c with the switch command. Example: 2024-06-03T00:02:19.897 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-06-03T00:02:19.897 INFO:tasks.workunit.client.0.smithi049.stderr: git switch -c 2024-06-03T00:02:19.897 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-06-03T00:02:19.897 INFO:tasks.workunit.client.0.smithi049.stderr:Or undo this operation with: 2024-06-03T00:02:19.897 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-06-03T00:02:19.897 INFO:tasks.workunit.client.0.smithi049.stderr: git switch - 2024-06-03T00:02:19.897 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-06-03T00:02:19.897 INFO:tasks.workunit.client.0.smithi049.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-06-03T00:02:19.897 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-06-03T00:02:19.897 INFO:tasks.workunit.client.0.smithi049.stderr:HEAD is now at dfcc4b3c2c5 Merge pull request #57814 from zdover23/wip-doc-2024-06-01-backport-57804-to-squid 2024-06-03T00:02:19.901 DEBUG:teuthology.orchestra.run.smithi049:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-06-03T00:02:19.987 INFO:tasks.workunit.client.0.smithi049.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-06-03T00:02:19.990 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-06-03T00:02:19.990 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-06-03T00:02:20.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:20 smithi049 ceph-mon[32302]: pgmap v452: 97 pgs: 97 active+clean; 674 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:02:20.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:20 smithi107 ceph-mon[37048]: pgmap v452: 97 pgs: 97 active+clean; 674 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:02:20.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:20 smithi057 ceph-mon[36457]: pgmap v452: 97 pgs: 97 active+clean; 674 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:02:21.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.036+0000 7ff7bd1af700 1 -- 172.21.15.49:0/3394213606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b8101390 msgr2=0x7ff7b8101810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:21.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.036+0000 7ff7bd1af700 1 --2- 172.21.15.49:0/3394213606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b8101390 0x7ff7b8101810 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac009990 tx=0x7ff7ac009ca0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.036+0000 7ff7bd1af700 1 -- 172.21.15.49:0/3394213606 shutdown_connections 2024-06-03T00:02:21.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.036+0000 7ff7bd1af700 1 --2- 172.21.15.49:0/3394213606 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7b8101d50 0x7ff7b810e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.036+0000 7ff7bd1af700 1 --2- 172.21.15.49:0/3394213606 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7b8107400 0x7ff7b81077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.036+0000 7ff7bd1af700 1 --2- 172.21.15.49:0/3394213606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b8101390 0x7ff7b8101810 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.036+0000 7ff7bd1af700 1 -- 172.21.15.49:0/3394213606 >> 172.21.15.49:0/3394213606 conn(0x7ff7b8078340 msgr2=0x7ff7b8078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:21.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.036+0000 7ff7bd1af700 1 -- 172.21.15.49:0/3394213606 shutdown_connections 2024-06-03T00:02:21.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.036+0000 7ff7bd1af700 1 -- 172.21.15.49:0/3394213606 wait complete. 2024-06-03T00:02:21.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.037+0000 7ff7bd1af700 1 Processor -- start 2024-06-03T00:02:21.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.037+0000 7ff7bd1af700 1 -- start start 2024-06-03T00:02:21.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.038+0000 7ff7bd1af700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7b8101390 0x7ff7b819add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:21.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.038+0000 7ff7bd1af700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b8101d50 0x7ff7b819b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:21.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.038+0000 7ff7bd1af700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7b8107400 0x7ff7b819f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:21.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.038+0000 7ff7bd1af700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b8111690 con 0x7ff7b8101d50 2024-06-03T00:02:21.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.038+0000 7ff7bd1af700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b8111510 con 0x7ff7b8107400 2024-06-03T00:02:21.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.038+0000 7ff7bd1af700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b8111810 con 0x7ff7b8101390 2024-06-03T00:02:21.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.038+0000 7ff7b659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b8101d50 0x7ff7b819b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:21.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.038+0000 7ff7b659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b8101d50 0x7ff7b819b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46580/0 (socket says 172.21.15.49:46580) 2024-06-03T00:02:21.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.038+0000 7ff7b659c700 1 -- 172.21.15.49:0/2348444319 learned_addr learned my addr 172.21.15.49:0/2348444319 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:21.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.038+0000 7ff7b6d9d700 1 --2- 172.21.15.49:0/2348444319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7b8101390 0x7ff7b819add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:21.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.038+0000 7ff7b759e700 1 --2- 172.21.15.49:0/2348444319 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7b8107400 0x7ff7b819f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:21.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.038+0000 7ff7b659c700 1 -- 172.21.15.49:0/2348444319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7b8101390 msgr2=0x7ff7b819add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:21.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.038+0000 7ff7b659c700 1 --2- 172.21.15.49:0/2348444319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7b8101390 0x7ff7b819add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.038+0000 7ff7b659c700 1 -- 172.21.15.49:0/2348444319 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7b8107400 msgr2=0x7ff7b819f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:21.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.038+0000 7ff7b659c700 1 --2- 172.21.15.49:0/2348444319 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7b8107400 0x7ff7b819f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.038+0000 7ff7b659c700 1 -- 172.21.15.49:0/2348444319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b819fde0 con 0x7ff7b8101d50 2024-06-03T00:02:21.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.039+0000 7ff7b659c700 1 --2- 172.21.15.49:0/2348444319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b8101d50 0x7ff7b819b310 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac000c00 tx=0x7ff7ac0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:21.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.039+0000 7ff79ffff700 1 -- 172.21.15.49:0/2348444319 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac027070 con 0x7ff7b8101d50 2024-06-03T00:02:21.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.039+0000 7ff7bd1af700 1 -- 172.21.15.49:0/2348444319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7b81a0070 con 0x7ff7b8101d50 2024-06-03T00:02:21.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.039+0000 7ff79ffff700 1 -- 172.21.15.49:0/2348444319 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7ac003e40 con 0x7ff7b8101d50 2024-06-03T00:02:21.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.039+0000 7ff79ffff700 1 -- 172.21.15.49:0/2348444319 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac022d10 con 0x7ff7b8101d50 2024-06-03T00:02:21.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.039+0000 7ff7bd1af700 1 -- 172.21.15.49:0/2348444319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7b81a7950 con 0x7ff7b8101d50 2024-06-03T00:02:21.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.041+0000 7ff79ffff700 1 -- 172.21.15.49:0/2348444319 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff7ac02a070 con 0x7ff7b8101d50 2024-06-03T00:02:21.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.042+0000 7ff79ffff700 1 --2- 172.21.15.49:0/2348444319 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff7a00a2c20 0x7ff7a00a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:21.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.042+0000 7ff7b6d9d700 1 --2- 172.21.15.49:0/2348444319 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff7a00a2c20 0x7ff7a00a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:21.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.042+0000 7ff79ffff700 1 -- 172.21.15.49:0/2348444319 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7ff7ac0cfe10 con 0x7ff7b8101d50 2024-06-03T00:02:21.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.042+0000 7ff7b6d9d700 1 --2- 172.21.15.49:0/2348444319 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff7a00a2c20 0x7ff7a00a50e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff7a80045b0 tx=0x7ff7a800b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:21.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.043+0000 7ff7c7a32b80 1 Processor -- start 2024-06-03T00:02:21.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.043+0000 7ff7c7a32b80 1 -- start start 2024-06-03T00:02:21.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.043+0000 7ff7c7a32b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555742ccdf60 0x555742cce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:21.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.043+0000 7ff7c7a32b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555742cce880 0x555742cc8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:21.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.043+0000 7ff7c7a32b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555742cc87a0 0x555742cc8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:21.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.043+0000 7ff7c7a32b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x555742bbaf60 con 0x555742ccdf60 2024-06-03T00:02:21.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.043+0000 7ff7c7a32b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x555742c19850 con 0x555742cce880 2024-06-03T00:02:21.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.043+0000 7ff7c7a32b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x555742b81460 con 0x555742cc87a0 2024-06-03T00:02:21.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.043+0000 7ff7b6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555742ccdf60 0x555742cce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:21.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.043+0000 7ff7b6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555742ccdf60 0x555742cce340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46596/0 (socket says 172.21.15.49:46596) 2024-06-03T00:02:21.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.043+0000 7ff7b6d9d700 1 -- 172.21.15.49:0/2278679085 learned_addr learned my addr 172.21.15.49:0/2278679085 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:21.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.043+0000 7ff7b759e700 1 --2- 172.21.15.49:0/2278679085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555742cc87a0 0x555742cc8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:21.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.044+0000 7ff7b659c700 1 --2- 172.21.15.49:0/2278679085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555742cce880 0x555742cc8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:21.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.044+0000 7ff7b6d9d700 1 -- 172.21.15.49:0/2278679085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555742cc87a0 msgr2=0x555742cc8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:21.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.044+0000 7ff7b6d9d700 1 --2- 172.21.15.49:0/2278679085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555742cc87a0 0x555742cc8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.044+0000 7ff7b6d9d700 1 -- 172.21.15.49:0/2278679085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555742cce880 msgr2=0x555742cc8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:21.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.044+0000 7ff7b6d9d700 1 --2- 172.21.15.49:0/2278679085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555742cce880 0x555742cc8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.044+0000 7ff7b6d9d700 1 -- 172.21.15.49:0/2278679085 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555742b688d0 con 0x555742ccdf60 2024-06-03T00:02:21.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.044+0000 7ff7b659c700 1 --2- 172.21.15.49:0/2278679085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555742cce880 0x555742cc8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:02:21.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.044+0000 7ff7b6d9d700 1 --2- 172.21.15.49:0/2278679085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555742ccdf60 0x555742cce340 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8003b20 tx=0x7ff7a8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d1a584ca4cdaf3c server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:21.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.044+0000 7ff79d7fa700 1 -- 172.21.15.49:0/2278679085 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a80118d0 con 0x555742ccdf60 2024-06-03T00:02:21.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.044+0000 7ff79d7fa700 1 -- 172.21.15.49:0/2278679085 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7a8004830 con 0x555742ccdf60 2024-06-03T00:02:21.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.044+0000 7ff79d7fa700 1 -- 172.21.15.49:0/2278679085 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a80055a0 con 0x555742ccdf60 2024-06-03T00:02:21.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.045+0000 7ff7c7a32b80 1 -- 172.21.15.49:0/2278679085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555742ccdf60 msgr2=0x555742cce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:21.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.045+0000 7ff7c7a32b80 1 --2- 172.21.15.49:0/2278679085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555742ccdf60 0x555742cce340 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8003b20 tx=0x7ff7a8013000 comp rx=0 tx=0).stop 2024-06-03T00:02:21.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.045+0000 7ff7c7a32b80 1 -- 172.21.15.49:0/2278679085 shutdown_connections 2024-06-03T00:02:21.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.045+0000 7ff7c7a32b80 1 --2- 172.21.15.49:0/2278679085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555742cc87a0 0x555742cc8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.045+0000 7ff7c7a32b80 1 --2- 172.21.15.49:0/2278679085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555742ccdf60 0x555742cce340 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.045+0000 7ff7c7a32b80 1 --2- 172.21.15.49:0/2278679085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555742cce880 0x555742cc8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.045+0000 7ff7c7a32b80 1 -- 172.21.15.49:0/2278679085 >> 172.21.15.49:0/2278679085 conn(0x555742bf5080 msgr2=0x555742cc3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:21.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.045+0000 7ff7c7a32b80 1 -- 172.21.15.49:0/2278679085 shutdown_connections 2024-06-03T00:02:21.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.045+0000 7ff7c7a32b80 1 -- 172.21.15.49:0/2278679085 wait complete. 2024-06-03T00:02:21.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.045+0000 7ff7c7a32b80 1 -- start start 2024-06-03T00:02:21.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.045+0000 7ff7c7a32b80 1 Processor -- start 2024-06-03T00:02:21.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.045+0000 7ff7c7a32b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555742cc87a0 0x555742cd45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:21.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.045+0000 7ff7c7a32b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555742ccdf60 0x555742cd18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:21.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.045+0000 7ff7c7a32b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555742cce880 0x555742cd1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:21.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.046+0000 7ff7c7a32b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x555742bb9fc0 con 0x555742ccdf60 2024-06-03T00:02:21.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.046+0000 7ff7c7a32b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x555742c15810 con 0x555742cce880 2024-06-03T00:02:21.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.046+0000 7ff7c7a32b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x555742cd5260 con 0x555742cc87a0 2024-06-03T00:02:21.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.046+0000 7ff7c7a32b80 10 client.0 _ll_register_callbacks cb 0x555742baf5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:02:21.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.046+0000 7ff7b659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555742ccdf60 0x555742cd18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:21.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.046+0000 7ff7b659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555742ccdf60 0x555742cd18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46604/0 (socket says 172.21.15.49:46604) 2024-06-03T00:02:21.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.046+0000 7ff7b659c700 1 -- 172.21.15.49:0/1480255895 learned_addr learned my addr 172.21.15.49:0/1480255895 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:21.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.046+0000 7ff7b6d9d700 1 --2- 172.21.15.49:0/1480255895 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555742cc87a0 0x555742cd45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:21.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.046+0000 7ff7b759e700 1 --2- 172.21.15.49:0/1480255895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555742cce880 0x555742cd1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:21.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.046+0000 7ff7b659c700 1 -- 172.21.15.49:0/1480255895 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555742cc87a0 msgr2=0x555742cd45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:21.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.046+0000 7ff7b659c700 1 --2- 172.21.15.49:0/1480255895 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555742cc87a0 0x555742cd45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.046+0000 7ff7b659c700 1 -- 172.21.15.49:0/1480255895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555742cce880 msgr2=0x555742cd1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:21.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.046+0000 7ff7b659c700 1 --2- 172.21.15.49:0/1480255895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555742cce880 0x555742cd1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.046+0000 7ff7b659c700 1 -- 172.21.15.49:0/1480255895 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555742bdf750 con 0x555742ccdf60 2024-06-03T00:02:21.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.046+0000 7ff7b6d9d700 1 --2- 172.21.15.49:0/1480255895 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555742cc87a0 0x555742cd45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:02:21.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.046+0000 7ff7b659c700 1 --2- 172.21.15.49:0/1480255895 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555742ccdf60 0x555742cd18a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac0a4db0 tx=0x7ff7ac09cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857605e7f925c181 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:21.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.046+0000 7ff79aff5700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:02:21.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.046+0000 7ff79aff5700 1 -- 172.21.15.49:0/1480255895 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac0a52e0 con 0x555742ccdf60 2024-06-03T00:02:21.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.046+0000 7ff79aff5700 1 -- 172.21.15.49:0/1480255895 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7ff7ac09aa00 con 0x555742ccdf60 2024-06-03T00:02:21.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.046+0000 7ff7c7a32b80 1 -- 172.21.15.49:0/1480255895 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7a8004830 con 0x555742ccdf60 2024-06-03T00:02:21.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.047+0000 7ff79aff5700 1 -- 172.21.15.49:0/1480255895 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff7ac003ff0 con 0x555742ccdf60 2024-06-03T00:02:21.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.047+0000 7ff7c7a32b80 10 client.15753 fetch_fsmap learned FSMap version 27 2024-06-03T00:02:21.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.047+0000 7ff7c7a32b80 1 -- 172.21.15.49:0/1480255895 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555742cdf900 con 0x555742ccdf60 2024-06-03T00:02:21.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.047+0000 7ff79aff5700 1 -- 172.21.15.49:0/1480255895 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7a8004830 con 0x555742ccdf60 2024-06-03T00:02:21.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.047+0000 7ff79aff5700 1 -- 172.21.15.49:0/1480255895 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ff7ac09bb50 con 0x555742ccdf60 2024-06-03T00:02:21.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.047+0000 7ff7c7a32b80 10 client.15753 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:02:21.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.047+0000 7ff7c7a32b80 10 client.15753 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-03T00:02:21.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.047+0000 7ff7c7a32b80 20 client.15753 populate_metadata read hostname 'smithi049' 2024-06-03T00:02:21.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.047+0000 7ff7c7a32b80 1 --2- 172.21.15.49:0/1480255895 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x555742ce1e20 0x555742ce4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:21.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.047+0000 7ff7c7a32b80 4 client.15753 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:02:21.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.047+0000 7ff7c7a32b80 1 -- 172.21.15.49:0/1480255895 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555742c26d50 con 0x555742ce1e20 2024-06-03T00:02:21.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.048+0000 7ff7b6d9d700 1 --2- 172.21.15.49:0/1480255895 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x555742ce1e20 0x555742ce4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:21.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.048+0000 7ff7b6d9d700 1 --2- 172.21.15.49:0/1480255895 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x555742ce1e20 0x555742ce4230 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b9ba927e2902499 server_cookie=4a02cc11533d026d in_seq=0 out_seq=0 2024-06-03T00:02:21.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.048+0000 7ff79aff5700 10 client.15753 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:21.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.049+0000 7ff79aff5700 1 -- 172.21.15.49:0/1480255895 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x555742c26d50 con 0x555742ce1e20 2024-06-03T00:02:21.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.049+0000 7ff79aff5700 10 client.15753 handle_command_reply: tid=0 2024-06-03T00:02:21.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.049+0000 7ff7c7a32b80 1 client.15753 shutdown 2024-06-03T00:02:21.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.049+0000 7ff7c7a32b80 1 -- 172.21.15.49:0/1480255895 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555742ccdf60 msgr2=0x555742cd18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:21.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.049+0000 7ff7c7a32b80 1 --2- 172.21.15.49:0/1480255895 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555742ccdf60 0x555742cd18a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac0a4db0 tx=0x7ff7ac09cf30 comp rx=0 tx=0).stop 2024-06-03T00:02:21.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.049+0000 7ff7c7a32b80 1 -- 172.21.15.49:0/1480255895 shutdown_connections 2024-06-03T00:02:21.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.049+0000 7ff7c7a32b80 1 --2- 172.21.15.49:0/1480255895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555742cce880 0x555742cd1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.049+0000 7ff7c7a32b80 1 --2- 172.21.15.49:0/1480255895 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555742cc87a0 0x555742cd45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.049+0000 7ff7c7a32b80 1 --2- 172.21.15.49:0/1480255895 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x555742ce1e20 0x555742ce4230 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.049+0000 7ff7c7a32b80 1 --2- 172.21.15.49:0/1480255895 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555742ccdf60 0x555742cd18a0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.049+0000 7ff7c7a32b80 1 -- 172.21.15.49:0/1480255895 >> 172.21.15.49:0/1480255895 conn(0x555742bf5080 msgr2=0x555742cc2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:21.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.049+0000 7ff79aff5700 0 client.15753 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:21.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.049+0000 7ff7c7a32b80 1 -- 172.21.15.49:0/1480255895 shutdown_connections 2024-06-03T00:02:21.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.049+0000 7ff7c7a32b80 1 -- 172.21.15.49:0/1480255895 wait complete. 2024-06-03T00:02:21.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.049+0000 7ff7c7a32b80 20 client.15753 trim_cache size 0 max 16384 2024-06-03T00:02:21.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.070+0000 7ff7c7a32b80 1 Processor -- start 2024-06-03T00:02:21.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.070+0000 7ff7c7a32b80 1 -- start start 2024-06-03T00:02:21.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.070+0000 7ff7c7a32b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555742cc87a0 0x555742cc8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:21.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.070+0000 7ff7c7a32b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555742ccdf60 0x555742ccf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:21.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.070+0000 7ff7c7a32b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555742cce880 0x555742cc2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:21.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.070+0000 7ff7c7a32b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b81aed00 con 0x555742ccdf60 2024-06-03T00:02:21.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.070+0000 7ff7c7a32b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b81b0840 con 0x555742cc87a0 2024-06-03T00:02:21.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.070+0000 7ff7c7a32b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b81af3d0 con 0x555742cce880 2024-06-03T00:02:21.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.070+0000 7ff7b659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555742ccdf60 0x555742ccf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:21.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.070+0000 7ff7b659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555742ccdf60 0x555742ccf430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46614/0 (socket says 172.21.15.49:46614) 2024-06-03T00:02:21.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.070+0000 7ff7b659c700 1 -- 172.21.15.49:0/4115693336 learned_addr learned my addr 172.21.15.49:0/4115693336 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:21.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.070+0000 7ff7b6d9d700 1 --2- 172.21.15.49:0/4115693336 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555742cc87a0 0x555742cc8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:21.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.071+0000 7ff7b759e700 1 --2- 172.21.15.49:0/4115693336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555742cce880 0x555742cc2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:21.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.071+0000 7ff7b659c700 1 -- 172.21.15.49:0/4115693336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555742cce880 msgr2=0x555742cc2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:21.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.071+0000 7ff7b659c700 1 --2- 172.21.15.49:0/4115693336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555742cce880 0x555742cc2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.071+0000 7ff7b659c700 1 -- 172.21.15.49:0/4115693336 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555742cc87a0 msgr2=0x555742cc8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:21.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.071+0000 7ff7b659c700 1 --2- 172.21.15.49:0/4115693336 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555742cc87a0 0x555742cc8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.071+0000 7ff7b659c700 1 -- 172.21.15.49:0/4115693336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555742cc4be0 con 0x555742ccdf60 2024-06-03T00:02:21.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.071+0000 7ff7b6d9d700 1 --2- 172.21.15.49:0/4115693336 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555742cc87a0 0x555742cc8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:02:21.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.071+0000 7ff7b659c700 1 --2- 172.21.15.49:0/4115693336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555742ccdf60 0x555742ccf430 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac09bff0 tx=0x7ff7ac009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87fd21e957885f62 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:21.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.071+0000 7ff79cff9700 1 -- 172.21.15.49:0/4115693336 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac0989a0 con 0x555742ccdf60 2024-06-03T00:02:21.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.071+0000 7ff79cff9700 1 -- 172.21.15.49:0/4115693336 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7ac004190 con 0x555742ccdf60 2024-06-03T00:02:21.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.071+0000 7ff79cff9700 1 -- 172.21.15.49:0/4115693336 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac0a4e50 con 0x555742ccdf60 2024-06-03T00:02:21.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.072+0000 7ff7c7a32b80 1 -- 172.21.15.49:0/4115693336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555742ccdf60 msgr2=0x555742ccf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:21.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.072+0000 7ff7c7a32b80 1 --2- 172.21.15.49:0/4115693336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555742ccdf60 0x555742ccf430 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac09bff0 tx=0x7ff7ac009ca0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.072+0000 7ff7c7a32b80 1 -- 172.21.15.49:0/4115693336 shutdown_connections 2024-06-03T00:02:21.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.072+0000 7ff7c7a32b80 1 --2- 172.21.15.49:0/4115693336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555742cce880 0x555742cc2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.072+0000 7ff7c7a32b80 1 --2- 172.21.15.49:0/4115693336 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555742cc87a0 0x555742cc8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.072+0000 7ff7c7a32b80 1 --2- 172.21.15.49:0/4115693336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555742ccdf60 0x555742ccf430 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.072+0000 7ff7c7a32b80 1 -- 172.21.15.49:0/4115693336 >> 172.21.15.49:0/4115693336 conn(0x555742bf5080 msgr2=0x555742cced20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:21.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.072+0000 7ff7c7a32b80 1 -- 172.21.15.49:0/4115693336 shutdown_connections 2024-06-03T00:02:21.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.072+0000 7ff7c7a32b80 1 -- 172.21.15.49:0/4115693336 wait complete. 2024-06-03T00:02:21.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.072+0000 7ff7c7a32b80 1 -- start start 2024-06-03T00:02:21.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.072+0000 7ff7c7a32b80 1 Processor -- start 2024-06-03T00:02:21.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.073+0000 7ff7c7a32b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555742cc87a0 0x555742cdabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:21.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.073+0000 7ff7c7a32b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555742ccdf60 0x555742ce93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:21.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.073+0000 7ff7c7a32b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555742cce880 0x555742ce9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:21.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.073+0000 7ff7c7a32b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b81b0170 con 0x555742ccdf60 2024-06-03T00:02:21.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.073+0000 7ff7c7a32b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b81afaa0 con 0x555742cce880 2024-06-03T00:02:21.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.073+0000 7ff7c7a32b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b81acc80 con 0x555742cc87a0 2024-06-03T00:02:21.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.073+0000 7ff7c7a32b80 10 client.0 _ll_register_callbacks cb 0x555742baf5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:02:21.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.073+0000 7ff7b659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555742ccdf60 0x555742ce93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:21.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.073+0000 7ff7b659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555742ccdf60 0x555742ce93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46616/0 (socket says 172.21.15.49:46616) 2024-06-03T00:02:21.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.073+0000 7ff7b659c700 1 -- 172.21.15.49:0/294134997 learned_addr learned my addr 172.21.15.49:0/294134997 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:21.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.073+0000 7ff7b759e700 1 --2- 172.21.15.49:0/294134997 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555742cce880 0x555742ce9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:21.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.073+0000 7ff7b6d9d700 1 --2- 172.21.15.49:0/294134997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555742cc87a0 0x555742cdabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:21.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.073+0000 7ff7b659c700 1 -- 172.21.15.49:0/294134997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555742cc87a0 msgr2=0x555742cdabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:21.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.073+0000 7ff7b659c700 1 --2- 172.21.15.49:0/294134997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555742cc87a0 0x555742cdabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.073+0000 7ff7b659c700 1 -- 172.21.15.49:0/294134997 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555742cce880 msgr2=0x555742ce9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:21.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.073+0000 7ff7b659c700 1 --2- 172.21.15.49:0/294134997 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555742cce880 0x555742ce9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.073+0000 7ff7b659c700 1 -- 172.21.15.49:0/294134997 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555742cea0e0 con 0x555742ccdf60 2024-06-03T00:02:21.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.073+0000 7ff7b6d9d700 1 --2- 172.21.15.49:0/294134997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555742cc87a0 0x555742cdabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:02:21.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.073+0000 7ff7b659c700 1 --2- 172.21.15.49:0/294134997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555742ccdf60 0x555742ce93f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac098690 tx=0x7ff7ac09cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93f78d7872f5f1a7 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:21.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.073+0000 7ff79aff5700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:02:21.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.074+0000 7ff79aff5700 1 -- 172.21.15.49:0/294134997 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac066060 con 0x555742ccdf60 2024-06-03T00:02:21.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.074+0000 7ff79aff5700 1 -- 172.21.15.49:0/294134997 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7ff7ac0a4e50 con 0x555742ccdf60 2024-06-03T00:02:21.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.074+0000 7ff7c7a32b80 1 -- 172.21.15.49:0/294134997 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7ac004190 con 0x555742ccdf60 2024-06-03T00:02:21.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.074+0000 7ff79aff5700 1 -- 172.21.15.49:0/294134997 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff7ac09cb70 con 0x555742ccdf60 2024-06-03T00:02:21.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.074+0000 7ff7c7a32b80 10 client.15759 fetch_fsmap learned FSMap version 27 2024-06-03T00:02:21.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.074+0000 7ff7c7a32b80 1 -- 172.21.15.49:0/294134997 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555742cea0e0 con 0x555742ccdf60 2024-06-03T00:02:21.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.074+0000 7ff79aff5700 1 -- 172.21.15.49:0/294134997 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7ac004190 con 0x555742ccdf60 2024-06-03T00:02:21.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.074+0000 7ff79aff5700 1 -- 172.21.15.49:0/294134997 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ff7ac09b6e0 con 0x555742ccdf60 2024-06-03T00:02:21.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.074+0000 7ff7c7a32b80 10 client.15759 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:02:21.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.074+0000 7ff7c7a32b80 10 client.15759 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-03T00:02:21.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.074+0000 7ff7c7a32b80 20 client.15759 populate_metadata read hostname 'smithi049' 2024-06-03T00:02:21.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.074+0000 7ff7c7a32b80 1 --2- 172.21.15.49:0/294134997 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x555742d4cc30 0x555742d4f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:21.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.074+0000 7ff7c7a32b80 4 client.15759 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-03T00:02:21.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.074+0000 7ff7c7a32b80 1 -- 172.21.15.49:0/294134997 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555742c212d0 con 0x555742d4cc30 2024-06-03T00:02:21.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.075+0000 7ff7b6d9d700 1 --2- 172.21.15.49:0/294134997 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x555742d4cc30 0x555742d4f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:21.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.075+0000 7ff7b6d9d700 1 --2- 172.21.15.49:0/294134997 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x555742d4cc30 0x555742d4f020 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0b9a6a195f191a6 server_cookie=96fd0d1622da70c7 in_seq=0 out_seq=0 2024-06-03T00:02:21.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.075+0000 7ff79aff5700 10 client.15759 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:21.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.075+0000 7ff79aff5700 1 -- 172.21.15.49:0/294134997 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x555742c212d0 con 0x555742d4cc30 2024-06-03T00:02:21.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.075+0000 7ff79aff5700 10 client.15759 handle_command_reply: tid=0 2024-06-03T00:02:21.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.075+0000 7ff7c7a32b80 1 client.15759 shutdown 2024-06-03T00:02:21.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.075+0000 7ff7c7a32b80 1 -- 172.21.15.49:0/294134997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555742ccdf60 msgr2=0x555742ce93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:21.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.075+0000 7ff7c7a32b80 1 --2- 172.21.15.49:0/294134997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555742ccdf60 0x555742ce93f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac098690 tx=0x7ff7ac09cf30 comp rx=0 tx=0).stop 2024-06-03T00:02:21.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.075+0000 7ff7c7a32b80 1 -- 172.21.15.49:0/294134997 shutdown_connections 2024-06-03T00:02:21.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.075+0000 7ff7c7a32b80 1 --2- 172.21.15.49:0/294134997 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555742cce880 0x555742ce9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.075+0000 7ff7c7a32b80 1 --2- 172.21.15.49:0/294134997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555742cc87a0 0x555742cdabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.075+0000 7ff7c7a32b80 1 --2- 172.21.15.49:0/294134997 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x555742d4cc30 0x555742d4f020 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.075+0000 7ff7c7a32b80 1 --2- 172.21.15.49:0/294134997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555742ccdf60 0x555742ce93f0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.075+0000 7ff7c7a32b80 1 -- 172.21.15.49:0/294134997 >> 172.21.15.49:0/294134997 conn(0x555742bf5080 msgr2=0x555742cd30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:21.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.075+0000 7ff79aff5700 0 client.15759 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:21.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.075+0000 7ff7c7a32b80 1 -- 172.21.15.49:0/294134997 shutdown_connections 2024-06-03T00:02:21.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.075+0000 7ff7c7a32b80 1 -- 172.21.15.49:0/294134997 wait complete. 2024-06-03T00:02:21.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.076+0000 7ff7c7a32b80 20 client.15759 trim_cache size 0 max 16384 2024-06-03T00:02:21.087 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:02:21.087 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "no active scrubs running", 2024-06-03T00:02:21.087 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {} 2024-06-03T00:02:21.087 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:02:21.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.076+0000 7ff7bd1af700 1 -- 172.21.15.49:0/2348444319 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff7a00a2c20 msgr2=0x7ff7a00a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:21.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.076+0000 7ff7bd1af700 1 --2- 172.21.15.49:0/2348444319 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff7a00a2c20 0x7ff7a00a50e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff7a80045b0 tx=0x7ff7a800b3c0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.076+0000 7ff7bd1af700 1 -- 172.21.15.49:0/2348444319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b8101d50 msgr2=0x7ff7b819b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:21.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.076+0000 7ff7bd1af700 1 --2- 172.21.15.49:0/2348444319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b8101d50 0x7ff7b819b310 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac000c00 tx=0x7ff7ac0047b0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.076+0000 7ff7bd1af700 1 -- 172.21.15.49:0/2348444319 shutdown_connections 2024-06-03T00:02:21.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.076+0000 7ff7bd1af700 1 --2- 172.21.15.49:0/2348444319 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff7a00a2c20 0x7ff7a00a50e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.076+0000 7ff7bd1af700 1 --2- 172.21.15.49:0/2348444319 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7b8107400 0x7ff7b819f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.076+0000 7ff7bd1af700 1 --2- 172.21.15.49:0/2348444319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7b8101390 0x7ff7b819add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.076+0000 7ff7bd1af700 1 --2- 172.21.15.49:0/2348444319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b8101d50 0x7ff7b819b310 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:21.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.076+0000 7ff7bd1af700 1 -- 172.21.15.49:0/2348444319 >> 172.21.15.49:0/2348444319 conn(0x7ff7b8078340 msgr2=0x7ff7b806a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:21.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.076+0000 7ff7bd1af700 1 -- 172.21.15.49:0/2348444319 shutdown_connections 2024-06-03T00:02:21.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:21.076+0000 7ff7bd1af700 1 -- 172.21.15.49:0/2348444319 wait complete. 2024-06-03T00:02:21.914 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-06-03T00:02:22.024 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-06-03T00:02:22.071 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-06-03T00:02:22.073 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-06-03T00:02:22.073 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-06-03T00:02:22.128 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-06-03T00:02:22.132 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-06-03T00:02:22.132 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-06-03T00:02:22.150 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-06-03T00:02:22.151 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-06-03T00:02:22.151 DEBUG:teuthology.orchestra.run.smithi049:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=dfcc4b3c2c55532c4c04fa47551c9df1dffdf746 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-06-03T00:02:22.158 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-03T00:02:22.158 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-03T00:02:22.219 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir -p fsstress 2024-06-03T00:02:22.221 INFO:tasks.workunit.client.0.smithi049.stderr:+ pushd fsstress 2024-06-03T00:02:22.222 INFO:tasks.workunit.client.0.smithi049.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-06-03T00:02:22.222 INFO:tasks.workunit.client.0.smithi049.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-06-03T00:02:22.449 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:02:22.799 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:22 smithi049 ceph-mon[32302]: pgmap v453: 97 pgs: 97 active+clean; 674 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-06-03T00:02:22.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:22 smithi107 ceph-mon[37048]: pgmap v453: 97 pgs: 97 active+clean; 674 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-06-03T00:02:22.860 INFO:tasks.workunit.client.0.smithi049.stderr:+ tar xzf ltp-full.tgz 2024-06-03T00:02:22.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:22 smithi057 ceph-mon[36457]: pgmap v453: 97 pgs: 97 active+clean; 674 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-06-03T00:02:23.281 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.279+0000 7f1dd2130640 1 -- 172.21.15.49:0/1034480439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1dcc100900 msgr2=0x7f1dcc100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:23.281 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.279+0000 7f1dd2130640 1 --2- 172.21.15.49:0/1034480439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1dcc100900 0x7f1dcc100d20 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc009900 tx=0x7f1dbc02a410 comp rx=0 tx=0).stop 2024-06-03T00:02:23.281 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.279+0000 7f1dd2130640 1 -- 172.21.15.49:0/1034480439 shutdown_connections 2024-06-03T00:02:23.281 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.279+0000 7f1dd2130640 1 --2- 172.21.15.49:0/1034480439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1dcc1024b0 0x7f1dcc108d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:23.281 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.279+0000 7f1dd2130640 1 --2- 172.21.15.49:0/1034480439 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dcc101af0 0x7f1dcc101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:23.281 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.279+0000 7f1dd2130640 1 --2- 172.21.15.49:0/1034480439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1dcc100900 0x7f1dcc100d20 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:23.281 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.279+0000 7f1dd2130640 1 -- 172.21.15.49:0/1034480439 >> 172.21.15.49:0/1034480439 conn(0x7f1dcc0fbe70 msgr2=0x7f1dcc0fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:23.281 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.279+0000 7f1dd2130640 1 -- 172.21.15.49:0/1034480439 shutdown_connections 2024-06-03T00:02:23.281 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.279+0000 7f1dd2130640 1 -- 172.21.15.49:0/1034480439 wait complete. 2024-06-03T00:02:23.281 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.279+0000 7f1dd2130640 1 Processor -- start 2024-06-03T00:02:23.282 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.280+0000 7f1dd2130640 1 -- start start 2024-06-03T00:02:23.282 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.280+0000 7f1dd2130640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dcc100900 0x7f1dcc069bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:23.282 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.280+0000 7f1dd2130640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1dcc101af0 0x7f1dcc19ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:23.282 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.280+0000 7f1dd2130640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1dcc1024b0 0x7f1dcc19f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:23.282 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.280+0000 7f1dd2130640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc10c550 con 0x7f1dcc1024b0 2024-06-03T00:02:23.282 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.280+0000 7f1dd2130640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc10c3d0 con 0x7f1dcc101af0 2024-06-03T00:02:23.282 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.280+0000 7f1dd2130640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc10c6d0 con 0x7f1dcc100900 2024-06-03T00:02:23.282 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.280+0000 7f1dcb7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dcc100900 0x7f1dcc069bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:23.282 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.280+0000 7f1dcb7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dcc100900 0x7f1dcc069bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:50656/0 (socket says 172.21.15.49:50656) 2024-06-03T00:02:23.282 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.280+0000 7f1dcbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1dcc1024b0 0x7f1dcc19f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:23.282 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.280+0000 7f1dcb7fe640 1 -- 172.21.15.49:0/2549285381 learned_addr learned my addr 172.21.15.49:0/2549285381 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:23.283 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.280+0000 7f1dcaffd640 1 --2- 172.21.15.49:0/2549285381 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1dcc101af0 0x7f1dcc19ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:23.283 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.280+0000 7f1dcb7fe640 1 -- 172.21.15.49:0/2549285381 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1dcc101af0 msgr2=0x7f1dcc19ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:23.283 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.280+0000 7f1dcb7fe640 1 --2- 172.21.15.49:0/2549285381 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1dcc101af0 0x7f1dcc19ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:23.283 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.280+0000 7f1dcb7fe640 1 -- 172.21.15.49:0/2549285381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1dcc1024b0 msgr2=0x7f1dcc19f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:23.283 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.280+0000 7f1dcb7fe640 1 --2- 172.21.15.49:0/2549285381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1dcc1024b0 0x7f1dcc19f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:23.283 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.280+0000 7f1dcb7fe640 1 -- 172.21.15.49:0/2549285381 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dcc19f940 con 0x7f1dcc100900 2024-06-03T00:02:23.283 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.280+0000 7f1dcbfff640 1 --2- 172.21.15.49:0/2549285381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1dcc1024b0 0x7f1dcc19f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:02:23.283 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.280+0000 7f1dcb7fe640 1 --2- 172.21.15.49:0/2549285381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dcc100900 0x7f1dcc069bc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc031610 tx=0x7f1dbc004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:23.283 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.281+0000 7f1dc8ff9640 1 -- 172.21.15.49:0/2549285381 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc03f030 con 0x7f1dcc100900 2024-06-03T00:02:23.283 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.281+0000 7f1dd2130640 1 -- 172.21.15.49:0/2549285381 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dcc19fb70 con 0x7f1dcc100900 2024-06-03T00:02:23.284 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.281+0000 7f1dc8ff9640 1 -- 172.21.15.49:0/2549285381 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dbc003ad0 con 0x7f1dcc100900 2024-06-03T00:02:23.284 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.281+0000 7f1dc8ff9640 1 -- 172.21.15.49:0/2549285381 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc035070 con 0x7f1dcc100900 2024-06-03T00:02:23.284 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.281+0000 7f1dd2130640 1 -- 172.21.15.49:0/2549285381 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dcc1a0060 con 0x7f1dcc100900 2024-06-03T00:02:23.290 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.283+0000 7f1dc8ff9640 1 -- 172.21.15.49:0/2549285381 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1dbc042030 con 0x7f1dcc100900 2024-06-03T00:02:23.290 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.283+0000 7f1dd4e3f740 1 Processor -- start 2024-06-03T00:02:23.290 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.283+0000 7f1dd4e3f740 1 -- start start 2024-06-03T00:02:23.290 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.283+0000 7f1dd4e3f740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555cf9eb1420 0x555cf9eb1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:23.290 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.283+0000 7f1dd4e3f740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555cf9eb1e10 0x555cf9eb6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:23.290 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.283+0000 7f1dd4e3f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555cf9eb6f80 0x555cf9eb9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:23.290 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.283+0000 7f1dd4e3f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x555cf9e104f0 con 0x555cf9eb6f80 2024-06-03T00:02:23.290 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.283+0000 7f1dd4e3f740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x555cf9dae870 con 0x555cf9eb1420 2024-06-03T00:02:23.290 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.283+0000 7f1dd4e3f740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x555cf9e0c4b0 con 0x555cf9eb1e10 2024-06-03T00:02:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.284+0000 7f1dcaffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555cf9eb6f80 0x555cf9eb9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.284+0000 7f1dcb7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555cf9eb1e10 0x555cf9eb6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.284+0000 7f1dcaffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555cf9eb6f80 0x555cf9eb9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50108/0 (socket says 172.21.15.49:50108) 2024-06-03T00:02:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.284+0000 7f1dcaffd640 1 -- 172.21.15.49:0/765608879 learned_addr learned my addr 172.21.15.49:0/765608879 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.284+0000 7f1dcbfff640 1 --2- 172.21.15.49:0/765608879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555cf9eb1420 0x555cf9eb1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.284+0000 7f1dcaffd640 1 -- 172.21.15.49:0/765608879 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555cf9eb1e10 msgr2=0x555cf9eb6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.284+0000 7f1dcaffd640 1 --2- 172.21.15.49:0/765608879 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555cf9eb1e10 0x555cf9eb6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.284+0000 7f1dcaffd640 1 -- 172.21.15.49:0/765608879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555cf9eb1420 msgr2=0x555cf9eb1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.284+0000 7f1dcaffd640 1 --2- 172.21.15.49:0/765608879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555cf9eb1420 0x555cf9eb1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.284+0000 7f1dcaffd640 1 -- 172.21.15.49:0/765608879 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cf9dca9b0 con 0x555cf9eb6f80 2024-06-03T00:02:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.284+0000 7f1dc8ff9640 1 --2- 172.21.15.49:0/2549285381 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1db40a2c30 0x7f1db40a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.284+0000 7f1dcbfff640 1 --2- 172.21.15.49:0/765608879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555cf9eb1420 0x555cf9eb1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:02:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.284+0000 7f1dcb7fe640 1 --2- 172.21.15.49:0/2549285381 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1db40a2c30 0x7f1db40a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.284+0000 7f1dcaffd640 1 --2- 172.21.15.49:0/765608879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555cf9eb6f80 0x555cf9eb9410 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0009c90 tx=0x7f1dc0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd800a4bec4b4140 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.284+0000 7f1dc8ff9640 1 -- 172.21.15.49:0/2549285381 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f1dbc0ef6c0 con 0x7f1dcc100900 2024-06-03T00:02:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.284+0000 7f1db1ffb640 1 -- 172.21.15.49:0/765608879 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc001e070 con 0x555cf9eb6f80 2024-06-03T00:02:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.284+0000 7f1db1ffb640 1 -- 172.21.15.49:0/765608879 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dc0019b10 con 0x555cf9eb6f80 2024-06-03T00:02:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.284+0000 7f1db1ffb640 1 -- 172.21.15.49:0/765608879 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc000ea00 con 0x555cf9eb6f80 2024-06-03T00:02:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.285+0000 7f1dd4e3f740 1 -- 172.21.15.49:0/765608879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555cf9eb6f80 msgr2=0x555cf9eb9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.285+0000 7f1dcb7fe640 1 --2- 172.21.15.49:0/2549285381 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1db40a2c30 0x7f1db40a50f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc0b89a0 tx=0x7f1dbc0f5530 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.285+0000 7f1dd4e3f740 1 --2- 172.21.15.49:0/765608879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555cf9eb6f80 0x555cf9eb9410 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0009c90 tx=0x7f1dc0011810 comp rx=0 tx=0).stop 2024-06-03T00:02:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.285+0000 7f1dd4e3f740 1 -- 172.21.15.49:0/765608879 shutdown_connections 2024-06-03T00:02:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.285+0000 7f1dd4e3f740 1 --2- 172.21.15.49:0/765608879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555cf9eb6f80 0x555cf9eb9410 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.285+0000 7f1dd4e3f740 1 --2- 172.21.15.49:0/765608879 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555cf9eb1e10 0x555cf9eb6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.285+0000 7f1dd4e3f740 1 --2- 172.21.15.49:0/765608879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555cf9eb1420 0x555cf9eb1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.285+0000 7f1dd4e3f740 1 -- 172.21.15.49:0/765608879 >> 172.21.15.49:0/765608879 conn(0x555cf9ea8680 msgr2=0x555cf9ea8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.285+0000 7f1dd4e3f740 1 -- 172.21.15.49:0/765608879 shutdown_connections 2024-06-03T00:02:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.285+0000 7f1dd4e3f740 1 -- 172.21.15.49:0/765608879 wait complete. 2024-06-03T00:02:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.285+0000 7f1dd4e3f740 1 -- start start 2024-06-03T00:02:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.286+0000 7f1dd4e3f740 1 Processor -- start 2024-06-03T00:02:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.286+0000 7f1dd4e3f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555cf9eb1420 0x555cf9ebb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.286+0000 7f1dd4e3f740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555cf9eb1e10 0x555cf9ebbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.286+0000 7f1dd4e3f740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555cf9eb6f80 0x555cf9ec2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.286+0000 7f1dd4e3f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x555cf9eb9f30 con 0x555cf9eb1420 2024-06-03T00:02:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.286+0000 7f1dd4e3f740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x555cf9d99ae0 con 0x555cf9eb1e10 2024-06-03T00:02:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.286+0000 7f1dd4e3f740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x555cf9eba0b0 con 0x555cf9eb6f80 2024-06-03T00:02:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.286+0000 7f1dd4e3f740 10 client.0 _ll_register_callbacks cb 0x555cf9dd29b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:02:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.286+0000 7f1dcbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555cf9eb1420 0x555cf9ebb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:23.294 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.286+0000 7f1dcbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555cf9eb1420 0x555cf9ebb660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50112/0 (socket says 172.21.15.49:50112) 2024-06-03T00:02:23.294 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.286+0000 7f1dcbfff640 1 -- 172.21.15.49:0/4062449181 learned_addr learned my addr 172.21.15.49:0/4062449181 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:23.294 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.286+0000 7f1dcbfff640 1 --2- 172.21.15.49:0/4062449181 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555cf9eb6f80 0x555cf9ec2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:23.294 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.286+0000 7f1dcaffd640 1 --2- 172.21.15.49:0/4062449181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555cf9eb1e10 0x555cf9ebbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:23.294 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.286+0000 7f1dcbfff640 1 -- 172.21.15.49:0/4062449181 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555cf9eb6f80 msgr2=0x555cf9ec2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:23.294 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.286+0000 7f1dcbfff640 1 --2- 172.21.15.49:0/4062449181 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555cf9eb6f80 0x555cf9ec2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:23.294 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.286+0000 7f1dcbfff640 1 -- 172.21.15.49:0/4062449181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555cf9eb1e10 msgr2=0x555cf9ebbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:23.294 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.286+0000 7f1dcbfff640 1 --2- 172.21.15.49:0/4062449181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555cf9eb1e10 0x555cf9ebbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:23.294 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.286+0000 7f1dcbfff640 1 -- 172.21.15.49:0/4062449181 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cf9b24210 con 0x555cf9eb1420 2024-06-03T00:02:23.294 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.287+0000 7f1dcbfff640 1 --2- 172.21.15.49:0/4062449181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555cf9eb1420 0x555cf9ebb660 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4010730 tx=0x7f1dc4009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=603c31be9edc8786 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:23.294 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.287+0000 7f1daaffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:02:23.294 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.287+0000 7f1daaffd640 1 -- 172.21.15.49:0/4062449181 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc40140d0 con 0x555cf9eb1420 2024-06-03T00:02:23.295 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.287+0000 7f1dd4e3f740 1 -- 172.21.15.49:0/4062449181 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1dc0019b10 con 0x555cf9eb1420 2024-06-03T00:02:23.295 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.287+0000 7f1daaffd640 1 -- 172.21.15.49:0/4062449181 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f1dc400e750 con 0x555cf9eb1420 2024-06-03T00:02:23.295 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.287+0000 7f1daaffd640 1 -- 172.21.15.49:0/4062449181 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1dc4028050 con 0x555cf9eb1420 2024-06-03T00:02:23.295 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.287+0000 7f1dd4e3f740 10 client.15771 fetch_fsmap learned FSMap version 27 2024-06-03T00:02:23.295 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.287+0000 7f1dd4e3f740 1 -- 172.21.15.49:0/4062449181 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555cf9bf0620 con 0x555cf9eb1420 2024-06-03T00:02:23.295 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.287+0000 7f1daaffd640 1 -- 172.21.15.49:0/4062449181 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dc0019b10 con 0x555cf9eb1420 2024-06-03T00:02:23.295 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.287+0000 7f1daaffd640 1 -- 172.21.15.49:0/4062449181 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f1dc400f040 con 0x555cf9eb1420 2024-06-03T00:02:23.295 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.287+0000 7f1dd4e3f740 10 client.15771 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:02:23.295 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.287+0000 7f1dd4e3f740 10 client.15771 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:02:23.295 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.287+0000 7f1dd4e3f740 20 client.15771 populate_metadata read hostname 'smithi049' 2024-06-03T00:02:23.295 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.288+0000 7f1dd4e3f740 1 --2- 172.21.15.49:0/4062449181 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x555cf9ec74c0 0x555cf9ec9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:23.295 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.288+0000 7f1dd4e3f740 4 client.15771 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:02:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.288+0000 7f1dd4e3f740 1 -- 172.21.15.49:0/4062449181 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555cf9e23f10 con 0x555cf9ec74c0 2024-06-03T00:02:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.288+0000 7f1dcaffd640 1 --2- 172.21.15.49:0/4062449181 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x555cf9ec74c0 0x555cf9ec9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.288+0000 7f1daaffd640 10 client.15771 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.288+0000 7f1dcaffd640 1 --2- 172.21.15.49:0/4062449181 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x555cf9ec74c0 0x555cf9ec9950 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bb60cc6ab2aeb32 server_cookie=609e301b60596427 in_seq=0 out_seq=0 2024-06-03T00:02:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.289+0000 7f1daaffd640 1 -- 172.21.15.49:0/4062449181 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x555cf9e23f10 con 0x555cf9ec74c0 2024-06-03T00:02:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.289+0000 7f1daaffd640 10 client.15771 handle_command_reply: tid=0 2024-06-03T00:02:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.289+0000 7f1dd4e3f740 1 client.15771 shutdown 2024-06-03T00:02:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.289+0000 7f1dd4e3f740 1 -- 172.21.15.49:0/4062449181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555cf9eb1420 msgr2=0x555cf9ebb660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.289+0000 7f1dd4e3f740 1 --2- 172.21.15.49:0/4062449181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555cf9eb1420 0x555cf9ebb660 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4010730 tx=0x7f1dc4009e90 comp rx=0 tx=0).stop 2024-06-03T00:02:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.290+0000 7f1dd4e3f740 1 -- 172.21.15.49:0/4062449181 shutdown_connections 2024-06-03T00:02:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.290+0000 7f1dd4e3f740 1 --2- 172.21.15.49:0/4062449181 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x555cf9ec74c0 0x555cf9ec9950 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.290+0000 7f1dd4e3f740 1 --2- 172.21.15.49:0/4062449181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555cf9eb1e10 0x555cf9ebbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.290+0000 7f1dd4e3f740 1 --2- 172.21.15.49:0/4062449181 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555cf9eb6f80 0x555cf9ec2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.290+0000 7f1daaffd640 0 client.15771 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.290+0000 7f1dd4e3f740 1 --2- 172.21.15.49:0/4062449181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555cf9eb1420 0x555cf9ebb660 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.290+0000 7f1dd4e3f740 1 -- 172.21.15.49:0/4062449181 >> 172.21.15.49:0/4062449181 conn(0x555cf9ea8680 msgr2=0x555cf9ea77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.290+0000 7f1dd4e3f740 1 -- 172.21.15.49:0/4062449181 shutdown_connections 2024-06-03T00:02:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.290+0000 7f1dd4e3f740 1 -- 172.21.15.49:0/4062449181 wait complete. 2024-06-03T00:02:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.290+0000 7f1dd4e3f740 20 client.15771 trim_cache size 0 max 16384 2024-06-03T00:02:23.309 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.305+0000 7f1dd4e3f740 1 Processor -- start 2024-06-03T00:02:23.309 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.305+0000 7f1dd4e3f740 1 -- start start 2024-06-03T00:02:23.309 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.305+0000 7f1dd4e3f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555cf9eb1420 0x555cf9eab590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:23.309 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.305+0000 7f1dd4e3f740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555cf9eb1e10 0x555cf9ec2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:23.309 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.305+0000 7f1dd4e3f740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555cf9eb6f80 0x555cf9eabad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:23.309 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.305+0000 7f1dd4e3f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc1a6d00 con 0x555cf9eb1420 2024-06-03T00:02:23.309 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.305+0000 7f1dd4e3f740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc1a8840 con 0x555cf9eb1e10 2024-06-03T00:02:23.309 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.305+0000 7f1dd4e3f740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc1a73d0 con 0x555cf9eb6f80 2024-06-03T00:02:23.309 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.305+0000 7f1dcbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555cf9eb1420 0x555cf9eab590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:23.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.305+0000 7f1dcbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555cf9eb1420 0x555cf9eab590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50122/0 (socket says 172.21.15.49:50122) 2024-06-03T00:02:23.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.305+0000 7f1dcbfff640 1 -- 172.21.15.49:0/474097180 learned_addr learned my addr 172.21.15.49:0/474097180 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:23.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.306+0000 7f1dcbfff640 1 --2- 172.21.15.49:0/474097180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555cf9eb6f80 0x555cf9eabad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:23.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.306+0000 7f1dcbfff640 1 -- 172.21.15.49:0/474097180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555cf9eb6f80 msgr2=0x555cf9eabad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:23.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.306+0000 7f1dcbfff640 1 --2- 172.21.15.49:0/474097180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555cf9eb6f80 0x555cf9eabad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:23.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.306+0000 7f1dcbfff640 1 -- 172.21.15.49:0/474097180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555cf9eb1e10 msgr2=0x555cf9ec2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:23.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.306+0000 7f1dcbfff640 1 --2- 172.21.15.49:0/474097180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555cf9eb1e10 0x555cf9ec2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:23.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.306+0000 7f1dcbfff640 1 -- 172.21.15.49:0/474097180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cf9ea84b0 con 0x555cf9eb1420 2024-06-03T00:02:23.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.306+0000 7f1dcbfff640 1 --2- 172.21.15.49:0/474097180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555cf9eb1420 0x555cf9eab590 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1dc40127d0 tx=0x7f1dc4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cfd8af4ff67e5fc server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:23.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.306+0000 7f1db17fa640 1 -- 172.21.15.49:0/474097180 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc40140d0 con 0x555cf9eb1420 2024-06-03T00:02:23.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.306+0000 7f1db17fa640 1 -- 172.21.15.49:0/474097180 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dc4012480 con 0x555cf9eb1420 2024-06-03T00:02:23.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.306+0000 7f1db17fa640 1 -- 172.21.15.49:0/474097180 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4004c00 con 0x555cf9eb1420 2024-06-03T00:02:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.307+0000 7f1dd4e3f740 1 -- 172.21.15.49:0/474097180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555cf9eb1420 msgr2=0x555cf9eab590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.307+0000 7f1dd4e3f740 1 --2- 172.21.15.49:0/474097180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555cf9eb1420 0x555cf9eab590 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1dc40127d0 tx=0x7f1dc4009840 comp rx=0 tx=0).stop 2024-06-03T00:02:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.307+0000 7f1dd4e3f740 1 -- 172.21.15.49:0/474097180 shutdown_connections 2024-06-03T00:02:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.307+0000 7f1dd4e3f740 1 --2- 172.21.15.49:0/474097180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555cf9eb1e10 0x555cf9ec2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.307+0000 7f1dd4e3f740 1 --2- 172.21.15.49:0/474097180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555cf9eb6f80 0x555cf9eabad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.307+0000 7f1dd4e3f740 1 --2- 172.21.15.49:0/474097180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555cf9eb1420 0x555cf9eab590 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.307+0000 7f1dd4e3f740 1 -- 172.21.15.49:0/474097180 >> 172.21.15.49:0/474097180 conn(0x555cf9ea8680 msgr2=0x555cf9eb3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.307+0000 7f1dd4e3f740 1 -- 172.21.15.49:0/474097180 shutdown_connections 2024-06-03T00:02:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.307+0000 7f1dd4e3f740 1 -- 172.21.15.49:0/474097180 wait complete. 2024-06-03T00:02:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.307+0000 7f1dd4e3f740 1 -- start start 2024-06-03T00:02:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.307+0000 7f1dd4e3f740 1 Processor -- start 2024-06-03T00:02:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.307+0000 7f1dd4e3f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555cf9eb1420 0x555cf9ebf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.308+0000 7f1dd4e3f740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555cf9eb1e10 0x555cf9ebfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.308+0000 7f1dd4e3f740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555cf9eb6f80 0x555cf9f30220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.308+0000 7f1dd4e3f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc1a8170 con 0x555cf9eb1420 2024-06-03T00:02:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.308+0000 7f1dd4e3f740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc1a7aa0 con 0x555cf9eb1e10 2024-06-03T00:02:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.308+0000 7f1dd4e3f740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc1a4cc0 con 0x555cf9eb6f80 2024-06-03T00:02:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.308+0000 7f1dcbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555cf9eb1420 0x555cf9ebf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.308+0000 7f1dd4e3f740 10 client.0 _ll_register_callbacks cb 0x7f1dc4014410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:02:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.308+0000 7f1dcbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555cf9eb1420 0x555cf9ebf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50128/0 (socket says 172.21.15.49:50128) 2024-06-03T00:02:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.308+0000 7f1dcbfff640 1 -- 172.21.15.49:0/3581208273 learned_addr learned my addr 172.21.15.49:0/3581208273 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.308+0000 7f1dcbfff640 1 --2- 172.21.15.49:0/3581208273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555cf9eb6f80 0x555cf9f30220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.308+0000 7f1dcaffd640 1 --2- 172.21.15.49:0/3581208273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555cf9eb1e10 0x555cf9ebfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.308+0000 7f1dcbfff640 1 -- 172.21.15.49:0/3581208273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555cf9eb6f80 msgr2=0x555cf9f30220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.308+0000 7f1dcbfff640 1 --2- 172.21.15.49:0/3581208273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555cf9eb6f80 0x555cf9f30220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.308+0000 7f1dcbfff640 1 -- 172.21.15.49:0/3581208273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555cf9eb1e10 msgr2=0x555cf9ebfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.308+0000 7f1dcbfff640 1 --2- 172.21.15.49:0/3581208273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555cf9eb1e10 0x555cf9ebfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.308+0000 7f1dcbfff640 1 -- 172.21.15.49:0/3581208273 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cf9ec2cd0 con 0x555cf9eb1420 2024-06-03T00:02:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.308+0000 7f1dcbfff640 1 --2- 172.21.15.49:0/3581208273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555cf9eb1420 0x555cf9ebf710 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4009ef0 tx=0x7f1dc4014350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8fb02606ac9e2ec server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.308+0000 7f1daaffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:02:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.308+0000 7f1daaffd640 1 -- 172.21.15.49:0/3581208273 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4030040 con 0x555cf9eb1420 2024-06-03T00:02:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.308+0000 7f1daaffd640 1 -- 172.21.15.49:0/3581208273 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f1dc4012bd0 con 0x555cf9eb1420 2024-06-03T00:02:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.308+0000 7f1dd4e3f740 1 -- 172.21.15.49:0/3581208273 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1dc4012480 con 0x555cf9eb1420 2024-06-03T00:02:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.308+0000 7f1daaffd640 1 -- 172.21.15.49:0/3581208273 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1dc4012dd0 con 0x555cf9eb1420 2024-06-03T00:02:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.308+0000 7f1dd4e3f740 10 client.15777 fetch_fsmap learned FSMap version 27 2024-06-03T00:02:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.308+0000 7f1dd4e3f740 1 -- 172.21.15.49:0/3581208273 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555cf9f31640 con 0x555cf9eb1420 2024-06-03T00:02:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.309+0000 7f1daaffd640 1 -- 172.21.15.49:0/3581208273 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dc4012480 con 0x555cf9eb1420 2024-06-03T00:02:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.309+0000 7f1daaffd640 1 -- 172.21.15.49:0/3581208273 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f1dc4036040 con 0x555cf9eb1420 2024-06-03T00:02:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.309+0000 7f1dd4e3f740 10 client.15777 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:02:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.309+0000 7f1dd4e3f740 10 client.15777 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:02:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.309+0000 7f1dd4e3f740 20 client.15777 populate_metadata read hostname 'smithi049' 2024-06-03T00:02:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.309+0000 7f1dd4e3f740 1 --2- 172.21.15.49:0/3581208273 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x555cf9f31f00 0x555cf9f34320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.309+0000 7f1dd4e3f740 4 client.15777 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-03T00:02:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.309+0000 7f1dd4e3f740 1 -- 172.21.15.49:0/3581208273 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555cf9e1dc20 con 0x555cf9f31f00 2024-06-03T00:02:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.309+0000 7f1dcaffd640 1 --2- 172.21.15.49:0/3581208273 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x555cf9f31f00 0x555cf9f34320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.309+0000 7f1dcaffd640 1 --2- 172.21.15.49:0/3581208273 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x555cf9f31f00 0x555cf9f34320 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96e30611c9bd5d85 server_cookie=ec8263b216b8ac30 in_seq=0 out_seq=0 2024-06-03T00:02:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:23.309+0000 7f1daaffd640 10 client.15777 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:24.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.159+0000 7f7d08152700 1 -- 172.21.15.49:0/1034131033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d00101390 msgr2=0x7f7d00101810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:24.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.159+0000 7f7d08152700 1 --2- 172.21.15.49:0/1034131033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d00101390 0x7f7d00101810 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4009990 tx=0x7f7cf4009ca0 comp rx=0 tx=0).stop 2024-06-03T00:02:24.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.159+0000 7f7d08152700 1 -- 172.21.15.49:0/1034131033 shutdown_connections 2024-06-03T00:02:24.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.159+0000 7f7d08152700 1 --2- 172.21.15.49:0/1034131033 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d00101d50 0x7f7d0010e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:24.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.159+0000 7f7d08152700 1 --2- 172.21.15.49:0/1034131033 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d00107400 0x7f7d001077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:24.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.159+0000 7f7d08152700 1 --2- 172.21.15.49:0/1034131033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d00101390 0x7f7d00101810 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:24.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.159+0000 7f7d08152700 1 -- 172.21.15.49:0/1034131033 >> 172.21.15.49:0/1034131033 conn(0x7f7d00078340 msgr2=0x7f7d00078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:24.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.159+0000 7f7d08152700 1 -- 172.21.15.49:0/1034131033 shutdown_connections 2024-06-03T00:02:24.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.159+0000 7f7d08152700 1 -- 172.21.15.49:0/1034131033 wait complete. 2024-06-03T00:02:24.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.160+0000 7f7d08152700 1 Processor -- start 2024-06-03T00:02:24.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.160+0000 7f7d08152700 1 -- start start 2024-06-03T00:02:24.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.160+0000 7f7d08152700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d00101390 0x7f7d0019d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:24.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.160+0000 7f7d08152700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d00101d50 0x7f7d0019dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:24.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.160+0000 7f7d08152700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d00107400 0x7f7d00197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:24.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.160+0000 7f7d08152700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7d00111690 con 0x7f7d00107400 2024-06-03T00:02:24.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.160+0000 7f7d08152700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f7d00111510 con 0x7f7d00101390 2024-06-03T00:02:24.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.160+0000 7f7d08152700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7d00111810 con 0x7f7d00101d50 2024-06-03T00:02:24.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.160+0000 7f7d066ef700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d00107400 0x7f7d00197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:24.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.160+0000 7f7d066ef700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d00107400 0x7f7d00197950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50150/0 (socket says 172.21.15.49:50150) 2024-06-03T00:02:24.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.160+0000 7f7d066ef700 1 -- 172.21.15.49:0/4241926806 learned_addr learned my addr 172.21.15.49:0/4241926806 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:24.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.160+0000 7f7d056ed700 1 --2- 172.21.15.49:0/4241926806 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d00101d50 0x7f7d0019dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:24.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.161+0000 7f7d05eee700 1 --2- 172.21.15.49:0/4241926806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d00101390 0x7f7d0019d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:24.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.161+0000 7f7d056ed700 1 -- 172.21.15.49:0/4241926806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d00101390 msgr2=0x7f7d0019d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:24.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.161+0000 7f7d056ed700 1 --2- 172.21.15.49:0/4241926806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d00101390 0x7f7d0019d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:24.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.161+0000 7f7d056ed700 1 -- 172.21.15.49:0/4241926806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d00107400 msgr2=0x7f7d00197950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:24.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.161+0000 7f7d056ed700 1 --2- 172.21.15.49:0/4241926806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d00107400 0x7f7d00197950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:24.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.161+0000 7f7d056ed700 1 -- 172.21.15.49:0/4241926806 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d001980b0 con 0x7f7d00101d50 2024-06-03T00:02:24.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.161+0000 7f7d066ef700 1 --2- 172.21.15.49:0/4241926806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d00107400 0x7f7d00197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:02:24.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.161+0000 7f7d056ed700 1 --2- 172.21.15.49:0/4241926806 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d00101d50 0x7f7d0019dcd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7cf40059d0 tx=0x7f7cf400bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:24.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.162+0000 7f7cf2ffd700 1 -- 172.21.15.49:0/4241926806 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4027070 con 0x7f7d00101d50 2024-06-03T00:02:24.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.162+0000 7f7d08152700 1 -- 172.21.15.49:0/4241926806 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d00198340 con 0x7f7d00101d50 2024-06-03T00:02:24.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.162+0000 7f7cf2ffd700 1 -- 172.21.15.49:0/4241926806 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7cf4003d70 con 0x7f7d00101d50 2024-06-03T00:02:24.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.162+0000 7f7cf2ffd700 1 -- 172.21.15.49:0/4241926806 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf400f460 con 0x7f7d00101d50 2024-06-03T00:02:24.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.162+0000 7f7d08152700 1 -- 172.21.15.49:0/4241926806 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d001a4660 con 0x7f7d00101d50 2024-06-03T00:02:24.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.163+0000 7f7d08152700 1 -- 172.21.15.49:0/4241926806 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d00069180 con 0x7f7d00101d50 2024-06-03T00:02:24.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.164+0000 7f7cf2ffd700 1 -- 172.21.15.49:0/4241926806 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7cf402a070 con 0x7f7d00101d50 2024-06-03T00:02:24.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.165+0000 7f7cf2ffd700 1 --2- 172.21.15.49:0/4241926806 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7cec0a2c20 0x7f7cec0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:24.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.165+0000 7f7d05eee700 1 --2- 172.21.15.49:0/4241926806 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7cec0a2c20 0x7f7cec0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:24.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.165+0000 7f7cf2ffd700 1 -- 172.21.15.49:0/4241926806 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f7cf40d03a0 con 0x7f7d00101d50 2024-06-03T00:02:24.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.165+0000 7f7d05eee700 1 --2- 172.21.15.49:0/4241926806 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7cec0a2c20 0x7f7cec0a50e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7d00198a90 tx=0x7f7cfc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:24.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.172+0000 7f7cf2ffd700 1 -- 172.21.15.49:0/4241926806 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7cf4013070 con 0x7f7d00101d50 2024-06-03T00:02:24.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:24.333+0000 7f1daaffd640 1 -- 172.21.15.49:0/3581208273 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x555cf9e1dc20 con 0x555cf9f31f00 2024-06-03T00:02:24.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:24.333+0000 7f1daaffd640 10 client.15777 handle_command_reply: tid=0 2024-06-03T00:02:24.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:24.333+0000 7f1dd4e3f740 1 client.15777 shutdown 2024-06-03T00:02:24.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:24.334+0000 7f1dd4e3f740 1 -- 172.21.15.49:0/3581208273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555cf9eb1420 msgr2=0x555cf9ebf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:24.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:24.334+0000 7f1dd4e3f740 1 --2- 172.21.15.49:0/3581208273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555cf9eb1420 0x555cf9ebf710 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4009ef0 tx=0x7f1dc4014350 comp rx=0 tx=0).stop 2024-06-03T00:02:24.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:24.334+0000 7f1dd4e3f740 1 -- 172.21.15.49:0/3581208273 shutdown_connections 2024-06-03T00:02:24.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:24.334+0000 7f1dd4e3f740 1 --2- 172.21.15.49:0/3581208273 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x555cf9f31f00 0x555cf9f34320 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:24.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:24.334+0000 7f1dd4e3f740 1 --2- 172.21.15.49:0/3581208273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555cf9eb1e10 0x555cf9ebfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:24.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:24.334+0000 7f1dd4e3f740 1 --2- 172.21.15.49:0/3581208273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555cf9eb6f80 0x555cf9f30220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:24.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:24.334+0000 7f1daaffd640 0 client.15777 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:24.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:24.334+0000 7f1dd4e3f740 1 --2- 172.21.15.49:0/3581208273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555cf9eb1420 0x555cf9ebf710 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:24.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:24.334+0000 7f1dd4e3f740 1 -- 172.21.15.49:0/3581208273 >> 172.21.15.49:0/3581208273 conn(0x555cf9ea8680 msgr2=0x555cf9eab590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:24.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:24.334+0000 7f1dd4e3f740 1 -- 172.21.15.49:0/3581208273 shutdown_connections 2024-06-03T00:02:24.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:24.334+0000 7f1dd4e3f740 1 -- 172.21.15.49:0/3581208273 wait complete. 2024-06-03T00:02:24.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:24.334+0000 7f1dd4e3f740 20 client.15777 trim_cache size 0 max 16384 2024-06-03T00:02:24.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-06-03T00:02:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-06-03T00:02:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-06-03T00:02:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:24.334+0000 7f1dd2130640 1 -- 172.21.15.49:0/2549285381 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1db40a2c30 msgr2=0x7f1db40a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:24.334+0000 7f1dd2130640 1 --2- 172.21.15.49:0/2549285381 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1db40a2c30 0x7f1db40a50f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc0b89a0 tx=0x7f1dbc0f5530 comp rx=0 tx=0).stop 2024-06-03T00:02:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:24.334+0000 7f1dd2130640 1 -- 172.21.15.49:0/2549285381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dcc100900 msgr2=0x7f1dcc069bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:24.334+0000 7f1dd2130640 1 --2- 172.21.15.49:0/2549285381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dcc100900 0x7f1dcc069bc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc031610 tx=0x7f1dbc004270 comp rx=0 tx=0).stop 2024-06-03T00:02:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:24.335+0000 7f1dd2130640 1 -- 172.21.15.49:0/2549285381 shutdown_connections 2024-06-03T00:02:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:24.335+0000 7f1dd2130640 1 --2- 172.21.15.49:0/2549285381 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1db40a2c30 0x7f1db40a50f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:24.335+0000 7f1dd2130640 1 --2- 172.21.15.49:0/2549285381 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1dcc101af0 0x7f1dcc19ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:24.335+0000 7f1dd2130640 1 --2- 172.21.15.49:0/2549285381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1dcc1024b0 0x7f1dcc19f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:24.335+0000 7f1dd2130640 1 --2- 172.21.15.49:0/2549285381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dcc100900 0x7f1dcc069bc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:24.335+0000 7f1dd2130640 1 -- 172.21.15.49:0/2549285381 >> 172.21.15.49:0/2549285381 conn(0x7f1dcc0fbe70 msgr2=0x7f1dcc104df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:24.335+0000 7f1dd2130640 1 -- 172.21.15.49:0/2549285381 shutdown_connections 2024-06-03T00:02:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:24.335+0000 7f1dd2130640 1 -- 172.21.15.49:0/2549285381 wait complete. 2024-06-03T00:02:24.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.460+0000 7f7d08152700 1 -- 172.21.15.49:0/4241926806 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d0002dca0 con 0x7f7d00101d50 2024-06-03T00:02:24.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.461+0000 7f7cf2ffd700 1 -- 172.21.15.49:0/4241926806 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11929 (secure 0 0 0) 0x7f7cf409d350 con 0x7f7d00101d50 2024-06-03T00:02:24.464 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:02:24.464 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1553264866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1553264866},{"type":"v1","addr":"172.21.15.49:6835","nonce":1553264866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2266285252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2266285252},{"type":"v1","addr":"172.21.15.49:6837","nonce":2266285252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T23:57:16.991201+0000","modified":"2024-06-03T00:00:26.305285+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24485,"mds_2":24466,"mds_3":24464,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6839/1729124617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":1729124617},{"type":"v1","addr":"172.21.15.49:6839","nonce":1729124617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6841/1902772235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":1902772235},{"type":"v1","addr":"172.21.15.49:6841","nonce":1902772235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6833/1633534002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1633534002},{"type":"v1","addr":"172.21.15.57:6833","nonce":1633534002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6835/2254905671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2254905671},{"type":"v1","addr":"172.21.15.57:6835","nonce":2254905671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.107:6835/3693542801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3693542801},{"type":"v1","addr":"172.21.15.107:6835","nonce":3693542801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.57:6837/230452144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":230452144},{"type":"v1","addr":"172.21.15.57:6837","nonce":230452144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.107:6837/3700593315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":3700593315},{"type":"v1","addr":"172.21.15.107:6837","nonce":3700593315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6839/249825195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":249825195},{"type":"v1","addr":"172.21.15.57:6839","nonce":249825195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6839/1986600681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1986600681},{"type":"v1","addr":"172.21.15.107:6839","nonce":1986600681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24485,24464,24460,24466,24487]},"id":1}]} 2024-06-03T00:02:24.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.463+0000 7f7d08152700 1 -- 172.21.15.49:0/4241926806 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7cec0a2c20 msgr2=0x7f7cec0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:24.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.463+0000 7f7d08152700 1 --2- 172.21.15.49:0/4241926806 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7cec0a2c20 0x7f7cec0a50e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7d00198a90 tx=0x7f7cfc009260 comp rx=0 tx=0).stop 2024-06-03T00:02:24.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.463+0000 7f7d08152700 1 -- 172.21.15.49:0/4241926806 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d00101d50 msgr2=0x7f7d0019dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:24.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.463+0000 7f7d08152700 1 --2- 172.21.15.49:0/4241926806 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d00101d50 0x7f7d0019dcd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7cf40059d0 tx=0x7f7cf400bab0 comp rx=0 tx=0).stop 2024-06-03T00:02:24.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.463+0000 7f7d08152700 1 -- 172.21.15.49:0/4241926806 shutdown_connections 2024-06-03T00:02:24.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.463+0000 7f7d08152700 1 --2- 172.21.15.49:0/4241926806 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7cec0a2c20 0x7f7cec0a50e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:24.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.463+0000 7f7d08152700 1 --2- 172.21.15.49:0/4241926806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7d00107400 0x7f7d00197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:24.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.463+0000 7f7d08152700 1 --2- 172.21.15.49:0/4241926806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d00101390 0x7f7d0019d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:24.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.463+0000 7f7d08152700 1 --2- 172.21.15.49:0/4241926806 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d00101d50 0x7f7d0019dcd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:24.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.463+0000 7f7d08152700 1 -- 172.21.15.49:0/4241926806 >> 172.21.15.49:0/4241926806 conn(0x7f7d00078340 msgr2=0x7f7d000ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:24.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.463+0000 7f7d08152700 1 -- 172.21.15.49:0/4241926806 shutdown_connections 2024-06-03T00:02:24.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:24.463+0000 7f7d08152700 1 -- 172.21.15.49:0/4241926806 wait complete. 2024-06-03T00:02:24.466 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 27 2024-06-03T00:02:24.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:24 smithi049 ceph-mon[32302]: pgmap v454: 97 pgs: 97 active+clean; 674 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:02:24.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:24 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/4241926806' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:02:24.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:24 smithi107 ceph-mon[37048]: pgmap v454: 97 pgs: 97 active+clean; 674 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:02:24.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:24 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/4241926806' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:02:24.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:24 smithi057 ceph-mon[36457]: pgmap v454: 97 pgs: 97 active+clean; 674 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-03T00:02:24.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:24 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/4241926806' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:02:25.125 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-06-03T00:02:25.418 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:02:26.818 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:26 smithi049 ceph-mon[32302]: pgmap v455: 97 pgs: 97 active+clean; 674 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 20 KiB/s wr, 26 op/s 2024-06-03T00:02:26.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:26 smithi107 ceph-mon[37048]: pgmap v455: 97 pgs: 97 active+clean; 674 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 20 KiB/s wr, 26 op/s 2024-06-03T00:02:26.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:26 smithi057 ceph-mon[36457]: pgmap v455: 97 pgs: 97 active+clean; 674 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 20 KiB/s wr, 26 op/s 2024-06-03T00:02:27.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.164+0000 7fbbad781700 1 -- 172.21.15.49:0/1992878249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbba8102550 msgr2=0x7fbba81029d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:27.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.164+0000 7fbbad781700 1 --2- 172.21.15.49:0/1992878249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbba8102550 0x7fbba81029d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fbb90009990 tx=0x7fbb90009ca0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.164+0000 7fbbad781700 1 -- 172.21.15.49:0/1992878249 shutdown_connections 2024-06-03T00:02:27.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.164+0000 7fbbad781700 1 --2- 172.21.15.49:0/1992878249 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbba8102f10 0x7fbba810f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.164+0000 7fbbad781700 1 --2- 172.21.15.49:0/1992878249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbba81084f0 0x7fbba81088d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.164+0000 7fbbad781700 1 --2- 172.21.15.49:0/1992878249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbba8102550 0x7fbba81029d0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.164+0000 7fbbad781700 1 -- 172.21.15.49:0/1992878249 >> 172.21.15.49:0/1992878249 conn(0x7fbba8079650 msgr2=0x7fbba8079a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:27.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.164+0000 7fbbad781700 1 -- 172.21.15.49:0/1992878249 shutdown_connections 2024-06-03T00:02:27.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.164+0000 7fbbad781700 1 -- 172.21.15.49:0/1992878249 wait complete. 2024-06-03T00:02:27.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.165+0000 7fbbad781700 1 Processor -- start 2024-06-03T00:02:27.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.165+0000 7fbbad781700 1 -- start start 2024-06-03T00:02:27.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.166+0000 7fbbad781700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbba8102550 0x7fbba8198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:27.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.166+0000 7fbbad781700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbba8102f10 0x7fbba81992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:27.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.166+0000 7fbbad781700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbba81084f0 0x7fbba819d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:27.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.166+0000 7fbbad781700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbba8112850 con 0x7fbba8102f10 2024-06-03T00:02:27.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.166+0000 7fbbad781700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fbba81126d0 con 0x7fbba81084f0 2024-06-03T00:02:27.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.166+0000 7fbbad781700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbba81129d0 con 0x7fbba8102550 2024-06-03T00:02:27.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.166+0000 7fbba67fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbba8102f10 0x7fbba81992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:27.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.166+0000 7fbba67fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbba8102f10 0x7fbba81992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50156/0 (socket says 172.21.15.49:50156) 2024-06-03T00:02:27.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.166+0000 7fbba67fc700 1 -- 172.21.15.49:0/1879188711 learned_addr learned my addr 172.21.15.49:0/1879188711 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:27.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.166+0000 7fbba77fe700 1 --2- 172.21.15.49:0/1879188711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbba81084f0 0x7fbba819d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:27.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.166+0000 7fbba6ffd700 1 --2- 172.21.15.49:0/1879188711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbba8102550 0x7fbba8198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:27.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.166+0000 7fbba67fc700 1 -- 172.21.15.49:0/1879188711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbba8102550 msgr2=0x7fbba8198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:27.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.166+0000 7fbba67fc700 1 --2- 172.21.15.49:0/1879188711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbba8102550 0x7fbba8198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.166+0000 7fbba67fc700 1 -- 172.21.15.49:0/1879188711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbba81084f0 msgr2=0x7fbba819d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:27.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.166+0000 7fbba67fc700 1 --2- 172.21.15.49:0/1879188711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbba81084f0 0x7fbba819d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.166+0000 7fbba67fc700 1 -- 172.21.15.49:0/1879188711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba819dd60 con 0x7fbba8102f10 2024-06-03T00:02:27.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.166+0000 7fbba6ffd700 1 --2- 172.21.15.49:0/1879188711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbba8102550 0x7fbba8198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:02:27.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.166+0000 7fbba67fc700 1 --2- 172.21.15.49:0/1879188711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbba8102f10 0x7fbba81992e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fbb9000bff0 tx=0x7fbb90005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:27.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.166+0000 7fbb9ffff700 1 -- 172.21.15.49:0/1879188711 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb90027070 con 0x7fbba8102f10 2024-06-03T00:02:27.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.166+0000 7fbb9ffff700 1 -- 172.21.15.49:0/1879188711 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb900040d0 con 0x7fbba8102f10 2024-06-03T00:02:27.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.166+0000 7fbbad781700 1 -- 172.21.15.49:0/1879188711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbba819dff0 con 0x7fbba8102f10 2024-06-03T00:02:27.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.167+0000 7fbb9ffff700 1 -- 172.21.15.49:0/1879188711 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb90022e00 con 0x7fbba8102f10 2024-06-03T00:02:27.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.167+0000 7fbbad781700 1 -- 172.21.15.49:0/1879188711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbba81a58d0 con 0x7fbba8102f10 2024-06-03T00:02:27.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.169+0000 7fbb9ffff700 1 -- 172.21.15.49:0/1879188711 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbb9002a070 con 0x7fbba8102f10 2024-06-03T00:02:27.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.169+0000 7fbb9ffff700 1 --2- 172.21.15.49:0/1879188711 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbb940a2ca0 0x7fbb940a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:27.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.170+0000 7fbba6ffd700 1 --2- 172.21.15.49:0/1879188711 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbb940a2ca0 0x7fbb940a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:27.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.170+0000 7fbb9ffff700 1 -- 172.21.15.49:0/1879188711 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fbb900cfdd0 con 0x7fbba8102f10 2024-06-03T00:02:27.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.170+0000 7fbba6ffd700 1 --2- 172.21.15.49:0/1879188711 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbb940a2ca0 0x7fbb940a5160 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbb98009fa0 tx=0x7fbb98009570 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:27.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.170+0000 7fbbb8004b80 1 Processor -- start 2024-06-03T00:02:27.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.170+0000 7fbbb8004b80 1 -- start start 2024-06-03T00:02:27.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.171+0000 7fbbb8004b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d224501640 0x55d224501a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:27.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.171+0000 7fbbb8004b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d224501f60 0x55d2244fb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:27.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.171+0000 7fbbb8004b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2244fbf20 0x55d2244fc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:27.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.171+0000 7fbbb8004b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55d22444d810 con 0x55d2244fbf20 2024-06-03T00:02:27.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.171+0000 7fbbb8004b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55d2243f5720 con 0x55d224501640 2024-06-03T00:02:27.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.171+0000 7fbbb8004b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d2244497d0 con 0x55d224501f60 2024-06-03T00:02:27.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.171+0000 7fbba77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2244fbf20 0x55d2244fc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:27.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.171+0000 7fbba77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2244fbf20 0x55d2244fc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50158/0 (socket says 172.21.15.49:50158) 2024-06-03T00:02:27.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.171+0000 7fbba77fe700 1 -- 172.21.15.49:0/1267153143 learned_addr learned my addr 172.21.15.49:0/1267153143 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:27.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.171+0000 7fbba6ffd700 1 --2- 172.21.15.49:0/1267153143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d224501640 0x55d224501a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:27.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.171+0000 7fbba67fc700 1 --2- 172.21.15.49:0/1267153143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d224501f60 0x55d2244fb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:27.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.171+0000 7fbba77fe700 1 -- 172.21.15.49:0/1267153143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d224501f60 msgr2=0x55d2244fb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:27.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.171+0000 7fbba77fe700 1 --2- 172.21.15.49:0/1267153143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d224501f60 0x55d2244fb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.171+0000 7fbba77fe700 1 -- 172.21.15.49:0/1267153143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d224501640 msgr2=0x55d224501a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:27.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.171+0000 7fbba77fe700 1 --2- 172.21.15.49:0/1267153143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d224501640 0x55d224501a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.171+0000 7fbba77fe700 1 -- 172.21.15.49:0/1267153143 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2243ebf50 con 0x55d2244fbf20 2024-06-03T00:02:27.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.171+0000 7fbba77fe700 1 --2- 172.21.15.49:0/1267153143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2244fbf20 0x55d2244fc340 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fbba0009a70 tx=0x7fbba0009d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6902b1573b887c1b server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:27.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.171+0000 7fbb9d7fa700 1 -- 172.21.15.49:0/1267153143 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba0017070 con 0x55d2244fbf20 2024-06-03T00:02:27.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.172+0000 7fbb9d7fa700 1 -- 172.21.15.49:0/1267153143 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbba000edb0 con 0x55d2244fbf20 2024-06-03T00:02:27.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.172+0000 7fbb9d7fa700 1 -- 172.21.15.49:0/1267153143 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba00123d0 con 0x55d2244fbf20 2024-06-03T00:02:27.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.172+0000 7fbbb8004b80 1 -- 172.21.15.49:0/1267153143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2244fbf20 msgr2=0x55d2244fc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:27.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.172+0000 7fbbb8004b80 1 --2- 172.21.15.49:0/1267153143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2244fbf20 0x55d2244fc340 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fbba0009a70 tx=0x7fbba0009d80 comp rx=0 tx=0).stop 2024-06-03T00:02:27.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.172+0000 7fbbb8004b80 1 -- 172.21.15.49:0/1267153143 shutdown_connections 2024-06-03T00:02:27.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.172+0000 7fbbb8004b80 1 --2- 172.21.15.49:0/1267153143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2244fbf20 0x55d2244fc340 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.172+0000 7fbbb8004b80 1 --2- 172.21.15.49:0/1267153143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d224501640 0x55d224501a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.172+0000 7fbbb8004b80 1 --2- 172.21.15.49:0/1267153143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d224501f60 0x55d2244fb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.172+0000 7fbbb8004b80 1 -- 172.21.15.49:0/1267153143 >> 172.21.15.49:0/1267153143 conn(0x55d224426cc0 msgr2=0x55d2244f6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:27.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.172+0000 7fbbb8004b80 1 -- 172.21.15.49:0/1267153143 shutdown_connections 2024-06-03T00:02:27.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.172+0000 7fbbb8004b80 1 -- 172.21.15.49:0/1267153143 wait complete. 2024-06-03T00:02:27.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.173+0000 7fbbb8004b80 1 -- start start 2024-06-03T00:02:27.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.173+0000 7fbbb8004b80 1 Processor -- start 2024-06-03T00:02:27.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.173+0000 7fbbb8004b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2244fbf20 0x55d224507d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:27.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.173+0000 7fbbb8004b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d224501640 0x55d224505030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:27.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.173+0000 7fbbb8004b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d224501f60 0x55d224505570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:27.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.173+0000 7fbbb8004b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55d2245089d0 con 0x55d224501640 2024-06-03T00:02:27.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.173+0000 7fbbb8004b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55d2243edbf0 con 0x55d224501f60 2024-06-03T00:02:27.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.173+0000 7fbbb8004b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d224508b50 con 0x55d2244fbf20 2024-06-03T00:02:27.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.173+0000 7fbbb8004b80 10 client.0 _ll_register_callbacks cb 0x55d2243e7920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:02:27.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.173+0000 7fbba67fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d224501640 0x55d224505030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:27.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.173+0000 7fbba67fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d224501640 0x55d224505030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50164/0 (socket says 172.21.15.49:50164) 2024-06-03T00:02:27.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.173+0000 7fbba67fc700 1 -- 172.21.15.49:0/662476175 learned_addr learned my addr 172.21.15.49:0/662476175 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:27.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.173+0000 7fbba6ffd700 1 --2- 172.21.15.49:0/662476175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2244fbf20 0x55d224507d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:27.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.174+0000 7fbba77fe700 1 --2- 172.21.15.49:0/662476175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d224501f60 0x55d224505570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:27.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.174+0000 7fbba67fc700 1 -- 172.21.15.49:0/662476175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2244fbf20 msgr2=0x55d224507d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:27.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.174+0000 7fbba67fc700 1 --2- 172.21.15.49:0/662476175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2244fbf20 0x55d224507d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.174+0000 7fbba67fc700 1 -- 172.21.15.49:0/662476175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d224501f60 msgr2=0x55d224505570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:27.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.174+0000 7fbba67fc700 1 --2- 172.21.15.49:0/662476175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d224501f60 0x55d224505570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.174+0000 7fbba67fc700 1 -- 172.21.15.49:0/662476175 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d22439c8d0 con 0x55d224501640 2024-06-03T00:02:27.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.174+0000 7fbba67fc700 1 --2- 172.21.15.49:0/662476175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d224501640 0x55d224505030 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fbb90009fd0 tx=0x7fbb900228a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3fc4ab9012cf9e0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:27.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.174+0000 7fbb8e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:02:27.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.174+0000 7fbb8e7fc700 1 -- 172.21.15.49:0/662476175 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9009c020 con 0x55d224501640 2024-06-03T00:02:27.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.174+0000 7fbb8e7fc700 1 -- 172.21.15.49:0/662476175 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fbb9009cb20 con 0x55d224501640 2024-06-03T00:02:27.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.174+0000 7fbbb8004b80 1 -- 172.21.15.49:0/662476175 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbba000edb0 con 0x55d224501640 2024-06-03T00:02:27.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.174+0000 7fbb8e7fc700 1 -- 172.21.15.49:0/662476175 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbb900870f0 con 0x55d224501640 2024-06-03T00:02:27.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.174+0000 7fbbb8004b80 10 client.15795 fetch_fsmap learned FSMap version 27 2024-06-03T00:02:27.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.174+0000 7fbbb8004b80 1 -- 172.21.15.49:0/662476175 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d224513330 con 0x55d224501640 2024-06-03T00:02:27.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.174+0000 7fbb8e7fc700 1 -- 172.21.15.49:0/662476175 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbba000edb0 con 0x55d224501640 2024-06-03T00:02:27.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.175+0000 7fbb8e7fc700 1 -- 172.21.15.49:0/662476175 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fbb900a4ea0 con 0x55d224501640 2024-06-03T00:02:27.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.175+0000 7fbbb8004b80 10 client.15795 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:02:27.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.175+0000 7fbbb8004b80 10 client.15795 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-06-03T00:02:27.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.175+0000 7fbbb8004b80 20 client.15795 populate_metadata read hostname 'smithi049' 2024-06-03T00:02:27.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.175+0000 7fbbb8004b80 1 --2- 172.21.15.49:0/662476175 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x55d2245158a0 0x55d224517cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:27.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.175+0000 7fbbb8004b80 4 client.15795 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:02:27.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.175+0000 7fbbb8004b80 1 -- 172.21.15.49:0/662476175 --> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d22445ad10 con 0x55d2245158a0 2024-06-03T00:02:27.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.175+0000 7fbba6ffd700 1 --2- 172.21.15.49:0/662476175 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x55d2245158a0 0x55d224517cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:27.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.175+0000 7fbba6ffd700 1 --2- 172.21.15.49:0/662476175 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x55d2245158a0 0x55d224517cc0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=48ab09ee0786f9ef server_cookie=25c5a8381037f23b in_seq=0 out_seq=0 2024-06-03T00:02:27.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.175+0000 7fbb8e7fc700 10 client.15795 ms_handle_connect on v2:172.21.15.107:6834/3693542801 2024-06-03T00:02:27.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.176+0000 7fbb8e7fc700 1 -- 172.21.15.49:0/662476175 <== mds.4 v2:172.21.15.107:6834/3693542801 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55d22445ad10 con 0x55d2245158a0 2024-06-03T00:02:27.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.176+0000 7fbb8e7fc700 10 client.15795 handle_command_reply: tid=0 2024-06-03T00:02:27.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.176+0000 7fbbb8004b80 1 client.15795 shutdown 2024-06-03T00:02:27.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.176+0000 7fbbb8004b80 1 -- 172.21.15.49:0/662476175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d224501640 msgr2=0x55d224505030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:27.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.176+0000 7fbbb8004b80 1 --2- 172.21.15.49:0/662476175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d224501640 0x55d224505030 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fbb90009fd0 tx=0x7fbb900228a0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.176+0000 7fbbb8004b80 1 -- 172.21.15.49:0/662476175 shutdown_connections 2024-06-03T00:02:27.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.176+0000 7fbbb8004b80 1 --2- 172.21.15.49:0/662476175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d224501f60 0x55d224505570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.176+0000 7fbbb8004b80 1 --2- 172.21.15.49:0/662476175 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x55d2245158a0 0x55d224517cc0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.176+0000 7fbbb8004b80 1 --2- 172.21.15.49:0/662476175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2244fbf20 0x55d224507d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.176+0000 7fbbb8004b80 1 --2- 172.21.15.49:0/662476175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d224501640 0x55d224505030 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.176+0000 7fbbb8004b80 1 -- 172.21.15.49:0/662476175 >> 172.21.15.49:0/662476175 conn(0x55d224426cc0 msgr2=0x55d2244fa9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:27.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.176+0000 7fbb8e7fc700 0 client.15795 ms_handle_reset on v2:172.21.15.107:6834/3693542801 2024-06-03T00:02:27.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.177+0000 7fbbb8004b80 1 -- 172.21.15.49:0/662476175 shutdown_connections 2024-06-03T00:02:27.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.177+0000 7fbbb8004b80 1 -- 172.21.15.49:0/662476175 wait complete. 2024-06-03T00:02:27.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.177+0000 7fbbb8004b80 20 client.15795 trim_cache size 0 max 16384 2024-06-03T00:02:27.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.192+0000 7fbbb8004b80 1 Processor -- start 2024-06-03T00:02:27.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.192+0000 7fbbb8004b80 1 -- start start 2024-06-03T00:02:27.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.192+0000 7fbbb8004b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2244fbf20 0x55d2244fb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:27.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.192+0000 7fbbb8004b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d224501640 0x55d224502bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:27.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.192+0000 7fbbb8004b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d224501f60 0x55d2244f0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:27.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.192+0000 7fbbb8004b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbba81acc40 con 0x55d224501f60 2024-06-03T00:02:27.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.192+0000 7fbbb8004b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fbba81ae780 con 0x55d224501640 2024-06-03T00:02:27.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.192+0000 7fbbb8004b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbba81ad310 con 0x55d2244fbf20 2024-06-03T00:02:27.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.192+0000 7fbba77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d224501f60 0x55d2244f0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:27.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.192+0000 7fbba77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d224501f60 0x55d2244f0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50166/0 (socket says 172.21.15.49:50166) 2024-06-03T00:02:27.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.192+0000 7fbba77fe700 1 -- 172.21.15.49:0/2464000073 learned_addr learned my addr 172.21.15.49:0/2464000073 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:27.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.192+0000 7fbba6ffd700 1 --2- 172.21.15.49:0/2464000073 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2244fbf20 0x55d2244fb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:27.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.192+0000 7fbba77fe700 1 -- 172.21.15.49:0/2464000073 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2244fbf20 msgr2=0x55d2244fb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:27.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.192+0000 7fbba77fe700 1 --2- 172.21.15.49:0/2464000073 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2244fbf20 0x55d2244fb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.192+0000 7fbba77fe700 1 -- 172.21.15.49:0/2464000073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d224501640 msgr2=0x55d224502bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:27.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.192+0000 7fbba67fc700 1 --2- 172.21.15.49:0/2464000073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d224501640 0x55d224502bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:27.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.192+0000 7fbba77fe700 1 --2- 172.21.15.49:0/2464000073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d224501640 0x55d224502bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.192+0000 7fbba77fe700 1 -- 172.21.15.49:0/2464000073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2244f7500 con 0x55d224501f60 2024-06-03T00:02:27.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.192+0000 7fbba67fc700 1 --2- 172.21.15.49:0/2464000073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d224501640 0x55d224502bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:02:27.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.193+0000 7fbba77fe700 1 --2- 172.21.15.49:0/2464000073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d224501f60 0x55d2244f0510 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fbba00099c0 tx=0x7fbba0006ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de37fb4de1cb02fa server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:27.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.193+0000 7fbb9cff9700 1 -- 172.21.15.49:0/2464000073 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba0029070 con 0x55d224501f60 2024-06-03T00:02:27.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.193+0000 7fbb9cff9700 1 -- 172.21.15.49:0/2464000073 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbba000eb50 con 0x55d224501f60 2024-06-03T00:02:27.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.193+0000 7fbb9cff9700 1 -- 172.21.15.49:0/2464000073 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba0017040 con 0x55d224501f60 2024-06-03T00:02:27.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.193+0000 7fbbb8004b80 1 -- 172.21.15.49:0/2464000073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d224501f60 msgr2=0x55d2244f0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:27.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.193+0000 7fbbb8004b80 1 --2- 172.21.15.49:0/2464000073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d224501f60 0x55d2244f0510 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fbba00099c0 tx=0x7fbba0006ac0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.194+0000 7fbbb8004b80 1 -- 172.21.15.49:0/2464000073 shutdown_connections 2024-06-03T00:02:27.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.194+0000 7fbbb8004b80 1 --2- 172.21.15.49:0/2464000073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d224501f60 0x55d2244f0510 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.194+0000 7fbbb8004b80 1 --2- 172.21.15.49:0/2464000073 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2244fbf20 0x55d2244fb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.194+0000 7fbbb8004b80 1 --2- 172.21.15.49:0/2464000073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d224501640 0x55d224502bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.194+0000 7fbbb8004b80 1 -- 172.21.15.49:0/2464000073 >> 172.21.15.49:0/2464000073 conn(0x55d224426cc0 msgr2=0x55d2244efe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:27.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.194+0000 7fbbb8004b80 1 -- 172.21.15.49:0/2464000073 shutdown_connections 2024-06-03T00:02:27.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.194+0000 7fbbb8004b80 1 -- 172.21.15.49:0/2464000073 wait complete. 2024-06-03T00:02:27.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.194+0000 7fbbb8004b80 1 -- start start 2024-06-03T00:02:27.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.194+0000 7fbbb8004b80 1 Processor -- start 2024-06-03T00:02:27.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.194+0000 7fbbb8004b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2244fbf20 0x55d22457d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:27.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.194+0000 7fbbb8004b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d224501640 0x55d22457d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:27.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.194+0000 7fbbb8004b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d224501f60 0x55d22451d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:27.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.194+0000 7fbbb8004b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbba81ae0b0 con 0x55d2244fbf20 2024-06-03T00:02:27.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.194+0000 7fbbb8004b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fbba81ad9e0 con 0x55d224501f60 2024-06-03T00:02:27.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.194+0000 7fbbb8004b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbba81aabc0 con 0x55d224501640 2024-06-03T00:02:27.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.194+0000 7fbbb8004b80 10 client.0 _ll_register_callbacks cb 0x55d2243e7920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:02:27.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.194+0000 7fbba6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2244fbf20 0x55d22457d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:27.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.194+0000 7fbba6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2244fbf20 0x55d22457d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50180/0 (socket says 172.21.15.49:50180) 2024-06-03T00:02:27.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.194+0000 7fbba6ffd700 1 -- 172.21.15.49:0/3155245932 learned_addr learned my addr 172.21.15.49:0/3155245932 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:27.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.195+0000 7fbba67fc700 1 --2- 172.21.15.49:0/3155245932 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d224501640 0x55d22457d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:27.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.195+0000 7fbba77fe700 1 --2- 172.21.15.49:0/3155245932 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d224501f60 0x55d22451d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:27.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.195+0000 7fbba6ffd700 1 -- 172.21.15.49:0/3155245932 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d224501640 msgr2=0x55d22457d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:27.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.195+0000 7fbba6ffd700 1 --2- 172.21.15.49:0/3155245932 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d224501640 0x55d22457d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.195+0000 7fbba6ffd700 1 -- 172.21.15.49:0/3155245932 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d224501f60 msgr2=0x55d22451d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:27.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.195+0000 7fbba6ffd700 1 --2- 172.21.15.49:0/3155245932 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d224501f60 0x55d22451d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.195+0000 7fbba6ffd700 1 -- 172.21.15.49:0/3155245932 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d22451da50 con 0x55d2244fbf20 2024-06-03T00:02:27.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.195+0000 7fbba67fc700 1 --2- 172.21.15.49:0/3155245932 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d224501640 0x55d22457d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:02:27.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.195+0000 7fbba6ffd700 1 --2- 172.21.15.49:0/3155245932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2244fbf20 0x55d22457d070 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x55d224518530 tx=0x7fbb98004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cceca4465494d91 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:27.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.195+0000 7fbb8e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:02:27.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.195+0000 7fbb8e7fc700 1 -- 172.21.15.49:0/3155245932 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb98033060 con 0x55d2244fbf20 2024-06-03T00:02:27.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.195+0000 7fbbb8004b80 1 -- 172.21.15.49:0/3155245932 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbba000eb50 con 0x55d2244fbf20 2024-06-03T00:02:27.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.195+0000 7fbb8e7fc700 1 -- 172.21.15.49:0/3155245932 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fbb98026620 con 0x55d2244fbf20 2024-06-03T00:02:27.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.195+0000 7fbb8e7fc700 1 -- 172.21.15.49:0/3155245932 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbb98026820 con 0x55d2244fbf20 2024-06-03T00:02:27.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.195+0000 7fbbb8004b80 10 client.15801 fetch_fsmap learned FSMap version 27 2024-06-03T00:02:27.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.195+0000 7fbbb8004b80 1 -- 172.21.15.49:0/3155245932 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d224584870 con 0x55d2244fbf20 2024-06-03T00:02:27.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.195+0000 7fbb8e7fc700 1 -- 172.21.15.49:0/3155245932 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbba000eb50 con 0x55d2244fbf20 2024-06-03T00:02:27.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.196+0000 7fbb8e7fc700 1 -- 172.21.15.49:0/3155245932 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fbb98038070 con 0x55d2244fbf20 2024-06-03T00:02:27.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.196+0000 7fbbb8004b80 10 client.15801 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:02:27.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.196+0000 7fbbb8004b80 10 client.15801 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-06-03T00:02:27.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.196+0000 7fbbb8004b80 20 client.15801 populate_metadata read hostname 'smithi049' 2024-06-03T00:02:27.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.196+0000 7fbbb8004b80 1 --2- 172.21.15.49:0/3155245932 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x55d224584f60 0x55d224587350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:27.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.196+0000 7fbbb8004b80 4 client.15801 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-03T00:02:27.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.196+0000 7fbbb8004b80 1 -- 172.21.15.49:0/3155245932 --> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d224455290 con 0x55d224584f60 2024-06-03T00:02:27.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.196+0000 7fbba67fc700 1 --2- 172.21.15.49:0/3155245932 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x55d224584f60 0x55d224587350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:27.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.196+0000 7fbba67fc700 1 --2- 172.21.15.49:0/3155245932 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x55d224584f60 0x55d224587350 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=cc15de612f214cde server_cookie=edb561388732d07 in_seq=0 out_seq=0 2024-06-03T00:02:27.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.196+0000 7fbb8e7fc700 10 client.15801 ms_handle_connect on v2:172.21.15.107:6834/3693542801 2024-06-03T00:02:27.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.196+0000 7fbb8e7fc700 1 -- 172.21.15.49:0/3155245932 <== mds.4 v2:172.21.15.107:6834/3693542801 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d224455290 con 0x55d224584f60 2024-06-03T00:02:27.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.196+0000 7fbb8e7fc700 10 client.15801 handle_command_reply: tid=0 2024-06-03T00:02:27.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.197+0000 7fbbb8004b80 1 client.15801 shutdown 2024-06-03T00:02:27.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.197+0000 7fbbb8004b80 1 -- 172.21.15.49:0/3155245932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2244fbf20 msgr2=0x55d22457d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:27.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.197+0000 7fbbb8004b80 1 --2- 172.21.15.49:0/3155245932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2244fbf20 0x55d22457d070 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x55d224518530 tx=0x7fbb98004ad0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.197+0000 7fbbb8004b80 1 -- 172.21.15.49:0/3155245932 shutdown_connections 2024-06-03T00:02:27.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.197+0000 7fbbb8004b80 1 --2- 172.21.15.49:0/3155245932 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d224501f60 0x55d22451d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.197+0000 7fbbb8004b80 1 --2- 172.21.15.49:0/3155245932 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d2244fbf20 0x55d22457d070 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.197+0000 7fbbb8004b80 1 --2- 172.21.15.49:0/3155245932 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x55d224584f60 0x55d224587350 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.197+0000 7fbbb8004b80 1 --2- 172.21.15.49:0/3155245932 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d224501640 0x55d22457d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.197+0000 7fbbb8004b80 1 -- 172.21.15.49:0/3155245932 >> 172.21.15.49:0/3155245932 conn(0x55d224426cc0 msgr2=0x55d224502a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:27.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.197+0000 7fbb8e7fc700 0 client.15801 ms_handle_reset on v2:172.21.15.107:6834/3693542801 2024-06-03T00:02:27.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.197+0000 7fbbb8004b80 1 -- 172.21.15.49:0/3155245932 shutdown_connections 2024-06-03T00:02:27.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.197+0000 7fbbb8004b80 1 -- 172.21.15.49:0/3155245932 wait complete. 2024-06-03T00:02:27.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.197+0000 7fbbb8004b80 20 client.15801 trim_cache size 0 max 16384 2024-06-03T00:02:27.202 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-06-03T00:02:27.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.197+0000 7fbbad781700 1 -- 172.21.15.49:0/1879188711 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbb940a2ca0 msgr2=0x7fbb940a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:27.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.197+0000 7fbbad781700 1 --2- 172.21.15.49:0/1879188711 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbb940a2ca0 0x7fbb940a5160 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbb98009fa0 tx=0x7fbb98009570 comp rx=0 tx=0).stop 2024-06-03T00:02:27.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.197+0000 7fbbad781700 1 -- 172.21.15.49:0/1879188711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbba8102f10 msgr2=0x7fbba81992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:27.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.197+0000 7fbbad781700 1 --2- 172.21.15.49:0/1879188711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbba8102f10 0x7fbba81992e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fbb9000bff0 tx=0x7fbb90005590 comp rx=0 tx=0).stop 2024-06-03T00:02:27.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.197+0000 7fbbad781700 1 -- 172.21.15.49:0/1879188711 shutdown_connections 2024-06-03T00:02:27.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.197+0000 7fbbad781700 1 --2- 172.21.15.49:0/1879188711 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbb940a2ca0 0x7fbb940a5160 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.197+0000 7fbbad781700 1 --2- 172.21.15.49:0/1879188711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbba81084f0 0x7fbba819d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.197+0000 7fbbad781700 1 --2- 172.21.15.49:0/1879188711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbba8102550 0x7fbba8198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.197+0000 7fbbad781700 1 --2- 172.21.15.49:0/1879188711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbba8102f10 0x7fbba81992e0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:27.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.198+0000 7fbbad781700 1 -- 172.21.15.49:0/1879188711 >> 172.21.15.49:0/1879188711 conn(0x7fbba8079650 msgr2=0x7fbba81005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:27.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.198+0000 7fbbad781700 1 -- 172.21.15.49:0/1879188711 shutdown_connections 2024-06-03T00:02:27.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:27.198+0000 7fbbad781700 1 -- 172.21.15.49:0/1879188711 wait complete. 2024-06-03T00:02:27.995 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-06-03T00:02:28.251 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:02:28.681 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:28 smithi049 ceph-mon[32302]: pgmap v456: 97 pgs: 97 active+clean; 2.8 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 207 KiB/s wr, 31 op/s 2024-06-03T00:02:28.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:28 smithi107 ceph-mon[37048]: pgmap v456: 97 pgs: 97 active+clean; 2.8 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 207 KiB/s wr, 31 op/s 2024-06-03T00:02:28.949 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:28 smithi057 ceph-mon[36457]: pgmap v456: 97 pgs: 97 active+clean; 2.8 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 207 KiB/s wr, 31 op/s 2024-06-03T00:02:29.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.986+0000 7f8bfd0ff700 1 -- 172.21.15.49:0/3342034625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bf8101380 msgr2=0x7f8bf8101800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:29.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.986+0000 7f8bfd0ff700 1 --2- 172.21.15.49:0/3342034625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bf8101380 0x7f8bf8101800 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8bec009990 tx=0x7f8bec009ca0 comp rx=0 tx=0).stop 2024-06-03T00:02:29.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.987+0000 7f8bfd0ff700 1 -- 172.21.15.49:0/3342034625 shutdown_connections 2024-06-03T00:02:29.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.987+0000 7f8bfd0ff700 1 --2- 172.21.15.49:0/3342034625 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bf8101d40 0x7f8bf810e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:29.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.987+0000 7f8bfd0ff700 1 --2- 172.21.15.49:0/3342034625 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bf81073f0 0x7f8bf81077d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:29.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.987+0000 7f8bfd0ff700 1 --2- 172.21.15.49:0/3342034625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bf8101380 0x7f8bf8101800 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:29.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.987+0000 7f8bfd0ff700 1 -- 172.21.15.49:0/3342034625 >> 172.21.15.49:0/3342034625 conn(0x7f8bf8078300 msgr2=0x7f8bf8078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:29.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.987+0000 7f8bfd0ff700 1 -- 172.21.15.49:0/3342034625 shutdown_connections 2024-06-03T00:02:29.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.987+0000 7f8bfd0ff700 1 -- 172.21.15.49:0/3342034625 wait complete. 2024-06-03T00:02:29.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.987+0000 7f8bfd0ff700 1 Processor -- start 2024-06-03T00:02:29.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.988+0000 7f8bfd0ff700 1 -- start start 2024-06-03T00:02:29.988 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 03 00:02:29 smithi049 sudo[93790]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-03T00:02:29.988 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 03 00:02:29 smithi049 sudo[93790]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-03T00:02:29.988 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 03 00:02:29 smithi049 sudo[93790]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-03T00:02:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.988+0000 7f8bfd0ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bf8101380 0x7f8bf819e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.988+0000 7f8bfd0ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bf8101d40 0x7f8bf819ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.988+0000 7f8bfd0ff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bf81073f0 0x7f8bf8198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.988+0000 7f8bfd0ff700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf8111660 con 0x7f8bf81073f0 2024-06-03T00:02:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.988+0000 7f8bf6d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bf8101380 0x7f8bf819e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.988+0000 7f8bfd0ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf81114e0 con 0x7f8bf8101d40 2024-06-03T00:02:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.988+0000 7f8bfd0ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf81117e0 con 0x7f8bf8101380 2024-06-03T00:02:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.988+0000 7f8bf759e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bf81073f0 0x7f8bf8198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:29.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.988+0000 7f8bf6d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bf8101380 0x7f8bf819e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:50774/0 (socket says 172.21.15.49:50774) 2024-06-03T00:02:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.988+0000 7f8bf6d9d700 1 -- 172.21.15.49:0/2836492596 learned_addr learned my addr 172.21.15.49:0/2836492596 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.988+0000 7f8bf659c700 1 --2- 172.21.15.49:0/2836492596 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bf8101d40 0x7f8bf819ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.989+0000 7f8bf6d9d700 1 -- 172.21.15.49:0/2836492596 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bf8101d40 msgr2=0x7f8bf819ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.989+0000 7f8bf6d9d700 1 --2- 172.21.15.49:0/2836492596 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bf8101d40 0x7f8bf819ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.989+0000 7f8bf6d9d700 1 -- 172.21.15.49:0/2836492596 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bf81073f0 msgr2=0x7f8bf8198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.989+0000 7f8bf6d9d700 1 --2- 172.21.15.49:0/2836492596 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bf81073f0 0x7f8bf8198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.989+0000 7f8bf6d9d700 1 -- 172.21.15.49:0/2836492596 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf8199160 con 0x7f8bf8101380 2024-06-03T00:02:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.989+0000 7f8bf659c700 1 --2- 172.21.15.49:0/2836492596 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bf8101d40 0x7f8bf819ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:02:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.989+0000 7f8bf6d9d700 1 --2- 172.21.15.49:0/2836492596 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bf8101380 0x7f8bf819e7f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8be800e9a0 tx=0x7f8be800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.989+0000 7f8bdffff700 1 -- 172.21.15.49:0/2836492596 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be800cbd0 con 0x7f8bf8101380 2024-06-03T00:02:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.989+0000 7f8bdffff700 1 -- 172.21.15.49:0/2836492596 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8be800cd70 con 0x7f8bf8101380 2024-06-03T00:02:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.989+0000 7f8bfd0ff700 1 -- 172.21.15.49:0/2836492596 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bf8199450 con 0x7f8bf8101380 2024-06-03T00:02:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.989+0000 7f8bdffff700 1 -- 172.21.15.49:0/2836492596 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be8018750 con 0x7f8bf8101380 2024-06-03T00:02:29.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.989+0000 7f8bfd0ff700 1 -- 172.21.15.49:0/2836492596 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bf81a56c0 con 0x7f8bf8101380 2024-06-03T00:02:29.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.992+0000 7f8bdffff700 1 -- 172.21.15.49:0/2836492596 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8be8010430 con 0x7f8bf8101380 2024-06-03T00:02:29.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.993+0000 7f8bdffff700 1 --2- 172.21.15.49:0/2836492596 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8be00a2c20 0x7f8be00a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:29.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.993+0000 7f8bdffff700 1 -- 172.21.15.49:0/2836492596 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f8be80cf2c0 con 0x7f8bf8101380 2024-06-03T00:02:29.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.993+0000 7f8bf659c700 1 --2- 172.21.15.49:0/2836492596 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8be00a2c20 0x7f8be00a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:29.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.993+0000 7f8bf659c700 1 --2- 172.21.15.49:0/2836492596 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8be00a2c20 0x7f8be00a50e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00b2e0 tx=0x7f8bec005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:29.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.994+0000 7f8c07982b80 1 Processor -- start 2024-06-03T00:02:29.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.994+0000 7f8c07982b80 1 -- start start 2024-06-03T00:02:29.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.995+0000 7f8c07982b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564dec301a70 0x564dec301e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:29.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.995+0000 7f8c07982b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564dec302390 0x564dec2fbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:29.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.995+0000 7f8c07982b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dec2fc330 0x564dec2fc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:29.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.995+0000 7f8c07982b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564dec249810 con 0x564dec2fc330 2024-06-03T00:02:29.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.995+0000 7f8c07982b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x564dec1f1720 con 0x564dec302390 2024-06-03T00:02:29.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.995+0000 7f8c07982b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564dec2457d0 con 0x564dec301a70 2024-06-03T00:02:29.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.995+0000 7f8bf6d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564dec301a70 0x564dec301e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:29.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.995+0000 7f8bf659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564dec302390 0x564dec2fbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:29.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.995+0000 7f8bf6d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564dec301a70 0x564dec301e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:50780/0 (socket says 172.21.15.49:50780) 2024-06-03T00:02:29.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.995+0000 7f8bf6d9d700 1 -- 172.21.15.49:0/810202745 learned_addr learned my addr 172.21.15.49:0/810202745 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:29.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.995+0000 7f8bf759e700 1 --2- 172.21.15.49:0/810202745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dec2fc330 0x564dec2fc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:29.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.995+0000 7f8bf6d9d700 1 -- 172.21.15.49:0/810202745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564dec302390 msgr2=0x564dec2fbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:29.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.995+0000 7f8bf6d9d700 1 --2- 172.21.15.49:0/810202745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564dec302390 0x564dec2fbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:29.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.995+0000 7f8bf6d9d700 1 -- 172.21.15.49:0/810202745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dec2fc330 msgr2=0x564dec2fc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:29.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.995+0000 7f8bf6d9d700 1 --2- 172.21.15.49:0/810202745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dec2fc330 0x564dec2fc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:29.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.995+0000 7f8bf6d9d700 1 -- 172.21.15.49:0/810202745 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dec1e7f50 con 0x564dec301a70 2024-06-03T00:02:29.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.995+0000 7f8bf6d9d700 1 --2- 172.21.15.49:0/810202745 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564dec301a70 0x564dec301e50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8be80a4220 tx=0x7f8be809b720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=655bc293c1196959 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:29.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.996+0000 7f8bdd7fa700 1 -- 172.21.15.49:0/810202745 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be809bae0 con 0x564dec301a70 2024-06-03T00:02:29.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.996+0000 7f8bdd7fa700 1 -- 172.21.15.49:0/810202745 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8be809fe90 con 0x564dec301a70 2024-06-03T00:02:29.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.996+0000 7f8bdd7fa700 1 -- 172.21.15.49:0/810202745 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be80a44c0 con 0x564dec301a70 2024-06-03T00:02:30.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.996+0000 7f8c07982b80 1 -- 172.21.15.49:0/810202745 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564dec301a70 msgr2=0x564dec301e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:30.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.996+0000 7f8c07982b80 1 --2- 172.21.15.49:0/810202745 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564dec301a70 0x564dec301e50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8be80a4220 tx=0x7f8be809b720 comp rx=0 tx=0).stop 2024-06-03T00:02:30.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.996+0000 7f8c07982b80 1 -- 172.21.15.49:0/810202745 shutdown_connections 2024-06-03T00:02:30.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.996+0000 7f8c07982b80 1 --2- 172.21.15.49:0/810202745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dec2fc330 0x564dec2fc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:30.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.997+0000 7f8c07982b80 1 --2- 172.21.15.49:0/810202745 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564dec301a70 0x564dec301e50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:30.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.997+0000 7f8c07982b80 1 --2- 172.21.15.49:0/810202745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564dec302390 0x564dec2fbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:30.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.997+0000 7f8c07982b80 1 -- 172.21.15.49:0/810202745 >> 172.21.15.49:0/810202745 conn(0x564dec222cc0 msgr2=0x564dec2f2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:30.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.997+0000 7f8c07982b80 1 -- 172.21.15.49:0/810202745 shutdown_connections 2024-06-03T00:02:30.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.997+0000 7f8c07982b80 1 -- 172.21.15.49:0/810202745 wait complete. 2024-06-03T00:02:30.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.997+0000 7f8c07982b80 1 -- start start 2024-06-03T00:02:30.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.997+0000 7f8c07982b80 1 Processor -- start 2024-06-03T00:02:30.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.997+0000 7f8c07982b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dec2fc330 0x564dec308160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:30.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.997+0000 7f8c07982b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564dec301a70 0x564dec305460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:30.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.997+0000 7f8c07982b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564dec302390 0x564dec3059a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:30.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.997+0000 7f8c07982b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564dec308d70 con 0x564dec2fc330 2024-06-03T00:02:30.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.997+0000 7f8c07982b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x564dec1e9bf0 con 0x564dec301a70 2024-06-03T00:02:30.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.997+0000 7f8c07982b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564dec308ef0 con 0x564dec302390 2024-06-03T00:02:30.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.997+0000 7f8c07982b80 10 client.0 _ll_register_callbacks cb 0x564dec1e3920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:02:30.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.997+0000 7f8bf6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dec2fc330 0x564dec308160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:30.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.998+0000 7f8bf6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dec2fc330 0x564dec308160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50210/0 (socket says 172.21.15.49:50210) 2024-06-03T00:02:30.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.998+0000 7f8bf6d9d700 1 -- 172.21.15.49:0/4106376295 learned_addr learned my addr 172.21.15.49:0/4106376295 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:30.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.998+0000 7f8bf759e700 1 --2- 172.21.15.49:0/4106376295 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564dec302390 0x564dec3059a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:30.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.998+0000 7f8bf659c700 1 --2- 172.21.15.49:0/4106376295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564dec301a70 0x564dec305460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:30.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.998+0000 7f8bf6d9d700 1 -- 172.21.15.49:0/4106376295 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564dec302390 msgr2=0x564dec3059a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:30.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.998+0000 7f8bf6d9d700 1 --2- 172.21.15.49:0/4106376295 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564dec302390 0x564dec3059a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:30.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.998+0000 7f8bf6d9d700 1 -- 172.21.15.49:0/4106376295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564dec301a70 msgr2=0x564dec305460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:30.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.998+0000 7f8bf6d9d700 1 --2- 172.21.15.49:0/4106376295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564dec301a70 0x564dec305460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:30.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.998+0000 7f8bf6d9d700 1 -- 172.21.15.49:0/4106376295 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dec1988d0 con 0x564dec2fc330 2024-06-03T00:02:30.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.998+0000 7f8bf659c700 1 --2- 172.21.15.49:0/4106376295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564dec301a70 0x564dec305460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:02:30.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.998+0000 7f8bf6d9d700 1 --2- 172.21.15.49:0/4106376295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dec2fc330 0x564dec308160 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8be8009230 tx=0x7f8be809c2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11941477db7279b server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:30.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.998+0000 7f8bdaff5700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:02:30.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.998+0000 7f8bdaff5700 1 -- 172.21.15.49:0/4106376295 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be80b9070 con 0x564dec2fc330 2024-06-03T00:02:30.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.998+0000 7f8bdaff5700 1 -- 172.21.15.49:0/4106376295 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f8be80109a0 con 0x564dec2fc330 2024-06-03T00:02:30.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.998+0000 7f8c07982b80 1 -- 172.21.15.49:0/4106376295 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8be809fe90 con 0x564dec2fc330 2024-06-03T00:02:30.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.999+0000 7f8bdaff5700 1 -- 172.21.15.49:0/4106376295 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8be80ba260 con 0x564dec2fc330 2024-06-03T00:02:30.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.999+0000 7f8c07982b80 10 client.15813 fetch_fsmap learned FSMap version 27 2024-06-03T00:02:30.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.999+0000 7f8c07982b80 1 -- 172.21.15.49:0/4106376295 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564dec3136f0 con 0x564dec2fc330 2024-06-03T00:02:30.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.999+0000 7f8bdaff5700 1 -- 172.21.15.49:0/4106376295 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8be809fe90 con 0x564dec2fc330 2024-06-03T00:02:30.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.999+0000 7f8bdaff5700 1 -- 172.21.15.49:0/4106376295 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f8be80b4ce0 con 0x564dec2fc330 2024-06-03T00:02:30.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.999+0000 7f8c07982b80 10 client.15813 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:02:30.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.999+0000 7f8c07982b80 10 client.15813 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-06-03T00:02:30.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.999+0000 7f8c07982b80 20 client.15813 populate_metadata read hostname 'smithi049' 2024-06-03T00:02:30.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.999+0000 7f8c07982b80 1 --2- 172.21.15.49:0/4106376295 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x564dec315bc0 0x564dec317fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:30.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.999+0000 7f8c07982b80 4 client.15813 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:02:30.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.999+0000 7f8c07982b80 1 -- 172.21.15.49:0/4106376295 --> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564dec256d10 con 0x564dec315bc0 2024-06-03T00:02:30.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:29.999+0000 7f8bf659c700 1 --2- 172.21.15.49:0/4106376295 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x564dec315bc0 0x564dec317fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:30.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.000+0000 7f8bdaff5700 10 client.15813 ms_handle_connect on v2:172.21.15.57:6836/230452144 2024-06-03T00:02:30.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.000+0000 7f8bf659c700 1 --2- 172.21.15.49:0/4106376295 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x564dec315bc0 0x564dec317fb0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=be5ef5b59f31f913 server_cookie=6de299dab83d019e in_seq=0 out_seq=0 2024-06-03T00:02:30.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.001+0000 7f8bdaff5700 1 -- 172.21.15.49:0/4106376295 <== mds.3 v2:172.21.15.57:6836/230452144 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x564dec256d10 con 0x564dec315bc0 2024-06-03T00:02:30.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.001+0000 7f8bdaff5700 10 client.15813 handle_command_reply: tid=0 2024-06-03T00:02:30.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.001+0000 7f8c07982b80 1 client.15813 shutdown 2024-06-03T00:02:30.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.001+0000 7f8c07982b80 1 -- 172.21.15.49:0/4106376295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dec2fc330 msgr2=0x564dec308160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:30.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.001+0000 7f8c07982b80 1 --2- 172.21.15.49:0/4106376295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dec2fc330 0x564dec308160 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8be8009230 tx=0x7f8be809c2a0 comp rx=0 tx=0).stop 2024-06-03T00:02:30.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.001+0000 7f8c07982b80 1 -- 172.21.15.49:0/4106376295 shutdown_connections 2024-06-03T00:02:30.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.001+0000 7f8c07982b80 1 --2- 172.21.15.49:0/4106376295 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x564dec315bc0 0x564dec317fb0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:30.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.001+0000 7f8c07982b80 1 --2- 172.21.15.49:0/4106376295 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564dec302390 0x564dec3059a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:30.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.001+0000 7f8c07982b80 1 --2- 172.21.15.49:0/4106376295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dec2fc330 0x564dec308160 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:30.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.001+0000 7f8c07982b80 1 --2- 172.21.15.49:0/4106376295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564dec301a70 0x564dec305460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:30.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.001+0000 7f8c07982b80 1 -- 172.21.15.49:0/4106376295 >> 172.21.15.49:0/4106376295 conn(0x564dec222cc0 msgr2=0x564dec2f69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:30.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.001+0000 7f8bdaff5700 0 client.15813 ms_handle_reset on v2:172.21.15.57:6836/230452144 2024-06-03T00:02:30.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.001+0000 7f8c07982b80 1 -- 172.21.15.49:0/4106376295 shutdown_connections 2024-06-03T00:02:30.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.001+0000 7f8c07982b80 1 -- 172.21.15.49:0/4106376295 wait complete. 2024-06-03T00:02:30.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.001+0000 7f8c07982b80 20 client.15813 trim_cache size 0 max 16384 2024-06-03T00:02:30.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.018+0000 7f8c07982b80 1 Processor -- start 2024-06-03T00:02:30.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.018+0000 7f8c07982b80 1 -- start start 2024-06-03T00:02:30.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.018+0000 7f8c07982b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dec2fc330 0x564dec31d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:30.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.018+0000 7f8c07982b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564dec301a70 0x564dec31da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:30.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.018+0000 7f8c07982b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564dec302390 0x564dec302770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:30.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.018+0000 7f8c07982b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf81aaa00 con 0x564dec2fc330 2024-06-03T00:02:30.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.018+0000 7f8c07982b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf81ac540 con 0x564dec302390 2024-06-03T00:02:30.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.018+0000 7f8c07982b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf81ab0d0 con 0x564dec301a70 2024-06-03T00:02:30.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.018+0000 7f8bf6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dec2fc330 0x564dec31d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:30.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.018+0000 7f8bf659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564dec301a70 0x564dec31da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:30.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.018+0000 7f8bf6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dec2fc330 0x564dec31d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50214/0 (socket says 172.21.15.49:50214) 2024-06-03T00:02:30.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.018+0000 7f8bf659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564dec301a70 0x564dec31da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:50796/0 (socket says 172.21.15.49:50796) 2024-06-03T00:02:30.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.018+0000 7f8bf6d9d700 1 -- 172.21.15.49:0/891421586 learned_addr learned my addr 172.21.15.49:0/891421586 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:30.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.018+0000 7f8bf759e700 1 --2- 172.21.15.49:0/891421586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564dec302390 0x564dec302770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:30.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.018+0000 7f8bf659c700 1 -- 172.21.15.49:0/891421586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564dec302390 msgr2=0x564dec302770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:30.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.018+0000 7f8bf659c700 1 --2- 172.21.15.49:0/891421586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564dec302390 0x564dec302770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:30.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.018+0000 7f8bf659c700 1 -- 172.21.15.49:0/891421586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dec2fc330 msgr2=0x564dec31d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:30.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.018+0000 7f8bf659c700 1 --2- 172.21.15.49:0/891421586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dec2fc330 0x564dec31d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:30.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.018+0000 7f8bf659c700 1 -- 172.21.15.49:0/891421586 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dec3039d0 con 0x564dec301a70 2024-06-03T00:02:30.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.019+0000 7f8bf759e700 1 --2- 172.21.15.49:0/891421586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564dec302390 0x564dec302770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:02:30.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.019+0000 7f8bf6d9d700 1 --2- 172.21.15.49:0/891421586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dec2fc330 0x564dec31d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:02:30.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.019+0000 7f8bf659c700 1 --2- 172.21.15.49:0/891421586 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564dec301a70 0x564dec31da90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8bec006010 tx=0x7f8bec020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b7b54e30e191da5 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:30.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.019+0000 7f8bdcff9700 1 -- 172.21.15.49:0/891421586 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bec00fba0 con 0x564dec301a70 2024-06-03T00:02:30.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.019+0000 7f8bdcff9700 1 -- 172.21.15.49:0/891421586 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bec036030 con 0x564dec301a70 2024-06-03T00:02:30.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.019+0000 7f8bdcff9700 1 -- 172.21.15.49:0/891421586 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bec031410 con 0x564dec301a70 2024-06-03T00:02:30.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.020+0000 7f8c07982b80 1 -- 172.21.15.49:0/891421586 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564dec301a70 msgr2=0x564dec31da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:30.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.020+0000 7f8c07982b80 1 --2- 172.21.15.49:0/891421586 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564dec301a70 0x564dec31da90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8bec006010 tx=0x7f8bec020000 comp rx=0 tx=0).stop 2024-06-03T00:02:30.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.020+0000 7f8c07982b80 1 -- 172.21.15.49:0/891421586 shutdown_connections 2024-06-03T00:02:30.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.020+0000 7f8c07982b80 1 --2- 172.21.15.49:0/891421586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564dec302390 0x564dec302770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:30.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.020+0000 7f8c07982b80 1 --2- 172.21.15.49:0/891421586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dec2fc330 0x564dec31d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:30.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.020+0000 7f8c07982b80 1 --2- 172.21.15.49:0/891421586 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564dec301a70 0x564dec31da90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:30.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.020+0000 7f8c07982b80 1 -- 172.21.15.49:0/891421586 >> 172.21.15.49:0/891421586 conn(0x564dec222cc0 msgr2=0x564dec303d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:30.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.020+0000 7f8c07982b80 1 -- 172.21.15.49:0/891421586 shutdown_connections 2024-06-03T00:02:30.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.020+0000 7f8c07982b80 1 -- 172.21.15.49:0/891421586 wait complete. 2024-06-03T00:02:30.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.020+0000 7f8c07982b80 1 -- start start 2024-06-03T00:02:30.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.020+0000 7f8c07982b80 1 Processor -- start 2024-06-03T00:02:30.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.021+0000 7f8c07982b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564dec2fc330 0x564dec30e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:30.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.021+0000 7f8c07982b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564dec301a70 0x564dec30e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:30.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.021+0000 7f8c07982b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dec302390 0x564dec31c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:30.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.021+0000 7f8c07982b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf81abe70 con 0x564dec302390 2024-06-03T00:02:30.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.021+0000 7f8c07982b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf81ab7a0 con 0x564dec2fc330 2024-06-03T00:02:30.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.021+0000 7f8c07982b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf81a8980 con 0x564dec301a70 2024-06-03T00:02:30.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.021+0000 7f8c07982b80 10 client.0 _ll_register_callbacks cb 0x564dec1e3920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:02:30.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.021+0000 7f8bf759e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dec302390 0x564dec31c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:30.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.021+0000 7f8bf659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564dec301a70 0x564dec30e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:30.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.021+0000 7f8bf759e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dec302390 0x564dec31c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50230/0 (socket says 172.21.15.49:50230) 2024-06-03T00:02:30.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.021+0000 7f8bf759e700 1 -- 172.21.15.49:0/3080182097 learned_addr learned my addr 172.21.15.49:0/3080182097 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:30.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.021+0000 7f8bf6d9d700 1 --2- 172.21.15.49:0/3080182097 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564dec2fc330 0x564dec30e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:30.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.021+0000 7f8bf659c700 1 -- 172.21.15.49:0/3080182097 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564dec2fc330 msgr2=0x564dec30e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:30.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.021+0000 7f8bf659c700 1 --2- 172.21.15.49:0/3080182097 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564dec2fc330 0x564dec30e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:30.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.021+0000 7f8bf659c700 1 -- 172.21.15.49:0/3080182097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dec302390 msgr2=0x564dec31c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:30.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.021+0000 7f8bf659c700 1 --2- 172.21.15.49:0/3080182097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dec302390 0x564dec31c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:30.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.021+0000 7f8bf659c700 1 -- 172.21.15.49:0/3080182097 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dec31d090 con 0x564dec301a70 2024-06-03T00:02:30.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.021+0000 7f8bf759e700 1 --2- 172.21.15.49:0/3080182097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dec302390 0x564dec31c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:02:30.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.021+0000 7f8bf659c700 1 --2- 172.21.15.49:0/3080182097 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564dec301a70 0x564dec30e8a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x564dec245460 tx=0x7f8bec025c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d418eb290f8d5ee6 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:30.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.021+0000 7f8bdaff5700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-06-03T00:02:30.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.021+0000 7f8bdaff5700 1 -- 172.21.15.49:0/3080182097 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bec03f020 con 0x564dec301a70 2024-06-03T00:02:30.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.021+0000 7f8bdaff5700 1 -- 172.21.15.49:0/3080182097 <== mon.1 v2:172.21.15.107:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f8bec00fda0 con 0x564dec301a70 2024-06-03T00:02:30.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.021+0000 7f8c07982b80 1 -- 172.21.15.49:0/3080182097 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bec036030 con 0x564dec301a70 2024-06-03T00:02:30.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.022+0000 7f8bdaff5700 1 -- 172.21.15.49:0/3080182097 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8bec025420 con 0x564dec301a70 2024-06-03T00:02:30.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.022+0000 7f8c07982b80 10 client.25432 fetch_fsmap learned FSMap version 27 2024-06-03T00:02:30.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.022+0000 7f8c07982b80 1 -- 172.21.15.49:0/3080182097 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564dec37fed0 con 0x564dec301a70 2024-06-03T00:02:30.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.022+0000 7f8bdaff5700 1 -- 172.21.15.49:0/3080182097 <== mon.1 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bec036030 con 0x564dec301a70 2024-06-03T00:02:30.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.022+0000 7f8bdaff5700 1 -- 172.21.15.49:0/3080182097 <== mon.1 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f8bec0047b0 con 0x564dec301a70 2024-06-03T00:02:30.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.022+0000 7f8c07982b80 10 client.25432 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:02:30.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.022+0000 7f8c07982b80 10 client.25432 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-06-03T00:02:30.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.022+0000 7f8c07982b80 20 client.25432 populate_metadata read hostname 'smithi049' 2024-06-03T00:02:30.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.022+0000 7f8c07982b80 1 --2- 172.21.15.49:0/3080182097 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x564dec380550 0x564dec382970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:30.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.022+0000 7f8c07982b80 4 client.25432 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-03T00:02:30.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.022+0000 7f8c07982b80 1 -- 172.21.15.49:0/3080182097 --> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564dec251290 con 0x564dec380550 2024-06-03T00:02:30.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.022+0000 7f8bf6d9d700 1 --2- 172.21.15.49:0/3080182097 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x564dec380550 0x564dec382970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:30.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.023+0000 7f8bf6d9d700 1 --2- 172.21.15.49:0/3080182097 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x564dec380550 0x564dec382970 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b388b43259bcb372 server_cookie=14778a159637415c in_seq=0 out_seq=0 2024-06-03T00:02:30.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.023+0000 7f8bdaff5700 10 client.25432 ms_handle_connect on v2:172.21.15.57:6836/230452144 2024-06-03T00:02:30.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.023+0000 7f8bdaff5700 1 -- 172.21.15.49:0/3080182097 <== mds.3 v2:172.21.15.57:6836/230452144 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564dec251290 con 0x564dec380550 2024-06-03T00:02:30.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.023+0000 7f8bdaff5700 10 client.25432 handle_command_reply: tid=0 2024-06-03T00:02:30.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.023+0000 7f8c07982b80 1 client.25432 shutdown 2024-06-03T00:02:30.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.023+0000 7f8c07982b80 1 -- 172.21.15.49:0/3080182097 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564dec301a70 msgr2=0x564dec30e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:30.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.023+0000 7f8c07982b80 1 --2- 172.21.15.49:0/3080182097 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564dec301a70 0x564dec30e8a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x564dec245460 tx=0x7f8bec025c80 comp rx=0 tx=0).stop 2024-06-03T00:02:30.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.023+0000 7f8c07982b80 1 -- 172.21.15.49:0/3080182097 shutdown_connections 2024-06-03T00:02:30.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.023+0000 7f8c07982b80 1 --2- 172.21.15.49:0/3080182097 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x564dec380550 0x564dec382970 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:30.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.023+0000 7f8c07982b80 1 --2- 172.21.15.49:0/3080182097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564dec302390 0x564dec31c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:30.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.023+0000 7f8c07982b80 1 --2- 172.21.15.49:0/3080182097 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564dec2fc330 0x564dec30e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:30.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.023+0000 7f8bdaff5700 0 client.25432 ms_handle_reset on v2:172.21.15.57:6836/230452144 2024-06-03T00:02:30.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.023+0000 7f8c07982b80 1 --2- 172.21.15.49:0/3080182097 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564dec301a70 0x564dec30e8a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:30.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.023+0000 7f8c07982b80 1 -- 172.21.15.49:0/3080182097 >> 172.21.15.49:0/3080182097 conn(0x564dec222cc0 msgr2=0x564dec2ebe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:30.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.023+0000 7f8c07982b80 1 -- 172.21.15.49:0/3080182097 shutdown_connections 2024-06-03T00:02:30.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.023+0000 7f8c07982b80 1 -- 172.21.15.49:0/3080182097 wait complete. 2024-06-03T00:02:30.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.023+0000 7f8c07982b80 20 client.25432 trim_cache size 0 max 16384 2024-06-03T00:02:30.028 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-06-03T00:02:30.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.024+0000 7f8bfd0ff700 1 -- 172.21.15.49:0/2836492596 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8be00a2c20 msgr2=0x7f8be00a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:30.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.024+0000 7f8bfd0ff700 1 --2- 172.21.15.49:0/2836492596 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8be00a2c20 0x7f8be00a50e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00b2e0 tx=0x7f8bec005e80 comp rx=0 tx=0).stop 2024-06-03T00:02:30.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.024+0000 7f8bfd0ff700 1 -- 172.21.15.49:0/2836492596 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bf8101380 msgr2=0x7f8bf819e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:30.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.024+0000 7f8bfd0ff700 1 --2- 172.21.15.49:0/2836492596 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bf8101380 0x7f8bf819e7f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8be800e9a0 tx=0x7f8be800ecb0 comp rx=0 tx=0).stop 2024-06-03T00:02:30.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.024+0000 7f8bfd0ff700 1 -- 172.21.15.49:0/2836492596 shutdown_connections 2024-06-03T00:02:30.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.024+0000 7f8bfd0ff700 1 --2- 172.21.15.49:0/2836492596 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8be00a2c20 0x7f8be00a50e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:30.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.024+0000 7f8bfd0ff700 1 --2- 172.21.15.49:0/2836492596 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bf81073f0 0x7f8bf8198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:30.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.024+0000 7f8bfd0ff700 1 --2- 172.21.15.49:0/2836492596 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bf8101380 0x7f8bf819e7f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:30.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.024+0000 7f8bfd0ff700 1 --2- 172.21.15.49:0/2836492596 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bf8101d40 0x7f8bf819ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:30.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.024+0000 7f8bfd0ff700 1 -- 172.21.15.49:0/2836492596 >> 172.21.15.49:0/2836492596 conn(0x7f8bf8078300 msgr2=0x7f8bf8100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:30.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.024+0000 7f8bfd0ff700 1 -- 172.21.15.49:0/2836492596 shutdown_connections 2024-06-03T00:02:30.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:30.024+0000 7f8bfd0ff700 1 -- 172.21.15.49:0/2836492596 wait complete. 2024-06-03T00:02:30.369 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 03 00:02:30 smithi049 sudo[93790]: pam_unix(sudo:session): session closed for user root 2024-06-03T00:02:30.710 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 03 00:02:30 smithi049 sudo[93851]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-03T00:02:30.711 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 03 00:02:30 smithi049 sudo[93851]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-03T00:02:30.711 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 03 00:02:30 smithi049 sudo[93851]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-03T00:02:30.711 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 03 00:02:30 smithi049 sudo[93851]: pam_unix(sudo:session): session closed for user root 2024-06-03T00:02:30.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:30 smithi049 ceph-mon[32302]: pgmap v457: 97 pgs: 97 active+clean; 11 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 927 KiB/s wr, 151 op/s 2024-06-03T00:02:30.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:30 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:02:30.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:30 smithi107 ceph-mon[37048]: pgmap v457: 97 pgs: 97 active+clean; 11 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 927 KiB/s wr, 151 op/s 2024-06-03T00:02:30.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:30 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:02:30.915 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-06-03T00:02:30.940 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:30 smithi057 ceph-mon[36457]: pgmap v457: 97 pgs: 97 active+clean; 11 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 927 KiB/s wr, 151 op/s 2024-06-03T00:02:30.941 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:30 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:02:31.163 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:02:31.200 INFO:journalctl@ceph.osd.1.smithi057.stdout:Jun 03 00:02:30 smithi057 sudo[68744]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-03T00:02:31.200 INFO:journalctl@ceph.osd.1.smithi057.stdout:Jun 03 00:02:30 smithi057 sudo[68744]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-03T00:02:31.200 INFO:journalctl@ceph.osd.1.smithi057.stdout:Jun 03 00:02:30 smithi057 sudo[68744]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-03T00:02:31.200 INFO:journalctl@ceph.osd.1.smithi057.stdout:Jun 03 00:02:30 smithi057 sudo[68744]: pam_unix(sudo:session): session closed for user root 2024-06-03T00:02:31.700 INFO:journalctl@ceph.osd.1.smithi057.stdout:Jun 03 00:02:31 smithi057 sudo[68747]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-03T00:02:31.700 INFO:journalctl@ceph.osd.1.smithi057.stdout:Jun 03 00:02:31 smithi057 sudo[68747]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-03T00:02:31.700 INFO:journalctl@ceph.osd.1.smithi057.stdout:Jun 03 00:02:31 smithi057 sudo[68747]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-03T00:02:31.700 INFO:journalctl@ceph.osd.1.smithi057.stdout:Jun 03 00:02:31 smithi057 sudo[68747]: pam_unix(sudo:session): session closed for user root 2024-06-03T00:02:31.922 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 03 00:02:31 smithi107 sudo[70320]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-03T00:02:31.923 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 03 00:02:31 smithi107 sudo[70320]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-03T00:02:31.923 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 03 00:02:31 smithi107 sudo[70320]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-03T00:02:31.923 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 03 00:02:31 smithi107 sudo[70320]: pam_unix(sudo:session): session closed for user root 2024-06-03T00:02:32.350 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 03 00:02:31 smithi107 sudo[70323]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-03T00:02:32.351 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 03 00:02:31 smithi107 sudo[70323]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-03T00:02:32.351 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 03 00:02:31 smithi107 sudo[70323]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-03T00:02:32.351 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 03 00:02:31 smithi107 sudo[70323]: pam_unix(sudo:session): session closed for user root 2024-06-03T00:02:32.557 INFO:journalctl@ceph.osd.3.smithi049.stdout:Jun 03 00:02:32 smithi049 sudo[93969]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-03T00:02:32.557 INFO:journalctl@ceph.osd.3.smithi049.stdout:Jun 03 00:02:32 smithi049 sudo[93969]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-03T00:02:32.558 INFO:journalctl@ceph.osd.3.smithi049.stdout:Jun 03 00:02:32 smithi049 sudo[93969]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-03T00:02:32.558 INFO:journalctl@ceph.osd.3.smithi049.stdout:Jun 03 00:02:32 smithi049 sudo[93969]: pam_unix(sudo:session): session closed for user root 2024-06-03T00:02:32.558 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:32 smithi049 ceph-mon[32302]: pgmap v458: 97 pgs: 97 active+clean; 15 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 1.3 MiB/s wr, 168 op/s 2024-06-03T00:02:32.558 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:32 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:02:32.558 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:32 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:02:32.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:32 smithi057 ceph-mon[36457]: pgmap v458: 97 pgs: 97 active+clean; 15 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 1.3 MiB/s wr, 168 op/s 2024-06-03T00:02:32.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:32 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:02:32.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:32 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:02:32.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.774+0000 7f952d45a700 1 -- 172.21.15.49:0/1683715707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9528102740 msgr2=0x7f9528102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:32.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.774+0000 7f952d45a700 1 --2- 172.21.15.49:0/1683715707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9528102740 0x7f9528102b20 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f95180099c0 tx=0x7f9518009cd0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.775+0000 7f952d45a700 1 -- 172.21.15.49:0/1683715707 shutdown_connections 2024-06-03T00:02:32.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.775+0000 7f952d45a700 1 --2- 172.21.15.49:0/1683715707 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9528107840 0x7f952810f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.775+0000 7f952d45a700 1 --2- 172.21.15.49:0/1683715707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9528102740 0x7f9528102b20 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.775+0000 7f952d45a700 1 --2- 172.21.15.49:0/1683715707 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95281030f0 0x7f9528107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.775+0000 7f952d45a700 1 -- 172.21.15.49:0/1683715707 >> 172.21.15.49:0/1683715707 conn(0x7f95280795f0 msgr2=0x7f9528079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:32.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.775+0000 7f952d45a700 1 -- 172.21.15.49:0/1683715707 shutdown_connections 2024-06-03T00:02:32.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.775+0000 7f952d45a700 1 -- 172.21.15.49:0/1683715707 wait complete. 2024-06-03T00:02:32.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.775+0000 7f952d45a700 1 Processor -- start 2024-06-03T00:02:32.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.775+0000 7f952d45a700 1 -- start start 2024-06-03T00:02:32.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.776+0000 7f952d45a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9528102740 0x7f952819e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:32.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.776+0000 7f952d45a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95281030f0 0x7f952819ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:32.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.776+0000 7f952d45a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9528107840 0x7f9528198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:32.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.776+0000 7f952d45a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9528112760 con 0x7f9528107840 2024-06-03T00:02:32.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.776+0000 7f952d45a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f95281125e0 con 0x7f95281030f0 2024-06-03T00:02:32.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.776+0000 7f952d45a700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f95281128e0 con 0x7f9528102740 2024-06-03T00:02:32.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.776+0000 7f95277fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9528107840 0x7f9528198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:32.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.776+0000 7f95277fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9528107840 0x7f9528198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50238/0 (socket says 172.21.15.49:50238) 2024-06-03T00:02:32.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.776+0000 7f95277fe700 1 -- 172.21.15.49:0/2063548443 learned_addr learned my addr 172.21.15.49:0/2063548443 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:32.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.776+0000 7f95267fc700 1 --2- 172.21.15.49:0/2063548443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95281030f0 0x7f952819ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:32.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.776+0000 7f9526ffd700 1 --2- 172.21.15.49:0/2063548443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9528102740 0x7f952819e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:32.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.776+0000 7f95277fe700 1 -- 172.21.15.49:0/2063548443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9528102740 msgr2=0x7f952819e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:32.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.776+0000 7f95277fe700 1 --2- 172.21.15.49:0/2063548443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9528102740 0x7f952819e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.776+0000 7f95277fe700 1 -- 172.21.15.49:0/2063548443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95281030f0 msgr2=0x7f952819ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:32.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.776+0000 7f95277fe700 1 --2- 172.21.15.49:0/2063548443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95281030f0 0x7f952819ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.776+0000 7f95277fe700 1 -- 172.21.15.49:0/2063548443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95281991c0 con 0x7f9528107840 2024-06-03T00:02:32.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.776+0000 7f95277fe700 1 --2- 172.21.15.49:0/2063548443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9528107840 0x7f9528198a60 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f9520007ee0 tx=0x7f95200117c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:32.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.777+0000 7f951ffff700 1 -- 172.21.15.49:0/2063548443 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9520004db0 con 0x7f9528107840 2024-06-03T00:02:32.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.777+0000 7f952d45a700 1 -- 172.21.15.49:0/2063548443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95281994b0 con 0x7f9528107840 2024-06-03T00:02:32.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.777+0000 7f952d45a700 1 -- 172.21.15.49:0/2063548443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95280746c0 con 0x7f9528107840 2024-06-03T00:02:32.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.777+0000 7f951ffff700 1 -- 172.21.15.49:0/2063548443 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9520005500 con 0x7f9528107840 2024-06-03T00:02:32.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.777+0000 7f951ffff700 1 -- 172.21.15.49:0/2063548443 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9520019770 con 0x7f9528107840 2024-06-03T00:02:32.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.779+0000 7f951ffff700 1 -- 172.21.15.49:0/2063548443 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9520005020 con 0x7f9528107840 2024-06-03T00:02:32.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.780+0000 7f951ffff700 1 --2- 172.21.15.49:0/2063548443 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f95140a2c20 0x7f95140a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:32.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.780+0000 7f9537cddb80 1 Processor -- start 2024-06-03T00:02:32.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.780+0000 7f9526ffd700 1 --2- 172.21.15.49:0/2063548443 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f95140a2c20 0x7f95140a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:32.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.780+0000 7f951ffff700 1 -- 172.21.15.49:0/2063548443 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f95200d2800 con 0x7f9528107840 2024-06-03T00:02:32.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.780+0000 7f9537cddb80 1 -- start start 2024-06-03T00:02:32.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.781+0000 7f9537cddb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f3210a640 0x564f3210aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:32.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.781+0000 7f9537cddb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f3210af60 0x564f321049e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:32.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.781+0000 7f9537cddb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f32104f20 0x564f32105340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:32.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.781+0000 7f9537cddb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564f32056810 con 0x564f3210af60 2024-06-03T00:02:32.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.781+0000 7f9537cddb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x564f31ffe720 con 0x564f3210a640 2024-06-03T00:02:32.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.781+0000 7f9537cddb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564f320527d0 con 0x564f32104f20 2024-06-03T00:02:32.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.781+0000 7f95267fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f3210af60 0x564f321049e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:32.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.781+0000 7f9526ffd700 1 --2- 172.21.15.49:0/2063548443 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f95140a2c20 0x7f95140a50e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9518000c00 tx=0x7f9518005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:32.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.781+0000 7f95267fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f3210af60 0x564f321049e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50248/0 (socket says 172.21.15.49:50248) 2024-06-03T00:02:32.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.781+0000 7f95267fc700 1 -- 172.21.15.49:0/1790932199 learned_addr learned my addr 172.21.15.49:0/1790932199 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:32.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.781+0000 7f95277fe700 1 --2- 172.21.15.49:0/1790932199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f32104f20 0x564f32105340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:32.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.781+0000 7f9526ffd700 1 --2- 172.21.15.49:0/1790932199 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f3210a640 0x564f3210aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:32.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.781+0000 7f95277fe700 1 -- 172.21.15.49:0/1790932199 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f3210a640 msgr2=0x564f3210aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:32.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.781+0000 7f95277fe700 1 --2- 172.21.15.49:0/1790932199 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f3210a640 0x564f3210aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.781+0000 7f95277fe700 1 -- 172.21.15.49:0/1790932199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f3210af60 msgr2=0x564f321049e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:32.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.781+0000 7f95277fe700 1 --2- 172.21.15.49:0/1790932199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f3210af60 0x564f321049e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.781+0000 7f95277fe700 1 -- 172.21.15.49:0/1790932199 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f31ff4f50 con 0x564f32104f20 2024-06-03T00:02:32.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.781+0000 7f95267fc700 1 --2- 172.21.15.49:0/1790932199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f3210af60 0x564f321049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:02:32.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.782+0000 7f95277fe700 1 --2- 172.21.15.49:0/1790932199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f32104f20 0x564f32105340 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9520009510 tx=0x7f9520004f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b067b2540e43720 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:32.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.782+0000 7f951d7fa700 1 -- 172.21.15.49:0/1790932199 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95200a7cd0 con 0x564f32104f20 2024-06-03T00:02:32.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.782+0000 7f951d7fa700 1 -- 172.21.15.49:0/1790932199 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9520005310 con 0x564f32104f20 2024-06-03T00:02:32.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.782+0000 7f951d7fa700 1 -- 172.21.15.49:0/1790932199 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9520099e30 con 0x564f32104f20 2024-06-03T00:02:32.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.783+0000 7f9537cddb80 1 -- 172.21.15.49:0/1790932199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f32104f20 msgr2=0x564f32105340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:32.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.783+0000 7f9537cddb80 1 --2- 172.21.15.49:0/1790932199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f32104f20 0x564f32105340 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9520009510 tx=0x7f9520004f50 comp rx=0 tx=0).stop 2024-06-03T00:02:32.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.783+0000 7f9537cddb80 1 -- 172.21.15.49:0/1790932199 shutdown_connections 2024-06-03T00:02:32.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.783+0000 7f9537cddb80 1 --2- 172.21.15.49:0/1790932199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f32104f20 0x564f32105340 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.783+0000 7f9537cddb80 1 --2- 172.21.15.49:0/1790932199 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f3210a640 0x564f3210aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.783+0000 7f9537cddb80 1 --2- 172.21.15.49:0/1790932199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f3210af60 0x564f321049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.783+0000 7f9537cddb80 1 -- 172.21.15.49:0/1790932199 >> 172.21.15.49:0/1790932199 conn(0x564f3202fcc0 msgr2=0x564f320ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:32.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.783+0000 7f9537cddb80 1 -- 172.21.15.49:0/1790932199 shutdown_connections 2024-06-03T00:02:32.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.783+0000 7f9537cddb80 1 -- 172.21.15.49:0/1790932199 wait complete. 2024-06-03T00:02:32.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.783+0000 7f9537cddb80 1 -- start start 2024-06-03T00:02:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.783+0000 7f9537cddb80 1 Processor -- start 2024-06-03T00:02:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.784+0000 7f9537cddb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f32104f20 0x564f32110dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.784+0000 7f9537cddb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f3210a640 0x564f3210e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.784+0000 7f9537cddb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f3210af60 0x564f3210e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.784+0000 7f95277fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f3210af60 0x564f3210e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.784+0000 7f95277fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f3210af60 0x564f3210e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50260/0 (socket says 172.21.15.49:50260) 2024-06-03T00:02:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.784+0000 7f95277fe700 1 -- 172.21.15.49:0/1452514685 learned_addr learned my addr 172.21.15.49:0/1452514685 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.784+0000 7f9537cddb80 1 -- 172.21.15.49:0/1452514685 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564f321119d0 con 0x564f3210af60 2024-06-03T00:02:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.784+0000 7f9537cddb80 1 -- 172.21.15.49:0/1452514685 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x564f31ff6bf0 con 0x564f32104f20 2024-06-03T00:02:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.784+0000 7f9537cddb80 1 -- 172.21.15.49:0/1452514685 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564f32111b50 con 0x564f3210a640 2024-06-03T00:02:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.784+0000 7f9526ffd700 1 --2- 172.21.15.49:0/1452514685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f32104f20 0x564f32110dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.784+0000 7f95267fc700 1 --2- 172.21.15.49:0/1452514685 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f3210a640 0x564f3210e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.784+0000 7f9537cddb80 10 client.0 _ll_register_callbacks cb 0x564f31ff0920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:02:32.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.784+0000 7f95277fe700 1 -- 172.21.15.49:0/1452514685 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f3210a640 msgr2=0x564f3210e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:32.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.784+0000 7f95277fe700 1 --2- 172.21.15.49:0/1452514685 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f3210a640 0x564f3210e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.784+0000 7f95277fe700 1 -- 172.21.15.49:0/1452514685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f32104f20 msgr2=0x564f32110dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:32.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.784+0000 7f95277fe700 1 --2- 172.21.15.49:0/1452514685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f32104f20 0x564f32110dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.784+0000 7f95277fe700 1 -- 172.21.15.49:0/1452514685 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f31fa58d0 con 0x564f3210af60 2024-06-03T00:02:32.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.784+0000 7f9526ffd700 1 --2- 172.21.15.49:0/1452514685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f32104f20 0x564f32110dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:02:32.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.784+0000 7f95277fe700 1 --2- 172.21.15.49:0/1452514685 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f3210af60 0x564f3210e610 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f952009ed10 tx=0x7f952009b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c4e5a9d671c0be server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:32.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.784+0000 7f950e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:02:32.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.785+0000 7f950e7fc700 1 -- 172.21.15.49:0/1452514685 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95200a30f0 con 0x564f3210af60 2024-06-03T00:02:32.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.785+0000 7f950e7fc700 1 -- 172.21.15.49:0/1452514685 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f9520099bd0 con 0x564f3210af60 2024-06-03T00:02:32.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.785+0000 7f9537cddb80 1 -- 172.21.15.49:0/1452514685 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9520005310 con 0x564f3210af60 2024-06-03T00:02:32.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.785+0000 7f950e7fc700 1 -- 172.21.15.49:0/1452514685 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9520099dd0 con 0x564f3210af60 2024-06-03T00:02:32.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.785+0000 7f9537cddb80 10 client.15831 fetch_fsmap learned FSMap version 27 2024-06-03T00:02:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.785+0000 7f9537cddb80 1 -- 172.21.15.49:0/1452514685 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564f321119d0 con 0x564f3210af60 2024-06-03T00:02:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.785+0000 7f950e7fc700 1 -- 172.21.15.49:0/1452514685 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95200b8020 con 0x564f3210af60 2024-06-03T00:02:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.785+0000 7f950e7fc700 1 -- 172.21.15.49:0/1452514685 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f9520018030 con 0x564f3210af60 2024-06-03T00:02:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.785+0000 7f9537cddb80 10 client.15831 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:02:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.785+0000 7f9537cddb80 10 client.15831 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-03T00:02:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.785+0000 7f9537cddb80 20 client.15831 populate_metadata read hostname 'smithi049' 2024-06-03T00:02:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.785+0000 7f9537cddb80 1 --2- 172.21.15.49:0/1452514685 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x564f3211e6c0 0x564f32120ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.785+0000 7f9537cddb80 4 client.15831 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:02:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.785+0000 7f9537cddb80 1 -- 172.21.15.49:0/1452514685 --> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9520005310 con 0x564f3211e6c0 2024-06-03T00:02:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.786+0000 7f9526ffd700 1 --2- 172.21.15.49:0/1452514685 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x564f3211e6c0 0x564f32120ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.786+0000 7f950e7fc700 10 client.15831 ms_handle_connect on v2:172.21.15.107:6836/3700593315 2024-06-03T00:02:32.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.786+0000 7f9526ffd700 1 --2- 172.21.15.49:0/1452514685 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x564f3211e6c0 0x564f32120ab0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4666456c2f17a407 server_cookie=9455fbc2e0b2b81 in_seq=0 out_seq=0 2024-06-03T00:02:32.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.787+0000 7f950e7fc700 1 -- 172.21.15.49:0/1452514685 <== mds.2 v2:172.21.15.107:6836/3700593315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x7f9520005310 con 0x564f3211e6c0 2024-06-03T00:02:32.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.787+0000 7f950e7fc700 10 client.15831 handle_command_reply: tid=0 2024-06-03T00:02:32.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.787+0000 7f9537cddb80 1 client.15831 shutdown 2024-06-03T00:02:32.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.787+0000 7f9537cddb80 1 -- 172.21.15.49:0/1452514685 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f3210af60 msgr2=0x564f3210e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:32.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.787+0000 7f9537cddb80 1 --2- 172.21.15.49:0/1452514685 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f3210af60 0x564f3210e610 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f952009ed10 tx=0x7f952009b430 comp rx=0 tx=0).stop 2024-06-03T00:02:32.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.787+0000 7f9537cddb80 1 -- 172.21.15.49:0/1452514685 shutdown_connections 2024-06-03T00:02:32.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.787+0000 7f9537cddb80 1 --2- 172.21.15.49:0/1452514685 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x564f3211e6c0 0x564f32120ab0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.787+0000 7f9537cddb80 1 --2- 172.21.15.49:0/1452514685 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f3210af60 0x564f3210e610 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.787+0000 7f950e7fc700 0 client.15831 ms_handle_reset on v2:172.21.15.107:6836/3700593315 2024-06-03T00:02:32.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.787+0000 7f9537cddb80 1 --2- 172.21.15.49:0/1452514685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f32104f20 0x564f32110dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.787+0000 7f9537cddb80 1 --2- 172.21.15.49:0/1452514685 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f3210a640 0x564f3210e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.787+0000 7f9537cddb80 1 -- 172.21.15.49:0/1452514685 >> 172.21.15.49:0/1452514685 conn(0x564f3202fcc0 msgr2=0x564f321039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:32.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.787+0000 7f9537cddb80 1 -- 172.21.15.49:0/1452514685 shutdown_connections 2024-06-03T00:02:32.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.788+0000 7f9537cddb80 1 -- 172.21.15.49:0/1452514685 wait complete. 2024-06-03T00:02:32.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.788+0000 7f9537cddb80 20 client.15831 trim_cache size 0 max 16384 2024-06-03T00:02:32.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.827+0000 7f9537cddb80 1 Processor -- start 2024-06-03T00:02:32.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.827+0000 7f9537cddb80 1 -- start start 2024-06-03T00:02:32.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.828+0000 7f9537cddb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f32104f20 0x564f3211acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:32.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.828+0000 7f9537cddb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f3210a640 0x564f321049e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:32.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.828+0000 7f9537cddb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f3210af60 0x564f320f9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:32.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.828+0000 7f9537cddb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f950800d370 con 0x564f32104f20 2024-06-03T00:02:32.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.828+0000 7f9537cddb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f950800eeb0 con 0x564f3210a640 2024-06-03T00:02:32.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.828+0000 7f9537cddb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f950800da40 con 0x564f3210af60 2024-06-03T00:02:32.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.828+0000 7f9526ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f32104f20 0x564f3211acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:32.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.828+0000 7f9526ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f32104f20 0x564f3211acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50262/0 (socket says 172.21.15.49:50262) 2024-06-03T00:02:32.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.828+0000 7f9526ffd700 1 -- 172.21.15.49:0/3073659085 learned_addr learned my addr 172.21.15.49:0/3073659085 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:32.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.828+0000 7f95267fc700 1 --2- 172.21.15.49:0/3073659085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f3210a640 0x564f321049e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:32.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.828+0000 7f95277fe700 1 --2- 172.21.15.49:0/3073659085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f3210af60 0x564f320f9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:32.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.829+0000 7f9526ffd700 1 -- 172.21.15.49:0/3073659085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f3210af60 msgr2=0x564f320f9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:32.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.829+0000 7f9526ffd700 1 --2- 172.21.15.49:0/3073659085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f3210af60 0x564f320f9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.829+0000 7f9526ffd700 1 -- 172.21.15.49:0/3073659085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f3210a640 msgr2=0x564f321049e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:32.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.829+0000 7f9526ffd700 1 --2- 172.21.15.49:0/3073659085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f3210a640 0x564f321049e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.829+0000 7f9526ffd700 1 -- 172.21.15.49:0/3073659085 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f32100320 con 0x564f32104f20 2024-06-03T00:02:32.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.829+0000 7f95277fe700 1 --2- 172.21.15.49:0/3073659085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f3210af60 0x564f320f9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:02:32.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.829+0000 7f9526ffd700 1 --2- 172.21.15.49:0/3073659085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f32104f20 0x564f3211acd0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f95180098e0 tx=0x7f9518020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f040e3eea76ac44 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:32.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.829+0000 7f951cff9700 1 -- 172.21.15.49:0/3073659085 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951800f460 con 0x564f32104f20 2024-06-03T00:02:32.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.829+0000 7f951cff9700 1 -- 172.21.15.49:0/3073659085 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f951800fae0 con 0x564f32104f20 2024-06-03T00:02:32.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.829+0000 7f951cff9700 1 -- 172.21.15.49:0/3073659085 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9518032a00 con 0x564f32104f20 2024-06-03T00:02:32.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.830+0000 7f9537cddb80 1 -- 172.21.15.49:0/3073659085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f32104f20 msgr2=0x564f3211acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:32.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.830+0000 7f9537cddb80 1 --2- 172.21.15.49:0/3073659085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f32104f20 0x564f3211acd0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f95180098e0 tx=0x7f9518020000 comp rx=0 tx=0).stop 2024-06-03T00:02:32.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.830+0000 7f9537cddb80 1 -- 172.21.15.49:0/3073659085 shutdown_connections 2024-06-03T00:02:32.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.830+0000 7f9537cddb80 1 --2- 172.21.15.49:0/3073659085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f3210af60 0x564f320f9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.830+0000 7f9537cddb80 1 --2- 172.21.15.49:0/3073659085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f32104f20 0x564f3211acd0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.830+0000 7f9537cddb80 1 --2- 172.21.15.49:0/3073659085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f3210a640 0x564f321049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.830+0000 7f9537cddb80 1 -- 172.21.15.49:0/3073659085 >> 172.21.15.49:0/3073659085 conn(0x564f3202fcc0 msgr2=0x564f320f8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:32.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.831+0000 7f9537cddb80 1 -- 172.21.15.49:0/3073659085 shutdown_connections 2024-06-03T00:02:32.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.831+0000 7f9537cddb80 1 -- 172.21.15.49:0/3073659085 wait complete. 2024-06-03T00:02:32.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.831+0000 7f9537cddb80 1 -- start start 2024-06-03T00:02:32.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.831+0000 7f9537cddb80 1 Processor -- start 2024-06-03T00:02:32.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.831+0000 7f9537cddb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f32104f20 0x564f321175b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:32.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.831+0000 7f9537cddb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f3210a640 0x564f32125ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:32.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.831+0000 7f9537cddb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f3210af60 0x564f32125ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:32.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.832+0000 7f95277fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f3210af60 0x564f32125ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:32.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.832+0000 7f95277fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f3210af60 0x564f32125ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46920/0 (socket says 172.21.15.49:46920) 2024-06-03T00:02:32.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.832+0000 7f95277fe700 1 -- 172.21.15.49:0/4052000454 learned_addr learned my addr 172.21.15.49:0/4052000454 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:32.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.832+0000 7f9537cddb80 1 -- 172.21.15.49:0/4052000454 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f950800e7e0 con 0x564f3210af60 2024-06-03T00:02:32.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.832+0000 7f9537cddb80 1 -- 172.21.15.49:0/4052000454 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f950800e110 con 0x564f32104f20 2024-06-03T00:02:32.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.832+0000 7f9537cddb80 1 -- 172.21.15.49:0/4052000454 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f950800b2f0 con 0x564f3210a640 2024-06-03T00:02:32.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.832+0000 7f95267fc700 1 --2- 172.21.15.49:0/4052000454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f3210a640 0x564f32125ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:32.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.832+0000 7f9537cddb80 10 client.0 _ll_register_callbacks cb 0x7f9510009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:02:32.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.832+0000 7f9526ffd700 1 --2- 172.21.15.49:0/4052000454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f32104f20 0x564f321175b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:32.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.832+0000 7f95277fe700 1 -- 172.21.15.49:0/4052000454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f3210a640 msgr2=0x564f32125ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:32.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.832+0000 7f95277fe700 1 --2- 172.21.15.49:0/4052000454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f3210a640 0x564f32125ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.832+0000 7f95277fe700 1 -- 172.21.15.49:0/4052000454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f32104f20 msgr2=0x564f321175b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:32.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.832+0000 7f95277fe700 1 --2- 172.21.15.49:0/4052000454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f32104f20 0x564f321175b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.832+0000 7f95277fe700 1 -- 172.21.15.49:0/4052000454 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f321267f0 con 0x564f3210af60 2024-06-03T00:02:32.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.832+0000 7f95277fe700 1 --2- 172.21.15.49:0/4052000454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f3210af60 0x564f32125ff0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f952009e7e0 tx=0x7f9520011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6f9e220231e841 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:32.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.832+0000 7f950e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:02:32.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.833+0000 7f950e7fc700 1 -- 172.21.15.49:0/4052000454 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f952009e4b0 con 0x564f3210af60 2024-06-03T00:02:32.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.833+0000 7f950e7fc700 1 -- 172.21.15.49:0/4052000454 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f952009adb0 con 0x564f3210af60 2024-06-03T00:02:32.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.833+0000 7f9537cddb80 1 -- 172.21.15.49:0/4052000454 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f951800fae0 con 0x564f3210af60 2024-06-03T00:02:32.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.833+0000 7f950e7fc700 1 -- 172.21.15.49:0/4052000454 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9520005310 con 0x564f3210af60 2024-06-03T00:02:32.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.833+0000 7f9537cddb80 10 client.15837 fetch_fsmap learned FSMap version 27 2024-06-03T00:02:32.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.833+0000 7f9537cddb80 1 -- 172.21.15.49:0/4052000454 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564f321267f0 con 0x564f3210af60 2024-06-03T00:02:32.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.833+0000 7f950e7fc700 1 -- 172.21.15.49:0/4052000454 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f951800fae0 con 0x564f3210af60 2024-06-03T00:02:32.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.833+0000 7f950e7fc700 1 -- 172.21.15.49:0/4052000454 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f9520018070 con 0x564f3210af60 2024-06-03T00:02:32.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.833+0000 7f9537cddb80 10 client.15837 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:02:32.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.833+0000 7f9537cddb80 10 client.15837 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-03T00:02:32.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.833+0000 7f9537cddb80 20 client.15837 populate_metadata read hostname 'smithi049' 2024-06-03T00:02:32.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.833+0000 7f9537cddb80 1 --2- 172.21.15.49:0/4052000454 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x564f3211e6c0 0x564f3218b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:32.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.833+0000 7f9537cddb80 4 client.15837 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-03T00:02:32.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.833+0000 7f9537cddb80 1 -- 172.21.15.49:0/4052000454 --> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564f32063d10 con 0x564f3211e6c0 2024-06-03T00:02:32.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.834+0000 7f9526ffd700 1 --2- 172.21.15.49:0/4052000454 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x564f3211e6c0 0x564f3218b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:32.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.834+0000 7f9526ffd700 1 --2- 172.21.15.49:0/4052000454 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x564f3211e6c0 0x564f3218b400 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ba13e58f783b960a server_cookie=1ee1a248e344a56e in_seq=0 out_seq=0 2024-06-03T00:02:32.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.834+0000 7f950e7fc700 10 client.15837 ms_handle_connect on v2:172.21.15.107:6836/3700593315 2024-06-03T00:02:32.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.835+0000 7f950e7fc700 1 -- 172.21.15.49:0/4052000454 <== mds.2 v2:172.21.15.107:6836/3700593315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564f32063d10 con 0x564f3211e6c0 2024-06-03T00:02:32.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.835+0000 7f950e7fc700 10 client.15837 handle_command_reply: tid=0 2024-06-03T00:02:32.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.835+0000 7f9537cddb80 1 client.15837 shutdown 2024-06-03T00:02:32.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.835+0000 7f9537cddb80 1 -- 172.21.15.49:0/4052000454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f3210af60 msgr2=0x564f32125ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:32.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.835+0000 7f9537cddb80 1 --2- 172.21.15.49:0/4052000454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f3210af60 0x564f32125ff0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f952009e7e0 tx=0x7f9520011c40 comp rx=0 tx=0).stop 2024-06-03T00:02:32.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.835+0000 7f9537cddb80 1 -- 172.21.15.49:0/4052000454 shutdown_connections 2024-06-03T00:02:32.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.835+0000 7f9537cddb80 1 --2- 172.21.15.49:0/4052000454 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x564f3211e6c0 0x564f3218b400 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.835+0000 7f9537cddb80 1 --2- 172.21.15.49:0/4052000454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f3210af60 0x564f32125ff0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.835+0000 7f9537cddb80 1 --2- 172.21.15.49:0/4052000454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f32104f20 0x564f321175b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.835+0000 7f9537cddb80 1 --2- 172.21.15.49:0/4052000454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f3210a640 0x564f32125ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.835+0000 7f9537cddb80 1 -- 172.21.15.49:0/4052000454 >> 172.21.15.49:0/4052000454 conn(0x564f3202fcc0 msgr2=0x564f320f9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:32.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.835+0000 7f950e7fc700 0 client.15837 ms_handle_reset on v2:172.21.15.107:6836/3700593315 2024-06-03T00:02:32.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.835+0000 7f9537cddb80 1 -- 172.21.15.49:0/4052000454 shutdown_connections 2024-06-03T00:02:32.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.835+0000 7f9537cddb80 1 -- 172.21.15.49:0/4052000454 wait complete. 2024-06-03T00:02:32.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.835+0000 7f9537cddb80 20 client.15837 trim_cache size 0 max 16384 2024-06-03T00:02:32.840 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-06-03T00:02:32.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.836+0000 7f952d45a700 1 -- 172.21.15.49:0/2063548443 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f95140a2c20 msgr2=0x7f95140a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:32.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.836+0000 7f952d45a700 1 --2- 172.21.15.49:0/2063548443 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f95140a2c20 0x7f95140a50e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9518000c00 tx=0x7f9518005fb0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.836+0000 7f952d45a700 1 -- 172.21.15.49:0/2063548443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9528107840 msgr2=0x7f9528198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:32.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.836+0000 7f952d45a700 1 --2- 172.21.15.49:0/2063548443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9528107840 0x7f9528198a60 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f9520007ee0 tx=0x7f95200117c0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.836+0000 7f952d45a700 1 -- 172.21.15.49:0/2063548443 shutdown_connections 2024-06-03T00:02:32.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.836+0000 7f952d45a700 1 --2- 172.21.15.49:0/2063548443 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f95140a2c20 0x7f95140a50e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.836+0000 7f952d45a700 1 --2- 172.21.15.49:0/2063548443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9528107840 0x7f9528198a60 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.836+0000 7f952d45a700 1 --2- 172.21.15.49:0/2063548443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9528102740 0x7f952819e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.836+0000 7f952d45a700 1 --2- 172.21.15.49:0/2063548443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95281030f0 0x7f952819ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:32.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.836+0000 7f952d45a700 1 -- 172.21.15.49:0/2063548443 >> 172.21.15.49:0/2063548443 conn(0x7f95280795f0 msgr2=0x7f9528108990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:32.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.837+0000 7f952d45a700 1 -- 172.21.15.49:0/2063548443 shutdown_connections 2024-06-03T00:02:32.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:32.837+0000 7f952d45a700 1 -- 172.21.15.49:0/2063548443 wait complete. 2024-06-03T00:02:32.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:32 smithi107 ceph-mon[37048]: pgmap v458: 97 pgs: 97 active+clean; 15 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 1.3 MiB/s wr, 168 op/s 2024-06-03T00:02:32.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:32 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:02:32.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:32 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:02:33.210 INFO:journalctl@ceph.osd.3.smithi049.stdout:Jun 03 00:02:32 smithi049 sudo[94030]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-03T00:02:33.211 INFO:journalctl@ceph.osd.3.smithi049.stdout:Jun 03 00:02:32 smithi049 sudo[94030]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-03T00:02:33.211 INFO:journalctl@ceph.osd.3.smithi049.stdout:Jun 03 00:02:32 smithi049 sudo[94030]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-03T00:02:33.211 INFO:journalctl@ceph.osd.3.smithi049.stdout:Jun 03 00:02:32 smithi049 sudo[94030]: pam_unix(sudo:session): session closed for user root 2024-06-03T00:02:33.592 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-06-03T00:02:33.699 INFO:journalctl@ceph.osd.4.smithi057.stdout:Jun 03 00:02:33 smithi057 sudo[68752]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-03T00:02:33.700 INFO:journalctl@ceph.osd.4.smithi057.stdout:Jun 03 00:02:33 smithi057 sudo[68752]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-03T00:02:33.700 INFO:journalctl@ceph.osd.4.smithi057.stdout:Jun 03 00:02:33 smithi057 sudo[68752]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-03T00:02:33.700 INFO:journalctl@ceph.osd.4.smithi057.stdout:Jun 03 00:02:33 smithi057 sudo[68752]: pam_unix(sudo:session): session closed for user root 2024-06-03T00:02:33.848 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:02:34.200 INFO:journalctl@ceph.osd.4.smithi057.stdout:Jun 03 00:02:33 smithi057 sudo[68755]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-03T00:02:34.200 INFO:journalctl@ceph.osd.4.smithi057.stdout:Jun 03 00:02:33 smithi057 sudo[68755]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-03T00:02:34.200 INFO:journalctl@ceph.osd.4.smithi057.stdout:Jun 03 00:02:33 smithi057 sudo[68755]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-03T00:02:34.200 INFO:journalctl@ceph.osd.4.smithi057.stdout:Jun 03 00:02:33 smithi057 sudo[68755]: pam_unix(sudo:session): session closed for user root 2024-06-03T00:02:34.319 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:02:34 smithi107 sudo[70326]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-03T00:02:34.319 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:02:34 smithi107 sudo[70326]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-03T00:02:34.319 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:02:34 smithi107 sudo[70326]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-03T00:02:34.319 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:02:34 smithi107 sudo[70326]: pam_unix(sudo:session): session closed for user root 2024-06-03T00:02:34.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:34 smithi107 ceph-mon[37048]: pgmap v459: 97 pgs: 97 active+clean; 20 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 1.8 MiB/s wr, 197 op/s 2024-06-03T00:02:34.600 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:02:34 smithi107 sudo[70329]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-03T00:02:34.600 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:02:34 smithi107 sudo[70329]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-03T00:02:34.601 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:02:34 smithi107 sudo[70329]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-03T00:02:34.601 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:02:34 smithi107 sudo[70329]: pam_unix(sudo:session): session closed for user root 2024-06-03T00:02:34.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:34 smithi057 ceph-mon[36457]: pgmap v459: 97 pgs: 97 active+clean; 20 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 1.8 MiB/s wr, 197 op/s 2024-06-03T00:02:34.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:34 smithi049 ceph-mon[32302]: pgmap v459: 97 pgs: 97 active+clean; 20 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 1.8 MiB/s wr, 197 op/s 2024-06-03T00:02:35.210 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:02:34 smithi049 sudo[94131]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-03T00:02:35.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:02:34 smithi049 sudo[94131]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-03T00:02:35.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:02:34 smithi049 sudo[94131]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-03T00:02:35.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:02:34 smithi049 sudo[94131]: pam_unix(sudo:session): session closed for user root 2024-06-03T00:02:35.505 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:02:35 smithi049 sudo[94137]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-03T00:02:35.505 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:02:35 smithi049 sudo[94137]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-03T00:02:35.505 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:02:35 smithi049 sudo[94137]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-03T00:02:35.505 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:02:35 smithi049 sudo[94137]: pam_unix(sudo:session): session closed for user root 2024-06-03T00:02:35.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.855+0000 7f03093ee700 1 -- 172.21.15.49:0/3608581584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f030406ab30 msgr2=0x7f030410f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:35.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.855+0000 7f03093ee700 1 --2- 172.21.15.49:0/3608581584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f030406ab30 0x7f030410f320 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f02fc00b0a0 tx=0x7f02fc00b3b0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.855+0000 7f03093ee700 1 -- 172.21.15.49:0/3608581584 shutdown_connections 2024-06-03T00:02:35.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.855+0000 7f03093ee700 1 --2- 172.21.15.49:0/3608581584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f030406ab30 0x7f030410f320 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.855+0000 7f03093ee700 1 --2- 172.21.15.49:0/3608581584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0304108500 0x7f03041088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.855+0000 7f03093ee700 1 --2- 172.21.15.49:0/3608581584 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f030406a170 0x7f030406a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.855+0000 7f03093ee700 1 -- 172.21.15.49:0/3608581584 >> 172.21.15.49:0/3608581584 conn(0x7f0304078340 msgr2=0x7f0304078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:35.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.855+0000 7f03093ee700 1 -- 172.21.15.49:0/3608581584 shutdown_connections 2024-06-03T00:02:35.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.855+0000 7f03093ee700 1 -- 172.21.15.49:0/3608581584 wait complete. 2024-06-03T00:02:35.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.856+0000 7f03093ee700 1 Processor -- start 2024-06-03T00:02:35.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.856+0000 7f03093ee700 1 -- start start 2024-06-03T00:02:35.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.856+0000 7f03093ee700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f030406a170 0x7f030419e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:35.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.856+0000 7f03093ee700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f030406ab30 0x7f030419ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:35.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.856+0000 7f03093ee700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0304108500 0x7f03041989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:35.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.856+0000 7f03093ee700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f03041127e0 con 0x7f030406ab30 2024-06-03T00:02:35.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.856+0000 7f03093ee700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0304112660 con 0x7f030406a170 2024-06-03T00:02:35.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.856+0000 7f03093ee700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0304112960 con 0x7f0304108500 2024-06-03T00:02:35.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.857+0000 7f03027fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f030406ab30 0x7f030419ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:35.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.857+0000 7f0302ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f030406a170 0x7f030419e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:35.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.857+0000 7f03027fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f030406ab30 0x7f030419ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46938/0 (socket says 172.21.15.49:46938) 2024-06-03T00:02:35.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.857+0000 7f03027fc700 1 -- 172.21.15.49:0/812005431 learned_addr learned my addr 172.21.15.49:0/812005431 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:35.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.857+0000 7f03037fe700 1 --2- 172.21.15.49:0/812005431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0304108500 0x7f03041989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:35.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.857+0000 7f03027fc700 1 -- 172.21.15.49:0/812005431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0304108500 msgr2=0x7f03041989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:35.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.857+0000 7f03027fc700 1 --2- 172.21.15.49:0/812005431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0304108500 0x7f03041989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.857+0000 7f03027fc700 1 -- 172.21.15.49:0/812005431 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f030406a170 msgr2=0x7f030419e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:35.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.857+0000 7f03027fc700 1 --2- 172.21.15.49:0/812005431 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f030406a170 0x7f030419e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.857+0000 7f03027fc700 1 -- 172.21.15.49:0/812005431 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0304199140 con 0x7f030406ab30 2024-06-03T00:02:35.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.857+0000 7f03027fc700 1 --2- 172.21.15.49:0/812005431 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f030406ab30 0x7f030419ed10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f02f800b530 tx=0x7f02f800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:35.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.857+0000 7f02ebfff700 1 -- 172.21.15.49:0/812005431 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f8015020 con 0x7f030406ab30 2024-06-03T00:02:35.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.857+0000 7f02ebfff700 1 -- 172.21.15.49:0/812005431 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02f8011d10 con 0x7f030406ab30 2024-06-03T00:02:35.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.857+0000 7f03093ee700 1 -- 172.21.15.49:0/812005431 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0304199430 con 0x7f030406ab30 2024-06-03T00:02:35.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.857+0000 7f02ebfff700 1 -- 172.21.15.49:0/812005431 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f800f2e0 con 0x7f030406ab30 2024-06-03T00:02:35.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.857+0000 7f03093ee700 1 -- 172.21.15.49:0/812005431 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03041a56a0 con 0x7f030406ab30 2024-06-03T00:02:35.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.860+0000 7f02ebfff700 1 -- 172.21.15.49:0/812005431 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f02f8018020 con 0x7f030406ab30 2024-06-03T00:02:35.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.860+0000 7f02ebfff700 1 --2- 172.21.15.49:0/812005431 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f02ec0a2c20 0x7f02ec0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:35.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.861+0000 7f02ebfff700 1 -- 172.21.15.49:0/812005431 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f02f80ce760 con 0x7f030406ab30 2024-06-03T00:02:35.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.861+0000 7f0302ffd700 1 --2- 172.21.15.49:0/812005431 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f02ec0a2c20 0x7f02ec0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:35.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.861+0000 7f0302ffd700 1 --2- 172.21.15.49:0/812005431 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f02ec0a2c20 0x7f02ec0a50e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0304107e00 tx=0x7f02f400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:35.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.861+0000 7f0313c71b80 1 Processor -- start 2024-06-03T00:02:35.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.861+0000 7f0313c71b80 1 -- start start 2024-06-03T00:02:35.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.861+0000 7f0313c71b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e1cf40f60 0x559e1cf41340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:35.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.861+0000 7f0313c71b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e1cf41880 0x559e1cf3b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:35.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.861+0000 7f0313c71b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e1cf3b7a0 0x559e1cf3bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:35.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.862+0000 7f0313c71b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559e1ce2df60 con 0x559e1cf40f60 2024-06-03T00:02:35.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.862+0000 7f0313c71b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x559e1ce8c850 con 0x559e1cf3b7a0 2024-06-03T00:02:35.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.862+0000 7f0313c71b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x559e1cdf4460 con 0x559e1cf41880 2024-06-03T00:02:35.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.862+0000 7f0302ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e1cf40f60 0x559e1cf41340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:35.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.862+0000 7f03027fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e1cf41880 0x559e1cf3b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:35.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.862+0000 7f0302ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e1cf40f60 0x559e1cf41340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46942/0 (socket says 172.21.15.49:46942) 2024-06-03T00:02:35.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.862+0000 7f0302ffd700 1 -- 172.21.15.49:0/1372745655 learned_addr learned my addr 172.21.15.49:0/1372745655 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:35.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.862+0000 7f03037fe700 1 --2- 172.21.15.49:0/1372745655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e1cf3b7a0 0x559e1cf3bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:35.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.862+0000 7f0302ffd700 1 -- 172.21.15.49:0/1372745655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e1cf41880 msgr2=0x559e1cf3b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:35.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.862+0000 7f0302ffd700 1 --2- 172.21.15.49:0/1372745655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e1cf41880 0x559e1cf3b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.862+0000 7f0302ffd700 1 -- 172.21.15.49:0/1372745655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e1cf3b7a0 msgr2=0x559e1cf3bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:35.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.862+0000 7f0302ffd700 1 --2- 172.21.15.49:0/1372745655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e1cf3b7a0 0x559e1cf3bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.862+0000 7f0302ffd700 1 -- 172.21.15.49:0/1372745655 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e1cddb8d0 con 0x559e1cf40f60 2024-06-03T00:02:35.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.862+0000 7f03037fe700 1 --2- 172.21.15.49:0/1372745655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e1cf3b7a0 0x559e1cf3bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:02:35.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.862+0000 7f0302ffd700 1 --2- 172.21.15.49:0/1372745655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e1cf40f60 0x559e1cf41340 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f02f400fe90 tx=0x7f02f4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a1627d2e0c8d867 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:35.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.862+0000 7f02e97fa700 1 -- 172.21.15.49:0/1372745655 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f4016070 con 0x559e1cf40f60 2024-06-03T00:02:35.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.862+0000 7f02e97fa700 1 -- 172.21.15.49:0/1372745655 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02f4014070 con 0x559e1cf40f60 2024-06-03T00:02:35.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.862+0000 7f02e97fa700 1 -- 172.21.15.49:0/1372745655 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f401d400 con 0x559e1cf40f60 2024-06-03T00:02:35.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.863+0000 7f0313c71b80 1 -- 172.21.15.49:0/1372745655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e1cf40f60 msgr2=0x559e1cf41340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:35.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.863+0000 7f0313c71b80 1 --2- 172.21.15.49:0/1372745655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e1cf40f60 0x559e1cf41340 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f02f400fe90 tx=0x7f02f4012000 comp rx=0 tx=0).stop 2024-06-03T00:02:35.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.863+0000 7f0313c71b80 1 -- 172.21.15.49:0/1372745655 shutdown_connections 2024-06-03T00:02:35.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.863+0000 7f0313c71b80 1 --2- 172.21.15.49:0/1372745655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e1cf3b7a0 0x559e1cf3bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.863+0000 7f0313c71b80 1 --2- 172.21.15.49:0/1372745655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e1cf40f60 0x559e1cf41340 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.863+0000 7f0313c71b80 1 --2- 172.21.15.49:0/1372745655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e1cf41880 0x559e1cf3b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.863+0000 7f0313c71b80 1 -- 172.21.15.49:0/1372745655 >> 172.21.15.49:0/1372745655 conn(0x559e1ce68080 msgr2=0x559e1cf36220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:35.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.863+0000 7f0313c71b80 1 -- 172.21.15.49:0/1372745655 shutdown_connections 2024-06-03T00:02:35.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.863+0000 7f0313c71b80 1 -- 172.21.15.49:0/1372745655 wait complete. 2024-06-03T00:02:35.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.864+0000 7f0313c71b80 1 -- start start 2024-06-03T00:02:35.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.864+0000 7f0313c71b80 1 Processor -- start 2024-06-03T00:02:35.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.864+0000 7f0313c71b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e1cf3b7a0 0x559e1cf47580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:35.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.864+0000 7f0313c71b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e1cf40f60 0x559e1cf44880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:35.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.864+0000 7f0313c71b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e1cf41880 0x559e1cf44dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:35.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.864+0000 7f0313c71b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559e1ce2cfc0 con 0x559e1cf3b7a0 2024-06-03T00:02:35.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.864+0000 7f0313c71b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x559e1ce88810 con 0x559e1cf40f60 2024-06-03T00:02:35.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.864+0000 7f0313c71b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x559e1cf48260 con 0x559e1cf41880 2024-06-03T00:02:35.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.864+0000 7f0313c71b80 10 client.0 _ll_register_callbacks cb 0x559e1ce225b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:02:35.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.864+0000 7f0302ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e1cf3b7a0 0x559e1cf47580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:35.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.864+0000 7f03037fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e1cf41880 0x559e1cf44dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:35.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.864+0000 7f0302ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e1cf3b7a0 0x559e1cf47580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46956/0 (socket says 172.21.15.49:46956) 2024-06-03T00:02:35.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.864+0000 7f0302ffd700 1 -- 172.21.15.49:0/1345287657 learned_addr learned my addr 172.21.15.49:0/1345287657 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:35.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.864+0000 7f03027fc700 1 --2- 172.21.15.49:0/1345287657 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e1cf40f60 0x559e1cf44880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:35.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.864+0000 7f03037fe700 1 -- 172.21.15.49:0/1345287657 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e1cf40f60 msgr2=0x559e1cf44880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:35.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.864+0000 7f03037fe700 1 --2- 172.21.15.49:0/1345287657 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e1cf40f60 0x559e1cf44880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.864+0000 7f03037fe700 1 -- 172.21.15.49:0/1345287657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e1cf3b7a0 msgr2=0x559e1cf47580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:35.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.864+0000 7f03037fe700 1 --2- 172.21.15.49:0/1345287657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e1cf3b7a0 0x559e1cf47580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.864+0000 7f03037fe700 1 -- 172.21.15.49:0/1345287657 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e1ce52750 con 0x559e1cf41880 2024-06-03T00:02:35.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.865+0000 7f03027fc700 1 --2- 172.21.15.49:0/1345287657 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e1cf40f60 0x559e1cf44880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:02:35.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.865+0000 7f0302ffd700 1 --2- 172.21.15.49:0/1345287657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e1cf3b7a0 0x559e1cf47580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:02:35.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.865+0000 7f03037fe700 1 --2- 172.21.15.49:0/1345287657 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e1cf41880 0x559e1cf44dc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f02fc00b070 tx=0x7f02fc004cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff37f84fea428f0d server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:35.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.865+0000 7f02e6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-06-03T00:02:35.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.865+0000 7f02e6ff5700 1 -- 172.21.15.49:0/1345287657 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02fc0078f0 con 0x559e1cf41880 2024-06-03T00:02:35.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.865+0000 7f02e6ff5700 1 -- 172.21.15.49:0/1345287657 <== mon.1 v2:172.21.15.107:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f02fc007a90 con 0x559e1cf41880 2024-06-03T00:02:35.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.865+0000 7f0313c71b80 1 -- 172.21.15.49:0/1345287657 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02f4014070 con 0x559e1cf41880 2024-06-03T00:02:35.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.865+0000 7f02e6ff5700 1 -- 172.21.15.49:0/1345287657 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f02fc007c90 con 0x559e1cf41880 2024-06-03T00:02:35.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.865+0000 7f0313c71b80 10 client.25459 fetch_fsmap learned FSMap version 27 2024-06-03T00:02:35.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.865+0000 7f0313c71b80 1 -- 172.21.15.49:0/1345287657 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559e1cf529d0 con 0x559e1cf41880 2024-06-03T00:02:35.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.865+0000 7f02e6ff5700 1 -- 172.21.15.49:0/1345287657 <== mon.1 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02f4014070 con 0x559e1cf41880 2024-06-03T00:02:35.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.866+0000 7f02e6ff5700 1 -- 172.21.15.49:0/1345287657 <== mon.1 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f02fc011070 con 0x559e1cf41880 2024-06-03T00:02:35.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.866+0000 7f0313c71b80 10 client.25459 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:02:35.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.866+0000 7f0313c71b80 10 client.25459 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-06-03T00:02:35.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.866+0000 7f0313c71b80 20 client.25459 populate_metadata read hostname 'smithi049' 2024-06-03T00:02:35.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.866+0000 7f0313c71b80 1 --2- 172.21.15.49:0/1345287657 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x559e1cf55010 0x559e1cf57400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:35.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.866+0000 7f0313c71b80 4 client.25459 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:02:35.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.866+0000 7f0313c71b80 1 -- 172.21.15.49:0/1345287657 --> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e1ce99d50 con 0x559e1cf55010 2024-06-03T00:02:35.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.866+0000 7f0302ffd700 1 --2- 172.21.15.49:0/1345287657 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x559e1cf55010 0x559e1cf57400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:35.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.866+0000 7f0302ffd700 1 --2- 172.21.15.49:0/1345287657 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x559e1cf55010 0x559e1cf57400 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d5e4768bbcb7545c server_cookie=e64d4fe5223f0590 in_seq=0 out_seq=0 2024-06-03T00:02:35.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.866+0000 7f02e6ff5700 10 client.25459 ms_handle_connect on v2:172.21.15.57:6838/249825195 2024-06-03T00:02:35.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.867+0000 7f02e6ff5700 1 -- 172.21.15.49:0/1345287657 <== mds.1 v2:172.21.15.57:6838/249825195 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x559e1ce99d50 con 0x559e1cf55010 2024-06-03T00:02:35.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.867+0000 7f02e6ff5700 10 client.25459 handle_command_reply: tid=0 2024-06-03T00:02:35.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.867+0000 7f0313c71b80 1 client.25459 shutdown 2024-06-03T00:02:35.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.867+0000 7f0313c71b80 1 -- 172.21.15.49:0/1345287657 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e1cf41880 msgr2=0x559e1cf44dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:35.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.867+0000 7f0313c71b80 1 --2- 172.21.15.49:0/1345287657 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e1cf41880 0x559e1cf44dc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f02fc00b070 tx=0x7f02fc004cd0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.867+0000 7f0313c71b80 1 -- 172.21.15.49:0/1345287657 shutdown_connections 2024-06-03T00:02:35.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.867+0000 7f0313c71b80 1 --2- 172.21.15.49:0/1345287657 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x559e1cf55010 0x559e1cf57400 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.867+0000 7f0313c71b80 1 --2- 172.21.15.49:0/1345287657 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e1cf41880 0x559e1cf44dc0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.867+0000 7f0313c71b80 1 --2- 172.21.15.49:0/1345287657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e1cf3b7a0 0x559e1cf47580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.867+0000 7f02e6ff5700 0 client.25459 ms_handle_reset on v2:172.21.15.57:6838/249825195 2024-06-03T00:02:35.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.867+0000 7f0313c71b80 1 --2- 172.21.15.49:0/1345287657 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e1cf40f60 0x559e1cf44880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.867+0000 7f0313c71b80 1 -- 172.21.15.49:0/1345287657 >> 172.21.15.49:0/1345287657 conn(0x559e1ce68080 msgr2=0x559e1cf35700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:35.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.867+0000 7f0313c71b80 1 -- 172.21.15.49:0/1345287657 shutdown_connections 2024-06-03T00:02:35.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.867+0000 7f0313c71b80 1 -- 172.21.15.49:0/1345287657 wait complete. 2024-06-03T00:02:35.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.867+0000 7f0313c71b80 20 client.25459 trim_cache size 0 max 16384 2024-06-03T00:02:35.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.883+0000 7f0313c71b80 1 Processor -- start 2024-06-03T00:02:35.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.883+0000 7f0313c71b80 1 -- start start 2024-06-03T00:02:35.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.883+0000 7f0313c71b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e1cf3b7a0 0x559e1cf42370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:35.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.883+0000 7f0313c71b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e1cf40f60 0x559e1cf4d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:35.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.883+0000 7f0313c71b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e1cf41880 0x559e1cf4dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:35.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.883+0000 7f0313c71b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f03041acbb0 con 0x559e1cf40f60 2024-06-03T00:02:35.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.883+0000 7f0313c71b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f03041ae6f0 con 0x559e1cf3b7a0 2024-06-03T00:02:35.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.883+0000 7f0313c71b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f03041ad280 con 0x559e1cf41880 2024-06-03T00:02:35.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.883+0000 7f03027fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e1cf40f60 0x559e1cf4d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:35.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.883+0000 7f03037fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e1cf41880 0x559e1cf4dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:35.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.883+0000 7f03027fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e1cf40f60 0x559e1cf4d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46964/0 (socket says 172.21.15.49:46964) 2024-06-03T00:02:35.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.883+0000 7f03027fc700 1 -- 172.21.15.49:0/2675056787 learned_addr learned my addr 172.21.15.49:0/2675056787 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:35.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.883+0000 7f0302ffd700 1 --2- 172.21.15.49:0/2675056787 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e1cf3b7a0 0x559e1cf42370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:35.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.884+0000 7f0302ffd700 1 -- 172.21.15.49:0/2675056787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e1cf41880 msgr2=0x559e1cf4dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:35.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.884+0000 7f0302ffd700 1 --2- 172.21.15.49:0/2675056787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e1cf41880 0x559e1cf4dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.884+0000 7f0302ffd700 1 -- 172.21.15.49:0/2675056787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e1cf40f60 msgr2=0x559e1cf4d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:35.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.884+0000 7f0302ffd700 1 --2- 172.21.15.49:0/2675056787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e1cf40f60 0x559e1cf4d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.884+0000 7f0302ffd700 1 -- 172.21.15.49:0/2675056787 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e1cf3c190 con 0x559e1cf3b7a0 2024-06-03T00:02:35.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.884+0000 7f03027fc700 1 --2- 172.21.15.49:0/2675056787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e1cf40f60 0x559e1cf4d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:02:35.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.884+0000 7f0302ffd700 1 --2- 172.21.15.49:0/2675056787 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e1cf3b7a0 0x559e1cf42370 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f02f4005f20 tx=0x7f02f400ffc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79af8981801cc8ff server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:35.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.884+0000 7f02e8ff9700 1 -- 172.21.15.49:0/2675056787 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f4016030 con 0x559e1cf3b7a0 2024-06-03T00:02:35.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.884+0000 7f02e8ff9700 1 -- 172.21.15.49:0/2675056787 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02f4014070 con 0x559e1cf3b7a0 2024-06-03T00:02:35.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.884+0000 7f02e8ff9700 1 -- 172.21.15.49:0/2675056787 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f4030400 con 0x559e1cf3b7a0 2024-06-03T00:02:35.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.885+0000 7f0313c71b80 1 -- 172.21.15.49:0/2675056787 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e1cf3b7a0 msgr2=0x559e1cf42370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:35.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.885+0000 7f0313c71b80 1 --2- 172.21.15.49:0/2675056787 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e1cf3b7a0 0x559e1cf42370 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f02f4005f20 tx=0x7f02f400ffc0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.885+0000 7f0313c71b80 1 -- 172.21.15.49:0/2675056787 shutdown_connections 2024-06-03T00:02:35.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.885+0000 7f0313c71b80 1 --2- 172.21.15.49:0/2675056787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e1cf41880 0x559e1cf4dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.885+0000 7f0313c71b80 1 --2- 172.21.15.49:0/2675056787 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e1cf3b7a0 0x559e1cf42370 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.885+0000 7f0313c71b80 1 --2- 172.21.15.49:0/2675056787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e1cf40f60 0x559e1cf4d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.885+0000 7f0313c71b80 1 -- 172.21.15.49:0/2675056787 >> 172.21.15.49:0/2675056787 conn(0x559e1ce68080 msgr2=0x559e1cf41c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:35.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.885+0000 7f0313c71b80 1 -- 172.21.15.49:0/2675056787 shutdown_connections 2024-06-03T00:02:35.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.885+0000 7f0313c71b80 1 -- 172.21.15.49:0/2675056787 wait complete. 2024-06-03T00:02:35.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.885+0000 7f0313c71b80 1 -- start start 2024-06-03T00:02:35.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.885+0000 7f0313c71b80 1 Processor -- start 2024-06-03T00:02:35.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.885+0000 7f0313c71b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e1cf3b7a0 0x559e1cf5d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:35.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.885+0000 7f0313c71b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e1cf40f60 0x559e1cf35450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:35.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.885+0000 7f0313c71b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e1cf41880 0x559e1cf35990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:35.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.885+0000 7f0313c71b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f03041ae020 con 0x559e1cf41880 2024-06-03T00:02:35.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.886+0000 7f0313c71b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f03041ad950 con 0x559e1cf40f60 2024-06-03T00:02:35.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.886+0000 7f0313c71b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f03041aab30 con 0x559e1cf3b7a0 2024-06-03T00:02:35.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.886+0000 7f0313c71b80 10 client.0 _ll_register_callbacks cb 0x559e1ce225b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:02:35.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.886+0000 7f03027fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e1cf40f60 0x559e1cf35450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:35.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.886+0000 7f0302ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e1cf3b7a0 0x559e1cf5d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:35.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.886+0000 7f03027fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e1cf40f60 0x559e1cf35450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.49:47836/0 (socket says 172.21.15.49:47836) 2024-06-03T00:02:35.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.886+0000 7f03027fc700 1 -- 172.21.15.49:0/728329892 learned_addr learned my addr 172.21.15.49:0/728329892 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:35.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.886+0000 7f0302ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e1cf3b7a0 0x559e1cf5d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:38926/0 (socket says 172.21.15.49:38926) 2024-06-03T00:02:35.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.886+0000 7f03037fe700 1 --2- 172.21.15.49:0/728329892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e1cf41880 0x559e1cf35990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:35.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.886+0000 7f03027fc700 1 -- 172.21.15.49:0/728329892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e1cf3b7a0 msgr2=0x559e1cf5d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:35.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.886+0000 7f03027fc700 1 --2- 172.21.15.49:0/728329892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e1cf3b7a0 0x559e1cf5d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.886+0000 7f03027fc700 1 -- 172.21.15.49:0/728329892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e1cf41880 msgr2=0x559e1cf35990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:35.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.886+0000 7f03027fc700 1 --2- 172.21.15.49:0/728329892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e1cf41880 0x559e1cf35990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.886+0000 7f03027fc700 1 -- 172.21.15.49:0/728329892 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e1cf36140 con 0x559e1cf40f60 2024-06-03T00:02:35.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.886+0000 7f03037fe700 1 --2- 172.21.15.49:0/728329892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e1cf41880 0x559e1cf35990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:02:35.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.886+0000 7f03027fc700 1 --2- 172.21.15.49:0/728329892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e1cf40f60 0x559e1cf35450 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f02f800bb90 tx=0x7f02f80109a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff92f51d93ed0cf7 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:35.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.886+0000 7f02e6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2024-06-03T00:02:35.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.886+0000 7f02e6ff5700 1 -- 172.21.15.49:0/728329892 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f809afc0 con 0x559e1cf40f60 2024-06-03T00:02:35.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.886+0000 7f0313c71b80 1 -- 172.21.15.49:0/728329892 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02f4014070 con 0x559e1cf40f60 2024-06-03T00:02:35.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.886+0000 7f02e6ff5700 1 -- 172.21.15.49:0/728329892 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f02f80105a0 con 0x559e1cf40f60 2024-06-03T00:02:35.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.886+0000 7f02e6ff5700 1 -- 172.21.15.49:0/728329892 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f02f8066170 con 0x559e1cf40f60 2024-06-03T00:02:35.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.887+0000 7f0313c71b80 10 client.25394 fetch_fsmap learned FSMap version 27 2024-06-03T00:02:35.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.887+0000 7f0313c71b80 1 -- 172.21.15.49:0/728329892 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559e1cfc3d00 con 0x559e1cf40f60 2024-06-03T00:02:35.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.887+0000 7f02e6ff5700 1 -- 172.21.15.49:0/728329892 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02f4014070 con 0x559e1cf40f60 2024-06-03T00:02:35.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.887+0000 7f02e6ff5700 1 -- 172.21.15.49:0/728329892 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f02f809d040 con 0x559e1cf40f60 2024-06-03T00:02:35.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.887+0000 7f0313c71b80 10 client.25394 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:02:35.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.887+0000 7f0313c71b80 10 client.25394 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-06-03T00:02:35.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.887+0000 7f0313c71b80 20 client.25394 populate_metadata read hostname 'smithi049' 2024-06-03T00:02:35.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.887+0000 7f0313c71b80 1 --2- 172.21.15.49:0/728329892 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x559e1cfc4360 0x559e1cfc6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:35.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.887+0000 7f0313c71b80 4 client.25394 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-03T00:02:35.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.887+0000 7f0313c71b80 1 -- 172.21.15.49:0/728329892 --> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559e1ce942d0 con 0x559e1cfc4360 2024-06-03T00:02:35.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.887+0000 7f0302ffd700 1 --2- 172.21.15.49:0/728329892 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x559e1cfc4360 0x559e1cfc6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:35.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.888+0000 7f0302ffd700 1 --2- 172.21.15.49:0/728329892 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x559e1cfc4360 0x559e1cfc6750 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cffac165ef767f4f server_cookie=e7e041374835bee1 in_seq=0 out_seq=0 2024-06-03T00:02:35.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.888+0000 7f02e6ff5700 10 client.25394 ms_handle_connect on v2:172.21.15.57:6838/249825195 2024-06-03T00:02:35.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.888+0000 7f02e6ff5700 1 -- 172.21.15.49:0/728329892 <== mds.1 v2:172.21.15.57:6838/249825195 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559e1ce942d0 con 0x559e1cfc4360 2024-06-03T00:02:35.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.888+0000 7f02e6ff5700 10 client.25394 handle_command_reply: tid=0 2024-06-03T00:02:35.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.888+0000 7f0313c71b80 1 client.25394 shutdown 2024-06-03T00:02:35.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.888+0000 7f0313c71b80 1 -- 172.21.15.49:0/728329892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e1cf40f60 msgr2=0x559e1cf35450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:35.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.888+0000 7f0313c71b80 1 --2- 172.21.15.49:0/728329892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e1cf40f60 0x559e1cf35450 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f02f800bb90 tx=0x7f02f80109a0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.888+0000 7f0313c71b80 1 -- 172.21.15.49:0/728329892 shutdown_connections 2024-06-03T00:02:35.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.888+0000 7f0313c71b80 1 --2- 172.21.15.49:0/728329892 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x559e1cfc4360 0x559e1cfc6750 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.888+0000 7f0313c71b80 1 --2- 172.21.15.49:0/728329892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e1cf41880 0x559e1cf35990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.888+0000 7f0313c71b80 1 --2- 172.21.15.49:0/728329892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e1cf3b7a0 0x559e1cf5d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.888+0000 7f02e6ff5700 0 client.25394 ms_handle_reset on v2:172.21.15.57:6838/249825195 2024-06-03T00:02:35.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.888+0000 7f0313c71b80 1 --2- 172.21.15.49:0/728329892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e1cf40f60 0x559e1cf35450 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.888+0000 7f0313c71b80 1 -- 172.21.15.49:0/728329892 >> 172.21.15.49:0/728329892 conn(0x559e1ce68080 msgr2=0x559e1cf460b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:35.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.888+0000 7f0313c71b80 1 -- 172.21.15.49:0/728329892 shutdown_connections 2024-06-03T00:02:35.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.888+0000 7f0313c71b80 1 -- 172.21.15.49:0/728329892 wait complete. 2024-06-03T00:02:35.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.888+0000 7f0313c71b80 20 client.25394 trim_cache size 0 max 16384 2024-06-03T00:02:35.897 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-06-03T00:02:35.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.889+0000 7f03093ee700 1 -- 172.21.15.49:0/812005431 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f02ec0a2c20 msgr2=0x7f02ec0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:35.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.889+0000 7f03093ee700 1 --2- 172.21.15.49:0/812005431 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f02ec0a2c20 0x7f02ec0a50e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0304107e00 tx=0x7f02f400a380 comp rx=0 tx=0).stop 2024-06-03T00:02:35.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.889+0000 7f03093ee700 1 -- 172.21.15.49:0/812005431 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f030406ab30 msgr2=0x7f030419ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:35.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.889+0000 7f03093ee700 1 --2- 172.21.15.49:0/812005431 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f030406ab30 0x7f030419ed10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f02f800b530 tx=0x7f02f800b840 comp rx=0 tx=0).stop 2024-06-03T00:02:35.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.889+0000 7f03093ee700 1 -- 172.21.15.49:0/812005431 shutdown_connections 2024-06-03T00:02:35.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.889+0000 7f03093ee700 1 --2- 172.21.15.49:0/812005431 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f02ec0a2c20 0x7f02ec0a50e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.889+0000 7f03093ee700 1 --2- 172.21.15.49:0/812005431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0304108500 0x7f03041989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.889+0000 7f03093ee700 1 --2- 172.21.15.49:0/812005431 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f030406a170 0x7f030419e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.889+0000 7f03093ee700 1 --2- 172.21.15.49:0/812005431 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f030406ab30 0x7f030419ed10 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:35.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.889+0000 7f03093ee700 1 -- 172.21.15.49:0/812005431 >> 172.21.15.49:0/812005431 conn(0x7f0304078340 msgr2=0x7f03040ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:35.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.889+0000 7f03093ee700 1 -- 172.21.15.49:0/812005431 shutdown_connections 2024-06-03T00:02:35.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:35.889+0000 7f03093ee700 1 -- 172.21.15.49:0/812005431 wait complete. 2024-06-03T00:02:35.949 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:02:35 smithi057 sudo[68760]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-03T00:02:35.950 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:02:35 smithi057 sudo[68760]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-03T00:02:35.950 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:02:35 smithi057 sudo[68760]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-03T00:02:35.950 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:02:35 smithi057 sudo[68760]: pam_unix(sudo:session): session closed for user root 2024-06-03T00:02:36.430 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:02:36 smithi057 sudo[68764]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-03T00:02:36.430 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:02:36 smithi057 sudo[68764]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-03T00:02:36.430 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:02:36 smithi057 sudo[68764]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-03T00:02:36.430 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:02:36 smithi057 sudo[68764]: pam_unix(sudo:session): session closed for user root 2024-06-03T00:02:36.652 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:36 smithi049 ceph-mon[32302]: pgmap v460: 97 pgs: 97 active+clean; 24 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 2.2 MiB/s wr, 213 op/s 2024-06-03T00:02:36.653 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:36 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-03T00:02:36.695 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:36 smithi107 ceph-mon[37048]: pgmap v460: 97 pgs: 97 active+clean; 24 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 2.2 MiB/s wr, 213 op/s 2024-06-03T00:02:36.695 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:36 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-03T00:02:36.695 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:02:36 smithi107 sudo[70382]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-03T00:02:36.695 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:02:36 smithi107 sudo[70382]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-03T00:02:36.695 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:02:36 smithi107 sudo[70382]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-03T00:02:36.695 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:02:36 smithi107 sudo[70382]: pam_unix(sudo:session): session closed for user root 2024-06-03T00:02:36.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:36 smithi057 ceph-mon[36457]: pgmap v460: 97 pgs: 97 active+clean; 24 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 2.2 MiB/s wr, 213 op/s 2024-06-03T00:02:36.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:36 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-03T00:02:36.828 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-06-03T00:02:37.100 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:02:36 smithi107 sudo[70401]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-03T00:02:37.100 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:02:36 smithi107 sudo[70401]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-03T00:02:37.100 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:02:36 smithi107 sudo[70401]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-03T00:02:37.100 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:02:36 smithi107 sudo[70401]: pam_unix(sudo:session): session closed for user root 2024-06-03T00:02:37.143 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:02:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.437+0000 7f9c2595a640 1 -- 172.21.15.49:0/3650417512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c20104e40 msgr2=0x7f9c201052c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.437+0000 7f9c2595a640 1 --2- 172.21.15.49:0/3650417512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c20104e40 0x7f9c201052c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9c14009900 tx=0x7f9c1402a410 comp rx=0 tx=0).stop 2024-06-03T00:02:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.437+0000 7f9c2595a640 1 -- 172.21.15.49:0/3650417512 shutdown_connections 2024-06-03T00:02:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.437+0000 7f9c2595a640 1 --2- 172.21.15.49:0/3650417512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c20105800 0x7f9c2010c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.437+0000 7f9c2595a640 1 --2- 172.21.15.49:0/3650417512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c20104e40 0x7f9c201052c0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.437+0000 7f9c2595a640 1 --2- 172.21.15.49:0/3650417512 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c20103c50 0x7f9c20104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.437+0000 7f9c2595a640 1 -- 172.21.15.49:0/3650417512 >> 172.21.15.49:0/3650417512 conn(0x7f9c200ff1c0 msgr2=0x7f9c20101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.437+0000 7f9c2595a640 1 -- 172.21.15.49:0/3650417512 shutdown_connections 2024-06-03T00:02:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.437+0000 7f9c2595a640 1 -- 172.21.15.49:0/3650417512 wait complete. 2024-06-03T00:02:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.439+0000 7f9c2595a640 1 Processor -- start 2024-06-03T00:02:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.440+0000 7f9c2595a640 1 -- start start 2024-06-03T00:02:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.440+0000 7f9c2595a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c20103c50 0x7f9c20199ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.440+0000 7f9c2595a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c20104e40 0x7f9c2019a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.440+0000 7f9c2595a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c20105800 0x7f9c201a14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.440+0000 7f9c2595a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2010f8d0 con 0x7f9c20103c50 2024-06-03T00:02:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.440+0000 7f9c2595a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2010f750 con 0x7f9c20104e40 2024-06-03T00:02:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.440+0000 7f9c2595a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2010fa50 con 0x7f9c20105800 2024-06-03T00:02:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.440+0000 7f9c1effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c20103c50 0x7f9c20199ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.440+0000 7f9c1effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c20103c50 0x7f9c20199ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47006/0 (socket says 172.21.15.49:47006) 2024-06-03T00:02:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.440+0000 7f9c1effd640 1 -- 172.21.15.49:0/73735164 learned_addr learned my addr 172.21.15.49:0/73735164 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.441+0000 7f9c1f7fe640 1 --2- 172.21.15.49:0/73735164 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c20105800 0x7f9c201a14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.441+0000 7f9c1e7fc640 1 --2- 172.21.15.49:0/73735164 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c20104e40 0x7f9c2019a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.441+0000 7f9c1f7fe640 1 -- 172.21.15.49:0/73735164 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c20104e40 msgr2=0x7f9c2019a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.441+0000 7f9c1f7fe640 1 --2- 172.21.15.49:0/73735164 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c20104e40 0x7f9c2019a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.441+0000 7f9c1f7fe640 1 -- 172.21.15.49:0/73735164 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c20103c50 msgr2=0x7f9c20199ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.441+0000 7f9c1f7fe640 1 --2- 172.21.15.49:0/73735164 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c20103c50 0x7f9c20199ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.441+0000 7f9c1f7fe640 1 -- 172.21.15.49:0/73735164 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c201a1b10 con 0x7f9c20105800 2024-06-03T00:02:37.443 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.441+0000 7f9c1effd640 1 --2- 172.21.15.49:0/73735164 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c20103c50 0x7f9c20199ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:02:37.444 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.441+0000 7f9c1e7fc640 1 --2- 172.21.15.49:0/73735164 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c20104e40 0x7f9c2019a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:02:37.444 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.441+0000 7f9c1f7fe640 1 --2- 172.21.15.49:0/73735164 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c20105800 0x7f9c201a14a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800e940 tx=0x7f9c1800ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:37.444 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.441+0000 7f9c24958640 1 -- 172.21.15.49:0/73735164 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18004d20 con 0x7f9c20105800 2024-06-03T00:02:37.444 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.442+0000 7f9c24958640 1 -- 172.21.15.49:0/73735164 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c18005020 con 0x7f9c20105800 2024-06-03T00:02:37.444 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.442+0000 7f9c2595a640 1 -- 172.21.15.49:0/73735164 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c20075e40 con 0x7f9c20105800 2024-06-03T00:02:37.444 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.442+0000 7f9c24958640 1 -- 172.21.15.49:0/73735164 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c180116b0 con 0x7f9c20105800 2024-06-03T00:02:37.444 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.442+0000 7f9c2595a640 1 -- 172.21.15.49:0/73735164 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c20076360 con 0x7f9c20105800 2024-06-03T00:02:37.445 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.444+0000 7f9c24958640 1 -- 172.21.15.49:0/73735164 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9c1800cb20 con 0x7f9c20105800 2024-06-03T00:02:37.445 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.445+0000 7f9c24958640 1 --2- 172.21.15.49:0/73735164 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9c080a2d30 0x7f9c080a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:37.445 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.445+0000 7f9c24958640 1 -- 172.21.15.49:0/73735164 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f9c180cf070 con 0x7f9c20105800 2024-06-03T00:02:37.446 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.445+0000 7f9c1effd640 1 --2- 172.21.15.49:0/73735164 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9c080a2d30 0x7f9c080a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:37.447 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.446+0000 7f9c1effd640 1 --2- 172.21.15.49:0/73735164 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9c080a2d30 0x7f9c080a51f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9c100058c0 tx=0x7f9c10005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.446+0000 7f9c28661740 1 Processor -- start 2024-06-03T00:02:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.446+0000 7f9c28661740 1 -- start start 2024-06-03T00:02:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.446+0000 7f9c28661740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561f6df26010 0x561f6df26430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.446+0000 7f9c28661740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f6df26a00 0x561f6df2b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.446+0000 7f9c28661740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f6df2bb70 0x561f6df2e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.446+0000 7f9c28661740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x561f6de894f0 con 0x561f6df26010 2024-06-03T00:02:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.446+0000 7f9c28661740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x561f6de27870 con 0x561f6df26a00 2024-06-03T00:02:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.446+0000 7f9c28661740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561f6de854b0 con 0x561f6df2bb70 2024-06-03T00:02:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.446+0000 7f9c1effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561f6df26010 0x561f6df26430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.446+0000 7f9c1effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561f6df26010 0x561f6df26430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47022/0 (socket says 172.21.15.49:47022) 2024-06-03T00:02:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.446+0000 7f9c1effd640 1 -- 172.21.15.49:0/4127082288 learned_addr learned my addr 172.21.15.49:0/4127082288 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.446+0000 7f9c1e7fc640 1 --2- 172.21.15.49:0/4127082288 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f6df26a00 0x561f6df2b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.446+0000 7f9c1f7fe640 1 --2- 172.21.15.49:0/4127082288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f6df2bb70 0x561f6df2e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.447+0000 7f9c1e7fc640 1 -- 172.21.15.49:0/4127082288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f6df2bb70 msgr2=0x561f6df2e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.447+0000 7f9c1e7fc640 1 --2- 172.21.15.49:0/4127082288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f6df2bb70 0x561f6df2e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.447+0000 7f9c1e7fc640 1 -- 172.21.15.49:0/4127082288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561f6df26010 msgr2=0x561f6df26430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.447+0000 7f9c1e7fc640 1 --2- 172.21.15.49:0/4127082288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561f6df26010 0x561f6df26430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.447+0000 7f9c1e7fc640 1 -- 172.21.15.49:0/4127082288 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f6de439b0 con 0x561f6df26a00 2024-06-03T00:02:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.447+0000 7f9c1e7fc640 1 --2- 172.21.15.49:0/4127082288 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f6df26a00 0x561f6df2b500 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9c14005ab0 tx=0x7f9c1403fae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38a9d9944b709fd9 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.447+0000 7f9c05ffb640 1 -- 172.21.15.49:0/4127082288 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c14035050 con 0x561f6df26a00 2024-06-03T00:02:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.447+0000 7f9c05ffb640 1 -- 172.21.15.49:0/4127082288 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c14004030 con 0x561f6df26a00 2024-06-03T00:02:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.447+0000 7f9c05ffb640 1 -- 172.21.15.49:0/4127082288 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c14004780 con 0x561f6df26a00 2024-06-03T00:02:37.452 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.448+0000 7f9c28661740 1 -- 172.21.15.49:0/4127082288 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f6df26a00 msgr2=0x561f6df2b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:37.452 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.448+0000 7f9c28661740 1 --2- 172.21.15.49:0/4127082288 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f6df26a00 0x561f6df2b500 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9c14005ab0 tx=0x7f9c1403fae0 comp rx=0 tx=0).stop 2024-06-03T00:02:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.448+0000 7f9c28661740 1 -- 172.21.15.49:0/4127082288 shutdown_connections 2024-06-03T00:02:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.448+0000 7f9c28661740 1 --2- 172.21.15.49:0/4127082288 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f6df26a00 0x561f6df2b500 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.448+0000 7f9c28661740 1 --2- 172.21.15.49:0/4127082288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f6df2bb70 0x561f6df2e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.448+0000 7f9c28661740 1 --2- 172.21.15.49:0/4127082288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561f6df26010 0x561f6df26430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.448+0000 7f9c28661740 1 -- 172.21.15.49:0/4127082288 >> 172.21.15.49:0/4127082288 conn(0x561f6df21680 msgr2=0x561f6df21a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.448+0000 7f9c28661740 1 -- 172.21.15.49:0/4127082288 shutdown_connections 2024-06-03T00:02:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.448+0000 7f9c28661740 1 -- 172.21.15.49:0/4127082288 wait complete. 2024-06-03T00:02:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.448+0000 7f9c28661740 1 -- start start 2024-06-03T00:02:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.449+0000 7f9c28661740 1 Processor -- start 2024-06-03T00:02:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.450+0000 7f9c28661740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561f6df26010 0x561f6df30290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.450+0000 7f9c28661740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f6df26a00 0x561f6df307d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.450+0000 7f9c28661740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f6df2bb70 0x561f6df37810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.450+0000 7f9c28661740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x561f6df2ea60 con 0x561f6df26010 2024-06-03T00:02:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.450+0000 7f9c28661740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x561f6de12ae0 con 0x561f6df26a00 2024-06-03T00:02:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.450+0000 7f9c28661740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561f6df2ebe0 con 0x561f6df2bb70 2024-06-03T00:02:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.450+0000 7f9c28661740 10 client.0 _ll_register_callbacks cb 0x561f6de4b9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:02:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.450+0000 7f9c1effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561f6df26010 0x561f6df30290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.450+0000 7f9c1effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561f6df26010 0x561f6df30290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47036/0 (socket says 172.21.15.49:47036) 2024-06-03T00:02:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.450+0000 7f9c1effd640 1 -- 172.21.15.49:0/1894920359 learned_addr learned my addr 172.21.15.49:0/1894920359 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.450+0000 7f9c1f7fe640 1 --2- 172.21.15.49:0/1894920359 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f6df2bb70 0x561f6df37810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.450+0000 7f9c1e7fc640 1 --2- 172.21.15.49:0/1894920359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f6df26a00 0x561f6df307d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.450+0000 7f9c1e7fc640 1 -- 172.21.15.49:0/1894920359 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f6df2bb70 msgr2=0x561f6df37810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.450+0000 7f9c1e7fc640 1 --2- 172.21.15.49:0/1894920359 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f6df2bb70 0x561f6df37810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.450+0000 7f9c1e7fc640 1 -- 172.21.15.49:0/1894920359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561f6df26010 msgr2=0x561f6df30290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.450+0000 7f9c1e7fc640 1 --2- 172.21.15.49:0/1894920359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561f6df26010 0x561f6df30290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.450+0000 7f9c1e7fc640 1 -- 172.21.15.49:0/1894920359 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f6db9d210 con 0x561f6df26a00 2024-06-03T00:02:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.450+0000 7f9c1effd640 1 --2- 172.21.15.49:0/1894920359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561f6df26010 0x561f6df30290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:02:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.450+0000 7f9c1f7fe640 1 --2- 172.21.15.49:0/1894920359 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f6df2bb70 0x561f6df37810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:02:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.450+0000 7f9c1e7fc640 1 --2- 172.21.15.49:0/1894920359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f6df26a00 0x561f6df307d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x561f6df22550 tx=0x7f9c14004410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7e47c2d739aeda7 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.450+0000 7f9bfeffd640 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2024-06-03T00:02:37.456 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.451+0000 7f9bfeffd640 1 -- 172.21.15.49:0/1894920359 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c14056060 con 0x561f6df26a00 2024-06-03T00:02:37.456 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.451+0000 7f9c28661740 1 -- 172.21.15.49:0/1894920359 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c14004030 con 0x561f6df26a00 2024-06-03T00:02:37.456 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.451+0000 7f9bfeffd640 1 -- 172.21.15.49:0/1894920359 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f9c140318c0 con 0x561f6df26a00 2024-06-03T00:02:37.456 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.451+0000 7f9bfeffd640 1 -- 172.21.15.49:0/1894920359 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9c140035f0 con 0x561f6df26a00 2024-06-03T00:02:37.456 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.451+0000 7f9c28661740 10 client.25406 fetch_fsmap learned FSMap version 27 2024-06-03T00:02:37.456 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.451+0000 7f9c28661740 1 -- 172.21.15.49:0/1894920359 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561f6dc69620 con 0x561f6df26a00 2024-06-03T00:02:37.456 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.451+0000 7f9bfeffd640 1 -- 172.21.15.49:0/1894920359 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c14004030 con 0x561f6df26a00 2024-06-03T00:02:37.456 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.451+0000 7f9bfeffd640 1 -- 172.21.15.49:0/1894920359 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f9c1405b070 con 0x561f6df26a00 2024-06-03T00:02:37.456 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.451+0000 7f9c28661740 10 client.25406 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:02:37.456 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.451+0000 7f9c28661740 10 client.25406 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:02:37.456 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.451+0000 7f9c28661740 20 client.25406 populate_metadata read hostname 'smithi049' 2024-06-03T00:02:37.456 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.451+0000 7f9c28661740 1 --2- 172.21.15.49:0/1894920359 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x561f6df3bd00 0x561f6df3e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:37.457 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.451+0000 7f9c28661740 4 client.25406 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:02:37.457 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.451+0000 7f9c28661740 1 -- 172.21.15.49:0/1894920359 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f6de9cf10 con 0x561f6df3bd00 2024-06-03T00:02:37.457 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.452+0000 7f9c1effd640 1 --2- 172.21.15.49:0/1894920359 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x561f6df3bd00 0x561f6df3e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:37.457 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.452+0000 7f9bfeffd640 10 client.25406 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:37.457 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.452+0000 7f9c1effd640 1 --2- 172.21.15.49:0/1894920359 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x561f6df3bd00 0x561f6df3e0f0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90a8e161bc286a9c server_cookie=a0677d1c52f22fd1 in_seq=0 out_seq=0 2024-06-03T00:02:37.458 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.454+0000 7f9bfeffd640 1 -- 172.21.15.49:0/1894920359 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x561f6de9cf10 con 0x561f6df3bd00 2024-06-03T00:02:37.458 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.454+0000 7f9bfeffd640 10 client.25406 handle_command_reply: tid=0 2024-06-03T00:02:37.458 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.454+0000 7f9c28661740 1 client.25406 shutdown 2024-06-03T00:02:37.458 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.454+0000 7f9c28661740 1 -- 172.21.15.49:0/1894920359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f6df26a00 msgr2=0x561f6df307d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.454+0000 7f9c28661740 1 --2- 172.21.15.49:0/1894920359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f6df26a00 0x561f6df307d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x561f6df22550 tx=0x7f9c14004410 comp rx=0 tx=0).stop 2024-06-03T00:02:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.454+0000 7f9c28661740 1 -- 172.21.15.49:0/1894920359 shutdown_connections 2024-06-03T00:02:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.454+0000 7f9c28661740 1 --2- 172.21.15.49:0/1894920359 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x561f6df3bd00 0x561f6df3e0f0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.454+0000 7f9c28661740 1 --2- 172.21.15.49:0/1894920359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f6df26a00 0x561f6df307d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.454+0000 7f9c28661740 1 --2- 172.21.15.49:0/1894920359 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f6df2bb70 0x561f6df37810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.454+0000 7f9c28661740 1 --2- 172.21.15.49:0/1894920359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561f6df26010 0x561f6df30290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.454+0000 7f9c28661740 1 -- 172.21.15.49:0/1894920359 >> 172.21.15.49:0/1894920359 conn(0x561f6df21680 msgr2=0x561f6df207e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.454+0000 7f9bfeffd640 0 client.25406 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.454+0000 7f9c28661740 1 -- 172.21.15.49:0/1894920359 shutdown_connections 2024-06-03T00:02:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.454+0000 7f9c28661740 1 -- 172.21.15.49:0/1894920359 wait complete. 2024-06-03T00:02:37.459 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.454+0000 7f9c28661740 20 client.25406 trim_cache size 0 max 16384 2024-06-03T00:02:37.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.471+0000 7f9c28661740 1 Processor -- start 2024-06-03T00:02:37.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.471+0000 7f9c28661740 1 -- start start 2024-06-03T00:02:37.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.471+0000 7f9c28661740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f6df26010 0x561f6df30290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:37.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.471+0000 7f9c28661740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f6df26a00 0x561f6df377d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:37.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.471+0000 7f9c28661740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561f6df2bb70 0x561f6df307d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:37.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.471+0000 7f9c28661740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9c201a6c80 con 0x561f6df2bb70 2024-06-03T00:02:37.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.471+0000 7f9c28661740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9c201a87c0 con 0x561f6df26a00 2024-06-03T00:02:37.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.471+0000 7f9c28661740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9c201a7350 con 0x561f6df26010 2024-06-03T00:02:37.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.471+0000 7f9c1effd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f6df26010 0x561f6df30290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:37.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.471+0000 7f9c1f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561f6df2bb70 0x561f6df307d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:37.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.471+0000 7f9c1effd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f6df26010 0x561f6df30290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:38976/0 (socket says 172.21.15.49:38976) 2024-06-03T00:02:37.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.471+0000 7f9c1effd640 1 -- 172.21.15.49:0/2280720411 learned_addr learned my addr 172.21.15.49:0/2280720411 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:37.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.472+0000 7f9c1e7fc640 1 --2- 172.21.15.49:0/2280720411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f6df26a00 0x561f6df377d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:37.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.472+0000 7f9c1effd640 1 -- 172.21.15.49:0/2280720411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f6df26a00 msgr2=0x561f6df377d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:37.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.472+0000 7f9c1effd640 1 --2- 172.21.15.49:0/2280720411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f6df26a00 0x561f6df377d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:37.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.472+0000 7f9c1effd640 1 -- 172.21.15.49:0/2280720411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561f6df2bb70 msgr2=0x561f6df307d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:37.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.472+0000 7f9c1effd640 1 --2- 172.21.15.49:0/2280720411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561f6df2bb70 0x561f6df307d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:37.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.472+0000 7f9c1effd640 1 -- 172.21.15.49:0/2280720411 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f6df22350 con 0x561f6df26010 2024-06-03T00:02:37.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.472+0000 7f9c1effd640 1 --2- 172.21.15.49:0/2280720411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f6df26010 0x561f6df30290 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9c10011db0 tx=0x7f9c10018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27098013a549ab7a server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:37.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.472+0000 7f9c057fa640 1 -- 172.21.15.49:0/2280720411 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1001cb10 con 0x561f6df26010 2024-06-03T00:02:37.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.472+0000 7f9c057fa640 1 -- 172.21.15.49:0/2280720411 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c10005500 con 0x561f6df26010 2024-06-03T00:02:37.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.472+0000 7f9c057fa640 1 -- 172.21.15.49:0/2280720411 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c10004db0 con 0x561f6df26010 2024-06-03T00:02:37.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.473+0000 7f9c28661740 1 -- 172.21.15.49:0/2280720411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f6df26010 msgr2=0x561f6df30290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:37.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.473+0000 7f9c28661740 1 --2- 172.21.15.49:0/2280720411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f6df26010 0x561f6df30290 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9c10011db0 tx=0x7f9c10018000 comp rx=0 tx=0).stop 2024-06-03T00:02:37.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.473+0000 7f9c28661740 1 -- 172.21.15.49:0/2280720411 shutdown_connections 2024-06-03T00:02:37.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.474+0000 7f9c28661740 1 --2- 172.21.15.49:0/2280720411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f6df26a00 0x561f6df377d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:37.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.474+0000 7f9c28661740 1 --2- 172.21.15.49:0/2280720411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561f6df2bb70 0x561f6df307d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:37.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.474+0000 7f9c28661740 1 --2- 172.21.15.49:0/2280720411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f6df26010 0x561f6df30290 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:37.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.474+0000 7f9c28661740 1 -- 172.21.15.49:0/2280720411 >> 172.21.15.49:0/2280720411 conn(0x561f6df21680 msgr2=0x561f6df1c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:37.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.474+0000 7f9c28661740 1 -- 172.21.15.49:0/2280720411 shutdown_connections 2024-06-03T00:02:37.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.474+0000 7f9c28661740 1 -- 172.21.15.49:0/2280720411 wait complete. 2024-06-03T00:02:37.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.474+0000 7f9c28661740 1 -- start start 2024-06-03T00:02:37.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.475+0000 7f9c28661740 1 Processor -- start 2024-06-03T00:02:37.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.476+0000 7f9c28661740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561f6df26010 0x561f6df37410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:37.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.476+0000 7f9c28661740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f6df26a00 0x561f6df33f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:37.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.476+0000 7f9c28661740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f6df2bb70 0x561f6df34490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:37.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.476+0000 7f9c1effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561f6df26010 0x561f6df37410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:37.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.476+0000 7f9c28661740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9c201a80f0 con 0x561f6df26010 2024-06-03T00:02:37.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.476+0000 7f9c28661740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9c201a7a20 con 0x561f6df26a00 2024-06-03T00:02:37.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.476+0000 7f9c1effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561f6df26010 0x561f6df37410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47064/0 (socket says 172.21.15.49:47064) 2024-06-03T00:02:37.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.476+0000 7f9c28661740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9c201a4c40 con 0x561f6df2bb70 2024-06-03T00:02:37.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.476+0000 7f9c1effd640 1 -- 172.21.15.49:0/1955389709 learned_addr learned my addr 172.21.15.49:0/1955389709 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:37.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.476+0000 7f9c1e7fc640 1 --2- 172.21.15.49:0/1955389709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f6df26a00 0x561f6df33f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:37.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.476+0000 7f9c28661740 10 client.0 _ll_register_callbacks cb 0x7f9c10009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:02:37.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.476+0000 7f9c1f7fe640 1 --2- 172.21.15.49:0/1955389709 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f6df2bb70 0x561f6df34490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:37.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.476+0000 7f9c1effd640 1 -- 172.21.15.49:0/1955389709 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f6df2bb70 msgr2=0x561f6df34490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:37.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.476+0000 7f9c1effd640 1 --2- 172.21.15.49:0/1955389709 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f6df2bb70 0x561f6df34490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:37.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.476+0000 7f9c1effd640 1 -- 172.21.15.49:0/1955389709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f6df26a00 msgr2=0x561f6df33f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:37.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.476+0000 7f9c1effd640 1 --2- 172.21.15.49:0/1955389709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f6df26a00 0x561f6df33f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:37.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.476+0000 7f9c1effd640 1 -- 172.21.15.49:0/1955389709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f6df349d0 con 0x561f6df26010 2024-06-03T00:02:37.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.476+0000 7f9c1f7fe640 1 --2- 172.21.15.49:0/1955389709 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f6df2bb70 0x561f6df34490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:02:37.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.476+0000 7f9c1effd640 1 --2- 172.21.15.49:0/1955389709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561f6df26010 0x561f6df37410 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9c10009600 tx=0x7f9c100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd84b02cee8567b8 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:37.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.476+0000 7f9bfeffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:02:37.482 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.477+0000 7f9bfeffd640 1 -- 172.21.15.49:0/1955389709 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1001c910 con 0x561f6df26010 2024-06-03T00:02:37.482 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.477+0000 7f9bfeffd640 1 -- 172.21.15.49:0/1955389709 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f9c1001cab0 con 0x561f6df26010 2024-06-03T00:02:37.482 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.477+0000 7f9c28661740 1 -- 172.21.15.49:0/1955389709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c10005500 con 0x561f6df26010 2024-06-03T00:02:37.482 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.477+0000 7f9bfeffd640 1 -- 172.21.15.49:0/1955389709 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9c1001ccb0 con 0x561f6df26010 2024-06-03T00:02:37.482 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.477+0000 7f9c28661740 10 client.15873 fetch_fsmap learned FSMap version 27 2024-06-03T00:02:37.482 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.477+0000 7f9c28661740 1 -- 172.21.15.49:0/1955389709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561f6dfa58d0 con 0x561f6df26010 2024-06-03T00:02:37.482 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.477+0000 7f9bfeffd640 1 -- 172.21.15.49:0/1955389709 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c10005500 con 0x561f6df26010 2024-06-03T00:02:37.482 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.477+0000 7f9bfeffd640 1 -- 172.21.15.49:0/1955389709 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f9c10039070 con 0x561f6df26010 2024-06-03T00:02:37.482 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.478+0000 7f9c28661740 10 client.15873 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:02:37.482 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.478+0000 7f9c28661740 10 client.15873 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:02:37.482 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.478+0000 7f9c28661740 20 client.15873 populate_metadata read hostname 'smithi049' 2024-06-03T00:02:37.483 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.478+0000 7f9c28661740 1 --2- 172.21.15.49:0/1955389709 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x561f6dfa6290 0x561f6dfa86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:37.483 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.478+0000 7f9c28661740 4 client.15873 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-03T00:02:37.483 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.478+0000 7f9c28661740 1 -- 172.21.15.49:0/1955389709 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561f6de96c20 con 0x561f6dfa6290 2024-06-03T00:02:37.483 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.478+0000 7f9c1e7fc640 1 --2- 172.21.15.49:0/1955389709 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x561f6dfa6290 0x561f6dfa86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:37.483 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.478+0000 7f9bfeffd640 10 client.15873 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:37.483 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:37.478+0000 7f9c1e7fc640 1 --2- 172.21.15.49:0/1955389709 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x561f6dfa6290 0x561f6dfa86b0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=761c79ea369ffeaf server_cookie=aade5a83ac9a30f8 in_seq=0 out_seq=0 2024-06-03T00:02:37.574 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:02:37 smithi049 sudo[94432]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-03T00:02:37.574 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:02:37 smithi049 sudo[94432]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-03T00:02:37.574 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:02:37 smithi049 sudo[94432]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-03T00:02:37.574 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:02:37 smithi049 sudo[94432]: pam_unix(sudo:session): session closed for user root 2024-06-03T00:02:37.574 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:37 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-03T00:02:37.574 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:37 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-03T00:02:37.574 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:37 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:02:37.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:37 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-03T00:02:37.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:37 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-03T00:02:37.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:37 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:02:37.828 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:02:37 smithi049 sudo[94500]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-03T00:02:37.828 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:02:37 smithi049 sudo[94500]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-03T00:02:37.828 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:02:37 smithi049 sudo[94500]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-03T00:02:37.828 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:02:37 smithi049 sudo[94500]: pam_unix(sudo:session): session closed for user root 2024-06-03T00:02:37.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:37 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-03T00:02:37.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:37 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-03T00:02:37.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:37 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:02:38.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:02:38 smithi057 sudo[68899]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-03T00:02:38.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:02:38 smithi057 sudo[68899]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-03T00:02:38.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:02:38 smithi057 sudo[68899]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-03T00:02:38.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:02:38 smithi057 sudo[68899]: pam_unix(sudo:session): session closed for user root 2024-06-03T00:02:38.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:02:38 smithi057 sudo[68903]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-03T00:02:38.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:02:38 smithi057 sudo[68903]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-03T00:02:38.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:02:38 smithi057 sudo[68903]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-03T00:02:38.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:02:38 smithi057 sudo[68903]: pam_unix(sudo:session): session closed for user root 2024-06-03T00:02:39.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.087+0000 7f5127fff700 1 -- 172.21.15.49:0/417112401 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5120003d80 con 0x7f5130113690 2024-06-03T00:02:39.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.088+0000 7f513741a700 1 -- 172.21.15.49:0/417112401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5130113690 msgr2=0x7f5130115a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:39.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.088+0000 7f513741a700 1 --2- 172.21.15.49:0/417112401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5130113690 0x7f5130115a80 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5120009990 tx=0x7f5120009ca0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.088+0000 7f513741a700 1 -- 172.21.15.49:0/417112401 shutdown_connections 2024-06-03T00:02:39.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.088+0000 7f513741a700 1 --2- 172.21.15.49:0/417112401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5130113690 0x7f5130115a80 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.088+0000 7f513741a700 1 --2- 172.21.15.49:0/417112401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51300746c0 0x7f5130074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.088+0000 7f513741a700 1 --2- 172.21.15.49:0/417112401 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5130074fe0 0x7f5130113150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.088+0000 7f513741a700 1 -- 172.21.15.49:0/417112401 >> 172.21.15.49:0/417112401 conn(0x7f5130079640 msgr2=0x7f5130079a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:39.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.090+0000 7f513741a700 1 -- 172.21.15.49:0/417112401 shutdown_connections 2024-06-03T00:02:39.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.091+0000 7f513741a700 1 -- 172.21.15.49:0/417112401 wait complete. 2024-06-03T00:02:39.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.092+0000 7f513741a700 1 Processor -- start 2024-06-03T00:02:39.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.092+0000 7f513741a700 1 -- start start 2024-06-03T00:02:39.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.092+0000 7f513741a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51300746c0 0x7f513010daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:39.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.092+0000 7f513741a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5130074fe0 0x7f513010dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:39.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.092+0000 7f513741a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5130113690 0x7f51301b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:39.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.092+0000 7f513741a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5130107dd0 con 0x7f5130074fe0 2024-06-03T00:02:39.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.092+0000 7f513741a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5130107c50 con 0x7f5130113690 2024-06-03T00:02:39.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.092+0000 7f513741a700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5130107f50 con 0x7f51300746c0 2024-06-03T00:02:39.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.093+0000 7f51359b7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5130113690 0x7f51301b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:39.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.093+0000 7f51359b7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5130113690 0x7f51301b38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.49:47940/0 (socket says 172.21.15.49:47940) 2024-06-03T00:02:39.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.093+0000 7f51359b7700 1 -- 172.21.15.49:0/2848163998 learned_addr learned my addr 172.21.15.49:0/2848163998 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:39.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.093+0000 7f51349b5700 1 --2- 172.21.15.49:0/2848163998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5130074fe0 0x7f513010dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:39.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.093+0000 7f51351b6700 1 --2- 172.21.15.49:0/2848163998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51300746c0 0x7f513010daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:39.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.093+0000 7f51359b7700 1 -- 172.21.15.49:0/2848163998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51300746c0 msgr2=0x7f513010daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:39.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.093+0000 7f51359b7700 1 --2- 172.21.15.49:0/2848163998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51300746c0 0x7f513010daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.093+0000 7f51359b7700 1 -- 172.21.15.49:0/2848163998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5130074fe0 msgr2=0x7f513010dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:39.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.093+0000 7f51359b7700 1 --2- 172.21.15.49:0/2848163998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5130074fe0 0x7f513010dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.093+0000 7f51359b7700 1 -- 172.21.15.49:0/2848163998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51301b3f70 con 0x7f5130113690 2024-06-03T00:02:39.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.094+0000 7f51359b7700 1 --2- 172.21.15.49:0/2848163998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5130113690 0x7f51301b38a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f51200057f0 tx=0x7f5120005eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:39.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.098+0000 7f51267fc700 1 -- 172.21.15.49:0/2848163998 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5120026070 con 0x7f5130113690 2024-06-03T00:02:39.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.098+0000 7f513741a700 1 -- 172.21.15.49:0/2848163998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51301b4200 con 0x7f5130113690 2024-06-03T00:02:39.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.098+0000 7f513741a700 1 -- 172.21.15.49:0/2848163998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51301b46e0 con 0x7f5130113690 2024-06-03T00:02:39.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.098+0000 7f51267fc700 1 -- 172.21.15.49:0/2848163998 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5120003800 con 0x7f5130113690 2024-06-03T00:02:39.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.098+0000 7f51267fc700 1 -- 172.21.15.49:0/2848163998 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512000fd30 con 0x7f5130113690 2024-06-03T00:02:39.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.104+0000 7f5141c9db80 1 Processor -- start 2024-06-03T00:02:39.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.104+0000 7f5141c9db80 1 -- start start 2024-06-03T00:02:39.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.104+0000 7f51267fc700 1 -- 172.21.15.49:0/2848163998 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5120029070 con 0x7f5130113690 2024-06-03T00:02:39.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.105+0000 7f5141c9db80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc445a0640 0x55cc445a0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:39.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.105+0000 7f5141c9db80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cc445a0f60 0x55cc4459a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:39.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.105+0000 7f5141c9db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cc4459af20 0x55cc4459b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:39.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.105+0000 7f5141c9db80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55cc444ec810 con 0x55cc445a0640 2024-06-03T00:02:39.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.105+0000 7f5141c9db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55cc44494720 con 0x55cc4459af20 2024-06-03T00:02:39.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.105+0000 7f5141c9db80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55cc444e87d0 con 0x55cc445a0f60 2024-06-03T00:02:39.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.105+0000 7f51349b5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc445a0640 0x55cc445a0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:39.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.105+0000 7f51349b5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc445a0640 0x55cc445a0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47088/0 (socket says 172.21.15.49:47088) 2024-06-03T00:02:39.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.105+0000 7f51349b5700 1 -- 172.21.15.49:0/2027373871 learned_addr learned my addr 172.21.15.49:0/2027373871 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:39.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.105+0000 7f51349b5700 1 --2- 172.21.15.49:0/2027373871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cc4459af20 0x55cc4459b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:39.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.105+0000 7f51351b6700 1 --2- 172.21.15.49:0/2027373871 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cc445a0f60 0x55cc4459a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:39.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.106+0000 7f51267fc700 1 --2- 172.21.15.49:0/2848163998 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f511c0a2df0 0x7f511c0a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:39.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.106+0000 7f51267fc700 1 -- 172.21.15.49:0/2848163998 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f51200cf810 con 0x7f5130113690 2024-06-03T00:02:39.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.106+0000 7f51359b7700 1 --2- 172.21.15.49:0/2848163998 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f511c0a2df0 0x7f511c0a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:39.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.107+0000 7f51359b7700 1 --2- 172.21.15.49:0/2848163998 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f511c0a2df0 0x7f511c0a52b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f512009bdc0 tx=0x7f51200092f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:39.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.107+0000 7f51349b5700 1 -- 172.21.15.49:0/2027373871 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cc445a0f60 msgr2=0x55cc4459a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:39.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.107+0000 7f51349b5700 1 --2- 172.21.15.49:0/2027373871 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cc445a0f60 0x55cc4459a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.107+0000 7f51349b5700 1 -- 172.21.15.49:0/2027373871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc445a0640 msgr2=0x55cc445a0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:39.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.107+0000 7f51349b5700 1 --2- 172.21.15.49:0/2027373871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc445a0640 0x55cc445a0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.107+0000 7f51349b5700 1 -- 172.21.15.49:0/2027373871 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc4448af50 con 0x55cc4459af20 2024-06-03T00:02:39.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.108+0000 7f51349b5700 1 --2- 172.21.15.49:0/2027373871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cc4459af20 0x55cc4459b340 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f512c00ad70 tx=0x7f512c004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d6c0bfb6b5ee1af server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:39.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.108+0000 7f511b7fe700 1 -- 172.21.15.49:0/2027373871 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512c014040 con 0x55cc4459af20 2024-06-03T00:02:39.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.109+0000 7f511b7fe700 1 -- 172.21.15.49:0/2027373871 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f512c015cc0 con 0x55cc4459af20 2024-06-03T00:02:39.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.110+0000 7f5141c9db80 1 -- 172.21.15.49:0/2027373871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cc4459af20 msgr2=0x55cc4459b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:39.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.110+0000 7f5141c9db80 1 --2- 172.21.15.49:0/2027373871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cc4459af20 0x55cc4459b340 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f512c00ad70 tx=0x7f512c004af0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.111+0000 7f5141c9db80 1 -- 172.21.15.49:0/2027373871 shutdown_connections 2024-06-03T00:02:39.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.111+0000 7f5141c9db80 1 --2- 172.21.15.49:0/2027373871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cc4459af20 0x55cc4459b340 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.111+0000 7f5141c9db80 1 --2- 172.21.15.49:0/2027373871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc445a0640 0x55cc445a0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.111+0000 7f5141c9db80 1 --2- 172.21.15.49:0/2027373871 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cc445a0f60 0x55cc4459a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.111+0000 7f5141c9db80 1 -- 172.21.15.49:0/2027373871 >> 172.21.15.49:0/2027373871 conn(0x55cc444c5cc0 msgr2=0x55cc44595850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:39.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.112+0000 7f5141c9db80 1 -- 172.21.15.49:0/2027373871 shutdown_connections 2024-06-03T00:02:39.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.112+0000 7f5141c9db80 1 -- 172.21.15.49:0/2027373871 wait complete. 2024-06-03T00:02:39.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.112+0000 7f5141c9db80 1 -- start start 2024-06-03T00:02:39.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.112+0000 7f5141c9db80 1 Processor -- start 2024-06-03T00:02:39.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.113+0000 7f5141c9db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cc4459af20 0x55cc445a6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:39.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.113+0000 7f5141c9db80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc445a0640 0x55cc445a40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:39.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.113+0000 7f5141c9db80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cc445a0f60 0x55cc445a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:39.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.113+0000 7f5141c9db80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55cc445a79c0 con 0x55cc445a0640 2024-06-03T00:02:39.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.113+0000 7f5141c9db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55cc4448cbf0 con 0x55cc4459af20 2024-06-03T00:02:39.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.113+0000 7f5141c9db80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55cc445a7b40 con 0x55cc445a0f60 2024-06-03T00:02:39.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.113+0000 7f5141c9db80 10 client.0 _ll_register_callbacks cb 0x55cc44486920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:02:39.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.113+0000 7f51349b5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cc4459af20 0x55cc445a6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:39.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.113+0000 7f51349b5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cc4459af20 0x55cc445a6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.49:47956/0 (socket says 172.21.15.49:47956) 2024-06-03T00:02:39.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.113+0000 7f51349b5700 1 -- 172.21.15.49:0/3115340598 learned_addr learned my addr 172.21.15.49:0/3115340598 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:39.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.113+0000 7f51351b6700 1 --2- 172.21.15.49:0/3115340598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc445a0640 0x55cc445a40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:39.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.114+0000 7f51349b5700 1 --2- 172.21.15.49:0/3115340598 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cc445a0f60 0x55cc445a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:39.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.114+0000 7f51351b6700 1 -- 172.21.15.49:0/3115340598 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cc445a0f60 msgr2=0x55cc445a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:39.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.114+0000 7f51351b6700 1 --2- 172.21.15.49:0/3115340598 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cc445a0f60 0x55cc445a4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.114+0000 7f51351b6700 1 -- 172.21.15.49:0/3115340598 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cc4459af20 msgr2=0x55cc445a6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:39.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.114+0000 7f51351b6700 1 --2- 172.21.15.49:0/3115340598 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cc4459af20 0x55cc445a6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.114+0000 7f51351b6700 1 -- 172.21.15.49:0/3115340598 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc4443b8d0 con 0x55cc445a0640 2024-06-03T00:02:39.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.114+0000 7f51349b5700 1 --2- 172.21.15.49:0/3115340598 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cc4459af20 0x55cc445a6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:02:39.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.115+0000 7f51351b6700 1 --2- 172.21.15.49:0/3115340598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc445a0640 0x55cc445a40c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f51280114f0 tx=0x7f5128011800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29683bacceab3322 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:39.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.115+0000 7f5118ff9700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:02:39.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.115+0000 7f5118ff9700 1 -- 172.21.15.49:0/3115340598 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5128014650 con 0x55cc445a0640 2024-06-03T00:02:39.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.115+0000 7f5118ff9700 1 -- 172.21.15.49:0/3115340598 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f51280147f0 con 0x55cc445a0640 2024-06-03T00:02:39.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.115+0000 7f5141c9db80 1 -- 172.21.15.49:0/3115340598 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cc444f9d10 con 0x55cc445a0640 2024-06-03T00:02:39.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.115+0000 7f5118ff9700 1 -- 172.21.15.49:0/3115340598 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f51280149f0 con 0x55cc445a0640 2024-06-03T00:02:39.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.115+0000 7f5141c9db80 10 client.15885 fetch_fsmap learned FSMap version 27 2024-06-03T00:02:39.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.115+0000 7f5141c9db80 1 -- 172.21.15.49:0/3115340598 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cc445b2300 con 0x55cc445a0640 2024-06-03T00:02:39.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.116+0000 7f5118ff9700 1 -- 172.21.15.49:0/3115340598 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5128014b90 con 0x55cc445a0640 2024-06-03T00:02:39.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.116+0000 7f5118ff9700 1 -- 172.21.15.49:0/3115340598 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f512801d400 con 0x55cc445a0640 2024-06-03T00:02:39.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.116+0000 7f5141c9db80 10 client.15885 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:02:39.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.116+0000 7f5141c9db80 10 client.15885 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-03T00:02:39.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.116+0000 7f5141c9db80 20 client.15885 populate_metadata read hostname 'smithi049' 2024-06-03T00:02:39.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.116+0000 7f5141c9db80 1 --2- 172.21.15.49:0/3115340598 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55cc445b4890 0x55cc445b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:39.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.116+0000 7f5141c9db80 4 client.15885 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:02:39.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.116+0000 7f5141c9db80 1 -- 172.21.15.49:0/3115340598 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc444f9d10 con 0x55cc445b4890 2024-06-03T00:02:39.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.120+0000 7f51349b5700 1 --2- 172.21.15.49:0/3115340598 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55cc445b4890 0x55cc445b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:39.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.128+0000 7f51349b5700 1 --2- 172.21.15.49:0/3115340598 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55cc445b4890 0x55cc445b6c80 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2689292653b501cf server_cookie=d8d35a1a54370a0f in_seq=0 out_seq=0 2024-06-03T00:02:39.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.128+0000 7f5118ff9700 10 client.15885 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:39.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.132+0000 7f5118ff9700 1 -- 172.21.15.49:0/3115340598 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55cc444f9d10 con 0x55cc445b4890 2024-06-03T00:02:39.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.132+0000 7f5118ff9700 10 client.15885 handle_command_reply: tid=0 2024-06-03T00:02:39.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.132+0000 7f5141c9db80 1 client.15885 shutdown 2024-06-03T00:02:39.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.133+0000 7f5141c9db80 1 -- 172.21.15.49:0/3115340598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc445a0640 msgr2=0x55cc445a40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:39.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.133+0000 7f5141c9db80 1 --2- 172.21.15.49:0/3115340598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc445a0640 0x55cc445a40c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f51280114f0 tx=0x7f5128011800 comp rx=0 tx=0).stop 2024-06-03T00:02:39.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.134+0000 7f5141c9db80 1 -- 172.21.15.49:0/3115340598 shutdown_connections 2024-06-03T00:02:39.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.134+0000 7f5141c9db80 1 --2- 172.21.15.49:0/3115340598 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cc445a0f60 0x55cc445a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.134+0000 7f5141c9db80 1 --2- 172.21.15.49:0/3115340598 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cc4459af20 0x55cc445a6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.134+0000 7f5141c9db80 1 --2- 172.21.15.49:0/3115340598 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55cc445b4890 0x55cc445b6c80 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.134+0000 7f5141c9db80 1 --2- 172.21.15.49:0/3115340598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc445a0640 0x55cc445a40c0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.134+0000 7f5141c9db80 1 -- 172.21.15.49:0/3115340598 >> 172.21.15.49:0/3115340598 conn(0x55cc444c5cc0 msgr2=0x55cc445999d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:39.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.134+0000 7f5118ff9700 0 client.15885 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:39.136 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:39 smithi049 ceph-mon[32302]: pgmap v461: 97 pgs: 97 active+clean; 24 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 2.2 MiB/s wr, 197 op/s 2024-06-03T00:02:39.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.134+0000 7f5141c9db80 1 -- 172.21.15.49:0/3115340598 shutdown_connections 2024-06-03T00:02:39.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.135+0000 7f5141c9db80 1 -- 172.21.15.49:0/3115340598 wait complete. 2024-06-03T00:02:39.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.135+0000 7f5141c9db80 20 client.15885 trim_cache size 0 max 16384 2024-06-03T00:02:39.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.166+0000 7f5141c9db80 1 Processor -- start 2024-06-03T00:02:39.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.167+0000 7f5141c9db80 1 -- start start 2024-06-03T00:02:39.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.167+0000 7f5141c9db80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc4459af20 0x55cc4459a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:39.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.167+0000 7f5141c9db80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cc445a0640 0x55cc445a4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:39.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.167+0000 7f5141c9db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cc445a0f60 0x55cc4458ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:39.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.167+0000 7f5141c9db80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f511400d530 con 0x55cc4459af20 2024-06-03T00:02:39.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.167+0000 7f5141c9db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f511400f070 con 0x55cc445a0f60 2024-06-03T00:02:39.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.167+0000 7f5141c9db80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f511400dc00 con 0x55cc445a0640 2024-06-03T00:02:39.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.168+0000 7f51349b5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc4459af20 0x55cc4459a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:39.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.168+0000 7f51349b5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc4459af20 0x55cc4459a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47100/0 (socket says 172.21.15.49:47100) 2024-06-03T00:02:39.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.168+0000 7f51349b5700 1 -- 172.21.15.49:0/4267906732 learned_addr learned my addr 172.21.15.49:0/4267906732 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:39.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.168+0000 7f51349b5700 1 --2- 172.21.15.49:0/4267906732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cc445a0f60 0x55cc4458ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:39.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.168+0000 7f51349b5700 1 -- 172.21.15.49:0/4267906732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cc445a0640 msgr2=0x55cc445a4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:39.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.168+0000 7f51349b5700 1 --2- 172.21.15.49:0/4267906732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cc445a0640 0x55cc445a4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.168+0000 7f51349b5700 1 -- 172.21.15.49:0/4267906732 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc4459af20 msgr2=0x55cc4459a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:39.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.168+0000 7f51349b5700 1 --2- 172.21.15.49:0/4267906732 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc4459af20 0x55cc4459a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.168+0000 7f51349b5700 1 -- 172.21.15.49:0/4267906732 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc44596520 con 0x55cc445a0f60 2024-06-03T00:02:39.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.169+0000 7f51349b5700 1 --2- 172.21.15.49:0/4267906732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cc445a0f60 0x55cc4458ee00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f512c004ba0 tx=0x7f512c00c040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a100e667802c42c2 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:39.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.169+0000 7f511affd700 1 -- 172.21.15.49:0/4267906732 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512c00ae60 con 0x55cc445a0f60 2024-06-03T00:02:39.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.169+0000 7f511affd700 1 -- 172.21.15.49:0/4267906732 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f512c01b5d0 con 0x55cc445a0f60 2024-06-03T00:02:39.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.169+0000 7f511affd700 1 -- 172.21.15.49:0/4267906732 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512c015910 con 0x55cc445a0f60 2024-06-03T00:02:39.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.170+0000 7f5141c9db80 1 -- 172.21.15.49:0/4267906732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cc445a0f60 msgr2=0x55cc4458ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:39.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.170+0000 7f5141c9db80 1 --2- 172.21.15.49:0/4267906732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cc445a0f60 0x55cc4458ee00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f512c004ba0 tx=0x7f512c00c040 comp rx=0 tx=0).stop 2024-06-03T00:02:39.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.171+0000 7f5141c9db80 1 -- 172.21.15.49:0/4267906732 shutdown_connections 2024-06-03T00:02:39.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.171+0000 7f5141c9db80 1 --2- 172.21.15.49:0/4267906732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cc445a0f60 0x55cc4458ee00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.171+0000 7f5141c9db80 1 --2- 172.21.15.49:0/4267906732 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc4459af20 0x55cc4459a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.171+0000 7f5141c9db80 1 --2- 172.21.15.49:0/4267906732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cc445a0640 0x55cc445a4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.171+0000 7f5141c9db80 1 -- 172.21.15.49:0/4267906732 >> 172.21.15.49:0/4267906732 conn(0x55cc444c5cc0 msgr2=0x55cc445a4080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:39.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.171+0000 7f5141c9db80 1 -- 172.21.15.49:0/4267906732 shutdown_connections 2024-06-03T00:02:39.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.171+0000 7f5141c9db80 1 -- 172.21.15.49:0/4267906732 wait complete. 2024-06-03T00:02:39.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.171+0000 7f5141c9db80 1 -- start start 2024-06-03T00:02:39.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.171+0000 7f5141c9db80 1 Processor -- start 2024-06-03T00:02:39.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.172+0000 7f5141c9db80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cc4459af20 0x55cc445ad270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:39.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.172+0000 7f5141c9db80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc445a0640 0x55cc445ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:39.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.172+0000 7f5141c9db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cc445a0f60 0x55cc445bbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:39.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.172+0000 7f5141c9db80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f511400e9a0 con 0x55cc445a0640 2024-06-03T00:02:39.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.173+0000 7f5141c9db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f511400e2d0 con 0x55cc445a0f60 2024-06-03T00:02:39.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.173+0000 7f5141c9db80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f511400b4b0 con 0x55cc4459af20 2024-06-03T00:02:39.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.173+0000 7f51351b6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc445a0640 0x55cc445ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:39.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.173+0000 7f51351b6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc445a0640 0x55cc445ad7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47112/0 (socket says 172.21.15.49:47112) 2024-06-03T00:02:39.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.173+0000 7f51351b6700 1 -- 172.21.15.49:0/138287986 learned_addr learned my addr 172.21.15.49:0/138287986 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:39.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.173+0000 7f5141c9db80 10 client.0 _ll_register_callbacks cb 0x55cc44486920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:02:39.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.173+0000 7f51349b5700 1 --2- 172.21.15.49:0/138287986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cc4459af20 0x55cc445ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:39.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.173+0000 7f51349b5700 1 --2- 172.21.15.49:0/138287986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cc445a0f60 0x55cc445bbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:39.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.174+0000 7f51351b6700 1 -- 172.21.15.49:0/138287986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cc4459af20 msgr2=0x55cc445ad270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:39.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.174+0000 7f51351b6700 1 --2- 172.21.15.49:0/138287986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cc4459af20 0x55cc445ad270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.174+0000 7f51351b6700 1 -- 172.21.15.49:0/138287986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cc445a0f60 msgr2=0x55cc445bbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:39.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.174+0000 7f51351b6700 1 --2- 172.21.15.49:0/138287986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cc445a0f60 0x55cc445bbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.174+0000 7f51351b6700 1 -- 172.21.15.49:0/138287986 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc445bc410 con 0x55cc445a0640 2024-06-03T00:02:39.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.174+0000 7f51351b6700 1 --2- 172.21.15.49:0/138287986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc445a0640 0x55cc445ad7b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f512800b010 tx=0x7f5128006a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8562633ee73bffed server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:39.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.174+0000 7f5118ff9700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:02:39.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.175+0000 7f5118ff9700 1 -- 172.21.15.49:0/138287986 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512801d610 con 0x55cc445a0640 2024-06-03T00:02:39.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.175+0000 7f5118ff9700 1 -- 172.21.15.49:0/138287986 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f5128014b90 con 0x55cc445a0640 2024-06-03T00:02:39.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.175+0000 7f5141c9db80 1 -- 172.21.15.49:0/138287986 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f512c01b5d0 con 0x55cc445a0640 2024-06-03T00:02:39.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.175+0000 7f5118ff9700 1 -- 172.21.15.49:0/138287986 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f512801dbf0 con 0x55cc445a0640 2024-06-03T00:02:39.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.175+0000 7f5141c9db80 10 client.15891 fetch_fsmap learned FSMap version 27 2024-06-03T00:02:39.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.175+0000 7f5141c9db80 1 -- 172.21.15.49:0/138287986 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cc4461f0d0 con 0x55cc445a0640 2024-06-03T00:02:39.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.176+0000 7f5118ff9700 1 -- 172.21.15.49:0/138287986 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5128006da0 con 0x55cc445a0640 2024-06-03T00:02:39.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.176+0000 7f5118ff9700 1 -- 172.21.15.49:0/138287986 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f5128003990 con 0x55cc445a0640 2024-06-03T00:02:39.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.176+0000 7f5141c9db80 10 client.15891 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:02:39.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.176+0000 7f5141c9db80 10 client.15891 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-03T00:02:39.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.176+0000 7f5141c9db80 20 client.15891 populate_metadata read hostname 'smithi049' 2024-06-03T00:02:39.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.176+0000 7f5141c9db80 1 --2- 172.21.15.49:0/138287986 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55cc4461f810 0x55cc44621c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:39.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.176+0000 7f5141c9db80 4 client.15891 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-03T00:02:39.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.176+0000 7f5141c9db80 1 -- 172.21.15.49:0/138287986 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f512c01b5d0 con 0x55cc4461f810 2024-06-03T00:02:39.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.177+0000 7f51349b5700 1 --2- 172.21.15.49:0/138287986 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55cc4461f810 0x55cc44621c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:39.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.180+0000 7f5118ff9700 10 client.15891 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:39.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.180+0000 7f51349b5700 1 --2- 172.21.15.49:0/138287986 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55cc4461f810 0x55cc44621c30 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98b1609ae7b7a5f9 server_cookie=ec0eb53bc30199f8 in_seq=0 out_seq=0 2024-06-03T00:02:39.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.185+0000 7f5118ff9700 1 -- 172.21.15.49:0/138287986 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f512c01b5d0 con 0x55cc4461f810 2024-06-03T00:02:39.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.185+0000 7f5118ff9700 10 client.15891 handle_command_reply: tid=0 2024-06-03T00:02:39.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.185+0000 7f5141c9db80 1 client.15891 shutdown 2024-06-03T00:02:39.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.185+0000 7f5141c9db80 1 -- 172.21.15.49:0/138287986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc445a0640 msgr2=0x55cc445ad7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:39.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.185+0000 7f5141c9db80 1 --2- 172.21.15.49:0/138287986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc445a0640 0x55cc445ad7b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f512800b010 tx=0x7f5128006a70 comp rx=0 tx=0).stop 2024-06-03T00:02:39.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.185+0000 7f5141c9db80 1 -- 172.21.15.49:0/138287986 shutdown_connections 2024-06-03T00:02:39.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.185+0000 7f5141c9db80 1 --2- 172.21.15.49:0/138287986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cc445a0f60 0x55cc445bbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.185+0000 7f5141c9db80 1 --2- 172.21.15.49:0/138287986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cc4459af20 0x55cc445ad270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.185+0000 7f5141c9db80 1 --2- 172.21.15.49:0/138287986 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55cc4461f810 0x55cc44621c30 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.185+0000 7f5141c9db80 1 --2- 172.21.15.49:0/138287986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc445a0640 0x55cc445ad7b0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.185+0000 7f5118ff9700 0 client.15891 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:39.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.186+0000 7f5141c9db80 1 -- 172.21.15.49:0/138287986 >> 172.21.15.49:0/138287986 conn(0x55cc444c5cc0 msgr2=0x55cc4458ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:39.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.186+0000 7f5141c9db80 1 -- 172.21.15.49:0/138287986 shutdown_connections 2024-06-03T00:02:39.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.186+0000 7f5141c9db80 1 -- 172.21.15.49:0/138287986 wait complete. 2024-06-03T00:02:39.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.186+0000 7f5141c9db80 20 client.15891 trim_cache size 0 max 16384 2024-06-03T00:02:39.195 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-06-03T00:02:39.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.187+0000 7f513741a700 1 -- 172.21.15.49:0/2848163998 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f511c0a2df0 msgr2=0x7f511c0a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:39.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.187+0000 7f513741a700 1 --2- 172.21.15.49:0/2848163998 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f511c0a2df0 0x7f511c0a52b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f512009bdc0 tx=0x7f51200092f0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.187+0000 7f513741a700 1 -- 172.21.15.49:0/2848163998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5130113690 msgr2=0x7f51301b38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:39.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.187+0000 7f513741a700 1 --2- 172.21.15.49:0/2848163998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5130113690 0x7f51301b38a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f51200057f0 tx=0x7f5120005eb0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.187+0000 7f513741a700 1 -- 172.21.15.49:0/2848163998 shutdown_connections 2024-06-03T00:02:39.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.187+0000 7f513741a700 1 --2- 172.21.15.49:0/2848163998 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f511c0a2df0 0x7f511c0a52b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.187+0000 7f513741a700 1 --2- 172.21.15.49:0/2848163998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5130113690 0x7f51301b38a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.187+0000 7f513741a700 1 --2- 172.21.15.49:0/2848163998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51300746c0 0x7f513010daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.187+0000 7f513741a700 1 --2- 172.21.15.49:0/2848163998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5130074fe0 0x7f513010dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.187+0000 7f513741a700 1 -- 172.21.15.49:0/2848163998 >> 172.21.15.49:0/2848163998 conn(0x7f5130079640 msgr2=0x7f5130104b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:39.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.187+0000 7f513741a700 1 -- 172.21.15.49:0/2848163998 shutdown_connections 2024-06-03T00:02:39.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:39.187+0000 7f513741a700 1 -- 172.21.15.49:0/2848163998 wait complete. 2024-06-03T00:02:39.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:39 smithi107 ceph-mon[37048]: pgmap v461: 97 pgs: 97 active+clean; 24 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 2.2 MiB/s wr, 197 op/s 2024-06-03T00:02:39.351 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:02:39 smithi107 sudo[70467]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-03T00:02:39.351 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:02:39 smithi107 sudo[70467]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-03T00:02:39.351 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:02:39 smithi107 sudo[70467]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-03T00:02:39.351 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:02:39 smithi107 sudo[70467]: pam_unix(sudo:session): session closed for user root 2024-06-03T00:02:39.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:39 smithi057 ceph-mon[36457]: pgmap v461: 97 pgs: 97 active+clean; 24 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 2.2 MiB/s wr, 197 op/s 2024-06-03T00:02:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:39.619+0000 7f9bfeffd640 1 -- 172.21.15.49:0/1955389709 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x561f6de96c20 con 0x561f6dfa6290 2024-06-03T00:02:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:39.619+0000 7f9bfeffd640 10 client.15873 handle_command_reply: tid=0 2024-06-03T00:02:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:39.619+0000 7f9c28661740 1 client.15873 shutdown 2024-06-03T00:02:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:39.619+0000 7f9c28661740 1 -- 172.21.15.49:0/1955389709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561f6df26010 msgr2=0x561f6df37410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:39.619+0000 7f9c28661740 1 --2- 172.21.15.49:0/1955389709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561f6df26010 0x561f6df37410 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9c10009600 tx=0x7f9c100046c0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:39.619+0000 7f9c28661740 1 -- 172.21.15.49:0/1955389709 shutdown_connections 2024-06-03T00:02:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:39.619+0000 7f9c28661740 1 --2- 172.21.15.49:0/1955389709 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x561f6dfa6290 0x561f6dfa86b0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:39.619+0000 7f9c28661740 1 --2- 172.21.15.49:0/1955389709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f6df26a00 0x561f6df33f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:39.619+0000 7f9c28661740 1 --2- 172.21.15.49:0/1955389709 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561f6df2bb70 0x561f6df34490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:39.619+0000 7f9bfeffd640 0 client.15873 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:39.619+0000 7f9c28661740 1 --2- 172.21.15.49:0/1955389709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561f6df26010 0x561f6df37410 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:39.619+0000 7f9c28661740 1 -- 172.21.15.49:0/1955389709 >> 172.21.15.49:0/1955389709 conn(0x561f6df21680 msgr2=0x561f6df24590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:39.619+0000 7f9c28661740 1 -- 172.21.15.49:0/1955389709 shutdown_connections 2024-06-03T00:02:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:39.619+0000 7f9c28661740 1 -- 172.21.15.49:0/1955389709 wait complete. 2024-06-03T00:02:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:39.619+0000 7f9c28661740 20 client.15873 trim_cache size 0 max 16384 2024-06-03T00:02:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-06-03T00:02:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-06-03T00:02:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-06-03T00:02:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:39.620+0000 7f9c2595a640 1 -- 172.21.15.49:0/73735164 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9c080a2d30 msgr2=0x7f9c080a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:39.620+0000 7f9c2595a640 1 --2- 172.21.15.49:0/73735164 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9c080a2d30 0x7f9c080a51f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9c100058c0 tx=0x7f9c10005f90 comp rx=0 tx=0).stop 2024-06-03T00:02:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:39.620+0000 7f9c2595a640 1 -- 172.21.15.49:0/73735164 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c20105800 msgr2=0x7f9c201a14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:39.620+0000 7f9c2595a640 1 --2- 172.21.15.49:0/73735164 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c20105800 0x7f9c201a14a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800e940 tx=0x7f9c1800ee00 comp rx=0 tx=0).stop 2024-06-03T00:02:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:39.620+0000 7f9c2595a640 1 -- 172.21.15.49:0/73735164 shutdown_connections 2024-06-03T00:02:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:39.620+0000 7f9c2595a640 1 --2- 172.21.15.49:0/73735164 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9c080a2d30 0x7f9c080a51f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:39.620+0000 7f9c2595a640 1 --2- 172.21.15.49:0/73735164 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c20104e40 0x7f9c2019a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:39.620+0000 7f9c2595a640 1 --2- 172.21.15.49:0/73735164 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c20105800 0x7f9c201a14a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:39.620+0000 7f9c2595a640 1 --2- 172.21.15.49:0/73735164 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c20103c50 0x7f9c20199ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:39.620+0000 7f9c2595a640 1 -- 172.21.15.49:0/73735164 >> 172.21.15.49:0/73735164 conn(0x7f9c200ff1c0 msgr2=0x7f9c201080e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:39.620+0000 7f9c2595a640 1 -- 172.21.15.49:0/73735164 shutdown_connections 2024-06-03T00:02:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:39.620+0000 7f9c2595a640 1 -- 172.21.15.49:0/73735164 wait complete. 2024-06-03T00:02:39.850 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:02:39 smithi107 sudo[70470]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-03T00:02:39.850 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:02:39 smithi107 sudo[70470]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-03T00:02:39.850 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:02:39 smithi107 sudo[70470]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-03T00:02:39.850 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:02:39 smithi107 sudo[70470]: pam_unix(sudo:session): session closed for user root 2024-06-03T00:02:40.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:39 smithi049 sudo[94595]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-03T00:02:40.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:39 smithi049 sudo[94595]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-03T00:02:40.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:39 smithi049 sudo[94595]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-03T00:02:40.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:39 smithi049 sudo[94595]: pam_unix(sudo:session): session closed for user root 2024-06-03T00:02:40.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:40 smithi049 sudo[94598]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-03T00:02:40.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:40 smithi049 sudo[94598]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-03T00:02:40.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:40 smithi049 sudo[94598]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-03T00:02:40.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:40 smithi049 sudo[94598]: pam_unix(sudo:session): session closed for user root 2024-06-03T00:02:40.917 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:40 smithi107 sudo[70473]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-03T00:02:40.917 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:40 smithi107 sudo[70473]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-03T00:02:40.917 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:40 smithi107 sudo[70473]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-03T00:02:40.917 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:40 smithi107 sudo[70473]: pam_unix(sudo:session): session closed for user root 2024-06-03T00:02:41.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:40 smithi057 ceph-mon[36457]: pgmap v462: 97 pgs: 97 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 2.4 MiB/s wr, 548 op/s 2024-06-03T00:02:41.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:40 smithi057 ceph-mon[36457]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-03T00:02:41.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:40 smithi057 ceph-mon[36457]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-03T00:02:41.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:40 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-03T00:02:41.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:40 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-03T00:02:41.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:40 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-03T00:02:41.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:40 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-03T00:02:41.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:40 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-03T00:02:41.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:40 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-03T00:02:41.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:40 smithi049 ceph-mon[32302]: pgmap v462: 97 pgs: 97 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 2.4 MiB/s wr, 548 op/s 2024-06-03T00:02:41.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:40 smithi049 ceph-mon[32302]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-03T00:02:41.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:40 smithi049 ceph-mon[32302]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-03T00:02:41.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:40 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-03T00:02:41.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:40 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-03T00:02:41.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:40 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-03T00:02:41.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:40 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-03T00:02:41.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:40 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-03T00:02:41.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:40 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-03T00:02:41.234 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-06-03T00:02:41.234 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-06-03T00:02:41.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:40 smithi107 sudo[70476]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-03T00:02:41.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:40 smithi107 sudo[70476]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-03T00:02:41.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:40 smithi107 sudo[70476]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-03T00:02:41.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:40 smithi107 sudo[70476]: pam_unix(sudo:session): session closed for user root 2024-06-03T00:02:41.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:40 smithi107 ceph-mon[37048]: pgmap v462: 97 pgs: 97 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 2.4 MiB/s wr, 548 op/s 2024-06-03T00:02:41.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:40 smithi107 ceph-mon[37048]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-03T00:02:41.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:40 smithi107 ceph-mon[37048]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-03T00:02:41.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-03T00:02:41.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-03T00:02:41.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-03T00:02:41.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-03T00:02:41.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-03T00:02:41.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-03T00:02:41.499 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:02:41.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:41 smithi057 sudo[68908]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-03T00:02:41.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:41 smithi057 sudo[68908]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-03T00:02:41.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:41 smithi057 sudo[68908]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-03T00:02:41.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:41 smithi057 sudo[68908]: pam_unix(sudo:session): session closed for user root 2024-06-03T00:02:42.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:41 smithi057 sudo[68911]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-03T00:02:42.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:41 smithi057 sudo[68911]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-03T00:02:42.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:41 smithi057 sudo[68911]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-03T00:02:42.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:41 smithi057 sudo[68911]: pam_unix(sudo:session): session closed for user root 2024-06-03T00:02:42.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:41 smithi057 ceph-mon[36457]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-03T00:02:42.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:41 smithi057 ceph-mon[36457]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-03T00:02:42.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:41 smithi057 ceph-mon[36457]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-03T00:02:42.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:41 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-03T00:02:42.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:41 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-03T00:02:42.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:41 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-03T00:02:42.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:41 smithi057 ceph-mon[36457]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-03T00:02:42.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:41 smithi049 ceph-mon[32302]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-03T00:02:42.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:41 smithi049 ceph-mon[32302]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-03T00:02:42.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:41 smithi049 ceph-mon[32302]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-03T00:02:42.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:41 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-03T00:02:42.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:41 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-03T00:02:42.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:41 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-03T00:02:42.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:41 smithi049 ceph-mon[32302]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-03T00:02:42.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:41 smithi107 ceph-mon[37048]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-03T00:02:42.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:41 smithi107 ceph-mon[37048]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-03T00:02:42.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:41 smithi107 ceph-mon[37048]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-03T00:02:42.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:41 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-03T00:02:42.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:41 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-03T00:02:42.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:41 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-03T00:02:42.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:41 smithi107 ceph-mon[37048]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-03T00:02:43.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:42 smithi057 ceph-mon[36457]: pgmap v463: 97 pgs: 97 active+clean; 31 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 607 op/s 2024-06-03T00:02:43.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:42 smithi049 ceph-mon[32302]: pgmap v463: 97 pgs: 97 active+clean; 31 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 607 op/s 2024-06-03T00:02:43.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:42 smithi107 ceph-mon[37048]: pgmap v463: 97 pgs: 97 active+clean; 31 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 607 op/s 2024-06-03T00:02:43.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.394+0000 7f8b4868b700 1 -- 172.21.15.49:0/3556925111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b401084f0 msgr2=0x7f8b401088d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:43.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.394+0000 7f8b4868b700 1 --2- 172.21.15.49:0/3556925111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b401084f0 0x7f8b401088d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009990 tx=0x7f8b3c009ca0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.394+0000 7f8b4868b700 1 -- 172.21.15.49:0/3556925111 shutdown_connections 2024-06-03T00:02:43.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.394+0000 7f8b4868b700 1 --2- 172.21.15.49:0/3556925111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b4006b3c0 0x7f8b4010f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.394+0000 7f8b4868b700 1 --2- 172.21.15.49:0/3556925111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b401084f0 0x7f8b401088d0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.394+0000 7f8b4868b700 1 --2- 172.21.15.49:0/3556925111 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b4006aa00 0x7f8b4006ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.394+0000 7f8b4868b700 1 -- 172.21.15.49:0/3556925111 >> 172.21.15.49:0/3556925111 conn(0x7f8b40078300 msgr2=0x7f8b40078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:43.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.394+0000 7f8b4868b700 1 -- 172.21.15.49:0/3556925111 shutdown_connections 2024-06-03T00:02:43.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.394+0000 7f8b4868b700 1 -- 172.21.15.49:0/3556925111 wait complete. 2024-06-03T00:02:43.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.395+0000 7f8b4868b700 1 Processor -- start 2024-06-03T00:02:43.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.395+0000 7f8b4868b700 1 -- start start 2024-06-03T00:02:43.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.395+0000 7f8b4868b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b4006aa00 0x7f8b40101450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:43.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.395+0000 7f8b4868b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b4006b3c0 0x7f8b40101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:43.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.395+0000 7f8b4868b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b401084f0 0x7f8b40101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:43.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.395+0000 7f8b4868b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8b40112750 con 0x7f8b401084f0 2024-06-03T00:02:43.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.395+0000 7f8b4868b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8b401125d0 con 0x7f8b4006b3c0 2024-06-03T00:02:43.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.395+0000 7f8b4868b700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8b401128d0 con 0x7f8b4006aa00 2024-06-03T00:02:43.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.395+0000 7f8b46427700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b4006aa00 0x7f8b40101450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:43.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.396+0000 7f8b46427700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b4006aa00 0x7f8b40101450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:40122/0 (socket says 172.21.15.49:40122) 2024-06-03T00:02:43.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.396+0000 7f8b46427700 1 -- 172.21.15.49:0/3073208382 learned_addr learned my addr 172.21.15.49:0/3073208382 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:43.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.396+0000 7f8b45c26700 1 --2- 172.21.15.49:0/3073208382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b4006b3c0 0x7f8b40101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:43.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.396+0000 7f8b46c28700 1 --2- 172.21.15.49:0/3073208382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b401084f0 0x7f8b40101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:43.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.396+0000 7f8b46427700 1 -- 172.21.15.49:0/3073208382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b4006b3c0 msgr2=0x7f8b40101990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:43.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.396+0000 7f8b46427700 1 --2- 172.21.15.49:0/3073208382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b4006b3c0 0x7f8b40101990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.396+0000 7f8b46427700 1 -- 172.21.15.49:0/3073208382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b401084f0 msgr2=0x7f8b40101ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:43.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.396+0000 7f8b46427700 1 --2- 172.21.15.49:0/3073208382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b401084f0 0x7f8b40101ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.396+0000 7f8b46427700 1 -- 172.21.15.49:0/3073208382 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b401a7120 con 0x7f8b4006aa00 2024-06-03T00:02:43.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.396+0000 7f8b46c28700 1 --2- 172.21.15.49:0/3073208382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b401084f0 0x7f8b40101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:02:43.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.396+0000 7f8b46427700 1 --2- 172.21.15.49:0/3073208382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b4006aa00 0x7f8b40101450 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c000c00 tx=0x7f8b3c00bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:43.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.396+0000 7f8b337fe700 1 -- 172.21.15.49:0/3073208382 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c027070 con 0x7f8b4006aa00 2024-06-03T00:02:43.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.396+0000 7f8b337fe700 1 -- 172.21.15.49:0/3073208382 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b3c003d70 con 0x7f8b4006aa00 2024-06-03T00:02:43.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.396+0000 7f8b4868b700 1 -- 172.21.15.49:0/3073208382 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b401a73b0 con 0x7f8b4006aa00 2024-06-03T00:02:43.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.396+0000 7f8b4868b700 1 -- 172.21.15.49:0/3073208382 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b401a7860 con 0x7f8b4006aa00 2024-06-03T00:02:43.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.396+0000 7f8b337fe700 1 -- 172.21.15.49:0/3073208382 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c00f6c0 con 0x7f8b4006aa00 2024-06-03T00:02:43.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.399+0000 7f8b337fe700 1 -- 172.21.15.49:0/3073208382 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8b3c02a070 con 0x7f8b4006aa00 2024-06-03T00:02:43.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.399+0000 7f8b337fe700 1 --2- 172.21.15.49:0/3073208382 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8b2c0a2ca0 0x7f8b2c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:43.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.399+0000 7f8b45c26700 1 --2- 172.21.15.49:0/3073208382 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8b2c0a2ca0 0x7f8b2c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:43.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.400+0000 7f8b337fe700 1 -- 172.21.15.49:0/3073208382 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f8b3c0d0030 con 0x7f8b4006aa00 2024-06-03T00:02:43.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.400+0000 7f8b45c26700 1 --2- 172.21.15.49:0/3073208382 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8b2c0a2ca0 0x7f8b2c0a5160 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8b40078970 tx=0x7f8b34009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:43.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.400+0000 7f8b52f0eb80 1 Processor -- start 2024-06-03T00:02:43.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.400+0000 7f8b52f0eb80 1 -- start start 2024-06-03T00:02:43.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.400+0000 7f8b52f0eb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c0e4596c0 0x560c0e459aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:43.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.400+0000 7f8b52f0eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c0e459fe0 0x560c0e453a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:43.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.400+0000 7f8b52f0eb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c0e453fa0 0x560c0e4543c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:43.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.400+0000 7f8b52f0eb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x560c0e3a5890 con 0x560c0e453fa0 2024-06-03T00:02:43.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.400+0000 7f8b52f0eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x560c0e34d7a0 con 0x560c0e459fe0 2024-06-03T00:02:43.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.400+0000 7f8b52f0eb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560c0e3a1850 con 0x560c0e4596c0 2024-06-03T00:02:43.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.401+0000 7f8b46c28700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c0e453fa0 0x560c0e4543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:43.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.401+0000 7f8b46427700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c0e4596c0 0x560c0e459aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:43.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.401+0000 7f8b46c28700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c0e453fa0 0x560c0e4543c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50764/0 (socket says 172.21.15.49:50764) 2024-06-03T00:02:43.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.401+0000 7f8b46c28700 1 -- 172.21.15.49:0/3124282060 learned_addr learned my addr 172.21.15.49:0/3124282060 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:43.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.401+0000 7f8b45c26700 1 --2- 172.21.15.49:0/3124282060 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c0e459fe0 0x560c0e453a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:43.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.401+0000 7f8b46427700 1 -- 172.21.15.49:0/3124282060 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c0e459fe0 msgr2=0x560c0e453a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:43.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.401+0000 7f8b46427700 1 --2- 172.21.15.49:0/3124282060 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c0e459fe0 0x560c0e453a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.401+0000 7f8b46427700 1 -- 172.21.15.49:0/3124282060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c0e453fa0 msgr2=0x560c0e4543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:43.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.401+0000 7f8b46427700 1 --2- 172.21.15.49:0/3124282060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c0e453fa0 0x560c0e4543c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.401+0000 7f8b46427700 1 -- 172.21.15.49:0/3124282060 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c0e343fd0 con 0x560c0e4596c0 2024-06-03T00:02:43.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.401+0000 7f8b46c28700 1 --2- 172.21.15.49:0/3124282060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c0e453fa0 0x560c0e4543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:02:43.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.401+0000 7f8b46427700 1 --2- 172.21.15.49:0/3124282060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c0e4596c0 0x560c0e459aa0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0cdbc0 tx=0x7f8b3c022b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7304cd0e34536feb server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:43.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.401+0000 7f8b30ff9700 1 -- 172.21.15.49:0/3124282060 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c09c960 con 0x560c0e4596c0 2024-06-03T00:02:43.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.401+0000 7f8b30ff9700 1 -- 172.21.15.49:0/3124282060 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b3c0a0d10 con 0x560c0e4596c0 2024-06-03T00:02:43.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.401+0000 7f8b30ff9700 1 -- 172.21.15.49:0/3124282060 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c0229c0 con 0x560c0e4596c0 2024-06-03T00:02:43.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.402+0000 7f8b52f0eb80 1 -- 172.21.15.49:0/3124282060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c0e4596c0 msgr2=0x560c0e459aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:43.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.402+0000 7f8b52f0eb80 1 --2- 172.21.15.49:0/3124282060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c0e4596c0 0x560c0e459aa0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0cdbc0 tx=0x7f8b3c022b80 comp rx=0 tx=0).stop 2024-06-03T00:02:43.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.402+0000 7f8b52f0eb80 1 -- 172.21.15.49:0/3124282060 shutdown_connections 2024-06-03T00:02:43.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.402+0000 7f8b52f0eb80 1 --2- 172.21.15.49:0/3124282060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c0e453fa0 0x560c0e4543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.402+0000 7f8b52f0eb80 1 --2- 172.21.15.49:0/3124282060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c0e4596c0 0x560c0e459aa0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.402+0000 7f8b52f0eb80 1 --2- 172.21.15.49:0/3124282060 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c0e459fe0 0x560c0e453a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.402+0000 7f8b52f0eb80 1 -- 172.21.15.49:0/3124282060 >> 172.21.15.49:0/3124282060 conn(0x560c0e37ed40 msgr2=0x560c0e44e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.402+0000 7f8b52f0eb80 1 -- 172.21.15.49:0/3124282060 shutdown_connections 2024-06-03T00:02:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.402+0000 7f8b52f0eb80 1 -- 172.21.15.49:0/3124282060 wait complete. 2024-06-03T00:02:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.403+0000 7f8b52f0eb80 1 -- start start 2024-06-03T00:02:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.403+0000 7f8b52f0eb80 1 Processor -- start 2024-06-03T00:02:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.403+0000 7f8b52f0eb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c0e453fa0 0x560c0e45fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.403+0000 7f8b52f0eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c0e4596c0 0x560c0e45d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.403+0000 7f8b52f0eb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c0e459fe0 0x560c0e45d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.403+0000 7f8b52f0eb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x560c0e3a1850 con 0x560c0e459fe0 2024-06-03T00:02:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.403+0000 7f8b52f0eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x560c0e345c70 con 0x560c0e4596c0 2024-06-03T00:02:43.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.403+0000 7f8b52f0eb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560c0e460770 con 0x560c0e453fa0 2024-06-03T00:02:43.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.403+0000 7f8b52f0eb80 10 client.0 _ll_register_callbacks cb 0x560c0e33f9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:02:43.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.403+0000 7f8b46c28700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c0e459fe0 0x560c0e45d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:43.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.403+0000 7f8b46427700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c0e453fa0 0x560c0e45fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:43.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.403+0000 7f8b46c28700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c0e459fe0 0x560c0e45d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50780/0 (socket says 172.21.15.49:50780) 2024-06-03T00:02:43.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.403+0000 7f8b46c28700 1 -- 172.21.15.49:0/1027195819 learned_addr learned my addr 172.21.15.49:0/1027195819 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:43.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.403+0000 7f8b45c26700 1 --2- 172.21.15.49:0/1027195819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c0e4596c0 0x560c0e45d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:43.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.403+0000 7f8b46427700 1 -- 172.21.15.49:0/1027195819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c0e4596c0 msgr2=0x560c0e45d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:43.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.403+0000 7f8b46427700 1 --2- 172.21.15.49:0/1027195819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c0e4596c0 0x560c0e45d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.403+0000 7f8b46427700 1 -- 172.21.15.49:0/1027195819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c0e459fe0 msgr2=0x560c0e45d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:43.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.403+0000 7f8b46427700 1 --2- 172.21.15.49:0/1027195819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c0e459fe0 0x560c0e45d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.403+0000 7f8b46427700 1 -- 172.21.15.49:0/1027195819 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c0e2f4950 con 0x560c0e453fa0 2024-06-03T00:02:43.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.404+0000 7f8b46427700 1 --2- 172.21.15.49:0/1027195819 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c0e453fa0 0x560c0e45fd80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c098d70 tx=0x7f8b3c0a55c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75f5e4f1ed3dc532 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:43.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.404+0000 7f8b29ffb700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-06-03T00:02:43.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.404+0000 7f8b29ffb700 1 -- 172.21.15.49:0/1027195819 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c0b4070 con 0x560c0e453fa0 2024-06-03T00:02:43.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.404+0000 7f8b29ffb700 1 -- 172.21.15.49:0/1027195819 <== mon.1 v2:172.21.15.107:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f8b3c0bb1f0 con 0x560c0e453fa0 2024-06-03T00:02:43.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.404+0000 7f8b52f0eb80 1 -- 172.21.15.49:0/1027195819 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b3c0a0d10 con 0x560c0e453fa0 2024-06-03T00:02:43.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.404+0000 7f8b29ffb700 1 -- 172.21.15.49:0/1027195819 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8b3c0a3250 con 0x560c0e453fa0 2024-06-03T00:02:43.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.404+0000 7f8b52f0eb80 10 client.25510 fetch_fsmap learned FSMap version 27 2024-06-03T00:02:43.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.404+0000 7f8b52f0eb80 1 -- 172.21.15.49:0/1027195819 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560c0e46af50 con 0x560c0e453fa0 2024-06-03T00:02:43.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.404+0000 7f8b29ffb700 1 -- 172.21.15.49:0/1027195819 <== mon.1 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b3c0a0d10 con 0x560c0e453fa0 2024-06-03T00:02:43.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.404+0000 7f8b29ffb700 1 -- 172.21.15.49:0/1027195819 <== mon.1 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f8b3c0870b0 con 0x560c0e453fa0 2024-06-03T00:02:43.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.404+0000 7f8b52f0eb80 10 client.25510 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:02:43.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.404+0000 7f8b52f0eb80 10 client.25510 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-03T00:02:43.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.404+0000 7f8b52f0eb80 20 client.25510 populate_metadata read hostname 'smithi049' 2024-06-03T00:02:43.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.404+0000 7f8b52f0eb80 1 --2- 172.21.15.49:0/1027195819 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x560c0e46d4c0 0x560c0e46f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:43.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.404+0000 7f8b52f0eb80 4 client.25510 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:02:43.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.404+0000 7f8b52f0eb80 1 -- 172.21.15.49:0/1027195819 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c0e3b2d90 con 0x560c0e46d4c0 2024-06-03T00:02:43.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.405+0000 7f8b45c26700 1 --2- 172.21.15.49:0/1027195819 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x560c0e46d4c0 0x560c0e46f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:43.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.405+0000 7f8b45c26700 1 --2- 172.21.15.49:0/1027195819 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x560c0e46d4c0 0x560c0e46f8b0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf267983f1507d6b server_cookie=fb82e2e92df6e81f in_seq=0 out_seq=0 2024-06-03T00:02:43.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.405+0000 7f8b29ffb700 10 client.25510 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:43.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.406+0000 7f8b29ffb700 1 -- 172.21.15.49:0/1027195819 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x560c0e3b2d90 con 0x560c0e46d4c0 2024-06-03T00:02:43.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.406+0000 7f8b29ffb700 10 client.25510 handle_command_reply: tid=0 2024-06-03T00:02:43.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.406+0000 7f8b52f0eb80 1 client.25510 shutdown 2024-06-03T00:02:43.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.406+0000 7f8b52f0eb80 1 -- 172.21.15.49:0/1027195819 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c0e453fa0 msgr2=0x560c0e45fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:43.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.406+0000 7f8b52f0eb80 1 --2- 172.21.15.49:0/1027195819 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c0e453fa0 0x560c0e45fd80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c098d70 tx=0x7f8b3c0a55c0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.406+0000 7f8b52f0eb80 1 -- 172.21.15.49:0/1027195819 shutdown_connections 2024-06-03T00:02:43.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.406+0000 7f8b52f0eb80 1 --2- 172.21.15.49:0/1027195819 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x560c0e46d4c0 0x560c0e46f8b0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.406+0000 7f8b52f0eb80 1 --2- 172.21.15.49:0/1027195819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c0e459fe0 0x560c0e45d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.406+0000 7f8b52f0eb80 1 --2- 172.21.15.49:0/1027195819 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c0e453fa0 0x560c0e45fd80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.406+0000 7f8b52f0eb80 1 --2- 172.21.15.49:0/1027195819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c0e4596c0 0x560c0e45d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.406+0000 7f8b29ffb700 0 client.25510 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:43.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.406+0000 7f8b52f0eb80 1 -- 172.21.15.49:0/1027195819 >> 172.21.15.49:0/1027195819 conn(0x560c0e37ed40 msgr2=0x560c0e452a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:43.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.407+0000 7f8b52f0eb80 1 -- 172.21.15.49:0/1027195819 shutdown_connections 2024-06-03T00:02:43.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.407+0000 7f8b52f0eb80 1 -- 172.21.15.49:0/1027195819 wait complete. 2024-06-03T00:02:43.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.407+0000 7f8b52f0eb80 20 client.25510 trim_cache size 0 max 16384 2024-06-03T00:02:43.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.429+0000 7f8b52f0eb80 1 Processor -- start 2024-06-03T00:02:43.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.429+0000 7f8b52f0eb80 1 -- start start 2024-06-03T00:02:43.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.429+0000 7f8b52f0eb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c0e453fa0 0x560c0e453a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:43.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.429+0000 7f8b52f0eb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c0e4596c0 0x560c0e45ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:43.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.429+0000 7f8b52f0eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c0e459fe0 0x560c0e475180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:43.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.429+0000 7f8b52f0eb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8b401aecb0 con 0x560c0e4596c0 2024-06-03T00:02:43.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.429+0000 7f8b52f0eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8b401b07f0 con 0x560c0e459fe0 2024-06-03T00:02:43.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.429+0000 7f8b52f0eb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8b401af380 con 0x560c0e453fa0 2024-06-03T00:02:43.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.429+0000 7f8b45c26700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c0e4596c0 0x560c0e45ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:43.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.429+0000 7f8b45c26700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c0e4596c0 0x560c0e45ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50792/0 (socket says 172.21.15.49:50792) 2024-06-03T00:02:43.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.429+0000 7f8b45c26700 1 -- 172.21.15.49:0/465644927 learned_addr learned my addr 172.21.15.49:0/465644927 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:43.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.429+0000 7f8b46427700 1 --2- 172.21.15.49:0/465644927 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c0e453fa0 0x560c0e453a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:43.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.429+0000 7f8b45c26700 1 -- 172.21.15.49:0/465644927 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c0e453fa0 msgr2=0x560c0e453a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:43.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.429+0000 7f8b45c26700 1 --2- 172.21.15.49:0/465644927 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c0e453fa0 0x560c0e453a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.429+0000 7f8b45c26700 1 -- 172.21.15.49:0/465644927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c0e459fe0 msgr2=0x560c0e475180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:43.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.429+0000 7f8b45c26700 1 --2- 172.21.15.49:0/465644927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c0e459fe0 0x560c0e475180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.429+0000 7f8b45c26700 1 -- 172.21.15.49:0/465644927 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c0e454380 con 0x560c0e4596c0 2024-06-03T00:02:43.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.430+0000 7f8b45c26700 1 --2- 172.21.15.49:0/465644927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c0e4596c0 0x560c0e45ac50 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8b40102e90 tx=0x7f8b34017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc9769567eae8524 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:43.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.430+0000 7f8b2bfff700 1 -- 172.21.15.49:0/465644927 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3402d070 con 0x560c0e4596c0 2024-06-03T00:02:43.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.430+0000 7f8b2bfff700 1 -- 172.21.15.49:0/465644927 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b34004530 con 0x560c0e4596c0 2024-06-03T00:02:43.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.430+0000 7f8b2bfff700 1 -- 172.21.15.49:0/465644927 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b34028360 con 0x560c0e4596c0 2024-06-03T00:02:43.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.430+0000 7f8b52f0eb80 1 -- 172.21.15.49:0/465644927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c0e4596c0 msgr2=0x560c0e45ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:43.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.430+0000 7f8b52f0eb80 1 --2- 172.21.15.49:0/465644927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c0e4596c0 0x560c0e45ac50 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8b40102e90 tx=0x7f8b34017000 comp rx=0 tx=0).stop 2024-06-03T00:02:43.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.430+0000 7f8b52f0eb80 1 -- 172.21.15.49:0/465644927 shutdown_connections 2024-06-03T00:02:43.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.430+0000 7f8b52f0eb80 1 --2- 172.21.15.49:0/465644927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c0e459fe0 0x560c0e475180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.430+0000 7f8b52f0eb80 1 --2- 172.21.15.49:0/465644927 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c0e453fa0 0x560c0e453a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.430+0000 7f8b52f0eb80 1 --2- 172.21.15.49:0/465644927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c0e4596c0 0x560c0e45ac50 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.430+0000 7f8b52f0eb80 1 -- 172.21.15.49:0/465644927 >> 172.21.15.49:0/465644927 conn(0x560c0e37ed40 msgr2=0x560c0e4484f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:43.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.430+0000 7f8b52f0eb80 1 -- 172.21.15.49:0/465644927 shutdown_connections 2024-06-03T00:02:43.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.430+0000 7f8b52f0eb80 1 -- 172.21.15.49:0/465644927 wait complete. 2024-06-03T00:02:43.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.431+0000 7f8b52f0eb80 1 -- start start 2024-06-03T00:02:43.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.431+0000 7f8b52f0eb80 1 Processor -- start 2024-06-03T00:02:43.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.431+0000 7f8b52f0eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c0e453fa0 0x560c0e4662d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:43.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.431+0000 7f8b52f0eb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c0e4596c0 0x560c0e462a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:43.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.431+0000 7f8b52f0eb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c0e459fe0 0x560c0e463040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:43.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.431+0000 7f8b52f0eb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8b401b0120 con 0x560c0e4596c0 2024-06-03T00:02:43.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.431+0000 7f8b52f0eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8b401afa50 con 0x560c0e453fa0 2024-06-03T00:02:43.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.431+0000 7f8b52f0eb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8b401acc30 con 0x560c0e459fe0 2024-06-03T00:02:43.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.431+0000 7f8b52f0eb80 10 client.0 _ll_register_callbacks cb 0x560c0e33f9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:02:43.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.431+0000 7f8b45c26700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c0e4596c0 0x560c0e462a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:43.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.431+0000 7f8b46c28700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c0e459fe0 0x560c0e463040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:43.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.431+0000 7f8b45c26700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c0e4596c0 0x560c0e462a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50800/0 (socket says 172.21.15.49:50800) 2024-06-03T00:02:43.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.431+0000 7f8b45c26700 1 -- 172.21.15.49:0/1155914232 learned_addr learned my addr 172.21.15.49:0/1155914232 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:43.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.431+0000 7f8b46427700 1 --2- 172.21.15.49:0/1155914232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c0e453fa0 0x560c0e4662d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:43.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.432+0000 7f8b46c28700 1 -- 172.21.15.49:0/1155914232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c0e453fa0 msgr2=0x560c0e4662d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:43.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.432+0000 7f8b46c28700 1 --2- 172.21.15.49:0/1155914232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c0e453fa0 0x560c0e4662d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.432+0000 7f8b46c28700 1 -- 172.21.15.49:0/1155914232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c0e4596c0 msgr2=0x560c0e462a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:43.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.432+0000 7f8b46c28700 1 --2- 172.21.15.49:0/1155914232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c0e4596c0 0x560c0e462a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.432+0000 7f8b46c28700 1 -- 172.21.15.49:0/1155914232 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c0e4d8160 con 0x560c0e459fe0 2024-06-03T00:02:43.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.432+0000 7f8b45c26700 1 --2- 172.21.15.49:0/1155914232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c0e4596c0 0x560c0e462a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:02:43.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.432+0000 7f8b46c28700 1 --2- 172.21.15.49:0/1155914232 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c0e459fe0 0x560c0e463040 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8b38009260 tx=0x7f8b38007c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=698c1d513584efd server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:43.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.432+0000 7f8b29ffb700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-06-03T00:02:43.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.432+0000 7f8b29ffb700 1 -- 172.21.15.49:0/1155914232 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b38027430 con 0x560c0e459fe0 2024-06-03T00:02:43.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.432+0000 7f8b52f0eb80 1 -- 172.21.15.49:0/1155914232 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b34004530 con 0x560c0e459fe0 2024-06-03T00:02:43.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.432+0000 7f8b29ffb700 1 -- 172.21.15.49:0/1155914232 <== mon.1 v2:172.21.15.107:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f8b380263d0 con 0x560c0e459fe0 2024-06-03T00:02:43.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.432+0000 7f8b29ffb700 1 -- 172.21.15.49:0/1155914232 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8b380275d0 con 0x560c0e459fe0 2024-06-03T00:02:43.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.432+0000 7f8b52f0eb80 10 client.25516 fetch_fsmap learned FSMap version 27 2024-06-03T00:02:43.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.432+0000 7f8b52f0eb80 1 -- 172.21.15.49:0/1155914232 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560c0e4d9390 con 0x560c0e459fe0 2024-06-03T00:02:43.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.432+0000 7f8b29ffb700 1 -- 172.21.15.49:0/1155914232 <== mon.1 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b34004530 con 0x560c0e459fe0 2024-06-03T00:02:43.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.433+0000 7f8b29ffb700 1 -- 172.21.15.49:0/1155914232 <== mon.1 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f8b38026ac0 con 0x560c0e459fe0 2024-06-03T00:02:43.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.433+0000 7f8b52f0eb80 10 client.25516 fetch_fsmap finished waiting for FSMap version 27 2024-06-03T00:02:43.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.433+0000 7f8b52f0eb80 10 client.25516 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-03T00:02:43.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.433+0000 7f8b52f0eb80 20 client.25516 populate_metadata read hostname 'smithi049' 2024-06-03T00:02:43.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.433+0000 7f8b52f0eb80 1 --2- 172.21.15.49:0/1155914232 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x560c0e4d9a80 0x560c0e4dbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:43.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.433+0000 7f8b52f0eb80 4 client.25516 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-06-03T00:02:43.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.433+0000 7f8b52f0eb80 1 -- 172.21.15.49:0/1155914232 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560c0e3ad310 con 0x560c0e4d9a80 2024-06-03T00:02:43.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.433+0000 7f8b46427700 1 --2- 172.21.15.49:0/1155914232 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x560c0e4d9a80 0x560c0e4dbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:43.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.433+0000 7f8b46427700 1 --2- 172.21.15.49:0/1155914232 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x560c0e4d9a80 0x560c0e4dbea0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70b111b22f3eef4a server_cookie=f94f0386ffa8ebe3 in_seq=0 out_seq=0 2024-06-03T00:02:43.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.433+0000 7f8b29ffb700 10 client.25516 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:43.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.434+0000 7f8b29ffb700 1 -- 172.21.15.49:0/1155914232 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560c0e3ad310 con 0x560c0e4d9a80 2024-06-03T00:02:43.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.434+0000 7f8b29ffb700 10 client.25516 handle_command_reply: tid=0 2024-06-03T00:02:43.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.434+0000 7f8b52f0eb80 1 client.25516 shutdown 2024-06-03T00:02:43.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.434+0000 7f8b52f0eb80 1 -- 172.21.15.49:0/1155914232 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c0e459fe0 msgr2=0x560c0e463040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:43.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.434+0000 7f8b52f0eb80 1 --2- 172.21.15.49:0/1155914232 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c0e459fe0 0x560c0e463040 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8b38009260 tx=0x7f8b38007c10 comp rx=0 tx=0).stop 2024-06-03T00:02:43.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.434+0000 7f8b52f0eb80 1 -- 172.21.15.49:0/1155914232 shutdown_connections 2024-06-03T00:02:43.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.434+0000 7f8b52f0eb80 1 --2- 172.21.15.49:0/1155914232 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c0e459fe0 0x560c0e463040 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.434+0000 7f8b52f0eb80 1 --2- 172.21.15.49:0/1155914232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c0e453fa0 0x560c0e4662d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.434+0000 7f8b52f0eb80 1 --2- 172.21.15.49:0/1155914232 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x560c0e4d9a80 0x560c0e4dbea0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.434+0000 7f8b52f0eb80 1 --2- 172.21.15.49:0/1155914232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560c0e4596c0 0x560c0e462a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.434+0000 7f8b29ffb700 0 client.25516 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:43.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.434+0000 7f8b52f0eb80 1 -- 172.21.15.49:0/1155914232 >> 172.21.15.49:0/1155914232 conn(0x560c0e37ed40 msgr2=0x560c0e458220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:43.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.435+0000 7f8b52f0eb80 1 -- 172.21.15.49:0/1155914232 shutdown_connections 2024-06-03T00:02:43.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.435+0000 7f8b52f0eb80 1 -- 172.21.15.49:0/1155914232 wait complete. 2024-06-03T00:02:43.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.435+0000 7f8b52f0eb80 20 client.25516 trim_cache size 0 max 16384 2024-06-03T00:02:43.440 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:02:43.440 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-06-03T00:02:43.440 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "b2878f21-cfde-4c0f-bff1-a048258a6bb8", 2024-06-03T00:02:43.440 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-06-03T00:02:43.441 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:02:43.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.435+0000 7f8b4868b700 1 -- 172.21.15.49:0/3073208382 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8b2c0a2ca0 msgr2=0x7f8b2c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:43.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.435+0000 7f8b4868b700 1 --2- 172.21.15.49:0/3073208382 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8b2c0a2ca0 0x7f8b2c0a5160 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8b40078970 tx=0x7f8b34009260 comp rx=0 tx=0).stop 2024-06-03T00:02:43.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.435+0000 7f8b4868b700 1 -- 172.21.15.49:0/3073208382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b4006aa00 msgr2=0x7f8b40101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:43.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.435+0000 7f8b4868b700 1 --2- 172.21.15.49:0/3073208382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b4006aa00 0x7f8b40101450 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c000c00 tx=0x7f8b3c00bab0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.435+0000 7f8b4868b700 1 -- 172.21.15.49:0/3073208382 shutdown_connections 2024-06-03T00:02:43.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.435+0000 7f8b4868b700 1 --2- 172.21.15.49:0/3073208382 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f8b2c0a2ca0 0x7f8b2c0a5160 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.435+0000 7f8b4868b700 1 --2- 172.21.15.49:0/3073208382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b401084f0 0x7f8b40101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.435+0000 7f8b4868b700 1 --2- 172.21.15.49:0/3073208382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b4006aa00 0x7f8b40101450 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.435+0000 7f8b4868b700 1 --2- 172.21.15.49:0/3073208382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b4006b3c0 0x7f8b40101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:43.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.435+0000 7f8b4868b700 1 -- 172.21.15.49:0/3073208382 >> 172.21.15.49:0/3073208382 conn(0x7f8b40078300 msgr2=0x7f8b40100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:43.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.435+0000 7f8b4868b700 1 -- 172.21.15.49:0/3073208382 shutdown_connections 2024-06-03T00:02:43.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:43.435+0000 7f8b4868b700 1 -- 172.21.15.49:0/3073208382 wait complete. 2024-06-03T00:02:44.258 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-03T00:02:44.532 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:02:44.775 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.481+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001338 [...2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/ auth{0=1} v326 ap=1 f(v0 m2024-06-03T00:02:35.206890+0000 89=89+0) n(v0 rc2024-06-03T00:02:35.206890+0000 90=89+1) (inest lock) (ifile excl) caps={24895=pAsLsXsFsx/pAsLsXsFsx@1},l=24895 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc0c9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001338:[<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(2)0x10000001338:[<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-06-03T00:02:35.206890+0000 89=89+0)","ondisk_value.rstat":"n(v0 rc2024-06-03T00:02:35.206890+0000 90=89+1)","memory_value.dirstat":"f(v0 m2024-06-03T00:02:35.206890+0000 89=89+0)","memory_value.rstat":"n(v0 rc2024-06-03T00:02:35.206890+0000 90=89+1)","error_str":""},"return_code":0} 2024-06-03T00:02:44.775 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.481+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000136e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/38-1.c auth v108 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc117600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000136e:[<0x10000001338/38-1.c v108>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000136e:[<0x10000001338/38-1.c v108>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.775 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.482+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001350 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/sigmacrolist.txt auth v48 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc118100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001350:[<0x10000001338/sigmacrolist.txt v48>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001350:[<0x10000001338/sigmacrolist.txt v48>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.775 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.482+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000135f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/31-1.c auth v78 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc117b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000135f:[<0x10000001338/31-1.c v78>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000135f:[<0x10000001338/31-1.c v78>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.775 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.482+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001370 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/34-1.c auth v112 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc117080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001370:[<0x10000001338/34-1.c v112>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001370:[<0x10000001338/34-1.c v112>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.775 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.483+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013a8 [...2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/ auth{0=1} v440 ap=1 f(v0 m2024-06-03T00:02:35.280888+0000 35=35+0) n(v0 rc2024-06-03T00:02:35.280888+0000 36=35+1) (inest lock) (ifile excl) caps={24895=pAsLsXsFsx/pAsLsXsFsx@1},l=24895 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc0ca100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000013a8:[<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(2)0x100000013a8:[<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-06-03T00:02:35.280888+0000 35=35+0)","ondisk_value.rstat":"n(v0 rc2024-06-03T00:02:35.280888+0000 36=35+1)","memory_value.dirstat":"f(v0 m2024-06-03T00:02:35.280888+0000 35=35+0)","memory_value.rstat":"n(v0 rc2024-06-03T00:02:35.280888+0000 36=35+1)","error_str":""},"return_code":0} 2024-06-03T00:02:44.775 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.483+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001387 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-37.c auth v158 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc118680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001387:[<0x10000001338/22-37.c v158>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001387:[<0x10000001338/22-37.c v158>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.775 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.483+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001392 [...2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/ auth{0=1} v368 ap=1 f(v0 m2024-06-03T00:02:35.230890+0000 20=20+0) n(v0 rc2024-06-03T00:02:35.230890+0000 21=20+1) (inest lock) (ifile excl) caps={24895=pAsLsXsFsx/pAsLsXsFsx@1},l=24895 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc0cac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001392:[<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(2)0x10000001392:[<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-06-03T00:02:35.230890+0000 20=20+0)","ondisk_value.rstat":"n(v0 rc2024-06-03T00:02:35.230890+0000 21=20+1)","memory_value.dirstat":"f(v0 m2024-06-03T00:02:35.230890+0000 20=20+0)","memory_value.rstat":"n(v0 rc2024-06-03T00:02:35.230890+0000 21=20+1)","error_str":""},"return_code":0} 2024-06-03T00:02:44.776 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.484+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013d3 [...2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/ auth{0=1} v465 ap=1 f(v0 m2024-06-03T00:02:35.318887+0000 2=0+2) n(v1 rc2024-06-03T00:02:35.371886+0000 65=62+3) (inest lock) (ifile excl) caps={24895=pAsLsXsFsx/pAsLsXsFsx@1},l=24895 | importingcaps=0 dirfrag=1 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5643cc0ca680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000013d3:[<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(2)0x100000013d3:[<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-06-03T00:02:35.318887+0000 2=0+2)","ondisk_value.rstat":"n(v0 rc2024-06-03T00:02:35.371886+0000 65=62+3)","memory_value.dirstat":"f(v0 m2024-06-03T00:02:35.318887+0000 2=0+2)","memory_value.rstat":"n(v1 rc2024-06-03T00:02:35.371886+0000 65=62+3)","error_str":""},"return_code":0} 2024-06-03T00:02:44.776 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.484+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013cc [...2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/ auth{0=1} v454 ap=1 f(v0 m2024-06-03T00:02:35.290888+0000 6=6+0) n(v0 rc2024-06-03T00:02:35.290888+0000 7=6+1) (inest lock) (ifile excl) caps={24895=pAsLsXsFsx/pAsLsXsFsx@1},l=24895 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc0cb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000013cc:[<0x100000012ee/errno_h v454>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(2)0x100000013cc:[<0x100000012ee/errno_h v454>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-06-03T00:02:35.290888+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2024-06-03T00:02:35.290888+0000 7=6+1)","memory_value.dirstat":"f(v0 m2024-06-03T00:02:35.290888+0000 6=6+0)","memory_value.rstat":"n(v0 rc2024-06-03T00:02:35.290888+0000 7=6+1)","error_str":""},"return_code":0} 2024-06-03T00:02:44.776 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.485+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012f3 [...2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/ auth{0=1} v34 ap=1 f(v0 m2024-06-03T00:02:35.080894+0000 12=12+0) n(v0 rc2024-06-03T00:02:35.080894+0000 13=12+1) (inest lock) (ifile excl) caps={24895=pAsLsXsFsx/pAsLsXsFsx@1},l=24895 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc0cb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000012f3:[<0x100000012ee/mqueue_h v34>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(2)0x100000012f3:[<0x100000012ee/mqueue_h v34>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-06-03T00:02:35.080894+0000 12=12+0)","ondisk_value.rstat":"n(v0 rc2024-06-03T00:02:35.080894+0000 13=12+1)","memory_value.dirstat":"f(v0 m2024-06-03T00:02:35.080894+0000 12=12+0)","memory_value.rstat":"n(v0 rc2024-06-03T00:02:35.080894+0000 13=12+1)","error_str":""},"return_code":0} 2024-06-03T00:02:44.776 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.486+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001331 [...2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/ auth{0=1} v146 ap=1 f(v0 m2024-06-03T00:02:35.128892+0000 6=6+0) n(v0 rc2024-06-03T00:02:35.128892+0000 7=6+1) (inest lock) (ifile excl) caps={24895=pAsLsXsFsx/pAsLsXsFsx@1},l=24895 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc116000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001331:[<0x100000012ee/aio_h v146>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(2)0x10000001331:[<0x100000012ee/aio_h v146>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-06-03T00:02:35.128892+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2024-06-03T00:02:35.128892+0000 7=6+1)","memory_value.dirstat":"f(v0 m2024-06-03T00:02:35.128892+0000 6=6+0)","memory_value.rstat":"n(v0 rc2024-06-03T00:02:35.128892+0000 7=6+1)","error_str":""},"return_code":0} 2024-06-03T00:02:44.776 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.488+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001300 [...2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/ auth{0=1} v132 ap=1 f(v0 m2024-06-03T00:02:35.123892+0000 48=48+0) n(v0 rc2024-06-03T00:02:35.123892+0000 49=48+1) (inest lock) (ifile excl) caps={24895=pAsLsXsFsx/pAsLsXsFsx@1},l=24895 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc116580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001300:[<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(2)0x10000001300:[<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-06-03T00:02:35.123892+0000 48=48+0)","ondisk_value.rstat":"n(v0 rc2024-06-03T00:02:35.123892+0000 49=48+1)","memory_value.dirstat":"f(v0 m2024-06-03T00:02:35.123892+0000 48=48+0)","memory_value.rstat":"n(v0 rc2024-06-03T00:02:35.123892+0000 49=48+1)","error_str":""},"return_code":0} 2024-06-03T00:02:44.776 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.488+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012ef [...2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/unistd_h/ auth{0=1} v8 ap=1 f(v0 m2024-06-03T00:02:35.069894+0000 3=3+0) n(v0 rc2024-06-03T00:02:35.069894+0000 4=3+1) (inest lock) (ifile excl) caps={24895=pAsLsXsFsx/pAsLsXsFsx@1},l=24895 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc116b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000012ef:[<0x100000012ee/unistd_h v8>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(2)0x100000012ef:[<0x100000012ee/unistd_h v8>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-06-03T00:02:35.069894+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-06-03T00:02:35.069894+0000 4=3+1)","memory_value.dirstat":"f(v0 m2024-06-03T00:02:35.069894+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-06-03T00:02:35.069894+0000 4=3+1)","error_str":""},"return_code":0} 2024-06-03T00:02:44.777 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.489+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000138e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-26.c auth v172 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc118c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000138e:[<0x10000001338/22-26.c v172>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000138e:[<0x10000001338/22-26.c v172>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.777 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.489+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000133f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-38.c auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc119180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000133f:[<0x10000001338/22-38.c v14>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000133f:[<0x10000001338/22-38.c v14>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.777 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.489+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001355 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-18.c auth v58 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc119700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001355:[<0x10000001338/22-18.c v58>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001355:[<0x10000001338/22-18.c v58>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.777 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.489+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000137e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-1.c auth v140 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc122580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000137e:[<0x10000001338/22-1.c v140>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000137e:[<0x10000001338/22-1.c v140>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.778 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.489+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000137a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/2-4.c auth v132 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc122000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000137a:[<0x10000001338/2-4.c v132>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000137a:[<0x10000001338/2-4.c v132>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.778 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.490+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001373 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-29.c auth v118 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc122b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001373:[<0x10000001338/22-29.c v118>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001373:[<0x10000001338/22-29.c v118>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.778 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.490+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000134f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-32.c auth v46 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc123080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000134f:[<0x10000001338/22-32.c v46>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000134f:[<0x10000001338/22-32.c v46>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.778 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.490+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001376 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/29-1.c auth v124 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc123600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001376:[<0x10000001338/29-1.c v124>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001376:[<0x10000001338/29-1.c v124>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.778 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.490+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001341 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/20-1.c auth v18 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc123b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001341:[<0x10000001338/20-1.c v18>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001341:[<0x10000001338/20-1.c v18>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.778 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.490+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001391 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/2-3.c auth v178 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc124100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001391:[<0x10000001338/2-3.c v178>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001391:[<0x10000001338/2-3.c v178>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.778 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.490+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000137c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/13-1.c auth v136 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc124680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000137c:[<0x10000001338/13-1.c v136>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000137c:[<0x10000001338/13-1.c v136>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.778 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.491+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001385 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/36-1.c auth v154 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc124c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001385:[<0x10000001338/36-1.c v154>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001385:[<0x10000001338/36-1.c v154>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.778 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.491+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000133e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-15.c auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc125180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000133e:[<0x10000001338/22-15.c v12>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000133e:[<0x10000001338/22-15.c v12>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.778 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.492+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001363 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/45-1.c auth v86 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc128000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001363:[<0x10000001338/45-1.c v86>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001363:[<0x10000001338/45-1.c v86>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.783 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.492+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001384 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-22.c auth v152 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc125700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001384:[<0x10000001338/22-22.c v152>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001384:[<0x10000001338/22-22.c v152>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.783 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.492+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000134a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/23-1.c auth v36 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc128580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000134a:[<0x10000001338/23-1.c v36>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000134a:[<0x10000001338/23-1.c v36>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.783 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.493+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001345 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-35.c auth v26 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc128b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001345:[<0x10000001338/22-35.c v26>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001345:[<0x10000001338/22-35.c v26>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.783 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.493+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001375 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-5.c auth v122 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc129080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001375:[<0x10000001338/22-5.c v122>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001375:[<0x10000001338/22-5.c v122>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.783 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.493+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001360 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/15-1.c auth v80 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc129600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001360:[<0x10000001338/15-1.c v80>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001360:[<0x10000001338/15-1.c v80>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.783 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.493+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001359 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-24.c auth v66 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc129b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001359:[<0x10000001338/22-24.c v66>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001359:[<0x10000001338/22-24.c v66>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.783 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.493+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001348 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-31.c auth v32 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc12a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001348:[<0x10000001338/22-31.c v32>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001348:[<0x10000001338/22-31.c v32>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.783 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.493+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001389 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/48-1.c auth v162 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc12ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001389:[<0x10000001338/48-1.c v162>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001389:[<0x10000001338/48-1.c v162>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.783 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.494+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000136c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/43-1.c auth v104 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc12a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000136c:[<0x10000001338/43-1.c v104>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000136c:[<0x10000001338/43-1.c v104>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.783 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.494+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000135b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/1-1.c auth v70 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc136000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000135b:[<0x10000001338/1-1.c v70>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000135b:[<0x10000001338/1-1.c v70>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.784 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.495+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001349 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-14.c auth v34 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc136580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001349:[<0x10000001338/22-14.c v34>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001349:[<0x10000001338/22-14.c v34>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.784 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.495+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000133c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-4.c auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc137600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000133c:[<0x10000001338/22-4.c v8>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000133c:[<0x10000001338/22-4.c v8>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.784 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.495+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001364 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-36.c auth v88 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc136b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001364:[<0x10000001338/22-36.c v88>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001364:[<0x10000001338/22-36.c v88>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.784 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.496+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001366 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-20.c auth v92 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc137080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001366:[<0x10000001338/22-20.c v92>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001366:[<0x10000001338/22-20.c v92>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.784 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.496+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000133b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/27-1.c auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc12b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000133b:[<0x10000001338/27-1.c v6>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000133b:[<0x10000001338/27-1.c v6>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.784 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.496+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001356 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/14-1.c auth v60 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc12b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001356:[<0x10000001338/14-1.c v60>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001356:[<0x10000001338/14-1.c v60>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.784 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.496+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001383 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-34.c auth v150 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc137b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001383:[<0x10000001338/22-34.c v150>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001383:[<0x10000001338/22-34.c v150>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.784 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.496+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001378 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/2-2.c auth v128 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc138100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001378:[<0x10000001338/2-2.c v128>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001378:[<0x10000001338/2-2.c v128>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.784 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.497+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000136d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-11.c auth v106 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc138680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000136d:[<0x10000001338/22-11.c v106>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000136d:[<0x10000001338/22-11.c v106>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.784 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.497+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001379 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-7.c auth v130 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc138c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001379:[<0x10000001338/22-7.c v130>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001379:[<0x10000001338/22-7.c v130>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.784 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.497+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000134e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/coverage.txt auth v44 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc139180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000134e:[<0x10000001338/coverage.txt v44>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000134e:[<0x10000001338/coverage.txt v44>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.784 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.497+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001347 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/40-1.c auth v30 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc139700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001347:[<0x10000001338/40-1.c v30>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001347:[<0x10000001338/40-1.c v30>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.785 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.497+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000134c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/24-1.c auth v40 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc142000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000134c:[<0x10000001338/24-1.c v40>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000134c:[<0x10000001338/24-1.c v40>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.785 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.497+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001343 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/47-1.c auth v22 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc142580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001343:[<0x10000001338/47-1.c v22>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001343:[<0x10000001338/47-1.c v22>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.785 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.498+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001344 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/39-1.c auth v24 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc142b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001344:[<0x10000001338/39-1.c v24>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001344:[<0x10000001338/39-1.c v24>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.785 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.498+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001346 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-10.c auth v28 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc143080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001346:[<0x10000001338/22-10.c v28>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001346:[<0x10000001338/22-10.c v28>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.785 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.498+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001361 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/35-1.c auth v82 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc143b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001361:[<0x10000001338/35-1.c v82>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001361:[<0x10000001338/35-1.c v82>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.785 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.498+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001372 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/50-1.c auth v116 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc144100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001372:[<0x10000001338/50-1.c v116>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001372:[<0x10000001338/50-1.c v116>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.785 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.498+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000136b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-33.c auth v102 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc144680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000136b:[<0x10000001338/22-33.c v102>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000136b:[<0x10000001338/22-33.c v102>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.785 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.498+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000138d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-39.c auth v170 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc144c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000138d:[<0x10000001338/22-39.c v170>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000138d:[<0x10000001338/22-39.c v170>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.785 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.499+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001382 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/4-1.c auth v148 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc145700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001382:[<0x10000001338/4-1.c v148>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001382:[<0x10000001338/4-1.c v148>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.785 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.499+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001371 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-8.c auth v114 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc14e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001371:[<0x10000001338/22-8.c v114>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001371:[<0x10000001338/22-8.c v114>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.785 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.499+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001368 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-3.c auth v96 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc145180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001368:[<0x10000001338/22-3.c v96>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001368:[<0x10000001338/22-3.c v96>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.785 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.499+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001381 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/26-1.c auth v146 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc14eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001381:[<0x10000001338/26-1.c v146>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001381:[<0x10000001338/26-1.c v146>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.786 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.499+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001357 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/2-1.c auth v62 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc14f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001357:[<0x10000001338/2-1.c v62>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001357:[<0x10000001338/2-1.c v62>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.786 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.500+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000133a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/37-1.c auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc14f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000133a:[<0x10000001338/37-1.c v4>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000133a:[<0x10000001338/37-1.c v4>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.786 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.500+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000135c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/42-1.c auth v72 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc14e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000135c:[<0x10000001338/42-1.c v72>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000135c:[<0x10000001338/42-1.c v72>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.786 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.500+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000133d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/3-1.c auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc150100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000133d:[<0x10000001338/3-1.c v10>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000133d:[<0x10000001338/3-1.c v10>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.786 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.500+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000135a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-25.c auth v68 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc14fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000135a:[<0x10000001338/22-25.c v68>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000135a:[<0x10000001338/22-25.c v68>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.786 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.500+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001365 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-27.c auth v90 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc150680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001365:[<0x10000001338/22-27.c v90>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001365:[<0x10000001338/22-27.c v90>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.786 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.500+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001380 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-19.c auth v144 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc150c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001380:[<0x10000001338/22-19.c v144>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001380:[<0x10000001338/22-19.c v144>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.786 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.501+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001358 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/5-1.c auth v64 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc158000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001358:[<0x10000001338/5-1.c v64>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001358:[<0x10000001338/5-1.c v64>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.786 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.501+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001390 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-40.c auth v176 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc151700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001390:[<0x10000001338/22-40.c v176>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001390:[<0x10000001338/22-40.c v176>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.786 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.501+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000136a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-21.c auth v100 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc151180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000136a:[<0x10000001338/22-21.c v100>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000136a:[<0x10000001338/22-21.c v100>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.786 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.501+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000137d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-6.c auth v138 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc158580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000137d:[<0x10000001338/22-6.c v138>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000137d:[<0x10000001338/22-6.c v138>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.787 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.501+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000138b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-13.c auth v166 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc159080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000138b:[<0x10000001338/22-13.c v166>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000138b:[<0x10000001338/22-13.c v166>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.787 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.502+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001351 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/18-1.c auth v50 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc158b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001351:[<0x10000001338/18-1.c v50>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001351:[<0x10000001338/18-1.c v50>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.787 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.502+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001362 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/44-1.c auth v84 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc159600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001362:[<0x10000001338/44-1.c v84>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001362:[<0x10000001338/44-1.c v84>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.787 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.502+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000134d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-2.c auth v42 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc159b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000134d:[<0x10000001338/22-2.c v42>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000134d:[<0x10000001338/22-2.c v42>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.787 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.502+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001352 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/make22tests auth v52 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc15a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001352:[<0x10000001338/make22tests v52>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001352:[<0x10000001338/make22tests v52>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.787 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.502+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000135d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-17.c auth v74 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc15a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000135d:[<0x10000001338/22-17.c v74>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000135d:[<0x10000001338/22-17.c v74>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.787 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.503+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001342 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/41-1.c auth v20 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc15ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001342:[<0x10000001338/41-1.c v20>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001342:[<0x10000001338/41-1.c v20>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.787 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.503+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000138c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/17-1.c auth v168 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc15b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000138c:[<0x10000001338/17-1.c v168>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000138c:[<0x10000001338/17-1.c v168>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.787 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.503+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001386 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/25-1.c auth v156 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc15b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001386:[<0x10000001338/25-1.c v156>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001386:[<0x10000001338/25-1.c v156>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.787 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.503+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000137b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-30.c auth v134 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc16a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000137b:[<0x10000001338/22-30.c v134>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000137b:[<0x10000001338/22-30.c v134>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.787 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.503+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001367 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-16.c auth v94 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc16a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001367:[<0x10000001338/22-16.c v94>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001367:[<0x10000001338/22-16.c v94>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.787 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.503+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001388 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/30-1.c auth v160 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc16ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001388:[<0x10000001338/30-1.c v160>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001388:[<0x10000001338/30-1.c v160>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.788 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.504+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001377 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-12.c auth v126 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc16b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001377:[<0x10000001338/22-12.c v126>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001377:[<0x10000001338/22-12.c v126>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.796 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.504+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001340 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-28.c auth v16 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc16b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001340:[<0x10000001338/22-28.c v16>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001340:[<0x10000001338/22-28.c v16>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.797 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.504+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000137f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/49-1.c auth v142 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc16bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000137f:[<0x10000001338/49-1.c v142>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000137f:[<0x10000001338/49-1.c v142>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.797 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.504+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001353 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/33-1.c auth v54 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc16c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001353:[<0x10000001338/33-1.c v54>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001353:[<0x10000001338/33-1.c v54>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.797 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.504+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001369 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/46-1.c auth v98 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc16c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001369:[<0x10000001338/46-1.c v98>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001369:[<0x10000001338/46-1.c v98>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.797 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.504+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001354 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/28-1.c auth v56 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc16d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001354:[<0x10000001338/28-1.c v56>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001354:[<0x10000001338/28-1.c v56>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.797 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.505+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000138a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/16-1.c auth v164 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc16cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000138a:[<0x10000001338/16-1.c v164>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000138a:[<0x10000001338/16-1.c v164>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.797 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.505+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000138f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-23.c auth v174 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc16d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000138f:[<0x10000001338/22-23.c v174>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000138f:[<0x10000001338/22-23.c v174>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.797 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.505+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001339 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-9.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc172000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001339:[<0x10000001338/22-9.c v2>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001339:[<0x10000001338/22-9.c v2>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.797 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.505+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000135e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/32-1.c auth v76 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc172580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000135e:[<0x10000001338/32-1.c v76>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000135e:[<0x10000001338/32-1.c v76>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.797 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.505+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000136f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/assertions.xml auth v110 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc172b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000136f:[<0x10000001338/assertions.xml v110>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000136f:[<0x10000001338/assertions.xml v110>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.797 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.506+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000134b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/19-1.c auth v38 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc173080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000134b:[<0x10000001338/19-1.c v38>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000134b:[<0x10000001338/19-1.c v38>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.798 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.506+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001374 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/21-1.c auth v120 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc173600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001374:[<0x10000001338/21-1.c v120>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001374:[<0x10000001338/21-1.c v120>,<0x100000012ee/signal_h v326>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.798 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.506+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012f1 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/unistd_h/1-1.c auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc248c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012f1:[<0x100000012ef/1-1.c v4>,<0x100000012ee/unistd_h v8>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000012f1:[<0x100000012ef/1-1.c v4>,<0x100000012ee/unistd_h v8>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.798 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.506+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012f0 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/unistd_h/2-1.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc249180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012f0:[<0x100000012ef/2-1.c v2>,<0x100000012ee/unistd_h v8>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000012f0:[<0x100000012ef/2-1.c v2>,<0x100000012ee/unistd_h v8>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.798 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.506+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012f2 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/unistd_h/assertions.xml auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc249700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012f2:[<0x100000012ef/assertions.xml v6>,<0x100000012ee/unistd_h v8>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000012f2:[<0x100000012ef/assertions.xml v6>,<0x100000012ee/unistd_h v8>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.798 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.506+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000131c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/34-1.c auth v56 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc217600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000131c:[<0x10000001300/34-1.c v56>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000131c:[<0x10000001300/34-1.c v56>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.798 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.507+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001315 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/31-1.c auth v42 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc217b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001315:[<0x10000001300/31-1.c v42>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001315:[<0x10000001300/31-1.c v42>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.798 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.507+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000131e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/7-1.c auth v60 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc218100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000131e:[<0x10000001300/7-1.c v60>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000131e:[<0x10000001300/7-1.c v60>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.798 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.507+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001322 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/22-1.c auth v68 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc218680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001322:[<0x10000001300/22-1.c v68>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001322:[<0x10000001300/22-1.c v68>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.798 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.507+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001330 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/35-2.c auth v96 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc218c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001330:[<0x10000001300/35-2.c v96>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001330:[<0x10000001300/35-2.c v96>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.798 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.507+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001320 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/29-1.c auth v64 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc219180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001320:[<0x10000001300/29-1.c v64>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001320:[<0x10000001300/29-1.c v64>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.799 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.508+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001326 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/3-4.c auth v76 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc219700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001326:[<0x10000001300/3-4.c v76>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001326:[<0x10000001300/3-4.c v76>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.799 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.508+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001321 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/13-1.c auth v66 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc222580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001321:[<0x10000001300/13-1.c v66>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001321:[<0x10000001300/13-1.c v66>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.799 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.508+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001306 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/23-1.c auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc222b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001306:[<0x10000001300/23-1.c v12>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001306:[<0x10000001300/23-1.c v12>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.799 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.508+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001318 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/15-1.c auth v48 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc223080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001318:[<0x10000001300/15-1.c v48>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001318:[<0x10000001300/15-1.c v48>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.799 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.508+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001304 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/20-1.c auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc222000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001304:[<0x10000001300/20-1.c v8>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001304:[<0x10000001300/20-1.c v8>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.799 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.509+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000131d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/12-1.c auth v58 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc223600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000131d:[<0x10000001300/12-1.c v58>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000131d:[<0x10000001300/12-1.c v58>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.799 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.509+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001316 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/7-4.c auth v44 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc223b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001316:[<0x10000001300/7-4.c v44>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001316:[<0x10000001300/7-4.c v44>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.799 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.509+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001301 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/27-1.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc224100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001301:[<0x10000001300/27-1.c v2>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001301:[<0x10000001300/27-1.c v2>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.799 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.509+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000130f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/14-1.c auth v30 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc224680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000130f:[<0x10000001300/14-1.c v30>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000130f:[<0x10000001300/14-1.c v30>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.799 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.509+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001313 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/1-1.c auth v38 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc224c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001313:[<0x10000001300/1-1.c v38>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001313:[<0x10000001300/1-1.c v38>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.799 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.509+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000130a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/coverage.txt auth v20 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc225180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000130a:[<0x10000001300/coverage.txt v20>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000130a:[<0x10000001300/coverage.txt v20>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.800 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.510+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000130c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/35-3.c auth v24 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc225700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000130c:[<0x10000001300/35-3.c v24>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000130c:[<0x10000001300/35-3.c v24>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.800 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.510+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001308 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/24-1.c auth v16 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc230000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001308:[<0x10000001300/24-1.c v16>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001308:[<0x10000001300/24-1.c v16>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.800 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.510+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001319 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/35-1.c auth v50 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc230580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001319:[<0x10000001300/35-1.c v50>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001319:[<0x10000001300/35-1.c v50>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.800 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.510+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000131a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/8-1.c auth v52 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc230b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000131a:[<0x10000001300/8-1.c v52>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000131a:[<0x10000001300/8-1.c v52>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.800 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.510+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001324 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/4-1.c auth v72 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc231080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001324:[<0x10000001300/4-1.c v72>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001324:[<0x10000001300/4-1.c v72>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.800 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.510+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000132c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/3-3.c auth v88 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc231600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000132c:[<0x10000001300/3-3.c v88>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000132c:[<0x10000001300/3-3.c v88>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.800 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.511+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001317 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/7-5.c auth v46 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc231b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001317:[<0x10000001300/7-5.c v46>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001317:[<0x10000001300/7-5.c v46>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.800 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.511+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001323 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/26-1.c auth v70 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc232100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001323:[<0x10000001300/26-1.c v70>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001323:[<0x10000001300/26-1.c v70>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.800 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.511+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001310 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/2-1.c auth v32 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc232680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001310:[<0x10000001300/2-1.c v32>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001310:[<0x10000001300/2-1.c v32>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.800 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.511+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001309 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/6-2.c auth v18 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc233180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001309:[<0x10000001300/6-2.c v18>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001309:[<0x10000001300/6-2.c v18>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.800 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.511+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001312 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/6-1.c auth v36 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc232c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001312:[<0x10000001300/6-1.c v36>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001312:[<0x10000001300/6-1.c v36>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.801 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.511+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001302 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/3-1.c auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc233700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001302:[<0x10000001300/3-1.c v4>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001302:[<0x10000001300/3-1.c v4>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.801 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.512+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000132a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/7-2.c auth v84 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc23c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000132a:[<0x10000001300/7-2.c v84>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000132a:[<0x10000001300/7-2.c v84>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.801 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.512+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001305 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/10-1.c auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc23cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001305:[<0x10000001300/10-1.c v10>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001305:[<0x10000001300/10-1.c v10>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.801 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.512+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001311 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/5-1.c auth v34 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc23c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001311:[<0x10000001300/5-1.c v34>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001311:[<0x10000001300/5-1.c v34>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.801 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.512+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000130b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/18-1.c auth v22 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc23d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000130b:[<0x10000001300/18-1.c v22>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000130b:[<0x10000001300/18-1.c v22>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.801 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.513+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001303 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/9-1.c auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc23d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001303:[<0x10000001300/9-1.c v6>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001303:[<0x10000001300/9-1.c v6>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.801 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.513+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001329 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/11-1.c auth v82 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc23db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001329:[<0x10000001300/11-1.c v82>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001329:[<0x10000001300/11-1.c v82>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.801 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.513+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000132b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/17-1.c auth v86 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc23e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000132b:[<0x10000001300/17-1.c v86>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000132b:[<0x10000001300/17-1.c v86>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.802 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.513+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000132d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/6-3.c auth v90 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc23e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000132d:[<0x10000001300/6-3.c v90>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000132d:[<0x10000001300/6-3.c v90>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.802 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.513+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000132f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/3-2.c auth v94 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc23ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000132f:[<0x10000001300/3-2.c v94>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000132f:[<0x10000001300/3-2.c v94>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.802 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.514+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001325 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/25-1.c auth v74 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc23f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001325:[<0x10000001300/25-1.c v74>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001325:[<0x10000001300/25-1.c v74>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.802 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.514+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001327 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/30-1.c auth v78 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc23f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001327:[<0x10000001300/30-1.c v78>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001327:[<0x10000001300/30-1.c v78>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.802 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.514+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001328 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/16-1.c auth v80 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc246580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001328:[<0x10000001300/16-1.c v80>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001328:[<0x10000001300/16-1.c v80>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.802 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.514+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000130d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/33-1.c auth v26 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc246000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000130d:[<0x10000001300/33-1.c v26>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000130d:[<0x10000001300/33-1.c v26>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.802 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.514+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000130e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/28-1.c auth v28 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc246b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000130e:[<0x10000001300/28-1.c v28>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000130e:[<0x10000001300/28-1.c v28>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.802 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.514+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001314 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/32-1.c auth v40 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc247080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001314:[<0x10000001300/32-1.c v40>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001314:[<0x10000001300/32-1.c v40>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.803 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.515+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000131b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/assertions.xml auth v54 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc247600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000131b:[<0x10000001300/assertions.xml v54>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000131b:[<0x10000001300/assertions.xml v54>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.803 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.515+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001307 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/19-1.c auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc247b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001307:[<0x10000001300/19-1.c v14>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001307:[<0x10000001300/19-1.c v14>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.803 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.515+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000131f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/21-1.c auth v62 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc248100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000131f:[<0x10000001300/21-1.c v62>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000131f:[<0x10000001300/21-1.c v62>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.803 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.515+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001333 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/1-2.c auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc20b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001333:[<0x10000001331/1-2.c v4>,<0x100000012ee/aio_h v146>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001333:[<0x10000001331/1-2.c v4>,<0x100000012ee/aio_h v146>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.803 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.515+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001335 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/1-1.c auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc20b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001335:[<0x10000001331/1-1.c v8>,<0x100000012ee/aio_h v146>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001335:[<0x10000001331/1-1.c v8>,<0x100000012ee/aio_h v146>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.803 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.515+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000132e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/7-3.c auth v92 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc248680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000132e:[<0x10000001300/7-3.c v92>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000132e:[<0x10000001300/7-3.c v92>,<0x100000012ee/time_h v132>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.803 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.516+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001337 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/4-1.c auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc216000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001337:[<0x10000001331/4-1.c v12>,<0x100000012ee/aio_h v146>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001337:[<0x10000001331/4-1.c v12>,<0x100000012ee/aio_h v146>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.803 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.516+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001334 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/2-1.c auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc216580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001334:[<0x10000001331/2-1.c v6>,<0x100000012ee/aio_h v146>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001334:[<0x10000001331/2-1.c v6>,<0x100000012ee/aio_h v146>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.803 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.516+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001332 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/3-1.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc216b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001332:[<0x10000001331/3-1.c v2>,<0x100000012ee/aio_h v146>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001332:[<0x10000001331/3-1.c v2>,<0x100000012ee/aio_h v146>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.803 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.516+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001336 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/assertions.xml auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc217080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001336:[<0x10000001331/assertions.xml v10>,<0x100000012ee/aio_h v146>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001336:[<0x10000001331/assertions.xml v10>,<0x100000012ee/aio_h v146>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.803 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.516+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012fd [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/7-1.c auth v20 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1fec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012fd:[<0x100000012f3/7-1.c v20>,<0x100000012ee/mqueue_h v34>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000012fd:[<0x100000012f3/7-1.c v20>,<0x100000012ee/mqueue_h v34>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.804 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.516+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012fa [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/1-1.c auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1ff180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012fa:[<0x100000012f3/1-1.c v14>,<0x100000012ee/mqueue_h v34>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000012fa:[<0x100000012f3/1-1.c v14>,<0x100000012ee/mqueue_h v34>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.804 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.517+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012fb [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/8-1.c auth v16 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1ff700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012fb:[<0x100000012f3/8-1.c v16>,<0x100000012ee/mqueue_h v34>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000012fb:[<0x100000012f3/8-1.c v16>,<0x100000012ee/mqueue_h v34>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.804 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.517+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012fe [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/4-1.c auth v22 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc208000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012fe:[<0x100000012f3/4-1.c v22>,<0x100000012ee/mqueue_h v34>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000012fe:[<0x100000012f3/4-1.c v22>,<0x100000012ee/mqueue_h v34>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.804 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.517+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012f7 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/2-1.c auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc208580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012f7:[<0x100000012f3/2-1.c v8>,<0x100000012ee/mqueue_h v34>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000012f7:[<0x100000012f3/2-1.c v8>,<0x100000012ee/mqueue_h v34>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.804 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.517+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012f9 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/6-1.c auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc208b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012f9:[<0x100000012f3/6-1.c v12>,<0x100000012ee/mqueue_h v34>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000012f9:[<0x100000012f3/6-1.c v12>,<0x100000012ee/mqueue_h v34>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.804 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.517+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012f4 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/3-1.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc209080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012f4:[<0x100000012f3/3-1.c v2>,<0x100000012ee/mqueue_h v34>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000012f4:[<0x100000012f3/3-1.c v2>,<0x100000012ee/mqueue_h v34>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.804 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.517+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012f8 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/5-1.c auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc209600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012f8:[<0x100000012f3/5-1.c v10>,<0x100000012ee/mqueue_h v34>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000012f8:[<0x100000012f3/5-1.c v10>,<0x100000012ee/mqueue_h v34>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.804 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.518+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012f6 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/10-1.c auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc209b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012f6:[<0x100000012f3/10-1.c v6>,<0x100000012ee/mqueue_h v34>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000012f6:[<0x100000012f3/10-1.c v6>,<0x100000012ee/mqueue_h v34>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.804 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.518+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012f5 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/9-1.c auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc20a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012f5:[<0x100000012f3/9-1.c v4>,<0x100000012ee/mqueue_h v34>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000012f5:[<0x100000012f3/9-1.c v4>,<0x100000012ee/mqueue_h v34>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.804 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.518+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012ff [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/11-1.c auth v24 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc20a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012ff:[<0x100000012f3/11-1.c v24>,<0x100000012ee/mqueue_h v34>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000012ff:[<0x100000012f3/11-1.c v24>,<0x100000012ee/mqueue_h v34>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.804 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.518+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012fc [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/assertions.xml auth v18 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc20ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012fc:[<0x100000012f3/assertions.xml v18>,<0x100000012ee/mqueue_h v34>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000012fc:[<0x100000012f3/assertions.xml v18>,<0x100000012ee/mqueue_h v34>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.804 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.518+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013cf [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/1-1.c auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1fcb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013cf:[<0x100000013cc/1-1.c v6>,<0x100000012ee/errno_h v454>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013cf:[<0x100000013cc/1-1.c v6>,<0x100000012ee/errno_h v454>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.805 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.518+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013d1 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/4-1.c auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1fd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013d1:[<0x100000013cc/4-1.c v10>,<0x100000012ee/errno_h v454>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013d1:[<0x100000013cc/4-1.c v10>,<0x100000012ee/errno_h v454>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.805 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.518+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013cd [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/3-1.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1fdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013cd:[<0x100000013cc/3-1.c v2>,<0x100000012ee/errno_h v454>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013cd:[<0x100000013cc/3-1.c v2>,<0x100000012ee/errno_h v454>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.805 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.519+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013d2 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/3-2.c auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1fe100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013d2:[<0x100000013cc/3-2.c v12>,<0x100000012ee/errno_h v454>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013d2:[<0x100000013cc/3-2.c v12>,<0x100000012ee/errno_h v454>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.805 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.519+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013ce [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/2-1.c auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1fd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013ce:[<0x100000013cc/2-1.c v4>,<0x100000012ee/errno_h v454>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013ce:[<0x100000013cc/2-1.c v4>,<0x100000012ee/errno_h v454>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.805 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.519+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013d0 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/assertions.xml auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1fe680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013d0:[<0x100000013cc/assertions.xml v8>,<0x100000012ee/errno_h v454>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013d0:[<0x100000013cc/assertions.xml v8>,<0x100000012ee/errno_h v454>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.805 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.519+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000139d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/15-1.c auth v22 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1e5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000139d:[<0x10000001392/15-1.c v22>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000139d:[<0x10000001392/15-1.c v22>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.805 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.519+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013a2 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/13-1.c auth v30 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1e5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013a2:[<0x10000001392/13-1.c v30>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013a2:[<0x10000001392/13-1.c v30>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.805 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.519+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013a0 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/12-1.c auth v28 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1e6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013a0:[<0x10000001392/12-1.c v28>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013a0:[<0x10000001392/12-1.c v28>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.805 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.520+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001399 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/8-4.c auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1e6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001399:[<0x10000001392/8-4.c v14>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001399:[<0x10000001392/8-4.c v14>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.805 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.520+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000139a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/14-1.c auth v16 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1e6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000139a:[<0x10000001392/14-1.c v16>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000139a:[<0x10000001392/14-1.c v16>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.805 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.520+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000139c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/1-1.c auth v20 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1e7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000139c:[<0x10000001392/1-1.c v20>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000139c:[<0x10000001392/1-1.c v20>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.805 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.520+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001397 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/coverage.txt auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1e7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001397:[<0x10000001392/coverage.txt v10>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001397:[<0x10000001392/coverage.txt v10>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.806 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.520+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000139e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/8-1.c auth v24 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1f0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000139e:[<0x10000001392/8-1.c v24>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000139e:[<0x10000001392/8-1.c v24>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.806 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.520+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013a3 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/4-1.c auth v32 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1f0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013a3:[<0x10000001392/4-1.c v32>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013a3:[<0x10000001392/4-1.c v32>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.806 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.520+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001393 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/8-3.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1f0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001393:[<0x10000001392/8-3.c v2>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001393:[<0x10000001392/8-3.c v2>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.806 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.521+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000139b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/2-1.c auth v18 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1f1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000139b:[<0x10000001392/2-1.c v18>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000139b:[<0x10000001392/2-1.c v18>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.806 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.521+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001394 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/3-1.c auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1f1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001394:[<0x10000001392/3-1.c v4>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001394:[<0x10000001392/3-1.c v4>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.806 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.521+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001395 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/10-1.c auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1f1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001395:[<0x10000001392/10-1.c v6>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001395:[<0x10000001392/10-1.c v6>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.806 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.521+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001398 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/18-1.c auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1f2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001398:[<0x10000001392/18-1.c v12>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001398:[<0x10000001392/18-1.c v12>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.806 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.521+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013a4 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/8-2.c auth v34 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1f3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013a4:[<0x10000001392/8-2.c v34>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013a4:[<0x10000001392/8-2.c v34>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.806 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.521+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013a5 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/16-1.c auth v36 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1f3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013a5:[<0x10000001392/16-1.c v36>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013a5:[<0x10000001392/16-1.c v36>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.806 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.522+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013a6 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/11-1.c auth v38 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1f2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013a6:[<0x10000001392/11-1.c v38>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013a6:[<0x10000001392/11-1.c v38>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.806 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.522+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013a7 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/17-1.c auth v40 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1f2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013a7:[<0x10000001392/17-1.c v40>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013a7:[<0x10000001392/17-1.c v40>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.807 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.523+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000139f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/assertions.xml auth v26 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1fc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000139f:[<0x10000001392/assertions.xml v26>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000139f:[<0x10000001392/assertions.xml v26>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.807 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.523+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001396 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/19-1.c auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1fc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001396:[<0x10000001392/19-1.c v8>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001396:[<0x10000001392/19-1.c v8>,<0x100000012ee/sched_h v368>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.807 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.523+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013d4 [...2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/ auth v42 ap=1 f(v0 m2024-06-03T00:02:35.317887+0000 20=20+0) n(v0 rc2024-06-03T00:02:35.317887+0000 21=20+1) (inest lock) (ifile excl) caps={24895=pAsLsXsFsx/pAsLsXsFsx@1},l=24895 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc198680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000013d4:[<0x100000013d3/shm_h v42>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(2)0x100000013d4:[<0x100000013d3/shm_h v42>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-06-03T00:02:35.317887+0000 20=20+0)","ondisk_value.rstat":"n(v0 rc2024-06-03T00:02:35.317887+0000 21=20+1)","memory_value.dirstat":"f(v0 m2024-06-03T00:02:35.317887+0000 20=20+0)","memory_value.rstat":"n(v0 rc2024-06-03T00:02:35.317887+0000 21=20+1)","error_str":""},"return_code":0} 2024-06-03T00:02:44.807 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.523+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013e9 [...2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/ auth v128 ap=1 f(v0 m2024-06-03T00:02:35.371886+0000 42=42+0) n(v0 rc2024-06-03T00:02:35.371886+0000 43=42+1) (inest lock) (ifile excl) caps={24895=pAsLsXsFsx/pAsLsXsFsx@1},l=24895 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc198c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000013e9:[<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(2)0x100000013e9:[<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-06-03T00:02:35.371886+0000 42=42+0)","ondisk_value.rstat":"n(v0 rc2024-06-03T00:02:35.371886+0000 43=42+1)","memory_value.dirstat":"f(v0 m2024-06-03T00:02:35.371886+0000 42=42+0)","memory_value.rstat":"n(v0 rc2024-06-03T00:02:35.371886+0000 43=42+1)","error_str":""},"return_code":0} 2024-06-03T00:02:44.807 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.523+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013bd [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/7-1.c auth v42 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc173b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013bd:[<0x100000013a8/7-1.c v42>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013bd:[<0x100000013a8/7-1.c v42>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.807 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.523+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013b7 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/10.c auth v30 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc174100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013b7:[<0x100000013a8/10.c v30>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013b7:[<0x100000013a8/10.c v30>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.807 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.524+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013c2 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-10.c auth v52 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc174680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013c2:[<0x100000013a8/3-10.c v52>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013c2:[<0x100000013a8/3-10.c v52>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.807 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.524+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013c5 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-4.c auth v58 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc174c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013c5:[<0x100000013a8/3-4.c v58>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013c5:[<0x100000013a8/3-4.c v58>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.807 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.524+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013ab [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/20-1.c auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc175180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013ab:[<0x100000013a8/20-1.c v6>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013ab:[<0x100000013a8/20-1.c v6>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.814 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.524+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013c3 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/13-1.c auth v54 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc175700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013c3:[<0x100000013a8/13-1.c v54>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013c3:[<0x100000013a8/13-1.c v54>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.814 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.524+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013c0 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-8.c auth v48 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc17e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013c0:[<0x100000013a8/3-8.c v48>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013c0:[<0x100000013a8/3-8.c v48>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.814 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.524+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013be [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-13.c auth v44 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc17e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013be:[<0x100000013a8/3-13.c v44>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013be:[<0x100000013a8/3-13.c v44>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.814 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.524+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013b6 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/15-1.c auth v28 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc17eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013b6:[<0x100000013a8/15-1.c v28>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013b6:[<0x100000013a8/15-1.c v28>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.814 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.524+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013b0 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/14-1.c auth v16 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc17f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013b0:[<0x100000013a8/14-1.c v16>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013b0:[<0x100000013a8/14-1.c v16>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.814 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.525+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013bc [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/12-1.c auth v40 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc17f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013bc:[<0x100000013a8/12-1.c v40>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013bc:[<0x100000013a8/12-1.c v40>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.814 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.525+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013ba [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-7.c auth v36 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc180100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013ba:[<0x100000013a8/3-7.c v36>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013ba:[<0x100000013a8/3-7.c v36>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.814 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.525+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013c1 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/2-2.c auth v50 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc180680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013c1:[<0x100000013a8/2-2.c v50>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013c1:[<0x100000013a8/2-2.c v50>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.814 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.525+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013b5 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/1-1.c auth v26 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc17fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013b5:[<0x100000013a8/1-1.c v26>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013b5:[<0x100000013a8/1-1.c v26>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.815 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.525+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013ae [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/coverage.txt auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc180c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013ae:[<0x100000013a8/coverage.txt v12>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013ae:[<0x100000013a8/coverage.txt v12>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.815 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.525+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013b8 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-11.c auth v32 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc181180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013b8:[<0x100000013a8/3-11.c v32>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013b8:[<0x100000013a8/3-11.c v32>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.815 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.525+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013b9 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/8-1.c auth v34 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc181700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013b9:[<0x100000013a8/8-1.c v34>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013b9:[<0x100000013a8/8-1.c v34>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.815 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.526+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013c4 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/4-1.c auth v56 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc188000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013c4:[<0x100000013a8/4-1.c v56>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013c4:[<0x100000013a8/4-1.c v56>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.815 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.526+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013b1 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/2-1.c auth v18 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc188b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013b1:[<0x100000013a8/2-1.c v18>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013b1:[<0x100000013a8/2-1.c v18>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.815 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.526+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013ca [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-3.c auth v68 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc188580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013ca:[<0x100000013a8/3-3.c v68>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013ca:[<0x100000013a8/3-3.c v68>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.815 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.526+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013b4 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/6-1.c auth v24 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc189080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013b4:[<0x100000013a8/6-1.c v24>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013b4:[<0x100000013a8/6-1.c v24>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.815 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.526+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013a9 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-1.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc189600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013a9:[<0x100000013a8/3-1.c v2>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013a9:[<0x100000013a8/3-1.c v2>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.815 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.526+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013bf [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-6.c auth v46 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc189b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013bf:[<0x100000013a8/3-6.c v46>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013bf:[<0x100000013a8/3-6.c v46>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.816 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.527+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013b3 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/5-1.c auth v22 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc18a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013b3:[<0x100000013a8/5-1.c v22>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013b3:[<0x100000013a8/5-1.c v22>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.816 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.527+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013af [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/18-1.c auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc18a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013af:[<0x100000013a8/18-1.c v14>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013af:[<0x100000013a8/18-1.c v14>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.816 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.527+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013aa [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/9-1.c auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc18ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013aa:[<0x100000013a8/9-1.c v4>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013aa:[<0x100000013a8/9-1.c v4>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.816 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.527+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013c9 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-9.c auth v66 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc18b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013c9:[<0x100000013a8/3-9.c v66>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013c9:[<0x100000013a8/3-9.c v66>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.816 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.527+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013c7 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/11-1.c auth v62 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc18b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013c7:[<0x100000013a8/11-1.c v62>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013c7:[<0x100000013a8/11-1.c v62>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.816 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.527+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013b2 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-12.c auth v20 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc196000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013b2:[<0x100000013a8/3-12.c v20>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013b2:[<0x100000013a8/3-12.c v20>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.816 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.527+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013c8 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/17-1.c auth v64 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc196580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013c8:[<0x100000013a8/17-1.c v64>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013c8:[<0x100000013a8/17-1.c v64>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.816 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.528+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013cb [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-2.c auth v70 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc196b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013cb:[<0x100000013a8/3-2.c v70>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013cb:[<0x100000013a8/3-2.c v70>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.816 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.528+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013c6 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/16-1.c auth v60 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc197080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013c6:[<0x100000013a8/16-1.c v60>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013c6:[<0x100000013a8/16-1.c v60>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.816 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.528+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013ac [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-5.c auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc197600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013ac:[<0x100000013a8/3-5.c v8>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013ac:[<0x100000013a8/3-5.c v8>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.816 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.528+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013bb [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/assertions.xml auth v38 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc197b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013bb:[<0x100000013a8/assertions.xml v38>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013bb:[<0x100000013a8/assertions.xml v38>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.816 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.528+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013ad [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/19-1.c auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc198100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013ad:[<0x100000013a8/19-1.c v10>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013ad:[<0x100000013a8/19-1.c v10>,<0x100000012ee/pthread_h v440>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.817 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.528+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013e1 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/7-1.c auth v26 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc199180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013e1:[<0x100000013d4/7-1.c v26>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013e1:[<0x100000013d4/7-1.c v26>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.817 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.529+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013e8 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/12-2.c auth v40 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc199700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013e8:[<0x100000013d4/12-2.c v40>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013e8:[<0x100000013d4/12-2.c v40>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.817 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.529+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013e0 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/12-1.c auth v24 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1a2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013e0:[<0x100000013d4/12-1.c v24>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013e0:[<0x100000013d4/12-1.c v24>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.817 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.529+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013dd [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/7-4.c auth v18 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1a2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013dd:[<0x100000013d4/7-4.c v18>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013dd:[<0x100000013d4/7-4.c v18>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.817 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.529+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013dc [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/1-1.c auth v16 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1a2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013dc:[<0x100000013d4/1-1.c v16>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013dc:[<0x100000013d4/1-1.c v16>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.817 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.529+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013e3 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/2-2.c auth v30 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1a3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013e3:[<0x100000013d4/2-2.c v30>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013e3:[<0x100000013d4/2-2.c v30>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.817 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.529+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013d8 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/coverage.txt auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1a3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013d8:[<0x100000013d4/coverage.txt v8>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013d8:[<0x100000013d4/coverage.txt v8>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.817 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.529+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013de [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/8-1.c auth v20 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc143600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013de:[<0x100000013d4/8-1.c v20>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013de:[<0x100000013d4/8-1.c v20>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.817 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.530+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013e4 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/4-1.c auth v32 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1a3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013e4:[<0x100000013d4/4-1.c v32>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013e4:[<0x100000013d4/4-1.c v32>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.817 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.530+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013d9 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/2-1.c auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1a4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013d9:[<0x100000013d4/2-1.c v10>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013d9:[<0x100000013d4/2-1.c v10>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.817 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.530+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013db [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/6-1.c auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1a4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013db:[<0x100000013d4/6-1.c v14>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013db:[<0x100000013d4/6-1.c v14>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.817 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.530+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013d5 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/3-1.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1a4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013d5:[<0x100000013d4/3-1.c v2>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013d5:[<0x100000013d4/3-1.c v2>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.818 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.530+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013e6 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/7-2.c auth v36 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1a5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013e6:[<0x100000013d4/7-2.c v36>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013e6:[<0x100000013d4/7-2.c v36>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.818 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.530+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013da [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/5-1.c auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1a5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013da:[<0x100000013d4/5-1.c v12>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013da:[<0x100000013d4/5-1.c v12>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.818 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.531+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013d7 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/10-1.c auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1b6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013d7:[<0x100000013d4/10-1.c v6>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013d7:[<0x100000013d4/10-1.c v6>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.818 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.531+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013d6 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/9-1.c auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1b6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013d6:[<0x100000013d4/9-1.c v4>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013d6:[<0x100000013d4/9-1.c v4>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.818 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.531+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013e2 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/12-3.c auth v28 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1b6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013e2:[<0x100000013d4/12-3.c v28>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013e2:[<0x100000013d4/12-3.c v28>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.818 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.531+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013e5 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/11-1.c auth v34 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1b7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013e5:[<0x100000013d4/11-1.c v34>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013e5:[<0x100000013d4/11-1.c v34>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.818 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.531+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013df [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/assertions.xml auth v22 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1b7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013df:[<0x100000013d4/assertions.xml v22>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013df:[<0x100000013d4/assertions.xml v22>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.818 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.531+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013e7 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/7-3.c auth v38 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1b7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013e7:[<0x100000013d4/7-3.c v38>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013e7:[<0x100000013d4/7-3.c v38>,<0x100000013d3/shm_h v42>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.818 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.532+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001403 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/7-1.c auth v52 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1b8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001403:[<0x100000013e9/7-1.c v52>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001403:[<0x100000013e9/7-1.c v52>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.818 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.532+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001407 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/2-4.c auth v60 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1b8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001407:[<0x100000013e9/2-4.c v60>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001407:[<0x100000013e9/2-4.c v60>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.818 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.532+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001409 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/22-1.c auth v64 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1b8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001409:[<0x100000013e9/22-1.c v64>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001409:[<0x100000013e9/22-1.c v64>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.819 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.532+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013ee [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/4-2.c auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1b9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013ee:[<0x100000013e9/4-2.c v10>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013ee:[<0x100000013e9/4-2.c v10>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.819 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.532+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001405 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/4-3.c auth v56 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1b9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001405:[<0x100000013e9/4-3.c v56>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001405:[<0x100000013e9/4-3.c v56>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.819 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.532+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013fe [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/9-3.c auth v42 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1c2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013fe:[<0x100000013e9/9-3.c v42>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013fe:[<0x100000013e9/9-3.c v42>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.819 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.533+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013ef [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/20-1.c auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1c2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013ef:[<0x100000013e9/20-1.c v12>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013ef:[<0x100000013e9/20-1.c v12>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.819 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.533+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001412 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/2-3.c auth v82 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1c2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001412:[<0x100000013e9/2-3.c v82>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001412:[<0x100000013e9/2-3.c v82>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.819 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.533+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001408 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/13-1.c auth v62 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1c3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001408:[<0x100000013e9/13-1.c v62>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001408:[<0x100000013e9/13-1.c v62>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.819 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.533+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013f1 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/23-1.c auth v16 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1c3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013f1:[<0x100000013e9/23-1.c v16>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013f1:[<0x100000013e9/23-1.c v16>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.819 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.533+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013ff [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/15-1.c auth v44 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1c3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013ff:[<0x100000013e9/15-1.c v44>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013ff:[<0x100000013e9/15-1.c v44>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.819 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.533+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001402 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/12-1.c auth v50 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1c4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001402:[<0x100000013e9/12-1.c v50>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001402:[<0x100000013e9/12-1.c v50>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.819 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.533+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013fc [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/7-4.c auth v38 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1c4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013fc:[<0x100000013e9/7-4.c v38>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013fc:[<0x100000013e9/7-4.c v38>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.819 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.534+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013fb [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/5-2.c auth v36 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1c4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013fb:[<0x100000013e9/5-2.c v36>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013fb:[<0x100000013e9/5-2.c v36>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.820 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.534+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013f6 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/14-1.c auth v26 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1c5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013f6:[<0x100000013e9/14-1.c v26>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013f6:[<0x100000013e9/14-1.c v26>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.820 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.534+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013fa [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/1-1.c auth v34 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1c5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013fa:[<0x100000013e9/1-1.c v34>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013fa:[<0x100000013e9/1-1.c v34>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.820 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.534+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013f4 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/coverage.txt auth v22 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1ca580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013f4:[<0x100000013e9/coverage.txt v22>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013f4:[<0x100000013e9/coverage.txt v22>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.820 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.534+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001406 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/2-2.c auth v58 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1ca000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001406:[<0x100000013e9/2-2.c v58>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001406:[<0x100000013e9/2-2.c v58>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.820 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.534+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000140a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/4-1.c auth v66 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1cb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000140a:[<0x100000013e9/4-1.c v66>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000140a:[<0x100000013e9/4-1.c v66>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.820 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.535+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001400 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/8-1.c auth v46 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1cb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001400:[<0x100000013e9/8-1.c v46>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001400:[<0x100000013e9/8-1.c v46>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.820 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.535+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013fd [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/7-5.c auth v40 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1cc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013fd:[<0x100000013e9/7-5.c v40>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013fd:[<0x100000013e9/7-5.c v40>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.820 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.535+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001410 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/3-3.c auth v78 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1cbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001410:[<0x100000013e9/3-3.c v78>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001410:[<0x100000013e9/3-3.c v78>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.820 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.535+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013ea [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/8-3.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1cc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013ea:[<0x100000013e9/8-3.c v2>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013ea:[<0x100000013e9/8-3.c v2>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.820 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.535+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013f3 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/24-1.c auth v20 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1cab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013f3:[<0x100000013e9/24-1.c v20>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013f3:[<0x100000013e9/24-1.c v20>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.820 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.535+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013f7 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/2-1.c auth v28 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1ccc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013f7:[<0x100000013e9/2-1.c v28>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013f7:[<0x100000013e9/2-1.c v28>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.820 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.536+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013f9 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/6-1.c auth v32 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1cd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013f9:[<0x100000013e9/6-1.c v32>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013f9:[<0x100000013e9/6-1.c v32>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.821 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.536+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013eb [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/3-1.c auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1cd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013eb:[<0x100000013e9/3-1.c v4>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013eb:[<0x100000013e9/3-1.c v4>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.821 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.536+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000140e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/7-2.c auth v74 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1da000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000140e:[<0x100000013e9/7-2.c v74>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000140e:[<0x100000013e9/7-2.c v74>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.821 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.536+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013f8 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/5-1.c auth v30 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1da580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013f8:[<0x100000013e9/5-1.c v30>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013f8:[<0x100000013e9/5-1.c v30>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.821 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.536+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013f0 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/10-1.c auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1dab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013f0:[<0x100000013e9/10-1.c v14>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013f0:[<0x100000013e9/10-1.c v14>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.821 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.536+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013f5 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/18-1.c auth v24 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1db080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013f5:[<0x100000013e9/18-1.c v24>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013f5:[<0x100000013e9/18-1.c v24>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.821 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.537+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013ec [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/9-1.c auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1db600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013ec:[<0x100000013e9/9-1.c v6>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013ec:[<0x100000013e9/9-1.c v6>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.821 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.537+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000140d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/11-1.c auth v72 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1dbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000140d:[<0x100000013e9/11-1.c v72>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000140d:[<0x100000013e9/11-1.c v72>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.821 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.537+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000140f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/17-1.c auth v76 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1dc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000140f:[<0x100000013e9/17-1.c v76>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000140f:[<0x100000013e9/17-1.c v76>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.821 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.537+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001413 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/3-2.c auth v84 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1dc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001413:[<0x100000013e9/3-2.c v84>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001413:[<0x100000013e9/3-2.c v84>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.821 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.537+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000140b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/8-2.c auth v68 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1dcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000140b:[<0x100000013e9/8-2.c v68>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000140b:[<0x100000013e9/8-2.c v68>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.821 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.537+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000140c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/16-1.c auth v70 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1dd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000140c:[<0x100000013e9/16-1.c v70>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000140c:[<0x100000013e9/16-1.c v70>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.821 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.537+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013ed [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/9-2.c auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1dd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013ed:[<0x100000013e9/9-2.c v8>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013ed:[<0x100000013e9/9-2.c v8>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.822 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.538+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001401 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/assertions.xml auth v48 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1e4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001401:[<0x100000013e9/assertions.xml v48>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001401:[<0x100000013e9/assertions.xml v48>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.822 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.538+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013f2 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/19-1.c auth v18 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1e4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013f2:[<0x100000013e9/19-1.c v18>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000013f2:[<0x100000013e9/19-1.c v18>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.822 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.538+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001404 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/21-1.c auth v54 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1e4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001404:[<0x100000013e9/21-1.c v54>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001404:[<0x100000013e9/21-1.c v54>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.822 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.538+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001411 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/7-3.c auth v80 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc1e5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001411:[<0x100000013e9/7-3.c v80>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v460>,<0x100000012ed/definitions v20>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001411:[<0x100000013e9/7-3.c v80>,<0x100000013d3/mman_h v128>,<0x100000012ee/sys v465>,<0x100000012ed/definitions v330>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.822 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.620+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000187d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-95.c auth v394 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643caf35080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000187d:[<0x10000001726/4-95.c v394>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000187d:[<0x10000001726/4-95.c v394>,<0x10000001414/sigaction v3724>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.822 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.620+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001761 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/9-1.c auth v118 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc0e4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001761:[<0x10000001726/9-1.c v118>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001761:[<0x10000001726/9-1.c v118>,<0x10000001414/sigaction v3724>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.822 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.620+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000180d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-91.c auth v360 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc0e4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000180d:[<0x10000001726/4-91.c v360>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000180d:[<0x10000001726/4-91.c v360>,<0x10000001414/sigaction v3724>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.822 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.620+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001916 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-35.c auth v436 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643caf35600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001916:[<0x10000001726/12-35.c v436>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001916:[<0x10000001726/12-35.c v436>,<0x10000001414/sigaction v3724>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.822 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.621+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000181b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-13.c auth v362 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc0e4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000181b:[<0x10000001726/4-13.c v362>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000181b:[<0x10000001726/4-13.c v362>,<0x10000001414/sigaction v3724>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.822 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.621+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001918 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-12.c auth v440 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc0e5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001918:[<0x10000001726/12-12.c v440>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001918:[<0x10000001726/12-12.c v440>,<0x10000001414/sigaction v3724>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.822 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.621+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001922 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-9.c auth v444 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc0e5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001922:[<0x10000001726/3-9.c v444>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001922:[<0x10000001726/3-9.c v444>,<0x10000001414/sigaction v3724>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.823 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.621+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001915 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-13.c auth v434 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc0e6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001915:[<0x10000001726/22-13.c v434>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001915:[<0x10000001726/22-13.c v434>,<0x10000001414/sigaction v3724>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.823 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.621+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000185a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-9.c auth v380 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc0e6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000185a:[<0x10000001726/4-9.c v380>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000185a:[<0x10000001726/4-9.c v380>,<0x10000001414/sigaction v3724>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.823 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.622+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017a6 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-27.c auth v256 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc0e6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017a6:[<0x10000001726/12-27.c v256>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017a6:[<0x10000001726/12-27.c v256>,<0x10000001414/sigaction v3724>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.823 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.622+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017e3 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-3.c auth v350 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc0e7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017e3:[<0x10000001726/23-3.c v350>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017e3:[<0x10000001726/23-3.c v350>,<0x10000001414/sigaction v3724>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.823 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.622+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001851 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/README auth v378 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2a2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001851:[<0x10000001726/README v378>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001851:[<0x10000001726/README v378>,<0x10000001414/sigaction v3724>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.823 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.622+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017c4 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-2.c auth v316 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc0e7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017c4:[<0x10000001726/22-2.c v316>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017c4:[<0x10000001726/22-2.c v316>,<0x10000001414/sigaction v3724>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.823 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.623+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001869 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-25.c auth v390 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2a2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001869:[<0x10000001726/1-25.c v390>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001869:[<0x10000001726/1-25.c v390>,<0x10000001414/sigaction v3724>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.823 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.623+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001764 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-103.c auth v124 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2a2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001764:[<0x10000001726/4-103.c v124>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001764:[<0x10000001726/4-103.c v124>,<0x10000001414/sigaction v3724>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.823 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.623+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001727 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-16.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2a3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001727:[<0x10000001726/12-16.c v2>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001727:[<0x10000001726/12-16.c v2>,<0x10000001414/sigaction v3724>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.823 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.624+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018d0 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-10.c auth v410 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2a3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018d0:[<0x10000001726/23-10.c v410>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018d0:[<0x10000001726/23-10.c v410>,<0x10000001414/sigaction v3724>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.823 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.624+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001860 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-6.c auth v382 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2a4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001860:[<0x10000001726/2-6.c v382>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001860:[<0x10000001726/2-6.c v382>,<0x10000001414/sigaction v3724>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.823 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.624+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017b7 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-16.c auth v290 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2a4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017b7:[<0x10000001726/6-16.c v290>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017b7:[<0x10000001726/6-16.c v290>,<0x10000001414/sigaction v3724>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.824 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.624+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018ea [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-4.c auth v418 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2a4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018ea:[<0x10000001726/18-4.c v418>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018ea:[<0x10000001726/18-4.c v418>,<0x10000001414/sigaction v3724>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.824 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.626+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001901 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-47.c auth v432 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2aa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001901:[<0x10000001726/4-47.c v432>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001901:[<0x10000001726/4-47.c v432>,<0x10000001414/sigaction v3724>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.824 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.629+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001930 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-14.c auth v450 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2aa580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001930:[<0x10000001726/16-14.c v450>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001930:[<0x10000001726/16-14.c v450>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.824 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.732+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001831 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-17.c auth v368 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2a3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001831:[<0x10000001726/22-17.c v368>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001831:[<0x10000001726/22-17.c v368>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.824 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.773+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018ae [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-3.c auth v402 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2aab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018ae:[<0x10000001726/12-3.c v402>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018ae:[<0x10000001726/12-3.c v402>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:44.824 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.773+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017d3 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-8.c auth v344 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2ab080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017d3:[<0x10000001726/13-8.c v344>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017d3:[<0x10000001726/13-8.c v344>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-mon[37048]: pgmap v464: 97 pgs: 97 active+clean; 28 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 990 op/s 2024-06-03T00:02:45.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-mon[37048]: scrub queued for path: / 2024-06-03T00:02:45.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:45.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:45.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-mon[37048]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:02:45.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:45.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:45.101 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.919+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001862 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-58.c auth v386 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2abb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001862:[<0x10000001726/4-58.c v386>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001862:[<0x10000001726/4-58.c v386>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.101 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:44.935+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001798 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-57.c auth v228 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2a5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001798:[<0x10000001726/4-57.c v228>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001798:[<0x10000001726/4-57.c v228>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:44 smithi057 ceph-mon[36457]: pgmap v464: 97 pgs: 97 active+clean; 28 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 990 op/s 2024-06-03T00:02:45.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:44 smithi057 ceph-mon[36457]: scrub queued for path: / 2024-06-03T00:02:45.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:44 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:45.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:44 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:45.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:44 smithi057 ceph-mon[36457]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:02:45.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:44 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:45.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:44 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:45.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:44 smithi049 ceph-mon[32302]: pgmap v464: 97 pgs: 97 active+clean; 28 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 990 op/s 2024-06-03T00:02:45.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:44 smithi049 ceph-mon[32302]: scrub queued for path: / 2024-06-03T00:02:45.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:44 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:45.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:44 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:45.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:44 smithi049 ceph-mon[32302]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:02:45.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:44 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:45.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:44 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:45.490 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.232+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017ff [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-31.c auth v354 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2ab600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017ff:[<0x10000001726/4-31.c v354>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017ff:[<0x10000001726/4-31.c v354>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.490 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.239+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017a7 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-3.c auth v258 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2ac680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017a7:[<0x10000001726/19-3.c v258>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017a7:[<0x10000001726/19-3.c v258>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.491 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.241+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018bc [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-14.c auth v404 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2acc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018bc:[<0x10000001726/28-14.c v404>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018bc:[<0x10000001726/28-14.c v404>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.491 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.243+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001833 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-36.c auth v370 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2ad180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001833:[<0x10000001726/4-36.c v370>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001833:[<0x10000001726/4-36.c v370>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.491 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.245+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017d9 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-14.c auth v348 pv465 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:36.936845+0000 b2450 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2ad700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017d9:[<0x10000001726/25-14.c v348>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017d9:[<0x10000001726/25-14.c v348>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.491 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.248+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000172c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-21.c auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2b8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000172c:[<0x10000001726/6-21.c v12>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000172c:[<0x10000001726/6-21.c v12>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.491 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.254+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000177c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-23.c auth v172 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2b8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000177c:[<0x10000001726/1-23.c v172>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000177c:[<0x10000001726/1-23.c v172>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.491 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.277+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001861 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-12.c auth v384 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2b8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001861:[<0x10000001726/18-12.c v384>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001861:[<0x10000001726/18-12.c v384>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.492 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.313+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001751 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-48.c auth v86 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc0e5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001751:[<0x10000001726/12-48.c v86>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001751:[<0x10000001726/12-48.c v86>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.492 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.321+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000188c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-13.c auth v398 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2a5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000188c:[<0x10000001726/18-13.c v398>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000188c:[<0x10000001726/18-13.c v398>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.492 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.322+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018ec [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-25.c auth v420 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2ba100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018ec:[<0x10000001726/19-25.c v420>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018ec:[<0x10000001726/19-25.c v420>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.492 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.329+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001754 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-20.c auth v92 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2b9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001754:[<0x10000001726/19-20.c v92>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001754:[<0x10000001726/19-20.c v92>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.492 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.332+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018a7 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-20.c auth v400 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2ac100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018a7:[<0x10000001726/1-20.c v400>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018a7:[<0x10000001726/1-20.c v400>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.492 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.333+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001774 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-22.c auth v156 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2bac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001774:[<0x10000001726/25-22.c v156>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001774:[<0x10000001726/25-22.c v156>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.492 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.335+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001777 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-7.c auth v162 pv471 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:36.544855+0000 b6203 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2bb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001777:[<0x10000001726/28-7.c v162>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001777:[<0x10000001726/28-7.c v162>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.492 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.336+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018ee [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-6.c auth v422 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2c2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018ee:[<0x10000001726/18-6.c v422>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018ee:[<0x10000001726/18-6.c v422>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.493 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.340+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001917 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/11-1.c auth v438 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2c2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001917:[<0x10000001726/11-1.c v438>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001917:[<0x10000001726/11-1.c v438>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.493 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.342+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000187b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-14.c auth v392 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2c2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000187b:[<0x10000001726/17-14.c v392>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000187b:[<0x10000001726/17-14.c v392>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.493 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.343+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001809 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-12.c auth v358 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2c3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001809:[<0x10000001726/3-12.c v358>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001809:[<0x10000001726/3-12.c v358>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.493 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.351+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001919 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-1.c auth v442 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2c3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001919:[<0x10000001726/17-1.c v442>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001919:[<0x10000001726/17-1.c v442>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.493 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.356+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000172b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-25.c auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2c3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000172b:[<0x10000001726/13-25.c v10>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000172b:[<0x10000001726/13-25.c v10>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.493 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.359+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000192b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-3.c auth v448 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2c4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000192b:[<0x10000001726/6-3.c v448>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000192b:[<0x10000001726/6-3.c v448>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.493 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.360+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018de [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-11.c auth v416 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2b9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018de:[<0x10000001726/13-11.c v416>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018de:[<0x10000001726/13-11.c v416>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.493 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.363+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018bf [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-15.c auth v408 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2c4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018bf:[<0x10000001726/4-15.c v408>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018bf:[<0x10000001726/4-15.c v408>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.493 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.366+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001795 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-4.c auth v222 pv463 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:36.815848+0000 b1722 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2c4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001795:[<0x10000001726/13-4.c v222>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001795:[<0x10000001726/13-4.c v222>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.494 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.366+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001781 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-67.c auth v182 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2c5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001781:[<0x10000001726/4-67.c v182>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001781:[<0x10000001726/4-67.c v182>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.494 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.374+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018f2 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-13.c auth v424 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2c5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018f2:[<0x10000001726/6-13.c v424>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018f2:[<0x10000001726/6-13.c v424>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.494 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.382+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001844 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-80.c auth v376 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2cc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001844:[<0x10000001726/4-80.c v376>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001844:[<0x10000001726/4-80.c v376>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.494 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.385+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001834 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-17.c auth v372 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2ccb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001834:[<0x10000001726/19-17.c v372>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001834:[<0x10000001726/19-17.c v372>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.494 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.388+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001800 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-25.c auth v356 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2cd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001800:[<0x10000001726/8-25.c v356>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001800:[<0x10000001726/8-25.c v356>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.494 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.389+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018f6 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-21.c auth v426 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2bb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018f6:[<0x10000001726/1-21.c v426>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018f6:[<0x10000001726/1-21.c v426>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.494 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.392+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001929 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-13.c auth v446 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2cd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001929:[<0x10000001726/23-13.c v446>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001929:[<0x10000001726/23-13.c v446>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.494 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.393+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018d6 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-12.c auth v414 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2cdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018d6:[<0x10000001726/13-12.c v414>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018d6:[<0x10000001726/13-12.c v414>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.495 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.393+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018bd [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-19.c auth v406 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2ba680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018bd:[<0x10000001726/8-19.c v406>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018bd:[<0x10000001726/8-19.c v406>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.495 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.395+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017d8 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-8.c auth v346 pv457 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2005-06-03T16:35:46.000000+0000 b1330 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2cec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017d8:[<0x10000001726/6-8.c v346>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017d8:[<0x10000001726/6-8.c v346>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.495 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.396+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001827 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-8.c auth v366 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2ce680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001827:[<0x10000001726/16-8.c v366>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001827:[<0x10000001726/16-8.c v366>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.495 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.398+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001835 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-24.c auth v374 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2ce100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001835:[<0x10000001726/18-24.c v374>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001835:[<0x10000001726/18-24.c v374>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.495 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.400+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001883 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-22.c auth v396 pv461 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:37.101841+0000 b1672 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2cf700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001883:[<0x10000001726/8-22.c v396>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001883:[<0x10000001726/8-22.c v396>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.495 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.400+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000194a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-2.c auth v452 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2cc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000194a:[<0x10000001726/3-2.c v452>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000194a:[<0x10000001726/3-2.c v452>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.495 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.400+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018d2 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-14.c auth v412 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2d6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018d2:[<0x10000001726/4-14.c v412>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018d2:[<0x10000001726/4-14.c v412>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.495 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.402+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017ce [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-20.c auth v336 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2d7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017ce:[<0x10000001726/13-20.c v336>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017ce:[<0x10000001726/13-20.c v336>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.496 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.402+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018f8 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-1.c auth v428 pv477 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:37.213838+0000 b2450 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2d6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018f8:[<0x10000001726/25-1.c v428>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018f8:[<0x10000001726/25-1.c v428>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.496 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.403+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017ad [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-21.c auth v270 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2d6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017ad:[<0x10000001726/23-21.c v270>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017ad:[<0x10000001726/23-21.c v270>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.496 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.404+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000174c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-6.c auth v76 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2d7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000174c:[<0x10000001726/12-6.c v76>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000174c:[<0x10000001726/12-6.c v76>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.496 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.404+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001822 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-23.c auth v364 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2d8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001822:[<0x10000001726/23-23.c v364>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001822:[<0x10000001726/23-23.c v364>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.497 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.405+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017f6 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-98.c auth v346 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2d9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017f6:[<0x10000001726/4-98.c v346>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017f6:[<0x10000001726/4-98.c v346>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.497 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.406+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017e4 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-13.c auth v352 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2cf180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017e4:[<0x10000001726/16-13.c v352>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017e4:[<0x10000001726/16-13.c v352>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.497 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.407+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018fa [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-5.c auth v430 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2d8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018fa:[<0x10000001726/19-5.c v430>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018fa:[<0x10000001726/19-5.c v430>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.497 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.407+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001938 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-26.c auth v446 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc326000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001938:[<0x10000001726/3-26.c v446>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001938:[<0x10000001726/3-26.c v446>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.498 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.407+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017c9 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-87.c auth v326 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc326580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017c9:[<0x10000001726/4-87.c v326>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017c9:[<0x10000001726/4-87.c v326>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.502 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.408+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000183f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-40.c auth v368 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc327080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000183f:[<0x10000001726/12-40.c v368>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000183f:[<0x10000001726/12-40.c v368>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.502 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.410+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017a9 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-13.c auth v262 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc326b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017a9:[<0x10000001726/8-13.c v262>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017a9:[<0x10000001726/8-13.c v262>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.502 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.410+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000181d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-18.c auth v358 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc327b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000181d:[<0x10000001726/3-18.c v358>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000181d:[<0x10000001726/3-18.c v358>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.502 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.412+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001888 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-23.c auth v396 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc328100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001888:[<0x10000001726/16-23.c v396>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001888:[<0x10000001726/16-23.c v396>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.503 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.413+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001865 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-26.c auth v382 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc328c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001865:[<0x10000001726/25-26.c v382>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001865:[<0x10000001726/25-26.c v382>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.503 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.413+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001770 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-60.c auth v148 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc327600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001770:[<0x10000001726/4-60.c v148>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001770:[<0x10000001726/4-60.c v148>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.503 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.414+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001982 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-13.c auth v204 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc329700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001982:[<0x10000001726/25-13.c v204>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001982:[<0x10000001726/25-13.c v204>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.503 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.416+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001855 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-11.c auth v378 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc329180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001855:[<0x10000001726/28-11.c v378>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001855:[<0x10000001726/28-11.c v378>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.511 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.417+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001793 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-10.c auth v218 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc32a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001793:[<0x10000001726/22-10.c v218>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001793:[<0x10000001726/22-10.c v218>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.511 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.418+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001908 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-13.c auth v422 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc32a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001908:[<0x10000001726/1-13.c v422>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001908:[<0x10000001726/1-13.c v422>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.511 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.419+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001836 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-4.c auth v364 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc32ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001836:[<0x10000001726/19-4.c v364>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001836:[<0x10000001726/19-4.c v364>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.511 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.420+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001815 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-99.c auth v354 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc32b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001815:[<0x10000001726/4-99.c v354>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001815:[<0x10000001726/4-99.c v354>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.511 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.421+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000192f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-11.c auth v444 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc32bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000192f:[<0x10000001726/1-11.c v444>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000192f:[<0x10000001726/1-11.c v444>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.511 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.421+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000190d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-2.c auth v426 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc32b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000190d:[<0x10000001726/18-2.c v426>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000190d:[<0x10000001726/18-2.c v426>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.512 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.422+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000190b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-23.c auth v424 pv467 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:37.231837+0000 b1898 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc32c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000190b:[<0x10000001726/4-23.c v424>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000190b:[<0x10000001726/4-23.c v424>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.512 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.423+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000186d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-18.c auth v384 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc32c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000186d:[<0x10000001726/1-18.c v384>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000186d:[<0x10000001726/1-18.c v384>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.512 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.424+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018f7 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-25.c auth v418 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc32cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018f7:[<0x10000001726/2-25.c v418>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018f7:[<0x10000001726/2-25.c v418>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.512 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.425+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001839 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-15.c auth v366 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc32d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001839:[<0x10000001726/17-15.c v366>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001839:[<0x10000001726/17-15.c v366>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.512 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.425+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000191c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-13.c auth v430 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc32d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000191c:[<0x10000001726/13-13.c v430>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000191c:[<0x10000001726/13-13.c v430>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.512 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.427+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018da [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-23.c auth v406 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc334580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018da:[<0x10000001726/25-23.c v406>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018da:[<0x10000001726/25-23.c v406>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.512 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.428+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018e4 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-3.c auth v412 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc334000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018e4:[<0x10000001726/1-3.c v412>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018e4:[<0x10000001726/1-3.c v412>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.512 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.429+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017cc [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-18.c auth v332 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc334b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017cc:[<0x10000001726/18-18.c v332>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017cc:[<0x10000001726/18-18.c v332>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.512 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.430+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001849 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-21.c auth v374 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc335080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001849:[<0x10000001726/17-21.c v374>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001849:[<0x10000001726/17-21.c v374>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.512 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.431+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000185b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-1.c auth v380 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc335600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000185b:[<0x10000001726/8-1.c v380>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000185b:[<0x10000001726/8-1.c v380>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.513 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.432+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000193b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-15.c auth v448 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc335b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000193b:[<0x10000001726/2-15.c v448>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000193b:[<0x10000001726/2-15.c v448>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.513 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.432+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001783 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-11.c auth v186 pv473 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:36.555855+0000 b4336 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc336100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001783:[<0x10000001726/23-11.c v186>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001783:[<0x10000001726/23-11.c v186>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.513 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.434+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001925 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-10.c auth v436 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc336680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001925:[<0x10000001726/13-10.c v436>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001925:[<0x10000001726/13-10.c v436>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.513 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.434+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001816 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-23.c auth v356 pv457 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:36.995843+0000 b1330 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc336c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001816:[<0x10000001726/6-23.c v356>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001816:[<0x10000001726/6-23.c v356>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.513 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.435+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000175a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-7.c auth v104 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc337180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000175a:[<0x10000001726/19-7.c v104>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000175a:[<0x10000001726/19-7.c v104>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.513 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.436+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001884 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-22.c auth v394 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc337700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001884:[<0x10000001726/2-22.c v394>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001884:[<0x10000001726/2-22.c v394>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.513 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.438+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001927 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-9.c auth v440 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc33e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001927:[<0x10000001726/18-9.c v440>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001927:[<0x10000001726/18-9.c v440>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.513 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.440+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018a8 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-19.c auth v402 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc33eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018a8:[<0x10000001726/25-19.c v402>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018a8:[<0x10000001726/25-19.c v402>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.513 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.440+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001752 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-18.c auth v88 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc33f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001752:[<0x10000001726/23-18.c v88>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001752:[<0x10000001726/23-18.c v88>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.514 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.442+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017b0 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-102.c auth v276 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc33f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017b0:[<0x10000001726/4-102.c v276>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017b0:[<0x10000001726/4-102.c v276>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.514 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.442+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001905 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-15.c auth v420 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc33e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001905:[<0x10000001726/18-15.c v420>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001905:[<0x10000001726/18-15.c v420>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.514 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.444+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001889 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-51.c auth v398 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc33fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001889:[<0x10000001726/4-51.c v398>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001889:[<0x10000001726/4-51.c v398>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.514 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.444+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001846 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-42.c auth v370 pv471 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:37.042842+0000 b1773 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc340680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001846:[<0x10000001726/12-42.c v370>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001846:[<0x10000001726/12-42.c v370>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.514 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.445+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000193d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-20.c auth v450 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc340c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000193d:[<0x10000001726/4-20.c v450>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000193d:[<0x10000001726/4-20.c v450>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.514 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.446+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017b9 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-11.c auth v294 pv475 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:36.855847+0000 b1333 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc341180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017b9:[<0x10000001726/6-11.c v294>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017b9:[<0x10000001726/6-11.c v294>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.514 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.447+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018e5 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-14.c auth v414 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc341700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018e5:[<0x10000001726/19-14.c v414>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018e5:[<0x10000001726/19-14.c v414>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.515 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.447+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001796 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-20.c auth v224 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc340100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001796:[<0x10000001726/3-20.c v224>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001796:[<0x10000001726/3-20.c v224>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.515 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.449+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000189b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-7.c auth v400 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc35a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000189b:[<0x10000001726/23-7.c v400>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000189b:[<0x10000001726/23-7.c v400>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.515 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.449+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001847 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-26.c auth v372 pv463 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:37.043842+0000 b2181 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc35a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001847:[<0x10000001726/17-26.c v372>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001847:[<0x10000001726/17-26.c v372>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.515 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.450+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001944 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-59.c auth v454 pv469 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:37.286836+0000 b902 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc35ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001944:[<0x10000001726/4-59.c v454>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001944:[<0x10000001726/4-59.c v454>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.515 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.451+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001829 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-2.c auth v360 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc35b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001829:[<0x10000001726/23-2.c v360>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001829:[<0x10000001726/23-2.c v360>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.515 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.451+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001926 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-24.c auth v438 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc35b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001926:[<0x10000001726/23-24.c v438>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001926:[<0x10000001726/23-24.c v438>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.515 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.451+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018e7 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-32.c auth v416 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc35bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018e7:[<0x10000001726/12-32.c v416>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018e7:[<0x10000001726/12-32.c v416>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.515 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.452+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018dd [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-12.c auth v408 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc35c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018dd:[<0x10000001726/1-12.c v408>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018dd:[<0x10000001726/1-12.c v408>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.515 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.452+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001943 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-6.c auth v452 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc35c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001943:[<0x10000001726/8-6.c v452>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001943:[<0x10000001726/8-6.c v452>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.515 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.453+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001797 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-37.c auth v226 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc35d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001797:[<0x10000001726/12-37.c v226>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001797:[<0x10000001726/12-37.c v226>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.516 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.453+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000192d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-14.c auth v442 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc35cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000192d:[<0x10000001726/13-14.c v442>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000192d:[<0x10000001726/13-14.c v442>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.516 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.454+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000191b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-6.c auth v428 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc35d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000191b:[<0x10000001726/25-6.c v428>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000191b:[<0x10000001726/25-6.c v428>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.516 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.456+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001853 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-3.c auth v376 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc364000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001853:[<0x10000001726/22-3.c v376>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001853:[<0x10000001726/22-3.c v376>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.516 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.456+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001876 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-38.c auth v386 pv465 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:37.088841+0000 b1773 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc364580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001876:[<0x10000001726/12-38.c v386>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001876:[<0x10000001726/12-38.c v386>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.516 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.457+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001808 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-10.c auth v352 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc364b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001808:[<0x10000001726/16-10.c v352>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001808:[<0x10000001726/16-10.c v352>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.516 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.458+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017c0 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-16.c auth v308 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc365080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017c0:[<0x10000001726/28-16.c v308>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017c0:[<0x10000001726/28-16.c v308>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.516 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.459+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018e0 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-1.c auth v410 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc365600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018e0:[<0x10000001726/4-1.c v410>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018e0:[<0x10000001726/4-1.c v410>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.516 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.460+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001924 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-3.c auth v434 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc366100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001924:[<0x10000001726/3-3.c v434>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001924:[<0x10000001726/3-3.c v434>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.516 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.461+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017ca [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-15.c auth v328 pv461 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:36.872847+0000 b4336 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc365b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017ca:[<0x10000001726/23-15.c v328>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017ca:[<0x10000001726/23-15.c v328>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.516 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.461+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000187c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-8.c auth v390 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc366680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000187c:[<0x10000001726/22-8.c v390>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000187c:[<0x10000001726/22-8.c v390>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.516 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.462+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001772 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-15.c auth v152 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc366c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001772:[<0x10000001726/16-15.c v152>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001772:[<0x10000001726/16-15.c v152>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.517 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.466+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001880 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-17.c auth v392 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc367180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001880:[<0x10000001726/12-17.c v392>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001880:[<0x10000001726/12-17.c v392>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.517 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.467+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001769 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-5.c auth v134 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc367700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001769:[<0x10000001726/28-5.c v134>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001769:[<0x10000001726/28-5.c v134>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.517 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.468+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001782 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-26.c auth v184 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc370000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001782:[<0x10000001726/19-26.c v184>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001782:[<0x10000001726/19-26.c v184>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.517 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.468+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017af [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-7.c auth v274 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc370580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017af:[<0x10000001726/13-7.c v274>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017af:[<0x10000001726/13-7.c v274>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.517 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.470+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001728 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-3.c auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc370b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001728:[<0x10000001726/8-3.c v4>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001728:[<0x10000001726/8-3.c v4>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.517 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.471+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001794 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-29.c auth v220 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc371080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001794:[<0x10000001726/12-29.c v220>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001794:[<0x10000001726/12-29.c v220>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.517 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.471+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017f8 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-2.c auth v348 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc371600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017f8:[<0x10000001726/25-2.c v348>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017f8:[<0x10000001726/25-2.c v348>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.517 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.472+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000191e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-11.c auth v432 pv487 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:37.249837+0000 b2450 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc371b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000191e:[<0x10000001726/25-11.c v432>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000191e:[<0x10000001726/25-11.c v432>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.518 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.474+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001805 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-1.c auth v350 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc372680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001805:[<0x10000001726/2-1.c v350>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001805:[<0x10000001726/2-1.c v350>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.518 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.475+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000182a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-12.c auth v362 pv459 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:37.015843+0000 b1681 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc372c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000182a:[<0x10000001726/8-12.c v362>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000182a:[<0x10000001726/8-12.c v362>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.518 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.476+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017d5 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-19.c auth v344 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc373180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017d5:[<0x10000001726/12-19.c v344>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017d5:[<0x10000001726/12-19.c v344>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.518 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.477+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000174e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-14.c auth v80 pv471 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:36.506856+0000 b1681 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc373700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000174e:[<0x10000001726/8-14.c v80>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000174e:[<0x10000001726/8-14.c v80>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.518 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.479+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001928 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-8.c auth v434 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc384000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001928:[<0x10000001726/2-8.c v434>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001928:[<0x10000001726/2-8.c v434>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.518 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.480+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001949 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-16.c auth v450 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc384580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001949:[<0x10000001726/8-16.c v450>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001949:[<0x10000001726/8-16.c v450>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.518 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.481+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000190e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-73.c auth v430 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc384b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000190e:[<0x10000001726/4-73.c v430>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000190e:[<0x10000001726/4-73.c v430>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.518 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.482+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001913 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-19.c auth v432 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc385080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001913:[<0x10000001726/6-19.c v432>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001913:[<0x10000001726/6-19.c v432>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.518 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.483+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001825 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-1.c auth v374 pv473 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:37.010843+0000 b1476 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc385600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001825:[<0x10000001726/1-1.c v374>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001825:[<0x10000001726/1-1.c v374>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.518 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.486+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000183c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-12.c auth v380 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc385b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000183c:[<0x10000001726/28-12.c v380>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000183c:[<0x10000001726/28-12.c v380>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.518 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.487+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000177f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-6.c auth v178 pv463 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:36.552855+0000 b6203 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc386100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000177f:[<0x10000001726/28-6.c v178>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000177f:[<0x10000001726/28-6.c v178>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.519 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.488+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001759 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-15.c auth v102 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc386680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001759:[<0x10000001726/6-15.c v102>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001759:[<0x10000001726/6-15.c v102>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.519 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.490+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017aa [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-14.c auth v264 pv455 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:36.839847+0000 b2501 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc386c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017aa:[<0x10000001726/22-14.c v264>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017aa:[<0x10000001726/22-14.c v264>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.519 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.491+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018cb [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-8.c auth v414 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc387180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018cb:[<0x10000001726/12-8.c v414>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018cb:[<0x10000001726/12-8.c v414>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.519 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.495+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018f5 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-17.c auth v422 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc387700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018f5:[<0x10000001726/2-17.c v422>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018f5:[<0x10000001726/2-17.c v422>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.519 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.496+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000193c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-24.c auth v442 pv483 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:37.279836+0000 b1728 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc38e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000193c:[<0x10000001726/13-24.c v442>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000193c:[<0x10000001726/13-24.c v442>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.519 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.498+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018b0 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-33.c auth v404 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc38e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018b0:[<0x10000001726/12-33.c v404>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018b0:[<0x10000001726/12-33.c v404>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.519 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.499+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017ba [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-6.c auth v296 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc38eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017ba:[<0x10000001726/6-6.c v296>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017ba:[<0x10000001726/6-6.c v296>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.851 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.500+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000183a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-25.c auth v378 pv457 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:37.030842+0000 b4336 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc38f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000183a:[<0x10000001726/23-25.c v378>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000183a:[<0x10000001726/23-25.c v378>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.851 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.501+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017b1 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-26.c auth v278 pv465 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:36.847847+0000 b3873 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc38f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017b1:[<0x10000001726/18-26.c v278>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017b1:[<0x10000001726/18-26.c v278>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.851 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.502+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000175d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-45.c auth v110 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc38fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000175d:[<0x10000001726/4-45.c v110>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000175d:[<0x10000001726/4-45.c v110>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.851 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.503+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001765 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-18.c auth v126 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc390100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001765:[<0x10000001726/25-18.c v126>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001765:[<0x10000001726/25-18.c v126>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.852 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.504+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000186b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-16.c auth v386 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc390680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000186b:[<0x10000001726/18-16.c v386>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000186b:[<0x10000001726/18-16.c v386>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.852 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.505+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000178a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-11.c auth v200 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc390c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000178a:[<0x10000001726/12-11.c v200>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000178a:[<0x10000001726/12-11.c v200>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.852 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.506+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000172f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-7.c auth v18 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc391180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000172f:[<0x10000001726/16-7.c v18>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000172f:[<0x10000001726/16-7.c v18>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.852 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.507+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017fd [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-23.c auth v362 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc391700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017fd:[<0x10000001726/13-23.c v362>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017fd:[<0x10000001726/13-23.c v362>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.852 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.508+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001845 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-20.c auth v382 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc398000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001845:[<0x10000001726/22-20.c v382>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001845:[<0x10000001726/22-20.c v382>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.852 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.509+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001820 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-23.c auth v372 pv479 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:37.005843+0000 b3868 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc398580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001820:[<0x10000001726/18-23.c v372>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001820:[<0x10000001726/18-23.c v372>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.852 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.510+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017db [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-2.c auth v348 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc398b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017db:[<0x10000001726/13-2.c v348>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017db:[<0x10000001726/13-2.c v348>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.852 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.511+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001937 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-21.c auth v440 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc399080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001937:[<0x10000001726/3-21.c v440>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001937:[<0x10000001726/3-21.c v440>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.852 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.512+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001788 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-10.c auth v196 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc399600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001788:[<0x10000001726/2-10.c v196>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001788:[<0x10000001726/2-10.c v196>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.852 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.513+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001873 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-7.c auth v390 pv477 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:37.085841+0000 b1520 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc399b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001873:[<0x10000001726/3-7.c v390>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001873:[<0x10000001726/3-7.c v390>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.855 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.514+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001758 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-4.c auth v100 pv481 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:36.515856+0000 b2501 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc39a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001758:[<0x10000001726/22-4.c v100>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001758:[<0x10000001726/22-4.c v100>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.855 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.515+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018c4 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-17.c auth v412 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc39a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018c4:[<0x10000001726/1-17.c v412>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018c4:[<0x10000001726/1-17.c v412>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.856 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.516+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017c6 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-3.c auth v320 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc39ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017c6:[<0x10000001726/17-3.c v320>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017c6:[<0x10000001726/17-3.c v320>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.856 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.517+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018b2 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-2.c auth v406 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc39b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018b2:[<0x10000001726/2-2.c v406>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018b2:[<0x10000001726/2-2.c v406>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.856 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.519+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017f0 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-33.c auth v358 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc39b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017f0:[<0x10000001726/4-33.c v358>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017f0:[<0x10000001726/4-33.c v358>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.856 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.519+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000189e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-13.c auth v400 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3a2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000189e:[<0x10000001726/12-13.c v400>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000189e:[<0x10000001726/12-13.c v400>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.856 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.520+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017da [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-26.c auth v346 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3a2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017da:[<0x10000001726/6-26.c v346>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017da:[<0x10000001726/6-26.c v346>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.856 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.521+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017e5 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-23.c auth v354 pv489 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:36.948845+0000 b4217 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3a2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017e5:[<0x10000001726/19-23.c v354>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017e5:[<0x10000001726/19-23.c v354>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.856 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.522+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018a9 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-38.c auth v402 pv491 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2005-06-03T16:35:29.000000+0000 b1989 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3a3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018a9:[<0x10000001726/4-38.c v402>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018a9:[<0x10000001726/4-38.c v402>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.856 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.523+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001867 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-20.c auth v388 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2b9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001867:[<0x10000001726/2-20.c v388>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001867:[<0x10000001726/2-20.c v388>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.856 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.523+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000178d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-22.c auth v206 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc2d7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000178d:[<0x10000001726/13-22.c v206>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000178d:[<0x10000001726/13-22.c v206>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.856 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.524+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001933 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-64.c auth v438 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3a3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001933:[<0x10000001726/4-64.c v438>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001933:[<0x10000001726/4-64.c v438>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.856 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.524+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000187a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-10.c auth v388 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc328680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000187a:[<0x10000001726/1-10.c v388>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000187a:[<0x10000001726/1-10.c v388>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.856 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.525+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018d9 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-15.c auth v404 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc372100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018d9:[<0x10000001726/12-15.c v404>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018d9:[<0x10000001726/12-15.c v404>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.857 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.526+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000190a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-6.c auth v426 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3a3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000190a:[<0x10000001726/19-6.c v426>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000190a:[<0x10000001726/19-6.c v426>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.857 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.526+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001874 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-11.c auth v392 pv475 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:37.086841+0000 b2501 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3a4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001874:[<0x10000001726/22-11.c v392>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001874:[<0x10000001726/22-11.c v392>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.857 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.527+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017dd [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-10.c auth v352 pv499 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:36.941845+0000 b2007 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3a4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017dd:[<0x10000001726/12-10.c v352>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017dd:[<0x10000001726/12-10.c v352>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.857 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.528+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018ba [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-7.c auth v410 pv493 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:37.154839+0000 b2492 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3a4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018ba:[<0x10000001726/22-7.c v410>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018ba:[<0x10000001726/22-7.c v410>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.857 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.528+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017cd [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/coverage.txt auth v334 pv467 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:36.875846+0000 b459 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3a5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017cd:[<0x10000001726/coverage.txt v334>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017cd:[<0x10000001726/coverage.txt v334>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.857 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.529+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001775 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-5.c auth v158 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3a5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001775:[<0x10000001726/12-5.c v158>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001775:[<0x10000001726/12-5.c v158>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.857 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.530+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018fd [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-19.c auth v424 pv461 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:37.218838+0000 b4222 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3ac000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018fd:[<0x10000001726/19-19.c v424>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018fd:[<0x10000001726/19-19.c v424>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.857 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.531+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017b4 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-8.c auth v284 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3ac580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017b4:[<0x10000001726/4-8.c v284>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017b4:[<0x10000001726/4-8.c v284>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.857 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.532+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001763 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-24.c auth v122 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3acb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001763:[<0x10000001726/1-24.c v122>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001763:[<0x10000001726/1-24.c v122>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.857 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.532+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001946 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-14.c auth v448 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3ad080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001946:[<0x10000001726/1-14.c v448>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001946:[<0x10000001726/1-14.c v448>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.857 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.533+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000188a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-8.c auth v396 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3ad600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000188a:[<0x10000001726/8-8.c v396>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000188a:[<0x10000001726/8-8.c v396>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.857 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.534+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000194b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-17.c auth v452 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3adb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000194b:[<0x10000001726/28-17.c v452>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000194b:[<0x10000001726/28-17.c v452>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.858 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.535+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018eb [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-7.c auth v418 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3ae100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018eb:[<0x10000001726/18-7.c v418>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018eb:[<0x10000001726/18-7.c v418>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.858 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.536+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000186c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-7.c auth v388 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3ae680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000186c:[<0x10000001726/2-7.c v388>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000186c:[<0x10000001726/2-7.c v388>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.858 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.536+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018f3 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-4.c auth v420 pv495 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:37.208838+0000 b1476 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3aec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018f3:[<0x10000001726/1-4.c v420>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018f3:[<0x10000001726/1-4.c v420>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.858 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.537+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000174f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-89.c auth v82 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3af180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000174f:[<0x10000001726/4-89.c v82>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000174f:[<0x10000001726/4-89.c v82>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.858 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.538+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001802 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/testfrmw.h auth v364 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3af700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001802:[<0x10000001726/testfrmw.h v364>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001802:[<0x10000001726/testfrmw.h v364>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.858 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.538+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017d4 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-4.c auth v344 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc05b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017d4:[<0x10000001726/6-4.c v344>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017d4:[<0x10000001726/6-4.c v344>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.858 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.539+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000193f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-19.c auth v444 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3b6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000193f:[<0x10000001726/2-19.c v444>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000193f:[<0x10000001726/2-19.c v444>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.858 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.540+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001945 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-66.c auth v446 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3b6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001945:[<0x10000001726/4-66.c v446>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001945:[<0x10000001726/4-66.c v446>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.858 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.541+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000190c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-5.c auth v428 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3b6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000190c:[<0x10000001726/25-5.c v428>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000190c:[<0x10000001726/25-5.c v428>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.858 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.542+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001850 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-11.c auth v384 pv459 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:37.052842+0000 b1525 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3b7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001850:[<0x10000001726/3-11.c v384>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001850:[<0x10000001726/3-11.c v384>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.858 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.543+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001838 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-101.c auth v376 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3b7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001838:[<0x10000001726/4-101.c v376>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001838:[<0x10000001726/4-101.c v376>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.858 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.543+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001887 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-7.c auth v394 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3b7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001887:[<0x10000001726/8-7.c v394>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001887:[<0x10000001726/8-7.c v394>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.859 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.544+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001813 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-17.c auth v368 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3b8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001813:[<0x10000001726/8-17.c v368>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001813:[<0x10000001726/8-17.c v368>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.859 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.545+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018b6 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-18.c auth v408 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3b8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018b6:[<0x10000001726/16-18.c v408>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018b6:[<0x10000001726/16-18.c v408>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.859 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.545+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018e9 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-13.c auth v416 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3b8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018e9:[<0x10000001726/19-13.c v416>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000018e9:[<0x10000001726/19-13.c v416>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.859 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.546+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000192e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-20.c auth v436 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3b9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000192e:[<0x10000001726/25-20.c v436>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000192e:[<0x10000001726/25-20.c v436>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.859 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.546+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017f2 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-4.c auth v360 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3b9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017f2:[<0x10000001726/17-4.c v360>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017f2:[<0x10000001726/17-4.c v360>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.859 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.547+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017ea [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-3.c auth v356 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3be000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017ea:[<0x10000001726/28-3.c v356>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017ea:[<0x10000001726/28-3.c v356>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.859 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.548+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000188b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-16.c auth v398 pv485 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:37.109840+0000 b1525 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3be580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000188b:[<0x10000001726/3-16.c v398>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000188b:[<0x10000001726/3-16.c v398>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.859 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.549+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000180c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-4.c auth v366 pv487 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:36.986844+0000 b2007 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3beb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000180c:[<0x10000001726/12-4.c v366>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000180c:[<0x10000001726/12-4.c v366>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.859 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.549+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017dc [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-9.c auth v350 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3bf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017dc:[<0x10000001726/28-9.c v350>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017dc:[<0x10000001726/28-9.c v350>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.859 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.550+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000181e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-9.c auth v370 pv469 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:37.003843+0000 b2441 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3bf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000181e:[<0x10000001726/25-9.c v370>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000181e:[<0x10000001726/25-9.c v370>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.859 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.550+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017be [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-17.c auth v304 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3bfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017be:[<0x10000001726/18-17.c v304>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000017be:[<0x10000001726/18-17.c v304>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:45.860 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.551+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001755 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-20.c auth v94 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24895=0-4194304@1} caps={24895=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24895 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc3c0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001755:[<0x10000001726/17-20.c v94>,<0x10000001414/sigaction v2612>,<0x100000012ed/interfaces v264>,<0x100000012e9/conformance v16>,<0x10000000204/open_posix_testsuite v303>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001755:[<0x10000001726/17-20.c v94>,<0x10000001414/sigaction v4453>,<0x100000012ed/interfaces v457>,<0x100000012e9/conformance v123>,<0x10000000204/open_posix_testsuite v409>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.089 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.912+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fde [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/watchdog/watchdog.c auth{0=1} v2 pv16 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.081920+0000 b18760 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc442680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fde:[<0x10000000fdd/watchdog.c v2>,<0x10000000fba/watchdog v72>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fde:[<0x10000000fdd/watchdog.c v2>,<0x10000000fba/watchdog v72>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.090 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.913+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fe0 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/watchdog/Makefile.in auth{0=1} v6 pv10 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.083920+0000 b18246 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc442c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fe0:[<0x10000000fdd/Makefile.in v6>,<0x10000000fba/watchdog v72>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fe0:[<0x10000000fdd/Makefile.in v6>,<0x10000000fba/watchdog v72>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.090 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:46.090 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:46.090 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:46.090 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:46.090 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:46.090 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:46.090 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:46.091 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001338 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.091 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000136e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/38-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.091 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001350 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/sigmacrolist.txt) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.091 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000135f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/31-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.091 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001370 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/34-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.091 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013a8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.091 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001387 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-37.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.091 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001392 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.091 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013d3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.091 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013cc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.091 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000012f3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.091 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001331 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.092 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.913+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fe1 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/watchdog/Makefile.am auth{0=1} v8 pv14 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2008-07-26T03:51:48.000000+0000 b1832 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc443180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fe1:[<0x10000000fdd/Makefile.am v8>,<0x10000000fba/watchdog v72>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fe1:[<0x10000000fdd/Makefile.am v8>,<0x10000000fba/watchdog v72>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.092 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.914+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fdf [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/watchdog/README auth{0=1} v4 pv12 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.082920+0000 b505 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc443700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fdf:[<0x10000000fdd/README v4>,<0x10000000fba/watchdog v72>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fdf:[<0x10000000fdd/README v4>,<0x10000000fba/watchdog v72>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.092 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.914+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010cb [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_fumi.h auth{0=1} v26 pv166 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.313914+0000 b4923 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc44e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010cb:[<0x100000010be/oa_soap_fumi.h v26>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010cb:[<0x100000010be/oa_soap_fumi.h v26>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.092 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.968+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ea [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_reset.c auth{0=1} v88 pv178 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.344913+0000 b11538 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc44e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010ea:[<0x100000010be/oa_soap_reset.c v88>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010ea:[<0x100000010be/oa_soap_reset.c v88>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.092 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.968+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010c2 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_enclosure_event.h auth{0=1} v8 pv164 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2009-01-19T07:36:21.000000+0000 b1948 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc44eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010c2:[<0x100000010be/oa_soap_enclosure_event.h v8>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010c2:[<0x100000010be/oa_soap_enclosure_event.h v8>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.092 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.969+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010db [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_resources.h auth{0=1} v58 pv210 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.330913+0000 b4393 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc44f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010db:[<0x100000010be/oa_soap_resources.h v58>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010db:[<0x100000010be/oa_soap_resources.h v58>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.093 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001300 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.093 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000012ef (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/unistd_h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.093 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000138e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-26.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.093 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000133f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-38.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.093 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001355 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-18.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.093 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000137e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.093 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000137a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/2-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.093 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001373 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-29.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.093 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000134f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-32.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.093 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001376 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/29-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.093 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001341 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/20-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.093 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001391 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/2-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.094 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000137c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/13-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.094 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001385 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/36-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.094 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.969+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ef [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_control.c auth{0=1} v98 pv208 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.348913+0000 b31262 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc44f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010ef:[<0x100000010be/oa_soap_control.c v98>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010ef:[<0x100000010be/oa_soap_control.c v98>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.094 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.969+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f5 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_event.c auth{0=1} v110 pv134 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2009-12-03T15:31:00.000000+0000 b58192 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc44fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f5:[<0x100000010be/oa_soap_event.c v110>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010f5:[<0x100000010be/oa_soap_event.c v110>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.094 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.970+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010dd [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_power.h auth{0=1} v62 pv218 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.332913+0000 b3174 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc450100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010dd:[<0x100000010be/oa_soap_power.h v62>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010dd:[<0x100000010be/oa_soap_power.h v62>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.094 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.971+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010c8 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_sensor.c auth{0=1} v20 pv188 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.310914+0000 b100635 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc450680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010c8:[<0x100000010be/oa_soap_sensor.c v20>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010c8:[<0x100000010be/oa_soap_sensor.c v20>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.095 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000133e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-15.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.095 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001363 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/45-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.095 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001384 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-22.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.095 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000134a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/23-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.095 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001345 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-35.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.095 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001375 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-5.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.095 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001360 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/15-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.095 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001359 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-24.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.095 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001348 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-31.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.095 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001389 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/48-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.095 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000136c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/43-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.095 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000135b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.095 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001349 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.096 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000133c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.096 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.971+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010c1 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_callsupport.h auth{0=1} v6 pv132 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2008-11-20T11:32:27.000000+0000 b9458 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc450c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010c1:[<0x100000010be/oa_soap_callsupport.h v6>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010c1:[<0x100000010be/oa_soap_callsupport.h v6>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.096 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.972+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f0 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_resources.c auth{0=1} v100 pv172 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.350913+0000 b222491 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc451180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f0:[<0x100000010be/oa_soap_resources.c v100>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010f0:[<0x100000010be/oa_soap_resources.c v100>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.096 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001364 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-36.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.096 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001366 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-20.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.096 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000133b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/27-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.096 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001356 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/14-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.097 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001383 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-34.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.097 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001378 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/2-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.097 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000136d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.097 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001379 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.097 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000134e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/coverage.txt) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.097 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001347 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/40-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.097 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000134c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/24-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.097 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001343 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/47-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.097 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001344 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/39-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.097 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001346 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-10.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.098 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.972+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010c6 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_discover.c auth{0=1} v16 pv120 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.308914+0000 b149563 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc451700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010c6:[<0x100000010be/oa_soap_discover.c v16>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010c6:[<0x100000010be/oa_soap_discover.c v16>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.098 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.973+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010e7 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_event.h auth{0=1} v82 pv136 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2009-04-17T10:52:57.000000+0000 b2502 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc458000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010e7:[<0x100000010be/oa_soap_event.h v82>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010e7:[<0x100000010be/oa_soap_event.h v82>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.098 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.974+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010bf [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_re_discover.h auth{0=1} v2 pv128 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.300914+0000 b4424 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc458580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010bf:[<0x100000010be/oa_soap_re_discover.h v2>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010bf:[<0x100000010be/oa_soap_re_discover.h v2>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.098 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.974+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010d8 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_re_discover.c auth{0=1} v52 pv186 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.327913+0000 b104327 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc458b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010d8:[<0x100000010be/oa_soap_re_discover.c v52>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010d8:[<0x100000010be/oa_soap_re_discover.c v52>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.098 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.974+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010c4 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_server_event.h auth{0=1} v12 pv140 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.305914+0000 b3545 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc459080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010c4:[<0x100000010be/oa_soap_server_event.h v12>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010c4:[<0x100000010be/oa_soap_server_event.h v12>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.098 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001361 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/35-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.098 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001372 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/50-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.098 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000136b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-33.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.098 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000138d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-39.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.099 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001382 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/4-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.099 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001371 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-8.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.099 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001368 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.099 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001381 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/26-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.099 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001357 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.099 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000133a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/37-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.099 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000135c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/42-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.099 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000133d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/3-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.099 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000135a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-25.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.099 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.975+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010d0 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_interconnect_event.c auth{0=1} v36 pv196 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.318913+0000 b30916 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc459600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010d0:[<0x100000010be/oa_soap_interconnect_event.c v36>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010d0:[<0x100000010be/oa_soap_interconnect_event.c v36>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.100 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.976+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f4 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_ps_event.h auth{0=1} v108 pv162 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2009-01-19T07:36:21.000000+0000 b2377 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc459b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f4:[<0x100000010be/oa_soap_ps_event.h v108>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010f4:[<0x100000010be/oa_soap_ps_event.h v108>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001365 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-27.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001380 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-19.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001358 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/5-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001390 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-40.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000136a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-21.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000137d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-6.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000138b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001351 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/18-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001362 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/44-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000134d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001352 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/make22tests) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000135d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-17.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001342 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/41-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000138c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/17-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.101 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.976+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ee [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_oa_event.c auth{0=1} v96 pv224 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.347913+0000 b18753 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc45a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010ee:[<0x100000010be/oa_soap_oa_event.c v96>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010ee:[<0x100000010be/oa_soap_oa_event.c v96>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.101 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.977+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010d4 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_ps_event.c auth{0=1} v44 pv170 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.324913+0000 b9482 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc45a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010d4:[<0x100000010be/oa_soap_ps_event.c v44>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010d4:[<0x100000010be/oa_soap_ps_event.c v44>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.101 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.977+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010cf [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_fan_event.h auth{0=1} v34 pv182 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.317914+0000 b2462 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc45ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010cf:[<0x100000010be/oa_soap_fan_event.h v34>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010cf:[<0x100000010be/oa_soap_fan_event.h v34>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.102 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.978+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010df [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_control.h auth{0=1} v66 pv126 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2009-01-19T07:36:20.000000+0000 b2932 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc45b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010df:[<0x100000010be/oa_soap_control.h v66>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010df:[<0x100000010be/oa_soap_control.h v66>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.102 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001386 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/25-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.102 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000137b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-30.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.102 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001367 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-16.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.102 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001388 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/30-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.102 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001377 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-12.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.102 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001340 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-28.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.102 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000137f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/49-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.102 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001353 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/33-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.103 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001369 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/46-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.103 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001354 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/28-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.103 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000138a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/16-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.103 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000138f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-23.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.103 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001339 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-9.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.103 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000135e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/32-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.103 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.978+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010e9 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_utils.c auth{0=1} v86 pv146 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.343913+0000 b55083 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc45b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010e9:[<0x100000010be/oa_soap_utils.c v86>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010e9:[<0x100000010be/oa_soap_utils.c v86>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.103 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.979+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010eb [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_annunciator.c auth{0=1} v90 pv176 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.345913+0000 b10671 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc464000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010eb:[<0x100000010be/oa_soap_annunciator.c v90>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010eb:[<0x100000010be/oa_soap_annunciator.c v90>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.104 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.980+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010e6 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_sensor.h auth{0=1} v80 pv206 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.340913+0000 b14347 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc464580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010e6:[<0x100000010be/oa_soap_sensor.h v80>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010e6:[<0x100000010be/oa_soap_sensor.h v80>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.104 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.980+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010d1 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_inventory.h auth{0=1} v38 pv200 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.320913+0000 b12732 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc464b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010d1:[<0x100000010be/oa_soap_inventory.h v38>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010d1:[<0x100000010be/oa_soap_inventory.h v38>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.104 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000136f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/assertions.xml) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.104 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000134b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/19-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.104 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001374 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/21-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.104 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000012f1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/unistd_h/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.104 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000012f0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/unistd_h/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.104 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000012f2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/unistd_h/assertions.xml) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.104 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000131c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/34-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.104 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001315 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/31-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.104 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000131e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/7-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.105 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001322 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/22-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.105 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001330 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/35-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.105 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001320 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/29-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.105 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001326 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/3-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.105 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001321 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/13-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.105 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.981+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010cd [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_fumi.c auth{0=1} v30 pv184 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.315914+0000 b15726 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc465080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010cd:[<0x100000010be/oa_soap_fumi.c v30>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010cd:[<0x100000010be/oa_soap_fumi.c v30>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.105 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.981+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010d3 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_watchdog.h auth{0=1} v42 pv148 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.323913+0000 b2445 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc465600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010d3:[<0x100000010be/oa_soap_watchdog.h v42>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010d3:[<0x100000010be/oa_soap_watchdog.h v42>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.105 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.982+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f2 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_hotswap.c auth{0=1} v104 pv214 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.352913+0000 b18809 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc465b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f2:[<0x100000010be/oa_soap_hotswap.c v104>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010f2:[<0x100000010be/oa_soap_hotswap.c v104>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.106 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001306 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/23-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.106 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001318 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/15-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.106 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001304 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/20-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.106 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000131d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/12-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.106 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001316 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/7-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.106 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001301 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/27-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.106 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000130f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/14-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.106 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001313 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.106 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000130a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/coverage.txt) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.106 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000130c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/35-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.106 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001308 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/24-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.106 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001319 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/35-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.106 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000131a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/8-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.107 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001324 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/4-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.107 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.982+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ed [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_dimi.c auth{0=1} v94 pv152 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2008-07-26T04:41:36.000000+0000 b10851 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc466100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010ed:[<0x100000010be/oa_soap_dimi.c v94>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010ed:[<0x100000010be/oa_soap_dimi.c v94>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.107 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.983+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010e3 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/Makefile.in auth{0=1} v74 pv204 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.337913+0000 b23575 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc466680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010e3:[<0x100000010be/Makefile.in v74>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010e3:[<0x100000010be/Makefile.in v74>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.107 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.984+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010c3 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_calls.h auth{0=1} v10 pv122 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.304914+0000 b60071 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc466c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010c3:[<0x100000010be/oa_soap_calls.h v10>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010c3:[<0x100000010be/oa_soap_calls.h v10>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.107 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.984+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010e5 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_annunciator.h auth{0=1} v78 pv160 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.339913+0000 b3723 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc467180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010e5:[<0x100000010be/oa_soap_annunciator.h v78>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010e5:[<0x100000010be/oa_soap_annunciator.h v78>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.108 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000132c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/3-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.108 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001317 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/7-5.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.108 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001323 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/26-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.108 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001310 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.108 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001309 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/6-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.108 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001312 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/6-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.108 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001302 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/3-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.108 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000132a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/7-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.108 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001305 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/10-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.108 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001311 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/5-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.108 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000130b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/18-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.108 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001303 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/9-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.108 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001329 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/11-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.108 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000132b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/17-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.109 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.984+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010d2 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_power.c auth{0=1} v40 pv114 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.322913+0000 b20879 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc467700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010d2:[<0x100000010be/oa_soap_power.c v40>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010d2:[<0x100000010be/oa_soap_power.c v40>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.109 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.985+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010e4 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_load_id.h auth{0=1} v76 pv116 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.338913+0000 b2134 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc46c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010e4:[<0x100000010be/oa_soap_load_id.h v76>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010e4:[<0x100000010be/oa_soap_load_id.h v76>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.109 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.986+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010dc [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_oa_event.h auth{0=1} v60 pv192 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.331913+0000 b2462 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc46c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010dc:[<0x100000010be/oa_soap_oa_event.h v60>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010dc:[<0x100000010be/oa_soap_oa_event.h v60>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.109 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.986+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ca [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_watchdog.c auth{0=1} v24 pv150 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.312914+0000 b4695 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc46cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010ca:[<0x100000010be/oa_soap_watchdog.c v24>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010ca:[<0x100000010be/oa_soap_watchdog.c v24>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.109 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000132d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/6-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.109 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000132f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/3-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.110 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001325 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/25-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.110 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001327 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/30-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.110 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001328 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/16-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.110 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000130d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/33-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.110 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000130e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/28-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.110 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001314 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/32-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.110 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000131b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/assertions.xml) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.110 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001307 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/19-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.110 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000131f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/21-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.110 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001333 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/1-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.110 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001335 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.110 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000132e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/7-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.111 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.987+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f3 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/Makefile.am auth{0=1} v106 pv174 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.353913+0000 b4555 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc46d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f3:[<0x100000010be/Makefile.am v106>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010f3:[<0x100000010be/Makefile.am v106>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.111 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.987+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010e8 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_inventory.c auth{0=1} v84 pv216 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.342913+0000 b167062 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc46d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010e8:[<0x100000010be/oa_soap_inventory.c v84>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010e8:[<0x100000010be/oa_soap_inventory.c v84>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.111 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.988+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010da [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_hotswap.h auth{0=1} v56 pv202 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.329913+0000 b3709 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc46db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010da:[<0x100000010be/oa_soap_hotswap.h v56>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010da:[<0x100000010be/oa_soap_hotswap.h v56>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.111 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.988+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010e0 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_callsupport.c auth{0=1} v68 pv180 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.334913+0000 b42506 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc46e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010e0:[<0x100000010be/oa_soap_callsupport.c v68>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010e0:[<0x100000010be/oa_soap_callsupport.c v68>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.111 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.989+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010cc [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_lcd_event.c auth{0=1} v28 pv220 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.314914+0000 b3636 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc46e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010cc:[<0x100000010be/oa_soap_lcd_event.c v28>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010cc:[<0x100000010be/oa_soap_lcd_event.c v28>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.111 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.989+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010d9 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_interconnect_event.h auth{0=1} v54 pv158 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.328913+0000 b2925 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc46ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010d9:[<0x100000010be/oa_soap_interconnect_event.h v54>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010d9:[<0x100000010be/oa_soap_interconnect_event.h v54>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.112 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001337 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/4-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.112 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001334 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.112 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001332 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/3-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.112 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001336 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/assertions.xml) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.112 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000012fd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/7-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.112 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000012fa (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.112 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000012fb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/8-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.112 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000012fe (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/4-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.112 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000012f7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.112 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000012f9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/6-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.112 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000012f4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/3-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.113 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000012f8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/5-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.113 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000012f6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/10-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.113 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000012f5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/9-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.113 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.990+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f1 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_fan_event.c auth{0=1} v102 pv194 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.351913+0000 b9142 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc46f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f1:[<0x100000010be/oa_soap_fan_event.c v102>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010f1:[<0x100000010be/oa_soap_fan_event.c v102>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.113 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.990+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010de [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_enclosure_event.c auth{0=1} v64 pv138 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2009-01-19T07:36:20.000000+0000 b3838 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc46f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010de:[<0x100000010be/oa_soap_enclosure_event.c v64>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010de:[<0x100000010be/oa_soap_enclosure_event.c v64>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.113 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.991+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010c5 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_sel.h auth{0=1} v14 pv190 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.306914+0000 b3105 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc47a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010c5:[<0x100000010be/oa_soap_sel.h v14>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010c5:[<0x100000010be/oa_soap_sel.h v14>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.113 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000012ff (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/11-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.114 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000012fc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/assertions.xml) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.114 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013cf (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.114 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013d1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/4-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.114 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013cd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/3-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.114 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013d2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/3-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.114 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013ce (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.114 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013d0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/assertions.xml) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.114 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000139d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/15-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.114 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013a2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/13-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.114 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013a0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/12-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.114 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001399 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/8-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.114 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000139a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/14-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.114 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000139c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.115 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.991+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010d6 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_sel.c auth{0=1} v48 pv154 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2008-07-26T04:41:37.000000+0000 b8149 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc47a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010d6:[<0x100000010be/oa_soap_sel.c v48>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010d6:[<0x100000010be/oa_soap_sel.c v48>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.115 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.992+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010e2 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_utils.h auth{0=1} v72 pv142 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.336913+0000 b4420 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc47ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010e2:[<0x100000010be/oa_soap_utils.h v72>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010e2:[<0x100000010be/oa_soap_utils.h v72>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.115 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.992+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f6 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_lcd_event.h auth{0=1} v112 pv144 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2009-01-19T07:36:21.000000+0000 b1928 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc47b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f6:[<0x100000010be/oa_soap_lcd_event.h v112>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010f6:[<0x100000010be/oa_soap_lcd_event.h v112>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.115 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.993+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010e1 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_server_event.c auth{0=1} v70 pv118 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.335913+0000 b39923 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc47b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010e1:[<0x100000010be/oa_soap_server_event.c v70>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010e1:[<0x100000010be/oa_soap_server_event.c v70>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.115 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.993+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010d7 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_discover.h auth{0=1} v50 pv124 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.326913+0000 b10272 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc47bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010d7:[<0x100000010be/oa_soap_discover.h v50>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010d7:[<0x100000010be/oa_soap_discover.h v50>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.116 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.994+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010d5 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap.c auth{0=1} v46 pv222 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.325913+0000 b20196 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc47c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010d5:[<0x100000010be/oa_soap.c v46>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010d5:[<0x100000010be/oa_soap.c v46>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.116 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001397 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/coverage.txt) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.116 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000139e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/8-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.116 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013a3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/4-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.116 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001393 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/8-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.116 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000139b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.116 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001394 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/3-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.116 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001395 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/10-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.116 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001398 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/18-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.116 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013a4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/8-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.116 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013a5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/16-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.117 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013a6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/11-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.117 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013a7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/17-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.117 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000139f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/assertions.xml) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.117 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001396 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/19-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.117 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.994+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010c9 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_calls.c auth{0=1} v22 pv168 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.311914+0000 b71604 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc47c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010c9:[<0x100000010be/oa_soap_calls.c v22>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010c9:[<0x100000010be/oa_soap_calls.c v22>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.117 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.995+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ce [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_load_id.c auth{0=1} v32 pv130 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.316914+0000 b3322 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc47cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010ce:[<0x100000010be/oa_soap_load_id.c v32>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010ce:[<0x100000010be/oa_soap_load_id.c v32>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.117 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.996+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ec [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap.h auth{0=1} v92 pv212 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.346913+0000 b8499 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc47d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010ec:[<0x100000010be/oa_soap.h v92>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010ec:[<0x100000010be/oa_soap.h v92>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.117 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.996+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010c0 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_dimi.h auth{0=1} v4 pv198 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.301914+0000 b3880 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc47d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010c0:[<0x100000010be/oa_soap_dimi.h v4>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010c0:[<0x100000010be/oa_soap_dimi.h v4>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.118 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013d4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.118 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013e9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.118 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013bd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/7-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.118 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013b7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/10.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.118 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013c2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-10.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.118 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013c5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.118 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013ab (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/20-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.118 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013c3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/13-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.118 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013c0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-8.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.118 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013be (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.118 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013b6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/15-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.119 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013b0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/14-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.119 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013bc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/12-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.119 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013ba (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.119 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.997+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010c7 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_reset.h auth{0=1} v18 pv156 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.309914+0000 b2174 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc484000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010c7:[<0x100000010be/oa_soap_reset.h v18>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010c7:[<0x100000010be/oa_soap_reset.h v18>,<0x10000000fba/oa_soap v452>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.119 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.997+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001111 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_annunciator_func.h auth{0=1} v12 pv267 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.382912+0000 b1675 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc484580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001111:[<0x1000000110b/sim_annunciator_func.h v12>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001111:[<0x1000000110b/sim_annunciator_func.h v12>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.119 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013c1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/2-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.119 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013b5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.120 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013ae (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/coverage.txt) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.120 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013b8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.120 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013b9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/8-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.120 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013c4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/4-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.120 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013b1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.120 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013ca (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.120 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013b4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/6-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.120 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013a9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.120 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013bf (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-6.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.120 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013b3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/5-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.120 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013af (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/18-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.120 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013aa (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/9-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.121 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.998+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000112f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_watchdog.c auth{0=1} v72 pv231 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.408911+0000 b9231 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc484b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000112f:[<0x1000000110b/sim_watchdog.c v72>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000112f:[<0x1000000110b/sim_watchdog.c v72>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.121 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.998+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001126 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_power.c auth{0=1} v54 pv193 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2008-07-26T03:51:46.000000+0000 b2365 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc485080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001126:[<0x1000000110b/sim_power.c v54>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001126:[<0x1000000110b/sim_power.c v54>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.121 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.999+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001110 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_hotswap.h auth{0=1} v10 pv229 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.381912+0000 b1307 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc485600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001110:[<0x1000000110b/sim_hotswap.h v10>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001110:[<0x1000000110b/sim_hotswap.h v10>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.121 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:45.999+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000110c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_fumi_func.h auth{0=1} v2 pv307 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2008-07-26T04:41:38.000000+0000 b726 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc485b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000110c:[<0x1000000110b/sim_fumi_func.h v2>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000110c:[<0x1000000110b/sim_fumi_func.h v2>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.121 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.000+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001127 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_watchdog.h auth{0=1} v56 pv297 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.401911+0000 b2029 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc486100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001127:[<0x1000000110b/sim_watchdog.h v56>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001127:[<0x1000000110b/sim_watchdog.h v56>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.121 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013c9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-9.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.121 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013c7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/11-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.121 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013b2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-12.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.122 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013c8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/17-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.122 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013cb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.122 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013c6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/16-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.122 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013ac (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-5.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.122 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013bb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/assertions.xml) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.122 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013ad (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/19-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.122 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013e1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/7-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.122 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013e8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/12-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.122 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013e0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/12-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.122 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013dd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/7-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.122 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013dc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.123 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.000+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000112e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_annunciators.h auth{0=1} v70 pv241 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2007-06-25T15:44:57.000000+0000 b1988 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc486680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000112e:[<0x1000000110b/sim_annunciators.h v70>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000112e:[<0x1000000110b/sim_annunciators.h v70>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.123 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.001+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001128 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_el.c auth{0=1} v58 pv293 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.402911+0000 b6321 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc486c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001128:[<0x1000000110b/sim_el.c v58>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001128:[<0x1000000110b/sim_el.c v58>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.123 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013e3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/2-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.123 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013d8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/coverage.txt) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.123 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013de (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/8-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.123 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013e4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/4-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.123 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013d9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.123 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013db (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/6-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.123 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013d5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/3-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.123 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013e6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/7-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.124 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013da (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/5-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.124 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013d7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/10-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.124 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013d6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/9-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.124 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013e2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/12-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.124 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013e5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/11-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.124 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013df (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/assertions.xml) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.124 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.001+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001112 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_control_func.h auth{0=1} v14 pv291 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.383912+0000 b900 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc487180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001112:[<0x1000000110b/sim_control_func.h v14>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001112:[<0x1000000110b/sim_control_func.h v14>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.124 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.004+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001133 [...2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/ auth{0=1} v178 pv359 ap=50 f(v0 m2024-06-03T00:02:34.453910+0000 49=49+0)->f(v0 m2024-06-03T00:02:34.453910+0000 49=49+0) n(v0 rc2024-06-03T00:02:34.453910+0000 50=49+1)->n(v0 rc2024-06-03T00:02:34.454910+0000 b161774 50=49+1) (inest lock w=49) (ifile excl) (iversion lock w=49) caps={24895=pAsLsXsFsx/pAsLsXsFsx@1},l=24895 | lock=2 importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc487700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001133:[<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(2)0x10000001133:[<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-06-03T00:02:34.453910+0000 49=49+0)","ondisk_value.rstat":"n(v0 rc2024-06-03T00:02:34.453910+0000 50=49+1)","memory_value.dirstat":"f(v0 m2024-06-03T00:02:34.453910+0000 49=49+0)","memory_value.rstat":"n(v0 rc2024-06-03T00:02:34.453910+0000 50=49+1)","error_str":""},"return_code":0} 2024-06-03T00:02:46.125 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.004+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001158 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_001.c auth v74 pv196 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.444910+0000 b904 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4ab180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001158:[<0x10000001133/sim_sanity_001.c v74>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001158:[<0x10000001133/sim_sanity_001.c v74>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.125 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.004+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001142 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_021.c auth v30 pv180 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.425911+0000 b3163 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4ab700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001142:[<0x10000001133/sim_sanity_021.c v30>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001142:[<0x10000001133/sim_sanity_021.c v30>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.125 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013e7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/7-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.125 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001403 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/7-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.125 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001407 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/2-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.125 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001409 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/22-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.125 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013ee (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/4-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.125 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001405 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/4-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.125 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013fe (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/9-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.125 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013ef (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/20-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.125 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001412 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/2-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.125 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001408 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/13-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.126 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013f1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/23-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.126 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013ff (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/15-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.126 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001402 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/12-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.126 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013fc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/7-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.126 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.004+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001141 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_018.c auth v28 pv160 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.424911+0000 b1964 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4b4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001141:[<0x10000001133/sim_sanity_018.c v28>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001141:[<0x10000001133/sim_sanity_018.c v28>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.126 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.005+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001146 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_025.c auth v38 pv112 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.428911+0000 b1981 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4b4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001146:[<0x10000001133/sim_sanity_025.c v38>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001146:[<0x10000001133/sim_sanity_025.c v38>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.126 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.005+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000113c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_040.c auth v18 pv132 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2008-07-26T03:51:46.000000+0000 b2220 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4b4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000113c:[<0x10000001133/sim_sanity_040.c v18>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000113c:[<0x10000001133/sim_sanity_040.c v18>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.126 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.005+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000112c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_reset.h auth{0=1} v66 pv329 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.406911+0000 b735 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc492000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000112c:[<0x1000000110b/sim_reset.h v66>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000112c:[<0x1000000110b/sim_reset.h v66>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.127 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013fb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/5-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.127 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013f6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/14-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.127 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013fa (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.127 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013f4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/coverage.txt) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.127 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001406 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/2-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.127 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000140a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/4-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.127 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001400 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/8-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.127 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013fd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/7-5.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.127 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001410 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/3-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.127 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013ea (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/8-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.127 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013f3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/24-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.128 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013f7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.128 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013f9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/6-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.128 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013eb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/3-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.128 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.005+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001114 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_reset.c auth{0=1} v18 pv245 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.385912+0000 b2126 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc492580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001114:[<0x1000000110b/sim_reset.c v18>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001114:[<0x1000000110b/sim_reset.c v18>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.128 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.006+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001118 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_annunciators.c auth{0=1} v26 pv273 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.388912+0000 b5567 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc492b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001118:[<0x1000000110b/sim_annunciators.c v26>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001118:[<0x1000000110b/sim_annunciators.c v26>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.128 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000140e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/7-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.128 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013f8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/5-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.129 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013f0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/10-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.129 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013f5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/18-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.129 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013ec (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/9-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.129 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000140d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/11-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.129 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000140f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/17-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.129 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001413 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/3-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.129 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000140b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/8-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.129 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000140c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/16-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.129 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013ed (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/9-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.129 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001401 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/assertions.xml) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.129 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000013f2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/19-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.130 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.006+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000111f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_control_func.c auth{0=1} v40 pv191 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.394911+0000 b5609 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc493080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000111f:[<0x1000000110b/sim_control_func.c v40>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000111f:[<0x1000000110b/sim_control_func.c v40>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.130 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.006+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001155 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_004.c auth v68 pv170 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.441910+0000 b1977 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4b5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001155:[<0x10000001133/sim_sanity_004.c v68>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001155:[<0x10000001133/sim_sanity_004.c v68>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.130 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.006+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001129 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_resources2.c auth{0=1} v60 pv221 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.403911+0000 b85830 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc493600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001129:[<0x1000000110b/sim_resources2.c v60>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001129:[<0x1000000110b/sim_resources2.c v60>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.130 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.006+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000115a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_027.c auth v78 pv118 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.446910+0000 b2854 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4b5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000115a:[<0x10000001133/sim_sanity_027.c v78>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000115a:[<0x10000001133/sim_sanity_027.c v78>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.130 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.007+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000110f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_dimi_func.c auth{0=1} v8 pv265 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.379912+0000 b836 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc493b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000110f:[<0x1000000110b/sim_dimi_func.c v8>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000110f:[<0x1000000110b/sim_dimi_func.c v8>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.130 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001404 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/21-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.130 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001411 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/7-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.130 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:46.131 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:46.131 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000187d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-95.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.131 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001761 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/9-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.131 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000180d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-91.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.131 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001916 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-35.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.131 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000181b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.131 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001918 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-12.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.131 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001922 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-9.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.131 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001915 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.131 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000185a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-9.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.131 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017a6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-27.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.131 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017e3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.131 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001851 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/README) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.132 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.007+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001135 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_036.c auth v4 pv146 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.413911+0000 b1903 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4b5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001135:[<0x10000001133/sim_sanity_036.c v4>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001135:[<0x10000001133/sim_sanity_036.c v4>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.132 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.007+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000115b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_002.c auth v80 pv102 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2008-07-26T03:51:46.000000+0000 b1273 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4b6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000115b:[<0x10000001133/sim_sanity_002.c v80>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000115b:[<0x10000001133/sim_sanity_002.c v80>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.132 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017c4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.132 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001869 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-25.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.132 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001764 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-103.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.132 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001727 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-16.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.132 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018d0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-10.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.132 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001860 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-6.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.132 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017b7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-16.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.133 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018ea (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.133 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001901 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-47.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.133 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001930 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.133 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001831 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-17.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.133 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018ae (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.133 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017d3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-8.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.133 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001862 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-58.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.134 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.007+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001157 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_017.c auth v72 pv190 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.443910+0000 b1961 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4b6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001157:[<0x10000001133/sim_sanity_017.c v72>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001157:[<0x10000001133/sim_sanity_017.c v72>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.134 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.007+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001130 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_controls.c auth{0=1} v74 pv343 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.409911+0000 b5842 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc494100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001130:[<0x1000000110b/sim_controls.c v74>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001130:[<0x1000000110b/sim_controls.c v74>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.134 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.008+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001150 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_006.c auth v58 pv182 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.437910+0000 b1969 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4b6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001150:[<0x10000001133/sim_sanity_006.c v58>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001150:[<0x10000001133/sim_sanity_006.c v58>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.134 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.008+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001160 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_019.c auth v90 pv128 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.451910+0000 b1960 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4b7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001160:[<0x10000001133/sim_sanity_019.c v90>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001160:[<0x10000001133/sim_sanity_019.c v90>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.134 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.008+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001151 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_043.c auth v60 pv134 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.438910+0000 b3180 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4b7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001151:[<0x10000001133/sim_sanity_043.c v60>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001151:[<0x10000001133/sim_sanity_043.c v60>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.134 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.008+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000113b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_016.c auth v16 pv188 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.419911+0000 b2583 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4be000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000113b:[<0x10000001133/sim_sanity_016.c v16>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000113b:[<0x10000001133/sim_sanity_016.c v16>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.134 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001798 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-57.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.134 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017ff (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-31.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.135 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017a7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.135 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018bc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.135 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001833 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-36.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.135 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017d9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.135 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000172c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-21.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.135 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000177c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-23.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.135 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001861 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-12.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.135 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001751 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-48.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.135 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000188c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.135 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018ec (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-25.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.135 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001754 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-20.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.135 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018a7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-20.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.136 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.008+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001164 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_037.c auth v98 pv104 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.454910+0000 b1922 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4be580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001164:[<0x10000001133/sim_sanity_037.c v98>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001164:[<0x10000001133/sim_sanity_037.c v98>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.136 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.009+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001143 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_026.c auth v32 pv186 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.426911+0000 b1941 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4beb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001143:[<0x10000001133/sim_sanity_026.c v32>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001143:[<0x10000001133/sim_sanity_026.c v32>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.136 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001774 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-22.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.136 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001777 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.136 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018ee (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-6.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.136 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001917 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/11-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.136 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000187b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.136 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001809 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-12.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.136 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001919 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.136 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000172b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-25.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.137 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000192b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.137 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018de (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.137 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018bf (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-15.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.137 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001795 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.137 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001781 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-67.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.137 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.009+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000115f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_032.c auth v88 pv126 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.450910+0000 b2048 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4bf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000115f:[<0x10000001133/sim_sanity_032.c v88>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000115f:[<0x10000001133/sim_sanity_032.c v88>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.138 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.009+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001137 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_028.c auth v8 pv122 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.415911+0000 b1944 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4bf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001137:[<0x10000001133/sim_sanity_028.c v8>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001137:[<0x10000001133/sim_sanity_028.c v8>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.138 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.009+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000113e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_033.c auth v22 pv154 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.421911+0000 b1994 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4bfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000113e:[<0x10000001133/sim_sanity_033.c v22>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000113e:[<0x10000001133/sim_sanity_033.c v22>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.138 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.009+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000114a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_034.c auth v46 pv164 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.432910+0000 b1931 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4c0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000114a:[<0x10000001133/sim_sanity_034.c v46>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000114a:[<0x10000001133/sim_sanity_034.c v46>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.138 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.010+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000111b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_dimi_func.h auth{0=1} v32 pv325 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.391912+0000 b666 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc494680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000111b:[<0x1000000110b/sim_dimi_func.h v32>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000111b:[<0x1000000110b/sim_dimi_func.h v32>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.138 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.010+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000115e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_030.c auth v86 pv108 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.449910+0000 b1939 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4c0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000115e:[<0x10000001133/sim_sanity_030.c v86>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000115e:[<0x10000001133/sim_sanity_030.c v86>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.138 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018f2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.138 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001844 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-80.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.138 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001834 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-17.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.138 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001800 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-25.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.138 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018f6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-21.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.139 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001929 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.139 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018d6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-12.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.139 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018bd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-19.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.139 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017d8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-8.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.139 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001827 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-8.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.139 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001835 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-24.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.139 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001883 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-22.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.139 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000194a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.139 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018d2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.140 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.010+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000114f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_035.c auth v56 pv114 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.436910+0000 b2122 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4c0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000114f:[<0x10000001133/sim_sanity_035.c v56>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000114f:[<0x10000001133/sim_sanity_035.c v56>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.140 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.010+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000112a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/Makefile.in auth{0=1} v62 pv217 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.404911+0000 b23689 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc494c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000112a:[<0x1000000110b/Makefile.in v62>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000112a:[<0x1000000110b/Makefile.in v62>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.140 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.011+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001156 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/Makefile.in auth v70 pv140 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.442910+0000 b55299 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4c1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001156:[<0x10000001133/Makefile.in v70>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001156:[<0x10000001133/Makefile.in v70>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.140 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.011+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000111d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_fumi.h auth{0=1} v36 pv253 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.393912+0000 b958 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc495180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000111d:[<0x1000000110b/sim_fumi.h v36>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000111d:[<0x1000000110b/sim_fumi.h v36>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.140 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.011+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001139 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_015.c auth v12 pv174 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.417911+0000 b2752 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4c1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001139:[<0x10000001133/sim_sanity_015.c v12>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001139:[<0x10000001133/sim_sanity_015.c v12>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.140 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017ce (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-20.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.140 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018f8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.140 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017ad (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-21.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.140 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000174c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-6.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.140 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001822 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-23.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.141 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017f6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-98.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.141 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017e4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.141 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018fa (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-5.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.141 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001938 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-26.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.141 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017c9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-87.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.141 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000183f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-40.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.141 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017a9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.141 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000181d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-18.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.141 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001888 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-23.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.142 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.011+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000113f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_045.c auth v24 pv136 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.422911+0000 b1891 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4cc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000113f:[<0x10000001133/sim_sanity_045.c v24>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000113f:[<0x10000001133/sim_sanity_045.c v24>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.142 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.012+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001149 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_014.c auth v44 pv156 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.431911+0000 b2376 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4cc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001149:[<0x10000001133/sim_sanity_014.c v44>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001149:[<0x10000001133/sim_sanity_014.c v44>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.142 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.012+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000111e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_dimi.c auth{0=1} v38 pv269 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2008-07-26T04:41:38.000000+0000 b2438 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc495700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000111e:[<0x1000000110b/sim_dimi.c v38>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000111e:[<0x1000000110b/sim_dimi.c v38>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.142 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.012+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001154 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_000.c auth v66 pv194 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.440910+0000 b897 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4ccb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001154:[<0x10000001133/sim_sanity_000.c v66>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001154:[<0x10000001133/sim_sanity_000.c v66>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.142 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001865 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-26.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.142 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001770 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-60.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.142 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001982 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.142 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001855 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.142 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001793 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-10.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.142 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001908 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.143 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001836 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.143 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001815 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-99.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.143 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000192f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.143 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000190d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.143 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000190b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-23.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.143 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000186d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-18.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.143 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018f7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-25.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.143 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001839 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-15.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.143 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.012+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000114e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_011.c auth v54 pv176 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.435910+0000 b1941 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4cd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000114e:[<0x10000001133/sim_sanity_011.c v54>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000114e:[<0x10000001133/sim_sanity_011.c v54>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.143 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.012+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001134 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_039.c auth v2 pv130 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2008-07-26T03:51:46.000000+0000 b2016 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4cd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001134:[<0x10000001133/sim_sanity_039.c v2>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001134:[<0x10000001133/sim_sanity_039.c v2>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.144 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000191c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.144 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018da (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-23.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.144 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018e4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.144 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017cc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-18.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.144 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001849 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-21.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.144 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000185b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.144 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000193b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-15.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.144 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001783 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.144 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001925 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-10.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.144 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001816 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-23.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.144 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000175a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.145 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001884 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-22.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.145 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001927 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-9.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.145 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018a8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-19.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.145 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.013+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001165 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/Makefile.am auth{0=1} v180 pv243 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.455910+0000 b1584 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc49c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001165:[<0x1000000110b/Makefile.am v180>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001165:[<0x1000000110b/Makefile.am v180>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.145 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.013+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001147 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_031.c auth v40 pv124 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.429911+0000 b1916 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4cdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001147:[<0x10000001133/sim_sanity_031.c v40>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001147:[<0x10000001133/sim_sanity_031.c v40>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.145 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.013+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000113d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_042.c auth v20 pv148 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.420911+0000 b2903 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4ce100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000113d:[<0x10000001133/sim_sanity_042.c v20>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000113d:[<0x10000001133/sim_sanity_042.c v20>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.145 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.013+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000112b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_el.h auth{0=1} v64 pv309 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.405911+0000 b1519 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc49c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000112b:[<0x1000000110b/sim_el.h v64>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000112b:[<0x1000000110b/sim_el.h v64>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.146 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001752 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-18.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.146 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017b0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-102.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.146 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001905 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-15.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.146 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001889 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-51.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.146 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001846 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-42.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.146 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000193d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-20.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.146 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017b9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.146 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018e5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.146 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001796 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-20.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.146 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000189b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.146 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001847 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-26.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.146 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001944 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-59.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.147 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001829 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.147 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001926 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-24.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.147 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.013+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001145 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/openhpi.conf auth v36 pv162 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2007-06-25T15:44:58.000000+0000 b117 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4ce680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001145:[<0x10000001133/openhpi.conf v36>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001145:[<0x10000001133/openhpi.conf v36>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.147 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.014+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001144 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_044.c auth v34 pv110 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.427911+0000 b3145 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4cec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001144:[<0x10000001133/sim_sanity_044.c v34>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001144:[<0x10000001133/sim_sanity_044.c v34>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.147 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.014+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001140 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_012.c auth v26 pv138 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.423911+0000 b2159 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4cf180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001140:[<0x10000001133/sim_sanity_012.c v26>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001140:[<0x10000001133/sim_sanity_012.c v26>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.147 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.014+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000111a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_inventory.c auth{0=1} v30 pv201 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.390912+0000 b30118 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc49cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000111a:[<0x1000000110b/sim_inventory.c v30>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000111a:[<0x1000000110b/sim_inventory.c v30>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.148 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018e7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-32.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.148 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018dd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-12.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.148 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001943 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-6.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.148 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001797 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-37.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.148 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000192d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.148 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000191b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-6.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.148 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001853 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.148 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001876 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-38.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.148 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001808 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-10.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.148 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017c0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-16.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.148 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018e0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.148 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001924 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.148 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017ca (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-15.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.149 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000187c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-8.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.149 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:45 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001772 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-15.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.159 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.014+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001163 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/Makefile.am auth v96 pv192 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.453910+0000 b7273 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4cf700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001163:[<0x10000001133/Makefile.am v96>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001163:[<0x10000001133/Makefile.am v96>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.159 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.014+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001161 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_023.c auth v92 pv152 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.452910+0000 b1946 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4d8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001161:[<0x10000001133/sim_sanity_023.c v92>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001161:[<0x10000001133/sim_sanity_023.c v92>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.159 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.015+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001125 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_sensor_func.c auth{0=1} v52 pv199 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.400911+0000 b20751 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc49d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001125:[<0x1000000110b/sim_sensor_func.c v52>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001125:[<0x1000000110b/sim_sensor_func.c v52>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.159 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.015+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001138 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_024.c auth v10 pv144 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.416911+0000 b1932 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4d8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001138:[<0x10000001133/sim_sanity_024.c v10>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001138:[<0x10000001133/sim_sanity_024.c v10>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.160 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.015+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000113a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_008.c auth v14 pv116 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.418911+0000 b2272 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4d8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000113a:[<0x10000001133/sim_sanity_008.c v14>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000113a:[<0x10000001133/sim_sanity_008.c v14>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.160 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.015+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000112d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_fumi_func.c auth{0=1} v68 pv295 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.407911+0000 b902 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc49d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000112d:[<0x1000000110b/sim_fumi_func.c v68>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000112d:[<0x1000000110b/sim_fumi_func.c v68>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.160 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.015+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000114d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_020.c auth v52 pv168 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.434910+0000 b1946 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4d9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000114d:[<0x10000001133/sim_sanity_020.c v52>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000114d:[<0x10000001133/sim_sanity_020.c v52>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.160 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.016+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001136 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_013.c auth v6 pv178 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.414911+0000 b1923 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4d9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001136:[<0x10000001133/sim_sanity_013.c v6>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001136:[<0x10000001133/sim_sanity_013.c v6>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.160 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.016+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001153 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_010.c auth v64 pv184 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2008-07-26T03:51:46.000000+0000 b1923 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4d9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001153:[<0x10000001133/sim_sanity_010.c v64>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001153:[<0x10000001133/sim_sanity_010.c v64>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.160 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.016+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001116 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_fumi.c auth{0=1} v22 pv353 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.387912+0000 b2437 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc49db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001116:[<0x1000000110b/sim_fumi.c v22>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001116:[<0x1000000110b/sim_fumi.c v22>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.160 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.016+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000114c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_041.c auth v50 pv100 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.433910+0000 b2014 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4dac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000114c:[<0x10000001133/sim_sanity_041.c v50>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000114c:[<0x10000001133/sim_sanity_041.c v50>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.160 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.016+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001159 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_003.c auth v76 pv166 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.445910+0000 b2622 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4da100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001159:[<0x10000001133/sim_sanity_003.c v76>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001159:[<0x10000001133/sim_sanity_003.c v76>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.160 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.017+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000114b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_005.c auth v48 pv158 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2008-07-26T03:51:46.000000+0000 b2289 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4da680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000114b:[<0x10000001133/sim_sanity_005.c v48>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000114b:[<0x10000001133/sim_sanity_005.c v48>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.161 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.017+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001113 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_sensors.c auth{0=1} v16 pv351 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.384912+0000 b4688 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc49e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001113:[<0x1000000110b/sim_sensors.c v16>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001113:[<0x1000000110b/sim_sensors.c v16>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.161 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.017+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001162 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_007.c auth v94 pv172 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2008-07-26T03:51:46.000000+0000 b2244 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4db180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001162:[<0x10000001133/sim_sanity_007.c v94>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001162:[<0x10000001133/sim_sanity_007.c v94>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.161 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.017+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001148 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_029.c auth v42 pv150 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.430911+0000 b2129 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4db700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001148:[<0x10000001133/sim_sanity_029.c v42>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001148:[<0x10000001133/sim_sanity_029.c v42>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.161 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.017+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001131 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_sensors.h auth{0=1} v76 pv237 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.410911+0000 b3604 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc49e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001131:[<0x1000000110b/sim_sensors.h v76>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001131:[<0x1000000110b/sim_sensors.h v76>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.161 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.017+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001152 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_022.c auth v62 pv106 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.439910+0000 b3429 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4e4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001152:[<0x10000001133/sim_sanity_022.c v62>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001152:[<0x10000001133/sim_sanity_022.c v62>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.161 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.017+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000115d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_038.c auth v84 pv142 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.448910+0000 b2307 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4e4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000115d:[<0x10000001133/sim_sanity_038.c v84>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000115d:[<0x10000001133/sim_sanity_038.c v84>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.161 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.018+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000115c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_009.c auth v82 pv120 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.447910+0000 b2380 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc4e4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000115c:[<0x10000001133/sim_sanity_009.c v82>,<0x1000000110b/t v178>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000115c:[<0x10000001133/sim_sanity_009.c v82>,<0x1000000110b/t v178>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.161 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.018+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000110d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_injector.c auth{0=1} v4 pv279 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.378912+0000 b10102 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc49ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000110d:[<0x1000000110b/sim_injector.c v4>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000110d:[<0x1000000110b/sim_injector.c v4>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.162 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.018+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001119 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_controls.h auth{0=1} v28 pv301 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.389912+0000 b1760 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc49f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001119:[<0x1000000110b/sim_controls.h v28>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001119:[<0x1000000110b/sim_controls.h v28>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.162 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.019+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001115 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_power.h auth{0=1} v20 pv299 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.386912+0000 b745 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc49f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001115:[<0x1000000110b/sim_power.h v20>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001115:[<0x1000000110b/sim_power.h v20>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.162 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.020+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000110e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_init.c auth{0=1} v6 pv261 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2009-01-19T07:36:21.000000+0000 b9903 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4a8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000110e:[<0x1000000110b/sim_init.c v6>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000110e:[<0x1000000110b/sim_init.c v6>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.162 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.020+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001120 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_init.h auth{0=1} v42 pv183 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.395911+0000 b1901 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4a8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001120:[<0x1000000110b/sim_init.h v42>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001120:[<0x1000000110b/sim_init.h v42>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.162 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.022+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001117 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_sensor_func.h auth{0=1} v24 pv247 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2007-06-25T15:44:57.000000+0000 b2288 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4a8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001117:[<0x1000000110b/sim_sensor_func.h v24>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001117:[<0x1000000110b/sim_sensor_func.h v24>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.162 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.022+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001121 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_annunciator_func.c auth{0=1} v44 pv209 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.396911+0000 b11605 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4a9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001121:[<0x1000000110b/sim_annunciator_func.c v44>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001121:[<0x1000000110b/sim_annunciator_func.c v44>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.162 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.023+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001123 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_inventory.h auth{0=1} v48 pv357 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.398911+0000 b4107 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4a9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001123:[<0x1000000110b/sim_inventory.h v48>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001123:[<0x1000000110b/sim_inventory.h v48>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.162 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.023+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001132 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_injector.h auth{0=1} v78 pv311 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.411911+0000 b1294 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4a9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001132:[<0x1000000110b/sim_injector.h v78>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001132:[<0x1000000110b/sim_injector.h v78>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.162 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.024+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001122 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_dimi.h auth{0=1} v46 pv319 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.397911+0000 b935 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4aa100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001122:[<0x1000000110b/sim_dimi.h v46>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001122:[<0x1000000110b/sim_dimi.h v46>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.163 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.025+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000111c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_resources.h auth{0=1} v34 pv327 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.392912+0000 b2076 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4aa680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000111c:[<0x1000000110b/sim_resources.h v34>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000111c:[<0x1000000110b/sim_resources.h v34>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.163 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.025+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001124 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_hotswap.c auth{0=1} v50 pv339 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.399911+0000 b12589 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4aac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001124:[<0x1000000110b/sim_hotswap.c v50>,<0x10000000fba/simulator v576>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001124:[<0x1000000110b/sim_hotswap.c v50>,<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.163 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.026+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010fe [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_ssl.c auth{0=1} v14 pv64 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.363912+0000 b4321 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4e5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010fe:[<0x100000010f7/ilo2_ribcl_ssl.c v14>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010fe:[<0x100000010f7/ilo2_ribcl_ssl.c v14>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.163 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.026+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001100 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_ssl.h auth{0=1} v18 pv50 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2008-07-26T04:41:36.000000+0000 b2075 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4e5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001100:[<0x100000010f7/ilo2_ribcl_ssl.h v18>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001100:[<0x100000010f7/ilo2_ribcl_ssl.h v18>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.163 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.027+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001108 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_idr.h auth{0=1} v34 pv66 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.372912+0000 b2882 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4e5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001108:[<0x100000010f7/ilo2_ribcl_idr.h v34>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001108:[<0x100000010f7/ilo2_ribcl_idr.h v34>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.163 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.027+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001107 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_rpt.c auth{0=1} v32 pv42 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.371912+0000 b7691 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4e6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001107:[<0x100000010f7/ilo2_ribcl_rpt.c v32>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001107:[<0x100000010f7/ilo2_ribcl_rpt.c v32>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.163 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.028+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001104 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_idr.c auth{0=1} v26 pv76 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.368912+0000 b35656 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4e6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001104:[<0x100000010f7/ilo2_ribcl_idr.c v26>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001104:[<0x100000010f7/ilo2_ribcl_idr.c v26>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.163 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.028+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010fc [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_control.c auth{0=1} v10 pv48 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.361912+0000 b26044 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4e6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010fc:[<0x100000010f7/ilo2_ribcl_control.c v10>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010fc:[<0x100000010f7/ilo2_ribcl_control.c v10>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.163 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.029+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001103 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/Makefile.in auth{0=1} v24 pv68 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.367912+0000 b19852 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4e7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001103:[<0x100000010f7/Makefile.in v24>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001103:[<0x100000010f7/Makefile.in v24>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.163 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.029+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001109 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl.c auth{0=1} v36 pv40 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.373912+0000 b12633 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4e7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001109:[<0x100000010f7/ilo2_ribcl.c v36>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001109:[<0x100000010f7/ilo2_ribcl.c v36>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.163 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.030+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f9 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_reset.c auth{0=1} v4 pv44 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.358912+0000 b7930 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4f2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f9:[<0x100000010f7/ilo2_ribcl_reset.c v4>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010f9:[<0x100000010f7/ilo2_ribcl_reset.c v4>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.163 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.030+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001101 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl.h auth{0=1} v20 pv62 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.365912+0000 b19885 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4f2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001101:[<0x100000010f7/ilo2_ribcl.h v20>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001101:[<0x100000010f7/ilo2_ribcl.h v20>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.164 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.031+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000110a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/Makefile.am auth{0=1} v38 pv72 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.374912+0000 b2493 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4f2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000110a:[<0x100000010f7/Makefile.am v38>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000110a:[<0x100000010f7/Makefile.am v38>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.164 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.031+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ff [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_discover.h auth{0=1} v16 pv52 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.364912+0000 b2627 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4f3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010ff:[<0x100000010f7/ilo2_ribcl_discover.h v16>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010ff:[<0x100000010f7/ilo2_ribcl_discover.h v16>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.164 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.032+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010fb [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_discover.c auth{0=1} v8 pv74 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.360912+0000 b71018 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4f3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010fb:[<0x100000010f7/ilo2_ribcl_discover.c v8>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010fb:[<0x100000010f7/ilo2_ribcl_discover.c v8>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.164 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.032+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010fa [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_sensor.c auth{0=1} v6 pv46 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.359912+0000 b39017 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4f3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010fa:[<0x100000010f7/ilo2_ribcl_sensor.c v6>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010fa:[<0x100000010f7/ilo2_ribcl_sensor.c v6>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.164 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.033+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001102 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_cmnds.h auth{0=1} v22 pv70 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.366912+0000 b9794 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4f4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001102:[<0x100000010f7/ilo2_ribcl_cmnds.h v22>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001102:[<0x100000010f7/ilo2_ribcl_cmnds.h v22>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.164 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.033+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010fd [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_xml.h auth{0=1} v12 pv54 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.362912+0000 b2672 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4f4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010fd:[<0x100000010f7/ilo2_ribcl_xml.h v12>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010fd:[<0x100000010f7/ilo2_ribcl_xml.h v12>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.164 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.034+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001105 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_xml.c auth{0=1} v28 pv60 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.369912+0000 b78418 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4f4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001105:[<0x100000010f7/ilo2_ribcl_xml.c v28>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001105:[<0x100000010f7/ilo2_ribcl_xml.c v28>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.164 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.034+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f8 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_power.c auth{0=1} v2 pv58 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.357912+0000 b12054 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4f5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f8:[<0x100000010f7/ilo2_ribcl_power.c v2>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010f8:[<0x100000010f7/ilo2_ribcl_power.c v2>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.164 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.035+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001106 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_sensor.h auth{0=1} v30 pv56 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.370912+0000 b2028 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4f5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001106:[<0x100000010f7/ilo2_ribcl_sensor.h v30>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001106:[<0x100000010f7/ilo2_ribcl_sensor.h v30>,<0x10000000fba/ilo2_ribcl v492>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.164 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.035+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000117b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_indicator.c auth{0=1} v42 pv104 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.481909+0000 b1352 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4fa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000117b:[<0x10000001166/rtas_indicator.c v42>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000117b:[<0x10000001166/rtas_indicator.c v42>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.164 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.035+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001173 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_reset.h auth{0=1} v26 pv76 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.470909+0000 b929 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4fa580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001173:[<0x10000001166/rtas_reset.h v26>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001173:[<0x10000001166/rtas_reset.h v26>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.165 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.036+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000117a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_power.c auth{0=1} v40 pv118 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.480909+0000 b1601 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4fab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000117a:[<0x10000001166/rtas_power.c v40>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000117a:[<0x10000001166/rtas_power.c v40>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.165 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.037+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000116e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_reset.c auth{0=1} v16 pv114 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.463910+0000 b1206 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4fb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000116e:[<0x10000001166/rtas_reset.c v16>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000116e:[<0x10000001166/rtas_reset.c v16>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.165 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.037+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001183 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas.h auth{0=1} v58 pv72 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.492909+0000 b756 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4fb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001183:[<0x10000001166/rtas.h v58>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001183:[<0x10000001166/rtas.h v58>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.165 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.038+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001170 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_event.c auth{0=1} v20 pv102 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.466910+0000 b824 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4fbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001170:[<0x10000001166/rtas_event.c v20>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001170:[<0x10000001166/rtas_event.c v20>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.165 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.038+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000116b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_inventory.h auth{0=1} v10 pv92 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.460910+0000 b2938 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4fc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000116b:[<0x10000001166/rtas_inventory.h v10>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000116b:[<0x10000001166/rtas_inventory.h v10>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.165 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.039+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001184 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_control.c auth{0=1} v60 pv120 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.493909+0000 b1901 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4fc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001184:[<0x10000001166/rtas_control.c v60>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001184:[<0x10000001166/rtas_control.c v60>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.165 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.039+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001182 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_hotswap.c auth{0=1} v56 pv90 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.491909+0000 b1594 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4fcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001182:[<0x10000001166/rtas_hotswap.c v56>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001182:[<0x10000001166/rtas_hotswap.c v56>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.165 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.040+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000116d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_utils.h auth{0=1} v14 pv98 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.462910+0000 b829 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4fd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000116d:[<0x10000001166/rtas_utils.h v14>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000116d:[<0x10000001166/rtas_utils.h v14>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.165 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.041+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001175 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_watchdog.h auth{0=1} v30 pv128 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.473909+0000 b1217 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc4fd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001175:[<0x10000001166/rtas_watchdog.h v30>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001175:[<0x10000001166/rtas_watchdog.h v30>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.165 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.041+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001171 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_discover.h auth{0=1} v22 pv112 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.467910+0000 b2066 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc508000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001171:[<0x10000001166/rtas_discover.h v22>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001171:[<0x10000001166/rtas_discover.h v22>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.165 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.041+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001179 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_resource.c auth{0=1} v38 pv96 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.478909+0000 b2958 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc508580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001179:[<0x10000001166/rtas_resource.c v38>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001179:[<0x10000001166/rtas_resource.c v38>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.166 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.042+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001186 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_resource.h auth{0=1} v64 pv106 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.496909+0000 b952 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc508b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001186:[<0x10000001166/rtas_resource.h v64>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001186:[<0x10000001166/rtas_resource.h v64>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.166 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.043+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000117f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_control.h auth{0=1} v50 pv110 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.487909+0000 b1326 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc509080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000117f:[<0x10000001166/rtas_control.h v50>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000117f:[<0x10000001166/rtas_control.h v50>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.166 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.043+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000116c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_watchdog.c auth{0=1} v12 pv66 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.461910+0000 b1775 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc509600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000116c:[<0x10000001166/rtas_watchdog.c v12>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000116c:[<0x10000001166/rtas_watchdog.c v12>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.166 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.044+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001178 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_discover.c auth{0=1} v36 pv80 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.477909+0000 b33120 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc509b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001178:[<0x10000001166/rtas_discover.c v36>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001178:[<0x10000001166/rtas_discover.c v36>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.166 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.045+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000116a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_indicator.h auth{0=1} v8 pv100 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.459910+0000 b977 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc50a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000116a:[<0x10000001166/rtas_indicator.h v8>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000116a:[<0x10000001166/rtas_indicator.h v8>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.166 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.045+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000117e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_annunciator.c auth{0=1} v48 pv124 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.485909+0000 b3918 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc50a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000117e:[<0x10000001166/rtas_annunciator.c v48>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000117e:[<0x10000001166/rtas_annunciator.c v48>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.166 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.046+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001172 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_utils.c auth{0=1} v24 pv108 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.468910+0000 b2003 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc50ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001172:[<0x10000001166/rtas_utils.c v24>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001172:[<0x10000001166/rtas_utils.c v24>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.166 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.046+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001180 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_event.h auth{0=1} v52 pv86 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.488909+0000 b700 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc50b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001180:[<0x10000001166/rtas_event.h v52>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001180:[<0x10000001166/rtas_event.h v52>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.166 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.047+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000117c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/Makefile.in auth{0=1} v44 pv68 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.482909+0000 b19018 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc50b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000117c:[<0x10000001166/Makefile.in v44>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000117c:[<0x10000001166/Makefile.in v44>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.166 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.048+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001177 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_eventlog.h auth{0=1} v34 pv74 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.475909+0000 b2528 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc518000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001177:[<0x10000001166/rtas_eventlog.h v34>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001177:[<0x10000001166/rtas_eventlog.h v34>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.167 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.048+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001181 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_eventlog.c auth{0=1} v54 pv70 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.489909+0000 b3901 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc518580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001181:[<0x10000001166/rtas_eventlog.c v54>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001181:[<0x10000001166/rtas_eventlog.c v54>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.167 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.049+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001169 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_hotswap.h auth{0=1} v6 pv94 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.458910+0000 b1123 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc518b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001169:[<0x10000001166/rtas_hotswap.h v6>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001169:[<0x10000001166/rtas_hotswap.h v6>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.167 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.050+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000117d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_power.h auth{0=1} v46 pv84 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.484909+0000 b932 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc519080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000117d:[<0x10000001166/rtas_power.h v46>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000117d:[<0x10000001166/rtas_power.h v46>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.167 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.050+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000116f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_annunciator.h auth{0=1} v18 pv126 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.464910+0000 b2329 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc519600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000116f:[<0x10000001166/rtas_annunciator.h v18>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000116f:[<0x10000001166/rtas_annunciator.h v18>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.167 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.050+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001176 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_sensor.h auth{0=1} v32 pv78 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.474909+0000 b4320 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc519b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001176:[<0x10000001166/rtas_sensor.h v32>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001176:[<0x10000001166/rtas_sensor.h v32>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.167 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.051+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001185 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/Makefile.am auth{0=1} v62 pv88 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.495909+0000 b1313 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc51a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001185:[<0x10000001166/Makefile.am v62>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001185:[<0x10000001166/Makefile.am v62>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.167 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.052+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001174 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_inventory.c auth{0=1} v28 pv122 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.471909+0000 b11593 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc51a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001174:[<0x10000001166/rtas_inventory.c v28>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001174:[<0x10000001166/rtas_inventory.c v28>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.167 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.052+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001167 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas.c auth{0=1} v2 pv116 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.457910+0000 b1793 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc51ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001167:[<0x10000001166/rtas.c v2>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001167:[<0x10000001166/rtas.c v2>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.167 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.053+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001168 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_sensor.c auth{0=1} v4 pv82 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2008-07-26T03:51:46.000000+0000 b16560 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc51b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001168:[<0x10000001166/rtas_sensor.c v4>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001168:[<0x10000001166/rtas_sensor.c v4>,<0x10000000fba/rtas v642>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.167 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.053+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fc3 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ekeyfru.h auth{0=1} v16 pv83 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.057920+0000 b894 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc51b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fc3:[<0x10000000fbb/ekeyfru.h v16>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fc3:[<0x10000000fbb/ekeyfru.h v16>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.167 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.054+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fbe [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sensor_event.c auth{0=1} v6 pv111 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.052920+0000 b34407 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc524000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fbe:[<0x10000000fbb/ipmi_sensor_event.c v6>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fbe:[<0x10000000fbb/ipmi_sensor_event.c v6>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.167 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.054+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fbf [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_close.c auth{0=1} v8 pv85 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.053920+0000 b1428 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc524580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fbf:[<0x10000000fbb/ipmi_close.c v8>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fbf:[<0x10000000fbb/ipmi_close.c v8>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.168 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.055+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fc1 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_control_event.c auth{0=1} v12 pv119 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.054920+0000 b20772 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc524b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fc1:[<0x10000000fbb/ipmi_control_event.c v12>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fc1:[<0x10000000fbb/ipmi_control_event.c v12>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.168 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.055+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fc0 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/hotswap.c auth{0=1} v10 pv99 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2008-07-26T03:51:45.000000+0000 b23974 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc525080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fc0:[<0x10000000fbb/hotswap.c v10>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fc0:[<0x10000000fbb/hotswap.c v10>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.168 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.056+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fc7 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.sym auth{0=1} v24 pv89 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.061920+0000 b44 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc525600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fc7:[<0x10000000fbb/ipmi.sym v24>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fc7:[<0x10000000fbb/ipmi.sym v24>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.168 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.057+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fcb [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/posix_vlog.c auth{0=1} v32 pv121 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.064920+0000 b1716 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc525b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fcb:[<0x10000000fbb/posix_vlog.c v32>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fcb:[<0x10000000fbb/posix_vlog.c v32>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.168 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.057+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fd7 [...2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/ auth{0=1} v62 pv127 ap=4 f(v0 m2024-06-03T00:02:34.077920+0000 3=3+0)->f(v0 m2024-06-03T00:02:34.077920+0000 3=3+0) n(v0 rc2024-06-03T00:02:34.077920+0000 4=3+1)->n(v0 rc2024-06-03T00:02:34.078920+0000 b31504 4=3+1) (inest lock w=3) (ifile excl) (iversion lock w=3) caps={24895=pAsLsXsFsx/pAsLsXsFsx@1},l=24895 | lock=2 importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc526100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000fd7:[<0x10000000fbb/t v62>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(2)0x10000000fd7:[<0x10000000fbb/t v62>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-06-03T00:02:34.077920+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-06-03T00:02:34.077920+0000 4=3+1)","memory_value.dirstat":"f(v0 m2024-06-03T00:02:34.077920+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-06-03T00:02:34.077920+0000 4=3+1)","error_str":""},"return_code":0} 2024-06-03T00:02:46.168 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.057+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fd9 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/Makefile.in auth v4 pv10 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.077920+0000 b16625 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc53c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fd9:[<0x10000000fd7/Makefile.in v4>,<0x10000000fbb/t v62>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fd9:[<0x10000000fd7/Makefile.in v4>,<0x10000000fbb/t v62>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.168 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.057+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fd8 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/ipmi_thres_test.c auth v2 pv8 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.076920+0000 b12899 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc53d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fd8:[<0x10000000fd7/ipmi_thres_test.c v2>,<0x10000000fbb/t v62>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fd8:[<0x10000000fd7/ipmi_thres_test.c v2>,<0x10000000fbb/t v62>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.168 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.057+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fda [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/Makefile.am auth v6 pv12 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.078920+0000 b1980 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc53cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fda:[<0x10000000fd7/Makefile.am v6>,<0x10000000fbb/t v62>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fda:[<0x10000000fd7/Makefile.am v6>,<0x10000000fbb/t v62>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.168 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.057+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fc5 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.h auth{0=1} v20 pv103 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.059920+0000 b27129 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc526680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fc5:[<0x10000000fbb/ipmi.h v20>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fc5:[<0x10000000fbb/ipmi.h v20>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.168 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.058+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fc2 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_connection.c auth{0=1} v14 pv87 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.056920+0000 b2814 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc526c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fc2:[<0x10000000fbb/ipmi_connection.c v14>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fc2:[<0x10000000fbb/ipmi_connection.c v14>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.168 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.058+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fd2 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/Makefile.in auth{0=1} v46 pv115 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.071920+0000 b25104 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc527180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fd2:[<0x10000000fbb/Makefile.in v46>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fd2:[<0x10000000fbb/Makefile.in v46>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.168 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.059+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fbd [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_vshm_rdrs.c auth{0=1} v4 pv81 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.051920+0000 b9052 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc527700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fbd:[<0x10000000fbb/atca_vshm_rdrs.c v4>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fbd:[<0x10000000fbb/atca_vshm_rdrs.c v4>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.169 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.060+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fd0 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_mc_event.c auth{0=1} v42 pv95 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.069920+0000 b4780 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc52e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fd0:[<0x10000000fbb/ipmi_mc_event.c v42>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fd0:[<0x10000000fbb/ipmi_mc_event.c v42>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.169 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.060+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fd3 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_shelf_fru.c auth{0=1} v48 pv109 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.072920+0000 b35693 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc52e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fd3:[<0x10000000fbb/atca_shelf_fru.c v48>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fd3:[<0x10000000fbb/atca_shelf_fru.c v48>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.169 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.061+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fce [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_entity.c auth{0=1} v38 pv77 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2007-06-25T15:44:53.000000+0000 b547 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc52eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fce:[<0x10000000fbb/ipmi_entity.c v38>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fce:[<0x10000000fbb/ipmi_entity.c v38>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.169 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.061+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fcc [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.c auth{0=1} v34 pv75 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.065920+0000 b69212 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc52f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fcc:[<0x10000000fbb/ipmi.c v34>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fcc:[<0x10000000fbb/ipmi.c v34>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.169 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.062+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fd4 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_shelf_rdrs.c auth{0=1} v50 pv105 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.073920+0000 b56559 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc52f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fd4:[<0x10000000fbb/atca_shelf_rdrs.c v50>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fd4:[<0x10000000fbb/atca_shelf_rdrs.c v50>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.169 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.063+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fdb [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/Makefile.am auth{0=1} v64 pv71 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2008-07-26T03:51:45.000000+0000 b2624 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc52fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fdb:[<0x10000000fbb/Makefile.am v64>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fdb:[<0x10000000fbb/Makefile.am v64>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.169 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.063+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fca [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_inventory_event.c auth{0=1} v30 pv97 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.063920+0000 b8463 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc530100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fca:[<0x10000000fbb/ipmi_inventory_event.c v30>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fca:[<0x10000000fbb/ipmi_inventory_event.c v30>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.169 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.064+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fbc [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_entity_event.c auth{0=1} v2 pv117 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.050920+0000 b26929 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc530680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fbc:[<0x10000000fbb/ipmi_entity_event.c v2>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fbc:[<0x10000000fbb/ipmi_entity_event.c v2>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.169 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.064+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fc8 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/sync.c auth{0=1} v26 pv113 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.062920+0000 b1285 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc530c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fc8:[<0x10000000fbb/sync.c v26>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fc8:[<0x10000000fbb/sync.c v26>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.169 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.065+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fc6 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_inventory.c auth{0=1} v22 pv107 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.060920+0000 b72434 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc531180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fc6:[<0x10000000fbb/ipmi_inventory.c v22>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fc6:[<0x10000000fbb/ipmi_inventory.c v22>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.169 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.066+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fd6 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_slot_rdrs.c auth{0=1} v54 pv91 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.074920+0000 b28405 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc531700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fd6:[<0x10000000fbb/atca_slot_rdrs.c v54>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fd6:[<0x10000000fbb/atca_slot_rdrs.c v54>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.169 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.066+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fd5 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_util.c auth{0=1} v52 pv123 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2008-07-26T03:51:45.000000+0000 b10962 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc53a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fd5:[<0x10000000fbb/ipmi_util.c v52>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fd5:[<0x10000000fbb/ipmi_util.c v52>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.170 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.067+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fc9 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_drv.c auth{0=1} v28 pv93 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2008-07-26T03:51:45.000000+0000 b9092 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc53a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fc9:[<0x10000000fbb/ipmi_drv.c v28>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fc9:[<0x10000000fbb/ipmi_drv.c v28>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.170 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.067+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fc4 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_controls.c auth{0=1} v18 pv129 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.058920+0000 b31969 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc53ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fc4:[<0x10000000fbb/ipmi_controls.c v18>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fc4:[<0x10000000fbb/ipmi_controls.c v18>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.170 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.068+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fcf [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sel.c auth{0=1} v40 pv79 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.068920+0000 b12459 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc53b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fcf:[<0x10000000fbb/ipmi_sel.c v40>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fcf:[<0x10000000fbb/ipmi_sel.c v40>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.170 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.068+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fd1 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_fru_rdrs.c auth{0=1} v44 pv131 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.070920+0000 b56474 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc53b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fd1:[<0x10000000fbb/atca_fru_rdrs.c v44>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fd1:[<0x10000000fbb/atca_fru_rdrs.c v44>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.170 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.069+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fdc [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sensor.c auth{0=1} v66 pv69 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.079920+0000 b36526 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc53bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fdc:[<0x10000000fbb/ipmi_sensor.c v66>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fdc:[<0x10000000fbb/ipmi_sensor.c v66>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.170 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.069+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fcd [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_event.c auth{0=1} v36 pv73 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.067920+0000 b2455 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc53c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fcd:[<0x10000000fbb/ipmi_event.c v36>,<0x10000000fba/ipmi v62>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fcd:[<0x10000000fbb/ipmi_event.c v36>,<0x10000000fba/ipmi v658>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.170 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.070+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ff3 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_resource.h auth{0=1} v34 pv269 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2007-11-05T10:22:00.000000+0000 b3801 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc53d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ff3:[<0x10000000fe2/ipmi_resource.h v34>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000ff3:[<0x10000000fe2/ipmi_resource.h v34>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.170 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.070+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fea [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_rdr.h auth{0=1} v16 pv207 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.091919+0000 b2083 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc548000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fea:[<0x10000000fe2/ipmi_rdr.h v16>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fea:[<0x10000000fe2/ipmi_rdr.h v16>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.170 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.071+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fff [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_utils.h auth{0=1} v58 pv317 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.112919+0000 b3722 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc548580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fff:[<0x10000000fe2/ipmi_utils.h v58>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fff:[<0x10000000fe2/ipmi_utils.h v58>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.170 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.071+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001005 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc.h auth{0=1} v70 pv251 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.117919+0000 b5887 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc548b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001005:[<0x10000000fe2/ipmi_mc.h v70>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001005:[<0x10000000fe2/ipmi_mc.h v70>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.170 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.072+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001002 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_msg.cpp auth{0=1} v64 pv305 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.115919+0000 b1287 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc549080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001002:[<0x10000000fe2/ipmi_msg.cpp v64>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001002:[<0x10000000fe2/ipmi_msg.cpp v64>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.171 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.072+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001015 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_force.cpp auth{0=1} v102 pv215 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.133918+0000 b6036 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc549600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001015:[<0x10000000fe2/ipmi_mc_vendor_force.cpp v102>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001015:[<0x10000000fe2/ipmi_mc_vendor_force.cpp v102>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.171 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.073+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fe8 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi.cpp auth{0=1} v12 pv353 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.089919+0000 b57338 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc549b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fe8:[<0x10000000fe2/ipmi.cpp v12>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fe8:[<0x10000000fe2/ipmi.cpp v12>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.171 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.073+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ffd [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_fru_info.h auth{0=1} v54 pv315 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.110919+0000 b2849 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc54a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ffd:[<0x10000000fe2/ipmi_fru_info.h v54>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000ffd:[<0x10000000fe2/ipmi_fru_info.h v54>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.171 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.074+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ff9 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_threshold.cpp auth{0=1} v46 pv325 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.106919+0000 b38398 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc54a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ff9:[<0x10000000fe2/ipmi_sensor_threshold.cpp v46>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000ff9:[<0x10000000fe2/ipmi_sensor_threshold.cpp v46>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.171 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.075+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001025 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con.cpp auth{0=1} v134 pv245 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.150918+0000 b13026 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc54ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001025:[<0x10000000fe2/ipmi_con.cpp v134>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001025:[<0x10000000fe2/ipmi_con.cpp v134>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.171 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.075+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000101b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/array.h auth{0=1} v114 pv295 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.139918+0000 b4086 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc54b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000101b:[<0x10000000fe2/array.h v114>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000101b:[<0x10000000fe2/array.h v114>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.171 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.076+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000102e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_event.h auth{0=1} v152 pv193 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.158918+0000 b2076 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc54b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000102e:[<0x10000000fe2/ipmi_event.h v152>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000102e:[<0x10000000fe2/ipmi_event.h v152>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.171 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.076+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ffa [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_resource.cpp auth{0=1} v48 pv347 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.107919+0000 b13217 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc556000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ffa:[<0x10000000fe2/ipmi_resource.cpp v48>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000ffa:[<0x10000000fe2/ipmi_resource.cpp v48>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.171 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.077+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fe6 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_log.cpp auth{0=1} v8 pv307 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.088920+0000 b6573 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc556580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fe6:[<0x10000000fe2/ipmi_log.cpp v8>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fe6:[<0x10000000fe2/ipmi_log.cpp v8>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.171 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.078+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000102f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_factors.cpp auth{0=1} v154 pv321 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.159918+0000 b10312 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc556b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000102f:[<0x10000000fe2/ipmi_sensor_factors.cpp v154>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000102f:[<0x10000000fe2/ipmi_sensor_factors.cpp v154>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.172 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.078+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ff1 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_domain.cpp auth{0=1} v30 pv355 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.099919+0000 b24006 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc557080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ff1:[<0x10000000fe2/ipmi_domain.cpp v30>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000ff1:[<0x10000000fe2/ipmi_domain.cpp v30>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.172 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.078+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001017 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_fix_sdr.cpp auth{0=1} v106 pv343 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.135918+0000 b5368 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc557600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001017:[<0x10000000fe2/ipmi_mc_vendor_fix_sdr.cpp v106>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001017:[<0x10000000fe2/ipmi_mc_vendor_fix_sdr.cpp v106>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.172 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.079+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000101e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_domain.h auth{0=1} v120 pv223 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.142918+0000 b5982 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc557b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000101e:[<0x10000000fe2/ipmi_domain.h v120>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000101e:[<0x10000000fe2/ipmi_domain.h v120>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.172 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.079+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001011 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_utils.cpp auth{0=1} v94 pv273 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.129918+0000 b2533 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc558100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001011:[<0x10000000fe2/ipmi_utils.cpp v94>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001011:[<0x10000000fe2/ipmi_utils.cpp v94>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.172 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.080+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001008 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor.h auth{0=1} v76 pv263 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.121919+0000 b6268 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc558680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001008:[<0x10000000fe2/ipmi_mc_vendor.h v76>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001008:[<0x10000000fe2/ipmi_mc_vendor.h v76>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.172 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.080+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001031 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_entity.h auth{0=1} v158 pv293 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.161918+0000 b4513 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc558c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001031:[<0x10000000fe2/ipmi_entity.h v158>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001031:[<0x10000000fe2/ipmi_entity.h v158>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.172 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.081+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001007 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_cmd.cpp auth{0=1} v74 pv333 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.120919+0000 b20190 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc559180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001007:[<0x10000000fe2/ipmi_cmd.cpp v74>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001007:[<0x10000000fe2/ipmi_cmd.cpp v74>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.172 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.082+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000102b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_atca_led.h auth{0=1} v146 pv211 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.155918+0000 b1690 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc559700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000102b:[<0x10000000fe2/ipmi_control_atca_led.h v146>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000102b:[<0x10000000fe2/ipmi_control_atca_led.h v146>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.172 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.082+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000101f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sel.cpp auth{0=1} v122 pv203 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.143918+0000 b21115 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc55e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000101f:[<0x10000000fe2/ipmi_sel.cpp v122>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000101f:[<0x10000000fe2/ipmi_sel.cpp v122>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.172 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.083+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001032 [...2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/ auth{0=1} v174 pv357 ap=8 f(v0 m2024-06-03T00:02:34.167917+0000 7=7+0)->f(v0 m2024-06-03T00:02:34.167917+0000 7=7+0) n(v0 rc2024-06-03T00:02:34.167917+0000 8=7+1)->n(v0 rc2024-06-03T00:02:34.168917+0000 b43450 8=7+1) (inest lock w=7) (ifile excl) (iversion lock w=7) caps={24895=pAsLsXsFsx/pAsLsXsFsx@1},l=24895 | lock=2 importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc55e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001032:[<0x10000000fe2/t v174>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(2)0x10000001032:[<0x10000000fe2/t v174>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-06-03T00:02:34.167917+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2024-06-03T00:02:34.167917+0000 8=7+1)","memory_value.dirstat":"f(v0 m2024-06-03T00:02:34.167917+0000 7=7+0)","memory_value.rstat":"n(v0 rc2024-06-03T00:02:34.167917+0000 8=7+1)","error_str":""},"return_code":0} 2024-06-03T00:02:46.172 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.083+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001035 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/thread_000.cpp auth v6 pv28 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.165917+0000 b1304 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5a3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001035:[<0x10000001032/thread_000.cpp v6>,<0x10000000fe2/t v174>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001035:[<0x10000001032/thread_000.cpp v6>,<0x10000000fe2/t v174>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.172 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.083+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001036 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/sensor_factors_000.cpp auth v8 pv18 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.166917+0000 b2467 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5a4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001036:[<0x10000001032/sensor_factors_000.cpp v8>,<0x10000000fe2/t v174>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001036:[<0x10000001032/sensor_factors_000.cpp v8>,<0x10000000fe2/t v174>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.172 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.083+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001038 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/Makefile.in auth v12 pv16 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.167917+0000 b23602 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5a4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001038:[<0x10000001032/Makefile.in v12>,<0x10000000fe2/t v174>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001038:[<0x10000001032/Makefile.in v12>,<0x10000000fe2/t v174>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.173 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.083+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001037 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/con_001.c auth v10 pv22 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2007-06-25T15:44:56.000000+0000 b8785 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5a4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001037:[<0x10000001032/con_001.c v10>,<0x10000000fe2/t v174>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001037:[<0x10000001032/con_001.c v10>,<0x10000000fe2/t v174>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.173 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.084+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001001 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi.h auth{0=1} v62 pv195 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.114919+0000 b3328 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc55eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001001:[<0x10000000fe2/ipmi.h v62>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001001:[<0x10000000fe2/ipmi.h v62>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.173 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.084+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001039 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/Makefile.am auth v14 pv20 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.168917+0000 b1825 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5a5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001039:[<0x10000001032/Makefile.am v14>,<0x10000000fe2/t v174>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001039:[<0x10000001032/Makefile.am v14>,<0x10000000fe2/t v174>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.173 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.084+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001033 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/test.h auth v2 pv26 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.163918+0000 b484 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5a5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001033:[<0x10000001032/test.h v2>,<0x10000000fe2/t v174>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001033:[<0x10000001032/test.h v2>,<0x10000000fe2/t v174>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.173 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.084+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001034 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/con_000.cpp auth v4 pv24 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.164918+0000 b4983 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5ae000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001034:[<0x10000001032/con_000.cpp v4>,<0x10000000fe2/t v174>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001034:[<0x10000001032/con_000.cpp v4>,<0x10000000fe2/t v174>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.173 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.084+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000101c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_addr.h auth{0=1} v116 pv229 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.140918+0000 b2639 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc55f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000101c:[<0x10000000fe2/ipmi_addr.h v116>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000101c:[<0x10000000fe2/ipmi_addr.h v116>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.173 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.084+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ffc [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_inventory_parser.h auth{0=1} v52 pv277 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.109919+0000 b6058 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc55f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ffc:[<0x10000000fe2/ipmi_inventory_parser.h v52>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000ffc:[<0x10000000fe2/ipmi_inventory_parser.h v52>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.173 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.085+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001029 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_discover.cpp auth{0=1} v142 pv327 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2008-05-05T11:18:17.000000+0000 b18771 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc55fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001029:[<0x10000000fe2/ipmi_discover.cpp v142>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001029:[<0x10000000fe2/ipmi_discover.cpp v142>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.173 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.086+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001010 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con_smi.h auth{0=1} v92 pv189 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.128918+0000 b1201 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc560100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001010:[<0x10000000fe2/ipmi_con_smi.h v92>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001010:[<0x10000000fe2/ipmi_con_smi.h v92>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.173 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.086+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001027 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_intel.h auth{0=1} v138 pv231 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.152918+0000 b2745 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc560680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001027:[<0x10000000fe2/ipmi_mc_vendor_intel.h v138>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001027:[<0x10000000fe2/ipmi_mc_vendor_intel.h v138>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.173 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.087+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000100d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con_lan.cpp auth{0=1} v86 pv221 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.125919+0000 b30029 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc560c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000100d:[<0x10000000fe2/ipmi_con_lan.cpp v86>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000100d:[<0x10000000fe2/ipmi_con_lan.cpp v86>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.173 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.088+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000101a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor.cpp auth{0=1} v112 pv253 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.138918+0000 b31236 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc561180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000101a:[<0x10000000fe2/ipmi_mc_vendor.cpp v112>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000101a:[<0x10000000fe2/ipmi_mc_vendor.cpp v112>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.174 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.088+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fe4 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_fan.h auth{0=1} v4 pv185 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.086920+0000 b1712 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc561700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fe4:[<0x10000000fe2/ipmi_control_fan.h v4>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fe4:[<0x10000000fe2/ipmi_control_fan.h v4>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.174 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.089+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001009 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_hotswap.h auth{0=1} v78 pv209 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.122919+0000 b1427 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc56c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001009:[<0x10000000fe2/ipmi_sensor_hotswap.h v78>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001009:[<0x10000000fe2/ipmi_sensor_hotswap.h v78>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.174 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.090+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001024 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor.h auth{0=1} v132 pv339 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.148918+0000 b10243 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc56c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001024:[<0x10000000fe2/ipmi_sensor.h v132>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001024:[<0x10000000fe2/ipmi_sensor.h v132>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.174 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.090+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001003 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_inventory_parser.cpp auth{0=1} v66 pv299 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2009-04-17T10:52:55.000000+0000 b21410 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc56cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001003:[<0x10000000fe2/ipmi_inventory_parser.cpp v66>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001003:[<0x10000000fe2/ipmi_inventory_parser.cpp v66>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.174 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.091+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001019 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sdr.h auth{0=1} v110 pv191 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.137918+0000 b4550 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc56d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001019:[<0x10000000fe2/ipmi_sdr.h v110>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001019:[<0x10000000fe2/ipmi_sdr.h v110>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.174 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.092+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001022 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_atca_led.cpp auth{0=1} v128 pv283 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.146918+0000 b14302 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc56d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001022:[<0x10000000fe2/ipmi_control_atca_led.cpp v128>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001022:[<0x10000000fe2/ipmi_control_atca_led.cpp v128>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.174 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.093+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001013 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc.cpp auth{0=1} v98 pv267 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.131918+0000 b19427 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc56db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001013:[<0x10000000fe2/ipmi_mc.cpp v98>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001013:[<0x10000000fe2/ipmi_mc.cpp v98>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.174 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.093+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ff2 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_fix_sdr.h auth{0=1} v32 pv213 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2007-06-25T15:44:54.000000+0000 b1332 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc56e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ff2:[<0x10000000fe2/ipmi_mc_vendor_fix_sdr.h v32>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000ff2:[<0x10000000fe2/ipmi_mc_vendor_fix_sdr.h v32>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.174 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.093+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001020 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/Makefile.in auth{0=1} v124 pv197 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.144918+0000 b28313 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc56e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001020:[<0x10000000fe2/Makefile.in v124>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001020:[<0x10000000fe2/Makefile.in v124>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.174 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.094+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000100e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_discrete.h auth{0=1} v88 pv187 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.126919+0000 b1664 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc56ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000100e:[<0x10000000fe2/ipmi_sensor_discrete.h v88>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000100e:[<0x10000000fe2/ipmi_sensor_discrete.h v88>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.174 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.095+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000103a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_force.h auth{0=1} v176 pv303 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.169917+0000 b914 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc56f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000103a:[<0x10000000fe2/ipmi_mc_vendor_force.h v176>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000103a:[<0x10000000fe2/ipmi_mc_vendor_force.h v176>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.174 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.096+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ffe [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_fru_info.cpp auth{0=1} v56 pv255 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.111919+0000 b4753 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc56f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ffe:[<0x10000000fe2/ipmi_fru_info.cpp v56>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000ffe:[<0x10000000fe2/ipmi_fru_info.cpp v56>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.175 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.097+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000102a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_watchdog.h auth{0=1} v144 pv319 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.154918+0000 b1219 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc57a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000102a:[<0x10000000fe2/ipmi_watchdog.h v144>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000102a:[<0x10000000fe2/ipmi_watchdog.h v144>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.175 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.098+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001023 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_addr.cpp auth{0=1} v130 pv247 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.147918+0000 b1420 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc57a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001023:[<0x10000000fe2/ipmi_addr.cpp v130>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001023:[<0x10000000fe2/ipmi_addr.cpp v130>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.175 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.098+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000102d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_cmd.h auth{0=1} v150 pv183 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.157918+0000 b10767 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc57ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000102d:[<0x10000000fe2/ipmi_cmd.h v150>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000102d:[<0x10000000fe2/ipmi_cmd.h v150>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.175 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.099+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001000 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_msg.h auth{0=1} v60 pv329 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.113919+0000 b1192 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc57b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001000:[<0x10000000fe2/ipmi_msg.h v60>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001000:[<0x10000000fe2/ipmi_msg.h v60>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.177 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.099+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001004 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_text_buffer.cpp auth{0=1} v68 pv201 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2007-06-25T15:44:55.000000+0000 b12637 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc57b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001004:[<0x10000000fe2/ipmi_text_buffer.cpp v68>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001004:[<0x10000000fe2/ipmi_text_buffer.cpp v68>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.177 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.100+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000103b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/Makefile.am auth{0=1} v178 pv227 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.170917+0000 b3643 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc57bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000103b:[<0x10000000fe2/Makefile.am v178>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000103b:[<0x10000000fe2/Makefile.am v178>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.177 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.101+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fef [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sel.h auth{0=1} v26 pv285 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.097919+0000 b3923 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc57c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fef:[<0x10000000fe2/ipmi_sel.h v26>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fef:[<0x10000000fe2/ipmi_sel.h v26>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.177 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.101+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001030 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_auth.h auth{0=1} v156 pv291 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.160918+0000 b3854 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc57c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001030:[<0x10000000fe2/ipmi_auth.h v156>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001030:[<0x10000000fe2/ipmi_auth.h v156>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.177 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.102+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001018 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_event.cpp auth{0=1} v108 pv313 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.136918+0000 b4058 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc57cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001018:[<0x10000000fe2/ipmi_event.cpp v108>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001018:[<0x10000000fe2/ipmi_event.cpp v108>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.178 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.102+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001021 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con_lan.h auth{0=1} v126 pv351 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.145918+0000 b3470 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc57d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001021:[<0x10000000fe2/ipmi_con_lan.h v126>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001021:[<0x10000000fe2/ipmi_con_lan.h v126>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.178 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.103+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000100f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/hotswap.cpp auth{0=1} v90 pv311 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.127918+0000 b14676 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc57d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000100f:[<0x10000000fe2/hotswap.cpp v90>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000100f:[<0x10000000fe2/hotswap.cpp v90>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.178 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.104+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000103c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_text_buffer.h auth{0=1} v180 pv331 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.171917+0000 b2510 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc584000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000103c:[<0x10000000fe2/ipmi_text_buffer.h v180>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000103c:[<0x10000000fe2/ipmi_text_buffer.h v180>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.178 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.105+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fec [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_sun_led.cpp auth{0=1} v20 pv219 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.094919+0000 b3740 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc584580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fec:[<0x10000000fe2/ipmi_control_sun_led.cpp v20>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fec:[<0x10000000fe2/ipmi_control_sun_led.cpp v20>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.178 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.105+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fe9 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_discrete.cpp auth{0=1} v14 pv349 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.090919+0000 b7142 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc584b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fe9:[<0x10000000fe2/ipmi_sensor_discrete.cpp v14>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fe9:[<0x10000000fe2/ipmi_sensor_discrete.cpp v14>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.178 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.106+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001026 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/thread.cpp auth{0=1} v136 pv257 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.151918+0000 b5160 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc585080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001026:[<0x10000000fe2/thread.cpp v136>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001026:[<0x10000000fe2/thread.cpp v136>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.178 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.107+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000100c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control.cpp auth{0=1} v84 pv265 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2007-06-25T15:44:54.000000+0000 b1437 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc585600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000100c:[<0x10000000fe2/ipmi_control.cpp v84>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000100c:[<0x10000000fe2/ipmi_control.cpp v84>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.178 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.107+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ff6 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_auth.cpp auth{0=1} v40 pv275 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.103919+0000 b3836 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc585b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ff6:[<0x10000000fe2/ipmi_auth.cpp v40>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000ff6:[<0x10000000fe2/ipmi_auth.cpp v40>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.178 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.108+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000100a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/thread.h auth{0=1} v80 pv271 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.123919+0000 b2333 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc586100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000100a:[<0x10000000fe2/thread.h v80>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000100a:[<0x10000000fe2/thread.h v80>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.178 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.109+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ffb [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con.h auth{0=1} v50 pv289 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.108919+0000 b5000 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc586680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ffb:[<0x10000000fe2/ipmi_con.h v50>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000ffb:[<0x10000000fe2/ipmi_con.h v50>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.178 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.109+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fed [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_sun.cpp auth{0=1} v22 pv323 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.095919+0000 b2492 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc586c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fed:[<0x10000000fe2/ipmi_mc_vendor_sun.cpp v22>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fed:[<0x10000000fe2/ipmi_mc_vendor_sun.cpp v22>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.178 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.110+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000101d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_inventory.h auth{0=1} v118 pv217 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.141918+0000 b1756 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc587180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000101d:[<0x10000000fe2/ipmi_inventory.h v118>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000101d:[<0x10000000fe2/ipmi_inventory.h v118>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.178 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.111+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001028 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_sun.h auth{0=1} v140 pv205 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.153918+0000 b884 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc587700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001028:[<0x10000000fe2/ipmi_mc_vendor_sun.h v140>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001028:[<0x10000000fe2/ipmi_mc_vendor_sun.h v140>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.179 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.111+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ff5 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_inventory.cpp auth{0=1} v38 pv243 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.102919+0000 b4274 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc594000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ff5:[<0x10000000fe2/ipmi_inventory.cpp v38>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000ff5:[<0x10000000fe2/ipmi_inventory.cpp v38>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.179 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.112+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ff7 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_discover.h auth{0=1} v42 pv337 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.104919+0000 b2315 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc594580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ff7:[<0x10000000fe2/ipmi_discover.h v42>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000ff7:[<0x10000000fe2/ipmi_discover.h v42>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.179 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.112+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000102c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_sun_led.h auth{0=1} v148 pv279 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.156918+0000 b1690 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc594b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000102c:[<0x10000000fe2/ipmi_control_sun_led.h v148>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000102c:[<0x10000000fe2/ipmi_control_sun_led.h v148>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.179 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.113+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000feb [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sdr.cpp auth{0=1} v18 pv335 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.093919+0000 b41337 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc595080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000feb:[<0x10000000fe2/ipmi_sdr.cpp v18>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000feb:[<0x10000000fe2/ipmi_sdr.cpp v18>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.179 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.113+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001012 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_watchdog.cpp auth{0=1} v96 pv309 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.130918+0000 b5019 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc595600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001012:[<0x10000000fe2/ipmi_watchdog.cpp v96>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001012:[<0x10000000fe2/ipmi_watchdog.cpp v96>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.179 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.114+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ff8 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_intel.cpp auth{0=1} v44 pv199 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.105919+0000 b11063 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc595b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ff8:[<0x10000000fe2/ipmi_mc_vendor_intel.cpp v44>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000ff8:[<0x10000000fe2/ipmi_mc_vendor_intel.cpp v44>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.179 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.114+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000100b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_rdr.cpp auth{0=1} v82 pv281 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.124919+0000 b2339 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc596100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000100b:[<0x10000000fe2/ipmi_rdr.cpp v82>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000100b:[<0x10000000fe2/ipmi_rdr.cpp v82>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.179 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.116+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fe7 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_fan.cpp auth{0=1} v10 pv287 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2007-06-25T15:44:54.000000+0000 b4109 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc596680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fe7:[<0x10000000fe2/ipmi_control_fan.cpp v10>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fe7:[<0x10000000fe2/ipmi_control_fan.cpp v10>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.179 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.116+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fee [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor.cpp auth{0=1} v24 pv237 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.096919+0000 b20241 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc596c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fee:[<0x10000000fe2/ipmi_sensor.cpp v24>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fee:[<0x10000000fe2/ipmi_sensor.cpp v24>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.179 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.116+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ff4 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_factors.h auth{0=1} v36 pv261 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.101919+0000 b3508 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc597180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ff4:[<0x10000000fe2/ipmi_sensor_factors.h v36>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000ff4:[<0x10000000fe2/ipmi_sensor_factors.h v36>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.179 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.117+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fe3 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_hotswap.cpp auth{0=1} v2 pv235 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.085920+0000 b9401 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc597700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fe3:[<0x10000000fe2/ipmi_sensor_hotswap.cpp v2>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fe3:[<0x10000000fe2/ipmi_sensor_hotswap.cpp v2>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.179 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.118+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fe5 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con_smi.cpp auth{0=1} v6 pv297 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.087920+0000 b11123 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5a2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fe5:[<0x10000000fe2/ipmi_con_smi.cpp v6>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000fe5:[<0x10000000fe2/ipmi_con_smi.cpp v6>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:46.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:46.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:46.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:46.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:46.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:46.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:46.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001338 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000136e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/38-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001350 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/sigmacrolist.txt) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000135f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/31-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001370 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/34-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.201 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013a8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.202 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001387 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-37.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.202 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001392 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.202 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013d3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.202 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013cc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.202 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000012f3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.202 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001331 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.202 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001300 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.202 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000012ef (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/unistd_h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.202 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000138e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-26.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.202 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000133f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-38.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.202 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001355 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-18.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.202 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000137e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.202 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000137a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/2-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.202 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001373 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-29.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.203 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000134f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-32.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.203 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001376 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/29-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.203 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001341 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/20-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.203 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001391 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/2-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.203 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000137c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/13-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.203 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001385 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/36-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.203 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000133e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-15.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.203 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001363 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/45-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.203 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001384 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-22.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.203 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000134a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/23-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.203 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001345 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-35.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.203 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001375 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-5.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.203 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001360 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/15-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.203 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001359 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-24.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.204 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001348 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-31.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.204 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001389 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/48-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.204 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000136c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/43-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.204 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000135b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.204 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001349 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.204 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000133c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.204 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001364 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-36.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.204 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001366 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-20.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.204 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000133b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/27-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.204 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001356 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/14-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.204 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001383 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-34.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.204 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001378 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/2-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.204 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000136d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.204 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001379 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.205 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000134e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/coverage.txt) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.205 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001347 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/40-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.205 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000134c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/24-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.205 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001343 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/47-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.205 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001344 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/39-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.205 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001346 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-10.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.205 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001361 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/35-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.205 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001372 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/50-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.205 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000136b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-33.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.205 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000138d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-39.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.205 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001382 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/4-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.205 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001371 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-8.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.205 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001368 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.205 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001381 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/26-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.205 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001357 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.206 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000133a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/37-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.206 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000135c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/42-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.206 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000133d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/3-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.206 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000135a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-25.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.206 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001365 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-27.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.206 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001380 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-19.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.206 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001358 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/5-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.206 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001390 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-40.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.206 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000136a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-21.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.206 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000137d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-6.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.206 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000138b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.206 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001351 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/18-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.206 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001362 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/44-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.206 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000134d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.207 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001352 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/make22tests) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.207 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000135d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-17.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.207 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001342 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/41-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.207 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000138c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/17-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.211 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001386 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/25-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.211 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000137b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-30.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.212 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001367 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-16.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.212 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001388 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/30-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.212 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001377 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-12.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.212 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001340 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-28.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.212 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000137f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/49-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.212 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001353 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/33-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.212 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001369 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/46-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.212 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001354 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/28-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.212 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000138a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/16-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.212 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000138f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-23.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.212 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001339 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-9.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.212 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000135e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/32-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.212 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000136f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/assertions.xml) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.213 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000134b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/19-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.213 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001374 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/21-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.213 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000012f1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/unistd_h/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.213 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000012f0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/unistd_h/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.213 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000012f2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/unistd_h/assertions.xml) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.213 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000131c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/34-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.213 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001315 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/31-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.213 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000131e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/7-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.213 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001322 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/22-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.213 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001330 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/35-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.213 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001320 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/29-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.213 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001326 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/3-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.213 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001321 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/13-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.213 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001306 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/23-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.214 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001318 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/15-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.214 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001304 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/20-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.214 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000131d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/12-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.214 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001316 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/7-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.214 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001301 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/27-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.214 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000130f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/14-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.214 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001313 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.214 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000130a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/coverage.txt) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.214 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000130c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/35-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.214 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001308 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/24-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.214 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001319 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/35-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.214 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000131a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/8-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.214 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001324 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/4-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.214 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000132c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/3-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.215 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001317 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/7-5.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.215 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001323 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/26-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.215 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001310 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.215 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001309 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/6-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.215 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001312 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/6-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.215 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001302 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/3-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.215 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000132a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/7-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.215 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001305 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/10-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.215 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001311 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/5-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.215 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000130b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/18-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.215 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001303 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/9-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.215 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001329 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/11-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.215 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000132b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/17-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.215 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000132d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/6-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.216 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000132f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/3-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.216 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001325 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/25-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.216 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001327 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/30-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.216 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001328 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/16-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.216 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000130d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/33-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.216 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000130e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/28-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.216 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001314 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/32-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.216 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000131b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/assertions.xml) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.216 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001307 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/19-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.216 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000131f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/21-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.216 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001333 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/1-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.216 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001335 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.216 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000132e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/7-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.216 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001337 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/4-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.216 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001334 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.217 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001332 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/3-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.217 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001336 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/assertions.xml) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.217 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000012fd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/7-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.217 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000012fa (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.217 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000012fb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/8-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.217 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000012fe (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/4-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.217 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000012f7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.217 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000012f9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/6-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.217 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000012f4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/3-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.217 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000012f8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/5-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.218 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000012f6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/10-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.218 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000012f5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/9-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.218 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000012ff (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/11-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.218 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000012fc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/assertions.xml) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.218 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013cf (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.218 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013d1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/4-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.218 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013cd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/3-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.218 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013d2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/3-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.218 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013ce (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.218 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013d0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/assertions.xml) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.218 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000139d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/15-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.218 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013a2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/13-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.218 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013a0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/12-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.218 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001399 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/8-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.219 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000139a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/14-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.219 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000139c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.219 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001397 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/coverage.txt) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.219 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000139e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/8-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.219 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013a3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/4-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.219 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001393 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/8-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.219 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000139b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.219 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001394 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/3-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.219 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001395 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/10-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.219 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001398 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/18-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.219 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013a4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/8-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.219 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013a5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/16-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.219 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013a6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/11-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.219 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013a7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/17-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.220 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000139f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/assertions.xml) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.220 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001396 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/19-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.220 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013d4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.220 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013e9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.220 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013bd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/7-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.220 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013b7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/10.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.220 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013c2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-10.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.220 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013c5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.220 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013ab (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/20-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.220 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013c3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/13-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.220 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013c0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-8.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.220 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013be (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.220 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013b6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/15-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.220 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013b0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/14-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.221 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013bc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/12-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.221 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013ba (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.221 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013c1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/2-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.221 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013b5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.221 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013ae (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/coverage.txt) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.221 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013b8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.221 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013b9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/8-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.221 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013c4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/4-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.221 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013b1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.221 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013ca (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.221 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013b4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/6-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.221 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013a9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.221 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013bf (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-6.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.221 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013b3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/5-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.221 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013af (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/18-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.222 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013aa (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/9-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.222 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013c9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-9.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.222 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013c7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/11-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.222 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013b2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-12.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.222 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013c8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/17-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.222 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013cb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.222 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013c6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/16-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.222 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013ac (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-5.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.222 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013bb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/assertions.xml) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.222 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013ad (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/19-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.222 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013e1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/7-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.222 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013e8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/12-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.222 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013e0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/12-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.222 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013dd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/7-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.223 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013dc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.223 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013e3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/2-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.223 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013d8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/coverage.txt) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.223 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013de (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/8-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.223 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013e4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/4-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.223 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013d9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.223 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013db (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/6-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.223 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013d5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/3-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.223 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013e6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/7-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.223 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013da (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/5-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.223 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013d7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/10-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.223 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013d6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/9-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.223 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013e2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/12-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.223 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013e5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/11-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.223 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013df (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/assertions.xml) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.224 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013e7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/7-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.224 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001403 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/7-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.224 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001407 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/2-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.224 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001409 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/22-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.224 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013ee (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/4-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.224 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001405 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/4-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.224 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013fe (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/9-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.224 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013ef (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/20-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.224 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001412 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/2-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.224 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001408 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/13-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.224 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013f1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/23-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.224 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013ff (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/15-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.224 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001402 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/12-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.224 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013fc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/7-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.225 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013fb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/5-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.225 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013f6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/14-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.225 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013fa (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.225 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013f4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/coverage.txt) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.225 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001406 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/2-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.225 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000140a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/4-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.225 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001400 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/8-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.225 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013fd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/7-5.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.225 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001410 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/3-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.225 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013ea (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/8-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.225 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013f3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/24-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.225 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013f7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.225 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013f9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/6-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.225 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013eb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/3-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.226 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000140e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/7-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.226 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013f8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/5-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.226 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013f0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/10-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.226 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013f5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/18-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.226 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013ec (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/9-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.226 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000140d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/11-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.226 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000140f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/17-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.226 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001413 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/3-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.226 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000140b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/8-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.226 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000140c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/16-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.226 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013ed (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/9-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.226 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001401 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/assertions.xml) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.226 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000013f2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/19-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.228 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:46.228 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:46.229 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:46.229 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:46.229 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:46.229 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:46.229 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:46.229 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001338 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.229 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000136e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/38-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.229 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001350 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/sigmacrolist.txt) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.229 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000135f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/31-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.229 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001370 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/34-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.229 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013a8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.229 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001387 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-37.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.229 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001392 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.229 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013d3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.230 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013cc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.230 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000012f3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.230 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001331 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.230 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001300 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.230 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000012ef (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/unistd_h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.230 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000138e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-26.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.230 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000133f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-38.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.230 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001355 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-18.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.230 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000137e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.230 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000137a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/2-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.230 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001373 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-29.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.230 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000134f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-32.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.230 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001376 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/29-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.230 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001341 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/20-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.231 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001391 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/2-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.231 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000137c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/13-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.231 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001385 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/36-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.231 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000133e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-15.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.231 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001363 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/45-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.231 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001384 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-22.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.231 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000134a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/23-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.231 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001345 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-35.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.231 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001375 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-5.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.231 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001360 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/15-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.231 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001359 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-24.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.231 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001348 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-31.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.231 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001389 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/48-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.231 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000136c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/43-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.232 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000135b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.232 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001349 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.232 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000133c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.232 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001364 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-36.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.232 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001366 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-20.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.232 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000133b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/27-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.232 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001356 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/14-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.232 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001383 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-34.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.232 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001378 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/2-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.232 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000136d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.232 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001379 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.232 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000134e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/coverage.txt) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.232 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001347 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/40-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.232 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000134c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/24-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.233 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001343 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/47-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.233 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001344 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/39-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.233 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001346 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-10.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.233 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001361 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/35-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.233 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001372 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/50-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.233 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000136b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-33.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.233 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000138d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-39.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.233 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001382 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/4-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.233 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001371 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-8.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.233 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001368 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.233 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001381 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/26-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.233 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001357 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.233 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000133a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/37-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.233 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000135c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/42-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.234 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000133d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/3-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.234 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000135a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-25.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.234 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001365 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-27.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.234 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001380 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-19.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.234 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001358 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/5-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.234 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001390 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-40.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.234 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000136a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-21.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.234 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000137d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-6.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.234 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000138b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.234 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001351 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/18-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.234 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001362 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/44-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.234 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000134d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.234 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001352 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/make22tests) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.234 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000135d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-17.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.235 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001342 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/41-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.235 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000138c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/17-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.235 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001386 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/25-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.235 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000137b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-30.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.235 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001367 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-16.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.235 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001388 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/30-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.235 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001377 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-12.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.235 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001340 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-28.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.235 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000137f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/49-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.235 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001353 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/33-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.235 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001369 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/46-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.235 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001354 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/28-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.235 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000138a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/16-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.235 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000138f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-23.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.236 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001339 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-9.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.236 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000135e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/32-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.236 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000136f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/assertions.xml) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.236 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000134b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/19-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.236 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001374 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/21-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.236 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000012f1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/unistd_h/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.236 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000012f0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/unistd_h/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.236 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000012f2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/unistd_h/assertions.xml) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.236 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000131c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/34-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.236 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001315 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/31-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.236 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000131e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/7-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.236 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001322 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/22-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.236 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001330 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/35-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.236 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001320 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/29-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.236 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001326 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/3-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.237 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001321 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/13-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.237 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001306 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/23-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.237 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001318 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/15-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.237 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001304 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/20-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.237 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000131d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/12-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.237 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001316 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/7-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.237 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001301 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/27-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.237 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000130f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/14-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.237 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001313 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.237 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000130a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/coverage.txt) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.237 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000130c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/35-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.237 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001308 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/24-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.237 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001319 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/35-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.237 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000131a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/8-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.238 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001324 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/4-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.238 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000132c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/3-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.238 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001317 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/7-5.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.238 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001323 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/26-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.238 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001310 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.238 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001309 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/6-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.238 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001312 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/6-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.238 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001302 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/3-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.238 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000132a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/7-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.238 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001305 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/10-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.238 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001311 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/5-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.238 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000130b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/18-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.238 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001303 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/9-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.238 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001329 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/11-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.239 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000132b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/17-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.239 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000132d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/6-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.239 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000132f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/3-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.239 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001325 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/25-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.239 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001327 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/30-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.239 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001328 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/16-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.239 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000130d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/33-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.239 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000130e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/28-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.239 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001314 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/32-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.239 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000131b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/assertions.xml) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.239 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001307 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/19-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.239 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000131f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/21-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.239 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001333 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/1-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.239 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001335 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.240 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000132e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/7-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.240 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001337 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/4-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.240 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001334 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.240 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001332 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/3-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.240 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001336 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/assertions.xml) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.240 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000012fd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/7-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.240 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000012fa (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.240 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000012fb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/8-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.240 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000012fe (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/4-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.240 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000012f7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.240 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000012f9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/6-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.240 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000012f4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/3-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.240 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000012f8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/5-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.240 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000012f6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/10-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.240 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000012f5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/9-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.241 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000012ff (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/11-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.241 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000012fc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/assertions.xml) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.241 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013cf (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.241 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013d1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/4-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.241 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013cd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/3-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.241 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013d2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/3-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.241 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013ce (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.241 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013d0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/assertions.xml) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.241 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000139d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/15-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.241 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013a2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/13-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.241 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013a0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/12-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.241 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001399 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/8-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.241 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000139a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/14-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.241 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000139c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.242 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001397 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/coverage.txt) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.242 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000139e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/8-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.242 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013a3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/4-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.242 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001393 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/8-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.242 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000139b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.242 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001394 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/3-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.242 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001395 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/10-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.242 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001398 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/18-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.242 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013a4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/8-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.242 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013a5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/16-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.242 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013a6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/11-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.242 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013a7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/17-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.242 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000139f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/assertions.xml) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.242 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001396 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/19-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.243 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013d4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.243 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013e9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.243 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013bd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/7-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.243 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013b7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/10.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.243 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013c2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-10.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.243 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013c5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.243 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013ab (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/20-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.243 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013c3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/13-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.243 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013c0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-8.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.243 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013be (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.243 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013b6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/15-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.243 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013b0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/14-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.243 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013bc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/12-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.243 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013ba (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.244 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013c1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/2-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.244 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013b5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.244 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013ae (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/coverage.txt) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.244 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013b8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.244 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013b9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/8-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.244 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013c4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/4-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.244 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013b1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.244 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013ca (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.244 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013b4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/6-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.244 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013a9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.244 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013bf (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-6.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.244 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013b3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/5-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.244 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013af (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/18-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.244 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013aa (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/9-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.245 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013c9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-9.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.245 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013c7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/11-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.245 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013b2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-12.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.245 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013c8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/17-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.245 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013cb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.245 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013c6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/16-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.245 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013ac (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-5.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.245 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013bb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/assertions.xml) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.245 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013ad (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/19-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.245 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013e1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/7-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.245 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013e8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/12-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.245 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013e0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/12-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.245 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013dd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/7-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.245 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013dc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.246 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013e3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/2-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.246 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013d8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/coverage.txt) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.246 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013de (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/8-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.246 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013e4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/4-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.246 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013d9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.246 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013db (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/6-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.246 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013d5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/3-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.246 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013e6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/7-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.246 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013da (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/5-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.246 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013d7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/10-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.246 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013d6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/9-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.246 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013e2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/12-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.246 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013e5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/11-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.246 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013df (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/assertions.xml) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.247 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013e7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/7-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.247 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001403 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/7-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.247 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001407 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/2-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.247 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001409 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/22-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.247 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013ee (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/4-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.247 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001405 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/4-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.247 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013fe (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/9-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.247 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013ef (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/20-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.247 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001412 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/2-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.247 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001408 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/13-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.247 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013f1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/23-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.247 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013ff (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/15-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.247 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001402 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/12-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.247 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013fc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/7-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.248 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013fb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/5-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.248 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013f6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/14-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.248 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013fa (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.248 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013f4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/coverage.txt) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.248 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001406 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/2-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.248 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000140a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/4-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.248 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001400 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/8-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.248 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013fd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/7-5.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.248 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001410 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/3-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.248 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013ea (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/8-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.248 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013f3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/24-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.248 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013f7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.248 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013f9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/6-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.248 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013eb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/3-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.249 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000140e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/7-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.249 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013f8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/5-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.249 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013f0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/10-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.249 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013f5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/18-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.249 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013ec (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/9-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.249 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000140d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/11-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.249 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000140f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/17-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.249 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001413 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/3-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.249 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000140b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/8-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.249 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000140c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/16-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.249 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013ed (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/9-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.249 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001401 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/assertions.xml) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.249 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000013f2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/19-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.249 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001404 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/21-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.249 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001411 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/7-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.250 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:46.250 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:46.250 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000187d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-95.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.250 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001761 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/9-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.250 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000180d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-91.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.250 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001916 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-35.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.250 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000181b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.250 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001918 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-12.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.250 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001922 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-9.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.250 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001915 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.250 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000185a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-9.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.250 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017a6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-27.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.250 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017e3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.250 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001851 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/README) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.251 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017c4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.251 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001869 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-25.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.251 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001764 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-103.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.251 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001727 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-16.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.251 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018d0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-10.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.251 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001860 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-6.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.251 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017b7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-16.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.251 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018ea (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.251 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001901 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-47.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.251 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001930 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.251 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001831 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-17.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.251 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018ae (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.251 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017d3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-8.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.251 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001862 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-58.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.252 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001798 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-57.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.252 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017ff (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-31.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.252 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017a7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.252 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018bc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.252 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001833 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-36.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.252 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017d9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.252 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000172c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-21.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.252 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000177c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-23.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.252 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001861 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-12.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.252 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001751 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-48.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.252 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000188c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.252 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018ec (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-25.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.252 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001754 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-20.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.252 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018a7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-20.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.253 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001774 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-22.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.253 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001777 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.253 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018ee (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-6.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.253 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001917 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/11-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.253 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000187b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.253 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001809 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-12.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.253 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001919 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.253 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000172b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-25.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.253 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000192b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.253 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018de (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.253 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018bf (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-15.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.253 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001795 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.253 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001781 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-67.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.253 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018f2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.253 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001844 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-80.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.254 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001834 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-17.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.254 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001800 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-25.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.254 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018f6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-21.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.254 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001929 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.254 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018d6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-12.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.254 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018bd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-19.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.254 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017d8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-8.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.254 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001827 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-8.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.254 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001835 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-24.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.254 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001883 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-22.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.254 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000194a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.254 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018d2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.254 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017ce (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-20.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.254 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018f8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.255 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017ad (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-21.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.255 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000174c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-6.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.255 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001822 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-23.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.255 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017f6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-98.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.255 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017e4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.255 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018fa (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-5.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.255 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001938 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-26.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.255 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017c9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-87.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.255 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000183f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-40.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.255 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017a9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.255 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000181d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-18.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.255 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001888 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-23.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.255 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001865 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-26.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.255 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001770 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-60.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.256 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001982 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.256 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001855 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.256 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001793 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-10.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.256 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001908 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.256 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001836 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.256 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001815 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-99.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.256 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000192f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.256 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000190d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.256 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000190b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-23.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.256 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000186d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-18.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.256 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018f7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-25.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.256 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001839 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-15.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.256 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000191c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.256 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018da (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-23.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.257 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018e4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.257 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017cc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-18.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.257 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001849 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-21.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.257 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000185b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.257 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000193b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-15.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.257 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001783 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.257 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001925 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-10.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.257 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001816 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-23.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.257 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000175a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.257 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001884 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-22.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.257 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001927 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-9.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.257 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018a8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-19.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.257 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001752 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-18.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.257 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017b0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-102.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.257 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001905 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-15.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.258 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001889 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-51.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.258 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001846 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-42.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.258 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000193d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-20.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.258 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017b9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.258 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018e5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.258 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001796 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-20.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.258 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000189b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.258 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001847 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-26.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.258 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001944 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-59.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.258 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001829 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.258 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001926 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-24.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.258 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018e7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-32.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.258 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018dd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-12.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.259 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001943 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-6.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.259 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001797 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-37.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.259 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000192d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.259 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000191b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-6.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.259 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001853 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.259 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001876 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-38.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.259 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001808 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-10.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.259 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017c0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-16.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.259 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018e0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.259 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001924 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.259 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017ca (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-15.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.259 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000187c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-8.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.259 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:45 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001772 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-15.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.261 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001404 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/21-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.261 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001411 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/7-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.261 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:46.261 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:46.261 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000187d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-95.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.261 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001761 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/9-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.261 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000180d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-91.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.262 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001916 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-35.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.262 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000181b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.262 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001918 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-12.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.262 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001922 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-9.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.262 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001915 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.262 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000185a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-9.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.262 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017a6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-27.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.262 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017e3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.262 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001851 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/README) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.262 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017c4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.262 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001869 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-25.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.262 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001764 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-103.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.262 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001727 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-16.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.263 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018d0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-10.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.263 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001860 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-6.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.263 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017b7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-16.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.263 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018ea (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.263 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001901 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-47.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.263 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001930 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.263 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001831 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-17.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.263 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018ae (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.263 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017d3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-8.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.263 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001862 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-58.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.263 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001798 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-57.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.263 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017ff (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-31.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.263 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017a7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.263 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018bc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.264 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001833 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-36.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.264 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017d9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.264 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000172c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-21.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.264 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000177c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-23.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.264 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001861 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-12.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.264 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001751 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-48.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.264 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000188c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.264 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018ec (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-25.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.264 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001754 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-20.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.264 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018a7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-20.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.264 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001774 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-22.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.264 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001777 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.264 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018ee (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-6.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.264 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001917 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/11-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.265 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000187b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.265 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001809 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-12.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.265 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001919 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.265 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000172b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-25.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.265 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000192b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.265 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018de (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.265 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018bf (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-15.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.265 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001795 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.265 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001781 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-67.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.265 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018f2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.265 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001844 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-80.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.265 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001834 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-17.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.265 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001800 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-25.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.265 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018f6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-21.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.266 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001929 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.266 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018d6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-12.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.266 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018bd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-19.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.266 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017d8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-8.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.266 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001827 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-8.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.266 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001835 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-24.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.266 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001883 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-22.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.266 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000194a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.266 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018d2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.266 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017ce (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-20.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.266 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018f8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.266 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017ad (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-21.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.266 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000174c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-6.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.266 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001822 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-23.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.267 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017f6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-98.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.267 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017e4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.267 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018fa (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-5.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.267 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001938 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-26.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.267 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017c9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-87.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.267 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000183f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-40.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.267 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017a9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.267 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000181d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-18.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.267 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001888 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-23.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.267 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001865 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-26.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.267 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001770 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-60.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.267 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001982 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.267 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001855 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.267 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001793 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-10.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.268 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001908 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.268 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001836 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.268 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001815 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-99.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.268 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000192f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.268 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000190d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.268 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000190b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-23.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.268 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000186d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-18.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.268 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018f7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-25.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.268 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001839 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-15.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.268 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000191c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.268 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018da (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-23.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.268 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018e4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.268 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017cc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-18.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.268 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001849 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-21.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.269 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000185b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.269 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000193b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-15.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.269 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001783 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.269 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001925 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-10.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.269 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001816 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-23.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.269 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000175a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.269 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001884 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-22.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.269 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001927 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-9.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.269 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018a8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-19.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.269 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001752 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-18.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.269 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017b0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-102.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.269 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001905 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-15.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.269 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001889 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-51.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.269 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001846 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-42.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.270 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000193d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-20.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.270 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017b9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.270 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018e5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.270 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001796 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-20.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.270 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000189b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.270 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001847 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-26.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.270 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001944 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-59.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.270 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001829 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.270 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001926 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-24.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.270 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018e7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-32.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.270 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018dd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-12.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.270 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001943 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-6.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.270 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001797 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-37.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.270 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000192d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.271 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000191b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-6.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.271 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001853 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.271 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001876 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-38.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.271 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001808 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-10.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.271 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017c0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-16.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.271 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018e0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.271 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001924 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.271 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017ca (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-15.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.271 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000187c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-8.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.271 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:45 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001772 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-15.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:46.361 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.118+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001014 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control.h auth{0=1} v100 pv359 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.132918+0000 b1506 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5a2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001014:[<0x10000000fe2/ipmi_control.h v100>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001014:[<0x10000000fe2/ipmi_control.h v100>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.361 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.119+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ff0 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_log.h auth{0=1} v28 pv259 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.098919+0000 b2222 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5a2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ff0:[<0x10000000fe2/ipmi_log.h v28>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000ff0:[<0x10000000fe2/ipmi_log.h v28>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.361 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.119+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001006 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_threshold.h auth{0=1} v72 pv301 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.119919+0000 b11906 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5a3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001006:[<0x10000000fe2/ipmi_sensor_threshold.h v72>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001006:[<0x10000000fe2/ipmi_sensor_threshold.h v72>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.361 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.120+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001016 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_entity.cpp auth{0=1} v104 pv239 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.134918+0000 b5313 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5a3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001016:[<0x10000000fe2/ipmi_entity.cpp v104>,<0x10000000fba/ipmidirect v240>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001016:[<0x10000000fe2/ipmi_entity.cpp v104>,<0x10000000fba/ipmidirect v660>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.361 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.121+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000106b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_event.c auth{0=1} v92 pv399 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.217916+0000 b56332 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5ae580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000106b:[<0x1000000103d/snmp_bc_event.c v92>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000106b:[<0x1000000103d/snmp_bc_event.c v92>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.361 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.121+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000105a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_discover_bc.c auth{0=1} v58 pv425 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.201917+0000 b178242 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5aeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000105a:[<0x1000000103d/snmp_bc_discover_bc.c v58>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000105a:[<0x1000000103d/snmp_bc_discover_bc.c v58>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.361 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.122+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001061 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_resources.h auth{0=1} v72 pv497 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.207916+0000 b21971 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5af080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001061:[<0x1000000103d/snmp_bc_resources.h v72>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001061:[<0x1000000103d/snmp_bc_resources.h v72>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.361 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.123+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000105d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_control.h auth{0=1} v64 pv487 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2007-06-25T15:45:00.000000+0000 b865 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5af600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000105d:[<0x1000000103d/snmp_bc_control.h v64>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000105d:[<0x1000000103d/snmp_bc_control.h v64>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.362 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.123+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001045 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_watchdog.c auth{0=1} v16 pv261 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.179917+0000 b1631 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5afb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001045:[<0x1000000103d/snmp_bc_watchdog.c v16>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001045:[<0x1000000103d/snmp_bc_watchdog.c v16>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.362 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.124+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001042 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_session.c auth{0=1} v10 pv361 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.177917+0000 b17596 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5b0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001042:[<0x1000000103d/snmp_bc_session.c v10>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001042:[<0x1000000103d/snmp_bc_session.c v10>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.362 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.127+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000103f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_inventory.h auth{0=1} v4 pv389 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.174917+0000 b3474 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5b0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000103f:[<0x1000000103d/snmp_bc_inventory.h v4>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000103f:[<0x1000000103d/snmp_bc_inventory.h v4>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.362 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.128+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000106c [...2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/ auth{0=1} v254 pv511 ap=81 f(v0 m2024-06-03T00:02:34.297914+0000 80=80+0)->f(v0 m2024-06-03T00:02:34.297914+0000 80=80+0) n(v0 rc2024-06-03T00:02:34.297914+0000 81=80+1)->n(v0 rc2024-06-03T00:02:34.298914+0000 b1110801 81=80+1) (inest lock w=80) (ifile excl) (iversion lock w=80) caps={24895=pAsLsXsFsx/pAsLsXsFsx@1},l=24895 | lock=2 importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5b0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000106c:[<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(2)0x1000000106c:[<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-06-03T00:02:34.297914+0000 80=80+0)","ondisk_value.rstat":"n(v0 rc2024-06-03T00:02:34.297914+0000 81=80+1)","memory_value.dirstat":"f(v0 m2024-06-03T00:02:34.297914+0000 80=80+0)","memory_value.rstat":"n(v0 rc2024-06-03T00:02:34.297914+0000 81=80+1)","error_str":""},"return_code":0} 2024-06-03T00:02:46.362 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.128+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010a7 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel007.c auth v118 pv288 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.278915+0000 b2866 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5e1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010a7:[<0x1000000106c/tel007.c v118>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010a7:[<0x1000000106c/tel007.c v118>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.362 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.128+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010b4 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset009.c auth v144 pv214 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.290914+0000 b2686 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5e2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010b4:[<0x1000000106c/tsensorset009.c v144>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010b4:[<0x1000000106c/tsensorset009.c v144>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.362 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.128+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ba [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset024.c auth v156 pv318 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.296914+0000 b2851 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5e2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010ba:[<0x1000000106c/tsensorset024.c v156>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010ba:[<0x1000000106c/tsensorset024.c v156>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.362 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.129+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001091 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/treset001.c auth v74 pv274 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.255915+0000 b3899 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5e2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001091:[<0x1000000106c/treset001.c v74>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001091:[<0x1000000106c/treset001.c v74>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.362 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.129+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001063 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_el.h auth{0=1} v76 pv469 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.209916+0000 b908 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5b1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001063:[<0x1000000103d/snmp_bc_el.h v76>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001063:[<0x1000000103d/snmp_bc_el.h v76>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.362 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.129+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000104d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_sel.h auth{0=1} v32 pv337 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.187917+0000 b2669 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5b1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000104d:[<0x1000000103d/snmp_bc_sel.h v32>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000104d:[<0x1000000103d/snmp_bc_sel.h v32>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.363 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.129+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001048 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_inventory.c auth{0=1} v22 pv341 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.182917+0000 b25144 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5b8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001048:[<0x1000000103d/snmp_bc_inventory.c v22>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001048:[<0x1000000103d/snmp_bc_inventory.c v22>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.363 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.130+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001062 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_control.c auth{0=1} v74 pv317 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.208916+0000 b11882 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5b8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001062:[<0x1000000103d/snmp_bc_control.c v74>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001062:[<0x1000000103d/snmp_bc_control.c v74>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.363 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.130+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000106d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tcontrol001.c auth v2 pv304 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.218916+0000 b4004 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5e3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000106d:[<0x1000000106c/tcontrol001.c v2>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000106d:[<0x1000000106c/tcontrol001.c v2>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.363 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.130+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001044 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_sensor.h auth{0=1} v14 pv339 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2007-06-25T15:45:02.000000+0000 b3509 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5b8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001044:[<0x1000000103d/snmp_bc_sensor.h v14>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001044:[<0x1000000103d/snmp_bc_sensor.h v14>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.363 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.130+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010a8 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel001.c auth v120 pv220 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2008-07-26T03:51:47.000000+0000 b1417 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5e3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010a8:[<0x1000000106c/tel001.c v120>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010a8:[<0x1000000106c/tel001.c v120>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.363 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.130+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000107c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget013.c auth v32 pv192 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2008-07-26T03:51:47.000000+0000 b3264 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5ea000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000107c:[<0x1000000106c/tsensorget013.c v32>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000107c:[<0x1000000106c/tsensorget013.c v32>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.363 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.131+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001050 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_discover_bc.h auth{0=1} v38 pv503 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.189917+0000 b8236 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5b9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001050:[<0x1000000103d/snmp_bc_discover_bc.h v38>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001050:[<0x1000000103d/snmp_bc_discover_bc.h v38>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.363 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.131+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010b9 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset002.c auth v154 pv186 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.295914+0000 b2731 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5ea580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010b9:[<0x1000000106c/tsensorset002.c v154>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010b9:[<0x1000000106c/tsensorset002.c v154>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.363 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.131+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000105e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc.h auth{0=1} v66 pv369 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.204916+0000 b4245 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5b9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000105e:[<0x1000000103d/snmp_bc.h v66>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000105e:[<0x1000000103d/snmp_bc.h v66>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.363 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.131+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000107d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/sim_file.c auth v34 pv306 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.233916+0000 b7480 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5eab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000107d:[<0x1000000106c/sim_file.c v34>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000107d:[<0x1000000106c/sim_file.c v34>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.363 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.131+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001074 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv003.c auth v16 pv196 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.224916+0000 b3476 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5eb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001074:[<0x1000000106c/tinv003.c v16>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001074:[<0x1000000106c/tinv003.c v16>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.364 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.132+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001085 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset019.c auth v50 pv264 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2007-06-25T15:45:10.000000+0000 b2695 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5eb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001085:[<0x1000000106c/tsensorset019.c v50>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001085:[<0x1000000106c/tsensorset019.c v50>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.364 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.132+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010a1 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/thotswap001.c auth v106 pv226 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.271915+0000 b4931 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5ebb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010a1:[<0x1000000106c/thotswap001.c v106>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010a1:[<0x1000000106c/thotswap001.c v106>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.364 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.132+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001053 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_sel.c auth{0=1} v44 pv411 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.192917+0000 b38901 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5b9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001053:[<0x1000000103d/snmp_bc_sel.c v44>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001053:[<0x1000000103d/snmp_bc_sel.c v44>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.364 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.132+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010bc [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset006.c auth v160 pv242 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.298914+0000 b2742 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5ec100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010bc:[<0x1000000106c/tsensorset006.c v160>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010bc:[<0x1000000106c/tsensorset006.c v160>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.364 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.132+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010a6 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsim_file.c auth v116 pv320 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.277915+0000 b1744 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5ec680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010a6:[<0x1000000106c/tsim_file.c v116>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010a6:[<0x1000000106c/tsim_file.c v116>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.364 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.132+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001081 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tcontrolfailover.c auth v42 pv250 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.237916+0000 b3838 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5ecc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001081:[<0x1000000106c/tcontrolfailover.c v42>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001081:[<0x1000000106c/tcontrolfailover.c v42>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.364 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.133+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001049 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_xml2event.c auth{0=1} v24 pv343 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.183917+0000 b11406 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5ba100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001049:[<0x1000000103d/snmp_bc_xml2event.c v24>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001049:[<0x1000000103d/snmp_bc_xml2event.c v24>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.364 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.133+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010aa [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset005.c auth v124 pv224 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.280914+0000 b2465 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5ed180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010aa:[<0x1000000106c/tsensorset005.c v124>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010aa:[<0x1000000106c/tsensorset005.c v124>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.364 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.133+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000108e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget004.c auth v68 pv286 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.252915+0000 b1979 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5ed700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000108e:[<0x1000000106c/tsensorget004.c v68>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000108e:[<0x1000000106c/tsensorget004.c v68>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.365 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.133+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ad [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset001.c auth v130 pv302 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.283914+0000 b2468 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5f6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010ad:[<0x1000000106c/tsensorset001.c v130>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010ad:[<0x1000000106c/tsensorset001.c v130>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.365 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.133+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001075 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset020.c auth v18 pv246 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.226916+0000 b1964 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5f6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001075:[<0x1000000106c/tsensorset020.c v18>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001075:[<0x1000000106c/tsensorset020.c v18>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.365 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.134+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001069 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_discover_rsa.c auth{0=1} v88 pv323 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.214916+0000 b10373 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5ba680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001069:[<0x1000000103d/snmp_bc_discover_rsa.c v88>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001069:[<0x1000000103d/snmp_bc_discover_rsa.c v88>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.365 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.134+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010b0 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tpower001.c auth v136 pv270 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.287914+0000 b3921 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5f6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010b0:[<0x1000000106c/tpower001.c v136>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010b0:[<0x1000000106c/tpower001.c v136>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.365 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.134+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000109f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv006.c auth v102 pv166 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.269915+0000 b2908 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5f7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000109f:[<0x1000000106c/tinv006.c v102>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000109f:[<0x1000000106c/tinv006.c v102>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.365 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.134+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001093 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tset_resource_tag.c auth v78 pv202 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.257915+0000 b2712 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5f7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001093:[<0x1000000106c/tset_resource_tag.c v78>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001093:[<0x1000000106c/tset_resource_tag.c v78>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.365 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.135+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001079 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset017.c auth v26 pv210 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.230916+0000 b3352 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5f7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001079:[<0x1000000106c/tsensorset017.c v26>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001079:[<0x1000000106c/tsensorset017.c v26>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.365 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.135+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000104f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_hotswap.h auth{0=1} v36 pv273 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.188917+0000 b1464 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5bac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000104f:[<0x1000000103d/snmp_bc_hotswap.h v36>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000104f:[<0x1000000103d/snmp_bc_hotswap.h v36>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.365 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.135+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010b7 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget040.c auth v150 pv188 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.293914+0000 b1969 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5f8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010b7:[<0x1000000106c/tsensorget040.c v150>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010b7:[<0x1000000106c/tsensorget040.c v150>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.365 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.135+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010a2 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset021.c auth v108 pv260 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.272915+0000 b2751 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5f8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010a2:[<0x1000000106c/tsensorset021.c v108>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010a2:[<0x1000000106c/tsensorset021.c v108>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.365 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.135+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000107e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv004.c auth v36 pv258 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.235916+0000 b3517 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5f8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000107e:[<0x1000000106c/tinv004.c v36>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000107e:[<0x1000000106c/tinv004.c v36>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.366 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.136+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001057 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_power.c auth{0=1} v52 pv327 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.196917+0000 b6217 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5bb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001057:[<0x1000000103d/snmp_bc_power.c v52>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001057:[<0x1000000103d/snmp_bc_power.c v52>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.366 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.136+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010a4 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/thotswap-mhs001.c auth v112 pv234 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.274915+0000 b5207 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5f9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010a4:[<0x1000000106c/thotswap-mhs001.c v112>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010a4:[<0x1000000106c/thotswap-mhs001.c v112>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.366 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.136+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010a0 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget036.c auth v104 pv194 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.270915+0000 b2772 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc5f9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010a0:[<0x1000000106c/tsensorget036.c v104>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010a0:[<0x1000000106c/tsensorget036.c v104>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.366 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.136+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010b6 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel006.c auth v148 pv290 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.292914+0000 b2649 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc604000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010b6:[<0x1000000106c/tel006.c v148>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010b6:[<0x1000000106c/tel006.c v148>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.366 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.136+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001066 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/Makefile.in auth{0=1} v82 pv507 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.212916+0000 b25575 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5bb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001066:[<0x1000000103d/Makefile.in v82>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001066:[<0x1000000103d/Makefile.in v82>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.366 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.136+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ac [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset007.c auth v128 pv168 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.282914+0000 b2816 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc604580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010ac:[<0x1000000106c/tsensorset007.c v128>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010ac:[<0x1000000106c/tsensorset007.c v128>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.366 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.137+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ab [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset018.c auth v126 pv180 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.281914+0000 b3297 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc604b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010ab:[<0x1000000106c/tsensorset018.c v126>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010ab:[<0x1000000106c/tsensorset018.c v126>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.366 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.137+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010a3 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget035.c auth v110 pv312 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.273915+0000 b1163 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc605080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010a3:[<0x1000000106c/tsensorget035.c v110>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010a3:[<0x1000000106c/tsensorget035.c v110>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.366 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.137+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000104c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_time.h auth{0=1} v30 pv509 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.186917+0000 b2661 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5c4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000104c:[<0x1000000103d/snmp_bc_time.h v30>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000104c:[<0x1000000103d/snmp_bc_time.h v30>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.366 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.137+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001078 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel004.c auth v24 pv252 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.229916+0000 b1850 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc605600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001078:[<0x1000000106c/tel004.c v24>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001078:[<0x1000000106c/tel004.c v24>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.366 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.137+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010a9 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset012.c auth v122 pv238 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2008-07-26T03:51:47.000000+0000 b3031 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc605b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010a9:[<0x1000000106c/tsensorset012.c v122>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010a9:[<0x1000000106c/tsensorset012.c v122>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.367 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.137+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001076 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tcontrol003.c auth v20 pv172 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.227916+0000 b4281 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc606100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001076:[<0x1000000106c/tcontrol003.c v20>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001076:[<0x1000000106c/tcontrol003.c v20>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.367 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.137+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001084 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsetup.h auth v48 pv240 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.241915+0000 b2271 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc606680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001084:[<0x1000000106c/tsetup.h v48>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001084:[<0x1000000106c/tsetup.h v48>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.367 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.138+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001052 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_discover.h auth{0=1} v42 pv275 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.191917+0000 b4395 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5c4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001052:[<0x1000000103d/snmp_bc_discover.h v42>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001052:[<0x1000000103d/snmp_bc_discover.h v42>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.367 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.138+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010b2 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv001.c auth v140 pv278 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.288914+0000 b3825 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc607180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010b2:[<0x1000000106c/tinv001.c v140>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010b2:[<0x1000000106c/tinv001.c v140>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.367 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.138+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001088 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget002.c auth v56 pv170 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.246915+0000 b1429 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc606c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001088:[<0x1000000106c/tsensorget002.c v56>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001088:[<0x1000000106c/tsensorget002.c v56>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.367 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.138+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010a5 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/sim_test_file auth v114 pv230 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.276915+0000 b368173 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc607700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010a5:[<0x1000000106c/sim_test_file v114>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010a5:[<0x1000000106c/sim_test_file v114>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.367 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.138+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000108a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel002.c auth v60 pv236 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.248915+0000 b1911 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc610000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000108a:[<0x1000000106c/tel002.c v60>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000108a:[<0x1000000106c/tel002.c v60>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.367 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.138+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000109e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/Makefile.in auth v100 pv218 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.268915+0000 b79041 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc610580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000109e:[<0x1000000106c/Makefile.in v100>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000109e:[<0x1000000106c/Makefile.in v100>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.367 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.139+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000108d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget016.c auth v66 pv284 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.251915+0000 b2227 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc610b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000108d:[<0x1000000106c/tsensorget016.c v66>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000108d:[<0x1000000106c/tsensorget016.c v66>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.367 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.139+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000109d [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv005.c auth v98 pv282 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.266915+0000 b3565 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc611080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000109d:[<0x1000000106c/tinv005.c v98>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000109d:[<0x1000000106c/tinv005.c v98>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.367 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.139+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001092 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset013.c auth v76 pv276 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.256915+0000 b2967 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc611600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001092:[<0x1000000106c/tsensorset013.c v76>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001092:[<0x1000000106c/tsensorset013.c v76>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.368 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.139+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010b3 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset015.c auth v142 pv182 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.289914+0000 b3328 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc611b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010b3:[<0x1000000106c/tsensorset015.c v142>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010b3:[<0x1000000106c/tsensorset015.c v142>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.368 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.140+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000107f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tset_resource_sev.c auth v38 pv216 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.236916+0000 b2620 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc612100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000107f:[<0x1000000106c/tset_resource_sev.c v38>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000107f:[<0x1000000106c/tset_resource_sev.c v38>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.368 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.140+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001067 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_utils.h auth{0=1} v84 pv371 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2007-06-25T15:45:02.000000+0000 b1269 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5c4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001067:[<0x1000000103d/snmp_bc_utils.h v84>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001067:[<0x1000000103d/snmp_bc_utils.h v84>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.368 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.140+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000106a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_el2event.h auth{0=1} v90 pv289 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.216916+0000 b1836 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5c5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000106a:[<0x1000000103d/snmp_bc_el2event.h v90>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000106a:[<0x1000000103d/snmp_bc_el2event.h v90>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.368 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.140+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001086 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/openhpi.conf auth v52 pv212 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.243915+0000 b3731 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc612680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001086:[<0x1000000106c/openhpi.conf v52>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001086:[<0x1000000106c/openhpi.conf v52>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.368 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.140+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000108f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel005.c auth v70 pv266 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.253915+0000 b2595 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc612c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000108f:[<0x1000000106c/tel005.c v70>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000108f:[<0x1000000106c/tel005.c v70>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.368 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.141+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000106f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tdiscover001.c auth v6 pv280 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.220916+0000 b1100 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc613180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000106f:[<0x1000000106c/tdiscover001.c v6>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000106f:[<0x1000000106c/tdiscover001.c v6>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.368 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.141+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001065 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_resources_rsa.c auth{0=1} v80 pv321 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.211916+0000 b84150 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5c5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001065:[<0x1000000103d/snmp_bc_resources_rsa.c v80>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001065:[<0x1000000103d/snmp_bc_resources_rsa.c v80>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.368 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.141+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001095 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget010.c auth v82 pv164 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.259915+0000 b3067 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc613700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001095:[<0x1000000106c/tsensorget010.c v82>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001095:[<0x1000000106c/tsensorget010.c v82>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.368 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.141+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010b8 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/Makefile.am auth v152 pv308 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.294914+0000 b19366 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc618000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010b8:[<0x1000000106c/Makefile.am v152>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010b8:[<0x1000000106c/Makefile.am v152>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.368 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.141+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001073 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tcontrol002.c auth v14 pv190 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.223916+0000 b3057 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc618580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001073:[<0x1000000106c/tcontrol002.c v14>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001073:[<0x1000000106c/tcontrol002.c v14>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.368 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.142+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001060 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_reset.h auth{0=1} v70 pv479 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.206916+0000 b737 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5c5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001060:[<0x1000000103d/snmp_bc_reset.h v70>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001060:[<0x1000000103d/snmp_bc_reset.h v70>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.369 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.142+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001083 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/sim_resources.c auth v46 pv174 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.240916+0000 b368036 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc618b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001083:[<0x1000000106c/sim_resources.c v46>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001083:[<0x1000000106c/sim_resources.c v46>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.369 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.142+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001098 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset008.c auth v88 pv314 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.262915+0000 b3651 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc619080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001098:[<0x1000000106c/tsensorset008.c v88>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001098:[<0x1000000106c/tsensorset008.c v88>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.369 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.142+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010af [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset022.c auth v134 pv200 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.286914+0000 b2830 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc619b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010af:[<0x1000000106c/tsensorset022.c v134>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010af:[<0x1000000106c/tsensorset022.c v134>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.369 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.143+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000107b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset004.c auth v30 pv254 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.232916+0000 b2948 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc619600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000107b:[<0x1000000106c/tsensorset004.c v30>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000107b:[<0x1000000106c/tsensorset004.c v30>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.369 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.143+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000105f [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_discover.c auth{0=1} v68 pv449 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.205916+0000 b19326 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5c6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000105f:[<0x1000000103d/snmp_bc_discover.c v68>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000105f:[<0x1000000103d/snmp_bc_discover.c v68>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.369 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.143+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ae [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tevent.c auth v132 pv300 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.285914+0000 b60066 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc61a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010ae:[<0x1000000106c/tevent.c v132>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010ae:[<0x1000000106c/tevent.c v132>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.369 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.143+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001040 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/eventmap2code.pl auth{0=1} v6 pv427 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.175917+0000 b18577 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5c6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001040:[<0x1000000103d/eventmap2code.pl v6>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001040:[<0x1000000103d/eventmap2code.pl v6>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.369 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.143+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010bb [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset003.c auth v158 pv316 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.297914+0000 b2734 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc61a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010bb:[<0x1000000106c/tsensorset003.c v158>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010bb:[<0x1000000106c/tsensorset003.c v158>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.369 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.144+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001080 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset010.c auth v40 pv262 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2008-07-26T03:51:47.000000+0000 b2914 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc61ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001080:[<0x1000000106c/tsensorset010.c v40>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001080:[<0x1000000106c/tsensorset010.c v40>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.369 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.144+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000108b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget005.c auth v62 pv294 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2007-06-25T15:45:05.000000+0000 b1985 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc61b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000108b:[<0x1000000106c/tsensorget005.c v62>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000108b:[<0x1000000106c/tsensorget005.c v62>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.369 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.144+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010b1 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsptime002.c auth v138 pv184 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2008-07-26T03:51:47.000000+0000 b1357 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc61b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010b1:[<0x1000000106c/tsptime002.c v138>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010b1:[<0x1000000106c/tsptime002.c v138>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.370 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.144+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010bd [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/Makefile.am auth{0=1} v256 pv461 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.299914+0000 b2899 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5c6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010bd:[<0x1000000103d/Makefile.am v256>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010bd:[<0x1000000103d/Makefile.am v256>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.370 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.144+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000107a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tcontrol_parms.c auth v28 pv244 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.231916+0000 b3270 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc62a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000107a:[<0x1000000106c/tcontrol_parms.c v28>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000107a:[<0x1000000106c/tcontrol_parms.c v28>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.370 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.145+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001096 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget001.c auth v84 pv232 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.260915+0000 b1162 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc62a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001096:[<0x1000000106c/tsensorget001.c v84>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001096:[<0x1000000106c/tsensorget001.c v84>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.370 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.145+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001097 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/snmp_utils.c auth v86 pv178 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.261915+0000 b2549 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc62ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001097:[<0x1000000106c/snmp_utils.c v86>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001097:[<0x1000000106c/snmp_utils.c v86>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.370 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.145+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000104b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_sensor.c auth{0=1} v28 pv265 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.185917+0000 b77627 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5c7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000104b:[<0x1000000103d/snmp_bc_sensor.c v28>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000104b:[<0x1000000103d/snmp_bc_sensor.c v28>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.370 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.145+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001077 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget003.c auth v22 pv204 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.228916+0000 b1336 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc62b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001077:[<0x1000000106c/tsensorget003.c v22>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001077:[<0x1000000106c/tsensorget003.c v22>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.370 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.145+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001072 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget041.c auth v12 pv198 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2008-07-26T03:51:47.000000+0000 b2993 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc62b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001072:[<0x1000000106c/tsensorget041.c v12>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001072:[<0x1000000106c/tsensorget041.c v12>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.370 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.145+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001071 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/sim_init.c auth v10 pv248 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.222916+0000 b3994 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc62bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001071:[<0x1000000106c/sim_init.c v10>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001071:[<0x1000000106c/sim_init.c v10>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.370 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.146+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001055 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_power.h auth{0=1} v48 pv259 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2007-06-25T15:45:01.000000+0000 b740 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5c7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001055:[<0x1000000103d/snmp_bc_power.h v48>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001055:[<0x1000000103d/snmp_bc_power.h v48>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.370 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.146+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000109a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv007.c auth v92 pv208 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.264915+0000 b2873 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc62c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000109a:[<0x1000000106c/tinv007.c v92>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000109a:[<0x1000000106c/tinv007.c v92>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.370 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.146+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000108c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset023.c auth v64 pv222 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.249915+0000 b2810 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc62cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000108c:[<0x1000000106c/tsensorset023.c v64>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000108c:[<0x1000000106c/tsensorset023.c v64>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.371 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.146+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000109c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/thotswap-simple001.c auth v96 pv310 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2007-06-25T15:45:04.000000+0000 b3454 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc62c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000109c:[<0x1000000106c/thotswap-simple001.c v96>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000109c:[<0x1000000106c/thotswap-simple001.c v96>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.371 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.147+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001090 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv002.c auth v72 pv228 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.254915+0000 b2820 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc62d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001090:[<0x1000000106c/tinv002.c v72>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001090:[<0x1000000106c/tinv002.c v72>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.371 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.147+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010b5 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsnmp_bc_getset.c auth v146 pv272 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.291914+0000 b3904 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc62d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010b5:[<0x1000000106c/tsnmp_bc_getset.c v146>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000010b5:[<0x1000000106c/tsnmp_bc_getset.c v146>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.371 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.147+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000105b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_annunciator.c auth{0=1} v60 pv353 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.202917+0000 b13161 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5d2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000105b:[<0x1000000103d/snmp_bc_annunciator.c v60>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000105b:[<0x1000000103d/snmp_bc_annunciator.c v60>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.371 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.147+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000109b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget034.c auth v94 pv206 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.265915+0000 b2935 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc634000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000109b:[<0x1000000106c/tsensorget034.c v94>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000109b:[<0x1000000106c/tsensorget034.c v94>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.371 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.147+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001082 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsptime001.c auth v44 pv292 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2007-06-25T15:45:11.000000+0000 b1501 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc634580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001082:[<0x1000000106c/tsptime001.c v44>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001082:[<0x1000000106c/tsptime001.c v44>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.371 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.148+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001068 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_lock.h auth{0=1} v86 pv451 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2007-06-25T15:45:01.000000+0000 b4045 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5d2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001068:[<0x1000000103d/snmp_bc_lock.h v86>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001068:[<0x1000000103d/snmp_bc_lock.h v86>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.371 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.148+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001089 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset011.c auth v58 pv176 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.247915+0000 b2920 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc634b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001089:[<0x1000000106c/tsensorset011.c v58>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001089:[<0x1000000106c/tsensorset011.c v58>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.371 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.148+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001070 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget033.c auth v8 pv256 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.221916+0000 b1928 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc635080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001070:[<0x1000000106c/tsensorget033.c v8>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001070:[<0x1000000106c/tsensorget033.c v8>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.371 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.148+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001099 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsetup.c auth v90 pv298 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.263915+0000 b6677 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc635600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001099:[<0x1000000106c/tsetup.c v90>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001099:[<0x1000000106c/tsetup.c v90>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.371 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.148+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001087 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/sim_resources.h auth v54 pv296 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.245915+0000 b907 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc635b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001087:[<0x1000000106c/sim_resources.h v54>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001087:[<0x1000000106c/sim_resources.h v54>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.371 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.148+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001054 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_event.h auth{0=1} v46 pv391 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.193917+0000 b2106 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5d2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001054:[<0x1000000103d/snmp_bc_event.h v46>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001054:[<0x1000000103d/snmp_bc_event.h v46>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.372 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.148+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001094 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel003.c auth v80 pv162 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.258915+0000 b1880 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc636100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001094:[<0x1000000106c/tel003.c v80>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001094:[<0x1000000106c/tel003.c v80>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.372 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.149+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000106e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget031.c auth v4 pv268 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.219916+0000 b2398 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5643cc636680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000106e:[<0x1000000106c/tsensorget031.c v4>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000106e:[<0x1000000106c/tsensorget031.c v4>,<0x1000000103d/t v254>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.372 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.149+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001047 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_time.c auth{0=1} v20 pv443 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.181917+0000 b12035 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5d3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001047:[<0x1000000103d/snmp_bc_time.c v20>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001047:[<0x1000000103d/snmp_bc_time.c v20>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.372 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.149+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000103e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc.c auth{0=1} v2 pv441 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.173917+0000 b14906 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5d3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000103e:[<0x1000000103d/snmp_bc.c v2>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000103e:[<0x1000000103d/snmp_bc.c v2>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.372 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.150+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001056 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_event.map auth{0=1} v50 pv417 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.195917+0000 b193766 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5d3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001056:[<0x1000000103d/snmp_bc_event.map v50>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001056:[<0x1000000103d/snmp_bc_event.map v50>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.372 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.151+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000104e [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_utils.c auth{0=1} v34 pv331 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2008-07-26T03:51:47.000000+0000 b12432 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5d4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000104e:[<0x1000000103d/snmp_bc_utils.c v34>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000104e:[<0x1000000103d/snmp_bc_utils.c v34>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.372 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.152+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001041 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/sim_init.c auth{0=1} v8 pv379 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.176917+0000 b792 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5d4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001041:[<0x1000000103d/sim_init.c v8>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001041:[<0x1000000103d/sim_init.c v8>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.372 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.152+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001059 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/sim_init.h auth{0=1} v56 pv491 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.199917+0000 b689 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5d4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001059:[<0x1000000103d/sim_init.h v56>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001059:[<0x1000000103d/sim_init.h v56>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.372 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.153+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000105c [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_reset.c auth{0=1} v62 pv293 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.203916+0000 b5109 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5d5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000105c:[<0x1000000103d/snmp_bc_reset.c v62>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000105c:[<0x1000000103d/snmp_bc_reset.c v62>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.372 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.154+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000104a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_annunciator.h auth{0=1} v26 pv315 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.184917+0000 b1699 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5d5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000104a:[<0x1000000103d/snmp_bc_annunciator.h v26>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000104a:[<0x1000000103d/snmp_bc_annunciator.h v26>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.372 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.155+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001064 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_hotswap.c auth{0=1} v78 pv301 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.210916+0000 b13877 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5e0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001064:[<0x1000000103d/snmp_bc_hotswap.c v78>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001064:[<0x1000000103d/snmp_bc_hotswap.c v78>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.372 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.155+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001058 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_resources.c auth{0=1} v54 pv485 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.198917+0000 b527325 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5e0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001058:[<0x1000000103d/snmp_bc_resources.c v54>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001058:[<0x1000000103d/snmp_bc_resources.c v54>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.373 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.156+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001046 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_plugin.h auth{0=1} v18 pv409 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.180917+0000 b1240 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5e0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001046:[<0x1000000103d/snmp_bc_plugin.h v18>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001046:[<0x1000000103d/snmp_bc_plugin.h v18>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.373 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.156+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001051 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_watchdog.h auth{0=1} v40 pv307 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.190917+0000 b908 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5e1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001051:[<0x1000000103d/snmp_bc_watchdog.h v40>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001051:[<0x1000000103d/snmp_bc_watchdog.h v40>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.373 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.156+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001043 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_session.h auth{0=1} v12 pv305 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.178917+0000 b1061 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc5e1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001043:[<0x1000000103d/snmp_bc_session.h v12>,<0x10000000fba/snmp_bc v338>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001043:[<0x1000000103d/snmp_bc_session.h v12>,<0x10000000fba/snmp_bc v662>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.373 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.157+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001189 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/sysfs/Makefile.in auth{0=1} v4 pv14 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.500909+0000 b18288 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc636c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001189:[<0x10000001187/Makefile.in v4>,<0x10000000fba/sysfs v652>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001189:[<0x10000001187/Makefile.in v4>,<0x10000000fba/sysfs v652>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.373 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.158+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000118b [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/sysfs/Makefile.am auth{0=1} v8 pv12 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.503909+0000 b1864 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc637180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000118b:[<0x10000001187/Makefile.am v8>,<0x10000000fba/sysfs v652>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000118b:[<0x10000001187/Makefile.am v8>,<0x10000000fba/sysfs v652>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.373 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.159+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001188 [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/sysfs/README auth{0=1} v2 pv16 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.499909+0000 b851 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc637700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001188:[<0x10000001187/README v2>,<0x10000000fba/sysfs v652>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000001188:[<0x10000001187/README v2>,<0x10000000fba/sysfs v652>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:46.373 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:02:46.159+0000 7f611533d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000118a [2,head] /volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/sysfs/sysfs2hpi.c auth{0=1} v6 pv10 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-06-03T00:02:34.502909+0000 b32501 1=1+0) (ifile excl w=1) cr={24895=0-4194304@1} caps={24895=pAsLsXsFsc/-@1},l=24895(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5643cc642000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000118a:[<0x10000001187/sysfs2hpi.c v6>,<0x10000000fba/sysfs v652>,<0x10000000c2d/plugins v150>,<0x10000000204/open_hpi_testsuite v327>,<0x10000000202/testcases v61>,<0x10000000007/ltp-full-20091231 v40>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v30>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v45>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000118a:[<0x10000001187/sysfs2hpi.c v6>,<0x10000000fba/sysfs v652>,<0x10000000c2d/plugins v576>,<0x10000000204/open_hpi_testsuite v421>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v48>,<0x10000000006/fsstress v48>,<0x10000000005/tmp v39>,<0x100000001fb/client.0 v38>,<0x100000001fa/546bc165-0360-459b-9bed-da0736be50f8 v20>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v30>,<0x1/volumes v52>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-06-03T00:02:47.001 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: pgmap v465: 97 pgs: 97 active+clean; 21 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.6 MiB/s wr, 1.21k op/s 2024-06-03T00:02:47.001 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001880 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-17.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.001 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001769 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-5.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.001 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001782 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-26.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.001 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017af (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.001 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001728 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.001 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001794 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-29.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.001 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017f8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.001 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000191e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.001 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001805 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.002 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000182a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-12.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.002 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017d5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-19.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.002 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000174e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.002 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001928 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-8.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.002 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001949 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-16.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.002 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000190e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-73.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.002 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001913 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-19.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.002 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001825 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.002 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000183c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-12.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.002 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000177f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-6.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.002 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001759 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-15.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.002 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017aa (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.003 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018cb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-8.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.003 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018f5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-17.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.003 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000193c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-24.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.003 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018b0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-33.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.003 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017ba (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-6.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.003 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000183a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-25.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.004 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017b1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-26.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.004 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000175d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-45.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.004 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001765 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-18.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.004 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000186b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-16.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.004 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000178a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.004 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000172f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.005 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017fd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-23.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.005 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001845 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-20.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.005 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001820 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-23.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.005 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017db (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.005 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001937 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-21.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.005 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001788 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-10.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.005 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001873 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.005 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001758 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.005 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018c4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-17.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.005 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017c6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.005 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018b2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.005 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017f0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-33.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.006 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000189e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.006 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017da (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-26.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.006 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017e5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-23.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.006 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018a9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-38.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.006 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001867 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-20.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.006 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000178d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-22.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.006 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001933 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-64.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.006 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000187a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-10.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.006 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018d9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-15.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.006 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000190a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-6.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.006 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001874 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.006 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017dd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-10.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.007 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018ba (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.007 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017cd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/coverage.txt) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.007 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001775 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-5.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.007 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018fd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-19.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.007 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017b4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-8.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.007 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001763 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-24.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.007 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001946 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.007 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000188a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-8.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.007 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000194b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-17.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.007 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018eb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.007 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000186c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.007 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018f3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.007 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000174f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-89.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.008 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001802 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/testfrmw.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.008 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017d4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.008 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000193f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-19.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.008 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001945 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-66.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.008 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000190c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-5.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.008 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001850 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.008 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001838 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-101.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.008 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001887 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.008 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001813 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-17.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.008 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018b6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-18.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.008 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000018e9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.008 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000192e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-20.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.008 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017f2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.009 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017ea (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.009 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000188b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-16.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.009 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000180c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.009 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017dc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-9.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.009 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000181e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-9.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.009 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000017be (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-17.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.009 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001755 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-20.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.009 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.009 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.009 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fde (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/watchdog/watchdog.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.009 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.009 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.009 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fe0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/watchdog/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.010 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fe1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/watchdog/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.010 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.010 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.010 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fdf (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/watchdog/README) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.010 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010cb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_fumi.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.010 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.010 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.010 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010ea (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_reset.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.010 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010c2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_enclosure_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.010 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.010 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.010 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010db (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_resources.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.010 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010ef (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_control.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.011 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.011 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.011 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010f5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.011 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.011 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.011 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010dd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_power.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.011 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.011 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.011 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010c8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_sensor.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.011 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010c1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_callsupport.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.011 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.011 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.011 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010f0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_resources.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.012 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.012 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.012 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010c6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_discover.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.012 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010e7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.012 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.012 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.012 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010bf (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_re_discover.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.012 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010d8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_re_discover.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.012 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.012 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.013 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010c4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_server_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.013 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.013 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.013 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010d0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_interconnect_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.013 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010f4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_ps_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.013 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010ee (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_oa_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.013 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.013 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.013 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010d4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_ps_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.013 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.013 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.013 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010cf (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_fan_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.013 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.014 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.014 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010df (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_control.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.014 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010e9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_utils.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.014 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.014 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010eb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_annunciator.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010e6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_sensor.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010d1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_inventory.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010cd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_fumi.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010d3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_watchdog.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010f2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_hotswap.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010ed (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_dimi.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.020 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010e3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010c3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_calls.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010e5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_annunciator.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010d2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_power.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010e4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_load_id.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010dc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_oa_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010ca (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_watchdog.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010f3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010e8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_inventory.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010da (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_hotswap.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010e0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_callsupport.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010cc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_lcd_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010d9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_interconnect_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010f1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_fan_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010de (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_enclosure_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010c5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_sel.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010d6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_sel.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010e2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_utils.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.023 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010f6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_lcd_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010e1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_server_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010d7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_discover.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010d5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010c9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_calls.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010ce (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_load_id.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010ec (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010c0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_dimi.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010c7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_reset.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001111 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_annunciator_func.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000112f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_watchdog.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.026 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.026 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001126 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_power.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.026 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.026 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.026 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001110 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_hotswap.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.026 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.026 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.026 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000110c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_fumi_func.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.026 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.026 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.026 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001127 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_watchdog.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.026 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.026 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.026 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000112e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_annunciators.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.027 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.027 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.027 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001128 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_el.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.027 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.027 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.027 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001112 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_control_func.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.027 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.027 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.027 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001133 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.027 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001158 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.027 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001142 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_021.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.027 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001141 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_018.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.027 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001146 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_025.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.027 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000113c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_040.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000112c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_reset.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001114 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_reset.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001118 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_annunciators.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000111f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_control_func.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001155 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_004.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001129 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_resources2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000115a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_027.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000110f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_dimi_func.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001135 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_036.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000115b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_002.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001157 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_017.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001130 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_controls.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001150 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_006.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001160 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_019.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001151 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_043.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000113b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_016.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001164 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_037.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001143 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_026.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000115f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_032.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001137 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_028.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000113e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_033.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000114a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_034.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000111b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_dimi_func.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000115e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_030.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000114f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_035.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000112a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001156 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000111d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_fumi.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001139 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_015.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000113f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_045.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001149 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_014.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000111e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_dimi.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001154 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_000.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000114e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_011.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001134 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_039.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001165 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001147 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_031.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000113d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_042.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000112b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_el.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001145 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/openhpi.conf) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001144 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_044.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001140 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_012.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000111a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_inventory.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001163 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001161 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_023.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001125 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_sensor_func.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001138 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_024.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000113a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_008.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000112d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_fumi_func.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000114d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_020.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001136 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_013.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001153 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_010.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001116 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_fumi.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000114c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_041.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001159 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_003.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000114b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_005.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.032 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001113 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_sensors.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.032 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001162 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_007.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.032 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001148 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_029.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.032 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001131 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_sensors.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.032 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001152 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_022.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.032 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000115d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_038.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.032 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000115c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_009.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.032 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000110d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_injector.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.032 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.032 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.032 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001119 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_controls.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.032 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.032 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.032 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001115 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_power.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000110e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_init.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001120 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_init.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001117 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_sensor_func.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001121 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_annunciator_func.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001123 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_inventory.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.033 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.034 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001132 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_injector.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.034 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.034 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.034 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001122 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_dimi.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.034 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.034 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.034 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000111c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_resources.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.034 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.034 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.034 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001124 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_hotswap.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.034 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010fe (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_ssl.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.035 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.035 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.035 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001100 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_ssl.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.035 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.035 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.035 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001108 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_idr.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.035 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.035 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.036 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001107 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_rpt.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.036 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001104 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_idr.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.036 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.036 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.036 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010fc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_control.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.036 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.036 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.036 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001103 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.036 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.036 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.036 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001109 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.036 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.036 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.037 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010f9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_reset.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.037 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.037 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.037 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001101 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.037 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.037 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.037 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000110a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.037 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010ff (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_discover.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.037 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.037 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.037 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010fb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_discover.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.038 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010fa (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_sensor.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.038 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.038 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.038 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001102 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_cmnds.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.038 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010fd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_xml.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.038 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001105 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_xml.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.038 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010f8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_power.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.038 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001106 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_sensor.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.038 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000117b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_indicator.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.038 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.039 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.039 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001173 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_reset.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.039 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.039 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.039 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000117a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_power.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.039 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.039 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.039 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000116e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_reset.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.039 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001183 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.039 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.039 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.040 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001170 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.040 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.040 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.040 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000116b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_inventory.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.040 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.040 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.040 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001184 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_control.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.040 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.040 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.041 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001182 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_hotswap.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.041 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.041 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.041 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000116d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_utils.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.041 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.042 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.042 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001175 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_watchdog.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.042 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001171 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_discover.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.042 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.042 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.043 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001179 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_resource.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.043 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.043 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.044 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001186 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_resource.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.044 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000117f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_control.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.044 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.044 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.044 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000116c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_watchdog.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.044 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.044 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.044 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001178 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_discover.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.044 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.045 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.045 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000116a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_indicator.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.045 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.045 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.045 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000117e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_annunciator.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.045 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.045 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.045 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001172 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_utils.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.045 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001180 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.046 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.046 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.046 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000117c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.046 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.046 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.046 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001177 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_eventlog.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.046 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.046 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.046 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001181 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_eventlog.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.046 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.046 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.046 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001169 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_hotswap.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.046 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.047 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.047 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000117d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_power.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.047 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000116f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_annunciator.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.047 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.047 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.047 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001176 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_sensor.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.047 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.047 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.047 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001185 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.047 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.047 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.047 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001174 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_inventory.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.047 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.047 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.048 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001167 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.048 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.048 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.048 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001168 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_sensor.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.048 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fc3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ekeyfru.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.048 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.048 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.048 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fbe (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sensor_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.048 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fbf (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_close.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.048 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.048 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.048 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fc1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_control_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.048 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.048 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.049 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fc0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/hotswap.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.049 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.049 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.049 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fc7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.sym) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.049 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.049 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.049 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fcb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/posix_vlog.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.049 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fd7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.049 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fd9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.049 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fd8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/ipmi_thres_test.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.049 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fda (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.049 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fc5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.049 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.049 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.050 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fc2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_connection.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.050 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fd2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.050 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.050 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.050 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fbd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_vshm_rdrs.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.050 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.050 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.050 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fd0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_mc_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.050 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.050 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.050 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fd3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_shelf_fru.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.050 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.050 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.050 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fce (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_entity.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.051 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.051 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.051 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fcc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.051 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.051 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.051 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fd4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_shelf_rdrs.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.051 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.051 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.051 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fdb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.051 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.051 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.051 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fca (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_inventory_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.051 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fbc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_entity_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.051 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.052 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.052 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fc8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/sync.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.052 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.052 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.052 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fc6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_inventory.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.052 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.052 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.052 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fd6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_slot_rdrs.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.052 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.052 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.052 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fd5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_util.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.052 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.052 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.052 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fc9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_drv.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.053 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.053 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.053 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fc4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_controls.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.053 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fcf (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sel.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.053 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.053 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.053 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fd1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_fru_rdrs.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.053 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fdc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sensor.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.053 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.053 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.053 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fcd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.053 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.053 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.053 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000ff3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_resource.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.054 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fea (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_rdr.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.054 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.054 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.054 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fff (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_utils.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.054 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.054 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.054 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001005 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.054 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.054 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.054 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001002 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_msg.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.054 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001015 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_force.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.054 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.054 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.054 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fe8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.055 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.055 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.055 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000ffd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_fru_info.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.055 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.055 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.055 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000ff9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_threshold.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.055 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.055 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.055 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001025 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.055 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000101b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/array.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.055 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.055 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.055 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000102e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.055 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000ffa (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_resource.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.056 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.056 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.056 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fe6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_log.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.056 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000102f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_factors.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.056 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000ff1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_domain.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.056 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001017 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_fix_sdr.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.056 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.056 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.056 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000101e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_domain.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.056 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.056 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.056 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001011 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_utils.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.056 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.056 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.057 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001008 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.057 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001031 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_entity.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.057 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.057 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.057 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001007 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_cmd.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.057 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.057 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.057 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000102b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_atca_led.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.057 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000101f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sel.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.057 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001032 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.057 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001035 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/thread_000.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.057 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001036 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/sensor_factors_000.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.057 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001038 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.058 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001037 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/con_001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.058 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001001 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.058 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001039 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.058 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001033 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/test.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.058 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001034 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/con_000.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.058 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000101c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_addr.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.058 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000ffc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_inventory_parser.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.058 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.058 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.058 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001029 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_discover.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.058 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.058 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.059 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001010 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con_smi.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.059 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.059 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.059 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001027 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_intel.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.059 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.059 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.059 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000100d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con_lan.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.059 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.059 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.059 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000101a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.059 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fe4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_fan.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.059 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001009 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_hotswap.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.059 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.059 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.060 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001024 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.060 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001003 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_inventory_parser.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.060 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.060 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.060 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001019 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sdr.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.060 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.060 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.060 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001022 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_atca_led.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.060 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001013 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.060 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000ff2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_fix_sdr.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.060 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001020 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.060 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.060 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.061 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000100e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_discrete.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.061 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.061 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.061 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000103a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_force.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.061 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.061 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.061 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000ffe (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_fru_info.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.061 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.061 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.061 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000102a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_watchdog.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.061 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.061 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.061 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001023 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_addr.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.061 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000102d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_cmd.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.061 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.062 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.062 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001000 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_msg.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.062 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001004 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_text_buffer.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.062 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.062 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.062 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000103b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.062 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fef (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sel.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.062 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.062 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.062 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001030 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_auth.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.062 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.062 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.062 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001018 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_event.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.063 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.063 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.063 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001021 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con_lan.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.063 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.063 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.063 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000100f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/hotswap.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.063 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.063 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.063 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000103c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_text_buffer.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.063 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.063 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.063 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fec (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_sun_led.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.063 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.064 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.064 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fe9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_discrete.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.064 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.064 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.064 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001026 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/thread.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.064 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000100c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.064 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000ff6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_auth.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.064 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.064 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.064 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000100a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/thread.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.064 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.064 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.064 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000ffb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.065 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fed (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_sun.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.065 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.065 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.065 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000101d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_inventory.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.065 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.065 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.065 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001028 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_sun.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.065 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000ff5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_inventory.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.065 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.065 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.065 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000ff7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_discover.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.065 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.065 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.065 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000102c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_sun_led.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.066 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.066 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.066 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000feb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sdr.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.066 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.066 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.066 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001012 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_watchdog.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.066 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.066 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.066 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000ff8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_intel.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.066 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.066 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.066 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000100b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_rdr.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.066 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.067 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.067 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fe7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_fan.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.067 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fee (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.067 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.067 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.067 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000ff4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_factors.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.067 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.067 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.067 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fe3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_hotswap.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.067 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.067 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.067 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000fe5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con_smi.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.068 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.068 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.068 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001014 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.068 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.068 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.068 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:46 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000000ff0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_log.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.068 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001006 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_threshold.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.068 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.068 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.068 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001016 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_entity.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.068 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.068 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.068 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000106b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.069 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000105a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_discover_bc.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.069 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.069 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.069 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001061 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_resources.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.069 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.069 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.069 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000105d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_control.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.069 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001045 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_watchdog.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.069 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.069 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.069 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001042 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_session.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.069 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.069 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.070 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000103f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_inventory.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.070 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000106c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.070 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010a7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel007.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.070 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010b4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset009.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.070 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010ba (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset024.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.070 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001091 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/treset001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.070 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001063 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_el.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.070 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000104d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_sel.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.070 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001048 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_inventory.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.070 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001062 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_control.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.070 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000106d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tcontrol001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.070 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001044 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_sensor.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.070 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010a8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.071 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000107c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget013.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.071 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001050 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_discover_bc.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.071 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010b9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset002.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.071 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000105e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.071 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000107d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/sim_file.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.071 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001074 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv003.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.071 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001085 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset019.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.071 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010a1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/thotswap001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.071 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001053 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_sel.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.071 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010bc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset006.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.071 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010a6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsim_file.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.071 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001081 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tcontrolfailover.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.071 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001049 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_xml2event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.071 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010aa (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset005.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.072 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000108e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget004.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.072 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010ad (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.072 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001075 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset020.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.072 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001069 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_discover_rsa.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.072 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010b0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tpower001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.072 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000109f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv006.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.072 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001093 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tset_resource_tag.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.072 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001079 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset017.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.072 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000104f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_hotswap.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.072 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010b7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget040.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.072 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010a2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset021.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.072 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000107e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv004.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.072 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001057 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_power.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.072 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010a4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/thotswap-mhs001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.073 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010a0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget036.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.073 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010b6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel006.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.073 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001066 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.073 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010ac (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset007.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.073 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010ab (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset018.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.073 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010a3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget035.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.073 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000104c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_time.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.073 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001078 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel004.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.073 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010a9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset012.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.073 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001076 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tcontrol003.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.073 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001084 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsetup.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.073 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001052 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_discover.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.073 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010b2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.074 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001088 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget002.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.074 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010a5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/sim_test_file) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.074 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000108a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel002.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.074 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000109e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.074 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000108d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget016.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.074 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000109d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv005.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.074 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001092 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset013.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.074 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010b3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset015.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.074 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000107f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tset_resource_sev.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.074 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001067 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_utils.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.074 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000106a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_el2event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.074 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001086 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/openhpi.conf) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.074 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000108f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel005.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.075 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000106f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tdiscover001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.075 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001065 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_resources_rsa.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.075 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001095 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget010.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.075 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010b8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.075 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001073 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tcontrol002.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.075 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001060 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_reset.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.075 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001083 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/sim_resources.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.075 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001098 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset008.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.075 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010af (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset022.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.075 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000107b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset004.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.075 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000105f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_discover.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.075 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010ae (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tevent.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.075 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001040 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/eventmap2code.pl) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.075 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010bb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset003.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.076 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001080 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset010.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.076 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000108b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget005.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.076 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010b1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsptime002.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.076 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010bd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.076 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000107a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tcontrol_parms.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.076 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001096 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.076 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001097 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/snmp_utils.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.076 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000104b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_sensor.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.076 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001077 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget003.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.076 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001072 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget041.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.076 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001071 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/sim_init.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.076 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001055 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_power.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.076 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000109a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv007.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.076 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000108c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset023.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.077 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000109c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/thotswap-simple001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.077 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001090 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv002.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.077 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x100000010b5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsnmp_bc_getset.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.077 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000105b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_annunciator.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.077 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000109b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget034.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.077 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001082 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsptime001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.077 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001068 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_lock.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.077 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001089 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset011.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.077 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001070 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget033.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.077 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001099 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsetup.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.077 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001087 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/sim_resources.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.077 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001054 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.077 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001094 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel003.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.077 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000106e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget031.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.078 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001047 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_time.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.078 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.078 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.078 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000103e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.078 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.078 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.078 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001056 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_event.map) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.078 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.078 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.078 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000104e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_utils.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.078 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.078 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.078 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001041 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/sim_init.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.079 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.079 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.079 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001059 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/sim_init.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.079 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.079 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.079 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000105c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_reset.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.079 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.079 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.079 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000104a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_annunciator.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.079 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.079 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.079 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001064 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_hotswap.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.079 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001058 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_resources.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.079 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.080 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.080 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001046 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_plugin.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.080 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001051 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_watchdog.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.080 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001043 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_session.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.080 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.080 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.080 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001189 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/sysfs/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.080 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000118b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/sysfs/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.080 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.080 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.080 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x10000001188 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/sysfs/README) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.080 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: Scrub error on inode 0x1000000118a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/sysfs/sysfs2hpi.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.080 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.081 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.081 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.081 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.081 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.081 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.081 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.081 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.081 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.081 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.081 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.081 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.081 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.081 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.081 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.082 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.082 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.082 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.082 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.082 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.082 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.082 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.082 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.082 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.082 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.082 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.082 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.082 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.082 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.083 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.083 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.083 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.083 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.083 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.083 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.083 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.083 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.083 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.083 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.083 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.083 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.084 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.084 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.084 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.084 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.084 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:47.084 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.033+0000 7fbce4843700 1 -- 172.21.15.49:0/3627807432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbce0101620 msgr2=0x7fbce0101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:47.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.033+0000 7fbce4843700 1 --2- 172.21.15.49:0/3627807432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbce0101620 0x7fbce0101a00 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fbcd00099c0 tx=0x7fbcd0009cd0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.033+0000 7fbce4843700 1 -- 172.21.15.49:0/3627807432 shutdown_connections 2024-06-03T00:02:47.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.033+0000 7fbce4843700 1 --2- 172.21.15.49:0/3627807432 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbce01066b0 0x7fbce010e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.033+0000 7fbce4843700 1 --2- 172.21.15.49:0/3627807432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbce0101620 0x7fbce0101a00 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.033+0000 7fbce4843700 1 --2- 172.21.15.49:0/3627807432 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbce0101fd0 0x7fbce0105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.033+0000 7fbce4843700 1 -- 172.21.15.49:0/3627807432 >> 172.21.15.49:0/3627807432 conn(0x7fbce0078340 msgr2=0x7fbce0078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:47.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.033+0000 7fbce4843700 1 -- 172.21.15.49:0/3627807432 shutdown_connections 2024-06-03T00:02:47.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.033+0000 7fbce4843700 1 -- 172.21.15.49:0/3627807432 wait complete. 2024-06-03T00:02:47.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.034+0000 7fbce4843700 1 Processor -- start 2024-06-03T00:02:47.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.034+0000 7fbce4843700 1 -- start start 2024-06-03T00:02:47.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.034+0000 7fbce4843700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbce0101620 0x7fbce019d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:47.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.034+0000 7fbce4843700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbce0101fd0 0x7fbce019dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:47.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.034+0000 7fbce4843700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbce01066b0 0x7fbce01979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:47.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.034+0000 7fbce4843700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbce0111690 con 0x7fbce0101fd0 2024-06-03T00:02:47.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.034+0000 7fbce4843700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fbce0111510 con 0x7fbce0101620 2024-06-03T00:02:47.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.034+0000 7fbce4843700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbce0111810 con 0x7fbce01066b0 2024-06-03T00:02:47.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.034+0000 7fbcddd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbce0101fd0 0x7fbce019dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:47.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.034+0000 7fbcddd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbce0101fd0 0x7fbce019dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50816/0 (socket says 172.21.15.49:50816) 2024-06-03T00:02:47.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.034+0000 7fbcddd9b700 1 -- 172.21.15.49:0/394742419 learned_addr learned my addr 172.21.15.49:0/394742419 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:47.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.034+0000 7fbcded9d700 1 --2- 172.21.15.49:0/394742419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbce01066b0 0x7fbce01979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:47.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.035+0000 7fbcde59c700 1 --2- 172.21.15.49:0/394742419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbce0101620 0x7fbce019d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:47.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.035+0000 7fbcded9d700 1 -- 172.21.15.49:0/394742419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbce0101620 msgr2=0x7fbce019d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:47.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.035+0000 7fbcded9d700 1 --2- 172.21.15.49:0/394742419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbce0101620 0x7fbce019d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.035+0000 7fbcded9d700 1 -- 172.21.15.49:0/394742419 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbce0101fd0 msgr2=0x7fbce019dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:47.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.035+0000 7fbcded9d700 1 --2- 172.21.15.49:0/394742419 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbce0101fd0 0x7fbce019dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.035+0000 7fbcded9d700 1 -- 172.21.15.49:0/394742419 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce0198110 con 0x7fbce01066b0 2024-06-03T00:02:47.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.035+0000 7fbcddd9b700 1 --2- 172.21.15.49:0/394742419 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbce0101fd0 0x7fbce019dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:02:47.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.035+0000 7fbcde59c700 1 --2- 172.21.15.49:0/394742419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbce0101620 0x7fbce019d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:02:47.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.035+0000 7fbcded9d700 1 --2- 172.21.15.49:0/394742419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbce01066b0 0x7fbce01979b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbcd800efb0 tx=0x7fbcd800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:47.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.035+0000 7fbccf7fe700 1 -- 172.21.15.49:0/394742419 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd800ca50 con 0x7fbce01066b0 2024-06-03T00:02:47.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.035+0000 7fbccf7fe700 1 -- 172.21.15.49:0/394742419 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcd800cbf0 con 0x7fbce01066b0 2024-06-03T00:02:47.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.035+0000 7fbce4843700 1 -- 172.21.15.49:0/394742419 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbce0198400 con 0x7fbce01066b0 2024-06-03T00:02:47.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.035+0000 7fbce4843700 1 -- 172.21.15.49:0/394742419 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbce006abc0 con 0x7fbce01066b0 2024-06-03T00:02:47.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.035+0000 7fbccf7fe700 1 -- 172.21.15.49:0/394742419 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd8007500 con 0x7fbce01066b0 2024-06-03T00:02:47.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.038+0000 7fbccf7fe700 1 -- 172.21.15.49:0/394742419 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbcd8012050 con 0x7fbce01066b0 2024-06-03T00:02:47.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.039+0000 7fbccf7fe700 1 --2- 172.21.15.49:0/394742419 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbcc80a2c20 0x7fbcc80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:47.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.039+0000 7fbcde59c700 1 --2- 172.21.15.49:0/394742419 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbcc80a2c20 0x7fbcc80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:47.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.039+0000 7fbccf7fe700 1 -- 172.21.15.49:0/394742419 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fbcd80ce8a0 con 0x7fbce01066b0 2024-06-03T00:02:47.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.039+0000 7fbcde59c700 1 --2- 172.21.15.49:0/394742419 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbcc80a2c20 0x7fbcc80a50e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0000c00 tx=0x7fbcd0005ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:47.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.039+0000 7fbcef0c6b80 1 Processor -- start 2024-06-03T00:02:47.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.040+0000 7fbcef0c6b80 1 -- start start 2024-06-03T00:02:47.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.040+0000 7fbcef0c6b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a6eeb05640 0x55a6eeb05a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:47.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.040+0000 7fbcef0c6b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a6eeb05f60 0x55a6eeaff9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:47.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.040+0000 7fbcef0c6b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6eeafff20 0x55a6eeb00340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:47.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.040+0000 7fbcef0c6b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a6eea51810 con 0x55a6eeafff20 2024-06-03T00:02:47.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.040+0000 7fbcef0c6b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55a6ee9f9720 con 0x55a6eeb05640 2024-06-03T00:02:47.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.040+0000 7fbcef0c6b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55a6eea4d7d0 con 0x55a6eeb05f60 2024-06-03T00:02:47.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.040+0000 7fbcde59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a6eeb05640 0x55a6eeb05a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:47.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.040+0000 7fbcded9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6eeafff20 0x55a6eeb00340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:47.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.040+0000 7fbcde59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a6eeb05640 0x55a6eeb05a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.49:55842/0 (socket says 172.21.15.49:55842) 2024-06-03T00:02:47.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.040+0000 7fbcde59c700 1 -- 172.21.15.49:0/1916599330 learned_addr learned my addr 172.21.15.49:0/1916599330 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:47.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.040+0000 7fbcddd9b700 1 --2- 172.21.15.49:0/1916599330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a6eeb05f60 0x55a6eeaff9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:47.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.040+0000 7fbcde59c700 1 -- 172.21.15.49:0/1916599330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a6eeb05f60 msgr2=0x55a6eeaff9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:47.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.040+0000 7fbcde59c700 1 --2- 172.21.15.49:0/1916599330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a6eeb05f60 0x55a6eeaff9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.040+0000 7fbcde59c700 1 -- 172.21.15.49:0/1916599330 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6eeafff20 msgr2=0x55a6eeb00340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:47.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.040+0000 7fbcde59c700 1 --2- 172.21.15.49:0/1916599330 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6eeafff20 0x55a6eeb00340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.040+0000 7fbcde59c700 1 -- 172.21.15.49:0/1916599330 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6ee9eff50 con 0x55a6eeb05640 2024-06-03T00:02:47.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.040+0000 7fbcded9d700 1 --2- 172.21.15.49:0/1916599330 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6eeafff20 0x55a6eeb00340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:02:47.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.041+0000 7fbcde59c700 1 --2- 172.21.15.49:0/1916599330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a6eeb05640 0x55a6eeb05a20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbcd00099c0 tx=0x7fbcd001a070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=113864f8d5f8ee4b server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:47.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.041+0000 7fbcccff9700 1 -- 172.21.15.49:0/1916599330 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd00052c0 con 0x55a6eeb05640 2024-06-03T00:02:47.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.041+0000 7fbcccff9700 1 -- 172.21.15.49:0/1916599330 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcd0003680 con 0x55a6eeb05640 2024-06-03T00:02:47.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.041+0000 7fbcccff9700 1 -- 172.21.15.49:0/1916599330 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd0010840 con 0x55a6eeb05640 2024-06-03T00:02:47.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.042+0000 7fbcef0c6b80 1 -- 172.21.15.49:0/1916599330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a6eeb05640 msgr2=0x55a6eeb05a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:47.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.042+0000 7fbcef0c6b80 1 --2- 172.21.15.49:0/1916599330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a6eeb05640 0x55a6eeb05a20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbcd00099c0 tx=0x7fbcd001a070 comp rx=0 tx=0).stop 2024-06-03T00:02:47.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.042+0000 7fbcef0c6b80 1 -- 172.21.15.49:0/1916599330 shutdown_connections 2024-06-03T00:02:47.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.042+0000 7fbcef0c6b80 1 --2- 172.21.15.49:0/1916599330 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6eeafff20 0x55a6eeb00340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.042+0000 7fbcef0c6b80 1 --2- 172.21.15.49:0/1916599330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a6eeb05640 0x55a6eeb05a20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.042+0000 7fbcef0c6b80 1 --2- 172.21.15.49:0/1916599330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a6eeb05f60 0x55a6eeaff9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.042+0000 7fbcef0c6b80 1 -- 172.21.15.49:0/1916599330 >> 172.21.15.49:0/1916599330 conn(0x55a6eea2acc0 msgr2=0x55a6eeafa850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:47.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.042+0000 7fbcef0c6b80 1 -- 172.21.15.49:0/1916599330 shutdown_connections 2024-06-03T00:02:47.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.042+0000 7fbcef0c6b80 1 -- 172.21.15.49:0/1916599330 wait complete. 2024-06-03T00:02:47.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.042+0000 7fbcef0c6b80 1 -- start start 2024-06-03T00:02:47.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.042+0000 7fbcef0c6b80 1 Processor -- start 2024-06-03T00:02:47.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.043+0000 7fbcef0c6b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6eeafff20 0x55a6eeb0bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:47.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.043+0000 7fbcef0c6b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a6eeb05640 0x55a6eeb08fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:47.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.043+0000 7fbcef0c6b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a6eeb05f60 0x55a6eeb094f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:47.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.043+0000 7fbcef0c6b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a6eeb0c910 con 0x55a6eeafff20 2024-06-03T00:02:47.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.043+0000 7fbcef0c6b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55a6ee9f1bf0 con 0x55a6eeb05640 2024-06-03T00:02:47.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.043+0000 7fbcef0c6b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55a6eeb0ca90 con 0x55a6eeb05f60 2024-06-03T00:02:47.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.043+0000 7fbcef0c6b80 10 client.0 _ll_register_callbacks cb 0x55a6ee9eb920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:02:47.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.043+0000 7fbcde59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6eeafff20 0x55a6eeb0bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:47.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.043+0000 7fbcddd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a6eeb05640 0x55a6eeb08fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:47.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.043+0000 7fbcded9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a6eeb05f60 0x55a6eeb094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:47.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.043+0000 7fbcde59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6eeafff20 0x55a6eeb0bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50822/0 (socket says 172.21.15.49:50822) 2024-06-03T00:02:47.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.043+0000 7fbcddd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a6eeb05640 0x55a6eeb08fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.49:55844/0 (socket says 172.21.15.49:55844) 2024-06-03T00:02:47.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.043+0000 7fbcded9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a6eeb05f60 0x55a6eeb094f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:40184/0 (socket says 172.21.15.49:40184) 2024-06-03T00:02:47.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.043+0000 7fbcde59c700 1 -- 172.21.15.49:0/1470941058 learned_addr learned my addr 172.21.15.49:0/1470941058 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:47.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.043+0000 7fbcde59c700 1 -- 172.21.15.49:0/1470941058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a6eeb05f60 msgr2=0x55a6eeb094f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:47.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.043+0000 7fbcde59c700 1 --2- 172.21.15.49:0/1470941058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a6eeb05f60 0x55a6eeb094f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.043+0000 7fbcde59c700 1 -- 172.21.15.49:0/1470941058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a6eeb05640 msgr2=0x55a6eeb08fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:47.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.043+0000 7fbcde59c700 1 --2- 172.21.15.49:0/1470941058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a6eeb05640 0x55a6eeb08fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.043+0000 7fbcde59c700 1 -- 172.21.15.49:0/1470941058 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6ee9a08d0 con 0x55a6eeafff20 2024-06-03T00:02:47.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.043+0000 7fbcddd9b700 1 --2- 172.21.15.49:0/1470941058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a6eeb05640 0x55a6eeb08fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:02:47.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.043+0000 7fbcde59c700 1 --2- 172.21.15.49:0/1470941058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6eeafff20 0x55a6eeb0bcb0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fbcd00098e0 tx=0x7fbcd0010d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8161291d1e2209a3 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:47.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.043+0000 7fbcc5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:02:47.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.044+0000 7fbcc5ffb700 1 -- 172.21.15.49:0/1470941058 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd0010880 con 0x55a6eeafff20 2024-06-03T00:02:47.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.044+0000 7fbcef0c6b80 1 -- 172.21.15.49:0/1470941058 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcd0003680 con 0x55a6eeafff20 2024-06-03T00:02:47.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.044+0000 7fbcc5ffb700 1 -- 172.21.15.49:0/1470941058 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fbcd000b730 con 0x55a6eeafff20 2024-06-03T00:02:47.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.044+0000 7fbcc5ffb700 1 -- 172.21.15.49:0/1470941058 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbcd000b930 con 0x55a6eeafff20 2024-06-03T00:02:47.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.044+0000 7fbcef0c6b80 10 client.15924 fetch_fsmap learned FSMap version 28 2024-06-03T00:02:47.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.044+0000 7fbcef0c6b80 1 -- 172.21.15.49:0/1470941058 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a6eeb0c910 con 0x55a6eeafff20 2024-06-03T00:02:47.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.044+0000 7fbcc5ffb700 1 -- 172.21.15.49:0/1470941058 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcd0003680 con 0x55a6eeafff20 2024-06-03T00:02:47.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.044+0000 7fbcc5ffb700 1 -- 172.21.15.49:0/1470941058 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbcd0036b40 con 0x55a6eeafff20 2024-06-03T00:02:47.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.044+0000 7fbcef0c6b80 10 client.15924 fetch_fsmap finished waiting for FSMap version 28 2024-06-03T00:02:47.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.044+0000 7fbcef0c6b80 10 client.15924 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-03T00:02:47.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.044+0000 7fbcef0c6b80 20 client.15924 populate_metadata read hostname 'smithi049' 2024-06-03T00:02:47.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.044+0000 7fbcef0c6b80 1 --2- 172.21.15.49:0/1470941058 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55a6eeb19570 0x55a6eeb1b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:47.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.044+0000 7fbcef0c6b80 4 client.15924 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:02:47.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.044+0000 7fbcef0c6b80 1 -- 172.21.15.49:0/1470941058 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a6eea5ed10 con 0x55a6eeb19570 2024-06-03T00:02:47.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.044+0000 7fbcddd9b700 1 --2- 172.21.15.49:0/1470941058 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55a6eeb19570 0x55a6eeb1b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:47.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.045+0000 7fbcc5ffb700 10 client.15924 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:47.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.045+0000 7fbcddd9b700 1 --2- 172.21.15.49:0/1470941058 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55a6eeb19570 0x55a6eeb1b9f0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37f069bf319c4c89 server_cookie=9a608c6387c1e928 in_seq=0 out_seq=0 2024-06-03T00:02:47.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.047+0000 7fbcc5ffb700 1 -- 172.21.15.49:0/1470941058 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55a6eea5ed10 con 0x55a6eeb19570 2024-06-03T00:02:47.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.047+0000 7fbcc5ffb700 10 client.15924 handle_command_reply: tid=0 2024-06-03T00:02:47.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.047+0000 7fbcef0c6b80 1 client.15924 shutdown 2024-06-03T00:02:47.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.047+0000 7fbcef0c6b80 1 -- 172.21.15.49:0/1470941058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6eeafff20 msgr2=0x55a6eeb0bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:47.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.047+0000 7fbcef0c6b80 1 --2- 172.21.15.49:0/1470941058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6eeafff20 0x55a6eeb0bcb0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fbcd00098e0 tx=0x7fbcd0010d30 comp rx=0 tx=0).stop 2024-06-03T00:02:47.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.047+0000 7fbcef0c6b80 1 -- 172.21.15.49:0/1470941058 shutdown_connections 2024-06-03T00:02:47.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.047+0000 7fbcef0c6b80 1 --2- 172.21.15.49:0/1470941058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a6eeb05f60 0x55a6eeb094f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.047+0000 7fbcef0c6b80 1 --2- 172.21.15.49:0/1470941058 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55a6eeb19570 0x55a6eeb1b9f0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.047+0000 7fbcef0c6b80 1 --2- 172.21.15.49:0/1470941058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6eeafff20 0x55a6eeb0bcb0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.047+0000 7fbcef0c6b80 1 --2- 172.21.15.49:0/1470941058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a6eeb05640 0x55a6eeb08fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.047+0000 7fbcef0c6b80 1 -- 172.21.15.49:0/1470941058 >> 172.21.15.49:0/1470941058 conn(0x55a6eea2acc0 msgr2=0x55a6eeafe9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:47.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.047+0000 7fbcc5ffb700 0 client.15924 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:47.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.047+0000 7fbcef0c6b80 1 -- 172.21.15.49:0/1470941058 shutdown_connections 2024-06-03T00:02:47.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.048+0000 7fbcef0c6b80 1 -- 172.21.15.49:0/1470941058 wait complete. 2024-06-03T00:02:47.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.048+0000 7fbcef0c6b80 20 client.15924 trim_cache size 0 max 16384 2024-06-03T00:02:47.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.069+0000 7fbcef0c6b80 1 Processor -- start 2024-06-03T00:02:47.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.069+0000 7fbcef0c6b80 1 -- start start 2024-06-03T00:02:47.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.069+0000 7fbcef0c6b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a6eeb05640 0x55a6eeaff9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:47.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.069+0000 7fbcef0c6b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a6eeb05f60 0x55a6eeb06bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:47.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.069+0000 7fbcef0c6b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6eeb038b0 0x55a6eeb04110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:47.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.069+0000 7fbcef0c6b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc000d3d0 con 0x55a6eeb038b0 2024-06-03T00:02:47.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.069+0000 7fbcef0c6b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc000ef70 con 0x55a6eeb05640 2024-06-03T00:02:47.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.069+0000 7fbcef0c6b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc000daa0 con 0x55a6eeb05f60 2024-06-03T00:02:47.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.069+0000 7fbcded9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6eeb038b0 0x55a6eeb04110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:47.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.069+0000 7fbcded9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6eeb038b0 0x55a6eeb04110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50834/0 (socket says 172.21.15.49:50834) 2024-06-03T00:02:47.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.069+0000 7fbcded9d700 1 -- 172.21.15.49:0/1607036141 learned_addr learned my addr 172.21.15.49:0/1607036141 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:47.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.069+0000 7fbcddd9b700 1 --2- 172.21.15.49:0/1607036141 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a6eeb05f60 0x55a6eeb06bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:47.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.069+0000 7fbcde59c700 1 --2- 172.21.15.49:0/1607036141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a6eeb05640 0x55a6eeaff9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:47.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.069+0000 7fbcddd9b700 1 -- 172.21.15.49:0/1607036141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a6eeb05640 msgr2=0x55a6eeaff9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:47.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.069+0000 7fbcddd9b700 1 --2- 172.21.15.49:0/1607036141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a6eeb05640 0x55a6eeaff9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.069+0000 7fbcddd9b700 1 -- 172.21.15.49:0/1607036141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6eeb038b0 msgr2=0x55a6eeb04110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:47.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.069+0000 7fbcddd9b700 1 --2- 172.21.15.49:0/1607036141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6eeb038b0 0x55a6eeb04110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.069+0000 7fbcddd9b700 1 -- 172.21.15.49:0/1607036141 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6eeb1bfd0 con 0x55a6eeb05f60 2024-06-03T00:02:47.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.069+0000 7fbcded9d700 1 --2- 172.21.15.49:0/1607036141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6eeb038b0 0x55a6eeb04110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:02:47.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.070+0000 7fbcddd9b700 1 --2- 172.21.15.49:0/1607036141 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a6eeb05f60 0x55a6eeb06bd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55a6eeb1c260 tx=0x7fbcd4009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a32167bd3fe2c6 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:47.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.070+0000 7fbcc7fff700 1 -- 172.21.15.49:0/1607036141 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4004020 con 0x55a6eeb05f60 2024-06-03T00:02:47.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.070+0000 7fbcc7fff700 1 -- 172.21.15.49:0/1607036141 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcd400f800 con 0x55a6eeb05f60 2024-06-03T00:02:47.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.070+0000 7fbcc7fff700 1 -- 172.21.15.49:0/1607036141 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd40039b0 con 0x55a6eeb05f60 2024-06-03T00:02:47.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.070+0000 7fbcef0c6b80 1 -- 172.21.15.49:0/1607036141 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a6eeb05f60 msgr2=0x55a6eeb06bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:47.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.070+0000 7fbcef0c6b80 1 --2- 172.21.15.49:0/1607036141 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a6eeb05f60 0x55a6eeb06bd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55a6eeb1c260 tx=0x7fbcd4009260 comp rx=0 tx=0).stop 2024-06-03T00:02:47.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.070+0000 7fbcef0c6b80 1 -- 172.21.15.49:0/1607036141 shutdown_connections 2024-06-03T00:02:47.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.070+0000 7fbcef0c6b80 1 --2- 172.21.15.49:0/1607036141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6eeb038b0 0x55a6eeb04110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.070+0000 7fbcef0c6b80 1 --2- 172.21.15.49:0/1607036141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a6eeb05640 0x55a6eeaff9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.070+0000 7fbcef0c6b80 1 --2- 172.21.15.49:0/1607036141 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a6eeb05f60 0x55a6eeb06bd0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.070+0000 7fbcef0c6b80 1 -- 172.21.15.49:0/1607036141 >> 172.21.15.49:0/1607036141 conn(0x55a6eea2acc0 msgr2=0x55a6eeaf4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:47.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.071+0000 7fbcef0c6b80 1 -- 172.21.15.49:0/1607036141 shutdown_connections 2024-06-03T00:02:47.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.071+0000 7fbcef0c6b80 1 -- 172.21.15.49:0/1607036141 wait complete. 2024-06-03T00:02:47.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.071+0000 7fbcef0c6b80 1 -- start start 2024-06-03T00:02:47.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.071+0000 7fbcef0c6b80 1 Processor -- start 2024-06-03T00:02:47.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.071+0000 7fbcef0c6b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a6eeb038b0 0x55a6eeb12580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:47.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.071+0000 7fbcef0c6b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a6eeb05640 0x55a6eeb20c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:47.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.071+0000 7fbcef0c6b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6eeb05f60 0x55a6eeb21210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:47.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.071+0000 7fbcef0c6b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc000e840 con 0x55a6eeb05f60 2024-06-03T00:02:47.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.071+0000 7fbcef0c6b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc000e170 con 0x55a6eeb05640 2024-06-03T00:02:47.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.071+0000 7fbcef0c6b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc000b350 con 0x55a6eeb038b0 2024-06-03T00:02:47.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.071+0000 7fbcef0c6b80 10 client.0 _ll_register_callbacks cb 0x55a6ee9eb920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:02:47.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.072+0000 7fbcded9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6eeb05f60 0x55a6eeb21210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:47.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.072+0000 7fbcde59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a6eeb038b0 0x55a6eeb12580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:47.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.072+0000 7fbcded9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6eeb05f60 0x55a6eeb21210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50848/0 (socket says 172.21.15.49:50848) 2024-06-03T00:02:47.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.072+0000 7fbcded9d700 1 -- 172.21.15.49:0/3839076508 learned_addr learned my addr 172.21.15.49:0/3839076508 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:47.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.072+0000 7fbcddd9b700 1 --2- 172.21.15.49:0/3839076508 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a6eeb05640 0x55a6eeb20c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:47.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.072+0000 7fbcded9d700 1 -- 172.21.15.49:0/3839076508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a6eeb038b0 msgr2=0x55a6eeb12580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:47.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.072+0000 7fbcded9d700 1 --2- 172.21.15.49:0/3839076508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a6eeb038b0 0x55a6eeb12580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.072+0000 7fbcded9d700 1 -- 172.21.15.49:0/3839076508 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a6eeb05640 msgr2=0x55a6eeb20c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:47.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.072+0000 7fbcded9d700 1 --2- 172.21.15.49:0/3839076508 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a6eeb05640 0x55a6eeb20c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.072+0000 7fbcded9d700 1 -- 172.21.15.49:0/3839076508 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6eeb21a50 con 0x55a6eeb05f60 2024-06-03T00:02:47.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.072+0000 7fbcde59c700 1 --2- 172.21.15.49:0/3839076508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a6eeb038b0 0x55a6eeb12580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:02:47.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.072+0000 7fbcded9d700 1 --2- 172.21.15.49:0/3839076508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6eeb05f60 0x55a6eeb21210 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbcd80cc2d0 tx=0x7fbcd8003da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22dae0c81480cc8 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:47.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.072+0000 7fbcc5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:02:47.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.072+0000 7fbcc5ffb700 1 -- 172.21.15.49:0/3839076508 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd809b850 con 0x55a6eeb05f60 2024-06-03T00:02:47.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.072+0000 7fbcc5ffb700 1 -- 172.21.15.49:0/3839076508 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fbcd809f100 con 0x55a6eeb05f60 2024-06-03T00:02:47.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.072+0000 7fbcef0c6b80 1 -- 172.21.15.49:0/3839076508 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcd400f800 con 0x55a6eeb05f60 2024-06-03T00:02:47.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.072+0000 7fbcc5ffb700 1 -- 172.21.15.49:0/3839076508 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbcd809f300 con 0x55a6eeb05f60 2024-06-03T00:02:47.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.072+0000 7fbcef0c6b80 10 client.15930 fetch_fsmap learned FSMap version 28 2024-06-03T00:02:47.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.072+0000 7fbcef0c6b80 1 -- 172.21.15.49:0/3839076508 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a6eeb843b0 con 0x55a6eeb05f60 2024-06-03T00:02:47.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.073+0000 7fbcc5ffb700 1 -- 172.21.15.49:0/3839076508 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcd400f800 con 0x55a6eeb05f60 2024-06-03T00:02:47.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.073+0000 7fbcc5ffb700 1 -- 172.21.15.49:0/3839076508 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbcd8080080 con 0x55a6eeb05f60 2024-06-03T00:02:47.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.073+0000 7fbcef0c6b80 10 client.15930 fetch_fsmap finished waiting for FSMap version 28 2024-06-03T00:02:47.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.073+0000 7fbcef0c6b80 10 client.15930 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-03T00:02:47.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.073+0000 7fbcef0c6b80 20 client.15930 populate_metadata read hostname 'smithi049' 2024-06-03T00:02:47.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.073+0000 7fbcef0c6b80 1 --2- 172.21.15.49:0/3839076508 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55a6eeb84b70 0x55a6eeb86f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:47.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.073+0000 7fbcef0c6b80 4 client.15930 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-03T00:02:47.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.073+0000 7fbcef0c6b80 1 -- 172.21.15.49:0/3839076508 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a6eea59290 con 0x55a6eeb84b70 2024-06-03T00:02:47.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.073+0000 7fbcde59c700 1 --2- 172.21.15.49:0/3839076508 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55a6eeb84b70 0x55a6eeb86f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:47.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.073+0000 7fbcc5ffb700 10 client.15930 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:47.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.073+0000 7fbcde59c700 1 --2- 172.21.15.49:0/3839076508 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55a6eeb84b70 0x55a6eeb86f90 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fb750d9b95eb844 server_cookie=6c73271a464d5300 in_seq=0 out_seq=0 2024-06-03T00:02:47.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.076+0000 7fbcc5ffb700 1 -- 172.21.15.49:0/3839076508 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x55a6eea59290 con 0x55a6eeb84b70 2024-06-03T00:02:47.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.076+0000 7fbcc5ffb700 10 client.15930 handle_command_reply: tid=0 2024-06-03T00:02:47.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.076+0000 7fbcef0c6b80 1 client.15930 shutdown 2024-06-03T00:02:47.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.076+0000 7fbcef0c6b80 1 -- 172.21.15.49:0/3839076508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6eeb05f60 msgr2=0x55a6eeb21210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:47.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.076+0000 7fbcef0c6b80 1 --2- 172.21.15.49:0/3839076508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6eeb05f60 0x55a6eeb21210 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbcd80cc2d0 tx=0x7fbcd8003da0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.076+0000 7fbcef0c6b80 1 -- 172.21.15.49:0/3839076508 shutdown_connections 2024-06-03T00:02:47.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.076+0000 7fbcef0c6b80 1 --2- 172.21.15.49:0/3839076508 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55a6eeb84b70 0x55a6eeb86f90 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.076+0000 7fbcef0c6b80 1 --2- 172.21.15.49:0/3839076508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a6eeb05f60 0x55a6eeb21210 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.076+0000 7fbcef0c6b80 1 --2- 172.21.15.49:0/3839076508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a6eeb038b0 0x55a6eeb12580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.076+0000 7fbcef0c6b80 1 --2- 172.21.15.49:0/3839076508 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a6eeb05640 0x55a6eeb20c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.076+0000 7fbcef0c6b80 1 -- 172.21.15.49:0/3839076508 >> 172.21.15.49:0/3839076508 conn(0x55a6eea2acc0 msgr2=0x55a6eeb07770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:47.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.076+0000 7fbcc5ffb700 0 client.15930 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:47.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.076+0000 7fbcef0c6b80 1 -- 172.21.15.49:0/3839076508 shutdown_connections 2024-06-03T00:02:47.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.076+0000 7fbcef0c6b80 1 -- 172.21.15.49:0/3839076508 wait complete. 2024-06-03T00:02:47.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.076+0000 7fbcef0c6b80 20 client.15930 trim_cache size 0 max 16384 2024-06-03T00:02:47.113 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:02:47.113 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "scrub active (2100 inodes in the stack)", 2024-06-03T00:02:47.113 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": { 2024-06-03T00:02:47.113 INFO:teuthology.orchestra.run.smithi049.stdout: "b2878f21-cfde-4c0f-bff1-a048258a6bb8": { 2024-06-03T00:02:47.113 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-06-03T00:02:47.113 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "b2878f21-cfde-4c0f-bff1-a048258a6bb8", 2024-06-03T00:02:47.113 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "recursive,force" 2024-06-03T00:02:47.113 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:02:47.113 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:02:47.114 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:02:47.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.077+0000 7fbce4843700 1 -- 172.21.15.49:0/394742419 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbcc80a2c20 msgr2=0x7fbcc80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:47.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.077+0000 7fbce4843700 1 --2- 172.21.15.49:0/394742419 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbcc80a2c20 0x7fbcc80a50e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0000c00 tx=0x7fbcd0005ab0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.077+0000 7fbce4843700 1 -- 172.21.15.49:0/394742419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbce01066b0 msgr2=0x7fbce01979b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:47.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.077+0000 7fbce4843700 1 --2- 172.21.15.49:0/394742419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbce01066b0 0x7fbce01979b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbcd800efb0 tx=0x7fbcd800c3a0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.077+0000 7fbce4843700 1 -- 172.21.15.49:0/394742419 shutdown_connections 2024-06-03T00:02:47.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.077+0000 7fbce4843700 1 --2- 172.21.15.49:0/394742419 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbcc80a2c20 0x7fbcc80a50e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.077+0000 7fbce4843700 1 --2- 172.21.15.49:0/394742419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbce01066b0 0x7fbce01979b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.077+0000 7fbce4843700 1 --2- 172.21.15.49:0/394742419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbce0101620 0x7fbce019d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.077+0000 7fbce4843700 1 --2- 172.21.15.49:0/394742419 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbce0101fd0 0x7fbce019dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:47.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.077+0000 7fbce4843700 1 -- 172.21.15.49:0/394742419 >> 172.21.15.49:0/394742419 conn(0x7fbce0078340 msgr2=0x7fbce01052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:47.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.077+0000 7fbce4843700 1 -- 172.21.15.49:0/394742419 shutdown_connections 2024-06-03T00:02:47.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:02:47.077+0000 7fbce4843700 1 -- 172.21.15.49:0/394742419 wait complete. 2024-06-03T00:02:47.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: pgmap v465: 97 pgs: 97 active+clean; 21 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.6 MiB/s wr, 1.21k op/s 2024-06-03T00:02:47.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001880 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-17.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001769 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-5.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001782 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-26.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017af (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001728 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001794 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-29.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017f8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000191e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001805 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000182a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-12.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017d5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-19.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000174e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001928 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-8.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001949 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-16.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000190e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-73.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001913 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-19.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001825 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000183c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-12.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000177f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-6.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001759 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-15.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017aa (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018cb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-8.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018f5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-17.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000193c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-24.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018b0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-33.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017ba (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-6.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000183a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-25.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017b1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-26.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000175d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-45.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001765 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-18.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000186b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-16.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000178a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000172f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017fd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-23.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001845 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-20.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001820 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-23.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017db (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001937 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-21.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001788 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-10.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001873 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001758 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018c4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-17.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017c6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018b2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017f0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-33.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000189e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017da (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-26.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017e5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-23.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018a9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-38.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001867 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-20.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000178d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-22.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001933 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-64.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000187a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-10.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018d9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-15.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000190a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-6.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001874 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017dd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-10.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018ba (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017cd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/coverage.txt) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001775 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-5.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018fd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-19.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017b4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-8.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.356 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001763 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-24.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.356 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001946 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.356 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000188a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-8.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.356 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000194b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-17.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.356 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018eb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.356 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000186c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.356 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018f3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000174f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-89.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001802 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/testfrmw.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017d4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000193f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-19.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001945 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-66.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000190c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-5.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001850 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001838 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-101.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001887 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001813 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-17.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018b6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-18.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000018e9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000192e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-20.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017f2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017ea (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000188b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-16.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000180c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017dc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-9.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000181e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-9.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000017be (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-17.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001755 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-20.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.362 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.362 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fde (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/watchdog/watchdog.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.362 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.362 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.362 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fe0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/watchdog/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.362 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fe1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/watchdog/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.362 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.362 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.362 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fdf (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/watchdog/README) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.362 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010cb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_fumi.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.362 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.362 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.362 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010ea (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_reset.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.363 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010c2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_enclosure_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.363 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.363 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.363 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010db (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_resources.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.363 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010ef (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_control.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.363 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.363 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.363 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010f5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.363 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.363 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.363 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010dd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_power.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.363 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.363 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.363 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010c8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_sensor.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.364 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010c1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_callsupport.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.364 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.364 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.364 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010f0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_resources.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.364 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.364 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.364 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010c6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_discover.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.364 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010e7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.364 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.364 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.364 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010bf (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_re_discover.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.364 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010d8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_re_discover.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.364 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.365 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.365 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010c4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_server_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.365 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.365 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.365 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010d0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_interconnect_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.365 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010f4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_ps_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.365 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010ee (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_oa_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.365 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.365 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.365 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010d4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_ps_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.365 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.365 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.365 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010cf (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_fan_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.365 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.365 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.366 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010df (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_control.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.366 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010e9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_utils.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.366 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.366 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.366 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010eb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_annunciator.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.366 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.366 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.366 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010e6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_sensor.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.366 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.366 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.366 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010d1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_inventory.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.366 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.366 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.367 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010cd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_fumi.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.367 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.367 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.367 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010d3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_watchdog.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.367 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010f2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_hotswap.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.367 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010ed (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_dimi.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.367 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.367 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.367 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010e3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.367 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.367 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.367 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010c3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_calls.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.367 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010e5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_annunciator.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.367 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.368 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.368 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010d2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_power.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.368 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.368 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.368 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010e4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_load_id.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.368 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.368 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.368 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010dc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_oa_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.368 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010ca (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_watchdog.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.368 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010f3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.368 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.368 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.368 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010e8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_inventory.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.368 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.369 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.369 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010da (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_hotswap.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.369 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010e0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_callsupport.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.369 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010cc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_lcd_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.369 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.369 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.369 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010d9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_interconnect_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.369 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.369 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.369 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010f1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_fan_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.370 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010de (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_enclosure_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.370 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.370 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.370 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010c5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_sel.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.370 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010d6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_sel.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.370 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.370 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.370 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010e2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_utils.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.370 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.371 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.371 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010f6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_lcd_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.371 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.371 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.371 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010e1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_server_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.371 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010d7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_discover.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.371 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.371 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.371 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010d5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.371 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.371 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.371 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010c9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_calls.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.371 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.371 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.372 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010ce (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_load_id.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.372 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.372 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.372 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010ec (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.372 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.372 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.372 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010c0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_dimi.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.372 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.372 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.372 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010c7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_reset.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.372 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001111 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_annunciator_func.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.372 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.372 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.372 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000112f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_watchdog.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.373 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.373 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.373 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001126 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_power.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.373 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.373 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.373 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001110 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_hotswap.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.373 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.373 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.373 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000110c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_fumi_func.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.373 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.373 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.374 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001127 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_watchdog.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.374 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.374 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.374 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000112e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_annunciators.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.374 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.374 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.374 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001128 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_el.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.374 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.374 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.374 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001112 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_control_func.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.374 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.374 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.374 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001133 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.375 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001158 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.375 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001142 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_021.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.375 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001141 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_018.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.375 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001146 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_025.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.375 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000113c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_040.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.375 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000112c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_reset.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.375 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001114 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_reset.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.375 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001118 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_annunciators.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.375 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000111f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_control_func.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.375 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001155 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_004.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.375 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001129 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_resources2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.375 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000115a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_027.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.375 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000110f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_dimi_func.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.375 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001135 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_036.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.376 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000115b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_002.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.376 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001157 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_017.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.376 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001130 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_controls.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.376 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001150 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_006.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.376 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001160 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_019.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.376 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001151 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_043.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.376 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000113b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_016.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.376 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001164 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_037.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.376 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001143 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_026.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.376 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000115f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_032.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.376 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001137 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_028.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.376 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000113e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_033.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.376 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000114a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_034.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.376 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000111b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_dimi_func.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.377 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000115e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_030.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.377 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000114f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_035.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.377 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000112a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.377 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001156 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.377 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000111d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_fumi.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.377 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001139 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_015.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.377 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000113f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_045.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.378 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001149 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_014.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.378 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000111e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_dimi.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.378 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001154 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_000.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.378 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000114e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_011.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.379 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001134 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_039.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.379 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001165 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.379 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001147 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_031.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.379 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000113d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_042.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.379 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000112b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_el.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.379 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001145 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/openhpi.conf) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.379 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001144 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_044.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.379 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001140 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_012.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.379 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000111a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_inventory.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.379 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001163 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.380 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001161 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_023.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.380 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001125 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_sensor_func.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.380 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001138 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_024.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.380 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000113a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_008.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.380 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000112d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_fumi_func.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.380 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000114d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_020.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.380 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001136 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_013.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.381 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001153 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_010.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.381 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001116 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_fumi.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.381 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000114c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_041.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.381 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001159 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_003.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.381 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000114b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_005.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.383 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001113 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_sensors.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.383 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001162 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_007.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.383 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001148 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_029.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.383 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001131 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_sensors.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.383 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001152 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_022.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.383 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000115d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_038.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.383 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000115c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_009.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.383 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000110d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_injector.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.383 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.383 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.384 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001119 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_controls.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.384 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.384 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.384 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001115 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_power.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.384 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.384 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.384 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000110e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_init.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.384 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.384 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.384 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001120 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_init.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.384 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.384 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.384 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001117 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_sensor_func.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.384 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.385 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.385 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001121 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_annunciator_func.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.385 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001123 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_inventory.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.385 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.385 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.385 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001132 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_injector.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.385 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.385 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.385 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001122 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_dimi.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.385 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.385 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.385 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000111c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_resources.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.385 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.385 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.386 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001124 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_hotswap.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.386 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010fe (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_ssl.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.386 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.386 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.386 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001100 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_ssl.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.386 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.386 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.386 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001108 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_idr.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.386 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.386 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.386 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001107 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_rpt.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.386 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001104 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_idr.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.386 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.387 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.387 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010fc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_control.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.387 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.387 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.387 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001103 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.387 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.387 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.387 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001109 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.387 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.387 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.388 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010f9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_reset.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.388 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.388 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.388 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001101 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.388 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.388 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.388 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000110a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.388 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010ff (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_discover.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.388 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.388 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.388 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010fb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_discover.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.388 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010fa (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_sensor.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.388 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.388 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.389 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001102 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_cmnds.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.389 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010fd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_xml.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.389 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001105 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_xml.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.389 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010f8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_power.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.389 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001106 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_sensor.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.389 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000117b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_indicator.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.389 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.389 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.389 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001173 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_reset.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.389 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.389 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.389 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000117a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_power.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.389 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.390 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.390 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000116e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_reset.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.390 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001183 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.390 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.390 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.390 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001170 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.390 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.390 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.390 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000116b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_inventory.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.391 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.391 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.391 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001184 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_control.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.391 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.391 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.391 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001182 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_hotswap.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.392 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.392 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.392 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000116d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_utils.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.392 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.392 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.392 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001175 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_watchdog.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.392 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001171 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_discover.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.392 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.392 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.392 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001179 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_resource.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.392 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.392 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.393 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001186 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_resource.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.393 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000117f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_control.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.393 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.393 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.393 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000116c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_watchdog.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.393 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.393 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.393 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001178 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_discover.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.393 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.393 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.394 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000116a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_indicator.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.394 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.394 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.394 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000117e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_annunciator.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.394 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.394 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.394 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001172 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_utils.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.394 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001180 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.394 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.394 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.394 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000117c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.394 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.394 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.395 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001177 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_eventlog.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.395 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.395 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.395 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001181 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_eventlog.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.395 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.395 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.395 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001169 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_hotswap.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.395 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.395 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.395 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000117d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_power.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.395 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000116f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_annunciator.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.395 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.395 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.395 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001176 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_sensor.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.396 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.396 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.396 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001185 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.396 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.396 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.396 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001174 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_inventory.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.396 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.397 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.397 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001167 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.397 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.397 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.397 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001168 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_sensor.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.397 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fc3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ekeyfru.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.397 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.397 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.397 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fbe (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sensor_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.397 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fbf (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_close.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.397 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.397 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.397 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fc1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_control_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.398 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.398 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.398 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fc0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/hotswap.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.398 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.398 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.398 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fc7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.sym) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.398 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.398 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.398 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fcb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/posix_vlog.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.398 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fd7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.398 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fd9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.399 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fd8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/ipmi_thres_test.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.399 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fda (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.399 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fc5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.399 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.399 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.399 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fc2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_connection.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.399 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fd2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.399 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.399 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.399 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fbd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_vshm_rdrs.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.399 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.399 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.399 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fd0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_mc_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.400 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.400 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.400 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fd3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_shelf_fru.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.400 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.400 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.400 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fce (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_entity.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.400 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.400 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.400 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fcc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.400 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.400 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.400 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fd4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_shelf_rdrs.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.401 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.401 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.401 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fdb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.401 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.401 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.401 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fca (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_inventory_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.401 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fbc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_entity_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.401 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.401 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.401 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fc8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/sync.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.401 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.401 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.401 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fc6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_inventory.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.402 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.402 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.402 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fd6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_slot_rdrs.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.402 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.402 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.402 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fd5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_util.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.402 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.402 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.402 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fc9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_drv.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.402 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.402 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.402 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fc4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_controls.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.402 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fcf (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sel.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.402 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.403 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.403 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fd1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_fru_rdrs.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.403 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fdc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sensor.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.403 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.403 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.403 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fcd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.403 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.405 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.405 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000ff3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_resource.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.406 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fea (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_rdr.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.406 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.406 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.406 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fff (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_utils.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.406 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.406 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.406 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001005 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.406 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.406 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.406 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001002 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_msg.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.406 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001015 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_force.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.406 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.407 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.407 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fe8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.407 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.407 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.407 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000ffd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_fru_info.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.407 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.407 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.407 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000ff9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_threshold.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.407 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.407 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.407 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001025 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.407 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000101b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/array.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.407 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.408 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.408 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000102e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.408 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000ffa (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_resource.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.408 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.408 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.408 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fe6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_log.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.408 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000102f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_factors.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.408 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000ff1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_domain.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.408 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001017 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_fix_sdr.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.408 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.408 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.408 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000101e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_domain.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.408 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.409 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.409 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001011 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_utils.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.409 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.409 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.409 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001008 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.409 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001031 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_entity.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.409 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.409 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.409 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001007 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_cmd.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.409 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.409 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.409 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000102b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_atca_led.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.410 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000101f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sel.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.410 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001032 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.410 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001035 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/thread_000.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.410 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001036 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/sensor_factors_000.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.410 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001038 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.410 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001037 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/con_001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.410 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001001 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.410 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001039 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.410 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001033 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/test.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.410 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001034 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/con_000.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.410 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000101c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_addr.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.410 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000ffc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_inventory_parser.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.410 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.411 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.411 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001029 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_discover.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.411 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.411 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.411 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001010 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con_smi.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.411 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.411 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.411 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001027 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_intel.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.411 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.411 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.411 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000100d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con_lan.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.411 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.411 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.411 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000101a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.411 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fe4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_fan.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.412 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001009 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_hotswap.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.412 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.412 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.412 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001024 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.412 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001003 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_inventory_parser.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.412 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.412 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.412 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001019 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sdr.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.412 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.412 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.412 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001022 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_atca_led.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.412 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001013 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.412 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000ff2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_fix_sdr.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.413 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001020 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.413 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.413 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.413 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000100e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_discrete.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.413 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.413 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.413 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000103a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_force.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.413 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.413 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.413 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000ffe (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_fru_info.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.413 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.413 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.413 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000102a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_watchdog.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.413 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.413 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.414 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001023 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_addr.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.414 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000102d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_cmd.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.414 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.414 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.414 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001000 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_msg.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.414 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001004 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_text_buffer.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.414 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.414 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.414 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000103b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.414 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fef (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sel.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.414 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.414 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.414 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001030 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_auth.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.414 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.415 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.415 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001018 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_event.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.415 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.415 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.415 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001021 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con_lan.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.415 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.415 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.415 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000100f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/hotswap.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.415 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.415 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.415 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000103c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_text_buffer.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.415 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.415 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.416 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fec (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_sun_led.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.416 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.416 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.416 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fe9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_discrete.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.416 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.416 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.416 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001026 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/thread.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.416 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000100c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.416 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000ff6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_auth.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.416 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.416 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.417 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000100a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/thread.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.417 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.417 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.417 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000ffb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.417 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fed (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_sun.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.417 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.417 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.417 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000101d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_inventory.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.417 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.417 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.417 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001028 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_sun.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.417 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000ff5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_inventory.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.417 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.417 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.418 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000ff7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_discover.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.418 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.418 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.418 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000102c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_sun_led.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.418 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.418 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.418 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000feb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sdr.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.418 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.418 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.418 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001012 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_watchdog.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.418 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.418 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.418 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000ff8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_intel.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.418 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.419 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.419 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000100b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_rdr.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.419 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.419 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.419 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fe7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_fan.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.419 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fee (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.419 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.419 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.421 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000ff4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_factors.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.421 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.421 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.422 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fe3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_hotswap.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.422 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.422 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.422 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000fe5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con_smi.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.422 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.422 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.422 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001014 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.422 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.422 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.422 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000000ff0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_log.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.422 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001006 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_threshold.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.422 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.423 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.423 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001016 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_entity.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.423 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.423 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.423 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000106b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.423 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000105a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_discover_bc.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.423 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.423 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.423 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001061 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_resources.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.423 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.423 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.423 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000105d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_control.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.423 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001045 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_watchdog.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.423 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.424 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.424 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001042 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_session.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.424 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.424 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.424 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000103f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_inventory.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.424 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000106c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.424 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010a7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel007.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.424 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010b4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset009.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.424 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010ba (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset024.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.424 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001091 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/treset001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.424 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001063 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_el.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.424 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000104d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_sel.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.424 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001048 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_inventory.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.424 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001062 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_control.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.425 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000106d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tcontrol001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.425 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001044 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_sensor.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.425 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010a8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.425 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000107c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget013.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.425 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001050 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_discover_bc.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.425 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010b9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset002.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.425 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000105e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.425 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000107d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/sim_file.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.425 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001074 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv003.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.425 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001085 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset019.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.425 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010a1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/thotswap001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.425 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001053 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_sel.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.425 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010bc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset006.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.425 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010a6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsim_file.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.426 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001081 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tcontrolfailover.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.426 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001049 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_xml2event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.426 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010aa (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset005.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.426 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000108e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget004.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.426 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010ad (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.426 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001075 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset020.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.426 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001069 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_discover_rsa.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.426 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010b0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tpower001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.426 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000109f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv006.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.426 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001093 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tset_resource_tag.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.426 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001079 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset017.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.426 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000104f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_hotswap.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.426 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010b7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget040.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.426 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010a2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset021.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.427 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000107e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv004.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.427 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001057 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_power.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.427 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010a4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/thotswap-mhs001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.427 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010a0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget036.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.427 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010b6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel006.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.427 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001066 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.427 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010ac (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset007.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.427 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010ab (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset018.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.427 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010a3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget035.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.427 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000104c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_time.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.427 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001078 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel004.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.427 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010a9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset012.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.427 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001076 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tcontrol003.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.427 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001084 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsetup.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.428 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001052 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_discover.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.428 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010b2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.428 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001088 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget002.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.428 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010a5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/sim_test_file) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.428 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000108a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel002.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.428 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000109e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.428 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000108d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget016.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.428 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000109d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv005.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.428 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001092 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset013.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.428 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010b3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset015.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.428 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000107f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tset_resource_sev.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.428 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001067 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_utils.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.428 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:46 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000106a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_el2event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.429 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001086 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/openhpi.conf) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.429 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000108f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel005.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.429 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000106f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tdiscover001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.429 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001065 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_resources_rsa.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.429 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001095 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget010.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.429 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010b8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.429 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001073 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tcontrol002.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.429 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001060 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_reset.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.429 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001083 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/sim_resources.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.429 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001098 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset008.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.429 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010af (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset022.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.429 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000107b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset004.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.429 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000105f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_discover.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.430 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010ae (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tevent.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.430 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001040 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/eventmap2code.pl) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.430 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010bb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset003.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.430 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001080 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset010.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.430 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000108b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget005.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.430 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010b1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsptime002.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.430 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010bd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.430 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000107a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tcontrol_parms.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.430 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001096 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.430 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001097 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/snmp_utils.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.430 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000104b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_sensor.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.430 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001077 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget003.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.430 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001072 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget041.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.431 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001071 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/sim_init.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.431 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001055 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_power.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.431 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000109a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv007.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.431 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000108c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset023.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.431 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000109c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/thotswap-simple001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.431 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001090 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv002.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.431 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x100000010b5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsnmp_bc_getset.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.431 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000105b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_annunciator.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.431 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000109b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget034.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.431 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001082 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsptime001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.431 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001068 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_lock.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.431 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001089 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset011.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.431 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001070 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget033.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.431 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001099 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsetup.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.432 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001087 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/sim_resources.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.432 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001054 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.432 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001094 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel003.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.432 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000106e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget031.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.432 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001047 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_time.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.432 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.432 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.432 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000103e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.432 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.432 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.432 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001056 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_event.map) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.432 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.432 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.433 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000104e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_utils.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.433 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.433 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.433 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001041 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/sim_init.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.433 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.433 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.433 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001059 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/sim_init.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.433 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.433 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.433 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000105c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_reset.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.434 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.434 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.434 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000104a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_annunciator.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.434 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.434 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.434 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001064 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_hotswap.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.434 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001058 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_resources.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.434 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.434 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.434 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001046 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_plugin.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.434 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001051 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_watchdog.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.434 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001043 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_session.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.434 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.435 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.435 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001189 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/sysfs/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.435 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000118b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/sysfs/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.435 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.435 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.435 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x10000001188 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/sysfs/README) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.435 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: Scrub error on inode 0x1000000118a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/sysfs/sysfs2hpi.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.435 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.435 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.435 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.435 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.435 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.435 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.435 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.435 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.436 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.436 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.436 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.436 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.436 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.436 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.436 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.436 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.436 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.436 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.436 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.436 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.436 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.436 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.437 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.437 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.437 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.437 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.437 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.437 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.437 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.437 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.437 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.437 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.437 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.438 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.438 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.438 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.438 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.438 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.438 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.438 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.438 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.438 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.438 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.438 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.438 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.438 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:47.438 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: pgmap v465: 97 pgs: 97 active+clean; 21 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.6 MiB/s wr, 1.21k op/s 2024-06-03T00:02:47.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001880 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-17.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001769 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-5.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001782 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-26.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017af (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001728 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001794 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-29.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017f8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000191e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001805 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000182a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-12.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017d5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-19.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000174e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001928 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-8.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001949 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-16.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000190e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-73.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001913 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-19.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001825 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-1.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000183c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-12.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000177f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-6.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001759 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-15.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017aa (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018cb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-8.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018f5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-17.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000193c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-24.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018b0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-33.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017ba (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-6.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000183a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-25.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017b1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-26.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000175d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-45.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001765 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-18.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000186b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-16.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000178a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000172f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017fd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-23.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001845 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-20.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001820 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-23.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017db (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001937 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-21.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001788 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-10.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001873 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001758 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018c4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-17.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017c6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018b2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017f0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-33.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000189e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017da (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-26.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017e5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-23.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018a9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-38.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001867 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-20.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000178d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-22.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001933 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-64.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000187a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-10.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018d9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-15.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000190a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-6.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001874 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017dd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-10.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018ba (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017cd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/coverage.txt) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001775 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-5.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018fd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-19.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017b4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-8.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001763 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-24.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001946 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-14.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000188a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-8.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000194b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-17.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018eb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000186c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018f3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000174f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-89.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001802 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/testfrmw.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017d4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000193f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-19.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001945 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-66.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000190c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-5.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001850 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-11.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001838 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-101.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001887 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-7.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001813 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-17.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018b6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-18.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000018e9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-13.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000192e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-20.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017f2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017ea (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-3.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000188b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-16.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000180c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-4.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017dc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-9.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000181e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-9.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000017be (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-17.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001755 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-20.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fde (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/watchdog/watchdog.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fe0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/watchdog/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fe1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/watchdog/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fdf (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/watchdog/README) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010cb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_fumi.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010ea (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_reset.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.461 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010c2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_enclosure_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.461 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.461 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.461 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010db (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_resources.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.461 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010ef (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_control.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.461 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.461 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.461 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010f5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.461 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.461 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.461 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010dd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_power.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.461 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.461 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.461 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010c8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_sensor.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.462 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010c1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_callsupport.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.462 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.462 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.462 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010f0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_resources.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.462 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.462 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.462 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010c6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_discover.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.462 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010e7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.462 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.462 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.462 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010bf (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_re_discover.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.462 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010d8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_re_discover.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.463 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.463 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.463 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010c4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_server_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.463 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.463 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.463 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010d0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_interconnect_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.463 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010f4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_ps_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.463 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010ee (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_oa_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.463 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.463 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.463 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010d4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_ps_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.463 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.463 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.464 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010cf (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_fan_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.464 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.464 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.464 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010df (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_control.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.464 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010e9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_utils.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.464 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.464 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.467 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010eb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_annunciator.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.467 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.468 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.468 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010e6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_sensor.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.468 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.468 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.468 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010d1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_inventory.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.468 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.468 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.468 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010cd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_fumi.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.468 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.468 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.468 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010d3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_watchdog.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.469 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010f2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_hotswap.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.469 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010ed (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_dimi.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.469 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.469 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.469 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010e3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.469 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.469 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.469 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010c3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_calls.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.469 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010e5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_annunciator.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.469 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.469 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.470 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010d2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_power.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.470 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.470 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.470 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010e4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_load_id.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.470 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.470 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.470 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010dc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_oa_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.470 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010ca (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_watchdog.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.470 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010f3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.470 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.471 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.471 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010e8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_inventory.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.471 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.471 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.471 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010da (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_hotswap.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.471 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010e0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_callsupport.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.471 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010cc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_lcd_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.471 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.471 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.471 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010d9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_interconnect_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.471 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.471 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.471 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010f1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_fan_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.472 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010de (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_enclosure_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.472 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.472 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.472 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010c5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_sel.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.472 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010d6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_sel.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.472 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.472 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.472 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010e2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_utils.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.472 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.472 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.472 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010f6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_lcd_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.472 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.473 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.473 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010e1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_server_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.473 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010d7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_discover.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.473 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.473 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.473 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010d5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.473 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.473 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.473 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010c9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_calls.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.473 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.473 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.473 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010ce (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_load_id.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.473 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.473 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.474 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010ec (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.474 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.474 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.474 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010c0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_dimi.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.474 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.474 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.474 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010c7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_reset.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.474 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001111 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_annunciator_func.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.474 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.474 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.474 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000112f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_watchdog.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.474 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.474 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.475 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001126 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_power.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.475 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.475 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.475 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001110 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_hotswap.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.475 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.475 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.475 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000110c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_fumi_func.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.475 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.475 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.475 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001127 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_watchdog.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.475 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.475 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.475 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000112e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_annunciators.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.476 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.476 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.476 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001128 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_el.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.476 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.476 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.476 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001112 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_control_func.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.476 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.476 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.476 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001133 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.476 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001158 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.476 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001142 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_021.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.476 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001141 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_018.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.476 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001146 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_025.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.477 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000113c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_040.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.477 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000112c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_reset.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.477 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001114 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_reset.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.477 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001118 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_annunciators.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.477 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000111f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_control_func.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.477 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001155 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_004.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.477 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001129 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_resources2.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.477 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000115a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_027.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.477 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000110f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_dimi_func.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.477 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001135 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_036.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.477 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000115b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_002.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.477 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001157 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_017.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.477 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001130 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_controls.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.477 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001150 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_006.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.477 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001160 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_019.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.478 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001151 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_043.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.478 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000113b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_016.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.478 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001164 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_037.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.478 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001143 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_026.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.478 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000115f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_032.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.478 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001137 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_028.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.478 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000113e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_033.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.478 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000114a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_034.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.478 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000111b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_dimi_func.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.478 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000115e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_030.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.478 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000114f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_035.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.478 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000112a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.478 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001156 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.479 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000111d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_fumi.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.479 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001139 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_015.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.479 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000113f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_045.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.479 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001149 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_014.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.479 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000111e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_dimi.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.479 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001154 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_000.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.479 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000114e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_011.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.479 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001134 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_039.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.479 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001165 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.479 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001147 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_031.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.479 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000113d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_042.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.479 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000112b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_el.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.479 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001145 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/openhpi.conf) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.479 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001144 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_044.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.480 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001140 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_012.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.480 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000111a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_inventory.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.480 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001163 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.480 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001161 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_023.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.480 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001125 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_sensor_func.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.480 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001138 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_024.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.480 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000113a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_008.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.480 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000112d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_fumi_func.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.480 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000114d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_020.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.480 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001136 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_013.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.480 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001153 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_010.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.480 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001116 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_fumi.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.481 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000114c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_041.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.481 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001159 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_003.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.481 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000114b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_005.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.481 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001113 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_sensors.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.481 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001162 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_007.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.481 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001148 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_029.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.481 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001131 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_sensors.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.481 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001152 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_022.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.481 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000115d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_038.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.481 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000115c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_009.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.481 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000110d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_injector.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.481 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.481 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.481 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001119 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_controls.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.482 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.482 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.482 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001115 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_power.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.482 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.482 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.482 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000110e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_init.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.482 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.482 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.482 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001120 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_init.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.482 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.482 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.482 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001117 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_sensor_func.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.483 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.483 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.483 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001121 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_annunciator_func.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.483 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001123 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_inventory.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.483 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.483 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.483 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001132 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_injector.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.483 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.483 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.483 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001122 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_dimi.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.483 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.483 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.483 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000111c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_resources.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.483 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.483 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.484 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001124 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_hotswap.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.484 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010fe (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_ssl.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.484 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.484 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.484 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001100 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_ssl.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.484 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.484 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.484 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001108 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_idr.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.484 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.484 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.484 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001107 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_rpt.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.484 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001104 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_idr.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.484 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.484 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.485 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010fc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_control.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.485 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.485 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.485 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001103 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.485 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.485 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.485 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001109 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.485 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.485 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.485 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010f9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_reset.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.485 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.485 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.485 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001101 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.485 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.485 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.486 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000110a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.486 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010ff (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_discover.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.486 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.486 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.486 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010fb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_discover.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.486 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010fa (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_sensor.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.486 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.486 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.486 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001102 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_cmnds.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.486 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010fd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_xml.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.486 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001105 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_xml.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.486 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010f8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_power.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.486 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001106 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_sensor.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.486 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000117b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_indicator.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.487 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.487 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.487 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001173 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_reset.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.487 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.487 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.487 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000117a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_power.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.487 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.487 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.487 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000116e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_reset.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.487 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001183 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.487 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.487 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.487 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001170 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.487 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.488 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.488 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000116b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_inventory.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.488 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.488 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.488 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001184 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_control.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.488 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.488 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.488 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001182 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_hotswap.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.488 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.488 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.488 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000116d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_utils.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.488 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.488 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.489 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001175 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_watchdog.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.489 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001171 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_discover.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.489 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.489 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.489 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001179 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_resource.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.489 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.489 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.489 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001186 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_resource.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.489 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000117f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_control.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.489 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.489 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.489 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000116c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_watchdog.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.489 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.489 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.489 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001178 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_discover.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.490 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.490 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.490 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000116a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_indicator.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.490 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.490 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.490 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000117e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_annunciator.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.490 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.490 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.490 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001172 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_utils.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.490 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001180 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.490 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.490 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.491 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000117c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.491 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.491 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.491 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001177 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_eventlog.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.491 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.491 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.491 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001181 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_eventlog.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.491 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.491 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.491 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001169 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_hotswap.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.491 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.491 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.491 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000117d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_power.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.491 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000116f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_annunciator.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.492 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.492 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.492 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001176 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_sensor.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.492 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.492 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.492 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001185 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.492 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.492 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.492 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001174 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_inventory.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.492 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.492 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.492 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001167 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.492 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.492 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.493 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001168 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_sensor.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.493 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fc3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ekeyfru.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.493 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.493 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.493 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fbe (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sensor_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.493 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fbf (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_close.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.493 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.493 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.493 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fc1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_control_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.493 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.493 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.493 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fc0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/hotswap.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.493 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.493 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.493 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fc7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.sym) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.494 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.494 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.494 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fcb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/posix_vlog.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.494 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fd7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.494 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fd9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.494 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fd8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/ipmi_thres_test.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.494 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fda (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.494 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fc5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.494 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.494 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.494 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fc2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_connection.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.494 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fd2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.494 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.495 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.495 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fbd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_vshm_rdrs.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.495 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.495 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.495 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fd0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_mc_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.495 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.495 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.495 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fd3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_shelf_fru.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.495 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.495 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.495 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fce (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_entity.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.495 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.495 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.495 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fcc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.495 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.496 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.496 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fd4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_shelf_rdrs.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.496 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.496 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.496 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fdb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.496 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.496 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.496 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fca (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_inventory_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.496 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fbc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_entity_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.496 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.496 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.496 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fc8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/sync.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.496 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.497 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.497 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fc6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_inventory.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.497 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.497 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.497 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fd6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_slot_rdrs.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.497 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.497 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.497 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fd5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_util.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.497 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.497 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.497 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fc9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_drv.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.497 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.497 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.497 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fc4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_controls.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.498 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fcf (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sel.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.498 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.498 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.498 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fd1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_fru_rdrs.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.498 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fdc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sensor.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.498 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.498 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.498 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fcd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.498 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.498 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.498 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000ff3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_resource.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.498 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fea (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_rdr.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.498 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.499 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.499 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fff (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_utils.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.499 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.499 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.499 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001005 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.499 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.499 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.499 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001002 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_msg.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.499 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001015 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_force.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.499 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.499 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.499 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fe8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.499 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.499 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.500 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000ffd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_fru_info.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.500 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.500 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.500 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000ff9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_threshold.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.500 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.500 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.500 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001025 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.500 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000101b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/array.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.500 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.500 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.500 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000102e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.500 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000ffa (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_resource.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.500 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.500 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.501 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fe6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_log.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.501 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000102f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_factors.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.501 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000ff1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_domain.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.501 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001017 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_fix_sdr.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.501 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.501 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.501 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000101e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_domain.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.501 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.501 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.501 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001011 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_utils.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.501 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.501 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.501 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001008 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.501 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001031 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_entity.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.502 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.502 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.502 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001007 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_cmd.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.502 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.502 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.502 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000102b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_atca_led.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.502 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000101f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sel.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.502 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001032 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.502 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001035 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/thread_000.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.502 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001036 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/sensor_factors_000.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.502 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001038 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.502 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001037 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/con_001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.502 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001001 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.503 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001039 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.503 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001033 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/test.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.503 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001034 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/con_000.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.503 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000101c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_addr.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.503 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000ffc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_inventory_parser.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.503 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.503 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.503 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001029 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_discover.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.503 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.503 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.503 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001010 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con_smi.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.503 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.503 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.503 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001027 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_intel.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.503 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.504 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.504 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000100d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con_lan.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.504 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.504 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.504 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000101a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.504 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fe4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_fan.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.504 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001009 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_hotswap.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.504 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.504 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.504 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001024 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.504 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001003 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_inventory_parser.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.504 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.504 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.504 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001019 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sdr.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.505 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.505 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.505 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001022 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_atca_led.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.505 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001013 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.505 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000ff2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_fix_sdr.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.505 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001020 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.505 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.505 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.505 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000100e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_discrete.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.505 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.505 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.505 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000103a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_force.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.505 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.505 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.505 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000ffe (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_fru_info.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.506 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.506 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.508 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000102a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_watchdog.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.508 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.508 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.508 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001023 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_addr.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.508 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000102d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_cmd.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.508 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.508 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.508 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001000 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_msg.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.508 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001004 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_text_buffer.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.508 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.508 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.509 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000103b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.509 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fef (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sel.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.509 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.509 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.509 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001030 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_auth.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.509 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.509 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.509 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001018 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_event.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.509 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.509 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.509 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001021 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con_lan.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.509 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.509 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.509 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000100f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/hotswap.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.510 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.510 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.510 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000103c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_text_buffer.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.510 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.510 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.510 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fec (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_sun_led.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.510 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.510 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.510 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fe9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_discrete.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.510 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.510 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.510 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001026 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/thread.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.510 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000100c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.511 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000ff6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_auth.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.511 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.511 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.511 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000100a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/thread.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.511 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.511 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.511 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000ffb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.511 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fed (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_sun.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.511 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.511 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.511 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000101d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_inventory.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.511 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.511 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.512 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001028 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_sun.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.512 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000ff5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_inventory.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.512 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.512 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.512 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000ff7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_discover.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.512 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.512 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.512 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000102c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_sun_led.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.512 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.512 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.512 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000feb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sdr.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.512 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.512 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.512 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001012 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_watchdog.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.512 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.513 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.513 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000ff8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_intel.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.513 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.513 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.513 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000100b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_rdr.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.513 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.513 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.513 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fe7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_fan.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.513 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fee (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.513 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.513 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.513 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000ff4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_factors.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.513 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.513 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.513 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fe3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_hotswap.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.513 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.514 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.514 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000fe5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con_smi.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.514 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.514 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.514 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001014 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.514 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.514 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.514 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000000ff0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_log.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.514 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001006 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_threshold.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.514 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.514 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.514 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001016 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_entity.cpp) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.515 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.515 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.515 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000106b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.515 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000105a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_discover_bc.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.515 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.515 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.515 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001061 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_resources.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.515 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.515 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.515 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000105d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_control.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.515 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001045 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_watchdog.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.515 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.515 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.516 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001042 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_session.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.516 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.516 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.516 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000103f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_inventory.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.516 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000106c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.516 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010a7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel007.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.516 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010b4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset009.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.516 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010ba (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset024.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.516 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001091 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/treset001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.516 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001063 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_el.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.516 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000104d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_sel.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.517 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001048 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_inventory.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.517 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001062 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_control.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.517 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000106d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tcontrol001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.517 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001044 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_sensor.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.517 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010a8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.517 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000107c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget013.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.517 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001050 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_discover_bc.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.517 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010b9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset002.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.517 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000105e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.517 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000107d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/sim_file.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.517 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001074 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv003.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.517 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001085 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset019.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.517 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010a1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/thotswap001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.517 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001053 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_sel.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.518 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010bc (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset006.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.518 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010a6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsim_file.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.518 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001081 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tcontrolfailover.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.518 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001049 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_xml2event.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.518 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010aa (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset005.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.518 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000108e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget004.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.518 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010ad (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.518 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001075 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset020.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.518 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001069 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_discover_rsa.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.518 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010b0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tpower001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.518 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000109f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv006.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.519 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001093 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tset_resource_tag.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.519 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001079 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset017.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.519 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000104f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_hotswap.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.519 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010b7 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget040.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.519 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010a2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset021.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.519 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000107e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv004.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.519 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001057 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_power.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.519 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010a4 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/thotswap-mhs001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.519 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010a0 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget036.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.519 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010b6 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel006.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.519 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001066 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.519 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010ac (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset007.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.519 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010ab (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset018.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.519 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010a3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget035.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.519 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000104c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_time.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.520 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001078 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel004.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.520 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010a9 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset012.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.520 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001076 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tcontrol003.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.520 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001084 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsetup.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.520 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001052 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_discover.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.520 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010b2 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.520 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001088 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget002.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.520 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010a5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/sim_test_file) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.520 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000108a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel002.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.520 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000109e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.520 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000108d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget016.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.520 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000109d (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv005.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.520 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001092 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset013.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.520 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010b3 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset015.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.520 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000107f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tset_resource_sev.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.521 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001067 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_utils.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.521 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000106a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_el2event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.521 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001086 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/openhpi.conf) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.521 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000108f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel005.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.521 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000106f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tdiscover001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.521 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001065 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_resources_rsa.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.521 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001095 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget010.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.521 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010b8 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.521 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001073 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tcontrol002.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.521 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001060 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_reset.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.521 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001083 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/sim_resources.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.521 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001098 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset008.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.521 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010af (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset022.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.521 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000107b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset004.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.522 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000105f (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_discover.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.522 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010ae (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tevent.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.522 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001040 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/eventmap2code.pl) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.522 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010bb (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset003.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.522 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001080 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset010.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.522 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000108b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget005.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.522 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010b1 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsptime002.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.522 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010bd (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.522 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000107a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tcontrol_parms.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.522 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001096 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.522 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001097 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/snmp_utils.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.522 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000104b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_sensor.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.522 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001077 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget003.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.522 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001072 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget041.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.522 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001071 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/sim_init.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.523 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001055 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_power.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.523 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000109a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv007.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.523 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000108c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset023.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.523 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000109c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/thotswap-simple001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.523 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001090 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv002.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.523 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x100000010b5 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsnmp_bc_getset.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.523 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000105b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_annunciator.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.523 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000109b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget034.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.523 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001082 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsptime001.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.523 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001068 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_lock.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.523 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001089 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset011.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.523 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001070 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget033.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.523 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001099 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsetup.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.523 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001087 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/sim_resources.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.523 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001054 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_event.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.523 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001094 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel003.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.524 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000106e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget031.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.524 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001047 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_time.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.524 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.524 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.524 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000103e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.524 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.524 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.524 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001056 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_event.map) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.524 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.524 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.524 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000104e (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_utils.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.524 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.524 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.524 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001041 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/sim_init.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.524 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.525 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.525 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001059 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/sim_init.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.525 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.525 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.525 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000105c (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_reset.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.525 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.525 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.525 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000104a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_annunciator.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.525 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.525 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.525 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001064 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_hotswap.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.525 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001058 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_resources.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.525 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.525 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.525 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001046 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_plugin.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.525 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001051 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_watchdog.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.526 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001043 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_session.h) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.526 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.526 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.526 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001189 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/sysfs/Makefile.in) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.526 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000118b (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/sysfs/Makefile.am) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.526 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.526 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.526 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x10000001188 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/sysfs/README) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.527 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: Scrub error on inode 0x1000000118a (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/sysfs/sysfs2hpi.c) see mds.c log and `damage ls` output for details 2024-06-03T00:02:47.527 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.527 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.527 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.527 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.527 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.527 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.528 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.528 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.528 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.528 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.528 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.528 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.529 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.529 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.529 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.530 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.530 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.530 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.530 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.530 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.530 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.530 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.530 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.531 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.531 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.531 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.531 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.531 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.531 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.531 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.531 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.531 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.531 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.531 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.531 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.531 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.531 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.531 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.532 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.532 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.532 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.532 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.532 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.532 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.532 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.532 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:47.532 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:46 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:47.908 INFO:tasks.cephfs.filesystem:scrub status for tag:b2878f21-cfde-4c0f-bff1-a048258a6bb8 - {'path': '/', 'tag': 'b2878f21-cfde-4c0f-bff1-a048258a6bb8', 'options': 'recursive,force'} 2024-06-03T00:02:48.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.212 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.212 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.212 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.212 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.212 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.212 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.212 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.212 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.212 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.212 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.212 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.212 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.212 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.212 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.213 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.213 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.213 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.213 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.213 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.213 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.213 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.213 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.213 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.213 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.213 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.213 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.213 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.214 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.214 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.214 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.214 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.214 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.214 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.214 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.214 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.214 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.214 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.214 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.214 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.214 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.215 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.215 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.215 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.215 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.215 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.215 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.215 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.215 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.216 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.216 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.216 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.216 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.216 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.216 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.216 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.216 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.216 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.216 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.217 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.217 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.217 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.217 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.217 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.217 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.217 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.217 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.217 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.217 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.217 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.217 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.217 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.217 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.218 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.218 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.218 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.218 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.218 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.218 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.218 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.218 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.218 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.218 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.219 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.219 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.219 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.219 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.219 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.219 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.219 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.219 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.219 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.219 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.219 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.219 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.219 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.219 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.220 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.220 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.220 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.220 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.220 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.220 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.220 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.220 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.220 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.220 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.220 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.220 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.220 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.220 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.221 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.221 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.221 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.221 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.221 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.221 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.221 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.221 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.221 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.221 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.221 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.221 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.221 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.221 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:48.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:47 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.358 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.358 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.358 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.358 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.358 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.359 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.359 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.359 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.359 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.359 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.359 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.359 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.359 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.359 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.359 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.359 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.359 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.359 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.359 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.362 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.362 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.362 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.362 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.362 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.362 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.362 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.362 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.362 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.362 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.362 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.362 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.362 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.362 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.363 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.363 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.363 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.363 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.363 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.363 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.363 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.363 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.363 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.363 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.363 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.363 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.363 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.363 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.363 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.363 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.364 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.364 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.364 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.364 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.364 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.364 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.364 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.364 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.364 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.364 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.364 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.364 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.364 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.364 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.364 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.364 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.365 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.365 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.365 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.365 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.365 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.365 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.365 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.365 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.365 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.365 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.365 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.365 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.365 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.365 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:48.365 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:47 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.461 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.461 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.461 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.461 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.461 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.461 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.461 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.461 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.461 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.461 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.461 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.461 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.461 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.461 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.461 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.462 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.462 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.462 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.462 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.462 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:48.462 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:48.462 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:47 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:49.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:48 smithi107 ceph-mon[37048]: pgmap v466: 97 pgs: 97 active+clean; 25 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.5 MiB/s wr, 1.25k op/s 2024-06-03T00:02:49.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:48 smithi107 ceph-mon[37048]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:02:49.425 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:48 smithi049 ceph-mon[32302]: pgmap v466: 97 pgs: 97 active+clean; 25 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.5 MiB/s wr, 1.25k op/s 2024-06-03T00:02:49.425 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:48 smithi049 ceph-mon[32302]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:02:49.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:48 smithi057 ceph-mon[36457]: pgmap v466: 97 pgs: 97 active+clean; 25 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.5 MiB/s wr, 1.25k op/s 2024-06-03T00:02:49.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:48 smithi057 ceph-mon[36457]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:02:51.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: pgmap v467: 97 pgs: 97 active+clean; 57 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.4 MiB/s wr, 1.88k op/s 2024-06-03T00:02:51.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:51.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:51.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:51.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:51.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:51.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:51.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:51.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:51.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:51.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:51.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:51.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:51.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:51.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:51.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:51.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:51.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:51.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:51.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:51.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:51.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:51.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:51.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:51.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:51.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:51.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:51.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:50 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: pgmap v467: 97 pgs: 97 active+clean; 57 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.4 MiB/s wr, 1.88k op/s 2024-06-03T00:02:51.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:51.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:51.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:51.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:51.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:51.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:51.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:51.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:51.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:51.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:51.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:51.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:51.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:51.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:51.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:51.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:51.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:51.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:51.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:51.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:51.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:51.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:51.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:51.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:51.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:51.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:51.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:50 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: pgmap v467: 97 pgs: 97 active+clean; 57 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.4 MiB/s wr, 1.88k op/s 2024-06-03T00:02:51.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:51.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:51.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:51.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:51.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mon-a[32298]: 2024-06-03T00:02:50.979+0000 7f435dd58700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-06-03T00:02:51.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:51.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:51.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:51.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:51.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:51.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:51.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:51.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:51.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:51.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:51.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:51.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:51.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:51.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:51.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:51.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:51.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:51.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:51.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:51.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:51.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:51.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:51.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:51.466 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:50 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.352 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.355 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.356 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.356 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.356 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.356 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.356 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.356 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.356 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.356 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.356 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.356 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.356 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.356 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.356 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.356 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.357 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.357 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.357 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.357 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.357 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.357 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.357 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.357 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.357 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.357 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.357 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.357 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.357 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.357 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.357 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.358 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.358 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.358 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.358 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.358 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.358 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.358 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.358 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.358 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.358 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.358 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.358 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.358 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.358 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.359 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.359 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.359 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.359 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.359 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.359 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.359 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.359 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.359 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.359 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.359 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.359 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.359 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.359 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.359 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-06-03T00:02:52.360 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: mds.? [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] up:active 2024-06-03T00:02:52.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:02:52.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: active paths [/] 2024-06-03T00:02:52.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.361 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:51 smithi107 ceph-mon[37048]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.453 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.455 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.456 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.457 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.459 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-06-03T00:02:52.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: mds.? [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] up:active 2024-06-03T00:02:52.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:02:52.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: active paths [/] 2024-06-03T00:02:52.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.460 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:51 smithi057 ceph-mon[36457]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.464 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.465 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.466 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.466 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.466 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.466 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.466 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.466 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.466 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.466 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.466 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.466 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.466 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.466 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.466 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.466 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.467 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.467 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.467 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.467 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.467 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.467 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.467 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.467 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.467 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.467 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.467 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.467 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.467 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.467 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.468 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.468 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.468 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.468 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.468 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.468 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.468 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.468 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.468 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.468 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.469 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.469 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.469 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.469 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.469 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.469 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.469 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.469 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.469 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.469 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.469 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.469 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.469 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.469 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.470 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.470 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.470 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.470 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.470 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.470 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.470 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.470 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.470 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.470 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.470 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.470 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.470 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.470 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.471 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.471 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.471 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.471 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.471 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.471 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-06-03T00:02:52.471 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: mds.? [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] up:active 2024-06-03T00:02:52.471 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:02:52.471 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.471 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.471 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: active paths [/] 2024-06-03T00:02:52.471 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.471 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:51 smithi049 ceph-mon[32302]: scrub summary: idle+waiting paths [/] 2024-06-03T00:02:52.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.714+0000 7ff1e5d61640 1 -- 172.21.15.49:0/3631488203 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1e0101af0 msgr2=0x7ff1e0101f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:52.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.714+0000 7ff1e5d61640 1 --2- 172.21.15.49:0/3631488203 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1e0101af0 0x7ff1e0101f70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0009900 tx=0x7ff1d002a410 comp rx=0 tx=0).stop 2024-06-03T00:02:52.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.714+0000 7ff1e5d61640 1 -- 172.21.15.49:0/3631488203 shutdown_connections 2024-06-03T00:02:52.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.714+0000 7ff1e5d61640 1 --2- 172.21.15.49:0/3631488203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1e01024b0 0x7ff1e0108d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:52.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.714+0000 7ff1e5d61640 1 --2- 172.21.15.49:0/3631488203 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1e0101af0 0x7ff1e0101f70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:52.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.714+0000 7ff1e5d61640 1 --2- 172.21.15.49:0/3631488203 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1e0100900 0x7ff1e0100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:52.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.714+0000 7ff1e5d61640 1 -- 172.21.15.49:0/3631488203 >> 172.21.15.49:0/3631488203 conn(0x7ff1e00fbe70 msgr2=0x7ff1e00fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:52.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.714+0000 7ff1e5d61640 1 -- 172.21.15.49:0/3631488203 shutdown_connections 2024-06-03T00:02:52.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.714+0000 7ff1e5d61640 1 -- 172.21.15.49:0/3631488203 wait complete. 2024-06-03T00:02:52.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.715+0000 7ff1e5d61640 1 Processor -- start 2024-06-03T00:02:52.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.715+0000 7ff1e5d61640 1 -- start start 2024-06-03T00:02:52.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.715+0000 7ff1e5d61640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1e0100900 0x7ff1e0197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:52.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.715+0000 7ff1e5d61640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1e0101af0 0x7ff1e01981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:52.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.715+0000 7ff1e5d61640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1e01024b0 0x7ff1e019f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:52.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.715+0000 7ff1e5d61640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e010d6a0 con 0x7ff1e0101af0 2024-06-03T00:02:52.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.715+0000 7ff1e5d61640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e010d520 con 0x7ff1e0100900 2024-06-03T00:02:52.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.715+0000 7ff1e5d61640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e010d820 con 0x7ff1e01024b0 2024-06-03T00:02:52.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.715+0000 7ff1deffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1e0101af0 0x7ff1e01981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.716+0000 7ff1dffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1e01024b0 0x7ff1e019f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.716+0000 7ff1deffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1e0101af0 0x7ff1e01981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50860/0 (socket says 172.21.15.49:50860) 2024-06-03T00:02:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.716+0000 7ff1deffd640 1 -- 172.21.15.49:0/2355365910 learned_addr learned my addr 172.21.15.49:0/2355365910 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.716+0000 7ff1df7fe640 1 --2- 172.21.15.49:0/2355365910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1e0100900 0x7ff1e0197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.716+0000 7ff1deffd640 1 -- 172.21.15.49:0/2355365910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1e01024b0 msgr2=0x7ff1e019f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.716+0000 7ff1deffd640 1 --2- 172.21.15.49:0/2355365910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1e01024b0 0x7ff1e019f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.716+0000 7ff1deffd640 1 -- 172.21.15.49:0/2355365910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1e0100900 msgr2=0x7ff1e0197c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.716+0000 7ff1deffd640 1 --2- 172.21.15.49:0/2355365910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1e0100900 0x7ff1e0197c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.716+0000 7ff1deffd640 1 -- 172.21.15.49:0/2355365910 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e019f8b0 con 0x7ff1e0101af0 2024-06-03T00:02:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.716+0000 7ff1deffd640 1 --2- 172.21.15.49:0/2355365910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1e0101af0 0x7ff1e01981b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0009230 tx=0x7ff1d0031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.716+0000 7ff1dcff9640 1 -- 172.21.15.49:0/2355365910 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d003f030 con 0x7ff1e0101af0 2024-06-03T00:02:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.716+0000 7ff1e5d61640 1 -- 172.21.15.49:0/2355365910 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1e019fb40 con 0x7ff1e0101af0 2024-06-03T00:02:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.716+0000 7ff1dcff9640 1 -- 172.21.15.49:0/2355365910 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1d0003ad0 con 0x7ff1e0101af0 2024-06-03T00:02:52.719 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.716+0000 7ff1dcff9640 1 -- 172.21.15.49:0/2355365910 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d0035070 con 0x7ff1e0101af0 2024-06-03T00:02:52.719 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.716+0000 7ff1e5d61640 1 -- 172.21.15.49:0/2355365910 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1e01a0030 con 0x7ff1e0101af0 2024-06-03T00:02:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.719+0000 7ff1dcff9640 1 -- 172.21.15.49:0/2355365910 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff1d0042030 con 0x7ff1e0101af0 2024-06-03T00:02:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.719+0000 7ff1e8a6f740 1 Processor -- start 2024-06-03T00:02:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.719+0000 7ff1e8a6f740 1 -- start start 2024-06-03T00:02:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.719+0000 7ff1e8a6f740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609f739f010 0x5609f739f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.719+0000 7ff1e8a6f740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5609f739fa00 0x5609f73a4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.719+0000 7ff1e8a6f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5609f73a4b70 0x5609f73a7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.719+0000 7ff1e8a6f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5609f73024f0 con 0x5609f73a4b70 2024-06-03T00:02:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.719+0000 7ff1e8a6f740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5609f72a0870 con 0x5609f739f010 2024-06-03T00:02:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.719+0000 7ff1e8a6f740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5609f72fe4b0 con 0x5609f739fa00 2024-06-03T00:02:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.719+0000 7ff1df7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5609f739fa00 0x5609f73a4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.719+0000 7ff1df7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5609f739fa00 0x5609f73a4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:40232/0 (socket says 172.21.15.49:40232) 2024-06-03T00:02:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.719+0000 7ff1df7fe640 1 -- 172.21.15.49:0/2664496525 learned_addr learned my addr 172.21.15.49:0/2664496525 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.719+0000 7ff1deffd640 1 --2- 172.21.15.49:0/2664496525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5609f73a4b70 0x5609f73a7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.719+0000 7ff1dcff9640 1 --2- 172.21.15.49:0/2355365910 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff1cc0a2c30 0x7ff1cc0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.719+0000 7ff1dffff640 1 --2- 172.21.15.49:0/2664496525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609f739f010 0x5609f739f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.720+0000 7ff1dffff640 1 --2- 172.21.15.49:0/2355365910 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff1cc0a2c30 0x7ff1cc0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.720+0000 7ff1df7fe640 1 -- 172.21.15.49:0/2664496525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609f739f010 msgr2=0x5609f739f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.720+0000 7ff1df7fe640 1 --2- 172.21.15.49:0/2664496525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609f739f010 0x5609f739f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.720+0000 7ff1df7fe640 1 -- 172.21.15.49:0/2664496525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5609f73a4b70 msgr2=0x5609f73a7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:52.730 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.720+0000 7ff1df7fe640 1 --2- 172.21.15.49:0/2664496525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5609f73a4b70 0x5609f73a7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:52.730 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.720+0000 7ff1df7fe640 1 -- 172.21.15.49:0/2664496525 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609f72bc9b0 con 0x5609f739fa00 2024-06-03T00:02:52.730 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.720+0000 7ff1dffff640 1 --2- 172.21.15.49:0/2664496525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609f739f010 0x5609f739f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:02:52.730 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.720+0000 7ff1dcff9640 1 -- 172.21.15.49:0/2355365910 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7ff1d00ef5f0 con 0x7ff1e0101af0 2024-06-03T00:02:52.730 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.720+0000 7ff1df7fe640 1 --2- 172.21.15.49:0/2664496525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5609f739fa00 0x5609f73a4500 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8009bf0 tx=0x7ff1c80117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66259029bfa29984 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:52.730 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.720+0000 7ff1dffff640 1 --2- 172.21.15.49:0/2355365910 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff1cc0a2c30 0x7ff1cc0a50f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x5609f73a0260 tx=0x7ff1d8009600 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:52.730 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.720+0000 7ff1d5ffb640 1 -- 172.21.15.49:0/2664496525 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c8012450 con 0x5609f739fa00 2024-06-03T00:02:52.730 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.720+0000 7ff1d5ffb640 1 -- 172.21.15.49:0/2664496525 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1c8012ad0 con 0x5609f739fa00 2024-06-03T00:02:52.730 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.720+0000 7ff1d5ffb640 1 -- 172.21.15.49:0/2664496525 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c800fb60 con 0x5609f739fa00 2024-06-03T00:02:52.730 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.721+0000 7ff1e8a6f740 1 -- 172.21.15.49:0/2664496525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5609f739fa00 msgr2=0x5609f73a4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:52.730 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.721+0000 7ff1e8a6f740 1 --2- 172.21.15.49:0/2664496525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5609f739fa00 0x5609f73a4500 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8009bf0 tx=0x7ff1c80117b0 comp rx=0 tx=0).stop 2024-06-03T00:02:52.730 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.721+0000 7ff1e8a6f740 1 -- 172.21.15.49:0/2664496525 shutdown_connections 2024-06-03T00:02:52.730 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.721+0000 7ff1e8a6f740 1 --2- 172.21.15.49:0/2664496525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5609f73a4b70 0x5609f73a7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.721+0000 7ff1e8a6f740 1 --2- 172.21.15.49:0/2664496525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5609f739fa00 0x5609f73a4500 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.721+0000 7ff1e8a6f740 1 --2- 172.21.15.49:0/2664496525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609f739f010 0x5609f739f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.721+0000 7ff1e8a6f740 1 -- 172.21.15.49:0/2664496525 >> 172.21.15.49:0/2664496525 conn(0x5609f739a680 msgr2=0x5609f739aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.721+0000 7ff1e8a6f740 1 -- 172.21.15.49:0/2664496525 shutdown_connections 2024-06-03T00:02:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.721+0000 7ff1e8a6f740 1 -- 172.21.15.49:0/2664496525 wait complete. 2024-06-03T00:02:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.721+0000 7ff1e8a6f740 1 -- start start 2024-06-03T00:02:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.721+0000 7ff1e8a6f740 1 Processor -- start 2024-06-03T00:02:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.722+0000 7ff1e8a6f740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5609f739f010 0x5609f73a92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.722+0000 7ff1e8a6f740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609f739fa00 0x5609f73a97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.722+0000 7ff1e8a6f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5609f73a4b70 0x5609f73b0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.722+0000 7ff1e8a6f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5609f73a7b20 con 0x5609f73a4b70 2024-06-03T00:02:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.722+0000 7ff1e8a6f740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5609f728bae0 con 0x5609f739fa00 2024-06-03T00:02:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.722+0000 7ff1e8a6f740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5609f73a7ca0 con 0x5609f739f010 2024-06-03T00:02:52.732 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.722+0000 7ff1e8a6f740 10 client.0 _ll_register_callbacks cb 0x5609f72c49b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:02:52.732 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.722+0000 7ff1df7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5609f739f010 0x5609f73a92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:52.732 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.722+0000 7ff1dffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5609f73a4b70 0x5609f73b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:52.732 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.722+0000 7ff1df7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5609f739f010 0x5609f73a92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:40236/0 (socket says 172.21.15.49:40236) 2024-06-03T00:02:52.732 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.722+0000 7ff1df7fe640 1 -- 172.21.15.49:0/1560231643 learned_addr learned my addr 172.21.15.49:0/1560231643 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:52.732 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.722+0000 7ff1deffd640 1 --2- 172.21.15.49:0/1560231643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609f739fa00 0x5609f73a97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:52.732 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.722+0000 7ff1df7fe640 1 -- 172.21.15.49:0/1560231643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609f739fa00 msgr2=0x5609f73a97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:52.732 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.722+0000 7ff1df7fe640 1 --2- 172.21.15.49:0/1560231643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609f739fa00 0x5609f73a97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:52.732 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.722+0000 7ff1df7fe640 1 -- 172.21.15.49:0/1560231643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5609f73a4b70 msgr2=0x5609f73b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:52.732 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.722+0000 7ff1df7fe640 1 --2- 172.21.15.49:0/1560231643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5609f73a4b70 0x5609f73b0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:52.732 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.722+0000 7ff1df7fe640 1 -- 172.21.15.49:0/1560231643 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609f7016210 con 0x5609f739f010 2024-06-03T00:02:52.732 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.722+0000 7ff1dffff640 1 --2- 172.21.15.49:0/1560231643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5609f73a4b70 0x5609f73b0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:02:52.732 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.722+0000 7ff1df7fe640 1 --2- 172.21.15.49:0/1560231643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5609f739f010 0x5609f73a92b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8011cb0 tx=0x7ff1c8012eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b00a9badd0bdcc10 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.722+0000 7ff1beffd640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-06-03T00:02:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.723+0000 7ff1beffd640 1 -- 172.21.15.49:0/1560231643 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c8028070 con 0x5609f739f010 2024-06-03T00:02:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.723+0000 7ff1beffd640 1 -- 172.21.15.49:0/1560231643 <== mon.1 v2:172.21.15.107:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7ff1c800f8a0 con 0x5609f739f010 2024-06-03T00:02:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.723+0000 7ff1e8a6f740 1 -- 172.21.15.49:0/1560231643 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1c8012ad0 con 0x5609f739f010 2024-06-03T00:02:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.723+0000 7ff1beffd640 1 -- 172.21.15.49:0/1560231643 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff1c8034050 con 0x5609f739f010 2024-06-03T00:02:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.723+0000 7ff1e8a6f740 10 client.25546 fetch_fsmap learned FSMap version 30 2024-06-03T00:02:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.723+0000 7ff1e8a6f740 1 -- 172.21.15.49:0/1560231643 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5609f70e2620 con 0x5609f739f010 2024-06-03T00:02:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.723+0000 7ff1beffd640 1 -- 172.21.15.49:0/1560231643 <== mon.1 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1c8012ad0 con 0x5609f739f010 2024-06-03T00:02:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.723+0000 7ff1beffd640 1 -- 172.21.15.49:0/1560231643 <== mon.1 v2:172.21.15.107:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7ff1c80046c0 con 0x5609f739f010 2024-06-03T00:02:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.723+0000 7ff1e8a6f740 10 client.25546 fetch_fsmap finished waiting for FSMap version 30 2024-06-03T00:02:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.723+0000 7ff1e8a6f740 10 client.25546 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:02:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.723+0000 7ff1e8a6f740 20 client.25546 populate_metadata read hostname 'smithi049' 2024-06-03T00:02:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.723+0000 7ff1e8a6f740 1 --2- 172.21.15.49:0/1560231643 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5609f73b4de0 0x5609f73b7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.723+0000 7ff1e8a6f740 4 client.25546 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:02:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.723+0000 7ff1e8a6f740 1 -- 172.21.15.49:0/1560231643 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5609f7315f10 con 0x5609f73b4de0 2024-06-03T00:02:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.723+0000 7ff1deffd640 1 --2- 172.21.15.49:0/1560231643 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5609f73b4de0 0x5609f73b7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.724+0000 7ff1deffd640 1 --2- 172.21.15.49:0/1560231643 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5609f73b4de0 0x5609f73b7210 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a352a0a97e1be237 server_cookie=d4836a612d6fcd83 in_seq=0 out_seq=0 2024-06-03T00:02:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.724+0000 7ff1beffd640 10 client.25546 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.726+0000 7ff1beffd640 1 -- 172.21.15.49:0/1560231643 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5609f7315f10 con 0x5609f73b4de0 2024-06-03T00:02:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.726+0000 7ff1beffd640 10 client.25546 handle_command_reply: tid=0 2024-06-03T00:02:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.726+0000 7ff1e8a6f740 1 client.25546 shutdown 2024-06-03T00:02:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.726+0000 7ff1e8a6f740 1 -- 172.21.15.49:0/1560231643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5609f739f010 msgr2=0x5609f73a92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.726+0000 7ff1e8a6f740 1 --2- 172.21.15.49:0/1560231643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5609f739f010 0x5609f73a92b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8011cb0 tx=0x7ff1c8012eb0 comp rx=0 tx=0).stop 2024-06-03T00:02:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.726+0000 7ff1e8a6f740 1 -- 172.21.15.49:0/1560231643 shutdown_connections 2024-06-03T00:02:52.735 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.726+0000 7ff1e8a6f740 1 --2- 172.21.15.49:0/1560231643 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5609f73b4de0 0x5609f73b7210 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:52.735 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.726+0000 7ff1e8a6f740 1 --2- 172.21.15.49:0/1560231643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609f739fa00 0x5609f73a97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:52.735 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.726+0000 7ff1e8a6f740 1 --2- 172.21.15.49:0/1560231643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5609f73a4b70 0x5609f73b0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:52.735 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.726+0000 7ff1beffd640 0 client.25546 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:52.735 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.726+0000 7ff1e8a6f740 1 --2- 172.21.15.49:0/1560231643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5609f739f010 0x5609f73a92b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:52.735 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.726+0000 7ff1e8a6f740 1 -- 172.21.15.49:0/1560231643 >> 172.21.15.49:0/1560231643 conn(0x5609f739a680 msgr2=0x5609f73997e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:52.735 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.726+0000 7ff1e8a6f740 1 -- 172.21.15.49:0/1560231643 shutdown_connections 2024-06-03T00:02:52.735 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.726+0000 7ff1e8a6f740 1 -- 172.21.15.49:0/1560231643 wait complete. 2024-06-03T00:02:52.735 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.726+0000 7ff1e8a6f740 20 client.25546 trim_cache size 0 max 16384 2024-06-03T00:02:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.742+0000 7ff1e8a6f740 1 Processor -- start 2024-06-03T00:02:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.742+0000 7ff1e8a6f740 1 -- start start 2024-06-03T00:02:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.742+0000 7ff1e8a6f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5609f739f010 0x5609f739d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.742+0000 7ff1e8a6f740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609f739fa00 0x5609f739db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.742+0000 7ff1e8a6f740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5609f73a4b70 0x5609f73a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.742+0000 7ff1e8a6f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e01a8e40 con 0x5609f739f010 2024-06-03T00:02:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.742+0000 7ff1e8a6f740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e01aaa10 con 0x5609f739fa00 2024-06-03T00:02:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.742+0000 7ff1e8a6f740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e01a9510 con 0x5609f73a4b70 2024-06-03T00:02:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.742+0000 7ff1df7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5609f739f010 0x5609f739d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.743+0000 7ff1df7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5609f739f010 0x5609f739d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50894/0 (socket says 172.21.15.49:50894) 2024-06-03T00:02:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.743+0000 7ff1dffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5609f73a4b70 0x5609f73a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.743+0000 7ff1df7fe640 1 -- 172.21.15.49:0/1662730288 learned_addr learned my addr 172.21.15.49:0/1662730288 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:52.745 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.743+0000 7ff1deffd640 1 --2- 172.21.15.49:0/1662730288 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609f739fa00 0x5609f739db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:52.745 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.743+0000 7ff1df7fe640 1 -- 172.21.15.49:0/1662730288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5609f73a4b70 msgr2=0x5609f73a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:52.745 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.743+0000 7ff1df7fe640 1 --2- 172.21.15.49:0/1662730288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5609f73a4b70 0x5609f73a88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:52.745 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.743+0000 7ff1df7fe640 1 -- 172.21.15.49:0/1662730288 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609f739fa00 msgr2=0x5609f739db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:52.745 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.743+0000 7ff1df7fe640 1 --2- 172.21.15.49:0/1662730288 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609f739fa00 0x5609f739db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:52.745 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.743+0000 7ff1df7fe640 1 -- 172.21.15.49:0/1662730288 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609f73a3ef0 con 0x5609f739f010 2024-06-03T00:02:52.745 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.743+0000 7ff1df7fe640 1 --2- 172.21.15.49:0/1662730288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5609f739f010 0x5609f739d650 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8009650 tx=0x7ff1c8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3bbddea56e08ef6 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:52.745 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.743+0000 7ff1d57fa640 1 -- 172.21.15.49:0/1662730288 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c8028040 con 0x5609f739f010 2024-06-03T00:02:52.745 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.743+0000 7ff1d57fa640 1 -- 172.21.15.49:0/1662730288 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1c8005040 con 0x5609f739f010 2024-06-03T00:02:52.745 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.743+0000 7ff1d57fa640 1 -- 172.21.15.49:0/1662730288 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c80042b0 con 0x5609f739f010 2024-06-03T00:02:52.745 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.744+0000 7ff1e8a6f740 1 -- 172.21.15.49:0/1662730288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5609f739f010 msgr2=0x5609f739d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:52.745 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.744+0000 7ff1e8a6f740 1 --2- 172.21.15.49:0/1662730288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5609f739f010 0x5609f739d650 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8009650 tx=0x7ff1c8009260 comp rx=0 tx=0).stop 2024-06-03T00:02:52.746 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.744+0000 7ff1e8a6f740 1 -- 172.21.15.49:0/1662730288 shutdown_connections 2024-06-03T00:02:52.746 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.744+0000 7ff1e8a6f740 1 --2- 172.21.15.49:0/1662730288 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609f739fa00 0x5609f739db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:52.746 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.744+0000 7ff1e8a6f740 1 --2- 172.21.15.49:0/1662730288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5609f73a4b70 0x5609f73a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:52.746 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.744+0000 7ff1e8a6f740 1 --2- 172.21.15.49:0/1662730288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5609f739f010 0x5609f739d650 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:52.746 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.744+0000 7ff1e8a6f740 1 -- 172.21.15.49:0/1662730288 >> 172.21.15.49:0/1662730288 conn(0x5609f739a680 msgr2=0x5609f73a80a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:52.746 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.744+0000 7ff1e8a6f740 1 -- 172.21.15.49:0/1662730288 shutdown_connections 2024-06-03T00:02:52.746 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.744+0000 7ff1e8a6f740 1 -- 172.21.15.49:0/1662730288 wait complete. 2024-06-03T00:02:52.746 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.744+0000 7ff1e8a6f740 1 -- start start 2024-06-03T00:02:52.746 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.744+0000 7ff1e8a6f740 1 Processor -- start 2024-06-03T00:02:52.748 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.745+0000 7ff1e8a6f740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609f739f010 0x5609f741a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:52.748 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.745+0000 7ff1e8a6f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5609f739fa00 0x5609f741ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:52.748 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.745+0000 7ff1e8a6f740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5609f73a4b70 0x5609f7421b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.745+0000 7ff1e8a6f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e01aa2b0 con 0x5609f739fa00 2024-06-03T00:02:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.745+0000 7ff1e8a6f740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e01a9be0 con 0x5609f739f010 2024-06-03T00:02:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.745+0000 7ff1e8a6f740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e01a6e00 con 0x5609f73a4b70 2024-06-03T00:02:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.745+0000 7ff1e8a6f740 10 client.0 _ll_register_callbacks cb 0x7ff1d00bbc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:02:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.745+0000 7ff1deffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5609f739fa00 0x5609f741ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.745+0000 7ff1deffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5609f739fa00 0x5609f741ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50900/0 (socket says 172.21.15.49:50900) 2024-06-03T00:02:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.745+0000 7ff1deffd640 1 -- 172.21.15.49:0/3695528211 learned_addr learned my addr 172.21.15.49:0/3695528211 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:02:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.745+0000 7ff1dffff640 1 --2- 172.21.15.49:0/3695528211 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5609f73a4b70 0x5609f7421b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.745+0000 7ff1df7fe640 1 --2- 172.21.15.49:0/3695528211 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609f739f010 0x5609f741a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.745+0000 7ff1deffd640 1 -- 172.21.15.49:0/3695528211 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5609f73a4b70 msgr2=0x5609f7421b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.745+0000 7ff1deffd640 1 --2- 172.21.15.49:0/3695528211 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5609f73a4b70 0x5609f7421b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.745+0000 7ff1deffd640 1 -- 172.21.15.49:0/3695528211 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609f739f010 msgr2=0x5609f741a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:02:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.745+0000 7ff1deffd640 1 --2- 172.21.15.49:0/3695528211 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609f739f010 0x5609f741a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.745+0000 7ff1deffd640 1 -- 172.21.15.49:0/3695528211 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609f7422180 con 0x5609f739fa00 2024-06-03T00:02:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.745+0000 7ff1deffd640 1 --2- 172.21.15.49:0/3695528211 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5609f739fa00 0x5609f741ab50 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff1d00314e0 tx=0x7ff1d00bbcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b81e16c49e6c144 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:02:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.745+0000 7ff1beffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:02:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.745+0000 7ff1beffd640 1 -- 172.21.15.49:0/3695528211 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d0049040 con 0x5609f739fa00 2024-06-03T00:02:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.745+0000 7ff1e8a6f740 1 -- 172.21.15.49:0/3695528211 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1c8005040 con 0x5609f739fa00 2024-06-03T00:02:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.745+0000 7ff1beffd640 1 -- 172.21.15.49:0/3695528211 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7ff1d003b460 con 0x5609f739fa00 2024-06-03T00:02:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.745+0000 7ff1beffd640 1 -- 172.21.15.49:0/3695528211 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff1d00c4ac0 con 0x5609f739fa00 2024-06-03T00:02:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.745+0000 7ff1e8a6f740 10 client.15948 fetch_fsmap learned FSMap version 30 2024-06-03T00:02:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.745+0000 7ff1e8a6f740 1 -- 172.21.15.49:0/3695528211 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5609f7423500 con 0x5609f739fa00 2024-06-03T00:02:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.746+0000 7ff1beffd640 1 -- 172.21.15.49:0/3695528211 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1c8005040 con 0x5609f739fa00 2024-06-03T00:02:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.746+0000 7ff1beffd640 1 -- 172.21.15.49:0/3695528211 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7ff1d0003c80 con 0x5609f739fa00 2024-06-03T00:02:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.746+0000 7ff1e8a6f740 10 client.15948 fetch_fsmap finished waiting for FSMap version 30 2024-06-03T00:02:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.746+0000 7ff1e8a6f740 10 client.15948 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:02:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.746+0000 7ff1e8a6f740 20 client.15948 populate_metadata read hostname 'smithi049' 2024-06-03T00:02:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.746+0000 7ff1e8a6f740 1 --2- 172.21.15.49:0/3695528211 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5609f7423ef0 0x5609f7426310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:02:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.746+0000 7ff1e8a6f740 4 client.15948 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-03T00:02:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.746+0000 7ff1e8a6f740 1 -- 172.21.15.49:0/3695528211 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5609f739a4d0 con 0x5609f7423ef0 2024-06-03T00:02:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.746+0000 7ff1df7fe640 1 --2- 172.21.15.49:0/3695528211 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5609f7423ef0 0x5609f7426310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:02:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.746+0000 7ff1df7fe640 1 --2- 172.21.15.49:0/3695528211 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5609f7423ef0 0x5609f7426310 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b2e36ddc1713cc5 server_cookie=1e5f3b1e02c7d17a in_seq=0 out_seq=0 2024-06-03T00:02:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:52.746+0000 7ff1beffd640 10 client.15948 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:53.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:52 smithi107 ceph-mon[37048]: pgmap v468: 97 pgs: 97 active+clean; 60 MiB data, 640 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 1.63k op/s 2024-06-03T00:02:53.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:52 smithi057 ceph-mon[36457]: pgmap v468: 97 pgs: 97 active+clean; 60 MiB data, 640 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 1.63k op/s 2024-06-03T00:02:53.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:52 smithi049 ceph-mon[32302]: pgmap v468: 97 pgs: 97 active+clean; 60 MiB data, 640 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 1.63k op/s 2024-06-03T00:02:54.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:54 smithi107 ceph-mon[37048]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:02:54.427 INFO:tasks.workunit.client.0.smithi049.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-06-03T00:02:54.427 INFO:tasks.workunit.client.0.smithi049.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-06-03T00:02:54.427 INFO:tasks.workunit.client.0.smithi049.stderr:+ make 2024-06-03T00:02:54.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:54 smithi057 ceph-mon[36457]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:02:54.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:54 smithi049 ceph-mon[32302]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:02:55.301 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:55 smithi049 ceph-mon[32302]: pgmap v469: 97 pgs: 97 active+clean; 66 MiB data, 660 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.3 MiB/s wr, 1.53k op/s 2024-06-03T00:02:55.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:55 smithi107 ceph-mon[37048]: pgmap v469: 97 pgs: 97 active+clean; 66 MiB data, 660 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.3 MiB/s wr, 1.53k op/s 2024-06-03T00:02:55.407 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:55.406+0000 7ff1beffd640 1 -- 172.21.15.49:0/3695528211 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5609f739a4d0 con 0x5609f7423ef0 2024-06-03T00:02:55.407 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:55.406+0000 7ff1beffd640 10 client.15948 handle_command_reply: tid=0 2024-06-03T00:02:55.408 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:55.406+0000 7ff1e8a6f740 1 client.15948 shutdown 2024-06-03T00:02:55.408 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:55.407+0000 7ff1e8a6f740 1 -- 172.21.15.49:0/3695528211 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5609f739fa00 msgr2=0x5609f741ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:55.408 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:55.407+0000 7ff1e8a6f740 1 --2- 172.21.15.49:0/3695528211 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5609f739fa00 0x5609f741ab50 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff1d00314e0 tx=0x7ff1d00bbcd0 comp rx=0 tx=0).stop 2024-06-03T00:02:55.408 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:55.407+0000 7ff1e8a6f740 1 -- 172.21.15.49:0/3695528211 shutdown_connections 2024-06-03T00:02:55.408 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:55.407+0000 7ff1e8a6f740 1 --2- 172.21.15.49:0/3695528211 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5609f7423ef0 0x5609f7426310 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:55.408 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:55.407+0000 7ff1beffd640 0 client.15948 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:02:55.408 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:55.407+0000 7ff1e8a6f740 1 --2- 172.21.15.49:0/3695528211 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5609f73a4b70 0x5609f7421b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:55.408 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:55.407+0000 7ff1e8a6f740 1 --2- 172.21.15.49:0/3695528211 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5609f739fa00 0x5609f741ab50 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:55.408 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:55.407+0000 7ff1e8a6f740 1 --2- 172.21.15.49:0/3695528211 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609f739f010 0x5609f741a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:55.408 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:55.407+0000 7ff1e8a6f740 1 -- 172.21.15.49:0/3695528211 >> 172.21.15.49:0/3695528211 conn(0x5609f739a680 msgr2=0x5609f7398f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:55.408 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:55.407+0000 7ff1e8a6f740 1 -- 172.21.15.49:0/3695528211 shutdown_connections 2024-06-03T00:02:55.408 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:55.407+0000 7ff1e8a6f740 1 -- 172.21.15.49:0/3695528211 wait complete. 2024-06-03T00:02:55.409 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:55.407+0000 7ff1e8a6f740 20 client.15948 trim_cache size 0 max 16384 2024-06-03T00:02:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-06-03T00:02:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-06-03T00:02:55.410 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-06-03T00:02:55.411 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:55.408+0000 7ff1e5d61640 1 -- 172.21.15.49:0/2355365910 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff1cc0a2c30 msgr2=0x7ff1cc0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:55.411 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:55.408+0000 7ff1e5d61640 1 --2- 172.21.15.49:0/2355365910 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff1cc0a2c30 0x7ff1cc0a50f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x5609f73a0260 tx=0x7ff1d8009600 comp rx=0 tx=0).stop 2024-06-03T00:02:55.411 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:55.408+0000 7ff1e5d61640 1 -- 172.21.15.49:0/2355365910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1e0101af0 msgr2=0x7ff1e01981b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:02:55.411 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:55.408+0000 7ff1e5d61640 1 --2- 172.21.15.49:0/2355365910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1e0101af0 0x7ff1e01981b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0009230 tx=0x7ff1d0031b60 comp rx=0 tx=0).stop 2024-06-03T00:02:55.411 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:55.408+0000 7ff1e5d61640 1 -- 172.21.15.49:0/2355365910 shutdown_connections 2024-06-03T00:02:55.411 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:55.408+0000 7ff1e5d61640 1 --2- 172.21.15.49:0/2355365910 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7ff1cc0a2c30 0x7ff1cc0a50f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:55.411 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:55.408+0000 7ff1e5d61640 1 --2- 172.21.15.49:0/2355365910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1e01024b0 0x7ff1e019f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:55.408+0000 7ff1e5d61640 1 --2- 172.21.15.49:0/2355365910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1e0101af0 0x7ff1e01981b0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:55.408+0000 7ff1e5d61640 1 --2- 172.21.15.49:0/2355365910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1e0100900 0x7ff1e0197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:02:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:55.408+0000 7ff1e5d61640 1 -- 172.21.15.49:0/2355365910 >> 172.21.15.49:0/2355365910 conn(0x7ff1e00fbe70 msgr2=0x7ff1e0104df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:02:55.412 INFO:tasks.workunit.client.0.smithi049.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-06-03T00:02:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:55.409+0000 7ff1e5d61640 1 -- 172.21.15.49:0/2355365910 shutdown_connections 2024-06-03T00:02:55.412 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:02:55.409+0000 7ff1e5d61640 1 -- 172.21.15.49:0/2355365910 wait complete. 2024-06-03T00:02:55.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:55 smithi057 ceph-mon[36457]: pgmap v469: 97 pgs: 97 active+clean; 66 MiB data, 660 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.3 MiB/s wr, 1.53k op/s 2024-06-03T00:02:56.067 INFO:tasks.workunit.client.0.smithi049.stderr:++ readlink -f fsstress 2024-06-03T00:02:56.068 INFO:tasks.workunit.client.0.smithi049.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-06-03T00:02:56.068 INFO:tasks.workunit.client.0.smithi049.stderr:+ popd 2024-06-03T00:02:56.069 INFO:tasks.workunit.client.0.smithi049.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-06-03T00:02:56.070 INFO:tasks.workunit.client.0.smithi049.stderr:+ popd 2024-06-03T00:02:56.070 INFO:tasks.workunit.client.0.smithi049.stdout:~/cephtest/mnt.0/client.0/tmp 2024-06-03T00:02:56.071 INFO:tasks.workunit.client.0.smithi049.stderr:++ mktemp -d -p . 2024-06-03T00:02:56.071 INFO:tasks.workunit.client.0.smithi049.stderr:+ T=./tmp.WzP4rFu8KA 2024-06-03T00:02:56.071 INFO:tasks.workunit.client.0.smithi049.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.WzP4rFu8KA -l 1 -n 1000 -p 10 -v 2024-06-03T00:02:56.072 INFO:tasks.workunit.client.0.smithi049.stdout:seed = 1717311216 2024-06-03T00:02:56.077 INFO:tasks.workunit.client.0.smithi049.stdout:0/0: mknod c0 0 2024-06-03T00:02:56.078 INFO:tasks.workunit.client.0.smithi049.stdout:2/0: getdents . 0 2024-06-03T00:02:56.078 INFO:tasks.workunit.client.0.smithi049.stdout:2/1: write - no filename 2024-06-03T00:02:56.078 INFO:tasks.workunit.client.0.smithi049.stdout:2/2: unlink - no file 2024-06-03T00:02:56.078 INFO:tasks.workunit.client.0.smithi049.stdout:2/3: truncate - no filename 2024-06-03T00:02:56.079 INFO:tasks.workunit.client.0.smithi049.stdout:2/4: rename - no filename 2024-06-03T00:02:56.079 INFO:tasks.workunit.client.0.smithi049.stdout:2/5: dread - no filename 2024-06-03T00:02:56.079 INFO:tasks.workunit.client.0.smithi049.stdout:1/0: creat f0 x:0 0 0 2024-06-03T00:02:56.079 INFO:tasks.workunit.client.0.smithi049.stdout:1/1: write f0 [145343,77738] 0 2024-06-03T00:02:56.081 INFO:tasks.workunit.client.0.smithi049.stdout:0/1: unlink c0 0 2024-06-03T00:02:56.081 INFO:tasks.workunit.client.0.smithi049.stdout:0/2: write - no filename 2024-06-03T00:02:56.081 INFO:tasks.workunit.client.0.smithi049.stdout:0/3: chown . 8418844 1 2024-06-03T00:02:56.081 INFO:tasks.workunit.client.0.smithi049.stdout:0/4: write - no filename 2024-06-03T00:02:56.081 INFO:tasks.workunit.client.0.smithi049.stdout:0/5: dread - no filename 2024-06-03T00:02:56.081 INFO:tasks.workunit.client.0.smithi049.stdout:0/6: fdatasync - no filename 2024-06-03T00:02:56.081 INFO:tasks.workunit.client.0.smithi049.stdout:0/7: read - no filename 2024-06-03T00:02:56.081 INFO:tasks.workunit.client.0.smithi049.stdout:0/8: rename - no filename 2024-06-03T00:02:56.081 INFO:tasks.workunit.client.0.smithi049.stdout:0/9: truncate - no filename 2024-06-03T00:02:56.081 INFO:tasks.workunit.client.0.smithi049.stdout:0/10: rmdir - no directory 2024-06-03T00:02:56.081 INFO:tasks.workunit.client.0.smithi049.stdout:0/11: write - no filename 2024-06-03T00:02:56.082 INFO:tasks.workunit.client.0.smithi049.stdout:0/12: stat - no entries 2024-06-03T00:02:56.082 INFO:tasks.workunit.client.0.smithi049.stdout:0/13: dwrite - no filename 2024-06-03T00:02:56.082 INFO:tasks.workunit.client.0.smithi049.stdout:0/14: write - no filename 2024-06-03T00:02:56.082 INFO:tasks.workunit.client.0.smithi049.stdout:0/15: dread - no filename 2024-06-03T00:02:56.084 INFO:tasks.workunit.client.0.smithi049.stdout:3/0: link - no file 2024-06-03T00:02:56.084 INFO:tasks.workunit.client.0.smithi049.stdout:3/1: dwrite - no filename 2024-06-03T00:02:56.084 INFO:tasks.workunit.client.0.smithi049.stdout:3/2: chown . 8843455 1 2024-06-03T00:02:56.084 INFO:tasks.workunit.client.0.smithi049.stdout:3/3: chown . 5480721 1 2024-06-03T00:02:56.084 INFO:tasks.workunit.client.0.smithi049.stdout:2/6: symlink l0 0 2024-06-03T00:02:56.084 INFO:tasks.workunit.client.0.smithi049.stdout:0/16: creat f1 x:0 0 0 2024-06-03T00:02:56.084 INFO:tasks.workunit.client.0.smithi049.stdout:1/2: dread f0 [0,4194304] 0 2024-06-03T00:02:56.084 INFO:tasks.workunit.client.0.smithi049.stdout:1/3: chown f0 4091795 1 2024-06-03T00:02:56.084 INFO:tasks.workunit.client.0.smithi049.stdout:4/0: unlink - no file 2024-06-03T00:02:56.085 INFO:tasks.workunit.client.0.smithi049.stdout:4/1: fdatasync - no filename 2024-06-03T00:02:56.085 INFO:tasks.workunit.client.0.smithi049.stdout:4/2: chown . 1940 1 2024-06-03T00:02:56.085 INFO:tasks.workunit.client.0.smithi049.stdout:4/3: write - no filename 2024-06-03T00:02:56.087 INFO:tasks.workunit.client.0.smithi049.stdout:3/4: creat f0 x:0 0 0 2024-06-03T00:02:56.087 INFO:tasks.workunit.client.0.smithi049.stdout:3/5: chown f0 257030 1 2024-06-03T00:02:56.087 INFO:tasks.workunit.client.0.smithi049.stdout:3/6: dread - f0 zero size 2024-06-03T00:02:56.088 INFO:tasks.workunit.client.0.smithi049.stdout:1/4: dread f0 [0,4194304] 0 2024-06-03T00:02:56.088 INFO:tasks.workunit.client.0.smithi049.stdout:2/7: creat f1 x:0 0 0 2024-06-03T00:02:56.088 INFO:tasks.workunit.client.0.smithi049.stdout:2/8: dread - f1 zero size 2024-06-03T00:02:56.088 INFO:tasks.workunit.client.0.smithi049.stdout:0/17: creat f2 x:0 0 0 2024-06-03T00:02:56.088 INFO:tasks.workunit.client.0.smithi049.stdout:0/18: rmdir - no directory 2024-06-03T00:02:56.088 INFO:tasks.workunit.client.0.smithi049.stdout:5/0: unlink - no file 2024-06-03T00:02:56.088 INFO:tasks.workunit.client.0.smithi049.stdout:5/1: dread - no filename 2024-06-03T00:02:56.088 INFO:tasks.workunit.client.0.smithi049.stdout:5/2: dread - no filename 2024-06-03T00:02:56.088 INFO:tasks.workunit.client.0.smithi049.stdout:5/3: dread - no filename 2024-06-03T00:02:56.088 INFO:tasks.workunit.client.0.smithi049.stdout:5/4: fdatasync - no filename 2024-06-03T00:02:56.088 INFO:tasks.workunit.client.0.smithi049.stdout:4/4: symlink l0 0 2024-06-03T00:02:56.088 INFO:tasks.workunit.client.0.smithi049.stdout:4/5: readlink l0 0 2024-06-03T00:02:56.089 INFO:tasks.workunit.client.0.smithi049.stdout:4/6: write - no filename 2024-06-03T00:02:56.089 INFO:tasks.workunit.client.0.smithi049.stdout:3/7: symlink l1 0 2024-06-03T00:02:56.089 INFO:tasks.workunit.client.0.smithi049.stdout:1/5: unlink f0 0 2024-06-03T00:02:56.089 INFO:tasks.workunit.client.0.smithi049.stdout:2/9: unlink l0 0 2024-06-03T00:02:56.090 INFO:tasks.workunit.client.0.smithi049.stdout:2/10: chown f1 28 1 2024-06-03T00:02:56.090 INFO:tasks.workunit.client.0.smithi049.stdout:0/19: creat f3 x:0 0 0 2024-06-03T00:02:56.090 INFO:tasks.workunit.client.0.smithi049.stdout:6/0: stat - no entries 2024-06-03T00:02:56.090 INFO:tasks.workunit.client.0.smithi049.stdout:6/1: dwrite - no filename 2024-06-03T00:02:56.091 INFO:tasks.workunit.client.0.smithi049.stdout:5/5: mknod c0 0 2024-06-03T00:02:56.091 INFO:tasks.workunit.client.0.smithi049.stdout:5/6: fsync - no filename 2024-06-03T00:02:56.092 INFO:tasks.workunit.client.0.smithi049.stdout:4/7: link l0 l1 0 2024-06-03T00:02:56.092 INFO:tasks.workunit.client.0.smithi049.stdout:4/8: dwrite - no filename 2024-06-03T00:02:56.092 INFO:tasks.workunit.client.0.smithi049.stdout:4/9: dread - no filename 2024-06-03T00:02:56.092 INFO:tasks.workunit.client.0.smithi049.stdout:4/10: write - no filename 2024-06-03T00:02:56.092 INFO:tasks.workunit.client.0.smithi049.stdout:3/8: mkdir d2 0 2024-06-03T00:02:56.093 INFO:tasks.workunit.client.0.smithi049.stdout:3/9: readlink l1 0 2024-06-03T00:02:56.093 INFO:tasks.workunit.client.0.smithi049.stdout:1/6: mkdir d1 0 2024-06-03T00:02:56.093 INFO:tasks.workunit.client.0.smithi049.stdout:1/7: truncate - no filename 2024-06-03T00:02:56.093 INFO:tasks.workunit.client.0.smithi049.stdout:1/8: chown d1 17420996 1 2024-06-03T00:02:56.094 INFO:tasks.workunit.client.0.smithi049.stdout:1/9: dwrite - no filename 2024-06-03T00:02:56.094 INFO:tasks.workunit.client.0.smithi049.stdout:1/10: rename d1 to d1/d2 22 2024-06-03T00:02:56.094 INFO:tasks.workunit.client.0.smithi049.stdout:1/11: write - no filename 2024-06-03T00:02:56.094 INFO:tasks.workunit.client.0.smithi049.stdout:1/12: getdents d1 0 2024-06-03T00:02:56.094 INFO:tasks.workunit.client.0.smithi049.stdout:2/11: creat f2 x:0 0 0 2024-06-03T00:02:56.095 INFO:tasks.workunit.client.0.smithi049.stdout:6/2: mknod c0 0 2024-06-03T00:02:56.096 INFO:tasks.workunit.client.0.smithi049.stdout:5/7: creat f1 x:0 0 0 2024-06-03T00:02:56.096 INFO:tasks.workunit.client.0.smithi049.stdout:5/8: write f1 [402101,10206] 0 2024-06-03T00:02:56.096 INFO:tasks.workunit.client.0.smithi049.stdout:4/11: unlink l1 0 2024-06-03T00:02:56.097 INFO:tasks.workunit.client.0.smithi049.stdout:3/10: mknod d2/c3 0 2024-06-03T00:02:56.097 INFO:tasks.workunit.client.0.smithi049.stdout:1/13: creat d1/f3 x:0 0 0 2024-06-03T00:02:56.098 INFO:tasks.workunit.client.0.smithi049.stdout:2/12: symlink l3 0 2024-06-03T00:02:56.098 INFO:tasks.workunit.client.0.smithi049.stdout:2/13: chown f1 50 1 2024-06-03T00:02:56.099 INFO:tasks.workunit.client.0.smithi049.stdout:8/0: chown . 91147845 1 2024-06-03T00:02:56.099 INFO:tasks.workunit.client.0.smithi049.stdout:8/1: getdents . 0 2024-06-03T00:02:56.099 INFO:tasks.workunit.client.0.smithi049.stdout:8/2: truncate - no filename 2024-06-03T00:02:56.100 INFO:tasks.workunit.client.0.smithi049.stdout:7/0: creat f0 x:0 0 0 2024-06-03T00:02:56.100 INFO:tasks.workunit.client.0.smithi049.stdout:6/3: rename c0 to c1 0 2024-06-03T00:02:56.101 INFO:tasks.workunit.client.0.smithi049.stdout:6/4: truncate - no filename 2024-06-03T00:02:56.101 INFO:tasks.workunit.client.0.smithi049.stdout:6/5: write - no filename 2024-06-03T00:02:56.101 INFO:tasks.workunit.client.0.smithi049.stdout:6/6: chown c1 73318 1 2024-06-03T00:02:56.101 INFO:tasks.workunit.client.0.smithi049.stdout:6/7: dwrite - no filename 2024-06-03T00:02:56.101 INFO:tasks.workunit.client.0.smithi049.stdout:6/8: chown c1 0 1 2024-06-03T00:02:56.101 INFO:tasks.workunit.client.0.smithi049.stdout:6/9: dwrite - no filename 2024-06-03T00:02:56.102 INFO:tasks.workunit.client.0.smithi049.stdout:6/10: fdatasync - no filename 2024-06-03T00:02:56.103 INFO:tasks.workunit.client.0.smithi049.stdout:4/12: creat f2 x:0 0 0 2024-06-03T00:02:56.103 INFO:tasks.workunit.client.0.smithi049.stdout:4/13: truncate f2 23715 0 2024-06-03T00:02:56.104 INFO:tasks.workunit.client.0.smithi049.stdout:4/14: truncate f2 620077 0 2024-06-03T00:02:56.104 INFO:tasks.workunit.client.0.smithi049.stdout:1/14: creat d1/f4 x:0 0 0 2024-06-03T00:02:56.104 INFO:tasks.workunit.client.0.smithi049.stdout:9/0: dread - no filename 2024-06-03T00:02:56.104 INFO:tasks.workunit.client.0.smithi049.stdout:9/1: write - no filename 2024-06-03T00:02:56.104 INFO:tasks.workunit.client.0.smithi049.stdout:8/3: mknod c0 0 2024-06-03T00:02:56.104 INFO:tasks.workunit.client.0.smithi049.stdout:8/4: dwrite - no filename 2024-06-03T00:02:56.105 INFO:tasks.workunit.client.0.smithi049.stdout:8/5: chown c0 62 1 2024-06-03T00:02:56.105 INFO:tasks.workunit.client.0.smithi049.stdout:6/11: mkdir d2 0 2024-06-03T00:02:56.105 INFO:tasks.workunit.client.0.smithi049.stdout:6/12: fdatasync - no filename 2024-06-03T00:02:56.106 INFO:tasks.workunit.client.0.smithi049.stdout:6/13: truncate - no filename 2024-06-03T00:02:56.106 INFO:tasks.workunit.client.0.smithi049.stdout:4/15: link l0 l3 0 2024-06-03T00:02:56.107 INFO:tasks.workunit.client.0.smithi049.stdout:1/15: rmdir d1 39 2024-06-03T00:02:56.109 INFO:tasks.workunit.client.0.smithi049.stdout:9/2: mknod c0 0 2024-06-03T00:02:56.109 INFO:tasks.workunit.client.0.smithi049.stdout:9/3: stat c0 0 2024-06-03T00:02:56.109 INFO:tasks.workunit.client.0.smithi049.stdout:9/4: read - no filename 2024-06-03T00:02:56.109 INFO:tasks.workunit.client.0.smithi049.stdout:9/5: rmdir - no directory 2024-06-03T00:02:56.109 INFO:tasks.workunit.client.0.smithi049.stdout:9/6: truncate - no filename 2024-06-03T00:02:56.113 INFO:tasks.workunit.client.0.smithi049.stdout:1/16: mknod d1/c5 0 2024-06-03T00:02:56.113 INFO:tasks.workunit.client.0.smithi049.stdout:1/17: write d1/f3 [353592,62527] 0 2024-06-03T00:02:56.113 INFO:tasks.workunit.client.0.smithi049.stdout:1/18: truncate d1/f4 149900 0 2024-06-03T00:02:56.113 INFO:tasks.workunit.client.0.smithi049.stdout:1/19: write d1/f3 [1119348,70780] 0 2024-06-03T00:02:56.113 INFO:tasks.workunit.client.0.smithi049.stdout:8/6: mkdir d1 0 2024-06-03T00:02:56.113 INFO:tasks.workunit.client.0.smithi049.stdout:8/7: chown d1 6 1 2024-06-03T00:02:56.113 INFO:tasks.workunit.client.0.smithi049.stdout:8/8: fsync - no filename 2024-06-03T00:02:56.113 INFO:tasks.workunit.client.0.smithi049.stdout:8/9: chown c0 87913 1 2024-06-03T00:02:56.113 INFO:tasks.workunit.client.0.smithi049.stdout:9/7: mkdir d1 0 2024-06-03T00:02:56.113 INFO:tasks.workunit.client.0.smithi049.stdout:9/8: chown c0 650 1 2024-06-03T00:02:56.114 INFO:tasks.workunit.client.0.smithi049.stdout:1/20: creat d1/f6 x:0 0 0 2024-06-03T00:02:56.116 INFO:tasks.workunit.client.0.smithi049.stdout:8/10: rmdir d1 0 2024-06-03T00:02:56.117 INFO:tasks.workunit.client.0.smithi049.stdout:9/9: symlink d1/l2 0 2024-06-03T00:02:56.117 INFO:tasks.workunit.client.0.smithi049.stdout:9/10: dwrite - no filename 2024-06-03T00:02:56.117 INFO:tasks.workunit.client.0.smithi049.stdout:9/11: dread - no filename 2024-06-03T00:02:56.117 INFO:tasks.workunit.client.0.smithi049.stdout:9/12: read - no filename 2024-06-03T00:02:56.117 INFO:tasks.workunit.client.0.smithi049.stdout:9/13: dread - no filename 2024-06-03T00:02:56.119 INFO:tasks.workunit.client.0.smithi049.stdout:1/21: creat d1/f7 x:0 0 0 2024-06-03T00:02:56.120 INFO:tasks.workunit.client.0.smithi049.stdout:8/11: symlink l2 0 2024-06-03T00:02:56.120 INFO:tasks.workunit.client.0.smithi049.stdout:8/12: dread - no filename 2024-06-03T00:02:56.120 INFO:tasks.workunit.client.0.smithi049.stdout:8/13: dread - no filename 2024-06-03T00:02:56.120 INFO:tasks.workunit.client.0.smithi049.stdout:8/14: dread - no filename 2024-06-03T00:02:56.129 INFO:tasks.workunit.client.0.smithi049.stdout:9/14: rename d1/l2 to d1/l3 0 2024-06-03T00:02:56.129 INFO:tasks.workunit.client.0.smithi049.stdout:1/22: symlink d1/l8 0 2024-06-03T00:02:56.129 INFO:tasks.workunit.client.0.smithi049.stdout:1/23: write d1/f7 [959680,68309] 0 2024-06-03T00:02:56.133 INFO:tasks.workunit.client.0.smithi049.stdout:8/15: rename l2 to l3 0 2024-06-03T00:02:56.133 INFO:tasks.workunit.client.0.smithi049.stdout:8/16: stat c0 0 2024-06-03T00:02:56.133 INFO:tasks.workunit.client.0.smithi049.stdout:8/17: dwrite - no filename 2024-06-03T00:02:56.133 INFO:tasks.workunit.client.0.smithi049.stdout:8/18: readlink l3 0 2024-06-03T00:02:56.134 INFO:tasks.workunit.client.0.smithi049.stdout:8/19: readlink l3 0 2024-06-03T00:02:56.159 INFO:tasks.workunit.client.0.smithi049.stdout:1/24: symlink d1/l9 0 2024-06-03T00:02:56.159 INFO:tasks.workunit.client.0.smithi049.stdout:1/25: chown d1 5159050 1 2024-06-03T00:02:56.159 INFO:tasks.workunit.client.0.smithi049.stdout:1/26: write d1/f6 [110817,89415] 0 2024-06-03T00:02:56.159 INFO:tasks.workunit.client.0.smithi049.stdout:9/15: symlink d1/l4 0 2024-06-03T00:02:56.159 INFO:tasks.workunit.client.0.smithi049.stdout:9/16: dread - no filename 2024-06-03T00:02:56.159 INFO:tasks.workunit.client.0.smithi049.stdout:9/17: dwrite - no filename 2024-06-03T00:02:56.160 INFO:tasks.workunit.client.0.smithi049.stdout:9/18: dread - no filename 2024-06-03T00:02:56.161 INFO:tasks.workunit.client.0.smithi049.stdout:8/20: mkdir d4 0 2024-06-03T00:02:56.161 INFO:tasks.workunit.client.0.smithi049.stdout:8/21: rename d4 to d4/d5 22 2024-06-03T00:02:56.161 INFO:tasks.workunit.client.0.smithi049.stdout:8/22: rename d4 to d4/d6 22 2024-06-03T00:02:56.161 INFO:tasks.workunit.client.0.smithi049.stdout:9/19: mkdir d1/d5 0 2024-06-03T00:02:56.162 INFO:tasks.workunit.client.0.smithi049.stdout:9/20: truncate - no filename 2024-06-03T00:02:56.162 INFO:tasks.workunit.client.0.smithi049.stdout:9/21: chown d1/l3 3714032 1 2024-06-03T00:02:56.165 INFO:tasks.workunit.client.0.smithi049.stdout:9/22: unlink d1/l4 0 2024-06-03T00:02:56.165 INFO:tasks.workunit.client.0.smithi049.stdout:9/23: write - no filename 2024-06-03T00:02:56.165 INFO:tasks.workunit.client.0.smithi049.stdout:9/24: dwrite - no filename 2024-06-03T00:02:56.166 INFO:tasks.workunit.client.0.smithi049.stdout:8/23: mkdir d4/d7 0 2024-06-03T00:02:56.169 INFO:tasks.workunit.client.0.smithi049.stdout:9/25: mknod d1/d5/c6 0 2024-06-03T00:02:56.169 INFO:tasks.workunit.client.0.smithi049.stdout:9/26: readlink d1/l3 0 2024-06-03T00:02:56.169 INFO:tasks.workunit.client.0.smithi049.stdout:9/27: rename d1/d5 to d1/d5/d7 22 2024-06-03T00:02:56.173 INFO:tasks.workunit.client.0.smithi049.stdout:8/24: creat d4/d7/f8 x:0 0 0 2024-06-03T00:02:56.174 INFO:tasks.workunit.client.0.smithi049.stdout:9/28: rmdir d1 39 2024-06-03T00:02:56.174 INFO:tasks.workunit.client.0.smithi049.stdout:9/29: read - no filename 2024-06-03T00:02:56.174 INFO:tasks.workunit.client.0.smithi049.stdout:9/30: chown d1 2 1 2024-06-03T00:02:56.174 INFO:tasks.workunit.client.0.smithi049.stdout:9/31: chown d1/d5/c6 1161246689 1 2024-06-03T00:02:56.174 INFO:tasks.workunit.client.0.smithi049.stdout:9/32: dwrite - no filename 2024-06-03T00:02:56.174 INFO:tasks.workunit.client.0.smithi049.stdout:9/33: stat d1/d5 0 2024-06-03T00:02:56.174 INFO:tasks.workunit.client.0.smithi049.stdout:9/34: chown c0 64824629 1 2024-06-03T00:02:56.174 INFO:tasks.workunit.client.0.smithi049.stdout:9/35: chown d1/l3 0 1 2024-06-03T00:02:56.175 INFO:tasks.workunit.client.0.smithi049.stdout:8/25: rename d4/d7/f8 to d4/d7/f9 0 2024-06-03T00:02:56.179 INFO:tasks.workunit.client.0.smithi049.stdout:9/36: creat d1/f8 x:0 0 0 2024-06-03T00:02:56.179 INFO:tasks.workunit.client.0.smithi049.stdout:9/37: write d1/f8 [145316,111244] 0 2024-06-03T00:02:56.180 INFO:tasks.workunit.client.0.smithi049.stdout:4/16: write f2 [466242,34004] 0 2024-06-03T00:02:56.180 INFO:tasks.workunit.client.0.smithi049.stdout:4/17: readlink l3 0 2024-06-03T00:02:56.181 INFO:tasks.workunit.client.0.smithi049.stdout:4/18: mkdir d4 0 2024-06-03T00:02:56.183 INFO:tasks.workunit.client.0.smithi049.stdout:4/19: symlink d4/l5 0 2024-06-03T00:02:56.184 INFO:tasks.workunit.client.0.smithi049.stdout:4/20: stat l0 0 2024-06-03T00:02:56.186 INFO:tasks.workunit.client.0.smithi049.stdout:4/21: creat d4/f6 x:0 0 0 2024-06-03T00:02:56.189 INFO:tasks.workunit.client.0.smithi049.stdout:4/22: rename d4/f6 to d4/f7 0 2024-06-03T00:02:56.189 INFO:tasks.workunit.client.0.smithi049.stdout:4/23: dread - d4/f7 zero size 2024-06-03T00:02:56.189 INFO:tasks.workunit.client.0.smithi049.stdout:4/24: dread - d4/f7 zero size 2024-06-03T00:02:56.189 INFO:tasks.workunit.client.0.smithi049.stdout:4/25: write d4/f7 [187308,4516] 0 2024-06-03T00:02:56.193 INFO:tasks.workunit.client.0.smithi049.stdout:4/26: mknod d4/c8 0 2024-06-03T00:02:56.194 INFO:tasks.workunit.client.0.smithi049.stdout:4/27: rename d4 to d4/d9 22 2024-06-03T00:02:56.285 INFO:tasks.workunit.client.0.smithi049.stdout:2/14: getdents . 0 2024-06-03T00:02:56.294 INFO:tasks.workunit.client.0.smithi049.stdout:6/14: unlink c1 0 2024-06-03T00:02:56.335 INFO:tasks.workunit.client.0.smithi049.stdout:5/9: truncate f1 220228 0 2024-06-03T00:02:56.505 INFO:tasks.workunit.client.0.smithi049.stdout:5/10: write f1 [241539,102572] 0 2024-06-03T00:02:56.514 INFO:tasks.workunit.client.0.smithi049.stdout:3/11: dwrite f0 [0,4194304] 0 2024-06-03T00:02:56.514 INFO:tasks.workunit.client.0.smithi049.stdout:3/12: stat d2 0 2024-06-03T00:02:56.532 INFO:tasks.workunit.client.0.smithi049.stdout:2/15: rename f2 to f4 0 2024-06-03T00:02:56.544 INFO:tasks.workunit.client.0.smithi049.stdout:8/26: dwrite d4/d7/f9 [0,4194304] 0 2024-06-03T00:02:56.581 INFO:tasks.workunit.client.0.smithi049.stdout:4/28: dwrite d4/f7 [0,4194304] 0 2024-06-03T00:02:56.594 INFO:tasks.workunit.client.0.smithi049.stdout:5/11: fdatasync f1 0 2024-06-03T00:02:56.603 INFO:tasks.workunit.client.0.smithi049.stdout:1/27: fsync d1/f6 0 2024-06-03T00:02:56.604 INFO:tasks.workunit.client.0.smithi049.stdout:1/28: chown d1/f7 1933812696 1 2024-06-03T00:02:56.604 INFO:tasks.workunit.client.0.smithi049.stdout:1/29: stat d1/l8 0 2024-06-03T00:02:56.613 INFO:tasks.workunit.client.0.smithi049.stdout:9/38: fsync d1/f8 0 2024-06-03T00:02:56.632 INFO:tasks.workunit.client.0.smithi049.stdout:6/15: mkdir d2/d3 0 2024-06-03T00:02:57.160 INFO:tasks.workunit.client.0.smithi049.stdout:3/13: creat d2/f4 x:0 0 0 2024-06-03T00:02:57.298 INFO:tasks.workunit.client.0.smithi049.stdout:2/16: chown l3 5318 1 2024-06-03T00:02:57.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:57 smithi107 ceph-mon[37048]: pgmap v470: 97 pgs: 97 active+clean; 70 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.6 MiB/s wr, 1.30k op/s 2024-06-03T00:02:57.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:57 smithi057 ceph-mon[36457]: pgmap v470: 97 pgs: 97 active+clean; 70 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.6 MiB/s wr, 1.30k op/s 2024-06-03T00:02:57.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:57 smithi049 ceph-mon[32302]: pgmap v470: 97 pgs: 97 active+clean; 70 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.6 MiB/s wr, 1.30k op/s 2024-06-03T00:02:57.543 INFO:tasks.workunit.client.0.smithi049.stdout:4/29: unlink d4/c8 0 2024-06-03T00:02:57.565 INFO:tasks.workunit.client.0.smithi049.stdout:4/30: dwrite d4/f7 [0,4194304] 0 2024-06-03T00:02:57.623 INFO:tasks.workunit.client.0.smithi049.stdout:1/30: unlink d1/f6 0 2024-06-03T00:02:57.624 INFO:tasks.workunit.client.0.smithi049.stdout:1/31: rename d1 to d1/da 22 2024-06-03T00:02:57.624 INFO:tasks.workunit.client.0.smithi049.stdout:1/32: readlink d1/l8 0 2024-06-03T00:02:57.636 INFO:tasks.workunit.client.0.smithi049.stdout:9/39: mknod d1/d5/c9 0 2024-06-03T00:02:57.665 INFO:tasks.workunit.client.0.smithi049.stdout:6/16: mkdir d2/d4 0 2024-06-03T00:02:57.665 INFO:tasks.workunit.client.0.smithi049.stdout:6/17: dread - no filename 2024-06-03T00:02:57.665 INFO:tasks.workunit.client.0.smithi049.stdout:6/18: readlink - no filename 2024-06-03T00:02:57.665 INFO:tasks.workunit.client.0.smithi049.stdout:6/19: fdatasync - no filename 2024-06-03T00:02:57.665 INFO:tasks.workunit.client.0.smithi049.stdout:6/20: truncate - no filename 2024-06-03T00:02:58.086 INFO:tasks.workunit.client.0.smithi049.stdout:3/14: creat d2/f5 x:0 0 0 2024-06-03T00:02:58.086 INFO:tasks.workunit.client.0.smithi049.stdout:3/15: dread - d2/f4 zero size 2024-06-03T00:02:58.086 INFO:tasks.workunit.client.0.smithi049.stdout:3/16: chown d2/c3 4 1 2024-06-03T00:02:58.087 INFO:tasks.workunit.client.0.smithi049.stdout:2/17: creat f5 x:0 0 0 2024-06-03T00:02:58.087 INFO:tasks.workunit.client.0.smithi049.stdout:2/18: stat f4 0 2024-06-03T00:02:58.087 INFO:tasks.workunit.client.0.smithi049.stdout:2/19: truncate f4 481898 0 2024-06-03T00:02:58.089 INFO:tasks.workunit.client.0.smithi049.stdout:1/33: mkdir d1/db 0 2024-06-03T00:02:58.089 INFO:tasks.workunit.client.0.smithi049.stdout:1/34: chown d1/f7 2026813 1 2024-06-03T00:02:58.089 INFO:tasks.workunit.client.0.smithi049.stdout:9/40: mkdir d1/da 0 2024-06-03T00:02:58.090 INFO:tasks.workunit.client.0.smithi049.stdout:9/41: write d1/f8 [167412,29449] 0 2024-06-03T00:02:58.091 INFO:tasks.workunit.client.0.smithi049.stdout:6/21: rename d2/d4 to d2/d3/d5 0 2024-06-03T00:02:58.091 INFO:tasks.workunit.client.0.smithi049.stdout:6/22: fsync - no filename 2024-06-03T00:02:58.091 INFO:tasks.workunit.client.0.smithi049.stdout:6/23: read - no filename 2024-06-03T00:02:58.091 INFO:tasks.workunit.client.0.smithi049.stdout:1/35: dread d1/f7 [0,4194304] 0 2024-06-03T00:02:58.092 INFO:tasks.workunit.client.0.smithi049.stdout:3/17: creat d2/f6 x:0 0 0 2024-06-03T00:02:58.094 INFO:tasks.workunit.client.0.smithi049.stdout:9/42: creat d1/fb x:0 0 0 2024-06-03T00:02:58.095 INFO:tasks.workunit.client.0.smithi049.stdout:6/24: symlink d2/l6 0 2024-06-03T00:02:58.096 INFO:tasks.workunit.client.0.smithi049.stdout:2/20: rename f5 to f6 0 2024-06-03T00:02:58.098 INFO:tasks.workunit.client.0.smithi049.stdout:6/25: link d2/l6 d2/d3/d5/l7 0 2024-06-03T00:02:58.098 INFO:tasks.workunit.client.0.smithi049.stdout:6/26: truncate - no filename 2024-06-03T00:02:58.099 INFO:tasks.workunit.client.0.smithi049.stdout:6/27: dread - no filename 2024-06-03T00:02:58.099 INFO:tasks.workunit.client.0.smithi049.stdout:6/28: write - no filename 2024-06-03T00:02:58.099 INFO:tasks.workunit.client.0.smithi049.stdout:6/29: dread - no filename 2024-06-03T00:02:58.099 INFO:tasks.workunit.client.0.smithi049.stdout:6/30: dwrite - no filename 2024-06-03T00:02:58.099 INFO:tasks.workunit.client.0.smithi049.stdout:6/31: dwrite - no filename 2024-06-03T00:02:58.100 INFO:tasks.workunit.client.0.smithi049.stdout:6/32: creat d2/d3/d5/f8 x:0 0 0 2024-06-03T00:02:58.102 INFO:tasks.workunit.client.0.smithi049.stdout:2/21: symlink l7 0 2024-06-03T00:02:58.102 INFO:tasks.workunit.client.0.smithi049.stdout:2/22: dread - f6 zero size 2024-06-03T00:02:58.103 INFO:tasks.workunit.client.0.smithi049.stdout:6/33: mkdir d2/d3/d9 0 2024-06-03T00:02:58.103 INFO:tasks.workunit.client.0.smithi049.stdout:6/34: truncate d2/d3/d5/f8 756238 0 2024-06-03T00:02:58.108 INFO:tasks.workunit.client.0.smithi049.stdout:2/23: mknod c8 0 2024-06-03T00:02:58.108 INFO:tasks.workunit.client.0.smithi049.stdout:2/24: dread - f6 zero size 2024-06-03T00:02:58.109 INFO:tasks.workunit.client.0.smithi049.stdout:2/25: creat f9 x:0 0 0 2024-06-03T00:02:58.109 INFO:tasks.workunit.client.0.smithi049.stdout:2/26: dread - f6 zero size 2024-06-03T00:02:58.114 INFO:tasks.workunit.client.0.smithi049.stdout:9/43: dwrite d1/f8 [0,4194304] 0 2024-06-03T00:02:58.117 INFO:tasks.workunit.client.0.smithi049.stdout:9/44: unlink d1/l3 0 2024-06-03T00:02:58.118 INFO:tasks.workunit.client.0.smithi049.stdout:9/45: mknod d1/da/cc 0 2024-06-03T00:02:58.134 INFO:tasks.workunit.client.0.smithi049.stdout:2/27: dwrite f1 [0,4194304] 0 2024-06-03T00:02:58.146 INFO:tasks.workunit.client.0.smithi049.stdout:8/27: dwrite d4/d7/f9 [4194304,4194304] 0 2024-06-03T00:02:58.149 INFO:tasks.workunit.client.0.smithi049.stdout:9/46: dwrite d1/fb [0,4194304] 0 2024-06-03T00:02:58.150 INFO:tasks.workunit.client.0.smithi049.stdout:9/47: readlink - no filename 2024-06-03T00:02:58.161 INFO:tasks.workunit.client.0.smithi049.stdout:9/48: write d1/fb [2782235,44613] 0 2024-06-03T00:02:58.169 INFO:tasks.workunit.client.0.smithi049.stdout:9/49: write d1/f8 [1951876,18953] 0 2024-06-03T00:02:58.169 INFO:tasks.workunit.client.0.smithi049.stdout:9/50: read d1/f8 [1109613,54266] 0 2024-06-03T00:02:58.180 INFO:tasks.workunit.client.0.smithi049.stdout:9/51: dread d1/fb [0,4194304] 0 2024-06-03T00:02:58.181 INFO:tasks.workunit.client.0.smithi049.stdout:4/31: getdents d4 0 2024-06-03T00:02:58.182 INFO:tasks.workunit.client.0.smithi049.stdout:4/32: creat d4/fa x:0 0 0 2024-06-03T00:02:58.185 INFO:tasks.workunit.client.0.smithi049.stdout:4/33: unlink d4/f7 0 2024-06-03T00:02:58.185 INFO:tasks.workunit.client.0.smithi049.stdout:4/34: write f2 [1545100,61852] 0 2024-06-03T00:02:58.185 INFO:tasks.workunit.client.0.smithi049.stdout:4/35: chown l3 23921470 1 2024-06-03T00:02:58.185 INFO:tasks.workunit.client.0.smithi049.stdout:4/36: dread - d4/fa zero size 2024-06-03T00:02:58.204 INFO:tasks.workunit.client.0.smithi049.stdout:9/52: dwrite d1/fb [0,4194304] 0 2024-06-03T00:02:58.212 INFO:tasks.workunit.client.0.smithi049.stdout:9/53: write d1/fb [3114729,96940] 0 2024-06-03T00:02:58.233 INFO:tasks.workunit.client.0.smithi049.stdout:9/54: dwrite d1/f8 [0,4194304] 0 2024-06-03T00:02:58.257 INFO:tasks.workunit.client.0.smithi049.stdout:9/55: dwrite d1/fb [0,4194304] 0 2024-06-03T00:02:58.266 INFO:tasks.workunit.client.0.smithi049.stdout:9/56: dread d1/f8 [0,4194304] 0 2024-06-03T00:02:58.267 INFO:tasks.workunit.client.0.smithi049.stdout:9/57: link d1/d5/c9 d1/d5/cd 0 2024-06-03T00:02:58.276 INFO:tasks.workunit.client.0.smithi049.stdout:9/58: write d1/fb [4073207,11543] 0 2024-06-03T00:02:58.276 INFO:tasks.workunit.client.0.smithi049.stdout:9/59: rename d1/d5 to d1/d5/de 22 2024-06-03T00:02:58.280 INFO:tasks.workunit.client.0.smithi049.stdout:9/60: read d1/f8 [836187,93967] 0 2024-06-03T00:02:58.281 INFO:tasks.workunit.client.0.smithi049.stdout:9/61: read d1/fb [2737305,58967] 0 2024-06-03T00:02:58.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:58 smithi107 ceph-mon[37048]: scrub summary: idle 2024-06-03T00:02:58.377 INFO:tasks.workunit.client.0.smithi049.stdout:6/35: rmdir d2/d3/d5 39 2024-06-03T00:02:58.380 INFO:tasks.workunit.client.0.smithi049.stdout:6/36: getdents d2/d3/d5 0 2024-06-03T00:02:58.381 INFO:tasks.workunit.client.0.smithi049.stdout:6/37: symlink d2/la 0 2024-06-03T00:02:58.383 INFO:tasks.workunit.client.0.smithi049.stdout:2/28: getdents . 0 2024-06-03T00:02:58.384 INFO:tasks.workunit.client.0.smithi049.stdout:2/29: mkdir da 0 2024-06-03T00:02:58.385 INFO:tasks.workunit.client.0.smithi049.stdout:9/62: getdents d1 0 2024-06-03T00:02:58.388 INFO:tasks.workunit.client.0.smithi049.stdout:8/28: truncate d4/d7/f9 7530660 0 2024-06-03T00:02:58.389 INFO:tasks.workunit.client.0.smithi049.stdout:8/29: mknod d4/d7/ca 0 2024-06-03T00:02:58.392 INFO:tasks.workunit.client.0.smithi049.stdout:9/63: fsync d1/fb 0 2024-06-03T00:02:58.392 INFO:tasks.workunit.client.0.smithi049.stdout:9/64: chown d1/d5/cd 34679613 1 2024-06-03T00:02:58.393 INFO:tasks.workunit.client.0.smithi049.stdout:8/30: rename d4/d7/ca to d4/d7/cb 0 2024-06-03T00:02:58.395 INFO:tasks.workunit.client.0.smithi049.stdout:9/65: creat d1/d5/ff x:0 0 0 2024-06-03T00:02:58.399 INFO:tasks.workunit.client.0.smithi049.stdout:6/38: dwrite d2/d3/d5/f8 [0,4194304] 0 2024-06-03T00:02:58.401 INFO:tasks.workunit.client.0.smithi049.stdout:9/66: truncate d1/fb 1947191 0 2024-06-03T00:02:58.401 INFO:tasks.workunit.client.0.smithi049.stdout:9/67: chown d1 544988462 1 2024-06-03T00:02:58.403 INFO:tasks.workunit.client.0.smithi049.stdout:6/39: mkdir d2/d3/db 0 2024-06-03T00:02:58.405 INFO:tasks.workunit.client.0.smithi049.stdout:2/30: dwrite f6 [0,4194304] 0 2024-06-03T00:02:58.405 INFO:tasks.workunit.client.0.smithi049.stdout:9/68: mkdir d1/d5/d10 0 2024-06-03T00:02:58.406 INFO:tasks.workunit.client.0.smithi049.stdout:9/69: write d1/d5/ff [160955,12462] 0 2024-06-03T00:02:58.409 INFO:tasks.workunit.client.0.smithi049.stdout:6/40: symlink d2/lc 0 2024-06-03T00:02:58.409 INFO:tasks.workunit.client.0.smithi049.stdout:6/41: chown d2/d3/d5 269 1 2024-06-03T00:02:58.413 INFO:tasks.workunit.client.0.smithi049.stdout:2/31: stat l3 0 2024-06-03T00:02:58.413 INFO:tasks.workunit.client.0.smithi049.stdout:2/32: readlink l3 0 2024-06-03T00:02:58.413 INFO:tasks.workunit.client.0.smithi049.stdout:2/33: truncate f9 470234 0 2024-06-03T00:02:58.413 INFO:tasks.workunit.client.0.smithi049.stdout:2/34: readlink l3 0 2024-06-03T00:02:58.417 INFO:tasks.workunit.client.0.smithi049.stdout:9/70: write d1/fb [2280261,41832] 0 2024-06-03T00:02:58.417 INFO:tasks.workunit.client.0.smithi049.stdout:9/71: write d1/fb [1030183,118435] 0 2024-06-03T00:02:58.418 INFO:tasks.workunit.client.0.smithi049.stdout:9/72: symlink d1/l11 0 2024-06-03T00:02:58.418 INFO:tasks.workunit.client.0.smithi049.stdout:8/31: dread d4/d7/f9 [0,4194304] 0 2024-06-03T00:02:58.420 INFO:tasks.workunit.client.0.smithi049.stdout:9/73: creat d1/d5/f12 x:0 0 0 2024-06-03T00:02:58.420 INFO:tasks.workunit.client.0.smithi049.stdout:9/74: getdents d1/d5/d10 0 2024-06-03T00:02:58.420 INFO:tasks.workunit.client.0.smithi049.stdout:9/75: write d1/f8 [3571330,43749] 0 2024-06-03T00:02:58.420 INFO:tasks.workunit.client.0.smithi049.stdout:9/76: write d1/f8 [3059144,38473] 0 2024-06-03T00:02:58.421 INFO:tasks.workunit.client.0.smithi049.stdout:9/77: write d1/d5/ff [934831,103235] 0 2024-06-03T00:02:58.424 INFO:tasks.workunit.client.0.smithi049.stdout:9/78: rename d1/d5/d10 to d1/d5/d13 0 2024-06-03T00:02:58.424 INFO:tasks.workunit.client.0.smithi049.stdout:9/79: chown d1/d5/cd 432887756 1 2024-06-03T00:02:58.426 INFO:tasks.workunit.client.0.smithi049.stdout:8/32: dread d4/d7/f9 [4194304,4194304] 0 2024-06-03T00:02:58.426 INFO:tasks.workunit.client.0.smithi049.stdout:6/42: dwrite d2/d3/d5/f8 [0,4194304] 0 2024-06-03T00:02:58.426 INFO:tasks.workunit.client.0.smithi049.stdout:6/43: write d2/d3/d5/f8 [5098775,15528] 0 2024-06-03T00:02:58.426 INFO:tasks.workunit.client.0.smithi049.stdout:9/80: link d1/d5/c9 d1/c14 0 2024-06-03T00:02:58.430 INFO:tasks.workunit.client.0.smithi049.stdout:8/33: creat d4/d7/fc x:0 0 0 2024-06-03T00:02:58.430 INFO:tasks.workunit.client.0.smithi049.stdout:9/81: unlink d1/d5/c9 0 2024-06-03T00:02:58.437 INFO:tasks.workunit.client.0.smithi049.stdout:8/34: dread d4/d7/f9 [0,4194304] 0 2024-06-03T00:02:58.438 INFO:tasks.workunit.client.0.smithi049.stdout:8/35: dread - d4/d7/fc zero size 2024-06-03T00:02:58.438 INFO:tasks.workunit.client.0.smithi049.stdout:8/36: write d4/d7/fc [387178,76105] 0 2024-06-03T00:02:58.441 INFO:tasks.workunit.client.0.smithi049.stdout:8/37: dread d4/d7/f9 [0,4194304] 0 2024-06-03T00:02:58.441 INFO:tasks.workunit.client.0.smithi049.stdout:8/38: fsync d4/d7/f9 0 2024-06-03T00:02:58.442 INFO:tasks.workunit.client.0.smithi049.stdout:8/39: creat d4/fd x:0 0 0 2024-06-03T00:02:58.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:58 smithi057 ceph-mon[36457]: scrub summary: idle 2024-06-03T00:02:58.452 INFO:tasks.workunit.client.0.smithi049.stdout:9/82: dwrite d1/d5/ff [0,4194304] 0 2024-06-03T00:02:58.452 INFO:tasks.workunit.client.0.smithi049.stdout:9/83: stat d1 0 2024-06-03T00:02:58.453 INFO:tasks.workunit.client.0.smithi049.stdout:9/84: fsync d1/d5/ff 0 2024-06-03T00:02:58.453 INFO:tasks.workunit.client.0.smithi049.stdout:6/44: dwrite d2/d3/d5/f8 [4194304,4194304] 0 2024-06-03T00:02:58.455 INFO:tasks.workunit.client.0.smithi049.stdout:6/45: mknod d2/d3/db/cd 0 2024-06-03T00:02:58.455 INFO:tasks.workunit.client.0.smithi049.stdout:8/40: dread d4/d7/fc [0,4194304] 0 2024-06-03T00:02:58.455 INFO:tasks.workunit.client.0.smithi049.stdout:8/41: chown d4/d7/fc 12124 1 2024-06-03T00:02:58.456 INFO:tasks.workunit.client.0.smithi049.stdout:6/46: mknod d2/ce 0 2024-06-03T00:02:58.456 INFO:tasks.workunit.client.0.smithi049.stdout:6/47: chown d2/d3/db 0 1 2024-06-03T00:02:58.457 INFO:tasks.workunit.client.0.smithi049.stdout:6/48: rename d2/d3/d5 to d2/d3/d9/df 0 2024-06-03T00:02:58.459 INFO:tasks.workunit.client.0.smithi049.stdout:6/49: creat d2/d3/db/f10 x:0 0 0 2024-06-03T00:02:58.459 INFO:tasks.workunit.client.0.smithi049.stdout:8/42: write d4/d7/f9 [5666355,122033] 0 2024-06-03T00:02:58.460 INFO:tasks.workunit.client.0.smithi049.stdout:6/50: rename d2/d3/db/f10 to d2/f11 0 2024-06-03T00:02:58.460 INFO:tasks.workunit.client.0.smithi049.stdout:6/51: write d2/d3/d9/df/f8 [8607117,9725] 0 2024-06-03T00:02:58.460 INFO:tasks.workunit.client.0.smithi049.stdout:6/52: dread - d2/f11 zero size 2024-06-03T00:02:58.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:58 smithi049 ceph-mon[32302]: scrub summary: idle 2024-06-03T00:02:58.462 INFO:tasks.workunit.client.0.smithi049.stdout:8/43: unlink c0 0 2024-06-03T00:02:58.463 INFO:tasks.workunit.client.0.smithi049.stdout:6/53: symlink d2/d3/db/l12 0 2024-06-03T00:02:58.463 INFO:tasks.workunit.client.0.smithi049.stdout:6/54: chown d2/ce 68822 1 2024-06-03T00:02:58.465 INFO:tasks.workunit.client.0.smithi049.stdout:8/44: rename d4/d7/f9 to d4/d7/fe 0 2024-06-03T00:02:58.466 INFO:tasks.workunit.client.0.smithi049.stdout:6/55: symlink d2/l13 0 2024-06-03T00:02:58.467 INFO:tasks.workunit.client.0.smithi049.stdout:8/45: mknod d4/cf 0 2024-06-03T00:02:58.467 INFO:tasks.workunit.client.0.smithi049.stdout:8/46: rmdir d4 39 2024-06-03T00:02:58.476 INFO:tasks.workunit.client.0.smithi049.stdout:9/85: dwrite d1/f8 [0,4194304] 0 2024-06-03T00:02:58.476 INFO:tasks.workunit.client.0.smithi049.stdout:9/86: chown d1/fb 7417668 1 2024-06-03T00:02:58.476 INFO:tasks.workunit.client.0.smithi049.stdout:9/87: read d1/fb [1062151,108110] 0 2024-06-03T00:02:58.477 INFO:tasks.workunit.client.0.smithi049.stdout:9/88: creat d1/f15 x:0 0 0 2024-06-03T00:02:58.478 INFO:tasks.workunit.client.0.smithi049.stdout:9/89: creat d1/d5/d13/f16 x:0 0 0 2024-06-03T00:02:58.478 INFO:tasks.workunit.client.0.smithi049.stdout:9/90: truncate d1/d5/d13/f16 906762 0 2024-06-03T00:02:58.478 INFO:tasks.workunit.client.0.smithi049.stdout:6/56: dwrite d2/f11 [0,4194304] 0 2024-06-03T00:02:58.483 INFO:tasks.workunit.client.0.smithi049.stdout:9/91: rmdir d1/d5/d13 39 2024-06-03T00:02:58.483 INFO:tasks.workunit.client.0.smithi049.stdout:9/92: truncate d1/d5/d13/f16 1708578 0 2024-06-03T00:02:58.484 INFO:tasks.workunit.client.0.smithi049.stdout:9/93: symlink d1/d5/d13/l17 0 2024-06-03T00:02:58.499 INFO:tasks.workunit.client.0.smithi049.stdout:6/57: dwrite d2/d3/d9/df/f8 [4194304,4194304] 0 2024-06-03T00:02:58.505 INFO:tasks.workunit.client.0.smithi049.stdout:6/58: dread d2/d3/d9/df/f8 [4194304,4194304] 0 2024-06-03T00:02:58.506 INFO:tasks.workunit.client.0.smithi049.stdout:6/59: link d2/d3/d9/df/f8 d2/d3/f14 0 2024-06-03T00:02:58.507 INFO:tasks.workunit.client.0.smithi049.stdout:6/60: readlink d2/la 0 2024-06-03T00:02:58.507 INFO:tasks.workunit.client.0.smithi049.stdout:6/61: creat d2/f15 x:0 0 0 2024-06-03T00:02:58.508 INFO:tasks.workunit.client.0.smithi049.stdout:6/62: write d2/d3/d9/df/f8 [8516834,109808] 0 2024-06-03T00:02:58.510 INFO:tasks.workunit.client.0.smithi049.stdout:6/63: link d2/d3/f14 d2/d3/db/f16 0 2024-06-03T00:02:58.510 INFO:tasks.workunit.client.0.smithi049.stdout:6/64: stat d2/lc 0 2024-06-03T00:02:58.510 INFO:tasks.workunit.client.0.smithi049.stdout:6/65: chown d2/d3/db 0 1 2024-06-03T00:02:58.510 INFO:tasks.workunit.client.0.smithi049.stdout:6/66: chown d2/d3/db/f16 102227901 1 2024-06-03T00:02:58.523 INFO:tasks.workunit.client.0.smithi049.stdout:6/67: dwrite d2/f11 [0,4194304] 0 2024-06-03T00:02:58.527 INFO:tasks.workunit.client.0.smithi049.stdout:6/68: mkdir d2/d3/d17 0 2024-06-03T00:02:58.542 INFO:tasks.workunit.client.0.smithi049.stdout:6/69: dwrite d2/d3/f14 [4194304,4194304] 0 2024-06-03T00:02:58.542 INFO:tasks.workunit.client.0.smithi049.stdout:6/70: rename d2/d3/d9 to d2/d3/d9/d18 22 2024-06-03T00:02:58.543 INFO:tasks.workunit.client.0.smithi049.stdout:6/71: mkdir d2/d3/db/d19 0 2024-06-03T00:02:58.548 INFO:tasks.workunit.client.0.smithi049.stdout:6/72: truncate d2/d3/db/f16 8181348 0 2024-06-03T00:02:58.548 INFO:tasks.workunit.client.0.smithi049.stdout:6/73: fsync d2/f11 0 2024-06-03T00:02:58.548 INFO:tasks.workunit.client.0.smithi049.stdout:6/74: chown d2/d3/db/cd 445 1 2024-06-03T00:02:58.556 INFO:tasks.workunit.client.0.smithi049.stdout:6/75: write d2/d3/f14 [6151078,13740] 0 2024-06-03T00:02:58.574 INFO:tasks.workunit.client.0.smithi049.stdout:6/76: dwrite d2/d3/f14 [0,4194304] 0 2024-06-03T00:02:58.575 INFO:tasks.workunit.client.0.smithi049.stdout:6/77: creat d2/d3/db/d19/f1a x:0 0 0 2024-06-03T00:02:58.575 INFO:tasks.workunit.client.0.smithi049.stdout:6/78: readlink d2/l6 0 2024-06-03T00:02:58.576 INFO:tasks.workunit.client.0.smithi049.stdout:6/79: rename d2 to d2/d3/d9/df/d1b 22 2024-06-03T00:02:58.576 INFO:tasks.workunit.client.0.smithi049.stdout:6/80: mknod d2/d3/d9/df/c1c 0 2024-06-03T00:02:58.576 INFO:tasks.workunit.client.0.smithi049.stdout:6/81: write d2/f11 [4880504,20535] 0 2024-06-03T00:02:58.593 INFO:tasks.workunit.client.0.smithi049.stdout:6/82: dwrite d2/d3/db/f16 [4194304,4194304] 0 2024-06-03T00:02:58.594 INFO:tasks.workunit.client.0.smithi049.stdout:6/83: fsync d2/d3/d9/df/f8 0 2024-06-03T00:02:58.594 INFO:tasks.workunit.client.0.smithi049.stdout:6/84: truncate d2/d3/db/f16 8814230 0 2024-06-03T00:02:58.594 INFO:tasks.workunit.client.0.smithi049.stdout:6/85: dread - d2/f15 zero size 2024-06-03T00:02:59.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:59 smithi107 ceph-mon[37048]: pgmap v471: 97 pgs: 97 active+clean; 68 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.6 MiB/s wr, 1.13k op/s 2024-06-03T00:02:59.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:59 smithi107 ceph-mon[37048]: scrub summary: idle 2024-06-03T00:02:59.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:59 smithi107 ceph-mon[37048]: scrub summary: idle 2024-06-03T00:02:59.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:02:59 smithi107 ceph-mon[37048]: scrub summary: idle 2024-06-03T00:02:59.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:59 smithi057 ceph-mon[36457]: pgmap v471: 97 pgs: 97 active+clean; 68 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.6 MiB/s wr, 1.13k op/s 2024-06-03T00:02:59.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:59 smithi057 ceph-mon[36457]: scrub summary: idle 2024-06-03T00:02:59.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:59 smithi057 ceph-mon[36457]: scrub summary: idle 2024-06-03T00:02:59.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:02:59 smithi057 ceph-mon[36457]: scrub summary: idle 2024-06-03T00:02:59.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:59 smithi049 ceph-mon[32302]: pgmap v471: 97 pgs: 97 active+clean; 68 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.6 MiB/s wr, 1.13k op/s 2024-06-03T00:02:59.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:59 smithi049 ceph-mon[32302]: scrub summary: idle 2024-06-03T00:02:59.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:59 smithi049 ceph-mon[32302]: scrub summary: idle 2024-06-03T00:02:59.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:02:59 smithi049 ceph-mon[32302]: scrub summary: idle 2024-06-03T00:02:59.690 INFO:tasks.workunit.client.0.smithi049.stdout:0/20: sync 2024-06-03T00:02:59.690 INFO:tasks.workunit.client.0.smithi049.stdout:3/18: sync 2024-06-03T00:02:59.690 INFO:tasks.workunit.client.0.smithi049.stdout:9/94: sync 2024-06-03T00:02:59.690 INFO:tasks.workunit.client.0.smithi049.stdout:5/12: sync 2024-06-03T00:02:59.691 INFO:tasks.workunit.client.0.smithi049.stdout:0/21: dread - f3 zero size 2024-06-03T00:02:59.691 INFO:tasks.workunit.client.0.smithi049.stdout:3/19: chown f0 1533098 1 2024-06-03T00:02:59.691 INFO:tasks.workunit.client.0.smithi049.stdout:4/37: sync 2024-06-03T00:02:59.691 INFO:tasks.workunit.client.0.smithi049.stdout:8/47: sync 2024-06-03T00:02:59.691 INFO:tasks.workunit.client.0.smithi049.stdout:2/35: sync 2024-06-03T00:02:59.691 INFO:tasks.workunit.client.0.smithi049.stdout:1/36: sync 2024-06-03T00:02:59.691 INFO:tasks.workunit.client.0.smithi049.stdout:7/1: sync 2024-06-03T00:02:59.691 INFO:tasks.workunit.client.0.smithi049.stdout:6/86: sync 2024-06-03T00:02:59.691 INFO:tasks.workunit.client.0.smithi049.stdout:4/38: write d4/fa [1045296,129921] 0 2024-06-03T00:02:59.691 INFO:tasks.workunit.client.0.smithi049.stdout:6/87: chown d2/d3/d9/df 29 1 2024-06-03T00:02:59.692 INFO:tasks.workunit.client.0.smithi049.stdout:5/13: write f1 [209084,94963] 0 2024-06-03T00:02:59.694 INFO:tasks.workunit.client.0.smithi049.stdout:3/20: truncate f0 1080188 0 2024-06-03T00:02:59.694 INFO:tasks.workunit.client.0.smithi049.stdout:3/21: write d2/f5 [373363,59295] 0 2024-06-03T00:02:59.696 INFO:tasks.workunit.client.0.smithi049.stdout:1/37: rename d1/c5 to d1/db/cc 0 2024-06-03T00:02:59.698 INFO:tasks.workunit.client.0.smithi049.stdout:2/36: creat da/fb x:0 0 0 2024-06-03T00:02:59.702 INFO:tasks.workunit.client.0.smithi049.stdout:7/2: symlink l1 0 2024-06-03T00:02:59.702 INFO:tasks.workunit.client.0.smithi049.stdout:7/3: dread - f0 zero size 2024-06-03T00:02:59.702 INFO:tasks.workunit.client.0.smithi049.stdout:7/4: fdatasync f0 0 2024-06-03T00:02:59.702 INFO:tasks.workunit.client.0.smithi049.stdout:7/5: truncate f0 720509 0 2024-06-03T00:02:59.703 INFO:tasks.workunit.client.0.smithi049.stdout:7/6: rmdir - no directory 2024-06-03T00:02:59.703 INFO:tasks.workunit.client.0.smithi049.stdout:7/7: dread f0 [0,4194304] 0 2024-06-03T00:02:59.703 INFO:tasks.workunit.client.0.smithi049.stdout:9/95: rmdir d1/da 39 2024-06-03T00:02:59.703 INFO:tasks.workunit.client.0.smithi049.stdout:3/22: rmdir d2 39 2024-06-03T00:02:59.704 INFO:tasks.workunit.client.0.smithi049.stdout:1/38: symlink d1/db/ld 0 2024-06-03T00:02:59.708 INFO:tasks.workunit.client.0.smithi049.stdout:2/37: mknod da/cc 0 2024-06-03T00:02:59.708 INFO:tasks.workunit.client.0.smithi049.stdout:2/38: readlink l3 0 2024-06-03T00:02:59.710 INFO:tasks.workunit.client.0.smithi049.stdout:8/48: dwrite d4/d7/fe [0,4194304] 0 2024-06-03T00:02:59.710 INFO:tasks.workunit.client.0.smithi049.stdout:8/49: truncate d4/fd 82944 0 2024-06-03T00:02:59.710 INFO:tasks.workunit.client.0.smithi049.stdout:8/50: chown d4/d7 103243 1 2024-06-03T00:02:59.710 INFO:tasks.workunit.client.0.smithi049.stdout:7/8: rename l1 to l2 0 2024-06-03T00:02:59.710 INFO:tasks.workunit.client.0.smithi049.stdout:8/51: read d4/d7/fc [375521,71651] 0 2024-06-03T00:02:59.712 INFO:tasks.workunit.client.0.smithi049.stdout:7/9: dread f0 [0,4194304] 0 2024-06-03T00:02:59.712 INFO:tasks.workunit.client.0.smithi049.stdout:7/10: chown f0 429 1 2024-06-03T00:02:59.712 INFO:tasks.workunit.client.0.smithi049.stdout:7/11: chown l2 421442210 1 2024-06-03T00:02:59.712 INFO:tasks.workunit.client.0.smithi049.stdout:6/88: dwrite d2/f11 [4194304,4194304] 0 2024-06-03T00:02:59.713 INFO:tasks.workunit.client.0.smithi049.stdout:9/96: mknod d1/da/c18 0 2024-06-03T00:02:59.714 INFO:tasks.workunit.client.0.smithi049.stdout:3/23: creat d2/f7 x:0 0 0 2024-06-03T00:02:59.715 INFO:tasks.workunit.client.0.smithi049.stdout:1/39: symlink d1/db/le 0 2024-06-03T00:02:59.717 INFO:tasks.workunit.client.0.smithi049.stdout:8/52: rmdir d4 39 2024-06-03T00:02:59.717 INFO:tasks.workunit.client.0.smithi049.stdout:8/53: truncate d4/d7/fc 1048203 0 2024-06-03T00:02:59.717 INFO:tasks.workunit.client.0.smithi049.stdout:2/39: dread f4 [0,4194304] 0 2024-06-03T00:02:59.718 INFO:tasks.workunit.client.0.smithi049.stdout:4/39: truncate d4/fa 487411 0 2024-06-03T00:02:59.719 INFO:tasks.workunit.client.0.smithi049.stdout:7/12: mkdir d3 0 2024-06-03T00:02:59.719 INFO:tasks.workunit.client.0.smithi049.stdout:7/13: readlink l2 0 2024-06-03T00:02:59.720 INFO:tasks.workunit.client.0.smithi049.stdout:7/14: dread f0 [0,4194304] 0 2024-06-03T00:02:59.720 INFO:tasks.workunit.client.0.smithi049.stdout:7/15: chown l2 763990237 1 2024-06-03T00:02:59.720 INFO:tasks.workunit.client.0.smithi049.stdout:6/89: link d2/d3/d9/df/c1c d2/d3/db/c1d 0 2024-06-03T00:02:59.722 INFO:tasks.workunit.client.0.smithi049.stdout:3/24: mkdir d2/d8 0 2024-06-03T00:02:59.722 INFO:tasks.workunit.client.0.smithi049.stdout:3/25: chown d2/f5 0 1 2024-06-03T00:02:59.724 INFO:tasks.workunit.client.0.smithi049.stdout:1/40: link d1/l8 d1/db/lf 0 2024-06-03T00:02:59.724 INFO:tasks.workunit.client.0.smithi049.stdout:1/41: chown d1/f3 6 1 2024-06-03T00:02:59.725 INFO:tasks.workunit.client.0.smithi049.stdout:8/54: link d4/fd d4/d7/f10 0 2024-06-03T00:02:59.726 INFO:tasks.workunit.client.0.smithi049.stdout:2/40: readlink l7 0 2024-06-03T00:02:59.730 INFO:tasks.workunit.client.0.smithi049.stdout:7/16: rename f0 to d3/f4 0 2024-06-03T00:02:59.731 INFO:tasks.workunit.client.0.smithi049.stdout:7/17: dread d3/f4 [0,4194304] 0 2024-06-03T00:02:59.732 INFO:tasks.workunit.client.0.smithi049.stdout:6/90: creat d2/d3/db/d19/f1e x:0 0 0 2024-06-03T00:02:59.732 INFO:tasks.workunit.client.0.smithi049.stdout:9/97: symlink d1/l19 0 2024-06-03T00:02:59.734 INFO:tasks.workunit.client.0.smithi049.stdout:1/42: mknod d1/c10 0 2024-06-03T00:02:59.735 INFO:tasks.workunit.client.0.smithi049.stdout:1/43: read d1/f3 [158201,5654] 0 2024-06-03T00:02:59.736 INFO:tasks.workunit.client.0.smithi049.stdout:8/55: unlink d4/cf 0 2024-06-03T00:02:59.738 INFO:tasks.workunit.client.0.smithi049.stdout:3/26: dwrite f0 [0,4194304] 0 2024-06-03T00:02:59.739 INFO:tasks.workunit.client.0.smithi049.stdout:7/18: rename l2 to d3/l5 0 2024-06-03T00:02:59.741 INFO:tasks.workunit.client.0.smithi049.stdout:1/44: mknod d1/db/c11 0 2024-06-03T00:02:59.744 INFO:tasks.workunit.client.0.smithi049.stdout:8/56: getdents d4/d7 0 2024-06-03T00:02:59.745 INFO:tasks.workunit.client.0.smithi049.stdout:4/40: rename d4/l5 to d4/lb 0 2024-06-03T00:02:59.749 INFO:tasks.workunit.client.0.smithi049.stdout:3/27: mknod d2/c9 0 2024-06-03T00:02:59.751 INFO:tasks.workunit.client.0.smithi049.stdout:7/19: mkdir d3/d6 0 2024-06-03T00:02:59.751 INFO:tasks.workunit.client.0.smithi049.stdout:7/20: write d3/f4 [887146,91189] 0 2024-06-03T00:02:59.753 INFO:tasks.workunit.client.0.smithi049.stdout:1/45: rename d1/l8 to d1/db/l12 0 2024-06-03T00:02:59.754 INFO:tasks.workunit.client.0.smithi049.stdout:3/28: creat d2/d8/fa x:0 0 0 2024-06-03T00:02:59.755 INFO:tasks.workunit.client.0.smithi049.stdout:3/29: write d2/d8/fa [981184,71044] 0 2024-06-03T00:02:59.756 INFO:tasks.workunit.client.0.smithi049.stdout:6/91: dwrite d2/f11 [4194304,4194304] 0 2024-06-03T00:02:59.758 INFO:tasks.workunit.client.0.smithi049.stdout:7/21: rename d3/l5 to d3/d6/l7 0 2024-06-03T00:02:59.759 INFO:tasks.workunit.client.0.smithi049.stdout:1/46: rmdir d1/db 39 2024-06-03T00:02:59.761 INFO:tasks.workunit.client.0.smithi049.stdout:9/98: dwrite d1/fb [0,4194304] 0 2024-06-03T00:02:59.761 INFO:tasks.workunit.client.0.smithi049.stdout:1/47: mkdir d1/db/d13 0 2024-06-03T00:02:59.761 INFO:tasks.workunit.client.0.smithi049.stdout:1/48: write d1/f7 [1108031,52728] 0 2024-06-03T00:02:59.762 INFO:tasks.workunit.client.0.smithi049.stdout:1/49: read d1/f4 [92979,81193] 0 2024-06-03T00:02:59.763 INFO:tasks.workunit.client.0.smithi049.stdout:9/99: rmdir d1/da 39 2024-06-03T00:02:59.766 INFO:tasks.workunit.client.0.smithi049.stdout:1/50: creat d1/db/f14 x:0 0 0 2024-06-03T00:02:59.767 INFO:tasks.workunit.client.0.smithi049.stdout:9/100: mkdir d1/d5/d1a 0 2024-06-03T00:02:59.769 INFO:tasks.workunit.client.0.smithi049.stdout:1/51: symlink d1/db/l15 0 2024-06-03T00:02:59.770 INFO:tasks.workunit.client.0.smithi049.stdout:9/101: rmdir d1/da 39 2024-06-03T00:02:59.780 INFO:tasks.workunit.client.0.smithi049.stdout:9/102: dread d1/d5/ff [0,4194304] 0 2024-06-03T00:02:59.781 INFO:tasks.workunit.client.0.smithi049.stdout:9/103: rmdir d1 39 2024-06-03T00:02:59.782 INFO:tasks.workunit.client.0.smithi049.stdout:6/92: dwrite d2/d3/f14 [4194304,4194304] 0 2024-06-03T00:02:59.789 INFO:tasks.workunit.client.0.smithi049.stdout:6/93: read d2/d3/d9/df/f8 [7369912,53531] 0 2024-06-03T00:02:59.795 INFO:tasks.workunit.client.0.smithi049.stdout:1/52: dwrite d1/db/f14 [0,4194304] 0 2024-06-03T00:02:59.795 INFO:tasks.workunit.client.0.smithi049.stdout:2/41: dwrite f9 [0,4194304] 0 2024-06-03T00:02:59.797 INFO:tasks.workunit.client.0.smithi049.stdout:9/104: read d1/fb [4009302,90351] 0 2024-06-03T00:02:59.809 INFO:tasks.workunit.client.0.smithi049.stdout:6/94: dwrite d2/f15 [0,4194304] 0 2024-06-03T00:02:59.809 INFO:tasks.workunit.client.0.smithi049.stdout:6/95: truncate d2/d3/db/d19/f1a 564498 0 2024-06-03T00:02:59.811 INFO:tasks.workunit.client.0.smithi049.stdout:6/96: mknod d2/d3/c1f 0 2024-06-03T00:02:59.811 INFO:tasks.workunit.client.0.smithi049.stdout:6/97: dread - d2/d3/db/d19/f1e zero size 2024-06-03T00:02:59.826 INFO:tasks.workunit.client.0.smithi049.stdout:1/53: dwrite d1/f4 [0,4194304] 0 2024-06-03T00:02:59.829 INFO:tasks.workunit.client.0.smithi049.stdout:1/54: creat d1/db/f16 x:0 0 0 2024-06-03T00:02:59.830 INFO:tasks.workunit.client.0.smithi049.stdout:1/55: symlink d1/l17 0 2024-06-03T00:02:59.831 INFO:tasks.workunit.client.0.smithi049.stdout:1/56: truncate d1/db/f14 3450736 0 2024-06-03T00:02:59.843 INFO:tasks.workunit.client.0.smithi049.stdout:9/105: dwrite d1/f15 [0,4194304] 0 2024-06-03T00:02:59.843 INFO:tasks.workunit.client.0.smithi049.stdout:2/42: dwrite f9 [0,4194304] 0 2024-06-03T00:02:59.846 INFO:tasks.workunit.client.0.smithi049.stdout:9/106: mknod d1/d5/d13/c1b 0 2024-06-03T00:02:59.846 INFO:tasks.workunit.client.0.smithi049.stdout:6/98: dwrite d2/d3/db/d19/f1e [0,4194304] 0 2024-06-03T00:02:59.848 INFO:tasks.workunit.client.0.smithi049.stdout:9/107: getdents d1 0 2024-06-03T00:02:59.850 INFO:tasks.workunit.client.0.smithi049.stdout:6/99: link d2/d3/db/d19/f1a d2/d3/d9/df/f20 0 2024-06-03T00:02:59.851 INFO:tasks.workunit.client.0.smithi049.stdout:6/100: symlink d2/d3/d17/l21 0 2024-06-03T00:02:59.852 INFO:tasks.workunit.client.0.smithi049.stdout:6/101: getdents d2/d3/db/d19 0 2024-06-03T00:02:59.852 INFO:tasks.workunit.client.0.smithi049.stdout:0/22: sync 2024-06-03T00:02:59.853 INFO:tasks.workunit.client.0.smithi049.stdout:5/14: sync 2024-06-03T00:02:59.853 INFO:tasks.workunit.client.0.smithi049.stdout:0/23: stat f1 0 2024-06-03T00:02:59.854 INFO:tasks.workunit.client.0.smithi049.stdout:5/15: symlink l2 0 2024-06-03T00:02:59.854 INFO:tasks.workunit.client.0.smithi049.stdout:9/108: dread d1/d5/ff [0,4194304] 0 2024-06-03T00:02:59.854 INFO:tasks.workunit.client.0.smithi049.stdout:9/109: chown d1/d5/d13 1 1 2024-06-03T00:02:59.854 INFO:tasks.workunit.client.0.smithi049.stdout:9/110: fdatasync d1/d5/d13/f16 0 2024-06-03T00:02:59.857 INFO:tasks.workunit.client.0.smithi049.stdout:5/16: dread f1 [0,4194304] 0 2024-06-03T00:02:59.857 INFO:tasks.workunit.client.0.smithi049.stdout:1/57: dwrite d1/f4 [0,4194304] 0 2024-06-03T00:02:59.857 INFO:tasks.workunit.client.0.smithi049.stdout:5/17: mkdir d3 0 2024-06-03T00:02:59.857 INFO:tasks.workunit.client.0.smithi049.stdout:5/18: stat c0 0 2024-06-03T00:02:59.858 INFO:tasks.workunit.client.0.smithi049.stdout:5/19: truncate f1 627657 0 2024-06-03T00:02:59.860 INFO:tasks.workunit.client.0.smithi049.stdout:1/58: mknod d1/db/c18 0 2024-06-03T00:02:59.860 INFO:tasks.workunit.client.0.smithi049.stdout:1/59: truncate d1/db/f16 222556 0 2024-06-03T00:02:59.860 INFO:tasks.workunit.client.0.smithi049.stdout:5/20: creat d3/f4 x:0 0 0 2024-06-03T00:02:59.860 INFO:tasks.workunit.client.0.smithi049.stdout:5/21: read f1 [179677,20820] 0 2024-06-03T00:02:59.860 INFO:tasks.workunit.client.0.smithi049.stdout:1/60: symlink d1/db/d13/l19 0 2024-06-03T00:02:59.860 INFO:tasks.workunit.client.0.smithi049.stdout:1/61: chown d1/db/le 144 1 2024-06-03T00:02:59.860 INFO:tasks.workunit.client.0.smithi049.stdout:5/22: unlink l2 0 2024-06-03T00:02:59.861 INFO:tasks.workunit.client.0.smithi049.stdout:6/102: dread d2/f11 [0,4194304] 0 2024-06-03T00:02:59.861 INFO:tasks.workunit.client.0.smithi049.stdout:6/103: symlink d2/d3/db/l22 0 2024-06-03T00:02:59.861 INFO:tasks.workunit.client.0.smithi049.stdout:6/104: fsync d2/d3/db/f16 0 2024-06-03T00:02:59.862 INFO:tasks.workunit.client.0.smithi049.stdout:5/23: dread f1 [0,4194304] 0 2024-06-03T00:02:59.863 INFO:tasks.workunit.client.0.smithi049.stdout:6/105: rename d2/d3/db/d19 to d2/d3/d9/d23 0 2024-06-03T00:02:59.864 INFO:tasks.workunit.client.0.smithi049.stdout:5/24: mkdir d3/d5 0 2024-06-03T00:02:59.864 INFO:tasks.workunit.client.0.smithi049.stdout:7/22: sync 2024-06-03T00:02:59.864 INFO:tasks.workunit.client.0.smithi049.stdout:7/23: chown d3/f4 19205245 1 2024-06-03T00:02:59.865 INFO:tasks.workunit.client.0.smithi049.stdout:6/106: creat d2/f24 x:0 0 0 2024-06-03T00:02:59.865 INFO:tasks.workunit.client.0.smithi049.stdout:5/25: mknod d3/d5/c6 0 2024-06-03T00:02:59.866 INFO:tasks.workunit.client.0.smithi049.stdout:7/24: mkdir d3/d8 0 2024-06-03T00:02:59.866 INFO:tasks.workunit.client.0.smithi049.stdout:7/25: stat d3/d8 0 2024-06-03T00:02:59.867 INFO:tasks.workunit.client.0.smithi049.stdout:6/107: getdents d2/d3/d9/df 0 2024-06-03T00:02:59.867 INFO:tasks.workunit.client.0.smithi049.stdout:7/26: truncate d3/f4 917312 0 2024-06-03T00:02:59.867 INFO:tasks.workunit.client.0.smithi049.stdout:7/27: chown d3 0 1 2024-06-03T00:02:59.868 INFO:tasks.workunit.client.0.smithi049.stdout:6/108: unlink d2/d3/f14 0 2024-06-03T00:02:59.869 INFO:tasks.workunit.client.0.smithi049.stdout:7/28: getdents d3/d6 0 2024-06-03T00:02:59.869 INFO:tasks.workunit.client.0.smithi049.stdout:6/109: creat d2/d3/d9/f25 x:0 0 0 2024-06-03T00:02:59.870 INFO:tasks.workunit.client.0.smithi049.stdout:7/29: mkdir d3/d6/d9 0 2024-06-03T00:02:59.871 INFO:tasks.workunit.client.0.smithi049.stdout:7/30: mkdir d3/d6/da 0 2024-06-03T00:02:59.874 INFO:tasks.workunit.client.0.smithi049.stdout:7/31: link d3/d6/l7 d3/d6/d9/lb 0 2024-06-03T00:02:59.878 INFO:tasks.workunit.client.0.smithi049.stdout:7/32: write d3/f4 [1180480,57692] 0 2024-06-03T00:02:59.878 INFO:tasks.workunit.client.0.smithi049.stdout:7/33: truncate d3/f4 2081072 0 2024-06-03T00:02:59.881 INFO:tasks.workunit.client.0.smithi049.stdout:9/111: write d1/f15 [58835,25798] 0 2024-06-03T00:02:59.882 INFO:tasks.workunit.client.0.smithi049.stdout:0/24: dwrite f2 [0,4194304] 0 2024-06-03T00:02:59.885 INFO:tasks.workunit.client.0.smithi049.stdout:1/62: dwrite d1/f4 [0,4194304] 0 2024-06-03T00:02:59.885 INFO:tasks.workunit.client.0.smithi049.stdout:1/63: chown d1/db/f14 1110137 1 2024-06-03T00:02:59.885 INFO:tasks.workunit.client.0.smithi049.stdout:1/64: stat d1 0 2024-06-03T00:02:59.886 INFO:tasks.workunit.client.0.smithi049.stdout:9/112: dread d1/fb [0,4194304] 0 2024-06-03T00:02:59.886 INFO:tasks.workunit.client.0.smithi049.stdout:0/25: creat f4 x:0 0 0 2024-06-03T00:02:59.889 INFO:tasks.workunit.client.0.smithi049.stdout:1/65: mkdir d1/d1a 0 2024-06-03T00:02:59.892 INFO:tasks.workunit.client.0.smithi049.stdout:1/66: link d1/f4 d1/db/f1b 0 2024-06-03T00:02:59.892 INFO:tasks.workunit.client.0.smithi049.stdout:7/34: truncate d3/f4 1415920 0 2024-06-03T00:02:59.894 INFO:tasks.workunit.client.0.smithi049.stdout:1/67: link d1/db/ld d1/d1a/l1c 0 2024-06-03T00:02:59.895 INFO:tasks.workunit.client.0.smithi049.stdout:9/113: write d1/f8 [3275030,37587] 0 2024-06-03T00:02:59.895 INFO:tasks.workunit.client.0.smithi049.stdout:1/68: dread d1/db/f16 [0,4194304] 0 2024-06-03T00:02:59.895 INFO:tasks.workunit.client.0.smithi049.stdout:1/69: chown d1/db/cc 0 1 2024-06-03T00:02:59.896 INFO:tasks.workunit.client.0.smithi049.stdout:9/114: symlink d1/d5/d13/l1c 0 2024-06-03T00:02:59.897 INFO:tasks.workunit.client.0.smithi049.stdout:9/115: write d1/f8 [2317106,31846] 0 2024-06-03T00:02:59.897 INFO:tasks.workunit.client.0.smithi049.stdout:9/116: stat d1/d5/c6 0 2024-06-03T00:02:59.897 INFO:tasks.workunit.client.0.smithi049.stdout:9/117: stat d1 0 2024-06-03T00:02:59.899 INFO:tasks.workunit.client.0.smithi049.stdout:1/70: symlink d1/l1d 0 2024-06-03T00:02:59.901 INFO:tasks.workunit.client.0.smithi049.stdout:1/71: creat d1/f1e x:0 0 0 2024-06-03T00:02:59.901 INFO:tasks.workunit.client.0.smithi049.stdout:1/72: chown d1/l17 12 1 2024-06-03T00:02:59.902 INFO:tasks.workunit.client.0.smithi049.stdout:1/73: creat d1/db/f1f x:0 0 0 2024-06-03T00:02:59.904 INFO:tasks.workunit.client.0.smithi049.stdout:1/74: truncate d1/db/f14 2265912 0 2024-06-03T00:02:59.905 INFO:tasks.workunit.client.0.smithi049.stdout:1/75: rmdir d1 39 2024-06-03T00:02:59.905 INFO:tasks.workunit.client.0.smithi049.stdout:1/76: chown d1/f1e 27651694 1 2024-06-03T00:02:59.905 INFO:tasks.workunit.client.0.smithi049.stdout:1/77: chown d1/db/d13/l19 152117 1 2024-06-03T00:02:59.905 INFO:tasks.workunit.client.0.smithi049.stdout:1/78: chown d1/f4 82008669 1 2024-06-03T00:02:59.905 INFO:tasks.workunit.client.0.smithi049.stdout:1/79: readlink d1/l1d 0 2024-06-03T00:02:59.905 INFO:tasks.workunit.client.0.smithi049.stdout:1/80: write d1/f1e [219298,46239] 0 2024-06-03T00:02:59.906 INFO:tasks.workunit.client.0.smithi049.stdout:1/81: creat d1/db/d13/f20 x:0 0 0 2024-06-03T00:02:59.908 INFO:tasks.workunit.client.0.smithi049.stdout:1/82: symlink d1/db/l21 0 2024-06-03T00:02:59.908 INFO:tasks.workunit.client.0.smithi049.stdout:1/83: write d1/f3 [1733197,17362] 0 2024-06-03T00:02:59.914 INFO:tasks.workunit.client.0.smithi049.stdout:9/118: dwrite d1/f15 [0,4194304] 0 2024-06-03T00:02:59.926 INFO:tasks.workunit.client.0.smithi049.stdout:1/84: dwrite d1/db/f16 [0,4194304] 0 2024-06-03T00:02:59.929 INFO:tasks.workunit.client.0.smithi049.stdout:1/85: creat d1/db/f22 x:0 0 0 2024-06-03T00:02:59.931 INFO:tasks.workunit.client.0.smithi049.stdout:1/86: fsync d1/db/f22 0 2024-06-03T00:02:59.931 INFO:tasks.workunit.client.0.smithi049.stdout:1/87: stat d1/db/d13/l19 0 2024-06-03T00:02:59.931 INFO:tasks.workunit.client.0.smithi049.stdout:1/88: fsync d1/db/f1b 0 2024-06-03T00:02:59.932 INFO:tasks.workunit.client.0.smithi049.stdout:1/89: rename d1/db/c11 to d1/db/d13/c23 0 2024-06-03T00:02:59.941 INFO:tasks.workunit.client.0.smithi049.stdout:9/119: dwrite d1/f8 [0,4194304] 0 2024-06-03T00:02:59.942 INFO:tasks.workunit.client.0.smithi049.stdout:9/120: creat d1/d5/f1d x:0 0 0 2024-06-03T00:02:59.958 INFO:tasks.workunit.client.0.smithi049.stdout:1/90: dwrite d1/db/f16 [4194304,4194304] 0 2024-06-03T00:02:59.959 INFO:tasks.workunit.client.0.smithi049.stdout:1/91: readlink d1/l17 0 2024-06-03T00:02:59.959 INFO:tasks.workunit.client.0.smithi049.stdout:1/92: fdatasync d1/db/f16 0 2024-06-03T00:02:59.959 INFO:tasks.workunit.client.0.smithi049.stdout:4/41: sync 2024-06-03T00:02:59.959 INFO:tasks.workunit.client.0.smithi049.stdout:3/30: sync 2024-06-03T00:02:59.959 INFO:tasks.workunit.client.0.smithi049.stdout:8/57: sync 2024-06-03T00:02:59.959 INFO:tasks.workunit.client.0.smithi049.stdout:8/58: fdatasync d4/d7/fe 0 2024-06-03T00:02:59.959 INFO:tasks.workunit.client.0.smithi049.stdout:8/59: chown d4/d7/fc 3 1 2024-06-03T00:02:59.960 INFO:tasks.workunit.client.0.smithi049.stdout:4/42: read f2 [631787,171] 0 2024-06-03T00:02:59.960 INFO:tasks.workunit.client.0.smithi049.stdout:4/43: readlink d4/lb 0 2024-06-03T00:02:59.960 INFO:tasks.workunit.client.0.smithi049.stdout:8/60: dread d4/d7/f10 [0,4194304] 0 2024-06-03T00:02:59.961 INFO:tasks.workunit.client.0.smithi049.stdout:4/44: creat d4/fc x:0 0 0 2024-06-03T00:02:59.961 INFO:tasks.workunit.client.0.smithi049.stdout:4/45: chown f2 77 1 2024-06-03T00:02:59.961 INFO:tasks.workunit.client.0.smithi049.stdout:4/46: chown d4/fa 3514 1 2024-06-03T00:02:59.961 INFO:tasks.workunit.client.0.smithi049.stdout:4/47: write f2 [2479144,30458] 0 2024-06-03T00:02:59.962 INFO:tasks.workunit.client.0.smithi049.stdout:4/48: creat d4/fd x:0 0 0 2024-06-03T00:02:59.969 INFO:tasks.workunit.client.0.smithi049.stdout:9/121: dwrite d1/d5/ff [4194304,4194304] 0 2024-06-03T00:02:59.969 INFO:tasks.workunit.client.0.smithi049.stdout:4/49: dread f2 [0,4194304] 0 2024-06-03T00:02:59.973 INFO:tasks.workunit.client.0.smithi049.stdout:4/50: mknod d4/ce 0 2024-06-03T00:02:59.973 INFO:tasks.workunit.client.0.smithi049.stdout:4/51: stat f2 0 2024-06-03T00:02:59.974 INFO:tasks.workunit.client.0.smithi049.stdout:4/52: creat d4/ff x:0 0 0 2024-06-03T00:02:59.977 INFO:tasks.workunit.client.0.smithi049.stdout:1/93: write d1/f4 [4157871,91] 0 2024-06-03T00:02:59.977 INFO:tasks.workunit.client.0.smithi049.stdout:1/94: write d1/f7 [1394467,59568] 0 2024-06-03T00:02:59.977 INFO:tasks.workunit.client.0.smithi049.stdout:1/95: chown d1/db/l15 7304 1 2024-06-03T00:02:59.978 INFO:tasks.workunit.client.0.smithi049.stdout:3/31: dread f0 [0,4194304] 0 2024-06-03T00:02:59.979 INFO:tasks.workunit.client.0.smithi049.stdout:1/96: write d1/f3 [524821,6658] 0 2024-06-03T00:02:59.979 INFO:tasks.workunit.client.0.smithi049.stdout:3/32: chown d2/f5 616720 1 2024-06-03T00:02:59.980 INFO:tasks.workunit.client.0.smithi049.stdout:1/97: symlink d1/db/d13/l24 0 2024-06-03T00:02:59.981 INFO:tasks.workunit.client.0.smithi049.stdout:3/33: creat d2/d8/fb x:0 0 0 2024-06-03T00:02:59.981 INFO:tasks.workunit.client.0.smithi049.stdout:9/122: write d1/f8 [1444310,68650] 0 2024-06-03T00:02:59.982 INFO:tasks.workunit.client.0.smithi049.stdout:1/98: creat d1/d1a/f25 x:0 0 0 2024-06-03T00:02:59.983 INFO:tasks.workunit.client.0.smithi049.stdout:3/34: rename d2/c9 to d2/cc 0 2024-06-03T00:02:59.985 INFO:tasks.workunit.client.0.smithi049.stdout:9/123: rename d1/d5/ff to d1/d5/d1a/f1e 0 2024-06-03T00:02:59.986 INFO:tasks.workunit.client.0.smithi049.stdout:1/99: link d1/db/l15 d1/db/l26 0 2024-06-03T00:02:59.987 INFO:tasks.workunit.client.0.smithi049.stdout:9/124: mknod d1/d5/d13/c1f 0 2024-06-03T00:02:59.988 INFO:tasks.workunit.client.0.smithi049.stdout:9/125: mknod d1/d5/c20 0 2024-06-03T00:02:59.990 INFO:tasks.workunit.client.0.smithi049.stdout:4/53: dwrite f2 [0,4194304] 0 2024-06-03T00:02:59.991 INFO:tasks.workunit.client.0.smithi049.stdout:8/61: dwrite d4/d7/f10 [0,4194304] 0 2024-06-03T00:02:59.994 INFO:tasks.workunit.client.0.smithi049.stdout:8/62: creat d4/d7/f11 x:0 0 0 2024-06-03T00:02:59.994 INFO:tasks.workunit.client.0.smithi049.stdout:9/126: dread d1/fb [0,4194304] 0 2024-06-03T00:02:59.994 INFO:tasks.workunit.client.0.smithi049.stdout:9/127: fsync d1/d5/f12 0 2024-06-03T00:02:59.994 INFO:tasks.workunit.client.0.smithi049.stdout:9/128: chown d1/l19 124028 1 2024-06-03T00:03:00.007 INFO:tasks.workunit.client.0.smithi049.stdout:4/54: dwrite d4/fc [0,4194304] 0 2024-06-03T00:03:00.008 INFO:tasks.workunit.client.0.smithi049.stdout:4/55: write d4/ff [964188,28814] 0 2024-06-03T00:03:00.008 INFO:tasks.workunit.client.0.smithi049.stdout:4/56: truncate d4/fd 308472 0 2024-06-03T00:03:00.018 INFO:tasks.workunit.client.0.smithi049.stdout:4/57: dwrite f2 [0,4194304] 0 2024-06-03T00:03:00.019 INFO:tasks.workunit.client.0.smithi049.stdout:4/58: mkdir d4/d10 0 2024-06-03T00:03:00.019 INFO:tasks.workunit.client.0.smithi049.stdout:9/129: dwrite d1/f8 [0,4194304] 0 2024-06-03T00:03:00.020 INFO:tasks.workunit.client.0.smithi049.stdout:4/59: symlink d4/d10/l11 0 2024-06-03T00:03:00.021 INFO:tasks.workunit.client.0.smithi049.stdout:9/130: rename d1/d5/cd to d1/da/c21 0 2024-06-03T00:03:00.022 INFO:tasks.workunit.client.0.smithi049.stdout:4/60: unlink l0 0 2024-06-03T00:03:00.024 INFO:tasks.workunit.client.0.smithi049.stdout:4/61: rename d4/ce to d4/c12 0 2024-06-03T00:03:00.024 INFO:tasks.workunit.client.0.smithi049.stdout:4/62: truncate d4/fa 868322 0 2024-06-03T00:03:00.024 INFO:tasks.workunit.client.0.smithi049.stdout:4/63: write d4/ff [166443,78324] 0 2024-06-03T00:03:00.031 INFO:tasks.workunit.client.0.smithi049.stdout:8/63: dwrite d4/d7/fe [0,4194304] 0 2024-06-03T00:03:00.031 INFO:tasks.workunit.client.0.smithi049.stdout:8/64: fsync d4/d7/fc 0 2024-06-03T00:03:00.031 INFO:tasks.workunit.client.0.smithi049.stdout:8/65: readlink l3 0 2024-06-03T00:03:00.032 INFO:tasks.workunit.client.0.smithi049.stdout:4/64: dread f2 [0,4194304] 0 2024-06-03T00:03:00.033 INFO:tasks.workunit.client.0.smithi049.stdout:8/66: creat d4/f12 x:0 0 0 2024-06-03T00:03:00.033 INFO:tasks.workunit.client.0.smithi049.stdout:8/67: write d4/d7/f11 [391196,44789] 0 2024-06-03T00:03:00.042 INFO:tasks.workunit.client.0.smithi049.stdout:9/131: dwrite d1/fb [0,4194304] 0 2024-06-03T00:03:00.044 INFO:tasks.workunit.client.0.smithi049.stdout:8/68: write d4/fd [254502,13852] 0 2024-06-03T00:03:00.049 INFO:tasks.workunit.client.0.smithi049.stdout:9/132: unlink d1/da/cc 0 2024-06-03T00:03:00.051 INFO:tasks.workunit.client.0.smithi049.stdout:4/65: dwrite d4/fa [0,4194304] 0 2024-06-03T00:03:00.053 INFO:tasks.workunit.client.0.smithi049.stdout:5/26: sync 2024-06-03T00:03:00.054 INFO:tasks.workunit.client.0.smithi049.stdout:0/26: sync 2024-06-03T00:03:00.054 INFO:tasks.workunit.client.0.smithi049.stdout:4/66: chown d4/lb 12115 1 2024-06-03T00:03:00.054 INFO:tasks.workunit.client.0.smithi049.stdout:2/43: sync 2024-06-03T00:03:00.054 INFO:tasks.workunit.client.0.smithi049.stdout:7/35: sync 2024-06-03T00:03:00.055 INFO:tasks.workunit.client.0.smithi049.stdout:6/110: sync 2024-06-03T00:03:00.055 INFO:tasks.workunit.client.0.smithi049.stdout:7/36: write d3/f4 [964886,6446] 0 2024-06-03T00:03:00.057 INFO:tasks.workunit.client.0.smithi049.stdout:5/27: mkdir d3/d7 0 2024-06-03T00:03:00.059 INFO:tasks.workunit.client.0.smithi049.stdout:0/27: symlink l5 0 2024-06-03T00:03:00.059 INFO:tasks.workunit.client.0.smithi049.stdout:0/28: readlink l5 0 2024-06-03T00:03:00.061 INFO:tasks.workunit.client.0.smithi049.stdout:7/37: creat d3/fc x:0 0 0 2024-06-03T00:03:00.061 INFO:tasks.workunit.client.0.smithi049.stdout:0/29: mkdir d6 0 2024-06-03T00:03:00.062 INFO:tasks.workunit.client.0.smithi049.stdout:4/67: mknod d4/c13 0 2024-06-03T00:03:00.064 INFO:tasks.workunit.client.0.smithi049.stdout:7/38: rename d3/d6/l7 to d3/ld 0 2024-06-03T00:03:00.064 INFO:tasks.workunit.client.0.smithi049.stdout:0/30: mknod d6/c7 0 2024-06-03T00:03:00.064 INFO:tasks.workunit.client.0.smithi049.stdout:0/31: read - f3 zero size 2024-06-03T00:03:00.064 INFO:tasks.workunit.client.0.smithi049.stdout:4/68: mkdir d4/d10/d14 0 2024-06-03T00:03:00.065 INFO:tasks.workunit.client.0.smithi049.stdout:0/32: mknod d6/c8 0 2024-06-03T00:03:00.065 INFO:tasks.workunit.client.0.smithi049.stdout:4/69: mkdir d4/d10/d14/d15 0 2024-06-03T00:03:00.066 INFO:tasks.workunit.client.0.smithi049.stdout:2/44: read f9 [2422612,76158] 0 2024-06-03T00:03:00.068 INFO:tasks.workunit.client.0.smithi049.stdout:4/70: mkdir d4/d16 0 2024-06-03T00:03:00.069 INFO:tasks.workunit.client.0.smithi049.stdout:8/69: dwrite d4/d7/fe [4194304,4194304] 0 2024-06-03T00:03:00.071 INFO:tasks.workunit.client.0.smithi049.stdout:8/70: unlink d4/f12 0 2024-06-03T00:03:00.072 INFO:tasks.workunit.client.0.smithi049.stdout:8/71: read d4/d7/fc [727704,20219] 0 2024-06-03T00:03:00.075 INFO:tasks.workunit.client.0.smithi049.stdout:8/72: creat d4/d7/f13 x:0 0 0 2024-06-03T00:03:00.085 INFO:tasks.workunit.client.0.smithi049.stdout:5/28: dwrite f1 [0,4194304] 0 2024-06-03T00:03:00.085 INFO:tasks.workunit.client.0.smithi049.stdout:6/111: dwrite d2/f24 [0,4194304] 0 2024-06-03T00:03:00.085 INFO:tasks.workunit.client.0.smithi049.stdout:4/71: write d4/fc [4059393,103286] 0 2024-06-03T00:03:00.088 INFO:tasks.workunit.client.0.smithi049.stdout:5/29: creat d3/d7/f8 x:0 0 0 2024-06-03T00:03:00.090 INFO:tasks.workunit.client.0.smithi049.stdout:6/112: creat d2/d3/d9/d23/f26 x:0 0 0 2024-06-03T00:03:00.091 INFO:tasks.workunit.client.0.smithi049.stdout:4/72: symlink d4/d16/l17 0 2024-06-03T00:03:00.091 INFO:tasks.workunit.client.0.smithi049.stdout:4/73: stat d4/d10/l11 0 2024-06-03T00:03:00.091 INFO:tasks.workunit.client.0.smithi049.stdout:5/30: mkdir d3/d9 0 2024-06-03T00:03:00.092 INFO:tasks.workunit.client.0.smithi049.stdout:6/113: creat d2/d3/d9/f27 x:0 0 0 2024-06-03T00:03:00.093 INFO:tasks.workunit.client.0.smithi049.stdout:0/33: dwrite f1 [0,4194304] 0 2024-06-03T00:03:00.094 INFO:tasks.workunit.client.0.smithi049.stdout:4/74: creat d4/d10/d14/d15/f18 x:0 0 0 2024-06-03T00:03:00.094 INFO:tasks.workunit.client.0.smithi049.stdout:2/45: dwrite f4 [0,4194304] 0 2024-06-03T00:03:00.095 INFO:tasks.workunit.client.0.smithi049.stdout:2/46: chown da/fb 17461 1 2024-06-03T00:03:00.095 INFO:tasks.workunit.client.0.smithi049.stdout:6/114: rename d2/d3/d9/df to d2/d3/db/d28 0 2024-06-03T00:03:00.100 INFO:tasks.workunit.client.0.smithi049.stdout:5/31: write f1 [2941194,79585] 0 2024-06-03T00:03:00.101 INFO:tasks.workunit.client.0.smithi049.stdout:4/75: symlink d4/d10/l19 0 2024-06-03T00:03:00.102 INFO:tasks.workunit.client.0.smithi049.stdout:2/47: unlink l3 0 2024-06-03T00:03:00.102 INFO:tasks.workunit.client.0.smithi049.stdout:2/48: readlink l7 0 2024-06-03T00:03:00.103 INFO:tasks.workunit.client.0.smithi049.stdout:5/32: mkdir d3/d5/da 0 2024-06-03T00:03:00.103 INFO:tasks.workunit.client.0.smithi049.stdout:5/33: dread - d3/f4 zero size 2024-06-03T00:03:00.103 INFO:tasks.workunit.client.0.smithi049.stdout:5/34: readlink - no filename 2024-06-03T00:03:00.103 INFO:tasks.workunit.client.0.smithi049.stdout:4/76: mknod d4/d10/d14/d15/c1a 0 2024-06-03T00:03:00.104 INFO:tasks.workunit.client.0.smithi049.stdout:2/49: mkdir da/dd 0 2024-06-03T00:03:00.104 INFO:tasks.workunit.client.0.smithi049.stdout:2/50: rename da/dd to da/dd/de 22 2024-06-03T00:03:00.105 INFO:tasks.workunit.client.0.smithi049.stdout:5/35: symlink d3/lb 0 2024-06-03T00:03:00.105 INFO:tasks.workunit.client.0.smithi049.stdout:5/36: dread - d3/f4 zero size 2024-06-03T00:03:00.111 INFO:tasks.workunit.client.0.smithi049.stdout:7/39: dwrite d3/fc [0,4194304] 0 2024-06-03T00:03:00.111 INFO:tasks.workunit.client.0.smithi049.stdout:8/73: dwrite d4/d7/f11 [0,4194304] 0 2024-06-03T00:03:00.111 INFO:tasks.workunit.client.0.smithi049.stdout:8/74: readlink l3 0 2024-06-03T00:03:00.111 INFO:tasks.workunit.client.0.smithi049.stdout:5/37: mknod d3/cc 0 2024-06-03T00:03:00.111 INFO:tasks.workunit.client.0.smithi049.stdout:2/51: truncate f1 2332421 0 2024-06-03T00:03:00.112 INFO:tasks.workunit.client.0.smithi049.stdout:7/40: rmdir d3/d6/da 0 2024-06-03T00:03:00.112 INFO:tasks.workunit.client.0.smithi049.stdout:7/41: readlink d3/ld 0 2024-06-03T00:03:00.113 INFO:tasks.workunit.client.0.smithi049.stdout:8/75: link d4/fd d4/d7/f14 0 2024-06-03T00:03:00.114 INFO:tasks.workunit.client.0.smithi049.stdout:8/76: truncate d4/d7/fc 2018406 0 2024-06-03T00:03:00.114 INFO:tasks.workunit.client.0.smithi049.stdout:5/38: creat d3/d5/fd x:0 0 0 2024-06-03T00:03:00.116 INFO:tasks.workunit.client.0.smithi049.stdout:0/34: dwrite f1 [0,4194304] 0 2024-06-03T00:03:00.116 INFO:tasks.workunit.client.0.smithi049.stdout:8/77: creat d4/f15 x:0 0 0 2024-06-03T00:03:00.116 INFO:tasks.workunit.client.0.smithi049.stdout:5/39: mknod d3/d7/ce 0 2024-06-03T00:03:00.116 INFO:tasks.workunit.client.0.smithi049.stdout:5/40: chown f1 54 1 2024-06-03T00:03:00.117 INFO:tasks.workunit.client.0.smithi049.stdout:7/42: mkdir d3/d6/de 0 2024-06-03T00:03:00.118 INFO:tasks.workunit.client.0.smithi049.stdout:0/35: rmdir d6 39 2024-06-03T00:03:00.118 INFO:tasks.workunit.client.0.smithi049.stdout:0/36: chown f1 3 1 2024-06-03T00:03:00.119 INFO:tasks.workunit.client.0.smithi049.stdout:5/41: symlink d3/d9/lf 0 2024-06-03T00:03:00.119 INFO:tasks.workunit.client.0.smithi049.stdout:5/42: dread - d3/d7/f8 zero size 2024-06-03T00:03:00.119 INFO:tasks.workunit.client.0.smithi049.stdout:0/37: mknod d6/c9 0 2024-06-03T00:03:00.128 INFO:tasks.workunit.client.0.smithi049.stdout:6/115: dwrite d2/f24 [0,4194304] 0 2024-06-03T00:03:00.128 INFO:tasks.workunit.client.0.smithi049.stdout:4/77: dwrite d4/ff [0,4194304] 0 2024-06-03T00:03:00.131 INFO:tasks.workunit.client.0.smithi049.stdout:6/116: mkdir d2/d3/d9/d23/d29 0 2024-06-03T00:03:00.133 INFO:tasks.workunit.client.0.smithi049.stdout:7/43: write d3/fc [2211919,5217] 0 2024-06-03T00:03:00.133 INFO:tasks.workunit.client.0.smithi049.stdout:4/78: getdents d4/d16 0 2024-06-03T00:03:00.134 INFO:tasks.workunit.client.0.smithi049.stdout:7/44: read d3/f4 [741574,40803] 0 2024-06-03T00:03:00.135 INFO:tasks.workunit.client.0.smithi049.stdout:4/79: symlink d4/d10/d14/l1b 0 2024-06-03T00:03:00.135 INFO:tasks.workunit.client.0.smithi049.stdout:4/80: chown d4/c12 1 1 2024-06-03T00:03:00.137 INFO:tasks.workunit.client.0.smithi049.stdout:7/45: rename d3/f4 to d3/d8/ff 0 2024-06-03T00:03:00.138 INFO:tasks.workunit.client.0.smithi049.stdout:0/38: dread f2 [0,4194304] 0 2024-06-03T00:03:00.138 INFO:tasks.workunit.client.0.smithi049.stdout:4/81: mkdir d4/d16/d1c 0 2024-06-03T00:03:00.139 INFO:tasks.workunit.client.0.smithi049.stdout:7/46: creat d3/d8/f10 x:0 0 0 2024-06-03T00:03:00.141 INFO:tasks.workunit.client.0.smithi049.stdout:0/39: creat d6/fa x:0 0 0 2024-06-03T00:03:00.142 INFO:tasks.workunit.client.0.smithi049.stdout:3/35: sync 2024-06-03T00:03:00.142 INFO:tasks.workunit.client.0.smithi049.stdout:3/36: dread - d2/d8/fb zero size 2024-06-03T00:03:00.142 INFO:tasks.workunit.client.0.smithi049.stdout:3/37: fsync d2/f6 0 2024-06-03T00:03:00.142 INFO:tasks.workunit.client.0.smithi049.stdout:1/100: sync 2024-06-03T00:03:00.143 INFO:tasks.workunit.client.0.smithi049.stdout:1/101: chown d1 14783 1 2024-06-03T00:03:00.143 INFO:tasks.workunit.client.0.smithi049.stdout:4/82: mknod d4/c1d 0 2024-06-03T00:03:00.143 INFO:tasks.workunit.client.0.smithi049.stdout:4/83: chown d4/d10/d14/d15/c1a 4129206 1 2024-06-03T00:03:00.145 INFO:tasks.workunit.client.0.smithi049.stdout:3/38: link d2/d8/fb d2/fd 0 2024-06-03T00:03:00.146 INFO:tasks.workunit.client.0.smithi049.stdout:1/102: creat d1/db/d13/f27 x:0 0 0 2024-06-03T00:03:00.146 INFO:tasks.workunit.client.0.smithi049.stdout:1/103: dread - d1/d1a/f25 zero size 2024-06-03T00:03:00.149 INFO:tasks.workunit.client.0.smithi049.stdout:3/39: creat d2/fe x:0 0 0 2024-06-03T00:03:00.149 INFO:tasks.workunit.client.0.smithi049.stdout:0/40: dread f2 [0,4194304] 0 2024-06-03T00:03:00.149 INFO:tasks.workunit.client.0.smithi049.stdout:0/41: truncate f4 1041372 0 2024-06-03T00:03:00.150 INFO:tasks.workunit.client.0.smithi049.stdout:1/104: rename d1/d1a/l1c to d1/d1a/l28 0 2024-06-03T00:03:00.150 INFO:tasks.workunit.client.0.smithi049.stdout:1/105: chown d1/c10 339 1 2024-06-03T00:03:00.150 INFO:tasks.workunit.client.0.smithi049.stdout:1/106: chown d1/c10 205263680 1 2024-06-03T00:03:00.151 INFO:tasks.workunit.client.0.smithi049.stdout:4/84: symlink d4/l1e 0 2024-06-03T00:03:00.153 INFO:tasks.workunit.client.0.smithi049.stdout:3/40: mknod d2/cf 0 2024-06-03T00:03:00.153 INFO:tasks.workunit.client.0.smithi049.stdout:1/107: creat d1/db/f29 x:0 0 0 2024-06-03T00:03:00.155 INFO:tasks.workunit.client.0.smithi049.stdout:4/85: creat d4/d16/d1c/f1f x:0 0 0 2024-06-03T00:03:00.155 INFO:tasks.workunit.client.0.smithi049.stdout:0/42: read f2 [1002489,70941] 0 2024-06-03T00:03:00.157 INFO:tasks.workunit.client.0.smithi049.stdout:6/117: dwrite d2/d3/db/d28/f8 [4194304,4194304] 0 2024-06-03T00:03:00.157 INFO:tasks.workunit.client.0.smithi049.stdout:5/43: dwrite d3/d7/f8 [0,4194304] 0 2024-06-03T00:03:00.157 INFO:tasks.workunit.client.0.smithi049.stdout:5/44: readlink d3/lb 0 2024-06-03T00:03:00.157 INFO:tasks.workunit.client.0.smithi049.stdout:6/118: write d2/d3/d9/d23/f26 [226478,58180] 0 2024-06-03T00:03:00.157 INFO:tasks.workunit.client.0.smithi049.stdout:8/78: dwrite d4/fd [4194304,4194304] 0 2024-06-03T00:03:00.157 INFO:tasks.workunit.client.0.smithi049.stdout:8/79: readlink l3 0 2024-06-03T00:03:00.157 INFO:tasks.workunit.client.0.smithi049.stdout:8/80: stat d4/fd 0 2024-06-03T00:03:00.157 INFO:tasks.workunit.client.0.smithi049.stdout:3/41: link d2/d8/fb d2/f10 0 2024-06-03T00:03:00.158 INFO:tasks.workunit.client.0.smithi049.stdout:1/108: unlink d1/l1d 0 2024-06-03T00:03:00.158 INFO:tasks.workunit.client.0.smithi049.stdout:1/109: read - d1/db/d13/f27 zero size 2024-06-03T00:03:00.159 INFO:tasks.workunit.client.0.smithi049.stdout:4/86: symlink d4/d16/l20 0 2024-06-03T00:03:00.159 INFO:tasks.workunit.client.0.smithi049.stdout:4/87: stat d4/d10 0 2024-06-03T00:03:00.159 INFO:tasks.workunit.client.0.smithi049.stdout:0/43: mknod d6/cb 0 2024-06-03T00:03:00.161 INFO:tasks.workunit.client.0.smithi049.stdout:5/45: symlink d3/d5/l10 0 2024-06-03T00:03:00.161 INFO:tasks.workunit.client.0.smithi049.stdout:6/119: mkdir d2/d3/d9/d2a 0 2024-06-03T00:03:00.161 INFO:tasks.workunit.client.0.smithi049.stdout:7/47: dwrite d3/d8/f10 [0,4194304] 0 2024-06-03T00:03:00.163 INFO:tasks.workunit.client.0.smithi049.stdout:8/81: creat d4/d7/f16 x:0 0 0 2024-06-03T00:03:00.163 INFO:tasks.workunit.client.0.smithi049.stdout:8/82: write d4/d7/f11 [4769601,56098] 0 2024-06-03T00:03:00.164 INFO:tasks.workunit.client.0.smithi049.stdout:8/83: dread - d4/d7/f16 zero size 2024-06-03T00:03:00.164 INFO:tasks.workunit.client.0.smithi049.stdout:8/84: read d4/fd [1200379,73527] 0 2024-06-03T00:03:00.166 INFO:tasks.workunit.client.0.smithi049.stdout:3/42: unlink d2/f5 0 2024-06-03T00:03:00.166 INFO:tasks.workunit.client.0.smithi049.stdout:3/43: read - d2/d8/fb zero size 2024-06-03T00:03:00.166 INFO:tasks.workunit.client.0.smithi049.stdout:3/44: write d2/fd [201688,111381] 0 2024-06-03T00:03:00.166 INFO:tasks.workunit.client.0.smithi049.stdout:3/45: write d2/f4 [528970,105259] 0 2024-06-03T00:03:00.166 INFO:tasks.workunit.client.0.smithi049.stdout:3/46: truncate d2/f7 241459 0 2024-06-03T00:03:00.166 INFO:tasks.workunit.client.0.smithi049.stdout:3/47: stat d2/f10 0 2024-06-03T00:03:00.167 INFO:tasks.workunit.client.0.smithi049.stdout:1/110: mknod d1/db/d13/c2a 0 2024-06-03T00:03:00.168 INFO:tasks.workunit.client.0.smithi049.stdout:4/88: symlink d4/d10/d14/l21 0 2024-06-03T00:03:00.169 INFO:tasks.workunit.client.0.smithi049.stdout:0/44: rmdir d6 39 2024-06-03T00:03:00.171 INFO:tasks.workunit.client.0.smithi049.stdout:7/48: mknod d3/d8/c11 0 2024-06-03T00:03:00.172 INFO:tasks.workunit.client.0.smithi049.stdout:7/49: chown d3/d6/de 1515 1 2024-06-03T00:03:00.172 INFO:tasks.workunit.client.0.smithi049.stdout:6/120: write d2/d3/db/d28/f8 [2990618,9177] 0 2024-06-03T00:03:00.172 INFO:tasks.workunit.client.0.smithi049.stdout:8/85: getdents d4 0 2024-06-03T00:03:00.172 INFO:tasks.workunit.client.0.smithi049.stdout:8/86: chown d4/d7/f13 16 1 2024-06-03T00:03:00.173 INFO:tasks.workunit.client.0.smithi049.stdout:5/46: write d3/d7/f8 [3742752,54069] 0 2024-06-03T00:03:00.173 INFO:tasks.workunit.client.0.smithi049.stdout:5/47: write d3/f4 [373310,74231] 0 2024-06-03T00:03:00.174 INFO:tasks.workunit.client.0.smithi049.stdout:3/48: rename d2/f6 to d2/f11 0 2024-06-03T00:03:00.175 INFO:tasks.workunit.client.0.smithi049.stdout:1/111: creat d1/db/f2b x:0 0 0 2024-06-03T00:03:00.176 INFO:tasks.workunit.client.0.smithi049.stdout:4/89: symlink d4/d16/d1c/l22 0 2024-06-03T00:03:00.177 INFO:tasks.workunit.client.0.smithi049.stdout:4/90: dread - d4/d16/d1c/f1f zero size 2024-06-03T00:03:00.178 INFO:tasks.workunit.client.0.smithi049.stdout:0/45: creat d6/fc x:0 0 0 2024-06-03T00:03:00.180 INFO:tasks.workunit.client.0.smithi049.stdout:8/87: rename d4/fd to d4/f17 0 2024-06-03T00:03:00.181 INFO:tasks.workunit.client.0.smithi049.stdout:5/48: mkdir d3/d11 0 2024-06-03T00:03:00.181 INFO:tasks.workunit.client.0.smithi049.stdout:5/49: chown d3/d11 9016 1 2024-06-03T00:03:00.182 INFO:tasks.workunit.client.0.smithi049.stdout:7/50: read d3/d8/f10 [866161,84307] 0 2024-06-03T00:03:00.183 INFO:tasks.workunit.client.0.smithi049.stdout:6/121: read d2/d3/db/d28/f8 [4783589,30155] 0 2024-06-03T00:03:00.183 INFO:tasks.workunit.client.0.smithi049.stdout:3/49: creat d2/d8/f12 x:0 0 0 2024-06-03T00:03:00.185 INFO:tasks.workunit.client.0.smithi049.stdout:1/112: unlink d1/c10 0 2024-06-03T00:03:00.187 INFO:tasks.workunit.client.0.smithi049.stdout:0/46: creat d6/fd x:0 0 0 2024-06-03T00:03:00.188 INFO:tasks.workunit.client.0.smithi049.stdout:8/88: truncate d4/d7/fc 2475089 0 2024-06-03T00:03:00.189 INFO:tasks.workunit.client.0.smithi049.stdout:7/51: creat d3/d6/f12 x:0 0 0 2024-06-03T00:03:00.190 INFO:tasks.workunit.client.0.smithi049.stdout:5/50: dread d3/d7/f8 [0,4194304] 0 2024-06-03T00:03:00.190 INFO:tasks.workunit.client.0.smithi049.stdout:6/122: mknod d2/d3/db/d28/c2b 0 2024-06-03T00:03:00.190 INFO:tasks.workunit.client.0.smithi049.stdout:5/51: write d3/d7/f8 [433901,124394] 0 2024-06-03T00:03:00.190 INFO:tasks.workunit.client.0.smithi049.stdout:5/52: rename d3 to d3/d9/d12 22 2024-06-03T00:03:00.191 INFO:tasks.workunit.client.0.smithi049.stdout:1/113: mkdir d1/db/d2c 0 2024-06-03T00:03:00.192 INFO:tasks.workunit.client.0.smithi049.stdout:2/52: truncate f1 2257681 0 2024-06-03T00:03:00.193 INFO:tasks.workunit.client.0.smithi049.stdout:4/91: dwrite d4/d16/d1c/f1f [0,4194304] 0 2024-06-03T00:03:00.193 INFO:tasks.workunit.client.0.smithi049.stdout:4/92: read d4/fd [135497,129693] 0 2024-06-03T00:03:00.193 INFO:tasks.workunit.client.0.smithi049.stdout:0/47: symlink d6/le 0 2024-06-03T00:03:00.195 INFO:tasks.workunit.client.0.smithi049.stdout:7/52: truncate d3/d8/ff 1258876 0 2024-06-03T00:03:00.197 INFO:tasks.workunit.client.0.smithi049.stdout:6/123: rename d2/d3/db/l22 to d2/d3/db/d28/l2c 0 2024-06-03T00:03:00.199 INFO:tasks.workunit.client.0.smithi049.stdout:3/50: dread d2/fd [0,4194304] 0 2024-06-03T00:03:00.199 INFO:tasks.workunit.client.0.smithi049.stdout:5/53: link d3/d7/f8 d3/d9/f13 0 2024-06-03T00:03:00.199 INFO:tasks.workunit.client.0.smithi049.stdout:5/54: chown d3/d5/da 956145639 1 2024-06-03T00:03:00.200 INFO:tasks.workunit.client.0.smithi049.stdout:1/114: creat d1/f2d x:0 0 0 2024-06-03T00:03:00.200 INFO:tasks.workunit.client.0.smithi049.stdout:1/115: chown d1/l17 1 1 2024-06-03T00:03:00.203 INFO:tasks.workunit.client.0.smithi049.stdout:4/93: fsync f2 0 2024-06-03T00:03:00.203 INFO:tasks.workunit.client.0.smithi049.stdout:4/94: read - d4/d10/d14/d15/f18 zero size 2024-06-03T00:03:00.203 INFO:tasks.workunit.client.0.smithi049.stdout:4/95: stat d4/ff 0 2024-06-03T00:03:00.204 INFO:tasks.workunit.client.0.smithi049.stdout:0/48: symlink d6/lf 0 2024-06-03T00:03:00.206 INFO:tasks.workunit.client.0.smithi049.stdout:7/53: getdents d3 0 2024-06-03T00:03:00.207 INFO:tasks.workunit.client.0.smithi049.stdout:8/89: dwrite d4/f15 [0,4194304] 0 2024-06-03T00:03:00.208 INFO:tasks.workunit.client.0.smithi049.stdout:6/124: creat d2/d3/d9/d23/d29/f2d x:0 0 0 2024-06-03T00:03:00.209 INFO:tasks.workunit.client.0.smithi049.stdout:3/51: creat d2/f13 x:0 0 0 2024-06-03T00:03:00.212 INFO:tasks.workunit.client.0.smithi049.stdout:1/116: symlink d1/db/d13/l2e 0 2024-06-03T00:03:00.214 INFO:tasks.workunit.client.0.smithi049.stdout:0/49: link d6/c7 d6/c10 0 2024-06-03T00:03:00.215 INFO:tasks.workunit.client.0.smithi049.stdout:3/52: dread d2/f4 [0,4194304] 0 2024-06-03T00:03:00.217 INFO:tasks.workunit.client.0.smithi049.stdout:6/125: rmdir d2 39 2024-06-03T00:03:00.218 INFO:tasks.workunit.client.0.smithi049.stdout:6/126: truncate d2/d3/d9/d23/d29/f2d 716223 0 2024-06-03T00:03:00.218 INFO:tasks.workunit.client.0.smithi049.stdout:9/133: sync 2024-06-03T00:03:00.220 INFO:tasks.workunit.client.0.smithi049.stdout:1/117: mkdir d1/d2f 0 2024-06-03T00:03:00.220 INFO:tasks.workunit.client.0.smithi049.stdout:1/118: write d1/f7 [2393192,109574] 0 2024-06-03T00:03:00.220 INFO:tasks.workunit.client.0.smithi049.stdout:1/119: chown d1/d2f 121159 1 2024-06-03T00:03:00.221 INFO:tasks.workunit.client.0.smithi049.stdout:0/50: rmdir d6 39 2024-06-03T00:03:00.221 INFO:tasks.workunit.client.0.smithi049.stdout:0/51: truncate d6/fd 558879 0 2024-06-03T00:03:00.221 INFO:tasks.workunit.client.0.smithi049.stdout:4/96: dwrite d4/ff [0,4194304] 0 2024-06-03T00:03:00.223 INFO:tasks.workunit.client.0.smithi049.stdout:3/53: mkdir d2/d14 0 2024-06-03T00:03:00.224 INFO:tasks.workunit.client.0.smithi049.stdout:6/127: symlink d2/d3/db/d28/l2e 0 2024-06-03T00:03:00.225 INFO:tasks.workunit.client.0.smithi049.stdout:9/134: truncate d1/d5/d1a/f1e 3347208 0 2024-06-03T00:03:00.226 INFO:tasks.workunit.client.0.smithi049.stdout:5/55: rename d3/d7 to d3/d11/d14 0 2024-06-03T00:03:00.227 INFO:tasks.workunit.client.0.smithi049.stdout:1/120: creat d1/d1a/f30 x:0 0 0 2024-06-03T00:03:00.227 INFO:tasks.workunit.client.0.smithi049.stdout:1/121: truncate d1/db/f2b 772161 0 2024-06-03T00:03:00.227 INFO:tasks.workunit.client.0.smithi049.stdout:1/122: write d1/d1a/f25 [475385,81240] 0 2024-06-03T00:03:00.229 INFO:tasks.workunit.client.0.smithi049.stdout:0/52: unlink d6/fd 0 2024-06-03T00:03:00.229 INFO:tasks.workunit.client.0.smithi049.stdout:0/53: write f2 [3990393,52511] 0 2024-06-03T00:03:00.229 INFO:tasks.workunit.client.0.smithi049.stdout:0/54: fdatasync f1 0 2024-06-03T00:03:00.230 INFO:tasks.workunit.client.0.smithi049.stdout:8/90: dwrite d4/d7/f13 [0,4194304] 0 2024-06-03T00:03:00.230 INFO:tasks.workunit.client.0.smithi049.stdout:8/91: write d4/f17 [699872,78617] 0 2024-06-03T00:03:00.230 INFO:tasks.workunit.client.0.smithi049.stdout:3/54: getdents d2/d8 0 2024-06-03T00:03:00.231 INFO:tasks.workunit.client.0.smithi049.stdout:2/53: dread f1 [0,4194304] 0 2024-06-03T00:03:00.231 INFO:tasks.workunit.client.0.smithi049.stdout:6/128: mkdir d2/d2f 0 2024-06-03T00:03:00.233 INFO:tasks.workunit.client.0.smithi049.stdout:9/135: rename d1/d5/c20 to d1/d5/d13/c22 0 2024-06-03T00:03:00.233 INFO:tasks.workunit.client.0.smithi049.stdout:9/136: rename d1 to d1/da/d23 22 2024-06-03T00:03:00.233 INFO:tasks.workunit.client.0.smithi049.stdout:7/54: dwrite d3/d8/ff [0,4194304] 0 2024-06-03T00:03:00.233 INFO:tasks.workunit.client.0.smithi049.stdout:5/56: creat d3/d5/da/f15 x:0 0 0 2024-06-03T00:03:00.235 INFO:tasks.workunit.client.0.smithi049.stdout:1/123: symlink d1/db/d13/l31 0 2024-06-03T00:03:00.239 INFO:tasks.workunit.client.0.smithi049.stdout:8/92: creat d4/d7/f18 x:0 0 0 2024-06-03T00:03:00.240 INFO:tasks.workunit.client.0.smithi049.stdout:3/55: link d2/fe d2/f15 0 2024-06-03T00:03:00.241 INFO:tasks.workunit.client.0.smithi049.stdout:2/54: stat c8 0 2024-06-03T00:03:00.244 INFO:tasks.workunit.client.0.smithi049.stdout:6/129: rename d2/d3/db to d2/d3/d9/d23/d29/d30 0 2024-06-03T00:03:00.249 INFO:tasks.workunit.client.0.smithi049.stdout:1/124: unlink d1/f4 0 2024-06-03T00:03:00.249 INFO:tasks.workunit.client.0.smithi049.stdout:5/57: dread f1 [0,4194304] 0 2024-06-03T00:03:00.250 INFO:tasks.workunit.client.0.smithi049.stdout:0/55: getdents d6 0 2024-06-03T00:03:00.251 INFO:tasks.workunit.client.0.smithi049.stdout:8/93: mknod d4/d7/c19 0 2024-06-03T00:03:00.251 INFO:tasks.workunit.client.0.smithi049.stdout:8/94: chown d4/d7/f10 343462 1 2024-06-03T00:03:00.252 INFO:tasks.workunit.client.0.smithi049.stdout:4/97: dwrite d4/fc [0,4194304] 0 2024-06-03T00:03:00.253 INFO:tasks.workunit.client.0.smithi049.stdout:3/56: unlink d2/d8/fb 0 2024-06-03T00:03:00.253 INFO:tasks.workunit.client.0.smithi049.stdout:1/125: write d1/db/f14 [494567,79690] 0 2024-06-03T00:03:00.255 INFO:tasks.workunit.client.0.smithi049.stdout:3/57: dread d2/f7 [0,4194304] 0 2024-06-03T00:03:00.255 INFO:tasks.workunit.client.0.smithi049.stdout:3/58: dread - d2/d8/f12 zero size 2024-06-03T00:03:00.255 INFO:tasks.workunit.client.0.smithi049.stdout:3/59: dread - d2/f13 zero size 2024-06-03T00:03:00.255 INFO:tasks.workunit.client.0.smithi049.stdout:2/55: mkdir da/dd/df 0 2024-06-03T00:03:00.257 INFO:tasks.workunit.client.0.smithi049.stdout:5/58: rmdir d3/d5 39 2024-06-03T00:03:00.257 INFO:tasks.workunit.client.0.smithi049.stdout:5/59: dread - d3/d5/fd zero size 2024-06-03T00:03:00.257 INFO:tasks.workunit.client.0.smithi049.stdout:5/60: truncate d3/d5/fd 1018287 0 2024-06-03T00:03:00.259 INFO:tasks.workunit.client.0.smithi049.stdout:8/95: link d4/f15 d4/d7/f1a 0 2024-06-03T00:03:00.259 INFO:tasks.workunit.client.0.smithi049.stdout:8/96: stat d4/d7/cb 0 2024-06-03T00:03:00.260 INFO:tasks.workunit.client.0.smithi049.stdout:4/98: creat d4/f23 x:0 0 0 2024-06-03T00:03:00.261 INFO:tasks.workunit.client.0.smithi049.stdout:1/126: mknod d1/c32 0 2024-06-03T00:03:00.262 INFO:tasks.workunit.client.0.smithi049.stdout:3/60: mknod d2/d14/c16 0 2024-06-03T00:03:00.263 INFO:tasks.workunit.client.0.smithi049.stdout:5/61: mkdir d3/d11/d14/d16 0 2024-06-03T00:03:00.265 INFO:tasks.workunit.client.0.smithi049.stdout:8/97: creat d4/d7/f1b x:0 0 0 2024-06-03T00:03:00.267 INFO:tasks.workunit.client.0.smithi049.stdout:1/127: creat d1/db/f33 x:0 0 0 2024-06-03T00:03:00.269 INFO:tasks.workunit.client.0.smithi049.stdout:3/61: symlink d2/d14/l17 0 2024-06-03T00:03:00.269 INFO:tasks.workunit.client.0.smithi049.stdout:3/62: read - d2/d8/f12 zero size 2024-06-03T00:03:00.270 INFO:tasks.workunit.client.0.smithi049.stdout:8/98: mknod d4/d7/c1c 0 2024-06-03T00:03:00.270 INFO:tasks.workunit.client.0.smithi049.stdout:8/99: dread - d4/d7/f16 zero size 2024-06-03T00:03:00.271 INFO:tasks.workunit.client.0.smithi049.stdout:1/128: mkdir d1/db/d13/d34 0 2024-06-03T00:03:00.272 INFO:tasks.workunit.client.0.smithi049.stdout:3/63: symlink d2/d8/l18 0 2024-06-03T00:03:00.272 INFO:tasks.workunit.client.0.smithi049.stdout:3/64: write d2/f7 [1197647,51372] 0 2024-06-03T00:03:00.272 INFO:tasks.workunit.client.0.smithi049.stdout:3/65: chown d2/d8/fa 8166552 1 2024-06-03T00:03:00.274 INFO:tasks.workunit.client.0.smithi049.stdout:1/129: creat d1/db/f35 x:0 0 0 2024-06-03T00:03:00.274 INFO:tasks.workunit.client.0.smithi049.stdout:1/130: readlink d1/db/l26 0 2024-06-03T00:03:00.277 INFO:tasks.workunit.client.0.smithi049.stdout:0/56: dwrite f1 [0,4194304] 0 2024-06-03T00:03:00.277 INFO:tasks.workunit.client.0.smithi049.stdout:0/57: stat d6/fa 0 2024-06-03T00:03:00.277 INFO:tasks.workunit.client.0.smithi049.stdout:0/58: chown f1 6 1 2024-06-03T00:03:00.277 INFO:tasks.workunit.client.0.smithi049.stdout:0/59: write d6/fa [1000187,84125] 0 2024-06-03T00:03:00.277 INFO:tasks.workunit.client.0.smithi049.stdout:3/66: rename d2/d14/c16 to d2/d14/c19 0 2024-06-03T00:03:00.278 INFO:tasks.workunit.client.0.smithi049.stdout:3/67: read - d2/f11 zero size 2024-06-03T00:03:00.282 INFO:tasks.workunit.client.0.smithi049.stdout:7/55: dwrite d3/fc [0,4194304] 0 2024-06-03T00:03:00.282 INFO:tasks.workunit.client.0.smithi049.stdout:7/56: readlink d3/d6/d9/lb 0 2024-06-03T00:03:00.283 INFO:tasks.workunit.client.0.smithi049.stdout:1/131: dread d1/db/f1b [0,4194304] 0 2024-06-03T00:03:00.288 INFO:tasks.workunit.client.0.smithi049.stdout:0/60: unlink d6/fa 0 2024-06-03T00:03:00.288 INFO:tasks.workunit.client.0.smithi049.stdout:0/61: chown f4 1317614 1 2024-06-03T00:03:00.289 INFO:tasks.workunit.client.0.smithi049.stdout:0/62: dread f4 [0,4194304] 0 2024-06-03T00:03:00.294 INFO:tasks.workunit.client.0.smithi049.stdout:9/137: dwrite d1/d5/d1a/f1e [0,4194304] 0 2024-06-03T00:03:00.294 INFO:tasks.workunit.client.0.smithi049.stdout:9/138: chown d1/f15 14 1 2024-06-03T00:03:00.294 INFO:tasks.workunit.client.0.smithi049.stdout:8/100: getdents d4/d7 0 2024-06-03T00:03:00.296 INFO:tasks.workunit.client.0.smithi049.stdout:6/130: dwrite d2/d3/d9/d23/f26 [0,4194304] 0 2024-06-03T00:03:00.297 INFO:tasks.workunit.client.0.smithi049.stdout:2/56: dwrite f9 [0,4194304] 0 2024-06-03T00:03:00.297 INFO:tasks.workunit.client.0.smithi049.stdout:2/57: chown da/fb 37659099 1 2024-06-03T00:03:00.297 INFO:tasks.workunit.client.0.smithi049.stdout:4/99: dwrite d4/f23 [0,4194304] 0 2024-06-03T00:03:00.297 INFO:tasks.workunit.client.0.smithi049.stdout:4/100: fdatasync f2 0 2024-06-03T00:03:00.300 INFO:tasks.workunit.client.0.smithi049.stdout:4/101: dread f2 [0,4194304] 0 2024-06-03T00:03:00.302 INFO:tasks.workunit.client.0.smithi049.stdout:1/132: dwrite d1/db/f2b [0,4194304] 0 2024-06-03T00:03:00.305 INFO:tasks.workunit.client.0.smithi049.stdout:2/58: dread f4 [0,4194304] 0 2024-06-03T00:03:00.310 INFO:tasks.workunit.client.0.smithi049.stdout:3/68: mkdir d2/d1a 0 2024-06-03T00:03:00.314 INFO:tasks.workunit.client.0.smithi049.stdout:0/63: mknod d6/c11 0 2024-06-03T00:03:00.314 INFO:tasks.workunit.client.0.smithi049.stdout:0/64: write f2 [1978872,110919] 0 2024-06-03T00:03:00.314 INFO:tasks.workunit.client.0.smithi049.stdout:9/139: dwrite d1/f8 [0,4194304] 0 2024-06-03T00:03:00.314 INFO:tasks.workunit.client.0.smithi049.stdout:6/131: link d2/d3/d9/d23/f1a d2/d3/d9/d23/d29/d30/d28/f31 0 2024-06-03T00:03:00.318 INFO:tasks.workunit.client.0.smithi049.stdout:1/133: dread - d1/db/d13/f27 zero size 2024-06-03T00:03:00.320 INFO:tasks.workunit.client.0.smithi049.stdout:2/59: link f6 da/dd/df/f10 0 2024-06-03T00:03:00.321 INFO:tasks.workunit.client.0.smithi049.stdout:7/57: rename d3/d6/de to d3/d6/d13 0 2024-06-03T00:03:00.323 INFO:tasks.workunit.client.0.smithi049.stdout:3/69: creat d2/d1a/f1b x:0 0 0 2024-06-03T00:03:00.324 INFO:tasks.workunit.client.0.smithi049.stdout:0/65: creat d6/f12 x:0 0 0 2024-06-03T00:03:00.325 INFO:tasks.workunit.client.0.smithi049.stdout:8/101: mkdir d4/d1d 0 2024-06-03T00:03:00.327 INFO:tasks.workunit.client.0.smithi049.stdout:4/102: dwrite d4/f23 [0,4194304] 0 2024-06-03T00:03:00.327 INFO:tasks.workunit.client.0.smithi049.stdout:9/140: rename d1/d5/f12 to d1/d5/f24 0 2024-06-03T00:03:00.328 INFO:tasks.workunit.client.0.smithi049.stdout:6/132: creat d2/d3/d9/d23/d29/f32 x:0 0 0 2024-06-03T00:03:00.329 INFO:tasks.workunit.client.0.smithi049.stdout:1/134: truncate d1/db/f2b 5022368 0 2024-06-03T00:03:00.332 INFO:tasks.workunit.client.0.smithi049.stdout:2/60: write da/dd/df/f10 [894323,77098] 0 2024-06-03T00:03:00.332 INFO:tasks.workunit.client.0.smithi049.stdout:2/61: truncate da/dd/df/f10 4989743 0 2024-06-03T00:03:00.337 INFO:tasks.workunit.client.0.smithi049.stdout:7/58: mkdir d3/d14 0 2024-06-03T00:03:00.337 INFO:tasks.workunit.client.0.smithi049.stdout:9/141: dread d1/d5/d1a/f1e [0,4194304] 0 2024-06-03T00:03:00.337 INFO:tasks.workunit.client.0.smithi049.stdout:6/133: getdents d2/d3/d9/d23/d29/d30/d28 0 2024-06-03T00:03:00.338 INFO:tasks.workunit.client.0.smithi049.stdout:1/135: write d1/db/f29 [757189,69839] 0 2024-06-03T00:03:00.338 INFO:tasks.workunit.client.0.smithi049.stdout:1/136: fsync d1/f3 0 2024-06-03T00:03:00.343 INFO:tasks.workunit.client.0.smithi049.stdout:2/62: rmdir da 39 2024-06-03T00:03:00.343 INFO:tasks.workunit.client.0.smithi049.stdout:2/63: chown da/cc 270527 1 2024-06-03T00:03:00.344 INFO:tasks.workunit.client.0.smithi049.stdout:7/59: creat d3/d6/f15 x:0 0 0 2024-06-03T00:03:00.345 INFO:tasks.workunit.client.0.smithi049.stdout:7/60: readlink d3/ld 0 2024-06-03T00:03:00.346 INFO:tasks.workunit.client.0.smithi049.stdout:9/142: creat d1/d5/d13/f25 x:0 0 0 2024-06-03T00:03:00.350 INFO:tasks.workunit.client.0.smithi049.stdout:2/64: link c8 da/dd/c11 0 2024-06-03T00:03:00.350 INFO:tasks.workunit.client.0.smithi049.stdout:8/102: dwrite d4/d7/f1a [4194304,4194304] 0 2024-06-03T00:03:00.351 INFO:tasks.workunit.client.0.smithi049.stdout:4/103: dwrite d4/fd [0,4194304] 0 2024-06-03T00:03:00.352 INFO:tasks.workunit.client.0.smithi049.stdout:1/137: getdents d1/db 0 2024-06-03T00:03:00.353 INFO:tasks.workunit.client.0.smithi049.stdout:2/65: mknod da/dd/c12 0 2024-06-03T00:03:00.356 INFO:tasks.workunit.client.0.smithi049.stdout:7/61: read d3/fc [580307,122914] 0 2024-06-03T00:03:00.356 INFO:tasks.workunit.client.0.smithi049.stdout:8/103: creat d4/d7/f1e x:0 0 0 2024-06-03T00:03:00.356 INFO:tasks.workunit.client.0.smithi049.stdout:7/62: write d3/d6/f12 [503618,126841] 0 2024-06-03T00:03:00.358 INFO:tasks.workunit.client.0.smithi049.stdout:4/104: mkdir d4/d16/d1c/d24 0 2024-06-03T00:03:00.358 INFO:tasks.workunit.client.0.smithi049.stdout:4/105: readlink d4/d16/d1c/l22 0 2024-06-03T00:03:00.358 INFO:tasks.workunit.client.0.smithi049.stdout:1/138: mkdir d1/d2f/d36 0 2024-06-03T00:03:00.358 INFO:tasks.workunit.client.0.smithi049.stdout:2/66: write f1 [1975477,95675] 0 2024-06-03T00:03:00.360 INFO:tasks.workunit.client.0.smithi049.stdout:7/63: rmdir d3/d6 39 2024-06-03T00:03:00.361 INFO:tasks.workunit.client.0.smithi049.stdout:9/143: write d1/f15 [3337417,81755] 0 2024-06-03T00:03:00.361 INFO:tasks.workunit.client.0.smithi049.stdout:9/144: read - d1/d5/f24 zero size 2024-06-03T00:03:00.362 INFO:tasks.workunit.client.0.smithi049.stdout:7/64: mknod d3/d6/d9/c16 0 2024-06-03T00:03:00.364 INFO:tasks.workunit.client.0.smithi049.stdout:7/65: mkdir d3/d8/d17 0 2024-06-03T00:03:00.366 INFO:tasks.workunit.client.0.smithi049.stdout:7/66: unlink d3/d8/ff 0 2024-06-03T00:03:00.366 INFO:tasks.workunit.client.0.smithi049.stdout:7/67: stat d3/fc 0 2024-06-03T00:03:00.368 INFO:tasks.workunit.client.0.smithi049.stdout:1/139: write d1/db/f16 [4324642,29440] 0 2024-06-03T00:03:00.368 INFO:tasks.workunit.client.0.smithi049.stdout:1/140: chown d1/db/ld 50 1 2024-06-03T00:03:00.368 INFO:tasks.workunit.client.0.smithi049.stdout:1/141: chown d1/db/l21 110851068 1 2024-06-03T00:03:00.368 INFO:tasks.workunit.client.0.smithi049.stdout:9/145: dread d1/d5/d13/f16 [0,4194304] 0 2024-06-03T00:03:00.368 INFO:tasks.workunit.client.0.smithi049.stdout:2/67: dread f6 [0,4194304] 0 2024-06-03T00:03:00.369 INFO:tasks.workunit.client.0.smithi049.stdout:4/106: dread d4/fd [0,4194304] 0 2024-06-03T00:03:00.369 INFO:tasks.workunit.client.0.smithi049.stdout:4/107: chown d4/d10/d14/d15/c1a 1641 1 2024-06-03T00:03:00.370 INFO:tasks.workunit.client.0.smithi049.stdout:4/108: creat d4/d16/d1c/f25 x:0 0 0 2024-06-03T00:03:00.371 INFO:tasks.workunit.client.0.smithi049.stdout:5/62: sync 2024-06-03T00:03:00.371 INFO:tasks.workunit.client.0.smithi049.stdout:4/109: creat d4/d16/d1c/f26 x:0 0 0 2024-06-03T00:03:00.373 INFO:tasks.workunit.client.0.smithi049.stdout:5/63: mknod d3/d5/da/c17 0 2024-06-03T00:03:00.374 INFO:tasks.workunit.client.0.smithi049.stdout:5/64: creat d3/d11/f18 x:0 0 0 2024-06-03T00:03:00.382 INFO:tasks.workunit.client.0.smithi049.stdout:8/104: dwrite d4/d7/fc [0,4194304] 0 2024-06-03T00:03:00.385 INFO:tasks.workunit.client.0.smithi049.stdout:8/105: rename d4/d1d to d4/d1f 0 2024-06-03T00:03:00.386 INFO:tasks.workunit.client.0.smithi049.stdout:4/110: write d4/d16/d1c/f1f [2182445,62002] 0 2024-06-03T00:03:00.387 INFO:tasks.workunit.client.0.smithi049.stdout:4/111: readlink d4/l1e 0 2024-06-03T00:03:00.387 INFO:tasks.workunit.client.0.smithi049.stdout:8/106: symlink d4/d7/l20 0 2024-06-03T00:03:00.395 INFO:tasks.workunit.client.0.smithi049.stdout:8/107: write d4/f15 [7549813,75752] 0 2024-06-03T00:03:00.395 INFO:tasks.workunit.client.0.smithi049.stdout:8/108: chown d4/d7/c1c 1017640544 1 2024-06-03T00:03:00.398 INFO:tasks.workunit.client.0.smithi049.stdout:8/109: mkdir d4/d7/d21 0 2024-06-03T00:03:00.398 INFO:tasks.workunit.client.0.smithi049.stdout:4/112: write d4/f23 [3863587,105855] 0 2024-06-03T00:03:00.398 INFO:tasks.workunit.client.0.smithi049.stdout:4/113: chown d4/d10/d14/d15/f18 41986 1 2024-06-03T00:03:00.399 INFO:tasks.workunit.client.0.smithi049.stdout:1/142: dwrite d1/db/f29 [0,4194304] 0 2024-06-03T00:03:00.402 INFO:tasks.workunit.client.0.smithi049.stdout:1/143: rename d1/db to d1/d2f/d36/d37 0 2024-06-03T00:03:00.402 INFO:tasks.workunit.client.0.smithi049.stdout:1/144: chown d1/d2f/d36/d37/d13/d34 28 1 2024-06-03T00:03:00.403 INFO:tasks.workunit.client.0.smithi049.stdout:1/145: mknod d1/d2f/c38 0 2024-06-03T00:03:00.404 INFO:tasks.workunit.client.0.smithi049.stdout:9/146: dwrite d1/d5/d13/f25 [0,4194304] 0 2024-06-03T00:03:00.404 INFO:tasks.workunit.client.0.smithi049.stdout:9/147: chown d1/d5/d13/c1b 71024 1 2024-06-03T00:03:00.405 INFO:tasks.workunit.client.0.smithi049.stdout:1/146: symlink d1/d2f/d36/d37/d2c/l39 0 2024-06-03T00:03:00.407 INFO:tasks.workunit.client.0.smithi049.stdout:9/148: getdents d1/d5/d1a 0 2024-06-03T00:03:00.410 INFO:tasks.workunit.client.0.smithi049.stdout:9/149: mkdir d1/da/d26 0 2024-06-03T00:03:00.411 INFO:tasks.workunit.client.0.smithi049.stdout:9/150: mkdir d1/da/d27 0 2024-06-03T00:03:00.413 INFO:tasks.workunit.client.0.smithi049.stdout:9/151: mknod d1/da/c28 0 2024-06-03T00:03:00.418 INFO:tasks.workunit.client.0.smithi049.stdout:2/68: dwrite f6 [0,4194304] 0 2024-06-03T00:03:00.419 INFO:tasks.workunit.client.0.smithi049.stdout:5/65: dwrite d3/d9/f13 [0,4194304] 0 2024-06-03T00:03:00.419 INFO:tasks.workunit.client.0.smithi049.stdout:5/66: write d3/d11/f18 [396557,74568] 0 2024-06-03T00:03:00.419 INFO:tasks.workunit.client.0.smithi049.stdout:5/67: readlink d3/d9/lf 0 2024-06-03T00:03:00.419 INFO:tasks.workunit.client.0.smithi049.stdout:7/68: dwrite d3/fc [0,4194304] 0 2024-06-03T00:03:00.420 INFO:tasks.workunit.client.0.smithi049.stdout:2/69: creat da/dd/f13 x:0 0 0 2024-06-03T00:03:00.420 INFO:tasks.workunit.client.0.smithi049.stdout:5/68: creat d3/d11/d14/f19 x:0 0 0 2024-06-03T00:03:00.420 INFO:tasks.workunit.client.0.smithi049.stdout:5/69: chown d3 3119 1 2024-06-03T00:03:00.421 INFO:tasks.workunit.client.0.smithi049.stdout:2/70: symlink da/dd/df/l14 0 2024-06-03T00:03:00.422 INFO:tasks.workunit.client.0.smithi049.stdout:5/70: truncate f1 3767762 0 2024-06-03T00:03:00.423 INFO:tasks.workunit.client.0.smithi049.stdout:5/71: mknod d3/d11/d14/d16/c1a 0 2024-06-03T00:03:00.425 INFO:tasks.workunit.client.0.smithi049.stdout:2/71: dread f6 [4194304,4194304] 0 2024-06-03T00:03:00.425 INFO:tasks.workunit.client.0.smithi049.stdout:5/72: rename d3/f4 to d3/d5/da/f1b 0 2024-06-03T00:03:00.426 INFO:tasks.workunit.client.0.smithi049.stdout:2/72: creat da/f15 x:0 0 0 2024-06-03T00:03:00.427 INFO:tasks.workunit.client.0.smithi049.stdout:2/73: truncate f9 2176802 0 2024-06-03T00:03:00.432 INFO:tasks.workunit.client.0.smithi049.stdout:4/114: dwrite f2 [4194304,4194304] 0 2024-06-03T00:03:00.435 INFO:tasks.workunit.client.0.smithi049.stdout:4/115: mknod d4/d10/c27 0 2024-06-03T00:03:00.435 INFO:tasks.workunit.client.0.smithi049.stdout:4/116: dread - d4/d10/d14/d15/f18 zero size 2024-06-03T00:03:00.436 INFO:tasks.workunit.client.0.smithi049.stdout:5/73: write d3/d11/d14/f8 [2512128,49483] 0 2024-06-03T00:03:00.436 INFO:tasks.workunit.client.0.smithi049.stdout:8/110: dwrite d4/d7/f11 [0,4194304] 0 2024-06-03T00:03:00.436 INFO:tasks.workunit.client.0.smithi049.stdout:8/111: read - d4/d7/f16 zero size 2024-06-03T00:03:00.437 INFO:tasks.workunit.client.0.smithi049.stdout:5/74: creat d3/d11/d14/f1c x:0 0 0 2024-06-03T00:03:00.439 INFO:tasks.workunit.client.0.smithi049.stdout:5/75: dread d3/d5/fd [0,4194304] 0 2024-06-03T00:03:00.439 INFO:tasks.workunit.client.0.smithi049.stdout:5/76: write d3/d11/d14/f1c [861313,108337] 0 2024-06-03T00:03:00.439 INFO:tasks.workunit.client.0.smithi049.stdout:7/69: truncate d3/fc 2457942 0 2024-06-03T00:03:00.440 INFO:tasks.workunit.client.0.smithi049.stdout:5/77: link f1 d3/d5/da/f1d 0 2024-06-03T00:03:00.441 INFO:tasks.workunit.client.0.smithi049.stdout:5/78: creat d3/d9/f1e x:0 0 0 2024-06-03T00:03:00.442 INFO:tasks.workunit.client.0.smithi049.stdout:5/79: fsync d3/d5/fd 0 2024-06-03T00:03:00.442 INFO:tasks.workunit.client.0.smithi049.stdout:7/70: symlink d3/d6/l18 0 2024-06-03T00:03:00.443 INFO:tasks.workunit.client.0.smithi049.stdout:5/80: mknod d3/d11/d14/c1f 0 2024-06-03T00:03:00.443 INFO:tasks.workunit.client.0.smithi049.stdout:9/152: dwrite d1/f15 [0,4194304] 0 2024-06-03T00:03:00.443 INFO:tasks.workunit.client.0.smithi049.stdout:1/147: dwrite d1/d2f/d36/d37/f33 [0,4194304] 0 2024-06-03T00:03:00.443 INFO:tasks.workunit.client.0.smithi049.stdout:1/148: readlink d1/l9 0 2024-06-03T00:03:00.444 INFO:tasks.workunit.client.0.smithi049.stdout:5/81: write d3/d11/f18 [46683,99618] 0 2024-06-03T00:03:00.444 INFO:tasks.workunit.client.0.smithi049.stdout:7/71: link d3/d6/d9/lb d3/d14/l19 0 2024-06-03T00:03:00.445 INFO:tasks.workunit.client.0.smithi049.stdout:1/149: dread d1/f3 [0,4194304] 0 2024-06-03T00:03:00.452 INFO:tasks.workunit.client.0.smithi049.stdout:9/153: dread d1/fb [0,4194304] 0 2024-06-03T00:03:00.452 INFO:tasks.workunit.client.0.smithi049.stdout:4/117: truncate f2 4638686 0 2024-06-03T00:03:00.452 INFO:tasks.workunit.client.0.smithi049.stdout:4/118: fdatasync d4/fa 0 2024-06-03T00:03:00.452 INFO:tasks.workunit.client.0.smithi049.stdout:4/119: stat d4/f23 0 2024-06-03T00:03:00.456 INFO:tasks.workunit.client.0.smithi049.stdout:4/120: dread d4/fd [0,4194304] 0 2024-06-03T00:03:00.456 INFO:tasks.workunit.client.0.smithi049.stdout:8/112: truncate d4/f15 6712417 0 2024-06-03T00:03:00.456 INFO:tasks.workunit.client.0.smithi049.stdout:8/113: dread - d4/d7/f16 zero size 2024-06-03T00:03:00.456 INFO:tasks.workunit.client.0.smithi049.stdout:8/114: dread - d4/d7/f18 zero size 2024-06-03T00:03:00.461 INFO:tasks.workunit.client.0.smithi049.stdout:5/82: mkdir d3/d9/d20 0 2024-06-03T00:03:00.461 INFO:tasks.workunit.client.0.smithi049.stdout:5/83: chown d3/d11/d14/ce 780922 1 2024-06-03T00:03:00.462 INFO:tasks.workunit.client.0.smithi049.stdout:5/84: write d3/d9/f13 [562443,45325] 0 2024-06-03T00:03:00.462 INFO:tasks.workunit.client.0.smithi049.stdout:5/85: write d3/d11/d14/f1c [79372,44805] 0 2024-06-03T00:03:00.462 INFO:tasks.workunit.client.0.smithi049.stdout:5/86: dread - d3/d9/f1e zero size 2024-06-03T00:03:00.463 INFO:tasks.workunit.client.0.smithi049.stdout:7/72: stat d3/d6/d9/lb 0 2024-06-03T00:03:00.463 INFO:tasks.workunit.client.0.smithi049.stdout:7/73: fdatasync d3/fc 0 2024-06-03T00:03:00.463 INFO:tasks.workunit.client.0.smithi049.stdout:7/74: stat d3/d6/f15 0 2024-06-03T00:03:00.466 INFO:tasks.workunit.client.0.smithi049.stdout:1/150: creat d1/f3a x:0 0 0 2024-06-03T00:03:00.466 INFO:tasks.workunit.client.0.smithi049.stdout:9/154: mknod d1/da/d27/c29 0 2024-06-03T00:03:00.466 INFO:tasks.workunit.client.0.smithi049.stdout:7/75: mknod d3/d8/d17/c1a 0 2024-06-03T00:03:00.468 INFO:tasks.workunit.client.0.smithi049.stdout:4/121: write d4/fa [2261699,109004] 0 2024-06-03T00:03:00.468 INFO:tasks.workunit.client.0.smithi049.stdout:1/151: creat d1/d2f/d36/d37/d13/d34/f3b x:0 0 0 2024-06-03T00:03:00.470 INFO:tasks.workunit.client.0.smithi049.stdout:8/115: write d4/d7/f11 [325420,87913] 0 2024-06-03T00:03:00.470 INFO:tasks.workunit.client.0.smithi049.stdout:9/155: creat d1/d5/f2a x:0 0 0 2024-06-03T00:03:00.472 INFO:tasks.workunit.client.0.smithi049.stdout:8/116: creat d4/d7/f22 x:0 0 0 2024-06-03T00:03:00.472 INFO:tasks.workunit.client.0.smithi049.stdout:8/117: fdatasync d4/d7/f1b 0 2024-06-03T00:03:00.472 INFO:tasks.workunit.client.0.smithi049.stdout:8/118: chown d4/d7/f22 1904 1 2024-06-03T00:03:00.472 INFO:tasks.workunit.client.0.smithi049.stdout:8/119: chown d4/d7/f1e 21857727 1 2024-06-03T00:03:00.473 INFO:tasks.workunit.client.0.smithi049.stdout:2/74: dwrite f9 [0,4194304] 0 2024-06-03T00:03:00.476 INFO:tasks.workunit.client.0.smithi049.stdout:0/66: sync 2024-06-03T00:03:00.476 INFO:tasks.workunit.client.0.smithi049.stdout:3/70: sync 2024-06-03T00:03:00.477 INFO:tasks.workunit.client.0.smithi049.stdout:6/134: sync 2024-06-03T00:03:00.477 INFO:tasks.workunit.client.0.smithi049.stdout:2/75: creat da/dd/df/f16 x:0 0 0 2024-06-03T00:03:00.480 INFO:tasks.workunit.client.0.smithi049.stdout:2/76: rename l7 to da/l17 0 2024-06-03T00:03:00.480 INFO:tasks.workunit.client.0.smithi049.stdout:0/67: dread f4 [0,4194304] 0 2024-06-03T00:03:00.482 INFO:tasks.workunit.client.0.smithi049.stdout:3/71: unlink d2/d8/f12 0 2024-06-03T00:03:00.483 INFO:tasks.workunit.client.0.smithi049.stdout:2/77: rmdir da 39 2024-06-03T00:03:00.483 INFO:tasks.workunit.client.0.smithi049.stdout:2/78: write da/f15 [408458,96169] 0 2024-06-03T00:03:00.484 INFO:tasks.workunit.client.0.smithi049.stdout:2/79: chown da/dd/c11 5 1 2024-06-03T00:03:00.485 INFO:tasks.workunit.client.0.smithi049.stdout:8/120: dread d4/f15 [0,4194304] 0 2024-06-03T00:03:00.486 INFO:tasks.workunit.client.0.smithi049.stdout:5/87: dread d3/d11/d14/f8 [0,4194304] 0 2024-06-03T00:03:00.489 INFO:tasks.workunit.client.0.smithi049.stdout:8/121: link l3 d4/d7/d21/l23 0 2024-06-03T00:03:00.493 INFO:tasks.workunit.client.0.smithi049.stdout:5/88: creat d3/d11/f21 x:0 0 0 2024-06-03T00:03:00.494 INFO:tasks.workunit.client.0.smithi049.stdout:0/68: dread f1 [0,4194304] 0 2024-06-03T00:03:00.495 INFO:tasks.workunit.client.0.smithi049.stdout:3/72: creat d2/d14/f1c x:0 0 0 2024-06-03T00:03:00.495 INFO:tasks.workunit.client.0.smithi049.stdout:3/73: truncate d2/d1a/f1b 907978 0 2024-06-03T00:03:00.495 INFO:tasks.workunit.client.0.smithi049.stdout:7/76: dwrite d3/d8/f10 [0,4194304] 0 2024-06-03T00:03:00.495 INFO:tasks.workunit.client.0.smithi049.stdout:7/77: write d3/d6/f15 [334819,54762] 0 2024-06-03T00:03:00.498 INFO:tasks.workunit.client.0.smithi049.stdout:8/122: mknod d4/d7/c24 0 2024-06-03T00:03:00.500 INFO:tasks.workunit.client.0.smithi049.stdout:5/89: symlink d3/d11/d14/l22 0 2024-06-03T00:03:00.500 INFO:tasks.workunit.client.0.smithi049.stdout:5/90: chown d3/d5/da/f15 20 1 2024-06-03T00:03:00.500 INFO:tasks.workunit.client.0.smithi049.stdout:5/91: chown d3/d11/f21 7279 1 2024-06-03T00:03:00.500 INFO:tasks.workunit.client.0.smithi049.stdout:0/69: symlink d6/l13 0 2024-06-03T00:03:00.502 INFO:tasks.workunit.client.0.smithi049.stdout:2/80: dread da/dd/df/f10 [0,4194304] 0 2024-06-03T00:03:00.510 INFO:tasks.workunit.client.0.smithi049.stdout:5/92: dread d3/d5/da/f1d [0,4194304] 0 2024-06-03T00:03:00.511 INFO:tasks.workunit.client.0.smithi049.stdout:7/78: dread d3/fc [0,4194304] 0 2024-06-03T00:03:00.513 INFO:tasks.workunit.client.0.smithi049.stdout:5/93: link d3/d5/l10 d3/d9/d20/l23 0 2024-06-03T00:03:00.513 INFO:tasks.workunit.client.0.smithi049.stdout:4/122: dwrite d4/d16/d1c/f1f [0,4194304] 0 2024-06-03T00:03:00.513 INFO:tasks.workunit.client.0.smithi049.stdout:5/94: write d3/d5/da/f1d [1660327,26059] 0 2024-06-03T00:03:00.513 INFO:tasks.workunit.client.0.smithi049.stdout:5/95: chown f1 207253 1 2024-06-03T00:03:00.514 INFO:tasks.workunit.client.0.smithi049.stdout:5/96: fsync d3/d5/da/f15 0 2024-06-03T00:03:00.514 INFO:tasks.workunit.client.0.smithi049.stdout:1/152: dwrite d1/d2f/d36/d37/f14 [0,4194304] 0 2024-06-03T00:03:00.514 INFO:tasks.workunit.client.0.smithi049.stdout:7/79: unlink d3/d14/l19 0 2024-06-03T00:03:00.514 INFO:tasks.workunit.client.0.smithi049.stdout:5/97: rmdir d3/d9/d20 39 2024-06-03T00:03:00.516 INFO:tasks.workunit.client.0.smithi049.stdout:1/153: unlink d1/d2f/d36/d37/d13/c2a 0 2024-06-03T00:03:00.518 INFO:tasks.workunit.client.0.smithi049.stdout:9/156: dwrite d1/d5/f24 [0,4194304] 0 2024-06-03T00:03:00.518 INFO:tasks.workunit.client.0.smithi049.stdout:9/157: write d1/d5/f2a [63681,99714] 0 2024-06-03T00:03:00.518 INFO:tasks.workunit.client.0.smithi049.stdout:9/158: chown d1/d5/c6 7092378 1 2024-06-03T00:03:00.518 INFO:tasks.workunit.client.0.smithi049.stdout:4/123: dread f2 [0,4194304] 0 2024-06-03T00:03:00.520 INFO:tasks.workunit.client.0.smithi049.stdout:3/74: dwrite d2/d1a/f1b [0,4194304] 0 2024-06-03T00:03:00.522 INFO:tasks.workunit.client.0.smithi049.stdout:5/98: dread d3/d9/f13 [0,4194304] 0 2024-06-03T00:03:00.522 INFO:tasks.workunit.client.0.smithi049.stdout:5/99: dread - d3/d11/d14/f19 zero size 2024-06-03T00:03:00.522 INFO:tasks.workunit.client.0.smithi049.stdout:9/159: link d1/da/c18 d1/da/d26/c2b 0 2024-06-03T00:03:00.522 INFO:tasks.workunit.client.0.smithi049.stdout:1/154: dread d1/d1a/f25 [0,4194304] 0 2024-06-03T00:03:00.523 INFO:tasks.workunit.client.0.smithi049.stdout:4/124: link d4/f23 d4/d10/d14/d15/f28 0 2024-06-03T00:03:00.526 INFO:tasks.workunit.client.0.smithi049.stdout:3/75: creat d2/d1a/f1d x:0 0 0 2024-06-03T00:03:00.528 INFO:tasks.workunit.client.0.smithi049.stdout:9/160: link d1/d5/d13/f16 d1/da/d26/f2c 0 2024-06-03T00:03:00.529 INFO:tasks.workunit.client.0.smithi049.stdout:0/70: dwrite f1 [0,4194304] 0 2024-06-03T00:03:00.529 INFO:tasks.workunit.client.0.smithi049.stdout:0/71: truncate d6/fc 731957 0 2024-06-03T00:03:00.529 INFO:tasks.workunit.client.0.smithi049.stdout:8/123: truncate d4/d7/f11 4001474 0 2024-06-03T00:03:00.529 INFO:tasks.workunit.client.0.smithi049.stdout:8/124: write d4/d7/f18 [482469,26449] 0 2024-06-03T00:03:00.529 INFO:tasks.workunit.client.0.smithi049.stdout:1/155: truncate d1/d2f/d36/d37/f35 305693 0 2024-06-03T00:03:00.532 INFO:tasks.workunit.client.0.smithi049.stdout:4/125: chown l3 30848162 1 2024-06-03T00:03:00.533 INFO:tasks.workunit.client.0.smithi049.stdout:4/126: chown l3 348 1 2024-06-03T00:03:00.533 INFO:tasks.workunit.client.0.smithi049.stdout:4/127: chown d4/f23 906492298 1 2024-06-03T00:03:00.533 INFO:tasks.workunit.client.0.smithi049.stdout:4/128: truncate d4/d16/d1c/f26 327183 0 2024-06-03T00:03:00.537 INFO:tasks.workunit.client.0.smithi049.stdout:0/72: rename d6/cb to d6/c14 0 2024-06-03T00:03:00.539 INFO:tasks.workunit.client.0.smithi049.stdout:1/156: creat d1/d2f/d36/d37/d13/d34/f3c x:0 0 0 2024-06-03T00:03:00.539 INFO:tasks.workunit.client.0.smithi049.stdout:9/161: dread d1/d5/d1a/f1e [0,4194304] 0 2024-06-03T00:03:00.541 INFO:tasks.workunit.client.0.smithi049.stdout:3/76: rename d2/f10 to d2/d8/f1e 0 2024-06-03T00:03:00.542 INFO:tasks.workunit.client.0.smithi049.stdout:2/81: dwrite f9 [0,4194304] 0 2024-06-03T00:03:00.544 INFO:tasks.workunit.client.0.smithi049.stdout:8/125: write d4/f17 [5160995,95448] 0 2024-06-03T00:03:00.545 INFO:tasks.workunit.client.0.smithi049.stdout:0/73: unlink d6/c11 0 2024-06-03T00:03:00.545 INFO:tasks.workunit.client.0.smithi049.stdout:0/74: write f3 [933065,90380] 0 2024-06-03T00:03:00.546 INFO:tasks.workunit.client.0.smithi049.stdout:9/162: mknod d1/d5/c2d 0 2024-06-03T00:03:00.546 INFO:tasks.workunit.client.0.smithi049.stdout:9/163: write d1/d5/d1a/f1e [4429568,96241] 0 2024-06-03T00:03:00.551 INFO:tasks.workunit.client.0.smithi049.stdout:1/157: dread d1/d2f/d36/d37/f33 [0,4194304] 0 2024-06-03T00:03:00.553 INFO:tasks.workunit.client.0.smithi049.stdout:8/126: read d4/d7/f13 [23831,3293] 0 2024-06-03T00:03:00.553 INFO:tasks.workunit.client.0.smithi049.stdout:8/127: fsync d4/d7/f16 0 2024-06-03T00:03:00.553 INFO:tasks.workunit.client.0.smithi049.stdout:8/128: fdatasync d4/d7/f18 0 2024-06-03T00:03:00.554 INFO:tasks.workunit.client.0.smithi049.stdout:4/129: dwrite d4/f23 [0,4194304] 0 2024-06-03T00:03:00.554 INFO:tasks.workunit.client.0.smithi049.stdout:4/130: chown d4/fa 249 1 2024-06-03T00:03:00.558 INFO:tasks.workunit.client.0.smithi049.stdout:1/158: link d1/d2f/d36/d37/ld d1/d2f/d36/d37/d13/d34/l3d 0 2024-06-03T00:03:00.558 INFO:tasks.workunit.client.0.smithi049.stdout:1/159: dread - d1/f2d zero size 2024-06-03T00:03:00.558 INFO:tasks.workunit.client.0.smithi049.stdout:1/160: readlink d1/l9 0 2024-06-03T00:03:00.559 INFO:tasks.workunit.client.0.smithi049.stdout:8/129: dread d4/d7/f18 [0,4194304] 0 2024-06-03T00:03:00.559 INFO:tasks.workunit.client.0.smithi049.stdout:7/80: dwrite d3/d6/f15 [0,4194304] 0 2024-06-03T00:03:00.559 INFO:tasks.workunit.client.0.smithi049.stdout:7/81: chown d3/d6 49 1 2024-06-03T00:03:00.559 INFO:tasks.workunit.client.0.smithi049.stdout:1/161: getdents d1/d2f/d36 0 2024-06-03T00:03:00.559 INFO:tasks.workunit.client.0.smithi049.stdout:2/82: dwrite da/fb [0,4194304] 0 2024-06-03T00:03:00.559 INFO:tasks.workunit.client.0.smithi049.stdout:2/83: fsync da/dd/f13 0 2024-06-03T00:03:00.559 INFO:tasks.workunit.client.0.smithi049.stdout:2/84: fsync f6 0 2024-06-03T00:03:00.561 INFO:tasks.workunit.client.0.smithi049.stdout:2/85: dread da/f15 [0,4194304] 0 2024-06-03T00:03:00.561 INFO:tasks.workunit.client.0.smithi049.stdout:2/86: readlink da/l17 0 2024-06-03T00:03:00.562 INFO:tasks.workunit.client.0.smithi049.stdout:7/82: creat d3/f1b x:0 0 0 2024-06-03T00:03:00.562 INFO:tasks.workunit.client.0.smithi049.stdout:7/83: truncate d3/f1b 767592 0 2024-06-03T00:03:00.563 INFO:tasks.workunit.client.0.smithi049.stdout:4/131: dread d4/fa [0,4194304] 0 2024-06-03T00:03:00.564 INFO:tasks.workunit.client.0.smithi049.stdout:1/162: creat d1/f3e x:0 0 0 2024-06-03T00:03:00.564 INFO:tasks.workunit.client.0.smithi049.stdout:1/163: chown d1/d2f/d36/d37/d13/d34/f3c 1022 1 2024-06-03T00:03:00.566 INFO:tasks.workunit.client.0.smithi049.stdout:0/75: rename d6/c14 to d6/c15 0 2024-06-03T00:03:00.569 INFO:tasks.workunit.client.0.smithi049.stdout:2/87: rename da/dd/c11 to da/dd/c18 0 2024-06-03T00:03:00.571 INFO:tasks.workunit.client.0.smithi049.stdout:1/164: dread d1/d2f/d36/d37/f29 [0,4194304] 0 2024-06-03T00:03:00.571 INFO:tasks.workunit.client.0.smithi049.stdout:7/84: rmdir d3/d6 39 2024-06-03T00:03:00.572 INFO:tasks.workunit.client.0.smithi049.stdout:9/164: dwrite d1/d5/d13/f16 [0,4194304] 0 2024-06-03T00:03:00.573 INFO:tasks.workunit.client.0.smithi049.stdout:3/77: dwrite d2/fe [0,4194304] 0 2024-06-03T00:03:00.573 INFO:tasks.workunit.client.0.smithi049.stdout:3/78: fsync d2/d8/f1e 0 2024-06-03T00:03:00.574 INFO:tasks.workunit.client.0.smithi049.stdout:3/79: chown d2/d14/c19 56 1 2024-06-03T00:03:00.575 INFO:tasks.workunit.client.0.smithi049.stdout:2/88: getdents da 0 2024-06-03T00:03:00.576 INFO:tasks.workunit.client.0.smithi049.stdout:1/165: stat d1/d2f/d36/d37/d13/c23 0 2024-06-03T00:03:00.577 INFO:tasks.workunit.client.0.smithi049.stdout:1/166: fsync d1/d2f/d36/d37/d13/d34/f3b 0 2024-06-03T00:03:00.579 INFO:tasks.workunit.client.0.smithi049.stdout:4/132: rename d4/d10/d14/l1b to d4/l29 0 2024-06-03T00:03:00.581 INFO:tasks.workunit.client.0.smithi049.stdout:9/165: symlink d1/da/d27/l2e 0 2024-06-03T00:03:00.581 INFO:tasks.workunit.client.0.smithi049.stdout:9/166: read - d1/d5/f1d zero size 2024-06-03T00:03:00.584 INFO:tasks.workunit.client.0.smithi049.stdout:3/80: creat d2/d14/f1f x:0 0 0 2024-06-03T00:03:00.584 INFO:tasks.workunit.client.0.smithi049.stdout:3/81: fsync d2/d8/fa 0 2024-06-03T00:03:00.584 INFO:tasks.workunit.client.0.smithi049.stdout:3/82: dread - d2/d1a/f1d zero size 2024-06-03T00:03:00.584 INFO:tasks.workunit.client.0.smithi049.stdout:3/83: chown l1 78572 1 2024-06-03T00:03:00.586 INFO:tasks.workunit.client.0.smithi049.stdout:0/76: dwrite f3 [0,4194304] 0 2024-06-03T00:03:00.586 INFO:tasks.workunit.client.0.smithi049.stdout:2/89: mknod da/dd/df/c19 0 2024-06-03T00:03:00.587 INFO:tasks.workunit.client.0.smithi049.stdout:1/167: creat d1/d2f/d36/d37/d13/d34/f3f x:0 0 0 2024-06-03T00:03:00.588 INFO:tasks.workunit.client.0.smithi049.stdout:7/85: link d3/d8/f10 d3/d6/f1c 0 2024-06-03T00:03:00.591 INFO:tasks.workunit.client.0.smithi049.stdout:9/167: dread d1/da/d26/f2c [0,4194304] 0 2024-06-03T00:03:00.592 INFO:tasks.workunit.client.0.smithi049.stdout:0/77: rename f1 to d6/f16 0 2024-06-03T00:03:00.593 INFO:tasks.workunit.client.0.smithi049.stdout:2/90: unlink da/dd/df/c19 0 2024-06-03T00:03:00.594 INFO:tasks.workunit.client.0.smithi049.stdout:1/168: mknod d1/d2f/d36/d37/d2c/c40 0 2024-06-03T00:03:00.595 INFO:tasks.workunit.client.0.smithi049.stdout:1/169: write d1/d2f/d36/d37/d13/d34/f3c [71412,14596] 0 2024-06-03T00:03:00.595 INFO:tasks.workunit.client.0.smithi049.stdout:7/86: mknod d3/d6/d9/c1d 0 2024-06-03T00:03:00.596 INFO:tasks.workunit.client.0.smithi049.stdout:4/133: mkdir d4/d2a 0 2024-06-03T00:03:00.596 INFO:tasks.workunit.client.0.smithi049.stdout:4/134: readlink d4/lb 0 2024-06-03T00:03:00.597 INFO:tasks.workunit.client.0.smithi049.stdout:9/168: unlink c0 0 2024-06-03T00:03:00.599 INFO:tasks.workunit.client.0.smithi049.stdout:4/135: mkdir d4/d10/d14/d2b 0 2024-06-03T00:03:00.600 INFO:tasks.workunit.client.0.smithi049.stdout:0/78: dread f2 [0,4194304] 0 2024-06-03T00:03:00.600 INFO:tasks.workunit.client.0.smithi049.stdout:9/169: rename d1/da/c21 to d1/d5/d1a/c2f 0 2024-06-03T00:03:00.600 INFO:tasks.workunit.client.0.smithi049.stdout:9/170: fdatasync d1/f8 0 2024-06-03T00:03:00.602 INFO:tasks.workunit.client.0.smithi049.stdout:4/136: link d4/fc d4/d16/d1c/f2c 0 2024-06-03T00:03:00.604 INFO:tasks.workunit.client.0.smithi049.stdout:0/79: creat d6/f17 x:0 0 0 2024-06-03T00:03:00.606 INFO:tasks.workunit.client.0.smithi049.stdout:4/137: symlink d4/d10/d14/l2d 0 2024-06-03T00:03:00.606 INFO:tasks.workunit.client.0.smithi049.stdout:7/87: write d3/d6/f15 [3701951,101590] 0 2024-06-03T00:03:00.608 INFO:tasks.workunit.client.0.smithi049.stdout:6/135: sync 2024-06-03T00:03:00.609 INFO:tasks.workunit.client.0.smithi049.stdout:4/138: mknod d4/d10/c2e 0 2024-06-03T00:03:00.610 INFO:tasks.workunit.client.0.smithi049.stdout:0/80: fsync d6/f16 0 2024-06-03T00:03:00.611 INFO:tasks.workunit.client.0.smithi049.stdout:2/91: dwrite f4 [4194304,4194304] 0 2024-06-03T00:03:00.613 INFO:tasks.workunit.client.0.smithi049.stdout:7/88: rename d3/d6/d9/c1d to d3/d8/d17/c1e 0 2024-06-03T00:03:00.615 INFO:tasks.workunit.client.0.smithi049.stdout:0/81: mkdir d6/d18 0 2024-06-03T00:03:00.618 INFO:tasks.workunit.client.0.smithi049.stdout:7/89: creat d3/d6/d13/f1f x:0 0 0 2024-06-03T00:03:00.620 INFO:tasks.workunit.client.0.smithi049.stdout:0/82: mkdir d6/d18/d19 0 2024-06-03T00:03:00.620 INFO:tasks.workunit.client.0.smithi049.stdout:0/83: rename d6/d18/d19 to d6/d18/d19/d1a 22 2024-06-03T00:03:00.620 INFO:tasks.workunit.client.0.smithi049.stdout:0/84: stat d6/fc 0 2024-06-03T00:03:00.623 INFO:tasks.workunit.client.0.smithi049.stdout:7/90: creat d3/d6/f20 x:0 0 0 2024-06-03T00:03:00.630 INFO:tasks.workunit.client.0.smithi049.stdout:2/92: dwrite da/dd/df/f16 [0,4194304] 0 2024-06-03T00:03:00.630 INFO:tasks.workunit.client.0.smithi049.stdout:2/93: write f1 [335324,47391] 0 2024-06-03T00:03:00.630 INFO:tasks.workunit.client.0.smithi049.stdout:2/94: write da/f15 [902508,65687] 0 2024-06-03T00:03:00.631 INFO:tasks.workunit.client.0.smithi049.stdout:1/170: dwrite d1/d2f/d36/d37/f1b [0,4194304] 0 2024-06-03T00:03:00.632 INFO:tasks.workunit.client.0.smithi049.stdout:0/85: write f3 [3587084,97759] 0 2024-06-03T00:03:00.642 INFO:tasks.workunit.client.0.smithi049.stdout:9/171: dwrite d1/d5/f2a [0,4194304] 0 2024-06-03T00:03:00.644 INFO:tasks.workunit.client.0.smithi049.stdout:9/172: mkdir d1/da/d27/d30 0 2024-06-03T00:03:00.645 INFO:tasks.workunit.client.0.smithi049.stdout:9/173: fsync d1/da/d26/f2c 0 2024-06-03T00:03:00.645 INFO:tasks.workunit.client.0.smithi049.stdout:9/174: mknod d1/d5/d1a/c31 0 2024-06-03T00:03:00.646 INFO:tasks.workunit.client.0.smithi049.stdout:9/175: fdatasync d1/f8 0 2024-06-03T00:03:00.647 INFO:tasks.workunit.client.0.smithi049.stdout:9/176: creat d1/da/d26/f32 x:0 0 0 2024-06-03T00:03:00.652 INFO:tasks.workunit.client.0.smithi049.stdout:9/177: write d1/d5/d13/f16 [1936998,84442] 0 2024-06-03T00:03:00.652 INFO:tasks.workunit.client.0.smithi049.stdout:9/178: chown d1/d5/d13/l17 873937 1 2024-06-03T00:03:00.653 INFO:tasks.workunit.client.0.smithi049.stdout:6/136: dwrite d2/f11 [4194304,4194304] 0 2024-06-03T00:03:00.653 INFO:tasks.workunit.client.0.smithi049.stdout:2/95: dwrite f6 [0,4194304] 0 2024-06-03T00:03:00.654 INFO:tasks.workunit.client.0.smithi049.stdout:1/171: dwrite d1/d2f/d36/d37/d13/f27 [0,4194304] 0 2024-06-03T00:03:00.654 INFO:tasks.workunit.client.0.smithi049.stdout:9/179: creat d1/da/d26/f33 x:0 0 0 2024-06-03T00:03:00.655 INFO:tasks.workunit.client.0.smithi049.stdout:7/91: dwrite d3/d6/d13/f1f [0,4194304] 0 2024-06-03T00:03:00.655 INFO:tasks.workunit.client.0.smithi049.stdout:9/180: dread - d1/da/d26/f33 zero size 2024-06-03T00:03:00.655 INFO:tasks.workunit.client.0.smithi049.stdout:9/181: chown d1/f8 130 1 2024-06-03T00:03:00.655 INFO:tasks.workunit.client.0.smithi049.stdout:6/137: symlink d2/d3/d17/l33 0 2024-06-03T00:03:00.656 INFO:tasks.workunit.client.0.smithi049.stdout:6/138: write d2/d3/d9/d23/d29/f2d [673082,26458] 0 2024-06-03T00:03:00.657 INFO:tasks.workunit.client.0.smithi049.stdout:1/172: mknod d1/d2f/d36/d37/d2c/c41 0 2024-06-03T00:03:00.657 INFO:tasks.workunit.client.0.smithi049.stdout:1/173: dread - d1/d1a/f30 zero size 2024-06-03T00:03:00.657 INFO:tasks.workunit.client.0.smithi049.stdout:1/174: chown d1 11820 1 2024-06-03T00:03:00.666 INFO:tasks.workunit.client.0.smithi049.stdout:9/182: creat d1/da/d27/d30/f34 x:0 0 0 2024-06-03T00:03:00.667 INFO:tasks.workunit.client.0.smithi049.stdout:9/183: fsync d1/da/d26/f33 0 2024-06-03T00:03:00.667 INFO:tasks.workunit.client.0.smithi049.stdout:9/184: chown d1/da/d26/f32 388894495 1 2024-06-03T00:03:00.668 INFO:tasks.workunit.client.0.smithi049.stdout:2/96: dread da/dd/df/f10 [0,4194304] 0 2024-06-03T00:03:00.669 INFO:tasks.workunit.client.0.smithi049.stdout:6/139: link d2/d3/d17/l33 d2/d3/l34 0 2024-06-03T00:03:00.669 INFO:tasks.workunit.client.0.smithi049.stdout:6/140: fdatasync d2/d3/d9/d23/d29/d30/f16 0 2024-06-03T00:03:00.669 INFO:tasks.workunit.client.0.smithi049.stdout:6/141: chown d2/d3/d9/d23/d29/d30/d28/f31 7 1 2024-06-03T00:03:00.669 INFO:tasks.workunit.client.0.smithi049.stdout:6/142: chown d2/d3 1 1 2024-06-03T00:03:00.670 INFO:tasks.workunit.client.0.smithi049.stdout:1/175: mkdir d1/d2f/d36/d37/d13/d42 0 2024-06-03T00:03:00.670 INFO:tasks.workunit.client.0.smithi049.stdout:1/176: truncate d1/f1e 659508 0 2024-06-03T00:03:00.670 INFO:tasks.workunit.client.0.smithi049.stdout:1/177: fsync d1/d2f/d36/d37/d13/d34/f3c 0 2024-06-03T00:03:00.671 INFO:tasks.workunit.client.0.smithi049.stdout:9/185: creat d1/d5/d13/f35 x:0 0 0 2024-06-03T00:03:00.672 INFO:tasks.workunit.client.0.smithi049.stdout:1/178: truncate d1/f7 876774 0 2024-06-03T00:03:00.673 INFO:tasks.workunit.client.0.smithi049.stdout:2/97: truncate f6 3590087 0 2024-06-03T00:03:00.675 INFO:tasks.workunit.client.0.smithi049.stdout:9/186: fsync d1/da/d26/f2c 0 2024-06-03T00:03:00.675 INFO:tasks.workunit.client.0.smithi049.stdout:8/130: sync 2024-06-03T00:03:00.676 INFO:tasks.workunit.client.0.smithi049.stdout:3/84: sync 2024-06-03T00:03:00.676 INFO:tasks.workunit.client.0.smithi049.stdout:5/100: sync 2024-06-03T00:03:00.676 INFO:tasks.workunit.client.0.smithi049.stdout:3/85: stat f0 0 2024-06-03T00:03:00.677 INFO:tasks.workunit.client.0.smithi049.stdout:8/131: mkdir d4/d7/d21/d25 0 2024-06-03T00:03:00.677 INFO:tasks.workunit.client.0.smithi049.stdout:8/132: stat d4/d7/fc 0 2024-06-03T00:03:00.678 INFO:tasks.workunit.client.0.smithi049.stdout:3/86: creat d2/d1a/f20 x:0 0 0 2024-06-03T00:03:00.678 INFO:tasks.workunit.client.0.smithi049.stdout:3/87: readlink d2/d14/l17 0 2024-06-03T00:03:00.679 INFO:tasks.workunit.client.0.smithi049.stdout:8/133: creat d4/d7/d21/f26 x:0 0 0 2024-06-03T00:03:00.679 INFO:tasks.workunit.client.0.smithi049.stdout:8/134: read d4/d7/f13 [2223312,85151] 0 2024-06-03T00:03:00.679 INFO:tasks.workunit.client.0.smithi049.stdout:8/135: getdents d4/d7/d21/d25 0 2024-06-03T00:03:00.680 INFO:tasks.workunit.client.0.smithi049.stdout:3/88: fdatasync d2/f15 0 2024-06-03T00:03:00.681 INFO:tasks.workunit.client.0.smithi049.stdout:3/89: symlink d2/d14/l21 0 2024-06-03T00:03:00.686 INFO:tasks.workunit.client.0.smithi049.stdout:0/86: dwrite f3 [0,4194304] 0 2024-06-03T00:03:00.687 INFO:tasks.workunit.client.0.smithi049.stdout:7/92: dwrite d3/d6/d13/f1f [0,4194304] 0 2024-06-03T00:03:00.687 INFO:tasks.workunit.client.0.smithi049.stdout:7/93: readlink d3/ld 0 2024-06-03T00:03:00.687 INFO:tasks.workunit.client.0.smithi049.stdout:7/94: write d3/fc [2905990,97344] 0 2024-06-03T00:03:00.689 INFO:tasks.workunit.client.0.smithi049.stdout:7/95: unlink d3/fc 0 2024-06-03T00:03:00.692 INFO:tasks.workunit.client.0.smithi049.stdout:5/101: dread f1 [0,4194304] 0 2024-06-03T00:03:00.692 INFO:tasks.workunit.client.0.smithi049.stdout:9/187: dread d1/f8 [0,4194304] 0 2024-06-03T00:03:00.693 INFO:tasks.workunit.client.0.smithi049.stdout:2/98: dread f6 [0,4194304] 0 2024-06-03T00:03:00.693 INFO:tasks.workunit.client.0.smithi049.stdout:2/99: dread - da/dd/f13 zero size 2024-06-03T00:03:00.693 INFO:tasks.workunit.client.0.smithi049.stdout:5/102: mkdir d3/d5/d24 0 2024-06-03T00:03:00.698 INFO:tasks.workunit.client.0.smithi049.stdout:3/90: dwrite d2/d14/f1c [0,4194304] 0 2024-06-03T00:03:00.698 INFO:tasks.workunit.client.0.smithi049.stdout:2/100: mknod da/c1a 0 2024-06-03T00:03:00.698 INFO:tasks.workunit.client.0.smithi049.stdout:2/101: chown da/l17 45488990 1 2024-06-03T00:03:00.701 INFO:tasks.workunit.client.0.smithi049.stdout:2/102: mknod da/c1b 0 2024-06-03T00:03:00.701 INFO:tasks.workunit.client.0.smithi049.stdout:2/103: dread - da/dd/f13 zero size 2024-06-03T00:03:00.703 INFO:tasks.workunit.client.0.smithi049.stdout:7/96: dread d3/d6/f15 [0,4194304] 0 2024-06-03T00:03:00.703 INFO:tasks.workunit.client.0.smithi049.stdout:2/104: creat da/f1c x:0 0 0 2024-06-03T00:03:00.707 INFO:tasks.workunit.client.0.smithi049.stdout:1/179: dwrite d1/d2f/d36/d37/f1b [0,4194304] 0 2024-06-03T00:03:00.707 INFO:tasks.workunit.client.0.smithi049.stdout:9/188: read d1/f8 [2658284,49413] 0 2024-06-03T00:03:00.707 INFO:tasks.workunit.client.0.smithi049.stdout:2/105: rename da/cc to da/dd/c1d 0 2024-06-03T00:03:00.708 INFO:tasks.workunit.client.0.smithi049.stdout:1/180: symlink d1/d2f/l43 0 2024-06-03T00:03:00.709 INFO:tasks.workunit.client.0.smithi049.stdout:0/87: write d6/f16 [1135442,4552] 0 2024-06-03T00:03:00.709 INFO:tasks.workunit.client.0.smithi049.stdout:0/88: write d6/fc [1768147,33640] 0 2024-06-03T00:03:00.709 INFO:tasks.workunit.client.0.smithi049.stdout:9/189: rename d1/da/d26/c2b to d1/d5/c36 0 2024-06-03T00:03:00.710 INFO:tasks.workunit.client.0.smithi049.stdout:2/106: mknod da/c1e 0 2024-06-03T00:03:00.710 INFO:tasks.workunit.client.0.smithi049.stdout:2/107: write da/dd/df/f16 [5130000,76601] 0 2024-06-03T00:03:00.711 INFO:tasks.workunit.client.0.smithi049.stdout:1/181: creat d1/d2f/f44 x:0 0 0 2024-06-03T00:03:00.713 INFO:tasks.workunit.client.0.smithi049.stdout:0/89: rename d6/lf to d6/d18/d19/l1b 0 2024-06-03T00:03:00.713 INFO:tasks.workunit.client.0.smithi049.stdout:6/143: dwrite d2/d3/d9/d23/f1e [0,4194304] 0 2024-06-03T00:03:00.713 INFO:tasks.workunit.client.0.smithi049.stdout:6/144: read d2/d3/d9/d23/d29/d30/d28/f8 [4730124,84662] 0 2024-06-03T00:03:00.713 INFO:tasks.workunit.client.0.smithi049.stdout:6/145: chown d2/d3/d9/d23/d29/d30/d28/l7 614181 1 2024-06-03T00:03:00.713 INFO:tasks.workunit.client.0.smithi049.stdout:6/146: rename d2 to d2/d2f/d35 22 2024-06-03T00:03:00.713 INFO:tasks.workunit.client.0.smithi049.stdout:6/147: fsync d2/d3/d9/d23/f26 0 2024-06-03T00:03:00.713 INFO:tasks.workunit.client.0.smithi049.stdout:6/148: fsync d2/d3/d9/d23/d29/d30/f16 0 2024-06-03T00:03:00.714 INFO:tasks.workunit.client.0.smithi049.stdout:6/149: fsync d2/d3/d9/d23/d29/f32 0 2024-06-03T00:03:00.718 INFO:tasks.workunit.client.0.smithi049.stdout:5/103: dwrite d3/d5/fd [0,4194304] 0 2024-06-03T00:03:00.719 INFO:tasks.workunit.client.0.smithi049.stdout:8/136: dwrite d4/d7/f14 [4194304,4194304] 0 2024-06-03T00:03:00.720 INFO:tasks.workunit.client.0.smithi049.stdout:2/108: unlink da/dd/df/f16 0 2024-06-03T00:03:00.720 INFO:tasks.workunit.client.0.smithi049.stdout:1/182: mkdir d1/d2f/d36/d37/d2c/d45 0 2024-06-03T00:03:00.720 INFO:tasks.workunit.client.0.smithi049.stdout:1/183: chown d1/d2f/d36/d37/d13/l31 0 1 2024-06-03T00:03:00.721 INFO:tasks.workunit.client.0.smithi049.stdout:6/150: mkdir d2/d3/d9/d23/d36 0 2024-06-03T00:03:00.726 INFO:tasks.workunit.client.0.smithi049.stdout:5/104: creat d3/d11/d14/d16/f25 x:0 0 0 2024-06-03T00:03:00.726 INFO:tasks.workunit.client.0.smithi049.stdout:5/105: chown d3/d11/d14/ce 0 1 2024-06-03T00:03:00.726 INFO:tasks.workunit.client.0.smithi049.stdout:5/106: truncate d3/d5/da/f15 719873 0 2024-06-03T00:03:00.726 INFO:tasks.workunit.client.0.smithi049.stdout:5/107: fsync f1 0 2024-06-03T00:03:00.726 INFO:tasks.workunit.client.0.smithi049.stdout:5/108: getdents d3/d5/d24 0 2024-06-03T00:03:00.726 INFO:tasks.workunit.client.0.smithi049.stdout:9/190: read d1/f15 [2940896,109853] 0 2024-06-03T00:03:00.727 INFO:tasks.workunit.client.0.smithi049.stdout:6/151: rmdir d2/d2f 0 2024-06-03T00:03:00.727 INFO:tasks.workunit.client.0.smithi049.stdout:9/191: creat d1/da/f37 x:0 0 0 2024-06-03T00:03:00.727 INFO:tasks.workunit.client.0.smithi049.stdout:9/192: chown d1/da/d27/l2e 57951 1 2024-06-03T00:03:00.728 INFO:tasks.workunit.client.0.smithi049.stdout:1/184: dread d1/d2f/d36/d37/f29 [0,4194304] 0 2024-06-03T00:03:00.728 INFO:tasks.workunit.client.0.smithi049.stdout:1/185: chown d1/d2f/d36/d37/d13/l2e 120125 1 2024-06-03T00:03:00.728 INFO:tasks.workunit.client.0.smithi049.stdout:8/137: dread d4/d7/f11 [0,4194304] 0 2024-06-03T00:03:00.729 INFO:tasks.workunit.client.0.smithi049.stdout:6/152: mkdir d2/d37 0 2024-06-03T00:03:00.729 INFO:tasks.workunit.client.0.smithi049.stdout:9/193: truncate d1/d5/d13/f25 2239824 0 2024-06-03T00:03:00.730 INFO:tasks.workunit.client.0.smithi049.stdout:9/194: truncate d1/da/d26/f32 184243 0 2024-06-03T00:03:00.731 INFO:tasks.workunit.client.0.smithi049.stdout:1/186: rename d1/d2f/d36/d37/f1b to d1/d2f/f46 0 2024-06-03T00:03:00.731 INFO:tasks.workunit.client.0.smithi049.stdout:1/187: write d1/d2f/d36/d37/f1f [1030545,11781] 0 2024-06-03T00:03:00.731 INFO:tasks.workunit.client.0.smithi049.stdout:1/188: stat d1/d2f/d36/d37/f1f 0 2024-06-03T00:03:00.733 INFO:tasks.workunit.client.0.smithi049.stdout:0/90: getdents d6 0 2024-06-03T00:03:00.734 INFO:tasks.workunit.client.0.smithi049.stdout:6/153: creat d2/d3/f38 x:0 0 0 2024-06-03T00:03:00.735 INFO:tasks.workunit.client.0.smithi049.stdout:9/195: mkdir d1/d5/d13/d38 0 2024-06-03T00:03:00.736 INFO:tasks.workunit.client.0.smithi049.stdout:1/189: creat d1/d2f/d36/d37/d13/f47 x:0 0 0 2024-06-03T00:03:00.737 INFO:tasks.workunit.client.0.smithi049.stdout:8/138: mkdir d4/d27 0 2024-06-03T00:03:00.738 INFO:tasks.workunit.client.0.smithi049.stdout:0/91: getdents d6/d18 0 2024-06-03T00:03:00.738 INFO:tasks.workunit.client.0.smithi049.stdout:0/92: dread - d6/f12 zero size 2024-06-03T00:03:00.739 INFO:tasks.workunit.client.0.smithi049.stdout:1/190: dread d1/f1e [0,4194304] 0 2024-06-03T00:03:00.739 INFO:tasks.workunit.client.0.smithi049.stdout:2/109: dwrite da/f15 [0,4194304] 0 2024-06-03T00:03:00.739 INFO:tasks.workunit.client.0.smithi049.stdout:1/191: write d1/d2f/d36/d37/d13/d34/f3f [544469,29471] 0 2024-06-03T00:03:00.739 INFO:tasks.workunit.client.0.smithi049.stdout:2/110: chown f9 133 1 2024-06-03T00:03:00.739 INFO:tasks.workunit.client.0.smithi049.stdout:7/97: dwrite d3/d6/f20 [0,4194304] 0 2024-06-03T00:03:00.739 INFO:tasks.workunit.client.0.smithi049.stdout:8/139: dread d4/d7/f18 [0,4194304] 0 2024-06-03T00:03:00.739 INFO:tasks.workunit.client.0.smithi049.stdout:7/98: fsync d3/d6/d13/f1f 0 2024-06-03T00:03:00.740 INFO:tasks.workunit.client.0.smithi049.stdout:6/154: symlink d2/l39 0 2024-06-03T00:03:00.740 INFO:tasks.workunit.client.0.smithi049.stdout:6/155: write d2/d3/d9/d23/d29/d30/d28/f20 [925422,7005] 0 2024-06-03T00:03:00.740 INFO:tasks.workunit.client.0.smithi049.stdout:6/156: chown d2/f24 144687 1 2024-06-03T00:03:00.740 INFO:tasks.workunit.client.0.smithi049.stdout:6/157: write d2/d3/d9/d23/d29/f32 [782289,109074] 0 2024-06-03T00:03:00.740 INFO:tasks.workunit.client.0.smithi049.stdout:6/158: chown d2/d3/d9/d23/d29/f32 8 1 2024-06-03T00:03:00.740 INFO:tasks.workunit.client.0.smithi049.stdout:9/196: creat d1/d5/d13/f39 x:0 0 0 2024-06-03T00:03:00.741 INFO:tasks.workunit.client.0.smithi049.stdout:0/93: mknod d6/d18/c1c 0 2024-06-03T00:03:00.742 INFO:tasks.workunit.client.0.smithi049.stdout:4/139: sync 2024-06-03T00:03:00.742 INFO:tasks.workunit.client.0.smithi049.stdout:4/140: truncate d4/d16/d1c/f25 21802 0 2024-06-03T00:03:00.744 INFO:tasks.workunit.client.0.smithi049.stdout:1/192: symlink d1/d2f/d36/d37/d13/l48 0 2024-06-03T00:03:00.746 INFO:tasks.workunit.client.0.smithi049.stdout:6/159: dread d2/d3/d9/d23/d29/d30/d28/f31 [0,4194304] 0 2024-06-03T00:03:00.746 INFO:tasks.workunit.client.0.smithi049.stdout:7/99: symlink d3/d8/l21 0 2024-06-03T00:03:00.746 INFO:tasks.workunit.client.0.smithi049.stdout:7/100: chown d3/d8/f10 347395595 1 2024-06-03T00:03:00.747 INFO:tasks.workunit.client.0.smithi049.stdout:9/197: mknod d1/da/d26/c3a 0 2024-06-03T00:03:00.748 INFO:tasks.workunit.client.0.smithi049.stdout:8/140: write d4/d7/fc [1417546,11844] 0 2024-06-03T00:03:00.748 INFO:tasks.workunit.client.0.smithi049.stdout:1/193: dread d1/f1e [0,4194304] 0 2024-06-03T00:03:00.748 INFO:tasks.workunit.client.0.smithi049.stdout:1/194: getdents d1/d2f/d36/d37/d13/d42 0 2024-06-03T00:03:00.749 INFO:tasks.workunit.client.0.smithi049.stdout:2/111: write f9 [1511681,57179] 0 2024-06-03T00:03:00.749 INFO:tasks.workunit.client.0.smithi049.stdout:2/112: fdatasync da/f1c 0 2024-06-03T00:03:00.749 INFO:tasks.workunit.client.0.smithi049.stdout:2/113: write f1 [1950254,537] 0 2024-06-03T00:03:00.749 INFO:tasks.workunit.client.0.smithi049.stdout:4/141: unlink d4/c13 0 2024-06-03T00:03:00.750 INFO:tasks.workunit.client.0.smithi049.stdout:7/101: creat d3/f22 x:0 0 0 2024-06-03T00:03:00.752 INFO:tasks.workunit.client.0.smithi049.stdout:9/198: mkdir d1/d5/d13/d3b 0 2024-06-03T00:03:00.755 INFO:tasks.workunit.client.0.smithi049.stdout:8/141: rename d4/d7/d21 to d4/d7/d28 0 2024-06-03T00:03:00.758 INFO:tasks.workunit.client.0.smithi049.stdout:2/114: mknod da/dd/c1f 0 2024-06-03T00:03:00.760 INFO:tasks.workunit.client.0.smithi049.stdout:7/102: mkdir d3/d8/d23 0 2024-06-03T00:03:00.760 INFO:tasks.workunit.client.0.smithi049.stdout:7/103: write d3/f22 [8833,88438] 0 2024-06-03T00:03:00.760 INFO:tasks.workunit.client.0.smithi049.stdout:7/104: write d3/d6/f12 [871802,117365] 0 2024-06-03T00:03:00.762 INFO:tasks.workunit.client.0.smithi049.stdout:9/199: unlink d1/f15 0 2024-06-03T00:03:00.762 INFO:tasks.workunit.client.0.smithi049.stdout:9/200: write d1/d5/d13/f39 [3546,103804] 0 2024-06-03T00:03:00.763 INFO:tasks.workunit.client.0.smithi049.stdout:7/105: getdents d3/d6/d13 0 2024-06-03T00:03:00.764 INFO:tasks.workunit.client.0.smithi049.stdout:9/201: creat d1/da/d27/f3c x:0 0 0 2024-06-03T00:03:00.766 INFO:tasks.workunit.client.0.smithi049.stdout:7/106: symlink d3/d8/d17/l24 0 2024-06-03T00:03:00.767 INFO:tasks.workunit.client.0.smithi049.stdout:9/202: getdents d1/da/d27/d30 0 2024-06-03T00:03:00.769 INFO:tasks.workunit.client.0.smithi049.stdout:7/107: creat d3/d6/f25 x:0 0 0 2024-06-03T00:03:00.778 INFO:tasks.workunit.client.0.smithi049.stdout:7/108: write d3/d6/f1c [3870522,54941] 0 2024-06-03T00:03:00.782 INFO:tasks.workunit.client.0.smithi049.stdout:7/109: link d3/d8/d17/c1e d3/c26 0 2024-06-03T00:03:00.782 INFO:tasks.workunit.client.0.smithi049.stdout:1/195: dwrite d1/d2f/d36/d37/f29 [4194304,4194304] 0 2024-06-03T00:03:00.782 INFO:tasks.workunit.client.0.smithi049.stdout:1/196: write d1/d2f/d36/d37/f1f [850708,48664] 0 2024-06-03T00:03:00.784 INFO:tasks.workunit.client.0.smithi049.stdout:1/197: mknod d1/d2f/d36/d37/d13/d42/c49 0 2024-06-03T00:03:00.785 INFO:tasks.workunit.client.0.smithi049.stdout:1/198: symlink d1/d2f/d36/d37/d13/l4a 0 2024-06-03T00:03:00.785 INFO:tasks.workunit.client.0.smithi049.stdout:1/199: write d1/d2f/d36/d37/d13/d34/f3b [403017,4368] 0 2024-06-03T00:03:00.785 INFO:tasks.workunit.client.0.smithi049.stdout:1/200: chown d1/d2f/d36/d37/d13/d34/l3d 20 1 2024-06-03T00:03:00.786 INFO:tasks.workunit.client.0.smithi049.stdout:6/160: dwrite d2/f15 [0,4194304] 0 2024-06-03T00:03:00.787 INFO:tasks.workunit.client.0.smithi049.stdout:1/201: dread d1/d1a/f25 [0,4194304] 0 2024-06-03T00:03:00.787 INFO:tasks.workunit.client.0.smithi049.stdout:6/161: write d2/f11 [8760385,7981] 0 2024-06-03T00:03:00.787 INFO:tasks.workunit.client.0.smithi049.stdout:6/162: chown d2/l39 648 1 2024-06-03T00:03:00.787 INFO:tasks.workunit.client.0.smithi049.stdout:6/163: chown d2/d3/d9/d23/d29/d30/d28/f8 28 1 2024-06-03T00:03:00.787 INFO:tasks.workunit.client.0.smithi049.stdout:4/142: dwrite d4/d10/d14/d15/f18 [0,4194304] 0 2024-06-03T00:03:00.787 INFO:tasks.workunit.client.0.smithi049.stdout:1/202: write d1/d1a/f25 [260473,44261] 0 2024-06-03T00:03:00.787 INFO:tasks.workunit.client.0.smithi049.stdout:6/164: symlink d2/d3/d9/l3a 0 2024-06-03T00:03:00.789 INFO:tasks.workunit.client.0.smithi049.stdout:4/143: mknod d4/d2a/c2f 0 2024-06-03T00:03:00.790 INFO:tasks.workunit.client.0.smithi049.stdout:1/203: symlink d1/d2f/d36/l4b 0 2024-06-03T00:03:00.790 INFO:tasks.workunit.client.0.smithi049.stdout:8/142: dwrite d4/d7/fc [0,4194304] 0 2024-06-03T00:03:00.791 INFO:tasks.workunit.client.0.smithi049.stdout:6/165: mkdir d2/d3b 0 2024-06-03T00:03:00.792 INFO:tasks.workunit.client.0.smithi049.stdout:4/144: rename d4/l1e to d4/d16/d1c/d24/l30 0 2024-06-03T00:03:00.792 INFO:tasks.workunit.client.0.smithi049.stdout:4/145: write d4/d16/d1c/f26 [235036,111957] 0 2024-06-03T00:03:00.792 INFO:tasks.workunit.client.0.smithi049.stdout:4/146: chown d4/d16/d1c/d24/l30 2560 1 2024-06-03T00:03:00.793 INFO:tasks.workunit.client.0.smithi049.stdout:1/204: symlink d1/d2f/d36/l4c 0 2024-06-03T00:03:00.793 INFO:tasks.workunit.client.0.smithi049.stdout:1/205: readlink d1/d2f/d36/d37/l21 0 2024-06-03T00:03:00.794 INFO:tasks.workunit.client.0.smithi049.stdout:8/143: rmdir d4/d1f 0 2024-06-03T00:03:00.795 INFO:tasks.workunit.client.0.smithi049.stdout:6/166: mknod d2/d3/d9/d23/d29/c3c 0 2024-06-03T00:03:00.796 INFO:tasks.workunit.client.0.smithi049.stdout:4/147: truncate d4/f23 3229400 0 2024-06-03T00:03:00.796 INFO:tasks.workunit.client.0.smithi049.stdout:4/148: readlink d4/d10/d14/l21 0 2024-06-03T00:03:00.797 INFO:tasks.workunit.client.0.smithi049.stdout:1/206: mknod d1/d1a/c4d 0 2024-06-03T00:03:00.797 INFO:tasks.workunit.client.0.smithi049.stdout:5/109: dwrite d3/d5/fd [4194304,4194304] 0 2024-06-03T00:03:00.797 INFO:tasks.workunit.client.0.smithi049.stdout:0/94: dwrite f3 [0,4194304] 0 2024-06-03T00:03:00.797 INFO:tasks.workunit.client.0.smithi049.stdout:9/203: dwrite d1/da/d27/d30/f34 [0,4194304] 0 2024-06-03T00:03:00.797 INFO:tasks.workunit.client.0.smithi049.stdout:8/144: mkdir d4/d7/d28/d25/d29 0 2024-06-03T00:03:00.798 INFO:tasks.workunit.client.0.smithi049.stdout:8/145: write d4/d7/f13 [1461750,56702] 0 2024-06-03T00:03:00.799 INFO:tasks.workunit.client.0.smithi049.stdout:4/149: creat d4/f31 x:0 0 0 2024-06-03T00:03:00.801 INFO:tasks.workunit.client.0.smithi049.stdout:1/207: creat d1/d2f/d36/f4e x:0 0 0 2024-06-03T00:03:00.803 INFO:tasks.workunit.client.0.smithi049.stdout:2/115: dwrite f9 [0,4194304] 0 2024-06-03T00:03:00.803 INFO:tasks.workunit.client.0.smithi049.stdout:2/116: dread - da/dd/f13 zero size 2024-06-03T00:03:00.803 INFO:tasks.workunit.client.0.smithi049.stdout:2/117: write f1 [3166563,15626] 0 2024-06-03T00:03:00.803 INFO:tasks.workunit.client.0.smithi049.stdout:2/118: fsync f4 0 2024-06-03T00:03:00.805 INFO:tasks.workunit.client.0.smithi049.stdout:5/110: rename d3/d9/f1e to d3/d11/d14/f26 0 2024-06-03T00:03:00.818 INFO:tasks.workunit.client.0.smithi049.stdout:6/167: dwrite d2/d3/d9/d23/d29/d30/f16 [0,4194304] 0 2024-06-03T00:03:00.828 INFO:tasks.workunit.client.0.smithi049.stdout:8/146: dwrite d4/d7/f18 [0,4194304] 0 2024-06-03T00:03:00.829 INFO:tasks.workunit.client.0.smithi049.stdout:9/204: dwrite d1/d5/d1a/f1e [4194304,4194304] 0 2024-06-03T00:03:00.829 INFO:tasks.workunit.client.0.smithi049.stdout:9/205: chown d1/d5/d13/c1b 341 1 2024-06-03T00:03:00.829 INFO:tasks.workunit.client.0.smithi049.stdout:9/206: chown d1/da/d27/f3c 263518438 1 2024-06-03T00:03:00.829 INFO:tasks.workunit.client.0.smithi049.stdout:9/207: truncate d1/da/f37 772770 0 2024-06-03T00:03:00.829 INFO:tasks.workunit.client.0.smithi049.stdout:4/150: rmdir d4/d2a 39 2024-06-03T00:03:00.831 INFO:tasks.workunit.client.0.smithi049.stdout:1/208: creat d1/f4f x:0 0 0 2024-06-03T00:03:00.831 INFO:tasks.workunit.client.0.smithi049.stdout:7/110: dwrite d3/d8/f10 [0,4194304] 0 2024-06-03T00:03:00.834 INFO:tasks.workunit.client.0.smithi049.stdout:2/119: unlink da/c1b 0 2024-06-03T00:03:00.836 INFO:tasks.workunit.client.0.smithi049.stdout:5/111: creat d3/d5/da/f27 x:0 0 0 2024-06-03T00:03:00.836 INFO:tasks.workunit.client.0.smithi049.stdout:5/112: stat d3/d5 0 2024-06-03T00:03:00.837 INFO:tasks.workunit.client.0.smithi049.stdout:6/168: getdents d2/d3/d9/d23 0 2024-06-03T00:03:00.840 INFO:tasks.workunit.client.0.smithi049.stdout:8/147: creat d4/d7/f2a x:0 0 0 2024-06-03T00:03:00.840 INFO:tasks.workunit.client.0.smithi049.stdout:8/148: fdatasync d4/d7/f18 0 2024-06-03T00:03:00.840 INFO:tasks.workunit.client.0.smithi049.stdout:9/208: truncate d1/d5/f24 158856 0 2024-06-03T00:03:00.841 INFO:tasks.workunit.client.0.smithi049.stdout:4/151: symlink d4/d16/d1c/d24/l32 0 2024-06-03T00:03:00.843 INFO:tasks.workunit.client.0.smithi049.stdout:1/209: mkdir d1/d2f/d50 0 2024-06-03T00:03:00.843 INFO:tasks.workunit.client.0.smithi049.stdout:1/210: truncate d1/f3e 958203 0 2024-06-03T00:03:00.844 INFO:tasks.workunit.client.0.smithi049.stdout:7/111: link d3/c26 d3/d8/c27 0 2024-06-03T00:03:00.845 INFO:tasks.workunit.client.0.smithi049.stdout:2/120: mknod da/c20 0 2024-06-03T00:03:00.846 INFO:tasks.workunit.client.0.smithi049.stdout:5/113: creat d3/d9/f28 x:0 0 0 2024-06-03T00:03:00.846 INFO:tasks.workunit.client.0.smithi049.stdout:5/114: write d3/d11/d14/f19 [355088,23012] 0 2024-06-03T00:03:00.846 INFO:tasks.workunit.client.0.smithi049.stdout:6/169: creat d2/d3/d9/f3d x:0 0 0 2024-06-03T00:03:00.848 INFO:tasks.workunit.client.0.smithi049.stdout:8/149: mkdir d4/d7/d28/d2b 0 2024-06-03T00:03:00.848 INFO:tasks.workunit.client.0.smithi049.stdout:8/150: read - d4/d7/f22 zero size 2024-06-03T00:03:00.849 INFO:tasks.workunit.client.0.smithi049.stdout:9/209: rename d1/d5/d13/l17 to d1/d5/d1a/l3d 0 2024-06-03T00:03:00.850 INFO:tasks.workunit.client.0.smithi049.stdout:4/152: mknod d4/d2a/c33 0 2024-06-03T00:03:00.850 INFO:tasks.workunit.client.0.smithi049.stdout:4/153: chown d4/d10/l11 236497610 1 2024-06-03T00:03:00.851 INFO:tasks.workunit.client.0.smithi049.stdout:1/211: symlink d1/d2f/d36/d37/d13/d34/l51 0 2024-06-03T00:03:00.852 INFO:tasks.workunit.client.0.smithi049.stdout:7/112: creat d3/f28 x:0 0 0 2024-06-03T00:03:00.852 INFO:tasks.workunit.client.0.smithi049.stdout:7/113: getdents d3/d8/d23 0 2024-06-03T00:03:00.853 INFO:tasks.workunit.client.0.smithi049.stdout:6/170: creat d2/f3e x:0 0 0 2024-06-03T00:03:00.853 INFO:tasks.workunit.client.0.smithi049.stdout:6/171: write d2/d3/f38 [1043755,113744] 0 2024-06-03T00:03:00.853 INFO:tasks.workunit.client.0.smithi049.stdout:8/151: creat d4/d7/d28/d25/d29/f2c x:0 0 0 2024-06-03T00:03:00.855 INFO:tasks.workunit.client.0.smithi049.stdout:2/121: rename da/c1a to da/dd/df/c21 0 2024-06-03T00:03:00.855 INFO:tasks.workunit.client.0.smithi049.stdout:2/122: chown f9 286 1 2024-06-03T00:03:00.856 INFO:tasks.workunit.client.0.smithi049.stdout:3/91: sync 2024-06-03T00:03:00.857 INFO:tasks.workunit.client.0.smithi049.stdout:4/154: link d4/fd d4/d2a/f34 0 2024-06-03T00:03:00.858 INFO:tasks.workunit.client.0.smithi049.stdout:1/212: mkdir d1/d2f/d36/d37/d13/d34/d52 0 2024-06-03T00:03:00.859 INFO:tasks.workunit.client.0.smithi049.stdout:7/114: rmdir d3 39 2024-06-03T00:03:00.859 INFO:tasks.workunit.client.0.smithi049.stdout:7/115: dread - d3/f28 zero size 2024-06-03T00:03:00.860 INFO:tasks.workunit.client.0.smithi049.stdout:6/172: symlink d2/d3/d9/d23/l3f 0 2024-06-03T00:03:00.861 INFO:tasks.workunit.client.0.smithi049.stdout:8/152: mknod d4/d27/c2d 0 2024-06-03T00:03:00.861 INFO:tasks.workunit.client.0.smithi049.stdout:9/210: truncate d1/da/d27/d30/f34 1400806 0 2024-06-03T00:03:00.864 INFO:tasks.workunit.client.0.smithi049.stdout:4/155: creat d4/d16/f35 x:0 0 0 2024-06-03T00:03:00.866 INFO:tasks.workunit.client.0.smithi049.stdout:1/213: rename d1/d1a/l28 to d1/d2f/d36/d37/d13/d34/l53 0 2024-06-03T00:03:00.867 INFO:tasks.workunit.client.0.smithi049.stdout:6/173: mkdir d2/d3/d9/d40 0 2024-06-03T00:03:00.868 INFO:tasks.workunit.client.0.smithi049.stdout:1/214: dread d1/d1a/f25 [0,4194304] 0 2024-06-03T00:03:00.868 INFO:tasks.workunit.client.0.smithi049.stdout:2/123: dwrite da/f15 [0,4194304] 0 2024-06-03T00:03:00.868 INFO:tasks.workunit.client.0.smithi049.stdout:1/215: write d1/d2f/d36/d37/d13/d34/f3c [240824,122236] 0 2024-06-03T00:03:00.869 INFO:tasks.workunit.client.0.smithi049.stdout:9/211: creat d1/d5/d13/d3b/f3e x:0 0 0 2024-06-03T00:03:00.870 INFO:tasks.workunit.client.0.smithi049.stdout:4/156: symlink d4/d10/d14/l36 0 2024-06-03T00:03:00.875 INFO:tasks.workunit.client.0.smithi049.stdout:9/212: dread d1/f8 [0,4194304] 0 2024-06-03T00:03:00.875 INFO:tasks.workunit.client.0.smithi049.stdout:9/213: stat d1/da/d27/c29 0 2024-06-03T00:03:00.877 INFO:tasks.workunit.client.0.smithi049.stdout:2/124: symlink da/dd/df/l22 0 2024-06-03T00:03:00.878 INFO:tasks.workunit.client.0.smithi049.stdout:1/216: symlink d1/d2f/d36/d37/d2c/d45/l54 0 2024-06-03T00:03:00.879 INFO:tasks.workunit.client.0.smithi049.stdout:4/157: mknod d4/d16/d1c/c37 0 2024-06-03T00:03:00.879 INFO:tasks.workunit.client.0.smithi049.stdout:4/158: fdatasync d4/fc 0 2024-06-03T00:03:00.880 INFO:tasks.workunit.client.0.smithi049.stdout:7/116: rename d3/d8/c11 to d3/d6/c29 0 2024-06-03T00:03:00.881 INFO:tasks.workunit.client.0.smithi049.stdout:3/92: dwrite d2/f13 [0,4194304] 0 2024-06-03T00:03:00.882 INFO:tasks.workunit.client.0.smithi049.stdout:2/125: unlink c8 0 2024-06-03T00:03:00.883 INFO:tasks.workunit.client.0.smithi049.stdout:1/217: truncate d1/d2f/d36/d37/f29 698423 0 2024-06-03T00:03:00.884 INFO:tasks.workunit.client.0.smithi049.stdout:4/159: symlink d4/d16/d1c/l38 0 2024-06-03T00:03:00.887 INFO:tasks.workunit.client.0.smithi049.stdout:8/153: rename d4/d7/d28/f26 to d4/d7/f2e 0 2024-06-03T00:03:00.887 INFO:tasks.workunit.client.0.smithi049.stdout:8/154: fdatasync d4/d7/f10 0 2024-06-03T00:03:00.887 INFO:tasks.workunit.client.0.smithi049.stdout:8/155: dread - d4/d7/f16 zero size 2024-06-03T00:03:00.888 INFO:tasks.workunit.client.0.smithi049.stdout:7/117: truncate d3/d8/f10 959127 0 2024-06-03T00:03:00.892 INFO:tasks.workunit.client.0.smithi049.stdout:9/214: dwrite d1/da/d26/f2c [0,4194304] 0 2024-06-03T00:03:00.892 INFO:tasks.workunit.client.0.smithi049.stdout:2/126: link f4 da/dd/df/f23 0 2024-06-03T00:03:00.895 INFO:tasks.workunit.client.0.smithi049.stdout:1/218: unlink d1/d2f/d36/d37/l15 0 2024-06-03T00:03:00.895 INFO:tasks.workunit.client.0.smithi049.stdout:1/219: chown d1/d2f/d36/d37/d13/l48 36067362 1 2024-06-03T00:03:00.895 INFO:tasks.workunit.client.0.smithi049.stdout:3/93: dread d2/f13 [0,4194304] 0 2024-06-03T00:03:00.896 INFO:tasks.workunit.client.0.smithi049.stdout:7/118: creat d3/d14/f2a x:0 0 0 2024-06-03T00:03:00.896 INFO:tasks.workunit.client.0.smithi049.stdout:7/119: fsync d3/d6/f12 0 2024-06-03T00:03:00.896 INFO:tasks.workunit.client.0.smithi049.stdout:7/120: dread - d3/f28 zero size 2024-06-03T00:03:00.897 INFO:tasks.workunit.client.0.smithi049.stdout:9/215: creat d1/da/f3f x:0 0 0 2024-06-03T00:03:00.898 INFO:tasks.workunit.client.0.smithi049.stdout:9/216: fdatasync d1/da/d26/f32 0 2024-06-03T00:03:00.899 INFO:tasks.workunit.client.0.smithi049.stdout:2/127: creat da/f24 x:0 0 0 2024-06-03T00:03:00.900 INFO:tasks.workunit.client.0.smithi049.stdout:4/160: dwrite d4/d16/d1c/f26 [0,4194304] 0 2024-06-03T00:03:00.902 INFO:tasks.workunit.client.0.smithi049.stdout:3/94: unlink d2/d1a/f1b 0 2024-06-03T00:03:00.902 INFO:tasks.workunit.client.0.smithi049.stdout:3/95: read - d2/d14/f1f zero size 2024-06-03T00:03:00.903 INFO:tasks.workunit.client.0.smithi049.stdout:9/217: rename d1/d5/d13/f35 to d1/da/d27/f40 0 2024-06-03T00:03:00.904 INFO:tasks.workunit.client.0.smithi049.stdout:9/218: chown d1/d5/c36 24614492 1 2024-06-03T00:03:00.905 INFO:tasks.workunit.client.0.smithi049.stdout:8/156: dwrite d4/d7/f1b [0,4194304] 0 2024-06-03T00:03:00.906 INFO:tasks.workunit.client.0.smithi049.stdout:1/220: dread d1/d2f/d36/d37/f16 [0,4194304] 0 2024-06-03T00:03:00.909 INFO:tasks.workunit.client.0.smithi049.stdout:4/161: unlink d4/fa 0 2024-06-03T00:03:00.910 INFO:tasks.workunit.client.0.smithi049.stdout:3/96: rmdir d2/d1a 39 2024-06-03T00:03:00.912 INFO:tasks.workunit.client.0.smithi049.stdout:8/157: creat d4/d7/d28/d25/d29/f2f x:0 0 0 2024-06-03T00:03:00.914 INFO:tasks.workunit.client.0.smithi049.stdout:1/221: getdents d1/d2f/d36/d37/d13/d34 0 2024-06-03T00:03:00.914 INFO:tasks.workunit.client.0.smithi049.stdout:1/222: stat d1/d2f/d36/d37/f16 0 2024-06-03T00:03:00.914 INFO:tasks.workunit.client.0.smithi049.stdout:1/223: truncate d1/d2f/d36/d37/f22 619903 0 2024-06-03T00:03:00.915 INFO:tasks.workunit.client.0.smithi049.stdout:9/219: dread d1/d5/d13/f16 [0,4194304] 0 2024-06-03T00:03:00.915 INFO:tasks.workunit.client.0.smithi049.stdout:3/97: truncate d2/f11 452933 0 2024-06-03T00:03:00.916 INFO:tasks.workunit.client.0.smithi049.stdout:8/158: mkdir d4/d27/d30 0 2024-06-03T00:03:00.917 INFO:tasks.workunit.client.0.smithi049.stdout:8/159: chown l3 0 1 2024-06-03T00:03:00.918 INFO:tasks.workunit.client.0.smithi049.stdout:9/220: link d1/d5/d13/f16 d1/d5/d13/d3b/f41 0 2024-06-03T00:03:00.919 INFO:tasks.workunit.client.0.smithi049.stdout:2/128: dwrite f1 [0,4194304] 0 2024-06-03T00:03:00.919 INFO:tasks.workunit.client.0.smithi049.stdout:2/129: readlink da/l17 0 2024-06-03T00:03:00.919 INFO:tasks.workunit.client.0.smithi049.stdout:4/162: getdents d4/d16/d1c 0 2024-06-03T00:03:00.921 INFO:tasks.workunit.client.0.smithi049.stdout:8/160: creat d4/d27/d30/f31 x:0 0 0 2024-06-03T00:03:00.921 INFO:tasks.workunit.client.0.smithi049.stdout:7/121: write d3/d8/f10 [1791119,99191] 0 2024-06-03T00:03:00.923 INFO:tasks.workunit.client.0.smithi049.stdout:1/224: write d1/d2f/d36/d37/d13/f27 [1268026,37693] 0 2024-06-03T00:03:00.924 INFO:tasks.workunit.client.0.smithi049.stdout:9/221: rename d1/d5/d13/d3b/f3e to d1/da/f42 0 2024-06-03T00:03:00.924 INFO:tasks.workunit.client.0.smithi049.stdout:9/222: write d1/d5/f1d [314704,14045] 0 2024-06-03T00:03:00.924 INFO:tasks.workunit.client.0.smithi049.stdout:9/223: write d1/d5/d13/d3b/f41 [4372378,86491] 0 2024-06-03T00:03:00.924 INFO:tasks.workunit.client.0.smithi049.stdout:9/224: getdents d1/da/d27/d30 0 2024-06-03T00:03:00.924 INFO:tasks.workunit.client.0.smithi049.stdout:4/163: dread d4/fd [0,4194304] 0 2024-06-03T00:03:00.931 INFO:tasks.workunit.client.0.smithi049.stdout:2/130: fsync da/dd/df/f23 0 2024-06-03T00:03:00.931 INFO:tasks.workunit.client.0.smithi049.stdout:2/131: chown da 521648 1 2024-06-03T00:03:00.931 INFO:tasks.workunit.client.0.smithi049.stdout:7/122: creat d3/d6/d9/f2b x:0 0 0 2024-06-03T00:03:00.931 INFO:tasks.workunit.client.0.smithi049.stdout:7/123: chown d3/d6/f1c 5 1 2024-06-03T00:03:00.932 INFO:tasks.workunit.client.0.smithi049.stdout:8/161: dread d4/d7/f18 [0,4194304] 0 2024-06-03T00:03:00.932 INFO:tasks.workunit.client.0.smithi049.stdout:8/162: write d4/d7/f1e [531674,115122] 0 2024-06-03T00:03:00.932 INFO:tasks.workunit.client.0.smithi049.stdout:8/163: write d4/d7/f14 [535775,12893] 0 2024-06-03T00:03:00.933 INFO:tasks.workunit.client.0.smithi049.stdout:1/225: rename d1/d2f/d36/d37/d13/l2e to d1/d2f/d36/d37/d13/d34/l55 0 2024-06-03T00:03:00.934 INFO:tasks.workunit.client.0.smithi049.stdout:9/225: rmdir d1/da/d27/d30 39 2024-06-03T00:03:00.935 INFO:tasks.workunit.client.0.smithi049.stdout:9/226: getdents d1/da/d27/d30 0 2024-06-03T00:03:00.935 INFO:tasks.workunit.client.0.smithi049.stdout:4/164: dread d4/d16/d1c/f2c [0,4194304] 0 2024-06-03T00:03:00.937 INFO:tasks.workunit.client.0.smithi049.stdout:7/124: getdents d3/d14 0 2024-06-03T00:03:00.941 INFO:tasks.workunit.client.0.smithi049.stdout:2/132: dwrite da/f15 [0,4194304] 0 2024-06-03T00:03:00.942 INFO:tasks.workunit.client.0.smithi049.stdout:1/226: mkdir d1/d2f/d36/d37/d13/d56 0 2024-06-03T00:03:00.943 INFO:tasks.workunit.client.0.smithi049.stdout:1/227: write d1/d1a/f30 [990080,36933] 0 2024-06-03T00:03:00.943 INFO:tasks.workunit.client.0.smithi049.stdout:1/228: read - d1/d2f/d36/d37/d13/f20 zero size 2024-06-03T00:03:00.943 INFO:tasks.workunit.client.0.smithi049.stdout:0/95: sync 2024-06-03T00:03:00.943 INFO:tasks.workunit.client.0.smithi049.stdout:0/96: fsync f3 0 2024-06-03T00:03:00.945 INFO:tasks.workunit.client.0.smithi049.stdout:9/227: creat d1/da/d26/f43 x:0 0 0 2024-06-03T00:03:00.946 INFO:tasks.workunit.client.0.smithi049.stdout:7/125: mknod d3/d14/c2c 0 2024-06-03T00:03:00.950 INFO:tasks.workunit.client.0.smithi049.stdout:9/228: dread d1/da/d27/d30/f34 [0,4194304] 0 2024-06-03T00:03:00.950 INFO:tasks.workunit.client.0.smithi049.stdout:9/229: readlink d1/l11 0 2024-06-03T00:03:00.951 INFO:tasks.workunit.client.0.smithi049.stdout:8/164: symlink d4/l32 0 2024-06-03T00:03:00.951 INFO:tasks.workunit.client.0.smithi049.stdout:8/165: write d4/d7/f13 [1706935,69355] 0 2024-06-03T00:03:00.952 INFO:tasks.workunit.client.0.smithi049.stdout:2/133: read f1 [1462170,112512] 0 2024-06-03T00:03:00.954 INFO:tasks.workunit.client.0.smithi049.stdout:7/126: stat d3/c26 0 2024-06-03T00:03:00.955 INFO:tasks.workunit.client.0.smithi049.stdout:0/97: mknod d6/d18/c1d 0 2024-06-03T00:03:00.956 INFO:tasks.workunit.client.0.smithi049.stdout:2/134: creat da/f25 x:0 0 0 2024-06-03T00:03:00.956 INFO:tasks.workunit.client.0.smithi049.stdout:9/230: dread d1/d5/d13/f16 [0,4194304] 0 2024-06-03T00:03:00.958 INFO:tasks.workunit.client.0.smithi049.stdout:7/127: symlink d3/d14/l2d 0 2024-06-03T00:03:00.958 INFO:tasks.workunit.client.0.smithi049.stdout:8/166: dread d4/d7/f1b [0,4194304] 0 2024-06-03T00:03:00.958 INFO:tasks.workunit.client.0.smithi049.stdout:8/167: fsync d4/d7/f11 0 2024-06-03T00:03:00.961 INFO:tasks.workunit.client.0.smithi049.stdout:2/135: rename da/f25 to da/dd/f26 0 2024-06-03T00:03:00.962 INFO:tasks.workunit.client.0.smithi049.stdout:7/128: rmdir d3/d6/d9 39 2024-06-03T00:03:00.963 INFO:tasks.workunit.client.0.smithi049.stdout:7/129: mknod d3/d8/c2e 0 2024-06-03T00:03:00.964 INFO:tasks.workunit.client.0.smithi049.stdout:7/130: creat d3/d8/d17/f2f x:0 0 0 2024-06-03T00:03:00.965 INFO:tasks.workunit.client.0.smithi049.stdout:9/231: dread d1/d5/d1a/f1e [4194304,4194304] 0 2024-06-03T00:03:00.965 INFO:tasks.workunit.client.0.smithi049.stdout:9/232: chown d1/l19 6 1 2024-06-03T00:03:00.966 INFO:tasks.workunit.client.0.smithi049.stdout:7/131: creat d3/f30 x:0 0 0 2024-06-03T00:03:00.966 INFO:tasks.workunit.client.0.smithi049.stdout:7/132: dread - d3/d6/d9/f2b zero size 2024-06-03T00:03:00.967 INFO:tasks.workunit.client.0.smithi049.stdout:9/233: creat d1/f44 x:0 0 0 2024-06-03T00:03:00.969 INFO:tasks.workunit.client.0.smithi049.stdout:9/234: symlink d1/da/d27/l45 0 2024-06-03T00:03:00.969 INFO:tasks.workunit.client.0.smithi049.stdout:9/235: mknod d1/d5/c46 0 2024-06-03T00:03:00.970 INFO:tasks.workunit.client.0.smithi049.stdout:9/236: symlink d1/da/d27/l47 0 2024-06-03T00:03:00.970 INFO:tasks.workunit.client.0.smithi049.stdout:9/237: stat d1/da/d26/c3a 0 2024-06-03T00:03:00.972 INFO:tasks.workunit.client.0.smithi049.stdout:9/238: rename d1/d5/f2a to d1/d5/d13/d3b/f48 0 2024-06-03T00:03:00.972 INFO:tasks.workunit.client.0.smithi049.stdout:9/239: chown d1/d5/d13 547470 1 2024-06-03T00:03:00.973 INFO:tasks.workunit.client.0.smithi049.stdout:9/240: unlink d1/da/d26/f2c 0 2024-06-03T00:03:00.975 INFO:tasks.workunit.client.0.smithi049.stdout:5/115: sync 2024-06-03T00:03:00.976 INFO:tasks.workunit.client.0.smithi049.stdout:5/116: rmdir d3/d9/d20 39 2024-06-03T00:03:00.977 INFO:tasks.workunit.client.0.smithi049.stdout:5/117: truncate d3/d11/d14/f1c 693937 0 2024-06-03T00:03:00.977 INFO:tasks.workunit.client.0.smithi049.stdout:5/118: chown d3/d9/f28 5 1 2024-06-03T00:03:00.978 INFO:tasks.workunit.client.0.smithi049.stdout:5/119: creat d3/d11/d14/f29 x:0 0 0 2024-06-03T00:03:00.990 INFO:tasks.workunit.client.0.smithi049.stdout:5/120: dwrite d3/d11/d14/f26 [0,4194304] 0 2024-06-03T00:03:00.990 INFO:tasks.workunit.client.0.smithi049.stdout:5/121: chown d3/d5/da/f15 783 1 2024-06-03T00:03:00.992 INFO:tasks.workunit.client.0.smithi049.stdout:5/122: link d3/d11/f21 d3/d11/d14/f2a 0 2024-06-03T00:03:00.993 INFO:tasks.workunit.client.0.smithi049.stdout:5/123: creat d3/d5/da/f2b x:0 0 0 2024-06-03T00:03:00.994 INFO:tasks.workunit.client.0.smithi049.stdout:5/124: creat d3/d11/d14/d16/f2c x:0 0 0 2024-06-03T00:03:00.995 INFO:tasks.workunit.client.0.smithi049.stdout:9/241: dwrite d1/da/d26/f32 [0,4194304] 0 2024-06-03T00:03:00.995 INFO:tasks.workunit.client.0.smithi049.stdout:9/242: dread - d1/da/d27/f40 zero size 2024-06-03T00:03:00.995 INFO:tasks.workunit.client.0.smithi049.stdout:5/125: rmdir d3/d11/d14 39 2024-06-03T00:03:00.997 INFO:tasks.workunit.client.0.smithi049.stdout:5/126: dread d3/d11/f18 [0,4194304] 0 2024-06-03T00:03:00.997 INFO:tasks.workunit.client.0.smithi049.stdout:5/127: chown d3/d5/da 180 1 2024-06-03T00:03:00.998 INFO:tasks.workunit.client.0.smithi049.stdout:5/128: mkdir d3/d5/d2d 0 2024-06-03T00:03:01.000 INFO:tasks.workunit.client.0.smithi049.stdout:5/129: rename d3/d11/d14/f8 to d3/d9/d20/f2e 0 2024-06-03T00:03:01.001 INFO:tasks.workunit.client.0.smithi049.stdout:9/243: dread d1/d5/d13/f16 [0,4194304] 0 2024-06-03T00:03:01.003 INFO:tasks.workunit.client.0.smithi049.stdout:9/244: rename d1/d5/d13/d38 to d1/d5/d13/d3b/d49 0 2024-06-03T00:03:01.005 INFO:tasks.workunit.client.0.smithi049.stdout:9/245: dread d1/d5/f24 [0,4194304] 0 2024-06-03T00:03:01.016 INFO:tasks.workunit.client.0.smithi049.stdout:5/130: dwrite d3/d5/da/f15 [0,4194304] 0 2024-06-03T00:03:01.019 INFO:tasks.workunit.client.0.smithi049.stdout:5/131: symlink d3/d11/l2f 0 2024-06-03T00:03:01.019 INFO:tasks.workunit.client.0.smithi049.stdout:5/132: write d3/d5/da/f1b [353905,37110] 0 2024-06-03T00:03:01.019 INFO:tasks.workunit.client.0.smithi049.stdout:5/133: fsync d3/d11/d14/f19 0 2024-06-03T00:03:01.024 INFO:tasks.workunit.client.0.smithi049.stdout:9/246: dwrite d1/d5/d13/d3b/f48 [4194304,4194304] 0 2024-06-03T00:03:01.027 INFO:tasks.workunit.client.0.smithi049.stdout:9/247: write d1/da/d27/d30/f34 [142232,74215] 0 2024-06-03T00:03:01.037 INFO:tasks.workunit.client.0.smithi049.stdout:6/174: sync 2024-06-03T00:03:01.038 INFO:tasks.workunit.client.0.smithi049.stdout:3/98: sync 2024-06-03T00:03:01.038 INFO:tasks.workunit.client.0.smithi049.stdout:6/175: fsync d2/d3/f38 0 2024-06-03T00:03:01.038 INFO:tasks.workunit.client.0.smithi049.stdout:5/134: dwrite d3/d5/da/f1d [0,4194304] 0 2024-06-03T00:03:01.038 INFO:tasks.workunit.client.0.smithi049.stdout:5/135: write d3/d5/da/f27 [943640,86370] 0 2024-06-03T00:03:01.038 INFO:tasks.workunit.client.0.smithi049.stdout:6/176: creat d2/d3/d9/d23/d29/f41 x:0 0 0 2024-06-03T00:03:01.038 INFO:tasks.workunit.client.0.smithi049.stdout:6/177: chown d2/d3/d9/d23/d29/d30/d28/c1c 50111 1 2024-06-03T00:03:01.039 INFO:tasks.workunit.client.0.smithi049.stdout:5/136: truncate d3/d5/da/f15 866687 0 2024-06-03T00:03:01.040 INFO:tasks.workunit.client.0.smithi049.stdout:5/137: mkdir d3/d11/d14/d30 0 2024-06-03T00:03:01.040 INFO:tasks.workunit.client.0.smithi049.stdout:5/138: readlink d3/d11/d14/l22 0 2024-06-03T00:03:01.041 INFO:tasks.workunit.client.0.smithi049.stdout:5/139: mknod d3/d5/d24/c31 0 2024-06-03T00:03:01.043 INFO:tasks.workunit.client.0.smithi049.stdout:3/99: dread d2/f13 [0,4194304] 0 2024-06-03T00:03:01.044 INFO:tasks.workunit.client.0.smithi049.stdout:3/100: mkdir d2/d14/d22 0 2024-06-03T00:03:01.050 INFO:tasks.workunit.client.0.smithi049.stdout:5/140: dread d3/d5/da/f27 [0,4194304] 0 2024-06-03T00:03:01.052 INFO:tasks.workunit.client.0.smithi049.stdout:5/141: symlink d3/l32 0 2024-06-03T00:03:01.052 INFO:tasks.workunit.client.0.smithi049.stdout:5/142: fsync d3/d11/d14/f19 0 2024-06-03T00:03:01.052 INFO:tasks.workunit.client.0.smithi049.stdout:5/143: chown d3/cc 77 1 2024-06-03T00:03:01.052 INFO:tasks.workunit.client.0.smithi049.stdout:5/144: write d3/d9/f13 [642601,59481] 0 2024-06-03T00:03:01.053 INFO:tasks.workunit.client.0.smithi049.stdout:5/145: symlink d3/d5/d24/l33 0 2024-06-03T00:03:01.053 INFO:tasks.workunit.client.0.smithi049.stdout:5/146: dread - d3/d11/d14/d16/f25 zero size 2024-06-03T00:03:01.054 INFO:tasks.workunit.client.0.smithi049.stdout:5/147: write d3/d9/f13 [1258529,122934] 0 2024-06-03T00:03:01.054 INFO:tasks.workunit.client.0.smithi049.stdout:6/178: dwrite d2/d3/d9/d23/d29/f32 [0,4194304] 0 2024-06-03T00:03:01.054 INFO:tasks.workunit.client.0.smithi049.stdout:6/179: fdatasync d2/d3/d9/d23/d29/f41 0 2024-06-03T00:03:01.054 INFO:tasks.workunit.client.0.smithi049.stdout:6/180: fdatasync d2/d3/d9/f3d 0 2024-06-03T00:03:01.055 INFO:tasks.workunit.client.0.smithi049.stdout:6/181: rmdir d2/d3/d9/d2a 0 2024-06-03T00:03:01.055 INFO:tasks.workunit.client.0.smithi049.stdout:6/182: readlink d2/l13 0 2024-06-03T00:03:01.062 INFO:tasks.workunit.client.0.smithi049.stdout:6/183: read d2/d3/d9/d23/f1e [399806,87750] 0 2024-06-03T00:03:01.065 INFO:tasks.workunit.client.0.smithi049.stdout:6/184: rename d2/d37 to d2/d3/d9/d23/d42 0 2024-06-03T00:03:01.066 INFO:tasks.workunit.client.0.smithi049.stdout:6/185: getdents d2/d3/d9/d23/d29 0 2024-06-03T00:03:01.075 INFO:tasks.workunit.client.0.smithi049.stdout:6/186: write d2/d3/d9/d23/d29/d30/d28/f8 [821577,29030] 0 2024-06-03T00:03:01.075 INFO:tasks.workunit.client.0.smithi049.stdout:3/101: dwrite d2/fd [0,4194304] 0 2024-06-03T00:03:01.076 INFO:tasks.workunit.client.0.smithi049.stdout:3/102: fdatasync d2/f11 0 2024-06-03T00:03:01.076 INFO:tasks.workunit.client.0.smithi049.stdout:6/187: read d2/d3/d9/d23/f1a [748387,32265] 0 2024-06-03T00:03:01.077 INFO:tasks.workunit.client.0.smithi049.stdout:6/188: dread d2/d3/d9/d23/f1a [0,4194304] 0 2024-06-03T00:03:01.079 INFO:tasks.workunit.client.0.smithi049.stdout:6/189: rename d2/d3/d9/d23/d29/d30/d28/f20 to d2/d3/d9/d23/d29/d30/f43 0 2024-06-03T00:03:01.080 INFO:tasks.workunit.client.0.smithi049.stdout:6/190: mknod d2/d3/d9/d23/d36/c44 0 2024-06-03T00:03:01.080 INFO:tasks.workunit.client.0.smithi049.stdout:5/148: dwrite d3/d11/f18 [0,4194304] 0 2024-06-03T00:03:01.080 INFO:tasks.workunit.client.0.smithi049.stdout:6/191: rmdir d2/d3/d17 39 2024-06-03T00:03:01.088 INFO:tasks.workunit.client.0.smithi049.stdout:6/192: creat d2/d3/d9/d23/d36/f45 x:0 0 0 2024-06-03T00:03:01.088 INFO:tasks.workunit.client.0.smithi049.stdout:3/103: dread d2/f15 [0,4194304] 0 2024-06-03T00:03:01.091 INFO:tasks.workunit.client.0.smithi049.stdout:3/104: getdents d2/d1a 0 2024-06-03T00:03:01.094 INFO:tasks.workunit.client.0.smithi049.stdout:3/105: rename d2/c3 to d2/d14/c23 0 2024-06-03T00:03:01.094 INFO:tasks.workunit.client.0.smithi049.stdout:3/106: chown d2/d8/l18 161240 1 2024-06-03T00:03:01.095 INFO:tasks.workunit.client.0.smithi049.stdout:1/229: sync 2024-06-03T00:03:01.095 INFO:tasks.workunit.client.0.smithi049.stdout:8/168: sync 2024-06-03T00:03:01.095 INFO:tasks.workunit.client.0.smithi049.stdout:0/98: sync 2024-06-03T00:03:01.095 INFO:tasks.workunit.client.0.smithi049.stdout:9/248: sync 2024-06-03T00:03:01.095 INFO:tasks.workunit.client.0.smithi049.stdout:4/165: sync 2024-06-03T00:03:01.096 INFO:tasks.workunit.client.0.smithi049.stdout:2/136: sync 2024-06-03T00:03:01.096 INFO:tasks.workunit.client.0.smithi049.stdout:7/133: sync 2024-06-03T00:03:01.096 INFO:tasks.workunit.client.0.smithi049.stdout:9/249: write d1/f44 [1018925,56748] 0 2024-06-03T00:03:01.096 INFO:tasks.workunit.client.0.smithi049.stdout:9/250: fsync d1/da/d26/f32 0 2024-06-03T00:03:01.097 INFO:tasks.workunit.client.0.smithi049.stdout:1/230: rmdir d1/d2f/d36/d37/d13/d56 0 2024-06-03T00:03:01.098 INFO:tasks.workunit.client.0.smithi049.stdout:0/99: unlink d6/c7 0 2024-06-03T00:03:01.099 INFO:tasks.workunit.client.0.smithi049.stdout:8/169: symlink d4/d27/l33 0 2024-06-03T00:03:01.100 INFO:tasks.workunit.client.0.smithi049.stdout:7/134: unlink d3/d6/l18 0 2024-06-03T00:03:01.100 INFO:tasks.workunit.client.0.smithi049.stdout:7/135: read - d3/f28 zero size 2024-06-03T00:03:01.101 INFO:tasks.workunit.client.0.smithi049.stdout:9/251: rename d1/d5/f1d to d1/d5/d13/d3b/f4a 0 2024-06-03T00:03:01.102 INFO:tasks.workunit.client.0.smithi049.stdout:1/231: write d1/d2f/d36/d37/f16 [5843817,56040] 0 2024-06-03T00:03:01.102 INFO:tasks.workunit.client.0.smithi049.stdout:5/149: dwrite d3/d5/da/f15 [0,4194304] 0 2024-06-03T00:03:01.102 INFO:tasks.workunit.client.0.smithi049.stdout:5/150: truncate d3/d5/da/f2b 41260 0 2024-06-03T00:03:01.103 INFO:tasks.workunit.client.0.smithi049.stdout:6/193: dread d2/f11 [4194304,4194304] 0 2024-06-03T00:03:01.103 INFO:tasks.workunit.client.0.smithi049.stdout:7/136: unlink d3/d8/c27 0 2024-06-03T00:03:01.104 INFO:tasks.workunit.client.0.smithi049.stdout:8/170: rename d4/d7/f2e to d4/d7/d28/d25/f34 0 2024-06-03T00:03:01.105 INFO:tasks.workunit.client.0.smithi049.stdout:9/252: rmdir d1/da/d26 39 2024-06-03T00:03:01.105 INFO:tasks.workunit.client.0.smithi049.stdout:9/253: chown d1/da/d27/l45 526954685 1 2024-06-03T00:03:01.107 INFO:tasks.workunit.client.0.smithi049.stdout:1/232: unlink d1/d2f/d36/d37/f29 0 2024-06-03T00:03:01.108 INFO:tasks.workunit.client.0.smithi049.stdout:3/107: write d2/fd [1658739,56900] 0 2024-06-03T00:03:01.108 INFO:tasks.workunit.client.0.smithi049.stdout:5/151: rmdir d3/d5/d24 39 2024-06-03T00:03:01.109 INFO:tasks.workunit.client.0.smithi049.stdout:9/254: dread d1/da/d27/d30/f34 [0,4194304] 0 2024-06-03T00:03:01.109 INFO:tasks.workunit.client.0.smithi049.stdout:9/255: chown d1/d5/d1a/f1e 420478 1 2024-06-03T00:03:01.109 INFO:tasks.workunit.client.0.smithi049.stdout:7/137: mknod d3/d6/d9/c31 0 2024-06-03T00:03:01.111 INFO:tasks.workunit.client.0.smithi049.stdout:6/194: rename d2/d3/d9/d23/d29/d30/d28/f8 to d2/d3/d17/f46 0 2024-06-03T00:03:01.113 INFO:tasks.workunit.client.0.smithi049.stdout:1/233: mkdir d1/d2f/d36/d57 0 2024-06-03T00:03:01.113 INFO:tasks.workunit.client.0.smithi049.stdout:7/138: dread d3/d6/f1c [0,4194304] 0 2024-06-03T00:03:01.113 INFO:tasks.workunit.client.0.smithi049.stdout:3/108: rmdir d2/d14 39 2024-06-03T00:03:01.115 INFO:tasks.workunit.client.0.smithi049.stdout:9/256: link d1/fb d1/d5/d13/f4b 0 2024-06-03T00:03:01.116 INFO:tasks.workunit.client.0.smithi049.stdout:7/139: mkdir d3/d32 0 2024-06-03T00:03:01.116 INFO:tasks.workunit.client.0.smithi049.stdout:7/140: dread - d3/d8/d17/f2f zero size 2024-06-03T00:03:01.118 INFO:tasks.workunit.client.0.smithi049.stdout:3/109: link d2/d14/f1c d2/d14/f24 0 2024-06-03T00:03:01.120 INFO:tasks.workunit.client.0.smithi049.stdout:2/137: dwrite f4 [4194304,4194304] 0 2024-06-03T00:03:01.120 INFO:tasks.workunit.client.0.smithi049.stdout:9/257: rename d1/d5/d1a/f1e to d1/da/d27/d30/f4c 0 2024-06-03T00:03:01.122 INFO:tasks.workunit.client.0.smithi049.stdout:7/141: mknod d3/d8/c33 0 2024-06-03T00:03:01.123 INFO:tasks.workunit.client.0.smithi049.stdout:3/110: mkdir d2/d14/d22/d25 0 2024-06-03T00:03:01.124 INFO:tasks.workunit.client.0.smithi049.stdout:5/152: write d3/d5/da/f1d [1354963,8492] 0 2024-06-03T00:03:01.124 INFO:tasks.workunit.client.0.smithi049.stdout:4/166: dwrite d4/d16/d1c/f2c [0,4194304] 0 2024-06-03T00:03:01.127 INFO:tasks.workunit.client.0.smithi049.stdout:7/142: rename d3/f28 to d3/d8/f34 0 2024-06-03T00:03:01.134 INFO:tasks.workunit.client.0.smithi049.stdout:5/153: rmdir d3/d5 39 2024-06-03T00:03:01.134 INFO:tasks.workunit.client.0.smithi049.stdout:4/167: rename d4/d16/d1c/f26 to d4/d16/d1c/f39 0 2024-06-03T00:03:01.134 INFO:tasks.workunit.client.0.smithi049.stdout:4/168: readlink d4/d10/l19 0 2024-06-03T00:03:01.135 INFO:tasks.workunit.client.0.smithi049.stdout:8/171: unlink d4/d7/d28/d25/f34 0 2024-06-03T00:03:01.136 INFO:tasks.workunit.client.0.smithi049.stdout:3/111: mkdir d2/d26 0 2024-06-03T00:03:01.138 INFO:tasks.workunit.client.0.smithi049.stdout:1/234: dwrite d1/d2f/d36/d37/d13/f20 [0,4194304] 0 2024-06-03T00:03:01.138 INFO:tasks.workunit.client.0.smithi049.stdout:0/100: dwrite f3 [4194304,4194304] 0 2024-06-03T00:03:01.141 INFO:tasks.workunit.client.0.smithi049.stdout:9/258: dwrite d1/da/d27/f3c [0,4194304] 0 2024-06-03T00:03:01.141 INFO:tasks.workunit.client.0.smithi049.stdout:5/154: creat d3/d11/d14/d16/f34 x:0 0 0 2024-06-03T00:03:01.141 INFO:tasks.workunit.client.0.smithi049.stdout:6/195: dwrite d2/d3/d9/d23/d36/f45 [0,4194304] 0 2024-06-03T00:03:01.143 INFO:tasks.workunit.client.0.smithi049.stdout:4/169: getdents d4 0 2024-06-03T00:03:01.145 INFO:tasks.workunit.client.0.smithi049.stdout:3/112: chown d2/cc 4 1 2024-06-03T00:03:01.149 INFO:tasks.workunit.client.0.smithi049.stdout:2/138: dwrite da/dd/f13 [0,4194304] 0 2024-06-03T00:03:01.149 INFO:tasks.workunit.client.0.smithi049.stdout:2/139: stat da/c1e 0 2024-06-03T00:03:01.150 INFO:tasks.workunit.client.0.smithi049.stdout:0/101: write d6/f17 [810605,11865] 0 2024-06-03T00:03:01.152 INFO:tasks.workunit.client.0.smithi049.stdout:1/235: mknod d1/d2f/d36/d37/d13/d34/d52/c58 0 2024-06-03T00:03:01.154 INFO:tasks.workunit.client.0.smithi049.stdout:3/113: dread d2/fd [0,4194304] 0 2024-06-03T00:03:01.154 INFO:tasks.workunit.client.0.smithi049.stdout:9/259: mknod d1/d5/d13/c4d 0 2024-06-03T00:03:01.156 INFO:tasks.workunit.client.0.smithi049.stdout:5/155: truncate d3/d5/da/f15 1267131 0 2024-06-03T00:03:01.159 INFO:tasks.workunit.client.0.smithi049.stdout:6/196: mknod d2/d3/d9/d23/d29/d30/d28/c47 0 2024-06-03T00:03:01.159 INFO:tasks.workunit.client.0.smithi049.stdout:6/197: write d2/d3/d9/d23/d29/f2d [276177,94232] 0 2024-06-03T00:03:01.160 INFO:tasks.workunit.client.0.smithi049.stdout:4/170: dwrite d4/d16/d1c/f25 [0,4194304] 0 2024-06-03T00:03:01.160 INFO:tasks.workunit.client.0.smithi049.stdout:4/171: chown d4/l29 0 1 2024-06-03T00:03:01.162 INFO:tasks.workunit.client.0.smithi049.stdout:0/102: dread f2 [0,4194304] 0 2024-06-03T00:03:01.162 INFO:tasks.workunit.client.0.smithi049.stdout:8/172: dwrite d4/d7/d28/d25/d29/f2c [0,4194304] 0 2024-06-03T00:03:01.164 INFO:tasks.workunit.client.0.smithi049.stdout:1/236: symlink d1/d2f/d36/l59 0 2024-06-03T00:03:01.165 INFO:tasks.workunit.client.0.smithi049.stdout:2/140: read f9 [43330,15168] 0 2024-06-03T00:03:01.165 INFO:tasks.workunit.client.0.smithi049.stdout:2/141: fsync da/f1c 0 2024-06-03T00:03:01.166 INFO:tasks.workunit.client.0.smithi049.stdout:9/260: creat d1/d5/d1a/f4e x:0 0 0 2024-06-03T00:03:01.168 INFO:tasks.workunit.client.0.smithi049.stdout:5/156: unlink d3/d11/d14/f1c 0 2024-06-03T00:03:01.170 INFO:tasks.workunit.client.0.smithi049.stdout:4/172: mknod d4/d10/c3a 0 2024-06-03T00:03:01.171 INFO:tasks.workunit.client.0.smithi049.stdout:3/114: dwrite d2/d14/f1c [0,4194304] 0 2024-06-03T00:03:01.174 INFO:tasks.workunit.client.0.smithi049.stdout:9/261: creat d1/da/d26/f4f x:0 0 0 2024-06-03T00:03:01.177 INFO:tasks.workunit.client.0.smithi049.stdout:5/157: unlink d3/d11/f18 0 2024-06-03T00:03:01.183 INFO:tasks.workunit.client.0.smithi049.stdout:9/262: write d1/da/d27/d30/f4c [6279223,16149] 0 2024-06-03T00:03:01.183 INFO:tasks.workunit.client.0.smithi049.stdout:9/263: fdatasync d1/d5/d13/d3b/f4a 0 2024-06-03T00:03:01.183 INFO:tasks.workunit.client.0.smithi049.stdout:9/264: stat d1/d5/d13/l1c 0 2024-06-03T00:03:01.183 INFO:tasks.workunit.client.0.smithi049.stdout:9/265: truncate d1/da/d26/f32 4626756 0 2024-06-03T00:03:01.183 INFO:tasks.workunit.client.0.smithi049.stdout:5/158: mknod d3/d5/da/c35 0 2024-06-03T00:03:01.183 INFO:tasks.workunit.client.0.smithi049.stdout:5/159: read d3/d5/da/f1b [219495,19374] 0 2024-06-03T00:03:01.184 INFO:tasks.workunit.client.0.smithi049.stdout:0/103: rename d6/d18/c1c to d6/d18/c1e 0 2024-06-03T00:03:01.186 INFO:tasks.workunit.client.0.smithi049.stdout:3/115: dread d2/f13 [0,4194304] 0 2024-06-03T00:03:01.186 INFO:tasks.workunit.client.0.smithi049.stdout:0/104: creat d6/d18/d19/f1f x:0 0 0 2024-06-03T00:03:01.186 INFO:tasks.workunit.client.0.smithi049.stdout:0/105: readlink l5 0 2024-06-03T00:03:01.186 INFO:tasks.workunit.client.0.smithi049.stdout:0/106: chown d6/d18/d19/l1b 47 1 2024-06-03T00:03:01.186 INFO:tasks.workunit.client.0.smithi049.stdout:3/116: symlink d2/d26/l27 0 2024-06-03T00:03:01.187 INFO:tasks.workunit.client.0.smithi049.stdout:3/117: dread - d2/d14/f1f zero size 2024-06-03T00:03:01.187 INFO:tasks.workunit.client.0.smithi049.stdout:0/107: symlink d6/d18/d19/l20 0 2024-06-03T00:03:01.188 INFO:tasks.workunit.client.0.smithi049.stdout:3/118: symlink d2/d14/d22/l28 0 2024-06-03T00:03:01.188 INFO:tasks.workunit.client.0.smithi049.stdout:3/119: write d2/f11 [937823,31039] 0 2024-06-03T00:03:01.188 INFO:tasks.workunit.client.0.smithi049.stdout:3/120: write d2/f11 [1787533,98393] 0 2024-06-03T00:03:01.188 INFO:tasks.workunit.client.0.smithi049.stdout:3/121: chown d2/d14/l17 4326 1 2024-06-03T00:03:01.188 INFO:tasks.workunit.client.0.smithi049.stdout:3/122: write d2/d8/f1e [1618827,52376] 0 2024-06-03T00:03:01.190 INFO:tasks.workunit.client.0.smithi049.stdout:3/123: write d2/f7 [607379,28027] 0 2024-06-03T00:03:01.190 INFO:tasks.workunit.client.0.smithi049.stdout:0/108: rename d6/fc to d6/f21 0 2024-06-03T00:03:01.192 INFO:tasks.workunit.client.0.smithi049.stdout:3/124: rmdir d2/d8 39 2024-06-03T00:03:01.192 INFO:tasks.workunit.client.0.smithi049.stdout:9/266: write d1/d5/d13/f16 [2643016,28555] 0 2024-06-03T00:03:01.193 INFO:tasks.workunit.client.0.smithi049.stdout:0/109: read d6/f16 [1548650,94279] 0 2024-06-03T00:03:01.193 INFO:tasks.workunit.client.0.smithi049.stdout:0/110: stat d6/f16 0 2024-06-03T00:03:01.195 INFO:tasks.workunit.client.0.smithi049.stdout:8/173: dwrite d4/d7/f13 [0,4194304] 0 2024-06-03T00:03:01.195 INFO:tasks.workunit.client.0.smithi049.stdout:8/174: truncate d4/d7/f16 603722 0 2024-06-03T00:03:01.195 INFO:tasks.workunit.client.0.smithi049.stdout:1/237: dwrite d1/f1e [0,4194304] 0 2024-06-03T00:03:01.195 INFO:tasks.workunit.client.0.smithi049.stdout:9/267: mkdir d1/da/d27/d30/d50 0 2024-06-03T00:03:01.197 INFO:tasks.workunit.client.0.smithi049.stdout:8/175: symlink d4/d27/d30/l35 0 2024-06-03T00:03:01.197 INFO:tasks.workunit.client.0.smithi049.stdout:8/176: dread - d4/d7/f2a zero size 2024-06-03T00:03:01.200 INFO:tasks.workunit.client.0.smithi049.stdout:2/142: dwrite da/dd/df/f23 [0,4194304] 0 2024-06-03T00:03:01.201 INFO:tasks.workunit.client.0.smithi049.stdout:9/268: creat d1/d5/d1a/f51 x:0 0 0 2024-06-03T00:03:01.204 INFO:tasks.workunit.client.0.smithi049.stdout:2/143: link da/dd/df/f10 da/dd/df/f27 0 2024-06-03T00:03:01.205 INFO:tasks.workunit.client.0.smithi049.stdout:0/111: rename d6/d18/c1e to d6/d18/d19/c22 0 2024-06-03T00:03:01.206 INFO:tasks.workunit.client.0.smithi049.stdout:2/144: symlink da/l28 0 2024-06-03T00:03:01.206 INFO:tasks.workunit.client.0.smithi049.stdout:2/145: dread - da/f24 zero size 2024-06-03T00:03:01.208 INFO:tasks.workunit.client.0.smithi049.stdout:4/173: dwrite d4/ff [0,4194304] 0 2024-06-03T00:03:01.209 INFO:tasks.workunit.client.0.smithi049.stdout:2/146: creat da/dd/df/f29 x:0 0 0 2024-06-03T00:03:01.210 INFO:tasks.workunit.client.0.smithi049.stdout:0/112: mknod d6/d18/c23 0 2024-06-03T00:03:01.210 INFO:tasks.workunit.client.0.smithi049.stdout:0/113: stat l5 0 2024-06-03T00:03:01.211 INFO:tasks.workunit.client.0.smithi049.stdout:4/174: unlink d4/d10/d14/l36 0 2024-06-03T00:03:01.215 INFO:tasks.workunit.client.0.smithi049.stdout:0/114: creat d6/d18/d19/f24 x:0 0 0 2024-06-03T00:03:01.216 INFO:tasks.workunit.client.0.smithi049.stdout:9/269: read d1/d5/d13/d3b/f48 [7545152,67447] 0 2024-06-03T00:03:01.216 INFO:tasks.workunit.client.0.smithi049.stdout:9/270: chown d1/f44 0 1 2024-06-03T00:03:01.216 INFO:tasks.workunit.client.0.smithi049.stdout:4/175: rmdir d4/d10/d14 39 2024-06-03T00:03:01.216 INFO:tasks.workunit.client.0.smithi049.stdout:4/176: read - d4/f31 zero size 2024-06-03T00:03:01.216 INFO:tasks.workunit.client.0.smithi049.stdout:5/160: dwrite d3/d5/da/f1d [0,4194304] 0 2024-06-03T00:03:01.216 INFO:tasks.workunit.client.0.smithi049.stdout:3/125: dwrite d2/f13 [0,4194304] 0 2024-06-03T00:03:01.218 INFO:tasks.workunit.client.0.smithi049.stdout:5/161: write d3/d5/da/f27 [47905,129315] 0 2024-06-03T00:03:01.218 INFO:tasks.workunit.client.0.smithi049.stdout:5/162: truncate d3/d5/da/f27 1230338 0 2024-06-03T00:03:01.218 INFO:tasks.workunit.client.0.smithi049.stdout:0/115: getdents d6 0 2024-06-03T00:03:01.218 INFO:tasks.workunit.client.0.smithi049.stdout:0/116: dread - d6/f12 zero size 2024-06-03T00:03:01.219 INFO:tasks.workunit.client.0.smithi049.stdout:0/117: write d6/d18/d19/f1f [510269,111383] 0 2024-06-03T00:03:01.219 INFO:tasks.workunit.client.0.smithi049.stdout:0/118: chown d6/d18/d19/f24 74996 1 2024-06-03T00:03:01.219 INFO:tasks.workunit.client.0.smithi049.stdout:0/119: write d6/f12 [722718,69413] 0 2024-06-03T00:03:01.219 INFO:tasks.workunit.client.0.smithi049.stdout:9/271: dread d1/da/d27/d30/f34 [0,4194304] 0 2024-06-03T00:03:01.219 INFO:tasks.workunit.client.0.smithi049.stdout:4/177: symlink d4/l3b 0 2024-06-03T00:03:01.219 INFO:tasks.workunit.client.0.smithi049.stdout:8/177: dwrite d4/d7/f14 [8388608,4194304] 0 2024-06-03T00:03:01.224 INFO:tasks.workunit.client.0.smithi049.stdout:3/126: symlink d2/d1a/l29 0 2024-06-03T00:03:01.225 INFO:tasks.workunit.client.0.smithi049.stdout:1/238: dwrite d1/d2f/d36/d37/f14 [0,4194304] 0 2024-06-03T00:03:01.226 INFO:tasks.workunit.client.0.smithi049.stdout:2/147: rename da/dd/c1d to da/dd/c2a 0 2024-06-03T00:03:01.227 INFO:tasks.workunit.client.0.smithi049.stdout:0/120: dread d6/f12 [0,4194304] 0 2024-06-03T00:03:01.228 INFO:tasks.workunit.client.0.smithi049.stdout:5/163: rmdir d3/d11/d14/d30 0 2024-06-03T00:03:01.228 INFO:tasks.workunit.client.0.smithi049.stdout:5/164: fdatasync d3/d11/d14/f29 0 2024-06-03T00:03:01.228 INFO:tasks.workunit.client.0.smithi049.stdout:5/165: dread - d3/d11/f21 zero size 2024-06-03T00:03:01.229 INFO:tasks.workunit.client.0.smithi049.stdout:4/178: creat d4/d16/d1c/f3c x:0 0 0 2024-06-03T00:03:01.231 INFO:tasks.workunit.client.0.smithi049.stdout:8/178: creat d4/d7/d28/f36 x:0 0 0 2024-06-03T00:03:01.231 INFO:tasks.workunit.client.0.smithi049.stdout:8/179: chown d4/d7/f2a 6 1 2024-06-03T00:03:01.234 INFO:tasks.workunit.client.0.smithi049.stdout:0/121: dread d6/f16 [0,4194304] 0 2024-06-03T00:03:01.238 INFO:tasks.workunit.client.0.smithi049.stdout:1/239: rmdir d1/d2f 39 2024-06-03T00:03:01.239 INFO:tasks.workunit.client.0.smithi049.stdout:4/179: write d4/d16/d1c/f1f [579916,18911] 0 2024-06-03T00:03:01.239 INFO:tasks.workunit.client.0.smithi049.stdout:5/166: creat d3/d5/d2d/f36 x:0 0 0 2024-06-03T00:03:01.241 INFO:tasks.workunit.client.0.smithi049.stdout:4/180: creat d4/f3d x:0 0 0 2024-06-03T00:03:01.242 INFO:tasks.workunit.client.0.smithi049.stdout:5/167: unlink d3/l32 0 2024-06-03T00:03:01.243 INFO:tasks.workunit.client.0.smithi049.stdout:5/168: chown d3/d11/f21 4074 1 2024-06-03T00:03:01.245 INFO:tasks.workunit.client.0.smithi049.stdout:1/240: unlink d1/d2f/d36/d37/l12 0 2024-06-03T00:03:01.246 INFO:tasks.workunit.client.0.smithi049.stdout:7/143: sync 2024-06-03T00:03:01.247 INFO:tasks.workunit.client.0.smithi049.stdout:1/241: read d1/d2f/d36/d37/d13/d34/f3f [5348,122441] 0 2024-06-03T00:03:01.247 INFO:tasks.workunit.client.0.smithi049.stdout:1/242: readlink d1/d2f/d36/d37/d13/d34/l55 0 2024-06-03T00:03:01.247 INFO:tasks.workunit.client.0.smithi049.stdout:3/127: dwrite d2/f7 [0,4194304] 0 2024-06-03T00:03:01.247 INFO:tasks.workunit.client.0.smithi049.stdout:3/128: truncate d2/d1a/f20 437856 0 2024-06-03T00:03:01.247 INFO:tasks.workunit.client.0.smithi049.stdout:3/129: write d2/fd [1784348,98095] 0 2024-06-03T00:03:01.248 INFO:tasks.workunit.client.0.smithi049.stdout:7/144: symlink d3/l35 0 2024-06-03T00:03:01.248 INFO:tasks.workunit.client.0.smithi049.stdout:7/145: write d3/d6/f12 [1580288,19530] 0 2024-06-03T00:03:01.249 INFO:tasks.workunit.client.0.smithi049.stdout:7/146: truncate d3/f1b 1113381 0 2024-06-03T00:03:01.254 INFO:tasks.workunit.client.0.smithi049.stdout:3/130: creat d2/d14/d22/f2a x:0 0 0 2024-06-03T00:03:01.256 INFO:tasks.workunit.client.0.smithi049.stdout:8/180: truncate d4/d7/f10 10964316 0 2024-06-03T00:03:01.258 INFO:tasks.workunit.client.0.smithi049.stdout:6/198: sync 2024-06-03T00:03:01.258 INFO:tasks.workunit.client.0.smithi049.stdout:6/199: truncate d2/d3/d9/f27 877435 0 2024-06-03T00:03:01.259 INFO:tasks.workunit.client.0.smithi049.stdout:3/131: rmdir d2/d8 39 2024-06-03T00:03:01.260 INFO:tasks.workunit.client.0.smithi049.stdout:2/148: dwrite da/dd/f13 [0,4194304] 0 2024-06-03T00:03:01.260 INFO:tasks.workunit.client.0.smithi049.stdout:0/122: dwrite d6/d18/d19/f1f [0,4194304] 0 2024-06-03T00:03:01.261 INFO:tasks.workunit.client.0.smithi049.stdout:8/181: symlink d4/d27/d30/l37 0 2024-06-03T00:03:01.263 INFO:tasks.workunit.client.0.smithi049.stdout:7/147: symlink d3/d14/l36 0 2024-06-03T00:03:01.264 INFO:tasks.workunit.client.0.smithi049.stdout:3/132: getdents d2/d26 0 2024-06-03T00:03:01.268 INFO:tasks.workunit.client.0.smithi049.stdout:6/200: dread d2/f24 [0,4194304] 0 2024-06-03T00:03:01.269 INFO:tasks.workunit.client.0.smithi049.stdout:4/181: dwrite d4/f23 [0,4194304] 0 2024-06-03T00:03:01.269 INFO:tasks.workunit.client.0.smithi049.stdout:2/149: creat da/dd/f2b x:0 0 0 2024-06-03T00:03:01.269 INFO:tasks.workunit.client.0.smithi049.stdout:2/150: fdatasync da/fb 0 2024-06-03T00:03:01.269 INFO:tasks.workunit.client.0.smithi049.stdout:2/151: stat da/dd/df/l22 0 2024-06-03T00:03:01.270 INFO:tasks.workunit.client.0.smithi049.stdout:5/169: dwrite d3/d11/d14/f29 [0,4194304] 0 2024-06-03T00:03:01.270 INFO:tasks.workunit.client.0.smithi049.stdout:0/123: rename d6/d18/d19/c22 to d6/d18/d19/c25 0 2024-06-03T00:03:01.271 INFO:tasks.workunit.client.0.smithi049.stdout:8/182: creat d4/d7/d28/d25/d29/f38 x:0 0 0 2024-06-03T00:03:01.272 INFO:tasks.workunit.client.0.smithi049.stdout:7/148: rmdir d3/d8/d17 39 2024-06-03T00:03:01.273 INFO:tasks.workunit.client.0.smithi049.stdout:3/133: write d2/f4 [633116,117084] 0 2024-06-03T00:03:01.276 INFO:tasks.workunit.client.0.smithi049.stdout:6/201: truncate d2/d3/d9/d23/d29/f2d 698743 0 2024-06-03T00:03:01.277 INFO:tasks.workunit.client.0.smithi049.stdout:4/182: rmdir d4/d16/d1c 39 2024-06-03T00:03:01.281 INFO:tasks.workunit.client.0.smithi049.stdout:5/170: rename d3/d11/d14/l22 to d3/d11/d14/l37 0 2024-06-03T00:03:01.283 INFO:tasks.workunit.client.0.smithi049.stdout:7/149: mkdir d3/d6/d9/d37 0 2024-06-03T00:03:01.283 INFO:tasks.workunit.client.0.smithi049.stdout:7/150: fdatasync d3/f1b 0 2024-06-03T00:03:01.286 INFO:tasks.workunit.client.0.smithi049.stdout:0/124: rename d6/d18/c23 to d6/d18/c26 0 2024-06-03T00:03:01.289 INFO:tasks.workunit.client.0.smithi049.stdout:2/152: dwrite da/dd/df/f29 [0,4194304] 0 2024-06-03T00:03:01.290 INFO:tasks.workunit.client.0.smithi049.stdout:3/134: unlink d2/cf 0 2024-06-03T00:03:01.296 INFO:tasks.workunit.client.0.smithi049.stdout:2/153: creat da/dd/df/f2c x:0 0 0 2024-06-03T00:03:01.297 INFO:tasks.workunit.client.0.smithi049.stdout:0/125: write f3 [32719,30259] 0 2024-06-03T00:03:01.297 INFO:tasks.workunit.client.0.smithi049.stdout:0/126: readlink d6/d18/d19/l20 0 2024-06-03T00:03:01.297 INFO:tasks.workunit.client.0.smithi049.stdout:0/127: readlink l5 0 2024-06-03T00:03:01.297 INFO:tasks.workunit.client.0.smithi049.stdout:0/128: dread - d6/d18/d19/f24 zero size 2024-06-03T00:03:01.298 INFO:tasks.workunit.client.0.smithi049.stdout:3/135: mkdir d2/d2b 0 2024-06-03T00:03:01.313 INFO:tasks.workunit.client.0.smithi049.stdout:3/136: write d2/f13 [1432032,17507] 0 2024-06-03T00:03:01.314 INFO:tasks.workunit.client.0.smithi049.stdout:6/202: dwrite d2/f11 [4194304,4194304] 0 2024-06-03T00:03:01.314 INFO:tasks.workunit.client.0.smithi049.stdout:6/203: fdatasync d2/d3/d9/d23/f1a 0 2024-06-03T00:03:01.316 INFO:tasks.workunit.client.0.smithi049.stdout:3/137: rmdir d2/d1a 39 2024-06-03T00:03:01.317 INFO:tasks.workunit.client.0.smithi049.stdout:5/171: dwrite d3/d5/da/f15 [0,4194304] 0 2024-06-03T00:03:01.318 INFO:tasks.workunit.client.0.smithi049.stdout:0/129: dwrite d6/f12 [0,4194304] 0 2024-06-03T00:03:01.318 INFO:tasks.workunit.client.0.smithi049.stdout:6/204: rmdir d2/d3/d9 39 2024-06-03T00:03:01.318 INFO:tasks.workunit.client.0.smithi049.stdout:6/205: fsync d2/d3/d9/d23/d29/d30/f43 0 2024-06-03T00:03:01.320 INFO:tasks.workunit.client.0.smithi049.stdout:3/138: mknod d2/d14/c2c 0 2024-06-03T00:03:01.322 INFO:tasks.workunit.client.0.smithi049.stdout:5/172: creat d3/d5/d24/f38 x:0 0 0 2024-06-03T00:03:01.325 INFO:tasks.workunit.client.0.smithi049.stdout:2/154: getdents da/dd/df 0 2024-06-03T00:03:01.325 INFO:tasks.workunit.client.0.smithi049.stdout:2/155: chown da/c20 28761 1 2024-06-03T00:03:01.326 INFO:tasks.workunit.client.0.smithi049.stdout:6/206: rename d2/d3/d9/d23/d42 to d2/d3/d9/d23/d48 0 2024-06-03T00:03:01.327 INFO:tasks.workunit.client.0.smithi049.stdout:6/207: truncate d2/d3/d9/d23/d29/f41 362422 0 2024-06-03T00:03:01.327 INFO:tasks.workunit.client.0.smithi049.stdout:6/208: truncate d2/d3/d9/d23/d29/d30/d28/f31 1779999 0 2024-06-03T00:03:01.327 INFO:tasks.workunit.client.0.smithi049.stdout:6/209: chown d2/d3/d9/d23/d29 558963457 1 2024-06-03T00:03:01.328 INFO:tasks.workunit.client.0.smithi049.stdout:5/173: rename d3/d11/l2f to d3/d11/l39 0 2024-06-03T00:03:01.330 INFO:tasks.workunit.client.0.smithi049.stdout:0/130: rename d6/f12 to d6/d18/f27 0 2024-06-03T00:03:01.330 INFO:tasks.workunit.client.0.smithi049.stdout:0/131: fdatasync f2 0 2024-06-03T00:03:01.330 INFO:tasks.workunit.client.0.smithi049.stdout:2/156: creat da/dd/df/f2d x:0 0 0 2024-06-03T00:03:01.331 INFO:tasks.workunit.client.0.smithi049.stdout:5/174: creat d3/f3a x:0 0 0 2024-06-03T00:03:01.332 INFO:tasks.workunit.client.0.smithi049.stdout:5/175: fdatasync d3/d5/da/f1d 0 2024-06-03T00:03:01.332 INFO:tasks.workunit.client.0.smithi049.stdout:5/176: chown d3 9453447 1 2024-06-03T00:03:01.332 INFO:tasks.workunit.client.0.smithi049.stdout:5/177: chown d3/d9/f28 130 1 2024-06-03T00:03:01.332 INFO:tasks.workunit.client.0.smithi049.stdout:3/139: dwrite d2/d14/f1c [0,4194304] 0 2024-06-03T00:03:01.333 INFO:tasks.workunit.client.0.smithi049.stdout:0/132: truncate d6/d18/d19/f1f 2875783 0 2024-06-03T00:03:01.335 INFO:tasks.workunit.client.0.smithi049.stdout:2/157: link da/l28 da/l2e 0 2024-06-03T00:03:01.336 INFO:tasks.workunit.client.0.smithi049.stdout:5/178: mknod d3/d11/d14/d16/c3b 0 2024-06-03T00:03:01.337 INFO:tasks.workunit.client.0.smithi049.stdout:5/179: dread - d3/d11/f21 zero size 2024-06-03T00:03:01.337 INFO:tasks.workunit.client.0.smithi049.stdout:5/180: truncate d3/d5/fd 8785437 0 2024-06-03T00:03:01.338 INFO:tasks.workunit.client.0.smithi049.stdout:3/140: creat d2/d26/f2d x:0 0 0 2024-06-03T00:03:01.339 INFO:tasks.workunit.client.0.smithi049.stdout:2/158: write f6 [608673,64116] 0 2024-06-03T00:03:01.342 INFO:tasks.workunit.client.0.smithi049.stdout:6/210: dwrite d2/d3/d9/d23/f26 [0,4194304] 0 2024-06-03T00:03:01.342 INFO:tasks.workunit.client.0.smithi049.stdout:6/211: readlink d2/d3/d9/d23/d29/d30/d28/l2c 0 2024-06-03T00:03:01.348 INFO:tasks.workunit.client.0.smithi049.stdout:3/141: rename d2/d14/f1f to d2/d14/f2e 0 2024-06-03T00:03:01.349 INFO:tasks.workunit.client.0.smithi049.stdout:0/133: mknod d6/d18/c28 0 2024-06-03T00:03:01.349 INFO:tasks.workunit.client.0.smithi049.stdout:3/142: dread d2/d1a/f20 [0,4194304] 0 2024-06-03T00:03:01.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:01 smithi107 ceph-mon[37048]: pgmap v472: 97 pgs: 97 active+clean; 126 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 13 MiB/s wr, 2.02k op/s 2024-06-03T00:03:01.351 INFO:tasks.workunit.client.0.smithi049.stdout:0/134: dread d6/f17 [0,4194304] 0 2024-06-03T00:03:01.352 INFO:tasks.workunit.client.0.smithi049.stdout:6/212: link d2/d3/d9/d23/d29/d30/d28/l7 d2/d3/d9/d23/d29/d30/d28/l49 0 2024-06-03T00:03:01.353 INFO:tasks.workunit.client.0.smithi049.stdout:6/213: mknod d2/d3/d9/d40/c4a 0 2024-06-03T00:03:01.354 INFO:tasks.workunit.client.0.smithi049.stdout:6/214: creat d2/d3/d9/d23/d36/f4b x:0 0 0 2024-06-03T00:03:01.355 INFO:tasks.workunit.client.0.smithi049.stdout:6/215: mknod d2/d3/d9/d40/c4c 0 2024-06-03T00:03:01.359 INFO:tasks.workunit.client.0.smithi049.stdout:5/181: dwrite d3/d5/da/f15 [0,4194304] 0 2024-06-03T00:03:01.359 INFO:tasks.workunit.client.0.smithi049.stdout:5/182: fdatasync d3/d11/d14/f29 0 2024-06-03T00:03:01.361 INFO:tasks.workunit.client.0.smithi049.stdout:5/183: mknod d3/d9/d20/c3c 0 2024-06-03T00:03:01.362 INFO:tasks.workunit.client.0.smithi049.stdout:5/184: chown d3 397 1 2024-06-03T00:03:01.362 INFO:tasks.workunit.client.0.smithi049.stdout:3/143: getdents d2/d26 0 2024-06-03T00:03:01.364 INFO:tasks.workunit.client.0.smithi049.stdout:5/185: creat d3/d9/d20/f3d x:0 0 0 2024-06-03T00:03:01.364 INFO:tasks.workunit.client.0.smithi049.stdout:5/186: truncate d3/f3a 794203 0 2024-06-03T00:03:01.364 INFO:tasks.workunit.client.0.smithi049.stdout:3/144: mknod d2/d14/d22/d25/c2f 0 2024-06-03T00:03:01.366 INFO:tasks.workunit.client.0.smithi049.stdout:5/187: creat d3/d5/da/f3e x:0 0 0 2024-06-03T00:03:01.366 INFO:tasks.workunit.client.0.smithi049.stdout:5/188: dread - d3/d11/f21 zero size 2024-06-03T00:03:01.367 INFO:tasks.workunit.client.0.smithi049.stdout:3/145: creat d2/d26/f30 x:0 0 0 2024-06-03T00:03:01.368 INFO:tasks.workunit.client.0.smithi049.stdout:5/189: symlink d3/d5/d2d/l3f 0 2024-06-03T00:03:01.368 INFO:tasks.workunit.client.0.smithi049.stdout:5/190: stat d3/d11/d14/d16/f25 0 2024-06-03T00:03:01.368 INFO:tasks.workunit.client.0.smithi049.stdout:0/135: dwrite d6/f21 [0,4194304] 0 2024-06-03T00:03:01.370 INFO:tasks.workunit.client.0.smithi049.stdout:3/146: rmdir d2/d2b 0 2024-06-03T00:03:01.371 INFO:tasks.workunit.client.0.smithi049.stdout:5/191: truncate d3/d9/d20/f2e 1032911 0 2024-06-03T00:03:01.374 INFO:tasks.workunit.client.0.smithi049.stdout:3/147: mkdir d2/d1a/d31 0 2024-06-03T00:03:01.375 INFO:tasks.workunit.client.0.smithi049.stdout:0/136: write d6/d18/d19/f1f [2660808,123978] 0 2024-06-03T00:03:01.375 INFO:tasks.workunit.client.0.smithi049.stdout:5/192: creat d3/d5/d2d/f40 x:0 0 0 2024-06-03T00:03:01.376 INFO:tasks.workunit.client.0.smithi049.stdout:5/193: fdatasync d3/d9/f28 0 2024-06-03T00:03:01.376 INFO:tasks.workunit.client.0.smithi049.stdout:5/194: write d3/d11/d14/f19 [306650,107122] 0 2024-06-03T00:03:01.377 INFO:tasks.workunit.client.0.smithi049.stdout:3/148: mkdir d2/d14/d32 0 2024-06-03T00:03:01.379 INFO:tasks.workunit.client.0.smithi049.stdout:9/272: sync 2024-06-03T00:03:01.379 INFO:tasks.workunit.client.0.smithi049.stdout:0/137: mkdir d6/d29 0 2024-06-03T00:03:01.380 INFO:tasks.workunit.client.0.smithi049.stdout:2/159: dwrite da/dd/df/f27 [0,4194304] 0 2024-06-03T00:03:01.381 INFO:tasks.workunit.client.0.smithi049.stdout:6/216: rename d2/d3/d9/d23/d29/d30/d28 to d2/d4d 0 2024-06-03T00:03:01.382 INFO:tasks.workunit.client.0.smithi049.stdout:5/195: rmdir d3/d9/d20 39 2024-06-03T00:03:01.384 INFO:tasks.workunit.client.0.smithi049.stdout:6/217: dread d2/d3/d9/d23/f1e [0,4194304] 0 2024-06-03T00:03:01.384 INFO:tasks.workunit.client.0.smithi049.stdout:3/149: creat d2/d14/d22/f33 x:0 0 0 2024-06-03T00:03:01.389 INFO:tasks.workunit.client.0.smithi049.stdout:9/273: dread d1/fb [0,4194304] 0 2024-06-03T00:03:01.390 INFO:tasks.workunit.client.0.smithi049.stdout:2/160: readlink da/dd/df/l22 0 2024-06-03T00:03:01.391 INFO:tasks.workunit.client.0.smithi049.stdout:3/150: dread d2/f7 [0,4194304] 0 2024-06-03T00:03:01.392 INFO:tasks.workunit.client.0.smithi049.stdout:6/218: write d2/f24 [1227170,24512] 0 2024-06-03T00:03:01.393 INFO:tasks.workunit.client.0.smithi049.stdout:6/219: truncate d2/d3/d9/d23/d29/d30/f43 2182759 0 2024-06-03T00:03:01.393 INFO:tasks.workunit.client.0.smithi049.stdout:9/274: mkdir d1/d5/d1a/d52 0 2024-06-03T00:03:01.395 INFO:tasks.workunit.client.0.smithi049.stdout:3/151: mkdir d2/d1a/d34 0 2024-06-03T00:03:01.395 INFO:tasks.workunit.client.0.smithi049.stdout:3/152: readlink d2/d1a/l29 0 2024-06-03T00:03:01.395 INFO:tasks.workunit.client.0.smithi049.stdout:0/138: truncate d6/f21 3241699 0 2024-06-03T00:03:01.397 INFO:tasks.workunit.client.0.smithi049.stdout:6/220: creat d2/d3/d9/d23/f4e x:0 0 0 2024-06-03T00:03:01.399 INFO:tasks.workunit.client.0.smithi049.stdout:2/161: mknod da/dd/c2f 0 2024-06-03T00:03:01.399 INFO:tasks.workunit.client.0.smithi049.stdout:2/162: chown da/dd/df/l22 67540872 1 2024-06-03T00:03:01.400 INFO:tasks.workunit.client.0.smithi049.stdout:0/139: creat d6/d18/d19/f2a x:0 0 0 2024-06-03T00:03:01.402 INFO:tasks.workunit.client.0.smithi049.stdout:6/221: mknod d2/d3/d9/d23/d36/c4f 0 2024-06-03T00:03:01.403 INFO:tasks.workunit.client.0.smithi049.stdout:2/163: creat da/dd/df/f30 x:0 0 0 2024-06-03T00:03:01.403 INFO:tasks.workunit.client.0.smithi049.stdout:3/153: dread d2/d8/f1e [0,4194304] 0 2024-06-03T00:03:01.405 INFO:tasks.workunit.client.0.smithi049.stdout:0/140: rename d6/f17 to d6/d18/d19/f2b 0 2024-06-03T00:03:01.406 INFO:tasks.workunit.client.0.smithi049.stdout:6/222: dread d2/f11 [0,4194304] 0 2024-06-03T00:03:01.406 INFO:tasks.workunit.client.0.smithi049.stdout:6/223: read - d2/d3/d9/d23/f4e zero size 2024-06-03T00:03:01.406 INFO:tasks.workunit.client.0.smithi049.stdout:5/196: dwrite d3/d11/d14/d16/f25 [0,4194304] 0 2024-06-03T00:03:01.407 INFO:tasks.workunit.client.0.smithi049.stdout:3/154: getdents d2/d14/d22 0 2024-06-03T00:03:01.409 INFO:tasks.workunit.client.0.smithi049.stdout:0/141: mknod d6/c2c 0 2024-06-03T00:03:01.409 INFO:tasks.workunit.client.0.smithi049.stdout:0/142: dread - d6/d18/d19/f24 zero size 2024-06-03T00:03:01.409 INFO:tasks.workunit.client.0.smithi049.stdout:2/164: dread f9 [0,4194304] 0 2024-06-03T00:03:01.413 INFO:tasks.workunit.client.0.smithi049.stdout:5/197: creat d3/d9/d20/f41 x:0 0 0 2024-06-03T00:03:01.413 INFO:tasks.workunit.client.0.smithi049.stdout:5/198: stat d3/f3a 0 2024-06-03T00:03:01.413 INFO:tasks.workunit.client.0.smithi049.stdout:5/199: truncate d3/d5/d24/f38 45650 0 2024-06-03T00:03:01.414 INFO:tasks.workunit.client.0.smithi049.stdout:8/183: sync 2024-06-03T00:03:01.414 INFO:tasks.workunit.client.0.smithi049.stdout:1/243: sync 2024-06-03T00:03:01.414 INFO:tasks.workunit.client.0.smithi049.stdout:4/183: sync 2024-06-03T00:03:01.414 INFO:tasks.workunit.client.0.smithi049.stdout:7/151: sync 2024-06-03T00:03:01.414 INFO:tasks.workunit.client.0.smithi049.stdout:8/184: dread - d4/d7/d28/f36 zero size 2024-06-03T00:03:01.414 INFO:tasks.workunit.client.0.smithi049.stdout:1/244: write d1/d2f/d36/d37/d13/f27 [4872295,109107] 0 2024-06-03T00:03:01.415 INFO:tasks.workunit.client.0.smithi049.stdout:3/155: dread f0 [0,4194304] 0 2024-06-03T00:03:01.416 INFO:tasks.workunit.client.0.smithi049.stdout:4/184: truncate d4/d16/d1c/f1f 2136526 0 2024-06-03T00:03:01.418 INFO:tasks.workunit.client.0.smithi049.stdout:7/152: dread d3/d6/f1c [0,4194304] 0 2024-06-03T00:03:01.418 INFO:tasks.workunit.client.0.smithi049.stdout:1/245: creat d1/d2f/d36/d37/d13/d42/f5a x:0 0 0 2024-06-03T00:03:01.419 INFO:tasks.workunit.client.0.smithi049.stdout:1/246: dread - d1/d2f/f44 zero size 2024-06-03T00:03:01.419 INFO:tasks.workunit.client.0.smithi049.stdout:6/224: read d2/f15 [2100106,846] 0 2024-06-03T00:03:01.420 INFO:tasks.workunit.client.0.smithi049.stdout:3/156: rmdir d2/d14/d32 0 2024-06-03T00:03:01.421 INFO:tasks.workunit.client.0.smithi049.stdout:3/157: readlink l1 0 2024-06-03T00:03:01.422 INFO:tasks.workunit.client.0.smithi049.stdout:9/275: dwrite d1/da/d26/f33 [0,4194304] 0 2024-06-03T00:03:01.422 INFO:tasks.workunit.client.0.smithi049.stdout:9/276: write d1/d5/d13/d3b/f4a [1187374,1773] 0 2024-06-03T00:03:01.422 INFO:tasks.workunit.client.0.smithi049.stdout:4/185: link d4/d10/l19 d4/d2a/l3e 0 2024-06-03T00:03:01.423 INFO:tasks.workunit.client.0.smithi049.stdout:7/153: creat d3/d6/d13/f38 x:0 0 0 2024-06-03T00:03:01.424 INFO:tasks.workunit.client.0.smithi049.stdout:7/154: read d3/d6/f12 [1205963,110507] 0 2024-06-03T00:03:01.425 INFO:tasks.workunit.client.0.smithi049.stdout:1/247: mknod d1/d2f/d36/d37/d13/d34/c5b 0 2024-06-03T00:03:01.425 INFO:tasks.workunit.client.0.smithi049.stdout:2/165: dread f6 [0,4194304] 0 2024-06-03T00:03:01.427 INFO:tasks.workunit.client.0.smithi049.stdout:6/225: write d2/d3/d9/d23/f26 [2812511,86949] 0 2024-06-03T00:03:01.428 INFO:tasks.workunit.client.0.smithi049.stdout:6/226: write d2/d3/d9/d23/f4e [108331,113095] 0 2024-06-03T00:03:01.428 INFO:tasks.workunit.client.0.smithi049.stdout:6/227: write d2/d3/f38 [2093737,47627] 0 2024-06-03T00:03:01.428 INFO:tasks.workunit.client.0.smithi049.stdout:6/228: fdatasync d2/d3/d9/d23/d29/f32 0 2024-06-03T00:03:01.428 INFO:tasks.workunit.client.0.smithi049.stdout:9/277: link d1/d5/d13/f4b d1/d5/d13/f53 0 2024-06-03T00:03:01.429 INFO:tasks.workunit.client.0.smithi049.stdout:7/155: creat d3/d8/d17/f39 x:0 0 0 2024-06-03T00:03:01.429 INFO:tasks.workunit.client.0.smithi049.stdout:7/156: dread - d3/d8/f34 zero size 2024-06-03T00:03:01.429 INFO:tasks.workunit.client.0.smithi049.stdout:7/157: fsync d3/d6/d13/f1f 0 2024-06-03T00:03:01.430 INFO:tasks.workunit.client.0.smithi049.stdout:1/248: chown d1/d2f/d36/d37/f33 315 1 2024-06-03T00:03:01.430 INFO:tasks.workunit.client.0.smithi049.stdout:1/249: dread - d1/f4f zero size 2024-06-03T00:03:01.431 INFO:tasks.workunit.client.0.smithi049.stdout:5/200: dread d3/d9/f13 [0,4194304] 0 2024-06-03T00:03:01.431 INFO:tasks.workunit.client.0.smithi049.stdout:5/201: write d3/d5/d2d/f36 [673836,87624] 0 2024-06-03T00:03:01.431 INFO:tasks.workunit.client.0.smithi049.stdout:6/229: symlink d2/l50 0 2024-06-03T00:03:01.433 INFO:tasks.workunit.client.0.smithi049.stdout:9/278: mkdir d1/da/d54 0 2024-06-03T00:03:01.433 INFO:tasks.workunit.client.0.smithi049.stdout:9/279: stat d1/da/d27/l47 0 2024-06-03T00:03:01.434 INFO:tasks.workunit.client.0.smithi049.stdout:3/158: getdents d2/d14 0 2024-06-03T00:03:01.435 INFO:tasks.workunit.client.0.smithi049.stdout:7/158: creat d3/d6/d13/f3a x:0 0 0 2024-06-03T00:03:01.435 INFO:tasks.workunit.client.0.smithi049.stdout:7/159: write d3/f30 [597813,71273] 0 2024-06-03T00:03:01.435 INFO:tasks.workunit.client.0.smithi049.stdout:7/160: write d3/d8/d17/f39 [124043,50144] 0 2024-06-03T00:03:01.437 INFO:tasks.workunit.client.0.smithi049.stdout:1/250: creat d1/d2f/d36/d57/f5c x:0 0 0 2024-06-03T00:03:01.439 INFO:tasks.workunit.client.0.smithi049.stdout:5/202: unlink d3/d11/d14/f26 0 2024-06-03T00:03:01.439 INFO:tasks.workunit.client.0.smithi049.stdout:5/203: dread - d3/d11/f21 zero size 2024-06-03T00:03:01.440 INFO:tasks.workunit.client.0.smithi049.stdout:6/230: mkdir d2/d3/d9/d23/d48/d51 0 2024-06-03T00:03:01.441 INFO:tasks.workunit.client.0.smithi049.stdout:9/280: unlink d1/da/d26/f4f 0 2024-06-03T00:03:01.442 INFO:tasks.workunit.client.0.smithi049.stdout:7/161: mkdir d3/d6/d9/d37/d3b 0 2024-06-03T00:03:01.443 INFO:tasks.workunit.client.0.smithi049.stdout:7/162: readlink d3/d14/l36 0 2024-06-03T00:03:01.443 INFO:tasks.workunit.client.0.smithi049.stdout:7/163: dread - d3/d6/f25 zero size 2024-06-03T00:03:01.443 INFO:tasks.workunit.client.0.smithi049.stdout:1/251: creat d1/d1a/f5d x:0 0 0 2024-06-03T00:03:01.445 INFO:tasks.workunit.client.0.smithi049.stdout:6/231: symlink d2/d3/d9/d23/d29/l52 0 2024-06-03T00:03:01.446 INFO:tasks.workunit.client.0.smithi049.stdout:9/281: creat d1/f55 x:0 0 0 2024-06-03T00:03:01.447 INFO:tasks.workunit.client.0.smithi049.stdout:7/164: mkdir d3/d6/d13/d3c 0 2024-06-03T00:03:01.447 INFO:tasks.workunit.client.0.smithi049.stdout:7/165: dread - d3/d6/d13/f38 zero size 2024-06-03T00:03:01.448 INFO:tasks.workunit.client.0.smithi049.stdout:1/252: getdents d1/d2f/d36/d37/d13/d34 0 2024-06-03T00:03:01.449 INFO:tasks.workunit.client.0.smithi049.stdout:4/186: dwrite d4/d10/d14/d15/f18 [0,4194304] 0 2024-06-03T00:03:01.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:01 smithi057 ceph-mon[36457]: pgmap v472: 97 pgs: 97 active+clean; 126 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 13 MiB/s wr, 2.02k op/s 2024-06-03T00:03:01.450 INFO:tasks.workunit.client.0.smithi049.stdout:7/166: dread d3/d8/f10 [0,4194304] 0 2024-06-03T00:03:01.450 INFO:tasks.workunit.client.0.smithi049.stdout:7/167: fsync d3/d6/d13/f1f 0 2024-06-03T00:03:01.450 INFO:tasks.workunit.client.0.smithi049.stdout:6/232: mkdir d2/d3/d9/d23/d48/d53 0 2024-06-03T00:03:01.452 INFO:tasks.workunit.client.0.smithi049.stdout:4/187: dread d4/d16/d1c/f1f [0,4194304] 0 2024-06-03T00:03:01.453 INFO:tasks.workunit.client.0.smithi049.stdout:0/143: dwrite d6/f16 [0,4194304] 0 2024-06-03T00:03:01.454 INFO:tasks.workunit.client.0.smithi049.stdout:8/185: dwrite d4/d7/f10 [0,4194304] 0 2024-06-03T00:03:01.455 INFO:tasks.workunit.client.0.smithi049.stdout:2/166: dwrite da/fb [0,4194304] 0 2024-06-03T00:03:01.459 INFO:tasks.workunit.client.0.smithi049.stdout:9/282: fsync d1/f55 0 2024-06-03T00:03:01.460 INFO:tasks.workunit.client.0.smithi049.stdout:9/283: stat d1/d5/d13 0 2024-06-03T00:03:01.460 INFO:tasks.workunit.client.0.smithi049.stdout:9/284: write d1/d5/d13/f4b [4366023,114898] 0 2024-06-03T00:03:01.460 INFO:tasks.workunit.client.0.smithi049.stdout:9/285: stat d1/da/c28 0 2024-06-03T00:03:01.462 INFO:tasks.workunit.client.0.smithi049.stdout:7/168: symlink d3/d8/d23/l3d 0 2024-06-03T00:03:01.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:01 smithi049 ceph-mon[32302]: pgmap v472: 97 pgs: 97 active+clean; 126 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 13 MiB/s wr, 2.02k op/s 2024-06-03T00:03:01.463 INFO:tasks.workunit.client.0.smithi049.stdout:4/188: unlink d4/l29 0 2024-06-03T00:03:01.464 INFO:tasks.workunit.client.0.smithi049.stdout:9/286: dread d1/d5/d13/f39 [0,4194304] 0 2024-06-03T00:03:01.464 INFO:tasks.workunit.client.0.smithi049.stdout:9/287: chown d1/da 1421 1 2024-06-03T00:03:01.464 INFO:tasks.workunit.client.0.smithi049.stdout:1/253: truncate d1/d2f/d36/d37/f35 526022 0 2024-06-03T00:03:01.464 INFO:tasks.workunit.client.0.smithi049.stdout:1/254: read - d1/d2f/f44 zero size 2024-06-03T00:03:01.467 INFO:tasks.workunit.client.0.smithi049.stdout:8/186: creat d4/d7/d28/d25/f39 x:0 0 0 2024-06-03T00:03:01.469 INFO:tasks.workunit.client.0.smithi049.stdout:4/189: rename d4/d10 to d4/d3f 0 2024-06-03T00:03:01.469 INFO:tasks.workunit.client.0.smithi049.stdout:4/190: stat d4/d3f/c2e 0 2024-06-03T00:03:01.469 INFO:tasks.workunit.client.0.smithi049.stdout:4/191: write d4/f23 [4873225,29152] 0 2024-06-03T00:03:01.470 INFO:tasks.workunit.client.0.smithi049.stdout:8/187: mkdir d4/d7/d3a 0 2024-06-03T00:03:01.470 INFO:tasks.workunit.client.0.smithi049.stdout:2/167: mknod da/dd/df/c31 0 2024-06-03T00:03:01.471 INFO:tasks.workunit.client.0.smithi049.stdout:4/192: creat d4/d3f/d14/f40 x:0 0 0 2024-06-03T00:03:01.471 INFO:tasks.workunit.client.0.smithi049.stdout:4/193: truncate d4/d16/f35 384033 0 2024-06-03T00:03:01.472 INFO:tasks.workunit.client.0.smithi049.stdout:4/194: truncate d4/ff 1828128 0 2024-06-03T00:03:01.472 INFO:tasks.workunit.client.0.smithi049.stdout:4/195: stat d4/d2a/c2f 0 2024-06-03T00:03:01.473 INFO:tasks.workunit.client.0.smithi049.stdout:2/168: symlink da/dd/df/l32 0 2024-06-03T00:03:01.473 INFO:tasks.workunit.client.0.smithi049.stdout:2/169: write da/dd/df/f30 [608315,34623] 0 2024-06-03T00:03:01.474 INFO:tasks.workunit.client.0.smithi049.stdout:4/196: symlink d4/d2a/l41 0 2024-06-03T00:03:01.475 INFO:tasks.workunit.client.0.smithi049.stdout:5/204: dwrite d3/d5/d2d/f36 [0,4194304] 0 2024-06-03T00:03:01.476 INFO:tasks.workunit.client.0.smithi049.stdout:2/170: rename da/f15 to da/dd/f33 0 2024-06-03T00:03:01.477 INFO:tasks.workunit.client.0.smithi049.stdout:2/171: fsync da/f24 0 2024-06-03T00:03:01.477 INFO:tasks.workunit.client.0.smithi049.stdout:2/172: write da/dd/f26 [420230,87164] 0 2024-06-03T00:03:01.479 INFO:tasks.workunit.client.0.smithi049.stdout:2/173: rename da/dd/df/f2d to da/dd/df/f34 0 2024-06-03T00:03:01.479 INFO:tasks.workunit.client.0.smithi049.stdout:0/144: dwrite f2 [0,4194304] 0 2024-06-03T00:03:01.482 INFO:tasks.workunit.client.0.smithi049.stdout:0/145: rmdir d6/d18 39 2024-06-03T00:03:01.483 INFO:tasks.workunit.client.0.smithi049.stdout:2/174: symlink da/dd/df/l35 0 2024-06-03T00:03:01.484 INFO:tasks.workunit.client.0.smithi049.stdout:0/146: read d6/d18/d19/f2b [625468,59288] 0 2024-06-03T00:03:01.485 INFO:tasks.workunit.client.0.smithi049.stdout:0/147: chown d6 1872578299 1 2024-06-03T00:03:01.485 INFO:tasks.workunit.client.0.smithi049.stdout:0/148: write d6/d18/d19/f1f [270110,45280] 0 2024-06-03T00:03:01.485 INFO:tasks.workunit.client.0.smithi049.stdout:9/288: dread d1/d5/d13/f16 [0,4194304] 0 2024-06-03T00:03:01.486 INFO:tasks.workunit.client.0.smithi049.stdout:2/175: creat da/dd/f36 x:0 0 0 2024-06-03T00:03:01.488 INFO:tasks.workunit.client.0.smithi049.stdout:0/149: creat d6/d29/f2d x:0 0 0 2024-06-03T00:03:01.488 INFO:tasks.workunit.client.0.smithi049.stdout:0/150: fsync d6/d18/f27 0 2024-06-03T00:03:01.489 INFO:tasks.workunit.client.0.smithi049.stdout:7/169: dwrite d3/d8/f34 [0,4194304] 0 2024-06-03T00:03:01.489 INFO:tasks.workunit.client.0.smithi049.stdout:7/170: write d3/d6/f12 [1884119,116188] 0 2024-06-03T00:03:01.489 INFO:tasks.workunit.client.0.smithi049.stdout:7/171: dread - d3/d6/d9/f2b zero size 2024-06-03T00:03:01.489 INFO:tasks.workunit.client.0.smithi049.stdout:7/172: write d3/f30 [1658381,5117] 0 2024-06-03T00:03:01.490 INFO:tasks.workunit.client.0.smithi049.stdout:9/289: symlink d1/da/d27/d30/l56 0 2024-06-03T00:03:01.491 INFO:tasks.workunit.client.0.smithi049.stdout:4/197: getdents d4 0 2024-06-03T00:03:01.491 INFO:tasks.workunit.client.0.smithi049.stdout:8/188: dwrite d4/d7/fe [0,4194304] 0 2024-06-03T00:03:01.497 INFO:tasks.workunit.client.0.smithi049.stdout:7/173: rename d3/c26 to d3/d6/c3e 0 2024-06-03T00:03:01.500 INFO:tasks.workunit.client.0.smithi049.stdout:7/174: mkdir d3/d6/d3f 0 2024-06-03T00:03:01.501 INFO:tasks.workunit.client.0.smithi049.stdout:2/176: dread da/dd/df/f30 [0,4194304] 0 2024-06-03T00:03:01.505 INFO:tasks.workunit.client.0.smithi049.stdout:5/205: dwrite d3/d11/d14/f19 [0,4194304] 0 2024-06-03T00:03:01.506 INFO:tasks.workunit.client.0.smithi049.stdout:4/198: write d4/d16/d1c/f2c [186811,66051] 0 2024-06-03T00:03:01.506 INFO:tasks.workunit.client.0.smithi049.stdout:1/255: dwrite d1/d2f/f46 [0,4194304] 0 2024-06-03T00:03:01.507 INFO:tasks.workunit.client.0.smithi049.stdout:7/175: creat d3/f40 x:0 0 0 2024-06-03T00:03:01.512 INFO:tasks.workunit.client.0.smithi049.stdout:5/206: rename c0 to d3/d11/d14/c42 0 2024-06-03T00:03:01.515 INFO:tasks.workunit.client.0.smithi049.stdout:5/207: dread d3/d5/da/f2b [0,4194304] 0 2024-06-03T00:03:01.518 INFO:tasks.workunit.client.0.smithi049.stdout:4/199: creat d4/d16/d1c/d24/f42 x:0 0 0 2024-06-03T00:03:01.519 INFO:tasks.workunit.client.0.smithi049.stdout:2/177: mkdir da/dd/d37 0 2024-06-03T00:03:01.520 INFO:tasks.workunit.client.0.smithi049.stdout:5/208: symlink d3/d5/d2d/l43 0 2024-06-03T00:03:01.520 INFO:tasks.workunit.client.0.smithi049.stdout:1/256: mkdir d1/d2f/d36/d37/d2c/d45/d5e 0 2024-06-03T00:03:01.521 INFO:tasks.workunit.client.0.smithi049.stdout:4/200: mkdir d4/d16/d1c/d24/d43 0 2024-06-03T00:03:01.522 INFO:tasks.workunit.client.0.smithi049.stdout:2/178: creat da/dd/f38 x:0 0 0 2024-06-03T00:03:01.523 INFO:tasks.workunit.client.0.smithi049.stdout:1/257: mkdir d1/d2f/d36/d37/d13/d34/d5f 0 2024-06-03T00:03:01.523 INFO:tasks.workunit.client.0.smithi049.stdout:4/201: creat d4/d16/f44 x:0 0 0 2024-06-03T00:03:01.524 INFO:tasks.workunit.client.0.smithi049.stdout:2/179: creat da/dd/f39 x:0 0 0 2024-06-03T00:03:01.526 INFO:tasks.workunit.client.0.smithi049.stdout:2/180: link da/c20 da/dd/c3a 0 2024-06-03T00:03:01.527 INFO:tasks.workunit.client.0.smithi049.stdout:2/181: stat f1 0 2024-06-03T00:03:01.527 INFO:tasks.workunit.client.0.smithi049.stdout:1/258: dread d1/d2f/d36/d37/f22 [0,4194304] 0 2024-06-03T00:03:01.527 INFO:tasks.workunit.client.0.smithi049.stdout:1/259: write d1/d1a/f5d [293976,3104] 0 2024-06-03T00:03:01.527 INFO:tasks.workunit.client.0.smithi049.stdout:0/151: dwrite d6/f21 [0,4194304] 0 2024-06-03T00:03:01.528 INFO:tasks.workunit.client.0.smithi049.stdout:9/290: dwrite d1/f55 [0,4194304] 0 2024-06-03T00:03:01.528 INFO:tasks.workunit.client.0.smithi049.stdout:7/176: dwrite d3/d6/f25 [0,4194304] 0 2024-06-03T00:03:01.528 INFO:tasks.workunit.client.0.smithi049.stdout:2/182: link da/dd/df/c31 da/dd/d37/c3b 0 2024-06-03T00:03:01.530 INFO:tasks.workunit.client.0.smithi049.stdout:1/260: creat d1/d2f/d36/d37/d2c/f60 x:0 0 0 2024-06-03T00:03:01.536 INFO:tasks.workunit.client.0.smithi049.stdout:0/152: write d6/f21 [2498758,45678] 0 2024-06-03T00:03:01.536 INFO:tasks.workunit.client.0.smithi049.stdout:0/153: write d6/f21 [4141171,35977] 0 2024-06-03T00:03:01.538 INFO:tasks.workunit.client.0.smithi049.stdout:7/177: creat d3/d32/f41 x:0 0 0 2024-06-03T00:03:01.542 INFO:tasks.workunit.client.0.smithi049.stdout:2/183: truncate f6 2551373 0 2024-06-03T00:03:01.542 INFO:tasks.workunit.client.0.smithi049.stdout:1/261: mkdir d1/d2f/d36/d37/d2c/d45/d61 0 2024-06-03T00:03:01.543 INFO:tasks.workunit.client.0.smithi049.stdout:4/202: dwrite d4/f3d [0,4194304] 0 2024-06-03T00:03:01.543 INFO:tasks.workunit.client.0.smithi049.stdout:0/154: rename d6/d18/d19 to d6/d29/d2e 0 2024-06-03T00:03:01.544 INFO:tasks.workunit.client.0.smithi049.stdout:9/291: dwrite d1/d5/d13/f39 [0,4194304] 0 2024-06-03T00:03:01.544 INFO:tasks.workunit.client.0.smithi049.stdout:9/292: chown d1/d5/d1a/f51 5 1 2024-06-03T00:03:01.545 INFO:tasks.workunit.client.0.smithi049.stdout:7/178: mknod d3/c42 0 2024-06-03T00:03:01.546 INFO:tasks.workunit.client.0.smithi049.stdout:2/184: unlink da/dd/f38 0 2024-06-03T00:03:01.548 INFO:tasks.workunit.client.0.smithi049.stdout:1/262: symlink d1/d2f/d36/d37/d2c/d45/l62 0 2024-06-03T00:03:01.548 INFO:tasks.workunit.client.0.smithi049.stdout:1/263: stat d1/d1a 0 2024-06-03T00:03:01.549 INFO:tasks.workunit.client.0.smithi049.stdout:1/264: write d1/d2f/d36/d37/d13/d34/f3b [244960,110980] 0 2024-06-03T00:03:01.549 INFO:tasks.workunit.client.0.smithi049.stdout:1/265: fsync d1/d2f/d36/d37/d13/f27 0 2024-06-03T00:03:01.549 INFO:tasks.workunit.client.0.smithi049.stdout:1/266: chown d1/d2f/d36/d37/d13 0 1 2024-06-03T00:03:01.550 INFO:tasks.workunit.client.0.smithi049.stdout:9/293: dread d1/fb [0,4194304] 0 2024-06-03T00:03:01.551 INFO:tasks.workunit.client.0.smithi049.stdout:4/203: write d4/d16/d1c/f25 [970685,68912] 0 2024-06-03T00:03:01.552 INFO:tasks.workunit.client.0.smithi049.stdout:0/155: rename d6/c9 to d6/d29/c2f 0 2024-06-03T00:03:01.557 INFO:tasks.workunit.client.0.smithi049.stdout:1/267: creat d1/d1a/f63 x:0 0 0 2024-06-03T00:03:01.558 INFO:tasks.workunit.client.0.smithi049.stdout:7/179: dwrite d3/d8/d17/f39 [0,4194304] 0 2024-06-03T00:03:01.558 INFO:tasks.workunit.client.0.smithi049.stdout:9/294: truncate d1/d5/d13/d3b/f48 5810125 0 2024-06-03T00:03:01.559 INFO:tasks.workunit.client.0.smithi049.stdout:4/204: read d4/d3f/d14/d15/f18 [1540470,92756] 0 2024-06-03T00:03:01.559 INFO:tasks.workunit.client.0.smithi049.stdout:4/205: chown d4/d16/d1c 23 1 2024-06-03T00:03:01.562 INFO:tasks.workunit.client.0.smithi049.stdout:2/185: mkdir da/dd/df/d3c 0 2024-06-03T00:03:01.562 INFO:tasks.workunit.client.0.smithi049.stdout:2/186: fsync da/dd/df/f30 0 2024-06-03T00:03:01.564 INFO:tasks.workunit.client.0.smithi049.stdout:6/233: sync 2024-06-03T00:03:01.564 INFO:tasks.workunit.client.0.smithi049.stdout:3/159: sync 2024-06-03T00:03:01.565 INFO:tasks.workunit.client.0.smithi049.stdout:7/180: mknod d3/d8/d23/c43 0 2024-06-03T00:03:01.566 INFO:tasks.workunit.client.0.smithi049.stdout:9/295: symlink d1/da/d26/l57 0 2024-06-03T00:03:01.567 INFO:tasks.workunit.client.0.smithi049.stdout:4/206: unlink d4/d2a/c2f 0 2024-06-03T00:03:01.567 INFO:tasks.workunit.client.0.smithi049.stdout:4/207: write d4/d16/f44 [625989,61557] 0 2024-06-03T00:03:01.567 INFO:tasks.workunit.client.0.smithi049.stdout:4/208: write d4/d3f/d14/d15/f18 [124341,43140] 0 2024-06-03T00:03:01.568 INFO:tasks.workunit.client.0.smithi049.stdout:4/209: chown d4/d3f/d14/f40 12 1 2024-06-03T00:03:01.568 INFO:tasks.workunit.client.0.smithi049.stdout:2/187: symlink da/dd/d37/l3d 0 2024-06-03T00:03:01.569 INFO:tasks.workunit.client.0.smithi049.stdout:3/160: mknod d2/d14/d22/d25/c35 0 2024-06-03T00:03:01.570 INFO:tasks.workunit.client.0.smithi049.stdout:1/268: dread d1/d2f/d36/d37/f16 [4194304,4194304] 0 2024-06-03T00:03:01.572 INFO:tasks.workunit.client.0.smithi049.stdout:7/181: symlink d3/d14/l44 0 2024-06-03T00:03:01.575 INFO:tasks.workunit.client.0.smithi049.stdout:7/182: rmdir d3/d6 39 2024-06-03T00:03:01.576 INFO:tasks.workunit.client.0.smithi049.stdout:1/269: mkdir d1/d2f/d36/d37/d64 0 2024-06-03T00:03:01.578 INFO:tasks.workunit.client.0.smithi049.stdout:7/183: rmdir d3/d6/d9/d37/d3b 0 2024-06-03T00:03:01.581 INFO:tasks.workunit.client.0.smithi049.stdout:1/270: link d1/d2f/d36/d37/d13/d34/l3d d1/d1a/l65 0 2024-06-03T00:03:01.581 INFO:tasks.workunit.client.0.smithi049.stdout:1/271: chown d1/d2f/d36/f4e 1 1 2024-06-03T00:03:01.583 INFO:tasks.workunit.client.0.smithi049.stdout:7/184: truncate d3/d6/f20 2826333 0 2024-06-03T00:03:01.584 INFO:tasks.workunit.client.0.smithi049.stdout:9/296: write d1/da/d26/f32 [2254480,46001] 0 2024-06-03T00:03:01.584 INFO:tasks.workunit.client.0.smithi049.stdout:1/272: chown d1/d2f/d36/d37/l26 229405 1 2024-06-03T00:03:01.584 INFO:tasks.workunit.client.0.smithi049.stdout:0/156: getdents d6 0 2024-06-03T00:03:01.586 INFO:tasks.workunit.client.0.smithi049.stdout:7/185: mknod d3/d8/d23/c45 0 2024-06-03T00:03:01.586 INFO:tasks.workunit.client.0.smithi049.stdout:7/186: write d3/d6/d9/f2b [265659,17475] 0 2024-06-03T00:03:01.586 INFO:tasks.workunit.client.0.smithi049.stdout:4/210: dread d4/d16/d1c/f39 [0,4194304] 0 2024-06-03T00:03:01.588 INFO:tasks.workunit.client.0.smithi049.stdout:9/297: mkdir d1/d5/d13/d3b/d49/d58 0 2024-06-03T00:03:01.590 INFO:tasks.workunit.client.0.smithi049.stdout:1/273: link d1/d2f/d36/l59 d1/d2f/d36/d37/d64/l66 0 2024-06-03T00:03:01.594 INFO:tasks.workunit.client.0.smithi049.stdout:0/157: rename d6/d18 to d6/d30 0 2024-06-03T00:03:01.594 INFO:tasks.workunit.client.0.smithi049.stdout:2/188: dwrite da/dd/df/f27 [0,4194304] 0 2024-06-03T00:03:01.595 INFO:tasks.workunit.client.0.smithi049.stdout:7/187: getdents d3/d6/d13 0 2024-06-03T00:03:01.596 INFO:tasks.workunit.client.0.smithi049.stdout:1/274: dread d1/d2f/d36/d37/d13/f27 [0,4194304] 0 2024-06-03T00:03:01.597 INFO:tasks.workunit.client.0.smithi049.stdout:9/298: creat d1/d5/d13/d3b/f59 x:0 0 0 2024-06-03T00:03:01.597 INFO:tasks.workunit.client.0.smithi049.stdout:9/299: fdatasync d1/d5/d13/d3b/f41 0 2024-06-03T00:03:01.599 INFO:tasks.workunit.client.0.smithi049.stdout:7/188: unlink d3/d6/d13/f1f 0 2024-06-03T00:03:01.600 INFO:tasks.workunit.client.0.smithi049.stdout:1/275: readlink d1/d2f/d36/d37/lf 0 2024-06-03T00:03:01.601 INFO:tasks.workunit.client.0.smithi049.stdout:9/300: mknod d1/d5/d13/d3b/d49/d58/c5a 0 2024-06-03T00:03:01.602 INFO:tasks.workunit.client.0.smithi049.stdout:0/158: mknod d6/d29/c31 0 2024-06-03T00:03:01.603 INFO:tasks.workunit.client.0.smithi049.stdout:2/189: dread f4 [4194304,4194304] 0 2024-06-03T00:03:01.603 INFO:tasks.workunit.client.0.smithi049.stdout:1/276: write d1/d2f/d36/d37/f22 [28015,122965] 0 2024-06-03T00:03:01.604 INFO:tasks.workunit.client.0.smithi049.stdout:3/161: dwrite d2/f11 [0,4194304] 0 2024-06-03T00:03:01.604 INFO:tasks.workunit.client.0.smithi049.stdout:7/189: write d3/d6/d13/f38 [768716,89899] 0 2024-06-03T00:03:01.604 INFO:tasks.workunit.client.0.smithi049.stdout:9/301: mkdir d1/da/d54/d5b 0 2024-06-03T00:03:01.606 INFO:tasks.workunit.client.0.smithi049.stdout:2/190: creat da/f3e x:0 0 0 2024-06-03T00:03:01.608 INFO:tasks.workunit.client.0.smithi049.stdout:1/277: mkdir d1/d2f/d36/d37/d2c/d45/d61/d67 0 2024-06-03T00:03:01.608 INFO:tasks.workunit.client.0.smithi049.stdout:4/211: dwrite d4/f3d [0,4194304] 0 2024-06-03T00:03:01.609 INFO:tasks.workunit.client.0.smithi049.stdout:9/302: read d1/d5/d13/f4b [1125219,14005] 0 2024-06-03T00:03:01.610 INFO:tasks.workunit.client.0.smithi049.stdout:9/303: fsync d1/d5/d13/f4b 0 2024-06-03T00:03:01.611 INFO:tasks.workunit.client.0.smithi049.stdout:3/162: mknod d2/d8/c36 0 2024-06-03T00:03:01.611 INFO:tasks.workunit.client.0.smithi049.stdout:3/163: write d2/f13 [5238712,126300] 0 2024-06-03T00:03:01.613 INFO:tasks.workunit.client.0.smithi049.stdout:7/190: rename d3/d8/d17/f39 to d3/d8/d17/f46 0 2024-06-03T00:03:01.615 INFO:tasks.workunit.client.0.smithi049.stdout:0/159: mkdir d6/d30/d32 0 2024-06-03T00:03:01.616 INFO:tasks.workunit.client.0.smithi049.stdout:2/191: symlink da/dd/df/d3c/l3f 0 2024-06-03T00:03:01.617 INFO:tasks.workunit.client.0.smithi049.stdout:8/189: sync 2024-06-03T00:03:01.617 INFO:tasks.workunit.client.0.smithi049.stdout:8/190: dread - d4/d7/d28/d25/d29/f38 zero size 2024-06-03T00:03:01.617 INFO:tasks.workunit.client.0.smithi049.stdout:1/278: creat d1/d2f/d36/d37/f68 x:0 0 0 2024-06-03T00:03:01.619 INFO:tasks.workunit.client.0.smithi049.stdout:4/212: creat d4/d16/d1c/d24/d43/f45 x:0 0 0 2024-06-03T00:03:01.621 INFO:tasks.workunit.client.0.smithi049.stdout:2/192: dread - da/dd/df/f2c zero size 2024-06-03T00:03:01.622 INFO:tasks.workunit.client.0.smithi049.stdout:1/279: unlink d1/d2f/d36/d37/d64/l66 0 2024-06-03T00:03:01.623 INFO:tasks.workunit.client.0.smithi049.stdout:4/213: truncate d4/d16/d1c/f25 1383877 0 2024-06-03T00:03:01.624 INFO:tasks.workunit.client.0.smithi049.stdout:0/160: write d6/d30/f27 [768103,57048] 0 2024-06-03T00:03:01.625 INFO:tasks.workunit.client.0.smithi049.stdout:8/191: write d4/d7/fc [2468871,26899] 0 2024-06-03T00:03:01.627 INFO:tasks.workunit.client.0.smithi049.stdout:4/214: mknod d4/d3f/d14/d2b/c46 0 2024-06-03T00:03:01.629 INFO:tasks.workunit.client.0.smithi049.stdout:0/161: creat d6/d29/f33 x:0 0 0 2024-06-03T00:03:01.631 INFO:tasks.workunit.client.0.smithi049.stdout:2/193: mkdir da/dd/d40 0 2024-06-03T00:03:01.633 INFO:tasks.workunit.client.0.smithi049.stdout:4/215: symlink d4/d16/d1c/l47 0 2024-06-03T00:03:01.637 INFO:tasks.workunit.client.0.smithi049.stdout:4/216: rename d4/f3d to d4/d3f/d14/d2b/f48 0 2024-06-03T00:03:01.638 INFO:tasks.workunit.client.0.smithi049.stdout:3/164: dwrite d2/d26/f2d [0,4194304] 0 2024-06-03T00:03:01.641 INFO:tasks.workunit.client.0.smithi049.stdout:7/191: unlink d3/d8/d17/f46 0 2024-06-03T00:03:01.641 INFO:tasks.workunit.client.0.smithi049.stdout:0/162: mknod d6/c34 0 2024-06-03T00:03:01.641 INFO:tasks.workunit.client.0.smithi049.stdout:9/304: dwrite d1/d5/d13/f25 [0,4194304] 0 2024-06-03T00:03:01.641 INFO:tasks.workunit.client.0.smithi049.stdout:2/194: mknod da/dd/df/c41 0 2024-06-03T00:03:01.644 INFO:tasks.workunit.client.0.smithi049.stdout:2/195: read da/dd/f26 [196036,40769] 0 2024-06-03T00:03:01.644 INFO:tasks.workunit.client.0.smithi049.stdout:7/192: rename d3 to d3/d14/d47 22 2024-06-03T00:03:01.645 INFO:tasks.workunit.client.0.smithi049.stdout:0/163: mknod d6/d30/d32/c35 0 2024-06-03T00:03:01.650 INFO:tasks.workunit.client.0.smithi049.stdout:9/305: rmdir d1/da/d26 39 2024-06-03T00:03:01.651 INFO:tasks.workunit.client.0.smithi049.stdout:1/280: dwrite d1/d2f/d36/d37/f2b [4194304,4194304] 0 2024-06-03T00:03:01.652 INFO:tasks.workunit.client.0.smithi049.stdout:2/196: mkdir da/dd/d40/d42 0 2024-06-03T00:03:01.653 INFO:tasks.workunit.client.0.smithi049.stdout:1/281: creat d1/d2f/d36/d37/d2c/d45/d61/f69 x:0 0 0 2024-06-03T00:03:01.655 INFO:tasks.workunit.client.0.smithi049.stdout:0/164: symlink d6/d30/l36 0 2024-06-03T00:03:01.657 INFO:tasks.workunit.client.0.smithi049.stdout:9/306: dread d1/d5/d13/f4b [0,4194304] 0 2024-06-03T00:03:01.657 INFO:tasks.workunit.client.0.smithi049.stdout:9/307: getdents d1/da/d54/d5b 0 2024-06-03T00:03:01.657 INFO:tasks.workunit.client.0.smithi049.stdout:1/282: mknod d1/d2f/d36/c6a 0 2024-06-03T00:03:01.658 INFO:tasks.workunit.client.0.smithi049.stdout:0/165: chown d6/c10 71329 1 2024-06-03T00:03:01.659 INFO:tasks.workunit.client.0.smithi049.stdout:9/308: stat d1/da/c18 0 2024-06-03T00:03:01.660 INFO:tasks.workunit.client.0.smithi049.stdout:8/192: dwrite d4/d27/d30/f31 [0,4194304] 0 2024-06-03T00:03:01.660 INFO:tasks.workunit.client.0.smithi049.stdout:8/193: rename d4/d7/d28 to d4/d7/d28/d2b/d3b 22 2024-06-03T00:03:01.661 INFO:tasks.workunit.client.0.smithi049.stdout:0/166: mknod d6/d29/d2e/c37 0 2024-06-03T00:03:01.661 INFO:tasks.workunit.client.0.smithi049.stdout:3/165: dwrite d2/d14/f24 [0,4194304] 0 2024-06-03T00:03:01.662 INFO:tasks.workunit.client.0.smithi049.stdout:4/217: dwrite d4/fd [0,4194304] 0 2024-06-03T00:03:01.662 INFO:tasks.workunit.client.0.smithi049.stdout:4/218: chown d4/d16/d1c/d24/f42 16333475 1 2024-06-03T00:03:01.663 INFO:tasks.workunit.client.0.smithi049.stdout:9/309: creat d1/da/d26/f5c x:0 0 0 2024-06-03T00:03:01.668 INFO:tasks.workunit.client.0.smithi049.stdout:8/194: rename d4/d7/d28/d25/d29 to d4/d27/d3c 0 2024-06-03T00:03:01.673 INFO:tasks.workunit.client.0.smithi049.stdout:3/166: write f0 [1574236,17836] 0 2024-06-03T00:03:01.676 INFO:tasks.workunit.client.0.smithi049.stdout:9/310: symlink d1/d5/d1a/l5d 0 2024-06-03T00:03:01.676 INFO:tasks.workunit.client.0.smithi049.stdout:9/311: chown d1/da/d27/d30/f34 10 1 2024-06-03T00:03:01.677 INFO:tasks.workunit.client.0.smithi049.stdout:5/209: sync 2024-06-03T00:03:01.680 INFO:tasks.workunit.client.0.smithi049.stdout:9/312: creat d1/da/f5e x:0 0 0 2024-06-03T00:03:01.684 INFO:tasks.workunit.client.0.smithi049.stdout:7/193: dwrite d3/d8/d17/f2f [0,4194304] 0 2024-06-03T00:03:01.684 INFO:tasks.workunit.client.0.smithi049.stdout:7/194: fdatasync d3/d8/d17/f2f 0 2024-06-03T00:03:01.688 INFO:tasks.workunit.client.0.smithi049.stdout:7/195: mkdir d3/d6/d13/d3c/d48 0 2024-06-03T00:03:01.693 INFO:tasks.workunit.client.0.smithi049.stdout:7/196: symlink d3/d14/l49 0 2024-06-03T00:03:01.693 INFO:tasks.workunit.client.0.smithi049.stdout:0/167: write d6/f16 [1824759,64398] 0 2024-06-03T00:03:01.694 INFO:tasks.workunit.client.0.smithi049.stdout:0/168: mknod d6/d30/c38 0 2024-06-03T00:03:01.694 INFO:tasks.workunit.client.0.smithi049.stdout:0/169: truncate d6/d29/f33 905133 0 2024-06-03T00:03:01.695 INFO:tasks.workunit.client.0.smithi049.stdout:7/197: dread d3/d8/f10 [0,4194304] 0 2024-06-03T00:03:01.695 INFO:tasks.workunit.client.0.smithi049.stdout:7/198: readlink d3/d6/d9/lb 0 2024-06-03T00:03:01.695 INFO:tasks.workunit.client.0.smithi049.stdout:7/199: chown d3/d6/d9/f2b 119022 1 2024-06-03T00:03:01.696 INFO:tasks.workunit.client.0.smithi049.stdout:8/195: dwrite d4/d27/d3c/f38 [0,4194304] 0 2024-06-03T00:03:01.696 INFO:tasks.workunit.client.0.smithi049.stdout:0/170: symlink d6/d29/d2e/l39 0 2024-06-03T00:03:01.697 INFO:tasks.workunit.client.0.smithi049.stdout:6/234: sync 2024-06-03T00:03:01.697 INFO:tasks.workunit.client.0.smithi049.stdout:6/235: write d2/d3/d9/f25 [916243,42190] 0 2024-06-03T00:03:01.697 INFO:tasks.workunit.client.0.smithi049.stdout:6/236: getdents d2/d3/d9/d23/d48/d53 0 2024-06-03T00:03:01.697 INFO:tasks.workunit.client.0.smithi049.stdout:6/237: fdatasync d2/d4d/f31 0 2024-06-03T00:03:01.697 INFO:tasks.workunit.client.0.smithi049.stdout:2/197: dwrite da/dd/f2b [0,4194304] 0 2024-06-03T00:03:01.700 INFO:tasks.workunit.client.0.smithi049.stdout:8/196: creat d4/d7/d3a/f3d x:0 0 0 2024-06-03T00:03:01.702 INFO:tasks.workunit.client.0.smithi049.stdout:1/283: dwrite d1/d1a/f63 [0,4194304] 0 2024-06-03T00:03:01.703 INFO:tasks.workunit.client.0.smithi049.stdout:7/200: rename d3/d8/d17 to d3/d6/d13/d4a 0 2024-06-03T00:03:01.708 INFO:tasks.workunit.client.0.smithi049.stdout:2/198: mkdir da/d43 0 2024-06-03T00:03:01.708 INFO:tasks.workunit.client.0.smithi049.stdout:2/199: dread - da/f24 zero size 2024-06-03T00:03:01.708 INFO:tasks.workunit.client.0.smithi049.stdout:4/219: dwrite d4/d3f/d14/d15/f18 [4194304,4194304] 0 2024-06-03T00:03:01.710 INFO:tasks.workunit.client.0.smithi049.stdout:1/284: mkdir d1/d2f/d50/d6b 0 2024-06-03T00:03:01.712 INFO:tasks.workunit.client.0.smithi049.stdout:0/171: rename d6/d29/d2e/l39 to d6/d29/l3a 0 2024-06-03T00:03:01.712 INFO:tasks.workunit.client.0.smithi049.stdout:7/201: mkdir d3/d6/d13/d3c/d4b 0 2024-06-03T00:03:01.715 INFO:tasks.workunit.client.0.smithi049.stdout:4/220: link d4/d2a/l3e d4/d3f/d14/d15/l49 0 2024-06-03T00:03:01.716 INFO:tasks.workunit.client.0.smithi049.stdout:8/197: mknod d4/c3e 0 2024-06-03T00:03:01.718 INFO:tasks.workunit.client.0.smithi049.stdout:6/238: rename d2/d3/d9/d23/d29/d30/f16 to d2/d3/d9/f54 0 2024-06-03T00:03:01.718 INFO:tasks.workunit.client.0.smithi049.stdout:0/172: getdents d6/d30/d32 0 2024-06-03T00:03:01.719 INFO:tasks.workunit.client.0.smithi049.stdout:6/239: write d2/d3/f38 [909598,126635] 0 2024-06-03T00:03:01.720 INFO:tasks.workunit.client.0.smithi049.stdout:0/173: creat d6/d30/f3b x:0 0 0 2024-06-03T00:03:01.720 INFO:tasks.workunit.client.0.smithi049.stdout:0/174: fsync d6/d29/f2d 0 2024-06-03T00:03:01.722 INFO:tasks.workunit.client.0.smithi049.stdout:7/202: link d3/d8/c2e d3/d14/c4c 0 2024-06-03T00:03:01.723 INFO:tasks.workunit.client.0.smithi049.stdout:6/240: mkdir d2/d3/d9/d55 0 2024-06-03T00:03:01.723 INFO:tasks.workunit.client.0.smithi049.stdout:6/241: write d2/d3/d9/d23/d29/f32 [4204114,57435] 0 2024-06-03T00:03:01.724 INFO:tasks.workunit.client.0.smithi049.stdout:0/175: symlink d6/d29/l3c 0 2024-06-03T00:03:01.725 INFO:tasks.workunit.client.0.smithi049.stdout:9/313: dwrite d1/da/f42 [0,4194304] 0 2024-06-03T00:03:01.725 INFO:tasks.workunit.client.0.smithi049.stdout:7/203: truncate d3/f30 793433 0 2024-06-03T00:03:01.726 INFO:tasks.workunit.client.0.smithi049.stdout:3/167: dwrite d2/fd [0,4194304] 0 2024-06-03T00:03:01.726 INFO:tasks.workunit.client.0.smithi049.stdout:7/204: dread d3/f1b [0,4194304] 0 2024-06-03T00:03:01.726 INFO:tasks.workunit.client.0.smithi049.stdout:7/205: chown d3/d14/l36 97772 1 2024-06-03T00:03:01.727 INFO:tasks.workunit.client.0.smithi049.stdout:7/206: fsync d3/f40 0 2024-06-03T00:03:01.727 INFO:tasks.workunit.client.0.smithi049.stdout:6/242: mknod d2/d3/d9/d23/d29/d30/c56 0 2024-06-03T00:03:01.728 INFO:tasks.workunit.client.0.smithi049.stdout:5/210: dwrite d3/d11/d14/f29 [0,4194304] 0 2024-06-03T00:03:01.729 INFO:tasks.workunit.client.0.smithi049.stdout:7/207: dread d3/f22 [0,4194304] 0 2024-06-03T00:03:01.729 INFO:tasks.workunit.client.0.smithi049.stdout:7/208: chown d3/d32 107474604 1 2024-06-03T00:03:01.729 INFO:tasks.workunit.client.0.smithi049.stdout:0/176: truncate f3 3890289 0 2024-06-03T00:03:01.732 INFO:tasks.workunit.client.0.smithi049.stdout:9/314: mkdir d1/da/d27/d30/d5f 0 2024-06-03T00:03:01.735 INFO:tasks.workunit.client.0.smithi049.stdout:3/168: creat d2/d1a/f37 x:0 0 0 2024-06-03T00:03:01.735 INFO:tasks.workunit.client.0.smithi049.stdout:3/169: chown d2/d14/c23 207546 1 2024-06-03T00:03:01.738 INFO:tasks.workunit.client.0.smithi049.stdout:1/285: dwrite d1/d1a/f5d [0,4194304] 0 2024-06-03T00:03:01.738 INFO:tasks.workunit.client.0.smithi049.stdout:4/221: dwrite d4/d2a/f34 [0,4194304] 0 2024-06-03T00:03:01.738 INFO:tasks.workunit.client.0.smithi049.stdout:1/286: read - d1/d2f/d36/d37/d2c/d45/d61/f69 zero size 2024-06-03T00:03:01.738 INFO:tasks.workunit.client.0.smithi049.stdout:4/222: chown d4/d3f/d14/d15/f18 25 1 2024-06-03T00:03:01.738 INFO:tasks.workunit.client.0.smithi049.stdout:1/287: dread - d1/d2f/f44 zero size 2024-06-03T00:03:01.742 INFO:tasks.workunit.client.0.smithi049.stdout:5/211: creat d3/d5/da/f44 x:0 0 0 2024-06-03T00:03:01.742 INFO:tasks.workunit.client.0.smithi049.stdout:5/212: fsync d3/d11/f21 0 2024-06-03T00:03:01.743 INFO:tasks.workunit.client.0.smithi049.stdout:0/177: creat d6/f3d x:0 0 0 2024-06-03T00:03:01.745 INFO:tasks.workunit.client.0.smithi049.stdout:9/315: symlink d1/da/d54/l60 0 2024-06-03T00:03:01.745 INFO:tasks.workunit.client.0.smithi049.stdout:9/316: fsync d1/da/d26/f5c 0 2024-06-03T00:03:01.746 INFO:tasks.workunit.client.0.smithi049.stdout:9/317: read d1/d5/d13/f53 [2193727,79990] 0 2024-06-03T00:03:01.746 INFO:tasks.workunit.client.0.smithi049.stdout:9/318: dread - d1/d5/d1a/f51 zero size 2024-06-03T00:03:01.747 INFO:tasks.workunit.client.0.smithi049.stdout:3/170: creat d2/d14/d22/d25/f38 x:0 0 0 2024-06-03T00:03:01.747 INFO:tasks.workunit.client.0.smithi049.stdout:3/171: chown d2/d1a/d31 4 1 2024-06-03T00:03:01.747 INFO:tasks.workunit.client.0.smithi049.stdout:3/172: dread - d2/d14/d22/f2a zero size 2024-06-03T00:03:01.750 INFO:tasks.workunit.client.0.smithi049.stdout:4/223: creat d4/d16/d1c/d24/f4a x:0 0 0 2024-06-03T00:03:01.753 INFO:tasks.workunit.client.0.smithi049.stdout:5/213: rmdir d3/d11/d14 39 2024-06-03T00:03:01.756 INFO:tasks.workunit.client.0.smithi049.stdout:9/319: mkdir d1/da/d54/d5b/d61 0 2024-06-03T00:03:01.757 INFO:tasks.workunit.client.0.smithi049.stdout:3/173: creat d2/f39 x:0 0 0 2024-06-03T00:03:01.759 INFO:tasks.workunit.client.0.smithi049.stdout:4/224: creat d4/d16/d1c/d24/d43/f4b x:0 0 0 2024-06-03T00:03:01.760 INFO:tasks.workunit.client.0.smithi049.stdout:5/214: symlink d3/d11/d14/d16/l45 0 2024-06-03T00:03:01.761 INFO:tasks.workunit.client.0.smithi049.stdout:3/174: mkdir d2/d14/d22/d3a 0 2024-06-03T00:03:01.765 INFO:tasks.workunit.client.0.smithi049.stdout:4/225: truncate d4/d16/f44 561180 0 2024-06-03T00:03:01.765 INFO:tasks.workunit.client.0.smithi049.stdout:4/226: read - d4/f31 zero size 2024-06-03T00:03:01.765 INFO:tasks.workunit.client.0.smithi049.stdout:4/227: read - d4/f31 zero size 2024-06-03T00:03:01.766 INFO:tasks.workunit.client.0.smithi049.stdout:4/228: dread - d4/d3f/d14/f40 zero size 2024-06-03T00:03:01.767 INFO:tasks.workunit.client.0.smithi049.stdout:5/215: creat d3/d11/d14/d16/f46 x:0 0 0 2024-06-03T00:03:01.767 INFO:tasks.workunit.client.0.smithi049.stdout:0/178: dwrite d6/d29/d2e/f2a [0,4194304] 0 2024-06-03T00:03:01.768 INFO:tasks.workunit.client.0.smithi049.stdout:5/216: rmdir d3/d11/d14 39 2024-06-03T00:03:01.768 INFO:tasks.workunit.client.0.smithi049.stdout:9/320: write d1/d5/d13/d3b/f48 [214951,23828] 0 2024-06-03T00:03:01.769 INFO:tasks.workunit.client.0.smithi049.stdout:0/179: dread d6/d29/d2e/f2b [0,4194304] 0 2024-06-03T00:03:01.770 INFO:tasks.workunit.client.0.smithi049.stdout:0/180: truncate d6/d29/f2d 601874 0 2024-06-03T00:03:01.770 INFO:tasks.workunit.client.0.smithi049.stdout:0/181: read d6/f16 [2195275,95187] 0 2024-06-03T00:03:01.770 INFO:tasks.workunit.client.0.smithi049.stdout:1/288: dwrite d1/d2f/d36/d37/f16 [0,4194304] 0 2024-06-03T00:03:01.771 INFO:tasks.workunit.client.0.smithi049.stdout:5/217: unlink d3/d5/da/f15 0 2024-06-03T00:03:01.772 INFO:tasks.workunit.client.0.smithi049.stdout:9/321: creat d1/da/d54/d5b/d61/f62 x:0 0 0 2024-06-03T00:03:01.773 INFO:tasks.workunit.client.0.smithi049.stdout:4/229: dread d4/d3f/d14/d15/f28 [0,4194304] 0 2024-06-03T00:03:01.773 INFO:tasks.workunit.client.0.smithi049.stdout:4/230: stat f2 0 2024-06-03T00:03:01.773 INFO:tasks.workunit.client.0.smithi049.stdout:0/182: readlink d6/l13 0 2024-06-03T00:03:01.774 INFO:tasks.workunit.client.0.smithi049.stdout:1/289: mkdir d1/d2f/d36/d37/d64/d6c 0 2024-06-03T00:03:01.777 INFO:tasks.workunit.client.0.smithi049.stdout:4/231: link d4/d3f/l11 d4/d2a/l4c 0 2024-06-03T00:03:01.777 INFO:tasks.workunit.client.0.smithi049.stdout:0/183: mknod d6/d29/d2e/c3e 0 2024-06-03T00:03:01.779 INFO:tasks.workunit.client.0.smithi049.stdout:4/232: creat d4/d3f/f4d x:0 0 0 2024-06-03T00:03:01.779 INFO:tasks.workunit.client.0.smithi049.stdout:4/233: chown d4/d16/d1c 475904664 1 2024-06-03T00:03:01.781 INFO:tasks.workunit.client.0.smithi049.stdout:0/184: creat d6/f3f x:0 0 0 2024-06-03T00:03:01.781 INFO:tasks.workunit.client.0.smithi049.stdout:0/185: write d6/d29/f33 [262697,62532] 0 2024-06-03T00:03:01.783 INFO:tasks.workunit.client.0.smithi049.stdout:4/234: rename d4/d3f/c3a to d4/d3f/d14/d15/c4e 0 2024-06-03T00:03:01.785 INFO:tasks.workunit.client.0.smithi049.stdout:0/186: creat d6/d30/d32/f40 x:0 0 0 2024-06-03T00:03:01.786 INFO:tasks.workunit.client.0.smithi049.stdout:4/235: mkdir d4/d16/d1c/d4f 0 2024-06-03T00:03:01.786 INFO:tasks.workunit.client.0.smithi049.stdout:4/236: write d4/d16/d1c/f25 [2001296,26302] 0 2024-06-03T00:03:01.789 INFO:tasks.workunit.client.0.smithi049.stdout:9/322: dwrite d1/d5/d13/f25 [0,4194304] 0 2024-06-03T00:03:01.791 INFO:tasks.workunit.client.0.smithi049.stdout:3/175: fsync d2/f39 0 2024-06-03T00:03:01.791 INFO:tasks.workunit.client.0.smithi049.stdout:3/176: write d2/d14/d22/d25/f38 [321443,46510] 0 2024-06-03T00:03:01.792 INFO:tasks.workunit.client.0.smithi049.stdout:9/323: symlink d1/da/d27/l63 0 2024-06-03T00:03:01.799 INFO:tasks.workunit.client.0.smithi049.stdout:4/237: getdents d4/d2a 0 2024-06-03T00:03:01.800 INFO:tasks.workunit.client.0.smithi049.stdout:4/238: write d4/d16/d1c/f25 [1555854,121098] 0 2024-06-03T00:03:01.805 INFO:tasks.workunit.client.0.smithi049.stdout:1/290: dwrite d1/d2f/d36/d37/d13/d42/f5a [0,4194304] 0 2024-06-03T00:03:01.805 INFO:tasks.workunit.client.0.smithi049.stdout:3/177: dread f0 [0,4194304] 0 2024-06-03T00:03:01.805 INFO:tasks.workunit.client.0.smithi049.stdout:3/178: stat d2/d1a/d31 0 2024-06-03T00:03:01.810 INFO:tasks.workunit.client.0.smithi049.stdout:1/291: rmdir d1/d2f/d36/d37/d13 39 2024-06-03T00:03:01.811 INFO:tasks.workunit.client.0.smithi049.stdout:0/187: dwrite d6/d29/d2e/f2a [0,4194304] 0 2024-06-03T00:03:01.812 INFO:tasks.workunit.client.0.smithi049.stdout:3/179: link d2/f39 d2/d1a/d34/f3b 0 2024-06-03T00:03:01.812 INFO:tasks.workunit.client.0.smithi049.stdout:1/292: rmdir d1/d2f/d36/d37/d2c 39 2024-06-03T00:03:01.814 INFO:tasks.workunit.client.0.smithi049.stdout:0/188: mknod d6/d29/d2e/c41 0 2024-06-03T00:03:01.815 INFO:tasks.workunit.client.0.smithi049.stdout:0/189: symlink d6/d29/l42 0 2024-06-03T00:03:01.816 INFO:tasks.workunit.client.0.smithi049.stdout:0/190: symlink d6/d30/l43 0 2024-06-03T00:03:01.825 INFO:tasks.workunit.client.0.smithi049.stdout:9/324: dwrite d1/d5/d1a/f51 [0,4194304] 0 2024-06-03T00:03:01.825 INFO:tasks.workunit.client.0.smithi049.stdout:4/239: dwrite d4/d16/d1c/f1f [0,4194304] 0 2024-06-03T00:03:01.829 INFO:tasks.workunit.client.0.smithi049.stdout:4/240: mknod d4/d3f/c50 0 2024-06-03T00:03:01.830 INFO:tasks.workunit.client.0.smithi049.stdout:3/180: dwrite d2/d14/d22/f2a [0,4194304] 0 2024-06-03T00:03:01.830 INFO:tasks.workunit.client.0.smithi049.stdout:4/241: creat d4/d16/d1c/d24/f51 x:0 0 0 2024-06-03T00:03:01.832 INFO:tasks.workunit.client.0.smithi049.stdout:3/181: symlink d2/d14/d22/l3c 0 2024-06-03T00:03:01.832 INFO:tasks.workunit.client.0.smithi049.stdout:3/182: chown d2/d1a/f1d 0 1 2024-06-03T00:03:01.833 INFO:tasks.workunit.client.0.smithi049.stdout:4/242: creat d4/d3f/f52 x:0 0 0 2024-06-03T00:03:01.833 INFO:tasks.workunit.client.0.smithi049.stdout:4/243: dread - d4/d16/d1c/d24/d43/f4b zero size 2024-06-03T00:03:01.833 INFO:tasks.workunit.client.0.smithi049.stdout:4/244: write d4/f31 [274871,113012] 0 2024-06-03T00:03:01.833 INFO:tasks.workunit.client.0.smithi049.stdout:3/183: symlink d2/d14/d22/d25/l3d 0 2024-06-03T00:03:01.835 INFO:tasks.workunit.client.0.smithi049.stdout:8/198: sync 2024-06-03T00:03:01.835 INFO:tasks.workunit.client.0.smithi049.stdout:2/200: sync 2024-06-03T00:03:01.835 INFO:tasks.workunit.client.0.smithi049.stdout:2/201: stat da/dd/f26 0 2024-06-03T00:03:01.835 INFO:tasks.workunit.client.0.smithi049.stdout:2/202: rename da/dd to da/dd/d40/d44 22 2024-06-03T00:03:01.836 INFO:tasks.workunit.client.0.smithi049.stdout:4/245: write d4/d3f/d14/d15/f28 [3005287,70520] 0 2024-06-03T00:03:01.836 INFO:tasks.workunit.client.0.smithi049.stdout:8/199: symlink d4/d27/d3c/l3f 0 2024-06-03T00:03:01.837 INFO:tasks.workunit.client.0.smithi049.stdout:8/200: dread - d4/d7/f22 zero size 2024-06-03T00:03:01.837 INFO:tasks.workunit.client.0.smithi049.stdout:8/201: chown d4/d7/f1b 64098096 1 2024-06-03T00:03:01.837 INFO:tasks.workunit.client.0.smithi049.stdout:1/293: dwrite d1/d2f/f44 [0,4194304] 0 2024-06-03T00:03:01.837 INFO:tasks.workunit.client.0.smithi049.stdout:2/203: unlink da/dd/d37/c3b 0 2024-06-03T00:03:01.838 INFO:tasks.workunit.client.0.smithi049.stdout:2/204: chown da/dd/d37/l3d 13309883 1 2024-06-03T00:03:01.838 INFO:tasks.workunit.client.0.smithi049.stdout:4/246: mknod d4/d2a/c53 0 2024-06-03T00:03:01.838 INFO:tasks.workunit.client.0.smithi049.stdout:4/247: fsync d4/d2a/f34 0 2024-06-03T00:03:01.839 INFO:tasks.workunit.client.0.smithi049.stdout:8/202: creat d4/d7/d3a/f40 x:0 0 0 2024-06-03T00:03:01.842 INFO:tasks.workunit.client.0.smithi049.stdout:1/294: creat d1/d2f/d36/d37/d2c/d45/d61/d67/f6d x:0 0 0 2024-06-03T00:03:01.842 INFO:tasks.workunit.client.0.smithi049.stdout:1/295: stat d1/d2f/d36/d37/d64/d6c 0 2024-06-03T00:03:01.845 INFO:tasks.workunit.client.0.smithi049.stdout:2/205: link da/dd/f13 da/f45 0 2024-06-03T00:03:01.845 INFO:tasks.workunit.client.0.smithi049.stdout:2/206: readlink da/dd/d37/l3d 0 2024-06-03T00:03:01.845 INFO:tasks.workunit.client.0.smithi049.stdout:0/191: dwrite d6/f21 [0,4194304] 0 2024-06-03T00:03:01.846 INFO:tasks.workunit.client.0.smithi049.stdout:9/325: dwrite d1/da/f5e [0,4194304] 0 2024-06-03T00:03:01.846 INFO:tasks.workunit.client.0.smithi049.stdout:4/248: symlink d4/l54 0 2024-06-03T00:03:01.846 INFO:tasks.workunit.client.0.smithi049.stdout:4/249: fsync d4/d16/f35 0 2024-06-03T00:03:01.847 INFO:tasks.workunit.client.0.smithi049.stdout:8/203: truncate d4/d27/d3c/f38 4007017 0 2024-06-03T00:03:01.847 INFO:tasks.workunit.client.0.smithi049.stdout:8/204: dread - d4/d27/d3c/f2f zero size 2024-06-03T00:03:01.851 INFO:tasks.workunit.client.0.smithi049.stdout:3/184: dwrite f0 [0,4194304] 0 2024-06-03T00:03:01.854 INFO:tasks.workunit.client.0.smithi049.stdout:9/326: dread d1/d5/d13/d3b/f48 [0,4194304] 0 2024-06-03T00:03:01.855 INFO:tasks.workunit.client.0.smithi049.stdout:2/207: dread da/dd/df/f23 [0,4194304] 0 2024-06-03T00:03:01.855 INFO:tasks.workunit.client.0.smithi049.stdout:4/250: creat d4/d16/d1c/d4f/f55 x:0 0 0 2024-06-03T00:03:01.855 INFO:tasks.workunit.client.0.smithi049.stdout:4/251: fdatasync d4/d3f/f52 0 2024-06-03T00:03:01.856 INFO:tasks.workunit.client.0.smithi049.stdout:1/296: mkdir d1/d2f/d36/d37/d13/d34/d6e 0 2024-06-03T00:03:01.859 INFO:tasks.workunit.client.0.smithi049.stdout:0/192: rename f3 to d6/d30/f44 0 2024-06-03T00:03:01.859 INFO:tasks.workunit.client.0.smithi049.stdout:8/205: write d4/d7/f14 [3240661,31880] 0 2024-06-03T00:03:01.859 INFO:tasks.workunit.client.0.smithi049.stdout:8/206: write d4/d7/f1a [6153126,81093] 0 2024-06-03T00:03:01.860 INFO:tasks.workunit.client.0.smithi049.stdout:9/327: creat d1/d5/d13/d3b/d49/f64 x:0 0 0 2024-06-03T00:03:01.861 INFO:tasks.workunit.client.0.smithi049.stdout:4/252: creat d4/d3f/f56 x:0 0 0 2024-06-03T00:03:01.864 INFO:tasks.workunit.client.0.smithi049.stdout:2/208: rename da/dd/c2a to da/dd/d40/d42/c46 0 2024-06-03T00:03:01.864 INFO:tasks.workunit.client.0.smithi049.stdout:2/209: dread - da/f24 zero size 2024-06-03T00:03:01.866 INFO:tasks.workunit.client.0.smithi049.stdout:0/193: symlink d6/d30/d32/l45 0 2024-06-03T00:03:01.867 INFO:tasks.workunit.client.0.smithi049.stdout:9/328: creat d1/d5/d13/d3b/f65 x:0 0 0 2024-06-03T00:03:01.867 INFO:tasks.workunit.client.0.smithi049.stdout:9/329: chown d1/d5/d13/d3b/d49/d58 4483638 1 2024-06-03T00:03:01.870 INFO:tasks.workunit.client.0.smithi049.stdout:1/297: rename d1/f3a to d1/d2f/d36/d37/d2c/d45/d5e/f6f 0 2024-06-03T00:03:01.871 INFO:tasks.workunit.client.0.smithi049.stdout:2/210: creat da/f47 x:0 0 0 2024-06-03T00:03:01.872 INFO:tasks.workunit.client.0.smithi049.stdout:6/243: sync 2024-06-03T00:03:01.874 INFO:tasks.workunit.client.0.smithi049.stdout:1/298: mkdir d1/d2f/d36/d37/d2c/d45/d61/d70 0 2024-06-03T00:03:01.875 INFO:tasks.workunit.client.0.smithi049.stdout:1/299: fsync d1/d2f/d36/d37/f1f 0 2024-06-03T00:03:01.875 INFO:tasks.workunit.client.0.smithi049.stdout:6/244: dread d2/d3/d9/d23/d29/d30/f43 [0,4194304] 0 2024-06-03T00:03:01.875 INFO:tasks.workunit.client.0.smithi049.stdout:6/245: fdatasync d2/d3/d9/d23/d36/f4b 0 2024-06-03T00:03:01.875 INFO:tasks.workunit.client.0.smithi049.stdout:6/246: truncate d2/d3/d9/d23/d29/f2d 1220149 0 2024-06-03T00:03:01.875 INFO:tasks.workunit.client.0.smithi049.stdout:6/247: fdatasync d2/d3/d9/d23/d29/f32 0 2024-06-03T00:03:01.876 INFO:tasks.workunit.client.0.smithi049.stdout:1/300: read d1/f3e [771857,6931] 0 2024-06-03T00:03:01.876 INFO:tasks.workunit.client.0.smithi049.stdout:1/301: write d1/d2f/d36/f4e [148317,122940] 0 2024-06-03T00:03:01.876 INFO:tasks.workunit.client.0.smithi049.stdout:1/302: chown d1/d2f/d36/c6a 904 1 2024-06-03T00:03:01.877 INFO:tasks.workunit.client.0.smithi049.stdout:0/194: fsync d6/d30/f44 0 2024-06-03T00:03:01.879 INFO:tasks.workunit.client.0.smithi049.stdout:3/185: truncate f0 1614748 0 2024-06-03T00:03:01.879 INFO:tasks.workunit.client.0.smithi049.stdout:3/186: write d2/f39 [658934,115986] 0 2024-06-03T00:03:01.881 INFO:tasks.workunit.client.0.smithi049.stdout:2/211: read da/f45 [2253077,119797] 0 2024-06-03T00:03:01.882 INFO:tasks.workunit.client.0.smithi049.stdout:9/330: dread d1/da/d26/f33 [0,4194304] 0 2024-06-03T00:03:01.882 INFO:tasks.workunit.client.0.smithi049.stdout:4/253: dwrite d4/d16/d1c/d24/d43/f45 [0,4194304] 0 2024-06-03T00:03:01.882 INFO:tasks.workunit.client.0.smithi049.stdout:8/207: dwrite d4/d7/f16 [0,4194304] 0 2024-06-03T00:03:01.884 INFO:tasks.workunit.client.0.smithi049.stdout:2/212: creat da/dd/d40/d42/f48 x:0 0 0 2024-06-03T00:03:01.884 INFO:tasks.workunit.client.0.smithi049.stdout:2/213: read - da/dd/df/f34 zero size 2024-06-03T00:03:01.888 INFO:tasks.workunit.client.0.smithi049.stdout:3/187: dread d2/d1a/d34/f3b [0,4194304] 0 2024-06-03T00:03:01.888 INFO:tasks.workunit.client.0.smithi049.stdout:9/331: mkdir d1/d5/d13/d66 0 2024-06-03T00:03:01.890 INFO:tasks.workunit.client.0.smithi049.stdout:0/195: dread d6/d29/d2e/f2a [0,4194304] 0 2024-06-03T00:03:01.896 INFO:tasks.workunit.client.0.smithi049.stdout:8/208: creat d4/d27/d30/f41 x:0 0 0 2024-06-03T00:03:01.897 INFO:tasks.workunit.client.0.smithi049.stdout:1/303: dwrite d1/f7 [0,4194304] 0 2024-06-03T00:03:01.899 INFO:tasks.workunit.client.0.smithi049.stdout:9/332: symlink d1/da/d26/l67 0 2024-06-03T00:03:01.899 INFO:tasks.workunit.client.0.smithi049.stdout:9/333: read d1/d5/d13/d3b/f4a [32898,58060] 0 2024-06-03T00:03:01.900 INFO:tasks.workunit.client.0.smithi049.stdout:4/254: dread d4/d16/d1c/f25 [0,4194304] 0 2024-06-03T00:03:01.900 INFO:tasks.workunit.client.0.smithi049.stdout:8/209: rename d4/d7/c24 to d4/d7/c42 0 2024-06-03T00:03:01.901 INFO:tasks.workunit.client.0.smithi049.stdout:6/248: dwrite d2/d3/d9/d23/f4e [0,4194304] 0 2024-06-03T00:03:01.901 INFO:tasks.workunit.client.0.smithi049.stdout:6/249: write d2/d3/d9/d23/d36/f45 [4576213,100401] 0 2024-06-03T00:03:01.901 INFO:tasks.workunit.client.0.smithi049.stdout:6/250: truncate d2/d3/d9/f3d 266487 0 2024-06-03T00:03:01.901 INFO:tasks.workunit.client.0.smithi049.stdout:2/214: mkdir da/dd/d49 0 2024-06-03T00:03:01.902 INFO:tasks.workunit.client.0.smithi049.stdout:3/188: write d2/d14/f24 [3266366,84128] 0 2024-06-03T00:03:01.902 INFO:tasks.workunit.client.0.smithi049.stdout:5/218: sync 2024-06-03T00:03:01.902 INFO:tasks.workunit.client.0.smithi049.stdout:7/209: sync 2024-06-03T00:03:01.902 INFO:tasks.workunit.client.0.smithi049.stdout:9/334: symlink d1/d5/d13/d3b/d49/l68 0 2024-06-03T00:03:01.904 INFO:tasks.workunit.client.0.smithi049.stdout:4/255: creat d4/d16/f57 x:0 0 0 2024-06-03T00:03:01.905 INFO:tasks.workunit.client.0.smithi049.stdout:8/210: mkdir d4/d27/d3c/d43 0 2024-06-03T00:03:01.905 INFO:tasks.workunit.client.0.smithi049.stdout:8/211: chown d4/d7 444 1 2024-06-03T00:03:01.907 INFO:tasks.workunit.client.0.smithi049.stdout:7/210: dread d3/d6/f12 [0,4194304] 0 2024-06-03T00:03:01.907 INFO:tasks.workunit.client.0.smithi049.stdout:7/211: chown d3/d32 29 1 2024-06-03T00:03:01.908 INFO:tasks.workunit.client.0.smithi049.stdout:6/251: mkdir d2/d3/d17/d57 0 2024-06-03T00:03:01.909 INFO:tasks.workunit.client.0.smithi049.stdout:6/252: read d2/d3/d9/f27 [383116,70474] 0 2024-06-03T00:03:01.909 INFO:tasks.workunit.client.0.smithi049.stdout:8/212: dread d4/d7/f1b [0,4194304] 0 2024-06-03T00:03:01.911 INFO:tasks.workunit.client.0.smithi049.stdout:2/215: unlink da/f3e 0 2024-06-03T00:03:01.913 INFO:tasks.workunit.client.0.smithi049.stdout:3/189: unlink d2/d26/f2d 0 2024-06-03T00:03:01.914 INFO:tasks.workunit.client.0.smithi049.stdout:5/219: creat d3/d11/d14/f47 x:0 0 0 2024-06-03T00:03:01.914 INFO:tasks.workunit.client.0.smithi049.stdout:5/220: readlink d3/d5/d2d/l3f 0 2024-06-03T00:03:01.915 INFO:tasks.workunit.client.0.smithi049.stdout:9/335: symlink d1/d5/d13/d66/l69 0 2024-06-03T00:03:01.915 INFO:tasks.workunit.client.0.smithi049.stdout:9/336: dread - d1/d5/d1a/f4e zero size 2024-06-03T00:03:01.915 INFO:tasks.workunit.client.0.smithi049.stdout:9/337: chown d1/da/d27/f40 234 1 2024-06-03T00:03:01.916 INFO:tasks.workunit.client.0.smithi049.stdout:1/304: dwrite d1/d2f/d36/d37/d13/d34/f3b [0,4194304] 0 2024-06-03T00:03:01.916 INFO:tasks.workunit.client.0.smithi049.stdout:1/305: fdatasync d1/d2f/d36/d37/d13/f27 0 2024-06-03T00:03:01.917 INFO:tasks.workunit.client.0.smithi049.stdout:4/256: rename d4/f31 to d4/d16/f58 0 2024-06-03T00:03:01.917 INFO:tasks.workunit.client.0.smithi049.stdout:4/257: chown d4/d16/d1c/f39 3945 1 2024-06-03T00:03:01.918 INFO:tasks.workunit.client.0.smithi049.stdout:7/212: getdents d3/d6/d9 0 2024-06-03T00:03:01.919 INFO:tasks.workunit.client.0.smithi049.stdout:2/216: creat da/dd/f4a x:0 0 0 2024-06-03T00:03:01.920 INFO:tasks.workunit.client.0.smithi049.stdout:5/221: mknod d3/d5/da/c48 0 2024-06-03T00:03:01.921 INFO:tasks.workunit.client.0.smithi049.stdout:9/338: mkdir d1/d5/d13/d6a 0 2024-06-03T00:03:01.922 INFO:tasks.workunit.client.0.smithi049.stdout:3/190: read d2/d14/d22/f2a [1387452,12225] 0 2024-06-03T00:03:01.924 INFO:tasks.workunit.client.0.smithi049.stdout:1/306: mkdir d1/d2f/d36/d37/d13/d71 0 2024-06-03T00:03:01.924 INFO:tasks.workunit.client.0.smithi049.stdout:1/307: getdents d1/d2f/d50/d6b 0 2024-06-03T00:03:01.924 INFO:tasks.workunit.client.0.smithi049.stdout:1/308: truncate d1/d2f/d36/d37/d13/f47 141226 0 2024-06-03T00:03:01.925 INFO:tasks.workunit.client.0.smithi049.stdout:7/213: link d3/f22 d3/d8/f4d 0 2024-06-03T00:03:01.926 INFO:tasks.workunit.client.0.smithi049.stdout:2/217: mkdir da/dd/d49/d4b 0 2024-06-03T00:03:01.926 INFO:tasks.workunit.client.0.smithi049.stdout:6/253: dwrite d2/d3/d9/d23/d29/f2d [0,4194304] 0 2024-06-03T00:03:01.927 INFO:tasks.workunit.client.0.smithi049.stdout:5/222: creat d3/d9/f49 x:0 0 0 2024-06-03T00:03:01.928 INFO:tasks.workunit.client.0.smithi049.stdout:3/191: creat d2/d14/d22/d3a/f3e x:0 0 0 2024-06-03T00:03:01.929 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-06-03T00:03:01.929 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-03T00:03:01.930 INFO:tasks.workunit.client.0.smithi049.stdout:1/309: mkdir d1/d2f/d36/d57/d72 0 2024-06-03T00:03:01.930 INFO:tasks.workunit.client.0.smithi049.stdout:1/310: truncate d1/d2f/d36/d37/d2c/d45/d5e/f6f 139525 0 2024-06-03T00:03:01.931 INFO:tasks.workunit.client.0.smithi049.stdout:7/214: mkdir d3/d6/d13/d3c/d48/d4e 0 2024-06-03T00:03:01.933 INFO:tasks.workunit.client.0.smithi049.stdout:2/218: rename da/c1e to da/dd/d40/d42/c4c 0 2024-06-03T00:03:01.935 INFO:tasks.workunit.client.0.smithi049.stdout:4/258: dwrite d4/d16/f44 [0,4194304] 0 2024-06-03T00:03:01.937 INFO:tasks.workunit.client.0.smithi049.stdout:6/254: creat d2/d4d/f58 x:0 0 0 2024-06-03T00:03:01.938 INFO:tasks.workunit.client.0.smithi049.stdout:5/223: mknod d3/d11/c4a 0 2024-06-03T00:03:01.939 INFO:tasks.workunit.client.0.smithi049.stdout:1/311: mknod d1/d2f/c73 0 2024-06-03T00:03:01.940 INFO:tasks.workunit.client.0.smithi049.stdout:7/215: truncate d3/d6/f12 368826 0 2024-06-03T00:03:01.942 INFO:tasks.workunit.client.0.smithi049.stdout:2/219: creat da/dd/d40/f4d x:0 0 0 2024-06-03T00:03:01.944 INFO:tasks.workunit.client.0.smithi049.stdout:3/192: dwrite f0 [0,4194304] 0 2024-06-03T00:03:01.945 INFO:tasks.workunit.client.0.smithi049.stdout:4/259: getdents d4/d16/d1c/d24 0 2024-06-03T00:03:01.947 INFO:tasks.workunit.client.0.smithi049.stdout:6/255: rename d2/f24 to d2/d3/d9/d23/d29/f59 0 2024-06-03T00:03:01.947 INFO:tasks.workunit.client.0.smithi049.stdout:6/256: write d2/d3/d9/d23/f1a [527926,94997] 0 2024-06-03T00:03:01.948 INFO:tasks.workunit.client.0.smithi049.stdout:5/224: mkdir d3/d5/d2d/d4b 0 2024-06-03T00:03:01.948 INFO:tasks.workunit.client.0.smithi049.stdout:2/220: write da/dd/df/f23 [7739007,108309] 0 2024-06-03T00:03:01.949 INFO:tasks.workunit.client.0.smithi049.stdout:1/312: creat d1/d1a/f74 x:0 0 0 2024-06-03T00:03:01.949 INFO:tasks.workunit.client.0.smithi049.stdout:1/313: write d1/f2d [591113,10971] 0 2024-06-03T00:03:01.954 INFO:tasks.workunit.client.0.smithi049.stdout:4/260: unlink d4/d16/f35 0 2024-06-03T00:03:01.954 INFO:tasks.workunit.client.0.smithi049.stdout:6/257: link d2/d3/d9/d23/f1a d2/d3/d9/d23/d29/d30/f5a 0 2024-06-03T00:03:01.954 INFO:tasks.workunit.client.0.smithi049.stdout:5/225: mkdir d3/d9/d20/d4c 0 2024-06-03T00:03:01.954 INFO:tasks.workunit.client.0.smithi049.stdout:5/226: dread - d3/d11/d14/d16/f2c zero size 2024-06-03T00:03:01.957 INFO:tasks.workunit.client.0.smithi049.stdout:1/314: symlink d1/d2f/d36/l75 0 2024-06-03T00:03:01.957 INFO:tasks.workunit.client.0.smithi049.stdout:7/216: dwrite d3/d8/f34 [0,4194304] 0 2024-06-03T00:03:01.957 INFO:tasks.workunit.client.0.smithi049.stdout:5/227: dread d3/d5/da/f27 [0,4194304] 0 2024-06-03T00:03:01.959 INFO:tasks.workunit.client.0.smithi049.stdout:6/258: symlink d2/d3/d17/l5b 0 2024-06-03T00:03:01.961 INFO:tasks.workunit.client.0.smithi049.stdout:2/221: link da/l2e da/dd/df/l4e 0 2024-06-03T00:03:01.961 INFO:tasks.workunit.client.0.smithi049.stdout:2/222: readlink da/l17 0 2024-06-03T00:03:01.963 INFO:tasks.workunit.client.0.smithi049.stdout:1/315: link d1/d1a/c4d d1/d2f/d50/c76 0 2024-06-03T00:03:01.964 INFO:tasks.workunit.client.0.smithi049.stdout:7/217: mknod d3/d32/c4f 0 2024-06-03T00:03:01.966 INFO:tasks.workunit.client.0.smithi049.stdout:5/228: creat d3/d5/f4d x:0 0 0 2024-06-03T00:03:01.966 INFO:tasks.workunit.client.0.smithi049.stdout:5/229: chown d3/d5/d24 3328928 1 2024-06-03T00:03:01.966 INFO:tasks.workunit.client.0.smithi049.stdout:5/230: write d3/d11/d14/d16/f34 [203491,88802] 0 2024-06-03T00:03:01.966 INFO:tasks.workunit.client.0.smithi049.stdout:4/261: dwrite d4/d16/d1c/d24/d43/f45 [4194304,4194304] 0 2024-06-03T00:03:01.967 INFO:tasks.workunit.client.0.smithi049.stdout:6/259: rmdir d2/d3/d9/d23/d29 39 2024-06-03T00:03:01.967 INFO:tasks.workunit.client.0.smithi049.stdout:6/260: truncate d2/d3/d9/f25 1698537 0 2024-06-03T00:03:01.971 INFO:tasks.workunit.client.0.smithi049.stdout:1/316: unlink d1/d1a/f5d 0 2024-06-03T00:03:01.971 INFO:tasks.workunit.client.0.smithi049.stdout:1/317: chown d1/d2f/d36/d37/f68 11187321 1 2024-06-03T00:03:01.975 INFO:tasks.workunit.client.0.smithi049.stdout:5/231: write d3/d5/da/f1d [2534970,89118] 0 2024-06-03T00:03:01.975 INFO:tasks.workunit.client.0.smithi049.stdout:4/262: mknod d4/c59 0 2024-06-03T00:03:01.977 INFO:tasks.workunit.client.0.smithi049.stdout:1/318: symlink d1/d2f/d36/d37/d13/d71/l77 0 2024-06-03T00:03:01.980 INFO:tasks.workunit.client.0.smithi049.stdout:5/232: unlink d3/d11/d14/d16/f46 0 2024-06-03T00:03:01.980 INFO:tasks.workunit.client.0.smithi049.stdout:1/319: rmdir d1 39 2024-06-03T00:03:01.982 INFO:tasks.workunit.client.0.smithi049.stdout:1/320: mkdir d1/d2f/d78 0 2024-06-03T00:03:01.986 INFO:tasks.workunit.client.0.smithi049.stdout:6/261: dwrite d2/d3/d9/f3d [0,4194304] 0 2024-06-03T00:03:01.988 INFO:tasks.workunit.client.0.smithi049.stdout:6/262: write d2/d3/d9/d23/d29/d30/f5a [2032532,37900] 0 2024-06-03T00:03:01.988 INFO:tasks.workunit.client.0.smithi049.stdout:6/263: read d2/d3/d9/d23/f26 [622475,26097] 0 2024-06-03T00:03:01.989 INFO:tasks.workunit.client.0.smithi049.stdout:6/264: truncate d2/d3/d9/d23/d36/f45 3263861 0 2024-06-03T00:03:01.990 INFO:tasks.workunit.client.0.smithi049.stdout:6/265: creat d2/d3/d9/d55/f5c x:0 0 0 2024-06-03T00:03:01.990 INFO:tasks.workunit.client.0.smithi049.stdout:6/266: write d2/d3/d9/f54 [2460246,7755] 0 2024-06-03T00:03:01.991 INFO:tasks.workunit.client.0.smithi049.stdout:6/267: symlink d2/d3/d9/d23/d48/d51/l5d 0 2024-06-03T00:03:02.003 INFO:tasks.workunit.client.0.smithi049.stdout:6/268: dread d2/d3/d9/d23/d29/f59 [0,4194304] 0 2024-06-03T00:03:02.003 INFO:tasks.workunit.client.0.smithi049.stdout:4/263: dwrite d4/d2a/f34 [4194304,4194304] 0 2024-06-03T00:03:02.003 INFO:tasks.workunit.client.0.smithi049.stdout:4/264: fsync d4/fc 0 2024-06-03T00:03:02.005 INFO:tasks.workunit.client.0.smithi049.stdout:7/218: dwrite d3/d14/f2a [0,4194304] 0 2024-06-03T00:03:02.006 INFO:tasks.workunit.client.0.smithi049.stdout:4/265: unlink d4/c12 0 2024-06-03T00:03:02.006 INFO:tasks.workunit.client.0.smithi049.stdout:4/266: write d4/d16/d1c/d24/f51 [780146,105689] 0 2024-06-03T00:03:02.007 INFO:tasks.workunit.client.0.smithi049.stdout:6/269: symlink d2/d3/d9/l5e 0 2024-06-03T00:03:02.007 INFO:tasks.workunit.client.0.smithi049.stdout:6/270: dread - d2/d3/d9/d23/d36/f4b zero size 2024-06-03T00:03:02.011 INFO:tasks.workunit.client.0.smithi049.stdout:5/233: dwrite d3/d11/f21 [0,4194304] 0 2024-06-03T00:03:02.011 INFO:tasks.workunit.client.0.smithi049.stdout:5/234: stat d3/d9/f49 0 2024-06-03T00:03:02.018 INFO:tasks.workunit.client.0.smithi049.stdout:4/267: symlink d4/d16/d1c/d24/d43/l5a 0 2024-06-03T00:03:02.018 INFO:tasks.workunit.client.0.smithi049.stdout:4/268: write d4/d16/f58 [309726,51564] 0 2024-06-03T00:03:02.018 INFO:tasks.workunit.client.0.smithi049.stdout:1/321: dwrite d1/d2f/d36/f4e [0,4194304] 0 2024-06-03T00:03:02.018 INFO:tasks.workunit.client.0.smithi049.stdout:6/271: truncate d2/d3/d9/d23/d29/f41 291413 0 2024-06-03T00:03:02.019 INFO:tasks.workunit.client.0.smithi049.stdout:7/219: dwrite d3/f30 [0,4194304] 0 2024-06-03T00:03:02.022 INFO:tasks.workunit.client.0.smithi049.stdout:5/235: symlink d3/d11/l4e 0 2024-06-03T00:03:02.022 INFO:tasks.workunit.client.0.smithi049.stdout:4/269: symlink d4/d3f/l5b 0 2024-06-03T00:03:02.026 INFO:tasks.workunit.client.0.smithi049.stdout:1/322: rmdir d1/d2f/d36/d37/d13/d34 39 2024-06-03T00:03:02.028 INFO:tasks.workunit.client.0.smithi049.stdout:7/220: truncate d3/d6/f20 2575073 0 2024-06-03T00:03:02.030 INFO:tasks.workunit.client.0.smithi049.stdout:7/221: dread d3/d6/f12 [0,4194304] 0 2024-06-03T00:03:02.030 INFO:tasks.workunit.client.0.smithi049.stdout:7/222: readlink d3/d8/l21 0 2024-06-03T00:03:02.031 INFO:tasks.workunit.client.0.smithi049.stdout:1/323: getdents d1/d2f/d36/d37/d13/d34/d52 0 2024-06-03T00:03:02.033 INFO:tasks.workunit.client.0.smithi049.stdout:7/223: symlink d3/d8/d23/l50 0 2024-06-03T00:03:02.035 INFO:tasks.workunit.client.0.smithi049.stdout:1/324: rename d1/f3e to d1/d1a/f79 0 2024-06-03T00:03:02.037 INFO:tasks.workunit.client.0.smithi049.stdout:7/224: creat d3/d6/d9/d37/f51 x:0 0 0 2024-06-03T00:03:02.037 INFO:tasks.workunit.client.0.smithi049.stdout:4/270: getdents d4/d3f 0 2024-06-03T00:03:02.039 INFO:tasks.workunit.client.0.smithi049.stdout:1/325: creat d1/d2f/d36/d37/d64/d6c/f7a x:0 0 0 2024-06-03T00:03:02.041 INFO:tasks.workunit.client.0.smithi049.stdout:7/225: rename d3/d14/c2c to d3/d6/d9/d37/c52 0 2024-06-03T00:03:02.041 INFO:tasks.workunit.client.0.smithi049.stdout:0/196: sync 2024-06-03T00:03:02.043 INFO:tasks.workunit.client.0.smithi049.stdout:4/271: creat d4/d16/d1c/d4f/f5c x:0 0 0 2024-06-03T00:03:02.043 INFO:tasks.workunit.client.0.smithi049.stdout:5/236: dwrite d3/d5/da/f2b [0,4194304] 0 2024-06-03T00:03:02.043 INFO:tasks.workunit.client.0.smithi049.stdout:6/272: dwrite d2/d4d/f58 [0,4194304] 0 2024-06-03T00:03:02.045 INFO:tasks.workunit.client.0.smithi049.stdout:1/326: creat d1/d2f/d36/d37/d2c/d45/d61/d67/f7b x:0 0 0 2024-06-03T00:03:02.045 INFO:tasks.workunit.client.0.smithi049.stdout:1/327: write d1/d2f/d36/d37/d64/d6c/f7a [254934,86547] 0 2024-06-03T00:03:02.045 INFO:tasks.workunit.client.0.smithi049.stdout:1/328: fdatasync d1/d2f/d36/d37/f33 0 2024-06-03T00:03:02.045 INFO:tasks.workunit.client.0.smithi049.stdout:1/329: chown d1/d2f/d36/d37/d2c/d45/d61/d67/f6d 1406277 1 2024-06-03T00:03:02.046 INFO:tasks.workunit.client.0.smithi049.stdout:7/226: write d3/f30 [4796024,174] 0 2024-06-03T00:03:02.046 INFO:tasks.workunit.client.0.smithi049.stdout:7/227: fdatasync d3/d14/f2a 0 2024-06-03T00:03:02.047 INFO:tasks.workunit.client.0.smithi049.stdout:7/228: fsync d3/d6/f20 0 2024-06-03T00:03:02.052 INFO:tasks.workunit.client.0.smithi049.stdout:6/273: creat d2/d3/d9/d23/d48/d51/f5f x:0 0 0 2024-06-03T00:03:02.052 INFO:tasks.workunit.client.0.smithi049.stdout:6/274: dread - d2/d3/d9/d23/d48/d51/f5f zero size 2024-06-03T00:03:02.052 INFO:tasks.workunit.client.0.smithi049.stdout:6/275: chown d2/d3/d9/d23/d29/f32 238599 1 2024-06-03T00:03:02.053 INFO:tasks.workunit.client.0.smithi049.stdout:1/330: mknod d1/d1a/c7c 0 2024-06-03T00:03:02.056 INFO:tasks.workunit.client.0.smithi049.stdout:0/197: rename d6/c2c to d6/d30/d32/c46 0 2024-06-03T00:03:02.056 INFO:tasks.workunit.client.0.smithi049.stdout:0/198: write d6/f16 [1985711,50421] 0 2024-06-03T00:03:02.060 INFO:tasks.workunit.client.0.smithi049.stdout:5/237: dwrite d3/d5/da/f27 [0,4194304] 0 2024-06-03T00:03:02.060 INFO:tasks.workunit.client.0.smithi049.stdout:5/238: readlink d3/d9/lf 0 2024-06-03T00:03:02.060 INFO:tasks.workunit.client.0.smithi049.stdout:5/239: chown d3/d11/c4a 0 1 2024-06-03T00:03:02.060 INFO:tasks.workunit.client.0.smithi049.stdout:5/240: write d3/d5/da/f3e [713030,43307] 0 2024-06-03T00:03:02.060 INFO:tasks.workunit.client.0.smithi049.stdout:5/241: fsync d3/f3a 0 2024-06-03T00:03:02.060 INFO:tasks.workunit.client.0.smithi049.stdout:5/242: truncate d3/d5/da/f3e 1020254 0 2024-06-03T00:03:02.061 INFO:tasks.workunit.client.0.smithi049.stdout:6/276: creat d2/d3/f60 x:0 0 0 2024-06-03T00:03:02.061 INFO:tasks.workunit.client.0.smithi049.stdout:1/331: mkdir d1/d2f/d36/d37/d13/d42/d7d 0 2024-06-03T00:03:02.062 INFO:tasks.workunit.client.0.smithi049.stdout:0/199: mkdir d6/d29/d47 0 2024-06-03T00:03:02.064 INFO:tasks.workunit.client.0.smithi049.stdout:4/272: dwrite d4/d3f/d14/d2b/f48 [0,4194304] 0 2024-06-03T00:03:02.064 INFO:tasks.workunit.client.0.smithi049.stdout:4/273: write d4/d3f/f56 [48565,93776] 0 2024-06-03T00:03:02.064 INFO:tasks.workunit.client.0.smithi049.stdout:4/274: chown d4/d2a 957 1 2024-06-03T00:03:02.064 INFO:tasks.workunit.client.0.smithi049.stdout:7/229: symlink d3/d6/d13/l53 0 2024-06-03T00:03:02.067 INFO:tasks.workunit.client.0.smithi049.stdout:5/243: rename d3/d5/d2d/l3f to d3/d11/d14/d16/l4f 0 2024-06-03T00:03:02.067 INFO:tasks.workunit.client.0.smithi049.stdout:5/244: chown d3/d11/d14/c1f 2339 1 2024-06-03T00:03:02.068 INFO:tasks.workunit.client.0.smithi049.stdout:6/277: creat d2/d3/d9/d23/d48/f61 x:0 0 0 2024-06-03T00:03:02.070 INFO:tasks.workunit.client.0.smithi049.stdout:0/200: creat d6/d30/d32/f48 x:0 0 0 2024-06-03T00:03:02.071 INFO:tasks.workunit.client.0.smithi049.stdout:4/275: truncate d4/d2a/f34 2990905 0 2024-06-03T00:03:02.072 INFO:tasks.workunit.client.0.smithi049.stdout:4/276: fdatasync d4/d16/d1c/f39 0 2024-06-03T00:03:02.073 INFO:tasks.workunit.client.0.smithi049.stdout:5/245: creat d3/d5/da/f50 x:0 0 0 2024-06-03T00:03:02.075 INFO:tasks.workunit.client.0.smithi049.stdout:6/278: rename d2/d3/d9/d23/f4e to d2/d3/d17/f62 0 2024-06-03T00:03:02.075 INFO:tasks.workunit.client.0.smithi049.stdout:6/279: stat d2/d3/d17/l21 0 2024-06-03T00:03:02.078 INFO:tasks.workunit.client.0.smithi049.stdout:4/277: write d4/d16/d1c/d24/f51 [200477,27444] 0 2024-06-03T00:03:02.082 INFO:tasks.workunit.client.0.smithi049.stdout:6/280: link d2/d3/d9/d23/f26 d2/d3/d9/d23/d29/f63 0 2024-06-03T00:03:02.082 INFO:tasks.workunit.client.0.smithi049.stdout:6/281: stat d2/l39 0 2024-06-03T00:03:02.087 INFO:tasks.workunit.client.0.smithi049.stdout:4/278: rename d4/fd to d4/d2a/f5d 0 2024-06-03T00:03:02.087 INFO:tasks.workunit.client.0.smithi049.stdout:4/279: fdatasync f2 0 2024-06-03T00:03:02.088 INFO:tasks.workunit.client.0.smithi049.stdout:6/282: dread d2/d3/d9/f54 [0,4194304] 0 2024-06-03T00:03:02.089 INFO:tasks.workunit.client.0.smithi049.stdout:4/280: symlink d4/d3f/d14/l5e 0 2024-06-03T00:03:02.090 INFO:tasks.workunit.client.0.smithi049.stdout:6/283: mkdir d2/d3/d17/d64 0 2024-06-03T00:03:02.091 INFO:tasks.workunit.client.0.smithi049.stdout:4/281: creat d4/d3f/f5f x:0 0 0 2024-06-03T00:03:02.092 INFO:tasks.workunit.client.0.smithi049.stdout:4/282: rmdir d4/d3f 39 2024-06-03T00:03:02.092 INFO:tasks.workunit.client.0.smithi049.stdout:4/283: fdatasync d4/d3f/d14/d15/f18 0 2024-06-03T00:03:02.093 INFO:tasks.workunit.client.0.smithi049.stdout:1/332: dwrite d1/d2f/d36/d37/f2b [0,4194304] 0 2024-06-03T00:03:02.093 INFO:tasks.workunit.client.0.smithi049.stdout:4/284: truncate d4/d16/d1c/f39 1258368 0 2024-06-03T00:03:02.094 INFO:tasks.workunit.client.0.smithi049.stdout:7/230: dwrite d3/d8/f4d [0,4194304] 0 2024-06-03T00:03:02.094 INFO:tasks.workunit.client.0.smithi049.stdout:7/231: dread d3/f1b [0,4194304] 0 2024-06-03T00:03:02.095 INFO:tasks.workunit.client.0.smithi049.stdout:7/232: truncate d3/d8/f10 2155046 0 2024-06-03T00:03:02.095 INFO:tasks.workunit.client.0.smithi049.stdout:1/333: unlink d1/d2f/d36/d37/d13/f20 0 2024-06-03T00:03:02.096 INFO:tasks.workunit.client.0.smithi049.stdout:5/246: dwrite d3/d5/da/f1d [0,4194304] 0 2024-06-03T00:03:02.096 INFO:tasks.workunit.client.0.smithi049.stdout:5/247: chown d3/d5/da/f27 44510234 1 2024-06-03T00:03:02.096 INFO:tasks.workunit.client.0.smithi049.stdout:5/248: write d3/d5/d24/f38 [688668,97275] 0 2024-06-03T00:03:02.097 INFO:tasks.workunit.client.0.smithi049.stdout:4/285: rename d4/d16/d1c/d24/l32 to d4/d16/d1c/d24/d43/l60 0 2024-06-03T00:03:02.102 INFO:tasks.workunit.client.0.smithi049.stdout:4/286: dread d4/d2a/f34 [0,4194304] 0 2024-06-03T00:03:02.104 INFO:tasks.workunit.client.0.smithi049.stdout:1/334: symlink d1/d2f/d36/l7e 0 2024-06-03T00:03:02.105 INFO:tasks.workunit.client.0.smithi049.stdout:6/284: read d2/d4d/f58 [869434,87264] 0 2024-06-03T00:03:02.105 INFO:tasks.workunit.client.0.smithi049.stdout:6/285: write d2/d3/d9/d23/f1e [2073078,98130] 0 2024-06-03T00:03:02.106 INFO:tasks.workunit.client.0.smithi049.stdout:5/249: mkdir d3/d5/d2d/d4b/d51 0 2024-06-03T00:03:02.108 INFO:tasks.workunit.client.0.smithi049.stdout:4/287: creat d4/d16/d1c/d4f/f61 x:0 0 0 2024-06-03T00:03:02.108 INFO:tasks.workunit.client.0.smithi049.stdout:4/288: readlink d4/d3f/l19 0 2024-06-03T00:03:02.111 INFO:tasks.workunit.client.0.smithi049.stdout:6/286: unlink d2/d3/d9/d40/c4a 0 2024-06-03T00:03:02.112 INFO:tasks.workunit.client.0.smithi049.stdout:1/335: dread d1/d2f/f46 [0,4194304] 0 2024-06-03T00:03:02.113 INFO:tasks.workunit.client.0.smithi049.stdout:5/250: mknod d3/d9/c52 0 2024-06-03T00:03:02.114 INFO:tasks.workunit.client.0.smithi049.stdout:4/289: creat d4/d3f/f62 x:0 0 0 2024-06-03T00:03:02.116 INFO:tasks.workunit.client.0.smithi049.stdout:1/336: creat d1/d2f/d36/d37/d13/d34/d6e/f7f x:0 0 0 2024-06-03T00:03:02.117 INFO:tasks.workunit.client.0.smithi049.stdout:1/337: dread d1/d2f/d36/d37/d2c/d45/d5e/f6f [0,4194304] 0 2024-06-03T00:03:02.117 INFO:tasks.workunit.client.0.smithi049.stdout:5/251: mkdir d3/d53 0 2024-06-03T00:03:02.117 INFO:tasks.workunit.client.0.smithi049.stdout:5/252: readlink d3/d11/d14/d16/l45 0 2024-06-03T00:03:02.117 INFO:tasks.workunit.client.0.smithi049.stdout:3/193: sync 2024-06-03T00:03:02.117 INFO:tasks.workunit.client.0.smithi049.stdout:2/223: sync 2024-06-03T00:03:02.117 INFO:tasks.workunit.client.0.smithi049.stdout:8/213: sync 2024-06-03T00:03:02.118 INFO:tasks.workunit.client.0.smithi049.stdout:9/339: sync 2024-06-03T00:03:02.119 INFO:tasks.workunit.client.0.smithi049.stdout:4/290: getdents d4/d3f/d14/d2b 0 2024-06-03T00:03:02.119 INFO:tasks.workunit.client.0.smithi049.stdout:4/291: fsync d4/d2a/f34 0 2024-06-03T00:03:02.121 INFO:tasks.workunit.client.0.smithi049.stdout:1/338: truncate d1/d2f/d36/d37/f22 450606 0 2024-06-03T00:03:02.123 INFO:tasks.workunit.client.0.smithi049.stdout:5/253: rename d3/d11/d14/d16/l4f to d3/l54 0 2024-06-03T00:03:02.124 INFO:tasks.workunit.client.0.smithi049.stdout:2/224: unlink da/dd/f4a 0 2024-06-03T00:03:02.126 INFO:tasks.workunit.client.0.smithi049.stdout:8/214: mknod d4/d7/c44 0 2024-06-03T00:03:02.126 INFO:tasks.workunit.client.0.smithi049.stdout:8/215: chown d4/d7/f14 5 1 2024-06-03T00:03:02.126 INFO:tasks.workunit.client.0.smithi049.stdout:7/233: truncate d3/d8/f10 1033860 0 2024-06-03T00:03:02.127 INFO:tasks.workunit.client.0.smithi049.stdout:4/292: creat d4/f63 x:0 0 0 2024-06-03T00:03:02.128 INFO:tasks.workunit.client.0.smithi049.stdout:1/339: dread d1/d2f/f46 [0,4194304] 0 2024-06-03T00:03:02.129 INFO:tasks.workunit.client.0.smithi049.stdout:4/293: dread d4/d16/f58 [0,4194304] 0 2024-06-03T00:03:02.129 INFO:tasks.workunit.client.0.smithi049.stdout:4/294: truncate d4/d3f/f5f 5392 0 2024-06-03T00:03:02.129 INFO:tasks.workunit.client.0.smithi049.stdout:4/295: chown d4/d16/d1c/d24/d43/l60 754712 1 2024-06-03T00:03:02.130 INFO:tasks.workunit.client.0.smithi049.stdout:4/296: fsync d4/d3f/f4d 0 2024-06-03T00:03:02.130 INFO:tasks.workunit.client.0.smithi049.stdout:3/194: rename d2/f7 to d2/d8/f3f 0 2024-06-03T00:03:02.133 INFO:tasks.workunit.client.0.smithi049.stdout:2/225: creat da/dd/d40/f4f x:0 0 0 2024-06-03T00:03:02.133 INFO:tasks.workunit.client.0.smithi049.stdout:2/226: write da/f24 [863498,117878] 0 2024-06-03T00:03:02.136 INFO:tasks.workunit.client.0.smithi049.stdout:3/195: symlink d2/d14/d22/l40 0 2024-06-03T00:03:02.138 INFO:tasks.workunit.client.0.smithi049.stdout:2/227: mknod da/d43/c50 0 2024-06-03T00:03:02.140 INFO:tasks.workunit.client.0.smithi049.stdout:3/196: mkdir d2/d26/d41 0 2024-06-03T00:03:02.142 INFO:tasks.workunit.client.0.smithi049.stdout:2/228: creat da/dd/d40/f51 x:0 0 0 2024-06-03T00:03:02.144 INFO:tasks.workunit.client.0.smithi049.stdout:3/197: rename d2/d14/d22/d25 to d2/d14/d22/d42 0 2024-06-03T00:03:02.146 INFO:tasks.workunit.client.0.smithi049.stdout:9/340: dwrite d1/f55 [0,4194304] 0 2024-06-03T00:03:02.146 INFO:tasks.workunit.client.0.smithi049.stdout:9/341: chown d1/da/d27/f40 14022297 1 2024-06-03T00:03:02.146 INFO:tasks.workunit.client.0.smithi049.stdout:8/216: dwrite d4/d7/f18 [0,4194304] 0 2024-06-03T00:03:02.146 INFO:tasks.workunit.client.0.smithi049.stdout:8/217: chown d4/d7/f1e 20567575 1 2024-06-03T00:03:02.147 INFO:tasks.workunit.client.0.smithi049.stdout:5/254: getdents d3 0 2024-06-03T00:03:02.149 INFO:tasks.workunit.client.0.smithi049.stdout:3/198: dread d2/d14/f1c [0,4194304] 0 2024-06-03T00:03:02.149 INFO:tasks.workunit.client.0.smithi049.stdout:3/199: fdatasync d2/d14/f24 0 2024-06-03T00:03:02.150 INFO:tasks.workunit.client.0.smithi049.stdout:3/200: symlink d2/l43 0 2024-06-03T00:03:02.153 INFO:tasks.workunit.client.0.smithi049.stdout:7/234: rename d3/d8 to d3/d6/d13/d54 0 2024-06-03T00:03:02.153 INFO:tasks.workunit.client.0.smithi049.stdout:7/235: chown d3/d14/l44 1164773 1 2024-06-03T00:03:02.154 INFO:tasks.workunit.client.0.smithi049.stdout:3/201: getdents d2/d14/d22/d3a 0 2024-06-03T00:03:02.162 INFO:tasks.workunit.client.0.smithi049.stdout:1/340: rename d1/d2f/d36/d37/le to d1/d2f/d36/d37/d13/d34/d52/l80 0 2024-06-03T00:03:02.162 INFO:tasks.workunit.client.0.smithi049.stdout:1/341: dread - d1/d2f/d36/d37/d2c/d45/d61/d67/f6d zero size 2024-06-03T00:03:02.162 INFO:tasks.workunit.client.0.smithi049.stdout:4/297: rename d4/d16/d1c/d4f/f55 to d4/d16/d1c/d24/f64 0 2024-06-03T00:03:02.164 INFO:tasks.workunit.client.0.smithi049.stdout:2/229: rename da/dd to da/d52 0 2024-06-03T00:03:02.164 INFO:tasks.workunit.client.0.smithi049.stdout:2/230: truncate da/f24 1766681 0 2024-06-03T00:03:02.165 INFO:tasks.workunit.client.0.smithi049.stdout:5/255: rename d3/d11 to d3/d5/da/d55 0 2024-06-03T00:03:02.165 INFO:tasks.workunit.client.0.smithi049.stdout:5/256: dread - d3/d9/f28 zero size 2024-06-03T00:03:02.165 INFO:tasks.workunit.client.0.smithi049.stdout:5/257: read d3/d9/f13 [339911,91324] 0 2024-06-03T00:03:02.167 INFO:tasks.workunit.client.0.smithi049.stdout:8/218: write d4/d27/d3c/f2c [2125380,86375] 0 2024-06-03T00:03:02.167 INFO:tasks.workunit.client.0.smithi049.stdout:8/219: readlink d4/d27/d30/l35 0 2024-06-03T00:03:02.167 INFO:tasks.workunit.client.0.smithi049.stdout:7/236: write d3/d6/d13/f38 [539034,37895] 0 2024-06-03T00:03:02.172 INFO:tasks.workunit.client.0.smithi049.stdout:4/298: mknod d4/d3f/d14/d2b/c65 0 2024-06-03T00:03:02.172 INFO:tasks.workunit.client.0.smithi049.stdout:3/202: rename d2/d26/d41 to d2/d14/d44 0 2024-06-03T00:03:02.172 INFO:tasks.workunit.client.0.smithi049.stdout:2/231: unlink da/d52/df/f23 0 2024-06-03T00:03:02.172 INFO:tasks.workunit.client.0.smithi049.stdout:4/299: write d4/f63 [299373,120544] 0 2024-06-03T00:03:02.172 INFO:tasks.workunit.client.0.smithi049.stdout:1/342: dread d1/d2f/d36/f4e [0,4194304] 0 2024-06-03T00:03:02.177 INFO:tasks.workunit.client.0.smithi049.stdout:2/232: creat da/d52/df/d3c/f53 x:0 0 0 2024-06-03T00:03:02.179 INFO:tasks.workunit.client.0.smithi049.stdout:3/203: mknod d2/c45 0 2024-06-03T00:03:02.179 INFO:tasks.workunit.client.0.smithi049.stdout:3/204: read - d2/d1a/f37 zero size 2024-06-03T00:03:02.179 INFO:tasks.workunit.client.0.smithi049.stdout:9/342: dwrite d1/fb [0,4194304] 0 2024-06-03T00:03:02.181 INFO:tasks.workunit.client.0.smithi049.stdout:1/343: read d1/d2f/f44 [2616162,51330] 0 2024-06-03T00:03:02.181 INFO:tasks.workunit.client.0.smithi049.stdout:1/344: readlink d1/d2f/d36/d37/d13/l4a 0 2024-06-03T00:03:02.182 INFO:tasks.workunit.client.0.smithi049.stdout:3/205: rename d2/d14/c2c to d2/d1a/d34/c46 0 2024-06-03T00:03:02.182 INFO:tasks.workunit.client.0.smithi049.stdout:9/343: creat d1/d5/f6b x:0 0 0 2024-06-03T00:03:02.182 INFO:tasks.workunit.client.0.smithi049.stdout:9/344: fdatasync d1/f8 0 2024-06-03T00:03:02.183 INFO:tasks.workunit.client.0.smithi049.stdout:1/345: getdents d1/d2f/d36/d37/d2c/d45/d5e 0 2024-06-03T00:03:02.184 INFO:tasks.workunit.client.0.smithi049.stdout:3/206: mkdir d2/d14/d22/d3a/d47 0 2024-06-03T00:03:02.186 INFO:tasks.workunit.client.0.smithi049.stdout:9/345: dread d1/f44 [0,4194304] 0 2024-06-03T00:03:02.186 INFO:tasks.workunit.client.0.smithi049.stdout:1/346: rename d1/d2f/d36/d37/d13/d34/l53 to d1/d2f/d36/d37/d2c/l81 0 2024-06-03T00:03:02.187 INFO:tasks.workunit.client.0.smithi049.stdout:3/207: rmdir d2/d1a/d34 39 2024-06-03T00:03:02.187 INFO:tasks.workunit.client.0.smithi049.stdout:3/208: write d2/f13 [1383914,46847] 0 2024-06-03T00:03:02.187 INFO:tasks.workunit.client.0.smithi049.stdout:3/209: dread - d2/d14/d22/d3a/f3e zero size 2024-06-03T00:03:02.188 INFO:tasks.workunit.client.0.smithi049.stdout:7/237: dwrite d3/d32/f41 [0,4194304] 0 2024-06-03T00:03:02.188 INFO:tasks.workunit.client.0.smithi049.stdout:3/210: creat d2/d1a/d34/f48 x:0 0 0 2024-06-03T00:03:02.192 INFO:tasks.workunit.client.0.smithi049.stdout:7/238: rename d3/d6/d13/f3a to d3/d6/d13/d54/f55 0 2024-06-03T00:03:02.192 INFO:tasks.workunit.client.0.smithi049.stdout:3/211: dread d2/d8/f3f [0,4194304] 0 2024-06-03T00:03:02.192 INFO:tasks.workunit.client.0.smithi049.stdout:3/212: fsync d2/d14/d22/d42/f38 0 2024-06-03T00:03:02.196 INFO:tasks.workunit.client.0.smithi049.stdout:5/258: dwrite d3/d5/da/d55/d14/f29 [0,4194304] 0 2024-06-03T00:03:02.200 INFO:tasks.workunit.client.0.smithi049.stdout:1/347: dread d1/d2f/d36/d37/f16 [0,4194304] 0 2024-06-03T00:03:02.200 INFO:tasks.workunit.client.0.smithi049.stdout:9/346: write d1/d5/d13/f53 [340705,82774] 0 2024-06-03T00:03:02.202 INFO:tasks.workunit.client.0.smithi049.stdout:1/348: creat d1/d2f/d36/d37/d2c/d45/d61/d70/f82 x:0 0 0 2024-06-03T00:03:02.202 INFO:tasks.workunit.client.0.smithi049.stdout:9/347: creat d1/d5/f6c x:0 0 0 2024-06-03T00:03:02.203 INFO:tasks.workunit.client.0.smithi049.stdout:1/349: mkdir d1/d2f/d36/d37/d2c/d45/d83 0 2024-06-03T00:03:02.203 INFO:tasks.workunit.client.0.smithi049.stdout:1/350: write d1/d2f/d36/d37/f16 [6483533,48662] 0 2024-06-03T00:03:02.204 INFO:tasks.workunit.client.0.smithi049.stdout:9/348: rename d1/d5/d13/d3b/f4a to d1/d5/d13/f6d 0 2024-06-03T00:03:02.205 INFO:tasks.workunit.client.0.smithi049.stdout:1/351: symlink d1/l84 0 2024-06-03T00:03:02.206 INFO:tasks.workunit.client.0.smithi049.stdout:9/349: creat d1/d5/d13/d3b/f6e x:0 0 0 2024-06-03T00:03:02.210 INFO:tasks.workunit.client.0.smithi049.stdout:2/233: dwrite da/d52/d40/f4d [0,4194304] 0 2024-06-03T00:03:02.218 INFO:tasks.workunit.client.0.smithi049.stdout:7/239: dwrite d3/d32/f41 [0,4194304] 0 2024-06-03T00:03:02.220 INFO:tasks.workunit.client.0.smithi049.stdout:2/234: dread f9 [0,4194304] 0 2024-06-03T00:03:02.220 INFO:tasks.workunit.client.0.smithi049.stdout:2/235: dread - da/d52/d40/f4f zero size 2024-06-03T00:03:02.220 INFO:tasks.workunit.client.0.smithi049.stdout:5/259: dwrite d3/d5/da/f44 [0,4194304] 0 2024-06-03T00:03:02.221 INFO:tasks.workunit.client.0.smithi049.stdout:7/240: mknod d3/d6/d13/d3c/d48/c56 0 2024-06-03T00:03:02.221 INFO:tasks.workunit.client.0.smithi049.stdout:9/350: dwrite d1/da/d27/f3c [0,4194304] 0 2024-06-03T00:03:02.222 INFO:tasks.workunit.client.0.smithi049.stdout:2/236: symlink da/d52/d40/d42/l54 0 2024-06-03T00:03:02.226 INFO:tasks.workunit.client.0.smithi049.stdout:9/351: mknod d1/da/d54/c6f 0 2024-06-03T00:03:02.226 INFO:tasks.workunit.client.0.smithi049.stdout:9/352: chown d1/da/d26/l67 85363689 1 2024-06-03T00:03:02.226 INFO:tasks.workunit.client.0.smithi049.stdout:9/353: stat d1/da/d26/l57 0 2024-06-03T00:03:02.228 INFO:tasks.workunit.client.0.smithi049.stdout:2/237: mkdir da/d55 0 2024-06-03T00:03:02.228 INFO:tasks.workunit.client.0.smithi049.stdout:2/238: stat da/f1c 0 2024-06-03T00:03:02.228 INFO:tasks.workunit.client.0.smithi049.stdout:2/239: dread - da/d52/df/f34 zero size 2024-06-03T00:03:02.229 INFO:tasks.workunit.client.0.smithi049.stdout:1/352: dwrite d1/d2f/d36/d37/d13/d34/f3b [0,4194304] 0 2024-06-03T00:03:02.229 INFO:tasks.workunit.client.0.smithi049.stdout:7/241: dread d3/d6/f15 [0,4194304] 0 2024-06-03T00:03:02.229 INFO:tasks.workunit.client.0.smithi049.stdout:7/242: chown d3/d6/d13/d3c/d4b 1 1 2024-06-03T00:03:02.229 INFO:tasks.workunit.client.0.smithi049.stdout:9/354: mkdir d1/da/d27/d30/d50/d70 0 2024-06-03T00:03:02.231 INFO:tasks.workunit.client.0.smithi049.stdout:2/240: truncate da/f45 2673124 0 2024-06-03T00:03:02.231 INFO:tasks.workunit.client.0.smithi049.stdout:2/241: truncate da/d52/df/f2c 331093 0 2024-06-03T00:03:02.233 INFO:tasks.workunit.client.0.smithi049.stdout:5/260: read d3/d5/da/d55/d14/f2a [3668157,69519] 0 2024-06-03T00:03:02.234 INFO:tasks.workunit.client.0.smithi049.stdout:7/243: rename d3/d6/d13/d54/d23 to d3/d57 0 2024-06-03T00:03:02.236 INFO:tasks.workunit.client.0.smithi049.stdout:7/244: link d3/d6/d9/lb d3/d6/d9/l58 0 2024-06-03T00:03:02.236 INFO:tasks.workunit.client.0.smithi049.stdout:0/201: sync 2024-06-03T00:03:02.237 INFO:tasks.workunit.client.0.smithi049.stdout:7/245: creat d3/d6/d3f/f59 x:0 0 0 2024-06-03T00:03:02.239 INFO:tasks.workunit.client.0.smithi049.stdout:9/355: dread d1/f55 [0,4194304] 0 2024-06-03T00:03:02.240 INFO:tasks.workunit.client.0.smithi049.stdout:9/356: dread - d1/d5/d13/d3b/f59 zero size 2024-06-03T00:03:02.240 INFO:tasks.workunit.client.0.smithi049.stdout:7/246: mkdir d3/d6/d13/d3c/d4b/d5a 0 2024-06-03T00:03:02.242 INFO:tasks.workunit.client.0.smithi049.stdout:7/247: write d3/d6/f1c [673891,50820] 0 2024-06-03T00:03:02.244 INFO:tasks.workunit.client.0.smithi049.stdout:0/202: rename d6/d29/d2e/l20 to d6/d30/l49 0 2024-06-03T00:03:02.244 INFO:tasks.workunit.client.0.smithi049.stdout:9/357: mknod d1/da/d54/c71 0 2024-06-03T00:03:02.244 INFO:tasks.workunit.client.0.smithi049.stdout:0/203: write f4 [1129494,97223] 0 2024-06-03T00:03:02.244 INFO:tasks.workunit.client.0.smithi049.stdout:0/204: fsync d6/d30/f44 0 2024-06-03T00:03:02.245 INFO:tasks.workunit.client.0.smithi049.stdout:7/248: mkdir d3/d6/d13/d3c/d48/d4e/d5b 0 2024-06-03T00:03:02.246 INFO:tasks.workunit.client.0.smithi049.stdout:2/242: dread da/d52/d40/f4d [0,4194304] 0 2024-06-03T00:03:02.246 INFO:tasks.workunit.client.0.smithi049.stdout:9/358: mkdir d1/d5/d1a/d52/d72 0 2024-06-03T00:03:02.247 INFO:tasks.workunit.client.0.smithi049.stdout:7/249: symlink d3/d6/d9/d37/l5c 0 2024-06-03T00:03:02.247 INFO:tasks.workunit.client.0.smithi049.stdout:7/250: chown d3/d14/f2a 1 1 2024-06-03T00:03:02.247 INFO:tasks.workunit.client.0.smithi049.stdout:7/251: write d3/d6/d3f/f59 [955964,46086] 0 2024-06-03T00:03:02.247 INFO:tasks.workunit.client.0.smithi049.stdout:2/243: stat da/d52/df/c21 0 2024-06-03T00:03:02.247 INFO:tasks.workunit.client.0.smithi049.stdout:2/244: write da/d52/df/f30 [1232982,60405] 0 2024-06-03T00:03:02.248 INFO:tasks.workunit.client.0.smithi049.stdout:9/359: rmdir d1/da/d27/d30 39 2024-06-03T00:03:02.249 INFO:tasks.workunit.client.0.smithi049.stdout:7/252: link d3/d14/l36 d3/d6/d13/d3c/l5d 0 2024-06-03T00:03:02.250 INFO:tasks.workunit.client.0.smithi049.stdout:9/360: symlink d1/da/d27/d30/d50/l73 0 2024-06-03T00:03:02.251 INFO:tasks.workunit.client.0.smithi049.stdout:9/361: chown d1/d5/d13/d3b/f6e 15267 1 2024-06-03T00:03:02.251 INFO:tasks.workunit.client.0.smithi049.stdout:0/205: dread f4 [0,4194304] 0 2024-06-03T00:03:02.251 INFO:tasks.workunit.client.0.smithi049.stdout:7/253: creat d3/d6/f5e x:0 0 0 2024-06-03T00:03:02.252 INFO:tasks.workunit.client.0.smithi049.stdout:9/362: creat d1/d5/d13/d3b/d49/d58/f74 x:0 0 0 2024-06-03T00:03:02.252 INFO:tasks.workunit.client.0.smithi049.stdout:9/363: stat d1/d5/f6b 0 2024-06-03T00:03:02.252 INFO:tasks.workunit.client.0.smithi049.stdout:9/364: dread - d1/d5/d1a/f4e zero size 2024-06-03T00:03:02.252 INFO:tasks.workunit.client.0.smithi049.stdout:5/261: dwrite d3/d5/da/f1b [0,4194304] 0 2024-06-03T00:03:02.253 INFO:tasks.workunit.client.0.smithi049.stdout:7/254: rename d3/d14/l49 to d3/d6/d13/d3c/d4b/d5a/l5f 0 2024-06-03T00:03:02.255 INFO:tasks.workunit.client.0.smithi049.stdout:9/365: rmdir d1/d5/d1a 39 2024-06-03T00:03:02.255 INFO:tasks.workunit.client.0.smithi049.stdout:9/366: write d1/da/d26/f5c [1048209,84945] 0 2024-06-03T00:03:02.255 INFO:tasks.workunit.client.0.smithi049.stdout:9/367: write d1/d5/d13/f53 [2890993,53975] 0 2024-06-03T00:03:02.256 INFO:tasks.workunit.client.0.smithi049.stdout:5/262: mknod d3/c56 0 2024-06-03T00:03:02.260 INFO:tasks.workunit.client.0.smithi049.stdout:7/255: mkdir d3/d6/d13/d54/d60 0 2024-06-03T00:03:02.260 INFO:tasks.workunit.client.0.smithi049.stdout:9/368: creat d1/da/d27/f75 x:0 0 0 2024-06-03T00:03:02.260 INFO:tasks.workunit.client.0.smithi049.stdout:9/369: write d1/da/d27/f40 [387621,125411] 0 2024-06-03T00:03:02.260 INFO:tasks.workunit.client.0.smithi049.stdout:9/370: truncate d1/d5/d13/d3b/f65 948659 0 2024-06-03T00:03:02.260 INFO:tasks.workunit.client.0.smithi049.stdout:7/256: symlink d3/d6/d13/d3c/d48/d4e/l61 0 2024-06-03T00:03:02.262 INFO:tasks.workunit.client.0.smithi049.stdout:9/371: creat d1/da/d54/f76 x:0 0 0 2024-06-03T00:03:02.262 INFO:tasks.workunit.client.0.smithi049.stdout:9/372: write d1/da/d26/f32 [1455880,107940] 0 2024-06-03T00:03:02.262 INFO:tasks.workunit.client.0.smithi049.stdout:9/373: dread - d1/da/f3f zero size 2024-06-03T00:03:02.262 INFO:tasks.workunit.client.0.smithi049.stdout:9/374: chown d1 839 1 2024-06-03T00:03:02.262 INFO:tasks.workunit.client.0.smithi049.stdout:9/375: chown d1/d5/d1a/d52/d72 458 1 2024-06-03T00:03:02.263 INFO:tasks.workunit.client.0.smithi049.stdout:7/257: rename d3/d6/c29 to d3/d6/d9/d37/c62 0 2024-06-03T00:03:02.263 INFO:tasks.workunit.client.0.smithi049.stdout:7/258: dread - d3/f40 zero size 2024-06-03T00:03:02.263 INFO:tasks.workunit.client.0.smithi049.stdout:7/259: write d3/d6/d13/d54/f10 [392194,37625] 0 2024-06-03T00:03:02.263 INFO:tasks.workunit.client.0.smithi049.stdout:9/376: symlink d1/d5/d13/d3b/d49/l77 0 2024-06-03T00:03:02.263 INFO:tasks.workunit.client.0.smithi049.stdout:9/377: write d1/fb [3078550,79972] 0 2024-06-03T00:03:02.263 INFO:tasks.workunit.client.0.smithi049.stdout:9/378: chown d1 1978586 1 2024-06-03T00:03:02.265 INFO:tasks.workunit.client.0.smithi049.stdout:9/379: rename d1/d5/d13/d3b/f59 to d1/f78 0 2024-06-03T00:03:02.267 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:03:02.281 INFO:tasks.workunit.client.0.smithi049.stdout:1/353: dwrite d1/d2f/f46 [4194304,4194304] 0 2024-06-03T00:03:02.285 INFO:tasks.workunit.client.0.smithi049.stdout:7/260: write d3/d6/f20 [381219,29544] 0 2024-06-03T00:03:02.285 INFO:tasks.workunit.client.0.smithi049.stdout:7/261: truncate d3/d6/f5e 438270 0 2024-06-03T00:03:02.287 INFO:tasks.workunit.client.0.smithi049.stdout:7/262: symlink d3/d6/d13/d54/l63 0 2024-06-03T00:03:02.288 INFO:tasks.workunit.client.0.smithi049.stdout:1/354: dread d1/d2f/f44 [0,4194304] 0 2024-06-03T00:03:02.288 INFO:tasks.workunit.client.0.smithi049.stdout:1/355: chown d1/d2f/d36/l7e 13739039 1 2024-06-03T00:03:02.288 INFO:tasks.workunit.client.0.smithi049.stdout:7/263: rename d3/l35 to d3/d6/d13/d3c/d48/d4e/l64 0 2024-06-03T00:03:02.288 INFO:tasks.workunit.client.0.smithi049.stdout:7/264: write d3/d6/d13/d54/f10 [600939,87923] 0 2024-06-03T00:03:02.288 INFO:tasks.workunit.client.0.smithi049.stdout:7/265: readlink d3/d6/d13/d3c/d48/d4e/l61 0 2024-06-03T00:03:02.291 INFO:tasks.workunit.client.0.smithi049.stdout:7/266: rename d3/f1b to d3/d6/d13/f65 0 2024-06-03T00:03:02.292 INFO:tasks.workunit.client.0.smithi049.stdout:5/263: dwrite d3/f3a [0,4194304] 0 2024-06-03T00:03:02.292 INFO:tasks.workunit.client.0.smithi049.stdout:5/264: readlink d3/d5/d2d/l43 0 2024-06-03T00:03:02.293 INFO:tasks.workunit.client.0.smithi049.stdout:9/380: dwrite d1/da/d27/f3c [0,4194304] 0 2024-06-03T00:03:02.293 INFO:tasks.workunit.client.0.smithi049.stdout:9/381: fdatasync d1/d5/d1a/f4e 0 2024-06-03T00:03:02.293 INFO:tasks.workunit.client.0.smithi049.stdout:9/382: readlink d1/d5/d13/l1c 0 2024-06-03T00:03:02.293 INFO:tasks.workunit.client.0.smithi049.stdout:7/267: creat d3/d6/d9/d37/f66 x:0 0 0 2024-06-03T00:03:02.293 INFO:tasks.workunit.client.0.smithi049.stdout:7/268: write d3/d6/d13/f65 [2011531,47990] 0 2024-06-03T00:03:02.294 INFO:tasks.workunit.client.0.smithi049.stdout:0/206: dwrite f4 [0,4194304] 0 2024-06-03T00:03:02.294 INFO:tasks.workunit.client.0.smithi049.stdout:0/207: dread - d6/d30/d32/f40 zero size 2024-06-03T00:03:02.294 INFO:tasks.workunit.client.0.smithi049.stdout:0/208: fdatasync d6/d29/d2e/f1f 0 2024-06-03T00:03:02.294 INFO:tasks.workunit.client.0.smithi049.stdout:0/209: chown d6/f3f 41576482 1 2024-06-03T00:03:02.301 INFO:tasks.workunit.client.0.smithi049.stdout:5/265: creat d3/d5/da/d55/d14/f57 x:0 0 0 2024-06-03T00:03:02.301 INFO:tasks.workunit.client.0.smithi049.stdout:0/210: dread d6/f16 [0,4194304] 0 2024-06-03T00:03:02.301 INFO:tasks.workunit.client.0.smithi049.stdout:5/266: readlink d3/d5/da/d55/d14/d16/l45 0 2024-06-03T00:03:02.301 INFO:tasks.workunit.client.0.smithi049.stdout:5/267: fsync d3/d5/da/d55/d14/d16/f25 0 2024-06-03T00:03:02.307 INFO:tasks.workunit.client.0.smithi049.stdout:9/383: mknod d1/d5/d13/d3b/c79 0 2024-06-03T00:03:02.308 INFO:tasks.workunit.client.0.smithi049.stdout:1/356: dwrite d1/d2f/d36/d37/d13/d34/d6e/f7f [0,4194304] 0 2024-06-03T00:03:02.312 INFO:tasks.workunit.client.0.smithi049.stdout:7/269: getdents d3/d6/d13/d3c/d4b/d5a 0 2024-06-03T00:03:02.312 INFO:tasks.workunit.client.0.smithi049.stdout:7/270: fdatasync d3/d6/f12 0 2024-06-03T00:03:02.313 INFO:tasks.workunit.client.0.smithi049.stdout:0/211: mknod d6/d29/c4a 0 2024-06-03T00:03:02.314 INFO:tasks.workunit.client.0.smithi049.stdout:5/268: link d3/d9/f28 d3/d5/f58 0 2024-06-03T00:03:02.315 INFO:tasks.workunit.client.0.smithi049.stdout:9/384: mkdir d1/d5/d7a 0 2024-06-03T00:03:02.317 INFO:tasks.workunit.client.0.smithi049.stdout:1/357: getdents d1/d2f/d36/d37/d2c/d45/d61 0 2024-06-03T00:03:02.319 INFO:tasks.workunit.client.0.smithi049.stdout:7/271: creat d3/d6/d9/d37/f67 x:0 0 0 2024-06-03T00:03:02.320 INFO:tasks.workunit.client.0.smithi049.stdout:7/272: write d3/d6/f20 [31009,98738] 0 2024-06-03T00:03:02.320 INFO:tasks.workunit.client.0.smithi049.stdout:0/212: getdents d6/d30/d32 0 2024-06-03T00:03:02.323 INFO:tasks.workunit.client.0.smithi049.stdout:2/245: truncate da/d52/f13 1575445 0 2024-06-03T00:03:02.324 INFO:tasks.workunit.client.0.smithi049.stdout:7/273: mknod d3/d6/d13/d54/c68 0 2024-06-03T00:03:02.325 INFO:tasks.workunit.client.0.smithi049.stdout:9/385: write d1/d5/d1a/f51 [1957328,65927] 0 2024-06-03T00:03:02.328 INFO:tasks.workunit.client.0.smithi049.stdout:2/246: creat da/d52/d37/f56 x:0 0 0 2024-06-03T00:03:02.328 INFO:tasks.workunit.client.0.smithi049.stdout:0/213: dread f4 [0,4194304] 0 2024-06-03T00:03:02.328 INFO:tasks.workunit.client.0.smithi049.stdout:0/214: chown d6/c10 7246085 1 2024-06-03T00:03:02.328 INFO:tasks.workunit.client.0.smithi049.stdout:2/247: read da/d52/f26 [40019,98761] 0 2024-06-03T00:03:02.328 INFO:tasks.workunit.client.0.smithi049.stdout:2/248: chown da/d52/df/f27 15764 1 2024-06-03T00:03:02.328 INFO:tasks.workunit.client.0.smithi049.stdout:7/274: link d3/f30 d3/d6/d9/f69 0 2024-06-03T00:03:02.328 INFO:tasks.workunit.client.0.smithi049.stdout:7/275: write d3/d6/d9/d37/f51 [37304,105368] 0 2024-06-03T00:03:02.329 INFO:tasks.workunit.client.0.smithi049.stdout:9/386: symlink d1/da/d54/d5b/d61/l7b 0 2024-06-03T00:03:02.330 INFO:tasks.workunit.client.0.smithi049.stdout:9/387: dread - d1/da/d54/f76 zero size 2024-06-03T00:03:02.333 INFO:tasks.workunit.client.0.smithi049.stdout:0/215: mkdir d6/d29/d47/d4b 0 2024-06-03T00:03:02.333 INFO:tasks.workunit.client.0.smithi049.stdout:0/216: write d6/f16 [3360417,39871] 0 2024-06-03T00:03:02.335 INFO:tasks.workunit.client.0.smithi049.stdout:7/276: truncate d3/d6/d13/d54/f4d 4108375 0 2024-06-03T00:03:02.338 INFO:tasks.workunit.client.0.smithi049.stdout:0/217: rename d6/l13 to d6/d30/d32/l4c 0 2024-06-03T00:03:02.338 INFO:tasks.workunit.client.0.smithi049.stdout:0/218: dread - d6/f3d zero size 2024-06-03T00:03:02.338 INFO:tasks.workunit.client.0.smithi049.stdout:0/219: chown d6/d29/d47/d4b 78 1 2024-06-03T00:03:02.344 INFO:tasks.workunit.client.0.smithi049.stdout:7/277: mknod d3/d6/d13/d4a/c6a 0 2024-06-03T00:03:02.344 INFO:tasks.workunit.client.0.smithi049.stdout:2/249: dwrite da/d52/d40/f4f [0,4194304] 0 2024-06-03T00:03:02.345 INFO:tasks.workunit.client.0.smithi049.stdout:0/220: link d6/d29/c31 d6/d30/d32/c4d 0 2024-06-03T00:03:02.347 INFO:tasks.workunit.client.0.smithi049.stdout:7/278: symlink d3/d6/d9/d37/l6b 0 2024-06-03T00:03:02.347 INFO:tasks.workunit.client.0.smithi049.stdout:7/279: read d3/d6/f1c [644316,104150] 0 2024-06-03T00:03:02.351 INFO:tasks.workunit.client.0.smithi049.stdout:2/250: unlink da/l2e 0 2024-06-03T00:03:02.352 INFO:tasks.workunit.client.0.smithi049.stdout:7/280: creat d3/d57/f6c x:0 0 0 2024-06-03T00:03:02.354 INFO:tasks.workunit.client.0.smithi049.stdout:2/251: link da/d52/df/c31 da/c57 0 2024-06-03T00:03:02.355 INFO:tasks.workunit.client.0.smithi049.stdout:0/221: rename d6/f3f to d6/f4e 0 2024-06-03T00:03:02.356 INFO:tasks.workunit.client.0.smithi049.stdout:7/281: mknod d3/d6/d13/d3c/d48/c6d 0 2024-06-03T00:03:02.357 INFO:tasks.workunit.client.0.smithi049.stdout:2/252: creat da/d55/f58 x:0 0 0 2024-06-03T00:03:02.357 INFO:tasks.workunit.client.0.smithi049.stdout:2/253: fdatasync da/f47 0 2024-06-03T00:03:02.357 INFO:tasks.workunit.client.0.smithi049.stdout:2/254: fsync da/d52/df/f34 0 2024-06-03T00:03:02.358 INFO:tasks.workunit.client.0.smithi049.stdout:0/222: readlink d6/le 0 2024-06-03T00:03:02.358 INFO:tasks.workunit.client.0.smithi049.stdout:7/282: rmdir d3/d6/d13/d3c/d48/d4e 39 2024-06-03T00:03:02.359 INFO:tasks.workunit.client.0.smithi049.stdout:0/223: rmdir d6/d29/d2e 39 2024-06-03T00:03:02.361 INFO:tasks.workunit.client.0.smithi049.stdout:0/224: creat d6/d29/d2e/f4f x:0 0 0 2024-06-03T00:03:02.362 INFO:tasks.workunit.client.0.smithi049.stdout:7/283: mkdir d3/d14/d6e 0 2024-06-03T00:03:02.364 INFO:tasks.workunit.client.0.smithi049.stdout:0/225: creat d6/d29/d47/f50 x:0 0 0 2024-06-03T00:03:02.364 INFO:tasks.workunit.client.0.smithi049.stdout:0/226: fdatasync d6/d29/f33 0 2024-06-03T00:03:02.365 INFO:tasks.workunit.client.0.smithi049.stdout:7/284: rename d3/d6/d13/d54/c33 to d3/d6/d9/c6f 0 2024-06-03T00:03:02.374 INFO:tasks.workunit.client.0.smithi049.stdout:7/285: read d3/d6/d9/f69 [1697581,31898] 0 2024-06-03T00:03:02.376 INFO:tasks.workunit.client.0.smithi049.stdout:7/286: symlink d3/d6/d13/d3c/d48/d4e/d5b/l70 0 2024-06-03T00:03:02.378 INFO:tasks.workunit.client.0.smithi049.stdout:6/287: sync 2024-06-03T00:03:02.380 INFO:tasks.workunit.client.0.smithi049.stdout:6/288: creat d2/d3/d9/d23/d29/d30/f65 x:0 0 0 2024-06-03T00:03:02.380 INFO:tasks.workunit.client.0.smithi049.stdout:2/255: dwrite da/f45 [0,4194304] 0 2024-06-03T00:03:02.381 INFO:tasks.workunit.client.0.smithi049.stdout:6/289: rmdir d2/d3/d9 39 2024-06-03T00:03:02.382 INFO:tasks.workunit.client.0.smithi049.stdout:8/220: sync 2024-06-03T00:03:02.382 INFO:tasks.workunit.client.0.smithi049.stdout:0/227: dwrite d6/d29/d2e/f24 [0,4194304] 0 2024-06-03T00:03:02.383 INFO:tasks.workunit.client.0.smithi049.stdout:2/256: rmdir da/d43 39 2024-06-03T00:03:02.383 INFO:tasks.workunit.client.0.smithi049.stdout:2/257: write da/d52/df/f34 [438687,15979] 0 2024-06-03T00:03:02.384 INFO:tasks.workunit.client.0.smithi049.stdout:8/221: mkdir d4/d7/d28/d45 0 2024-06-03T00:03:02.388 INFO:tasks.workunit.client.0.smithi049.stdout:0/228: creat d6/d29/d47/d4b/f51 x:0 0 0 2024-06-03T00:03:02.388 INFO:tasks.workunit.client.0.smithi049.stdout:0/229: dread - d6/d29/d2e/f4f zero size 2024-06-03T00:03:02.389 INFO:tasks.workunit.client.0.smithi049.stdout:2/258: rename da/d52/d49/d4b to da/d52/d37/d59 0 2024-06-03T00:03:02.389 INFO:tasks.workunit.client.0.smithi049.stdout:2/259: write da/f1c [500895,74403] 0 2024-06-03T00:03:02.390 INFO:tasks.workunit.client.0.smithi049.stdout:8/222: truncate d4/d7/f14 3676137 0 2024-06-03T00:03:02.390 INFO:tasks.workunit.client.0.smithi049.stdout:3/213: sync 2024-06-03T00:03:02.390 INFO:tasks.workunit.client.0.smithi049.stdout:4/300: sync 2024-06-03T00:03:02.390 INFO:tasks.workunit.client.0.smithi049.stdout:4/301: chown d4/d16/d1c/f1f 15 1 2024-06-03T00:03:02.391 INFO:tasks.workunit.client.0.smithi049.stdout:0/230: mkdir d6/d29/d2e/d52 0 2024-06-03T00:03:02.391 INFO:tasks.workunit.client.0.smithi049.stdout:0/231: truncate d6/d29/d2e/f4f 981121 0 2024-06-03T00:03:02.392 INFO:tasks.workunit.client.0.smithi049.stdout:6/290: dwrite d2/d3/f38 [0,4194304] 0 2024-06-03T00:03:02.395 INFO:tasks.workunit.client.0.smithi049.stdout:6/291: dread d2/d4d/f31 [0,4194304] 0 2024-06-03T00:03:02.396 INFO:tasks.workunit.client.0.smithi049.stdout:8/223: dread d4/d7/f1a [4194304,4194304] 0 2024-06-03T00:03:02.396 INFO:tasks.workunit.client.0.smithi049.stdout:8/224: fdatasync d4/d7/d3a/f3d 0 2024-06-03T00:03:02.398 INFO:tasks.workunit.client.0.smithi049.stdout:8/225: creat d4/d7/d28/f46 x:0 0 0 2024-06-03T00:03:02.399 INFO:tasks.workunit.client.0.smithi049.stdout:8/226: mknod d4/d7/d3a/c47 0 2024-06-03T00:03:02.399 INFO:tasks.workunit.client.0.smithi049.stdout:8/227: stat d4/d7/f1e 0 2024-06-03T00:03:02.400 INFO:tasks.workunit.client.0.smithi049.stdout:0/232: truncate d6/d29/d2e/f4f 108722 0 2024-06-03T00:03:02.401 INFO:tasks.workunit.client.0.smithi049.stdout:8/228: mkdir d4/d7/d48 0 2024-06-03T00:03:02.402 INFO:tasks.workunit.client.0.smithi049.stdout:0/233: truncate d6/d29/f33 564209 0 2024-06-03T00:03:02.405 INFO:tasks.workunit.client.0.smithi049.stdout:0/234: rename d6/d29/l3c to d6/d29/d47/l53 0 2024-06-03T00:03:02.408 INFO:tasks.workunit.client.0.smithi049.stdout:0/235: creat d6/d29/f54 x:0 0 0 2024-06-03T00:03:02.408 INFO:tasks.workunit.client.0.smithi049.stdout:0/236: chown d6/d30/l49 795 1 2024-06-03T00:03:02.410 INFO:tasks.workunit.client.0.smithi049.stdout:0/237: mknod d6/d29/d2e/c55 0 2024-06-03T00:03:02.410 INFO:tasks.workunit.client.0.smithi049.stdout:0/238: write d6/f3d [1011549,2560] 0 2024-06-03T00:03:02.411 INFO:tasks.workunit.client.0.smithi049.stdout:0/239: chown d6 14896038 1 2024-06-03T00:03:02.411 INFO:tasks.workunit.client.0.smithi049.stdout:2/260: dwrite da/d52/df/f27 [4194304,4194304] 0 2024-06-03T00:03:02.414 INFO:tasks.workunit.client.0.smithi049.stdout:8/229: dread d4/d7/f11 [0,4194304] 0 2024-06-03T00:03:02.420 INFO:tasks.workunit.client.0.smithi049.stdout:8/230: dread d4/d7/f10 [0,4194304] 0 2024-06-03T00:03:02.421 INFO:tasks.workunit.client.0.smithi049.stdout:4/302: dwrite d4/d3f/d14/f40 [0,4194304] 0 2024-06-03T00:03:02.423 INFO:tasks.workunit.client.0.smithi049.stdout:4/303: unlink d4/d16/d1c/c37 0 2024-06-03T00:03:02.424 INFO:tasks.workunit.client.0.smithi049.stdout:4/304: creat d4/d16/d1c/d4f/f66 x:0 0 0 2024-06-03T00:03:02.424 INFO:tasks.workunit.client.0.smithi049.stdout:4/305: chown d4/d3f/d14/l5e 5 1 2024-06-03T00:03:02.425 INFO:tasks.workunit.client.0.smithi049.stdout:6/292: dwrite d2/d3/d9/d23/d29/f63 [0,4194304] 0 2024-06-03T00:03:02.426 INFO:tasks.workunit.client.0.smithi049.stdout:8/231: dread d4/d7/f14 [0,4194304] 0 2024-06-03T00:03:02.426 INFO:tasks.workunit.client.0.smithi049.stdout:8/232: dread - d4/d7/d3a/f40 zero size 2024-06-03T00:03:02.426 INFO:tasks.workunit.client.0.smithi049.stdout:8/233: stat d4/d27/d3c/l3f 0 2024-06-03T00:03:02.426 INFO:tasks.workunit.client.0.smithi049.stdout:3/214: dwrite d2/f11 [0,4194304] 0 2024-06-03T00:03:02.429 INFO:tasks.workunit.client.0.smithi049.stdout:6/293: link d2/d3/d9/d23/d29/c3c d2/d3/c66 0 2024-06-03T00:03:02.429 INFO:tasks.workunit.client.0.smithi049.stdout:6/294: getdents d2/d3b 0 2024-06-03T00:03:02.429 INFO:tasks.workunit.client.0.smithi049.stdout:4/306: dread f2 [0,4194304] 0 2024-06-03T00:03:02.431 INFO:tasks.workunit.client.0.smithi049.stdout:8/234: unlink d4/d27/d30/l37 0 2024-06-03T00:03:02.431 INFO:tasks.workunit.client.0.smithi049.stdout:8/235: fsync d4/d7/f2a 0 2024-06-03T00:03:02.432 INFO:tasks.workunit.client.0.smithi049.stdout:3/215: getdents d2/d1a/d34 0 2024-06-03T00:03:02.433 INFO:tasks.workunit.client.0.smithi049.stdout:2/261: dwrite da/f47 [0,4194304] 0 2024-06-03T00:03:02.433 INFO:tasks.workunit.client.0.smithi049.stdout:2/262: chown da/d52/d37/l3d 300714216 1 2024-06-03T00:03:02.433 INFO:tasks.workunit.client.0.smithi049.stdout:2/263: truncate da/d52/d40/f4f 5192889 0 2024-06-03T00:03:02.433 INFO:tasks.workunit.client.0.smithi049.stdout:6/295: dread d2/f11 [0,4194304] 0 2024-06-03T00:03:02.433 INFO:tasks.workunit.client.0.smithi049.stdout:6/296: readlink d2/l6 0 2024-06-03T00:03:02.433 INFO:tasks.workunit.client.0.smithi049.stdout:6/297: fsync d2/d3/d9/d23/d29/d30/f5a 0 2024-06-03T00:03:02.434 INFO:tasks.workunit.client.0.smithi049.stdout:2/264: write da/f1c [439702,44872] 0 2024-06-03T00:03:02.434 INFO:tasks.workunit.client.0.smithi049.stdout:2/265: dread - da/d52/d40/f51 zero size 2024-06-03T00:03:02.434 INFO:tasks.workunit.client.0.smithi049.stdout:2/266: chown da/d52/df/l32 17289 1 2024-06-03T00:03:02.436 INFO:tasks.workunit.client.0.smithi049.stdout:4/307: creat d4/d16/f67 x:0 0 0 2024-06-03T00:03:02.437 INFO:tasks.workunit.client.0.smithi049.stdout:8/236: rmdir d4/d7 39 2024-06-03T00:03:02.438 INFO:tasks.workunit.client.0.smithi049.stdout:8/237: write d4/d7/d28/d25/f39 [531571,97849] 0 2024-06-03T00:03:02.439 INFO:tasks.workunit.client.0.smithi049.stdout:4/308: write d4/d2a/f5d [1271843,113199] 0 2024-06-03T00:03:02.439 INFO:tasks.workunit.client.0.smithi049.stdout:4/309: write d4/d3f/d14/d2b/f48 [4532280,70017] 0 2024-06-03T00:03:02.439 INFO:tasks.workunit.client.0.smithi049.stdout:4/310: dread - d4/d16/d1c/d4f/f5c zero size 2024-06-03T00:03:02.439 INFO:tasks.workunit.client.0.smithi049.stdout:4/311: write d4/d3f/f62 [750295,129557] 0 2024-06-03T00:03:02.439 INFO:tasks.workunit.client.0.smithi049.stdout:4/312: chown d4/l3b 57 1 2024-06-03T00:03:02.440 INFO:tasks.workunit.client.0.smithi049.stdout:3/216: rmdir d2/d1a/d34 39 2024-06-03T00:03:02.443 INFO:tasks.workunit.client.0.smithi049.stdout:3/217: dread d2/d14/f24 [0,4194304] 0 2024-06-03T00:03:02.444 INFO:tasks.workunit.client.0.smithi049.stdout:3/218: dread - d2/d14/f2e zero size 2024-06-03T00:03:02.444 INFO:tasks.workunit.client.0.smithi049.stdout:3/219: chown d2/d14/d22/f2a 502443468 1 2024-06-03T00:03:02.444 INFO:tasks.workunit.client.0.smithi049.stdout:6/298: mknod d2/d3/d9/d40/c67 0 2024-06-03T00:03:02.445 INFO:tasks.workunit.client.0.smithi049.stdout:8/238: creat d4/d7/d28/d45/f49 x:0 0 0 2024-06-03T00:03:02.445 INFO:tasks.workunit.client.0.smithi049.stdout:8/239: readlink d4/d7/l20 0 2024-06-03T00:03:02.445 INFO:tasks.workunit.client.0.smithi049.stdout:8/240: truncate d4/d27/d3c/f2c 4649233 0 2024-06-03T00:03:02.446 INFO:tasks.workunit.client.0.smithi049.stdout:8/241: stat d4/d7/f11 0 2024-06-03T00:03:02.446 INFO:tasks.workunit.client.0.smithi049.stdout:8/242: write d4/d7/d28/d45/f49 [554325,51009] 0 2024-06-03T00:03:02.446 INFO:tasks.workunit.client.0.smithi049.stdout:8/243: chown d4/d7/l20 35974739 1 2024-06-03T00:03:02.446 INFO:tasks.workunit.client.0.smithi049.stdout:8/244: chown d4/d7/cb 51684748 1 2024-06-03T00:03:02.454 INFO:tasks.workunit.client.0.smithi049.stdout:2/267: dwrite da/d55/f58 [0,4194304] 0 2024-06-03T00:03:02.454 INFO:tasks.workunit.client.0.smithi049.stdout:2/268: stat da/d52/df/c41 0 2024-06-03T00:03:02.455 INFO:tasks.workunit.client.0.smithi049.stdout:6/299: write d2/d3/d9/d23/d29/f2d [174593,104872] 0 2024-06-03T00:03:02.455 INFO:tasks.workunit.client.0.smithi049.stdout:6/300: write d2/d3/d9/d23/d48/d51/f5f [161798,68820] 0 2024-06-03T00:03:02.456 INFO:tasks.workunit.client.0.smithi049.stdout:2/269: symlink da/d55/l5a 0 2024-06-03T00:03:02.457 INFO:tasks.workunit.client.0.smithi049.stdout:6/301: symlink d2/d3/d9/d55/l68 0 2024-06-03T00:03:02.458 INFO:tasks.workunit.client.0.smithi049.stdout:6/302: rmdir d2/d3 39 2024-06-03T00:03:02.459 INFO:tasks.workunit.client.0.smithi049.stdout:2/270: mknod da/d52/df/c5b 0 2024-06-03T00:03:02.460 INFO:tasks.workunit.client.0.smithi049.stdout:6/303: creat d2/d3/d17/d57/f69 x:0 0 0 2024-06-03T00:03:02.462 INFO:tasks.workunit.client.0.smithi049.stdout:6/304: mkdir d2/d3/d9/d23/d29/d6a 0 2024-06-03T00:03:02.463 INFO:tasks.workunit.client.0.smithi049.stdout:6/305: creat d2/d3/d17/f6b x:0 0 0 2024-06-03T00:03:02.464 INFO:tasks.workunit.client.0.smithi049.stdout:6/306: symlink d2/d4d/l6c 0 2024-06-03T00:03:02.464 INFO:tasks.workunit.client.0.smithi049.stdout:6/307: chown d2/d3/d9/d23/d48/f61 18027068 1 2024-06-03T00:03:02.465 INFO:tasks.workunit.client.0.smithi049.stdout:6/308: creat d2/d3/d9/d23/d29/d30/f6d x:0 0 0 2024-06-03T00:03:02.465 INFO:tasks.workunit.client.0.smithi049.stdout:6/309: write d2/f15 [2833692,4325] 0 2024-06-03T00:03:02.465 INFO:tasks.workunit.client.0.smithi049.stdout:6/310: fdatasync d2/d3/d9/d23/d36/f45 0 2024-06-03T00:03:02.465 INFO:tasks.workunit.client.0.smithi049.stdout:6/311: truncate d2/d3/d17/d57/f69 468925 0 2024-06-03T00:03:02.465 INFO:tasks.workunit.client.0.smithi049.stdout:6/312: dread - d2/f3e zero size 2024-06-03T00:03:02.465 INFO:tasks.workunit.client.0.smithi049.stdout:4/313: dwrite d4/d16/d1c/d4f/f5c [0,4194304] 0 2024-06-03T00:03:02.466 INFO:tasks.workunit.client.0.smithi049.stdout:4/314: fsync d4/d16/d1c/d24/f42 0 2024-06-03T00:03:02.466 INFO:tasks.workunit.client.0.smithi049.stdout:2/271: dread da/fb [0,4194304] 0 2024-06-03T00:03:02.466 INFO:tasks.workunit.client.0.smithi049.stdout:3/220: dwrite d2/d14/d22/d3a/f3e [0,4194304] 0 2024-06-03T00:03:02.469 INFO:tasks.workunit.client.0.smithi049.stdout:4/315: symlink d4/d2a/l68 0 2024-06-03T00:03:02.470 INFO:tasks.workunit.client.0.smithi049.stdout:4/316: stat d4/d16/d1c/d24/f51 0 2024-06-03T00:03:02.470 INFO:tasks.workunit.client.0.smithi049.stdout:4/317: write d4/d2a/f34 [448835,1147] 0 2024-06-03T00:03:02.470 INFO:tasks.workunit.client.0.smithi049.stdout:2/272: creat da/d52/d37/d59/f5c x:0 0 0 2024-06-03T00:03:02.470 INFO:tasks.workunit.client.0.smithi049.stdout:6/313: dread d2/d3/d9/d23/d48/d51/f5f [0,4194304] 0 2024-06-03T00:03:02.470 INFO:tasks.workunit.client.0.smithi049.stdout:6/314: chown d2/d3/d9/d23/d36 58 1 2024-06-03T00:03:02.471 INFO:tasks.workunit.client.0.smithi049.stdout:4/318: mkdir d4/d16/d69 0 2024-06-03T00:03:02.471 INFO:tasks.workunit.client.0.smithi049.stdout:4/319: truncate d4/d16/d1c/d24/f51 1479995 0 2024-06-03T00:03:02.475 INFO:tasks.workunit.client.0.smithi049.stdout:6/315: unlink d2/l39 0 2024-06-03T00:03:02.475 INFO:tasks.workunit.client.0.smithi049.stdout:6/316: readlink d2/l13 0 2024-06-03T00:03:02.475 INFO:tasks.workunit.client.0.smithi049.stdout:6/317: chown d2/d3/d17/l5b 21350544 1 2024-06-03T00:03:02.486 INFO:tasks.workunit.client.0.smithi049.stdout:2/273: truncate da/d52/df/f10 5114669 0 2024-06-03T00:03:02.487 INFO:tasks.workunit.client.0.smithi049.stdout:2/274: symlink da/d52/d40/d42/l5d 0 2024-06-03T00:03:02.487 INFO:tasks.workunit.client.0.smithi049.stdout:2/275: rmdir da 39 2024-06-03T00:03:02.489 INFO:tasks.workunit.client.0.smithi049.stdout:2/276: dread da/f1c [0,4194304] 0 2024-06-03T00:03:02.490 INFO:tasks.workunit.client.0.smithi049.stdout:6/318: dwrite d2/d3/d17/f46 [0,4194304] 0 2024-06-03T00:03:02.491 INFO:tasks.workunit.client.0.smithi049.stdout:2/277: unlink da/d52/df/f30 0 2024-06-03T00:03:02.491 INFO:tasks.workunit.client.0.smithi049.stdout:2/278: read - da/d52/d37/f56 zero size 2024-06-03T00:03:02.505 INFO:tasks.workunit.client.0.smithi049.stdout:6/319: dwrite d2/d3/d17/f46 [0,4194304] 0 2024-06-03T00:03:02.506 INFO:tasks.workunit.client.0.smithi049.stdout:6/320: fdatasync d2/d3/d9/d23/d29/f41 0 2024-06-03T00:03:02.507 INFO:tasks.workunit.client.0.smithi049.stdout:6/321: getdents d2/d3/d9/d40 0 2024-06-03T00:03:02.508 INFO:tasks.workunit.client.0.smithi049.stdout:6/322: mkdir d2/d3/d17/d57/d6e 0 2024-06-03T00:03:02.511 INFO:tasks.workunit.client.0.smithi049.stdout:6/323: rename d2/d4d/c1c to d2/d3/d9/c6f 0 2024-06-03T00:03:02.511 INFO:tasks.workunit.client.0.smithi049.stdout:6/324: fsync d2/f3e 0 2024-06-03T00:03:02.512 INFO:tasks.workunit.client.0.smithi049.stdout:6/325: creat d2/d3/d9/d23/d48/f70 x:0 0 0 2024-06-03T00:03:02.512 INFO:tasks.workunit.client.0.smithi049.stdout:6/326: chown d2/d3/d9/d23/d36/f4b 18854795 1 2024-06-03T00:03:02.520 INFO:tasks.workunit.client.0.smithi049.stdout:6/327: read d2/d3/d17/f46 [927659,93738] 0 2024-06-03T00:03:02.522 INFO:tasks.workunit.client.0.smithi049.stdout:6/328: creat d2/d3/d9/f71 x:0 0 0 2024-06-03T00:03:02.523 INFO:tasks.workunit.client.0.smithi049.stdout:6/329: mkdir d2/d3/d9/d23/d36/d72 0 2024-06-03T00:03:02.526 INFO:tasks.workunit.client.0.smithi049.stdout:6/330: link d2/d3/d17/d57/f69 d2/d3/d17/f73 0 2024-06-03T00:03:02.526 INFO:tasks.workunit.client.0.smithi049.stdout:6/331: fdatasync d2/d3/d9/d23/d29/d30/f65 0 2024-06-03T00:03:02.526 INFO:tasks.workunit.client.0.smithi049.stdout:6/332: getdents d2/d3/d9/d23/d36/d72 0 2024-06-03T00:03:02.526 INFO:tasks.workunit.client.0.smithi049.stdout:6/333: dread - d2/d3/f60 zero size 2024-06-03T00:03:02.527 INFO:tasks.workunit.client.0.smithi049.stdout:6/334: creat d2/d4d/f74 x:0 0 0 2024-06-03T00:03:02.528 INFO:tasks.workunit.client.0.smithi049.stdout:6/335: stat d2/d3/d9/d23/d29/c3c 0 2024-06-03T00:03:02.528 INFO:tasks.workunit.client.0.smithi049.stdout:6/336: fdatasync d2/d3/d9/d23/f26 0 2024-06-03T00:03:02.528 INFO:tasks.workunit.client.0.smithi049.stdout:6/337: read - d2/d3/d9/d55/f5c zero size 2024-06-03T00:03:02.528 INFO:tasks.workunit.client.0.smithi049.stdout:6/338: truncate d2/f15 4596523 0 2024-06-03T00:03:02.528 INFO:tasks.workunit.client.0.smithi049.stdout:6/339: chown d2/d3/d9/d23/d29/f2d 0 1 2024-06-03T00:03:02.529 INFO:tasks.workunit.client.0.smithi049.stdout:6/340: read d2/d3/d9/d23/d29/f41 [88985,63561] 0 2024-06-03T00:03:02.550 INFO:tasks.workunit.client.0.smithi049.stdout:6/341: dwrite d2/d3/d9/d55/f5c [0,4194304] 0 2024-06-03T00:03:02.555 INFO:tasks.workunit.client.0.smithi049.stdout:6/342: dread d2/f15 [0,4194304] 0 2024-06-03T00:03:02.708 INFO:tasks.workunit.client.0.smithi049.stdout:1/358: sync 2024-06-03T00:03:02.708 INFO:tasks.workunit.client.0.smithi049.stdout:3/221: sync 2024-06-03T00:03:02.708 INFO:tasks.workunit.client.0.smithi049.stdout:9/388: sync 2024-06-03T00:03:02.708 INFO:tasks.workunit.client.0.smithi049.stdout:8/245: sync 2024-06-03T00:03:02.708 INFO:tasks.workunit.client.0.smithi049.stdout:0/240: sync 2024-06-03T00:03:02.708 INFO:tasks.workunit.client.0.smithi049.stdout:5/269: sync 2024-06-03T00:03:02.708 INFO:tasks.workunit.client.0.smithi049.stdout:4/320: sync 2024-06-03T00:03:02.709 INFO:tasks.workunit.client.0.smithi049.stdout:3/222: write d2/d1a/f1d [178418,26164] 0 2024-06-03T00:03:02.709 INFO:tasks.workunit.client.0.smithi049.stdout:1/359: write d1/d2f/d36/d37/d13/d34/f3c [1188535,95962] 0 2024-06-03T00:03:02.709 INFO:tasks.workunit.client.0.smithi049.stdout:7/287: sync 2024-06-03T00:03:02.709 INFO:tasks.workunit.client.0.smithi049.stdout:5/270: write d3/d5/da/d55/d14/f2a [2333589,50720] 0 2024-06-03T00:03:02.709 INFO:tasks.workunit.client.0.smithi049.stdout:5/271: chown d3/d9/lf 313430 1 2024-06-03T00:03:02.709 INFO:tasks.workunit.client.0.smithi049.stdout:7/288: chown d3/d6/d9/d37/f67 348540 1 2024-06-03T00:03:02.709 INFO:tasks.workunit.client.0.smithi049.stdout:3/223: write d2/fd [4745544,78308] 0 2024-06-03T00:03:02.709 INFO:tasks.workunit.client.0.smithi049.stdout:7/289: fdatasync d3/d6/d9/d37/f66 0 2024-06-03T00:03:02.709 INFO:tasks.workunit.client.0.smithi049.stdout:6/343: sync 2024-06-03T00:03:02.709 INFO:tasks.workunit.client.0.smithi049.stdout:7/290: stat d3/d6/d9/f2b 0 2024-06-03T00:03:02.709 INFO:tasks.workunit.client.0.smithi049.stdout:2/279: sync 2024-06-03T00:03:02.710 INFO:tasks.workunit.client.0.smithi049.stdout:4/321: creat d4/d3f/d14/d15/f6a x:0 0 0 2024-06-03T00:03:02.710 INFO:tasks.workunit.client.0.smithi049.stdout:4/322: fdatasync d4/d3f/d14/f40 0 2024-06-03T00:03:02.710 INFO:tasks.workunit.client.0.smithi049.stdout:4/323: write d4/d2a/f34 [2630083,105734] 0 2024-06-03T00:03:02.710 INFO:tasks.workunit.client.0.smithi049.stdout:1/360: truncate d1/d2f/d36/d37/f22 346979 0 2024-06-03T00:03:02.711 INFO:tasks.workunit.client.0.smithi049.stdout:7/291: symlink d3/d6/d13/d3c/d4b/d5a/l71 0 2024-06-03T00:03:02.712 INFO:tasks.workunit.client.0.smithi049.stdout:2/280: mknod da/d52/d49/c5e 0 2024-06-03T00:03:02.713 INFO:tasks.workunit.client.0.smithi049.stdout:8/246: rename d4/d7/l20 to d4/l4a 0 2024-06-03T00:03:02.714 INFO:tasks.workunit.client.0.smithi049.stdout:0/241: mkdir d6/d56 0 2024-06-03T00:03:02.715 INFO:tasks.workunit.client.0.smithi049.stdout:4/324: truncate d4/d16/d1c/d24/f51 1195257 0 2024-06-03T00:03:02.716 INFO:tasks.workunit.client.0.smithi049.stdout:9/389: dread d1/d5/d13/f39 [0,4194304] 0 2024-06-03T00:03:02.720 INFO:tasks.workunit.client.0.smithi049.stdout:6/344: rename d2/d3/d9/d23/f1a to d2/d3/d17/d57/f75 0 2024-06-03T00:03:02.721 INFO:tasks.workunit.client.0.smithi049.stdout:0/242: rmdir d6 39 2024-06-03T00:03:02.723 INFO:tasks.workunit.client.0.smithi049.stdout:6/345: mkdir d2/d4d/d76 0 2024-06-03T00:03:02.723 INFO:tasks.workunit.client.0.smithi049.stdout:6/346: readlink d2/d4d/l2e 0 2024-06-03T00:03:02.723 INFO:tasks.workunit.client.0.smithi049.stdout:6/347: write d2/d4d/f74 [332689,71065] 0 2024-06-03T00:03:02.728 INFO:tasks.workunit.client.0.smithi049.stdout:6/348: rename d2/d3/d9/d23/d29/d30/f43 to d2/d3/d17/f77 0 2024-06-03T00:03:02.729 INFO:tasks.workunit.client.0.smithi049.stdout:0/243: read d6/f21 [2419088,71799] 0 2024-06-03T00:03:02.733 INFO:tasks.workunit.client.0.smithi049.stdout:0/244: link d6/d30/d32/l4c d6/d29/d47/d4b/l57 0 2024-06-03T00:03:02.735 INFO:tasks.workunit.client.0.smithi049.stdout:0/245: mknod d6/d29/d2e/c58 0 2024-06-03T00:03:02.736 INFO:tasks.workunit.client.0.smithi049.stdout:0/246: fsync d6/d29/f54 0 2024-06-03T00:03:02.736 INFO:tasks.workunit.client.0.smithi049.stdout:0/247: readlink d6/le 0 2024-06-03T00:03:02.736 INFO:tasks.workunit.client.0.smithi049.stdout:0/248: chown d6/d30/d32/c4d 0 1 2024-06-03T00:03:02.736 INFO:tasks.workunit.client.0.smithi049.stdout:0/249: chown d6/d30/d32/f40 168539552 1 2024-06-03T00:03:02.739 INFO:tasks.workunit.client.0.smithi049.stdout:6/349: write d2/d3/d9/d23/d29/f32 [665650,99067] 0 2024-06-03T00:03:02.739 INFO:tasks.workunit.client.0.smithi049.stdout:6/350: write d2/d3/d17/f77 [468039,9428] 0 2024-06-03T00:03:02.743 INFO:tasks.workunit.client.0.smithi049.stdout:6/351: symlink d2/d4d/d76/l78 0 2024-06-03T00:03:02.745 INFO:tasks.workunit.client.0.smithi049.stdout:6/352: rmdir d2/d3/d9/d23 39 2024-06-03T00:03:02.745 INFO:tasks.workunit.client.0.smithi049.stdout:6/353: chown d2/d3/d17/f77 23403 1 2024-06-03T00:03:02.745 INFO:tasks.workunit.client.0.smithi049.stdout:7/292: dwrite d3/d6/f20 [0,4194304] 0 2024-06-03T00:03:02.746 INFO:tasks.workunit.client.0.smithi049.stdout:6/354: mknod d2/d3/d9/d23/d48/c79 0 2024-06-03T00:03:02.748 INFO:tasks.workunit.client.0.smithi049.stdout:7/293: truncate d3/d32/f41 2841036 0 2024-06-03T00:03:02.749 INFO:tasks.workunit.client.0.smithi049.stdout:7/294: unlink d3/d14/c4c 0 2024-06-03T00:03:02.749 INFO:tasks.workunit.client.0.smithi049.stdout:7/295: dread - d3/d57/f6c zero size 2024-06-03T00:03:02.750 INFO:tasks.workunit.client.0.smithi049.stdout:7/296: write d3/d6/d3f/f59 [1788910,119673] 0 2024-06-03T00:03:02.750 INFO:tasks.workunit.client.0.smithi049.stdout:7/297: rename d3/d6/d13/d54 to d3/d6/d13/d54/d60/d72 22 2024-06-03T00:03:02.751 INFO:tasks.workunit.client.0.smithi049.stdout:7/298: creat d3/d6/f73 x:0 0 0 2024-06-03T00:03:02.751 INFO:tasks.workunit.client.0.smithi049.stdout:7/299: chown d3/f22 31914874 1 2024-06-03T00:03:02.751 INFO:tasks.workunit.client.0.smithi049.stdout:7/300: truncate d3/d6/f73 316827 0 2024-06-03T00:03:02.752 INFO:tasks.workunit.client.0.smithi049.stdout:7/301: rename d3/d6/d13/d54/c2e to d3/d6/d9/c74 0 2024-06-03T00:03:02.752 INFO:tasks.workunit.client.0.smithi049.stdout:7/302: fdatasync d3/d6/d9/d37/f67 0 2024-06-03T00:03:02.753 INFO:tasks.workunit.client.0.smithi049.stdout:7/303: truncate d3/d6/d13/d54/f10 10549 0 2024-06-03T00:03:02.759 INFO:tasks.workunit.client.0.smithi049.stdout:9/390: dwrite d1/da/d27/d30/f34 [0,4194304] 0 2024-06-03T00:03:02.759 INFO:tasks.workunit.client.0.smithi049.stdout:9/391: chown d1/d5/d13/d3b/f6e 10564 1 2024-06-03T00:03:02.759 INFO:tasks.workunit.client.0.smithi049.stdout:5/272: dwrite d3/d5/da/d55/d14/f47 [0,4194304] 0 2024-06-03T00:03:02.759 INFO:tasks.workunit.client.0.smithi049.stdout:4/325: dwrite d4/d2a/f34 [0,4194304] 0 2024-06-03T00:03:02.759 INFO:tasks.workunit.client.0.smithi049.stdout:4/326: write d4/d3f/f4d [650379,54034] 0 2024-06-03T00:03:02.759 INFO:tasks.workunit.client.0.smithi049.stdout:4/327: readlink d4/d3f/l11 0 2024-06-03T00:03:02.759 INFO:tasks.workunit.client.0.smithi049.stdout:2/281: dwrite da/d52/df/f10 [0,4194304] 0 2024-06-03T00:03:02.760 INFO:tasks.workunit.client.0.smithi049.stdout:8/247: dwrite d4/f15 [0,4194304] 0 2024-06-03T00:03:02.762 INFO:tasks.workunit.client.0.smithi049.stdout:7/304: write d3/d6/d13/d4a/f2f [1904114,38490] 0 2024-06-03T00:03:02.764 INFO:tasks.workunit.client.0.smithi049.stdout:4/328: creat d4/d3f/d14/d2b/f6b x:0 0 0 2024-06-03T00:03:02.764 INFO:tasks.workunit.client.0.smithi049.stdout:4/329: truncate d4/d3f/f5f 282286 0 2024-06-03T00:03:02.765 INFO:tasks.workunit.client.0.smithi049.stdout:9/392: dread d1/da/d26/f32 [0,4194304] 0 2024-06-03T00:03:02.765 INFO:tasks.workunit.client.0.smithi049.stdout:9/393: chown d1/da/d26/f43 964 1 2024-06-03T00:03:02.771 INFO:tasks.workunit.client.0.smithi049.stdout:2/282: write da/d52/df/f27 [1438266,23252] 0 2024-06-03T00:03:02.773 INFO:tasks.workunit.client.0.smithi049.stdout:8/248: creat d4/d27/f4b x:0 0 0 2024-06-03T00:03:02.777 INFO:tasks.workunit.client.0.smithi049.stdout:4/330: rename d4/d16/d1c/f39 to d4/f6c 0 2024-06-03T00:03:02.778 INFO:tasks.workunit.client.0.smithi049.stdout:4/331: write d4/d16/d1c/d4f/f66 [57125,91733] 0 2024-06-03T00:03:02.782 INFO:tasks.workunit.client.0.smithi049.stdout:2/283: mknod da/d55/c5f 0 2024-06-03T00:03:02.782 INFO:tasks.workunit.client.0.smithi049.stdout:8/249: link d4/d7/d28/f36 d4/d27/f4c 0 2024-06-03T00:03:02.783 INFO:tasks.workunit.client.0.smithi049.stdout:5/273: dwrite d3/d5/da/d55/d14/f2a [0,4194304] 0 2024-06-03T00:03:02.783 INFO:tasks.workunit.client.0.smithi049.stdout:4/332: link d4/d3f/d14/d2b/f48 d4/d2a/f6d 0 2024-06-03T00:03:02.783 INFO:tasks.workunit.client.0.smithi049.stdout:9/394: dwrite d1/da/d54/d5b/d61/f62 [0,4194304] 0 2024-06-03T00:03:02.783 INFO:tasks.workunit.client.0.smithi049.stdout:9/395: write d1/d5/d13/f53 [2406891,41804] 0 2024-06-03T00:03:02.784 INFO:tasks.workunit.client.0.smithi049.stdout:2/284: mkdir da/d52/df/d3c/d60 0 2024-06-03T00:03:02.784 INFO:tasks.workunit.client.0.smithi049.stdout:2/285: write da/d52/df/d3c/f53 [740095,54004] 0 2024-06-03T00:03:02.786 INFO:tasks.workunit.client.0.smithi049.stdout:5/274: creat d3/d5/d2d/d4b/f59 x:0 0 0 2024-06-03T00:03:02.786 INFO:tasks.workunit.client.0.smithi049.stdout:5/275: dread - d3/d5/da/d55/d14/f57 zero size 2024-06-03T00:03:02.786 INFO:tasks.workunit.client.0.smithi049.stdout:5/276: stat d3/d5/da 0 2024-06-03T00:03:02.789 INFO:tasks.workunit.client.0.smithi049.stdout:9/396: symlink d1/l7c 0 2024-06-03T00:03:02.790 INFO:tasks.workunit.client.0.smithi049.stdout:9/397: chown d1/da/d27 35 1 2024-06-03T00:03:02.793 INFO:tasks.workunit.client.0.smithi049.stdout:9/398: link d1/da/d27/f40 d1/da/d27/d30/d5f/f7d 0 2024-06-03T00:03:02.800 INFO:tasks.workunit.client.0.smithi049.stdout:2/286: mknod da/d52/c61 0 2024-06-03T00:03:02.802 INFO:tasks.workunit.client.0.smithi049.stdout:2/287: link da/d52/d40/f51 da/d52/d37/d59/f62 0 2024-06-03T00:03:02.805 INFO:tasks.workunit.client.0.smithi049.stdout:4/333: dwrite d4/d3f/d14/d15/f6a [0,4194304] 0 2024-06-03T00:03:02.809 INFO:tasks.workunit.client.0.smithi049.stdout:8/250: dwrite d4/d7/d28/f46 [0,4194304] 0 2024-06-03T00:03:02.809 INFO:tasks.workunit.client.0.smithi049.stdout:8/251: truncate d4/d7/f22 722638 0 2024-06-03T00:03:02.810 INFO:tasks.workunit.client.0.smithi049.stdout:4/334: rmdir d4/d3f/d14 39 2024-06-03T00:03:02.810 INFO:tasks.workunit.client.0.smithi049.stdout:4/335: stat d4/l54 0 2024-06-03T00:03:02.811 INFO:tasks.workunit.client.0.smithi049.stdout:5/277: dwrite d3/d9/f28 [0,4194304] 0 2024-06-03T00:03:02.811 INFO:tasks.workunit.client.0.smithi049.stdout:5/278: read - d3/d9/d20/f3d zero size 2024-06-03T00:03:02.814 INFO:tasks.workunit.client.0.smithi049.stdout:4/336: creat d4/d16/d1c/d4f/f6e x:0 0 0 2024-06-03T00:03:02.818 INFO:tasks.workunit.client.0.smithi049.stdout:5/279: mkdir d3/d9/d20/d4c/d5a 0 2024-06-03T00:03:02.819 INFO:tasks.workunit.client.0.smithi049.stdout:4/337: rmdir d4/d16 39 2024-06-03T00:03:02.819 INFO:tasks.workunit.client.0.smithi049.stdout:4/338: chown d4/f6c 504853 1 2024-06-03T00:03:02.820 INFO:tasks.workunit.client.0.smithi049.stdout:5/280: mknod d3/d5/d2d/c5b 0 2024-06-03T00:03:02.822 INFO:tasks.workunit.client.0.smithi049.stdout:9/399: dwrite d1/d5/d13/f6d [0,4194304] 0 2024-06-03T00:03:02.823 INFO:tasks.workunit.client.0.smithi049.stdout:2/288: dwrite da/d55/f58 [0,4194304] 0 2024-06-03T00:03:02.823 INFO:tasks.workunit.client.0.smithi049.stdout:2/289: stat da/f47 0 2024-06-03T00:03:02.824 INFO:tasks.workunit.client.0.smithi049.stdout:4/339: creat d4/d16/d1c/f6f x:0 0 0 2024-06-03T00:03:02.824 INFO:tasks.workunit.client.0.smithi049.stdout:4/340: chown d4/d2a/l4c 121 1 2024-06-03T00:03:02.828 INFO:tasks.workunit.client.0.smithi049.stdout:2/290: rename da/d52/d40/d42 to da/d52/d40/d63 0 2024-06-03T00:03:02.828 INFO:tasks.workunit.client.0.smithi049.stdout:4/341: getdents d4/d16/d1c/d24/d43 0 2024-06-03T00:03:02.829 INFO:tasks.workunit.client.0.smithi049.stdout:4/342: chown d4/d3f/l11 2830 1 2024-06-03T00:03:02.830 INFO:tasks.workunit.client.0.smithi049.stdout:2/291: creat da/d52/d40/f64 x:0 0 0 2024-06-03T00:03:02.835 INFO:tasks.workunit.client.0.smithi049.stdout:2/292: write da/fb [3860813,59094] 0 2024-06-03T00:03:02.837 INFO:tasks.workunit.client.0.smithi049.stdout:2/293: creat da/d52/d37/d59/f65 x:0 0 0 2024-06-03T00:03:02.837 INFO:tasks.workunit.client.0.smithi049.stdout:2/294: chown da/c57 6 1 2024-06-03T00:03:02.841 INFO:tasks.workunit.client.0.smithi049.stdout:8/252: dwrite d4/d7/d28/d25/f39 [0,4194304] 0 2024-06-03T00:03:02.841 INFO:tasks.workunit.client.0.smithi049.stdout:5/281: dwrite d3/d5/da/d55/d14/f2a [0,4194304] 0 2024-06-03T00:03:02.842 INFO:tasks.workunit.client.0.smithi049.stdout:5/282: chown d3/d5/da/f1d 220 1 2024-06-03T00:03:02.842 INFO:tasks.workunit.client.0.smithi049.stdout:4/343: dread d4/d16/f44 [0,4194304] 0 2024-06-03T00:03:02.845 INFO:tasks.workunit.client.0.smithi049.stdout:5/283: rename d3/d5/da/c17 to d3/d5/d2d/c5c 0 2024-06-03T00:03:02.846 INFO:tasks.workunit.client.0.smithi049.stdout:4/344: symlink d4/d3f/l70 0 2024-06-03T00:03:02.846 INFO:tasks.workunit.client.0.smithi049.stdout:4/345: truncate d4/d16/d1c/d24/f4a 967662 0 2024-06-03T00:03:02.848 INFO:tasks.workunit.client.0.smithi049.stdout:4/346: mknod d4/d16/d1c/d24/c71 0 2024-06-03T00:03:02.852 INFO:tasks.workunit.client.0.smithi049.stdout:4/347: dread d4/d16/d1c/d24/f51 [0,4194304] 0 2024-06-03T00:03:02.853 INFO:tasks.workunit.client.0.smithi049.stdout:9/400: dwrite d1/d5/d13/f4b [0,4194304] 0 2024-06-03T00:03:02.854 INFO:tasks.workunit.client.0.smithi049.stdout:5/284: write d3/d9/f28 [3478789,85395] 0 2024-06-03T00:03:02.855 INFO:tasks.workunit.client.0.smithi049.stdout:9/401: rmdir d1/d5/d1a 39 2024-06-03T00:03:02.857 INFO:tasks.workunit.client.0.smithi049.stdout:9/402: symlink d1/da/d54/l7e 0 2024-06-03T00:03:02.859 INFO:tasks.workunit.client.0.smithi049.stdout:9/403: mkdir d1/d5/d13/d3b/d7f 0 2024-06-03T00:03:02.861 INFO:tasks.workunit.client.0.smithi049.stdout:9/404: unlink d1/d5/d13/f6d 0 2024-06-03T00:03:02.868 INFO:tasks.workunit.client.0.smithi049.stdout:2/295: dwrite da/d52/f39 [0,4194304] 0 2024-06-03T00:03:02.868 INFO:tasks.workunit.client.0.smithi049.stdout:5/285: dread d3/d9/f28 [0,4194304] 0 2024-06-03T00:03:02.868 INFO:tasks.workunit.client.0.smithi049.stdout:5/286: chown d3/d9/d20/d4c/d5a 154 1 2024-06-03T00:03:02.870 INFO:tasks.workunit.client.0.smithi049.stdout:8/253: dwrite d4/d7/d28/d25/f39 [0,4194304] 0 2024-06-03T00:03:02.870 INFO:tasks.workunit.client.0.smithi049.stdout:8/254: fsync d4/d27/d30/f41 0 2024-06-03T00:03:02.870 INFO:tasks.workunit.client.0.smithi049.stdout:8/255: write d4/d7/d28/f36 [708894,24989] 0 2024-06-03T00:03:02.870 INFO:tasks.workunit.client.0.smithi049.stdout:8/256: chown d4/d7/d3a 29646 1 2024-06-03T00:03:02.871 INFO:tasks.workunit.client.0.smithi049.stdout:2/296: rename da/d52/d37/d59/f62 to da/d52/df/d3c/f66 0 2024-06-03T00:03:02.871 INFO:tasks.workunit.client.0.smithi049.stdout:2/297: chown da/d52/df/l35 97120 1 2024-06-03T00:03:02.871 INFO:tasks.workunit.client.0.smithi049.stdout:5/287: rmdir d3/d9 39 2024-06-03T00:03:02.872 INFO:tasks.workunit.client.0.smithi049.stdout:5/288: rename d3/d5/da/d55 to d3/d5/da/d55/d5d 22 2024-06-03T00:03:02.874 INFO:tasks.workunit.client.0.smithi049.stdout:4/348: dwrite d4/d16/d1c/d4f/f61 [0,4194304] 0 2024-06-03T00:03:02.875 INFO:tasks.workunit.client.0.smithi049.stdout:8/257: dread d4/d7/d28/f36 [0,4194304] 0 2024-06-03T00:03:02.878 INFO:tasks.workunit.client.0.smithi049.stdout:5/289: symlink d3/d5/da/l5e 0 2024-06-03T00:03:02.879 INFO:tasks.workunit.client.0.smithi049.stdout:9/405: dwrite d1/da/d26/f5c [0,4194304] 0 2024-06-03T00:03:02.879 INFO:tasks.workunit.client.0.smithi049.stdout:9/406: fsync d1/da/f37 0 2024-06-03T00:03:02.880 INFO:tasks.workunit.client.0.smithi049.stdout:5/290: dread d3/d5/da/d55/d14/d16/f34 [0,4194304] 0 2024-06-03T00:03:02.880 INFO:tasks.workunit.client.0.smithi049.stdout:8/258: unlink d4/d7/fc 0 2024-06-03T00:03:02.881 INFO:tasks.workunit.client.0.smithi049.stdout:2/298: truncate da/d52/df/f29 1733035 0 2024-06-03T00:03:02.883 INFO:tasks.workunit.client.0.smithi049.stdout:2/299: dread da/f1c [0,4194304] 0 2024-06-03T00:03:02.883 INFO:tasks.workunit.client.0.smithi049.stdout:2/300: write da/d52/d37/d59/f65 [589069,113108] 0 2024-06-03T00:03:02.885 INFO:tasks.workunit.client.0.smithi049.stdout:9/407: stat d1/d5/d1a/l3d 0 2024-06-03T00:03:02.886 INFO:tasks.workunit.client.0.smithi049.stdout:9/408: dread - d1/d5/f6b zero size 2024-06-03T00:03:02.886 INFO:tasks.workunit.client.0.smithi049.stdout:5/291: creat d3/d5/d24/f5f x:0 0 0 2024-06-03T00:03:02.887 INFO:tasks.workunit.client.0.smithi049.stdout:4/349: dwrite d4/d16/d1c/f25 [0,4194304] 0 2024-06-03T00:03:02.887 INFO:tasks.workunit.client.0.smithi049.stdout:8/259: mkdir d4/d7/d4d 0 2024-06-03T00:03:02.889 INFO:tasks.workunit.client.0.smithi049.stdout:5/292: dread d3/d5/da/f3e [0,4194304] 0 2024-06-03T00:03:02.889 INFO:tasks.workunit.client.0.smithi049.stdout:5/293: chown d3/d9/c52 67344894 1 2024-06-03T00:03:02.889 INFO:tasks.workunit.client.0.smithi049.stdout:5/294: read - d3/d9/d20/f41 zero size 2024-06-03T00:03:02.889 INFO:tasks.workunit.client.0.smithi049.stdout:2/301: getdents da/d52/d40/d63 0 2024-06-03T00:03:02.890 INFO:tasks.workunit.client.0.smithi049.stdout:9/409: link d1/da/c18 d1/da/c80 0 2024-06-03T00:03:02.890 INFO:tasks.workunit.client.0.smithi049.stdout:9/410: chown d1/d5/d13/l1c 518009 1 2024-06-03T00:03:02.891 INFO:tasks.workunit.client.0.smithi049.stdout:3/224: sync 2024-06-03T00:03:02.891 INFO:tasks.workunit.client.0.smithi049.stdout:3/225: chown d2/d8/f3f 38 1 2024-06-03T00:03:02.891 INFO:tasks.workunit.client.0.smithi049.stdout:3/226: chown d2/l43 1903 1 2024-06-03T00:03:02.892 INFO:tasks.workunit.client.0.smithi049.stdout:4/350: unlink d4/d16/d1c/d24/l30 0 2024-06-03T00:03:02.892 INFO:tasks.workunit.client.0.smithi049.stdout:5/295: rmdir d3/d5/da/d55/d14/d16 39 2024-06-03T00:03:02.894 INFO:tasks.workunit.client.0.smithi049.stdout:3/227: rename d2/d14/l21 to d2/d14/d22/d3a/d47/l49 0 2024-06-03T00:03:02.894 INFO:tasks.workunit.client.0.smithi049.stdout:3/228: truncate d2/d14/d22/d42/f38 1332170 0 2024-06-03T00:03:02.895 INFO:tasks.workunit.client.0.smithi049.stdout:4/351: creat d4/d16/d69/f72 x:0 0 0 2024-06-03T00:03:02.896 INFO:tasks.workunit.client.0.smithi049.stdout:0/250: sync 2024-06-03T00:03:02.896 INFO:tasks.workunit.client.0.smithi049.stdout:1/361: sync 2024-06-03T00:03:02.896 INFO:tasks.workunit.client.0.smithi049.stdout:7/305: sync 2024-06-03T00:03:02.896 INFO:tasks.workunit.client.0.smithi049.stdout:6/355: sync 2024-06-03T00:03:02.896 INFO:tasks.workunit.client.0.smithi049.stdout:6/356: fdatasync d2/d3/d9/d23/d48/f61 0 2024-06-03T00:03:02.898 INFO:tasks.workunit.client.0.smithi049.stdout:3/229: mknod d2/d14/d22/d42/c4a 0 2024-06-03T00:03:02.899 INFO:tasks.workunit.client.0.smithi049.stdout:4/352: mknod d4/d3f/d14/c73 0 2024-06-03T00:03:02.901 INFO:tasks.workunit.client.0.smithi049.stdout:7/306: dread d3/d6/d9/d37/f51 [0,4194304] 0 2024-06-03T00:03:02.901 INFO:tasks.workunit.client.0.smithi049.stdout:0/251: rmdir d6/d29/d2e 39 2024-06-03T00:03:02.902 INFO:tasks.workunit.client.0.smithi049.stdout:1/362: truncate d1/d2f/d36/f4e 86723 0 2024-06-03T00:03:02.902 INFO:tasks.workunit.client.0.smithi049.stdout:1/363: write d1/d2f/d36/d37/d2c/f60 [772816,84233] 0 2024-06-03T00:03:02.902 INFO:tasks.workunit.client.0.smithi049.stdout:3/230: mkdir d2/d26/d4b 0 2024-06-03T00:03:02.903 INFO:tasks.workunit.client.0.smithi049.stdout:4/353: creat d4/d2a/f74 x:0 0 0 2024-06-03T00:03:02.904 INFO:tasks.workunit.client.0.smithi049.stdout:7/307: creat d3/d6/d3f/f75 x:0 0 0 2024-06-03T00:03:02.905 INFO:tasks.workunit.client.0.smithi049.stdout:7/308: fsync d3/d6/d13/f38 0 2024-06-03T00:03:02.905 INFO:tasks.workunit.client.0.smithi049.stdout:7/309: chown d3/d6/d13/d4a/f2f 34 1 2024-06-03T00:03:02.908 INFO:tasks.workunit.client.0.smithi049.stdout:6/357: dread d2/d3/d9/d23/f26 [0,4194304] 0 2024-06-03T00:03:02.910 INFO:tasks.workunit.client.0.smithi049.stdout:0/252: mkdir d6/d59 0 2024-06-03T00:03:02.911 INFO:tasks.workunit.client.0.smithi049.stdout:6/358: truncate d2/d3/f38 824123 0 2024-06-03T00:03:02.912 INFO:tasks.workunit.client.0.smithi049.stdout:4/354: dread d4/f23 [0,4194304] 0 2024-06-03T00:03:02.912 INFO:tasks.workunit.client.0.smithi049.stdout:4/355: readlink d4/d16/d1c/l47 0 2024-06-03T00:03:02.912 INFO:tasks.workunit.client.0.smithi049.stdout:4/356: dread - d4/d16/d1c/d24/f42 zero size 2024-06-03T00:03:02.912 INFO:tasks.workunit.client.0.smithi049.stdout:4/357: chown d4/d16 135 1 2024-06-03T00:03:02.913 INFO:tasks.workunit.client.0.smithi049.stdout:0/253: rmdir d6/d30 39 2024-06-03T00:03:02.914 INFO:tasks.workunit.client.0.smithi049.stdout:2/302: dwrite da/d52/df/d3c/f53 [0,4194304] 0 2024-06-03T00:03:02.914 INFO:tasks.workunit.client.0.smithi049.stdout:6/359: symlink d2/d4d/l7a 0 2024-06-03T00:03:02.916 INFO:tasks.workunit.client.0.smithi049.stdout:0/254: creat d6/d30/f5a x:0 0 0 2024-06-03T00:03:02.918 INFO:tasks.workunit.client.0.smithi049.stdout:0/255: link d6/d30/f44 d6/d59/f5b 0 2024-06-03T00:03:02.920 INFO:tasks.workunit.client.0.smithi049.stdout:0/256: creat d6/d29/d2e/d52/f5c x:0 0 0 2024-06-03T00:03:02.920 INFO:tasks.workunit.client.0.smithi049.stdout:0/257: chown d6/d30/f3b 0 1 2024-06-03T00:03:02.921 INFO:tasks.workunit.client.0.smithi049.stdout:0/258: dread - d6/d29/d47/d4b/f51 zero size 2024-06-03T00:03:02.921 INFO:tasks.workunit.client.0.smithi049.stdout:5/296: dwrite d3/f3a [0,4194304] 0 2024-06-03T00:03:02.923 INFO:tasks.workunit.client.0.smithi049.stdout:3/231: rename d2/d26 to d2/d8/d4c 0 2024-06-03T00:03:02.923 INFO:tasks.workunit.client.0.smithi049.stdout:3/232: fsync d2/f15 0 2024-06-03T00:03:02.923 INFO:tasks.workunit.client.0.smithi049.stdout:3/233: read d2/d14/f24 [3452398,39818] 0 2024-06-03T00:03:02.923 INFO:tasks.workunit.client.0.smithi049.stdout:3/234: stat d2/f39 0 2024-06-03T00:03:02.924 INFO:tasks.workunit.client.0.smithi049.stdout:0/259: mknod d6/d59/c5d 0 2024-06-03T00:03:02.924 INFO:tasks.workunit.client.0.smithi049.stdout:9/411: dwrite d1/da/d26/f32 [4194304,4194304] 0 2024-06-03T00:03:02.927 INFO:tasks.workunit.client.0.smithi049.stdout:2/303: read da/d52/f39 [3824070,65836] 0 2024-06-03T00:03:02.928 INFO:tasks.workunit.client.0.smithi049.stdout:0/260: getdents d6 0 2024-06-03T00:03:02.929 INFO:tasks.workunit.client.0.smithi049.stdout:0/261: write d6/f4e [592184,41242] 0 2024-06-03T00:03:02.929 INFO:tasks.workunit.client.0.smithi049.stdout:0/262: truncate d6/d29/f54 122328 0 2024-06-03T00:03:02.930 INFO:tasks.workunit.client.0.smithi049.stdout:9/412: mkdir d1/da/d27/d30/d5f/d81 0 2024-06-03T00:03:02.936 INFO:tasks.workunit.client.0.smithi049.stdout:4/358: dwrite d4/d3f/f62 [0,4194304] 0 2024-06-03T00:03:02.936 INFO:tasks.workunit.client.0.smithi049.stdout:4/359: dread - d4/d16/d69/f72 zero size 2024-06-03T00:03:02.938 INFO:tasks.workunit.client.0.smithi049.stdout:1/364: dwrite d1/d2f/d36/d37/d2c/f60 [0,4194304] 0 2024-06-03T00:03:02.938 INFO:tasks.workunit.client.0.smithi049.stdout:1/365: readlink d1/d2f/d36/d37/d13/l48 0 2024-06-03T00:03:02.941 INFO:tasks.workunit.client.0.smithi049.stdout:6/360: dwrite d2/d3/d9/d23/d48/f61 [0,4194304] 0 2024-06-03T00:03:02.947 INFO:tasks.workunit.client.0.smithi049.stdout:2/304: dwrite da/d52/df/f27 [4194304,4194304] 0 2024-06-03T00:03:02.947 INFO:tasks.workunit.client.0.smithi049.stdout:2/305: chown f6 57917 1 2024-06-03T00:03:02.947 INFO:tasks.workunit.client.0.smithi049.stdout:2/306: readlink da/l17 0 2024-06-03T00:03:02.947 INFO:tasks.workunit.client.0.smithi049.stdout:2/307: read da/d52/df/f10 [1034205,9001] 0 2024-06-03T00:03:02.949 INFO:tasks.workunit.client.0.smithi049.stdout:5/297: dwrite d3/d5/da/d55/d14/d16/f25 [0,4194304] 0 2024-06-03T00:03:02.957 INFO:tasks.workunit.client.0.smithi049.stdout:7/310: rename d3/d6/f73 to d3/d14/f76 0 2024-06-03T00:03:02.957 INFO:tasks.workunit.client.0.smithi049.stdout:7/311: stat d3/d6/d13/d3c/d48/d4e 0 2024-06-03T00:03:02.959 INFO:tasks.workunit.client.0.smithi049.stdout:6/361: dwrite d2/d3/d9/f3d [0,4194304] 0 2024-06-03T00:03:02.963 INFO:tasks.workunit.client.0.smithi049.stdout:9/413: unlink d1/da/d54/c6f 0 2024-06-03T00:03:02.967 INFO:tasks.workunit.client.0.smithi049.stdout:9/414: write d1/f55 [1657407,74715] 0 2024-06-03T00:03:02.975 INFO:tasks.workunit.client.0.smithi049.stdout:4/360: mknod d4/d2a/c75 0 2024-06-03T00:03:02.975 INFO:tasks.workunit.client.0.smithi049.stdout:4/361: chown d4/f6c 517137 1 2024-06-03T00:03:02.982 INFO:tasks.workunit.client.0.smithi049.stdout:1/366: rmdir d1/d2f/d50 39 2024-06-03T00:03:02.990 INFO:tasks.workunit.client.0.smithi049.stdout:2/308: symlink da/d52/d37/d59/l67 0 2024-06-03T00:03:02.991 INFO:tasks.workunit.client.0.smithi049.stdout:5/298: creat d3/d5/da/d55/d14/f60 x:0 0 0 2024-06-03T00:03:02.993 INFO:tasks.workunit.client.0.smithi049.stdout:7/312: creat d3/d6/d3f/f77 x:0 0 0 2024-06-03T00:03:02.997 INFO:tasks.workunit.client.0.smithi049.stdout:6/362: link d2/d4d/c2b d2/d4d/d76/c7b 0 2024-06-03T00:03:02.998 INFO:tasks.workunit.client.0.smithi049.stdout:9/415: symlink d1/d5/l82 0 2024-06-03T00:03:02.999 INFO:tasks.workunit.client.0.smithi049.stdout:2/309: dread f6 [4194304,4194304] 0 2024-06-03T00:03:02.999 INFO:tasks.workunit.client.0.smithi049.stdout:4/362: mkdir d4/d2a/d76 0 2024-06-03T00:03:03.003 INFO:tasks.workunit.client.0.smithi049.stdout:5/299: symlink d3/d53/l61 0 2024-06-03T00:03:03.003 INFO:tasks.workunit.client.0.smithi049.stdout:5/300: fdatasync d3/d5/da/d55/d14/d16/f2c 0 2024-06-03T00:03:03.005 INFO:tasks.workunit.client.0.smithi049.stdout:9/416: write d1/da/d27/f3c [1554798,74107] 0 2024-06-03T00:03:03.005 INFO:tasks.workunit.client.0.smithi049.stdout:9/417: fsync d1/da/d26/f5c 0 2024-06-03T00:03:03.005 INFO:tasks.workunit.client.0.smithi049.stdout:6/363: symlink d2/d3/d9/d23/d29/l7c 0 2024-06-03T00:03:03.007 INFO:tasks.workunit.client.0.smithi049.stdout:2/310: stat da/l28 0 2024-06-03T00:03:03.009 INFO:tasks.workunit.client.0.smithi049.stdout:5/301: mkdir d3/d5/d2d/d4b/d62 0 2024-06-03T00:03:03.012 INFO:tasks.workunit.client.0.smithi049.stdout:9/418: link d1/d5/f24 d1/da/d54/d5b/f83 0 2024-06-03T00:03:03.013 INFO:tasks.workunit.client.0.smithi049.stdout:6/364: creat d2/d3/d9/d40/f7d x:0 0 0 2024-06-03T00:03:03.013 INFO:tasks.workunit.client.0.smithi049.stdout:2/311: symlink da/d52/d37/l68 0 2024-06-03T00:03:03.015 INFO:tasks.workunit.client.0.smithi049.stdout:5/302: rename d3/d5/da/d55/d14/l37 to d3/d5/d2d/d4b/l63 0 2024-06-03T00:03:03.015 INFO:tasks.workunit.client.0.smithi049.stdout:5/303: readlink d3/d5/l10 0 2024-06-03T00:03:03.016 INFO:tasks.workunit.client.0.smithi049.stdout:9/419: link d1/da/c80 d1/da/d27/d30/d5f/d81/c84 0 2024-06-03T00:03:03.017 INFO:tasks.workunit.client.0.smithi049.stdout:7/313: dwrite d3/d6/f5e [0,4194304] 0 2024-06-03T00:03:03.017 INFO:tasks.workunit.client.0.smithi049.stdout:4/363: dwrite d4/ff [0,4194304] 0 2024-06-03T00:03:03.022 INFO:tasks.workunit.client.0.smithi049.stdout:6/365: symlink d2/d3/d9/d40/l7e 0 2024-06-03T00:03:03.022 INFO:tasks.workunit.client.0.smithi049.stdout:2/312: symlink da/d43/l69 0 2024-06-03T00:03:03.024 INFO:tasks.workunit.client.0.smithi049.stdout:9/420: mknod d1/d5/d13/d6a/c85 0 2024-06-03T00:03:03.024 INFO:tasks.workunit.client.0.smithi049.stdout:9/421: readlink d1/d5/d13/d66/l69 0 2024-06-03T00:03:03.028 INFO:tasks.workunit.client.0.smithi049.stdout:7/314: link d3/d14/l44 d3/d6/d13/d3c/d4b/d5a/l78 0 2024-06-03T00:03:03.028 INFO:tasks.workunit.client.0.smithi049.stdout:7/315: getdents d3/d14/d6e 0 2024-06-03T00:03:03.029 INFO:tasks.workunit.client.0.smithi049.stdout:7/316: read d3/d6/d3f/f59 [1744691,71585] 0 2024-06-03T00:03:03.030 INFO:tasks.workunit.client.0.smithi049.stdout:6/366: symlink d2/d3/d9/l7f 0 2024-06-03T00:03:03.032 INFO:tasks.workunit.client.0.smithi049.stdout:5/304: dwrite d3/d5/f4d [0,4194304] 0 2024-06-03T00:03:03.032 INFO:tasks.workunit.client.0.smithi049.stdout:2/313: symlink da/d52/df/d3c/l6a 0 2024-06-03T00:03:03.032 INFO:tasks.workunit.client.0.smithi049.stdout:2/314: chown da/d52/d40/f51 506206 1 2024-06-03T00:03:03.036 INFO:tasks.workunit.client.0.smithi049.stdout:2/315: mknod da/d52/d49/c6b 0 2024-06-03T00:03:03.036 INFO:tasks.workunit.client.0.smithi049.stdout:2/316: readlink da/l28 0 2024-06-03T00:03:03.040 INFO:tasks.workunit.client.0.smithi049.stdout:2/317: rename da/d52/df/f27 to da/d52/d49/f6c 0 2024-06-03T00:03:03.040 INFO:tasks.workunit.client.0.smithi049.stdout:2/318: fdatasync da/d52/d40/f4d 0 2024-06-03T00:03:03.040 INFO:tasks.workunit.client.0.smithi049.stdout:2/319: rmdir da/d52/d40/d63 39 2024-06-03T00:03:03.043 INFO:tasks.workunit.client.0.smithi049.stdout:2/320: mknod da/d43/c6d 0 2024-06-03T00:03:03.046 INFO:tasks.workunit.client.0.smithi049.stdout:9/422: dwrite d1/da/d27/d30/f34 [0,4194304] 0 2024-06-03T00:03:03.046 INFO:tasks.workunit.client.0.smithi049.stdout:2/321: unlink da/d52/d37/d59/f65 0 2024-06-03T00:03:03.049 INFO:tasks.workunit.client.0.smithi049.stdout:9/423: creat d1/da/f86 x:0 0 0 2024-06-03T00:03:03.049 INFO:tasks.workunit.client.0.smithi049.stdout:9/424: fdatasync d1/f8 0 2024-06-03T00:03:03.049 INFO:tasks.workunit.client.0.smithi049.stdout:0/263: truncate d6/f4e 464275 0 2024-06-03T00:03:03.051 INFO:tasks.workunit.client.0.smithi049.stdout:2/322: unlink da/d52/df/d3c/l3f 0 2024-06-03T00:03:03.051 INFO:tasks.workunit.client.0.smithi049.stdout:7/317: dwrite d3/d6/d3f/f59 [0,4194304] 0 2024-06-03T00:03:03.051 INFO:tasks.workunit.client.0.smithi049.stdout:0/264: creat d6/d56/f5e x:0 0 0 2024-06-03T00:03:03.052 INFO:tasks.workunit.client.0.smithi049.stdout:2/323: rmdir da/d52/df 39 2024-06-03T00:03:03.057 INFO:tasks.workunit.client.0.smithi049.stdout:7/318: unlink d3/d6/f12 0 2024-06-03T00:03:03.057 INFO:tasks.workunit.client.0.smithi049.stdout:5/305: dwrite d3/d5/d2d/f40 [0,4194304] 0 2024-06-03T00:03:03.057 INFO:tasks.workunit.client.0.smithi049.stdout:5/306: truncate d3/d9/d20/f2e 1357974 0 2024-06-03T00:03:03.058 INFO:tasks.workunit.client.0.smithi049.stdout:6/367: dwrite d2/d3/d17/f62 [0,4194304] 0 2024-06-03T00:03:03.059 INFO:tasks.workunit.client.0.smithi049.stdout:2/324: creat da/d52/d40/f6e x:0 0 0 2024-06-03T00:03:03.065 INFO:tasks.workunit.client.0.smithi049.stdout:2/325: creat da/d52/f6f x:0 0 0 2024-06-03T00:03:03.065 INFO:tasks.workunit.client.0.smithi049.stdout:2/326: readlink da/d52/d37/l3d 0 2024-06-03T00:03:03.070 INFO:tasks.workunit.client.0.smithi049.stdout:2/327: mkdir da/d52/d37/d70 0 2024-06-03T00:03:03.070 INFO:tasks.workunit.client.0.smithi049.stdout:2/328: readlink da/d52/d37/l68 0 2024-06-03T00:03:03.071 INFO:tasks.workunit.client.0.smithi049.stdout:9/425: dwrite d1/da/d26/f32 [8388608,4194304] 0 2024-06-03T00:03:03.071 INFO:tasks.workunit.client.0.smithi049.stdout:2/329: truncate da/d52/f13 1692885 0 2024-06-03T00:03:03.072 INFO:tasks.workunit.client.0.smithi049.stdout:0/265: dwrite d6/d30/d32/f40 [0,4194304] 0 2024-06-03T00:03:03.072 INFO:tasks.workunit.client.0.smithi049.stdout:0/266: write d6/d29/d2e/f1f [1538265,44997] 0 2024-06-03T00:03:03.074 INFO:tasks.workunit.client.0.smithi049.stdout:9/426: mkdir d1/d5/d13/d66/d87 0 2024-06-03T00:03:03.074 INFO:tasks.workunit.client.0.smithi049.stdout:9/427: truncate d1/da/d54/f76 852456 0 2024-06-03T00:03:03.077 INFO:tasks.workunit.client.0.smithi049.stdout:2/330: creat da/d52/d37/d70/f71 x:0 0 0 2024-06-03T00:03:03.078 INFO:tasks.workunit.client.0.smithi049.stdout:9/428: mkdir d1/d5/d88 0 2024-06-03T00:03:03.079 INFO:tasks.workunit.client.0.smithi049.stdout:9/429: fdatasync d1/da/d27/f75 0 2024-06-03T00:03:03.079 INFO:tasks.workunit.client.0.smithi049.stdout:9/430: fsync d1/da/d26/f43 0 2024-06-03T00:03:03.080 INFO:tasks.workunit.client.0.smithi049.stdout:9/431: mknod d1/c89 0 2024-06-03T00:03:03.080 INFO:tasks.workunit.client.0.smithi049.stdout:9/432: chown d1/da/d26 149 1 2024-06-03T00:03:03.080 INFO:tasks.workunit.client.0.smithi049.stdout:9/433: write d1/d5/d13/d3b/f48 [3426662,94462] 0 2024-06-03T00:03:03.080 INFO:tasks.workunit.client.0.smithi049.stdout:9/434: read d1/d5/d1a/f51 [198708,50304] 0 2024-06-03T00:03:03.085 INFO:tasks.workunit.client.0.smithi049.stdout:5/307: dwrite d3/d5/d2d/d4b/f59 [0,4194304] 0 2024-06-03T00:03:03.085 INFO:tasks.workunit.client.0.smithi049.stdout:6/368: dwrite d2/d3/d9/d40/f7d [0,4194304] 0 2024-06-03T00:03:03.091 INFO:tasks.workunit.client.0.smithi049.stdout:6/369: symlink d2/d3/d9/d40/l80 0 2024-06-03T00:03:03.097 INFO:tasks.workunit.client.0.smithi049.stdout:9/435: dwrite d1/da/f3f [0,4194304] 0 2024-06-03T00:03:03.099 INFO:tasks.workunit.client.0.smithi049.stdout:5/308: dwrite d3/d5/d2d/f36 [0,4194304] 0 2024-06-03T00:03:03.108 INFO:tasks.workunit.client.0.smithi049.stdout:6/370: dwrite d2/d3/d9/d23/d29/f32 [0,4194304] 0 2024-06-03T00:03:03.109 INFO:tasks.workunit.client.0.smithi049.stdout:6/371: symlink d2/d3/d9/d23/d29/d30/l81 0 2024-06-03T00:03:03.110 INFO:tasks.workunit.client.0.smithi049.stdout:6/372: chown d2/d3/l34 39383716 1 2024-06-03T00:03:03.111 INFO:tasks.workunit.client.0.smithi049.stdout:6/373: creat d2/d3/d9/d23/f82 x:0 0 0 2024-06-03T00:03:03.112 INFO:tasks.workunit.client.0.smithi049.stdout:6/374: truncate d2/d3/d17/f46 6880560 0 2024-06-03T00:03:03.115 INFO:tasks.workunit.client.0.smithi049.stdout:6/375: unlink d2/d3/d9/f25 0 2024-06-03T00:03:03.117 INFO:tasks.workunit.client.0.smithi049.stdout:6/376: link d2/f11 d2/d3/d9/d23/d48/d51/f83 0 2024-06-03T00:03:03.123 INFO:tasks.workunit.client.0.smithi049.stdout:5/309: dwrite d3/d5/da/d55/d14/f47 [0,4194304] 0 2024-06-03T00:03:03.134 INFO:tasks.workunit.client.0.smithi049.stdout:5/310: mknod d3/d5/d2d/d4b/d62/c64 0 2024-06-03T00:03:03.143 INFO:tasks.workunit.client.0.smithi049.stdout:4/364: symlink d4/l77 0 2024-06-03T00:03:03.144 INFO:tasks.workunit.client.0.smithi049.stdout:5/311: dread d3/d5/da/f2b [0,4194304] 0 2024-06-03T00:03:03.144 INFO:tasks.workunit.client.0.smithi049.stdout:4/365: creat d4/d3f/d14/d15/f78 x:0 0 0 2024-06-03T00:03:03.150 INFO:tasks.workunit.client.0.smithi049.stdout:5/312: dread d3/d5/da/d55/d14/f29 [0,4194304] 0 2024-06-03T00:03:03.150 INFO:tasks.workunit.client.0.smithi049.stdout:5/313: readlink d3/d5/da/d55/d14/d16/l45 0 2024-06-03T00:03:03.155 INFO:tasks.workunit.client.0.smithi049.stdout:5/314: mkdir d3/d9/d20/d4c/d5a/d65 0 2024-06-03T00:03:03.157 INFO:tasks.workunit.client.0.smithi049.stdout:6/377: truncate d2/d3/d9/f54 6552337 0 2024-06-03T00:03:03.157 INFO:tasks.workunit.client.0.smithi049.stdout:6/378: truncate d2/d3/d9/d23/d29/d30/f6d 228041 0 2024-06-03T00:03:03.158 INFO:tasks.workunit.client.0.smithi049.stdout:6/379: symlink d2/d3/l84 0 2024-06-03T00:03:03.158 INFO:tasks.workunit.client.0.smithi049.stdout:6/380: write d2/d3/d9/d23/d48/f70 [528508,5777] 0 2024-06-03T00:03:03.158 INFO:tasks.workunit.client.0.smithi049.stdout:6/381: fsync d2/d3/d9/d23/f1e 0 2024-06-03T00:03:03.161 INFO:tasks.workunit.client.0.smithi049.stdout:6/382: write d2/f11 [392994,100403] 0 2024-06-03T00:03:03.163 INFO:tasks.workunit.client.0.smithi049.stdout:5/315: read d3/d5/da/f27 [3535292,81816] 0 2024-06-03T00:03:03.163 INFO:tasks.workunit.client.0.smithi049.stdout:6/383: getdents d2/d3/d9/d23/d36 0 2024-06-03T00:03:03.164 INFO:tasks.workunit.client.0.smithi049.stdout:5/316: creat d3/f66 x:0 0 0 2024-06-03T00:03:03.165 INFO:tasks.workunit.client.0.smithi049.stdout:6/384: creat d2/d3/d9/d23/d48/d53/f85 x:0 0 0 2024-06-03T00:03:03.172 INFO:tasks.workunit.client.0.smithi049.stdout:6/385: getdents d2/d3/d9/d23/d48/d53 0 2024-06-03T00:03:03.174 INFO:tasks.workunit.client.0.smithi049.stdout:6/386: mknod d2/d3b/c86 0 2024-06-03T00:03:03.174 INFO:tasks.workunit.client.0.smithi049.stdout:6/387: dread - d2/d3/d9/d23/f82 zero size 2024-06-03T00:03:03.176 INFO:tasks.workunit.client.0.smithi049.stdout:6/388: unlink d2/d3/d9/d23/d29/d30/f5a 0 2024-06-03T00:03:03.176 INFO:tasks.workunit.client.0.smithi049.stdout:6/389: chown d2/d3/d17/f73 12 1 2024-06-03T00:03:03.178 INFO:tasks.workunit.client.0.smithi049.stdout:6/390: stat d2/d3/d9/c6f 0 2024-06-03T00:03:03.181 INFO:tasks.workunit.client.0.smithi049.stdout:5/317: dwrite d3/f3a [0,4194304] 0 2024-06-03T00:03:03.185 INFO:tasks.workunit.client.0.smithi049.stdout:6/391: dread d2/d3/d17/f62 [0,4194304] 0 2024-06-03T00:03:03.190 INFO:tasks.workunit.client.0.smithi049.stdout:5/318: dread d3/d5/d2d/f40 [0,4194304] 0 2024-06-03T00:03:03.192 INFO:tasks.workunit.client.0.smithi049.stdout:5/319: rename d3/d5/da/d55/f21 to d3/d5/da/f67 0 2024-06-03T00:03:03.194 INFO:tasks.workunit.client.0.smithi049.stdout:5/320: mkdir d3/d9/d68 0 2024-06-03T00:03:03.195 INFO:tasks.workunit.client.0.smithi049.stdout:5/321: creat d3/d9/d20/d4c/d5a/d65/f69 x:0 0 0 2024-06-03T00:03:03.196 INFO:tasks.workunit.client.0.smithi049.stdout:5/322: creat d3/d9/d20/d4c/f6a x:0 0 0 2024-06-03T00:03:03.198 INFO:tasks.workunit.client.0.smithi049.stdout:5/323: mknod d3/d5/d2d/d4b/d62/c6b 0 2024-06-03T00:03:03.198 INFO:tasks.workunit.client.0.smithi049.stdout:5/324: chown d3/d5/da/d55/d14/d16/c1a 71657211 1 2024-06-03T00:03:03.199 INFO:tasks.workunit.client.0.smithi049.stdout:5/325: truncate d3/d9/f13 2091570 0 2024-06-03T00:03:03.200 INFO:tasks.workunit.client.0.smithi049.stdout:5/326: creat d3/d5/d2d/d4b/d51/f6c x:0 0 0 2024-06-03T00:03:03.200 INFO:tasks.workunit.client.0.smithi049.stdout:5/327: write d3/d5/d2d/f36 [4907617,130120] 0 2024-06-03T00:03:03.205 INFO:tasks.workunit.client.0.smithi049.stdout:6/392: dwrite d2/d3/d9/d23/f26 [0,4194304] 0 2024-06-03T00:03:03.210 INFO:tasks.workunit.client.0.smithi049.stdout:5/328: write d3/d5/da/d55/d14/f47 [252751,94247] 0 2024-06-03T00:03:03.210 INFO:tasks.workunit.client.0.smithi049.stdout:5/329: dread - d3/d5/d2d/d4b/d51/f6c zero size 2024-06-03T00:03:03.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:03 smithi049 ceph-mon[32302]: pgmap v473: 97 pgs: 97 active+clean; 136 MiB data, 822 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 11 MiB/s wr, 1.55k op/s 2024-06-03T00:03:03.215 INFO:tasks.workunit.client.0.smithi049.stdout:6/393: truncate d2/d3/d9/d23/d29/f59 3236325 0 2024-06-03T00:03:03.219 INFO:tasks.workunit.client.0.smithi049.stdout:6/394: creat d2/d3/d9/d40/f87 x:0 0 0 2024-06-03T00:03:03.219 INFO:tasks.workunit.client.0.smithi049.stdout:6/395: chown d2/d3/d9/f3d 25987 1 2024-06-03T00:03:03.221 INFO:tasks.workunit.client.0.smithi049.stdout:5/330: write d3/d5/da/f44 [651498,62348] 0 2024-06-03T00:03:03.221 INFO:tasks.workunit.client.0.smithi049.stdout:5/331: write d3/d5/da/d55/d14/d16/f25 [5201295,14388] 0 2024-06-03T00:03:03.221 INFO:tasks.workunit.client.0.smithi049.stdout:6/396: mkdir d2/d3/d17/d57/d6e/d88 0 2024-06-03T00:03:03.224 INFO:tasks.workunit.client.0.smithi049.stdout:6/397: mkdir d2/d3/d9/d23/d48/d89 0 2024-06-03T00:03:03.227 INFO:tasks.workunit.client.0.smithi049.stdout:6/398: getdents d2/d4d/d76 0 2024-06-03T00:03:03.229 INFO:tasks.workunit.client.0.smithi049.stdout:6/399: creat d2/d4d/f8a x:0 0 0 2024-06-03T00:03:03.231 INFO:tasks.workunit.client.0.smithi049.stdout:5/332: dread d3/d5/da/f67 [0,4194304] 0 2024-06-03T00:03:03.231 INFO:tasks.workunit.client.0.smithi049.stdout:6/400: mknod d2/d3/c8b 0 2024-06-03T00:03:03.235 INFO:tasks.workunit.client.0.smithi049.stdout:5/333: rename d3/d5/da/f3e to d3/d5/d2d/d4b/d62/f6d 0 2024-06-03T00:03:03.235 INFO:tasks.workunit.client.0.smithi049.stdout:5/334: chown d3/d9/d20/d4c 15 1 2024-06-03T00:03:03.241 INFO:tasks.workunit.client.0.smithi049.stdout:6/401: rename d2/d4d/f31 to d2/d3/d17/d57/f8c 0 2024-06-03T00:03:03.241 INFO:tasks.workunit.client.0.smithi049.stdout:6/402: chown d2/d3/d17/f6b 58085 1 2024-06-03T00:03:03.241 INFO:tasks.workunit.client.0.smithi049.stdout:6/403: chown d2/d3/d9/d23/d36 30568937 1 2024-06-03T00:03:03.242 INFO:tasks.workunit.client.0.smithi049.stdout:6/404: mknod d2/d3/d17/d57/d6e/c8d 0 2024-06-03T00:03:03.242 INFO:tasks.workunit.client.0.smithi049.stdout:6/405: getdents d2/d3/d9/d23/d48/d53 0 2024-06-03T00:03:03.243 INFO:tasks.workunit.client.0.smithi049.stdout:6/406: truncate d2/d3/d9/d23/d48/f61 4020196 0 2024-06-03T00:03:03.245 INFO:tasks.workunit.client.0.smithi049.stdout:6/407: mknod d2/d3/d17/d57/c8e 0 2024-06-03T00:03:03.249 INFO:tasks.workunit.client.0.smithi049.stdout:5/335: dwrite d3/d5/da/d55/d14/d16/f2c [0,4194304] 0 2024-06-03T00:03:03.270 INFO:tasks.workunit.client.0.smithi049.stdout:8/260: sync 2024-06-03T00:03:03.270 INFO:tasks.workunit.client.0.smithi049.stdout:3/235: sync 2024-06-03T00:03:03.270 INFO:tasks.workunit.client.0.smithi049.stdout:3/236: readlink d2/d14/d22/l40 0 2024-06-03T00:03:03.270 INFO:tasks.workunit.client.0.smithi049.stdout:5/336: dwrite d3/d5/da/f44 [0,4194304] 0 2024-06-03T00:03:03.271 INFO:tasks.workunit.client.0.smithi049.stdout:6/408: dwrite d2/d3/d9/f3d [0,4194304] 0 2024-06-03T00:03:03.272 INFO:tasks.workunit.client.0.smithi049.stdout:3/237: dread d2/d14/d22/d42/f38 [0,4194304] 0 2024-06-03T00:03:03.277 INFO:tasks.workunit.client.0.smithi049.stdout:5/337: write d3/d5/da/f2b [3104885,97297] 0 2024-06-03T00:03:03.278 INFO:tasks.workunit.client.0.smithi049.stdout:5/338: write d3/f66 [599234,54442] 0 2024-06-03T00:03:03.283 INFO:tasks.workunit.client.0.smithi049.stdout:8/261: dwrite d4/d7/d28/f36 [0,4194304] 0 2024-06-03T00:03:03.287 INFO:tasks.workunit.client.0.smithi049.stdout:5/339: write d3/d5/d2d/d4b/f59 [2067769,6551] 0 2024-06-03T00:03:03.288 INFO:tasks.workunit.client.0.smithi049.stdout:3/238: mknod d2/d14/c4d 0 2024-06-03T00:03:03.290 INFO:tasks.workunit.client.0.smithi049.stdout:8/262: symlink d4/d7/d4d/l4e 0 2024-06-03T00:03:03.290 INFO:tasks.workunit.client.0.smithi049.stdout:8/263: fdatasync d4/d7/f18 0 2024-06-03T00:03:03.292 INFO:tasks.workunit.client.0.smithi049.stdout:8/264: dread d4/d7/f1e [0,4194304] 0 2024-06-03T00:03:03.293 INFO:tasks.workunit.client.0.smithi049.stdout:8/265: fdatasync d4/d7/f1a 0 2024-06-03T00:03:03.293 INFO:tasks.workunit.client.0.smithi049.stdout:5/340: truncate d3/d5/da/d55/d14/f29 1489874 0 2024-06-03T00:03:03.293 INFO:tasks.workunit.client.0.smithi049.stdout:5/341: fsync d3/d9/d20/f41 0 2024-06-03T00:03:03.293 INFO:tasks.workunit.client.0.smithi049.stdout:3/239: mknod d2/d8/d4c/c4e 0 2024-06-03T00:03:03.295 INFO:tasks.workunit.client.0.smithi049.stdout:8/266: unlink d4/d7/f16 0 2024-06-03T00:03:03.296 INFO:tasks.workunit.client.0.smithi049.stdout:5/342: mknod d3/d5/d2d/d4b/d51/c6e 0 2024-06-03T00:03:03.297 INFO:tasks.workunit.client.0.smithi049.stdout:3/240: creat d2/d1a/d34/f4f x:0 0 0 2024-06-03T00:03:03.299 INFO:tasks.workunit.client.0.smithi049.stdout:3/241: write d2/f39 [6889,14007] 0 2024-06-03T00:03:03.300 INFO:tasks.workunit.client.0.smithi049.stdout:8/267: mkdir d4/d27/d30/d4f 0 2024-06-03T00:03:03.300 INFO:tasks.workunit.client.0.smithi049.stdout:8/268: fdatasync d4/d27/d3c/f2f 0 2024-06-03T00:03:03.301 INFO:tasks.workunit.client.0.smithi049.stdout:5/343: write d3/d5/da/d55/d14/f29 [422067,27040] 0 2024-06-03T00:03:03.301 INFO:tasks.workunit.client.0.smithi049.stdout:5/344: write d3/d5/da/d55/d14/f57 [306097,73810] 0 2024-06-03T00:03:03.304 INFO:tasks.workunit.client.0.smithi049.stdout:3/242: mknod d2/d14/d44/c50 0 2024-06-03T00:03:03.304 INFO:tasks.workunit.client.0.smithi049.stdout:3/243: write d2/d1a/f20 [995835,56560] 0 2024-06-03T00:03:03.306 INFO:tasks.workunit.client.0.smithi049.stdout:8/269: symlink d4/d7/d48/l50 0 2024-06-03T00:03:03.306 INFO:tasks.workunit.client.0.smithi049.stdout:8/270: write d4/f17 [1889961,81011] 0 2024-06-03T00:03:03.306 INFO:tasks.workunit.client.0.smithi049.stdout:8/271: truncate d4/d7/d28/d45/f49 626911 0 2024-06-03T00:03:03.306 INFO:tasks.workunit.client.0.smithi049.stdout:8/272: read d4/d7/f11 [1908683,60174] 0 2024-06-03T00:03:03.306 INFO:tasks.workunit.client.0.smithi049.stdout:8/273: write d4/d7/f1a [7746508,122841] 0 2024-06-03T00:03:03.306 INFO:tasks.workunit.client.0.smithi049.stdout:8/274: chown d4/d27/d3c/d43 1036 1 2024-06-03T00:03:03.307 INFO:tasks.workunit.client.0.smithi049.stdout:5/345: mkdir d3/d9/d20/d4c/d5a/d6f 0 2024-06-03T00:03:03.307 INFO:tasks.workunit.client.0.smithi049.stdout:5/346: write d3/d5/da/d55/d14/f19 [4552193,58369] 0 2024-06-03T00:03:03.307 INFO:tasks.workunit.client.0.smithi049.stdout:5/347: write d3/d9/d20/f3d [929164,41318] 0 2024-06-03T00:03:03.307 INFO:tasks.workunit.client.0.smithi049.stdout:5/348: chown d3/d9/lf 2036043 1 2024-06-03T00:03:03.308 INFO:tasks.workunit.client.0.smithi049.stdout:3/244: unlink d2/d14/d22/d3a/f3e 0 2024-06-03T00:03:03.314 INFO:tasks.workunit.client.0.smithi049.stdout:8/275: symlink d4/d7/d28/l51 0 2024-06-03T00:03:03.314 INFO:tasks.workunit.client.0.smithi049.stdout:8/276: truncate d4/d7/f22 1526329 0 2024-06-03T00:03:03.315 INFO:tasks.workunit.client.0.smithi049.stdout:5/349: creat d3/d9/d68/f70 x:0 0 0 2024-06-03T00:03:03.329 INFO:tasks.workunit.client.0.smithi049.stdout:8/277: dwrite d4/d27/f4b [0,4194304] 0 2024-06-03T00:03:03.348 INFO:tasks.workunit.client.0.smithi049.stdout:5/350: creat d3/d9/d20/d4c/d5a/d65/f71 x:0 0 0 2024-06-03T00:03:03.349 INFO:tasks.workunit.client.0.smithi049.stdout:8/278: mkdir d4/d7/d28/d52 0 2024-06-03T00:03:03.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:03 smithi107 ceph-mon[37048]: pgmap v473: 97 pgs: 97 active+clean; 136 MiB data, 822 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 11 MiB/s wr, 1.55k op/s 2024-06-03T00:03:03.350 INFO:tasks.workunit.client.0.smithi049.stdout:6/409: dwrite d2/d3/d9/f3d [0,4194304] 0 2024-06-03T00:03:03.351 INFO:tasks.workunit.client.0.smithi049.stdout:5/351: chown d3/d5/d2d/d4b/d62/c6b 18 1 2024-06-03T00:03:03.351 INFO:tasks.workunit.client.0.smithi049.stdout:5/352: stat d3/d9/d20/d4c 0 2024-06-03T00:03:03.352 INFO:tasks.workunit.client.0.smithi049.stdout:6/410: symlink d2/d3/d17/l8f 0 2024-06-03T00:03:03.352 INFO:tasks.workunit.client.0.smithi049.stdout:6/411: symlink d2/d3/d9/d55/l90 0 2024-06-03T00:03:03.353 INFO:tasks.workunit.client.0.smithi049.stdout:6/412: truncate d2/d3/d9/f27 387146 0 2024-06-03T00:03:03.353 INFO:tasks.workunit.client.0.smithi049.stdout:6/413: chown d2/d3/l84 1 1 2024-06-03T00:03:03.355 INFO:tasks.workunit.client.0.smithi049.stdout:6/414: dread d2/d4d/f74 [0,4194304] 0 2024-06-03T00:03:03.355 INFO:tasks.workunit.client.0.smithi049.stdout:6/415: fdatasync d2/d3/d9/f27 0 2024-06-03T00:03:03.355 INFO:tasks.workunit.client.0.smithi049.stdout:2/331: sync 2024-06-03T00:03:03.355 INFO:tasks.workunit.client.0.smithi049.stdout:9/436: sync 2024-06-03T00:03:03.355 INFO:tasks.workunit.client.0.smithi049.stdout:1/367: sync 2024-06-03T00:03:03.355 INFO:tasks.workunit.client.0.smithi049.stdout:4/366: sync 2024-06-03T00:03:03.355 INFO:tasks.workunit.client.0.smithi049.stdout:7/319: sync 2024-06-03T00:03:03.355 INFO:tasks.workunit.client.0.smithi049.stdout:0/267: sync 2024-06-03T00:03:03.356 INFO:tasks.workunit.client.0.smithi049.stdout:6/416: mknod d2/d3/d9/d40/c91 0 2024-06-03T00:03:03.357 INFO:tasks.workunit.client.0.smithi049.stdout:0/268: write d6/f4e [1293370,127406] 0 2024-06-03T00:03:03.357 INFO:tasks.workunit.client.0.smithi049.stdout:4/367: creat d4/d3f/f79 x:0 0 0 2024-06-03T00:03:03.359 INFO:tasks.workunit.client.0.smithi049.stdout:2/332: unlink da/d52/d40/f4d 0 2024-06-03T00:03:03.359 INFO:tasks.workunit.client.0.smithi049.stdout:2/333: stat da/f45 0 2024-06-03T00:03:03.359 INFO:tasks.workunit.client.0.smithi049.stdout:9/437: truncate d1/d5/d13/d3b/f65 906248 0 2024-06-03T00:03:03.360 INFO:tasks.workunit.client.0.smithi049.stdout:6/417: creat d2/d3/d9/d23/d48/f92 x:0 0 0 2024-06-03T00:03:03.360 INFO:tasks.workunit.client.0.smithi049.stdout:6/418: read - d2/d3/d9/d40/f87 zero size 2024-06-03T00:03:03.361 INFO:tasks.workunit.client.0.smithi049.stdout:6/419: write d2/d4d/f58 [1240027,27742] 0 2024-06-03T00:03:03.361 INFO:tasks.workunit.client.0.smithi049.stdout:6/420: chown d2/d3/d9/d23/d48/d53/f85 40988484 1 2024-06-03T00:03:03.361 INFO:tasks.workunit.client.0.smithi049.stdout:6/421: chown d2/d3/d9/f71 1740 1 2024-06-03T00:03:03.361 INFO:tasks.workunit.client.0.smithi049.stdout:6/422: write d2/d3/f60 [57060,50330] 0 2024-06-03T00:03:03.361 INFO:tasks.workunit.client.0.smithi049.stdout:6/423: fdatasync d2/d3/d17/f46 0 2024-06-03T00:03:03.362 INFO:tasks.workunit.client.0.smithi049.stdout:1/368: creat d1/d2f/d36/d37/d2c/d45/d61/d70/f85 x:0 0 0 2024-06-03T00:03:03.363 INFO:tasks.workunit.client.0.smithi049.stdout:1/369: chown d1/d2f/d36/d37/d13/d71 27268 1 2024-06-03T00:03:03.363 INFO:tasks.workunit.client.0.smithi049.stdout:1/370: chown d1/d2f/d36/d37/d2c/d45/d61 64875618 1 2024-06-03T00:03:03.363 INFO:tasks.workunit.client.0.smithi049.stdout:0/269: creat d6/d29/f5f x:0 0 0 2024-06-03T00:03:03.363 INFO:tasks.workunit.client.0.smithi049.stdout:0/270: truncate d6/d29/d47/d4b/f51 679970 0 2024-06-03T00:03:03.363 INFO:tasks.workunit.client.0.smithi049.stdout:1/371: read d1/d2f/d36/d37/d13/f47 [80119,56479] 0 2024-06-03T00:03:03.363 INFO:tasks.workunit.client.0.smithi049.stdout:4/368: getdents d4 0 2024-06-03T00:03:03.365 INFO:tasks.workunit.client.0.smithi049.stdout:2/334: mkdir da/d72 0 2024-06-03T00:03:03.365 INFO:tasks.workunit.client.0.smithi049.stdout:2/335: chown da/d52/d40 25 1 2024-06-03T00:03:03.367 INFO:tasks.workunit.client.0.smithi049.stdout:9/438: unlink d1/d5/d13/f39 0 2024-06-03T00:03:03.368 INFO:tasks.workunit.client.0.smithi049.stdout:4/369: dread d4/d3f/d14/d15/f18 [0,4194304] 0 2024-06-03T00:03:03.368 INFO:tasks.workunit.client.0.smithi049.stdout:4/370: dread - d4/d3f/d14/d15/f78 zero size 2024-06-03T00:03:03.368 INFO:tasks.workunit.client.0.smithi049.stdout:4/371: read - d4/d16/f67 zero size 2024-06-03T00:03:03.369 INFO:tasks.workunit.client.0.smithi049.stdout:2/336: getdents da/d52/d40 0 2024-06-03T00:03:03.370 INFO:tasks.workunit.client.0.smithi049.stdout:2/337: chown da/d52/d40/d63/c46 1833 1 2024-06-03T00:03:03.370 INFO:tasks.workunit.client.0.smithi049.stdout:7/320: write d3/d6/f25 [4019796,117072] 0 2024-06-03T00:03:03.371 INFO:tasks.workunit.client.0.smithi049.stdout:0/271: dread d6/d29/d2e/f2a [0,4194304] 0 2024-06-03T00:03:03.373 INFO:tasks.workunit.client.0.smithi049.stdout:7/321: mkdir d3/d6/d13/d79 0 2024-06-03T00:03:03.375 INFO:tasks.workunit.client.0.smithi049.stdout:0/272: dread d6/d29/d2e/f2b [0,4194304] 0 2024-06-03T00:03:03.375 INFO:tasks.workunit.client.0.smithi049.stdout:7/322: creat d3/d6/d13/d3c/d4b/f7a x:0 0 0 2024-06-03T00:03:03.377 INFO:tasks.workunit.client.0.smithi049.stdout:7/323: unlink d3/d6/c3e 0 2024-06-03T00:03:03.378 INFO:tasks.workunit.client.0.smithi049.stdout:0/273: mknod d6/d30/c60 0 2024-06-03T00:03:03.378 INFO:tasks.workunit.client.0.smithi049.stdout:2/338: dread da/d52/f33 [0,4194304] 0 2024-06-03T00:03:03.378 INFO:tasks.workunit.client.0.smithi049.stdout:2/339: stat da/d52/d40/d63/l54 0 2024-06-03T00:03:03.380 INFO:tasks.workunit.client.0.smithi049.stdout:2/340: rmdir da/d52/d40 39 2024-06-03T00:03:03.380 INFO:tasks.workunit.client.0.smithi049.stdout:2/341: readlink da/d52/df/l32 0 2024-06-03T00:03:03.380 INFO:tasks.workunit.client.0.smithi049.stdout:2/342: stat da/d43/c6d 0 2024-06-03T00:03:03.380 INFO:tasks.workunit.client.0.smithi049.stdout:2/343: write da/d52/f6f [674764,120570] 0 2024-06-03T00:03:03.380 INFO:tasks.workunit.client.0.smithi049.stdout:7/324: rename d3/d6/d13/d3c/d48/d4e to d3/d6/d13/d3c/d48/d7b 0 2024-06-03T00:03:03.380 INFO:tasks.workunit.client.0.smithi049.stdout:4/372: write d4/d3f/d14/d15/f18 [4375176,49852] 0 2024-06-03T00:03:03.380 INFO:tasks.workunit.client.0.smithi049.stdout:9/439: dread d1/da/f5e [0,4194304] 0 2024-06-03T00:03:03.381 INFO:tasks.workunit.client.0.smithi049.stdout:4/373: mkdir d4/d16/d1c/d7a 0 2024-06-03T00:03:03.382 INFO:tasks.workunit.client.0.smithi049.stdout:2/344: mkdir da/d52/d73 0 2024-06-03T00:03:03.383 INFO:tasks.workunit.client.0.smithi049.stdout:9/440: dread d1/f44 [0,4194304] 0 2024-06-03T00:03:03.389 INFO:tasks.workunit.client.0.smithi049.stdout:0/274: write d6/d29/d2e/f2a [440206,125568] 0 2024-06-03T00:03:03.397 INFO:tasks.workunit.client.0.smithi049.stdout:8/279: truncate d4/d27/d3c/f38 4414333 0 2024-06-03T00:03:03.401 INFO:tasks.workunit.client.0.smithi049.stdout:8/280: rename d4/d7/d3a to d4/d27/d30/d4f/d53 0 2024-06-03T00:03:03.406 INFO:tasks.workunit.client.0.smithi049.stdout:7/325: dwrite d3/d6/f25 [0,4194304] 0 2024-06-03T00:03:03.414 INFO:tasks.workunit.client.0.smithi049.stdout:0/275: dwrite d6/d30/d32/f48 [0,4194304] 0 2024-06-03T00:03:03.414 INFO:tasks.workunit.client.0.smithi049.stdout:9/441: dwrite d1/d5/f6c [0,4194304] 0 2024-06-03T00:03:03.414 INFO:tasks.workunit.client.0.smithi049.stdout:0/276: chown d6/d29/d2e/f2b 0 1 2024-06-03T00:03:03.414 INFO:tasks.workunit.client.0.smithi049.stdout:4/374: dwrite d4/d3f/d14/d15/f6a [4194304,4194304] 0 2024-06-03T00:03:03.414 INFO:tasks.workunit.client.0.smithi049.stdout:4/375: fsync d4/f6c 0 2024-06-03T00:03:03.414 INFO:tasks.workunit.client.0.smithi049.stdout:4/376: write d4/d16/f67 [554922,103431] 0 2024-06-03T00:03:03.415 INFO:tasks.workunit.client.0.smithi049.stdout:8/281: creat d4/d7/d48/f54 x:0 0 0 2024-06-03T00:03:03.415 INFO:tasks.workunit.client.0.smithi049.stdout:5/353: symlink d3/d5/da/d55/l72 0 2024-06-03T00:03:03.416 INFO:tasks.workunit.client.0.smithi049.stdout:9/442: truncate d1/da/d26/f5c 4129893 0 2024-06-03T00:03:03.416 INFO:tasks.workunit.client.0.smithi049.stdout:8/282: getdents d4/d7/d28/d25 0 2024-06-03T00:03:03.417 INFO:tasks.workunit.client.0.smithi049.stdout:4/377: rmdir d4/d3f 39 2024-06-03T00:03:03.420 INFO:tasks.workunit.client.0.smithi049.stdout:9/443: rmdir d1/d5/d88 0 2024-06-03T00:03:03.420 INFO:tasks.workunit.client.0.smithi049.stdout:9/444: dread - d1/d5/d13/d3b/d49/d58/f74 zero size 2024-06-03T00:03:03.421 INFO:tasks.workunit.client.0.smithi049.stdout:4/378: rmdir d4/d3f/d14 39 2024-06-03T00:03:03.422 INFO:tasks.workunit.client.0.smithi049.stdout:9/445: symlink d1/d5/d13/d6a/l8a 0 2024-06-03T00:03:03.423 INFO:tasks.workunit.client.0.smithi049.stdout:7/326: dwrite d3/d6/d3f/f77 [0,4194304] 0 2024-06-03T00:03:03.423 INFO:tasks.workunit.client.0.smithi049.stdout:7/327: truncate d3/d6/d13/d54/f10 380046 0 2024-06-03T00:03:03.423 INFO:tasks.workunit.client.0.smithi049.stdout:4/379: getdents d4/d16/d69 0 2024-06-03T00:03:03.428 INFO:tasks.workunit.client.0.smithi049.stdout:4/380: link d4/d16/d1c/d24/c71 d4/c7b 0 2024-06-03T00:03:03.438 INFO:tasks.workunit.client.0.smithi049.stdout:0/277: write f2 [312981,105966] 0 2024-06-03T00:03:03.438 INFO:tasks.workunit.client.0.smithi049.stdout:9/446: dread d1/da/d26/f33 [0,4194304] 0 2024-06-03T00:03:03.438 INFO:tasks.workunit.client.0.smithi049.stdout:0/278: rmdir d6/d59 39 2024-06-03T00:03:03.439 INFO:tasks.workunit.client.0.smithi049.stdout:9/447: symlink d1/da/d27/d30/d5f/l8b 0 2024-06-03T00:03:03.440 INFO:tasks.workunit.client.0.smithi049.stdout:0/279: truncate d6/d59/f5b 2883338 0 2024-06-03T00:03:03.441 INFO:tasks.workunit.client.0.smithi049.stdout:0/280: creat d6/f61 x:0 0 0 2024-06-03T00:03:03.441 INFO:tasks.workunit.client.0.smithi049.stdout:0/281: chown d6/d30 1 1 2024-06-03T00:03:03.446 INFO:tasks.workunit.client.0.smithi049.stdout:5/354: dwrite d3/d9/d68/f70 [0,4194304] 0 2024-06-03T00:03:03.446 INFO:tasks.workunit.client.0.smithi049.stdout:5/355: stat d3/d5/da/d55/d14/d16/f25 0 2024-06-03T00:03:03.449 INFO:tasks.workunit.client.0.smithi049.stdout:0/282: fsync d6/d29/d2e/f2a 0 2024-06-03T00:03:03.449 INFO:tasks.workunit.client.0.smithi049.stdout:0/283: readlink d6/d29/d47/l53 0 2024-06-03T00:03:03.449 INFO:tasks.workunit.client.0.smithi049.stdout:4/381: dwrite d4/d16/d1c/d24/f4a [0,4194304] 0 2024-06-03T00:03:03.449 INFO:tasks.workunit.client.0.smithi049.stdout:8/283: dwrite d4/d27/f4b [0,4194304] 0 2024-06-03T00:03:03.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:03 smithi057 ceph-mon[36457]: pgmap v473: 97 pgs: 97 active+clean; 136 MiB data, 822 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 11 MiB/s wr, 1.55k op/s 2024-06-03T00:03:03.451 INFO:tasks.workunit.client.0.smithi049.stdout:7/328: dwrite d3/f30 [0,4194304] 0 2024-06-03T00:03:03.451 INFO:tasks.workunit.client.0.smithi049.stdout:7/329: truncate d3/d6/d9/d37/f51 929195 0 2024-06-03T00:03:03.451 INFO:tasks.workunit.client.0.smithi049.stdout:7/330: truncate d3/d6/f1c 433003 0 2024-06-03T00:03:03.451 INFO:tasks.workunit.client.0.smithi049.stdout:7/331: chown d3/d6/d3f/f59 680 1 2024-06-03T00:03:03.451 INFO:tasks.workunit.client.0.smithi049.stdout:8/284: symlink d4/d7/d28/l55 0 2024-06-03T00:03:03.453 INFO:tasks.workunit.client.0.smithi049.stdout:0/284: rename d6/d59/c5d to d6/d30/d32/c62 0 2024-06-03T00:03:03.454 INFO:tasks.workunit.client.0.smithi049.stdout:4/382: link d4/d16/d1c/d24/c71 d4/c7c 0 2024-06-03T00:03:03.454 INFO:tasks.workunit.client.0.smithi049.stdout:4/383: write d4/d16/d69/f72 [25856,80462] 0 2024-06-03T00:03:03.454 INFO:tasks.workunit.client.0.smithi049.stdout:4/384: chown d4/d16/f44 3 1 2024-06-03T00:03:03.454 INFO:tasks.workunit.client.0.smithi049.stdout:8/285: rename d4/d7/f18 to d4/d7/f56 0 2024-06-03T00:03:03.455 INFO:tasks.workunit.client.0.smithi049.stdout:4/385: symlink d4/l7d 0 2024-06-03T00:03:03.455 INFO:tasks.workunit.client.0.smithi049.stdout:4/386: chown d4/d16/f67 1 1 2024-06-03T00:03:03.456 INFO:tasks.workunit.client.0.smithi049.stdout:0/285: dread d6/f3d [0,4194304] 0 2024-06-03T00:03:03.457 INFO:tasks.workunit.client.0.smithi049.stdout:0/286: mknod d6/d59/c63 0 2024-06-03T00:03:03.457 INFO:tasks.workunit.client.0.smithi049.stdout:4/387: creat d4/d16/d1c/f7e x:0 0 0 2024-06-03T00:03:03.458 INFO:tasks.workunit.client.0.smithi049.stdout:4/388: write d4/d16/d1c/d24/f42 [240216,46715] 0 2024-06-03T00:03:03.459 INFO:tasks.workunit.client.0.smithi049.stdout:0/287: creat d6/d30/d32/f64 x:0 0 0 2024-06-03T00:03:03.459 INFO:tasks.workunit.client.0.smithi049.stdout:4/389: mkdir d4/d3f/d14/d7f 0 2024-06-03T00:03:03.461 INFO:tasks.workunit.client.0.smithi049.stdout:7/332: dread d3/d6/d13/d54/f34 [0,4194304] 0 2024-06-03T00:03:03.461 INFO:tasks.workunit.client.0.smithi049.stdout:0/288: symlink d6/d29/d47/d4b/l65 0 2024-06-03T00:03:03.463 INFO:tasks.workunit.client.0.smithi049.stdout:7/333: creat d3/d6/d13/f7c x:0 0 0 2024-06-03T00:03:03.465 INFO:tasks.workunit.client.0.smithi049.stdout:9/448: dwrite d1/d5/d13/d3b/f48 [4194304,4194304] 0 2024-06-03T00:03:03.470 INFO:tasks.workunit.client.0.smithi049.stdout:0/289: dread d6/f21 [0,4194304] 0 2024-06-03T00:03:03.470 INFO:tasks.workunit.client.0.smithi049.stdout:0/290: chown d6/d29/d2e/f1f 41521 1 2024-06-03T00:03:03.471 INFO:tasks.workunit.client.0.smithi049.stdout:4/390: dread d4/d16/d1c/f25 [0,4194304] 0 2024-06-03T00:03:03.472 INFO:tasks.workunit.client.0.smithi049.stdout:4/391: stat d4/d2a/c75 0 2024-06-03T00:03:03.472 INFO:tasks.workunit.client.0.smithi049.stdout:4/392: readlink d4/d3f/l70 0 2024-06-03T00:03:03.472 INFO:tasks.workunit.client.0.smithi049.stdout:0/291: rmdir d6/d29 39 2024-06-03T00:03:03.473 INFO:tasks.workunit.client.0.smithi049.stdout:4/393: creat d4/d16/d1c/d7a/f80 x:0 0 0 2024-06-03T00:03:03.474 INFO:tasks.workunit.client.0.smithi049.stdout:7/334: dread d3/d6/d3f/f59 [0,4194304] 0 2024-06-03T00:03:03.475 INFO:tasks.workunit.client.0.smithi049.stdout:4/394: creat d4/d2a/f81 x:0 0 0 2024-06-03T00:03:03.477 INFO:tasks.workunit.client.0.smithi049.stdout:4/395: mkdir d4/d3f/d14/d82 0 2024-06-03T00:03:03.478 INFO:tasks.workunit.client.0.smithi049.stdout:4/396: getdents d4/d3f/d14/d2b 0 2024-06-03T00:03:03.478 INFO:tasks.workunit.client.0.smithi049.stdout:4/397: chown d4/d16/d1c/d4f/f6e 708 1 2024-06-03T00:03:03.480 INFO:tasks.workunit.client.0.smithi049.stdout:4/398: rename d4/d3f/c50 to d4/d16/c83 0 2024-06-03T00:03:03.480 INFO:tasks.workunit.client.0.smithi049.stdout:4/399: dread - d4/d2a/f81 zero size 2024-06-03T00:03:03.481 INFO:tasks.workunit.client.0.smithi049.stdout:4/400: write d4/d3f/d14/d15/f78 [381678,4890] 0 2024-06-03T00:03:03.481 INFO:tasks.workunit.client.0.smithi049.stdout:4/401: write d4/d3f/d14/d2b/f6b [587250,108540] 0 2024-06-03T00:03:03.481 INFO:tasks.workunit.client.0.smithi049.stdout:4/402: write d4/d16/d1c/d4f/f6e [242451,95454] 0 2024-06-03T00:03:03.481 INFO:tasks.workunit.client.0.smithi049.stdout:8/286: dwrite d4/d27/d3c/f2c [0,4194304] 0 2024-06-03T00:03:03.487 INFO:tasks.workunit.client.0.smithi049.stdout:9/449: dwrite d1/d5/d13/d3b/d49/f64 [0,4194304] 0 2024-06-03T00:03:03.490 INFO:tasks.workunit.client.0.smithi049.stdout:4/403: dread d4/d2a/f34 [0,4194304] 0 2024-06-03T00:03:03.490 INFO:tasks.workunit.client.0.smithi049.stdout:4/404: readlink d4/d2a/l3e 0 2024-06-03T00:03:03.490 INFO:tasks.workunit.client.0.smithi049.stdout:4/405: write d4/d2a/f81 [586642,99874] 0 2024-06-03T00:03:03.491 INFO:tasks.workunit.client.0.smithi049.stdout:4/406: getdents d4/d16/d1c/d24 0 2024-06-03T00:03:03.491 INFO:tasks.workunit.client.0.smithi049.stdout:4/407: getdents d4/d3f/d14/d82 0 2024-06-03T00:03:03.491 INFO:tasks.workunit.client.0.smithi049.stdout:4/408: fdatasync d4/d3f/f4d 0 2024-06-03T00:03:03.492 INFO:tasks.workunit.client.0.smithi049.stdout:8/287: write d4/d27/d3c/f2c [3845871,36461] 0 2024-06-03T00:03:03.492 INFO:tasks.workunit.client.0.smithi049.stdout:4/409: write d4/d3f/f4d [259634,69606] 0 2024-06-03T00:03:03.492 INFO:tasks.workunit.client.0.smithi049.stdout:7/335: dwrite d3/f40 [0,4194304] 0 2024-06-03T00:03:03.493 INFO:tasks.workunit.client.0.smithi049.stdout:9/450: dread d1/da/d27/f40 [0,4194304] 0 2024-06-03T00:03:03.493 INFO:tasks.workunit.client.0.smithi049.stdout:8/288: truncate d4/d7/d28/d25/f39 664732 0 2024-06-03T00:03:03.496 INFO:tasks.workunit.client.0.smithi049.stdout:4/410: rename d4/d16 to d4/d3f/d14/d2b/d84 0 2024-06-03T00:03:03.496 INFO:tasks.workunit.client.0.smithi049.stdout:7/336: mkdir d3/d14/d7d 0 2024-06-03T00:03:03.498 INFO:tasks.workunit.client.0.smithi049.stdout:9/451: rename d1/da/d26/f33 to d1/d5/d13/d66/d87/f8c 0 2024-06-03T00:03:03.498 INFO:tasks.workunit.client.0.smithi049.stdout:7/337: creat d3/d6/d13/d79/f7e x:0 0 0 2024-06-03T00:03:03.498 INFO:tasks.workunit.client.0.smithi049.stdout:4/411: mknod d4/c85 0 2024-06-03T00:03:03.499 INFO:tasks.workunit.client.0.smithi049.stdout:7/338: unlink d3/d6/d13/d3c/l5d 0 2024-06-03T00:03:03.500 INFO:tasks.workunit.client.0.smithi049.stdout:8/289: rename d4/d7/d48/f54 to d4/d7/d28/d25/f57 0 2024-06-03T00:03:03.500 INFO:tasks.workunit.client.0.smithi049.stdout:9/452: truncate d1/f8 1330581 0 2024-06-03T00:03:03.500 INFO:tasks.workunit.client.0.smithi049.stdout:9/453: readlink d1/da/d27/l2e 0 2024-06-03T00:03:03.500 INFO:tasks.workunit.client.0.smithi049.stdout:7/339: getdents d3/d6/d13/d4a 0 2024-06-03T00:03:03.501 INFO:tasks.workunit.client.0.smithi049.stdout:9/454: mknod d1/d5/d13/d6a/c8d 0 2024-06-03T00:03:03.502 INFO:tasks.workunit.client.0.smithi049.stdout:8/290: mkdir d4/d7/d58 0 2024-06-03T00:03:03.503 INFO:tasks.workunit.client.0.smithi049.stdout:9/455: link d1/d5/d13/c22 d1/d5/d13/d3b/d7f/c8e 0 2024-06-03T00:03:03.503 INFO:tasks.workunit.client.0.smithi049.stdout:9/456: stat d1/da/d54/l60 0 2024-06-03T00:03:03.503 INFO:tasks.workunit.client.0.smithi049.stdout:7/340: link d3/c42 d3/d6/d13/d3c/c7f 0 2024-06-03T00:03:03.504 INFO:tasks.workunit.client.0.smithi049.stdout:8/291: symlink d4/d7/l59 0 2024-06-03T00:03:03.504 INFO:tasks.workunit.client.0.smithi049.stdout:8/292: readlink d4/d7/l59 0 2024-06-03T00:03:03.505 INFO:tasks.workunit.client.0.smithi049.stdout:7/341: creat d3/d32/f80 x:0 0 0 2024-06-03T00:03:03.505 INFO:tasks.workunit.client.0.smithi049.stdout:7/342: fdatasync d3/d6/d13/d54/f10 0 2024-06-03T00:03:03.506 INFO:tasks.workunit.client.0.smithi049.stdout:8/293: creat d4/d27/d30/d4f/f5a x:0 0 0 2024-06-03T00:03:03.509 INFO:tasks.workunit.client.0.smithi049.stdout:8/294: rename d4/d7/cb to d4/d27/d30/d4f/d53/c5b 0 2024-06-03T00:03:03.510 INFO:tasks.workunit.client.0.smithi049.stdout:7/343: truncate d3/f40 2143553 0 2024-06-03T00:03:03.510 INFO:tasks.workunit.client.0.smithi049.stdout:7/344: chown d3/d57/f6c 13 1 2024-06-03T00:03:03.511 INFO:tasks.workunit.client.0.smithi049.stdout:8/295: creat d4/d7/d28/d45/f5c x:0 0 0 2024-06-03T00:03:03.512 INFO:tasks.workunit.client.0.smithi049.stdout:8/296: creat d4/d7/d48/f5d x:0 0 0 2024-06-03T00:03:03.513 INFO:tasks.workunit.client.0.smithi049.stdout:8/297: mknod d4/d7/c5e 0 2024-06-03T00:03:03.513 INFO:tasks.workunit.client.0.smithi049.stdout:8/298: stat d4/d7/l59 0 2024-06-03T00:03:03.518 INFO:tasks.workunit.client.0.smithi049.stdout:7/345: rename d3/d6/d9/d37/l5c to d3/d6/d13/d4a/l81 0 2024-06-03T00:03:03.519 INFO:tasks.workunit.client.0.smithi049.stdout:7/346: chown d3/d6/d13/d3c/d4b 61171 1 2024-06-03T00:03:03.520 INFO:tasks.workunit.client.0.smithi049.stdout:7/347: dread d3/d6/d9/f2b [0,4194304] 0 2024-06-03T00:03:03.522 INFO:tasks.workunit.client.0.smithi049.stdout:7/348: creat d3/f82 x:0 0 0 2024-06-03T00:03:03.522 INFO:tasks.workunit.client.0.smithi049.stdout:7/349: write d3/d14/f76 [672988,31985] 0 2024-06-03T00:03:03.522 INFO:tasks.workunit.client.0.smithi049.stdout:7/350: dread d3/d6/f1c [0,4194304] 0 2024-06-03T00:03:03.523 INFO:tasks.workunit.client.0.smithi049.stdout:4/412: dwrite d4/d3f/d14/d2b/d84/d1c/d4f/f5c [0,4194304] 0 2024-06-03T00:03:03.524 INFO:tasks.workunit.client.0.smithi049.stdout:9/457: dwrite d1/da/d26/f5c [0,4194304] 0 2024-06-03T00:03:03.524 INFO:tasks.workunit.client.0.smithi049.stdout:9/458: stat d1/d5/d7a 0 2024-06-03T00:03:03.524 INFO:tasks.workunit.client.0.smithi049.stdout:7/351: rmdir d3/d6/d13/d3c 39 2024-06-03T00:03:03.525 INFO:tasks.workunit.client.0.smithi049.stdout:7/352: chown d3/d57/c43 17424 1 2024-06-03T00:03:03.525 INFO:tasks.workunit.client.0.smithi049.stdout:7/353: write d3/d6/d13/d54/f10 [269296,83693] 0 2024-06-03T00:03:03.525 INFO:tasks.workunit.client.0.smithi049.stdout:4/413: dread d4/d3f/f56 [0,4194304] 0 2024-06-03T00:03:03.527 INFO:tasks.workunit.client.0.smithi049.stdout:4/414: write d4/d3f/d14/d15/f28 [4651207,16448] 0 2024-06-03T00:03:03.527 INFO:tasks.workunit.client.0.smithi049.stdout:7/354: creat d3/d6/d3f/f83 x:0 0 0 2024-06-03T00:03:03.527 INFO:tasks.workunit.client.0.smithi049.stdout:7/355: chown d3/d6/d3f/f59 0 1 2024-06-03T00:03:03.528 INFO:tasks.workunit.client.0.smithi049.stdout:7/356: creat d3/d6/d9/d37/f84 x:0 0 0 2024-06-03T00:03:03.529 INFO:tasks.workunit.client.0.smithi049.stdout:7/357: fsync d3/d6/d9/f2b 0 2024-06-03T00:03:03.529 INFO:tasks.workunit.client.0.smithi049.stdout:9/459: creat d1/da/d27/d30/d5f/d81/f8f x:0 0 0 2024-06-03T00:03:03.530 INFO:tasks.workunit.client.0.smithi049.stdout:4/415: creat d4/d3f/d14/d2b/d84/d1c/d4f/f86 x:0 0 0 2024-06-03T00:03:03.530 INFO:tasks.workunit.client.0.smithi049.stdout:4/416: fsync d4/ff 0 2024-06-03T00:03:03.531 INFO:tasks.workunit.client.0.smithi049.stdout:4/417: write d4/d3f/f52 [499609,17764] 0 2024-06-03T00:03:03.531 INFO:tasks.workunit.client.0.smithi049.stdout:9/460: dread d1/d5/d13/f4b [4194304,4194304] 0 2024-06-03T00:03:03.532 INFO:tasks.workunit.client.0.smithi049.stdout:9/461: readlink d1/l11 0 2024-06-03T00:03:03.532 INFO:tasks.workunit.client.0.smithi049.stdout:9/462: stat d1/da/d26/c3a 0 2024-06-03T00:03:03.532 INFO:tasks.workunit.client.0.smithi049.stdout:4/418: mkdir d4/d3f/d14/d7f/d87 0 2024-06-03T00:03:03.532 INFO:tasks.workunit.client.0.smithi049.stdout:7/358: read d3/d6/d13/f65 [1290638,25803] 0 2024-06-03T00:03:03.532 INFO:tasks.workunit.client.0.smithi049.stdout:7/359: write d3/d6/d13/f7c [248817,59031] 0 2024-06-03T00:03:03.533 INFO:tasks.workunit.client.0.smithi049.stdout:9/463: link d1/da/f86 d1/d5/d13/d3b/d49/d58/f90 0 2024-06-03T00:03:03.533 INFO:tasks.workunit.client.0.smithi049.stdout:9/464: dread - d1/d5/d13/d3b/d49/d58/f74 zero size 2024-06-03T00:03:03.533 INFO:tasks.workunit.client.0.smithi049.stdout:7/360: symlink d3/d6/d13/d3c/d48/l85 0 2024-06-03T00:03:03.533 INFO:tasks.workunit.client.0.smithi049.stdout:4/419: truncate d4/d3f/d14/d15/f18 7012400 0 2024-06-03T00:03:03.534 INFO:tasks.workunit.client.0.smithi049.stdout:9/465: creat d1/d5/d13/d3b/d49/d58/f91 x:0 0 0 2024-06-03T00:03:03.536 INFO:tasks.workunit.client.0.smithi049.stdout:4/420: unlink d4/c7b 0 2024-06-03T00:03:03.536 INFO:tasks.workunit.client.0.smithi049.stdout:4/421: fsync d4/d3f/d14/d2b/d84/d1c/d4f/f66 0 2024-06-03T00:03:03.536 INFO:tasks.workunit.client.0.smithi049.stdout:4/422: fdatasync d4/d3f/d14/d2b/d84/d1c/d24/d43/f45 0 2024-06-03T00:03:03.537 INFO:tasks.workunit.client.0.smithi049.stdout:9/466: symlink d1/d5/d13/d3b/l92 0 2024-06-03T00:03:03.538 INFO:tasks.workunit.client.0.smithi049.stdout:7/361: dread d3/d32/f41 [0,4194304] 0 2024-06-03T00:03:03.539 INFO:tasks.workunit.client.0.smithi049.stdout:4/423: creat d4/d3f/d14/d2b/d84/d1c/d4f/f88 x:0 0 0 2024-06-03T00:03:03.540 INFO:tasks.workunit.client.0.smithi049.stdout:7/362: unlink d3/ld 0 2024-06-03T00:03:03.541 INFO:tasks.workunit.client.0.smithi049.stdout:9/467: symlink d1/da/d54/l93 0 2024-06-03T00:03:03.542 INFO:tasks.workunit.client.0.smithi049.stdout:7/363: mkdir d3/d6/d86 0 2024-06-03T00:03:03.542 INFO:tasks.workunit.client.0.smithi049.stdout:4/424: mkdir d4/d3f/d14/d2b/d84/d69/d89 0 2024-06-03T00:03:03.544 INFO:tasks.workunit.client.0.smithi049.stdout:7/364: creat d3/d6/d13/d3c/d4b/d5a/f87 x:0 0 0 2024-06-03T00:03:03.546 INFO:tasks.workunit.client.0.smithi049.stdout:7/365: symlink d3/d14/l88 0 2024-06-03T00:03:03.547 INFO:tasks.workunit.client.0.smithi049.stdout:9/468: symlink d1/da/d26/l94 0 2024-06-03T00:03:03.547 INFO:tasks.workunit.client.0.smithi049.stdout:9/469: chown d1/d5/d1a/d52 109387735 1 2024-06-03T00:03:03.547 INFO:tasks.workunit.client.0.smithi049.stdout:4/425: mkdir d4/d3f/d14/d2b/d84/d1c/d7a/d8a 0 2024-06-03T00:03:03.548 INFO:tasks.workunit.client.0.smithi049.stdout:4/426: truncate d4/d3f/d14/d2b/d84/d1c/d24/d43/f4b 1037016 0 2024-06-03T00:03:03.548 INFO:tasks.workunit.client.0.smithi049.stdout:4/427: write d4/d3f/f5f [943900,74031] 0 2024-06-03T00:03:03.548 INFO:tasks.workunit.client.0.smithi049.stdout:4/428: readlink d4/d2a/l3e 0 2024-06-03T00:03:03.549 INFO:tasks.workunit.client.0.smithi049.stdout:4/429: creat d4/d3f/d14/d7f/d87/f8b x:0 0 0 2024-06-03T00:03:03.549 INFO:tasks.workunit.client.0.smithi049.stdout:7/366: truncate d3/d6/d13/d54/f4d 3448985 0 2024-06-03T00:03:03.550 INFO:tasks.workunit.client.0.smithi049.stdout:4/430: unlink d4/d3f/f5f 0 2024-06-03T00:03:03.550 INFO:tasks.workunit.client.0.smithi049.stdout:7/367: getdents d3 0 2024-06-03T00:03:03.550 INFO:tasks.workunit.client.0.smithi049.stdout:7/368: fdatasync d3/d6/d13/f65 0 2024-06-03T00:03:03.551 INFO:tasks.workunit.client.0.smithi049.stdout:7/369: truncate d3/f82 993612 0 2024-06-03T00:03:03.551 INFO:tasks.workunit.client.0.smithi049.stdout:7/370: getdents d3/d32 0 2024-06-03T00:03:03.571 INFO:tasks.workunit.client.0.smithi049.stdout:9/470: dwrite d1/da/d27/d30/d5f/f7d [0,4194304] 0 2024-06-03T00:03:03.571 INFO:tasks.workunit.client.0.smithi049.stdout:9/471: fdatasync d1/da/d27/f3c 0 2024-06-03T00:03:03.572 INFO:tasks.workunit.client.0.smithi049.stdout:9/472: dread d1/d5/d13/d3b/f65 [0,4194304] 0 2024-06-03T00:03:03.574 INFO:tasks.workunit.client.0.smithi049.stdout:9/473: mkdir d1/d95 0 2024-06-03T00:03:03.575 INFO:tasks.workunit.client.0.smithi049.stdout:9/474: creat d1/da/d54/d5b/d61/f96 x:0 0 0 2024-06-03T00:03:03.576 INFO:tasks.workunit.client.0.smithi049.stdout:9/475: fsync d1/f78 0 2024-06-03T00:03:03.576 INFO:tasks.workunit.client.0.smithi049.stdout:9/476: truncate d1/da/d26/f43 749509 0 2024-06-03T00:03:03.576 INFO:tasks.workunit.client.0.smithi049.stdout:9/477: creat d1/da/d27/d30/f97 x:0 0 0 2024-06-03T00:03:03.578 INFO:tasks.workunit.client.0.smithi049.stdout:9/478: creat d1/d5/d13/d3b/d49/d58/f98 x:0 0 0 2024-06-03T00:03:03.578 INFO:tasks.workunit.client.0.smithi049.stdout:9/479: stat d1/d5/d13/d66/d87/f8c 0 2024-06-03T00:03:03.578 INFO:tasks.workunit.client.0.smithi049.stdout:4/431: dwrite d4/d3f/d14/d2b/d84/d1c/d4f/f5c [0,4194304] 0 2024-06-03T00:03:03.579 INFO:tasks.workunit.client.0.smithi049.stdout:9/480: creat d1/da/f99 x:0 0 0 2024-06-03T00:03:03.579 INFO:tasks.workunit.client.0.smithi049.stdout:9/481: chown d1/da/d27/l2e 81 1 2024-06-03T00:03:03.579 INFO:tasks.workunit.client.0.smithi049.stdout:9/482: truncate d1/f8 2062749 0 2024-06-03T00:03:03.580 INFO:tasks.workunit.client.0.smithi049.stdout:4/432: creat d4/d2a/f8c x:0 0 0 2024-06-03T00:03:03.580 INFO:tasks.workunit.client.0.smithi049.stdout:4/433: stat d4/d3f/d14/d2b/d84/d1c/d4f/f86 0 2024-06-03T00:03:03.582 INFO:tasks.workunit.client.0.smithi049.stdout:9/483: symlink d1/d5/l9a 0 2024-06-03T00:03:03.582 INFO:tasks.workunit.client.0.smithi049.stdout:7/371: dwrite d3/d32/f80 [0,4194304] 0 2024-06-03T00:03:03.582 INFO:tasks.workunit.client.0.smithi049.stdout:7/372: truncate d3/d6/f25 5000031 0 2024-06-03T00:03:03.583 INFO:tasks.workunit.client.0.smithi049.stdout:4/434: creat d4/d3f/d14/d2b/d84/f8d x:0 0 0 2024-06-03T00:03:03.584 INFO:tasks.workunit.client.0.smithi049.stdout:9/484: unlink d1/c89 0 2024-06-03T00:03:03.586 INFO:tasks.workunit.client.0.smithi049.stdout:7/373: mknod d3/d6/d13/d3c/c89 0 2024-06-03T00:03:03.586 INFO:tasks.workunit.client.0.smithi049.stdout:7/374: getdents d3/d6/d13/d54 0 2024-06-03T00:03:03.603 INFO:tasks.workunit.client.0.smithi049.stdout:4/435: dwrite d4/d3f/d14/d2b/d84/d1c/f25 [0,4194304] 0 2024-06-03T00:03:03.605 INFO:tasks.workunit.client.0.smithi049.stdout:4/436: mknod d4/d3f/d14/d2b/d84/d69/d89/c8e 0 2024-06-03T00:03:03.607 INFO:tasks.workunit.client.0.smithi049.stdout:7/375: dread d3/d6/d9/f69 [0,4194304] 0 2024-06-03T00:03:03.607 INFO:tasks.workunit.client.0.smithi049.stdout:9/485: dwrite d1/da/d54/d5b/d61/f62 [4194304,4194304] 0 2024-06-03T00:03:03.608 INFO:tasks.workunit.client.0.smithi049.stdout:7/376: mkdir d3/d32/d8a 0 2024-06-03T00:03:03.610 INFO:tasks.workunit.client.0.smithi049.stdout:7/377: creat d3/d14/d7d/f8b x:0 0 0 2024-06-03T00:03:03.610 INFO:tasks.workunit.client.0.smithi049.stdout:7/378: chown d3/d6/d13/d54/l63 26 1 2024-06-03T00:03:03.610 INFO:tasks.workunit.client.0.smithi049.stdout:7/379: fdatasync d3/d14/f76 0 2024-06-03T00:03:03.612 INFO:tasks.workunit.client.0.smithi049.stdout:7/380: link d3/d6/d9/lb d3/d6/d13/d54/l8c 0 2024-06-03T00:03:03.614 INFO:tasks.workunit.client.0.smithi049.stdout:9/486: write d1/da/f42 [67384,63376] 0 2024-06-03T00:03:03.614 INFO:tasks.workunit.client.0.smithi049.stdout:9/487: dread - d1/da/d27/d30/f97 zero size 2024-06-03T00:03:03.614 INFO:tasks.workunit.client.0.smithi049.stdout:7/381: mkdir d3/d6/d86/d8d 0 2024-06-03T00:03:03.614 INFO:tasks.workunit.client.0.smithi049.stdout:7/382: write d3/d6/d13/d4a/f2f [2770424,74426] 0 2024-06-03T00:03:03.616 INFO:tasks.workunit.client.0.smithi049.stdout:7/383: chown d3/d6/d9/d37/c52 190092 1 2024-06-03T00:03:03.616 INFO:tasks.workunit.client.0.smithi049.stdout:7/384: fsync d3/d57/f6c 0 2024-06-03T00:03:03.617 INFO:tasks.workunit.client.0.smithi049.stdout:9/488: creat d1/d5/d1a/d52/f9b x:0 0 0 2024-06-03T00:03:03.617 INFO:tasks.workunit.client.0.smithi049.stdout:9/489: readlink d1/l7c 0 2024-06-03T00:03:03.617 INFO:tasks.workunit.client.0.smithi049.stdout:7/385: mkdir d3/d6/d13/d3c/d4b/d8e 0 2024-06-03T00:03:03.618 INFO:tasks.workunit.client.0.smithi049.stdout:9/490: creat d1/d5/d13/d3b/d49/d58/f9c x:0 0 0 2024-06-03T00:03:03.619 INFO:tasks.workunit.client.0.smithi049.stdout:9/491: symlink d1/da/d27/d30/d5f/d81/l9d 0 2024-06-03T00:03:03.624 INFO:tasks.workunit.client.0.smithi049.stdout:7/386: write d3/d6/d3f/f77 [2257032,36542] 0 2024-06-03T00:03:03.624 INFO:tasks.workunit.client.0.smithi049.stdout:7/387: write d3/f82 [1563963,15475] 0 2024-06-03T00:03:03.624 INFO:tasks.workunit.client.0.smithi049.stdout:7/388: dread - d3/d6/d13/d79/f7e zero size 2024-06-03T00:03:03.624 INFO:tasks.workunit.client.0.smithi049.stdout:7/389: write d3/d6/f1c [1311880,51211] 0 2024-06-03T00:03:03.624 INFO:tasks.workunit.client.0.smithi049.stdout:7/390: chown d3/d6/f5e 1609147 1 2024-06-03T00:03:03.626 INFO:tasks.workunit.client.0.smithi049.stdout:4/437: dwrite d4/f6c [0,4194304] 0 2024-06-03T00:03:03.626 INFO:tasks.workunit.client.0.smithi049.stdout:7/391: dread d3/d6/d13/f65 [0,4194304] 0 2024-06-03T00:03:03.629 INFO:tasks.workunit.client.0.smithi049.stdout:4/438: rename d4/d3f/d14/d2b/d84/d1c/d24/f64 to d4/d3f/d14/d7f/f8f 0 2024-06-03T00:03:03.630 INFO:tasks.workunit.client.0.smithi049.stdout:4/439: symlink d4/d3f/d14/d2b/d84/d1c/d7a/l90 0 2024-06-03T00:03:03.631 INFO:tasks.workunit.client.0.smithi049.stdout:7/392: rename d3/d57 to d3/d6/d9/d8f 0 2024-06-03T00:03:03.631 INFO:tasks.workunit.client.0.smithi049.stdout:7/393: dread - d3/d6/d13/d3c/d4b/f7a zero size 2024-06-03T00:03:03.632 INFO:tasks.workunit.client.0.smithi049.stdout:7/394: mkdir d3/d6/d86/d90 0 2024-06-03T00:03:03.632 INFO:tasks.workunit.client.0.smithi049.stdout:7/395: truncate d3/d6/d9/d37/f84 315069 0 2024-06-03T00:03:03.633 INFO:tasks.workunit.client.0.smithi049.stdout:7/396: mkdir d3/d6/d9/d91 0 2024-06-03T00:03:03.634 INFO:tasks.workunit.client.0.smithi049.stdout:7/397: mkdir d3/d14/d7d/d92 0 2024-06-03T00:03:03.635 INFO:tasks.workunit.client.0.smithi049.stdout:9/492: write d1/da/d27/d30/f34 [1371660,51018] 0 2024-06-03T00:03:03.635 INFO:tasks.workunit.client.0.smithi049.stdout:9/493: read d1/d5/d13/d3b/f65 [494184,55189] 0 2024-06-03T00:03:03.636 INFO:tasks.workunit.client.0.smithi049.stdout:7/398: rmdir d3/d32/d8a 0 2024-06-03T00:03:03.636 INFO:tasks.workunit.client.0.smithi049.stdout:7/399: write d3/d6/d13/d79/f7e [185474,79877] 0 2024-06-03T00:03:03.636 INFO:tasks.workunit.client.0.smithi049.stdout:7/400: write d3/d6/d13/d54/f55 [983075,106355] 0 2024-06-03T00:03:03.637 INFO:tasks.workunit.client.0.smithi049.stdout:9/494: symlink d1/d95/l9e 0 2024-06-03T00:03:03.637 INFO:tasks.workunit.client.0.smithi049.stdout:9/495: write d1/d5/d13/d3b/f65 [1954277,48385] 0 2024-06-03T00:03:03.637 INFO:tasks.workunit.client.0.smithi049.stdout:9/496: stat d1/da/d54/d5b/d61/l7b 0 2024-06-03T00:03:03.637 INFO:tasks.workunit.client.0.smithi049.stdout:9/497: readlink d1/da/d26/l67 0 2024-06-03T00:03:03.638 INFO:tasks.workunit.client.0.smithi049.stdout:9/498: mknod d1/d5/d1a/d52/c9f 0 2024-06-03T00:03:03.639 INFO:tasks.workunit.client.0.smithi049.stdout:7/401: rename d3/d6/d9/c74 to d3/d14/c93 0 2024-06-03T00:03:03.639 INFO:tasks.workunit.client.0.smithi049.stdout:9/499: mkdir d1/da/d27/d30/d5f/d81/da0 0 2024-06-03T00:03:03.639 INFO:tasks.workunit.client.0.smithi049.stdout:9/500: fsync d1/d5/f6c 0 2024-06-03T00:03:03.639 INFO:tasks.workunit.client.0.smithi049.stdout:9/501: chown d1/da/c28 435783686 1 2024-06-03T00:03:03.640 INFO:tasks.workunit.client.0.smithi049.stdout:9/502: read - d1/d5/d13/d3b/d49/d58/f74 zero size 2024-06-03T00:03:03.640 INFO:tasks.workunit.client.0.smithi049.stdout:9/503: write d1/da/d27/d30/f34 [3096672,34368] 0 2024-06-03T00:03:03.640 INFO:tasks.workunit.client.0.smithi049.stdout:9/504: fdatasync d1/d5/d13/d3b/d49/f64 0 2024-06-03T00:03:03.640 INFO:tasks.workunit.client.0.smithi049.stdout:9/505: write d1/d5/d13/d3b/d49/d58/f74 [211494,67903] 0 2024-06-03T00:03:03.640 INFO:tasks.workunit.client.0.smithi049.stdout:9/506: stat d1/d5/d13/d66/d87 0 2024-06-03T00:03:03.640 INFO:tasks.workunit.client.0.smithi049.stdout:9/507: creat d1/da/d27/d30/d5f/d81/fa1 x:0 0 0 2024-06-03T00:03:03.641 INFO:tasks.workunit.client.0.smithi049.stdout:7/402: unlink d3/d6/d13/d54/f34 0 2024-06-03T00:03:03.641 INFO:tasks.workunit.client.0.smithi049.stdout:7/403: stat d3/d6/d3f/f77 0 2024-06-03T00:03:03.641 INFO:tasks.workunit.client.0.smithi049.stdout:9/508: read - d1/d5/d13/d3b/d49/d58/f91 zero size 2024-06-03T00:03:03.641 INFO:tasks.workunit.client.0.smithi049.stdout:7/404: write d3/d6/d9/f2b [624794,124917] 0 2024-06-03T00:03:03.642 INFO:tasks.workunit.client.0.smithi049.stdout:7/405: creat d3/d6/d13/f94 x:0 0 0 2024-06-03T00:03:03.643 INFO:tasks.workunit.client.0.smithi049.stdout:7/406: mkdir d3/d32/d95 0 2024-06-03T00:03:03.644 INFO:tasks.workunit.client.0.smithi049.stdout:3/245: sync 2024-06-03T00:03:03.644 INFO:tasks.workunit.client.0.smithi049.stdout:1/372: sync 2024-06-03T00:03:03.644 INFO:tasks.workunit.client.0.smithi049.stdout:5/356: sync 2024-06-03T00:03:03.644 INFO:tasks.workunit.client.0.smithi049.stdout:2/345: sync 2024-06-03T00:03:03.644 INFO:tasks.workunit.client.0.smithi049.stdout:6/424: sync 2024-06-03T00:03:03.644 INFO:tasks.workunit.client.0.smithi049.stdout:5/357: chown d3/d5/d24/c31 43012 1 2024-06-03T00:03:03.644 INFO:tasks.workunit.client.0.smithi049.stdout:5/358: readlink d3/d5/d24/l33 0 2024-06-03T00:03:03.645 INFO:tasks.workunit.client.0.smithi049.stdout:2/346: dread - da/d52/d40/d63/f48 zero size 2024-06-03T00:03:03.645 INFO:tasks.workunit.client.0.smithi049.stdout:6/425: truncate d2/d4d/f58 4877385 0 2024-06-03T00:03:03.645 INFO:tasks.workunit.client.0.smithi049.stdout:5/359: chown d3/d5/da/d55/d14/c42 67 1 2024-06-03T00:03:03.645 INFO:tasks.workunit.client.0.smithi049.stdout:6/426: write d2/d3/d9/d23/f1e [4035730,20974] 0 2024-06-03T00:03:03.645 INFO:tasks.workunit.client.0.smithi049.stdout:2/347: write da/d52/d40/f51 [519177,55900] 0 2024-06-03T00:03:03.645 INFO:tasks.workunit.client.0.smithi049.stdout:7/407: mkdir d3/d6/d13/d54/d96 0 2024-06-03T00:03:03.645 INFO:tasks.workunit.client.0.smithi049.stdout:7/408: write d3/d6/f1c [79767,35759] 0 2024-06-03T00:03:03.645 INFO:tasks.workunit.client.0.smithi049.stdout:1/373: write d1/f3 [483675,84823] 0 2024-06-03T00:03:03.646 INFO:tasks.workunit.client.0.smithi049.stdout:6/427: link d2/f15 d2/d4d/d76/f93 0 2024-06-03T00:03:03.646 INFO:tasks.workunit.client.0.smithi049.stdout:2/348: rename da/d52/df/l4e to da/d52/d37/d59/l74 0 2024-06-03T00:03:03.646 INFO:tasks.workunit.client.0.smithi049.stdout:3/246: mkdir d2/d1a/d51 0 2024-06-03T00:03:03.646 INFO:tasks.workunit.client.0.smithi049.stdout:4/440: dwrite d4/d2a/f81 [0,4194304] 0 2024-06-03T00:03:03.646 INFO:tasks.workunit.client.0.smithi049.stdout:2/349: write f9 [4872727,74849] 0 2024-06-03T00:03:03.647 INFO:tasks.workunit.client.0.smithi049.stdout:7/409: mknod d3/d6/d13/d54/d96/c97 0 2024-06-03T00:03:03.647 INFO:tasks.workunit.client.0.smithi049.stdout:3/247: rename d2/d8 to d2/d14/d44/d52 0 2024-06-03T00:03:03.647 INFO:tasks.workunit.client.0.smithi049.stdout:3/248: write d2/f39 [500605,19730] 0 2024-06-03T00:03:03.648 INFO:tasks.workunit.client.0.smithi049.stdout:2/350: symlink da/d43/l75 0 2024-06-03T00:03:03.649 INFO:tasks.workunit.client.0.smithi049.stdout:4/441: symlink d4/d2a/d76/l91 0 2024-06-03T00:03:03.650 INFO:tasks.workunit.client.0.smithi049.stdout:5/360: write d3/d5/fd [930646,83391] 0 2024-06-03T00:03:03.651 INFO:tasks.workunit.client.0.smithi049.stdout:2/351: creat da/d52/df/d3c/f76 x:0 0 0 2024-06-03T00:03:03.651 INFO:tasks.workunit.client.0.smithi049.stdout:2/352: readlink da/d52/df/l22 0 2024-06-03T00:03:03.651 INFO:tasks.workunit.client.0.smithi049.stdout:7/410: unlink d3/d6/d9/d8f/l50 0 2024-06-03T00:03:03.651 INFO:tasks.workunit.client.0.smithi049.stdout:6/428: creat d2/d3/d17/d57/d6e/d88/f94 x:0 0 0 2024-06-03T00:03:03.651 INFO:tasks.workunit.client.0.smithi049.stdout:6/429: write d2/d3/d9/f3d [4465747,73152] 0 2024-06-03T00:03:03.651 INFO:tasks.workunit.client.0.smithi049.stdout:6/430: fsync d2/d3/d9/f71 0 2024-06-03T00:03:03.652 INFO:tasks.workunit.client.0.smithi049.stdout:5/361: mknod d3/d5/da/c73 0 2024-06-03T00:03:03.652 INFO:tasks.workunit.client.0.smithi049.stdout:5/362: truncate d3/d9/d20/d4c/d5a/d65/f69 912237 0 2024-06-03T00:03:03.652 INFO:tasks.workunit.client.0.smithi049.stdout:4/442: getdents d4/d3f/d14/d2b/d84/d69 0 2024-06-03T00:03:03.653 INFO:tasks.workunit.client.0.smithi049.stdout:2/353: symlink da/d52/df/d3c/d60/l77 0 2024-06-03T00:03:03.654 INFO:tasks.workunit.client.0.smithi049.stdout:7/411: unlink d3/d6/d13/d3c/d4b/d5a/l78 0 2024-06-03T00:03:03.654 INFO:tasks.workunit.client.0.smithi049.stdout:5/363: rename d3/d5/d2d/c5c to d3/d9/d20/d4c/d5a/d65/c74 0 2024-06-03T00:03:03.656 INFO:tasks.workunit.client.0.smithi049.stdout:2/354: read da/d52/df/f34 [23791,100006] 0 2024-06-03T00:03:03.656 INFO:tasks.workunit.client.0.smithi049.stdout:2/355: chown da/d52/d37/d70/f71 1 1 2024-06-03T00:03:03.657 INFO:tasks.workunit.client.0.smithi049.stdout:2/356: creat da/d52/df/d3c/d60/f78 x:0 0 0 2024-06-03T00:03:03.658 INFO:tasks.workunit.client.0.smithi049.stdout:5/364: write d3/d9/f13 [1898032,37210] 0 2024-06-03T00:03:03.658 INFO:tasks.workunit.client.0.smithi049.stdout:2/357: mknod da/d52/d37/c79 0 2024-06-03T00:03:03.661 INFO:tasks.workunit.client.0.smithi049.stdout:2/358: mkdir da/d52/df/d3c/d7a 0 2024-06-03T00:03:03.667 INFO:tasks.workunit.client.0.smithi049.stdout:2/359: write da/d52/f13 [31062,38706] 0 2024-06-03T00:03:03.667 INFO:tasks.workunit.client.0.smithi049.stdout:9/509: dwrite d1/f8 [0,4194304] 0 2024-06-03T00:03:03.669 INFO:tasks.workunit.client.0.smithi049.stdout:9/510: creat d1/da/d27/fa2 x:0 0 0 2024-06-03T00:03:03.670 INFO:tasks.workunit.client.0.smithi049.stdout:9/511: creat d1/d5/d13/d3b/d49/d58/fa3 x:0 0 0 2024-06-03T00:03:03.672 INFO:tasks.workunit.client.0.smithi049.stdout:3/249: write f0 [96115,113735] 0 2024-06-03T00:03:03.672 INFO:tasks.workunit.client.0.smithi049.stdout:3/250: chown d2/d14/d22/d42/c2f 3849902 1 2024-06-03T00:03:03.675 INFO:tasks.workunit.client.0.smithi049.stdout:1/374: dwrite d1/d2f/d36/d37/f33 [4194304,4194304] 0 2024-06-03T00:03:03.676 INFO:tasks.workunit.client.0.smithi049.stdout:6/431: dwrite d2/d3/d17/f73 [0,4194304] 0 2024-06-03T00:03:03.676 INFO:tasks.workunit.client.0.smithi049.stdout:6/432: fsync d2/d3/d9/d23/d36/f45 0 2024-06-03T00:03:03.676 INFO:tasks.workunit.client.0.smithi049.stdout:6/433: read d2/d3/d9/d23/d29/f59 [2839128,86140] 0 2024-06-03T00:03:03.676 INFO:tasks.workunit.client.0.smithi049.stdout:4/443: dwrite d4/d3f/d14/d2b/d84/d1c/d4f/f66 [0,4194304] 0 2024-06-03T00:03:03.677 INFO:tasks.workunit.client.0.smithi049.stdout:1/375: getdents d1/d1a 0 2024-06-03T00:03:03.679 INFO:tasks.workunit.client.0.smithi049.stdout:2/360: dread da/f45 [0,4194304] 0 2024-06-03T00:03:03.681 INFO:tasks.workunit.client.0.smithi049.stdout:9/512: dread d1/d5/d13/d3b/f41 [0,4194304] 0 2024-06-03T00:03:03.681 INFO:tasks.workunit.client.0.smithi049.stdout:9/513: chown d1/da/c18 39757636 1 2024-06-03T00:03:03.685 INFO:tasks.workunit.client.0.smithi049.stdout:3/251: write d2/f11 [3724423,95754] 0 2024-06-03T00:03:03.686 INFO:tasks.workunit.client.0.smithi049.stdout:4/444: dread d4/d3f/d14/d15/f28 [0,4194304] 0 2024-06-03T00:03:03.687 INFO:tasks.workunit.client.0.smithi049.stdout:3/252: link d2/d1a/d34/f48 d2/d14/d44/d52/d4c/f53 0 2024-06-03T00:03:03.688 INFO:tasks.workunit.client.0.smithi049.stdout:5/365: dwrite d3/d5/d24/f5f [0,4194304] 0 2024-06-03T00:03:03.688 INFO:tasks.workunit.client.0.smithi049.stdout:2/361: dread da/d52/d49/f6c [0,4194304] 0 2024-06-03T00:03:03.688 INFO:tasks.workunit.client.0.smithi049.stdout:3/253: creat d2/d14/f54 x:0 0 0 2024-06-03T00:03:03.688 INFO:tasks.workunit.client.0.smithi049.stdout:2/362: chown da/f45 38122746 1 2024-06-03T00:03:03.689 INFO:tasks.workunit.client.0.smithi049.stdout:2/363: readlink da/l28 0 2024-06-03T00:03:03.689 INFO:tasks.workunit.client.0.smithi049.stdout:4/445: truncate d4/d3f/d14/d2b/d84/d1c/f2c 2787016 0 2024-06-03T00:03:03.689 INFO:tasks.workunit.client.0.smithi049.stdout:2/364: write f4 [7048456,130601] 0 2024-06-03T00:03:03.689 INFO:tasks.workunit.client.0.smithi049.stdout:2/365: truncate f9 5786068 0 2024-06-03T00:03:03.690 INFO:tasks.workunit.client.0.smithi049.stdout:2/366: readlink da/d52/d37/l68 0 2024-06-03T00:03:03.690 INFO:tasks.workunit.client.0.smithi049.stdout:2/367: read da/d52/f6f [714611,33898] 0 2024-06-03T00:03:03.690 INFO:tasks.workunit.client.0.smithi049.stdout:6/434: dread d2/d3/d9/d23/d48/f61 [0,4194304] 0 2024-06-03T00:03:03.691 INFO:tasks.workunit.client.0.smithi049.stdout:6/435: fsync d2/d3/d17/d57/f75 0 2024-06-03T00:03:03.691 INFO:tasks.workunit.client.0.smithi049.stdout:6/436: dread - d2/d3/d9/d23/f82 zero size 2024-06-03T00:03:03.691 INFO:tasks.workunit.client.0.smithi049.stdout:4/446: creat d4/d3f/d14/d7f/d87/f92 x:0 0 0 2024-06-03T00:03:03.691 INFO:tasks.workunit.client.0.smithi049.stdout:4/447: write d4/f63 [1189771,51211] 0 2024-06-03T00:03:03.691 INFO:tasks.workunit.client.0.smithi049.stdout:4/448: truncate d4/d2a/f8c 663925 0 2024-06-03T00:03:03.693 INFO:tasks.workunit.client.0.smithi049.stdout:1/376: dread d1/d2f/d36/d37/f14 [0,4194304] 0 2024-06-03T00:03:03.693 INFO:tasks.workunit.client.0.smithi049.stdout:7/412: dwrite d3/d6/d9/d37/f67 [0,4194304] 0 2024-06-03T00:03:03.693 INFO:tasks.workunit.client.0.smithi049.stdout:1/377: write d1/d2f/d36/d37/d64/d6c/f7a [1188214,83747] 0 2024-06-03T00:03:03.693 INFO:tasks.workunit.client.0.smithi049.stdout:1/378: write d1/d1a/f25 [888755,17346] 0 2024-06-03T00:03:03.693 INFO:tasks.workunit.client.0.smithi049.stdout:2/368: getdents da/d52/df/d3c 0 2024-06-03T00:03:03.697 INFO:tasks.workunit.client.0.smithi049.stdout:4/449: rename d4/d3f/d14/d15/l49 to d4/d3f/d14/d2b/d84/d1c/d24/l93 0 2024-06-03T00:03:03.697 INFO:tasks.workunit.client.0.smithi049.stdout:3/254: dread d2/fe [0,4194304] 0 2024-06-03T00:03:03.699 INFO:tasks.workunit.client.0.smithi049.stdout:3/255: write d2/d14/d44/d52/f1e [4588643,107125] 0 2024-06-03T00:03:03.701 INFO:tasks.workunit.client.0.smithi049.stdout:3/256: getdents d2/d14/d22/d3a/d47 0 2024-06-03T00:03:03.702 INFO:tasks.workunit.client.0.smithi049.stdout:9/514: dwrite d1/d5/d13/d3b/d49/f64 [0,4194304] 0 2024-06-03T00:03:03.703 INFO:tasks.workunit.client.0.smithi049.stdout:3/257: truncate d2/fe 724058 0 2024-06-03T00:03:03.703 INFO:tasks.workunit.client.0.smithi049.stdout:6/437: dread d2/d3/d9/f3d [0,4194304] 0 2024-06-03T00:03:03.704 INFO:tasks.workunit.client.0.smithi049.stdout:5/366: truncate d3/d5/fd 4350715 0 2024-06-03T00:03:03.706 INFO:tasks.workunit.client.0.smithi049.stdout:6/438: fsync d2/d3/d9/d23/f1e 0 2024-06-03T00:03:03.706 INFO:tasks.workunit.client.0.smithi049.stdout:5/367: mkdir d3/d5/da/d55/d75 0 2024-06-03T00:03:03.706 INFO:tasks.workunit.client.0.smithi049.stdout:5/368: chown d3/d5/da 2834 1 2024-06-03T00:03:03.707 INFO:tasks.workunit.client.0.smithi049.stdout:5/369: truncate d3/d5/d2d/d4b/d51/f6c 504266 0 2024-06-03T00:03:03.707 INFO:tasks.workunit.client.0.smithi049.stdout:7/413: creat d3/d14/d6e/f98 x:0 0 0 2024-06-03T00:03:03.707 INFO:tasks.workunit.client.0.smithi049.stdout:7/414: write d3/d6/d13/d4a/f2f [2646669,78290] 0 2024-06-03T00:03:03.709 INFO:tasks.workunit.client.0.smithi049.stdout:5/370: creat d3/d5/d2d/d4b/d51/f76 x:0 0 0 2024-06-03T00:03:03.709 INFO:tasks.workunit.client.0.smithi049.stdout:5/371: readlink d3/l54 0 2024-06-03T00:03:03.711 INFO:tasks.workunit.client.0.smithi049.stdout:3/258: dread d2/d14/d44/d52/f3f [0,4194304] 0 2024-06-03T00:03:03.712 INFO:tasks.workunit.client.0.smithi049.stdout:5/372: symlink d3/d9/d20/d4c/d5a/l77 0 2024-06-03T00:03:03.712 INFO:tasks.workunit.client.0.smithi049.stdout:5/373: getdents d3/d5/da/d55/d75 0 2024-06-03T00:03:03.714 INFO:tasks.workunit.client.0.smithi049.stdout:2/369: link da/d52/df/c31 da/d52/d73/c7b 0 2024-06-03T00:03:03.714 INFO:tasks.workunit.client.0.smithi049.stdout:6/439: write d2/d3/d17/f62 [1208832,26659] 0 2024-06-03T00:03:03.714 INFO:tasks.workunit.client.0.smithi049.stdout:6/440: chown d2/d4d/d76/l78 124685529 1 2024-06-03T00:03:03.716 INFO:tasks.workunit.client.0.smithi049.stdout:4/450: stat d4/d3f/d14/d15/c4e 0 2024-06-03T00:03:03.716 INFO:tasks.workunit.client.0.smithi049.stdout:5/374: creat d3/d9/d68/f78 x:0 0 0 2024-06-03T00:03:03.718 INFO:tasks.workunit.client.0.smithi049.stdout:6/441: dread d2/d3/d9/d23/d48/f61 [0,4194304] 0 2024-06-03T00:03:03.719 INFO:tasks.workunit.client.0.smithi049.stdout:9/515: symlink d1/da/d27/d30/d5f/d81/da0/la4 0 2024-06-03T00:03:03.719 INFO:tasks.workunit.client.0.smithi049.stdout:9/516: write d1/d5/d13/f25 [4205432,99902] 0 2024-06-03T00:03:03.722 INFO:tasks.workunit.client.0.smithi049.stdout:2/370: rename da/d52/c3a to da/d52/d40/c7c 0 2024-06-03T00:03:03.723 INFO:tasks.workunit.client.0.smithi049.stdout:1/379: dwrite d1/d2f/d36/d37/f68 [0,4194304] 0 2024-06-03T00:03:03.724 INFO:tasks.workunit.client.0.smithi049.stdout:4/451: truncate d4/d3f/d14/d2b/d84/d1c/d4f/f61 3335586 0 2024-06-03T00:03:03.724 INFO:tasks.workunit.client.0.smithi049.stdout:4/452: fdatasync d4/d3f/d14/d2b/d84/d1c/d4f/f6e 0 2024-06-03T00:03:03.725 INFO:tasks.workunit.client.0.smithi049.stdout:9/517: mknod d1/ca5 0 2024-06-03T00:03:03.726 INFO:tasks.workunit.client.0.smithi049.stdout:6/442: dread d2/d3/d9/d23/d29/f59 [0,4194304] 0 2024-06-03T00:03:03.727 INFO:tasks.workunit.client.0.smithi049.stdout:7/415: dwrite d3/d6/d13/f94 [0,4194304] 0 2024-06-03T00:03:03.727 INFO:tasks.workunit.client.0.smithi049.stdout:1/380: write d1/d2f/d36/d37/f14 [1296220,129549] 0 2024-06-03T00:03:03.728 INFO:tasks.workunit.client.0.smithi049.stdout:4/453: creat d4/d2a/f94 x:0 0 0 2024-06-03T00:03:03.731 INFO:tasks.workunit.client.0.smithi049.stdout:6/443: rename d2/d3/d17/l33 to d2/d3/d9/d23/d48/d51/l95 0 2024-06-03T00:03:03.731 INFO:tasks.workunit.client.0.smithi049.stdout:6/444: readlink d2/d3/d9/l3a 0 2024-06-03T00:03:03.732 INFO:tasks.workunit.client.0.smithi049.stdout:6/445: write d2/d3/d9/d40/f87 [38941,115917] 0 2024-06-03T00:03:03.733 INFO:tasks.workunit.client.0.smithi049.stdout:1/381: unlink d1/d2f/d36/d37/d13/d34/f3b 0 2024-06-03T00:03:03.737 INFO:tasks.workunit.client.0.smithi049.stdout:4/454: rename d4/d3f/d14/d2b/d84/f44 to d4/d3f/d14/d2b/d84/d1c/d4f/f95 0 2024-06-03T00:03:03.737 INFO:tasks.workunit.client.0.smithi049.stdout:5/375: dwrite d3/d5/d2d/d4b/d51/f6c [0,4194304] 0 2024-06-03T00:03:03.739 INFO:tasks.workunit.client.0.smithi049.stdout:1/382: mknod d1/d2f/d36/d37/d2c/c86 0 2024-06-03T00:03:03.740 INFO:tasks.workunit.client.0.smithi049.stdout:1/383: read d1/d1a/f30 [334385,112390] 0 2024-06-03T00:03:03.740 INFO:tasks.workunit.client.0.smithi049.stdout:1/384: write d1/f2d [1630001,112801] 0 2024-06-03T00:03:03.742 INFO:tasks.workunit.client.0.smithi049.stdout:5/376: dread d3/d9/d20/f3d [0,4194304] 0 2024-06-03T00:03:03.744 INFO:tasks.workunit.client.0.smithi049.stdout:1/385: rename d1/d2f/d36/d37/d2c/l39 to d1/d2f/d36/d37/l87 0 2024-06-03T00:03:03.744 INFO:tasks.workunit.client.0.smithi049.stdout:4/455: dread d4/d3f/f62 [0,4194304] 0 2024-06-03T00:03:03.746 INFO:tasks.workunit.client.0.smithi049.stdout:1/386: creat d1/d1a/f88 x:0 0 0 2024-06-03T00:03:03.746 INFO:tasks.workunit.client.0.smithi049.stdout:5/377: rename d3/d9/d20/l23 to d3/d5/da/d55/d75/l79 0 2024-06-03T00:03:03.747 INFO:tasks.workunit.client.0.smithi049.stdout:5/378: truncate d3/d5/da/d55/d14/f19 2011771 0 2024-06-03T00:03:03.748 INFO:tasks.workunit.client.0.smithi049.stdout:5/379: read - d3/d9/d20/f41 zero size 2024-06-03T00:03:03.748 INFO:tasks.workunit.client.0.smithi049.stdout:1/387: rename d1/d2f/d36/d37/d13/l19 to d1/d1a/l89 0 2024-06-03T00:03:03.749 INFO:tasks.workunit.client.0.smithi049.stdout:5/380: symlink d3/d9/d20/d4c/d5a/l7a 0 2024-06-03T00:03:03.750 INFO:tasks.workunit.client.0.smithi049.stdout:9/518: getdents d1 0 2024-06-03T00:03:03.750 INFO:tasks.workunit.client.0.smithi049.stdout:9/519: write d1/d5/d13/d3b/d49/d58/f9c [575193,89712] 0 2024-06-03T00:03:03.750 INFO:tasks.workunit.client.0.smithi049.stdout:9/520: truncate d1/da/d27/d30/f97 359151 0 2024-06-03T00:03:03.752 INFO:tasks.workunit.client.0.smithi049.stdout:9/521: creat d1/d5/d1a/fa6 x:0 0 0 2024-06-03T00:03:03.752 INFO:tasks.workunit.client.0.smithi049.stdout:9/522: chown d1/d5/l9a 210 1 2024-06-03T00:03:03.754 INFO:tasks.workunit.client.0.smithi049.stdout:9/523: dread - d1/da/d27/f75 zero size 2024-06-03T00:03:03.755 INFO:tasks.workunit.client.0.smithi049.stdout:9/524: creat d1/d5/d13/d66/d87/fa7 x:0 0 0 2024-06-03T00:03:03.757 INFO:tasks.workunit.client.0.smithi049.stdout:9/525: rename d1/da/d27/d30 to d1/da/da8 0 2024-06-03T00:03:03.758 INFO:tasks.workunit.client.0.smithi049.stdout:2/371: dwrite da/d52/d37/d70/f71 [0,4194304] 0 2024-06-03T00:03:03.758 INFO:tasks.workunit.client.0.smithi049.stdout:3/259: dwrite d2/d14/d44/d52/f1e [0,4194304] 0 2024-06-03T00:03:03.762 INFO:tasks.workunit.client.0.smithi049.stdout:3/260: mknod d2/d14/d22/d3a/d47/c55 0 2024-06-03T00:03:03.766 INFO:tasks.workunit.client.0.smithi049.stdout:2/372: dread da/d52/df/f29 [0,4194304] 0 2024-06-03T00:03:03.766 INFO:tasks.workunit.client.0.smithi049.stdout:2/373: write da/d52/f13 [1886100,30478] 0 2024-06-03T00:03:03.766 INFO:tasks.workunit.client.0.smithi049.stdout:2/374: write da/d52/df/f2c [1126958,44869] 0 2024-06-03T00:03:03.766 INFO:tasks.workunit.client.0.smithi049.stdout:2/375: fsync da/d52/d40/f6e 0 2024-06-03T00:03:03.771 INFO:tasks.workunit.client.0.smithi049.stdout:2/376: creat da/d52/d40/d63/f7d x:0 0 0 2024-06-03T00:03:03.771 INFO:tasks.workunit.client.0.smithi049.stdout:2/377: fdatasync da/d52/df/d3c/d60/f78 0 2024-06-03T00:03:03.823 INFO:tasks.workunit.client.0.smithi049.stdout:0/292: sync 2024-06-03T00:03:03.824 INFO:tasks.workunit.client.0.smithi049.stdout:1/388: dwrite d1/d2f/d36/d37/d13/f47 [0,4194304] 0 2024-06-03T00:03:03.824 INFO:tasks.workunit.client.0.smithi049.stdout:7/416: dwrite d3/d6/d13/d4a/f2f [0,4194304] 0 2024-06-03T00:03:03.827 INFO:tasks.workunit.client.0.smithi049.stdout:7/417: rename d3/d6/d9/d8f/l3d to d3/d6/d13/l99 0 2024-06-03T00:03:03.827 INFO:tasks.workunit.client.0.smithi049.stdout:7/418: write d3/d6/d9/d37/f51 [1973734,86025] 0 2024-06-03T00:03:03.827 INFO:tasks.workunit.client.0.smithi049.stdout:7/419: chown d3/d6/d9/d8f/c43 237841574 1 2024-06-03T00:03:03.827 INFO:tasks.workunit.client.0.smithi049.stdout:8/299: sync 2024-06-03T00:03:03.827 INFO:tasks.workunit.client.0.smithi049.stdout:8/300: write d4/f17 [2210138,6745] 0 2024-06-03T00:03:03.828 INFO:tasks.workunit.client.0.smithi049.stdout:7/420: unlink d3/d6/d9/d37/f84 0 2024-06-03T00:03:03.829 INFO:tasks.workunit.client.0.smithi049.stdout:7/421: getdents d3/d6/d13/d54 0 2024-06-03T00:03:03.829 INFO:tasks.workunit.client.0.smithi049.stdout:8/301: symlink d4/d27/l5f 0 2024-06-03T00:03:03.830 INFO:tasks.workunit.client.0.smithi049.stdout:7/422: creat d3/d6/d9/d37/f9a x:0 0 0 2024-06-03T00:03:03.831 INFO:tasks.workunit.client.0.smithi049.stdout:7/423: rmdir d3/d6/d13/d3c 39 2024-06-03T00:03:03.831 INFO:tasks.workunit.client.0.smithi049.stdout:7/424: fdatasync d3/d6/d13/f7c 0 2024-06-03T00:03:03.837 INFO:tasks.workunit.client.0.smithi049.stdout:1/389: dread d1/d2f/d36/d37/f16 [0,4194304] 0 2024-06-03T00:03:03.838 INFO:tasks.workunit.client.0.smithi049.stdout:9/526: dwrite d1/da/d27/f3c [0,4194304] 0 2024-06-03T00:03:03.839 INFO:tasks.workunit.client.0.smithi049.stdout:1/390: creat d1/d1a/f8a x:0 0 0 2024-06-03T00:03:03.839 INFO:tasks.workunit.client.0.smithi049.stdout:1/391: chown d1/d2f/d36/d37/d2c/d45/d61/f69 7 1 2024-06-03T00:03:03.840 INFO:tasks.workunit.client.0.smithi049.stdout:9/527: rename d1/da/d27/l47 to d1/d5/d1a/d52/la9 0 2024-06-03T00:03:03.840 INFO:tasks.workunit.client.0.smithi049.stdout:9/528: stat d1/da/d26/c3a 0 2024-06-03T00:03:03.841 INFO:tasks.workunit.client.0.smithi049.stdout:1/392: getdents d1/d2f/d36/d37/d13/d71 0 2024-06-03T00:03:03.841 INFO:tasks.workunit.client.0.smithi049.stdout:4/456: dwrite d4/d3f/d14/d7f/d87/f92 [0,4194304] 0 2024-06-03T00:03:03.843 INFO:tasks.workunit.client.0.smithi049.stdout:9/529: unlink d1/d5/d13/f25 0 2024-06-03T00:03:03.843 INFO:tasks.workunit.client.0.smithi049.stdout:3/261: dwrite d2/d14/f1c [0,4194304] 0 2024-06-03T00:03:03.843 INFO:tasks.workunit.client.0.smithi049.stdout:1/393: creat d1/d2f/d36/d37/d64/f8b x:0 0 0 2024-06-03T00:03:03.844 INFO:tasks.workunit.client.0.smithi049.stdout:5/381: dwrite d3/d5/da/f50 [0,4194304] 0 2024-06-03T00:03:03.845 INFO:tasks.workunit.client.0.smithi049.stdout:4/457: creat d4/d2a/f96 x:0 0 0 2024-06-03T00:03:03.845 INFO:tasks.workunit.client.0.smithi049.stdout:4/458: chown d4/d3f/d14/d2b/d84 54462338 1 2024-06-03T00:03:03.845 INFO:tasks.workunit.client.0.smithi049.stdout:4/459: readlink d4/d3f/d14/d2b/d84/d1c/d24/d43/l5a 0 2024-06-03T00:03:03.845 INFO:tasks.workunit.client.0.smithi049.stdout:3/262: symlink d2/d1a/d31/l56 0 2024-06-03T00:03:03.847 INFO:tasks.workunit.client.0.smithi049.stdout:9/530: creat d1/da/d27/faa x:0 0 0 2024-06-03T00:03:03.847 INFO:tasks.workunit.client.0.smithi049.stdout:9/531: truncate d1/d5/d13/d3b/d49/d58/f98 289190 0 2024-06-03T00:03:03.848 INFO:tasks.workunit.client.0.smithi049.stdout:1/394: mkdir d1/d2f/d36/d37/d64/d6c/d8c 0 2024-06-03T00:03:03.848 INFO:tasks.workunit.client.0.smithi049.stdout:5/382: mknod d3/d5/d2d/d4b/d62/c7b 0 2024-06-03T00:03:03.849 INFO:tasks.workunit.client.0.smithi049.stdout:4/460: creat d4/d3f/d14/d2b/d84/d1c/d7a/f97 x:0 0 0 2024-06-03T00:03:03.849 INFO:tasks.workunit.client.0.smithi049.stdout:9/532: mknod d1/da/d26/cab 0 2024-06-03T00:03:03.850 INFO:tasks.workunit.client.0.smithi049.stdout:3/263: rename d2/l43 to d2/d14/d22/d3a/l57 0 2024-06-03T00:03:03.850 INFO:tasks.workunit.client.0.smithi049.stdout:3/264: chown d2/d14/d44/d52/d4c 30855 1 2024-06-03T00:03:03.850 INFO:tasks.workunit.client.0.smithi049.stdout:5/383: dread d3/f66 [0,4194304] 0 2024-06-03T00:03:03.850 INFO:tasks.workunit.client.0.smithi049.stdout:5/384: chown d3/d9/c52 44 1 2024-06-03T00:03:03.851 INFO:tasks.workunit.client.0.smithi049.stdout:5/385: dread - d3/d5/d2d/d4b/d51/f76 zero size 2024-06-03T00:03:03.851 INFO:tasks.workunit.client.0.smithi049.stdout:3/265: mkdir d2/d14/d44/d52/d4c/d4b/d58 0 2024-06-03T00:03:03.851 INFO:tasks.workunit.client.0.smithi049.stdout:3/266: rmdir d2/d14/d22/d3a 39 2024-06-03T00:03:03.852 INFO:tasks.workunit.client.0.smithi049.stdout:3/267: mknod d2/d14/c59 0 2024-06-03T00:03:03.854 INFO:tasks.workunit.client.0.smithi049.stdout:1/395: dread d1/d2f/d36/d37/d64/d6c/f7a [0,4194304] 0 2024-06-03T00:03:03.864 INFO:tasks.workunit.client.0.smithi049.stdout:0/293: dwrite d6/d29/d47/d4b/f51 [0,4194304] 0 2024-06-03T00:03:03.864 INFO:tasks.workunit.client.0.smithi049.stdout:0/294: truncate d6/d30/f5a 191651 0 2024-06-03T00:03:03.866 INFO:tasks.workunit.client.0.smithi049.stdout:7/425: dwrite d3/d6/d13/f7c [0,4194304] 0 2024-06-03T00:03:03.869 INFO:tasks.workunit.client.0.smithi049.stdout:7/426: getdents d3/d6/d13/d54/d96 0 2024-06-03T00:03:03.872 INFO:tasks.workunit.client.0.smithi049.stdout:7/427: creat d3/d6/d13/d3c/d4b/f9b x:0 0 0 2024-06-03T00:03:03.874 INFO:tasks.workunit.client.0.smithi049.stdout:1/396: dread d1/d1a/f63 [0,4194304] 0 2024-06-03T00:03:03.874 INFO:tasks.workunit.client.0.smithi049.stdout:1/397: readlink d1/d2f/d36/d37/d13/d34/l51 0 2024-06-03T00:03:03.874 INFO:tasks.workunit.client.0.smithi049.stdout:1/398: chown d1/d2f/d36/d37/d13/d34/d6e/f7f 0 1 2024-06-03T00:03:03.875 INFO:tasks.workunit.client.0.smithi049.stdout:0/295: dread f2 [0,4194304] 0 2024-06-03T00:03:03.876 INFO:tasks.workunit.client.0.smithi049.stdout:0/296: chown d6/d30/c26 0 1 2024-06-03T00:03:03.876 INFO:tasks.workunit.client.0.smithi049.stdout:9/533: dwrite d1/d5/d13/f4b [0,4194304] 0 2024-06-03T00:03:03.876 INFO:tasks.workunit.client.0.smithi049.stdout:1/399: symlink d1/d2f/d36/d37/d13/d34/d6e/l8d 0 2024-06-03T00:03:03.876 INFO:tasks.workunit.client.0.smithi049.stdout:0/297: mknod d6/d29/d2e/c66 0 2024-06-03T00:03:03.877 INFO:tasks.workunit.client.0.smithi049.stdout:1/400: unlink d1/f2d 0 2024-06-03T00:03:03.878 INFO:tasks.workunit.client.0.smithi049.stdout:0/298: getdents d6/d59 0 2024-06-03T00:03:03.878 INFO:tasks.workunit.client.0.smithi049.stdout:9/534: symlink d1/da/lac 0 2024-06-03T00:03:03.879 INFO:tasks.workunit.client.0.smithi049.stdout:9/535: getdents d1/d5/d13/d3b 0 2024-06-03T00:03:03.883 INFO:tasks.workunit.client.0.smithi049.stdout:7/428: write d3/d14/f2a [3346722,54851] 0 2024-06-03T00:03:03.884 INFO:tasks.workunit.client.0.smithi049.stdout:7/429: fsync d3/d6/f1c 0 2024-06-03T00:03:03.884 INFO:tasks.workunit.client.0.smithi049.stdout:3/268: dwrite d2/d1a/f1d [0,4194304] 0 2024-06-03T00:03:03.889 INFO:tasks.workunit.client.0.smithi049.stdout:5/386: dwrite d3/d9/d20/f2e [0,4194304] 0 2024-06-03T00:03:03.896 INFO:tasks.workunit.client.0.smithi049.stdout:7/430: write d3/d6/d13/f94 [1528560,65440] 0 2024-06-03T00:03:03.897 INFO:tasks.workunit.client.0.smithi049.stdout:5/387: dread d3/d5/da/f2b [0,4194304] 0 2024-06-03T00:03:03.898 INFO:tasks.workunit.client.0.smithi049.stdout:5/388: readlink d3/d5/d2d/l43 0 2024-06-03T00:03:03.899 INFO:tasks.workunit.client.0.smithi049.stdout:7/431: rename d3/d6/d9/d37 to d3/d6/d13/d3c/d48/d7b/d9c 0 2024-06-03T00:03:03.899 INFO:tasks.workunit.client.0.smithi049.stdout:5/389: creat d3/f7c x:0 0 0 2024-06-03T00:03:03.900 INFO:tasks.workunit.client.0.smithi049.stdout:5/390: chown d3/d5/d2d 209 1 2024-06-03T00:03:03.900 INFO:tasks.workunit.client.0.smithi049.stdout:3/269: dwrite d2/d1a/d34/f4f [0,4194304] 0 2024-06-03T00:03:03.900 INFO:tasks.workunit.client.0.smithi049.stdout:3/270: fsync d2/f39 0 2024-06-03T00:03:03.900 INFO:tasks.workunit.client.0.smithi049.stdout:3/271: fsync d2/d14/f54 0 2024-06-03T00:03:03.901 INFO:tasks.workunit.client.0.smithi049.stdout:3/272: write d2/d14/d22/d42/f38 [640332,6646] 0 2024-06-03T00:03:03.903 INFO:tasks.workunit.client.0.smithi049.stdout:3/273: mknod d2/d14/d22/d42/c5a 0 2024-06-03T00:03:03.903 INFO:tasks.workunit.client.0.smithi049.stdout:3/274: read d2/f39 [189555,85139] 0 2024-06-03T00:03:03.905 INFO:tasks.workunit.client.0.smithi049.stdout:3/275: creat d2/d14/d44/f5b x:0 0 0 2024-06-03T00:03:03.906 INFO:tasks.workunit.client.0.smithi049.stdout:3/276: read f0 [1351804,50091] 0 2024-06-03T00:03:03.906 INFO:tasks.workunit.client.0.smithi049.stdout:3/277: fdatasync d2/fe 0 2024-06-03T00:03:03.906 INFO:tasks.workunit.client.0.smithi049.stdout:5/391: dread d3/d5/d2d/d4b/f59 [0,4194304] 0 2024-06-03T00:03:03.906 INFO:tasks.workunit.client.0.smithi049.stdout:3/278: write d2/d14/d44/d52/d4c/f53 [945310,9336] 0 2024-06-03T00:03:03.906 INFO:tasks.workunit.client.0.smithi049.stdout:3/279: stat d2/d1a/d34 0 2024-06-03T00:03:03.906 INFO:tasks.workunit.client.0.smithi049.stdout:1/401: dwrite d1/d1a/f79 [0,4194304] 0 2024-06-03T00:03:03.906 INFO:tasks.workunit.client.0.smithi049.stdout:0/299: dwrite d6/d59/f5b [0,4194304] 0 2024-06-03T00:03:03.906 INFO:tasks.workunit.client.0.smithi049.stdout:0/300: fdatasync d6/d30/f5a 0 2024-06-03T00:03:03.906 INFO:tasks.workunit.client.0.smithi049.stdout:5/392: unlink d3/d5/da/l5e 0 2024-06-03T00:03:03.907 INFO:tasks.workunit.client.0.smithi049.stdout:0/301: mkdir d6/d29/d47/d4b/d67 0 2024-06-03T00:03:03.908 INFO:tasks.workunit.client.0.smithi049.stdout:1/402: symlink d1/d2f/d36/d37/d13/d34/d52/l8e 0 2024-06-03T00:03:03.909 INFO:tasks.workunit.client.0.smithi049.stdout:3/280: mkdir d2/d1a/d34/d5c 0 2024-06-03T00:03:03.909 INFO:tasks.workunit.client.0.smithi049.stdout:0/302: mknod d6/d29/d47/c68 0 2024-06-03T00:03:03.909 INFO:tasks.workunit.client.0.smithi049.stdout:0/303: chown d6/d29/l42 3862 1 2024-06-03T00:03:03.909 INFO:tasks.workunit.client.0.smithi049.stdout:7/432: rmdir d3/d6/d13/d3c/d48/d7b/d9c 39 2024-06-03T00:03:03.910 INFO:tasks.workunit.client.0.smithi049.stdout:3/281: creat d2/d1a/f5d x:0 0 0 2024-06-03T00:03:03.910 INFO:tasks.workunit.client.0.smithi049.stdout:3/282: chown d2/d1a/d34 32272 1 2024-06-03T00:03:03.911 INFO:tasks.workunit.client.0.smithi049.stdout:7/433: rename d3/d6/d13/d3c/d48/d7b/d9c/c52 to d3/d6/d3f/c9d 0 2024-06-03T00:03:03.911 INFO:tasks.workunit.client.0.smithi049.stdout:0/304: dread d6/f4e [0,4194304] 0 2024-06-03T00:03:03.912 INFO:tasks.workunit.client.0.smithi049.stdout:3/283: creat d2/d1a/d34/f5e x:0 0 0 2024-06-03T00:03:03.912 INFO:tasks.workunit.client.0.smithi049.stdout:7/434: symlink d3/d14/d7d/l9e 0 2024-06-03T00:03:03.912 INFO:tasks.workunit.client.0.smithi049.stdout:7/435: readlink d3/d6/d13/l99 0 2024-06-03T00:03:03.913 INFO:tasks.workunit.client.0.smithi049.stdout:0/305: symlink d6/l69 0 2024-06-03T00:03:03.913 INFO:tasks.workunit.client.0.smithi049.stdout:7/436: symlink d3/d6/d13/d3c/d4b/d8e/l9f 0 2024-06-03T00:03:03.914 INFO:tasks.workunit.client.0.smithi049.stdout:5/393: dread d3/f3a [0,4194304] 0 2024-06-03T00:03:03.914 INFO:tasks.workunit.client.0.smithi049.stdout:5/394: readlink d3/lb 0 2024-06-03T00:03:03.914 INFO:tasks.workunit.client.0.smithi049.stdout:5/395: write d3/d5/fd [802598,53395] 0 2024-06-03T00:03:03.915 INFO:tasks.workunit.client.0.smithi049.stdout:7/437: rmdir d3/d6/d13/d54/d60 0 2024-06-03T00:03:03.915 INFO:tasks.workunit.client.0.smithi049.stdout:7/438: truncate d3/d6/d9/d8f/f6c 203027 0 2024-06-03T00:03:03.915 INFO:tasks.workunit.client.0.smithi049.stdout:7/439: write d3/d6/d13/d79/f7e [267263,56132] 0 2024-06-03T00:03:03.915 INFO:tasks.workunit.client.0.smithi049.stdout:5/396: mkdir d3/d7d 0 2024-06-03T00:03:03.916 INFO:tasks.workunit.client.0.smithi049.stdout:1/403: dread d1/f1e [0,4194304] 0 2024-06-03T00:03:03.916 INFO:tasks.workunit.client.0.smithi049.stdout:1/404: fdatasync d1/d1a/f79 0 2024-06-03T00:03:03.916 INFO:tasks.workunit.client.0.smithi049.stdout:5/397: stat d3/l54 0 2024-06-03T00:03:03.916 INFO:tasks.workunit.client.0.smithi049.stdout:7/440: creat d3/d6/d9/d91/fa0 x:0 0 0 2024-06-03T00:03:03.917 INFO:tasks.workunit.client.0.smithi049.stdout:7/441: getdents d3/d6 0 2024-06-03T00:03:03.917 INFO:tasks.workunit.client.0.smithi049.stdout:7/442: write d3/d6/d13/f94 [759134,98248] 0 2024-06-03T00:03:03.922 INFO:tasks.workunit.client.0.smithi049.stdout:3/284: dread d2/d1a/d34/f4f [0,4194304] 0 2024-06-03T00:03:03.923 INFO:tasks.workunit.client.0.smithi049.stdout:3/285: creat d2/d1a/d31/f5f x:0 0 0 2024-06-03T00:03:03.925 INFO:tasks.workunit.client.0.smithi049.stdout:3/286: creat d2/d14/d44/d52/d4c/d4b/d58/f60 x:0 0 0 2024-06-03T00:03:03.927 INFO:tasks.workunit.client.0.smithi049.stdout:3/287: symlink d2/d1a/l61 0 2024-06-03T00:03:03.928 INFO:tasks.workunit.client.0.smithi049.stdout:3/288: creat d2/d1a/d34/f62 x:0 0 0 2024-06-03T00:03:03.928 INFO:tasks.workunit.client.0.smithi049.stdout:3/289: write d2/d1a/d31/f5f [702895,47541] 0 2024-06-03T00:03:03.930 INFO:tasks.workunit.client.0.smithi049.stdout:7/443: dread d3/d6/d13/f7c [0,4194304] 0 2024-06-03T00:03:03.930 INFO:tasks.workunit.client.0.smithi049.stdout:3/290: rmdir d2/d1a/d31 39 2024-06-03T00:03:03.930 INFO:tasks.workunit.client.0.smithi049.stdout:3/291: chown d2/d14/c4d 149373032 1 2024-06-03T00:03:03.930 INFO:tasks.workunit.client.0.smithi049.stdout:3/292: read - d2/d14/d44/d52/d4c/f30 zero size 2024-06-03T00:03:03.931 INFO:tasks.workunit.client.0.smithi049.stdout:7/444: creat d3/d6/d13/d3c/d4b/d5a/fa1 x:0 0 0 2024-06-03T00:03:03.931 INFO:tasks.workunit.client.0.smithi049.stdout:7/445: chown d3/d6/d13/d3c/d48/d7b/d9c/f9a 5298692 1 2024-06-03T00:03:03.931 INFO:tasks.workunit.client.0.smithi049.stdout:3/293: creat d2/d14/f63 x:0 0 0 2024-06-03T00:03:03.933 INFO:tasks.workunit.client.0.smithi049.stdout:3/294: unlink d2/d14/f1c 0 2024-06-03T00:03:03.934 INFO:tasks.workunit.client.0.smithi049.stdout:3/295: rmdir d2 39 2024-06-03T00:03:03.936 INFO:tasks.workunit.client.0.smithi049.stdout:5/398: dwrite d3/d5/d2d/d4b/d51/f6c [4194304,4194304] 0 2024-06-03T00:03:03.936 INFO:tasks.workunit.client.0.smithi049.stdout:3/296: mkdir d2/d1a/d51/d64 0 2024-06-03T00:03:03.939 INFO:tasks.workunit.client.0.smithi049.stdout:5/399: symlink d3/d5/d2d/d4b/d62/l7e 0 2024-06-03T00:03:03.939 INFO:tasks.workunit.client.0.smithi049.stdout:5/400: rename d3/d5/da to d3/d5/da/d55/d7f 22 2024-06-03T00:03:03.939 INFO:tasks.workunit.client.0.smithi049.stdout:3/297: getdents d2/d14/d22/d3a/d47 0 2024-06-03T00:03:03.939 INFO:tasks.workunit.client.0.smithi049.stdout:3/298: write d2/d1a/f37 [970760,112359] 0 2024-06-03T00:03:03.943 INFO:tasks.workunit.client.0.smithi049.stdout:1/405: dwrite d1/d2f/d36/d37/d2c/f60 [0,4194304] 0 2024-06-03T00:03:03.945 INFO:tasks.workunit.client.0.smithi049.stdout:1/406: mkdir d1/d2f/d36/d37/d13/d34/d8f 0 2024-06-03T00:03:03.945 INFO:tasks.workunit.client.0.smithi049.stdout:1/407: write d1/d2f/d36/d37/d2c/d45/d61/d67/f6d [571598,55209] 0 2024-06-03T00:03:03.945 INFO:tasks.workunit.client.0.smithi049.stdout:5/401: rename d3/d5/da/f44 to d3/d5/da/d55/d14/d16/f80 0 2024-06-03T00:03:03.947 INFO:tasks.workunit.client.0.smithi049.stdout:1/408: rmdir d1 39 2024-06-03T00:03:03.948 INFO:tasks.workunit.client.0.smithi049.stdout:3/299: creat d2/d1a/f65 x:0 0 0 2024-06-03T00:03:03.948 INFO:tasks.workunit.client.0.smithi049.stdout:1/409: getdents d1/d2f/d36/d37/d2c/d45/d5e 0 2024-06-03T00:03:03.948 INFO:tasks.workunit.client.0.smithi049.stdout:1/410: fsync d1/d2f/d36/d37/d2c/d45/d61/d70/f85 0 2024-06-03T00:03:03.948 INFO:tasks.workunit.client.0.smithi049.stdout:1/411: read d1/d2f/d36/d37/d13/f27 [1561703,73500] 0 2024-06-03T00:03:03.949 INFO:tasks.workunit.client.0.smithi049.stdout:3/300: truncate d2/d1a/d34/f4f 3273779 0 2024-06-03T00:03:03.949 INFO:tasks.workunit.client.0.smithi049.stdout:3/301: write d2/d1a/d34/f48 [1698677,30240] 0 2024-06-03T00:03:03.949 INFO:tasks.workunit.client.0.smithi049.stdout:7/446: dwrite d3/d6/d9/d91/fa0 [0,4194304] 0 2024-06-03T00:03:03.949 INFO:tasks.workunit.client.0.smithi049.stdout:1/412: dread d1/d1a/f30 [0,4194304] 0 2024-06-03T00:03:03.950 INFO:tasks.workunit.client.0.smithi049.stdout:3/302: creat d2/d1a/f66 x:0 0 0 2024-06-03T00:03:03.951 INFO:tasks.workunit.client.0.smithi049.stdout:1/413: unlink d1/d2f/d36/d37/d13/d42/c49 0 2024-06-03T00:03:03.952 INFO:tasks.workunit.client.0.smithi049.stdout:1/414: symlink d1/d2f/d36/d37/d13/d42/d7d/l90 0 2024-06-03T00:03:03.954 INFO:tasks.workunit.client.0.smithi049.stdout:3/303: dread d2/d1a/d31/f5f [0,4194304] 0 2024-06-03T00:03:03.955 INFO:tasks.workunit.client.0.smithi049.stdout:7/447: dread d3/f30 [0,4194304] 0 2024-06-03T00:03:03.955 INFO:tasks.workunit.client.0.smithi049.stdout:7/448: chown d3/d32/d95 344035990 1 2024-06-03T00:03:03.955 INFO:tasks.workunit.client.0.smithi049.stdout:5/402: write d3/d5/da/d55/d14/d16/f25 [405661,90492] 0 2024-06-03T00:03:03.955 INFO:tasks.workunit.client.0.smithi049.stdout:7/449: write d3/d14/d7d/f8b [742511,85692] 0 2024-06-03T00:03:03.955 INFO:tasks.workunit.client.0.smithi049.stdout:7/450: read d3/d14/f2a [3316497,93746] 0 2024-06-03T00:03:03.955 INFO:tasks.workunit.client.0.smithi049.stdout:7/451: chown d3/d6/d13/d3c/d48/c56 172753820 1 2024-06-03T00:03:03.956 INFO:tasks.workunit.client.0.smithi049.stdout:7/452: creat d3/d6/d13/d4a/fa2 x:0 0 0 2024-06-03T00:03:03.956 INFO:tasks.workunit.client.0.smithi049.stdout:5/403: mknod d3/d9/d20/d4c/c81 0 2024-06-03T00:03:03.956 INFO:tasks.workunit.client.0.smithi049.stdout:5/404: read - d3/f7c zero size 2024-06-03T00:03:03.958 INFO:tasks.workunit.client.0.smithi049.stdout:7/453: rmdir d3/d6/d13/d3c/d48/d7b/d9c 39 2024-06-03T00:03:03.959 INFO:tasks.workunit.client.0.smithi049.stdout:7/454: symlink d3/d6/d13/d3c/d48/la3 0 2024-06-03T00:03:03.961 INFO:tasks.workunit.client.0.smithi049.stdout:7/455: getdents d3/d6/d9 0 2024-06-03T00:03:03.962 INFO:tasks.workunit.client.0.smithi049.stdout:5/405: truncate d3/d5/fd 1135796 0 2024-06-03T00:03:03.962 INFO:tasks.workunit.client.0.smithi049.stdout:5/406: chown d3/d5/d24/f5f 2793 1 2024-06-03T00:03:03.962 INFO:tasks.workunit.client.0.smithi049.stdout:5/407: write d3/d5/da/d55/d14/d16/f34 [284000,100351] 0 2024-06-03T00:03:03.964 INFO:tasks.workunit.client.0.smithi049.stdout:5/408: mknod d3/d5/da/d55/d14/d16/c82 0 2024-06-03T00:03:03.966 INFO:tasks.workunit.client.0.smithi049.stdout:5/409: creat d3/d9/d68/f83 x:0 0 0 2024-06-03T00:03:03.966 INFO:tasks.workunit.client.0.smithi049.stdout:5/410: chown d3/d5/c6 9821888 1 2024-06-03T00:03:03.967 INFO:tasks.workunit.client.0.smithi049.stdout:5/411: mknod d3/c84 0 2024-06-03T00:03:03.968 INFO:tasks.workunit.client.0.smithi049.stdout:5/412: write d3/d5/d24/f38 [1191179,66356] 0 2024-06-03T00:03:03.968 INFO:tasks.workunit.client.0.smithi049.stdout:5/413: stat d3/d5/fd 0 2024-06-03T00:03:03.970 INFO:tasks.workunit.client.0.smithi049.stdout:5/414: mknod d3/d7d/c85 0 2024-06-03T00:03:03.971 INFO:tasks.workunit.client.0.smithi049.stdout:1/415: dwrite d1/d2f/d36/d37/d2c/d45/d61/d70/f82 [0,4194304] 0 2024-06-03T00:03:03.971 INFO:tasks.workunit.client.0.smithi049.stdout:1/416: fsync d1/d2f/d36/d37/d2c/d45/d5e/f6f 0 2024-06-03T00:03:03.974 INFO:tasks.workunit.client.0.smithi049.stdout:1/417: symlink d1/d2f/d36/d37/l91 0 2024-06-03T00:03:03.977 INFO:tasks.workunit.client.0.smithi049.stdout:5/415: dread d3/d5/da/d55/d14/d16/f25 [0,4194304] 0 2024-06-03T00:03:03.978 INFO:tasks.workunit.client.0.smithi049.stdout:5/416: chown d3/d5/d2d/f36 89 1 2024-06-03T00:03:03.979 INFO:tasks.workunit.client.0.smithi049.stdout:7/456: dwrite d3/d6/d9/d91/fa0 [0,4194304] 0 2024-06-03T00:03:03.983 INFO:tasks.workunit.client.0.smithi049.stdout:1/418: getdents d1/d2f/d36/d37 0 2024-06-03T00:03:03.983 INFO:tasks.workunit.client.0.smithi049.stdout:1/419: write d1/d2f/d36/d37/d64/f8b [244460,1409] 0 2024-06-03T00:03:03.984 INFO:tasks.workunit.client.0.smithi049.stdout:1/420: creat d1/d2f/d36/d37/d64/d6c/f92 x:0 0 0 2024-06-03T00:03:03.985 INFO:tasks.workunit.client.0.smithi049.stdout:1/421: link d1/d1a/f63 d1/d2f/d36/d57/d72/f93 0 2024-06-03T00:03:03.986 INFO:tasks.workunit.client.0.smithi049.stdout:1/422: truncate d1/d2f/d36/d37/f16 1660507 0 2024-06-03T00:03:03.987 INFO:tasks.workunit.client.0.smithi049.stdout:1/423: rmdir d1/d2f/d36/d37/d2c 39 2024-06-03T00:03:03.988 INFO:tasks.workunit.client.0.smithi049.stdout:1/424: mkdir d1/d2f/d36/d37/d13/d34/d8f/d94 0 2024-06-03T00:03:03.988 INFO:tasks.workunit.client.0.smithi049.stdout:1/425: fdatasync d1/d2f/d36/d37/d64/d6c/f92 0 2024-06-03T00:03:03.988 INFO:tasks.workunit.client.0.smithi049.stdout:1/426: chown d1/d2f/d36/d37/d13/d34/d52/c58 28590 1 2024-06-03T00:03:03.988 INFO:tasks.workunit.client.0.smithi049.stdout:1/427: chown d1/d2f/d36/d37/d13/d34/d52/c58 32228 1 2024-06-03T00:03:03.988 INFO:tasks.workunit.client.0.smithi049.stdout:1/428: fdatasync d1/d2f/f46 0 2024-06-03T00:03:03.989 INFO:tasks.workunit.client.0.smithi049.stdout:1/429: chown d1/d1a/l65 20 1 2024-06-03T00:03:04.048 INFO:tasks.workunit.client.0.smithi049.stdout:2/378: sync 2024-06-03T00:03:04.048 INFO:tasks.workunit.client.0.smithi049.stdout:6/446: sync 2024-06-03T00:03:04.048 INFO:tasks.workunit.client.0.smithi049.stdout:4/461: sync 2024-06-03T00:03:04.049 INFO:tasks.workunit.client.0.smithi049.stdout:8/302: sync 2024-06-03T00:03:04.049 INFO:tasks.workunit.client.0.smithi049.stdout:2/379: stat da/d52/d40/f4f 0 2024-06-03T00:03:04.049 INFO:tasks.workunit.client.0.smithi049.stdout:6/447: chown d2/d3/d9/d55/l90 1 1 2024-06-03T00:03:04.050 INFO:tasks.workunit.client.0.smithi049.stdout:2/380: creat da/d43/f7e x:0 0 0 2024-06-03T00:03:04.050 INFO:tasks.workunit.client.0.smithi049.stdout:2/381: creat da/d52/d49/f7f x:0 0 0 2024-06-03T00:03:04.052 INFO:tasks.workunit.client.0.smithi049.stdout:2/382: getdents da/d52/d37/d59 0 2024-06-03T00:03:04.052 INFO:tasks.workunit.client.0.smithi049.stdout:2/383: readlink da/d52/d40/d63/l54 0 2024-06-03T00:03:04.052 INFO:tasks.workunit.client.0.smithi049.stdout:2/384: dread - da/d43/f7e zero size 2024-06-03T00:03:04.052 INFO:tasks.workunit.client.0.smithi049.stdout:2/385: mkdir da/d52/d37/d59/d80 0 2024-06-03T00:03:04.052 INFO:tasks.workunit.client.0.smithi049.stdout:2/386: dread - da/d43/f7e zero size 2024-06-03T00:03:04.057 INFO:tasks.workunit.client.0.smithi049.stdout:6/448: dread d2/d3/d9/d23/d36/f45 [0,4194304] 0 2024-06-03T00:03:04.057 INFO:tasks.workunit.client.0.smithi049.stdout:6/449: read d2/d3/d17/d57/f75 [1378625,32223] 0 2024-06-03T00:03:04.057 INFO:tasks.workunit.client.0.smithi049.stdout:6/450: mknod d2/d3/d9/d23/d36/d72/c96 0 2024-06-03T00:03:04.058 INFO:tasks.workunit.client.0.smithi049.stdout:6/451: mkdir d2/d3/d9/d23/d29/d30/d97 0 2024-06-03T00:03:04.060 INFO:tasks.workunit.client.0.smithi049.stdout:4/462: read d4/d3f/d14/d15/f6a [2124172,123618] 0 2024-06-03T00:03:04.066 INFO:tasks.workunit.client.0.smithi049.stdout:4/463: read f2 [592155,75196] 0 2024-06-03T00:03:04.066 INFO:tasks.workunit.client.0.smithi049.stdout:4/464: fsync d4/d3f/d14/d2b/d84/d1c/f7e 0 2024-06-03T00:03:04.066 INFO:tasks.workunit.client.0.smithi049.stdout:4/465: stat d4/d3f/d14/l2d 0 2024-06-03T00:03:04.066 INFO:tasks.workunit.client.0.smithi049.stdout:4/466: readlink d4/l77 0 2024-06-03T00:03:04.067 INFO:tasks.workunit.client.0.smithi049.stdout:8/303: dwrite d4/d27/d30/f41 [0,4194304] 0 2024-06-03T00:03:04.068 INFO:tasks.workunit.client.0.smithi049.stdout:4/467: creat d4/d3f/f98 x:0 0 0 2024-06-03T00:03:04.068 INFO:tasks.workunit.client.0.smithi049.stdout:4/468: chown d4/d3f/d14/c73 1099745 1 2024-06-03T00:03:04.068 INFO:tasks.workunit.client.0.smithi049.stdout:4/469: read d4/d3f/f56 [73234,2247] 0 2024-06-03T00:03:04.074 INFO:tasks.workunit.client.0.smithi049.stdout:6/452: dwrite d2/d3/d9/d23/d29/f2d [0,4194304] 0 2024-06-03T00:03:04.076 INFO:tasks.workunit.client.0.smithi049.stdout:6/453: creat d2/d3/f98 x:0 0 0 2024-06-03T00:03:04.083 INFO:tasks.workunit.client.0.smithi049.stdout:4/470: dwrite d4/d3f/d14/d2b/d84/d1c/d7a/f97 [0,4194304] 0 2024-06-03T00:03:04.100 INFO:tasks.workunit.client.0.smithi049.stdout:4/471: dwrite d4/d2a/f34 [0,4194304] 0 2024-06-03T00:03:04.100 INFO:tasks.workunit.client.0.smithi049.stdout:4/472: fdatasync d4/f6c 0 2024-06-03T00:03:04.108 INFO:tasks.workunit.client.0.smithi049.stdout:4/473: write d4/ff [3741236,112380] 0 2024-06-03T00:03:04.132 INFO:tasks.workunit.client.0.smithi049.stdout:6/454: dwrite d2/d3/d9/d23/d48/d51/f83 [0,4194304] 0 2024-06-03T00:03:04.137 INFO:tasks.workunit.client.0.smithi049.stdout:6/455: dread d2/d3/d17/f62 [0,4194304] 0 2024-06-03T00:03:04.137 INFO:tasks.workunit.client.0.smithi049.stdout:6/456: readlink d2/d3/d9/d23/l3f 0 2024-06-03T00:03:04.137 INFO:tasks.workunit.client.0.smithi049.stdout:6/457: dread - d2/f3e zero size 2024-06-03T00:03:04.137 INFO:tasks.workunit.client.0.smithi049.stdout:6/458: truncate d2/d3/d9/d23/d48/f70 791102 0 2024-06-03T00:03:04.138 INFO:tasks.workunit.client.0.smithi049.stdout:6/459: link d2/l6 d2/d3/d17/d57/d6e/l99 0 2024-06-03T00:03:04.139 INFO:tasks.workunit.client.0.smithi049.stdout:6/460: getdents d2/d3/d9 0 2024-06-03T00:03:04.159 INFO:tasks.workunit.client.0.smithi049.stdout:6/461: dwrite d2/d3/d9/f27 [0,4194304] 0 2024-06-03T00:03:05.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:05 smithi049 ceph-mon[32302]: pgmap v474: 97 pgs: 97 active+clean; 364 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 34 MiB/s rd, 48 MiB/s wr, 1.47k op/s 2024-06-03T00:03:05.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:05 smithi107 ceph-mon[37048]: pgmap v474: 97 pgs: 97 active+clean; 364 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 34 MiB/s rd, 48 MiB/s wr, 1.47k op/s 2024-06-03T00:03:05.391 INFO:tasks.workunit.client.0.smithi049.stdout:7/457: sync 2024-06-03T00:03:05.391 INFO:tasks.workunit.client.0.smithi049.stdout:2/387: sync 2024-06-03T00:03:05.391 INFO:tasks.workunit.client.0.smithi049.stdout:4/474: sync 2024-06-03T00:03:05.391 INFO:tasks.workunit.client.0.smithi049.stdout:2/388: chown da/l17 11760545 1 2024-06-03T00:03:05.391 INFO:tasks.workunit.client.0.smithi049.stdout:8/304: sync 2024-06-03T00:03:05.391 INFO:tasks.workunit.client.0.smithi049.stdout:1/430: sync 2024-06-03T00:03:05.392 INFO:tasks.workunit.client.0.smithi049.stdout:4/475: readlink d4/d3f/d14/l21 0 2024-06-03T00:03:05.392 INFO:tasks.workunit.client.0.smithi049.stdout:0/306: sync 2024-06-03T00:03:05.392 INFO:tasks.workunit.client.0.smithi049.stdout:3/304: sync 2024-06-03T00:03:05.392 INFO:tasks.workunit.client.0.smithi049.stdout:9/536: sync 2024-06-03T00:03:05.392 INFO:tasks.workunit.client.0.smithi049.stdout:2/389: read da/d52/f26 [206532,31596] 0 2024-06-03T00:03:05.392 INFO:tasks.workunit.client.0.smithi049.stdout:9/537: fdatasync d1/d5/d13/d66/d87/f8c 0 2024-06-03T00:03:05.392 INFO:tasks.workunit.client.0.smithi049.stdout:2/390: dread - da/d52/df/d3c/f76 zero size 2024-06-03T00:03:05.392 INFO:tasks.workunit.client.0.smithi049.stdout:2/391: truncate da/d52/df/d3c/f76 697910 0 2024-06-03T00:03:05.392 INFO:tasks.workunit.client.0.smithi049.stdout:1/431: write d1/d2f/d36/d37/d2c/d45/d5e/f6f [1151853,119211] 0 2024-06-03T00:03:05.392 INFO:tasks.workunit.client.0.smithi049.stdout:6/462: sync 2024-06-03T00:03:05.392 INFO:tasks.workunit.client.0.smithi049.stdout:5/417: sync 2024-06-03T00:03:05.392 INFO:tasks.workunit.client.0.smithi049.stdout:6/463: readlink d2/d4d/l7 0 2024-06-03T00:03:05.392 INFO:tasks.workunit.client.0.smithi049.stdout:6/464: readlink d2/l50 0 2024-06-03T00:03:05.393 INFO:tasks.workunit.client.0.smithi049.stdout:6/465: dread - d2/d3/d17/d57/d6e/d88/f94 zero size 2024-06-03T00:03:05.393 INFO:tasks.workunit.client.0.smithi049.stdout:4/476: symlink d4/d3f/d14/d2b/d84/d69/l99 0 2024-06-03T00:03:05.393 INFO:tasks.workunit.client.0.smithi049.stdout:7/458: rename d3/d32/c4f to d3/d6/d13/d3c/d4b/d8e/ca4 0 2024-06-03T00:03:05.393 INFO:tasks.workunit.client.0.smithi049.stdout:2/392: creat da/d72/f81 x:0 0 0 2024-06-03T00:03:05.393 INFO:tasks.workunit.client.0.smithi049.stdout:2/393: truncate da/f45 2964755 0 2024-06-03T00:03:05.394 INFO:tasks.workunit.client.0.smithi049.stdout:2/394: creat da/d52/f82 x:0 0 0 2024-06-03T00:03:05.395 INFO:tasks.workunit.client.0.smithi049.stdout:2/395: truncate da/d43/f7e 938083 0 2024-06-03T00:03:05.395 INFO:tasks.workunit.client.0.smithi049.stdout:2/396: truncate da/f1c 311121 0 2024-06-03T00:03:05.396 INFO:tasks.workunit.client.0.smithi049.stdout:6/466: rename d2/d3/d9/d23/d36/d72/c96 to d2/d3/d9/d23/d36/c9a 0 2024-06-03T00:03:05.398 INFO:tasks.workunit.client.0.smithi049.stdout:7/459: symlink d3/d6/d86/d8d/la5 0 2024-06-03T00:03:05.398 INFO:tasks.workunit.client.0.smithi049.stdout:7/460: chown d3/d6/d86/d90 112394 1 2024-06-03T00:03:05.398 INFO:tasks.workunit.client.0.smithi049.stdout:7/461: fdatasync d3/d6/f25 0 2024-06-03T00:03:05.401 INFO:tasks.workunit.client.0.smithi049.stdout:7/462: unlink d3/d32/f41 0 2024-06-03T00:03:05.401 INFO:tasks.workunit.client.0.smithi049.stdout:5/418: write d3/d5/da/d55/d14/d16/f80 [4138787,130961] 0 2024-06-03T00:03:05.401 INFO:tasks.workunit.client.0.smithi049.stdout:1/432: dread d1/d2f/d36/d37/f68 [0,4194304] 0 2024-06-03T00:03:05.401 INFO:tasks.workunit.client.0.smithi049.stdout:8/305: write d4/d7/d28/f36 [1485207,6219] 0 2024-06-03T00:03:05.402 INFO:tasks.workunit.client.0.smithi049.stdout:7/463: link d3/d6/d13/d54/f4d d3/d6/d9/fa6 0 2024-06-03T00:03:05.404 INFO:tasks.workunit.client.0.smithi049.stdout:7/464: creat d3/d6/d13/d3c/d4b/fa7 x:0 0 0 2024-06-03T00:03:05.405 INFO:tasks.workunit.client.0.smithi049.stdout:1/433: creat d1/d2f/d36/d37/d13/d34/d8f/d94/f95 x:0 0 0 2024-06-03T00:03:05.407 INFO:tasks.workunit.client.0.smithi049.stdout:7/465: rename d3/d6/d9/lb to d3/d6/d13/d3c/d4b/d5a/la8 0 2024-06-03T00:03:05.407 INFO:tasks.workunit.client.0.smithi049.stdout:8/306: link d4/d7/c42 d4/d7/d28/d52/c60 0 2024-06-03T00:03:05.408 INFO:tasks.workunit.client.0.smithi049.stdout:8/307: chown d4/d7/d28/l55 386291472 1 2024-06-03T00:03:05.408 INFO:tasks.workunit.client.0.smithi049.stdout:8/308: write d4/d27/d3c/f2c [4675041,68011] 0 2024-06-03T00:03:05.408 INFO:tasks.workunit.client.0.smithi049.stdout:8/309: dread - d4/d27/d3c/f2f zero size 2024-06-03T00:03:05.409 INFO:tasks.workunit.client.0.smithi049.stdout:7/466: creat d3/d6/d86/fa9 x:0 0 0 2024-06-03T00:03:05.410 INFO:tasks.workunit.client.0.smithi049.stdout:1/434: rename d1/d2f/d36/d37/l26 to d1/d2f/d50/d6b/l96 0 2024-06-03T00:03:05.411 INFO:tasks.workunit.client.0.smithi049.stdout:9/538: dread d1/d5/d13/f53 [0,4194304] 0 2024-06-03T00:03:05.411 INFO:tasks.workunit.client.0.smithi049.stdout:1/435: getdents d1/d2f/d36/d57/d72 0 2024-06-03T00:03:05.413 INFO:tasks.workunit.client.0.smithi049.stdout:3/305: dwrite d2/d1a/f65 [0,4194304] 0 2024-06-03T00:03:05.413 INFO:tasks.workunit.client.0.smithi049.stdout:6/467: write d2/d3/d9/d23/d29/f2d [1858651,60444] 0 2024-06-03T00:03:05.413 INFO:tasks.workunit.client.0.smithi049.stdout:9/539: rmdir d1/d5/d7a 0 2024-06-03T00:03:05.414 INFO:tasks.workunit.client.0.smithi049.stdout:9/540: chown d1/da/da8 42253 1 2024-06-03T00:03:05.414 INFO:tasks.workunit.client.0.smithi049.stdout:5/419: read d3/d5/da/f1b [353321,81727] 0 2024-06-03T00:03:05.414 INFO:tasks.workunit.client.0.smithi049.stdout:2/397: write da/f47 [1338300,10858] 0 2024-06-03T00:03:05.414 INFO:tasks.workunit.client.0.smithi049.stdout:6/468: creat d2/d3/d9/d23/f9b x:0 0 0 2024-06-03T00:03:05.415 INFO:tasks.workunit.client.0.smithi049.stdout:6/469: mknod d2/d3/d9/d23/d29/d30/c9c 0 2024-06-03T00:03:05.417 INFO:tasks.workunit.client.0.smithi049.stdout:9/541: mkdir d1/d5/d13/d3b/dad 0 2024-06-03T00:03:05.418 INFO:tasks.workunit.client.0.smithi049.stdout:5/420: unlink d3/d5/d2d/f40 0 2024-06-03T00:03:05.418 INFO:tasks.workunit.client.0.smithi049.stdout:5/421: readlink d3/d5/da/d55/d14/d16/l45 0 2024-06-03T00:03:05.418 INFO:tasks.workunit.client.0.smithi049.stdout:5/422: write d3/d5/da/f27 [1531856,125944] 0 2024-06-03T00:03:05.420 INFO:tasks.workunit.client.0.smithi049.stdout:7/467: write d3/d6/d13/d4a/f2f [4161141,21603] 0 2024-06-03T00:03:05.420 INFO:tasks.workunit.client.0.smithi049.stdout:7/468: stat d3/d32/f80 0 2024-06-03T00:03:05.420 INFO:tasks.workunit.client.0.smithi049.stdout:8/310: dread d4/d7/f13 [0,4194304] 0 2024-06-03T00:03:05.420 INFO:tasks.workunit.client.0.smithi049.stdout:8/311: readlink d4/d27/l5f 0 2024-06-03T00:03:05.422 INFO:tasks.workunit.client.0.smithi049.stdout:2/398: mkdir da/d72/d83 0 2024-06-03T00:03:05.422 INFO:tasks.workunit.client.0.smithi049.stdout:5/423: mknod d3/d5/d24/c86 0 2024-06-03T00:03:05.424 INFO:tasks.workunit.client.0.smithi049.stdout:9/542: unlink d1/da/lac 0 2024-06-03T00:03:05.424 INFO:tasks.workunit.client.0.smithi049.stdout:8/312: rename d4/d7/f1a to d4/d7/f61 0 2024-06-03T00:03:05.424 INFO:tasks.workunit.client.0.smithi049.stdout:8/313: dread - d4/d27/d30/d4f/f5a zero size 2024-06-03T00:03:05.425 INFO:tasks.workunit.client.0.smithi049.stdout:1/436: write d1/d2f/d36/d37/f33 [3843034,9551] 0 2024-06-03T00:03:05.426 INFO:tasks.workunit.client.0.smithi049.stdout:9/543: link d1/da/d26/l67 d1/da/da8/d5f/d81/lae 0 2024-06-03T00:03:05.426 INFO:tasks.workunit.client.0.smithi049.stdout:9/544: write d1/d5/d1a/f4e [421760,127283] 0 2024-06-03T00:03:05.427 INFO:tasks.workunit.client.0.smithi049.stdout:5/424: unlink d3/d9/c52 0 2024-06-03T00:03:05.428 INFO:tasks.workunit.client.0.smithi049.stdout:9/545: creat d1/faf x:0 0 0 2024-06-03T00:03:05.428 INFO:tasks.workunit.client.0.smithi049.stdout:6/470: dread d2/d3/d9/f27 [0,4194304] 0 2024-06-03T00:03:05.428 INFO:tasks.workunit.client.0.smithi049.stdout:5/425: symlink d3/d5/da/d55/l87 0 2024-06-03T00:03:05.429 INFO:tasks.workunit.client.0.smithi049.stdout:5/426: chown d3/d5/da/d55/d14 0 1 2024-06-03T00:03:05.429 INFO:tasks.workunit.client.0.smithi049.stdout:9/546: truncate d1/da/da8/f34 3139671 0 2024-06-03T00:03:05.429 INFO:tasks.workunit.client.0.smithi049.stdout:0/307: dwrite d6/d29/d47/d4b/f51 [4194304,4194304] 0 2024-06-03T00:03:05.430 INFO:tasks.workunit.client.0.smithi049.stdout:6/471: symlink d2/d3/d9/d23/d48/d53/l9d 0 2024-06-03T00:03:05.431 INFO:tasks.workunit.client.0.smithi049.stdout:6/472: chown d2/d3/d9/f71 0 1 2024-06-03T00:03:05.433 INFO:tasks.workunit.client.0.smithi049.stdout:6/473: symlink d2/d3/d9/d23/d36/l9e 0 2024-06-03T00:03:05.433 INFO:tasks.workunit.client.0.smithi049.stdout:5/427: dread d3/f66 [0,4194304] 0 2024-06-03T00:03:05.433 INFO:tasks.workunit.client.0.smithi049.stdout:5/428: write d3/d5/d2d/d4b/d51/f76 [313876,55382] 0 2024-06-03T00:03:05.435 INFO:tasks.workunit.client.0.smithi049.stdout:6/474: creat d2/d3/f9f x:0 0 0 2024-06-03T00:03:05.437 INFO:tasks.workunit.client.0.smithi049.stdout:3/306: dwrite d2/d14/d44/d52/d4c/d4b/d58/f60 [0,4194304] 0 2024-06-03T00:03:05.438 INFO:tasks.workunit.client.0.smithi049.stdout:3/307: truncate d2/d14/d44/f5b 273037 0 2024-06-03T00:03:05.438 INFO:tasks.workunit.client.0.smithi049.stdout:3/308: readlink d2/d14/l17 0 2024-06-03T00:03:05.438 INFO:tasks.workunit.client.0.smithi049.stdout:5/429: mknod d3/d53/c88 0 2024-06-03T00:03:05.438 INFO:tasks.workunit.client.0.smithi049.stdout:6/475: truncate d2/d3/d9/d23/d29/f63 59474 0 2024-06-03T00:03:05.439 INFO:tasks.workunit.client.0.smithi049.stdout:5/430: symlink d3/d7d/l89 0 2024-06-03T00:03:05.439 INFO:tasks.workunit.client.0.smithi049.stdout:5/431: stat d3/d9/d20/d4c/d5a/d65/f71 0 2024-06-03T00:03:05.439 INFO:tasks.workunit.client.0.smithi049.stdout:5/432: chown d3/d5 1475 1 2024-06-03T00:03:05.439 INFO:tasks.workunit.client.0.smithi049.stdout:5/433: readlink d3/d5/da/d55/d14/d16/l45 0 2024-06-03T00:03:05.439 INFO:tasks.workunit.client.0.smithi049.stdout:5/434: fsync d3/d9/d20/f3d 0 2024-06-03T00:03:05.439 INFO:tasks.workunit.client.0.smithi049.stdout:6/476: mknod d2/d3/d9/d23/d29/ca0 0 2024-06-03T00:03:05.440 INFO:tasks.workunit.client.0.smithi049.stdout:3/309: dread d2/d1a/d34/f4f [0,4194304] 0 2024-06-03T00:03:05.441 INFO:tasks.workunit.client.0.smithi049.stdout:6/477: creat d2/d3/d9/d23/d29/d6a/fa1 x:0 0 0 2024-06-03T00:03:05.442 INFO:tasks.workunit.client.0.smithi049.stdout:6/478: write d2/d3/f98 [198846,52881] 0 2024-06-03T00:03:05.444 INFO:tasks.workunit.client.0.smithi049.stdout:6/479: symlink d2/d3/d9/d23/d29/d6a/la2 0 2024-06-03T00:03:05.444 INFO:tasks.workunit.client.0.smithi049.stdout:6/480: write d2/d3/d9/d40/f87 [213385,33244] 0 2024-06-03T00:03:05.445 INFO:tasks.workunit.client.0.smithi049.stdout:6/481: mknod d2/d3/d9/d23/d29/d6a/ca3 0 2024-06-03T00:03:05.448 INFO:tasks.workunit.client.0.smithi049.stdout:7/469: dwrite d3/d6/d13/d3c/d48/d7b/d9c/f51 [0,4194304] 0 2024-06-03T00:03:05.449 INFO:tasks.workunit.client.0.smithi049.stdout:6/482: creat d2/d3/d17/d64/fa4 x:0 0 0 2024-06-03T00:03:05.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:05 smithi057 ceph-mon[36457]: pgmap v474: 97 pgs: 97 active+clean; 364 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 34 MiB/s rd, 48 MiB/s wr, 1.47k op/s 2024-06-03T00:03:05.457 INFO:tasks.workunit.client.0.smithi049.stdout:2/399: dwrite da/d52/df/d3c/d60/f78 [0,4194304] 0 2024-06-03T00:03:05.457 INFO:tasks.workunit.client.0.smithi049.stdout:2/400: stat da/d52/d49/f6c 0 2024-06-03T00:03:05.457 INFO:tasks.workunit.client.0.smithi049.stdout:7/470: rename d3/d14/d7d to d3/d6/d13/d54/daa 0 2024-06-03T00:03:05.460 INFO:tasks.workunit.client.0.smithi049.stdout:6/483: mknod d2/d3/d9/ca5 0 2024-06-03T00:03:05.461 INFO:tasks.workunit.client.0.smithi049.stdout:2/401: creat da/d52/d37/f84 x:0 0 0 2024-06-03T00:03:05.462 INFO:tasks.workunit.client.0.smithi049.stdout:7/471: mknod d3/d6/d13/d3c/d4b/d8e/cab 0 2024-06-03T00:03:05.464 INFO:tasks.workunit.client.0.smithi049.stdout:7/472: creat d3/fac x:0 0 0 2024-06-03T00:03:05.464 INFO:tasks.workunit.client.0.smithi049.stdout:7/473: fsync d3/d6/d13/d3c/d48/d7b/d9c/f51 0 2024-06-03T00:03:05.464 INFO:tasks.workunit.client.0.smithi049.stdout:6/484: dread d2/d3/d17/f77 [0,4194304] 0 2024-06-03T00:03:05.470 INFO:tasks.workunit.client.0.smithi049.stdout:0/308: dwrite d6/f16 [4194304,4194304] 0 2024-06-03T00:03:05.470 INFO:tasks.workunit.client.0.smithi049.stdout:8/314: dwrite d4/d7/f56 [0,4194304] 0 2024-06-03T00:03:05.470 INFO:tasks.workunit.client.0.smithi049.stdout:8/315: fsync d4/d7/f61 0 2024-06-03T00:03:05.470 INFO:tasks.workunit.client.0.smithi049.stdout:9/547: write d1/da/da8/f4c [3610598,46217] 0 2024-06-03T00:03:05.472 INFO:tasks.workunit.client.0.smithi049.stdout:8/316: rmdir d4/d7/d48 39 2024-06-03T00:03:05.473 INFO:tasks.workunit.client.0.smithi049.stdout:5/435: dwrite d3/d5/d2d/d4b/f59 [0,4194304] 0 2024-06-03T00:03:05.474 INFO:tasks.workunit.client.0.smithi049.stdout:9/548: symlink d1/d5/d1a/lb0 0 2024-06-03T00:03:05.475 INFO:tasks.workunit.client.0.smithi049.stdout:1/437: dwrite d1/d1a/f25 [0,4194304] 0 2024-06-03T00:03:05.475 INFO:tasks.workunit.client.0.smithi049.stdout:6/485: write d2/d3/d9/d23/d29/f32 [4131930,14277] 0 2024-06-03T00:03:05.476 INFO:tasks.workunit.client.0.smithi049.stdout:9/549: getdents d1/d5 0 2024-06-03T00:03:05.476 INFO:tasks.workunit.client.0.smithi049.stdout:5/436: rename d3/d5/d24/f38 to d3/d5/d24/f8a 0 2024-06-03T00:03:05.477 INFO:tasks.workunit.client.0.smithi049.stdout:1/438: write d1/d2f/d36/d37/d64/d6c/f7a [943596,92783] 0 2024-06-03T00:03:05.478 INFO:tasks.workunit.client.0.smithi049.stdout:6/486: mkdir d2/d3/d9/d23/d36/da6 0 2024-06-03T00:03:05.479 INFO:tasks.workunit.client.0.smithi049.stdout:9/550: creat d1/d5/d13/d66/d87/fb1 x:0 0 0 2024-06-03T00:03:05.479 INFO:tasks.workunit.client.0.smithi049.stdout:9/551: chown d1/da/d27/faa 24 1 2024-06-03T00:03:05.479 INFO:tasks.workunit.client.0.smithi049.stdout:9/552: write d1/faf [526999,126236] 0 2024-06-03T00:03:05.480 INFO:tasks.workunit.client.0.smithi049.stdout:7/474: getdents d3 0 2024-06-03T00:03:05.480 INFO:tasks.workunit.client.0.smithi049.stdout:7/475: getdents d3/d6/d86/d90 0 2024-06-03T00:03:05.483 INFO:tasks.workunit.client.0.smithi049.stdout:1/439: creat d1/d2f/d36/d37/d64/d6c/d8c/f97 x:0 0 0 2024-06-03T00:03:05.483 INFO:tasks.workunit.client.0.smithi049.stdout:1/440: readlink d1/d2f/d36/d37/d13/d34/d6e/l8d 0 2024-06-03T00:03:05.483 INFO:tasks.workunit.client.0.smithi049.stdout:3/310: dwrite d2/d14/f54 [0,4194304] 0 2024-06-03T00:03:05.483 INFO:tasks.workunit.client.0.smithi049.stdout:3/311: stat d2/f15 0 2024-06-03T00:03:05.484 INFO:tasks.workunit.client.0.smithi049.stdout:9/553: mknod d1/d5/d13/d3b/d49/d58/cb2 0 2024-06-03T00:03:05.484 INFO:tasks.workunit.client.0.smithi049.stdout:9/554: write d1/d5/d13/d3b/d49/d58/f98 [305132,104299] 0 2024-06-03T00:03:05.486 INFO:tasks.workunit.client.0.smithi049.stdout:3/312: mknod d2/d1a/d31/c67 0 2024-06-03T00:03:05.487 INFO:tasks.workunit.client.0.smithi049.stdout:7/476: dread d3/f30 [0,4194304] 0 2024-06-03T00:03:05.488 INFO:tasks.workunit.client.0.smithi049.stdout:6/487: dread d2/f15 [0,4194304] 0 2024-06-03T00:03:05.488 INFO:tasks.workunit.client.0.smithi049.stdout:3/313: mkdir d2/d14/d22/d42/d68 0 2024-06-03T00:03:05.489 INFO:tasks.workunit.client.0.smithi049.stdout:3/314: rmdir d2/d14/d22/d3a/d47 39 2024-06-03T00:03:05.489 INFO:tasks.workunit.client.0.smithi049.stdout:3/315: chown d2/d1a/d31 3 1 2024-06-03T00:03:05.489 INFO:tasks.workunit.client.0.smithi049.stdout:3/316: write d2/d1a/d34/f5e [1040627,6326] 0 2024-06-03T00:03:05.490 INFO:tasks.workunit.client.0.smithi049.stdout:6/488: creat d2/d3/d17/d57/d6e/d88/fa7 x:0 0 0 2024-06-03T00:03:05.490 INFO:tasks.workunit.client.0.smithi049.stdout:3/317: symlink d2/d1a/d31/l69 0 2024-06-03T00:03:05.490 INFO:tasks.workunit.client.0.smithi049.stdout:6/489: symlink d2/d3/d9/d40/la8 0 2024-06-03T00:03:05.491 INFO:tasks.workunit.client.0.smithi049.stdout:3/318: creat d2/d14/d44/d52/f6a x:0 0 0 2024-06-03T00:03:05.492 INFO:tasks.workunit.client.0.smithi049.stdout:8/317: dread d4/d27/d30/f31 [0,4194304] 0 2024-06-03T00:03:05.493 INFO:tasks.workunit.client.0.smithi049.stdout:8/318: mkdir d4/d7/d58/d62 0 2024-06-03T00:03:05.493 INFO:tasks.workunit.client.0.smithi049.stdout:8/319: chown d4/d7/d28/f46 3184 1 2024-06-03T00:03:05.494 INFO:tasks.workunit.client.0.smithi049.stdout:6/490: rename d2/d3/d17/l21 to d2/d3/d9/d40/la9 0 2024-06-03T00:03:05.494 INFO:tasks.workunit.client.0.smithi049.stdout:6/491: write d2/d3/f98 [327318,84932] 0 2024-06-03T00:03:05.494 INFO:tasks.workunit.client.0.smithi049.stdout:7/477: dread d3/d6/d13/f38 [0,4194304] 0 2024-06-03T00:03:05.494 INFO:tasks.workunit.client.0.smithi049.stdout:6/492: fsync d2/d3/d9/d23/d48/f70 0 2024-06-03T00:03:05.494 INFO:tasks.workunit.client.0.smithi049.stdout:6/493: chown d2/d3/d9/d23/d29/f32 1335 1 2024-06-03T00:03:05.495 INFO:tasks.workunit.client.0.smithi049.stdout:5/437: read d3/d5/da/d55/d14/d16/f2c [335864,75286] 0 2024-06-03T00:03:05.495 INFO:tasks.workunit.client.0.smithi049.stdout:8/320: write d4/d7/f1e [39076,46267] 0 2024-06-03T00:03:05.497 INFO:tasks.workunit.client.0.smithi049.stdout:5/438: dread d3/d9/d20/d4c/d5a/d65/f69 [0,4194304] 0 2024-06-03T00:03:05.497 INFO:tasks.workunit.client.0.smithi049.stdout:3/319: dread d2/d14/d44/d52/fa [0,4194304] 0 2024-06-03T00:03:05.497 INFO:tasks.workunit.client.0.smithi049.stdout:2/402: dwrite f9 [0,4194304] 0 2024-06-03T00:03:05.497 INFO:tasks.workunit.client.0.smithi049.stdout:2/403: write da/f1c [966073,69534] 0 2024-06-03T00:03:05.497 INFO:tasks.workunit.client.0.smithi049.stdout:8/321: readlink l3 0 2024-06-03T00:03:05.498 INFO:tasks.workunit.client.0.smithi049.stdout:5/439: rmdir d3/d5/d2d/d4b 39 2024-06-03T00:03:05.498 INFO:tasks.workunit.client.0.smithi049.stdout:5/440: write d3/d9/d20/d4c/d5a/d65/f71 [398266,104538] 0 2024-06-03T00:03:05.499 INFO:tasks.workunit.client.0.smithi049.stdout:3/320: mknod d2/d1a/d31/c6b 0 2024-06-03T00:03:05.500 INFO:tasks.workunit.client.0.smithi049.stdout:2/404: rename da/d52/d40/f51 to da/f85 0 2024-06-03T00:03:05.500 INFO:tasks.workunit.client.0.smithi049.stdout:2/405: dread - da/d52/d49/f7f zero size 2024-06-03T00:03:05.500 INFO:tasks.workunit.client.0.smithi049.stdout:8/322: truncate d4/d7/d28/f46 634093 0 2024-06-03T00:03:05.501 INFO:tasks.workunit.client.0.smithi049.stdout:8/323: dread - d4/d7/d48/f5d zero size 2024-06-03T00:03:05.501 INFO:tasks.workunit.client.0.smithi049.stdout:5/441: getdents d3/d53 0 2024-06-03T00:03:05.501 INFO:tasks.workunit.client.0.smithi049.stdout:1/441: write d1/d2f/d36/d37/f33 [8211974,55740] 0 2024-06-03T00:03:05.502 INFO:tasks.workunit.client.0.smithi049.stdout:8/324: mknod d4/d27/d30/d4f/c63 0 2024-06-03T00:03:05.502 INFO:tasks.workunit.client.0.smithi049.stdout:0/309: dwrite d6/f61 [0,4194304] 0 2024-06-03T00:03:05.502 INFO:tasks.workunit.client.0.smithi049.stdout:6/494: dread d2/d3/d9/d23/d29/f59 [0,4194304] 0 2024-06-03T00:03:05.502 INFO:tasks.workunit.client.0.smithi049.stdout:6/495: readlink d2/l13 0 2024-06-03T00:03:05.504 INFO:tasks.workunit.client.0.smithi049.stdout:8/325: creat d4/d7/d58/f64 x:0 0 0 2024-06-03T00:03:05.505 INFO:tasks.workunit.client.0.smithi049.stdout:1/442: creat d1/d2f/d78/f98 x:0 0 0 2024-06-03T00:03:05.505 INFO:tasks.workunit.client.0.smithi049.stdout:1/443: read - d1/d2f/d36/d57/f5c zero size 2024-06-03T00:03:05.505 INFO:tasks.workunit.client.0.smithi049.stdout:6/496: truncate d2/f11 101504 0 2024-06-03T00:03:05.505 INFO:tasks.workunit.client.0.smithi049.stdout:6/497: chown d2/d3/d9/d23/d29/d30/l81 1638623 1 2024-06-03T00:03:05.506 INFO:tasks.workunit.client.0.smithi049.stdout:1/444: mkdir d1/d2f/d36/d37/d2c/d45/d83/d99 0 2024-06-03T00:03:05.506 INFO:tasks.workunit.client.0.smithi049.stdout:9/555: dwrite d1/d5/d13/d3b/f65 [0,4194304] 0 2024-06-03T00:03:05.507 INFO:tasks.workunit.client.0.smithi049.stdout:6/498: unlink d2/d3/d9/d23/d29/d30/f65 0 2024-06-03T00:03:05.507 INFO:tasks.workunit.client.0.smithi049.stdout:1/445: creat d1/d2f/d50/d6b/f9a x:0 0 0 2024-06-03T00:03:05.507 INFO:tasks.workunit.client.0.smithi049.stdout:1/446: read - d1/d2f/d36/d37/d2c/d45/d61/d67/f7b zero size 2024-06-03T00:03:05.509 INFO:tasks.workunit.client.0.smithi049.stdout:9/556: creat d1/d5/d13/d3b/dad/fb3 x:0 0 0 2024-06-03T00:03:05.510 INFO:tasks.workunit.client.0.smithi049.stdout:0/310: dread d6/d29/d2e/f24 [0,4194304] 0 2024-06-03T00:03:05.512 INFO:tasks.workunit.client.0.smithi049.stdout:6/499: creat d2/d3/d17/d57/d6e/d88/faa x:0 0 0 2024-06-03T00:03:05.513 INFO:tasks.workunit.client.0.smithi049.stdout:1/447: creat d1/d2f/d36/d37/d13/d42/f9b x:0 0 0 2024-06-03T00:03:05.513 INFO:tasks.workunit.client.0.smithi049.stdout:1/448: readlink d1/d2f/d36/d37/lf 0 2024-06-03T00:03:05.514 INFO:tasks.workunit.client.0.smithi049.stdout:0/311: creat d6/d29/d47/f6a x:0 0 0 2024-06-03T00:03:05.514 INFO:tasks.workunit.client.0.smithi049.stdout:0/312: write f2 [1501483,130900] 0 2024-06-03T00:03:05.516 INFO:tasks.workunit.client.0.smithi049.stdout:6/500: rmdir d2/d3/d17/d57/d6e/d88 39 2024-06-03T00:03:05.516 INFO:tasks.workunit.client.0.smithi049.stdout:6/501: write d2/d4d/f58 [2611878,116013] 0 2024-06-03T00:03:05.516 INFO:tasks.workunit.client.0.smithi049.stdout:6/502: write d2/d4d/d76/f93 [3662664,87720] 0 2024-06-03T00:03:05.516 INFO:tasks.workunit.client.0.smithi049.stdout:1/449: creat d1/d2f/d36/d37/d13/d71/f9c x:0 0 0 2024-06-03T00:03:05.516 INFO:tasks.workunit.client.0.smithi049.stdout:2/406: write da/d52/df/d3c/d60/f78 [869170,68451] 0 2024-06-03T00:03:05.517 INFO:tasks.workunit.client.0.smithi049.stdout:1/450: mknod d1/d2f/d36/d37/d64/d6c/d8c/c9d 0 2024-06-03T00:03:05.518 INFO:tasks.workunit.client.0.smithi049.stdout:0/313: unlink d6/d29/l3a 0 2024-06-03T00:03:05.520 INFO:tasks.workunit.client.0.smithi049.stdout:6/503: creat d2/d3/d9/d23/d48/fab x:0 0 0 2024-06-03T00:03:05.520 INFO:tasks.workunit.client.0.smithi049.stdout:6/504: readlink d2/d3/d9/d23/d29/d30/l81 0 2024-06-03T00:03:05.521 INFO:tasks.workunit.client.0.smithi049.stdout:6/505: chown d2/d3/d9/d40/l80 8 1 2024-06-03T00:03:05.522 INFO:tasks.workunit.client.0.smithi049.stdout:3/321: dwrite d2/d14/d44/d52/f3f [4194304,4194304] 0 2024-06-03T00:03:05.522 INFO:tasks.workunit.client.0.smithi049.stdout:2/407: unlink da/f47 0 2024-06-03T00:03:05.522 INFO:tasks.workunit.client.0.smithi049.stdout:6/506: rename d2/d3/f60 to d2/d3/d17/d57/fac 0 2024-06-03T00:03:05.524 INFO:tasks.workunit.client.0.smithi049.stdout:1/451: mknod d1/d2f/d36/d57/d72/c9e 0 2024-06-03T00:03:05.524 INFO:tasks.workunit.client.0.smithi049.stdout:0/314: link d6/d29/f2d d6/d30/f6b 0 2024-06-03T00:03:05.525 INFO:tasks.workunit.client.0.smithi049.stdout:2/408: getdents da/d52/d40 0 2024-06-03T00:03:05.526 INFO:tasks.workunit.client.0.smithi049.stdout:6/507: rename d2/d3/d9/d40/f7d to d2/d3/d17/d57/d6e/fad 0 2024-06-03T00:03:05.527 INFO:tasks.workunit.client.0.smithi049.stdout:1/452: creat d1/d2f/d78/f9f x:0 0 0 2024-06-03T00:03:05.527 INFO:tasks.workunit.client.0.smithi049.stdout:0/315: creat d6/d29/d2e/d52/f6c x:0 0 0 2024-06-03T00:03:05.529 INFO:tasks.workunit.client.0.smithi049.stdout:2/409: mknod da/d72/d83/c86 0 2024-06-03T00:03:05.529 INFO:tasks.workunit.client.0.smithi049.stdout:2/410: truncate da/d52/f26 515394 0 2024-06-03T00:03:05.529 INFO:tasks.workunit.client.0.smithi049.stdout:2/411: truncate da/d52/df/f34 624067 0 2024-06-03T00:03:05.529 INFO:tasks.workunit.client.0.smithi049.stdout:2/412: write da/d52/f82 [525167,84904] 0 2024-06-03T00:03:05.529 INFO:tasks.workunit.client.0.smithi049.stdout:9/557: dwrite d1/da/f5e [0,4194304] 0 2024-06-03T00:03:05.530 INFO:tasks.workunit.client.0.smithi049.stdout:6/508: creat d2/d4d/fae x:0 0 0 2024-06-03T00:03:05.530 INFO:tasks.workunit.client.0.smithi049.stdout:6/509: fsync d2/d3/d9/d23/d29/d30/f6d 0 2024-06-03T00:03:05.530 INFO:tasks.workunit.client.0.smithi049.stdout:6/510: getdents d2/d3/d9/d23/d48/d89 0 2024-06-03T00:03:05.531 INFO:tasks.workunit.client.0.smithi049.stdout:1/453: mkdir d1/d2f/d36/d37/d2c/d45/da0 0 2024-06-03T00:03:05.532 INFO:tasks.workunit.client.0.smithi049.stdout:0/316: rename d6/d30/d32/f48 to d6/d29/d2e/f6d 0 2024-06-03T00:03:05.533 INFO:tasks.workunit.client.0.smithi049.stdout:2/413: creat da/d52/d49/f87 x:0 0 0 2024-06-03T00:03:05.533 INFO:tasks.workunit.client.0.smithi049.stdout:6/511: symlink d2/d3/d17/d57/laf 0 2024-06-03T00:03:05.534 INFO:tasks.workunit.client.0.smithi049.stdout:1/454: mkdir d1/d2f/d36/d57/da1 0 2024-06-03T00:03:05.536 INFO:tasks.workunit.client.0.smithi049.stdout:6/512: unlink d2/d3/f9f 0 2024-06-03T00:03:05.536 INFO:tasks.workunit.client.0.smithi049.stdout:1/455: mknod d1/d2f/d36/d37/d2c/d45/d5e/ca2 0 2024-06-03T00:03:05.536 INFO:tasks.workunit.client.0.smithi049.stdout:1/456: fsync d1/d2f/d36/d37/d2c/d45/d61/d67/f7b 0 2024-06-03T00:03:05.543 INFO:tasks.workunit.client.0.smithi049.stdout:2/414: dread da/d52/d49/f6c [0,4194304] 0 2024-06-03T00:03:05.544 INFO:tasks.workunit.client.0.smithi049.stdout:2/415: symlink da/d52/d37/d59/d80/l88 0 2024-06-03T00:03:05.544 INFO:tasks.workunit.client.0.smithi049.stdout:0/317: rename d6/d29/d2e to d6/d29/d47/d4b/d67/d6e 0 2024-06-03T00:03:05.546 INFO:tasks.workunit.client.0.smithi049.stdout:0/318: symlink d6/d29/d47/d4b/l6f 0 2024-06-03T00:03:05.546 INFO:tasks.workunit.client.0.smithi049.stdout:6/513: dread d2/d3/d9/d23/d36/f45 [0,4194304] 0 2024-06-03T00:03:05.546 INFO:tasks.workunit.client.0.smithi049.stdout:6/514: chown d2/d3/d9/d23/d48/d53/l9d 8664 1 2024-06-03T00:03:05.547 INFO:tasks.workunit.client.0.smithi049.stdout:0/319: creat d6/d29/d47/d4b/d67/d6e/f70 x:0 0 0 2024-06-03T00:03:05.547 INFO:tasks.workunit.client.0.smithi049.stdout:0/320: truncate d6/d29/f54 213388 0 2024-06-03T00:03:05.548 INFO:tasks.workunit.client.0.smithi049.stdout:6/515: rmdir d2/d3/d9/d23/d29/d30/d97 0 2024-06-03T00:03:05.549 INFO:tasks.workunit.client.0.smithi049.stdout:6/516: chown d2/d3/d17/d57/f69 1 1 2024-06-03T00:03:05.549 INFO:tasks.workunit.client.0.smithi049.stdout:6/517: rmdir d2/d3/d17/d64 39 2024-06-03T00:03:05.549 INFO:tasks.workunit.client.0.smithi049.stdout:6/518: chown d2/d3/d9/d40/c91 92494 1 2024-06-03T00:03:05.550 INFO:tasks.workunit.client.0.smithi049.stdout:9/558: dwrite d1/d5/d13/d3b/d49/d58/f9c [0,4194304] 0 2024-06-03T00:03:05.551 INFO:tasks.workunit.client.0.smithi049.stdout:6/519: rename d2/d4d/l2e to d2/d4d/lb0 0 2024-06-03T00:03:05.551 INFO:tasks.workunit.client.0.smithi049.stdout:6/520: truncate d2/d3/d9/d23/f82 248433 0 2024-06-03T00:03:05.551 INFO:tasks.workunit.client.0.smithi049.stdout:6/521: truncate d2/d3/d17/f77 2528178 0 2024-06-03T00:03:05.553 INFO:tasks.workunit.client.0.smithi049.stdout:9/559: creat d1/d5/fb4 x:0 0 0 2024-06-03T00:03:05.554 INFO:tasks.workunit.client.0.smithi049.stdout:9/560: dread - d1/d5/f6b zero size 2024-06-03T00:03:05.554 INFO:tasks.workunit.client.0.smithi049.stdout:9/561: stat d1/da/d54/d5b/d61/f96 0 2024-06-03T00:03:05.557 INFO:tasks.workunit.client.0.smithi049.stdout:9/562: creat d1/da/da8/fb5 x:0 0 0 2024-06-03T00:03:05.557 INFO:tasks.workunit.client.0.smithi049.stdout:9/563: read - d1/da/f99 zero size 2024-06-03T00:03:05.558 INFO:tasks.workunit.client.0.smithi049.stdout:9/564: write d1/d5/d13/d3b/d49/d58/f98 [176968,11437] 0 2024-06-03T00:03:05.560 INFO:tasks.workunit.client.0.smithi049.stdout:9/565: creat d1/da/da8/fb6 x:0 0 0 2024-06-03T00:03:05.562 INFO:tasks.workunit.client.0.smithi049.stdout:9/566: rmdir d1/d5/d13/d3b/dad 39 2024-06-03T00:03:05.565 INFO:tasks.workunit.client.0.smithi049.stdout:1/457: dwrite d1/d1a/f63 [0,4194304] 0 2024-06-03T00:03:05.567 INFO:tasks.workunit.client.0.smithi049.stdout:3/322: dwrite d2/d14/d22/d42/f38 [0,4194304] 0 2024-06-03T00:03:05.569 INFO:tasks.workunit.client.0.smithi049.stdout:2/416: dwrite da/d52/d40/f4f [0,4194304] 0 2024-06-03T00:03:05.570 INFO:tasks.workunit.client.0.smithi049.stdout:1/458: link d1/d2f/c73 d1/d2f/d36/d37/d13/d34/ca3 0 2024-06-03T00:03:05.570 INFO:tasks.workunit.client.0.smithi049.stdout:1/459: truncate d1/d2f/d36/d37/d13/d42/f9b 253159 0 2024-06-03T00:03:05.570 INFO:tasks.workunit.client.0.smithi049.stdout:1/460: chown d1/d2f/d36/f4e 8 1 2024-06-03T00:03:05.571 INFO:tasks.workunit.client.0.smithi049.stdout:2/417: symlink da/d72/d83/l89 0 2024-06-03T00:03:05.572 INFO:tasks.workunit.client.0.smithi049.stdout:1/461: dread d1/d2f/d36/d37/f1f [0,4194304] 0 2024-06-03T00:03:05.572 INFO:tasks.workunit.client.0.smithi049.stdout:1/462: chown d1/d2f/d36/d37/d2c/d45/d61/d67/f7b 3 1 2024-06-03T00:03:05.574 INFO:tasks.workunit.client.0.smithi049.stdout:1/463: unlink d1/d2f/d36/d37/f1f 0 2024-06-03T00:03:05.575 INFO:tasks.workunit.client.0.smithi049.stdout:9/567: getdents d1/da/da8 0 2024-06-03T00:03:05.576 INFO:tasks.workunit.client.0.smithi049.stdout:0/321: dwrite d6/d30/f6b [0,4194304] 0 2024-06-03T00:03:05.576 INFO:tasks.workunit.client.0.smithi049.stdout:6/522: dwrite d2/d3/d9/d23/d48/d51/f5f [0,4194304] 0 2024-06-03T00:03:05.576 INFO:tasks.workunit.client.0.smithi049.stdout:1/464: dread d1/d2f/d36/d37/d64/f8b [0,4194304] 0 2024-06-03T00:03:05.577 INFO:tasks.workunit.client.0.smithi049.stdout:9/568: creat d1/d5/d13/d66/d87/fb7 x:0 0 0 2024-06-03T00:03:05.577 INFO:tasks.workunit.client.0.smithi049.stdout:1/465: creat d1/d2f/d50/fa4 x:0 0 0 2024-06-03T00:03:05.577 INFO:tasks.workunit.client.0.smithi049.stdout:1/466: stat d1/d2f/f46 0 2024-06-03T00:03:05.578 INFO:tasks.workunit.client.0.smithi049.stdout:9/569: symlink d1/da/d54/d5b/lb8 0 2024-06-03T00:03:05.579 INFO:tasks.workunit.client.0.smithi049.stdout:1/467: mknod d1/d2f/ca5 0 2024-06-03T00:03:05.579 INFO:tasks.workunit.client.0.smithi049.stdout:9/570: symlink d1/d5/d13/d3b/lb9 0 2024-06-03T00:03:05.580 INFO:tasks.workunit.client.0.smithi049.stdout:1/468: creat d1/d2f/d36/d57/d72/fa6 x:0 0 0 2024-06-03T00:03:05.580 INFO:tasks.workunit.client.0.smithi049.stdout:1/469: truncate d1/d2f/d36/d37/d2c/d45/d61/f69 593508 0 2024-06-03T00:03:05.581 INFO:tasks.workunit.client.0.smithi049.stdout:6/523: symlink d2/d3/d9/d55/lb1 0 2024-06-03T00:03:05.581 INFO:tasks.workunit.client.0.smithi049.stdout:9/571: truncate d1/da/da8/d5f/f7d 1492190 0 2024-06-03T00:03:05.582 INFO:tasks.workunit.client.0.smithi049.stdout:1/470: link d1/d2f/d36/f4e d1/d2f/d36/d37/fa7 0 2024-06-03T00:03:05.583 INFO:tasks.workunit.client.0.smithi049.stdout:0/322: write d6/d29/f2d [3311966,41380] 0 2024-06-03T00:03:05.583 INFO:tasks.workunit.client.0.smithi049.stdout:6/524: link d2/d3/d17/d57/d6e/d88/f94 d2/d3/d9/d23/fb2 0 2024-06-03T00:03:05.584 INFO:tasks.workunit.client.0.smithi049.stdout:9/572: rename d1/d5/d13/d3b/f6e to d1/fba 0 2024-06-03T00:03:05.584 INFO:tasks.workunit.client.0.smithi049.stdout:0/323: dread d6/d29/f54 [0,4194304] 0 2024-06-03T00:03:05.585 INFO:tasks.workunit.client.0.smithi049.stdout:1/471: symlink d1/d2f/d36/d37/d13/d34/d5f/la8 0 2024-06-03T00:03:05.585 INFO:tasks.workunit.client.0.smithi049.stdout:6/525: dread d2/d3/d9/d23/d29/f63 [0,4194304] 0 2024-06-03T00:03:05.587 INFO:tasks.workunit.client.0.smithi049.stdout:9/573: mkdir d1/d5/d13/d3b/dbb 0 2024-06-03T00:03:05.587 INFO:tasks.workunit.client.0.smithi049.stdout:6/526: symlink d2/d3/d9/d23/d29/d6a/lb3 0 2024-06-03T00:03:05.589 INFO:tasks.workunit.client.0.smithi049.stdout:9/574: rename d1/d5/d13/d3b/d49/d58 to d1/d5/d13/d3b/d7f/dbc 0 2024-06-03T00:03:05.589 INFO:tasks.workunit.client.0.smithi049.stdout:9/575: readlink d1/da/d27/l2e 0 2024-06-03T00:03:05.591 INFO:tasks.workunit.client.0.smithi049.stdout:9/576: dread d1/da/d54/f76 [0,4194304] 0 2024-06-03T00:03:05.591 INFO:tasks.workunit.client.0.smithi049.stdout:9/577: fsync d1/f44 0 2024-06-03T00:03:05.591 INFO:tasks.workunit.client.0.smithi049.stdout:9/578: dread - d1/d5/d1a/d52/f9b zero size 2024-06-03T00:03:05.591 INFO:tasks.workunit.client.0.smithi049.stdout:0/324: dread d6/d29/d47/d4b/d67/d6e/f2a [0,4194304] 0 2024-06-03T00:03:05.591 INFO:tasks.workunit.client.0.smithi049.stdout:6/527: rename d2/d3/d9/d23/f9b to d2/d3/d17/d57/d6e/fb4 0 2024-06-03T00:03:05.592 INFO:tasks.workunit.client.0.smithi049.stdout:9/579: symlink d1/d5/d13/d3b/dbb/lbd 0 2024-06-03T00:03:05.593 INFO:tasks.workunit.client.0.smithi049.stdout:9/580: creat d1/d5/d1a/fbe x:0 0 0 2024-06-03T00:03:05.593 INFO:tasks.workunit.client.0.smithi049.stdout:9/581: write d1/d5/d1a/d52/f9b [778370,25973] 0 2024-06-03T00:03:05.593 INFO:tasks.workunit.client.0.smithi049.stdout:9/582: write d1/da/da8/fb5 [1046596,80448] 0 2024-06-03T00:03:05.595 INFO:tasks.workunit.client.0.smithi049.stdout:2/418: dwrite da/d52/d40/f6e [0,4194304] 0 2024-06-03T00:03:05.595 INFO:tasks.workunit.client.0.smithi049.stdout:2/419: truncate da/f24 2260976 0 2024-06-03T00:03:05.596 INFO:tasks.workunit.client.0.smithi049.stdout:2/420: readlink da/d52/df/l14 0 2024-06-03T00:03:05.596 INFO:tasks.workunit.client.0.smithi049.stdout:2/421: chown da/d52/df/d3c 156609072 1 2024-06-03T00:03:05.596 INFO:tasks.workunit.client.0.smithi049.stdout:2/422: fsync da/d52/df/d3c/f66 0 2024-06-03T00:03:05.597 INFO:tasks.workunit.client.0.smithi049.stdout:2/423: read da/d52/df/d3c/d60/f78 [231216,31824] 0 2024-06-03T00:03:05.599 INFO:tasks.workunit.client.0.smithi049.stdout:0/325: read d6/d29/d47/d4b/f51 [1951942,68267] 0 2024-06-03T00:03:05.599 INFO:tasks.workunit.client.0.smithi049.stdout:0/326: chown d6/d30/d32/f40 0 1 2024-06-03T00:03:05.600 INFO:tasks.workunit.client.0.smithi049.stdout:0/327: mknod d6/c71 0 2024-06-03T00:03:05.601 INFO:tasks.workunit.client.0.smithi049.stdout:0/328: mkdir d6/d59/d72 0 2024-06-03T00:03:05.603 INFO:tasks.workunit.client.0.smithi049.stdout:9/583: write d1/da/d27/f40 [1059466,105284] 0 2024-06-03T00:03:05.603 INFO:tasks.workunit.client.0.smithi049.stdout:9/584: chown d1/d5 75134252 1 2024-06-03T00:03:05.603 INFO:tasks.workunit.client.0.smithi049.stdout:1/472: dwrite d1/d1a/f88 [0,4194304] 0 2024-06-03T00:03:05.609 INFO:tasks.workunit.client.0.smithi049.stdout:2/424: creat da/d52/d40/f8a x:0 0 0 2024-06-03T00:03:05.609 INFO:tasks.workunit.client.0.smithi049.stdout:2/425: stat da/d52/d40/f6e 0 2024-06-03T00:03:05.609 INFO:tasks.workunit.client.0.smithi049.stdout:2/426: write da/d52/df/f2c [1933146,118889] 0 2024-06-03T00:03:05.612 INFO:tasks.workunit.client.0.smithi049.stdout:9/585: rename d1/d5/d13/d6a to d1/da/dbf 0 2024-06-03T00:03:05.615 INFO:tasks.workunit.client.0.smithi049.stdout:1/473: mknod d1/d2f/d78/ca9 0 2024-06-03T00:03:05.616 INFO:tasks.workunit.client.0.smithi049.stdout:0/329: dwrite d6/d29/d47/d4b/d67/d6e/f2a [4194304,4194304] 0 2024-06-03T00:03:05.616 INFO:tasks.workunit.client.0.smithi049.stdout:2/427: unlink da/d52/f36 0 2024-06-03T00:03:05.617 INFO:tasks.workunit.client.0.smithi049.stdout:9/586: symlink d1/da/da8/d50/d70/lc0 0 2024-06-03T00:03:05.618 INFO:tasks.workunit.client.0.smithi049.stdout:1/474: creat d1/d2f/d36/d37/d2c/d45/d61/d70/faa x:0 0 0 2024-06-03T00:03:05.620 INFO:tasks.workunit.client.0.smithi049.stdout:9/587: link d1/d5/d1a/d52/la9 d1/da/d26/lc1 0 2024-06-03T00:03:05.620 INFO:tasks.workunit.client.0.smithi049.stdout:9/588: read d1/d5/d13/d3b/f41 [1008602,48590] 0 2024-06-03T00:03:05.621 INFO:tasks.workunit.client.0.smithi049.stdout:1/475: truncate d1/d2f/d36/d37/f35 334121 0 2024-06-03T00:03:05.623 INFO:tasks.workunit.client.0.smithi049.stdout:9/589: creat d1/da/d54/fc2 x:0 0 0 2024-06-03T00:03:05.624 INFO:tasks.workunit.client.0.smithi049.stdout:0/330: dread d6/d29/d47/d4b/d67/d6e/f1f [0,4194304] 0 2024-06-03T00:03:05.624 INFO:tasks.workunit.client.0.smithi049.stdout:1/476: mkdir d1/d2f/d36/d37/d2c/d45/da0/dab 0 2024-06-03T00:03:05.625 INFO:tasks.workunit.client.0.smithi049.stdout:0/331: mknod d6/d29/d47/d4b/d67/d6e/d52/c73 0 2024-06-03T00:03:05.625 INFO:tasks.workunit.client.0.smithi049.stdout:9/590: rename d1/d5/c46 to d1/da/d54/cc3 0 2024-06-03T00:03:05.625 INFO:tasks.workunit.client.0.smithi049.stdout:9/591: chown d1/f8 59 1 2024-06-03T00:03:05.626 INFO:tasks.workunit.client.0.smithi049.stdout:2/428: read da/d52/f2b [3237375,24793] 0 2024-06-03T00:03:05.626 INFO:tasks.workunit.client.0.smithi049.stdout:0/332: link d6/d30/f3b d6/d29/d47/f74 0 2024-06-03T00:03:05.626 INFO:tasks.workunit.client.0.smithi049.stdout:0/333: getdents d6/d59/d72 0 2024-06-03T00:03:05.627 INFO:tasks.workunit.client.0.smithi049.stdout:0/334: mknod d6/d29/d47/d4b/d67/c75 0 2024-06-03T00:03:05.627 INFO:tasks.workunit.client.0.smithi049.stdout:1/477: rename d1/l84 to d1/d2f/d36/d37/d13/d34/d5f/lac 0 2024-06-03T00:03:05.628 INFO:tasks.workunit.client.0.smithi049.stdout:9/592: creat d1/da/d54/d5b/d61/fc4 x:0 0 0 2024-06-03T00:03:05.628 INFO:tasks.workunit.client.0.smithi049.stdout:0/335: rename d6/l69 to d6/d56/l76 0 2024-06-03T00:03:05.629 INFO:tasks.workunit.client.0.smithi049.stdout:0/336: mknod d6/c77 0 2024-06-03T00:03:05.629 INFO:tasks.workunit.client.0.smithi049.stdout:0/337: stat f2 0 2024-06-03T00:03:05.629 INFO:tasks.workunit.client.0.smithi049.stdout:2/429: mknod da/d52/d40/c8b 0 2024-06-03T00:03:05.629 INFO:tasks.workunit.client.0.smithi049.stdout:2/430: fsync da/d52/df/f10 0 2024-06-03T00:03:05.629 INFO:tasks.workunit.client.0.smithi049.stdout:2/431: write f9 [6609314,74656] 0 2024-06-03T00:03:05.630 INFO:tasks.workunit.client.0.smithi049.stdout:1/478: mkdir d1/d2f/d36/d37/d13/d34/d6e/dad 0 2024-06-03T00:03:05.631 INFO:tasks.workunit.client.0.smithi049.stdout:9/593: creat d1/da/da8/d5f/d81/da0/fc5 x:0 0 0 2024-06-03T00:03:05.631 INFO:tasks.workunit.client.0.smithi049.stdout:2/432: truncate da/d52/df/f10 4614823 0 2024-06-03T00:03:05.632 INFO:tasks.workunit.client.0.smithi049.stdout:1/479: truncate d1/d2f/d36/d37/f14 942989 0 2024-06-03T00:03:05.633 INFO:tasks.workunit.client.0.smithi049.stdout:9/594: mkdir d1/d5/d13/d3b/dad/dc6 0 2024-06-03T00:03:05.633 INFO:tasks.workunit.client.0.smithi049.stdout:9/595: stat d1/da/da8/f34 0 2024-06-03T00:03:05.635 INFO:tasks.workunit.client.0.smithi049.stdout:2/433: symlink da/d52/d40/l8c 0 2024-06-03T00:03:05.635 INFO:tasks.workunit.client.0.smithi049.stdout:2/434: truncate da/d52/d49/f87 20894 0 2024-06-03T00:03:05.635 INFO:tasks.workunit.client.0.smithi049.stdout:2/435: chown da/d52/d37 10266303 1 2024-06-03T00:03:05.635 INFO:tasks.workunit.client.0.smithi049.stdout:2/436: readlink da/d52/d37/d59/d80/l88 0 2024-06-03T00:03:05.635 INFO:tasks.workunit.client.0.smithi049.stdout:2/437: dread - da/d72/f81 zero size 2024-06-03T00:03:05.636 INFO:tasks.workunit.client.0.smithi049.stdout:9/596: getdents d1/da/d27 0 2024-06-03T00:03:05.638 INFO:tasks.workunit.client.0.smithi049.stdout:2/438: symlink da/l8d 0 2024-06-03T00:03:05.640 INFO:tasks.workunit.client.0.smithi049.stdout:9/597: creat d1/d5/d13/d3b/d49/fc7 x:0 0 0 2024-06-03T00:03:05.640 INFO:tasks.workunit.client.0.smithi049.stdout:9/598: truncate d1/d5/d13/d3b/d7f/dbc/f90 604999 0 2024-06-03T00:03:05.642 INFO:tasks.workunit.client.0.smithi049.stdout:9/599: unlink d1/d5/f6b 0 2024-06-03T00:03:05.652 INFO:tasks.workunit.client.0.smithi049.stdout:1/480: fsync d1/d2f/d36/d37/f14 0 2024-06-03T00:03:05.652 INFO:tasks.workunit.client.0.smithi049.stdout:1/481: dread - d1/d1a/f74 zero size 2024-06-03T00:03:05.655 INFO:tasks.workunit.client.0.smithi049.stdout:1/482: rename d1/d1a/c4d to d1/d2f/d36/d57/d72/cae 0 2024-06-03T00:03:05.662 INFO:tasks.workunit.client.0.smithi049.stdout:1/483: write d1/d2f/d36/d37/d13/f47 [2322346,24862] 0 2024-06-03T00:03:05.662 INFO:tasks.workunit.client.0.smithi049.stdout:1/484: stat d1/d2f/d36/d37/d2c/d45/d61/d70/f82 0 2024-06-03T00:03:05.662 INFO:tasks.workunit.client.0.smithi049.stdout:1/485: write d1/d2f/d50/fa4 [904280,83056] 0 2024-06-03T00:03:05.663 INFO:tasks.workunit.client.0.smithi049.stdout:9/600: dwrite d1/da/f42 [4194304,4194304] 0 2024-06-03T00:03:05.663 INFO:tasks.workunit.client.0.smithi049.stdout:9/601: write d1/d5/d13/f16 [5222891,9697] 0 2024-06-03T00:03:05.663 INFO:tasks.workunit.client.0.smithi049.stdout:2/439: dwrite da/d52/d49/f87 [0,4194304] 0 2024-06-03T00:03:05.663 INFO:tasks.workunit.client.0.smithi049.stdout:1/486: rmdir d1/d2f/d36/d37/d13/d34/d5f 39 2024-06-03T00:03:05.663 INFO:tasks.workunit.client.0.smithi049.stdout:1/487: readlink d1/d2f/d36/d37/d13/l24 0 2024-06-03T00:03:05.666 INFO:tasks.workunit.client.0.smithi049.stdout:9/602: unlink d1/da/da8/d5f/d81/f8f 0 2024-06-03T00:03:05.670 INFO:tasks.workunit.client.0.smithi049.stdout:9/603: symlink d1/d95/lc8 0 2024-06-03T00:03:05.671 INFO:tasks.workunit.client.0.smithi049.stdout:9/604: truncate d1/da/f42 8422194 0 2024-06-03T00:03:05.671 INFO:tasks.workunit.client.0.smithi049.stdout:9/605: write d1/da/da8/f34 [948759,106338] 0 2024-06-03T00:03:05.671 INFO:tasks.workunit.client.0.smithi049.stdout:2/440: symlink da/d52/df/l8e 0 2024-06-03T00:03:05.672 INFO:tasks.workunit.client.0.smithi049.stdout:2/441: link da/d52/df/c41 da/d52/d37/c8f 0 2024-06-03T00:03:05.686 INFO:tasks.workunit.client.0.smithi049.stdout:2/442: dread da/d52/d37/d70/f71 [0,4194304] 0 2024-06-03T00:03:05.689 INFO:tasks.workunit.client.0.smithi049.stdout:9/606: dwrite d1/da/da8/f4c [4194304,4194304] 0 2024-06-03T00:03:05.691 INFO:tasks.workunit.client.0.smithi049.stdout:9/607: symlink d1/da/lc9 0 2024-06-03T00:03:05.692 INFO:tasks.workunit.client.0.smithi049.stdout:2/443: getdents da/d52/d37 0 2024-06-03T00:03:05.695 INFO:tasks.workunit.client.0.smithi049.stdout:1/488: read d1/d2f/d36/d37/d13/d42/f5a [240547,29981] 0 2024-06-03T00:03:05.696 INFO:tasks.workunit.client.0.smithi049.stdout:9/608: symlink d1/d5/d1a/lca 0 2024-06-03T00:03:05.696 INFO:tasks.workunit.client.0.smithi049.stdout:9/609: write d1/da/f99 [906506,23544] 0 2024-06-03T00:03:05.696 INFO:tasks.workunit.client.0.smithi049.stdout:9/610: fsync d1/d5/d13/d3b/d7f/dbc/f91 0 2024-06-03T00:03:05.697 INFO:tasks.workunit.client.0.smithi049.stdout:2/444: mknod da/c90 0 2024-06-03T00:03:05.698 INFO:tasks.workunit.client.0.smithi049.stdout:9/611: creat d1/da/da8/d5f/d81/fcb x:0 0 0 2024-06-03T00:03:05.700 INFO:tasks.workunit.client.0.smithi049.stdout:9/612: creat d1/da/d54/fcc x:0 0 0 2024-06-03T00:03:05.700 INFO:tasks.workunit.client.0.smithi049.stdout:9/613: stat d1/da/d54/d5b/d61/f96 0 2024-06-03T00:03:05.700 INFO:tasks.workunit.client.0.smithi049.stdout:9/614: chown d1/da/da8/d5f/d81/da0/fc5 1724186 1 2024-06-03T00:03:05.702 INFO:tasks.workunit.client.0.smithi049.stdout:9/615: creat d1/da/d54/d5b/fcd x:0 0 0 2024-06-03T00:03:05.702 INFO:tasks.workunit.client.0.smithi049.stdout:9/616: dread - d1/d5/d1a/fbe zero size 2024-06-03T00:03:05.711 INFO:tasks.workunit.client.0.smithi049.stdout:2/445: write da/d55/f58 [387927,83180] 0 2024-06-03T00:03:05.716 INFO:tasks.workunit.client.0.smithi049.stdout:1/489: dwrite d1/d1a/f25 [0,4194304] 0 2024-06-03T00:03:05.717 INFO:tasks.workunit.client.0.smithi049.stdout:1/490: getdents d1/d2f/d36 0 2024-06-03T00:03:05.718 INFO:tasks.workunit.client.0.smithi049.stdout:1/491: mknod d1/d2f/d50/caf 0 2024-06-03T00:03:05.718 INFO:tasks.workunit.client.0.smithi049.stdout:1/492: stat d1/d2f/d36/d37/d2c/d45/d61/d70 0 2024-06-03T00:03:05.719 INFO:tasks.workunit.client.0.smithi049.stdout:1/493: symlink d1/d2f/d36/d37/d2c/lb0 0 2024-06-03T00:03:05.734 INFO:tasks.workunit.client.0.smithi049.stdout:1/494: dwrite d1/d2f/d36/d37/d64/d6c/f7a [0,4194304] 0 2024-06-03T00:03:05.736 INFO:tasks.workunit.client.0.smithi049.stdout:1/495: truncate d1/d2f/d36/d37/d13/d42/f5a 1152517 0 2024-06-03T00:03:05.736 INFO:tasks.workunit.client.0.smithi049.stdout:1/496: write d1/d2f/d78/f98 [1004748,41941] 0 2024-06-03T00:03:05.739 INFO:tasks.workunit.client.0.smithi049.stdout:1/497: read d1/d2f/d36/d37/d13/d42/f5a [260353,86436] 0 2024-06-03T00:03:05.740 INFO:tasks.workunit.client.0.smithi049.stdout:1/498: mkdir d1/d2f/d36/d37/d13/d34/d52/db1 0 2024-06-03T00:03:05.740 INFO:tasks.workunit.client.0.smithi049.stdout:1/499: dread - d1/d2f/d36/d57/f5c zero size 2024-06-03T00:03:05.754 INFO:tasks.workunit.client.0.smithi049.stdout:1/500: dwrite d1/d2f/d36/d37/d2c/d45/d61/d70/f82 [4194304,4194304] 0 2024-06-03T00:03:05.755 INFO:tasks.workunit.client.0.smithi049.stdout:1/501: creat d1/d2f/d36/d37/d2c/d45/fb2 x:0 0 0 2024-06-03T00:03:05.773 INFO:tasks.workunit.client.0.smithi049.stdout:1/502: dwrite d1/d2f/d36/d37/f35 [0,4194304] 0 2024-06-03T00:03:05.775 INFO:tasks.workunit.client.0.smithi049.stdout:1/503: mknod d1/d2f/d36/d37/d13/d34/d52/db1/cb3 0 2024-06-03T00:03:05.776 INFO:tasks.workunit.client.0.smithi049.stdout:1/504: mknod d1/d2f/d36/d37/d64/d6c/d8c/cb4 0 2024-06-03T00:03:05.776 INFO:tasks.workunit.client.0.smithi049.stdout:1/505: mkdir d1/d2f/d36/d37/db5 0 2024-06-03T00:03:05.777 INFO:tasks.workunit.client.0.smithi049.stdout:1/506: fsync d1/f1e 0 2024-06-03T00:03:05.777 INFO:tasks.workunit.client.0.smithi049.stdout:1/507: mknod d1/d2f/d78/cb6 0 2024-06-03T00:03:05.778 INFO:tasks.workunit.client.0.smithi049.stdout:1/508: creat d1/d2f/d36/d37/d13/d34/d6e/dad/fb7 x:0 0 0 2024-06-03T00:03:05.779 INFO:tasks.workunit.client.0.smithi049.stdout:1/509: creat d1/d2f/d50/fb8 x:0 0 0 2024-06-03T00:03:05.779 INFO:tasks.workunit.client.0.smithi049.stdout:1/510: fsync d1/d1a/f25 0 2024-06-03T00:03:05.779 INFO:tasks.workunit.client.0.smithi049.stdout:1/511: write d1/d1a/f79 [4591886,44657] 0 2024-06-03T00:03:05.781 INFO:tasks.workunit.client.0.smithi049.stdout:1/512: rename d1/d2f/d36/d37/d2c/d45/d83/d99 to d1/d2f/d36/d57/db9 0 2024-06-03T00:03:05.781 INFO:tasks.workunit.client.0.smithi049.stdout:1/513: stat d1/d2f/d36/d37/d13/d34/d52/c58 0 2024-06-03T00:03:05.782 INFO:tasks.workunit.client.0.smithi049.stdout:1/514: rename d1/d1a/f30 to d1/d2f/d36/d37/d13/fba 0 2024-06-03T00:03:05.783 INFO:tasks.workunit.client.0.smithi049.stdout:1/515: chown d1/d2f/d36/d37/d2c/d45/d61 8 1 2024-06-03T00:03:05.798 INFO:tasks.workunit.client.0.smithi049.stdout:1/516: dwrite d1/d2f/d36/d37/d64/d6c/f92 [0,4194304] 0 2024-06-03T00:03:05.798 INFO:tasks.workunit.client.0.smithi049.stdout:1/517: stat d1/d2f/d36/d37/d2c/d45/l54 0 2024-06-03T00:03:05.800 INFO:tasks.workunit.client.0.smithi049.stdout:1/518: creat d1/d2f/d36/d37/d2c/fbb x:0 0 0 2024-06-03T00:03:05.800 INFO:tasks.workunit.client.0.smithi049.stdout:1/519: truncate d1/d2f/d36/d37/d2c/d45/d5e/f6f 2274354 0 2024-06-03T00:03:05.810 INFO:tasks.workunit.client.0.smithi049.stdout:4/477: sync 2024-06-03T00:03:05.811 INFO:tasks.workunit.client.0.smithi049.stdout:4/478: write d4/d3f/f4d [1054152,2660] 0 2024-06-03T00:03:05.811 INFO:tasks.workunit.client.0.smithi049.stdout:4/479: chown d4/d3f/c27 18495 1 2024-06-03T00:03:05.811 INFO:tasks.workunit.client.0.smithi049.stdout:4/480: fsync d4/fc 0 2024-06-03T00:03:05.817 INFO:tasks.workunit.client.0.smithi049.stdout:1/520: dwrite d1/d2f/d36/d37/d2c/d45/d61/d67/f6d [0,4194304] 0 2024-06-03T00:03:05.823 INFO:tasks.workunit.client.0.smithi049.stdout:4/481: dwrite d4/d3f/d14/d2b/d84/d1c/f7e [0,4194304] 0 2024-06-03T00:03:05.823 INFO:tasks.workunit.client.0.smithi049.stdout:4/482: read d4/d3f/d14/d15/f18 [2688874,125437] 0 2024-06-03T00:03:05.829 INFO:tasks.workunit.client.0.smithi049.stdout:4/483: link d4/d2a/f34 d4/d3f/d14/d2b/d84/d1c/d24/f9a 0 2024-06-03T00:03:05.830 INFO:tasks.workunit.client.0.smithi049.stdout:4/484: creat d4/d3f/d14/d2b/d84/f9b x:0 0 0 2024-06-03T00:03:05.832 INFO:tasks.workunit.client.0.smithi049.stdout:1/521: dwrite d1/d2f/d36/d37/d13/d34/d8f/d94/f95 [0,4194304] 0 2024-06-03T00:03:05.834 INFO:tasks.workunit.client.0.smithi049.stdout:1/522: rmdir d1/d2f/d36/d37/d2c/d45/d61/d70 39 2024-06-03T00:03:05.836 INFO:tasks.workunit.client.0.smithi049.stdout:1/523: creat d1/d2f/d36/d37/d2c/d45/da0/dab/fbc x:0 0 0 2024-06-03T00:03:05.837 INFO:tasks.workunit.client.0.smithi049.stdout:4/485: dread d4/d2a/f5d [0,4194304] 0 2024-06-03T00:03:05.838 INFO:tasks.workunit.client.0.smithi049.stdout:1/524: creat d1/d2f/fbd x:0 0 0 2024-06-03T00:03:05.838 INFO:tasks.workunit.client.0.smithi049.stdout:1/525: chown d1/d2f/d50/fb8 846105 1 2024-06-03T00:03:05.839 INFO:tasks.workunit.client.0.smithi049.stdout:4/486: dread d4/d3f/d14/d2b/d84/d1c/d24/f42 [0,4194304] 0 2024-06-03T00:03:05.840 INFO:tasks.workunit.client.0.smithi049.stdout:4/487: rename d4/d3f/d14/d2b/f6b to d4/d3f/d14/d7f/d87/f9c 0 2024-06-03T00:03:05.842 INFO:tasks.workunit.client.0.smithi049.stdout:4/488: rename d4/d2a/f74 to d4/d3f/d14/d2b/d84/d1c/d24/d43/f9d 0 2024-06-03T00:03:05.846 INFO:tasks.workunit.client.0.smithi049.stdout:4/489: rename d4/d3f/l19 to d4/d2a/l9e 0 2024-06-03T00:03:05.846 INFO:tasks.workunit.client.0.smithi049.stdout:1/526: write d1/d2f/d36/d37/d64/d6c/f92 [3627680,110575] 0 2024-06-03T00:03:05.849 INFO:tasks.workunit.client.0.smithi049.stdout:1/527: dread d1/d2f/d50/fa4 [0,4194304] 0 2024-06-03T00:03:05.853 INFO:tasks.workunit.client.0.smithi049.stdout:4/490: dread d4/d3f/d14/f40 [0,4194304] 0 2024-06-03T00:03:05.857 INFO:tasks.workunit.client.0.smithi049.stdout:1/528: dread d1/d2f/d36/d37/d64/d6c/f7a [0,4194304] 0 2024-06-03T00:03:05.861 INFO:tasks.workunit.client.0.smithi049.stdout:4/491: dread d4/d3f/d14/d2b/d84/d1c/d4f/f5c [0,4194304] 0 2024-06-03T00:03:05.862 INFO:tasks.workunit.client.0.smithi049.stdout:4/492: dread - d4/d3f/f79 zero size 2024-06-03T00:03:05.862 INFO:tasks.workunit.client.0.smithi049.stdout:4/493: rmdir d4/d3f/d14/d2b/d84/d1c/d4f 39 2024-06-03T00:03:05.863 INFO:tasks.workunit.client.0.smithi049.stdout:4/494: creat d4/d2a/f9f x:0 0 0 2024-06-03T00:03:05.870 INFO:tasks.workunit.client.0.smithi049.stdout:7/478: sync 2024-06-03T00:03:05.870 INFO:tasks.workunit.client.0.smithi049.stdout:5/442: sync 2024-06-03T00:03:05.872 INFO:tasks.workunit.client.0.smithi049.stdout:7/479: creat d3/d6/d3f/fad x:0 0 0 2024-06-03T00:03:05.872 INFO:tasks.workunit.client.0.smithi049.stdout:5/443: dread d3/d9/d20/d4c/d5a/d65/f71 [0,4194304] 0 2024-06-03T00:03:05.873 INFO:tasks.workunit.client.0.smithi049.stdout:7/480: mkdir d3/d6/d86/d90/dae 0 2024-06-03T00:03:05.873 INFO:tasks.workunit.client.0.smithi049.stdout:5/444: creat d3/d9/d20/d4c/d5a/d6f/f8b x:0 0 0 2024-06-03T00:03:05.873 INFO:tasks.workunit.client.0.smithi049.stdout:5/445: chown d3/d5/da/f67 2821541 1 2024-06-03T00:03:05.874 INFO:tasks.workunit.client.0.smithi049.stdout:5/446: creat d3/d7d/f8c x:0 0 0 2024-06-03T00:03:05.876 INFO:tasks.workunit.client.0.smithi049.stdout:7/481: dread d3/d6/d13/f65 [0,4194304] 0 2024-06-03T00:03:05.877 INFO:tasks.workunit.client.0.smithi049.stdout:7/482: link d3/d6/d13/d3c/d4b/d8e/ca4 d3/d6/d9/d8f/caf 0 2024-06-03T00:03:05.878 INFO:tasks.workunit.client.0.smithi049.stdout:7/483: getdents d3/d6/d86/d8d 0 2024-06-03T00:03:05.879 INFO:tasks.workunit.client.0.smithi049.stdout:4/495: dwrite d4/d3f/d14/d2b/d84/f67 [0,4194304] 0 2024-06-03T00:03:05.880 INFO:tasks.workunit.client.0.smithi049.stdout:4/496: read d4/d3f/d14/d2b/d84/d1c/d24/d43/f4b [95116,124295] 0 2024-06-03T00:03:05.881 INFO:tasks.workunit.client.0.smithi049.stdout:4/497: symlink d4/d3f/d14/d82/la0 0 2024-06-03T00:03:05.882 INFO:tasks.workunit.client.0.smithi049.stdout:1/529: dwrite d1/d2f/d36/d57/d72/f93 [0,4194304] 0 2024-06-03T00:03:05.883 INFO:tasks.workunit.client.0.smithi049.stdout:4/498: symlink d4/d3f/la1 0 2024-06-03T00:03:05.886 INFO:tasks.workunit.client.0.smithi049.stdout:1/530: creat d1/fbe x:0 0 0 2024-06-03T00:03:05.887 INFO:tasks.workunit.client.0.smithi049.stdout:7/484: dread d3/d6/d13/d3c/d48/d7b/d9c/f51 [0,4194304] 0 2024-06-03T00:03:05.888 INFO:tasks.workunit.client.0.smithi049.stdout:7/485: creat d3/d6/d13/d4a/fb0 x:0 0 0 2024-06-03T00:03:05.889 INFO:tasks.workunit.client.0.smithi049.stdout:4/499: link d4/d3f/d14/d2b/d84/d1c/d24/d43/f4b d4/d3f/d14/fa2 0 2024-06-03T00:03:05.889 INFO:tasks.workunit.client.0.smithi049.stdout:7/486: symlink d3/d32/d95/lb1 0 2024-06-03T00:03:05.890 INFO:tasks.workunit.client.0.smithi049.stdout:7/487: symlink d3/d6/d86/d90/dae/lb2 0 2024-06-03T00:03:05.891 INFO:tasks.workunit.client.0.smithi049.stdout:4/500: creat d4/d3f/d14/d7f/fa3 x:0 0 0 2024-06-03T00:03:05.891 INFO:tasks.workunit.client.0.smithi049.stdout:7/488: rename d3/d14/d6e/f98 to d3/d6/d13/d54/daa/fb3 0 2024-06-03T00:03:05.891 INFO:tasks.workunit.client.0.smithi049.stdout:7/489: chown d3/d6/d13/d3c/d4b/d8e/cab 18 1 2024-06-03T00:03:05.892 INFO:tasks.workunit.client.0.smithi049.stdout:7/490: mknod d3/d6/d13/d54/d96/cb4 0 2024-06-03T00:03:05.892 INFO:tasks.workunit.client.0.smithi049.stdout:4/501: truncate d4/d3f/d14/d15/f28 4376096 0 2024-06-03T00:03:05.893 INFO:tasks.workunit.client.0.smithi049.stdout:5/447: dwrite d3/d5/da/f67 [0,4194304] 0 2024-06-03T00:03:05.893 INFO:tasks.workunit.client.0.smithi049.stdout:5/448: readlink d3/d5/da/d55/l72 0 2024-06-03T00:03:05.894 INFO:tasks.workunit.client.0.smithi049.stdout:4/502: creat d4/d2a/fa4 x:0 0 0 2024-06-03T00:03:05.898 INFO:tasks.workunit.client.0.smithi049.stdout:4/503: symlink d4/d3f/d14/d7f/la5 0 2024-06-03T00:03:05.900 INFO:tasks.workunit.client.0.smithi049.stdout:4/504: mkdir d4/d3f/d14/d2b/d84/d69/d89/da6 0 2024-06-03T00:03:05.900 INFO:tasks.workunit.client.0.smithi049.stdout:4/505: chown d4/d2a/l3e 14155536 1 2024-06-03T00:03:05.900 INFO:tasks.workunit.client.0.smithi049.stdout:1/531: dwrite d1/d2f/d36/d37/d2c/d45/d61/d70/f85 [0,4194304] 0 2024-06-03T00:03:05.901 INFO:tasks.workunit.client.0.smithi049.stdout:4/506: creat d4/d3f/d14/d2b/d84/d69/d89/da6/fa7 x:0 0 0 2024-06-03T00:03:05.904 INFO:tasks.workunit.client.0.smithi049.stdout:1/532: truncate d1/d2f/d36/d37/d13/d34/f3c 244 0 2024-06-03T00:03:05.905 INFO:tasks.workunit.client.0.smithi049.stdout:4/507: creat d4/fa8 x:0 0 0 2024-06-03T00:03:05.906 INFO:tasks.workunit.client.0.smithi049.stdout:4/508: truncate d4/d3f/d14/d2b/d84/d1c/f6f 284497 0 2024-06-03T00:03:05.906 INFO:tasks.workunit.client.0.smithi049.stdout:1/533: creat d1/d2f/d36/d57/da1/fbf x:0 0 0 2024-06-03T00:03:05.906 INFO:tasks.workunit.client.0.smithi049.stdout:1/534: chown d1/d2f/l43 12 1 2024-06-03T00:03:05.909 INFO:tasks.workunit.client.0.smithi049.stdout:4/509: rename d4/d3f/d14/d2b/d84/d1c/d4f/f6e to d4/d3f/d14/d2b/d84/d1c/d7a/d8a/fa9 0 2024-06-03T00:03:05.910 INFO:tasks.workunit.client.0.smithi049.stdout:1/535: write d1/f1e [3419013,73491] 0 2024-06-03T00:03:05.911 INFO:tasks.workunit.client.0.smithi049.stdout:4/510: creat d4/d3f/d14/d2b/faa x:0 0 0 2024-06-03T00:03:05.918 INFO:tasks.workunit.client.0.smithi049.stdout:5/449: dwrite d3/d5/da/d55/d14/d16/f25 [0,4194304] 0 2024-06-03T00:03:05.920 INFO:tasks.workunit.client.0.smithi049.stdout:7/491: dwrite d3/d6/d13/f7c [0,4194304] 0 2024-06-03T00:03:05.920 INFO:tasks.workunit.client.0.smithi049.stdout:7/492: fdatasync d3/d6/d86/fa9 0 2024-06-03T00:03:05.930 INFO:tasks.workunit.client.0.smithi049.stdout:5/450: dread f1 [0,4194304] 0 2024-06-03T00:03:05.933 INFO:tasks.workunit.client.0.smithi049.stdout:4/511: dwrite d4/d3f/d14/d7f/fa3 [0,4194304] 0 2024-06-03T00:03:05.934 INFO:tasks.workunit.client.0.smithi049.stdout:1/536: dwrite d1/d2f/d36/d37/d13/fba [0,4194304] 0 2024-06-03T00:03:05.934 INFO:tasks.workunit.client.0.smithi049.stdout:1/537: write d1/d2f/d36/f4e [821352,84224] 0 2024-06-03T00:03:05.935 INFO:tasks.workunit.client.0.smithi049.stdout:7/493: dwrite d3/d6/d13/d3c/d4b/f7a [0,4194304] 0 2024-06-03T00:03:05.938 INFO:tasks.workunit.client.0.smithi049.stdout:7/494: rmdir d3/d6 39 2024-06-03T00:03:05.939 INFO:tasks.workunit.client.0.smithi049.stdout:1/538: mknod d1/d2f/d36/d37/d13/d34/d5f/cc0 0 2024-06-03T00:03:05.939 INFO:tasks.workunit.client.0.smithi049.stdout:1/539: chown d1/d2f/d78/ca9 1 1 2024-06-03T00:03:05.942 INFO:tasks.workunit.client.0.smithi049.stdout:1/540: unlink d1/d2f/d36/d37/cc 0 2024-06-03T00:03:05.944 INFO:tasks.workunit.client.0.smithi049.stdout:4/512: write d4/d3f/d14/d2b/d84/d1c/d4f/f5c [2817632,85193] 0 2024-06-03T00:03:05.944 INFO:tasks.workunit.client.0.smithi049.stdout:4/513: truncate d4/d3f/d14/d2b/d84/d1c/f7e 4771116 0 2024-06-03T00:03:05.944 INFO:tasks.workunit.client.0.smithi049.stdout:4/514: dread - d4/d2a/f96 zero size 2024-06-03T00:03:05.945 INFO:tasks.workunit.client.0.smithi049.stdout:4/515: creat d4/d3f/d14/d2b/d84/d1c/d24/d43/fab x:0 0 0 2024-06-03T00:03:05.946 INFO:tasks.workunit.client.0.smithi049.stdout:4/516: mknod d4/d3f/d14/d7f/d87/cac 0 2024-06-03T00:03:05.947 INFO:tasks.workunit.client.0.smithi049.stdout:4/517: rmdir d4 39 2024-06-03T00:03:05.949 INFO:tasks.workunit.client.0.smithi049.stdout:4/518: mknod d4/d3f/d14/d2b/cad 0 2024-06-03T00:03:05.949 INFO:tasks.workunit.client.0.smithi049.stdout:4/519: stat d4/d3f/d14/d2b/d84/d1c/d24/d43/l5a 0 2024-06-03T00:03:05.949 INFO:tasks.workunit.client.0.smithi049.stdout:4/520: dread - d4/d3f/d14/d2b/faa zero size 2024-06-03T00:03:05.950 INFO:tasks.workunit.client.0.smithi049.stdout:4/521: rename d4/d3f/d14/c73 to d4/d3f/d14/d2b/d84/d69/d89/cae 0 2024-06-03T00:03:05.951 INFO:tasks.workunit.client.0.smithi049.stdout:4/522: rmdir d4/d3f/d14/d2b/d84/d69/d89 39 2024-06-03T00:03:05.951 INFO:tasks.workunit.client.0.smithi049.stdout:5/451: dwrite d3/d9/f28 [0,4194304] 0 2024-06-03T00:03:05.951 INFO:tasks.workunit.client.0.smithi049.stdout:5/452: fdatasync d3/d9/d20/d4c/d5a/d65/f71 0 2024-06-03T00:03:05.952 INFO:tasks.workunit.client.0.smithi049.stdout:4/523: mkdir d4/d3f/d14/d2b/d84/d1c/d24/d43/daf 0 2024-06-03T00:03:05.953 INFO:tasks.workunit.client.0.smithi049.stdout:4/524: mknod d4/d3f/d14/d2b/d84/d69/cb0 0 2024-06-03T00:03:05.970 INFO:tasks.workunit.client.0.smithi049.stdout:1/541: dwrite d1/d2f/d36/d37/d13/d34/f3f [0,4194304] 0 2024-06-03T00:03:05.970 INFO:tasks.workunit.client.0.smithi049.stdout:4/525: dwrite d4/d3f/d14/d2b/d84/d1c/f25 [0,4194304] 0 2024-06-03T00:03:05.973 INFO:tasks.workunit.client.0.smithi049.stdout:1/542: symlink d1/d2f/d36/d37/d13/d34/d52/lc1 0 2024-06-03T00:03:05.976 INFO:tasks.workunit.client.0.smithi049.stdout:1/543: rmdir d1/d2f/d36/d37/db5 0 2024-06-03T00:03:05.986 INFO:tasks.workunit.client.0.smithi049.stdout:4/526: dwrite d4/d3f/d14/d2b/d84/d1c/d24/d43/f9d [0,4194304] 0 2024-06-03T00:03:05.986 INFO:tasks.workunit.client.0.smithi049.stdout:4/527: dread - d4/d3f/d14/d2b/d84/d1c/d4f/f86 zero size 2024-06-03T00:03:05.988 INFO:tasks.workunit.client.0.smithi049.stdout:4/528: creat d4/d3f/fb1 x:0 0 0 2024-06-03T00:03:05.995 INFO:tasks.workunit.client.0.smithi049.stdout:1/544: dwrite d1/d2f/d36/d57/da1/fbf [0,4194304] 0 2024-06-03T00:03:05.995 INFO:tasks.workunit.client.0.smithi049.stdout:1/545: fdatasync d1/d2f/d36/d37/f14 0 2024-06-03T00:03:05.996 INFO:tasks.workunit.client.0.smithi049.stdout:1/546: mknod d1/d2f/d36/d37/d2c/d45/d61/d70/cc2 0 2024-06-03T00:03:05.997 INFO:tasks.workunit.client.0.smithi049.stdout:1/547: mknod d1/d2f/d50/d6b/cc3 0 2024-06-03T00:03:05.997 INFO:tasks.workunit.client.0.smithi049.stdout:1/548: chown d1/d2f/d36/d37/d13/d34/f3c 187026094 1 2024-06-03T00:03:05.998 INFO:tasks.workunit.client.0.smithi049.stdout:1/549: dread - d1/d2f/d36/d37/d64/d6c/d8c/f97 zero size 2024-06-03T00:03:05.998 INFO:tasks.workunit.client.0.smithi049.stdout:1/550: stat d1/d2f/d36/d37/d13/d34/ca3 0 2024-06-03T00:03:05.998 INFO:tasks.workunit.client.0.smithi049.stdout:4/529: dread d4/d3f/d14/d2b/d84/d1c/d4f/f61 [0,4194304] 0 2024-06-03T00:03:05.998 INFO:tasks.workunit.client.0.smithi049.stdout:4/530: chown d4/d3f/d14/d2b/d84/l20 31329 1 2024-06-03T00:03:05.999 INFO:tasks.workunit.client.0.smithi049.stdout:1/551: link d1/d2f/d50/fa4 d1/d2f/d78/fc4 0 2024-06-03T00:03:05.999 INFO:tasks.workunit.client.0.smithi049.stdout:1/552: stat d1/d2f/l43 0 2024-06-03T00:03:06.000 INFO:tasks.workunit.client.0.smithi049.stdout:4/531: unlink d4/d2a/l68 0 2024-06-03T00:03:06.001 INFO:tasks.workunit.client.0.smithi049.stdout:4/532: creat d4/d3f/d14/d2b/d84/d69/d89/fb2 x:0 0 0 2024-06-03T00:03:06.002 INFO:tasks.workunit.client.0.smithi049.stdout:4/533: symlink d4/d3f/d14/d2b/lb3 0 2024-06-03T00:03:06.007 INFO:tasks.workunit.client.0.smithi049.stdout:1/553: dread d1/d2f/d36/d37/d2c/d45/d61/d70/f85 [0,4194304] 0 2024-06-03T00:03:06.007 INFO:tasks.workunit.client.0.smithi049.stdout:1/554: write d1/d2f/d36/d37/d2c/d45/d61/d67/f7b [56118,34029] 0 2024-06-03T00:03:06.007 INFO:tasks.workunit.client.0.smithi049.stdout:1/555: truncate d1/d2f/d36/d37/fa7 1480541 0 2024-06-03T00:03:06.008 INFO:tasks.workunit.client.0.smithi049.stdout:1/556: creat d1/d2f/d36/d37/fc5 x:0 0 0 2024-06-03T00:03:06.008 INFO:tasks.workunit.client.0.smithi049.stdout:1/557: fdatasync d1/d2f/d36/d57/f5c 0 2024-06-03T00:03:06.008 INFO:tasks.workunit.client.0.smithi049.stdout:1/558: write d1/d2f/d36/d37/d2c/d45/d61/f69 [1516818,103754] 0 2024-06-03T00:03:06.010 INFO:tasks.workunit.client.0.smithi049.stdout:1/559: unlink d1/d2f/d36/d37/d13/d34/d52/l80 0 2024-06-03T00:03:06.010 INFO:tasks.workunit.client.0.smithi049.stdout:4/534: write d4/d3f/d14/d2b/d84/d1c/d4f/f66 [1951429,11154] 0 2024-06-03T00:03:06.013 INFO:tasks.workunit.client.0.smithi049.stdout:1/560: mkdir d1/d2f/d36/d37/d13/dc6 0 2024-06-03T00:03:06.014 INFO:tasks.workunit.client.0.smithi049.stdout:4/535: mknod d4/d3f/d14/d2b/cb4 0 2024-06-03T00:03:06.015 INFO:tasks.workunit.client.0.smithi049.stdout:1/561: symlink d1/d2f/d36/d37/d2c/d45/d5e/lc7 0 2024-06-03T00:03:06.017 INFO:tasks.workunit.client.0.smithi049.stdout:4/536: creat d4/d3f/d14/fb5 x:0 0 0 2024-06-03T00:03:06.017 INFO:tasks.workunit.client.0.smithi049.stdout:4/537: fdatasync d4/d3f/d14/d2b/d84/d1c/d7a/f80 0 2024-06-03T00:03:06.017 INFO:tasks.workunit.client.0.smithi049.stdout:1/562: mknod d1/d2f/d36/d37/d13/d34/d6e/cc8 0 2024-06-03T00:03:06.019 INFO:tasks.workunit.client.0.smithi049.stdout:4/538: rename d4/d3f/d14/d2b/cb4 to d4/d3f/d14/d15/cb6 0 2024-06-03T00:03:06.019 INFO:tasks.workunit.client.0.smithi049.stdout:4/539: write d4/d3f/d14/d2b/d84/d1c/d4f/f66 [2053092,120150] 0 2024-06-03T00:03:06.020 INFO:tasks.workunit.client.0.smithi049.stdout:1/563: mknod d1/d2f/d50/d6b/cc9 0 2024-06-03T00:03:06.022 INFO:tasks.workunit.client.0.smithi049.stdout:4/540: mknod d4/d3f/d14/cb7 0 2024-06-03T00:03:06.022 INFO:tasks.workunit.client.0.smithi049.stdout:4/541: write d4/d2a/f9f [949075,117516] 0 2024-06-03T00:03:06.023 INFO:tasks.workunit.client.0.smithi049.stdout:1/564: symlink d1/d2f/d36/d37/d13/d34/d8f/lca 0 2024-06-03T00:03:06.024 INFO:tasks.workunit.client.0.smithi049.stdout:4/542: rmdir d4/d3f/d14/d82 39 2024-06-03T00:03:06.024 INFO:tasks.workunit.client.0.smithi049.stdout:1/565: dread d1/d2f/d36/d37/d64/f8b [0,4194304] 0 2024-06-03T00:03:06.024 INFO:tasks.workunit.client.0.smithi049.stdout:1/566: dread - d1/d1a/f74 zero size 2024-06-03T00:03:06.026 INFO:tasks.workunit.client.0.smithi049.stdout:4/543: mknod d4/d3f/d14/d2b/d84/d69/d89/cb8 0 2024-06-03T00:03:06.026 INFO:tasks.workunit.client.0.smithi049.stdout:4/544: fdatasync d4/d3f/d14/d2b/d84/d1c/f2c 0 2024-06-03T00:03:06.026 INFO:tasks.workunit.client.0.smithi049.stdout:4/545: chown d4/d3f/d14/d2b/c46 29 1 2024-06-03T00:03:06.027 INFO:tasks.workunit.client.0.smithi049.stdout:1/567: unlink d1/d2f/d36/d37/d13/d34/l55 0 2024-06-03T00:03:06.028 INFO:tasks.workunit.client.0.smithi049.stdout:4/546: symlink d4/d3f/d14/d2b/d84/d69/lb9 0 2024-06-03T00:03:06.029 INFO:tasks.workunit.client.0.smithi049.stdout:1/568: rename d1/d2f/c38 to d1/d1a/ccb 0 2024-06-03T00:03:06.030 INFO:tasks.workunit.client.0.smithi049.stdout:4/547: creat d4/d3f/d14/d2b/d84/d1c/d24/d43/fba x:0 0 0 2024-06-03T00:03:06.031 INFO:tasks.workunit.client.0.smithi049.stdout:4/548: creat d4/d2a/fbb x:0 0 0 2024-06-03T00:03:06.033 INFO:tasks.workunit.client.0.smithi049.stdout:4/549: link d4/fa8 d4/d3f/d14/d2b/d84/d69/fbc 0 2024-06-03T00:03:06.033 INFO:tasks.workunit.client.0.smithi049.stdout:4/550: rmdir d4/d3f/d14/d7f 39 2024-06-03T00:03:06.035 INFO:tasks.workunit.client.0.smithi049.stdout:4/551: rename d4/d3f/d14/d2b/d84/d1c/d4f/f61 to d4/d3f/d14/d2b/d84/d1c/d7a/fbd 0 2024-06-03T00:03:06.036 INFO:tasks.workunit.client.0.smithi049.stdout:4/552: unlink d4/d3f/d14/d2b/d84/d1c/d24/d43/f4b 0 2024-06-03T00:03:06.037 INFO:tasks.workunit.client.0.smithi049.stdout:4/553: creat d4/d3f/d14/d2b/d84/d1c/d24/d43/fbe x:0 0 0 2024-06-03T00:03:06.055 INFO:tasks.workunit.client.0.smithi049.stdout:1/569: dwrite d1/d2f/d36/d37/f2b [4194304,4194304] 0 2024-06-03T00:03:06.058 INFO:tasks.workunit.client.0.smithi049.stdout:4/554: dwrite d4/d3f/d14/fa2 [0,4194304] 0 2024-06-03T00:03:06.062 INFO:tasks.workunit.client.0.smithi049.stdout:4/555: getdents d4/d3f/d14/d7f 0 2024-06-03T00:03:06.062 INFO:tasks.workunit.client.0.smithi049.stdout:4/556: truncate d4/d2a/f8c 1619579 0 2024-06-03T00:03:06.069 INFO:tasks.workunit.client.0.smithi049.stdout:1/570: dwrite d1/d2f/d78/f9f [0,4194304] 0 2024-06-03T00:03:06.069 INFO:tasks.workunit.client.0.smithi049.stdout:1/571: chown d1/d2f/d36/d37/f2b 65009674 1 2024-06-03T00:03:06.076 INFO:tasks.workunit.client.0.smithi049.stdout:1/572: creat d1/d2f/d36/d37/d13/dc6/fcc x:0 0 0 2024-06-03T00:03:06.078 INFO:tasks.workunit.client.0.smithi049.stdout:1/573: symlink d1/d2f/d36/d37/d13/d34/d6e/lcd 0 2024-06-03T00:03:06.083 INFO:tasks.workunit.client.0.smithi049.stdout:1/574: rename d1/d2f/d36/d37/f14 to d1/d2f/d50/fce 0 2024-06-03T00:03:06.100 INFO:tasks.workunit.client.0.smithi049.stdout:1/575: dwrite d1/d2f/d36/d37/d2c/d45/da0/dab/fbc [0,4194304] 0 2024-06-03T00:03:06.100 INFO:tasks.workunit.client.0.smithi049.stdout:1/576: dread - d1/d2f/d36/d37/d2c/fbb zero size 2024-06-03T00:03:06.100 INFO:tasks.workunit.client.0.smithi049.stdout:1/577: write d1/d2f/d36/d37/d2c/d45/d61/d70/faa [777695,78147] 0 2024-06-03T00:03:06.102 INFO:tasks.workunit.client.0.smithi049.stdout:1/578: symlink d1/d2f/d36/d37/d2c/lcf 0 2024-06-03T00:03:06.104 INFO:tasks.workunit.client.0.smithi049.stdout:1/579: mkdir d1/d2f/d36/d37/d13/d34/dd0 0 2024-06-03T00:03:06.105 INFO:tasks.workunit.client.0.smithi049.stdout:1/580: mkdir d1/d2f/d36/d37/d2c/d45/d5e/dd1 0 2024-06-03T00:03:06.107 INFO:tasks.workunit.client.0.smithi049.stdout:1/581: mkdir d1/d1a/dd2 0 2024-06-03T00:03:06.110 INFO:tasks.workunit.client.0.smithi049.stdout:1/582: truncate d1/d2f/d36/d37/d2c/d45/da0/dab/fbc 1730596 0 2024-06-03T00:03:06.122 INFO:tasks.workunit.client.0.smithi049.stdout:1/583: dwrite d1/d1a/f79 [4194304,4194304] 0 2024-06-03T00:03:06.130 INFO:tasks.workunit.client.0.smithi049.stdout:1/584: dread d1/d2f/d36/d37/d13/d34/f3f [0,4194304] 0 2024-06-03T00:03:06.131 INFO:tasks.workunit.client.0.smithi049.stdout:1/585: write d1/d2f/d36/d37/d13/f47 [675061,107198] 0 2024-06-03T00:03:06.131 INFO:tasks.workunit.client.0.smithi049.stdout:1/586: chown d1/d2f/d36/d37/d13/d34/d8f/lca 54272 1 2024-06-03T00:03:06.132 INFO:tasks.workunit.client.0.smithi049.stdout:1/587: creat d1/d2f/d36/d37/d13/d42/d7d/fd3 x:0 0 0 2024-06-03T00:03:06.132 INFO:tasks.workunit.client.0.smithi049.stdout:1/588: chown d1/d2f/d36/d37/d2c/c86 66 1 2024-06-03T00:03:06.134 INFO:tasks.workunit.client.0.smithi049.stdout:1/589: creat d1/d2f/d36/d37/d13/d34/fd4 x:0 0 0 2024-06-03T00:03:06.135 INFO:tasks.workunit.client.0.smithi049.stdout:1/590: mknod d1/d2f/d36/d57/cd5 0 2024-06-03T00:03:06.137 INFO:tasks.workunit.client.0.smithi049.stdout:1/591: creat d1/d2f/d36/d37/d13/d42/fd6 x:0 0 0 2024-06-03T00:03:06.137 INFO:tasks.workunit.client.0.smithi049.stdout:1/592: write d1/d2f/d36/d37/f35 [4758560,41502] 0 2024-06-03T00:03:06.137 INFO:tasks.workunit.client.0.smithi049.stdout:1/593: fdatasync d1/d2f/d36/d37/f68 0 2024-06-03T00:03:06.138 INFO:tasks.workunit.client.0.smithi049.stdout:1/594: stat d1/d2f/d36/d37/d13/d34/d5f/lac 0 2024-06-03T00:03:06.144 INFO:tasks.workunit.client.0.smithi049.stdout:1/595: rename d1/d2f/d36/d37/d13/d42 to d1/d2f/d78/dd7 0 2024-06-03T00:03:06.147 INFO:tasks.workunit.client.0.smithi049.stdout:1/596: dread d1/d2f/d36/d37/d2c/d45/d61/d70/f85 [0,4194304] 0 2024-06-03T00:03:06.148 INFO:tasks.workunit.client.0.smithi049.stdout:1/597: dread - d1/d2f/d36/d37/fc5 zero size 2024-06-03T00:03:06.149 INFO:tasks.workunit.client.0.smithi049.stdout:1/598: rmdir d1/d2f/d36/d37 39 2024-06-03T00:03:06.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.970+0000 7f604bccd700 1 -- 172.21.15.49:0/1716694690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f604406ac00 msgr2=0x7f604406b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:06.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.970+0000 7f604bccd700 1 --2- 172.21.15.49:0/1716694690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f604406ac00 0x7f604406b080 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6034009990 tx=0x7f6034009ca0 comp rx=0 tx=0).stop 2024-06-03T00:03:06.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.971+0000 7f604bccd700 1 -- 172.21.15.49:0/1716694690 shutdown_connections 2024-06-03T00:03:06.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.971+0000 7f604bccd700 1 --2- 172.21.15.49:0/1716694690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f604406b5c0 0x7f604410f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:06.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.971+0000 7f604bccd700 1 --2- 172.21.15.49:0/1716694690 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6044108530 0x7f6044108910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:06.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.971+0000 7f604bccd700 1 --2- 172.21.15.49:0/1716694690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f604406ac00 0x7f604406b080 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:06.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.971+0000 7f604bccd700 1 -- 172.21.15.49:0/1716694690 >> 172.21.15.49:0/1716694690 conn(0x7f6044077400 msgr2=0x7f6044077810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:06.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.971+0000 7f604bccd700 1 -- 172.21.15.49:0/1716694690 shutdown_connections 2024-06-03T00:03:06.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.971+0000 7f604bccd700 1 -- 172.21.15.49:0/1716694690 wait complete. 2024-06-03T00:03:06.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.972+0000 7f604bccd700 1 Processor -- start 2024-06-03T00:03:06.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.972+0000 7f604bccd700 1 -- start start 2024-06-03T00:03:06.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.972+0000 7f604bccd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f604406ac00 0x7f604419e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:06.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.972+0000 7f604bccd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f604406b5c0 0x7f604419ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:06.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.972+0000 7f604bccd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6044108530 0x7f6044198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:06.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.972+0000 7f604bccd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6044112760 con 0x7f604406ac00 2024-06-03T00:03:06.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.972+0000 7f604bccd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f60441125e0 con 0x7f604406b5c0 2024-06-03T00:03:06.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.972+0000 7f604bccd700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f60441128e0 con 0x7f6044108530 2024-06-03T00:03:06.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.972+0000 7f6049a69700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f604406ac00 0x7f604419e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:06.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.972+0000 7f6049268700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f604406b5c0 0x7f604419ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:06.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.972+0000 7f604a26a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6044108530 0x7f6044198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:06.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.972+0000 7f6049268700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f604406b5c0 0x7f604419ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.49:41132/0 (socket says 172.21.15.49:41132) 2024-06-03T00:03:06.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.972+0000 7f6049268700 1 -- 172.21.15.49:0/29791734 learned_addr learned my addr 172.21.15.49:0/29791734 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:06.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.973+0000 7f6049268700 1 -- 172.21.15.49:0/29791734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6044108530 msgr2=0x7f6044198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:06.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.973+0000 7f6049268700 1 --2- 172.21.15.49:0/29791734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6044108530 0x7f6044198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:06.278 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:03:06.278 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1553264866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1553264866},{"type":"v1","addr":"172.21.15.49:6835","nonce":1553264866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2266285252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2266285252},{"type":"v1","addr":"172.21.15.49:6837","nonce":2266285252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T23:57:16.991201+0000","modified":"2024-06-03T00:02:52.952379+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24485,"mds_2":24466,"mds_3":24464,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6839/1729124617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":1729124617},{"type":"v1","addr":"172.21.15.49:6839","nonce":1729124617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6841/1902772235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":1902772235},{"type":"v1","addr":"172.21.15.49:6841","nonce":1902772235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6833/1633534002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1633534002},{"type":"v1","addr":"172.21.15.57:6833","nonce":1633534002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6835/2254905671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2254905671},{"type":"v1","addr":"172.21.15.57:6835","nonce":2254905671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.107:6835/3693542801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3693542801},{"type":"v1","addr":"172.21.15.107:6835","nonce":3693542801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.57:6837/230452144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":230452144},{"type":"v1","addr":"172.21.15.57:6837","nonce":230452144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":92,"addr":"172.21.15.107:6837/3700593315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":3700593315},{"type":"v1","addr":"172.21.15.107:6837","nonce":3700593315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6839/249825195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":249825195},{"type":"v1","addr":"172.21.15.57:6839","nonce":249825195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6839/1986600681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1986600681},{"type":"v1","addr":"172.21.15.107:6839","nonce":1986600681}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24485,24464,24460,24466,24487]},"id":1}]} 2024-06-03T00:03:06.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.973+0000 7f6049268700 1 -- 172.21.15.49:0/29791734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f604406ac00 msgr2=0x7f604419e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:06.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.973+0000 7f6049268700 1 --2- 172.21.15.49:0/29791734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f604406ac00 0x7f604419e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:06.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.973+0000 7f6049268700 1 -- 172.21.15.49:0/29791734 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6044199220 con 0x7f604406b5c0 2024-06-03T00:03:06.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.973+0000 7f6049a69700 1 --2- 172.21.15.49:0/29791734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f604406ac00 0x7f604419e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:06.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.973+0000 7f604a26a700 1 --2- 172.21.15.49:0/29791734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6044108530 0x7f6044198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:06.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.973+0000 7f6049268700 1 --2- 172.21.15.49:0/29791734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f604406b5c0 0x7f604419ee40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6034000c00 tx=0x7f60340047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:06.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.973+0000 7f603affd700 1 -- 172.21.15.49:0/29791734 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6034027070 con 0x7f604406b5c0 2024-06-03T00:03:06.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.973+0000 7f603affd700 1 -- 172.21.15.49:0/29791734 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6034003e40 con 0x7f604406b5c0 2024-06-03T00:03:06.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.973+0000 7f604bccd700 1 -- 172.21.15.49:0/29791734 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60441994b0 con 0x7f604406b5c0 2024-06-03T00:03:06.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.973+0000 7f603affd700 1 -- 172.21.15.49:0/29791734 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6034022d10 con 0x7f604406b5c0 2024-06-03T00:03:06.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.973+0000 7f604bccd700 1 -- 172.21.15.49:0/29791734 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60441a57d0 con 0x7f604406b5c0 2024-06-03T00:03:06.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.975+0000 7f604bccd700 1 -- 172.21.15.49:0/29791734 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6044103bf0 con 0x7f604406b5c0 2024-06-03T00:03:06.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.976+0000 7f603affd700 1 -- 172.21.15.49:0/29791734 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f603402a070 con 0x7f604406b5c0 2024-06-03T00:03:06.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.977+0000 7f603affd700 1 --2- 172.21.15.49:0/29791734 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f60300a2ca0 0x7f60300a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:06.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.977+0000 7f603affd700 1 -- 172.21.15.49:0/29791734 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f60340cfd80 con 0x7f604406b5c0 2024-06-03T00:03:06.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.977+0000 7f6049a69700 1 --2- 172.21.15.49:0/29791734 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f60300a2ca0 0x7f60300a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:06.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.978+0000 7f6049a69700 1 --2- 172.21.15.49:0/29791734 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f60300a2ca0 0x7f60300a5160 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6040005950 tx=0x7f604000a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:06.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:05.982+0000 7f603affd700 1 -- 172.21.15.49:0/29791734 <== mon.2 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f603405e850 con 0x7f604406b5c0 2024-06-03T00:03:06.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:06.257+0000 7f604bccd700 1 -- 172.21.15.49:0/29791734 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f604402dca0 con 0x7f604406b5c0 2024-06-03T00:03:06.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:06.258+0000 7f603affd700 1 -- 172.21.15.49:0/29791734 <== mon.2 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11936 (secure 0 0 0) 0x7f6034013070 con 0x7f604406b5c0 2024-06-03T00:03:06.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:06.260+0000 7f604bccd700 1 -- 172.21.15.49:0/29791734 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f60300a2ca0 msgr2=0x7f60300a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:06.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:06.260+0000 7f604bccd700 1 --2- 172.21.15.49:0/29791734 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f60300a2ca0 0x7f60300a5160 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6040005950 tx=0x7f604000a300 comp rx=0 tx=0).stop 2024-06-03T00:03:06.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:06.260+0000 7f604bccd700 1 -- 172.21.15.49:0/29791734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f604406b5c0 msgr2=0x7f604419ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:06.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:06.260+0000 7f604bccd700 1 --2- 172.21.15.49:0/29791734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f604406b5c0 0x7f604419ee40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6034000c00 tx=0x7f60340047b0 comp rx=0 tx=0).stop 2024-06-03T00:03:06.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:06.260+0000 7f604bccd700 1 -- 172.21.15.49:0/29791734 shutdown_connections 2024-06-03T00:03:06.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:06.260+0000 7f604bccd700 1 --2- 172.21.15.49:0/29791734 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f60300a2ca0 0x7f60300a5160 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:06.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:06.260+0000 7f604bccd700 1 --2- 172.21.15.49:0/29791734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6044108530 0x7f6044198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:06.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:06.260+0000 7f604bccd700 1 --2- 172.21.15.49:0/29791734 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f604406ac00 0x7f604419e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:06.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:06.260+0000 7f604bccd700 1 --2- 172.21.15.49:0/29791734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f604406b5c0 0x7f604419ee40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:06.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:06.260+0000 7f604bccd700 1 -- 172.21.15.49:0/29791734 >> 172.21.15.49:0/29791734 conn(0x7f6044077400 msgr2=0x7f6044100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:06.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:06.260+0000 7f604bccd700 1 -- 172.21.15.49:0/29791734 shutdown_connections 2024-06-03T00:03:06.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:06.260+0000 7f604bccd700 1 -- 172.21.15.49:0/29791734 wait complete. 2024-06-03T00:03:06.281 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 31 2024-06-03T00:03:07.052 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24487 quiesce db / --timeout 90 --expiration 130 --await-for 45.0' 2024-06-03T00:03:07.052 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- timeout 105 ceph tell mds.24487 quiesce db / --timeout 90 --expiration 130 --await-for 45.0 2024-06-03T00:03:07.346 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:03:07.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:07 smithi107 ceph-mon[37048]: pgmap v475: 97 pgs: 97 active+clean; 823 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 91 MiB/s rd, 125 MiB/s wr, 1.52k op/s 2024-06-03T00:03:07.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:07 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/29791734' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:03:07.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:07 smithi057 ceph-mon[36457]: pgmap v475: 97 pgs: 97 active+clean; 823 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 91 MiB/s rd, 125 MiB/s wr, 1.52k op/s 2024-06-03T00:03:07.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:07 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/29791734' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:03:07.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:07 smithi049 ceph-mon[32302]: pgmap v475: 97 pgs: 97 active+clean; 823 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 91 MiB/s rd, 125 MiB/s wr, 1.52k op/s 2024-06-03T00:03:07.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:07 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/29791734' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:03:07.595 INFO:tasks.workunit.client.0.smithi049.stdout:7/495: sync 2024-06-03T00:03:07.596 INFO:tasks.workunit.client.0.smithi049.stdout:1/599: sync 2024-06-03T00:03:07.596 INFO:tasks.workunit.client.0.smithi049.stdout:0/338: sync 2024-06-03T00:03:07.596 INFO:tasks.workunit.client.0.smithi049.stdout:6/528: sync 2024-06-03T00:03:07.596 INFO:tasks.workunit.client.0.smithi049.stdout:9/617: sync 2024-06-03T00:03:07.596 INFO:tasks.workunit.client.0.smithi049.stdout:2/446: sync 2024-06-03T00:03:07.596 INFO:tasks.workunit.client.0.smithi049.stdout:8/326: sync 2024-06-03T00:03:07.596 INFO:tasks.workunit.client.0.smithi049.stdout:1/600: read - d1/d2f/d78/dd7/fd6 zero size 2024-06-03T00:03:07.597 INFO:tasks.workunit.client.0.smithi049.stdout:9/618: read - d1/da/d54/d5b/d61/fc4 zero size 2024-06-03T00:03:07.597 INFO:tasks.workunit.client.0.smithi049.stdout:1/601: fdatasync d1/d2f/fbd 0 2024-06-03T00:03:07.597 INFO:tasks.workunit.client.0.smithi049.stdout:9/619: truncate d1/d5/d13/d3b/dad/fb3 973320 0 2024-06-03T00:03:07.597 INFO:tasks.workunit.client.0.smithi049.stdout:6/529: stat d2/d3/d17/d57/laf 0 2024-06-03T00:03:07.597 INFO:tasks.workunit.client.0.smithi049.stdout:3/323: sync 2024-06-03T00:03:07.597 INFO:tasks.workunit.client.0.smithi049.stdout:5/453: sync 2024-06-03T00:03:07.597 INFO:tasks.workunit.client.0.smithi049.stdout:4/557: sync 2024-06-03T00:03:07.597 INFO:tasks.workunit.client.0.smithi049.stdout:3/324: write d2/d1a/f37 [1654114,82590] 0 2024-06-03T00:03:07.598 INFO:tasks.workunit.client.0.smithi049.stdout:3/325: dread - d2/d14/f2e zero size 2024-06-03T00:03:07.598 INFO:tasks.workunit.client.0.smithi049.stdout:0/339: mknod d6/d29/c78 0 2024-06-03T00:03:07.598 INFO:tasks.workunit.client.0.smithi049.stdout:8/327: creat d4/d7/d28/d52/f65 x:0 0 0 2024-06-03T00:03:07.599 INFO:tasks.workunit.client.0.smithi049.stdout:0/340: creat d6/d29/f79 x:0 0 0 2024-06-03T00:03:07.599 INFO:tasks.workunit.client.0.smithi049.stdout:0/341: chown d6/d29/d47/d4b/d67/d6e/c3e 131792123 1 2024-06-03T00:03:07.599 INFO:tasks.workunit.client.0.smithi049.stdout:2/447: creat da/d55/f91 x:0 0 0 2024-06-03T00:03:07.599 INFO:tasks.workunit.client.0.smithi049.stdout:1/602: creat d1/d2f/d50/d6b/fd8 x:0 0 0 2024-06-03T00:03:07.602 INFO:tasks.workunit.client.0.smithi049.stdout:8/328: rename d4/d27/d30/d4f to d4/d7/d28/d52/d66 0 2024-06-03T00:03:07.602 INFO:tasks.workunit.client.0.smithi049.stdout:1/603: symlink d1/d2f/d36/d37/d13/d34/d8f/ld9 0 2024-06-03T00:03:07.602 INFO:tasks.workunit.client.0.smithi049.stdout:8/329: write d4/d7/f22 [202441,2805] 0 2024-06-03T00:03:07.603 INFO:tasks.workunit.client.0.smithi049.stdout:8/330: chown d4/d27/d3c/d43 0 1 2024-06-03T00:03:07.606 INFO:tasks.workunit.client.0.smithi049.stdout:8/331: mkdir d4/d7/d28/d52/d66/d67 0 2024-06-03T00:03:07.607 INFO:tasks.workunit.client.0.smithi049.stdout:0/342: dread d6/d29/d47/d4b/d67/d6e/f2b [0,4194304] 0 2024-06-03T00:03:07.608 INFO:tasks.workunit.client.0.smithi049.stdout:8/332: symlink d4/d7/d28/d2b/l68 0 2024-06-03T00:03:07.609 INFO:tasks.workunit.client.0.smithi049.stdout:0/343: getdents d6/d29/d47/d4b/d67/d6e/d52 0 2024-06-03T00:03:07.609 INFO:tasks.workunit.client.0.smithi049.stdout:0/344: fsync d6/d59/f5b 0 2024-06-03T00:03:07.609 INFO:tasks.workunit.client.0.smithi049.stdout:0/345: fdatasync d6/d29/d47/d4b/d67/d6e/f24 0 2024-06-03T00:03:07.613 INFO:tasks.workunit.client.0.smithi049.stdout:1/604: write d1/d2f/d36/d37/d13/fba [1804283,66719] 0 2024-06-03T00:03:07.616 INFO:tasks.workunit.client.0.smithi049.stdout:4/558: dread d4/d3f/d14/d2b/f48 [0,4194304] 0 2024-06-03T00:03:07.617 INFO:tasks.workunit.client.0.smithi049.stdout:6/530: dwrite d2/d3/f38 [0,4194304] 0 2024-06-03T00:03:07.619 INFO:tasks.workunit.client.0.smithi049.stdout:4/559: rmdir d4/d3f/d14/d2b/d84/d1c/d24/d43 39 2024-06-03T00:03:07.619 INFO:tasks.workunit.client.0.smithi049.stdout:0/346: dread d6/d30/f27 [0,4194304] 0 2024-06-03T00:03:07.619 INFO:tasks.workunit.client.0.smithi049.stdout:0/347: dread - d6/d29/f79 zero size 2024-06-03T00:03:07.620 INFO:tasks.workunit.client.0.smithi049.stdout:6/531: rename d2/d3/f38 to d2/d3/d9/d23/d48/d51/fb5 0 2024-06-03T00:03:07.622 INFO:tasks.workunit.client.0.smithi049.stdout:4/560: mknod d4/d3f/d14/cbf 0 2024-06-03T00:03:07.622 INFO:tasks.workunit.client.0.smithi049.stdout:1/605: dread d1/d2f/d36/d37/f68 [0,4194304] 0 2024-06-03T00:03:07.622 INFO:tasks.workunit.client.0.smithi049.stdout:0/348: link d6/le d6/d29/d47/l7a 0 2024-06-03T00:03:07.623 INFO:tasks.workunit.client.0.smithi049.stdout:4/561: truncate d4/f6c 1370711 0 2024-06-03T00:03:07.624 INFO:tasks.workunit.client.0.smithi049.stdout:6/532: mkdir d2/d3/d9/db6 0 2024-06-03T00:03:07.624 INFO:tasks.workunit.client.0.smithi049.stdout:6/533: readlink d2/l6 0 2024-06-03T00:03:07.626 INFO:tasks.workunit.client.0.smithi049.stdout:6/534: rmdir d2/d3/d17/d57/d6e/d88 39 2024-06-03T00:03:07.626 INFO:tasks.workunit.client.0.smithi049.stdout:6/535: fsync d2/d3/d9/d55/f5c 0 2024-06-03T00:03:07.627 INFO:tasks.workunit.client.0.smithi049.stdout:4/562: symlink d4/lc0 0 2024-06-03T00:03:07.627 INFO:tasks.workunit.client.0.smithi049.stdout:4/563: read - d4/fa8 zero size 2024-06-03T00:03:07.627 INFO:tasks.workunit.client.0.smithi049.stdout:4/564: readlink d4/d3f/l5b 0 2024-06-03T00:03:07.629 INFO:tasks.workunit.client.0.smithi049.stdout:6/536: symlink d2/d3/d17/d57/d6e/lb7 0 2024-06-03T00:03:07.630 INFO:tasks.workunit.client.0.smithi049.stdout:4/565: link d4/d2a/f34 d4/d3f/d14/fc1 0 2024-06-03T00:03:07.630 INFO:tasks.workunit.client.0.smithi049.stdout:4/566: readlink d4/lb 0 2024-06-03T00:03:07.631 INFO:tasks.workunit.client.0.smithi049.stdout:4/567: fdatasync d4/d3f/d14/d2b/d84/f57 0 2024-06-03T00:03:07.631 INFO:tasks.workunit.client.0.smithi049.stdout:4/568: chown d4/d3f/d14/d2b/d84/d1c/d24/f42 1 1 2024-06-03T00:03:07.631 INFO:tasks.workunit.client.0.smithi049.stdout:4/569: getdents d4/d3f/d14/d2b/d84/d1c/d24/d43/daf 0 2024-06-03T00:03:07.632 INFO:tasks.workunit.client.0.smithi049.stdout:6/537: creat d2/fb8 x:0 0 0 2024-06-03T00:03:07.632 INFO:tasks.workunit.client.0.smithi049.stdout:6/538: fdatasync d2/d3/d9/d23/d29/f2d 0 2024-06-03T00:03:07.632 INFO:tasks.workunit.client.0.smithi049.stdout:6/539: write d2/d4d/f58 [1751196,72439] 0 2024-06-03T00:03:07.632 INFO:tasks.workunit.client.0.smithi049.stdout:7/496: dwrite d3/d6/d13/f7c [0,4194304] 0 2024-06-03T00:03:07.635 INFO:tasks.workunit.client.0.smithi049.stdout:4/570: rename d4/d3f/d14/d2b/d84/d69/d89/da6 to d4/d3f/d14/d2b/d84/d1c/d7a/dc2 0 2024-06-03T00:03:07.639 INFO:tasks.workunit.client.0.smithi049.stdout:3/326: dwrite d2/fd [0,4194304] 0 2024-06-03T00:03:07.641 INFO:tasks.workunit.client.0.smithi049.stdout:5/454: dwrite d3/d9/d20/f41 [0,4194304] 0 2024-06-03T00:03:07.641 INFO:tasks.workunit.client.0.smithi049.stdout:6/540: read d2/d3/d17/f73 [656196,73682] 0 2024-06-03T00:03:07.642 INFO:tasks.workunit.client.0.smithi049.stdout:3/327: unlink d2/d1a/l29 0 2024-06-03T00:03:07.649 INFO:tasks.workunit.client.0.smithi049.stdout:0/349: dwrite d6/d29/d47/d4b/d67/d6e/f70 [0,4194304] 0 2024-06-03T00:03:07.650 INFO:tasks.workunit.client.0.smithi049.stdout:5/455: mkdir d3/d5/d2d/d8d 0 2024-06-03T00:03:07.651 INFO:tasks.workunit.client.0.smithi049.stdout:3/328: truncate d2/d14/d44/d52/fa 73653 0 2024-06-03T00:03:07.651 INFO:tasks.workunit.client.0.smithi049.stdout:3/329: chown d2/d14/d44/d52/d4c/c4e 23835515 1 2024-06-03T00:03:07.652 INFO:tasks.workunit.client.0.smithi049.stdout:5/456: getdents d3/d5/d24 0 2024-06-03T00:03:07.652 INFO:tasks.workunit.client.0.smithi049.stdout:5/457: chown d3/d5/da/d55/d14/d16/l45 15 1 2024-06-03T00:03:07.654 INFO:tasks.workunit.client.0.smithi049.stdout:3/330: creat d2/d14/d44/d52/d4c/f6c x:0 0 0 2024-06-03T00:03:07.657 INFO:tasks.workunit.client.0.smithi049.stdout:2/448: dwrite da/d52/d49/f7f [0,4194304] 0 2024-06-03T00:03:07.657 INFO:tasks.workunit.client.0.smithi049.stdout:8/333: dwrite d4/d7/f56 [4194304,4194304] 0 2024-06-03T00:03:07.657 INFO:tasks.workunit.client.0.smithi049.stdout:8/334: write d4/d7/d28/d45/f49 [1567956,16795] 0 2024-06-03T00:03:07.658 INFO:tasks.workunit.client.0.smithi049.stdout:7/497: dwrite d3/d6/d13/d54/f10 [0,4194304] 0 2024-06-03T00:03:07.658 INFO:tasks.workunit.client.0.smithi049.stdout:5/458: creat d3/d5/da/d55/d14/d16/f8e x:0 0 0 2024-06-03T00:03:07.659 INFO:tasks.workunit.client.0.smithi049.stdout:7/498: creat d3/d6/d13/d3c/d48/fb5 x:0 0 0 2024-06-03T00:03:07.660 INFO:tasks.workunit.client.0.smithi049.stdout:7/499: stat d3/d6/d13/d3c/d48/d7b/d9c/l6b 0 2024-06-03T00:03:07.660 INFO:tasks.workunit.client.0.smithi049.stdout:7/500: fdatasync d3/d6/d9/fa6 0 2024-06-03T00:03:07.660 INFO:tasks.workunit.client.0.smithi049.stdout:3/331: dread d2/d1a/d34/f4f [0,4194304] 0 2024-06-03T00:03:07.661 INFO:tasks.workunit.client.0.smithi049.stdout:7/501: creat d3/d6/d13/d3c/d48/d7b/d9c/fb6 x:0 0 0 2024-06-03T00:03:07.662 INFO:tasks.workunit.client.0.smithi049.stdout:1/606: dwrite d1/d2f/d36/d37/d13/d34/f3f [0,4194304] 0 2024-06-03T00:03:07.663 INFO:tasks.workunit.client.0.smithi049.stdout:2/449: link da/d52/d40/c8b da/d52/d37/d59/c92 0 2024-06-03T00:03:07.664 INFO:tasks.workunit.client.0.smithi049.stdout:5/459: symlink d3/d5/da/l8f 0 2024-06-03T00:03:07.664 INFO:tasks.workunit.client.0.smithi049.stdout:5/460: chown d3/d5/da/d55/d75 1 1 2024-06-03T00:03:07.665 INFO:tasks.workunit.client.0.smithi049.stdout:5/461: creat d3/d5/da/d55/d14/f90 x:0 0 0 2024-06-03T00:03:07.668 INFO:tasks.workunit.client.0.smithi049.stdout:6/541: dwrite d2/d3/d9/d23/f82 [0,4194304] 0 2024-06-03T00:03:07.668 INFO:tasks.workunit.client.0.smithi049.stdout:1/607: link d1/d1a/l65 d1/d2f/d36/d37/d13/dc6/lda 0 2024-06-03T00:03:07.668 INFO:tasks.workunit.client.0.smithi049.stdout:1/608: dread - d1/d2f/d78/dd7/fd6 zero size 2024-06-03T00:03:07.670 INFO:tasks.workunit.client.0.smithi049.stdout:4/571: dwrite d4/d3f/d14/d15/f6a [0,4194304] 0 2024-06-03T00:03:07.670 INFO:tasks.workunit.client.0.smithi049.stdout:5/462: dread d3/d5/da/d55/d14/d16/f34 [0,4194304] 0 2024-06-03T00:03:07.670 INFO:tasks.workunit.client.0.smithi049.stdout:0/350: dwrite d6/d29/d47/d4b/d67/d6e/d52/f6c [0,4194304] 0 2024-06-03T00:03:07.671 INFO:tasks.workunit.client.0.smithi049.stdout:2/450: mkdir da/d52/d40/d93 0 2024-06-03T00:03:07.671 INFO:tasks.workunit.client.0.smithi049.stdout:6/542: creat d2/fb9 x:0 0 0 2024-06-03T00:03:07.671 INFO:tasks.workunit.client.0.smithi049.stdout:2/451: dread - da/d72/f81 zero size 2024-06-03T00:03:07.672 INFO:tasks.workunit.client.0.smithi049.stdout:6/543: symlink d2/d4d/lba 0 2024-06-03T00:03:07.672 INFO:tasks.workunit.client.0.smithi049.stdout:5/463: unlink d3/d5/da/c35 0 2024-06-03T00:03:07.672 INFO:tasks.workunit.client.0.smithi049.stdout:5/464: stat d3/d5/fd 0 2024-06-03T00:03:07.673 INFO:tasks.workunit.client.0.smithi049.stdout:6/544: link d2/d3/d9/d40/la8 d2/lbb 0 2024-06-03T00:03:07.674 INFO:tasks.workunit.client.0.smithi049.stdout:4/572: link d4/d2a/f5d d4/fc3 0 2024-06-03T00:03:07.674 INFO:tasks.workunit.client.0.smithi049.stdout:5/465: creat d3/d7d/f91 x:0 0 0 2024-06-03T00:03:07.674 INFO:tasks.workunit.client.0.smithi049.stdout:4/573: write d4/d2a/f94 [216128,20965] 0 2024-06-03T00:03:07.674 INFO:tasks.workunit.client.0.smithi049.stdout:5/466: fsync d3/d5/da/d55/d14/f2a 0 2024-06-03T00:03:07.674 INFO:tasks.workunit.client.0.smithi049.stdout:5/467: getdents d3/d53 0 2024-06-03T00:03:07.674 INFO:tasks.workunit.client.0.smithi049.stdout:3/332: dread d2/d1a/f1d [0,4194304] 0 2024-06-03T00:03:07.675 INFO:tasks.workunit.client.0.smithi049.stdout:6/545: rename d2/d3/d9/l5e to d2/d4d/d76/lbc 0 2024-06-03T00:03:07.676 INFO:tasks.workunit.client.0.smithi049.stdout:3/333: creat d2/d14/d22/d42/f6d x:0 0 0 2024-06-03T00:03:07.677 INFO:tasks.workunit.client.0.smithi049.stdout:3/334: chown d2/d14/d44/d52/d4c/c4e 1749 1 2024-06-03T00:03:07.677 INFO:tasks.workunit.client.0.smithi049.stdout:6/546: mknod d2/d3/d9/cbd 0 2024-06-03T00:03:07.677 INFO:tasks.workunit.client.0.smithi049.stdout:8/335: dwrite d4/d7/f61 [4194304,4194304] 0 2024-06-03T00:03:07.677 INFO:tasks.workunit.client.0.smithi049.stdout:4/574: mknod d4/d3f/d14/d7f/cc4 0 2024-06-03T00:03:07.678 INFO:tasks.workunit.client.0.smithi049.stdout:5/468: rename d3/d5/da/f1b to d3/d5/d2d/f92 0 2024-06-03T00:03:07.678 INFO:tasks.workunit.client.0.smithi049.stdout:4/575: mknod d4/d3f/d14/d2b/d84/d1c/d24/d43/cc5 0 2024-06-03T00:03:07.678 INFO:tasks.workunit.client.0.smithi049.stdout:1/609: dread d1/d2f/d36/d57/da1/fbf [0,4194304] 0 2024-06-03T00:03:07.681 INFO:tasks.workunit.client.0.smithi049.stdout:0/351: write f4 [900982,30418] 0 2024-06-03T00:03:07.681 INFO:tasks.workunit.client.0.smithi049.stdout:8/336: mknod d4/d7/d28/d45/c69 0 2024-06-03T00:03:07.681 INFO:tasks.workunit.client.0.smithi049.stdout:1/610: creat d1/d2f/d36/d37/d13/d34/d6e/fdb x:0 0 0 2024-06-03T00:03:07.682 INFO:tasks.workunit.client.0.smithi049.stdout:5/469: symlink d3/d9/d68/l93 0 2024-06-03T00:03:07.682 INFO:tasks.workunit.client.0.smithi049.stdout:5/470: chown d3/d5/f4d 5 1 2024-06-03T00:03:07.682 INFO:tasks.workunit.client.0.smithi049.stdout:0/352: truncate d6/d29/d47/d4b/d67/d6e/f70 582916 0 2024-06-03T00:03:07.682 INFO:tasks.workunit.client.0.smithi049.stdout:0/353: dread - d6/d29/d47/d4b/d67/d6e/d52/f5c zero size 2024-06-03T00:03:07.683 INFO:tasks.workunit.client.0.smithi049.stdout:5/471: symlink d3/d5/da/d55/d14/d16/l94 0 2024-06-03T00:03:07.683 INFO:tasks.workunit.client.0.smithi049.stdout:5/472: rmdir d3/d9/d20/d4c/d5a/d6f 39 2024-06-03T00:03:07.683 INFO:tasks.workunit.client.0.smithi049.stdout:5/473: readlink d3/l54 0 2024-06-03T00:03:07.683 INFO:tasks.workunit.client.0.smithi049.stdout:5/474: read d3/d5/da/f2b [2257706,20157] 0 2024-06-03T00:03:07.684 INFO:tasks.workunit.client.0.smithi049.stdout:2/452: dwrite da/d52/d37/f56 [0,4194304] 0 2024-06-03T00:03:07.685 INFO:tasks.workunit.client.0.smithi049.stdout:2/453: readlink da/d52/d37/d59/d80/l88 0 2024-06-03T00:03:07.685 INFO:tasks.workunit.client.0.smithi049.stdout:2/454: write da/d52/df/f34 [1429644,14259] 0 2024-06-03T00:03:07.686 INFO:tasks.workunit.client.0.smithi049.stdout:8/337: read d4/d7/d28/f46 [12590,104910] 0 2024-06-03T00:03:07.689 INFO:tasks.workunit.client.0.smithi049.stdout:8/338: rename d4/d7/d28/d52/d66/d53/f3d to d4/d7/d28/d45/f6a 0 2024-06-03T00:03:07.694 INFO:tasks.workunit.client.0.smithi049.stdout:5/475: write d3/d9/f28 [2887001,67542] 0 2024-06-03T00:03:07.695 INFO:tasks.workunit.client.0.smithi049.stdout:5/476: symlink d3/d9/l95 0 2024-06-03T00:03:07.700 INFO:tasks.workunit.client.0.smithi049.stdout:8/339: dread d4/d27/d30/f31 [0,4194304] 0 2024-06-03T00:03:07.701 INFO:tasks.workunit.client.0.smithi049.stdout:8/340: mkdir d4/d27/d3c/d43/d6b 0 2024-06-03T00:03:07.701 INFO:tasks.workunit.client.0.smithi049.stdout:6/547: dwrite d2/d3/d9/f27 [0,4194304] 0 2024-06-03T00:03:07.704 INFO:tasks.workunit.client.0.smithi049.stdout:6/548: symlink d2/d3/d9/d23/d29/d30/lbe 0 2024-06-03T00:03:07.704 INFO:tasks.workunit.client.0.smithi049.stdout:6/549: fdatasync d2/d3/d9/d23/d29/f41 0 2024-06-03T00:03:07.704 INFO:tasks.workunit.client.0.smithi049.stdout:6/550: write d2/d3/d17/d64/fa4 [107286,22309] 0 2024-06-03T00:03:07.705 INFO:tasks.workunit.client.0.smithi049.stdout:6/551: mknod d2/d3/d9/d23/d48/d89/cbf 0 2024-06-03T00:03:07.705 INFO:tasks.workunit.client.0.smithi049.stdout:6/552: readlink d2/d3/d9/l3a 0 2024-06-03T00:03:07.707 INFO:tasks.workunit.client.0.smithi049.stdout:6/553: unlink d2/d3/d9/d40/c4c 0 2024-06-03T00:03:07.709 INFO:tasks.workunit.client.0.smithi049.stdout:6/554: rename d2/d3/d9/f27 to d2/d3/d9/d23/d48/d51/fc0 0 2024-06-03T00:03:07.710 INFO:tasks.workunit.client.0.smithi049.stdout:2/455: write da/d52/d40/f6e [965484,128807] 0 2024-06-03T00:03:07.710 INFO:tasks.workunit.client.0.smithi049.stdout:2/456: fdatasync f4 0 2024-06-03T00:03:07.710 INFO:tasks.workunit.client.0.smithi049.stdout:6/555: getdents d2/d3/d9/d55 0 2024-06-03T00:03:07.712 INFO:tasks.workunit.client.0.smithi049.stdout:1/611: dwrite d1/d2f/d78/fc4 [0,4194304] 0 2024-06-03T00:03:07.712 INFO:tasks.workunit.client.0.smithi049.stdout:1/612: write d1/d2f/d50/fce [1220873,20150] 0 2024-06-03T00:03:07.712 INFO:tasks.workunit.client.0.smithi049.stdout:1/613: stat d1/d2f/d78 0 2024-06-03T00:03:07.712 INFO:tasks.workunit.client.0.smithi049.stdout:1/614: chown d1/d2f/d36/d37/l91 519 1 2024-06-03T00:03:07.712 INFO:tasks.workunit.client.0.smithi049.stdout:1/615: dread - d1/d2f/d36/d37/d13/d34/d6e/fdb zero size 2024-06-03T00:03:07.717 INFO:tasks.workunit.client.0.smithi049.stdout:1/616: link d1/d2f/d36/d37/d13/d34/d6e/l8d d1/ldc 0 2024-06-03T00:03:07.717 INFO:tasks.workunit.client.0.smithi049.stdout:1/617: truncate d1/d2f/d36/d37/d64/d6c/d8c/f97 733747 0 2024-06-03T00:03:07.719 INFO:tasks.workunit.client.0.smithi049.stdout:1/618: creat d1/d2f/d36/d57/d72/fdd x:0 0 0 2024-06-03T00:03:07.721 INFO:tasks.workunit.client.0.smithi049.stdout:6/556: dread d2/d3/d9/d23/f82 [0,4194304] 0 2024-06-03T00:03:07.721 INFO:tasks.workunit.client.0.smithi049.stdout:6/557: truncate d2/d3/d9/d23/f26 954608 0 2024-06-03T00:03:07.721 INFO:tasks.workunit.client.0.smithi049.stdout:8/341: dwrite d4/d7/d28/d45/f49 [0,4194304] 0 2024-06-03T00:03:07.722 INFO:tasks.workunit.client.0.smithi049.stdout:6/558: getdents d2/d3/d9/d23/d36 0 2024-06-03T00:03:07.722 INFO:tasks.workunit.client.0.smithi049.stdout:6/559: stat d2/d3/d9/d23/d36/f4b 0 2024-06-03T00:03:07.722 INFO:tasks.workunit.client.0.smithi049.stdout:6/560: chown d2/l13 96 1 2024-06-03T00:03:07.722 INFO:tasks.workunit.client.0.smithi049.stdout:6/561: stat d2/d3/d9/d23/d29/d30/l12 0 2024-06-03T00:03:07.723 INFO:tasks.workunit.client.0.smithi049.stdout:8/342: mkdir d4/d7/d28/d52/d66/d53/d6c 0 2024-06-03T00:03:07.725 INFO:tasks.workunit.client.0.smithi049.stdout:8/343: rename d4/d7/d28/d52/d66/d67 to d4/d7/d28/d25/d6d 0 2024-06-03T00:03:07.725 INFO:tasks.workunit.client.0.smithi049.stdout:5/477: dwrite d3/d5/da/d55/d14/d16/f80 [0,4194304] 0 2024-06-03T00:03:07.725 INFO:tasks.workunit.client.0.smithi049.stdout:5/478: dread - d3/d7d/f8c zero size 2024-06-03T00:03:07.725 INFO:tasks.workunit.client.0.smithi049.stdout:2/457: dwrite da/d52/d37/d70/f71 [4194304,4194304] 0 2024-06-03T00:03:07.725 INFO:tasks.workunit.client.0.smithi049.stdout:2/458: fsync da/d52/f39 0 2024-06-03T00:03:07.726 INFO:tasks.workunit.client.0.smithi049.stdout:1/619: dread d1/d2f/d36/d37/d2c/d45/da0/dab/fbc [0,4194304] 0 2024-06-03T00:03:07.726 INFO:tasks.workunit.client.0.smithi049.stdout:1/620: fdatasync d1/d2f/d36/d37/f33 0 2024-06-03T00:03:07.726 INFO:tasks.workunit.client.0.smithi049.stdout:5/479: mknod d3/d5/da/d55/c96 0 2024-06-03T00:03:07.727 INFO:tasks.workunit.client.0.smithi049.stdout:5/480: getdents d3/d5/d2d 0 2024-06-03T00:03:07.728 INFO:tasks.workunit.client.0.smithi049.stdout:8/344: rename d4/d7/f56 to d4/f6e 0 2024-06-03T00:03:07.729 INFO:tasks.workunit.client.0.smithi049.stdout:1/621: mkdir d1/d2f/d36/d37/d2c/d45/d5e/dde 0 2024-06-03T00:03:07.730 INFO:tasks.workunit.client.0.smithi049.stdout:1/622: chown d1/d2f/d36/d37/d13/d34/d52 1543866 1 2024-06-03T00:03:07.730 INFO:tasks.workunit.client.0.smithi049.stdout:1/623: stat d1/d2f/d36/d37/d2c/d45/da0/dab/fbc 0 2024-06-03T00:03:07.730 INFO:tasks.workunit.client.0.smithi049.stdout:5/481: mkdir d3/d5/d2d/d4b/d97 0 2024-06-03T00:03:07.732 INFO:tasks.workunit.client.0.smithi049.stdout:1/624: write d1/f3 [1522458,108779] 0 2024-06-03T00:03:07.733 INFO:tasks.workunit.client.0.smithi049.stdout:1/625: truncate d1/d1a/f88 1566510 0 2024-06-03T00:03:07.735 INFO:tasks.workunit.client.0.smithi049.stdout:1/626: rename d1/d2f/d36/d57/db9 to d1/d2f/d36/d57/d72/ddf 0 2024-06-03T00:03:07.735 INFO:tasks.workunit.client.0.smithi049.stdout:1/627: chown d1/d2f/d36/d37/d13/d34/d5f 105 1 2024-06-03T00:03:07.735 INFO:tasks.workunit.client.0.smithi049.stdout:1/628: chown d1/d2f/d78/f9f 7 1 2024-06-03T00:03:07.740 INFO:tasks.workunit.client.0.smithi049.stdout:6/562: dwrite d2/d3/d9/d23/f26 [0,4194304] 0 2024-06-03T00:03:07.740 INFO:tasks.workunit.client.0.smithi049.stdout:6/563: stat d2/d3/d9/d23/f82 0 2024-06-03T00:03:07.743 INFO:tasks.workunit.client.0.smithi049.stdout:1/629: dread d1/d2f/d36/d37/d13/d34/d6e/f7f [0,4194304] 0 2024-06-03T00:03:07.743 INFO:tasks.workunit.client.0.smithi049.stdout:6/564: creat d2/d3/d9/d40/fc1 x:0 0 0 2024-06-03T00:03:07.744 INFO:tasks.workunit.client.0.smithi049.stdout:1/630: creat d1/d2f/d36/d37/d2c/d45/d83/fe0 x:0 0 0 2024-06-03T00:03:07.744 INFO:tasks.workunit.client.0.smithi049.stdout:1/631: truncate d1/d2f/d36/d37/d2c/d45/d61/f69 2304012 0 2024-06-03T00:03:07.746 INFO:tasks.workunit.client.0.smithi049.stdout:1/632: truncate d1/d2f/d50/fa4 2265513 0 2024-06-03T00:03:07.758 INFO:tasks.workunit.client.0.smithi049.stdout:8/345: dwrite d4/d7/f14 [4194304,4194304] 0 2024-06-03T00:03:07.760 INFO:tasks.workunit.client.0.smithi049.stdout:2/459: dwrite da/d52/f39 [0,4194304] 0 2024-06-03T00:03:07.761 INFO:tasks.workunit.client.0.smithi049.stdout:8/346: mknod d4/d27/d30/c6f 0 2024-06-03T00:03:07.764 INFO:tasks.workunit.client.0.smithi049.stdout:2/460: rmdir da/d52/d37/d70 39 2024-06-03T00:03:07.764 INFO:tasks.workunit.client.0.smithi049.stdout:8/347: unlink d4/d7/c5e 0 2024-06-03T00:03:07.764 INFO:tasks.workunit.client.0.smithi049.stdout:8/348: chown d4/d7/d58/f64 957369278 1 2024-06-03T00:03:07.765 INFO:tasks.workunit.client.0.smithi049.stdout:8/349: getdents d4/d27/d3c/d43 0 2024-06-03T00:03:07.765 INFO:tasks.workunit.client.0.smithi049.stdout:8/350: chown d4/d7/d28/d2b/l68 139 1 2024-06-03T00:03:07.765 INFO:tasks.workunit.client.0.smithi049.stdout:8/351: mknod d4/d27/d3c/c70 0 2024-06-03T00:03:07.766 INFO:tasks.workunit.client.0.smithi049.stdout:6/565: dwrite d2/d3/d17/d57/f69 [0,4194304] 0 2024-06-03T00:03:07.768 INFO:tasks.workunit.client.0.smithi049.stdout:6/566: dread d2/d3/d9/d23/d48/f70 [0,4194304] 0 2024-06-03T00:03:07.768 INFO:tasks.workunit.client.0.smithi049.stdout:6/567: read d2/d4d/f58 [806184,93704] 0 2024-06-03T00:03:07.770 INFO:tasks.workunit.client.0.smithi049.stdout:6/568: unlink d2/l13 0 2024-06-03T00:03:07.772 INFO:tasks.workunit.client.0.smithi049.stdout:6/569: mknod d2/d4d/cc2 0 2024-06-03T00:03:07.772 INFO:tasks.workunit.client.0.smithi049.stdout:6/570: chown d2/d3/d9/d23/d36/d72 92186 1 2024-06-03T00:03:07.772 INFO:tasks.workunit.client.0.smithi049.stdout:1/633: dwrite d1/d2f/d36/d37/d64/d6c/f7a [0,4194304] 0 2024-06-03T00:03:07.774 INFO:tasks.workunit.client.0.smithi049.stdout:1/634: symlink d1/d2f/d36/d37/d13/d34/d52/db1/le1 0 2024-06-03T00:03:07.775 INFO:tasks.workunit.client.0.smithi049.stdout:1/635: mkdir d1/d2f/d36/d37/d13/d34/dd0/de2 0 2024-06-03T00:03:07.775 INFO:tasks.workunit.client.0.smithi049.stdout:1/636: write d1/d2f/d78/dd7/f9b [337387,23504] 0 2024-06-03T00:03:07.777 INFO:tasks.workunit.client.0.smithi049.stdout:1/637: creat d1/d2f/d36/d37/d2c/d45/d61/d70/fe3 x:0 0 0 2024-06-03T00:03:07.781 INFO:tasks.workunit.client.0.smithi049.stdout:8/352: write d4/d7/f14 [6828387,121388] 0 2024-06-03T00:03:07.781 INFO:tasks.workunit.client.0.smithi049.stdout:1/638: write d1/d2f/d36/d37/d2c/d45/da0/dab/fbc [803636,12903] 0 2024-06-03T00:03:07.782 INFO:tasks.workunit.client.0.smithi049.stdout:1/639: chown d1/d1a/f63 934309 1 2024-06-03T00:03:07.782 INFO:tasks.workunit.client.0.smithi049.stdout:1/640: write d1/f4f [717797,62144] 0 2024-06-03T00:03:07.783 INFO:tasks.workunit.client.0.smithi049.stdout:1/641: mknod d1/d2f/d36/d37/d13/dc6/ce4 0 2024-06-03T00:03:07.783 INFO:tasks.workunit.client.0.smithi049.stdout:2/461: dwrite da/d52/f2b [0,4194304] 0 2024-06-03T00:03:07.784 INFO:tasks.workunit.client.0.smithi049.stdout:8/353: dread d4/d7/d28/d25/f39 [0,4194304] 0 2024-06-03T00:03:07.785 INFO:tasks.workunit.client.0.smithi049.stdout:1/642: creat d1/d2f/d36/d37/d2c/d45/da0/fe5 x:0 0 0 2024-06-03T00:03:07.785 INFO:tasks.workunit.client.0.smithi049.stdout:1/643: stat d1/d2f/d36/d57/d72/fa6 0 2024-06-03T00:03:07.786 INFO:tasks.workunit.client.0.smithi049.stdout:8/354: creat d4/d7/d28/d52/f71 x:0 0 0 2024-06-03T00:03:07.786 INFO:tasks.workunit.client.0.smithi049.stdout:8/355: fdatasync d4/d7/f1b 0 2024-06-03T00:03:07.786 INFO:tasks.workunit.client.0.smithi049.stdout:2/462: creat da/d52/d40/f94 x:0 0 0 2024-06-03T00:03:07.792 INFO:tasks.workunit.client.0.smithi049.stdout:8/356: dread d4/d27/f4c [0,4194304] 0 2024-06-03T00:03:07.792 INFO:tasks.workunit.client.0.smithi049.stdout:6/571: dwrite d2/d3/d9/f54 [0,4194304] 0 2024-06-03T00:03:07.792 INFO:tasks.workunit.client.0.smithi049.stdout:6/572: fsync d2/d3/d9/d23/d29/f2d 0 2024-06-03T00:03:07.793 INFO:tasks.workunit.client.0.smithi049.stdout:8/357: creat d4/d7/d28/d2b/f72 x:0 0 0 2024-06-03T00:03:07.794 INFO:tasks.workunit.client.0.smithi049.stdout:8/358: truncate d4/d7/d28/d52/f71 245466 0 2024-06-03T00:03:07.808 INFO:tasks.workunit.client.0.smithi049.stdout:2/463: dwrite da/d52/d37/d70/f71 [4194304,4194304] 0 2024-06-03T00:03:07.809 INFO:tasks.workunit.client.0.smithi049.stdout:6/573: dread d2/d3/d9/d23/d48/d51/fc0 [0,4194304] 0 2024-06-03T00:03:07.809 INFO:tasks.workunit.client.0.smithi049.stdout:1/644: dwrite d1/d2f/d36/d37/d2c/d45/d61/d67/f7b [0,4194304] 0 2024-06-03T00:03:07.812 INFO:tasks.workunit.client.0.smithi049.stdout:1/645: link d1/d2f/d36/d37/d13/d34/d5f/la8 d1/d2f/d36/d57/le6 0 2024-06-03T00:03:07.812 INFO:tasks.workunit.client.0.smithi049.stdout:1/646: getdents d1/d2f/d36/d37/d2c/d45/d5e/dd1 0 2024-06-03T00:03:07.813 INFO:tasks.workunit.client.0.smithi049.stdout:8/359: dwrite d4/d27/d3c/f2f [0,4194304] 0 2024-06-03T00:03:07.814 INFO:tasks.workunit.client.0.smithi049.stdout:1/647: rename d1/d2f/d36/d37/d13/d34/d5f/lac to d1/d2f/le7 0 2024-06-03T00:03:07.816 INFO:tasks.workunit.client.0.smithi049.stdout:6/574: write d2/d3/d9/d23/d48/f61 [1109499,81632] 0 2024-06-03T00:03:07.816 INFO:tasks.workunit.client.0.smithi049.stdout:8/360: truncate d4/d7/d28/f36 780840 0 2024-06-03T00:03:07.816 INFO:tasks.workunit.client.0.smithi049.stdout:6/575: fdatasync d2/d3/d17/d57/d6e/d88/f94 0 2024-06-03T00:03:07.817 INFO:tasks.workunit.client.0.smithi049.stdout:8/361: creat d4/f73 x:0 0 0 2024-06-03T00:03:07.817 INFO:tasks.workunit.client.0.smithi049.stdout:8/362: truncate d4/d7/d48/f5d 546266 0 2024-06-03T00:03:07.817 INFO:tasks.workunit.client.0.smithi049.stdout:1/648: rename d1/d2f/d36/d57/da1/fbf to d1/d2f/d36/d37/d13/d34/dd0/fe8 0 2024-06-03T00:03:07.818 INFO:tasks.workunit.client.0.smithi049.stdout:1/649: rmdir d1/d2f/d78/dd7/d7d 39 2024-06-03T00:03:07.818 INFO:tasks.workunit.client.0.smithi049.stdout:6/576: rmdir d2/d3/d9/db6 0 2024-06-03T00:03:07.818 INFO:tasks.workunit.client.0.smithi049.stdout:6/577: write d2/d3/d17/d57/f75 [248495,85072] 0 2024-06-03T00:03:07.819 INFO:tasks.workunit.client.0.smithi049.stdout:6/578: fsync d2/d3/f98 0 2024-06-03T00:03:07.819 INFO:tasks.workunit.client.0.smithi049.stdout:6/579: fdatasync d2/d4d/f74 0 2024-06-03T00:03:07.819 INFO:tasks.workunit.client.0.smithi049.stdout:8/363: creat d4/d7/f74 x:0 0 0 2024-06-03T00:03:07.823 INFO:tasks.workunit.client.0.smithi049.stdout:2/464: dwrite da/d52/d40/f8a [0,4194304] 0 2024-06-03T00:03:07.825 INFO:tasks.workunit.client.0.smithi049.stdout:2/465: mknod da/d55/c95 0 2024-06-03T00:03:07.826 INFO:tasks.workunit.client.0.smithi049.stdout:2/466: fdatasync da/d52/df/f2c 0 2024-06-03T00:03:07.827 INFO:tasks.workunit.client.0.smithi049.stdout:6/580: dread d2/d3/d9/d23/d29/f63 [0,4194304] 0 2024-06-03T00:03:07.827 INFO:tasks.workunit.client.0.smithi049.stdout:6/581: readlink d2/d4d/l6c 0 2024-06-03T00:03:07.827 INFO:tasks.workunit.client.0.smithi049.stdout:2/467: symlink da/d52/d37/l96 0 2024-06-03T00:03:07.831 INFO:tasks.workunit.client.0.smithi049.stdout:8/364: dread d4/d27/d3c/f38 [0,4194304] 0 2024-06-03T00:03:07.839 INFO:tasks.workunit.client.0.smithi049.stdout:8/365: write d4/d7/f61 [2349920,412] 0 2024-06-03T00:03:07.846 INFO:tasks.workunit.client.0.smithi049.stdout:6/582: dwrite d2/d3/d17/f73 [0,4194304] 0 2024-06-03T00:03:07.846 INFO:tasks.workunit.client.0.smithi049.stdout:1/650: dwrite d1/d1a/f74 [0,4194304] 0 2024-06-03T00:03:07.848 INFO:tasks.workunit.client.0.smithi049.stdout:6/583: rename d2/d4d/f74 to d2/d3/d9/d23/fc3 0 2024-06-03T00:03:07.850 INFO:tasks.workunit.client.0.smithi049.stdout:6/584: symlink d2/lc4 0 2024-06-03T00:03:07.853 INFO:tasks.workunit.client.0.smithi049.stdout:6/585: creat d2/d3/d9/d23/d48/d53/fc5 x:0 0 0 2024-06-03T00:03:07.856 INFO:tasks.workunit.client.0.smithi049.stdout:1/651: read d1/d1a/f25 [3437242,2372] 0 2024-06-03T00:03:07.858 INFO:tasks.workunit.client.0.smithi049.stdout:1/652: creat d1/d2f/d36/d57/fe9 x:0 0 0 2024-06-03T00:03:07.858 INFO:tasks.workunit.client.0.smithi049.stdout:8/366: dwrite d4/d7/f13 [0,4194304] 0 2024-06-03T00:03:07.858 INFO:tasks.workunit.client.0.smithi049.stdout:1/653: mknod d1/d1a/cea 0 2024-06-03T00:03:07.860 INFO:tasks.workunit.client.0.smithi049.stdout:8/367: truncate d4/d7/f1b 4140397 0 2024-06-03T00:03:07.860 INFO:tasks.workunit.client.0.smithi049.stdout:1/654: creat d1/d2f/d36/d37/d2c/d45/feb x:0 0 0 2024-06-03T00:03:07.861 INFO:tasks.workunit.client.0.smithi049.stdout:8/368: mkdir d4/d7/d28/d25/d6d/d75 0 2024-06-03T00:03:07.861 INFO:tasks.workunit.client.0.smithi049.stdout:1/655: mknod d1/d1a/dd2/cec 0 2024-06-03T00:03:07.863 INFO:tasks.workunit.client.0.smithi049.stdout:8/369: creat d4/d7/d28/d52/f76 x:0 0 0 2024-06-03T00:03:07.863 INFO:tasks.workunit.client.0.smithi049.stdout:1/656: truncate d1/d2f/d36/d37/d2c/f60 2496405 0 2024-06-03T00:03:07.864 INFO:tasks.workunit.client.0.smithi049.stdout:1/657: rmdir d1/d1a/dd2 39 2024-06-03T00:03:07.864 INFO:tasks.workunit.client.0.smithi049.stdout:8/370: mknod d4/d7/d28/d52/d66/d53/c77 0 2024-06-03T00:03:07.866 INFO:tasks.workunit.client.0.smithi049.stdout:8/371: rmdir d4/d7/d28/d25/d6d/d75 0 2024-06-03T00:03:07.866 INFO:tasks.workunit.client.0.smithi049.stdout:8/372: chown d4/d7/c42 133439 1 2024-06-03T00:03:07.870 INFO:tasks.workunit.client.0.smithi049.stdout:6/586: dwrite d2/d3/d17/f6b [0,4194304] 0 2024-06-03T00:03:07.870 INFO:tasks.workunit.client.0.smithi049.stdout:6/587: fsync d2/d3/d9/d40/fc1 0 2024-06-03T00:03:07.870 INFO:tasks.workunit.client.0.smithi049.stdout:6/588: write d2/d3/d9/d23/d48/f92 [942921,54370] 0 2024-06-03T00:03:07.870 INFO:tasks.workunit.client.0.smithi049.stdout:6/589: fdatasync d2/d3/d17/d57/d6e/fad 0 2024-06-03T00:03:07.870 INFO:tasks.workunit.client.0.smithi049.stdout:6/590: fdatasync d2/fb9 0 2024-06-03T00:03:07.871 INFO:tasks.workunit.client.0.smithi049.stdout:1/658: getdents d1/d2f/d36/d37/d2c/d45 0 2024-06-03T00:03:07.871 INFO:tasks.workunit.client.0.smithi049.stdout:1/659: chown d1/d2f/d50/fa4 0 1 2024-06-03T00:03:07.871 INFO:tasks.workunit.client.0.smithi049.stdout:1/660: chown d1/d2f/d36/d37/d2c/c40 19687 1 2024-06-03T00:03:07.871 INFO:tasks.workunit.client.0.smithi049.stdout:1/661: truncate d1/d2f/d36/d37/d13/d34/f3c 80027 0 2024-06-03T00:03:07.871 INFO:tasks.workunit.client.0.smithi049.stdout:6/591: symlink d2/d3/d9/d55/lc6 0 2024-06-03T00:03:07.873 INFO:tasks.workunit.client.0.smithi049.stdout:6/592: rename d2/d4d/f8a to d2/d3/d9/fc7 0 2024-06-03T00:03:07.873 INFO:tasks.workunit.client.0.smithi049.stdout:6/593: write d2/d3/d9/f3d [5176360,41493] 0 2024-06-03T00:03:07.873 INFO:tasks.workunit.client.0.smithi049.stdout:8/373: dread d4/d7/f61 [0,4194304] 0 2024-06-03T00:03:07.873 INFO:tasks.workunit.client.0.smithi049.stdout:8/374: write d4/d7/f22 [1780774,44157] 0 2024-06-03T00:03:07.873 INFO:tasks.workunit.client.0.smithi049.stdout:8/375: read - d4/d7/d28/d45/f6a zero size 2024-06-03T00:03:07.876 INFO:tasks.workunit.client.0.smithi049.stdout:8/376: rmdir d4/d7/d28/d25/d6d 0 2024-06-03T00:03:07.879 INFO:tasks.workunit.client.0.smithi049.stdout:8/377: unlink d4/d7/d28/d2b/f72 0 2024-06-03T00:03:07.885 INFO:tasks.workunit.client.0.smithi049.stdout:6/594: dwrite d2/d3/d9/d23/d48/d53/fc5 [0,4194304] 0 2024-06-03T00:03:07.891 INFO:tasks.workunit.client.0.smithi049.stdout:6/595: truncate d2/d3/d9/d23/d29/f63 3649299 0 2024-06-03T00:03:07.891 INFO:tasks.workunit.client.0.smithi049.stdout:6/596: dread - d2/d3/d9/d23/d36/f4b zero size 2024-06-03T00:03:07.891 INFO:tasks.workunit.client.0.smithi049.stdout:1/662: dwrite d1/d2f/d36/d37/f16 [0,4194304] 0 2024-06-03T00:03:07.891 INFO:tasks.workunit.client.0.smithi049.stdout:9/620: sync 2024-06-03T00:03:07.891 INFO:tasks.workunit.client.0.smithi049.stdout:1/663: mkdir d1/d2f/d36/d37/d64/d6c/ded 0 2024-06-03T00:03:07.895 INFO:tasks.workunit.client.0.smithi049.stdout:6/597: dread d2/d3/d9/d23/d29/f32 [0,4194304] 0 2024-06-03T00:03:07.897 INFO:tasks.workunit.client.0.smithi049.stdout:6/598: creat d2/d3/d17/d64/fc8 x:0 0 0 2024-06-03T00:03:07.905 INFO:tasks.workunit.client.0.smithi049.stdout:6/599: dread d2/d3/d9/d23/d48/d51/fc0 [0,4194304] 0 2024-06-03T00:03:07.906 INFO:tasks.workunit.client.0.smithi049.stdout:6/600: mkdir d2/d3/d9/d40/dc9 0 2024-06-03T00:03:07.906 INFO:tasks.workunit.client.0.smithi049.stdout:6/601: truncate d2/d3/d9/d23/d48/d51/fc0 4339912 0 2024-06-03T00:03:07.906 INFO:tasks.workunit.client.0.smithi049.stdout:6/602: mkdir d2/d3b/dca 0 2024-06-03T00:03:07.908 INFO:tasks.workunit.client.0.smithi049.stdout:6/603: rename d2/d3/d17/d64/fa4 to d2/d3/d9/fcb 0 2024-06-03T00:03:07.911 INFO:tasks.workunit.client.0.smithi049.stdout:9/621: dwrite d1/d5/d1a/f4e [0,4194304] 0 2024-06-03T00:03:07.912 INFO:tasks.workunit.client.0.smithi049.stdout:1/664: dwrite d1/d2f/d36/d37/d13/fba [0,4194304] 0 2024-06-03T00:03:07.912 INFO:tasks.workunit.client.0.smithi049.stdout:1/665: write d1/d2f/d36/d37/d2c/d45/d61/f69 [2702317,37004] 0 2024-06-03T00:03:07.922 INFO:tasks.workunit.client.0.smithi049.stdout:9/622: dread d1/da/da8/f34 [0,4194304] 0 2024-06-03T00:03:07.922 INFO:tasks.workunit.client.0.smithi049.stdout:9/623: chown d1/d5/d1a/lb0 251 1 2024-06-03T00:03:07.922 INFO:tasks.workunit.client.0.smithi049.stdout:9/624: write d1/da/d54/fc2 [588624,45945] 0 2024-06-03T00:03:07.922 INFO:tasks.workunit.client.0.smithi049.stdout:9/625: readlink d1/l11 0 2024-06-03T00:03:07.923 INFO:tasks.workunit.client.0.smithi049.stdout:6/604: dwrite d2/d3/d9/d23/d48/d53/f85 [0,4194304] 0 2024-06-03T00:03:07.923 INFO:tasks.workunit.client.0.smithi049.stdout:6/605: readlink d2/d4d/l7 0 2024-06-03T00:03:07.923 INFO:tasks.workunit.client.0.smithi049.stdout:6/606: write d2/d3/d17/f77 [215888,116445] 0 2024-06-03T00:03:07.923 INFO:tasks.workunit.client.0.smithi049.stdout:1/666: write d1/d2f/f46 [3957746,129882] 0 2024-06-03T00:03:07.923 INFO:tasks.workunit.client.0.smithi049.stdout:1/667: fdatasync d1/f7 0 2024-06-03T00:03:07.924 INFO:tasks.workunit.client.0.smithi049.stdout:9/626: dread d1/d5/d13/d3b/d7f/dbc/f98 [0,4194304] 0 2024-06-03T00:03:07.924 INFO:tasks.workunit.client.0.smithi049.stdout:9/627: write d1/d5/d1a/d52/f9b [1698860,90736] 0 2024-06-03T00:03:07.924 INFO:tasks.workunit.client.0.smithi049.stdout:6/607: mkdir d2/d3/d17/d57/d6e/d88/dcc 0 2024-06-03T00:03:07.925 INFO:tasks.workunit.client.0.smithi049.stdout:6/608: creat d2/d3b/dca/fcd x:0 0 0 2024-06-03T00:03:07.925 INFO:tasks.workunit.client.0.smithi049.stdout:6/609: truncate d2/d3/d17/d57/d6e/d88/fa7 76330 0 2024-06-03T00:03:07.926 INFO:tasks.workunit.client.0.smithi049.stdout:9/628: rename d1/da/d54/d5b/f83 to d1/d5/fce 0 2024-06-03T00:03:07.926 INFO:tasks.workunit.client.0.smithi049.stdout:9/629: truncate d1/da/da8/d5f/d81/da0/fc5 824123 0 2024-06-03T00:03:07.926 INFO:tasks.workunit.client.0.smithi049.stdout:6/610: creat d2/fce x:0 0 0 2024-06-03T00:03:07.927 INFO:tasks.workunit.client.0.smithi049.stdout:6/611: rename d2/d4d/fae to d2/d3/d9/d23/d36/fcf 0 2024-06-03T00:03:07.927 INFO:tasks.workunit.client.0.smithi049.stdout:6/612: chown d2/d3/d9/d23/d36/l9e 59178 1 2024-06-03T00:03:07.929 INFO:tasks.workunit.client.0.smithi049.stdout:6/613: symlink d2/d4d/d76/ld0 0 2024-06-03T00:03:07.929 INFO:tasks.workunit.client.0.smithi049.stdout:6/614: readlink d2/d3/d9/d23/d48/d53/l9d 0 2024-06-03T00:03:07.942 INFO:tasks.workunit.client.0.smithi049.stdout:1/668: dwrite d1/d2f/d36/d37/d2c/d45/fb2 [0,4194304] 0 2024-06-03T00:03:07.945 INFO:tasks.workunit.client.0.smithi049.stdout:1/669: creat d1/d2f/d36/d37/d13/d34/fee x:0 0 0 2024-06-03T00:03:07.945 INFO:tasks.workunit.client.0.smithi049.stdout:9/630: dwrite d1/d5/d1a/fa6 [0,4194304] 0 2024-06-03T00:03:07.945 INFO:tasks.workunit.client.0.smithi049.stdout:9/631: dread - d1/d5/d1a/fbe zero size 2024-06-03T00:03:07.945 INFO:tasks.workunit.client.0.smithi049.stdout:9/632: fdatasync d1/da/f42 0 2024-06-03T00:03:07.946 INFO:tasks.workunit.client.0.smithi049.stdout:1/670: truncate d1/d2f/d36/d37/d13/d34/d6e/f7f 2367016 0 2024-06-03T00:03:07.946 INFO:tasks.workunit.client.0.smithi049.stdout:1/671: dread - d1/d2f/fbd zero size 2024-06-03T00:03:07.947 INFO:tasks.workunit.client.0.smithi049.stdout:6/615: dwrite d2/d3/d17/d57/fac [0,4194304] 0 2024-06-03T00:03:07.947 INFO:tasks.workunit.client.0.smithi049.stdout:6/616: write d2/d3/d9/d23/d48/f61 [5031940,31502] 0 2024-06-03T00:03:07.948 INFO:tasks.workunit.client.0.smithi049.stdout:6/617: dread - d2/d3/d9/d23/d48/fab zero size 2024-06-03T00:03:07.950 INFO:tasks.workunit.client.0.smithi049.stdout:6/618: creat d2/d3b/fd1 x:0 0 0 2024-06-03T00:03:07.950 INFO:tasks.workunit.client.0.smithi049.stdout:9/633: mknod d1/d5/ccf 0 2024-06-03T00:03:07.950 INFO:tasks.workunit.client.0.smithi049.stdout:7/502: sync 2024-06-03T00:03:07.950 INFO:tasks.workunit.client.0.smithi049.stdout:5/482: sync 2024-06-03T00:03:07.951 INFO:tasks.workunit.client.0.smithi049.stdout:3/335: sync 2024-06-03T00:03:07.951 INFO:tasks.workunit.client.0.smithi049.stdout:4/576: sync 2024-06-03T00:03:07.951 INFO:tasks.workunit.client.0.smithi049.stdout:7/503: chown d3/d6/d9/d8f/f6c 14306317 1 2024-06-03T00:03:07.951 INFO:tasks.workunit.client.0.smithi049.stdout:0/354: sync 2024-06-03T00:03:07.951 INFO:tasks.workunit.client.0.smithi049.stdout:3/336: chown d2/d14/d22/d42/c35 150 1 2024-06-03T00:03:07.951 INFO:tasks.workunit.client.0.smithi049.stdout:6/619: mknod d2/d3/d9/d23/d36/d72/cd2 0 2024-06-03T00:03:07.951 INFO:tasks.workunit.client.0.smithi049.stdout:6/620: write d2/d3/d9/fc7 [949598,85882] 0 2024-06-03T00:03:07.952 INFO:tasks.workunit.client.0.smithi049.stdout:5/483: creat d3/d5/d2d/d8d/f98 x:0 0 0 2024-06-03T00:03:07.953 INFO:tasks.workunit.client.0.smithi049.stdout:3/337: truncate d2/d14/d44/d52/f3f 2214151 0 2024-06-03T00:03:07.954 INFO:tasks.workunit.client.0.smithi049.stdout:1/672: symlink d1/d2f/d36/d37/d13/d34/d6e/lef 0 2024-06-03T00:03:07.955 INFO:tasks.workunit.client.0.smithi049.stdout:5/484: truncate d3/d9/d20/f3d 137661 0 2024-06-03T00:03:07.955 INFO:tasks.workunit.client.0.smithi049.stdout:5/485: chown d3/d9/d20/c3c 240524 1 2024-06-03T00:03:07.957 INFO:tasks.workunit.client.0.smithi049.stdout:5/486: creat d3/d9/f99 x:0 0 0 2024-06-03T00:03:07.957 INFO:tasks.workunit.client.0.smithi049.stdout:5/487: truncate d3/d5/d2d/d4b/d51/f76 679942 0 2024-06-03T00:03:07.957 INFO:tasks.workunit.client.0.smithi049.stdout:9/634: creat d1/d5/d1a/fd0 x:0 0 0 2024-06-03T00:03:07.957 INFO:tasks.workunit.client.0.smithi049.stdout:9/635: truncate d1/d5/d13/d3b/d49/f64 4348985 0 2024-06-03T00:03:07.957 INFO:tasks.workunit.client.0.smithi049.stdout:4/577: readlink d4/d3f/d14/l5e 0 2024-06-03T00:03:07.959 INFO:tasks.workunit.client.0.smithi049.stdout:1/673: creat d1/d2f/d36/d37/d13/d71/ff0 x:0 0 0 2024-06-03T00:03:07.960 INFO:tasks.workunit.client.0.smithi049.stdout:1/674: truncate d1/d2f/d36/d37/d2c/d45/d61/d70/fe3 731462 0 2024-06-03T00:03:07.960 INFO:tasks.workunit.client.0.smithi049.stdout:1/675: chown d1/d2f/d36/d57 55519146 1 2024-06-03T00:03:07.960 INFO:tasks.workunit.client.0.smithi049.stdout:1/676: chown d1/d2f/d36/d37/d13/d34/ca3 49626453 1 2024-06-03T00:03:07.960 INFO:tasks.workunit.client.0.smithi049.stdout:1/677: fsync d1/d1a/f74 0 2024-06-03T00:03:07.960 INFO:tasks.workunit.client.0.smithi049.stdout:1/678: write d1/d2f/f44 [2802971,3602] 0 2024-06-03T00:03:07.960 INFO:tasks.workunit.client.0.smithi049.stdout:1/679: chown d1/d2f/d36/d57/d72 147207 1 2024-06-03T00:03:07.960 INFO:tasks.workunit.client.0.smithi049.stdout:1/680: chown d1/d2f/d36/d37/d13/d34 20539 1 2024-06-03T00:03:07.960 INFO:tasks.workunit.client.0.smithi049.stdout:1/681: fsync d1/d2f/d36/f4e 0 2024-06-03T00:03:07.960 INFO:tasks.workunit.client.0.smithi049.stdout:1/682: readlink d1/d2f/d36/d37/d13/l24 0 2024-06-03T00:03:07.963 INFO:tasks.workunit.client.0.smithi049.stdout:9/636: mkdir d1/d5/d13/d3b/d7f/dbc/dd1 0 2024-06-03T00:03:07.963 INFO:tasks.workunit.client.0.smithi049.stdout:9/637: truncate d1/da/d27/f75 841280 0 2024-06-03T00:03:07.963 INFO:tasks.workunit.client.0.smithi049.stdout:0/355: read d6/d30/f44 [2190379,4889] 0 2024-06-03T00:03:07.965 INFO:tasks.workunit.client.0.smithi049.stdout:4/578: rename d4/d3f/d14/d15 to d4/d3f/d14/d2b/d84/d69/dc6 0 2024-06-03T00:03:07.966 INFO:tasks.workunit.client.0.smithi049.stdout:6/621: write d2/d3/d17/f6b [2038889,43123] 0 2024-06-03T00:03:07.969 INFO:tasks.workunit.client.0.smithi049.stdout:0/356: rename d6/d29/d47/d4b/d67/d6e/f2a to d6/d29/d47/f7b 0 2024-06-03T00:03:07.969 INFO:tasks.workunit.client.0.smithi049.stdout:0/357: write d6/d30/f3b [746998,78188] 0 2024-06-03T00:03:07.969 INFO:tasks.workunit.client.0.smithi049.stdout:9/638: mknod d1/da/dbf/cd2 0 2024-06-03T00:03:07.969 INFO:tasks.workunit.client.0.smithi049.stdout:5/488: dread d3/d5/f58 [0,4194304] 0 2024-06-03T00:03:07.971 INFO:tasks.workunit.client.0.smithi049.stdout:6/622: rmdir d2/d3/d9/d40/dc9 0 2024-06-03T00:03:07.972 INFO:tasks.workunit.client.0.smithi049.stdout:0/358: truncate d6/d30/f27 3110438 0 2024-06-03T00:03:07.974 INFO:tasks.workunit.client.0.smithi049.stdout:6/623: truncate d2/d3/d9/d23/f1e 2135804 0 2024-06-03T00:03:07.974 INFO:tasks.workunit.client.0.smithi049.stdout:6/624: readlink d2/d3/d9/d40/l80 0 2024-06-03T00:03:07.974 INFO:tasks.workunit.client.0.smithi049.stdout:9/639: creat d1/d5/d13/d3b/d49/fd3 x:0 0 0 2024-06-03T00:03:07.975 INFO:tasks.workunit.client.0.smithi049.stdout:7/504: dwrite d3/d6/d13/d3c/d48/d7b/d9c/fb6 [0,4194304] 0 2024-06-03T00:03:07.975 INFO:tasks.workunit.client.0.smithi049.stdout:1/683: dread d1/d2f/d36/d37/d13/d34/d8f/d94/f95 [0,4194304] 0 2024-06-03T00:03:07.975 INFO:tasks.workunit.client.0.smithi049.stdout:1/684: stat d1/d2f/d36/d37/d2c/d45/d5e 0 2024-06-03T00:03:07.975 INFO:tasks.workunit.client.0.smithi049.stdout:1/685: chown d1/f3 12 1 2024-06-03T00:03:07.975 INFO:tasks.workunit.client.0.smithi049.stdout:0/359: unlink d6/f3d 0 2024-06-03T00:03:07.975 INFO:tasks.workunit.client.0.smithi049.stdout:0/360: truncate d6/f21 4680209 0 2024-06-03T00:03:07.976 INFO:tasks.workunit.client.0.smithi049.stdout:4/579: rename d4/d3f/d14/d2b/d84/d69/fbc to d4/d3f/d14/d82/fc7 0 2024-06-03T00:03:07.976 INFO:tasks.workunit.client.0.smithi049.stdout:4/580: write d4/d3f/d14/d2b/d84/d1c/f6f [861213,49314] 0 2024-06-03T00:03:07.978 INFO:tasks.workunit.client.0.smithi049.stdout:1/686: mknod d1/d2f/d36/d37/d64/d6c/cf1 0 2024-06-03T00:03:07.978 INFO:tasks.workunit.client.0.smithi049.stdout:7/505: creat d3/d6/d86/d90/dae/fb7 x:0 0 0 2024-06-03T00:03:07.978 INFO:tasks.workunit.client.0.smithi049.stdout:7/506: chown d3/d14/c93 2 1 2024-06-03T00:03:07.980 INFO:tasks.workunit.client.0.smithi049.stdout:0/361: creat d6/d29/d47/d4b/d67/d6e/d52/f7c x:0 0 0 2024-06-03T00:03:07.980 INFO:tasks.workunit.client.0.smithi049.stdout:9/640: rename d1/da/d27/l45 to d1/d5/d13/d3b/d7f/dbc/dd1/ld4 0 2024-06-03T00:03:07.980 INFO:tasks.workunit.client.0.smithi049.stdout:7/507: truncate d3/d6/d9/f69 3163476 0 2024-06-03T00:03:07.983 INFO:tasks.workunit.client.0.smithi049.stdout:9/641: dread d1/d5/fce [0,4194304] 0 2024-06-03T00:03:07.983 INFO:tasks.workunit.client.0.smithi049.stdout:6/625: dread d2/d3/d17/d57/d6e/fad [0,4194304] 0 2024-06-03T00:03:07.983 INFO:tasks.workunit.client.0.smithi049.stdout:0/362: rename d6/d30/l49 to d6/d56/l7d 0 2024-06-03T00:03:07.985 INFO:tasks.workunit.client.0.smithi049.stdout:9/642: mknod d1/da/da8/d50/d70/cd5 0 2024-06-03T00:03:07.986 INFO:tasks.workunit.client.0.smithi049.stdout:7/508: creat d3/d6/d13/d54/daa/d92/fb8 x:0 0 0 2024-06-03T00:03:07.986 INFO:tasks.workunit.client.0.smithi049.stdout:5/489: dwrite d3/d5/da/d55/d14/d16/f80 [0,4194304] 0 2024-06-03T00:03:07.988 INFO:tasks.workunit.client.0.smithi049.stdout:6/626: mkdir d2/d3/d17/d57/d6e/dd3 0 2024-06-03T00:03:07.988 INFO:tasks.workunit.client.0.smithi049.stdout:5/490: mkdir d3/d5/d9a 0 2024-06-03T00:03:07.988 INFO:tasks.workunit.client.0.smithi049.stdout:9/643: creat d1/da/da8/d5f/d81/da0/fd6 x:0 0 0 2024-06-03T00:03:07.988 INFO:tasks.workunit.client.0.smithi049.stdout:7/509: symlink d3/lb9 0 2024-06-03T00:03:07.989 INFO:tasks.workunit.client.0.smithi049.stdout:9/644: dread d1/da/da8/f97 [0,4194304] 0 2024-06-03T00:03:07.989 INFO:tasks.workunit.client.0.smithi049.stdout:9/645: fsync d1/d5/d13/d66/d87/fb7 0 2024-06-03T00:03:07.990 INFO:tasks.workunit.client.0.smithi049.stdout:5/491: creat d3/d5/d9a/f9b x:0 0 0 2024-06-03T00:03:07.990 INFO:tasks.workunit.client.0.smithi049.stdout:5/492: stat d3/d7d/f91 0 2024-06-03T00:03:07.990 INFO:tasks.workunit.client.0.smithi049.stdout:5/493: fsync d3/d9/f99 0 2024-06-03T00:03:07.990 INFO:tasks.workunit.client.0.smithi049.stdout:6/627: mkdir d2/d3/d9/d23/d29/dd4 0 2024-06-03T00:03:07.991 INFO:tasks.workunit.client.0.smithi049.stdout:7/510: creat d3/d6/d13/d54/fba x:0 0 0 2024-06-03T00:03:07.991 INFO:tasks.workunit.client.0.smithi049.stdout:7/511: stat d3/d6 0 2024-06-03T00:03:07.991 INFO:tasks.workunit.client.0.smithi049.stdout:9/646: creat d1/d5/d13/d3b/d7f/dbc/fd7 x:0 0 0 2024-06-03T00:03:07.992 INFO:tasks.workunit.client.0.smithi049.stdout:6/628: mknod d2/d3/d17/d64/cd5 0 2024-06-03T00:03:07.992 INFO:tasks.workunit.client.0.smithi049.stdout:6/629: fdatasync d2/d3/d9/d23/d29/f59 0 2024-06-03T00:03:07.992 INFO:tasks.workunit.client.0.smithi049.stdout:6/630: write d2/d3/d17/d57/fac [4875858,96071] 0 2024-06-03T00:03:07.992 INFO:tasks.workunit.client.0.smithi049.stdout:9/647: rmdir d1/d5/d13/d3b/d49 39 2024-06-03T00:03:07.992 INFO:tasks.workunit.client.0.smithi049.stdout:9/648: chown d1/da/d54/d5b/fcd 1342103 1 2024-06-03T00:03:07.993 INFO:tasks.workunit.client.0.smithi049.stdout:1/687: dread d1/d1a/f25 [0,4194304] 0 2024-06-03T00:03:07.994 INFO:tasks.workunit.client.0.smithi049.stdout:7/512: mknod d3/d6/d13/d3c/d48/cbb 0 2024-06-03T00:03:07.995 INFO:tasks.workunit.client.0.smithi049.stdout:9/649: rename d1/da/da8/l56 to d1/d5/d13/d3b/dad/ld8 0 2024-06-03T00:03:07.995 INFO:tasks.workunit.client.0.smithi049.stdout:9/650: write d1/f78 [635705,46423] 0 2024-06-03T00:03:07.996 INFO:tasks.workunit.client.0.smithi049.stdout:1/688: creat d1/d2f/d36/d37/d2c/d45/da0/dab/ff2 x:0 0 0 2024-06-03T00:03:07.996 INFO:tasks.workunit.client.0.smithi049.stdout:1/689: write d1/d2f/d36/d37/d2c/d45/d61/d67/f6d [4224463,17558] 0 2024-06-03T00:03:07.997 INFO:tasks.workunit.client.0.smithi049.stdout:6/631: truncate d2/d3/d9/d55/f5c 3897312 0 2024-06-03T00:03:07.998 INFO:tasks.workunit.client.0.smithi049.stdout:6/632: write d2/d3/d9/d23/d29/d30/f6d [1147395,123907] 0 2024-06-03T00:03:07.998 INFO:tasks.workunit.client.0.smithi049.stdout:9/651: creat d1/da/d26/fd9 x:0 0 0 2024-06-03T00:03:08.000 INFO:tasks.workunit.client.0.smithi049.stdout:1/690: creat d1/d2f/d36/d37/ff3 x:0 0 0 2024-06-03T00:03:08.000 INFO:tasks.workunit.client.0.smithi049.stdout:1/691: fdatasync d1/d2f/d36/d37/d2c/d45/d61/d70/f82 0 2024-06-03T00:03:08.000 INFO:tasks.workunit.client.0.smithi049.stdout:4/581: dwrite d4/d3f/d14/d7f/d87/f9c [0,4194304] 0 2024-06-03T00:03:08.001 INFO:tasks.workunit.client.0.smithi049.stdout:7/513: truncate d3/d14/f76 263127 0 2024-06-03T00:03:08.001 INFO:tasks.workunit.client.0.smithi049.stdout:9/652: mkdir d1/da/da8/d50/dda 0 2024-06-03T00:03:08.002 INFO:tasks.workunit.client.0.smithi049.stdout:9/653: fsync d1/da/d27/fa2 0 2024-06-03T00:03:08.002 INFO:tasks.workunit.client.0.smithi049.stdout:1/692: creat d1/d2f/d36/d37/d13/d34/dd0/de2/ff4 x:0 0 0 2024-06-03T00:03:08.002 INFO:tasks.workunit.client.0.smithi049.stdout:1/693: fsync d1/d2f/d78/f9f 0 2024-06-03T00:03:08.005 INFO:tasks.workunit.client.0.smithi049.stdout:4/582: creat d4/d2a/d76/fc8 x:0 0 0 2024-06-03T00:03:08.006 INFO:tasks.workunit.client.0.smithi049.stdout:0/363: dwrite d6/d30/f5a [0,4194304] 0 2024-06-03T00:03:08.007 INFO:tasks.workunit.client.0.smithi049.stdout:7/514: link d3/d14/c93 d3/d14/cbc 0 2024-06-03T00:03:08.007 INFO:tasks.workunit.client.0.smithi049.stdout:9/654: creat d1/da/da8/d5f/fdb x:0 0 0 2024-06-03T00:03:08.009 INFO:tasks.workunit.client.0.smithi049.stdout:1/694: symlink d1/d2f/d36/d37/d2c/d45/d5e/lf5 0 2024-06-03T00:03:08.010 INFO:tasks.workunit.client.0.smithi049.stdout:0/364: link d6/d30/d32/c35 d6/d56/c7e 0 2024-06-03T00:03:08.011 INFO:tasks.workunit.client.0.smithi049.stdout:4/583: rename d4/f6c to d4/d3f/d14/d2b/d84/d1c/d7a/dc2/fc9 0 2024-06-03T00:03:08.012 INFO:tasks.workunit.client.0.smithi049.stdout:7/515: symlink d3/d6/d13/d3c/d4b/lbd 0 2024-06-03T00:03:08.013 INFO:tasks.workunit.client.0.smithi049.stdout:9/655: mknod d1/da/da8/d5f/cdc 0 2024-06-03T00:03:08.014 INFO:tasks.workunit.client.0.smithi049.stdout:9/656: write d1/da/da8/d5f/d81/fcb [122687,1839] 0 2024-06-03T00:03:08.014 INFO:tasks.workunit.client.0.smithi049.stdout:0/365: creat d6/d29/d47/f7f x:0 0 0 2024-06-03T00:03:08.014 INFO:tasks.workunit.client.0.smithi049.stdout:0/366: dread - d6/d29/d47/f6a zero size 2024-06-03T00:03:08.014 INFO:tasks.workunit.client.0.smithi049.stdout:0/367: fdatasync d6/d29/f5f 0 2024-06-03T00:03:08.014 INFO:tasks.workunit.client.0.smithi049.stdout:0/368: stat d6/c8 0 2024-06-03T00:03:08.014 INFO:tasks.workunit.client.0.smithi049.stdout:5/494: dwrite d3/d5/da/d55/d14/d16/f25 [0,4194304] 0 2024-06-03T00:03:08.017 INFO:tasks.workunit.client.0.smithi049.stdout:9/657: rename d1/d5/d13/d66 to d1/d5/d13/ddd 0 2024-06-03T00:03:08.019 INFO:tasks.workunit.client.0.smithi049.stdout:1/695: dread d1/d2f/d36/d37/d2c/d45/d61/d67/f7b [0,4194304] 0 2024-06-03T00:03:08.020 INFO:tasks.workunit.client.0.smithi049.stdout:9/658: mknod d1/da/da8/d50/dda/cde 0 2024-06-03T00:03:08.021 INFO:tasks.workunit.client.0.smithi049.stdout:0/369: dread d6/f4e [0,4194304] 0 2024-06-03T00:03:08.021 INFO:tasks.workunit.client.0.smithi049.stdout:7/516: write d3/d6/d13/d3c/d48/d7b/d9c/f67 [3241937,125898] 0 2024-06-03T00:03:08.022 INFO:tasks.workunit.client.0.smithi049.stdout:6/633: dwrite d2/d4d/d76/f93 [0,4194304] 0 2024-06-03T00:03:08.022 INFO:tasks.workunit.client.0.smithi049.stdout:6/634: truncate d2/d3/d9/d23/d36/fcf 981279 0 2024-06-03T00:03:08.022 INFO:tasks.workunit.client.0.smithi049.stdout:1/696: symlink d1/d2f/lf6 0 2024-06-03T00:03:08.022 INFO:tasks.workunit.client.0.smithi049.stdout:7/517: symlink d3/d6/d13/d3c/d48/d7b/d5b/lbe 0 2024-06-03T00:03:08.023 INFO:tasks.workunit.client.0.smithi049.stdout:6/635: unlink d2/d3/d17/d57/f75 0 2024-06-03T00:03:08.024 INFO:tasks.workunit.client.0.smithi049.stdout:9/659: rmdir d1/da/d27 39 2024-06-03T00:03:08.024 INFO:tasks.workunit.client.0.smithi049.stdout:6/636: fdatasync d2/d3/d9/d23/d48/fab 0 2024-06-03T00:03:08.024 INFO:tasks.workunit.client.0.smithi049.stdout:7/518: mknod d3/cbf 0 2024-06-03T00:03:08.026 INFO:tasks.workunit.client.0.smithi049.stdout:7/519: symlink d3/lc0 0 2024-06-03T00:03:08.026 INFO:tasks.workunit.client.0.smithi049.stdout:7/520: dread - d3/d6/d3f/fad zero size 2024-06-03T00:03:08.029 INFO:tasks.workunit.client.0.smithi049.stdout:4/584: dread d4/d3f/d14/f40 [0,4194304] 0 2024-06-03T00:03:08.030 INFO:tasks.workunit.client.0.smithi049.stdout:9/660: dread d1/f44 [0,4194304] 0 2024-06-03T00:03:08.031 INFO:tasks.workunit.client.0.smithi049.stdout:1/697: rename d1/d2f/d36/d37/d2c/d45/d5e to d1/d2f/df7 0 2024-06-03T00:03:08.031 INFO:tasks.workunit.client.0.smithi049.stdout:4/585: rmdir d4/d3f/d14/d2b/d84/d1c/d24 39 2024-06-03T00:03:08.032 INFO:tasks.workunit.client.0.smithi049.stdout:0/370: write d6/d29/d47/d4b/f51 [6017435,88121] 0 2024-06-03T00:03:08.033 INFO:tasks.workunit.client.0.smithi049.stdout:6/637: rename d2/d3/d9/d23/d36/d72 to d2/d3/d9/d23/d29/dd6 0 2024-06-03T00:03:08.033 INFO:tasks.workunit.client.0.smithi049.stdout:6/638: fdatasync d2/d3/d9/d23/d29/d6a/fa1 0 2024-06-03T00:03:08.033 INFO:tasks.workunit.client.0.smithi049.stdout:6/639: write d2/d3/d9/d23/fb2 [339899,72196] 0 2024-06-03T00:03:08.033 INFO:tasks.workunit.client.0.smithi049.stdout:1/698: symlink d1/d2f/d36/d37/d13/dc6/lf8 0 2024-06-03T00:03:08.033 INFO:tasks.workunit.client.0.smithi049.stdout:0/371: symlink d6/d29/d47/d4b/d67/d6e/l80 0 2024-06-03T00:03:08.033 INFO:tasks.workunit.client.0.smithi049.stdout:5/495: dwrite d3/d9/d68/f70 [0,4194304] 0 2024-06-03T00:03:08.034 INFO:tasks.workunit.client.0.smithi049.stdout:4/586: mknod d4/cca 0 2024-06-03T00:03:08.034 INFO:tasks.workunit.client.0.smithi049.stdout:4/587: write f2 [3594030,119082] 0 2024-06-03T00:03:08.034 INFO:tasks.workunit.client.0.smithi049.stdout:6/640: creat d2/d3/d9/fd7 x:0 0 0 2024-06-03T00:03:08.034 INFO:tasks.workunit.client.0.smithi049.stdout:6/641: fsync d2/d3b/fd1 0 2024-06-03T00:03:08.035 INFO:tasks.workunit.client.0.smithi049.stdout:2/468: sync 2024-06-03T00:03:08.035 INFO:tasks.workunit.client.0.smithi049.stdout:0/372: rename d6/d29/f5f to d6/d29/d47/d4b/d67/d6e/d52/f81 0 2024-06-03T00:03:08.036 INFO:tasks.workunit.client.0.smithi049.stdout:5/496: mkdir d3/d53/d9c 0 2024-06-03T00:03:08.037 INFO:tasks.workunit.client.0.smithi049.stdout:1/699: mknod d1/d2f/d36/d37/d13/d34/d52/cf9 0 2024-06-03T00:03:08.041 INFO:tasks.workunit.client.0.smithi049.stdout:1/700: symlink d1/d2f/d36/d37/d64/lfa 0 2024-06-03T00:03:08.041 INFO:tasks.workunit.client.0.smithi049.stdout:6/642: rename d2/d4d/d76/lbc to d2/d3/d9/d23/ld8 0 2024-06-03T00:03:08.041 INFO:tasks.workunit.client.0.smithi049.stdout:6/643: chown d2/d3/c66 1 1 2024-06-03T00:03:08.044 INFO:tasks.workunit.client.0.smithi049.stdout:6/644: creat d2/d3/d17/d64/fd9 x:0 0 0 2024-06-03T00:03:08.044 INFO:tasks.workunit.client.0.smithi049.stdout:1/701: symlink d1/d2f/d36/d37/d13/d34/d8f/d94/lfb 0 2024-06-03T00:03:08.045 INFO:tasks.workunit.client.0.smithi049.stdout:6/645: mknod d2/d3/d17/d57/d6e/d88/dcc/cda 0 2024-06-03T00:03:08.046 INFO:tasks.workunit.client.0.smithi049.stdout:6/646: mknod d2/d3/d9/d23/d48/d89/cdb 0 2024-06-03T00:03:08.046 INFO:tasks.workunit.client.0.smithi049.stdout:1/702: creat d1/d2f/d36/d57/ffc x:0 0 0 2024-06-03T00:03:08.048 INFO:tasks.workunit.client.0.smithi049.stdout:1/703: rename d1/d2f/d36/d37/d2c/d45/d61/f69 to d1/d2f/d36/d37/d13/d71/ffd 0 2024-06-03T00:03:08.049 INFO:tasks.workunit.client.0.smithi049.stdout:1/704: mknod d1/d2f/d36/d37/d13/d34/dd0/de2/cfe 0 2024-06-03T00:03:08.051 INFO:tasks.workunit.client.0.smithi049.stdout:7/521: dwrite d3/d6/d9/f69 [0,4194304] 0 2024-06-03T00:03:08.052 INFO:tasks.workunit.client.0.smithi049.stdout:1/705: creat d1/d2f/d36/d37/d13/dc6/fff x:0 0 0 2024-06-03T00:03:08.052 INFO:tasks.workunit.client.0.smithi049.stdout:1/706: dread - d1/d2f/d50/d6b/fd8 zero size 2024-06-03T00:03:08.053 INFO:tasks.workunit.client.0.smithi049.stdout:7/522: symlink d3/d6/d13/d3c/d48/lc1 0 2024-06-03T00:03:08.059 INFO:tasks.workunit.client.0.smithi049.stdout:7/523: write d3/d6/f1c [2770763,72939] 0 2024-06-03T00:03:08.059 INFO:tasks.workunit.client.0.smithi049.stdout:7/524: stat d3/d6/d13/d54/daa/d92 0 2024-06-03T00:03:08.059 INFO:tasks.workunit.client.0.smithi049.stdout:7/525: readlink d3/d6/d13/d3c/d48/d7b/d9c/l6b 0 2024-06-03T00:03:08.059 INFO:tasks.workunit.client.0.smithi049.stdout:9/661: dwrite d1/d5/fb4 [0,4194304] 0 2024-06-03T00:03:08.060 INFO:tasks.workunit.client.0.smithi049.stdout:9/662: read d1/d5/d13/d3b/d7f/dbc/f74 [132459,39515] 0 2024-06-03T00:03:08.062 INFO:tasks.workunit.client.0.smithi049.stdout:7/526: creat d3/d6/d13/d3c/d4b/d5a/fc2 x:0 0 0 2024-06-03T00:03:08.062 INFO:tasks.workunit.client.0.smithi049.stdout:7/527: truncate d3/d6/d13/d3c/d4b/d5a/fa1 1013833 0 2024-06-03T00:03:08.062 INFO:tasks.workunit.client.0.smithi049.stdout:7/528: dread - d3/d6/d13/d3c/d48/d7b/d9c/f9a zero size 2024-06-03T00:03:08.063 INFO:tasks.workunit.client.0.smithi049.stdout:9/663: mknod d1/da/cdf 0 2024-06-03T00:03:08.063 INFO:tasks.workunit.client.0.smithi049.stdout:7/529: mknod d3/d6/d13/d54/daa/d92/cc3 0 2024-06-03T00:03:08.063 INFO:tasks.workunit.client.0.smithi049.stdout:7/530: fsync d3/d6/d13/f7c 0 2024-06-03T00:03:08.063 INFO:tasks.workunit.client.0.smithi049.stdout:7/531: chown d3/d6/d13/d3c/d48/c6d 2682 1 2024-06-03T00:03:08.065 INFO:tasks.workunit.client.0.smithi049.stdout:9/664: symlink d1/d5/d13/ddd/d87/le0 0 2024-06-03T00:03:08.065 INFO:tasks.workunit.client.0.smithi049.stdout:7/532: mkdir d3/d6/d13/d3c/d48/d7b/d9c/dc4 0 2024-06-03T00:03:08.067 INFO:tasks.workunit.client.0.smithi049.stdout:8/378: sync 2024-06-03T00:03:08.068 INFO:tasks.workunit.client.0.smithi049.stdout:9/665: link d1/d5/d1a/d52/c9f d1/d5/d13/ddd/ce1 0 2024-06-03T00:03:08.069 INFO:tasks.workunit.client.0.smithi049.stdout:9/666: chown d1/d5/d13/f53 190018 1 2024-06-03T00:03:08.073 INFO:tasks.workunit.client.0.smithi049.stdout:4/588: dwrite d4/d3f/d14/d2b/d84/d69/dc6/f6a [0,4194304] 0 2024-06-03T00:03:08.074 INFO:tasks.workunit.client.0.smithi049.stdout:2/469: dwrite da/d52/d40/f94 [0,4194304] 0 2024-06-03T00:03:08.075 INFO:tasks.workunit.client.0.smithi049.stdout:6/647: dwrite d2/d3/d9/d23/f82 [0,4194304] 0 2024-06-03T00:03:08.075 INFO:tasks.workunit.client.0.smithi049.stdout:0/373: dwrite d6/d30/f3b [0,4194304] 0 2024-06-03T00:03:08.076 INFO:tasks.workunit.client.0.smithi049.stdout:4/589: rename d4/d3f/d14/d2b/d84/d1c/f25 to d4/d3f/d14/d2b/d84/d1c/d24/d43/daf/fcb 0 2024-06-03T00:03:08.076 INFO:tasks.workunit.client.0.smithi049.stdout:4/590: write d4/f23 [3862561,9588] 0 2024-06-03T00:03:08.077 INFO:tasks.workunit.client.0.smithi049.stdout:6/648: mknod d2/d3b/dca/cdc 0 2024-06-03T00:03:08.077 INFO:tasks.workunit.client.0.smithi049.stdout:6/649: dread - d2/d3/d17/d57/d6e/d88/faa zero size 2024-06-03T00:03:08.078 INFO:tasks.workunit.client.0.smithi049.stdout:4/591: dread d4/d3f/f56 [0,4194304] 0 2024-06-03T00:03:08.078 INFO:tasks.workunit.client.0.smithi049.stdout:8/379: dread d4/d7/f1b [0,4194304] 0 2024-06-03T00:03:08.079 INFO:tasks.workunit.client.0.smithi049.stdout:0/374: link d6/d30/f5a d6/d30/d32/f82 0 2024-06-03T00:03:08.079 INFO:tasks.workunit.client.0.smithi049.stdout:0/375: chown d6/d30/d32/c46 32418 1 2024-06-03T00:03:08.079 INFO:tasks.workunit.client.0.smithi049.stdout:0/376: fdatasync d6/d29/d47/d4b/d67/d6e/d52/f81 0 2024-06-03T00:03:08.079 INFO:tasks.workunit.client.0.smithi049.stdout:4/592: getdents d4/d3f/d14/d2b 0 2024-06-03T00:03:08.079 INFO:tasks.workunit.client.0.smithi049.stdout:4/593: fsync d4/d3f/d14/d2b/d84/f67 0 2024-06-03T00:03:08.080 INFO:tasks.workunit.client.0.smithi049.stdout:6/650: mkdir d2/d3/d17/ddd 0 2024-06-03T00:03:08.080 INFO:tasks.workunit.client.0.smithi049.stdout:8/380: creat d4/d27/f78 x:0 0 0 2024-06-03T00:03:08.080 INFO:tasks.workunit.client.0.smithi049.stdout:6/651: mkdir d2/d3/d17/d57/d6e/d88/dde 0 2024-06-03T00:03:08.081 INFO:tasks.workunit.client.0.smithi049.stdout:4/594: creat d4/fcc x:0 0 0 2024-06-03T00:03:08.081 INFO:tasks.workunit.client.0.smithi049.stdout:8/381: mknod d4/d27/d3c/d43/d6b/c79 0 2024-06-03T00:03:08.081 INFO:tasks.workunit.client.0.smithi049.stdout:0/377: rename d6/d29/d47/d4b/f51 to d6/d30/f83 0 2024-06-03T00:03:08.082 INFO:tasks.workunit.client.0.smithi049.stdout:9/667: dwrite d1/fba [0,4194304] 0 2024-06-03T00:03:08.082 INFO:tasks.workunit.client.0.smithi049.stdout:9/668: truncate d1/d5/d1a/fd0 666864 0 2024-06-03T00:03:08.083 INFO:tasks.workunit.client.0.smithi049.stdout:6/652: getdents d2/d3/d9/d23/d48 0 2024-06-03T00:03:08.084 INFO:tasks.workunit.client.0.smithi049.stdout:2/470: dread f9 [0,4194304] 0 2024-06-03T00:03:08.084 INFO:tasks.workunit.client.0.smithi049.stdout:6/653: getdents d2/d3/d9/d23/d29 0 2024-06-03T00:03:08.085 INFO:tasks.workunit.client.0.smithi049.stdout:6/654: chown d2/d3/d9 105435 1 2024-06-03T00:03:08.085 INFO:tasks.workunit.client.0.smithi049.stdout:9/669: mknod d1/d5/d1a/d52/d72/ce2 0 2024-06-03T00:03:08.086 INFO:tasks.workunit.client.0.smithi049.stdout:2/471: symlink da/d52/d37/d59/d80/l97 0 2024-06-03T00:03:08.087 INFO:tasks.workunit.client.0.smithi049.stdout:6/655: creat d2/d3/fdf x:0 0 0 2024-06-03T00:03:08.092 INFO:tasks.workunit.client.0.smithi049.stdout:2/472: dread da/d52/f13 [0,4194304] 0 2024-06-03T00:03:08.092 INFO:tasks.workunit.client.0.smithi049.stdout:2/473: chown da/d52/d37/f56 6 1 2024-06-03T00:03:08.096 INFO:tasks.workunit.client.0.smithi049.stdout:8/382: dread d4/d7/f14 [0,4194304] 0 2024-06-03T00:03:08.100 INFO:tasks.workunit.client.0.smithi049.stdout:8/383: link l3 d4/l7a 0 2024-06-03T00:03:08.102 INFO:tasks.workunit.client.0.smithi049.stdout:8/384: link d4/d7/d28/d52/f65 d4/d7/d58/f7b 0 2024-06-03T00:03:08.102 INFO:tasks.workunit.client.0.smithi049.stdout:8/385: write d4/f15 [1584661,18879] 0 2024-06-03T00:03:08.103 INFO:tasks.workunit.client.0.smithi049.stdout:0/378: write d6/d29/d47/f74 [3008594,67992] 0 2024-06-03T00:03:08.103 INFO:tasks.workunit.client.0.smithi049.stdout:0/379: chown d6/d29/d47/d4b/d67/d6e/c41 25039 1 2024-06-03T00:03:08.104 INFO:tasks.workunit.client.0.smithi049.stdout:8/386: truncate d4/d7/f11 125647 0 2024-06-03T00:03:08.104 INFO:tasks.workunit.client.0.smithi049.stdout:8/387: stat d4/d27/d3c/d43 0 2024-06-03T00:03:08.104 INFO:tasks.workunit.client.0.smithi049.stdout:8/388: chown d4/d7 759047872 1 2024-06-03T00:03:08.104 INFO:tasks.workunit.client.0.smithi049.stdout:0/380: dread d6/d29/d47/d4b/d67/d6e/f4f [0,4194304] 0 2024-06-03T00:03:08.106 INFO:tasks.workunit.client.0.smithi049.stdout:8/389: unlink d4/d7/d48/l50 0 2024-06-03T00:03:08.106 INFO:tasks.workunit.client.0.smithi049.stdout:8/390: read - d4/d7/d58/f64 zero size 2024-06-03T00:03:08.106 INFO:tasks.workunit.client.0.smithi049.stdout:8/391: chown d4/d7/f13 6700 1 2024-06-03T00:03:08.106 INFO:tasks.workunit.client.0.smithi049.stdout:8/392: chown d4/d27/d3c/c70 5 1 2024-06-03T00:03:08.106 INFO:tasks.workunit.client.0.smithi049.stdout:0/381: mknod d6/d29/d47/d4b/d67/d6e/d52/c84 0 2024-06-03T00:03:08.107 INFO:tasks.workunit.client.0.smithi049.stdout:0/382: rmdir d6/d29/d47/d4b/d67/d6e 39 2024-06-03T00:03:08.107 INFO:tasks.workunit.client.0.smithi049.stdout:8/393: mknod d4/d27/d3c/d43/c7c 0 2024-06-03T00:03:08.108 INFO:tasks.workunit.client.0.smithi049.stdout:8/394: symlink d4/d27/l7d 0 2024-06-03T00:03:08.112 INFO:tasks.workunit.client.0.smithi049.stdout:6/656: dwrite d2/d3/d9/d23/d48/f61 [0,4194304] 0 2024-06-03T00:03:08.113 INFO:tasks.workunit.client.0.smithi049.stdout:9/670: dwrite d1/d5/d13/d3b/d7f/dbc/f90 [0,4194304] 0 2024-06-03T00:03:08.114 INFO:tasks.workunit.client.0.smithi049.stdout:2/474: dwrite da/d52/df/f2c [0,4194304] 0 2024-06-03T00:03:08.115 INFO:tasks.workunit.client.0.smithi049.stdout:6/657: mknod d2/d3/d17/d57/d6e/dd3/ce0 0 2024-06-03T00:03:08.116 INFO:tasks.workunit.client.0.smithi049.stdout:4/595: dwrite d4/d3f/d14/d2b/d84/d1c/d4f/f66 [4194304,4194304] 0 2024-06-03T00:03:08.121 INFO:tasks.workunit.client.0.smithi049.stdout:8/395: rename d4/d7/d58 to d4/d7/d28/d52/d66/d53/d7e 0 2024-06-03T00:03:08.124 INFO:tasks.workunit.client.0.smithi049.stdout:8/396: rename d4/d7/fe to d4/d7/d28/d52/d66/d53/d7e/f7f 0 2024-06-03T00:03:08.125 INFO:tasks.workunit.client.0.smithi049.stdout:8/397: write d4/d7/d28/d45/f5c [657368,75423] 0 2024-06-03T00:03:08.125 INFO:tasks.workunit.client.0.smithi049.stdout:4/596: dread d4/d3f/d14/d2b/d84/d1c/d24/f9a [0,4194304] 0 2024-06-03T00:03:08.127 INFO:tasks.workunit.client.0.smithi049.stdout:8/398: getdents d4 0 2024-06-03T00:03:08.130 INFO:tasks.workunit.client.0.smithi049.stdout:8/399: link d4/d7/d28/d45/f5c d4/f80 0 2024-06-03T00:03:08.132 INFO:tasks.workunit.client.0.smithi049.stdout:0/383: dwrite d6/d29/d47/f50 [0,4194304] 0 2024-06-03T00:03:08.133 INFO:tasks.workunit.client.0.smithi049.stdout:8/400: symlink d4/d27/d30/l81 0 2024-06-03T00:03:08.134 INFO:tasks.workunit.client.0.smithi049.stdout:0/384: unlink d6/le 0 2024-06-03T00:03:08.135 INFO:tasks.workunit.client.0.smithi049.stdout:0/385: creat d6/d59/d72/f85 x:0 0 0 2024-06-03T00:03:08.136 INFO:tasks.workunit.client.0.smithi049.stdout:3/338: sync 2024-06-03T00:03:08.137 INFO:tasks.workunit.client.0.smithi049.stdout:3/339: symlink d2/d1a/d51/d64/l6e 0 2024-06-03T00:03:08.138 INFO:tasks.workunit.client.0.smithi049.stdout:0/386: creat d6/d59/d72/f86 x:0 0 0 2024-06-03T00:03:08.138 INFO:tasks.workunit.client.0.smithi049.stdout:3/340: rename d2/d14/d44/d52/d4c/f53 to d2/d14/f6f 0 2024-06-03T00:03:08.139 INFO:tasks.workunit.client.0.smithi049.stdout:3/341: write d2/d1a/d34/f3b [1052979,17960] 0 2024-06-03T00:03:08.140 INFO:tasks.workunit.client.0.smithi049.stdout:0/387: creat d6/d29/d47/d4b/d67/d6e/f87 x:0 0 0 2024-06-03T00:03:08.140 INFO:tasks.workunit.client.0.smithi049.stdout:0/388: fdatasync d6/d30/f83 0 2024-06-03T00:03:08.141 INFO:tasks.workunit.client.0.smithi049.stdout:9/671: dwrite d1/da/da8/d5f/f7d [0,4194304] 0 2024-06-03T00:03:08.141 INFO:tasks.workunit.client.0.smithi049.stdout:9/672: read d1/d5/d13/d3b/d7f/dbc/f74 [248703,44748] 0 2024-06-03T00:03:08.141 INFO:tasks.workunit.client.0.smithi049.stdout:9/673: truncate d1/da/d26/f5c 4658239 0 2024-06-03T00:03:08.146 INFO:tasks.workunit.client.0.smithi049.stdout:2/475: dwrite da/d52/d49/f7f [0,4194304] 0 2024-06-03T00:03:08.152 INFO:tasks.workunit.client.0.smithi049.stdout:2/476: getdents da/d52/d49 0 2024-06-03T00:03:08.152 INFO:tasks.workunit.client.0.smithi049.stdout:2/477: write da/d43/f7e [94973,96575] 0 2024-06-03T00:03:08.152 INFO:tasks.workunit.client.0.smithi049.stdout:2/478: chown da/l28 0 1 2024-06-03T00:03:08.154 INFO:tasks.workunit.client.0.smithi049.stdout:3/342: dread f0 [0,4194304] 0 2024-06-03T00:03:08.155 INFO:tasks.workunit.client.0.smithi049.stdout:4/597: dwrite d4/fc3 [4194304,4194304] 0 2024-06-03T00:03:08.155 INFO:tasks.workunit.client.0.smithi049.stdout:4/598: stat d4/d3f/d14/d2b/d84/d1c/d7a/f97 0 2024-06-03T00:03:08.155 INFO:tasks.workunit.client.0.smithi049.stdout:4/599: read - d4/d3f/fb1 zero size 2024-06-03T00:03:08.155 INFO:tasks.workunit.client.0.smithi049.stdout:4/600: read - d4/d2a/f96 zero size 2024-06-03T00:03:08.155 INFO:tasks.workunit.client.0.smithi049.stdout:9/674: dread d1/da/f5e [0,4194304] 0 2024-06-03T00:03:08.156 INFO:tasks.workunit.client.0.smithi049.stdout:9/675: mkdir d1/d5/d13/de3 0 2024-06-03T00:03:08.156 INFO:tasks.workunit.client.0.smithi049.stdout:9/676: write d1/d5/d13/d3b/d7f/dbc/f98 [94281,15630] 0 2024-06-03T00:03:08.156 INFO:tasks.workunit.client.0.smithi049.stdout:8/401: dwrite d4/f73 [0,4194304] 0 2024-06-03T00:03:08.157 INFO:tasks.workunit.client.0.smithi049.stdout:3/343: rename d2/d14/d22/d42/f6d to d2/d14/f70 0 2024-06-03T00:03:08.157 INFO:tasks.workunit.client.0.smithi049.stdout:9/677: creat d1/fe4 x:0 0 0 2024-06-03T00:03:08.157 INFO:tasks.workunit.client.0.smithi049.stdout:9/678: dread - d1/d5/d13/d3b/d7f/dbc/f91 zero size 2024-06-03T00:03:08.157 INFO:tasks.workunit.client.0.smithi049.stdout:9/679: fsync d1/da/d54/fc2 0 2024-06-03T00:03:08.159 INFO:tasks.workunit.client.0.smithi049.stdout:9/680: creat d1/d5/d13/d3b/dad/fe5 x:0 0 0 2024-06-03T00:03:08.159 INFO:tasks.workunit.client.0.smithi049.stdout:0/389: dwrite d6/d30/f6b [4194304,4194304] 0 2024-06-03T00:03:08.160 INFO:tasks.workunit.client.0.smithi049.stdout:2/479: dread da/d52/df/d3c/f53 [0,4194304] 0 2024-06-03T00:03:08.161 INFO:tasks.workunit.client.0.smithi049.stdout:9/681: rename d1/d5/d13/d3b/c79 to d1/d5/d13/d3b/d7f/ce6 0 2024-06-03T00:03:08.162 INFO:tasks.workunit.client.0.smithi049.stdout:2/480: mknod da/d55/c98 0 2024-06-03T00:03:08.163 INFO:tasks.workunit.client.0.smithi049.stdout:3/344: creat d2/d1a/d51/d64/f71 x:0 0 0 2024-06-03T00:03:08.163 INFO:tasks.workunit.client.0.smithi049.stdout:0/390: rename d6/d30/d32/l4c to d6/d59/l88 0 2024-06-03T00:03:08.163 INFO:tasks.workunit.client.0.smithi049.stdout:9/682: creat d1/da/da8/fe7 x:0 0 0 2024-06-03T00:03:08.164 INFO:tasks.workunit.client.0.smithi049.stdout:0/391: mknod d6/d29/d47/c89 0 2024-06-03T00:03:08.164 INFO:tasks.workunit.client.0.smithi049.stdout:0/392: readlink d6/d29/l42 0 2024-06-03T00:03:08.165 INFO:tasks.workunit.client.0.smithi049.stdout:0/393: mknod d6/c8a 0 2024-06-03T00:03:08.169 INFO:tasks.workunit.client.0.smithi049.stdout:0/394: rename d6/d56/f5e to d6/d29/f8b 0 2024-06-03T00:03:08.170 INFO:tasks.workunit.client.0.smithi049.stdout:0/395: truncate d6/d29/f8b 30412 0 2024-06-03T00:03:08.170 INFO:tasks.workunit.client.0.smithi049.stdout:0/396: read d6/d59/f5b [1755531,78138] 0 2024-06-03T00:03:08.171 INFO:tasks.workunit.client.0.smithi049.stdout:8/402: dread d4/d7/d28/d45/f49 [0,4194304] 0 2024-06-03T00:03:08.172 INFO:tasks.workunit.client.0.smithi049.stdout:8/403: dread d4/d27/f4c [0,4194304] 0 2024-06-03T00:03:08.173 INFO:tasks.workunit.client.0.smithi049.stdout:0/397: creat d6/d56/f8c x:0 0 0 2024-06-03T00:03:08.173 INFO:tasks.workunit.client.0.smithi049.stdout:8/404: creat d4/d7/d28/d52/d66/d53/f82 x:0 0 0 2024-06-03T00:03:08.174 INFO:tasks.workunit.client.0.smithi049.stdout:8/405: creat d4/d7/d28/d45/f83 x:0 0 0 2024-06-03T00:03:08.175 INFO:tasks.workunit.client.0.smithi049.stdout:8/406: rmdir d4/d27/d3c/d43 39 2024-06-03T00:03:08.176 INFO:tasks.workunit.client.0.smithi049.stdout:8/407: mkdir d4/d7/d28/d2b/d84 0 2024-06-03T00:03:08.179 INFO:tasks.workunit.client.0.smithi049.stdout:4/601: dwrite d4/d3f/d14/d2b/d84/d1c/d7a/d8a/fa9 [0,4194304] 0 2024-06-03T00:03:08.181 INFO:tasks.workunit.client.0.smithi049.stdout:4/602: link d4/d3f/d14/fc1 d4/d3f/d14/d2b/fcd 0 2024-06-03T00:03:08.182 INFO:tasks.workunit.client.0.smithi049.stdout:4/603: mknod d4/d3f/d14/d2b/d84/d69/d89/cce 0 2024-06-03T00:03:08.182 INFO:tasks.workunit.client.0.smithi049.stdout:4/604: stat d4/lb 0 2024-06-03T00:03:08.186 INFO:tasks.workunit.client.0.smithi049.stdout:4/605: dread d4/d3f/d14/d2b/d84/d1c/d24/f42 [0,4194304] 0 2024-06-03T00:03:08.191 INFO:tasks.workunit.client.0.smithi049.stdout:4/606: dread d4/d3f/d14/fc1 [0,4194304] 0 2024-06-03T00:03:08.191 INFO:tasks.workunit.client.0.smithi049.stdout:8/408: dread d4/d27/f4b [0,4194304] 0 2024-06-03T00:03:08.191 INFO:tasks.workunit.client.0.smithi049.stdout:8/409: write d4/d7/d28/d52/d66/d53/d7e/f7b [726568,33589] 0 2024-06-03T00:03:08.191 INFO:tasks.workunit.client.0.smithi049.stdout:8/410: chown d4/d7/f11 367642 1 2024-06-03T00:03:08.193 INFO:tasks.workunit.client.0.smithi049.stdout:8/411: symlink d4/d7/d28/d45/l85 0 2024-06-03T00:03:08.193 INFO:tasks.workunit.client.0.smithi049.stdout:4/607: dread d4/d2a/f8c [0,4194304] 0 2024-06-03T00:03:08.194 INFO:tasks.workunit.client.0.smithi049.stdout:8/412: unlink d4/d7/d28/d45/f5c 0 2024-06-03T00:03:08.197 INFO:tasks.workunit.client.0.smithi049.stdout:3/345: dwrite d2/d14/d44/d52/d4c/f30 [0,4194304] 0 2024-06-03T00:03:08.202 INFO:tasks.workunit.client.0.smithi049.stdout:3/346: dread d2/d1a/d34/f48 [0,4194304] 0 2024-06-03T00:03:08.203 INFO:tasks.workunit.client.0.smithi049.stdout:9/683: dwrite d1/da/d27/f40 [0,4194304] 0 2024-06-03T00:03:08.205 INFO:tasks.workunit.client.0.smithi049.stdout:8/413: dread d4/d7/f14 [4194304,4194304] 0 2024-06-03T00:03:08.205 INFO:tasks.workunit.client.0.smithi049.stdout:2/481: dwrite da/d52/f2b [0,4194304] 0 2024-06-03T00:03:08.205 INFO:tasks.workunit.client.0.smithi049.stdout:8/414: chown d4/f73 251 1 2024-06-03T00:03:08.206 INFO:tasks.workunit.client.0.smithi049.stdout:2/482: write da/d52/df/d3c/d60/f78 [30272,76516] 0 2024-06-03T00:03:08.206 INFO:tasks.workunit.client.0.smithi049.stdout:2/483: chown da/d52/f39 3 1 2024-06-03T00:03:08.206 INFO:tasks.workunit.client.0.smithi049.stdout:2/484: truncate da/d52/f33 4751466 0 2024-06-03T00:03:08.206 INFO:tasks.workunit.client.0.smithi049.stdout:3/347: link d2/d1a/d34/f48 d2/d14/d22/d3a/d47/f72 0 2024-06-03T00:03:08.206 INFO:tasks.workunit.client.0.smithi049.stdout:4/608: write d4/d3f/d14/fc1 [5107187,40765] 0 2024-06-03T00:03:08.206 INFO:tasks.workunit.client.0.smithi049.stdout:4/609: readlink d4/d2a/l3e 0 2024-06-03T00:03:08.206 INFO:tasks.workunit.client.0.smithi049.stdout:0/398: dwrite d6/d29/d47/d4b/d67/d6e/d52/f81 [0,4194304] 0 2024-06-03T00:03:08.206 INFO:tasks.workunit.client.0.smithi049.stdout:0/399: chown d6/d59/d72/f86 14168 1 2024-06-03T00:03:08.206 INFO:tasks.workunit.client.0.smithi049.stdout:9/684: mkdir d1/d5/d13/de3/de8 0 2024-06-03T00:03:08.207 INFO:tasks.workunit.client.0.smithi049.stdout:3/348: creat d2/d1a/f73 x:0 0 0 2024-06-03T00:03:08.207 INFO:tasks.workunit.client.0.smithi049.stdout:3/349: chown d2/d14/d44/d52/d4c/c4e 1445 1 2024-06-03T00:03:08.210 INFO:tasks.workunit.client.0.smithi049.stdout:0/400: dread d6/d30/f6b [0,4194304] 0 2024-06-03T00:03:08.210 INFO:tasks.workunit.client.0.smithi049.stdout:2/485: dread da/d52/df/f34 [0,4194304] 0 2024-06-03T00:03:08.211 INFO:tasks.workunit.client.0.smithi049.stdout:8/415: write d4/d27/f4b [448095,26527] 0 2024-06-03T00:03:08.211 INFO:tasks.workunit.client.0.smithi049.stdout:8/416: chown d4/d7/d4d 14 1 2024-06-03T00:03:08.211 INFO:tasks.workunit.client.0.smithi049.stdout:4/610: rmdir d4/d3f/d14/d2b/d84/d1c/d24/d43 39 2024-06-03T00:03:08.212 INFO:tasks.workunit.client.0.smithi049.stdout:4/611: dread - d4/d3f/d14/d2b/d84/d1c/d7a/f80 zero size 2024-06-03T00:03:08.212 INFO:tasks.workunit.client.0.smithi049.stdout:3/350: symlink d2/d14/d44/d52/l74 0 2024-06-03T00:03:08.212 INFO:tasks.workunit.client.0.smithi049.stdout:3/351: dread - d2/d1a/d34/f62 zero size 2024-06-03T00:03:08.213 INFO:tasks.workunit.client.0.smithi049.stdout:9/685: mknod d1/d5/d13/d3b/ce9 0 2024-06-03T00:03:08.213 INFO:tasks.workunit.client.0.smithi049.stdout:9/686: read - d1/d5/d13/d3b/d49/fc7 zero size 2024-06-03T00:03:08.214 INFO:tasks.workunit.client.0.smithi049.stdout:8/417: creat d4/d7/d28/f86 x:0 0 0 2024-06-03T00:03:08.214 INFO:tasks.workunit.client.0.smithi049.stdout:8/418: chown d4/d7/d28/f46 30593 1 2024-06-03T00:03:08.214 INFO:tasks.workunit.client.0.smithi049.stdout:2/486: write da/d52/df/d3c/f53 [1436764,91266] 0 2024-06-03T00:03:08.214 INFO:tasks.workunit.client.0.smithi049.stdout:2/487: write da/f1c [1600873,33303] 0 2024-06-03T00:03:08.214 INFO:tasks.workunit.client.0.smithi049.stdout:2/488: chown da/d52/d37 813492 1 2024-06-03T00:03:08.215 INFO:tasks.workunit.client.0.smithi049.stdout:2/489: rename da to da/d52/d40/d99 22 2024-06-03T00:03:08.215 INFO:tasks.workunit.client.0.smithi049.stdout:9/687: dread d1/d5/f24 [0,4194304] 0 2024-06-03T00:03:08.215 INFO:tasks.workunit.client.0.smithi049.stdout:9/688: fsync d1/d5/d13/d3b/d7f/dbc/f9c 0 2024-06-03T00:03:08.215 INFO:tasks.workunit.client.0.smithi049.stdout:9/689: readlink d1/da/d26/l67 0 2024-06-03T00:03:08.217 INFO:tasks.workunit.client.0.smithi049.stdout:3/352: getdents d2/d14/d44/d52/d4c/d4b/d58 0 2024-06-03T00:03:08.217 INFO:tasks.workunit.client.0.smithi049.stdout:4/612: creat d4/d3f/d14/fcf x:0 0 0 2024-06-03T00:03:08.218 INFO:tasks.workunit.client.0.smithi049.stdout:0/401: dread d6/d30/d32/f40 [0,4194304] 0 2024-06-03T00:03:08.219 INFO:tasks.workunit.client.0.smithi049.stdout:2/490: mkdir da/d52/df/d3c/d9a 0 2024-06-03T00:03:08.221 INFO:tasks.workunit.client.0.smithi049.stdout:9/690: link d1/da/lc9 d1/da/dbf/lea 0 2024-06-03T00:03:08.222 INFO:tasks.workunit.client.0.smithi049.stdout:3/353: rmdir d2/d1a/d51 39 2024-06-03T00:03:08.223 INFO:tasks.workunit.client.0.smithi049.stdout:3/354: chown d2/d1a/f73 91 1 2024-06-03T00:03:08.223 INFO:tasks.workunit.client.0.smithi049.stdout:3/355: fsync d2/f11 0 2024-06-03T00:03:08.223 INFO:tasks.workunit.client.0.smithi049.stdout:3/356: readlink d2/d14/d22/l28 0 2024-06-03T00:03:08.223 INFO:tasks.workunit.client.0.smithi049.stdout:4/613: mknod d4/d3f/d14/d2b/cd0 0 2024-06-03T00:03:08.224 INFO:tasks.workunit.client.0.smithi049.stdout:2/491: getdents da/d52/d37/d59/d80 0 2024-06-03T00:03:08.224 INFO:tasks.workunit.client.0.smithi049.stdout:3/357: mkdir d2/d1a/d31/d75 0 2024-06-03T00:03:08.225 INFO:tasks.workunit.client.0.smithi049.stdout:9/691: mkdir d1/da/da8/d50/deb 0 2024-06-03T00:03:08.227 INFO:tasks.workunit.client.0.smithi049.stdout:3/358: mkdir d2/d1a/d76 0 2024-06-03T00:03:08.227 INFO:tasks.workunit.client.0.smithi049.stdout:3/359: truncate d2/f39 2098306 0 2024-06-03T00:03:08.227 INFO:tasks.workunit.client.0.smithi049.stdout:3/360: truncate d2/d1a/d34/f4f 3986809 0 2024-06-03T00:03:08.227 INFO:tasks.workunit.client.0.smithi049.stdout:2/492: rmdir da 39 2024-06-03T00:03:08.227 INFO:tasks.workunit.client.0.smithi049.stdout:1/707: sync 2024-06-03T00:03:08.227 INFO:tasks.workunit.client.0.smithi049.stdout:0/402: dread d6/d29/d47/f74 [0,4194304] 0 2024-06-03T00:03:08.229 INFO:tasks.workunit.client.0.smithi049.stdout:1/708: truncate d1/d2f/d36/d37/d2c/d45/d61/d70/f85 481570 0 2024-06-03T00:03:08.229 INFO:tasks.workunit.client.0.smithi049.stdout:1/709: write d1/d2f/d36/d37/d2c/d45/da0/dab/ff2 [399972,23559] 0 2024-06-03T00:03:08.229 INFO:tasks.workunit.client.0.smithi049.stdout:1/710: write d1/d2f/d36/d37/d13/dc6/fff [751251,36943] 0 2024-06-03T00:03:08.231 INFO:tasks.workunit.client.0.smithi049.stdout:0/403: unlink d6/d29/d47/f74 0 2024-06-03T00:03:08.231 INFO:tasks.workunit.client.0.smithi049.stdout:7/533: sync 2024-06-03T00:03:08.231 INFO:tasks.workunit.client.0.smithi049.stdout:5/497: sync 2024-06-03T00:03:08.234 INFO:tasks.workunit.client.0.smithi049.stdout:5/498: getdents d3/d9/d20/d4c/d5a/d6f 0 2024-06-03T00:03:08.234 INFO:tasks.workunit.client.0.smithi049.stdout:5/499: fsync d3/d5/da/d55/d14/d16/f25 0 2024-06-03T00:03:08.234 INFO:tasks.workunit.client.0.smithi049.stdout:5/500: write d3/d9/f99 [1022768,126854] 0 2024-06-03T00:03:08.234 INFO:tasks.workunit.client.0.smithi049.stdout:5/501: chown d3/d5/d2d/d4b/d62/c64 1431 1 2024-06-03T00:03:08.234 INFO:tasks.workunit.client.0.smithi049.stdout:4/614: write d4/d3f/d14/f40 [2146343,23817] 0 2024-06-03T00:03:08.234 INFO:tasks.workunit.client.0.smithi049.stdout:4/615: truncate d4/d2a/f9f 1559133 0 2024-06-03T00:03:08.237 INFO:tasks.workunit.client.0.smithi049.stdout:4/616: rename d4/cca to d4/d3f/d14/d2b/cd1 0 2024-06-03T00:03:08.242 INFO:tasks.workunit.client.0.smithi049.stdout:8/419: dwrite d4/d27/d3c/f38 [0,4194304] 0 2024-06-03T00:03:08.242 INFO:tasks.workunit.client.0.smithi049.stdout:4/617: creat d4/d3f/fd2 x:0 0 0 2024-06-03T00:03:08.247 INFO:tasks.workunit.client.0.smithi049.stdout:8/420: creat d4/d7/d28/d2b/f87 x:0 0 0 2024-06-03T00:03:08.252 INFO:tasks.workunit.client.0.smithi049.stdout:9/692: dwrite d1/d5/d1a/fa6 [0,4194304] 0 2024-06-03T00:03:08.256 INFO:tasks.workunit.client.0.smithi049.stdout:3/361: dwrite d2/d14/d22/f2a [4194304,4194304] 0 2024-06-03T00:03:08.257 INFO:tasks.workunit.client.0.smithi049.stdout:3/362: chown d2/d14/d44/d52/f3f 423887 1 2024-06-03T00:03:08.262 INFO:tasks.workunit.client.0.smithi049.stdout:9/693: creat d1/d5/d13/d3b/dbb/fec x:0 0 0 2024-06-03T00:03:08.267 INFO:tasks.workunit.client.0.smithi049.stdout:8/421: rename d4/d7 to d4/d27/d3c/d88 0 2024-06-03T00:03:08.268 INFO:tasks.workunit.client.0.smithi049.stdout:8/422: symlink d4/d27/d30/l89 0 2024-06-03T00:03:08.268 INFO:tasks.workunit.client.0.smithi049.stdout:8/423: readlink d4/d27/l5f 0 2024-06-03T00:03:08.269 INFO:tasks.workunit.client.0.smithi049.stdout:9/694: read d1/d5/d13/d3b/d49/f64 [783696,23493] 0 2024-06-03T00:03:08.270 INFO:tasks.workunit.client.0.smithi049.stdout:8/424: mkdir d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a 0 2024-06-03T00:03:08.271 INFO:tasks.workunit.client.0.smithi049.stdout:8/425: fdatasync d4/f73 0 2024-06-03T00:03:08.271 INFO:tasks.workunit.client.0.smithi049.stdout:8/426: dread - d4/d27/d3c/d88/d28/d52/f76 zero size 2024-06-03T00:03:08.271 INFO:tasks.workunit.client.0.smithi049.stdout:8/427: chown d4/d27/d3c/d88/d28/f36 13059 1 2024-06-03T00:03:08.271 INFO:tasks.workunit.client.0.smithi049.stdout:4/618: dwrite d4/d3f/d14/d2b/f48 [4194304,4194304] 0 2024-06-03T00:03:08.271 INFO:tasks.workunit.client.0.smithi049.stdout:9/695: creat d1/da/da8/fed x:0 0 0 2024-06-03T00:03:08.272 INFO:tasks.workunit.client.0.smithi049.stdout:9/696: creat d1/da/fee x:0 0 0 2024-06-03T00:03:08.272 INFO:tasks.workunit.client.0.smithi049.stdout:8/428: rmdir d4/d27/d3c 39 2024-06-03T00:03:08.272 INFO:tasks.workunit.client.0.smithi049.stdout:4/619: mkdir d4/d3f/d14/d2b/d84/d69/dc6/dd3 0 2024-06-03T00:03:08.273 INFO:tasks.workunit.client.0.smithi049.stdout:9/697: creat d1/da/da8/d50/d70/fef x:0 0 0 2024-06-03T00:03:08.274 INFO:tasks.workunit.client.0.smithi049.stdout:4/620: symlink d4/d2a/ld4 0 2024-06-03T00:03:08.275 INFO:tasks.workunit.client.0.smithi049.stdout:9/698: mknod d1/d5/cf0 0 2024-06-03T00:03:08.275 INFO:tasks.workunit.client.0.smithi049.stdout:0/404: dwrite d6/d29/f79 [0,4194304] 0 2024-06-03T00:03:08.275 INFO:tasks.workunit.client.0.smithi049.stdout:9/699: write d1/d5/d1a/fa6 [4564004,70753] 0 2024-06-03T00:03:08.276 INFO:tasks.workunit.client.0.smithi049.stdout:0/405: write d6/d29/d47/d4b/d67/d6e/d52/f6c [4949696,24944] 0 2024-06-03T00:03:08.276 INFO:tasks.workunit.client.0.smithi049.stdout:8/429: getdents d4 0 2024-06-03T00:03:08.277 INFO:tasks.workunit.client.0.smithi049.stdout:9/700: rename d1/d5/d13/c4d to d1/da/da8/d50/cf1 0 2024-06-03T00:03:08.277 INFO:tasks.workunit.client.0.smithi049.stdout:9/701: write d1/fe4 [609656,19768] 0 2024-06-03T00:03:08.277 INFO:tasks.workunit.client.0.smithi049.stdout:9/702: read - d1/da/da8/fe7 zero size 2024-06-03T00:03:08.277 INFO:tasks.workunit.client.0.smithi049.stdout:0/406: truncate d6/f61 2155212 0 2024-06-03T00:03:08.278 INFO:tasks.workunit.client.0.smithi049.stdout:8/430: mknod d4/d27/d3c/d43/d6b/c8b 0 2024-06-03T00:03:08.279 INFO:tasks.workunit.client.0.smithi049.stdout:8/431: rename d4/d27/d3c/d88/d28/d45/f83 to d4/d27/d3c/d88/d28/d52/d66/d53/d7e/f8c 0 2024-06-03T00:03:08.282 INFO:tasks.workunit.client.0.smithi049.stdout:5/502: dwrite d3/d5/d2d/d4b/f59 [0,4194304] 0 2024-06-03T00:03:08.282 INFO:tasks.workunit.client.0.smithi049.stdout:1/711: dwrite d1/d2f/d36/d37/d64/d6c/f92 [4194304,4194304] 0 2024-06-03T00:03:08.282 INFO:tasks.workunit.client.0.smithi049.stdout:5/503: fsync d3/d5/da/d55/d14/f2a 0 2024-06-03T00:03:08.282 INFO:tasks.workunit.client.0.smithi049.stdout:5/504: chown d3/d5/da/d55/d14/f47 598191 1 2024-06-03T00:03:08.283 INFO:tasks.workunit.client.0.smithi049.stdout:5/505: chown d3/d5/da/f50 61 1 2024-06-03T00:03:08.283 INFO:tasks.workunit.client.0.smithi049.stdout:3/363: dwrite d2/d1a/d34/f3b [0,4194304] 0 2024-06-03T00:03:08.283 INFO:tasks.workunit.client.0.smithi049.stdout:0/407: write d6/d29/f8b [437800,108588] 0 2024-06-03T00:03:08.283 INFO:tasks.workunit.client.0.smithi049.stdout:5/506: truncate d3/d5/d2d/d4b/d51/f76 601986 0 2024-06-03T00:03:08.285 INFO:tasks.workunit.client.0.smithi049.stdout:0/408: getdents d6/d29/d47/d4b 0 2024-06-03T00:03:08.285 INFO:tasks.workunit.client.0.smithi049.stdout:0/409: chown d6/d30/d32/f64 285 1 2024-06-03T00:03:08.286 INFO:tasks.workunit.client.0.smithi049.stdout:9/703: write d1/d5/fb4 [1635679,77771] 0 2024-06-03T00:03:08.286 INFO:tasks.workunit.client.0.smithi049.stdout:1/712: link d1/d2f/d36/d37/d13/d71/f9c d1/d2f/d36/d37/d64/d6c/d8c/f100 0 2024-06-03T00:03:08.287 INFO:tasks.workunit.client.0.smithi049.stdout:4/621: write d4/d3f/d14/fa2 [3066350,125126] 0 2024-06-03T00:03:08.289 INFO:tasks.workunit.client.0.smithi049.stdout:1/713: dread d1/d2f/d36/d37/d2c/d45/da0/dab/ff2 [0,4194304] 0 2024-06-03T00:03:08.290 INFO:tasks.workunit.client.0.smithi049.stdout:0/410: dread d6/d29/f33 [0,4194304] 0 2024-06-03T00:03:08.290 INFO:tasks.workunit.client.0.smithi049.stdout:0/411: write d6/d29/f8b [825642,8340] 0 2024-06-03T00:03:08.290 INFO:tasks.workunit.client.0.smithi049.stdout:4/622: dread d4/d3f/f56 [0,4194304] 0 2024-06-03T00:03:08.292 INFO:tasks.workunit.client.0.smithi049.stdout:1/714: creat d1/d2f/d36/d37/d2c/f101 x:0 0 0 2024-06-03T00:03:08.292 INFO:tasks.workunit.client.0.smithi049.stdout:1/715: truncate d1/f3 2509623 0 2024-06-03T00:03:08.292 INFO:tasks.workunit.client.0.smithi049.stdout:0/412: truncate d6/d29/d47/f50 1877846 0 2024-06-03T00:03:08.292 INFO:tasks.workunit.client.0.smithi049.stdout:3/364: write d2/d14/f24 [4107991,71830] 0 2024-06-03T00:03:08.293 INFO:tasks.workunit.client.0.smithi049.stdout:3/365: write d2/d14/f6f [1698969,115684] 0 2024-06-03T00:03:08.294 INFO:tasks.workunit.client.0.smithi049.stdout:1/716: write d1/d2f/df7/f6f [1987307,99076] 0 2024-06-03T00:03:08.294 INFO:tasks.workunit.client.0.smithi049.stdout:1/717: dread - d1/d2f/d36/d37/d2c/fbb zero size 2024-06-03T00:03:08.294 INFO:tasks.workunit.client.0.smithi049.stdout:0/413: symlink d6/l8d 0 2024-06-03T00:03:08.294 INFO:tasks.workunit.client.0.smithi049.stdout:4/623: symlink d4/d3f/d14/d2b/d84/d1c/d24/d43/ld5 0 2024-06-03T00:03:08.294 INFO:tasks.workunit.client.0.smithi049.stdout:3/366: link d2/d14/d44/c50 d2/d1a/c77 0 2024-06-03T00:03:08.298 INFO:tasks.workunit.client.0.smithi049.stdout:5/507: dread d3/d5/d2d/f92 [0,4194304] 0 2024-06-03T00:03:08.298 INFO:tasks.workunit.client.0.smithi049.stdout:0/414: creat d6/d30/f8e x:0 0 0 2024-06-03T00:03:08.298 INFO:tasks.workunit.client.0.smithi049.stdout:1/718: mkdir d1/d2f/d36/d37/d2c/d102 0 2024-06-03T00:03:08.298 INFO:tasks.workunit.client.0.smithi049.stdout:1/719: readlink d1/d2f/d36/d37/d13/dc6/lda 0 2024-06-03T00:03:08.299 INFO:tasks.workunit.client.0.smithi049.stdout:0/415: dread d6/d29/d47/d4b/d67/d6e/f70 [0,4194304] 0 2024-06-03T00:03:08.301 INFO:tasks.workunit.client.0.smithi049.stdout:0/416: write d6/d29/d47/f6a [702816,125373] 0 2024-06-03T00:03:08.303 INFO:tasks.workunit.client.0.smithi049.stdout:8/432: dwrite d4/d27/d3c/d88/d28/d2b/f87 [0,4194304] 0 2024-06-03T00:03:08.303 INFO:tasks.workunit.client.0.smithi049.stdout:0/417: rename d6/d30/f6b to d6/d59/d72/f8f 0 2024-06-03T00:03:08.304 INFO:tasks.workunit.client.0.smithi049.stdout:8/433: dread d4/d27/d3c/d88/d28/d52/f71 [0,4194304] 0 2024-06-03T00:03:08.304 INFO:tasks.workunit.client.0.smithi049.stdout:8/434: stat d4/c3e 0 2024-06-03T00:03:08.307 INFO:tasks.workunit.client.0.smithi049.stdout:8/435: symlink d4/d27/d3c/d88/d28/d52/l8d 0 2024-06-03T00:03:08.308 INFO:tasks.workunit.client.0.smithi049.stdout:8/436: mkdir d4/d27/d3c/d88/d28/d52/d66/d8e 0 2024-06-03T00:03:08.309 INFO:tasks.workunit.client.0.smithi049.stdout:8/437: mkdir d4/d27/d3c/d88/d48/d8f 0 2024-06-03T00:03:08.309 INFO:tasks.workunit.client.0.smithi049.stdout:8/438: write d4/d27/d3c/d88/f74 [103145,21418] 0 2024-06-03T00:03:08.310 INFO:tasks.workunit.client.0.smithi049.stdout:8/439: creat d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/f90 x:0 0 0 2024-06-03T00:03:08.315 INFO:tasks.workunit.client.0.smithi049.stdout:0/418: write d6/d59/d72/f8f [7220377,81459] 0 2024-06-03T00:03:08.316 INFO:tasks.workunit.client.0.smithi049.stdout:0/419: creat d6/d29/d47/f90 x:0 0 0 2024-06-03T00:03:08.317 INFO:tasks.workunit.client.0.smithi049.stdout:0/420: write d6/d29/d47/d4b/d67/d6e/f2b [1548890,49341] 0 2024-06-03T00:03:08.317 INFO:tasks.workunit.client.0.smithi049.stdout:1/720: dread d1/d2f/f46 [4194304,4194304] 0 2024-06-03T00:03:08.317 INFO:tasks.workunit.client.0.smithi049.stdout:1/721: fsync d1/d2f/f46 0 2024-06-03T00:03:08.317 INFO:tasks.workunit.client.0.smithi049.stdout:1/722: write d1/d2f/d36/d37/d2c/d45/d61/d70/fe3 [961676,90261] 0 2024-06-03T00:03:08.318 INFO:tasks.workunit.client.0.smithi049.stdout:0/421: creat d6/d29/d47/d4b/d67/d6e/d52/f91 x:0 0 0 2024-06-03T00:03:08.319 INFO:tasks.workunit.client.0.smithi049.stdout:1/723: rename d1/d2f/d36/d37/d13/d34/ca3 to d1/d2f/d36/d37/d13/d34/dd0/c103 0 2024-06-03T00:03:08.320 INFO:tasks.workunit.client.0.smithi049.stdout:0/422: creat d6/f92 x:0 0 0 2024-06-03T00:03:08.320 INFO:tasks.workunit.client.0.smithi049.stdout:5/508: dwrite d3/d7d/f8c [0,4194304] 0 2024-06-03T00:03:08.320 INFO:tasks.workunit.client.0.smithi049.stdout:1/724: creat d1/d2f/d36/d37/d64/f104 x:0 0 0 2024-06-03T00:03:08.321 INFO:tasks.workunit.client.0.smithi049.stdout:3/367: dwrite d2/d14/d44/d52/d4c/d4b/d58/f60 [4194304,4194304] 0 2024-06-03T00:03:08.321 INFO:tasks.workunit.client.0.smithi049.stdout:0/423: rmdir d6/d59/d72 39 2024-06-03T00:03:08.321 INFO:tasks.workunit.client.0.smithi049.stdout:0/424: chown d6/d59/f5b 655704 1 2024-06-03T00:03:08.323 INFO:tasks.workunit.client.0.smithi049.stdout:5/509: truncate d3/d5/da/f50 3541213 0 2024-06-03T00:03:08.324 INFO:tasks.workunit.client.0.smithi049.stdout:3/368: mknod d2/d1a/d51/d64/c78 0 2024-06-03T00:03:08.325 INFO:tasks.workunit.client.0.smithi049.stdout:3/369: truncate d2/d14/d22/d3a/d47/f72 185358 0 2024-06-03T00:03:08.325 INFO:tasks.workunit.client.0.smithi049.stdout:3/370: readlink d2/d14/d44/d52/l74 0 2024-06-03T00:03:08.326 INFO:tasks.workunit.client.0.smithi049.stdout:6/658: sync 2024-06-03T00:03:08.326 INFO:tasks.workunit.client.0.smithi049.stdout:6/659: dread - d2/d3/fdf zero size 2024-06-03T00:03:08.326 INFO:tasks.workunit.client.0.smithi049.stdout:6/660: fsync d2/d3/d9/d23/d48/d51/f5f 0 2024-06-03T00:03:08.326 INFO:tasks.workunit.client.0.smithi049.stdout:3/371: mkdir d2/d14/d22/d3a/d47/d79 0 2024-06-03T00:03:08.327 INFO:tasks.workunit.client.0.smithi049.stdout:3/372: unlink d2/d1a/f5d 0 2024-06-03T00:03:08.328 INFO:tasks.workunit.client.0.smithi049.stdout:0/425: getdents d6/d29/d47/d4b/d67/d6e/d52 0 2024-06-03T00:03:08.328 INFO:tasks.workunit.client.0.smithi049.stdout:0/426: fdatasync d6/d59/f5b 0 2024-06-03T00:03:08.328 INFO:tasks.workunit.client.0.smithi049.stdout:0/427: fdatasync f2 0 2024-06-03T00:03:08.328 INFO:tasks.workunit.client.0.smithi049.stdout:3/373: truncate d2/d14/d44/d52/f3f 1073689 0 2024-06-03T00:03:08.329 INFO:tasks.workunit.client.0.smithi049.stdout:3/374: write d2/d1a/d51/d64/f71 [129622,124557] 0 2024-06-03T00:03:08.329 INFO:tasks.workunit.client.0.smithi049.stdout:3/375: mknod d2/d14/d22/c7a 0 2024-06-03T00:03:08.331 INFO:tasks.workunit.client.0.smithi049.stdout:0/428: mkdir d6/d59/d93 0 2024-06-03T00:03:08.331 INFO:tasks.workunit.client.0.smithi049.stdout:8/440: dwrite d4/d27/d3c/d88/d28/d52/d66/d53/d7e/f7b [0,4194304] 0 2024-06-03T00:03:08.332 INFO:tasks.workunit.client.0.smithi049.stdout:0/429: read d6/d29/d47/d4b/d67/d6e/f70 [552285,17581] 0 2024-06-03T00:03:08.336 INFO:tasks.workunit.client.0.smithi049.stdout:6/661: write d2/d3/d9/d23/f82 [2893676,81198] 0 2024-06-03T00:03:08.336 INFO:tasks.workunit.client.0.smithi049.stdout:6/662: fdatasync d2/d3/d9/f54 0 2024-06-03T00:03:08.340 INFO:tasks.workunit.client.0.smithi049.stdout:8/441: dread d4/d27/d3c/d88/f61 [4194304,4194304] 0 2024-06-03T00:03:08.342 INFO:tasks.workunit.client.0.smithi049.stdout:3/376: dread d2/d1a/d51/d64/f71 [0,4194304] 0 2024-06-03T00:03:08.342 INFO:tasks.workunit.client.0.smithi049.stdout:3/377: write d2/d14/d44/d52/f6a [136814,5153] 0 2024-06-03T00:03:08.343 INFO:tasks.workunit.client.0.smithi049.stdout:5/510: dwrite d3/d5/d9a/f9b [0,4194304] 0 2024-06-03T00:03:08.343 INFO:tasks.workunit.client.0.smithi049.stdout:5/511: write d3/d5/da/d55/d14/d16/f2c [5113525,114044] 0 2024-06-03T00:03:08.343 INFO:tasks.workunit.client.0.smithi049.stdout:3/378: mknod d2/d1a/d31/d75/c7b 0 2024-06-03T00:03:08.344 INFO:tasks.workunit.client.0.smithi049.stdout:6/663: dread d2/d3/d9/f3d [0,4194304] 0 2024-06-03T00:03:08.344 INFO:tasks.workunit.client.0.smithi049.stdout:0/430: dread d6/f21 [0,4194304] 0 2024-06-03T00:03:08.346 INFO:tasks.workunit.client.0.smithi049.stdout:6/664: creat d2/d4d/fe1 x:0 0 0 2024-06-03T00:03:08.346 INFO:tasks.workunit.client.0.smithi049.stdout:5/512: mkdir d3/d9/d20/d4c/d9d 0 2024-06-03T00:03:08.347 INFO:tasks.workunit.client.0.smithi049.stdout:0/431: truncate d6/d30/d32/f82 3515248 0 2024-06-03T00:03:08.348 INFO:tasks.workunit.client.0.smithi049.stdout:3/379: creat d2/d14/d22/f7c x:0 0 0 2024-06-03T00:03:08.348 INFO:tasks.workunit.client.0.smithi049.stdout:6/665: rmdir d2/d3/d17/d57/d6e/d88/dcc 39 2024-06-03T00:03:08.349 INFO:tasks.workunit.client.0.smithi049.stdout:5/513: mknod d3/d9/d20/d4c/d5a/d65/c9e 0 2024-06-03T00:03:08.350 INFO:tasks.workunit.client.0.smithi049.stdout:5/514: stat d3/d5/da/f27 0 2024-06-03T00:03:08.350 INFO:tasks.workunit.client.0.smithi049.stdout:0/432: mkdir d6/d59/d72/d94 0 2024-06-03T00:03:08.351 INFO:tasks.workunit.client.0.smithi049.stdout:3/380: link d2/d1a/d51/d64/c78 d2/d1a/d34/c7d 0 2024-06-03T00:03:08.351 INFO:tasks.workunit.client.0.smithi049.stdout:0/433: link d6/d29/f54 d6/d29/d47/d4b/f95 0 2024-06-03T00:03:08.351 INFO:tasks.workunit.client.0.smithi049.stdout:8/442: dread d4/d27/d3c/d88/d28/d2b/f87 [0,4194304] 0 2024-06-03T00:03:08.351 INFO:tasks.workunit.client.0.smithi049.stdout:5/515: creat d3/f9f x:0 0 0 2024-06-03T00:03:08.352 INFO:tasks.workunit.client.0.smithi049.stdout:3/381: creat d2/d1a/d31/f7e x:0 0 0 2024-06-03T00:03:08.352 INFO:tasks.workunit.client.0.smithi049.stdout:3/382: readlink d2/d14/l17 0 2024-06-03T00:03:08.353 INFO:tasks.workunit.client.0.smithi049.stdout:0/434: mkdir d6/d29/d47/d4b/d67/d6e/d52/d96 0 2024-06-03T00:03:08.353 INFO:tasks.workunit.client.0.smithi049.stdout:8/443: getdents d4/d27/d3c/d88/d48 0 2024-06-03T00:03:08.354 INFO:tasks.workunit.client.0.smithi049.stdout:0/435: write d6/d29/f8b [222353,61914] 0 2024-06-03T00:03:08.354 INFO:tasks.workunit.client.0.smithi049.stdout:6/666: dread d2/d3/d9/d23/d29/f63 [0,4194304] 0 2024-06-03T00:03:08.354 INFO:tasks.workunit.client.0.smithi049.stdout:5/516: creat d3/d5/da/d55/d75/fa0 x:0 0 0 2024-06-03T00:03:08.357 INFO:tasks.workunit.client.0.smithi049.stdout:5/517: unlink d3/d5/da/f27 0 2024-06-03T00:03:08.357 INFO:tasks.workunit.client.0.smithi049.stdout:5/518: truncate d3/d9/d68/f83 793130 0 2024-06-03T00:03:08.357 INFO:tasks.workunit.client.0.smithi049.stdout:5/519: fdatasync d3/d5/d2d/d4b/f59 0 2024-06-03T00:03:08.357 INFO:tasks.workunit.client.0.smithi049.stdout:6/667: dread d2/d3/d9/fc7 [0,4194304] 0 2024-06-03T00:03:08.357 INFO:tasks.workunit.client.0.smithi049.stdout:5/520: mknod d3/d9/d20/d4c/d9d/ca1 0 2024-06-03T00:03:08.358 INFO:tasks.workunit.client.0.smithi049.stdout:6/668: mkdir d2/d3/d17/d57/d6e/dd3/de2 0 2024-06-03T00:03:08.363 INFO:tasks.workunit.client.0.smithi049.stdout:0/436: rename d6/d29/d47 to d6/d97 0 2024-06-03T00:03:08.363 INFO:tasks.workunit.client.0.smithi049.stdout:0/437: dread - d6/d97/d4b/d67/d6e/d52/f91 zero size 2024-06-03T00:03:08.364 INFO:tasks.workunit.client.0.smithi049.stdout:0/438: symlink d6/d97/d4b/d67/l98 0 2024-06-03T00:03:08.369 INFO:tasks.workunit.client.0.smithi049.stdout:5/521: write d3/d9/d68/f70 [106231,2688] 0 2024-06-03T00:03:08.371 INFO:tasks.workunit.client.0.smithi049.stdout:3/383: dwrite d2/d14/d44/d52/f3f [0,4194304] 0 2024-06-03T00:03:08.372 INFO:tasks.workunit.client.0.smithi049.stdout:3/384: truncate d2/d1a/f73 714251 0 2024-06-03T00:03:08.372 INFO:tasks.workunit.client.0.smithi049.stdout:3/385: truncate d2/d1a/d31/f7e 993486 0 2024-06-03T00:03:08.372 INFO:tasks.workunit.client.0.smithi049.stdout:3/386: write d2/d1a/f1d [4791784,55279] 0 2024-06-03T00:03:08.372 INFO:tasks.workunit.client.0.smithi049.stdout:3/387: rename d2/d14/d44/d52/d4c/f6c to d2/d14/d44/d52/d4c/d4b/f7f 0 2024-06-03T00:03:08.373 INFO:tasks.workunit.client.0.smithi049.stdout:3/388: mkdir d2/d14/d22/d42/d68/d80 0 2024-06-03T00:03:08.374 INFO:tasks.workunit.client.0.smithi049.stdout:3/389: symlink d2/d14/d22/d42/d68/l81 0 2024-06-03T00:03:08.374 INFO:tasks.workunit.client.0.smithi049.stdout:3/390: write d2/f11 [4646037,125626] 0 2024-06-03T00:03:08.375 INFO:tasks.workunit.client.0.smithi049.stdout:0/439: write d6/d30/d32/f40 [3263363,121153] 0 2024-06-03T00:03:08.375 INFO:tasks.workunit.client.0.smithi049.stdout:0/440: write d6/d29/f54 [938066,120649] 0 2024-06-03T00:03:08.375 INFO:tasks.workunit.client.0.smithi049.stdout:0/441: fsync f4 0 2024-06-03T00:03:08.375 INFO:tasks.workunit.client.0.smithi049.stdout:3/391: truncate d2/d14/f24 3145325 0 2024-06-03T00:03:08.377 INFO:tasks.workunit.client.0.smithi049.stdout:3/392: rename d2/d14/d44/d52/f3f to d2/d14/f82 0 2024-06-03T00:03:08.377 INFO:tasks.workunit.client.0.smithi049.stdout:3/393: fdatasync d2/fd 0 2024-06-03T00:03:08.377 INFO:tasks.workunit.client.0.smithi049.stdout:0/442: creat d6/d59/d93/f99 x:0 0 0 2024-06-03T00:03:08.378 INFO:tasks.workunit.client.0.smithi049.stdout:0/443: chown d6/d56 11861 1 2024-06-03T00:03:08.378 INFO:tasks.workunit.client.0.smithi049.stdout:0/444: truncate d6/d97/f50 2211210 0 2024-06-03T00:03:08.378 INFO:tasks.workunit.client.0.smithi049.stdout:5/522: write d3/d5/d24/f5f [3440664,64301] 0 2024-06-03T00:03:08.378 INFO:tasks.workunit.client.0.smithi049.stdout:5/523: chown d3/d5/d24/c31 14960927 1 2024-06-03T00:03:08.378 INFO:tasks.workunit.client.0.smithi049.stdout:3/394: rename d2/d1a/d34/d5c to d2/d1a/d51/d83 0 2024-06-03T00:03:08.378 INFO:tasks.workunit.client.0.smithi049.stdout:3/395: write d2/d14/d44/d52/fa [374840,48731] 0 2024-06-03T00:03:08.380 INFO:tasks.workunit.client.0.smithi049.stdout:0/445: rename d6/d97/d4b/d67/d6e/c66 to d6/d30/c9a 0 2024-06-03T00:03:08.380 INFO:tasks.workunit.client.0.smithi049.stdout:0/446: truncate d6/f92 994526 0 2024-06-03T00:03:08.380 INFO:tasks.workunit.client.0.smithi049.stdout:0/447: read f2 [2693189,120076] 0 2024-06-03T00:03:08.380 INFO:tasks.workunit.client.0.smithi049.stdout:0/448: chown d6/d30/f27 35914719 1 2024-06-03T00:03:08.381 INFO:tasks.workunit.client.0.smithi049.stdout:0/449: mknod d6/d29/c9b 0 2024-06-03T00:03:08.382 INFO:tasks.workunit.client.0.smithi049.stdout:0/450: creat d6/d30/f9c x:0 0 0 2024-06-03T00:03:08.383 INFO:tasks.workunit.client.0.smithi049.stdout:3/396: rename d2/d14/c4d to d2/d14/d22/d3a/d47/c84 0 2024-06-03T00:03:08.383 INFO:tasks.workunit.client.0.smithi049.stdout:5/524: read d3/d5/da/d55/d14/f19 [627938,55710] 0 2024-06-03T00:03:08.383 INFO:tasks.workunit.client.0.smithi049.stdout:0/451: dread d6/d97/d4b/d67/d6e/f4f [0,4194304] 0 2024-06-03T00:03:08.384 INFO:tasks.workunit.client.0.smithi049.stdout:6/669: dwrite d2/d3/d9/d23/d36/f4b [0,4194304] 0 2024-06-03T00:03:08.384 INFO:tasks.workunit.client.0.smithi049.stdout:0/452: creat d6/d59/d93/f9d x:0 0 0 2024-06-03T00:03:08.384 INFO:tasks.workunit.client.0.smithi049.stdout:0/453: write f2 [2055416,21226] 0 2024-06-03T00:03:08.386 INFO:tasks.workunit.client.0.smithi049.stdout:5/525: link d3/d9/d20/d4c/d5a/d65/c9e d3/d5/d2d/d4b/ca2 0 2024-06-03T00:03:08.387 INFO:tasks.workunit.client.0.smithi049.stdout:6/670: mkdir d2/d4d/de3 0 2024-06-03T00:03:08.388 INFO:tasks.workunit.client.0.smithi049.stdout:0/454: dread d6/d29/f54 [0,4194304] 0 2024-06-03T00:03:08.388 INFO:tasks.workunit.client.0.smithi049.stdout:6/671: mkdir d2/d4d/d76/de4 0 2024-06-03T00:03:08.389 INFO:tasks.workunit.client.0.smithi049.stdout:3/397: rename f0 to d2/d14/d44/d52/d4c/d4b/d58/f85 0 2024-06-03T00:03:08.389 INFO:tasks.workunit.client.0.smithi049.stdout:3/398: fsync d2/d14/d22/d42/f38 0 2024-06-03T00:03:08.391 INFO:tasks.workunit.client.0.smithi049.stdout:0/455: rename d6/d59/d72/f8f to d6/d59/f9e 0 2024-06-03T00:03:08.393 INFO:tasks.workunit.client.0.smithi049.stdout:0/456: rename d6/d29/f2d to d6/d97/d4b/d67/d6e/d52/d96/f9f 0 2024-06-03T00:03:08.395 INFO:tasks.workunit.client.0.smithi049.stdout:5/526: write d3/d5/da/f67 [3554190,103193] 0 2024-06-03T00:03:08.396 INFO:tasks.workunit.client.0.smithi049.stdout:5/527: mkdir d3/d5/da3 0 2024-06-03T00:03:08.397 INFO:tasks.workunit.client.0.smithi049.stdout:0/457: rename d6/d59/f5b to d6/fa0 0 2024-06-03T00:03:08.398 INFO:tasks.workunit.client.0.smithi049.stdout:0/458: rename d6/c8 to d6/d29/ca1 0 2024-06-03T00:03:08.399 INFO:tasks.workunit.client.0.smithi049.stdout:0/459: symlink d6/la2 0 2024-06-03T00:03:08.399 INFO:tasks.workunit.client.0.smithi049.stdout:0/460: readlink d6/d56/l76 0 2024-06-03T00:03:08.402 INFO:tasks.workunit.client.0.smithi049.stdout:6/672: dwrite d2/d3/d17/f77 [0,4194304] 0 2024-06-03T00:03:08.402 INFO:tasks.workunit.client.0.smithi049.stdout:6/673: write d2/d3/d17/d57/d6e/d88/fa7 [676242,118994] 0 2024-06-03T00:03:08.402 INFO:tasks.workunit.client.0.smithi049.stdout:6/674: dread - d2/d3/d9/d23/d48/fab zero size 2024-06-03T00:03:08.403 INFO:tasks.workunit.client.0.smithi049.stdout:3/399: dread d2/f11 [0,4194304] 0 2024-06-03T00:03:08.403 INFO:tasks.workunit.client.0.smithi049.stdout:6/675: mknod d2/d3/d17/d57/d6e/dd3/de2/ce5 0 2024-06-03T00:03:08.410 INFO:tasks.workunit.client.0.smithi049.stdout:0/461: dread d6/d59/f9e [4194304,4194304] 0 2024-06-03T00:03:08.412 INFO:tasks.workunit.client.0.smithi049.stdout:0/462: mkdir d6/d30/da3 0 2024-06-03T00:03:08.414 INFO:tasks.workunit.client.0.smithi049.stdout:0/463: creat d6/d56/fa4 x:0 0 0 2024-06-03T00:03:08.414 INFO:tasks.workunit.client.0.smithi049.stdout:0/464: chown d6/fa0 13044110 1 2024-06-03T00:03:08.417 INFO:tasks.workunit.client.0.smithi049.stdout:0/465: mknod d6/d29/ca5 0 2024-06-03T00:03:08.417 INFO:tasks.workunit.client.0.smithi049.stdout:5/528: dwrite d3/d5/da/d55/d14/d16/f80 [0,4194304] 0 2024-06-03T00:03:08.417 INFO:tasks.workunit.client.0.smithi049.stdout:5/529: read d3/d5/da/f67 [2484603,7209] 0 2024-06-03T00:03:08.417 INFO:tasks.workunit.client.0.smithi049.stdout:5/530: chown d3/d5/da/d55/d14/d16/f8e 446 1 2024-06-03T00:03:08.418 INFO:tasks.workunit.client.0.smithi049.stdout:5/531: mkdir d3/d53/d9c/da4 0 2024-06-03T00:03:08.419 INFO:tasks.workunit.client.0.smithi049.stdout:5/532: write d3/d5/f58 [71804,125857] 0 2024-06-03T00:03:08.434 INFO:tasks.workunit.client.0.smithi049.stdout:3/400: dwrite d2/d14/d44/d52/d4c/d4b/d58/f85 [4194304,4194304] 0 2024-06-03T00:03:08.435 INFO:tasks.workunit.client.0.smithi049.stdout:3/401: chown d2/d14/d44/d52/l74 1 1 2024-06-03T00:03:08.437 INFO:tasks.workunit.client.0.smithi049.stdout:3/402: link d2/d14/d22/d42/l3d d2/d14/d22/d42/d68/d80/l86 0 2024-06-03T00:03:08.437 INFO:tasks.workunit.client.0.smithi049.stdout:6/676: dwrite d2/d3/d9/d23/d36/f45 [0,4194304] 0 2024-06-03T00:03:08.438 INFO:tasks.workunit.client.0.smithi049.stdout:0/466: dwrite f2 [4194304,4194304] 0 2024-06-03T00:03:08.439 INFO:tasks.workunit.client.0.smithi049.stdout:3/403: dread d2/d1a/d34/f5e [0,4194304] 0 2024-06-03T00:03:08.439 INFO:tasks.workunit.client.0.smithi049.stdout:6/677: unlink d2/d3/d9/d55/lc6 0 2024-06-03T00:03:08.440 INFO:tasks.workunit.client.0.smithi049.stdout:3/404: write d2/d14/f6f [188119,120208] 0 2024-06-03T00:03:08.441 INFO:tasks.workunit.client.0.smithi049.stdout:0/467: rename d6/d97/d4b/d67/d6e/f24 to d6/d97/d4b/d67/d6e/d52/d96/fa6 0 2024-06-03T00:03:08.441 INFO:tasks.workunit.client.0.smithi049.stdout:3/405: link d2/d14/c59 d2/d14/d44/d52/c87 0 2024-06-03T00:03:08.442 INFO:tasks.workunit.client.0.smithi049.stdout:3/406: mknod d2/d1a/d31/c88 0 2024-06-03T00:03:08.443 INFO:tasks.workunit.client.0.smithi049.stdout:5/533: dwrite d3/d9/d20/f2e [0,4194304] 0 2024-06-03T00:03:08.444 INFO:tasks.workunit.client.0.smithi049.stdout:3/407: creat d2/d14/d44/d52/d4c/d4b/f89 x:0 0 0 2024-06-03T00:03:08.444 INFO:tasks.workunit.client.0.smithi049.stdout:3/408: chown d2/d1a/d51/d64/l6e 27335799 1 2024-06-03T00:03:08.444 INFO:tasks.workunit.client.0.smithi049.stdout:3/409: write d2/d1a/f1d [5517414,87439] 0 2024-06-03T00:03:08.444 INFO:tasks.workunit.client.0.smithi049.stdout:5/534: mknod d3/d5/da/d55/d14/ca5 0 2024-06-03T00:03:08.445 INFO:tasks.workunit.client.0.smithi049.stdout:3/410: rename d2/cc to d2/d1a/d31/c8a 0 2024-06-03T00:03:08.446 INFO:tasks.workunit.client.0.smithi049.stdout:5/535: symlink d3/d9/d20/d4c/d5a/d6f/la6 0 2024-06-03T00:03:08.447 INFO:tasks.workunit.client.0.smithi049.stdout:5/536: creat d3/d5/da/d55/d14/fa7 x:0 0 0 2024-06-03T00:03:08.448 INFO:tasks.workunit.client.0.smithi049.stdout:5/537: creat d3/d9/d20/fa8 x:0 0 0 2024-06-03T00:03:08.449 INFO:tasks.workunit.client.0.smithi049.stdout:6/678: write d2/d3/d9/d23/d36/f45 [1518239,11858] 0 2024-06-03T00:03:08.450 INFO:tasks.workunit.client.0.smithi049.stdout:5/538: creat d3/d5/d24/fa9 x:0 0 0 2024-06-03T00:03:08.450 INFO:tasks.workunit.client.0.smithi049.stdout:5/539: stat d3/d5/da/d55/d75/fa0 0 2024-06-03T00:03:08.452 INFO:tasks.workunit.client.0.smithi049.stdout:5/540: dread d3/d5/da/d55/d14/f57 [0,4194304] 0 2024-06-03T00:03:08.452 INFO:tasks.workunit.client.0.smithi049.stdout:5/541: dread - d3/d7d/f91 zero size 2024-06-03T00:03:08.470 INFO:tasks.workunit.client.0.smithi049.stdout:0/468: dwrite d6/fa0 [0,4194304] 0 2024-06-03T00:03:08.470 INFO:tasks.workunit.client.0.smithi049.stdout:3/411: dwrite d2/fe [0,4194304] 0 2024-06-03T00:03:08.471 INFO:tasks.workunit.client.0.smithi049.stdout:3/412: dread - d2/d14/d22/f7c zero size 2024-06-03T00:03:08.471 INFO:tasks.workunit.client.0.smithi049.stdout:0/469: symlink d6/d97/d4b/d67/d6e/d52/la7 0 2024-06-03T00:03:08.471 INFO:tasks.workunit.client.0.smithi049.stdout:5/542: dwrite d3/d5/da/d55/d14/f90 [0,4194304] 0 2024-06-03T00:03:08.471 INFO:tasks.workunit.client.0.smithi049.stdout:5/543: stat f1 0 2024-06-03T00:03:08.473 INFO:tasks.workunit.client.0.smithi049.stdout:0/470: rename d6/d29/c78 to d6/d56/ca8 0 2024-06-03T00:03:08.473 INFO:tasks.workunit.client.0.smithi049.stdout:3/413: creat d2/f8b x:0 0 0 2024-06-03T00:03:08.477 INFO:tasks.workunit.client.0.smithi049.stdout:0/471: dread d6/d29/f54 [0,4194304] 0 2024-06-03T00:03:08.485 INFO:tasks.workunit.client.0.smithi049.stdout:0/472: dread f2 [0,4194304] 0 2024-06-03T00:03:08.486 INFO:tasks.workunit.client.0.smithi049.stdout:0/473: getdents d6/d30/da3 0 2024-06-03T00:03:08.486 INFO:tasks.workunit.client.0.smithi049.stdout:0/474: write d6/d97/f6a [566501,98608] 0 2024-06-03T00:03:08.486 INFO:tasks.workunit.client.0.smithi049.stdout:0/475: chown d6/d30/d32/c4d 10472869 1 2024-06-03T00:03:08.486 INFO:tasks.workunit.client.0.smithi049.stdout:0/476: readlink d6/d30/l43 0 2024-06-03T00:03:08.488 INFO:tasks.workunit.client.0.smithi049.stdout:0/477: symlink d6/d97/d4b/d67/la9 0 2024-06-03T00:03:08.490 INFO:tasks.workunit.client.0.smithi049.stdout:0/478: creat d6/d30/da3/faa x:0 0 0 2024-06-03T00:03:08.491 INFO:tasks.workunit.client.0.smithi049.stdout:0/479: truncate d6/d97/f50 186937 0 2024-06-03T00:03:08.493 INFO:tasks.workunit.client.0.smithi049.stdout:0/480: creat d6/d30/da3/fab x:0 0 0 2024-06-03T00:03:08.493 INFO:tasks.workunit.client.0.smithi049.stdout:0/481: stat d6/d30/d32/f64 0 2024-06-03T00:03:08.493 INFO:tasks.workunit.client.0.smithi049.stdout:0/482: creat d6/d30/fac x:0 0 0 2024-06-03T00:03:08.503 INFO:tasks.workunit.client.0.smithi049.stdout:5/544: dwrite d3/d9/d20/d4c/d5a/d65/f69 [0,4194304] 0 2024-06-03T00:03:08.504 INFO:tasks.workunit.client.0.smithi049.stdout:3/414: dwrite d2/d14/d44/d52/d4c/d4b/d58/f60 [4194304,4194304] 0 2024-06-03T00:03:08.506 INFO:tasks.workunit.client.0.smithi049.stdout:5/545: link d3/d9/d20/d4c/d5a/l7a d3/d5/da/d55/d14/laa 0 2024-06-03T00:03:08.507 INFO:tasks.workunit.client.0.smithi049.stdout:5/546: mknod d3/d5/da3/cab 0 2024-06-03T00:03:08.515 INFO:tasks.workunit.client.0.smithi049.stdout:3/415: write d2/d1a/d34/f3b [5008,6211] 0 2024-06-03T00:03:08.515 INFO:tasks.workunit.client.0.smithi049.stdout:3/416: truncate d2/f8b 810406 0 2024-06-03T00:03:08.515 INFO:tasks.workunit.client.0.smithi049.stdout:3/417: dread d2/d1a/f73 [0,4194304] 0 2024-06-03T00:03:08.522 INFO:tasks.workunit.client.0.smithi049.stdout:5/547: write d3/d9/f13 [3618698,98217] 0 2024-06-03T00:03:08.523 INFO:tasks.workunit.client.0.smithi049.stdout:5/548: chown d3/d5/d2d/d4b/d62/l7e 23316 1 2024-06-03T00:03:08.523 INFO:tasks.workunit.client.0.smithi049.stdout:5/549: stat d3/d7d/l89 0 2024-06-03T00:03:08.523 INFO:tasks.workunit.client.0.smithi049.stdout:5/550: stat d3/d5/d2d/d4b/f59 0 2024-06-03T00:03:08.523 INFO:tasks.workunit.client.0.smithi049.stdout:5/551: stat d3/d7d/c85 0 2024-06-03T00:03:08.523 INFO:tasks.workunit.client.0.smithi049.stdout:5/552: read - d3/d5/da/d55/d14/fa7 zero size 2024-06-03T00:03:08.523 INFO:tasks.workunit.client.0.smithi049.stdout:5/553: chown d3/d5/da/d55/d14/d16/c1a 3 1 2024-06-03T00:03:08.524 INFO:tasks.workunit.client.0.smithi049.stdout:0/483: dwrite d6/d97/f50 [0,4194304] 0 2024-06-03T00:03:08.524 INFO:tasks.workunit.client.0.smithi049.stdout:3/418: write d2/f15 [1726761,63797] 0 2024-06-03T00:03:08.524 INFO:tasks.workunit.client.0.smithi049.stdout:3/419: truncate d2/d14/d44/f5b 1219176 0 2024-06-03T00:03:08.524 INFO:tasks.workunit.client.0.smithi049.stdout:3/420: chown d2/d1a/d31/c6b 1 1 2024-06-03T00:03:08.525 INFO:tasks.workunit.client.0.smithi049.stdout:5/554: creat d3/d9/d20/fac x:0 0 0 2024-06-03T00:03:08.528 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.528+0000 7f6cd79c1640 1 -- 172.21.15.49:0/2981952991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6cd0100900 msgr2=0x7f6cd0100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:08.528 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.528+0000 7f6cd79c1640 1 --2- 172.21.15.49:0/2981952991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6cd0100900 0x7f6cd0100d20 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc009900 tx=0x7f6ccc02a3f0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.528 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.528+0000 7f6cd79c1640 1 -- 172.21.15.49:0/2981952991 shutdown_connections 2024-06-03T00:03:08.528 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.528+0000 7f6cd79c1640 1 --2- 172.21.15.49:0/2981952991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6cd0101af0 0x7f6cd0101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.528 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.528+0000 7f6cd79c1640 1 --2- 172.21.15.49:0/2981952991 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cd01024b0 0x7f6cd0108d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.529 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.528+0000 7f6cd79c1640 1 --2- 172.21.15.49:0/2981952991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6cd0100900 0x7f6cd0100d20 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.529 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.528+0000 7f6cd79c1640 1 -- 172.21.15.49:0/2981952991 >> 172.21.15.49:0/2981952991 conn(0x7f6cd00fbe90 msgr2=0x7f6cd00fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:08.529 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.528+0000 7f6cd79c1640 1 -- 172.21.15.49:0/2981952991 shutdown_connections 2024-06-03T00:03:08.529 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.529+0000 7f6cd79c1640 1 -- 172.21.15.49:0/2981952991 wait complete. 2024-06-03T00:03:08.531 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.529+0000 7f6cd79c1640 1 Processor -- start 2024-06-03T00:03:08.531 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.529+0000 7f6cd79c1640 1 -- start start 2024-06-03T00:03:08.531 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.529+0000 7f6cd79c1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cd0100900 0x7f6cd0199e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:08.531 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.530+0000 7f6cd79c1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6cd0101af0 0x7f6cd019a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:08.531 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.530+0000 7f6cd79c1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6cd01024b0 0x7f6cd01a13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:08.531 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.530+0000 7f6cd79c1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd010b480 con 0x7f6cd0101af0 2024-06-03T00:03:08.531 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.530+0000 7f6cd79c1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd010b300 con 0x7f6cd01024b0 2024-06-03T00:03:08.531 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.530+0000 7f6cd79c1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd010b600 con 0x7f6cd0100900 2024-06-03T00:03:08.531 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.530+0000 7f6cd4f5c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6cd0101af0 0x7f6cd019a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:08.531 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.530+0000 7f6cd4f5c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6cd0101af0 0x7f6cd019a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44636/0 (socket says 172.21.15.49:44636) 2024-06-03T00:03:08.532 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.530+0000 7f6cd4f5c640 1 -- 172.21.15.49:0/4201602250 learned_addr learned my addr 172.21.15.49:0/4201602250 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:08.532 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.530+0000 7f6cd5f5e640 1 --2- 172.21.15.49:0/4201602250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6cd01024b0 0x7f6cd01a13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:08.532 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.530+0000 7f6cd575d640 1 --2- 172.21.15.49:0/4201602250 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cd0100900 0x7f6cd0199e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:08.532 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.530+0000 7f6cd5f5e640 1 -- 172.21.15.49:0/4201602250 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cd0100900 msgr2=0x7f6cd0199e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:08.532 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.530+0000 7f6cd5f5e640 1 --2- 172.21.15.49:0/4201602250 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cd0100900 0x7f6cd0199e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.532 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.530+0000 7f6cd5f5e640 1 -- 172.21.15.49:0/4201602250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6cd0101af0 msgr2=0x7f6cd019a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:08.532 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.530+0000 7f6cd5f5e640 1 --2- 172.21.15.49:0/4201602250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6cd0101af0 0x7f6cd019a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.532 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.530+0000 7f6cd5f5e640 1 -- 172.21.15.49:0/4201602250 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd01a1a50 con 0x7f6cd01024b0 2024-06-03T00:03:08.532 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.530+0000 7f6cd4f5c640 1 --2- 172.21.15.49:0/4201602250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6cd0101af0 0x7f6cd019a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:08.532 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.530+0000 7f6cd5f5e640 1 --2- 172.21.15.49:0/4201602250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6cd01024b0 0x7f6cd01a13e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8009fd0 tx=0x7f6cc800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:08.532 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.531+0000 7f6cc67fc640 1 -- 172.21.15.49:0/4201602250 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc800ce20 con 0x7f6cd01024b0 2024-06-03T00:03:08.532 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.531+0000 7f6cd79c1640 1 -- 172.21.15.49:0/4201602250 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd01a1d40 con 0x7f6cd01024b0 2024-06-03T00:03:08.532 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.531+0000 7f6cc67fc640 1 -- 172.21.15.49:0/4201602250 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cc8005020 con 0x7f6cd01024b0 2024-06-03T00:03:08.533 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.531+0000 7f6cc67fc640 1 -- 172.21.15.49:0/4201602250 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8010720 con 0x7f6cd01024b0 2024-06-03T00:03:08.533 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.531+0000 7f6cd79c1640 1 -- 172.21.15.49:0/4201602250 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd01a2230 con 0x7f6cd01024b0 2024-06-03T00:03:08.533 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.534+0000 7f6cc67fc640 1 -- 172.21.15.49:0/4201602250 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6cc8005540 con 0x7f6cd01024b0 2024-06-03T00:03:08.534 INFO:tasks.workunit.client.0.smithi049.stdout:7/534: sync 2024-06-03T00:03:08.534 INFO:tasks.workunit.client.0.smithi049.stdout:8/444: sync 2024-06-03T00:03:08.534 INFO:tasks.workunit.client.0.smithi049.stdout:4/624: sync 2024-06-03T00:03:08.534 INFO:tasks.workunit.client.0.smithi049.stdout:2/493: sync 2024-06-03T00:03:08.534 INFO:tasks.workunit.client.0.smithi049.stdout:1/725: sync 2024-06-03T00:03:08.536 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.535+0000 7f6cda7af740 1 Processor -- start 2024-06-03T00:03:08.536 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.536+0000 7f6cda7af740 1 -- start start 2024-06-03T00:03:08.537 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.536+0000 7f6cda7af740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a1c706820 0x556a1c706c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:08.537 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.536+0000 7f6cda7af740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a1c707210 0x556a1c70bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:08.537 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.536+0000 7f6cda7af740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a1c70c380 0x556a1c70e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:08.537 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.536+0000 7f6cc67fc640 1 --2- 172.21.15.49:0/4201602250 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6cbc0a2c30 0x7f6cbc0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:08.537 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.536+0000 7f6cda7af740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556a1c6614f0 con 0x556a1c707210 2024-06-03T00:03:08.537 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.536+0000 7f6cda7af740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x556a1c5ff870 con 0x556a1c706820 2024-06-03T00:03:08.537 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.536+0000 7f6cda7af740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556a1c65d4b0 con 0x556a1c70c380 2024-06-03T00:03:08.537 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.536+0000 7f6cd5f5e640 1 --2- 172.21.15.49:0/4201602250 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6cbc0a2c30 0x7f6cbc0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:08.537 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.537+0000 7f6cd4f5c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a1c706820 0x556a1c706c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:08.537 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.537+0000 7f6cd4f5c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a1c706820 0x556a1c706c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.49:41170/0 (socket says 172.21.15.49:41170) 2024-06-03T00:03:08.537 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.537+0000 7f6cd4f5c640 1 -- 172.21.15.49:0/3645726528 learned_addr learned my addr 172.21.15.49:0/3645726528 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:08.537 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.537+0000 7f6cc67fc640 1 -- 172.21.15.49:0/4201602250 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f6cc80cf750 con 0x7f6cd01024b0 2024-06-03T00:03:08.537 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.537+0000 7f6cd575d640 1 --2- 172.21.15.49:0/3645726528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a1c707210 0x556a1c70bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:08.538 INFO:tasks.workunit.client.0.smithi049.stdout:9/704: sync 2024-06-03T00:03:08.538 INFO:tasks.workunit.client.0.smithi049.stdout:5/555: write d3/d5/da/d55/d14/f90 [442565,63412] 0 2024-06-03T00:03:08.539 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.537+0000 7f6cd5f5e640 1 --2- 172.21.15.49:0/4201602250 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6cbc0a2c30 0x7f6cbc0a50f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8098410 tx=0x7f6cc80bc040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:08.539 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.537+0000 7f6cd575d640 1 -- 172.21.15.49:0/3645726528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a1c70c380 msgr2=0x556a1c70e810 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-03T00:03:08.539 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.537+0000 7f6cd575d640 1 --2- 172.21.15.49:0/3645726528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a1c70c380 0x556a1c70e810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.539 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.537+0000 7f6cd575d640 1 -- 172.21.15.49:0/3645726528 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a1c706820 msgr2=0x556a1c706c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:08.539 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.537+0000 7f6cd575d640 1 --2- 172.21.15.49:0/3645726528 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a1c706820 0x556a1c706c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.539 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.537+0000 7f6cd575d640 1 -- 172.21.15.49:0/3645726528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a1c61b9b0 con 0x556a1c707210 2024-06-03T00:03:08.539 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.538+0000 7f6cd575d640 1 --2- 172.21.15.49:0/3645726528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a1c707210 0x556a1c70bd10 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc009230 tx=0x7f6ccc005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909b9954ec733172 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:08.539 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.538+0000 7f6cbb7fe640 1 -- 172.21.15.49:0/3645726528 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc040070 con 0x556a1c707210 2024-06-03T00:03:08.540 INFO:tasks.workunit.client.0.smithi049.stdout:2/494: rename da/c57 to da/d72/d83/c9b 0 2024-06-03T00:03:08.540 INFO:tasks.workunit.client.0.smithi049.stdout:5/556: mkdir d3/d5/da/d55/d75/dad 0 2024-06-03T00:03:08.540 INFO:tasks.workunit.client.0.smithi049.stdout:5/557: truncate d3/d5/da/d55/d14/f57 1303742 0 2024-06-03T00:03:08.542 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.540+0000 7f6cbb7fe640 1 -- 172.21.15.49:0/3645726528 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ccc004030 con 0x556a1c707210 2024-06-03T00:03:08.542 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.540+0000 7f6cbb7fe640 1 -- 172.21.15.49:0/3645726528 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc035040 con 0x556a1c707210 2024-06-03T00:03:08.542 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.541+0000 7f6cda7af740 1 -- 172.21.15.49:0/3645726528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a1c707210 msgr2=0x556a1c70bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:08.542 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.541+0000 7f6cda7af740 1 --2- 172.21.15.49:0/3645726528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a1c707210 0x556a1c70bd10 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc009230 tx=0x7f6ccc005e20 comp rx=0 tx=0).stop 2024-06-03T00:03:08.542 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.541+0000 7f6cda7af740 1 -- 172.21.15.49:0/3645726528 shutdown_connections 2024-06-03T00:03:08.543 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.541+0000 7f6cda7af740 1 --2- 172.21.15.49:0/3645726528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a1c70c380 0x556a1c70e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.543 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.541+0000 7f6cda7af740 1 --2- 172.21.15.49:0/3645726528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a1c707210 0x556a1c70bd10 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.543 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.541+0000 7f6cda7af740 1 --2- 172.21.15.49:0/3645726528 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a1c706820 0x556a1c706c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.543 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.542+0000 7f6cda7af740 1 -- 172.21.15.49:0/3645726528 >> 172.21.15.49:0/3645726528 conn(0x556a1c701e90 msgr2=0x556a1c702290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:08.543 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.542+0000 7f6cda7af740 1 -- 172.21.15.49:0/3645726528 shutdown_connections 2024-06-03T00:03:08.543 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.542+0000 7f6cda7af740 1 -- 172.21.15.49:0/3645726528 wait complete. 2024-06-03T00:03:08.543 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.542+0000 7f6cda7af740 1 -- start start 2024-06-03T00:03:08.543 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.543+0000 7f6cda7af740 1 Processor -- start 2024-06-03T00:03:08.544 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.544+0000 7f6cda7af740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a1c706820 0x556a1c710a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:08.544 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.544+0000 7f6cda7af740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a1c707210 0x556a1c710f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:08.544 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.544+0000 7f6cda7af740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a1c70c380 0x556a1c717fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.545+0000 7f6cd4f5c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a1c706820 0x556a1c710a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.545+0000 7f6cd4f5c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a1c706820 0x556a1c710a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.49:41174/0 (socket says 172.21.15.49:41174) 2024-06-03T00:03:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.545+0000 7f6cd4f5c640 1 -- 172.21.15.49:0/1577830694 learned_addr learned my addr 172.21.15.49:0/1577830694 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.545+0000 7f6cda7af740 1 -- 172.21.15.49:0/1577830694 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556a1c70f2d0 con 0x556a1c70c380 2024-06-03T00:03:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.545+0000 7f6cda7af740 1 -- 172.21.15.49:0/1577830694 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x556a1c5eaae0 con 0x556a1c706820 2024-06-03T00:03:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.545+0000 7f6cda7af740 1 -- 172.21.15.49:0/1577830694 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556a1c70f450 con 0x556a1c707210 2024-06-03T00:03:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.545+0000 7f6cda7af740 10 client.0 _ll_register_callbacks cb 0x556a1c6239b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:03:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.545+0000 7f6cd4f5c640 1 --2- 172.21.15.49:0/1577830694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a1c70c380 0x556a1c717fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:08.547 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.546+0000 7f6cd575d640 1 --2- 172.21.15.49:0/1577830694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a1c707210 0x556a1c710f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:08.547 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.546+0000 7f6cd4f5c640 1 -- 172.21.15.49:0/1577830694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a1c707210 msgr2=0x556a1c710f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:08.547 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.546+0000 7f6cd4f5c640 1 --2- 172.21.15.49:0/1577830694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a1c707210 0x556a1c710f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.547 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.546+0000 7f6cd4f5c640 1 -- 172.21.15.49:0/1577830694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a1c70c380 msgr2=0x556a1c717fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:08.547 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.547+0000 7f6cd4f5c640 1 --2- 172.21.15.49:0/1577830694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a1c70c380 0x556a1c717fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.547 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.547+0000 7f6cd4f5c640 1 -- 172.21.15.49:0/1577830694 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a1c375210 con 0x556a1c706820 2024-06-03T00:03:08.547 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.547+0000 7f6cd575d640 1 --2- 172.21.15.49:0/1577830694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a1c707210 0x556a1c710f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:03:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.547+0000 7f6cd4f5c640 1 --2- 172.21.15.49:0/1577830694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a1c706820 0x556a1c710a40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0010fa0 tx=0x7f6cc0009d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9545abd5cd49248 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.547+0000 7f6cb8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2024-06-03T00:03:08.549 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.548+0000 7f6cb8ff9640 1 -- 172.21.15.49:0/1577830694 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc0019040 con 0x556a1c706820 2024-06-03T00:03:08.549 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.548+0000 7f6cb8ff9640 1 -- 172.21.15.49:0/1577830694 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f6cc0004230 con 0x556a1c706820 2024-06-03T00:03:08.549 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.548+0000 7f6cda7af740 1 -- 172.21.15.49:0/1577830694 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ccc004030 con 0x556a1c706820 2024-06-03T00:03:08.549 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.548+0000 7f6cb8ff9640 1 -- 172.21.15.49:0/1577830694 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f6cc0027050 con 0x556a1c706820 2024-06-03T00:03:08.549 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.548+0000 7f6cda7af740 10 client.25496 fetch_fsmap learned FSMap version 31 2024-06-03T00:03:08.549 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.548+0000 7f6cda7af740 1 -- 172.21.15.49:0/1577830694 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556a1c441620 con 0x556a1c706820 2024-06-03T00:03:08.550 INFO:tasks.workunit.client.0.smithi049.stdout:8/445: dread d4/d27/d3c/f2c [0,4194304] 0 2024-06-03T00:03:08.550 INFO:tasks.workunit.client.0.smithi049.stdout:8/446: read d4/d27/d3c/f2c [2355093,26975] 0 2024-06-03T00:03:08.551 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.549+0000 7f6cb8ff9640 1 -- 172.21.15.49:0/1577830694 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ccc004030 con 0x556a1c706820 2024-06-03T00:03:08.551 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.549+0000 7f6cb8ff9640 1 -- 172.21.15.49:0/1577830694 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f6cc0004a50 con 0x556a1c706820 2024-06-03T00:03:08.551 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.549+0000 7f6cda7af740 10 client.25496 fetch_fsmap finished waiting for FSMap version 31 2024-06-03T00:03:08.551 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.549+0000 7f6cda7af740 10 client.25496 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:03:08.551 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.550+0000 7f6cda7af740 20 client.25496 populate_metadata read hostname 'smithi049' 2024-06-03T00:03:08.551 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.550+0000 7f6cda7af740 1 --2- 172.21.15.49:0/1577830694 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x556a1c71c920 0x556a1c71edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:08.551 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.550+0000 7f6cda7af740 4 client.25496 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:03:08.551 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.550+0000 7f6cda7af740 1 -- 172.21.15.49:0/1577830694 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a1c674f10 con 0x556a1c71c920 2024-06-03T00:03:08.551 INFO:tasks.workunit.client.0.smithi049.stdout:7/535: dread d3/d6/d3f/f77 [0,4194304] 0 2024-06-03T00:03:08.552 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.550+0000 7f6cd575d640 1 --2- 172.21.15.49:0/1577830694 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x556a1c71c920 0x556a1c71edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:08.552 INFO:tasks.workunit.client.0.smithi049.stdout:7/536: write d3/fac [190556,26433] 0 2024-06-03T00:03:08.552 INFO:tasks.workunit.client.0.smithi049.stdout:1/726: dread d1/d2f/d78/dd7/f5a [0,4194304] 0 2024-06-03T00:03:08.553 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.552+0000 7f6cb8ff9640 10 client.25496 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:08.553 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.552+0000 7f6cd575d640 1 --2- 172.21.15.49:0/1577830694 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x556a1c71c920 0x556a1c71edc0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da7426bc9569188e server_cookie=4321c5b5aff0942 in_seq=0 out_seq=0 2024-06-03T00:03:08.555 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.554+0000 7f6cb8ff9640 1 -- 172.21.15.49:0/1577830694 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x556a1c674f10 con 0x556a1c71c920 2024-06-03T00:03:08.555 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.554+0000 7f6cb8ff9640 10 client.25496 handle_command_reply: tid=0 2024-06-03T00:03:08.555 INFO:tasks.workunit.client.0.smithi049.stdout:7/537: link d3/d6/d13/d3c/d4b/d5a/la8 d3/d6/d13/d3c/d48/d7b/d9c/dc4/lc5 0 2024-06-03T00:03:08.555 INFO:tasks.workunit.client.0.smithi049.stdout:3/421: dwrite d2/d14/d44/d52/f6a [0,4194304] 0 2024-06-03T00:03:08.556 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.554+0000 7f6cda7af740 1 client.25496 shutdown 2024-06-03T00:03:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.555+0000 7f6cda7af740 1 -- 172.21.15.49:0/1577830694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a1c706820 msgr2=0x556a1c710a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.555+0000 7f6cda7af740 1 --2- 172.21.15.49:0/1577830694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a1c706820 0x556a1c710a40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0010fa0 tx=0x7f6cc0009d00 comp rx=0 tx=0).stop 2024-06-03T00:03:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.555+0000 7f6cda7af740 1 -- 172.21.15.49:0/1577830694 shutdown_connections 2024-06-03T00:03:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.555+0000 7f6cda7af740 1 --2- 172.21.15.49:0/1577830694 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x556a1c71c920 0x556a1c71edc0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.555+0000 7f6cda7af740 1 --2- 172.21.15.49:0/1577830694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a1c70c380 0x556a1c717fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.555+0000 7f6cda7af740 1 --2- 172.21.15.49:0/1577830694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a1c707210 0x556a1c710f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.555+0000 7f6cda7af740 1 --2- 172.21.15.49:0/1577830694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a1c706820 0x556a1c710a40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.555+0000 7f6cda7af740 1 -- 172.21.15.49:0/1577830694 >> 172.21.15.49:0/1577830694 conn(0x556a1c701e90 msgr2=0x556a1c6f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.555+0000 7f6cb8ff9640 0 client.25496 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.555+0000 7f6cda7af740 1 -- 172.21.15.49:0/1577830694 shutdown_connections 2024-06-03T00:03:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.556+0000 7f6cda7af740 1 -- 172.21.15.49:0/1577830694 wait complete. 2024-06-03T00:03:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.556+0000 7f6cda7af740 20 client.25496 trim_cache size 0 max 16384 2024-06-03T00:03:08.558 INFO:tasks.workunit.client.0.smithi049.stdout:1/727: dread d1/d1a/f88 [0,4194304] 0 2024-06-03T00:03:08.564 INFO:tasks.workunit.client.0.smithi049.stdout:6/679: sync 2024-06-03T00:03:08.566 INFO:tasks.workunit.client.0.smithi049.stdout:6/680: truncate d2/d3/d9/d23/d48/d51/fc0 152659 0 2024-06-03T00:03:08.568 INFO:tasks.workunit.client.0.smithi049.stdout:7/538: dread d3/d6/d9/d91/fa0 [0,4194304] 0 2024-06-03T00:03:08.568 INFO:tasks.workunit.client.0.smithi049.stdout:7/539: chown d3/d6/d13/d3c/d48/d7b 1032646 1 2024-06-03T00:03:08.568 INFO:tasks.workunit.client.0.smithi049.stdout:6/681: getdents d2/d3/d17/d57 0 2024-06-03T00:03:08.570 INFO:tasks.workunit.client.0.smithi049.stdout:7/540: rename d3/d6/d13/d3c/d48/d7b/d9c/f67 to d3/d6/d13/d3c/d48/d7b/d5b/fc6 0 2024-06-03T00:03:08.570 INFO:tasks.workunit.client.0.smithi049.stdout:7/541: dread - d3/d6/d13/d3c/d48/d7b/d9c/f9a zero size 2024-06-03T00:03:08.570 INFO:tasks.workunit.client.0.smithi049.stdout:7/542: write d3/d6/d3f/f83 [72754,119178] 0 2024-06-03T00:03:08.572 INFO:tasks.workunit.client.0.smithi049.stdout:7/543: unlink d3/d6/d13/d3c/d48/la3 0 2024-06-03T00:03:08.572 INFO:tasks.workunit.client.0.smithi049.stdout:1/728: dread d1/d2f/f46 [4194304,4194304] 0 2024-06-03T00:03:08.572 INFO:tasks.workunit.client.0.smithi049.stdout:5/558: dwrite d3/d5/d24/f8a [0,4194304] 0 2024-06-03T00:03:08.572 INFO:tasks.workunit.client.0.smithi049.stdout:1/729: write d1/d2f/d36/d37/f22 [911148,126928] 0 2024-06-03T00:03:08.572 INFO:tasks.workunit.client.0.smithi049.stdout:1/730: fsync d1/d2f/d36/d37/d13/dc6/fcc 0 2024-06-03T00:03:08.574 INFO:tasks.workunit.client.0.smithi049.stdout:1/731: creat d1/d2f/d36/d37/d13/d34/dd0/f105 x:0 0 0 2024-06-03T00:03:08.574 INFO:tasks.workunit.client.0.smithi049.stdout:3/422: dwrite d2/d1a/f73 [0,4194304] 0 2024-06-03T00:03:08.574 INFO:tasks.workunit.client.0.smithi049.stdout:3/423: readlink d2/d14/d22/d42/d68/l81 0 2024-06-03T00:03:08.574 INFO:tasks.workunit.client.0.smithi049.stdout:6/682: dread d2/d3/d9/d23/d29/f59 [0,4194304] 0 2024-06-03T00:03:08.575 INFO:tasks.workunit.client.0.smithi049.stdout:5/559: symlink d3/d9/d20/lae 0 2024-06-03T00:03:08.575 INFO:tasks.workunit.client.0.smithi049.stdout:1/732: mknod d1/d2f/d36/d57/d72/ddf/c106 0 2024-06-03T00:03:08.575 INFO:tasks.workunit.client.0.smithi049.stdout:1/733: truncate d1/d2f/d50/d6b/fd8 864359 0 2024-06-03T00:03:08.576 INFO:tasks.workunit.client.0.smithi049.stdout:5/560: mkdir d3/daf 0 2024-06-03T00:03:08.576 INFO:tasks.workunit.client.0.smithi049.stdout:6/683: rename d2/d3/d9/c6f to d2/d3b/ce6 0 2024-06-03T00:03:08.578 INFO:tasks.workunit.client.0.smithi049.stdout:5/561: rename d3/d5/d2d/d4b/d62/c7b to d3/d5/da/d55/d75/dad/cb0 0 2024-06-03T00:03:08.580 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.580+0000 7f6cda7af740 1 Processor -- start 2024-06-03T00:03:08.580 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.580+0000 7f6cda7af740 1 -- start start 2024-06-03T00:03:08.580 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.580+0000 7f6cda7af740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a1c706820 0x556a1c705590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:08.581 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.580+0000 7f6cda7af740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a1c707210 0x556a1c717f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:08.581 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.580+0000 7f6cda7af740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a1c70c380 0x556a1c710650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:08.581 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.580+0000 7f6cda7af740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd01a6c30 con 0x556a1c706820 2024-06-03T00:03:08.581 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.580+0000 7f6cda7af740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd01a8830 con 0x556a1c707210 2024-06-03T00:03:08.581 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.580+0000 7f6cda7af740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd01a7300 con 0x556a1c70c380 2024-06-03T00:03:08.581 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.580+0000 7f6cd4f5c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a1c706820 0x556a1c705590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:08.581 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.580+0000 7f6cd4f5c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a1c706820 0x556a1c705590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44668/0 (socket says 172.21.15.49:44668) 2024-06-03T00:03:08.581 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.580+0000 7f6cd4f5c640 1 -- 172.21.15.49:0/3526741356 learned_addr learned my addr 172.21.15.49:0/3526741356 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:08.581 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.581+0000 7f6cd4f5c640 1 -- 172.21.15.49:0/3526741356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a1c70c380 msgr2=0x556a1c710650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:08.581 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.581+0000 7f6cd4f5c640 1 --2- 172.21.15.49:0/3526741356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a1c70c380 0x556a1c710650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.581 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.581+0000 7f6cd4f5c640 1 -- 172.21.15.49:0/3526741356 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a1c707210 msgr2=0x556a1c717f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:08.581 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.581+0000 7f6cd4f5c640 1 --2- 172.21.15.49:0/3526741356 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a1c707210 0x556a1c717f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.581 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.581+0000 7f6cd4f5c640 1 -- 172.21.15.49:0/3526741356 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a1c6f50f0 con 0x556a1c706820 2024-06-03T00:03:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.581+0000 7f6cd4f5c640 1 --2- 172.21.15.49:0/3526741356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a1c706820 0x556a1c705590 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0004ea0 tx=0x7f6cc0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88c5118460f035b server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.581+0000 7f6cbaffd640 1 -- 172.21.15.49:0/3526741356 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc000fe20 con 0x556a1c706820 2024-06-03T00:03:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.581+0000 7f6cbaffd640 1 -- 172.21.15.49:0/3526741356 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cc0030020 con 0x556a1c706820 2024-06-03T00:03:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.581+0000 7f6cbaffd640 1 -- 172.21.15.49:0/3526741356 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc0005450 con 0x556a1c706820 2024-06-03T00:03:08.583 INFO:tasks.workunit.client.0.smithi049.stdout:9/705: dwrite d1/d5/d13/d3b/d7f/dbc/f74 [0,4194304] 0 2024-06-03T00:03:08.583 INFO:tasks.workunit.client.0.smithi049.stdout:9/706: write d1/d5/d1a/fbe [364068,121302] 0 2024-06-03T00:03:08.583 INFO:tasks.workunit.client.0.smithi049.stdout:9/707: truncate d1/d5/d13/ddd/d87/fa7 166555 0 2024-06-03T00:03:08.584 INFO:tasks.workunit.client.0.smithi049.stdout:9/708: truncate d1/da/d54/fcc 951239 0 2024-06-03T00:03:08.584 INFO:tasks.workunit.client.0.smithi049.stdout:6/684: rename d2/fb8 to d2/d3/d9/d23/d29/fe7 0 2024-06-03T00:03:08.584 INFO:tasks.workunit.client.0.smithi049.stdout:6/685: stat d2/d3/d9/l7f 0 2024-06-03T00:03:08.584 INFO:tasks.workunit.client.0.smithi049.stdout:8/447: dwrite d4/d27/d3c/d88/d28/d52/d66/f5a [0,4194304] 0 2024-06-03T00:03:08.584 INFO:tasks.workunit.client.0.smithi049.stdout:2/495: dwrite da/d52/d40/f8a [0,4194304] 0 2024-06-03T00:03:08.585 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.582+0000 7f6cda7af740 1 -- 172.21.15.49:0/3526741356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a1c706820 msgr2=0x556a1c705590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:08.585 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.582+0000 7f6cda7af740 1 --2- 172.21.15.49:0/3526741356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a1c706820 0x556a1c705590 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0004ea0 tx=0x7f6cc0005fd0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.585 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.583+0000 7f6cda7af740 1 -- 172.21.15.49:0/3526741356 shutdown_connections 2024-06-03T00:03:08.585 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.583+0000 7f6cda7af740 1 --2- 172.21.15.49:0/3526741356 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a1c707210 0x556a1c717f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.583+0000 7f6cda7af740 1 --2- 172.21.15.49:0/3526741356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a1c70c380 0x556a1c710650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.583+0000 7f6cda7af740 1 --2- 172.21.15.49:0/3526741356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a1c706820 0x556a1c705590 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.583+0000 7f6cda7af740 1 -- 172.21.15.49:0/3526741356 >> 172.21.15.49:0/3526741356 conn(0x556a1c701e90 msgr2=0x556a1c704e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.583+0000 7f6cda7af740 1 -- 172.21.15.49:0/3526741356 shutdown_connections 2024-06-03T00:03:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.583+0000 7f6cda7af740 1 -- 172.21.15.49:0/3526741356 wait complete. 2024-06-03T00:03:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.583+0000 7f6cda7af740 1 -- start start 2024-06-03T00:03:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.583+0000 7f6cda7af740 1 Processor -- start 2024-06-03T00:03:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.584+0000 7f6cda7af740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a1c707210 0x556a1c715750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.584+0000 7f6cda7af740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a1c70c380 0x556a1c715c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.584+0000 7f6cda7af740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a1c716c50 0x556a1c7170d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.584+0000 7f6cda7af740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd01a80a0 con 0x556a1c716c50 2024-06-03T00:03:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.584+0000 7f6cda7af740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd01a79d0 con 0x556a1c707210 2024-06-03T00:03:08.587 INFO:tasks.workunit.client.0.smithi049.stdout:9/709: creat d1/da/da8/d50/d70/ff2 x:0 0 0 2024-06-03T00:03:08.587 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.585+0000 7f6cd4f5c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a1c716c50 0x556a1c7170d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.585+0000 7f6cd4f5c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a1c716c50 0x556a1c7170d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44680/0 (socket says 172.21.15.49:44680) 2024-06-03T00:03:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.585+0000 7f6cd4f5c640 1 -- 172.21.15.49:0/2716241582 learned_addr learned my addr 172.21.15.49:0/2716241582 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.585+0000 7f6cda7af740 1 -- 172.21.15.49:0/2716241582 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd01a4bf0 con 0x556a1c70c380 2024-06-03T00:03:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.585+0000 7f6cda7af740 10 client.0 _ll_register_callbacks cb 0x7f6cc0010490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:03:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.586+0000 7f6cd575d640 1 --2- 172.21.15.49:0/2716241582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a1c70c380 0x556a1c715c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.586+0000 7f6cd4f5c640 1 --2- 172.21.15.49:0/2716241582 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a1c707210 0x556a1c715750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.586+0000 7f6cd4f5c640 1 -- 172.21.15.49:0/2716241582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a1c70c380 msgr2=0x556a1c715c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.586+0000 7f6cd4f5c640 1 --2- 172.21.15.49:0/2716241582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a1c70c380 0x556a1c715c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.586+0000 7f6cd4f5c640 1 -- 172.21.15.49:0/2716241582 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a1c707210 msgr2=0x556a1c715750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.586+0000 7f6cd4f5c640 1 --2- 172.21.15.49:0/2716241582 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a1c707210 0x556a1c715750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.586+0000 7f6cd4f5c640 1 -- 172.21.15.49:0/2716241582 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a1c70fe60 con 0x556a1c716c50 2024-06-03T00:03:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.586+0000 7f6cd4f5c640 1 --2- 172.21.15.49:0/2716241582 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a1c716c50 0x556a1c7170d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0004ef0 tx=0x7f6cc0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1205f0b640170c4 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:08.589 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.586+0000 7f6cb8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:03:08.589 INFO:tasks.workunit.client.0.smithi049.stdout:2/496: symlink da/d72/l9c 0 2024-06-03T00:03:08.589 INFO:tasks.workunit.client.0.smithi049.stdout:7/544: write d3/d6/d13/d54/f4d [393967,40850] 0 2024-06-03T00:03:08.590 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.587+0000 7f6cb8ff9640 1 -- 172.21.15.49:0/2716241582 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc002f070 con 0x556a1c716c50 2024-06-03T00:03:08.590 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.587+0000 7f6cb8ff9640 1 -- 172.21.15.49:0/2716241582 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f6cc00053d0 con 0x556a1c716c50 2024-06-03T00:03:08.590 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.587+0000 7f6cda7af740 1 -- 172.21.15.49:0/2716241582 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cc0030020 con 0x556a1c716c50 2024-06-03T00:03:08.590 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.588+0000 7f6cb8ff9640 1 -- 172.21.15.49:0/2716241582 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f6cc000eaf0 con 0x556a1c716c50 2024-06-03T00:03:08.590 INFO:tasks.workunit.client.0.smithi049.stdout:9/710: mkdir d1/d5/d13/ddd/df3 0 2024-06-03T00:03:08.590 INFO:tasks.workunit.client.0.smithi049.stdout:9/711: truncate d1/d5/d13/d3b/d49/fc7 149985 0 2024-06-03T00:03:08.590 INFO:tasks.workunit.client.0.smithi049.stdout:3/424: dread d2/d14/d22/d42/f38 [0,4194304] 0 2024-06-03T00:03:08.590 INFO:tasks.workunit.client.0.smithi049.stdout:3/425: chown d2/d14/d22/d3a/d47/f72 423286606 1 2024-06-03T00:03:08.590 INFO:tasks.workunit.client.0.smithi049.stdout:3/426: chown d2/d14/d44/d52/d4c 30177 1 2024-06-03T00:03:08.591 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.588+0000 7f6cda7af740 10 client.15972 fetch_fsmap learned FSMap version 31 2024-06-03T00:03:08.591 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.588+0000 7f6cda7af740 1 -- 172.21.15.49:0/2716241582 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556a1c7878e0 con 0x556a1c716c50 2024-06-03T00:03:08.591 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.589+0000 7f6cb8ff9640 1 -- 172.21.15.49:0/2716241582 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cc0030020 con 0x556a1c716c50 2024-06-03T00:03:08.591 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.589+0000 7f6cb8ff9640 1 -- 172.21.15.49:0/2716241582 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f6cc0035460 con 0x556a1c716c50 2024-06-03T00:03:08.591 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.589+0000 7f6cda7af740 10 client.15972 fetch_fsmap finished waiting for FSMap version 31 2024-06-03T00:03:08.592 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.589+0000 7f6cda7af740 10 client.15972 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:03:08.592 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.589+0000 7f6cda7af740 20 client.15972 populate_metadata read hostname 'smithi049' 2024-06-03T00:03:08.592 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.589+0000 7f6cda7af740 1 --2- 172.21.15.49:0/2716241582 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x556a1c788170 0x556a1c78a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:08.592 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.589+0000 7f6cda7af740 4 client.15972 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-03T00:03:08.592 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.589+0000 7f6cda7af740 1 -- 172.21.15.49:0/2716241582 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556a1c66ec20 con 0x556a1c788170 2024-06-03T00:03:08.592 INFO:tasks.workunit.client.0.smithi049.stdout:2/497: link da/d52/df/d3c/d60/l77 da/d72/d83/l9d 0 2024-06-03T00:03:08.592 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.589+0000 7f6cd575d640 1 --2- 172.21.15.49:0/2716241582 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x556a1c788170 0x556a1c78a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:08.593 INFO:tasks.workunit.client.0.smithi049.stdout:3/427: symlink d2/d14/d44/d52/d4c/d4b/d58/l8c 0 2024-06-03T00:03:08.593 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.590+0000 7f6cd575d640 1 --2- 172.21.15.49:0/2716241582 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x556a1c788170 0x556a1c78a590 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fe1f222d6395011 server_cookie=71778f36fada4788 in_seq=0 out_seq=0 2024-06-03T00:03:08.593 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.590+0000 7f6cb8ff9640 10 client.15972 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:08.593 INFO:tasks.workunit.client.0.smithi049.stdout:2/498: mkdir da/d52/d9e 0 2024-06-03T00:03:08.594 INFO:tasks.workunit.client.0.smithi049.stdout:3/428: rename d2/d14/d22/f7c to d2/d14/d44/d52/d4c/d4b/d58/f8d 0 2024-06-03T00:03:08.595 INFO:tasks.workunit.client.0.smithi049.stdout:2/499: write da/d52/df/d3c/f66 [348899,53943] 0 2024-06-03T00:03:08.595 INFO:tasks.workunit.client.0.smithi049.stdout:1/734: dwrite d1/d2f/d36/d37/d13/d71/ffd [0,4194304] 0 2024-06-03T00:03:08.597 INFO:tasks.workunit.client.0.smithi049.stdout:3/429: symlink d2/d1a/d51/d83/l8e 0 2024-06-03T00:03:08.597 INFO:tasks.workunit.client.0.smithi049.stdout:3/430: fsync d2/d14/f70 0 2024-06-03T00:03:08.597 INFO:tasks.workunit.client.0.smithi049.stdout:3/431: write d2/d1a/d51/d64/f71 [484584,93411] 0 2024-06-03T00:03:08.597 INFO:tasks.workunit.client.0.smithi049.stdout:1/735: creat d1/d2f/d36/d57/da1/f107 x:0 0 0 2024-06-03T00:03:08.599 INFO:tasks.workunit.client.0.smithi049.stdout:3/432: mkdir d2/d14/d22/d42/d8f 0 2024-06-03T00:03:08.599 INFO:tasks.workunit.client.0.smithi049.stdout:3/433: getdents d2/d14/d22/d3a/d47/d79 0 2024-06-03T00:03:08.599 INFO:tasks.workunit.client.0.smithi049.stdout:9/712: write d1/da/d27/f3c [1748549,121416] 0 2024-06-03T00:03:08.599 INFO:tasks.workunit.client.0.smithi049.stdout:9/713: write d1/da/d54/d5b/d61/fc4 [797605,71862] 0 2024-06-03T00:03:08.600 INFO:tasks.workunit.client.0.smithi049.stdout:9/714: chown d1/da/dbf 980 1 2024-06-03T00:03:08.600 INFO:tasks.workunit.client.0.smithi049.stdout:9/715: read d1/d5/d13/d3b/f48 [611443,115883] 0 2024-06-03T00:03:08.600 INFO:tasks.workunit.client.0.smithi049.stdout:2/500: unlink da/d52/d37/d59/f5c 0 2024-06-03T00:03:08.600 INFO:tasks.workunit.client.0.smithi049.stdout:2/501: truncate da/f85 1107062 0 2024-06-03T00:03:08.601 INFO:tasks.workunit.client.0.smithi049.stdout:3/434: mknod d2/d1a/d51/c90 0 2024-06-03T00:03:08.601 INFO:tasks.workunit.client.0.smithi049.stdout:3/435: readlink d2/d14/d22/d3a/l57 0 2024-06-03T00:03:08.601 INFO:tasks.workunit.client.0.smithi049.stdout:3/436: stat d2/d14/d44/d52/d4c/d4b/d58/l8c 0 2024-06-03T00:03:08.601 INFO:tasks.workunit.client.0.smithi049.stdout:1/736: symlink d1/d2f/d36/d37/d13/d34/dd0/de2/l108 0 2024-06-03T00:03:08.601 INFO:tasks.workunit.client.0.smithi049.stdout:8/448: dread d4/d27/d3c/f38 [0,4194304] 0 2024-06-03T00:03:08.601 INFO:tasks.workunit.client.0.smithi049.stdout:8/449: dread - d4/d27/d3c/d88/d28/d52/d66/d53/f82 zero size 2024-06-03T00:03:08.601 INFO:tasks.workunit.client.0.smithi049.stdout:8/450: readlink d4/d27/d3c/d88/d28/d2b/l68 0 2024-06-03T00:03:08.601 INFO:tasks.workunit.client.0.smithi049.stdout:3/437: creat d2/d1a/d31/f91 x:0 0 0 2024-06-03T00:03:08.603 INFO:tasks.workunit.client.0.smithi049.stdout:3/438: creat d2/d14/d22/d3a/d47/f92 x:0 0 0 2024-06-03T00:03:08.603 INFO:tasks.workunit.client.0.smithi049.stdout:3/439: chown d2/d1a/d31/c88 2057 1 2024-06-03T00:03:08.603 INFO:tasks.workunit.client.0.smithi049.stdout:9/716: symlink d1/da/da8/d50/d70/lf4 0 2024-06-03T00:03:08.603 INFO:tasks.workunit.client.0.smithi049.stdout:9/717: write d1/d5/d1a/f51 [3069922,54440] 0 2024-06-03T00:03:08.604 INFO:tasks.workunit.client.0.smithi049.stdout:2/502: mkdir da/d72/d83/d9f 0 2024-06-03T00:03:08.605 INFO:tasks.workunit.client.0.smithi049.stdout:1/737: unlink d1/d2f/d50/d6b/f9a 0 2024-06-03T00:03:08.607 INFO:tasks.workunit.client.0.smithi049.stdout:1/738: rename d1/d2f/d50/d6b/fd8 to d1/d2f/d36/d37/d2c/d45/d61/f109 0 2024-06-03T00:03:08.609 INFO:tasks.workunit.client.0.smithi049.stdout:1/739: read d1/f4f [97118,121368] 0 2024-06-03T00:03:08.610 INFO:tasks.workunit.client.0.smithi049.stdout:1/740: rmdir d1/d2f/d36/d37/d13/d34/d5f 39 2024-06-03T00:03:08.612 INFO:tasks.workunit.client.0.smithi049.stdout:6/686: dwrite d2/d3/d17/f77 [0,4194304] 0 2024-06-03T00:03:08.612 INFO:tasks.workunit.client.0.smithi049.stdout:1/741: rename d1/d2f/d36/d37/d13/d71/l77 to d1/d2f/d36/d37/d13/d34/d8f/l10a 0 2024-06-03T00:03:08.612 INFO:tasks.workunit.client.0.smithi049.stdout:1/742: dread - d1/d2f/d36/d57/ffc zero size 2024-06-03T00:03:08.612 INFO:tasks.workunit.client.0.smithi049.stdout:1/743: readlink d1/d2f/d36/d37/d2c/lb0 0 2024-06-03T00:03:08.613 INFO:tasks.workunit.client.0.smithi049.stdout:1/744: symlink d1/d2f/d36/d37/d2c/d45/d83/l10b 0 2024-06-03T00:03:08.614 INFO:tasks.workunit.client.0.smithi049.stdout:1/745: read d1/d2f/d50/fce [52221,36266] 0 2024-06-03T00:03:08.614 INFO:tasks.workunit.client.0.smithi049.stdout:5/562: dwrite f1 [0,4194304] 0 2024-06-03T00:03:08.614 INFO:tasks.workunit.client.0.smithi049.stdout:5/563: chown d3/d5/da/d55/d75/dad 1 1 2024-06-03T00:03:08.615 INFO:tasks.workunit.client.0.smithi049.stdout:6/687: creat d2/d4d/fe8 x:0 0 0 2024-06-03T00:03:08.615 INFO:tasks.workunit.client.0.smithi049.stdout:1/746: link d1/d2f/d36/d37/d2c/d45/l62 d1/d2f/df7/l10c 0 2024-06-03T00:03:08.617 INFO:tasks.workunit.client.0.smithi049.stdout:5/564: mknod d3/d5/d24/cb1 0 2024-06-03T00:03:08.619 INFO:tasks.workunit.client.0.smithi049.stdout:2/503: write da/d52/d37/d70/f71 [8103814,59560] 0 2024-06-03T00:03:08.619 INFO:tasks.workunit.client.0.smithi049.stdout:2/504: stat da/c20 0 2024-06-03T00:03:08.619 INFO:tasks.workunit.client.0.smithi049.stdout:7/545: dwrite d3/d6/d13/d3c/d4b/f9b [0,4194304] 0 2024-06-03T00:03:08.619 INFO:tasks.workunit.client.0.smithi049.stdout:5/565: creat d3/d7d/fb2 x:0 0 0 2024-06-03T00:03:08.619 INFO:tasks.workunit.client.0.smithi049.stdout:5/566: chown d3/d5/da/d55/l4e 26 1 2024-06-03T00:03:08.620 INFO:tasks.workunit.client.0.smithi049.stdout:8/451: dwrite d4/d27/d3c/d88/f13 [4194304,4194304] 0 2024-06-03T00:03:08.622 INFO:tasks.workunit.client.0.smithi049.stdout:6/688: rename d2/d3/d9/d23/d36 to d2/d3/d17/d57/d6e/d88/dde/de9 0 2024-06-03T00:03:08.622 INFO:tasks.workunit.client.0.smithi049.stdout:8/452: creat d4/d27/d3c/d88/f91 x:0 0 0 2024-06-03T00:03:08.622 INFO:tasks.workunit.client.0.smithi049.stdout:8/453: fsync d4/d27/d3c/d88/d28/f36 0 2024-06-03T00:03:08.623 INFO:tasks.workunit.client.0.smithi049.stdout:8/454: fdatasync d4/d27/d3c/d88/f91 0 2024-06-03T00:03:08.623 INFO:tasks.workunit.client.0.smithi049.stdout:8/455: fdatasync d4/d27/d3c/d88/d48/f5d 0 2024-06-03T00:03:08.625 INFO:tasks.workunit.client.0.smithi049.stdout:8/456: creat d4/d27/d3c/d88/d28/d45/f92 x:0 0 0 2024-06-03T00:03:08.625 INFO:tasks.workunit.client.0.smithi049.stdout:8/457: write d4/d27/d3c/d88/f2a [824229,5082] 0 2024-06-03T00:03:08.625 INFO:tasks.workunit.client.0.smithi049.stdout:8/458: chown d4/d27/d3c/d88/f11 17 1 2024-06-03T00:03:08.625 INFO:tasks.workunit.client.0.smithi049.stdout:8/459: dread - d4/d27/d3c/d88/d28/d52/d66/d53/d7e/f64 zero size 2024-06-03T00:03:08.625 INFO:tasks.workunit.client.0.smithi049.stdout:8/460: fdatasync d4/d27/d3c/f38 0 2024-06-03T00:03:08.625 INFO:tasks.workunit.client.0.smithi049.stdout:7/546: creat d3/d6/d13/d3c/fc7 x:0 0 0 2024-06-03T00:03:08.625 INFO:tasks.workunit.client.0.smithi049.stdout:6/689: dread d2/d3/d9/fcb [0,4194304] 0 2024-06-03T00:03:08.625 INFO:tasks.workunit.client.0.smithi049.stdout:2/505: rename da/d52/f13 to da/d52/df/d3c/d9a/fa0 0 2024-06-03T00:03:08.627 INFO:tasks.workunit.client.0.smithi049.stdout:2/506: creat da/d52/d40/d93/fa1 x:0 0 0 2024-06-03T00:03:08.627 INFO:tasks.workunit.client.0.smithi049.stdout:8/461: rename d4/d27/l5f to d4/d27/d3c/d88/d28/d52/d66/d53/d6c/l93 0 2024-06-03T00:03:08.627 INFO:tasks.workunit.client.0.smithi049.stdout:8/462: stat d4/d27/d3c/f2f 0 2024-06-03T00:03:08.634 INFO:tasks.workunit.client.0.smithi049.stdout:5/567: read d3/d5/da/f50 [541479,113628] 0 2024-06-03T00:03:08.635 INFO:tasks.workunit.client.0.smithi049.stdout:9/718: dwrite d1/d5/d13/d3b/d7f/dbc/f98 [0,4194304] 0 2024-06-03T00:03:08.635 INFO:tasks.workunit.client.0.smithi049.stdout:2/507: fsync da/f85 0 2024-06-03T00:03:08.635 INFO:tasks.workunit.client.0.smithi049.stdout:2/508: dread - da/d52/d40/d93/fa1 zero size 2024-06-03T00:03:08.635 INFO:tasks.workunit.client.0.smithi049.stdout:3/440: dwrite d2/f8b [0,4194304] 0 2024-06-03T00:03:08.635 INFO:tasks.workunit.client.0.smithi049.stdout:5/568: creat d3/d5/d9a/fb3 x:0 0 0 2024-06-03T00:03:08.636 INFO:tasks.workunit.client.0.smithi049.stdout:1/747: dwrite d1/d2f/d36/d37/d64/d6c/d8c/f97 [0,4194304] 0 2024-06-03T00:03:08.637 INFO:tasks.workunit.client.0.smithi049.stdout:9/719: mknod d1/d5/d13/ddd/df3/cf5 0 2024-06-03T00:03:08.637 INFO:tasks.workunit.client.0.smithi049.stdout:9/720: fsync d1/da/da8/f34 0 2024-06-03T00:03:08.640 INFO:tasks.workunit.client.0.smithi049.stdout:3/441: dread d2/f39 [0,4194304] 0 2024-06-03T00:03:08.642 INFO:tasks.workunit.client.0.smithi049.stdout:5/569: creat d3/d9/d20/d4c/d5a/d6f/fb4 x:0 0 0 2024-06-03T00:03:08.642 INFO:tasks.workunit.client.0.smithi049.stdout:5/570: dread - d3/d5/da/d55/d14/fa7 zero size 2024-06-03T00:03:08.643 INFO:tasks.workunit.client.0.smithi049.stdout:7/547: dwrite d3/d6/d13/d54/f10 [0,4194304] 0 2024-06-03T00:03:08.643 INFO:tasks.workunit.client.0.smithi049.stdout:7/548: chown d3/d32/f80 430 1 2024-06-03T00:03:08.643 INFO:tasks.workunit.client.0.smithi049.stdout:7/549: readlink d3/d6/d13/d3c/d48/l85 0 2024-06-03T00:03:08.643 INFO:tasks.workunit.client.0.smithi049.stdout:7/550: stat d3/d32 0 2024-06-03T00:03:08.644 INFO:tasks.workunit.client.0.smithi049.stdout:3/442: mknod d2/d14/d22/d3a/d47/d79/c93 0 2024-06-03T00:03:08.644 INFO:tasks.workunit.client.0.smithi049.stdout:3/443: fsync d2/f8b 0 2024-06-03T00:03:08.644 INFO:tasks.workunit.client.0.smithi049.stdout:3/444: read - d2/d1a/d34/f62 zero size 2024-06-03T00:03:08.645 INFO:tasks.workunit.client.0.smithi049.stdout:9/721: read d1/da/d26/f5c [597026,118695] 0 2024-06-03T00:03:08.645 INFO:tasks.workunit.client.0.smithi049.stdout:5/571: stat d3/d5/da/d55/d75/l79 0 2024-06-03T00:03:08.647 INFO:tasks.workunit.client.0.smithi049.stdout:3/445: truncate d2/f39 2310670 0 2024-06-03T00:03:08.649 INFO:tasks.workunit.client.0.smithi049.stdout:5/572: unlink d3/c56 0 2024-06-03T00:03:08.649 INFO:tasks.workunit.client.0.smithi049.stdout:5/573: dread - d3/d9/d20/d4c/d5a/d6f/fb4 zero size 2024-06-03T00:03:08.649 INFO:tasks.workunit.client.0.smithi049.stdout:1/748: mknod d1/d2f/d36/d37/d2c/d45/d61/c10d 0 2024-06-03T00:03:08.650 INFO:tasks.workunit.client.0.smithi049.stdout:3/446: mkdir d2/d1a/d31/d75/d94 0 2024-06-03T00:03:08.650 INFO:tasks.workunit.client.0.smithi049.stdout:3/447: write d2/d1a/d34/f48 [191713,47028] 0 2024-06-03T00:03:08.651 INFO:tasks.workunit.client.0.smithi049.stdout:2/509: truncate f6 2080103 0 2024-06-03T00:03:08.651 INFO:tasks.workunit.client.0.smithi049.stdout:5/574: creat d3/d53/d9c/da4/fb5 x:0 0 0 2024-06-03T00:03:08.652 INFO:tasks.workunit.client.0.smithi049.stdout:3/448: mkdir d2/d1a/d76/d95 0 2024-06-03T00:03:08.652 INFO:tasks.workunit.client.0.smithi049.stdout:3/449: chown d2/d1a/d34/f48 1698906 1 2024-06-03T00:03:08.652 INFO:tasks.workunit.client.0.smithi049.stdout:3/450: fdatasync d2/d14/f54 0 2024-06-03T00:03:08.653 INFO:tasks.workunit.client.0.smithi049.stdout:9/722: rename d1/fb to d1/da/da8/d50/ff6 0 2024-06-03T00:03:08.653 INFO:tasks.workunit.client.0.smithi049.stdout:9/723: fsync d1/faf 0 2024-06-03T00:03:08.654 INFO:tasks.workunit.client.0.smithi049.stdout:5/575: link d3/d5/da/d55/d14/f2a d3/d5/d2d/d4b/d97/fb6 0 2024-06-03T00:03:08.654 INFO:tasks.workunit.client.0.smithi049.stdout:5/576: fdatasync f1 0 2024-06-03T00:03:08.655 INFO:tasks.workunit.client.0.smithi049.stdout:1/749: creat d1/d2f/d36/d37/d13/d34/d8f/d94/f10e x:0 0 0 2024-06-03T00:03:08.656 INFO:tasks.workunit.client.0.smithi049.stdout:3/451: symlink d2/d1a/d31/d75/d94/l96 0 2024-06-03T00:03:08.657 INFO:tasks.workunit.client.0.smithi049.stdout:2/510: unlink da/d52/d40/d93/fa1 0 2024-06-03T00:03:08.659 INFO:tasks.workunit.client.0.smithi049.stdout:9/724: creat d1/da/da8/d5f/d81/da0/ff7 x:0 0 0 2024-06-03T00:03:08.660 INFO:tasks.workunit.client.0.smithi049.stdout:3/452: creat d2/d14/d44/d52/d4c/f97 x:0 0 0 2024-06-03T00:03:08.661 INFO:tasks.workunit.client.0.smithi049.stdout:2/511: mknod da/d55/ca2 0 2024-06-03T00:03:08.661 INFO:tasks.workunit.client.0.smithi049.stdout:2/512: fsync da/d52/d37/d70/f71 0 2024-06-03T00:03:08.662 INFO:tasks.workunit.client.0.smithi049.stdout:3/453: rename d2/d1a/d51/d64 to d2/d14/d44/d52/d4c/d4b/d98 0 2024-06-03T00:03:08.663 INFO:tasks.workunit.client.0.smithi049.stdout:9/725: truncate d1/d5/f6c 4162264 0 2024-06-03T00:03:08.663 INFO:tasks.workunit.client.0.smithi049.stdout:3/454: creat d2/d1a/d76/f99 x:0 0 0 2024-06-03T00:03:08.664 INFO:tasks.workunit.client.0.smithi049.stdout:7/551: dwrite d3/d6/d13/d54/f10 [4194304,4194304] 0 2024-06-03T00:03:08.664 INFO:tasks.workunit.client.0.smithi049.stdout:2/513: mknod da/d72/d83/d9f/ca3 0 2024-06-03T00:03:08.664 INFO:tasks.workunit.client.0.smithi049.stdout:3/455: creat d2/d14/d22/f9a x:0 0 0 2024-06-03T00:03:08.667 INFO:tasks.workunit.client.0.smithi049.stdout:3/456: mkdir d2/d1a/d76/d9b 0 2024-06-03T00:03:08.667 INFO:tasks.workunit.client.0.smithi049.stdout:2/514: dread da/d52/f6f [0,4194304] 0 2024-06-03T00:03:08.669 INFO:tasks.workunit.client.0.smithi049.stdout:7/552: mkdir d3/d6/d13/d3c/d48/d7b/d9c/dc8 0 2024-06-03T00:03:08.669 INFO:tasks.workunit.client.0.smithi049.stdout:9/726: symlink d1/d5/d13/ddd/lf8 0 2024-06-03T00:03:08.669 INFO:tasks.workunit.client.0.smithi049.stdout:7/553: write d3/d6/d13/d4a/fa2 [779855,72856] 0 2024-06-03T00:03:08.669 INFO:tasks.workunit.client.0.smithi049.stdout:9/727: write d1/d5/d13/ddd/d87/fb1 [723446,99063] 0 2024-06-03T00:03:08.669 INFO:tasks.workunit.client.0.smithi049.stdout:3/457: creat d2/d1a/d51/f9c x:0 0 0 2024-06-03T00:03:08.669 INFO:tasks.workunit.client.0.smithi049.stdout:5/577: dread d3/d5/d9a/f9b [0,4194304] 0 2024-06-03T00:03:08.670 INFO:tasks.workunit.client.0.smithi049.stdout:7/554: mknod d3/d6/d13/d54/daa/cc9 0 2024-06-03T00:03:08.671 INFO:tasks.workunit.client.0.smithi049.stdout:7/555: creat d3/d6/d13/d3c/d48/d7b/d5b/fca x:0 0 0 2024-06-03T00:03:08.671 INFO:tasks.workunit.client.0.smithi049.stdout:3/458: dread d2/d14/d22/d3a/d47/f72 [0,4194304] 0 2024-06-03T00:03:08.671 INFO:tasks.workunit.client.0.smithi049.stdout:3/459: fdatasync d2/d1a/d34/f5e 0 2024-06-03T00:03:08.671 INFO:tasks.workunit.client.0.smithi049.stdout:1/750: dwrite d1/d1a/f88 [0,4194304] 0 2024-06-03T00:03:08.671 INFO:tasks.workunit.client.0.smithi049.stdout:2/515: creat da/d52/d37/fa4 x:0 0 0 2024-06-03T00:03:08.672 INFO:tasks.workunit.client.0.smithi049.stdout:7/556: rename d3/lc0 to d3/d14/d6e/lcb 0 2024-06-03T00:03:08.673 INFO:tasks.workunit.client.0.smithi049.stdout:9/728: symlink d1/da/d54/lf9 0 2024-06-03T00:03:08.674 INFO:tasks.workunit.client.0.smithi049.stdout:7/557: dread d3/d6/d9/f2b [0,4194304] 0 2024-06-03T00:03:08.674 INFO:tasks.workunit.client.0.smithi049.stdout:7/558: getdents d3/d6/d86/d90/dae 0 2024-06-03T00:03:08.675 INFO:tasks.workunit.client.0.smithi049.stdout:5/578: creat d3/d5/d9a/fb7 x:0 0 0 2024-06-03T00:03:08.675 INFO:tasks.workunit.client.0.smithi049.stdout:7/559: symlink d3/d6/d13/d54/daa/lcc 0 2024-06-03T00:03:08.676 INFO:tasks.workunit.client.0.smithi049.stdout:1/751: symlink d1/d2f/d36/d37/d2c/d102/l10f 0 2024-06-03T00:03:08.677 INFO:tasks.workunit.client.0.smithi049.stdout:7/560: link d3/d6/d13/d3c/d4b/d5a/la8 d3/d6/d13/d54/daa/lcd 0 2024-06-03T00:03:08.677 INFO:tasks.workunit.client.0.smithi049.stdout:1/752: read d1/d2f/d36/d37/d2c/d45/d61/d70/f85 [203892,93997] 0 2024-06-03T00:03:08.677 INFO:tasks.workunit.client.0.smithi049.stdout:3/460: symlink d2/d14/d22/d42/l9d 0 2024-06-03T00:03:08.678 INFO:tasks.workunit.client.0.smithi049.stdout:2/516: creat da/d52/d37/d59/d80/fa5 x:0 0 0 2024-06-03T00:03:08.678 INFO:tasks.workunit.client.0.smithi049.stdout:7/561: creat d3/d6/d13/d3c/d48/d7b/d9c/dc4/fce x:0 0 0 2024-06-03T00:03:08.680 INFO:tasks.workunit.client.0.smithi049.stdout:3/461: mkdir d2/d1a/d31/d75/d94/d9e 0 2024-06-03T00:03:08.680 INFO:tasks.workunit.client.0.smithi049.stdout:3/462: readlink d2/d14/d22/l3c 0 2024-06-03T00:03:08.681 INFO:tasks.workunit.client.0.smithi049.stdout:1/753: unlink d1/d2f/d36/d37/d13/d34/d6e/fdb 0 2024-06-03T00:03:08.681 INFO:tasks.workunit.client.0.smithi049.stdout:3/463: mknod d2/d1a/d31/c9f 0 2024-06-03T00:03:08.683 INFO:tasks.workunit.client.0.smithi049.stdout:3/464: rmdir d2/d14/d44/d52 39 2024-06-03T00:03:08.685 INFO:tasks.workunit.client.0.smithi049.stdout:3/465: write d2/f4 [325158,49241] 0 2024-06-03T00:03:08.688 INFO:tasks.workunit.client.0.smithi049.stdout:3/466: mkdir d2/d1a/d76/d9b/da0 0 2024-06-03T00:03:08.692 INFO:tasks.workunit.client.0.smithi049.stdout:3/467: symlink d2/la1 0 2024-06-03T00:03:08.694 INFO:tasks.workunit.client.0.smithi049.stdout:3/468: mkdir d2/d14/d44/d52/d4c/d4b/d98/da2 0 2024-06-03T00:03:08.697 INFO:tasks.workunit.client.0.smithi049.stdout:3/469: dread d2/d14/f6f [0,4194304] 0 2024-06-03T00:03:08.697 INFO:tasks.workunit.client.0.smithi049.stdout:9/729: dwrite d1/d5/d13/ddd/d87/fb7 [0,4194304] 0 2024-06-03T00:03:08.697 INFO:tasks.workunit.client.0.smithi049.stdout:5/579: dwrite d3/d9/d20/d4c/d5a/d6f/f8b [0,4194304] 0 2024-06-03T00:03:08.698 INFO:tasks.workunit.client.0.smithi049.stdout:9/730: mknod d1/d5/d1a/d52/d72/cfa 0 2024-06-03T00:03:08.701 INFO:tasks.workunit.client.0.smithi049.stdout:5/580: rmdir d3/d5/d9a 39 2024-06-03T00:03:08.702 INFO:tasks.workunit.client.0.smithi049.stdout:5/581: stat d3/c84 0 2024-06-03T00:03:08.702 INFO:tasks.workunit.client.0.smithi049.stdout:5/582: stat d3/d5/d24/l33 0 2024-06-03T00:03:08.702 INFO:tasks.workunit.client.0.smithi049.stdout:9/731: getdents d1/da/d26 0 2024-06-03T00:03:08.706 INFO:tasks.workunit.client.0.smithi049.stdout:9/732: unlink d1/da/da8/d5f/cdc 0 2024-06-03T00:03:08.707 INFO:tasks.workunit.client.0.smithi049.stdout:9/733: truncate d1/da/d54/d5b/fcd 1019327 0 2024-06-03T00:03:08.707 INFO:tasks.workunit.client.0.smithi049.stdout:9/734: chown d1/d5/d13/d3b/d49/l77 3 1 2024-06-03T00:03:08.708 INFO:tasks.workunit.client.0.smithi049.stdout:9/735: creat d1/d5/d13/d3b/d7f/dbc/ffb x:0 0 0 2024-06-03T00:03:08.708 INFO:tasks.workunit.client.0.smithi049.stdout:9/736: truncate d1/d5/d1a/fd0 1226826 0 2024-06-03T00:03:08.724 INFO:tasks.workunit.client.0.smithi049.stdout:5/583: dread d3/d5/d2d/d4b/f59 [0,4194304] 0 2024-06-03T00:03:08.728 INFO:tasks.workunit.client.0.smithi049.stdout:5/584: creat d3/d9/d20/d4c/fb8 x:0 0 0 2024-06-03T00:03:08.730 INFO:tasks.workunit.client.0.smithi049.stdout:5/585: rmdir d3/d5/d2d 39 2024-06-03T00:03:08.759 INFO:tasks.workunit.client.0.smithi049.stdout:1/754: dwrite d1/d2f/d78/fc4 [0,4194304] 0 2024-06-03T00:03:08.759 INFO:tasks.workunit.client.0.smithi049.stdout:1/755: chown d1/d2f/d36/d37/d13/d34/dd0/c103 75969 1 2024-06-03T00:03:08.759 INFO:tasks.workunit.client.0.smithi049.stdout:1/756: write d1/d2f/d36/d37/ff3 [949951,35125] 0 2024-06-03T00:03:08.759 INFO:tasks.workunit.client.0.smithi049.stdout:1/757: readlink d1/d2f/l43 0 2024-06-03T00:03:08.777 INFO:tasks.workunit.client.0.smithi049.stdout:7/562: dwrite d3/d6/d9/fa6 [0,4194304] 0 2024-06-03T00:03:08.780 INFO:tasks.workunit.client.0.smithi049.stdout:7/563: dread d3/f82 [0,4194304] 0 2024-06-03T00:03:08.794 INFO:tasks.workunit.client.0.smithi049.stdout:3/470: dwrite d2/fd [4194304,4194304] 0 2024-06-03T00:03:08.796 INFO:tasks.workunit.client.0.smithi049.stdout:9/737: rename d1/d5/d1a to d1/d5/d13/d3b/d7f/dbc/dfc 0 2024-06-03T00:03:08.796 INFO:tasks.workunit.client.0.smithi049.stdout:2/517: dwrite da/d52/d40/d63/f48 [0,4194304] 0 2024-06-03T00:03:08.797 INFO:tasks.workunit.client.0.smithi049.stdout:9/738: getdents d1/d5/d13 0 2024-06-03T00:03:08.798 INFO:tasks.workunit.client.0.smithi049.stdout:3/471: rename d2/d1a/d31/c6b to d2/d1a/d34/ca3 0 2024-06-03T00:03:08.800 INFO:tasks.workunit.client.0.smithi049.stdout:2/518: getdents da/d43 0 2024-06-03T00:03:08.801 INFO:tasks.workunit.client.0.smithi049.stdout:2/519: rmdir da/d52/d73 39 2024-06-03T00:03:08.803 INFO:tasks.workunit.client.0.smithi049.stdout:2/520: rmdir da/d52/d37/d59 39 2024-06-03T00:03:08.803 INFO:tasks.workunit.client.0.smithi049.stdout:2/521: chown da/d52/d40/f4f 51990597 1 2024-06-03T00:03:08.806 INFO:tasks.workunit.client.0.smithi049.stdout:2/522: mkdir da/d52/d73/da6 0 2024-06-03T00:03:08.806 INFO:tasks.workunit.client.0.smithi049.stdout:2/523: fdatasync da/d52/df/f29 0 2024-06-03T00:03:08.807 INFO:tasks.workunit.client.0.smithi049.stdout:9/739: dread d1/d5/d13/d3b/d7f/dbc/dfc/fa6 [0,4194304] 0 2024-06-03T00:03:08.807 INFO:tasks.workunit.client.0.smithi049.stdout:9/740: chown d1/d5/d13/d3b/dad/fb3 458 1 2024-06-03T00:03:08.807 INFO:tasks.workunit.client.0.smithi049.stdout:2/524: truncate da/fb 1549725 0 2024-06-03T00:03:08.807 INFO:tasks.workunit.client.0.smithi049.stdout:2/525: fsync da/d52/f39 0 2024-06-03T00:03:08.808 INFO:tasks.workunit.client.0.smithi049.stdout:2/526: write f1 [2945826,82308] 0 2024-06-03T00:03:08.808 INFO:tasks.workunit.client.0.smithi049.stdout:9/741: dread d1/da/d54/d5b/fcd [0,4194304] 0 2024-06-03T00:03:08.809 INFO:tasks.workunit.client.0.smithi049.stdout:2/527: truncate da/d52/f6f 547639 0 2024-06-03T00:03:08.813 INFO:tasks.workunit.client.0.smithi049.stdout:5/586: read d3/d5/d2d/d4b/d51/f76 [257361,33699] 0 2024-06-03T00:03:08.815 INFO:tasks.workunit.client.0.smithi049.stdout:5/587: rmdir d3/d5/da/d55/d75/dad 39 2024-06-03T00:03:08.815 INFO:tasks.workunit.client.0.smithi049.stdout:5/588: fdatasync d3/d5/fd 0 2024-06-03T00:03:08.815 INFO:tasks.workunit.client.0.smithi049.stdout:5/589: chown d3/d5/da/d55/d75/dad/cb0 14013 1 2024-06-03T00:03:08.816 INFO:tasks.workunit.client.0.smithi049.stdout:5/590: truncate d3/d5/f58 3333012 0 2024-06-03T00:03:08.818 INFO:tasks.workunit.client.0.smithi049.stdout:5/591: mkdir d3/d53/d9c/da4/db9 0 2024-06-03T00:03:08.818 INFO:tasks.workunit.client.0.smithi049.stdout:5/592: chown d3/d9/d20/d4c/fb8 157 1 2024-06-03T00:03:08.818 INFO:tasks.workunit.client.0.smithi049.stdout:2/528: write da/d52/d40/f8a [1430494,88270] 0 2024-06-03T00:03:08.818 INFO:tasks.workunit.client.0.smithi049.stdout:2/529: readlink da/l17 0 2024-06-03T00:03:08.819 INFO:tasks.workunit.client.0.smithi049.stdout:1/758: dwrite d1/d2f/d36/d37/d2c/d45/d61/d70/f82 [4194304,4194304] 0 2024-06-03T00:03:08.819 INFO:tasks.workunit.client.0.smithi049.stdout:5/593: rename d3/d5/d24/fa9 to d3/fba 0 2024-06-03T00:03:08.820 INFO:tasks.workunit.client.0.smithi049.stdout:1/759: mkdir d1/d2f/df7/dd1/d110 0 2024-06-03T00:03:08.821 INFO:tasks.workunit.client.0.smithi049.stdout:5/594: mknod d3/d7d/cbb 0 2024-06-03T00:03:08.821 INFO:tasks.workunit.client.0.smithi049.stdout:5/595: fdatasync d3/d5/da/d55/d75/fa0 0 2024-06-03T00:03:08.822 INFO:tasks.workunit.client.0.smithi049.stdout:1/760: creat d1/d2f/d36/d37/d13/d34/dd0/f111 x:0 0 0 2024-06-03T00:03:08.822 INFO:tasks.workunit.client.0.smithi049.stdout:1/761: write d1/d2f/d36/d37/d64/d6c/f92 [3223685,77521] 0 2024-06-03T00:03:08.822 INFO:tasks.workunit.client.0.smithi049.stdout:3/472: dwrite d2/d14/d44/d52/d4c/d4b/d58/f8d [0,4194304] 0 2024-06-03T00:03:08.822 INFO:tasks.workunit.client.0.smithi049.stdout:3/473: stat d2/d14/d44 0 2024-06-03T00:03:08.822 INFO:tasks.workunit.client.0.smithi049.stdout:1/762: mkdir d1/d2f/d36/d57/da1/d112 0 2024-06-03T00:03:08.823 INFO:tasks.workunit.client.0.smithi049.stdout:3/474: truncate d2/d14/d44/d52/d4c/d4b/d58/f85 3658295 0 2024-06-03T00:03:08.823 INFO:tasks.workunit.client.0.smithi049.stdout:3/475: readlink d2/d14/l17 0 2024-06-03T00:03:08.823 INFO:tasks.workunit.client.0.smithi049.stdout:3/476: dread - d2/d14/f63 zero size 2024-06-03T00:03:08.823 INFO:tasks.workunit.client.0.smithi049.stdout:3/477: stat d2/d14/d22/d42/c4a 0 2024-06-03T00:03:08.824 INFO:tasks.workunit.client.0.smithi049.stdout:3/478: creat d2/d1a/d51/fa4 x:0 0 0 2024-06-03T00:03:08.827 INFO:tasks.workunit.client.0.smithi049.stdout:1/763: dread d1/f1e [0,4194304] 0 2024-06-03T00:03:08.832 INFO:tasks.workunit.client.0.smithi049.stdout:3/479: dread d2/d14/f82 [0,4194304] 0 2024-06-03T00:03:08.834 INFO:tasks.workunit.client.0.smithi049.stdout:3/480: creat d2/d14/d44/fa5 x:0 0 0 2024-06-03T00:03:08.834 INFO:tasks.workunit.client.0.smithi049.stdout:3/481: fdatasync d2/d1a/f73 0 2024-06-03T00:03:08.840 INFO:tasks.workunit.client.0.smithi049.stdout:1/764: dwrite d1/d1a/f8a [0,4194304] 0 2024-06-03T00:03:08.842 INFO:tasks.workunit.client.0.smithi049.stdout:3/482: dread d2/f11 [0,4194304] 0 2024-06-03T00:03:08.843 INFO:tasks.workunit.client.0.smithi049.stdout:3/483: readlink d2/d14/d44/d52/d4c/l27 0 2024-06-03T00:03:08.843 INFO:tasks.workunit.client.0.smithi049.stdout:3/484: write d2/d1a/d34/f48 [106887,64459] 0 2024-06-03T00:03:08.843 INFO:tasks.workunit.client.0.smithi049.stdout:3/485: truncate d2/d14/d44/d52/d4c/d4b/f7f 1031668 0 2024-06-03T00:03:08.844 INFO:tasks.workunit.client.0.smithi049.stdout:3/486: creat d2/d1a/d31/d75/d94/d9e/fa6 x:0 0 0 2024-06-03T00:03:08.845 INFO:tasks.workunit.client.0.smithi049.stdout:1/765: creat d1/d2f/d78/dd7/d7d/f113 x:0 0 0 2024-06-03T00:03:08.845 INFO:tasks.workunit.client.0.smithi049.stdout:7/564: dwrite d3/d6/d13/d79/f7e [0,4194304] 0 2024-06-03T00:03:08.846 INFO:tasks.workunit.client.0.smithi049.stdout:7/565: stat d3/d6/d13/d54/c68 0 2024-06-03T00:03:08.847 INFO:tasks.workunit.client.0.smithi049.stdout:1/766: mknod d1/d2f/d36/d37/d13/c114 0 2024-06-03T00:03:08.847 INFO:tasks.workunit.client.0.smithi049.stdout:7/566: write d3/d6/d9/d8f/f6c [127488,99915] 0 2024-06-03T00:03:08.847 INFO:tasks.workunit.client.0.smithi049.stdout:9/742: dwrite d1/da/da8/d50/d70/ff2 [0,4194304] 0 2024-06-03T00:03:08.849 INFO:tasks.workunit.client.0.smithi049.stdout:5/596: dwrite d3/d5/da/d55/d14/f19 [0,4194304] 0 2024-06-03T00:03:08.852 INFO:tasks.workunit.client.0.smithi049.stdout:2/530: write da/d52/f6f [67809,40550] 0 2024-06-03T00:03:08.852 INFO:tasks.workunit.client.0.smithi049.stdout:5/597: getdents d3/d7d 0 2024-06-03T00:03:08.854 INFO:tasks.workunit.client.0.smithi049.stdout:2/531: truncate da/d52/f39 1814371 0 2024-06-03T00:03:08.855 INFO:tasks.workunit.client.0.smithi049.stdout:5/598: mknod d3/d5/da/d55/d75/dad/cbc 0 2024-06-03T00:03:08.857 INFO:tasks.workunit.client.0.smithi049.stdout:2/532: rename da/d52/d49/c5e to da/d52/d37/d70/ca7 0 2024-06-03T00:03:08.857 INFO:tasks.workunit.client.0.smithi049.stdout:5/599: dread d3/f66 [0,4194304] 0 2024-06-03T00:03:08.858 INFO:tasks.workunit.client.0.smithi049.stdout:2/533: rmdir da/d52/d40 39 2024-06-03T00:03:08.858 INFO:tasks.workunit.client.0.smithi049.stdout:1/767: write d1/d1a/f79 [514499,77767] 0 2024-06-03T00:03:08.860 INFO:tasks.workunit.client.0.smithi049.stdout:0/484: sync 2024-06-03T00:03:08.860 INFO:tasks.workunit.client.0.smithi049.stdout:4/625: sync 2024-06-03T00:03:08.860 INFO:tasks.workunit.client.0.smithi049.stdout:6/690: sync 2024-06-03T00:03:08.860 INFO:tasks.workunit.client.0.smithi049.stdout:6/691: write d2/d3/d9/d23/f1e [1152585,98297] 0 2024-06-03T00:03:08.861 INFO:tasks.workunit.client.0.smithi049.stdout:7/567: write d3/d6/d9/fa6 [2892237,75226] 0 2024-06-03T00:03:08.861 INFO:tasks.workunit.client.0.smithi049.stdout:5/600: rmdir d3/d5/da/d55/d14/d16 39 2024-06-03T00:03:08.861 INFO:tasks.workunit.client.0.smithi049.stdout:0/485: rmdir d6/d97/d4b 39 2024-06-03T00:03:08.862 INFO:tasks.workunit.client.0.smithi049.stdout:6/692: dread d2/d3/d9/d40/f87 [0,4194304] 0 2024-06-03T00:03:08.863 INFO:tasks.workunit.client.0.smithi049.stdout:5/601: creat d3/d5/da3/fbd x:0 0 0 2024-06-03T00:03:08.863 INFO:tasks.workunit.client.0.smithi049.stdout:5/602: write d3/d5/da/d55/d14/f2a [1507743,79626] 0 2024-06-03T00:03:08.863 INFO:tasks.workunit.client.0.smithi049.stdout:7/568: rename d3/d6/d13/d54/daa/d92/cc3 to d3/d6/d13/d54/daa/d92/ccf 0 2024-06-03T00:03:08.865 INFO:tasks.workunit.client.0.smithi049.stdout:7/569: creat d3/d32/d95/fd0 x:0 0 0 2024-06-03T00:03:08.866 INFO:tasks.workunit.client.0.smithi049.stdout:5/603: rename d3/d5/da/d55/c96 to d3/d5/cbe 0 2024-06-03T00:03:08.866 INFO:tasks.workunit.client.0.smithi049.stdout:2/534: dread f4 [4194304,4194304] 0 2024-06-03T00:03:08.867 INFO:tasks.workunit.client.0.smithi049.stdout:2/535: mkdir da/d52/df/d3c/da8 0 2024-06-03T00:03:08.867 INFO:tasks.workunit.client.0.smithi049.stdout:6/693: symlink d2/d3/d17/d57/lea 0 2024-06-03T00:03:08.868 INFO:tasks.workunit.client.0.smithi049.stdout:2/536: mkdir da/d52/d40/d93/da9 0 2024-06-03T00:03:08.868 INFO:tasks.workunit.client.0.smithi049.stdout:2/537: write da/d72/f81 [364879,81298] 0 2024-06-03T00:03:08.868 INFO:tasks.workunit.client.0.smithi049.stdout:2/538: chown da/d52/d37/d59/d80 2072550 1 2024-06-03T00:03:08.870 INFO:tasks.workunit.client.0.smithi049.stdout:7/570: link d3/d14/d6e/lcb d3/d6/d13/d3c/d48/ld1 0 2024-06-03T00:03:08.871 INFO:tasks.workunit.client.0.smithi049.stdout:9/743: dwrite d1/da/da8/fb6 [0,4194304] 0 2024-06-03T00:03:08.871 INFO:tasks.workunit.client.0.smithi049.stdout:9/744: fdatasync d1/f8 0 2024-06-03T00:03:08.871 INFO:tasks.workunit.client.0.smithi049.stdout:9/745: chown d1/da/da8/d50/dda 1400697 1 2024-06-03T00:03:08.874 INFO:tasks.workunit.client.0.smithi049.stdout:1/768: dread d1/d1a/f63 [0,4194304] 0 2024-06-03T00:03:08.874 INFO:tasks.workunit.client.0.smithi049.stdout:7/571: rename d3/d6/d13/d54/c68 to d3/cd2 0 2024-06-03T00:03:08.876 INFO:tasks.workunit.client.0.smithi049.stdout:1/769: getdents d1/d2f/d36/d57 0 2024-06-03T00:03:08.877 INFO:tasks.workunit.client.0.smithi049.stdout:6/694: read d2/d3/d9/d23/d48/d53/f85 [971508,36609] 0 2024-06-03T00:03:08.877 INFO:tasks.workunit.client.0.smithi049.stdout:7/572: truncate d3/d6/f15 1306217 0 2024-06-03T00:03:08.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.879+0000 7f6cb8ff9640 1 -- 172.21.15.49:0/2716241582 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x556a1c66ec20 con 0x556a1c788170 2024-06-03T00:03:08.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.879+0000 7f6cb8ff9640 10 client.15972 handle_command_reply: tid=0 2024-06-03T00:03:08.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.880+0000 7f6cda7af740 1 client.15972 shutdown 2024-06-03T00:03:08.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.880+0000 7f6cda7af740 1 -- 172.21.15.49:0/2716241582 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a1c716c50 msgr2=0x556a1c7170d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:08.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.880+0000 7f6cda7af740 1 --2- 172.21.15.49:0/2716241582 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a1c716c50 0x556a1c7170d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0004ef0 tx=0x7f6cc0012000 comp rx=0 tx=0).stop 2024-06-03T00:03:08.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.880+0000 7f6cda7af740 1 -- 172.21.15.49:0/2716241582 shutdown_connections 2024-06-03T00:03:08.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.880+0000 7f6cda7af740 1 --2- 172.21.15.49:0/2716241582 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x556a1c788170 0x556a1c78a590 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.880 INFO:tasks.workunit.client.0.smithi049.stdout:6/695: creat d2/d3/d17/d57/d6e/dd3/feb x:0 0 0 2024-06-03T00:03:08.881 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.880+0000 7f6cda7af740 1 --2- 172.21.15.49:0/2716241582 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a1c716c50 0x556a1c7170d0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.881 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.880+0000 7f6cda7af740 1 --2- 172.21.15.49:0/2716241582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a1c70c380 0x556a1c715c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.881 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.880+0000 7f6cda7af740 1 --2- 172.21.15.49:0/2716241582 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a1c707210 0x556a1c715750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.881 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.880+0000 7f6cb8ff9640 0 client.15972 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.880+0000 7f6cda7af740 1 -- 172.21.15.49:0/2716241582 >> 172.21.15.49:0/2716241582 conn(0x556a1c701e90 msgr2=0x556a1c7105c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.880+0000 7f6cda7af740 1 -- 172.21.15.49:0/2716241582 shutdown_connections 2024-06-03T00:03:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.880+0000 7f6cda7af740 1 -- 172.21.15.49:0/2716241582 wait complete. 2024-06-03T00:03:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.880+0000 7f6cda7af740 20 client.15972 trim_cache size 0 max 16384 2024-06-03T00:03:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-06-03T00:03:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-06-03T00:03:08.882 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-06-03T00:03:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.881+0000 7f6cd79c1640 1 -- 172.21.15.49:0/4201602250 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6cbc0a2c30 msgr2=0x7f6cbc0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.881+0000 7f6cd79c1640 1 --2- 172.21.15.49:0/4201602250 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6cbc0a2c30 0x7f6cbc0a50f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8098410 tx=0x7f6cc80bc040 comp rx=0 tx=0).stop 2024-06-03T00:03:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.881+0000 7f6cd79c1640 1 -- 172.21.15.49:0/4201602250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6cd01024b0 msgr2=0x7f6cd01a13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.881+0000 7f6cd79c1640 1 --2- 172.21.15.49:0/4201602250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6cd01024b0 0x7f6cd01a13e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8009fd0 tx=0x7f6cc800ef10 comp rx=0 tx=0).stop 2024-06-03T00:03:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.881+0000 7f6cd79c1640 1 -- 172.21.15.49:0/4201602250 shutdown_connections 2024-06-03T00:03:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.881+0000 7f6cd79c1640 1 --2- 172.21.15.49:0/4201602250 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f6cbc0a2c30 0x7f6cbc0a50f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.881+0000 7f6cd79c1640 1 --2- 172.21.15.49:0/4201602250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6cd01024b0 0x7f6cd01a13e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.883 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.881+0000 7f6cd79c1640 1 --2- 172.21.15.49:0/4201602250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6cd0101af0 0x7f6cd019a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.884 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.881+0000 7f6cd79c1640 1 --2- 172.21.15.49:0/4201602250 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cd0100900 0x7f6cd0199e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:08.884 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.881+0000 7f6cd79c1640 1 -- 172.21.15.49:0/4201602250 >> 172.21.15.49:0/4201602250 conn(0x7f6cd00fbe90 msgr2=0x7f6cd0190b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:08.884 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.881+0000 7f6cd79c1640 1 -- 172.21.15.49:0/4201602250 shutdown_connections 2024-06-03T00:03:08.884 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:08.881+0000 7f6cd79c1640 1 -- 172.21.15.49:0/4201602250 wait complete. 2024-06-03T00:03:08.884 INFO:tasks.workunit.client.0.smithi049.stdout:6/696: truncate d2/d3/d9/d23/d48/d53/f85 299615 0 2024-06-03T00:03:08.884 INFO:tasks.workunit.client.0.smithi049.stdout:6/697: stat d2/d3b/fd1 0 2024-06-03T00:03:08.884 INFO:tasks.workunit.client.0.smithi049.stdout:6/698: readlink d2/d3/d17/d57/d6e/d88/dde/de9/l9e 0 2024-06-03T00:03:08.884 INFO:tasks.workunit.client.0.smithi049.stdout:6/699: rename d2/d3/d9/f3d to d2/d3/d9/d23/d29/d30/fec 0 2024-06-03T00:03:08.887 INFO:tasks.workunit.client.0.smithi049.stdout:1/770: dread d1/d2f/d36/d37/d13/f47 [0,4194304] 0 2024-06-03T00:03:08.896 INFO:tasks.workunit.client.0.smithi049.stdout:1/771: dread d1/d1a/f8a [0,4194304] 0 2024-06-03T00:03:08.896 INFO:tasks.workunit.client.0.smithi049.stdout:2/539: dwrite da/f45 [0,4194304] 0 2024-06-03T00:03:08.896 INFO:tasks.workunit.client.0.smithi049.stdout:1/772: creat d1/d2f/df7/dd1/f115 x:0 0 0 2024-06-03T00:03:08.897 INFO:tasks.workunit.client.0.smithi049.stdout:2/540: rename da/d52/d49 to da/d52/d40/d63/daa 0 2024-06-03T00:03:08.898 INFO:tasks.workunit.client.0.smithi049.stdout:1/773: symlink d1/d2f/d78/l116 0 2024-06-03T00:03:08.899 INFO:tasks.workunit.client.0.smithi049.stdout:1/774: mknod d1/d2f/d36/d37/d2c/c117 0 2024-06-03T00:03:08.917 INFO:tasks.workunit.client.0.smithi049.stdout:6/700: dwrite d2/d3/d9/d23/d48/f70 [0,4194304] 0 2024-06-03T00:03:08.917 INFO:tasks.workunit.client.0.smithi049.stdout:7/573: dwrite d3/d6/d13/d79/f7e [0,4194304] 0 2024-06-03T00:03:08.918 INFO:tasks.workunit.client.0.smithi049.stdout:7/574: readlink d3/d6/d86/d8d/la5 0 2024-06-03T00:03:08.918 INFO:tasks.workunit.client.0.smithi049.stdout:7/575: readlink d3/d6/d13/d3c/d48/lc1 0 2024-06-03T00:03:08.918 INFO:tasks.workunit.client.0.smithi049.stdout:2/541: dwrite da/d52/f26 [0,4194304] 0 2024-06-03T00:03:08.920 INFO:tasks.workunit.client.0.smithi049.stdout:2/542: unlink da/d52/df/c31 0 2024-06-03T00:03:08.920 INFO:tasks.workunit.client.0.smithi049.stdout:6/701: link d2/d3/d9/d23/d48/f61 d2/d3b/fed 0 2024-06-03T00:03:08.921 INFO:tasks.workunit.client.0.smithi049.stdout:7/576: symlink d3/d6/d13/d3c/d48/d7b/d5b/ld3 0 2024-06-03T00:03:08.922 INFO:tasks.workunit.client.0.smithi049.stdout:2/543: dread da/d52/df/f34 [0,4194304] 0 2024-06-03T00:03:08.922 INFO:tasks.workunit.client.0.smithi049.stdout:6/702: symlink d2/d3/d17/d57/d6e/dd3/de2/lee 0 2024-06-03T00:03:08.924 INFO:tasks.workunit.client.0.smithi049.stdout:7/577: creat d3/d6/d13/d54/daa/fd4 x:0 0 0 2024-06-03T00:03:08.924 INFO:tasks.workunit.client.0.smithi049.stdout:2/544: unlink da/d52/d40/f4f 0 2024-06-03T00:03:08.926 INFO:tasks.workunit.client.0.smithi049.stdout:6/703: creat d2/d3/d17/d57/d6e/fef x:0 0 0 2024-06-03T00:03:08.926 INFO:tasks.workunit.client.0.smithi049.stdout:2/545: creat da/d55/fab x:0 0 0 2024-06-03T00:03:08.928 INFO:tasks.workunit.client.0.smithi049.stdout:2/546: mkdir da/d52/d37/dac 0 2024-06-03T00:03:08.928 INFO:tasks.workunit.client.0.smithi049.stdout:6/704: creat d2/d3/d17/d57/d6e/d88/dde/ff0 x:0 0 0 2024-06-03T00:03:08.928 INFO:tasks.workunit.client.0.smithi049.stdout:2/547: unlink da/d72/d83/c9b 0 2024-06-03T00:03:08.929 INFO:tasks.workunit.client.0.smithi049.stdout:2/548: stat f9 0 2024-06-03T00:03:08.936 INFO:tasks.workunit.client.0.smithi049.stdout:6/705: dread d2/d3/d17/f6b [0,4194304] 0 2024-06-03T00:03:08.938 INFO:tasks.workunit.client.0.smithi049.stdout:6/706: creat d2/d3/d9/d23/d48/ff1 x:0 0 0 2024-06-03T00:03:08.938 INFO:tasks.workunit.client.0.smithi049.stdout:6/707: write d2/d3/d9/d40/f87 [665773,76634] 0 2024-06-03T00:03:08.945 INFO:tasks.workunit.client.0.smithi049.stdout:6/708: dread d2/d3/d17/d57/f69 [0,4194304] 0 2024-06-03T00:03:08.946 INFO:tasks.workunit.client.0.smithi049.stdout:6/709: write d2/d3/d17/d57/d6e/d88/fa7 [1619466,73160] 0 2024-06-03T00:03:08.946 INFO:tasks.workunit.client.0.smithi049.stdout:6/710: write d2/d3/d9/d23/d48/d51/f5f [4838980,12051] 0 2024-06-03T00:03:08.946 INFO:tasks.workunit.client.0.smithi049.stdout:6/711: chown d2/d4d/d76/l78 301663420 1 2024-06-03T00:03:08.961 INFO:tasks.workunit.client.0.smithi049.stdout:6/712: dwrite d2/d3/d9/fc7 [0,4194304] 0 2024-06-03T00:03:08.964 INFO:tasks.workunit.client.0.smithi049.stdout:6/713: symlink d2/d3/d9/d23/lf2 0 2024-06-03T00:03:08.965 INFO:tasks.workunit.client.0.smithi049.stdout:6/714: dread d2/d3/d9/d23/d29/f41 [0,4194304] 0 2024-06-03T00:03:08.965 INFO:tasks.workunit.client.0.smithi049.stdout:6/715: chown d2/d3/d17/f77 66738 1 2024-06-03T00:03:09.032 INFO:tasks.workunit.client.0.smithi049.stdout:6/716: dwrite d2/d3/d17/f6b [0,4194304] 0 2024-06-03T00:03:09.032 INFO:tasks.workunit.client.0.smithi049.stdout:6/717: chown d2/d3b/ce6 208432 1 2024-06-03T00:03:09.033 INFO:tasks.workunit.client.0.smithi049.stdout:6/718: mkdir d2/d3b/df3 0 2024-06-03T00:03:09.034 INFO:tasks.workunit.client.0.smithi049.stdout:6/719: creat d2/d3b/ff4 x:0 0 0 2024-06-03T00:03:09.036 INFO:tasks.workunit.client.0.smithi049.stdout:2/549: dread da/d52/df/f2c [0,4194304] 0 2024-06-03T00:03:09.036 INFO:tasks.workunit.client.0.smithi049.stdout:2/550: fsync f6 0 2024-06-03T00:03:09.036 INFO:tasks.workunit.client.0.smithi049.stdout:2/551: write da/d52/d40/d63/daa/f6c [906731,123608] 0 2024-06-03T00:03:09.036 INFO:tasks.workunit.client.0.smithi049.stdout:5/604: dwrite d3/d5/fd [0,4194304] 0 2024-06-03T00:03:09.036 INFO:tasks.workunit.client.0.smithi049.stdout:5/605: write d3/d9/d20/d4c/d5a/d65/f69 [4788401,106528] 0 2024-06-03T00:03:09.037 INFO:tasks.workunit.client.0.smithi049.stdout:6/720: symlink d2/d3/d17/d57/lf5 0 2024-06-03T00:03:09.041 INFO:tasks.workunit.client.0.smithi049.stdout:9/746: dwrite d1/d5/fb4 [0,4194304] 0 2024-06-03T00:03:09.042 INFO:tasks.workunit.client.0.smithi049.stdout:1/775: dwrite d1/d2f/d36/d57/d72/fdd [0,4194304] 0 2024-06-03T00:03:09.042 INFO:tasks.workunit.client.0.smithi049.stdout:7/578: getdents d3/d6/d13/d3c/d48 0 2024-06-03T00:03:09.043 INFO:tasks.workunit.client.0.smithi049.stdout:9/747: creat d1/d5/d13/de3/de8/ffd x:0 0 0 2024-06-03T00:03:09.043 INFO:tasks.workunit.client.0.smithi049.stdout:9/748: write d1/da/da8/f34 [878102,130138] 0 2024-06-03T00:03:09.043 INFO:tasks.workunit.client.0.smithi049.stdout:9/749: stat d1/d5/d13/d3b/d7f/dbc/dfc/fbe 0 2024-06-03T00:03:09.043 INFO:tasks.workunit.client.0.smithi049.stdout:9/750: read d1/da/da8/f34 [772270,120222] 0 2024-06-03T00:03:09.044 INFO:tasks.workunit.client.0.smithi049.stdout:9/751: write d1/da/d27/f75 [1020524,75033] 0 2024-06-03T00:03:09.044 INFO:tasks.workunit.client.0.smithi049.stdout:7/579: unlink d3/d6/d3f/f83 0 2024-06-03T00:03:09.046 INFO:tasks.workunit.client.0.smithi049.stdout:2/552: dread da/f45 [0,4194304] 0 2024-06-03T00:03:09.047 INFO:tasks.workunit.client.0.smithi049.stdout:9/752: truncate d1/fba 431195 0 2024-06-03T00:03:09.049 INFO:tasks.workunit.client.0.smithi049.stdout:2/553: truncate da/d52/df/f29 522284 0 2024-06-03T00:03:09.049 INFO:tasks.workunit.client.0.smithi049.stdout:2/554: read - da/d52/d37/fa4 zero size 2024-06-03T00:03:09.050 INFO:tasks.workunit.client.0.smithi049.stdout:6/721: fsync d2/d3/d9/d23/d48/f61 0 2024-06-03T00:03:09.050 INFO:tasks.workunit.client.0.smithi049.stdout:6/722: write d2/d3/d9/fcb [262920,52085] 0 2024-06-03T00:03:09.053 INFO:tasks.workunit.client.0.smithi049.stdout:2/555: unlink da/d43/c50 0 2024-06-03T00:03:09.060 INFO:tasks.workunit.client.0.smithi049.stdout:2/556: creat da/d55/fad x:0 0 0 2024-06-03T00:03:09.060 INFO:tasks.workunit.client.0.smithi049.stdout:2/557: write f6 [3120648,34229] 0 2024-06-03T00:03:09.060 INFO:tasks.workunit.client.0.smithi049.stdout:2/558: write da/d52/d40/f64 [659079,79268] 0 2024-06-03T00:03:09.060 INFO:tasks.workunit.client.0.smithi049.stdout:2/559: read f4 [6763054,22890] 0 2024-06-03T00:03:09.061 INFO:tasks.workunit.client.0.smithi049.stdout:6/723: dread d2/d3/d9/d23/d29/f32 [0,4194304] 0 2024-06-03T00:03:09.062 INFO:tasks.workunit.client.0.smithi049.stdout:2/560: unlink da/d52/df/d3c/f66 0 2024-06-03T00:03:09.063 INFO:tasks.workunit.client.0.smithi049.stdout:2/561: symlink da/d52/d37/d70/lae 0 2024-06-03T00:03:09.063 INFO:tasks.workunit.client.0.smithi049.stdout:9/753: dread d1/da/da8/d50/d70/ff2 [0,4194304] 0 2024-06-03T00:03:09.063 INFO:tasks.workunit.client.0.smithi049.stdout:9/754: readlink d1/da/d54/l93 0 2024-06-03T00:03:09.065 INFO:tasks.workunit.client.0.smithi049.stdout:1/776: dwrite d1/d2f/d78/dd7/d7d/fd3 [0,4194304] 0 2024-06-03T00:03:09.065 INFO:tasks.workunit.client.0.smithi049.stdout:1/777: dread - d1/d2f/d36/d37/d2c/f101 zero size 2024-06-03T00:03:09.068 INFO:tasks.workunit.client.0.smithi049.stdout:7/580: dwrite d3/d6/d13/f94 [0,4194304] 0 2024-06-03T00:03:09.068 INFO:tasks.workunit.client.0.smithi049.stdout:7/581: stat d3/d6/d13/d3c/d48/d7b/d9c/fb6 0 2024-06-03T00:03:09.069 INFO:tasks.workunit.client.0.smithi049.stdout:7/582: mkdir d3/d6/d13/d4a/dd5 0 2024-06-03T00:03:09.070 INFO:tasks.workunit.client.0.smithi049.stdout:7/583: rmdir d3/d6/d9/d91 39 2024-06-03T00:03:09.073 INFO:tasks.workunit.client.0.smithi049.stdout:7/584: symlink d3/d6/d13/ld6 0 2024-06-03T00:03:09.087 INFO:tasks.workunit.client.0.smithi049.stdout:6/724: dwrite d2/d3b/fd1 [0,4194304] 0 2024-06-03T00:03:09.088 INFO:tasks.workunit.client.0.smithi049.stdout:7/585: dwrite d3/d6/d13/d3c/d48/d7b/d5b/fc6 [4194304,4194304] 0 2024-06-03T00:03:09.091 INFO:tasks.workunit.client.0.smithi049.stdout:6/725: dread d2/d3/d9/d23/f26 [0,4194304] 0 2024-06-03T00:03:09.092 INFO:tasks.workunit.client.0.smithi049.stdout:6/726: symlink d2/d4d/de3/lf6 0 2024-06-03T00:03:09.092 INFO:tasks.workunit.client.0.smithi049.stdout:6/727: dread - d2/d3/d9/f71 zero size 2024-06-03T00:03:09.094 INFO:tasks.workunit.client.0.smithi049.stdout:1/778: dwrite d1/d2f/d36/d37/d13/d34/d8f/d94/f10e [0,4194304] 0 2024-06-03T00:03:09.094 INFO:tasks.workunit.client.0.smithi049.stdout:2/562: dwrite da/d52/df/d3c/f53 [0,4194304] 0 2024-06-03T00:03:09.097 INFO:tasks.workunit.client.0.smithi049.stdout:1/779: truncate d1/d2f/d78/dd7/d7d/fd3 1325735 0 2024-06-03T00:03:09.099 INFO:tasks.workunit.client.0.smithi049.stdout:7/586: dread d3/d32/f80 [0,4194304] 0 2024-06-03T00:03:09.100 INFO:tasks.workunit.client.0.smithi049.stdout:6/728: dread d2/d3/d17/d57/f8c [0,4194304] 0 2024-06-03T00:03:09.100 INFO:tasks.workunit.client.0.smithi049.stdout:6/729: stat d2/d3/d9/d23/d48/f92 0 2024-06-03T00:03:09.100 INFO:tasks.workunit.client.0.smithi049.stdout:6/730: stat d2/d3/d9/d23/d29/f32 0 2024-06-03T00:03:09.100 INFO:tasks.workunit.client.0.smithi049.stdout:1/780: unlink d1/d2f/df7/dd1/f115 0 2024-06-03T00:03:09.100 INFO:tasks.workunit.client.0.smithi049.stdout:1/781: chown d1/d2f/d36/d57/cd5 26 1 2024-06-03T00:03:09.101 INFO:tasks.workunit.client.0.smithi049.stdout:6/731: mknod d2/d3/d17/cf7 0 2024-06-03T00:03:09.101 INFO:tasks.workunit.client.0.smithi049.stdout:6/732: truncate d2/d3/d9/d40/fc1 602552 0 2024-06-03T00:03:09.102 INFO:tasks.workunit.client.0.smithi049.stdout:6/733: mkdir d2/d3/d17/d57/d6e/d88/dcc/df8 0 2024-06-03T00:03:09.102 INFO:tasks.workunit.client.0.smithi049.stdout:1/782: unlink d1/d2f/d36/d37/d2c/d45/fb2 0 2024-06-03T00:03:09.104 INFO:tasks.workunit.client.0.smithi049.stdout:6/734: link d2/d4d/d76/f93 d2/ff9 0 2024-06-03T00:03:09.105 INFO:tasks.workunit.client.0.smithi049.stdout:6/735: chown d2/ff9 17730570 1 2024-06-03T00:03:09.105 INFO:tasks.workunit.client.0.smithi049.stdout:2/563: write da/d52/d40/d63/f48 [2687231,41447] 0 2024-06-03T00:03:09.105 INFO:tasks.workunit.client.0.smithi049.stdout:1/783: creat d1/d2f/d36/d37/d2c/d45/d61/d67/f118 x:0 0 0 2024-06-03T00:03:09.106 INFO:tasks.workunit.client.0.smithi049.stdout:6/736: rename d2/d3/d17/d57/d6e/dd3/ce0 to d2/d3/d17/d57/d6e/d88/dde/cfa 0 2024-06-03T00:03:09.106 INFO:tasks.workunit.client.0.smithi049.stdout:2/564: truncate da/d52/f39 33503 0 2024-06-03T00:03:09.107 INFO:tasks.workunit.client.0.smithi049.stdout:6/737: mknod d2/d3/d17/cfb 0 2024-06-03T00:03:09.107 INFO:tasks.workunit.client.0.smithi049.stdout:7/587: write d3/d6/d13/f94 [1037234,48117] 0 2024-06-03T00:03:09.109 INFO:tasks.workunit.client.0.smithi049.stdout:1/784: link d1/d2f/d36/d37/d13/d34/d5f/la8 d1/d2f/d36/d37/d64/d6c/d8c/l119 0 2024-06-03T00:03:09.109 INFO:tasks.workunit.client.0.smithi049.stdout:1/785: stat d1/d2f/d36/d37/d13/d71 0 2024-06-03T00:03:09.109 INFO:tasks.workunit.client.0.smithi049.stdout:6/738: truncate d2/d3/d9/d23/d29/d30/f6d 235461 0 2024-06-03T00:03:09.109 INFO:tasks.workunit.client.0.smithi049.stdout:6/739: chown d2/d3/d17/d57/d6e/dd3 13 1 2024-06-03T00:03:09.109 INFO:tasks.workunit.client.0.smithi049.stdout:6/740: write d2/d3/d17/d57/d6e/d88/faa [241007,37624] 0 2024-06-03T00:03:09.109 INFO:tasks.workunit.client.0.smithi049.stdout:8/463: sync 2024-06-03T00:03:09.110 INFO:tasks.workunit.client.0.smithi049.stdout:7/588: unlink d3/d6/d13/d54/l8c 0 2024-06-03T00:03:09.113 INFO:tasks.workunit.client.0.smithi049.stdout:7/589: getdents d3/d6/d86/d8d 0 2024-06-03T00:03:09.113 INFO:tasks.workunit.client.0.smithi049.stdout:7/590: write d3/d14/f2a [773641,18983] 0 2024-06-03T00:03:09.114 INFO:tasks.workunit.client.0.smithi049.stdout:1/786: creat d1/d2f/d36/d37/d2c/d45/d61/d67/f11a x:0 0 0 2024-06-03T00:03:09.114 INFO:tasks.workunit.client.0.smithi049.stdout:8/464: mknod d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/c94 0 2024-06-03T00:03:09.114 INFO:tasks.workunit.client.0.smithi049.stdout:7/591: dread d3/d6/d13/d4a/fa2 [0,4194304] 0 2024-06-03T00:03:09.114 INFO:tasks.workunit.client.0.smithi049.stdout:7/592: chown d3/d6/d13/d4a/fb0 23966 1 2024-06-03T00:03:09.114 INFO:tasks.workunit.client.0.smithi049.stdout:6/741: getdents d2/d3/d17/d57/d6e/dd3 0 2024-06-03T00:03:09.115 INFO:tasks.workunit.client.0.smithi049.stdout:8/465: rename d4/d27/d30/f31 to d4/d27/d3c/d88/d4d/f95 0 2024-06-03T00:03:09.115 INFO:tasks.workunit.client.0.smithi049.stdout:7/593: mknod d3/d6/d9/cd7 0 2024-06-03T00:03:09.115 INFO:tasks.workunit.client.0.smithi049.stdout:7/594: readlink d3/d6/d13/d3c/d4b/d5a/l5f 0 2024-06-03T00:03:09.115 INFO:tasks.workunit.client.0.smithi049.stdout:7/595: truncate d3/d6/d13/d4a/fa2 1678990 0 2024-06-03T00:03:09.116 INFO:tasks.workunit.client.0.smithi049.stdout:1/787: rmdir d1 39 2024-06-03T00:03:09.116 INFO:tasks.workunit.client.0.smithi049.stdout:8/466: symlink d4/d27/l96 0 2024-06-03T00:03:09.116 INFO:tasks.workunit.client.0.smithi049.stdout:6/742: creat d2/d3/d17/d57/d6e/d88/dcc/df8/ffc x:0 0 0 2024-06-03T00:03:09.116 INFO:tasks.workunit.client.0.smithi049.stdout:6/743: truncate d2/d4d/fe8 220144 0 2024-06-03T00:03:09.117 INFO:tasks.workunit.client.0.smithi049.stdout:8/467: symlink d4/d27/d3c/d88/l97 0 2024-06-03T00:03:09.117 INFO:tasks.workunit.client.0.smithi049.stdout:8/468: fdatasync d4/d27/d3c/d88/d28/d52/d66/d53/d7e/f64 0 2024-06-03T00:03:09.118 INFO:tasks.workunit.client.0.smithi049.stdout:8/469: mknod d4/d27/d3c/d88/d28/d25/c98 0 2024-06-03T00:03:09.118 INFO:tasks.workunit.client.0.smithi049.stdout:8/470: chown d4/d27/d3c/d88/d28/d52/l8d 10 1 2024-06-03T00:03:09.120 INFO:tasks.workunit.client.0.smithi049.stdout:8/471: chown d4/d27/d3c/d88/d28/f86 711 1 2024-06-03T00:03:09.120 INFO:tasks.workunit.client.0.smithi049.stdout:6/744: getdents d2/d3/d9/d23/d29 0 2024-06-03T00:03:09.120 INFO:tasks.workunit.client.0.smithi049.stdout:2/565: dwrite da/d52/f26 [4194304,4194304] 0 2024-06-03T00:03:09.122 INFO:tasks.workunit.client.0.smithi049.stdout:1/788: rename d1/d2f/d78/fc4 to d1/f11b 0 2024-06-03T00:03:09.122 INFO:tasks.workunit.client.0.smithi049.stdout:7/596: dread d3/d14/f2a [0,4194304] 0 2024-06-03T00:03:09.123 INFO:tasks.workunit.client.0.smithi049.stdout:6/745: mkdir d2/d4d/d76/dfd 0 2024-06-03T00:03:09.125 INFO:tasks.workunit.client.0.smithi049.stdout:1/789: rename d1/d2f/d36/d37/d64/d6c/d8c/f97 to d1/d2f/df7/f11c 0 2024-06-03T00:03:09.128 INFO:tasks.workunit.client.0.smithi049.stdout:6/746: dread d2/d3/d9/d23/d48/f92 [0,4194304] 0 2024-06-03T00:03:09.129 INFO:tasks.workunit.client.0.smithi049.stdout:7/597: rename d3/d6 to d3/dd8 0 2024-06-03T00:03:09.136 INFO:tasks.workunit.client.0.smithi049.stdout:1/790: dread d1/d2f/df7/f11c [0,4194304] 0 2024-06-03T00:03:09.136 INFO:tasks.workunit.client.0.smithi049.stdout:1/791: fsync d1/d2f/d50/fa4 0 2024-06-03T00:03:09.137 INFO:tasks.workunit.client.0.smithi049.stdout:1/792: read d1/d2f/d78/dd7/f9b [105514,84243] 0 2024-06-03T00:03:09.137 INFO:tasks.workunit.client.0.smithi049.stdout:1/793: truncate d1/d2f/d36/d37/d2c/d45/d61/d67/f6d 5276193 0 2024-06-03T00:03:09.139 INFO:tasks.workunit.client.0.smithi049.stdout:1/794: dread d1/d2f/d36/d37/d13/d34/f3c [0,4194304] 0 2024-06-03T00:03:09.139 INFO:tasks.workunit.client.0.smithi049.stdout:7/598: dread d3/dd8/d13/d3c/d48/d7b/d5b/fc6 [4194304,4194304] 0 2024-06-03T00:03:09.139 INFO:tasks.workunit.client.0.smithi049.stdout:7/599: chown d3/dd8/d9/d91/fa0 27187 1 2024-06-03T00:03:09.139 INFO:tasks.workunit.client.0.smithi049.stdout:7/600: chown d3/dd8/d13/d4a/c1e 7 1 2024-06-03T00:03:09.139 INFO:tasks.workunit.client.0.smithi049.stdout:1/795: getdents d1/d2f/d36/d37/d2c/d45/da0 0 2024-06-03T00:03:09.140 INFO:tasks.workunit.client.0.smithi049.stdout:1/796: getdents d1/d2f/d36/d57/d72 0 2024-06-03T00:03:09.140 INFO:tasks.workunit.client.0.smithi049.stdout:1/797: truncate d1/d2f/d36/d37/d13/dc6/fff 1430977 0 2024-06-03T00:03:09.141 INFO:tasks.workunit.client.0.smithi049.stdout:1/798: mkdir d1/d1a/dd2/d11d 0 2024-06-03T00:03:09.142 INFO:tasks.workunit.client.0.smithi049.stdout:1/799: link d1/d2f/d36/d37/d13/f27 d1/d2f/d36/d37/d2c/d102/f11e 0 2024-06-03T00:03:09.143 INFO:tasks.workunit.client.0.smithi049.stdout:1/800: mkdir d1/d2f/d36/d37/d13/d34/d11f 0 2024-06-03T00:03:09.143 INFO:tasks.workunit.client.0.smithi049.stdout:8/472: dwrite d4/d27/d3c/d88/d28/d52/f65 [0,4194304] 0 2024-06-03T00:03:09.143 INFO:tasks.workunit.client.0.smithi049.stdout:8/473: dread - d4/d27/d3c/d88/d28/d45/f6a zero size 2024-06-03T00:03:09.144 INFO:tasks.workunit.client.0.smithi049.stdout:2/566: dwrite da/d52/d40/f94 [0,4194304] 0 2024-06-03T00:03:09.144 INFO:tasks.workunit.client.0.smithi049.stdout:2/567: symlink da/d52/d40/d93/da9/laf 0 2024-06-03T00:03:09.145 INFO:tasks.workunit.client.0.smithi049.stdout:2/568: getdents da/d52/d40/d63 0 2024-06-03T00:03:09.146 INFO:tasks.workunit.client.0.smithi049.stdout:2/569: creat da/d72/d83/fb0 x:0 0 0 2024-06-03T00:03:09.146 INFO:tasks.workunit.client.0.smithi049.stdout:2/570: chown da/d52/d37/fa4 49 1 2024-06-03T00:03:09.149 INFO:tasks.workunit.client.0.smithi049.stdout:7/601: dread d3/dd8/f25 [0,4194304] 0 2024-06-03T00:03:09.164 INFO:tasks.workunit.client.0.smithi049.stdout:8/474: dwrite d4/d27/f4c [0,4194304] 0 2024-06-03T00:03:09.164 INFO:tasks.workunit.client.0.smithi049.stdout:8/475: write d4/d27/d3c/d88/d48/f5d [1401384,105944] 0 2024-06-03T00:03:09.165 INFO:tasks.workunit.client.0.smithi049.stdout:8/476: symlink d4/d27/l99 0 2024-06-03T00:03:09.172 INFO:tasks.workunit.client.0.smithi049.stdout:1/801: dwrite d1/d2f/d36/d57/d72/fa6 [0,4194304] 0 2024-06-03T00:03:09.172 INFO:tasks.workunit.client.0.smithi049.stdout:8/477: write d4/d27/d3c/d88/d28/f36 [547119,85681] 0 2024-06-03T00:03:09.172 INFO:tasks.workunit.client.0.smithi049.stdout:8/478: readlink d4/d27/d3c/d88/d28/d52/l8d 0 2024-06-03T00:03:09.174 INFO:tasks.workunit.client.0.smithi049.stdout:8/479: creat d4/d27/d3c/d88/d28/d52/f9a x:0 0 0 2024-06-03T00:03:09.174 INFO:tasks.workunit.client.0.smithi049.stdout:2/571: dwrite da/d52/df/f10 [0,4194304] 0 2024-06-03T00:03:09.174 INFO:tasks.workunit.client.0.smithi049.stdout:2/572: truncate da/d52/df/f10 4851181 0 2024-06-03T00:03:09.175 INFO:tasks.workunit.client.0.smithi049.stdout:1/802: mknod d1/d2f/d36/d37/d13/d34/c120 0 2024-06-03T00:03:09.175 INFO:tasks.workunit.client.0.smithi049.stdout:1/803: write d1/d2f/d78/dd7/d7d/fd3 [2281590,13421] 0 2024-06-03T00:03:09.175 INFO:tasks.workunit.client.0.smithi049.stdout:2/573: creat da/d52/d37/d70/fb1 x:0 0 0 2024-06-03T00:03:09.180 INFO:tasks.workunit.client.0.smithi049.stdout:1/804: dread d1/d2f/d36/d57/d72/f93 [0,4194304] 0 2024-06-03T00:03:09.181 INFO:tasks.workunit.client.0.smithi049.stdout:8/480: dread d4/d27/d3c/d88/f13 [0,4194304] 0 2024-06-03T00:03:09.182 INFO:tasks.workunit.client.0.smithi049.stdout:1/805: creat d1/d2f/d36/d57/d72/ddf/f121 x:0 0 0 2024-06-03T00:03:09.182 INFO:tasks.workunit.client.0.smithi049.stdout:1/806: dread - d1/d2f/d36/d37/d13/d34/dd0/de2/ff4 zero size 2024-06-03T00:03:09.182 INFO:tasks.workunit.client.0.smithi049.stdout:2/574: mknod da/d52/d73/cb2 0 2024-06-03T00:03:09.184 INFO:tasks.workunit.client.0.smithi049.stdout:2/575: rmdir da/d52 39 2024-06-03T00:03:09.186 INFO:tasks.workunit.client.0.smithi049.stdout:2/576: getdents da/d52/d73/da6 0 2024-06-03T00:03:09.187 INFO:tasks.workunit.client.0.smithi049.stdout:2/577: unlink da/d43/c6d 0 2024-06-03T00:03:09.188 INFO:tasks.workunit.client.0.smithi049.stdout:1/807: read d1/f7 [1200421,126256] 0 2024-06-03T00:03:09.189 INFO:tasks.workunit.client.0.smithi049.stdout:2/578: unlink da/d52/f6f 0 2024-06-03T00:03:09.189 INFO:tasks.workunit.client.0.smithi049.stdout:2/579: dread - da/d52/d37/f84 zero size 2024-06-03T00:03:09.189 INFO:tasks.workunit.client.0.smithi049.stdout:2/580: symlink da/d52/d40/d93/lb3 0 2024-06-03T00:03:09.191 INFO:tasks.workunit.client.0.smithi049.stdout:2/581: mknod da/d52/d9e/cb4 0 2024-06-03T00:03:09.194 INFO:tasks.workunit.client.0.smithi049.stdout:1/808: read d1/d2f/d36/d37/d2c/f60 [1899611,122249] 0 2024-06-03T00:03:09.194 INFO:tasks.workunit.client.0.smithi049.stdout:1/809: dread - d1/d2f/d36/d37/d2c/d45/da0/fe5 zero size 2024-06-03T00:03:09.202 INFO:tasks.workunit.client.0.smithi049.stdout:1/810: dread d1/f11b [0,4194304] 0 2024-06-03T00:03:09.211 INFO:tasks.workunit.client.0.smithi049.stdout:2/582: dwrite da/d52/df/d3c/f53 [0,4194304] 0 2024-06-03T00:03:09.211 INFO:tasks.workunit.client.0.smithi049.stdout:2/583: stat da/d55/ca2 0 2024-06-03T00:03:09.212 INFO:tasks.workunit.client.0.smithi049.stdout:2/584: rename da/d52/d37/l3d to da/d52/df/d3c/d7a/lb5 0 2024-06-03T00:03:09.213 INFO:tasks.workunit.client.0.smithi049.stdout:2/585: symlink da/d52/df/d3c/d7a/lb6 0 2024-06-03T00:03:09.213 INFO:tasks.workunit.client.0.smithi049.stdout:2/586: fdatasync da/d52/d40/f94 0 2024-06-03T00:03:09.214 INFO:tasks.workunit.client.0.smithi049.stdout:2/587: mknod da/d52/d37/d59/d80/cb7 0 2024-06-03T00:03:09.214 INFO:tasks.workunit.client.0.smithi049.stdout:2/588: dread - da/d52/d37/d70/fb1 zero size 2024-06-03T00:03:09.215 INFO:tasks.workunit.client.0.smithi049.stdout:2/589: stat da/d52/df/d3c 0 2024-06-03T00:03:09.215 INFO:tasks.workunit.client.0.smithi049.stdout:2/590: stat da/d52/d40 0 2024-06-03T00:03:09.215 INFO:tasks.workunit.client.0.smithi049.stdout:2/591: truncate da/d52/d40/d63/daa/f6c 5354102 0 2024-06-03T00:03:09.215 INFO:tasks.workunit.client.0.smithi049.stdout:2/592: symlink da/d52/d37/dac/lb8 0 2024-06-03T00:03:09.215 INFO:tasks.workunit.client.0.smithi049.stdout:2/593: readlink da/d52/d37/d59/d80/l97 0 2024-06-03T00:03:09.216 INFO:tasks.workunit.client.0.smithi049.stdout:2/594: chown da/d52/df/l35 3 1 2024-06-03T00:03:09.216 INFO:tasks.workunit.client.0.smithi049.stdout:2/595: chown da/d52/df/l35 0 1 2024-06-03T00:03:09.216 INFO:tasks.workunit.client.0.smithi049.stdout:2/596: chown da/c20 192521 1 2024-06-03T00:03:09.216 INFO:tasks.workunit.client.0.smithi049.stdout:2/597: fsync da/d52/d37/d59/d80/fa5 0 2024-06-03T00:03:09.216 INFO:tasks.workunit.client.0.smithi049.stdout:1/811: dwrite d1/d2f/d36/d37/d13/dc6/fff [0,4194304] 0 2024-06-03T00:03:09.216 INFO:tasks.workunit.client.0.smithi049.stdout:2/598: mkdir da/d52/d73/da6/db9 0 2024-06-03T00:03:09.218 INFO:tasks.workunit.client.0.smithi049.stdout:1/812: rename d1/d2f/d36/d37/d2c/d45/da0/dab to d1/d2f/df7/d122 0 2024-06-03T00:03:09.219 INFO:tasks.workunit.client.0.smithi049.stdout:1/813: write d1/d2f/d36/d37/d2c/d45/d61/d70/fe3 [1263827,59178] 0 2024-06-03T00:03:09.221 INFO:tasks.workunit.client.0.smithi049.stdout:1/814: mkdir d1/d2f/d36/d37/d13/d34/d52/d123 0 2024-06-03T00:03:09.236 INFO:tasks.workunit.client.0.smithi049.stdout:2/599: dwrite da/d52/f82 [0,4194304] 0 2024-06-03T00:03:09.236 INFO:tasks.workunit.client.0.smithi049.stdout:2/600: write da/d52/d40/f8a [667511,126198] 0 2024-06-03T00:03:09.237 INFO:tasks.workunit.client.0.smithi049.stdout:1/815: dwrite d1/d2f/d36/d37/d2c/f101 [0,4194304] 0 2024-06-03T00:03:09.240 INFO:tasks.workunit.client.0.smithi049.stdout:1/816: getdents d1/d2f/d78/dd7 0 2024-06-03T00:03:09.241 INFO:tasks.workunit.client.0.smithi049.stdout:1/817: symlink d1/d2f/d36/d37/d13/d34/d52/d123/l124 0 2024-06-03T00:03:09.241 INFO:tasks.workunit.client.0.smithi049.stdout:1/818: chown d1/d2f/d78/dd7/fd6 1394231 1 2024-06-03T00:03:09.245 INFO:tasks.workunit.client.0.smithi049.stdout:1/819: dread d1/f1e [0,4194304] 0 2024-06-03T00:03:09.245 INFO:tasks.workunit.client.0.smithi049.stdout:1/820: dread - d1/d2f/d36/d37/d13/d34/d6e/dad/fb7 zero size 2024-06-03T00:03:09.247 INFO:tasks.workunit.client.0.smithi049.stdout:1/821: symlink d1/d2f/d36/d37/d13/d34/d52/l125 0 2024-06-03T00:03:09.247 INFO:tasks.workunit.client.0.smithi049.stdout:1/822: fdatasync d1/d2f/d36/d37/d13/d34/d8f/d94/f95 0 2024-06-03T00:03:09.247 INFO:tasks.workunit.client.0.smithi049.stdout:1/823: dread - d1/d2f/d36/d37/d13/d34/dd0/f111 zero size 2024-06-03T00:03:09.247 INFO:tasks.workunit.client.0.smithi049.stdout:1/824: fdatasync d1/d2f/d78/dd7/d7d/f113 0 2024-06-03T00:03:09.248 INFO:tasks.workunit.client.0.smithi049.stdout:1/825: creat d1/d2f/df7/f126 x:0 0 0 2024-06-03T00:03:09.249 INFO:tasks.workunit.client.0.smithi049.stdout:1/826: creat d1/d2f/d36/d37/d13/d34/d6e/dad/f127 x:0 0 0 2024-06-03T00:03:09.251 INFO:tasks.workunit.client.0.smithi049.stdout:1/827: link d1/d2f/d36/d57/d72/ddf/c106 d1/d2f/d36/d57/d72/ddf/c128 0 2024-06-03T00:03:09.251 INFO:tasks.workunit.client.0.smithi049.stdout:1/828: write d1/d2f/f44 [1513701,120817] 0 2024-06-03T00:03:09.251 INFO:tasks.workunit.client.0.smithi049.stdout:1/829: dread - d1/d2f/d36/d37/d2c/d45/d61/d67/f11a zero size 2024-06-03T00:03:09.251 INFO:tasks.workunit.client.0.smithi049.stdout:1/830: readlink d1/ldc 0 2024-06-03T00:03:09.253 INFO:tasks.workunit.client.0.smithi049.stdout:1/831: link d1/d2f/d36/d37/d2c/d45/d61/d70/f85 d1/d2f/d36/d37/f129 0 2024-06-03T00:03:09.253 INFO:tasks.workunit.client.0.smithi049.stdout:1/832: read d1/d2f/d36/d37/f33 [2621369,115469] 0 2024-06-03T00:03:09.257 INFO:tasks.workunit.client.0.smithi049.stdout:2/601: dwrite f9 [0,4194304] 0 2024-06-03T00:03:09.267 INFO:tasks.workunit.client.0.smithi049.stdout:1/833: dwrite d1/d2f/d78/dd7/f9b [0,4194304] 0 2024-06-03T00:03:09.269 INFO:tasks.workunit.client.0.smithi049.stdout:2/602: write da/d52/d40/d63/daa/f87 [2245344,27520] 0 2024-06-03T00:03:09.269 INFO:tasks.workunit.client.0.smithi049.stdout:2/603: fsync da/d52/d40/f94 0 2024-06-03T00:03:09.269 INFO:tasks.workunit.client.0.smithi049.stdout:2/604: chown da/d52/df/c5b 70 1 2024-06-03T00:03:09.272 INFO:tasks.workunit.client.0.smithi049.stdout:1/834: rename d1/d2f/d36/d37/d2c/d102/f11e to d1/d2f/df7/f12a 0 2024-06-03T00:03:09.291 INFO:tasks.workunit.client.0.smithi049.stdout:2/605: dwrite f9 [0,4194304] 0 2024-06-03T00:03:09.292 INFO:tasks.workunit.client.0.smithi049.stdout:2/606: write da/d52/d40/d63/f48 [4432681,105450] 0 2024-06-03T00:03:09.292 INFO:tasks.workunit.client.0.smithi049.stdout:3/487: sync 2024-06-03T00:03:09.292 INFO:tasks.workunit.client.0.smithi049.stdout:3/488: creat d2/d14/d22/fa7 x:0 0 0 2024-06-03T00:03:09.293 INFO:tasks.workunit.client.0.smithi049.stdout:3/489: truncate d2/d14/f24 1808097 0 2024-06-03T00:03:09.293 INFO:tasks.workunit.client.0.smithi049.stdout:3/490: chown d2/d1a/d34/f4f 519 1 2024-06-03T00:03:09.293 INFO:tasks.workunit.client.0.smithi049.stdout:2/607: rename da/d72/d83/d9f/ca3 to da/d52/d37/cba 0 2024-06-03T00:03:09.294 INFO:tasks.workunit.client.0.smithi049.stdout:3/491: rmdir d2/d14/d44/d52/d4c/d4b 39 2024-06-03T00:03:09.294 INFO:tasks.workunit.client.0.smithi049.stdout:2/608: rmdir da/d55 39 2024-06-03T00:03:09.294 INFO:tasks.workunit.client.0.smithi049.stdout:2/609: read - da/d72/d83/fb0 zero size 2024-06-03T00:03:09.295 INFO:tasks.workunit.client.0.smithi049.stdout:3/492: unlink d2/d14/f63 0 2024-06-03T00:03:09.296 INFO:tasks.workunit.client.0.smithi049.stdout:2/610: truncate da/d52/df/f34 231456 0 2024-06-03T00:03:09.297 INFO:tasks.workunit.client.0.smithi049.stdout:3/493: creat d2/d1a/d51/d83/fa8 x:0 0 0 2024-06-03T00:03:09.297 INFO:tasks.workunit.client.0.smithi049.stdout:2/611: mknod da/d52/cbb 0 2024-06-03T00:03:09.298 INFO:tasks.workunit.client.0.smithi049.stdout:3/494: rmdir d2/d1a/d31/d75 39 2024-06-03T00:03:09.299 INFO:tasks.workunit.client.0.smithi049.stdout:2/612: getdents da/d52/d40/d93 0 2024-06-03T00:03:09.305 INFO:tasks.workunit.client.0.smithi049.stdout:3/495: write d2/d1a/f73 [3417330,3217] 0 2024-06-03T00:03:09.307 INFO:tasks.workunit.client.0.smithi049.stdout:2/613: dread f1 [0,4194304] 0 2024-06-03T00:03:09.308 INFO:tasks.workunit.client.0.smithi049.stdout:3/496: rename d2/d14/d44/d52/fa to d2/d14/d44/d52/d4c/d4b/d58/fa9 0 2024-06-03T00:03:09.309 INFO:tasks.workunit.client.0.smithi049.stdout:2/614: link da/d52/d40/f6e da/d72/d83/fbc 0 2024-06-03T00:03:09.309 INFO:tasks.workunit.client.0.smithi049.stdout:3/497: symlink d2/d14/d44/d52/d4c/laa 0 2024-06-03T00:03:09.310 INFO:tasks.workunit.client.0.smithi049.stdout:2/615: symlink da/d52/d37/d59/d80/lbd 0 2024-06-03T00:03:09.311 INFO:tasks.workunit.client.0.smithi049.stdout:3/498: mknod d2/d1a/d31/d75/d94/cab 0 2024-06-03T00:03:09.311 INFO:tasks.workunit.client.0.smithi049.stdout:3/499: chown d2/d1a/d31/d75 16727893 1 2024-06-03T00:03:09.312 INFO:tasks.workunit.client.0.smithi049.stdout:2/616: rename da/d52/d37/d59/c92 to da/d52/d37/cbe 0 2024-06-03T00:03:09.313 INFO:tasks.workunit.client.0.smithi049.stdout:2/617: creat da/d55/fbf x:0 0 0 2024-06-03T00:03:09.319 INFO:tasks.workunit.client.0.smithi049.stdout:3/500: rename d2/d1a/d34/f4f to d2/d14/fac 0 2024-06-03T00:03:09.319 INFO:tasks.workunit.client.0.smithi049.stdout:2/618: creat da/d52/d40/d93/da9/fc0 x:0 0 0 2024-06-03T00:03:09.319 INFO:tasks.workunit.client.0.smithi049.stdout:2/619: chown f6 467 1 2024-06-03T00:03:09.319 INFO:tasks.workunit.client.0.smithi049.stdout:2/620: write da/d72/d83/fbc [5238256,69570] 0 2024-06-03T00:03:09.319 INFO:tasks.workunit.client.0.smithi049.stdout:3/501: creat d2/d14/d22/d3a/d47/fad x:0 0 0 2024-06-03T00:03:09.319 INFO:tasks.workunit.client.0.smithi049.stdout:3/502: truncate d2/d1a/d34/f5e 452813 0 2024-06-03T00:03:09.319 INFO:tasks.workunit.client.0.smithi049.stdout:3/503: creat d2/d1a/d34/fae x:0 0 0 2024-06-03T00:03:09.322 INFO:tasks.workunit.client.0.smithi049.stdout:3/504: mkdir d2/d14/d44/d52/d4c/d4b/daf 0 2024-06-03T00:03:09.324 INFO:tasks.workunit.client.0.smithi049.stdout:2/621: dread da/d52/d40/d63/daa/f6c [0,4194304] 0 2024-06-03T00:03:09.324 INFO:tasks.workunit.client.0.smithi049.stdout:2/622: creat da/d52/d9e/fc1 x:0 0 0 2024-06-03T00:03:09.325 INFO:tasks.workunit.client.0.smithi049.stdout:2/623: getdents da/d72/d83/d9f 0 2024-06-03T00:03:09.330 INFO:tasks.workunit.client.0.smithi049.stdout:3/505: write d2/f8b [288009,102085] 0 2024-06-03T00:03:09.331 INFO:tasks.workunit.client.0.smithi049.stdout:3/506: symlink d2/d1a/d31/d75/d94/d9e/lb0 0 2024-06-03T00:03:09.333 INFO:tasks.workunit.client.0.smithi049.stdout:3/507: rename d2/d14/d44/d52/d4c/d4b/d98/da2 to d2/d14/d22/d42/d68/d80/db1 0 2024-06-03T00:03:09.333 INFO:tasks.workunit.client.0.smithi049.stdout:2/624: dread da/d52/d40/d63/f48 [0,4194304] 0 2024-06-03T00:03:09.333 INFO:tasks.workunit.client.0.smithi049.stdout:2/625: rmdir da/d52/df/d3c 39 2024-06-03T00:03:09.334 INFO:tasks.workunit.client.0.smithi049.stdout:2/626: stat da/d52/c2f 0 2024-06-03T00:03:09.335 INFO:tasks.workunit.client.0.smithi049.stdout:3/508: unlink d2/d1a/d31/l56 0 2024-06-03T00:03:09.335 INFO:tasks.workunit.client.0.smithi049.stdout:3/509: chown d2/d1a/d51/d83/l8e 90 1 2024-06-03T00:03:09.335 INFO:tasks.workunit.client.0.smithi049.stdout:2/627: mkdir da/dc2 0 2024-06-03T00:03:09.336 INFO:tasks.workunit.client.0.smithi049.stdout:3/510: rename d2/d14/d44/d52/d4c/d4b/d58/f60 to d2/d1a/d31/d75/d94/d9e/fb2 0 2024-06-03T00:03:09.340 INFO:tasks.workunit.client.0.smithi049.stdout:3/511: fdatasync d2/d1a/f73 0 2024-06-03T00:03:09.340 INFO:tasks.workunit.client.0.smithi049.stdout:3/512: stat d2/d14/d22/d3a/d47/c55 0 2024-06-03T00:03:09.340 INFO:tasks.workunit.client.0.smithi049.stdout:3/513: stat d2/d1a/d31/d75/d94/d9e/lb0 0 2024-06-03T00:03:09.345 INFO:tasks.workunit.client.0.smithi049.stdout:3/514: rmdir d2/d14/d22/d42/d68/d80/db1 0 2024-06-03T00:03:09.345 INFO:tasks.workunit.client.0.smithi049.stdout:3/515: write d2/d14/d22/d3a/d47/f72 [828289,41111] 0 2024-06-03T00:03:09.348 INFO:tasks.workunit.client.0.smithi049.stdout:3/516: dread d2/d14/d22/d3a/d47/f72 [0,4194304] 0 2024-06-03T00:03:09.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:09 smithi107 ceph-mon[37048]: pgmap v476: 97 pgs: 97 active+clean; 852 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 95 MiB/s rd, 130 MiB/s wr, 1.35k op/s 2024-06-03T00:03:09.350 INFO:tasks.workunit.client.0.smithi049.stdout:3/517: link d2/d14/d22/d42/d68/d80/l86 d2/d14/d44/d52/lb3 0 2024-06-03T00:03:09.351 INFO:tasks.workunit.client.0.smithi049.stdout:3/518: creat d2/d14/d22/d42/d8f/fb4 x:0 0 0 2024-06-03T00:03:09.351 INFO:tasks.workunit.client.0.smithi049.stdout:3/519: dread - d2/d14/d44/fa5 zero size 2024-06-03T00:03:09.352 INFO:tasks.workunit.client.0.smithi049.stdout:3/520: unlink d2/d1a/d34/ca3 0 2024-06-03T00:03:09.353 INFO:tasks.workunit.client.0.smithi049.stdout:3/521: creat d2/d14/d44/d52/d4c/d4b/fb5 x:0 0 0 2024-06-03T00:03:09.354 INFO:tasks.workunit.client.0.smithi049.stdout:3/522: mkdir d2/d1a/d76/d9b/db6 0 2024-06-03T00:03:09.355 INFO:tasks.workunit.client.0.smithi049.stdout:2/628: dwrite f4 [0,4194304] 0 2024-06-03T00:03:09.356 INFO:tasks.workunit.client.0.smithi049.stdout:3/523: rename d2/d14/d44/d52/d4c/d4b/d98/c78 to d2/d14/d44/d52/d4c/d4b/daf/cb7 0 2024-06-03T00:03:09.356 INFO:tasks.workunit.client.0.smithi049.stdout:3/524: write d2/d14/d44/d52/d4c/d4b/f89 [929501,80844] 0 2024-06-03T00:03:09.372 INFO:tasks.workunit.client.0.smithi049.stdout:2/629: dwrite da/d72/d83/fb0 [0,4194304] 0 2024-06-03T00:03:09.374 INFO:tasks.workunit.client.0.smithi049.stdout:2/630: unlink da/d52/d37/d70/ca7 0 2024-06-03T00:03:09.379 INFO:tasks.workunit.client.0.smithi049.stdout:3/525: dwrite d2/d14/d22/f2a [0,4194304] 0 2024-06-03T00:03:09.379 INFO:tasks.workunit.client.0.smithi049.stdout:3/526: dread - d2/d14/d22/d3a/d47/fad zero size 2024-06-03T00:03:09.387 INFO:tasks.workunit.client.0.smithi049.stdout:2/631: dwrite da/d52/d37/d59/d80/fa5 [0,4194304] 0 2024-06-03T00:03:09.387 INFO:tasks.workunit.client.0.smithi049.stdout:2/632: truncate da/d52/d37/d70/fb1 857658 0 2024-06-03T00:03:09.388 INFO:tasks.workunit.client.0.smithi049.stdout:3/527: dread d2/d14/d44/d52/f6a [0,4194304] 0 2024-06-03T00:03:09.388 INFO:tasks.workunit.client.0.smithi049.stdout:3/528: write d2/d14/d44/d52/d4c/f97 [909247,92252] 0 2024-06-03T00:03:09.388 INFO:tasks.workunit.client.0.smithi049.stdout:4/626: sync 2024-06-03T00:03:09.388 INFO:tasks.workunit.client.0.smithi049.stdout:5/606: sync 2024-06-03T00:03:09.388 INFO:tasks.workunit.client.0.smithi049.stdout:0/486: sync 2024-06-03T00:03:09.388 INFO:tasks.workunit.client.0.smithi049.stdout:0/487: write d6/d29/f8b [465784,23573] 0 2024-06-03T00:03:09.389 INFO:tasks.workunit.client.0.smithi049.stdout:5/607: write d3/d9/f49 [513541,92626] 0 2024-06-03T00:03:09.389 INFO:tasks.workunit.client.0.smithi049.stdout:5/608: write d3/d5/d9a/fb3 [334713,103297] 0 2024-06-03T00:03:09.389 INFO:tasks.workunit.client.0.smithi049.stdout:3/529: creat d2/d14/d44/fb8 x:0 0 0 2024-06-03T00:03:09.389 INFO:tasks.workunit.client.0.smithi049.stdout:2/633: rename da/d52/df/f2c to da/d52/d73/da6/fc3 0 2024-06-03T00:03:09.391 INFO:tasks.workunit.client.0.smithi049.stdout:5/609: unlink d3/d5/d2d/d4b/d51/f76 0 2024-06-03T00:03:09.391 INFO:tasks.workunit.client.0.smithi049.stdout:5/610: write d3/d9/d68/f78 [68341,84744] 0 2024-06-03T00:03:09.391 INFO:tasks.workunit.client.0.smithi049.stdout:5/611: write d3/d5/da/d55/d14/d16/f25 [5389134,12659] 0 2024-06-03T00:03:09.391 INFO:tasks.workunit.client.0.smithi049.stdout:0/488: rename d6/d97/d4b/d67/l98 to d6/d97/d4b/d67/d6e/lad 0 2024-06-03T00:03:09.391 INFO:tasks.workunit.client.0.smithi049.stdout:3/530: mknod d2/d14/d22/d42/d68/cb9 0 2024-06-03T00:03:09.392 INFO:tasks.workunit.client.0.smithi049.stdout:0/489: mknod d6/cae 0 2024-06-03T00:03:09.392 INFO:tasks.workunit.client.0.smithi049.stdout:0/490: chown d6/cae 0 1 2024-06-03T00:03:09.392 INFO:tasks.workunit.client.0.smithi049.stdout:0/491: rmdir d6/d97/d4b/d67/d6e/d52 39 2024-06-03T00:03:09.392 INFO:tasks.workunit.client.0.smithi049.stdout:5/612: mkdir d3/d5/d2d/d4b/d97/dbf 0 2024-06-03T00:03:09.392 INFO:tasks.workunit.client.0.smithi049.stdout:0/492: dread - d6/d97/d4b/d67/d6e/d52/f5c zero size 2024-06-03T00:03:09.393 INFO:tasks.workunit.client.0.smithi049.stdout:0/493: readlink d6/d30/d32/l45 0 2024-06-03T00:03:09.393 INFO:tasks.workunit.client.0.smithi049.stdout:0/494: dread - d6/d97/d4b/d67/d6e/f87 zero size 2024-06-03T00:03:09.393 INFO:tasks.workunit.client.0.smithi049.stdout:0/495: dread - d6/d30/da3/faa zero size 2024-06-03T00:03:09.393 INFO:tasks.workunit.client.0.smithi049.stdout:3/531: symlink d2/d1a/d51/d83/lba 0 2024-06-03T00:03:09.394 INFO:tasks.workunit.client.0.smithi049.stdout:0/496: read d6/d97/d4b/f95 [226407,10685] 0 2024-06-03T00:03:09.394 INFO:tasks.workunit.client.0.smithi049.stdout:2/634: read da/f45 [1916578,108046] 0 2024-06-03T00:03:09.394 INFO:tasks.workunit.client.0.smithi049.stdout:0/497: stat d6/d97/d4b/d67/d6e/f6d 0 2024-06-03T00:03:09.394 INFO:tasks.workunit.client.0.smithi049.stdout:0/498: dread - d6/d59/d72/f86 zero size 2024-06-03T00:03:09.394 INFO:tasks.workunit.client.0.smithi049.stdout:2/635: chown da/d52/d37/d70/fb1 49 1 2024-06-03T00:03:09.394 INFO:tasks.workunit.client.0.smithi049.stdout:2/636: chown da/d52/d40/d93/da9 10994075 1 2024-06-03T00:03:09.394 INFO:tasks.workunit.client.0.smithi049.stdout:2/637: readlink da/d52/d40/d63/l5d 0 2024-06-03T00:03:09.394 INFO:tasks.workunit.client.0.smithi049.stdout:5/613: creat d3/d5/da/d55/d14/d16/fc0 x:0 0 0 2024-06-03T00:03:09.394 INFO:tasks.workunit.client.0.smithi049.stdout:5/614: fdatasync d3/d5/da/f67 0 2024-06-03T00:03:09.395 INFO:tasks.workunit.client.0.smithi049.stdout:3/532: creat d2/d1a/d76/fbb x:0 0 0 2024-06-03T00:03:09.395 INFO:tasks.workunit.client.0.smithi049.stdout:2/638: creat da/d52/d37/dac/fc4 x:0 0 0 2024-06-03T00:03:09.396 INFO:tasks.workunit.client.0.smithi049.stdout:5/615: dread d3/d5/da/d55/d14/d16/f34 [0,4194304] 0 2024-06-03T00:03:09.397 INFO:tasks.workunit.client.0.smithi049.stdout:2/639: truncate da/d52/df/d3c/f53 2056117 0 2024-06-03T00:03:09.398 INFO:tasks.workunit.client.0.smithi049.stdout:3/533: rename d2/d14/c19 to d2/d14/d22/d3a/d47/d79/cbc 0 2024-06-03T00:03:09.398 INFO:tasks.workunit.client.0.smithi049.stdout:3/534: write d2/f8b [3564031,24268] 0 2024-06-03T00:03:09.399 INFO:tasks.workunit.client.0.smithi049.stdout:2/640: creat da/d52/d73/da6/db9/fc5 x:0 0 0 2024-06-03T00:03:09.399 INFO:tasks.workunit.client.0.smithi049.stdout:2/641: truncate da/d52/df/f34 500147 0 2024-06-03T00:03:09.400 INFO:tasks.workunit.client.0.smithi049.stdout:3/535: creat d2/fbd x:0 0 0 2024-06-03T00:03:09.400 INFO:tasks.workunit.client.0.smithi049.stdout:3/536: write d2/f8b [1703665,116352] 0 2024-06-03T00:03:09.400 INFO:tasks.workunit.client.0.smithi049.stdout:2/642: mkdir da/d52/df/d3c/d60/dc6 0 2024-06-03T00:03:09.401 INFO:tasks.workunit.client.0.smithi049.stdout:2/643: rmdir da/d52/df/d3c/d7a 39 2024-06-03T00:03:09.402 INFO:tasks.workunit.client.0.smithi049.stdout:2/644: mkdir da/d52/df/d3c/d60/dc7 0 2024-06-03T00:03:09.427 INFO:tasks.workunit.client.0.smithi049.stdout:0/499: dwrite f4 [0,4194304] 0 2024-06-03T00:03:09.428 INFO:tasks.workunit.client.0.smithi049.stdout:0/500: fdatasync d6/d97/d4b/d67/d6e/d52/f91 0 2024-06-03T00:03:09.428 INFO:tasks.workunit.client.0.smithi049.stdout:4/627: dwrite d4/d3f/d14/fcf [0,4194304] 0 2024-06-03T00:03:09.428 INFO:tasks.workunit.client.0.smithi049.stdout:3/537: dwrite d2/d1a/f65 [4194304,4194304] 0 2024-06-03T00:03:09.428 INFO:tasks.workunit.client.0.smithi049.stdout:3/538: chown d2/d14/d22/d42/d68/cb9 4100558 1 2024-06-03T00:03:09.429 INFO:tasks.workunit.client.0.smithi049.stdout:0/501: rename d6/d30/c26 to d6/d97/d4b/caf 0 2024-06-03T00:03:09.430 INFO:tasks.workunit.client.0.smithi049.stdout:3/539: truncate d2/d14/d44/d52/d4c/d4b/d58/f85 2476796 0 2024-06-03T00:03:09.430 INFO:tasks.workunit.client.0.smithi049.stdout:4/628: creat d4/d3f/d14/d2b/d84/d69/dc6/fd6 x:0 0 0 2024-06-03T00:03:09.431 INFO:tasks.workunit.client.0.smithi049.stdout:3/540: mkdir d2/d1a/d51/dbe 0 2024-06-03T00:03:09.431 INFO:tasks.workunit.client.0.smithi049.stdout:3/541: fsync d2/d1a/d51/fa4 0 2024-06-03T00:03:09.442 INFO:tasks.workunit.client.0.smithi049.stdout:4/629: dread d4/d3f/d14/d7f/d87/f92 [0,4194304] 0 2024-06-03T00:03:09.443 INFO:tasks.workunit.client.0.smithi049.stdout:3/542: dread d2/fe [0,4194304] 0 2024-06-03T00:03:09.443 INFO:tasks.workunit.client.0.smithi049.stdout:3/543: truncate d2/d1a/f20 1876829 0 2024-06-03T00:03:09.444 INFO:tasks.workunit.client.0.smithi049.stdout:4/630: creat d4/d2a/d76/fd7 x:0 0 0 2024-06-03T00:03:09.445 INFO:tasks.workunit.client.0.smithi049.stdout:4/631: creat d4/d3f/d14/fd8 x:0 0 0 2024-06-03T00:03:09.447 INFO:tasks.workunit.client.0.smithi049.stdout:3/544: write d2/d14/d44/d52/f6a [3264207,110338] 0 2024-06-03T00:03:09.448 INFO:tasks.workunit.client.0.smithi049.stdout:3/545: chown d2/d14/d22/c7a 0 1 2024-06-03T00:03:09.448 INFO:tasks.workunit.client.0.smithi049.stdout:0/502: dwrite d6/d30/da3/fab [0,4194304] 0 2024-06-03T00:03:09.448 INFO:tasks.workunit.client.0.smithi049.stdout:3/546: mknod d2/d1a/d51/d83/cbf 0 2024-06-03T00:03:09.448 INFO:tasks.workunit.client.0.smithi049.stdout:4/632: link d4/d3f/d14/d2b/d84/d1c/d7a/f80 d4/d3f/d14/fd9 0 2024-06-03T00:03:09.449 INFO:tasks.workunit.client.0.smithi049.stdout:3/547: mknod d2/d1a/cc0 0 2024-06-03T00:03:09.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:09 smithi057 ceph-mon[36457]: pgmap v476: 97 pgs: 97 active+clean; 852 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 95 MiB/s rd, 130 MiB/s wr, 1.35k op/s 2024-06-03T00:03:09.450 INFO:tasks.workunit.client.0.smithi049.stdout:0/503: getdents d6/d30/da3 0 2024-06-03T00:03:09.450 INFO:tasks.workunit.client.0.smithi049.stdout:4/633: creat d4/d3f/d14/d2b/fda x:0 0 0 2024-06-03T00:03:09.451 INFO:tasks.workunit.client.0.smithi049.stdout:4/634: chown d4/d3f/d14/d2b/d84/d1c/d4f 30 1 2024-06-03T00:03:09.451 INFO:tasks.workunit.client.0.smithi049.stdout:4/635: fdatasync d4/d3f/d14/d2b/d84/d1c/f6f 0 2024-06-03T00:03:09.451 INFO:tasks.workunit.client.0.smithi049.stdout:4/636: chown d4/d3f/d14/d7f/la5 3412 1 2024-06-03T00:03:09.451 INFO:tasks.workunit.client.0.smithi049.stdout:0/504: read d6/f92 [513374,95402] 0 2024-06-03T00:03:09.452 INFO:tasks.workunit.client.0.smithi049.stdout:0/505: truncate d6/d30/d32/f82 3157604 0 2024-06-03T00:03:09.452 INFO:tasks.workunit.client.0.smithi049.stdout:0/506: truncate d6/d29/f33 1339552 0 2024-06-03T00:03:09.452 INFO:tasks.workunit.client.0.smithi049.stdout:0/507: chown d6/d59/d93 7300 1 2024-06-03T00:03:09.452 INFO:tasks.workunit.client.0.smithi049.stdout:0/508: getdents d6/d59/d72/d94 0 2024-06-03T00:03:09.452 INFO:tasks.workunit.client.0.smithi049.stdout:0/509: chown d6/d97/d4b/d67/d6e/d52/f91 502997463 1 2024-06-03T00:03:09.452 INFO:tasks.workunit.client.0.smithi049.stdout:0/510: write d6/d29/f33 [2180625,16181] 0 2024-06-03T00:03:09.455 INFO:tasks.workunit.client.0.smithi049.stdout:4/637: rename d4/d3f/d14/d2b/d84/d1c/d7a to d4/d3f/d14/d7f/ddb 0 2024-06-03T00:03:09.458 INFO:tasks.workunit.client.0.smithi049.stdout:0/511: rename d6/d97/d4b/d67/la9 to d6/d30/lb0 0 2024-06-03T00:03:09.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:09 smithi049 ceph-mon[32302]: pgmap v476: 97 pgs: 97 active+clean; 852 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 95 MiB/s rd, 130 MiB/s wr, 1.35k op/s 2024-06-03T00:03:09.463 INFO:tasks.workunit.client.0.smithi049.stdout:4/638: dread d4/d3f/d14/d2b/d84/d1c/d24/f4a [0,4194304] 0 2024-06-03T00:03:09.463 INFO:tasks.workunit.client.0.smithi049.stdout:0/512: write d6/f61 [730060,116626] 0 2024-06-03T00:03:09.463 INFO:tasks.workunit.client.0.smithi049.stdout:0/513: fdatasync d6/d30/f44 0 2024-06-03T00:03:09.464 INFO:tasks.workunit.client.0.smithi049.stdout:4/639: creat d4/d3f/d14/d2b/d84/fdc x:0 0 0 2024-06-03T00:03:09.464 INFO:tasks.workunit.client.0.smithi049.stdout:0/514: creat d6/d29/fb1 x:0 0 0 2024-06-03T00:03:09.465 INFO:tasks.workunit.client.0.smithi049.stdout:4/640: truncate d4/d2a/f81 2690187 0 2024-06-03T00:03:09.466 INFO:tasks.workunit.client.0.smithi049.stdout:4/641: mknod d4/d3f/d14/d7f/d87/cdd 0 2024-06-03T00:03:09.466 INFO:tasks.workunit.client.0.smithi049.stdout:3/548: dwrite d2/d1a/d31/d75/d94/d9e/fa6 [0,4194304] 0 2024-06-03T00:03:09.467 INFO:tasks.workunit.client.0.smithi049.stdout:4/642: symlink d4/d3f/d14/d2b/d84/d1c/d24/lde 0 2024-06-03T00:03:09.469 INFO:tasks.workunit.client.0.smithi049.stdout:3/549: rename d2/d1a/d51/fa4 to d2/d1a/d31/d75/d94/fc1 0 2024-06-03T00:03:09.470 INFO:tasks.workunit.client.0.smithi049.stdout:3/550: mknod d2/cc2 0 2024-06-03T00:03:09.472 INFO:tasks.workunit.client.0.smithi049.stdout:7/602: sync 2024-06-03T00:03:09.472 INFO:tasks.workunit.client.0.smithi049.stdout:8/481: sync 2024-06-03T00:03:09.472 INFO:tasks.workunit.client.0.smithi049.stdout:9/755: sync 2024-06-03T00:03:09.472 INFO:tasks.workunit.client.0.smithi049.stdout:8/482: fdatasync d4/f6e 0 2024-06-03T00:03:09.473 INFO:tasks.workunit.client.0.smithi049.stdout:9/756: readlink d1/d5/d13/d3b/d7f/dbc/dfc/lb0 0 2024-06-03T00:03:09.473 INFO:tasks.workunit.client.0.smithi049.stdout:7/603: truncate d3/dd8/d86/fa9 929199 0 2024-06-03T00:03:09.473 INFO:tasks.workunit.client.0.smithi049.stdout:6/747: sync 2024-06-03T00:03:09.473 INFO:tasks.workunit.client.0.smithi049.stdout:8/483: write d4/d27/d3c/d88/f74 [511545,119926] 0 2024-06-03T00:03:09.473 INFO:tasks.workunit.client.0.smithi049.stdout:8/484: truncate d4/d27/d3c/d88/d28/d52/f9a 637843 0 2024-06-03T00:03:09.474 INFO:tasks.workunit.client.0.smithi049.stdout:7/604: creat d3/dd8/d13/d3c/d4b/d5a/fd9 x:0 0 0 2024-06-03T00:03:09.475 INFO:tasks.workunit.client.0.smithi049.stdout:8/485: mknod d4/d27/d3c/d88/d28/d25/c9b 0 2024-06-03T00:03:09.475 INFO:tasks.workunit.client.0.smithi049.stdout:7/605: chown d3/dd8/d13/d3c/d48/ld1 33271855 1 2024-06-03T00:03:09.475 INFO:tasks.workunit.client.0.smithi049.stdout:8/486: readlink d4/d27/d3c/d88/d4d/l4e 0 2024-06-03T00:03:09.475 INFO:tasks.workunit.client.0.smithi049.stdout:8/487: write d4/d27/d3c/d88/d28/d25/f39 [1424133,8191] 0 2024-06-03T00:03:09.475 INFO:tasks.workunit.client.0.smithi049.stdout:8/488: write d4/d27/d3c/d88/d28/d45/f6a [779667,129517] 0 2024-06-03T00:03:09.475 INFO:tasks.workunit.client.0.smithi049.stdout:8/489: readlink d4/d27/d3c/d88/d28/l23 0 2024-06-03T00:03:09.475 INFO:tasks.workunit.client.0.smithi049.stdout:9/757: rename d1/d5/d13/ddd to d1/d5/d13/de3/dfe 0 2024-06-03T00:03:09.475 INFO:tasks.workunit.client.0.smithi049.stdout:6/748: creat d2/d3/d17/d57/d6e/dd3/ffe x:0 0 0 2024-06-03T00:03:09.476 INFO:tasks.workunit.client.0.smithi049.stdout:7/606: creat d3/dd8/d13/d3c/d48/fda x:0 0 0 2024-06-03T00:03:09.476 INFO:tasks.workunit.client.0.smithi049.stdout:8/490: creat d4/d27/d3c/d88/d28/d52/d66/d53/d6c/f9c x:0 0 0 2024-06-03T00:03:09.477 INFO:tasks.workunit.client.0.smithi049.stdout:7/607: mknod d3/d32/d95/cdb 0 2024-06-03T00:03:09.478 INFO:tasks.workunit.client.0.smithi049.stdout:3/551: dread d2/d14/d44/d52/d4c/f30 [0,4194304] 0 2024-06-03T00:03:09.478 INFO:tasks.workunit.client.0.smithi049.stdout:3/552: dread - d2/d1a/d76/f99 zero size 2024-06-03T00:03:09.478 INFO:tasks.workunit.client.0.smithi049.stdout:6/749: mkdir d2/dff 0 2024-06-03T00:03:09.479 INFO:tasks.workunit.client.0.smithi049.stdout:3/553: symlink d2/d14/d44/d52/lc3 0 2024-06-03T00:03:09.479 INFO:tasks.workunit.client.0.smithi049.stdout:6/750: mknod d2/d3b/c100 0 2024-06-03T00:03:09.480 INFO:tasks.workunit.client.0.smithi049.stdout:0/515: write d6/d30/f44 [3332841,130532] 0 2024-06-03T00:03:09.480 INFO:tasks.workunit.client.0.smithi049.stdout:3/554: creat d2/d14/d44/d52/fc4 x:0 0 0 2024-06-03T00:03:09.483 INFO:tasks.workunit.client.0.smithi049.stdout:7/608: dread d3/dd8/d13/d3c/d4b/d5a/fa1 [0,4194304] 0 2024-06-03T00:03:09.483 INFO:tasks.workunit.client.0.smithi049.stdout:7/609: chown d3/dd8/d3f/c9d 6994 1 2024-06-03T00:03:09.483 INFO:tasks.workunit.client.0.smithi049.stdout:4/643: read d4/d3f/d14/fcf [2355940,18503] 0 2024-06-03T00:03:09.483 INFO:tasks.workunit.client.0.smithi049.stdout:4/644: chown d4/d3f/d14/d2b/d84/d69/d89/cb8 1 1 2024-06-03T00:03:09.483 INFO:tasks.workunit.client.0.smithi049.stdout:6/751: creat d2/d3/d17/d57/d6e/d88/dcc/df8/f101 x:0 0 0 2024-06-03T00:03:09.483 INFO:tasks.workunit.client.0.smithi049.stdout:6/752: chown d2/d4d/de3 9145173 1 2024-06-03T00:03:09.483 INFO:tasks.workunit.client.0.smithi049.stdout:4/645: write d4/d3f/f79 [253292,2832] 0 2024-06-03T00:03:09.483 INFO:tasks.workunit.client.0.smithi049.stdout:6/753: fdatasync d2/d3/d9/d23/d29/fe7 0 2024-06-03T00:03:09.484 INFO:tasks.workunit.client.0.smithi049.stdout:4/646: mkdir d4/d2a/ddf 0 2024-06-03T00:03:09.486 INFO:tasks.workunit.client.0.smithi049.stdout:0/516: rename d6/f16 to d6/fb2 0 2024-06-03T00:03:09.486 INFO:tasks.workunit.client.0.smithi049.stdout:0/517: truncate d6/f21 5159687 0 2024-06-03T00:03:09.487 INFO:tasks.workunit.client.0.smithi049.stdout:4/647: rename d4/d3f/d14/cbf to d4/d3f/d14/d2b/ce0 0 2024-06-03T00:03:09.487 INFO:tasks.workunit.client.0.smithi049.stdout:4/648: write d4/fc [1841208,50473] 0 2024-06-03T00:03:09.487 INFO:tasks.workunit.client.0.smithi049.stdout:4/649: dread - d4/d3f/d14/d2b/d84/fdc zero size 2024-06-03T00:03:09.487 INFO:tasks.workunit.client.0.smithi049.stdout:7/610: mkdir d3/dd8/d13/d54/ddc 0 2024-06-03T00:03:09.488 INFO:tasks.workunit.client.0.smithi049.stdout:0/518: mknod d6/d29/cb3 0 2024-06-03T00:03:09.490 INFO:tasks.workunit.client.0.smithi049.stdout:0/519: mkdir d6/d59/d93/db4 0 2024-06-03T00:03:09.490 INFO:tasks.workunit.client.0.smithi049.stdout:7/611: dread d3/fac [0,4194304] 0 2024-06-03T00:03:09.490 INFO:tasks.workunit.client.0.smithi049.stdout:0/520: chown d6/d59/d93/f99 32 1 2024-06-03T00:03:09.490 INFO:tasks.workunit.client.0.smithi049.stdout:0/521: chown d6/d97/d4b/d67/d6e/c58 24817290 1 2024-06-03T00:03:09.490 INFO:tasks.workunit.client.0.smithi049.stdout:4/650: getdents d4/d3f/d14/d7f/ddb/d8a 0 2024-06-03T00:03:09.491 INFO:tasks.workunit.client.0.smithi049.stdout:7/612: link d3/dd8/d13/d3c/d4b/d8e/ca4 d3/dd8/d86/d8d/cdd 0 2024-06-03T00:03:09.492 INFO:tasks.workunit.client.0.smithi049.stdout:4/651: mknod d4/d3f/d14/d7f/ce1 0 2024-06-03T00:03:09.492 INFO:tasks.workunit.client.0.smithi049.stdout:4/652: fdatasync d4/d3f/d14/d2b/f48 0 2024-06-03T00:03:09.493 INFO:tasks.workunit.client.0.smithi049.stdout:6/754: read d2/ff9 [2047348,32652] 0 2024-06-03T00:03:09.493 INFO:tasks.workunit.client.0.smithi049.stdout:0/522: mknod d6/d59/cb5 0 2024-06-03T00:03:09.493 INFO:tasks.workunit.client.0.smithi049.stdout:0/523: stat d6/c77 0 2024-06-03T00:03:09.493 INFO:tasks.workunit.client.0.smithi049.stdout:0/524: chown d6/d97/d4b/d67/d6e/d52/f5c 8 1 2024-06-03T00:03:09.494 INFO:tasks.workunit.client.0.smithi049.stdout:4/653: symlink d4/d3f/d14/d7f/ddb/le2 0 2024-06-03T00:03:09.494 INFO:tasks.workunit.client.0.smithi049.stdout:4/654: fdatasync d4/d3f/d14/d7f/ddb/dc2/fa7 0 2024-06-03T00:03:09.494 INFO:tasks.workunit.client.0.smithi049.stdout:6/755: mkdir d2/d3/d9/d23/d48/d89/d102 0 2024-06-03T00:03:09.494 INFO:tasks.workunit.client.0.smithi049.stdout:6/756: fdatasync d2/d3/d9/d23/fc3 0 2024-06-03T00:03:09.495 INFO:tasks.workunit.client.0.smithi049.stdout:0/525: rename d6/d30/f3b to d6/d59/fb6 0 2024-06-03T00:03:09.497 INFO:tasks.workunit.client.0.smithi049.stdout:6/757: mkdir d2/d3b/d103 0 2024-06-03T00:03:09.497 INFO:tasks.workunit.client.0.smithi049.stdout:6/758: readlink d2/d3/d9/d23/ld8 0 2024-06-03T00:03:09.497 INFO:tasks.workunit.client.0.smithi049.stdout:6/759: fdatasync d2/d3/d9/fd7 0 2024-06-03T00:03:09.498 INFO:tasks.workunit.client.0.smithi049.stdout:0/526: creat d6/d97/d4b/fb7 x:0 0 0 2024-06-03T00:03:09.499 INFO:tasks.workunit.client.0.smithi049.stdout:9/758: dwrite d1/da/d26/f32 [8388608,4194304] 0 2024-06-03T00:03:09.499 INFO:tasks.workunit.client.0.smithi049.stdout:9/759: write d1/d5/d13/d3b/d49/fd3 [193714,95960] 0 2024-06-03T00:03:09.499 INFO:tasks.workunit.client.0.smithi049.stdout:6/760: link d2/d3b/fd1 d2/d4d/d76/dfd/f104 0 2024-06-03T00:03:09.500 INFO:tasks.workunit.client.0.smithi049.stdout:8/491: dwrite d4/d27/d3c/d88/f1b [0,4194304] 0 2024-06-03T00:03:09.500 INFO:tasks.workunit.client.0.smithi049.stdout:0/527: link d6/d97/d4b/d67/d6e/c25 d6/d56/cb8 0 2024-06-03T00:03:09.504 INFO:tasks.workunit.client.0.smithi049.stdout:6/761: truncate d2/d3/d9/d23/f1e 2086994 0 2024-06-03T00:03:09.504 INFO:tasks.workunit.client.0.smithi049.stdout:9/760: link d1/d95/l9e d1/d5/d13/d3b/d49/lff 0 2024-06-03T00:03:09.504 INFO:tasks.workunit.client.0.smithi049.stdout:9/761: chown d1/da/da8/d5f/d81/fcb 416 1 2024-06-03T00:03:09.504 INFO:tasks.workunit.client.0.smithi049.stdout:9/762: fdatasync d1/d5/d13/de3/dfe/d87/fb7 0 2024-06-03T00:03:09.505 INFO:tasks.workunit.client.0.smithi049.stdout:3/555: dwrite d2/d14/f24 [0,4194304] 0 2024-06-03T00:03:09.505 INFO:tasks.workunit.client.0.smithi049.stdout:8/492: creat d4/f9d x:0 0 0 2024-06-03T00:03:09.505 INFO:tasks.workunit.client.0.smithi049.stdout:8/493: chown d4/d27/d3c/d88/d28/f86 81152228 1 2024-06-03T00:03:09.505 INFO:tasks.workunit.client.0.smithi049.stdout:8/494: dread - d4/d27/d3c/d88/d28/d52/d66/d53/f82 zero size 2024-06-03T00:03:09.507 INFO:tasks.workunit.client.0.smithi049.stdout:3/556: mkdir d2/d14/d22/d3a/d47/d79/dc5 0 2024-06-03T00:03:09.507 INFO:tasks.workunit.client.0.smithi049.stdout:3/557: chown d2/d14/d44/fb8 9596815 1 2024-06-03T00:03:09.507 INFO:tasks.workunit.client.0.smithi049.stdout:3/558: chown d2/d14/f2e 11663 1 2024-06-03T00:03:09.516 INFO:tasks.workunit.client.0.smithi049.stdout:6/762: dread d2/d3/d17/d57/f8c [0,4194304] 0 2024-06-03T00:03:09.517 INFO:tasks.workunit.client.0.smithi049.stdout:4/655: dwrite d4/d2a/f6d [4194304,4194304] 0 2024-06-03T00:03:09.517 INFO:tasks.workunit.client.0.smithi049.stdout:4/656: chown d4/d3f/d14/fc1 0 1 2024-06-03T00:03:09.518 INFO:tasks.workunit.client.0.smithi049.stdout:8/495: dread d4/d27/d3c/d88/d28/d45/f6a [0,4194304] 0 2024-06-03T00:03:09.518 INFO:tasks.workunit.client.0.smithi049.stdout:8/496: fsync d4/d27/d3c/d88/d28/d52/d66/d53/f40 0 2024-06-03T00:03:09.518 INFO:tasks.workunit.client.0.smithi049.stdout:8/497: read - d4/d27/d3c/d88/d28/d52/d66/d53/d7e/f64 zero size 2024-06-03T00:03:09.518 INFO:tasks.workunit.client.0.smithi049.stdout:6/763: mknod d2/d3/d9/d23/d29/d6a/c105 0 2024-06-03T00:03:09.518 INFO:tasks.workunit.client.0.smithi049.stdout:4/657: rmdir d4/d3f/d14/d2b/d84/d1c/d24/d43 39 2024-06-03T00:03:09.519 INFO:tasks.workunit.client.0.smithi049.stdout:8/498: truncate d4/d27/d3c/d88/d28/d52/f65 3686047 0 2024-06-03T00:03:09.519 INFO:tasks.workunit.client.0.smithi049.stdout:4/658: creat d4/d3f/d14/d7f/ddb/d8a/fe3 x:0 0 0 2024-06-03T00:03:09.519 INFO:tasks.workunit.client.0.smithi049.stdout:4/659: chown d4/d3f/d14/d7f/ddb/le2 7399 1 2024-06-03T00:03:09.519 INFO:tasks.workunit.client.0.smithi049.stdout:4/660: fsync d4/f23 0 2024-06-03T00:03:09.520 INFO:tasks.workunit.client.0.smithi049.stdout:6/764: unlink d2/d3/d9/d23/d48/d51/f83 0 2024-06-03T00:03:09.520 INFO:tasks.workunit.client.0.smithi049.stdout:6/765: chown d2/d3/d9/d23/d29/ca0 225559 1 2024-06-03T00:03:09.520 INFO:tasks.workunit.client.0.smithi049.stdout:6/766: fsync d2/d3/d17/d64/fc8 0 2024-06-03T00:03:09.520 INFO:tasks.workunit.client.0.smithi049.stdout:6/767: fdatasync d2/d3/d17/d57/d6e/d88/fa7 0 2024-06-03T00:03:09.520 INFO:tasks.workunit.client.0.smithi049.stdout:6/768: fdatasync d2/d3/d17/d57/d6e/fef 0 2024-06-03T00:03:09.521 INFO:tasks.workunit.client.0.smithi049.stdout:8/499: link d4/d27/d3c/d88/d28/d45/f49 d4/d27/d3c/d88/d28/d2b/d84/f9e 0 2024-06-03T00:03:09.521 INFO:tasks.workunit.client.0.smithi049.stdout:8/500: dread - d4/d27/d3c/d88/d28/d52/f76 zero size 2024-06-03T00:03:09.522 INFO:tasks.workunit.client.0.smithi049.stdout:4/661: creat d4/d3f/d14/d2b/d84/d69/fe4 x:0 0 0 2024-06-03T00:03:09.522 INFO:tasks.workunit.client.0.smithi049.stdout:4/662: fdatasync d4/d2a/f5d 0 2024-06-03T00:03:09.522 INFO:tasks.workunit.client.0.smithi049.stdout:4/663: write d4/d3f/d14/d2b/d84/fdc [736011,51089] 0 2024-06-03T00:03:09.522 INFO:tasks.workunit.client.0.smithi049.stdout:4/664: chown d4/d3f/d14/d2b/d84/d69/d89/cce 39585 1 2024-06-03T00:03:09.522 INFO:tasks.workunit.client.0.smithi049.stdout:4/665: symlink d4/d3f/d14/d7f/le5 0 2024-06-03T00:03:09.522 INFO:tasks.workunit.client.0.smithi049.stdout:4/666: read d4/d3f/d14/d2b/d84/d69/f72 [94324,125432] 0 2024-06-03T00:03:09.522 INFO:tasks.workunit.client.0.smithi049.stdout:4/667: chown d4/d2a/d76/l91 424589 1 2024-06-03T00:03:09.522 INFO:tasks.workunit.client.0.smithi049.stdout:6/769: creat d2/d3/d17/ddd/f106 x:0 0 0 2024-06-03T00:03:09.522 INFO:tasks.workunit.client.0.smithi049.stdout:6/770: write d2/d3b/fed [5646335,51615] 0 2024-06-03T00:03:09.524 INFO:tasks.workunit.client.0.smithi049.stdout:4/668: rename d4/d3f/d14/d2b/d84/d69/d89/fb2 to d4/d3f/d14/fe6 0 2024-06-03T00:03:09.524 INFO:tasks.workunit.client.0.smithi049.stdout:4/669: write d4/d3f/d14/d2b/d84/f8d [136886,116296] 0 2024-06-03T00:03:09.524 INFO:tasks.workunit.client.0.smithi049.stdout:7/613: dwrite d3/dd8/d9/d91/fa0 [0,4194304] 0 2024-06-03T00:03:09.525 INFO:tasks.workunit.client.0.smithi049.stdout:6/771: creat d2/f107 x:0 0 0 2024-06-03T00:03:09.525 INFO:tasks.workunit.client.0.smithi049.stdout:6/772: truncate d2/d3/d9/d23/d48/ff1 338451 0 2024-06-03T00:03:09.525 INFO:tasks.workunit.client.0.smithi049.stdout:6/773: write d2/d3/d9/d23/d29/f59 [283203,81366] 0 2024-06-03T00:03:09.527 INFO:tasks.workunit.client.0.smithi049.stdout:4/670: rename d4/d2a/d76/l91 to d4/d3f/d14/d7f/ddb/dc2/le7 0 2024-06-03T00:03:09.530 INFO:tasks.workunit.client.0.smithi049.stdout:4/671: creat d4/d3f/d14/d2b/d84/d1c/d24/d43/daf/fe8 x:0 0 0 2024-06-03T00:03:09.530 INFO:tasks.workunit.client.0.smithi049.stdout:4/672: readlink d4/d2a/l41 0 2024-06-03T00:03:09.531 INFO:tasks.workunit.client.0.smithi049.stdout:4/673: mknod d4/d3f/d14/d2b/d84/d69/dc6/dd3/ce9 0 2024-06-03T00:03:09.531 INFO:tasks.workunit.client.0.smithi049.stdout:4/674: chown d4/d3f/d14/d2b/d84/d69/dc6 6185 1 2024-06-03T00:03:09.533 INFO:tasks.workunit.client.0.smithi049.stdout:4/675: link d4/d3f/d14/d7f/d87/cdd d4/d3f/d14/d7f/ddb/dc2/cea 0 2024-06-03T00:03:09.534 INFO:tasks.workunit.client.0.smithi049.stdout:4/676: symlink d4/d3f/d14/d2b/d84/d69/leb 0 2024-06-03T00:03:09.535 INFO:tasks.workunit.client.0.smithi049.stdout:4/677: symlink d4/d3f/d14/d7f/d87/lec 0 2024-06-03T00:03:09.535 INFO:tasks.workunit.client.0.smithi049.stdout:4/678: dread - d4/d2a/fbb zero size 2024-06-03T00:03:09.537 INFO:tasks.workunit.client.0.smithi049.stdout:4/679: mkdir d4/d3f/d14/d2b/d84/d1c/d4f/ded 0 2024-06-03T00:03:09.537 INFO:tasks.workunit.client.0.smithi049.stdout:4/680: write d4/d3f/d14/d2b/d84/d1c/d24/d43/daf/fe8 [1039355,99811] 0 2024-06-03T00:03:09.537 INFO:tasks.workunit.client.0.smithi049.stdout:4/681: fsync d4/d3f/d14/d2b/d84/d69/dc6/f6a 0 2024-06-03T00:03:09.537 INFO:tasks.workunit.client.0.smithi049.stdout:4/682: chown d4/c59 32799 1 2024-06-03T00:03:09.537 INFO:tasks.workunit.client.0.smithi049.stdout:6/774: dread d2/d3/d9/fc7 [0,4194304] 0 2024-06-03T00:03:09.537 INFO:tasks.workunit.client.0.smithi049.stdout:4/683: mknod d4/d3f/d14/d2b/d84/d1c/d4f/ded/cee 0 2024-06-03T00:03:09.543 INFO:tasks.workunit.client.0.smithi049.stdout:9/763: dwrite d1/d5/d13/d3b/dad/fb3 [0,4194304] 0 2024-06-03T00:03:09.543 INFO:tasks.workunit.client.0.smithi049.stdout:9/764: write d1/da/da8/fe7 [329652,43624] 0 2024-06-03T00:03:09.543 INFO:tasks.workunit.client.0.smithi049.stdout:0/528: dwrite d6/d30/f27 [0,4194304] 0 2024-06-03T00:03:09.543 INFO:tasks.workunit.client.0.smithi049.stdout:0/529: dread - d6/d59/d93/f9d zero size 2024-06-03T00:03:09.543 INFO:tasks.workunit.client.0.smithi049.stdout:0/530: fdatasync d6/d59/fb6 0 2024-06-03T00:03:09.545 INFO:tasks.workunit.client.0.smithi049.stdout:3/559: dwrite d2/d14/d22/fa7 [0,4194304] 0 2024-06-03T00:03:09.545 INFO:tasks.workunit.client.0.smithi049.stdout:9/765: rmdir d1/da/d54 39 2024-06-03T00:03:09.547 INFO:tasks.workunit.client.0.smithi049.stdout:0/531: rename d6/d56 to d6/d97/d4b/d67/d6e/d52/d96/db9 0 2024-06-03T00:03:09.547 INFO:tasks.workunit.client.0.smithi049.stdout:0/532: fdatasync d6/d30/f8e 0 2024-06-03T00:03:09.547 INFO:tasks.workunit.client.0.smithi049.stdout:0/533: dread - d6/d97/d4b/d67/d6e/d52/d96/db9/fa4 zero size 2024-06-03T00:03:09.547 INFO:tasks.workunit.client.0.smithi049.stdout:0/534: readlink d6/l8d 0 2024-06-03T00:03:09.547 INFO:tasks.workunit.client.0.smithi049.stdout:8/501: dwrite d4/f15 [0,4194304] 0 2024-06-03T00:03:09.547 INFO:tasks.workunit.client.0.smithi049.stdout:8/502: fdatasync d4/d27/d3c/d88/f1e 0 2024-06-03T00:03:09.549 INFO:tasks.workunit.client.0.smithi049.stdout:3/560: truncate d2/d1a/f65 5854689 0 2024-06-03T00:03:09.550 INFO:tasks.workunit.client.0.smithi049.stdout:9/766: mknod d1/da/da8/d50/d70/c100 0 2024-06-03T00:03:09.551 INFO:tasks.workunit.client.0.smithi049.stdout:8/503: creat d4/d27/d3c/d88/d28/d25/f9f x:0 0 0 2024-06-03T00:03:09.551 INFO:tasks.workunit.client.0.smithi049.stdout:8/504: dread - d4/d27/d3c/d88/d28/d52/f76 zero size 2024-06-03T00:03:09.551 INFO:tasks.workunit.client.0.smithi049.stdout:4/684: dread d4/d3f/d14/d2b/d84/d1c/f1f [0,4194304] 0 2024-06-03T00:03:09.552 INFO:tasks.workunit.client.0.smithi049.stdout:4/685: readlink d4/d2a/ld4 0 2024-06-03T00:03:09.552 INFO:tasks.workunit.client.0.smithi049.stdout:3/561: getdents d2/d1a/d34 0 2024-06-03T00:03:09.552 INFO:tasks.workunit.client.0.smithi049.stdout:3/562: chown d2/d1a/d51/d83/cbf 61 1 2024-06-03T00:03:09.552 INFO:tasks.workunit.client.0.smithi049.stdout:9/767: link d1/d5/d13/d3b/l92 d1/d5/d13/d3b/d49/l101 0 2024-06-03T00:03:09.553 INFO:tasks.workunit.client.0.smithi049.stdout:4/686: creat d4/d3f/d14/d2b/d84/d69/dc6/dd3/fef x:0 0 0 2024-06-03T00:03:09.553 INFO:tasks.workunit.client.0.smithi049.stdout:8/505: mkdir d4/d27/d3c/d88/d28/d25/da0 0 2024-06-03T00:03:09.556 INFO:tasks.workunit.client.0.smithi049.stdout:3/563: mkdir d2/d1a/d76/dc6 0 2024-06-03T00:03:09.556 INFO:tasks.workunit.client.0.smithi049.stdout:9/768: creat d1/d5/d13/f102 x:0 0 0 2024-06-03T00:03:09.557 INFO:tasks.workunit.client.0.smithi049.stdout:8/506: symlink d4/d27/la1 0 2024-06-03T00:03:09.559 INFO:tasks.workunit.client.0.smithi049.stdout:4/687: symlink d4/d3f/d14/d7f/ddb/dc2/lf0 0 2024-06-03T00:03:09.559 INFO:tasks.workunit.client.0.smithi049.stdout:4/688: chown d4/d3f/la1 11 1 2024-06-03T00:03:09.559 INFO:tasks.workunit.client.0.smithi049.stdout:3/564: creat d2/d14/fc7 x:0 0 0 2024-06-03T00:03:09.559 INFO:tasks.workunit.client.0.smithi049.stdout:6/775: dwrite d2/d3b/fd1 [0,4194304] 0 2024-06-03T00:03:09.560 INFO:tasks.workunit.client.0.smithi049.stdout:3/565: getdents d2/d14/d44/d52/d4c/d4b 0 2024-06-03T00:03:09.560 INFO:tasks.workunit.client.0.smithi049.stdout:9/769: mkdir d1/d5/d13/d103 0 2024-06-03T00:03:09.561 INFO:tasks.workunit.client.0.smithi049.stdout:6/776: symlink d2/d4d/d76/de4/l108 0 2024-06-03T00:03:09.563 INFO:tasks.workunit.client.0.smithi049.stdout:6/777: unlink d2/d3/d17/d57/f8c 0 2024-06-03T00:03:09.563 INFO:tasks.workunit.client.0.smithi049.stdout:6/778: fdatasync d2/d3/d9/f71 0 2024-06-03T00:03:09.563 INFO:tasks.workunit.client.0.smithi049.stdout:6/779: chown d2/d3/d9/d23/d29/d30/c9c 166429 1 2024-06-03T00:03:09.563 INFO:tasks.workunit.client.0.smithi049.stdout:3/566: rename d2/d14/d44/d52/d4c/l27 to d2/d14/d22/d3a/d47/d79/lc8 0 2024-06-03T00:03:09.564 INFO:tasks.workunit.client.0.smithi049.stdout:4/689: mkdir d4/d3f/d14/d2b/d84/d69/d89/df1 0 2024-06-03T00:03:09.565 INFO:tasks.workunit.client.0.smithi049.stdout:3/567: mknod d2/d14/d22/cc9 0 2024-06-03T00:03:09.565 INFO:tasks.workunit.client.0.smithi049.stdout:3/568: dread - d2/d14/d22/d42/d8f/fb4 zero size 2024-06-03T00:03:09.565 INFO:tasks.workunit.client.0.smithi049.stdout:3/569: chown d2/fbd 0 1 2024-06-03T00:03:09.566 INFO:tasks.workunit.client.0.smithi049.stdout:9/770: rename d1/da/d54/l93 to d1/da/d54/d5b/l104 0 2024-06-03T00:03:09.570 INFO:tasks.workunit.client.0.smithi049.stdout:9/771: truncate d1/da/da8/d5f/f7d 3225774 0 2024-06-03T00:03:09.573 INFO:tasks.workunit.client.0.smithi049.stdout:9/772: creat d1/d5/d13/f105 x:0 0 0 2024-06-03T00:03:09.578 INFO:tasks.workunit.client.0.smithi049.stdout:9/773: dread d1/faf [0,4194304] 0 2024-06-03T00:03:09.578 INFO:tasks.workunit.client.0.smithi049.stdout:9/774: truncate d1/da/d26/fd9 841375 0 2024-06-03T00:03:09.578 INFO:tasks.workunit.client.0.smithi049.stdout:9/775: readlink d1/da/da8/d5f/l8b 0 2024-06-03T00:03:09.579 INFO:tasks.workunit.client.0.smithi049.stdout:9/776: dread d1/da/d54/fc2 [0,4194304] 0 2024-06-03T00:03:09.580 INFO:tasks.workunit.client.0.smithi049.stdout:4/690: read d4/d3f/d14/d7f/ddb/fbd [18877,31808] 0 2024-06-03T00:03:09.581 INFO:tasks.workunit.client.0.smithi049.stdout:9/777: mkdir d1/da/d54/d5b/d106 0 2024-06-03T00:03:09.583 INFO:tasks.workunit.client.0.smithi049.stdout:4/691: mknod d4/d3f/d14/d7f/ddb/dc2/cf2 0 2024-06-03T00:03:09.583 INFO:tasks.workunit.client.0.smithi049.stdout:4/692: write d4/d3f/d14/fe6 [388179,42972] 0 2024-06-03T00:03:09.583 INFO:tasks.workunit.client.0.smithi049.stdout:4/693: fdatasync d4/d3f/d14/d2b/d84/d69/dc6/f78 0 2024-06-03T00:03:09.584 INFO:tasks.workunit.client.0.smithi049.stdout:9/778: mknod d1/da/dbf/c107 0 2024-06-03T00:03:09.586 INFO:tasks.workunit.client.0.smithi049.stdout:4/694: link d4/d3f/d14/d2b/d84/d69/d89/cce d4/cf3 0 2024-06-03T00:03:09.588 INFO:tasks.workunit.client.0.smithi049.stdout:9/779: creat d1/d5/d13/de3/f108 x:0 0 0 2024-06-03T00:03:09.589 INFO:tasks.workunit.client.0.smithi049.stdout:4/695: rmdir d4/d3f/d14/d2b/d84/d69/d89 39 2024-06-03T00:03:09.591 INFO:tasks.workunit.client.0.smithi049.stdout:9/780: link d1/d5/d13/d3b/d7f/dbc/dfc/c31 d1/d5/d13/d3b/dbb/c109 0 2024-06-03T00:03:09.593 INFO:tasks.workunit.client.0.smithi049.stdout:4/696: creat d4/d3f/d14/d2b/ff4 x:0 0 0 2024-06-03T00:03:09.593 INFO:tasks.workunit.client.0.smithi049.stdout:4/697: chown d4/d3f/d14/l5e 15743 1 2024-06-03T00:03:09.594 INFO:tasks.workunit.client.0.smithi049.stdout:6/780: dwrite d2/d3/d9/d23/d48/d51/fc0 [0,4194304] 0 2024-06-03T00:03:09.594 INFO:tasks.workunit.client.0.smithi049.stdout:8/507: dwrite d4/d27/d3c/d88/d28/f46 [0,4194304] 0 2024-06-03T00:03:09.594 INFO:tasks.workunit.client.0.smithi049.stdout:0/535: dwrite d6/d59/d72/f86 [0,4194304] 0 2024-06-03T00:03:09.595 INFO:tasks.workunit.client.0.smithi049.stdout:8/508: rmdir d4/d27/d3c/d88/d28/d52/d66 39 2024-06-03T00:03:09.596 INFO:tasks.workunit.client.0.smithi049.stdout:6/781: mkdir d2/d3/d17/d64/d109 0 2024-06-03T00:03:09.596 INFO:tasks.workunit.client.0.smithi049.stdout:3/570: dwrite d2/d14/d44/fa5 [0,4194304] 0 2024-06-03T00:03:09.599 INFO:tasks.workunit.client.0.smithi049.stdout:3/571: getdents d2/d1a/d31 0 2024-06-03T00:03:09.601 INFO:tasks.workunit.client.0.smithi049.stdout:1/835: sync 2024-06-03T00:03:09.601 INFO:tasks.workunit.client.0.smithi049.stdout:3/572: unlink d2/d14/d22/d42/f38 0 2024-06-03T00:03:09.601 INFO:tasks.workunit.client.0.smithi049.stdout:5/616: sync 2024-06-03T00:03:09.601 INFO:tasks.workunit.client.0.smithi049.stdout:2/645: sync 2024-06-03T00:03:09.602 INFO:tasks.workunit.client.0.smithi049.stdout:0/536: creat d6/d59/d93/db4/fba x:0 0 0 2024-06-03T00:03:09.603 INFO:tasks.workunit.client.0.smithi049.stdout:5/617: mkdir d3/d53/dc1 0 2024-06-03T00:03:09.603 INFO:tasks.workunit.client.0.smithi049.stdout:5/618: read - d3/d53/d9c/da4/fb5 zero size 2024-06-03T00:03:09.603 INFO:tasks.workunit.client.0.smithi049.stdout:5/619: write d3/d5/da/d55/d14/f60 [118483,4848] 0 2024-06-03T00:03:09.603 INFO:tasks.workunit.client.0.smithi049.stdout:5/620: write d3/d5/da/d55/d75/fa0 [114549,24251] 0 2024-06-03T00:03:09.603 INFO:tasks.workunit.client.0.smithi049.stdout:1/836: symlink d1/d2f/d36/d37/d64/l12b 0 2024-06-03T00:03:09.604 INFO:tasks.workunit.client.0.smithi049.stdout:5/621: write d3/d5/d9a/fb3 [139739,106716] 0 2024-06-03T00:03:09.605 INFO:tasks.workunit.client.0.smithi049.stdout:2/646: symlink da/d52/d40/d93/lc8 0 2024-06-03T00:03:09.606 INFO:tasks.workunit.client.0.smithi049.stdout:2/647: chown da/d52/df/d3c/da8 8731696 1 2024-06-03T00:03:09.606 INFO:tasks.workunit.client.0.smithi049.stdout:5/622: mknod d3/d5/d2d/d4b/d51/cc2 0 2024-06-03T00:03:09.607 INFO:tasks.workunit.client.0.smithi049.stdout:6/782: creat d2/d3/d9/d23/d48/f10a x:0 0 0 2024-06-03T00:03:09.607 INFO:tasks.workunit.client.0.smithi049.stdout:2/648: creat da/d52/d40/d93/fc9 x:0 0 0 2024-06-03T00:03:09.608 INFO:tasks.workunit.client.0.smithi049.stdout:5/623: creat d3/d5/d2d/d4b/d97/dbf/fc3 x:0 0 0 2024-06-03T00:03:09.609 INFO:tasks.workunit.client.0.smithi049.stdout:5/624: rmdir d3/d5/d2d 39 2024-06-03T00:03:09.610 INFO:tasks.workunit.client.0.smithi049.stdout:0/537: write f4 [2732191,117864] 0 2024-06-03T00:03:09.610 INFO:tasks.workunit.client.0.smithi049.stdout:0/538: dread - d6/d30/f8e zero size 2024-06-03T00:03:09.611 INFO:tasks.workunit.client.0.smithi049.stdout:2/649: mkdir da/d52/d37/d59/dca 0 2024-06-03T00:03:09.612 INFO:tasks.workunit.client.0.smithi049.stdout:5/625: unlink d3/d5/da/d55/d14/d16/f80 0 2024-06-03T00:03:09.612 INFO:tasks.workunit.client.0.smithi049.stdout:6/783: dread d2/d3/d17/d57/d6e/d88/fa7 [0,4194304] 0 2024-06-03T00:03:09.613 INFO:tasks.workunit.client.0.smithi049.stdout:2/650: dread da/d72/f81 [0,4194304] 0 2024-06-03T00:03:09.614 INFO:tasks.workunit.client.0.smithi049.stdout:5/626: creat d3/d9/d20/d4c/d5a/d6f/fc4 x:0 0 0 2024-06-03T00:03:09.614 INFO:tasks.workunit.client.0.smithi049.stdout:6/784: getdents d2/d3/d17/d57 0 2024-06-03T00:03:09.615 INFO:tasks.workunit.client.0.smithi049.stdout:6/785: rmdir d2/d3/d17/d57/d6e/d88 39 2024-06-03T00:03:09.615 INFO:tasks.workunit.client.0.smithi049.stdout:6/786: stat d2/d3/d9/d55/l68 0 2024-06-03T00:03:09.616 INFO:tasks.workunit.client.0.smithi049.stdout:1/837: write d1/d2f/d36/d37/d2c/d45/d61/d70/f82 [1184118,93608] 0 2024-06-03T00:03:09.616 INFO:tasks.workunit.client.0.smithi049.stdout:2/651: dread da/d43/f7e [0,4194304] 0 2024-06-03T00:03:09.617 INFO:tasks.workunit.client.0.smithi049.stdout:5/627: link d3/d5/da/d55/d14/d16/f34 d3/d5/d9a/fc5 0 2024-06-03T00:03:09.617 INFO:tasks.workunit.client.0.smithi049.stdout:5/628: write d3/d5/da/d55/d14/d16/f8e [1009096,53379] 0 2024-06-03T00:03:09.618 INFO:tasks.workunit.client.0.smithi049.stdout:4/698: rename d4/d3f/d14/d2b/d84/d69/d89 to d4/d3f/d14/d7f/ddb/df5 0 2024-06-03T00:03:09.618 INFO:tasks.workunit.client.0.smithi049.stdout:5/629: creat d3/d7d/fc6 x:0 0 0 2024-06-03T00:03:09.622 INFO:tasks.workunit.client.0.smithi049.stdout:2/652: link da/d52/d37/f84 da/fcb 0 2024-06-03T00:03:09.622 INFO:tasks.workunit.client.0.smithi049.stdout:2/653: fdatasync da/d52/f39 0 2024-06-03T00:03:09.622 INFO:tasks.workunit.client.0.smithi049.stdout:2/654: fdatasync da/fcb 0 2024-06-03T00:03:09.623 INFO:tasks.workunit.client.0.smithi049.stdout:9/781: dwrite d1/f8 [0,4194304] 0 2024-06-03T00:03:09.623 INFO:tasks.workunit.client.0.smithi049.stdout:9/782: fdatasync d1/da/d27/f40 0 2024-06-03T00:03:09.626 INFO:tasks.workunit.client.0.smithi049.stdout:6/787: dread d2/d3/d17/d57/d6e/fad [0,4194304] 0 2024-06-03T00:03:09.629 INFO:tasks.workunit.client.0.smithi049.stdout:8/509: dwrite d4/d27/d3c/d88/d28/d25/f39 [0,4194304] 0 2024-06-03T00:03:09.635 INFO:tasks.workunit.client.0.smithi049.stdout:0/539: dwrite d6/d29/f33 [0,4194304] 0 2024-06-03T00:03:09.636 INFO:tasks.workunit.client.0.smithi049.stdout:0/540: creat d6/d29/fbb x:0 0 0 2024-06-03T00:03:09.638 INFO:tasks.workunit.client.0.smithi049.stdout:1/838: dwrite d1/d2f/d78/f98 [0,4194304] 0 2024-06-03T00:03:09.638 INFO:tasks.workunit.client.0.smithi049.stdout:1/839: chown d1/d2f/d36/d37/d13/d34/c5b 402 1 2024-06-03T00:03:09.640 INFO:tasks.workunit.client.0.smithi049.stdout:9/783: dread d1/d5/d13/de3/dfe/d87/fb7 [0,4194304] 0 2024-06-03T00:03:09.640 INFO:tasks.workunit.client.0.smithi049.stdout:9/784: chown d1/da/da8/d50/dda/cde 3 1 2024-06-03T00:03:09.646 INFO:tasks.workunit.client.0.smithi049.stdout:9/785: mknod d1/d95/c10a 0 2024-06-03T00:03:09.646 INFO:tasks.workunit.client.0.smithi049.stdout:9/786: read - d1/d5/d13/de3/de8/ffd zero size 2024-06-03T00:03:09.647 INFO:tasks.workunit.client.0.smithi049.stdout:0/541: dread d6/d29/f79 [0,4194304] 0 2024-06-03T00:03:09.647 INFO:tasks.workunit.client.0.smithi049.stdout:0/542: chown d6/d30/d32/f40 8 1 2024-06-03T00:03:09.652 INFO:tasks.workunit.client.0.smithi049.stdout:1/840: read d1/d2f/d36/d37/d13/d34/f3f [735281,51964] 0 2024-06-03T00:03:09.652 INFO:tasks.workunit.client.0.smithi049.stdout:9/787: rmdir d1/d5/d13/d3b/d7f 39 2024-06-03T00:03:09.654 INFO:tasks.workunit.client.0.smithi049.stdout:5/630: dwrite d3/d9/d20/d4c/d5a/d6f/f8b [4194304,4194304] 0 2024-06-03T00:03:09.655 INFO:tasks.workunit.client.0.smithi049.stdout:1/841: truncate d1/d2f/d36/d57/d72/fdd 606649 0 2024-06-03T00:03:09.655 INFO:tasks.workunit.client.0.smithi049.stdout:4/699: dwrite d4/d3f/fd2 [0,4194304] 0 2024-06-03T00:03:09.656 INFO:tasks.workunit.client.0.smithi049.stdout:5/631: creat d3/d5/fc7 x:0 0 0 2024-06-03T00:03:09.657 INFO:tasks.workunit.client.0.smithi049.stdout:9/788: rename d1/da/d54/f76 to d1/da/d54/d5b/d106/f10b 0 2024-06-03T00:03:09.658 INFO:tasks.workunit.client.0.smithi049.stdout:2/655: dwrite da/f24 [0,4194304] 0 2024-06-03T00:03:09.660 INFO:tasks.workunit.client.0.smithi049.stdout:0/543: dread d6/f61 [0,4194304] 0 2024-06-03T00:03:09.660 INFO:tasks.workunit.client.0.smithi049.stdout:1/842: symlink d1/d2f/df7/l12c 0 2024-06-03T00:03:09.663 INFO:tasks.workunit.client.0.smithi049.stdout:5/632: unlink d3/d9/d20/d4c/d5a/d6f/la6 0 2024-06-03T00:03:09.665 INFO:tasks.workunit.client.0.smithi049.stdout:5/633: getdents d3/d5/d2d/d4b/d62 0 2024-06-03T00:03:09.665 INFO:tasks.workunit.client.0.smithi049.stdout:2/656: dread da/f1c [0,4194304] 0 2024-06-03T00:03:09.665 INFO:tasks.workunit.client.0.smithi049.stdout:5/634: dread - d3/d7d/f91 zero size 2024-06-03T00:03:09.665 INFO:tasks.workunit.client.0.smithi049.stdout:5/635: write d3/d5/da/d55/d14/f47 [5092830,62160] 0 2024-06-03T00:03:09.665 INFO:tasks.workunit.client.0.smithi049.stdout:5/636: write d3/d5/d2d/d4b/d97/fb6 [69218,88761] 0 2024-06-03T00:03:09.666 INFO:tasks.workunit.client.0.smithi049.stdout:6/788: dwrite d2/d3/d17/d57/d6e/d88/fa7 [0,4194304] 0 2024-06-03T00:03:09.667 INFO:tasks.workunit.client.0.smithi049.stdout:9/789: link d1/d5/f24 d1/d5/d13/d3b/f10c 0 2024-06-03T00:03:09.668 INFO:tasks.workunit.client.0.smithi049.stdout:9/790: write d1/d5/d13/f105 [627581,126112] 0 2024-06-03T00:03:09.669 INFO:tasks.workunit.client.0.smithi049.stdout:9/791: dread d1/d5/d13/d3b/d7f/dbc/dfc/fbe [0,4194304] 0 2024-06-03T00:03:09.670 INFO:tasks.workunit.client.0.smithi049.stdout:4/700: rename d4/d3f/d14/d2b/d84/d1c/d4f/f95 to d4/d3f/d14/d2b/d84/d1c/d4f/ded/ff6 0 2024-06-03T00:03:09.670 INFO:tasks.workunit.client.0.smithi049.stdout:8/510: dwrite d4/d27/d3c/d88/f91 [0,4194304] 0 2024-06-03T00:03:09.671 INFO:tasks.workunit.client.0.smithi049.stdout:1/843: mknod d1/d2f/d36/d37/d13/d34/dd0/c12d 0 2024-06-03T00:03:09.673 INFO:tasks.workunit.client.0.smithi049.stdout:2/657: link da/d52/d40/c7c da/d72/d83/ccc 0 2024-06-03T00:03:09.673 INFO:tasks.workunit.client.0.smithi049.stdout:2/658: read - da/d52/d40/d93/da9/fc0 zero size 2024-06-03T00:03:09.675 INFO:tasks.workunit.client.0.smithi049.stdout:9/792: symlink d1/da/da8/d50/deb/l10d 0 2024-06-03T00:03:09.676 INFO:tasks.workunit.client.0.smithi049.stdout:6/789: write d2/d4d/d76/dfd/f104 [753668,112406] 0 2024-06-03T00:03:09.676 INFO:tasks.workunit.client.0.smithi049.stdout:6/790: readlink d2/d3/d9/l3a 0 2024-06-03T00:03:09.677 INFO:tasks.workunit.client.0.smithi049.stdout:0/544: dwrite d6/d29/fbb [0,4194304] 0 2024-06-03T00:03:09.677 INFO:tasks.workunit.client.0.smithi049.stdout:0/545: dread - d6/d97/d4b/fb7 zero size 2024-06-03T00:03:09.677 INFO:tasks.workunit.client.0.smithi049.stdout:9/793: rmdir d1/d5/d13/d3b/dad 39 2024-06-03T00:03:09.677 INFO:tasks.workunit.client.0.smithi049.stdout:9/794: fdatasync d1/da/da8/d5f/f7d 0 2024-06-03T00:03:09.677 INFO:tasks.workunit.client.0.smithi049.stdout:9/795: stat d1/da/da8/d50/deb/l10d 0 2024-06-03T00:03:09.677 INFO:tasks.workunit.client.0.smithi049.stdout:5/637: rename d3/d5/d9a/fb3 to d3/d9/d20/d4c/d5a/d6f/fc8 0 2024-06-03T00:03:09.677 INFO:tasks.workunit.client.0.smithi049.stdout:6/791: link d2/lc d2/d3/d17/d57/d6e/dd3/de2/l10b 0 2024-06-03T00:03:09.679 INFO:tasks.workunit.client.0.smithi049.stdout:9/796: mkdir d1/d5/d13/d3b/dbb/d10e 0 2024-06-03T00:03:09.679 INFO:tasks.workunit.client.0.smithi049.stdout:9/797: chown d1/d5/d13/d3b/d7f/dbc/ffb 31274057 1 2024-06-03T00:03:09.679 INFO:tasks.workunit.client.0.smithi049.stdout:9/798: chown d1/d5/d13/d3b/dbb/fec 29053510 1 2024-06-03T00:03:09.679 INFO:tasks.workunit.client.0.smithi049.stdout:5/638: symlink d3/d5/d9a/lc9 0 2024-06-03T00:03:09.679 INFO:tasks.workunit.client.0.smithi049.stdout:0/546: creat d6/d97/d4b/d67/fbc x:0 0 0 2024-06-03T00:03:09.680 INFO:tasks.workunit.client.0.smithi049.stdout:8/511: read d4/d27/d3c/d88/d28/f46 [4097986,78274] 0 2024-06-03T00:03:09.680 INFO:tasks.workunit.client.0.smithi049.stdout:1/844: rename d1/d2f/d36/d37/d13/d34/dd0/de2/l108 to d1/d2f/d36/d57/da1/l12e 0 2024-06-03T00:03:09.680 INFO:tasks.workunit.client.0.smithi049.stdout:5/639: truncate f1 731497 0 2024-06-03T00:03:09.682 INFO:tasks.workunit.client.0.smithi049.stdout:9/799: symlink d1/d5/d13/d3b/l10f 0 2024-06-03T00:03:09.682 INFO:tasks.workunit.client.0.smithi049.stdout:0/547: rename d6/d97/c68 to d6/d97/d4b/d67/d6e/d52/d96/cbd 0 2024-06-03T00:03:09.682 INFO:tasks.workunit.client.0.smithi049.stdout:5/640: mkdir d3/d5/d2d/d4b/d97/dbf/dca 0 2024-06-03T00:03:09.683 INFO:tasks.workunit.client.0.smithi049.stdout:0/548: truncate d6/d97/f50 4101914 0 2024-06-03T00:03:09.683 INFO:tasks.workunit.client.0.smithi049.stdout:1/845: mknod d1/d2f/d36/d37/d64/d6c/c12f 0 2024-06-03T00:03:09.684 INFO:tasks.workunit.client.0.smithi049.stdout:5/641: symlink d3/d5/da/lcb 0 2024-06-03T00:03:09.684 INFO:tasks.workunit.client.0.smithi049.stdout:5/642: readlink d3/d5/d24/l33 0 2024-06-03T00:03:09.684 INFO:tasks.workunit.client.0.smithi049.stdout:5/643: chown d3/d5/da/d55/d14/f19 0 1 2024-06-03T00:03:09.685 INFO:tasks.workunit.client.0.smithi049.stdout:1/846: mknod d1/d2f/d36/d57/d72/c130 0 2024-06-03T00:03:09.685 INFO:tasks.workunit.client.0.smithi049.stdout:1/847: rmdir d1/d2f/d78 39 2024-06-03T00:03:09.688 INFO:tasks.workunit.client.0.smithi049.stdout:4/701: write d4/d3f/d14/d2b/d84/d1c/d4f/ded/ff6 [760539,29430] 0 2024-06-03T00:03:09.688 INFO:tasks.workunit.client.0.smithi049.stdout:1/848: mkdir d1/d2f/d36/d37/d2c/d131 0 2024-06-03T00:03:09.688 INFO:tasks.workunit.client.0.smithi049.stdout:2/659: dwrite da/f24 [0,4194304] 0 2024-06-03T00:03:09.690 INFO:tasks.workunit.client.0.smithi049.stdout:4/702: link d4/d3f/d14/d2b/d84/d69/fe4 d4/d3f/d14/d7f/d87/ff7 0 2024-06-03T00:03:09.690 INFO:tasks.workunit.client.0.smithi049.stdout:4/703: fsync d4/d3f/d14/d2b/d84/d69/dc6/f18 0 2024-06-03T00:03:09.691 INFO:tasks.workunit.client.0.smithi049.stdout:2/660: rmdir da/d55 39 2024-06-03T00:03:09.692 INFO:tasks.workunit.client.0.smithi049.stdout:2/661: chown da/d43/f7e 2652981 1 2024-06-03T00:03:09.692 INFO:tasks.workunit.client.0.smithi049.stdout:2/662: fdatasync da/d52/f39 0 2024-06-03T00:03:09.694 INFO:tasks.workunit.client.0.smithi049.stdout:2/663: rmdir da/d52/d37/d70 39 2024-06-03T00:03:09.706 INFO:tasks.workunit.client.0.smithi049.stdout:8/512: dwrite d4/d27/d3c/d88/d28/d25/f39 [4194304,4194304] 0 2024-06-03T00:03:09.708 INFO:tasks.workunit.client.0.smithi049.stdout:8/513: creat d4/d27/d3c/d88/d28/d2b/d84/fa2 x:0 0 0 2024-06-03T00:03:09.709 INFO:tasks.workunit.client.0.smithi049.stdout:5/644: dwrite d3/d5/d24/f5f [4194304,4194304] 0 2024-06-03T00:03:09.709 INFO:tasks.workunit.client.0.smithi049.stdout:5/645: chown f1 0 1 2024-06-03T00:03:09.709 INFO:tasks.workunit.client.0.smithi049.stdout:5/646: stat d3/d9/d20/fac 0 2024-06-03T00:03:09.711 INFO:tasks.workunit.client.0.smithi049.stdout:8/514: getdents d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62 0 2024-06-03T00:03:09.711 INFO:tasks.workunit.client.0.smithi049.stdout:8/515: readlink l3 0 2024-06-03T00:03:09.716 INFO:tasks.workunit.client.0.smithi049.stdout:8/516: unlink d4/d27/d3c/d88/c1c 0 2024-06-03T00:03:09.721 INFO:tasks.workunit.client.0.smithi049.stdout:8/517: dread d4/d27/d3c/d88/f22 [0,4194304] 0 2024-06-03T00:03:09.721 INFO:tasks.workunit.client.0.smithi049.stdout:8/518: chown d4/d27/d3c/d88/d28/d25/f39 0 1 2024-06-03T00:03:09.722 INFO:tasks.workunit.client.0.smithi049.stdout:0/549: dwrite d6/d97/d4b/d67/d6e/f70 [0,4194304] 0 2024-06-03T00:03:09.723 INFO:tasks.workunit.client.0.smithi049.stdout:9/800: dwrite d1/da/da8/d5f/f7d [0,4194304] 0 2024-06-03T00:03:09.723 INFO:tasks.workunit.client.0.smithi049.stdout:8/519: rename d4/d27/d3c/d88/d28/d25/da0 to d4/d27/d3c/d88/d28/d52/da3 0 2024-06-03T00:03:09.723 INFO:tasks.workunit.client.0.smithi049.stdout:8/520: getdents d4/d27/d3c/d88/d48 0 2024-06-03T00:03:09.724 INFO:tasks.workunit.client.0.smithi049.stdout:0/550: link d6/d30/da3/faa d6/d59/d72/fbe 0 2024-06-03T00:03:09.724 INFO:tasks.workunit.client.0.smithi049.stdout:9/801: mknod d1/da/d54/d5b/c110 0 2024-06-03T00:03:09.725 INFO:tasks.workunit.client.0.smithi049.stdout:0/551: symlink d6/d97/d4b/lbf 0 2024-06-03T00:03:09.725 INFO:tasks.workunit.client.0.smithi049.stdout:0/552: fdatasync d6/d59/d93/f9d 0 2024-06-03T00:03:09.728 INFO:tasks.workunit.client.0.smithi049.stdout:4/704: dwrite d4/d3f/fb1 [0,4194304] 0 2024-06-03T00:03:09.728 INFO:tasks.workunit.client.0.smithi049.stdout:6/792: dwrite d2/f107 [0,4194304] 0 2024-06-03T00:03:09.729 INFO:tasks.workunit.client.0.smithi049.stdout:1/849: dwrite d1/d2f/d36/d37/d13/d34/fee [0,4194304] 0 2024-06-03T00:03:09.730 INFO:tasks.workunit.client.0.smithi049.stdout:6/793: read d2/d4d/fe8 [212690,94656] 0 2024-06-03T00:03:09.733 INFO:tasks.workunit.client.0.smithi049.stdout:0/553: write d6/d30/d32/f82 [50658,123334] 0 2024-06-03T00:03:09.733 INFO:tasks.workunit.client.0.smithi049.stdout:0/554: chown d6/d30/l43 0 1 2024-06-03T00:03:09.733 INFO:tasks.workunit.client.0.smithi049.stdout:0/555: dread - d6/d59/d93/f9d zero size 2024-06-03T00:03:09.733 INFO:tasks.workunit.client.0.smithi049.stdout:0/556: chown d6/fa0 3215473 1 2024-06-03T00:03:09.736 INFO:tasks.workunit.client.0.smithi049.stdout:4/705: chown d4/d3f/d14/l2d 733298 1 2024-06-03T00:03:09.737 INFO:tasks.workunit.client.0.smithi049.stdout:5/647: dwrite d3/d5/da/f67 [0,4194304] 0 2024-06-03T00:03:09.737 INFO:tasks.workunit.client.0.smithi049.stdout:5/648: chown d3 2939166 1 2024-06-03T00:03:09.742 INFO:tasks.workunit.client.0.smithi049.stdout:1/850: mknod d1/d2f/d36/d37/d13/d34/d8f/c132 0 2024-06-03T00:03:09.743 INFO:tasks.workunit.client.0.smithi049.stdout:1/851: chown d1/d1a/l65 212447922 1 2024-06-03T00:03:09.744 INFO:tasks.workunit.client.0.smithi049.stdout:1/852: symlink d1/d2f/d50/l133 0 2024-06-03T00:03:09.746 INFO:tasks.workunit.client.0.smithi049.stdout:1/853: mkdir d1/d2f/d36/d57/d72/d134 0 2024-06-03T00:03:09.746 INFO:tasks.workunit.client.0.smithi049.stdout:1/854: write d1/d2f/d36/d37/d2c/d45/da0/fe5 [231986,35526] 0 2024-06-03T00:03:09.746 INFO:tasks.workunit.client.0.smithi049.stdout:4/706: read d4/d2a/f6d [8191557,88407] 0 2024-06-03T00:03:09.747 INFO:tasks.workunit.client.0.smithi049.stdout:9/802: dwrite d1/da/d26/f5c [0,4194304] 0 2024-06-03T00:03:09.747 INFO:tasks.workunit.client.0.smithi049.stdout:1/855: rmdir d1/d2f/d36/d37/d13/d34/dd0/de2 39 2024-06-03T00:03:09.748 INFO:tasks.workunit.client.0.smithi049.stdout:9/803: dread d1/d5/d13/d3b/d7f/dbc/dfc/fd0 [0,4194304] 0 2024-06-03T00:03:09.750 INFO:tasks.workunit.client.0.smithi049.stdout:1/856: creat d1/d2f/d36/d37/d13/d34/d52/db1/f135 x:0 0 0 2024-06-03T00:03:09.752 INFO:tasks.workunit.client.0.smithi049.stdout:9/804: rename d1/da/da8/d50/deb/l10d to d1/da/l111 0 2024-06-03T00:03:09.752 INFO:tasks.workunit.client.0.smithi049.stdout:9/805: fsync d1/da/d54/d5b/d61/f96 0 2024-06-03T00:03:09.752 INFO:tasks.workunit.client.0.smithi049.stdout:6/794: dwrite d2/d3/d9/d23/d48/fab [0,4194304] 0 2024-06-03T00:03:09.753 INFO:tasks.workunit.client.0.smithi049.stdout:9/806: link d1/da/c28 d1/d5/d13/de3/c112 0 2024-06-03T00:03:09.754 INFO:tasks.workunit.client.0.smithi049.stdout:7/614: sync 2024-06-03T00:03:09.755 INFO:tasks.workunit.client.0.smithi049.stdout:1/857: read d1/d2f/d36/d37/d13/d34/d6e/f7f [434966,94615] 0 2024-06-03T00:03:09.757 INFO:tasks.workunit.client.0.smithi049.stdout:0/557: dwrite d6/d97/d4b/fb7 [0,4194304] 0 2024-06-03T00:03:09.758 INFO:tasks.workunit.client.0.smithi049.stdout:1/858: mknod d1/d2f/d36/d37/d13/d34/d6e/c136 0 2024-06-03T00:03:09.759 INFO:tasks.workunit.client.0.smithi049.stdout:0/558: creat d6/d97/fc0 x:0 0 0 2024-06-03T00:03:09.759 INFO:tasks.workunit.client.0.smithi049.stdout:5/649: dwrite d3/d5/da3/fbd [0,4194304] 0 2024-06-03T00:03:09.760 INFO:tasks.workunit.client.0.smithi049.stdout:5/650: chown d3/d5/da/d55/d75/fa0 0 1 2024-06-03T00:03:09.760 INFO:tasks.workunit.client.0.smithi049.stdout:5/651: truncate d3/d9/d20/d4c/d5a/d65/f71 991050 0 2024-06-03T00:03:09.760 INFO:tasks.workunit.client.0.smithi049.stdout:5/652: read d3/d5/da/f2b [2237513,120175] 0 2024-06-03T00:03:09.760 INFO:tasks.workunit.client.0.smithi049.stdout:0/559: symlink d6/d29/lc1 0 2024-06-03T00:03:09.761 INFO:tasks.workunit.client.0.smithi049.stdout:9/807: dread d1/da/d27/f75 [0,4194304] 0 2024-06-03T00:03:09.763 INFO:tasks.workunit.client.0.smithi049.stdout:0/560: unlink d6/d30/l43 0 2024-06-03T00:03:09.764 INFO:tasks.workunit.client.0.smithi049.stdout:9/808: unlink d1/d5/f24 0 2024-06-03T00:03:09.765 INFO:tasks.workunit.client.0.smithi049.stdout:0/561: unlink d6/d97/d4b/d67/d6e/lad 0 2024-06-03T00:03:09.766 INFO:tasks.workunit.client.0.smithi049.stdout:0/562: dread - d6/d97/d4b/d67/fbc zero size 2024-06-03T00:03:09.766 INFO:tasks.workunit.client.0.smithi049.stdout:9/809: truncate d1/da/d27/f40 768171 0 2024-06-03T00:03:09.766 INFO:tasks.workunit.client.0.smithi049.stdout:9/810: chown d1/da 26 1 2024-06-03T00:03:09.767 INFO:tasks.workunit.client.0.smithi049.stdout:0/563: creat d6/d97/fc2 x:0 0 0 2024-06-03T00:03:09.768 INFO:tasks.workunit.client.0.smithi049.stdout:0/564: read d6/d97/d4b/d67/d6e/f1f [873043,72819] 0 2024-06-03T00:03:09.768 INFO:tasks.workunit.client.0.smithi049.stdout:9/811: creat d1/d5/d13/d3b/d49/f113 x:0 0 0 2024-06-03T00:03:09.772 INFO:tasks.workunit.client.0.smithi049.stdout:4/707: dwrite d4/d2a/f8c [0,4194304] 0 2024-06-03T00:03:09.779 INFO:tasks.workunit.client.0.smithi049.stdout:0/565: dread d6/d59/fb6 [0,4194304] 0 2024-06-03T00:03:09.779 INFO:tasks.workunit.client.0.smithi049.stdout:0/566: dread - d6/d30/f9c zero size 2024-06-03T00:03:09.780 INFO:tasks.workunit.client.0.smithi049.stdout:4/708: link d4/d3f/d14/d2b/d84/d1c/l22 d4/d3f/d14/d7f/ddb/df5/df1/lf8 0 2024-06-03T00:03:09.780 INFO:tasks.workunit.client.0.smithi049.stdout:4/709: write d4/d3f/d14/f40 [4121911,25078] 0 2024-06-03T00:03:09.780 INFO:tasks.workunit.client.0.smithi049.stdout:0/567: creat d6/d97/d4b/d67/d6e/d52/fc3 x:0 0 0 2024-06-03T00:03:09.782 INFO:tasks.workunit.client.0.smithi049.stdout:4/710: creat d4/d3f/d14/d7f/ff9 x:0 0 0 2024-06-03T00:03:09.782 INFO:tasks.workunit.client.0.smithi049.stdout:0/568: link d6/d30/d32/f82 d6/d97/d4b/d67/d6e/d52/d96/fc4 0 2024-06-03T00:03:09.782 INFO:tasks.workunit.client.0.smithi049.stdout:0/569: fdatasync d6/d29/f54 0 2024-06-03T00:03:09.783 INFO:tasks.workunit.client.0.smithi049.stdout:0/570: rmdir d6 39 2024-06-03T00:03:09.784 INFO:tasks.workunit.client.0.smithi049.stdout:0/571: write d6/d30/f8e [1010855,91045] 0 2024-06-03T00:03:09.784 INFO:tasks.workunit.client.0.smithi049.stdout:0/572: write d6/d59/d93/f9d [200805,128845] 0 2024-06-03T00:03:09.784 INFO:tasks.workunit.client.0.smithi049.stdout:4/711: rmdir d4 39 2024-06-03T00:03:09.785 INFO:tasks.workunit.client.0.smithi049.stdout:4/712: chown d4/d3f/d14/d2b/d84/l20 0 1 2024-06-03T00:03:09.789 INFO:tasks.workunit.client.0.smithi049.stdout:5/653: dwrite d3/d5/da/f1d [0,4194304] 0 2024-06-03T00:03:09.789 INFO:tasks.workunit.client.0.smithi049.stdout:7/615: dwrite d3/dd8/d13/d3c/d4b/fa7 [0,4194304] 0 2024-06-03T00:03:09.790 INFO:tasks.workunit.client.0.smithi049.stdout:1/859: dwrite d1/d2f/d36/d37/d13/d71/ffd [0,4194304] 0 2024-06-03T00:03:09.790 INFO:tasks.workunit.client.0.smithi049.stdout:4/713: dread d4/f63 [0,4194304] 0 2024-06-03T00:03:09.791 INFO:tasks.workunit.client.0.smithi049.stdout:9/812: dwrite d1/d5/d13/d3b/d49/fc7 [0,4194304] 0 2024-06-03T00:03:09.794 INFO:tasks.workunit.client.0.smithi049.stdout:9/813: chown d1/d5/d13/d3b/d7f/dbc/ffb 9684653 1 2024-06-03T00:03:09.794 INFO:tasks.workunit.client.0.smithi049.stdout:9/814: chown d1/da/d27/f75 828870937 1 2024-06-03T00:03:09.796 INFO:tasks.workunit.client.0.smithi049.stdout:3/573: sync 2024-06-03T00:03:09.799 INFO:tasks.workunit.client.0.smithi049.stdout:3/574: rename d2/d14/d22/d3a/d47/d79/dc5 to d2/d14/d44/d52/d4c/d4b/dca 0 2024-06-03T00:03:09.800 INFO:tasks.workunit.client.0.smithi049.stdout:7/616: rmdir d3 39 2024-06-03T00:03:09.801 INFO:tasks.workunit.client.0.smithi049.stdout:3/575: creat d2/d14/d22/d3a/fcb x:0 0 0 2024-06-03T00:03:09.801 INFO:tasks.workunit.client.0.smithi049.stdout:3/576: write d2/d14/d22/f9a [317621,13033] 0 2024-06-03T00:03:09.804 INFO:tasks.workunit.client.0.smithi049.stdout:3/577: rename d2/d14/d22/d3a/fcb to d2/d14/d44/d52/d4c/d4b/fcc 0 2024-06-03T00:03:09.806 INFO:tasks.workunit.client.0.smithi049.stdout:7/617: unlink d3/dd8/d86/d90/dae/lb2 0 2024-06-03T00:03:09.806 INFO:tasks.workunit.client.0.smithi049.stdout:3/578: creat d2/d1a/d51/d83/fcd x:0 0 0 2024-06-03T00:03:09.806 INFO:tasks.workunit.client.0.smithi049.stdout:4/714: dread d4/d3f/d14/d2b/d84/d69/dc6/f6a [0,4194304] 0 2024-06-03T00:03:09.807 INFO:tasks.workunit.client.0.smithi049.stdout:0/573: dwrite d6/d97/d4b/d67/d6e/d52/f81 [0,4194304] 0 2024-06-03T00:03:09.808 INFO:tasks.workunit.client.0.smithi049.stdout:3/579: rename d2/d14/d22/d3a/d47/f72 to d2/d1a/d76/d9b/db6/fce 0 2024-06-03T00:03:09.808 INFO:tasks.workunit.client.0.smithi049.stdout:4/715: mknod d4/d3f/d14/d2b/d84/d1c/d24/d43/daf/cfa 0 2024-06-03T00:03:09.808 INFO:tasks.workunit.client.0.smithi049.stdout:3/580: getdents d2/d14/d44/d52/d4c/d4b/daf 0 2024-06-03T00:03:09.809 INFO:tasks.workunit.client.0.smithi049.stdout:3/581: symlink d2/d1a/d51/d83/lcf 0 2024-06-03T00:03:09.812 INFO:tasks.workunit.client.0.smithi049.stdout:3/582: link d2/d1a/d76/fbb d2/d1a/d51/dbe/fd0 0 2024-06-03T00:03:09.815 INFO:tasks.workunit.client.0.smithi049.stdout:4/716: dread d4/d3f/d14/fcf [0,4194304] 0 2024-06-03T00:03:09.815 INFO:tasks.workunit.client.0.smithi049.stdout:1/860: dwrite d1/d2f/d36/d57/da1/f107 [0,4194304] 0 2024-06-03T00:03:09.816 INFO:tasks.workunit.client.0.smithi049.stdout:4/717: dread d4/d3f/f56 [0,4194304] 0 2024-06-03T00:03:09.818 INFO:tasks.workunit.client.0.smithi049.stdout:1/861: creat d1/d2f/d78/f137 x:0 0 0 2024-06-03T00:03:09.821 INFO:tasks.workunit.client.0.smithi049.stdout:4/718: rename d4/d3f/d14/d2b/d84/d69/dc6/f18 to d4/d3f/ffb 0 2024-06-03T00:03:09.821 INFO:tasks.workunit.client.0.smithi049.stdout:4/719: chown d4/d3f/d14/d2b/cd1 18647473 1 2024-06-03T00:03:09.821 INFO:tasks.workunit.client.0.smithi049.stdout:4/720: chown d4/d3f/d14/d2b/cd1 52953466 1 2024-06-03T00:03:09.821 INFO:tasks.workunit.client.0.smithi049.stdout:4/721: fsync d4/d3f/d14/d2b/d84/d1c/d24/f4a 0 2024-06-03T00:03:09.823 INFO:tasks.workunit.client.0.smithi049.stdout:3/583: dread d2/fd [0,4194304] 0 2024-06-03T00:03:09.823 INFO:tasks.workunit.client.0.smithi049.stdout:3/584: read - d2/d14/d44/d52/d4c/d4b/fcc zero size 2024-06-03T00:03:09.823 INFO:tasks.workunit.client.0.smithi049.stdout:3/585: chown d2/d14/d44/c50 6023 1 2024-06-03T00:03:09.823 INFO:tasks.workunit.client.0.smithi049.stdout:4/722: creat d4/d3f/ffc x:0 0 0 2024-06-03T00:03:09.823 INFO:tasks.workunit.client.0.smithi049.stdout:1/862: dread d1/f1e [0,4194304] 0 2024-06-03T00:03:09.823 INFO:tasks.workunit.client.0.smithi049.stdout:4/723: fdatasync d4/d3f/d14/d2b/fcd 0 2024-06-03T00:03:09.823 INFO:tasks.workunit.client.0.smithi049.stdout:4/724: chown d4/d3f/d14/d2b/d84/l17 5106488 1 2024-06-03T00:03:09.823 INFO:tasks.workunit.client.0.smithi049.stdout:4/725: stat d4/d3f/d14/d2b/c46 0 2024-06-03T00:03:09.823 INFO:tasks.workunit.client.0.smithi049.stdout:1/863: read - d1/d2f/d36/d37/d2c/d45/d61/d67/f118 zero size 2024-06-03T00:03:09.823 INFO:tasks.workunit.client.0.smithi049.stdout:1/864: chown d1/d2f/d36/d37/d64/d6c/d8c/f100 3892 1 2024-06-03T00:03:09.825 INFO:tasks.workunit.client.0.smithi049.stdout:7/618: dwrite d3/dd8/d13/d3c/d48/fda [0,4194304] 0 2024-06-03T00:03:09.825 INFO:tasks.workunit.client.0.smithi049.stdout:1/865: dread d1/d2f/d78/dd7/f5a [0,4194304] 0 2024-06-03T00:03:09.825 INFO:tasks.workunit.client.0.smithi049.stdout:1/866: readlink d1/ldc 0 2024-06-03T00:03:09.827 INFO:tasks.workunit.client.0.smithi049.stdout:7/619: creat d3/d14/fde x:0 0 0 2024-06-03T00:03:09.829 INFO:tasks.workunit.client.0.smithi049.stdout:7/620: symlink d3/dd8/d13/d3c/d48/d7b/d5b/ldf 0 2024-06-03T00:03:09.831 INFO:tasks.workunit.client.0.smithi049.stdout:7/621: unlink d3/dd8/d13/d3c/d4b/d5a/fa1 0 2024-06-03T00:03:09.832 INFO:tasks.workunit.client.0.smithi049.stdout:7/622: readlink d3/dd8/d13/d3c/d48/d7b/d5b/ldf 0 2024-06-03T00:03:09.832 INFO:tasks.workunit.client.0.smithi049.stdout:1/867: dread d1/d1a/f79 [0,4194304] 0 2024-06-03T00:03:09.832 INFO:tasks.workunit.client.0.smithi049.stdout:1/868: fdatasync d1/d2f/df7/f6f 0 2024-06-03T00:03:09.833 INFO:tasks.workunit.client.0.smithi049.stdout:7/623: symlink d3/dd8/d86/d90/dae/le0 0 2024-06-03T00:03:09.833 INFO:tasks.workunit.client.0.smithi049.stdout:7/624: write d3/dd8/f25 [4298696,32070] 0 2024-06-03T00:03:09.833 INFO:tasks.workunit.client.0.smithi049.stdout:7/625: dread - d3/dd8/d13/d3c/fc7 zero size 2024-06-03T00:03:09.834 INFO:tasks.workunit.client.0.smithi049.stdout:7/626: chown d3/dd8/d13/d3c/d48/lc1 378012314 1 2024-06-03T00:03:09.834 INFO:tasks.workunit.client.0.smithi049.stdout:7/627: fsync d3/dd8/d9/d8f/f6c 0 2024-06-03T00:03:09.834 INFO:tasks.workunit.client.0.smithi049.stdout:1/869: link d1/d2f/d36/d37/d13/f27 d1/d2f/d36/d37/d13/d34/dd0/f138 0 2024-06-03T00:03:09.835 INFO:tasks.workunit.client.0.smithi049.stdout:1/870: mknod d1/d2f/d36/d37/d13/d34/c139 0 2024-06-03T00:03:09.837 INFO:tasks.workunit.client.0.smithi049.stdout:1/871: write d1/d2f/d36/d37/ff3 [196125,108401] 0 2024-06-03T00:03:09.838 INFO:tasks.workunit.client.0.smithi049.stdout:1/872: mknod d1/d2f/d36/d37/d13/d34/d6e/dad/c13a 0 2024-06-03T00:03:09.839 INFO:tasks.workunit.client.0.smithi049.stdout:1/873: write d1/f7 [1772759,126605] 0 2024-06-03T00:03:09.839 INFO:tasks.workunit.client.0.smithi049.stdout:1/874: write d1/d2f/d36/d37/d2c/d45/d83/fe0 [807654,26417] 0 2024-06-03T00:03:09.839 INFO:tasks.workunit.client.0.smithi049.stdout:1/875: readlink d1/d2f/d36/d37/d13/d34/l51 0 2024-06-03T00:03:09.848 INFO:tasks.workunit.client.0.smithi049.stdout:7/628: dwrite d3/dd8/d13/d54/daa/d92/fb8 [0,4194304] 0 2024-06-03T00:03:09.857 INFO:tasks.workunit.client.0.smithi049.stdout:7/629: dread d3/dd8/d13/d3c/d48/d7b/d5b/fc6 [4194304,4194304] 0 2024-06-03T00:03:09.857 INFO:tasks.workunit.client.0.smithi049.stdout:7/630: write d3/dd8/d9/fa6 [3904194,109340] 0 2024-06-03T00:03:09.857 INFO:tasks.workunit.client.0.smithi049.stdout:7/631: truncate d3/dd8/d13/d3c/d48/d7b/d5b/fca 468055 0 2024-06-03T00:03:09.864 INFO:tasks.workunit.client.0.smithi049.stdout:2/664: sync 2024-06-03T00:03:09.864 INFO:tasks.workunit.client.0.smithi049.stdout:2/665: creat da/d52/d40/d63/fcd x:0 0 0 2024-06-03T00:03:09.866 INFO:tasks.workunit.client.0.smithi049.stdout:2/666: read da/d52/f39 [11565,40703] 0 2024-06-03T00:03:09.866 INFO:tasks.workunit.client.0.smithi049.stdout:2/667: write da/d52/d40/d63/fcd [840324,103871] 0 2024-06-03T00:03:09.866 INFO:tasks.workunit.client.0.smithi049.stdout:7/632: dread d3/dd8/f20 [0,4194304] 0 2024-06-03T00:03:09.866 INFO:tasks.workunit.client.0.smithi049.stdout:2/668: getdents da/d52/df/d3c/d9a 0 2024-06-03T00:03:09.867 INFO:tasks.workunit.client.0.smithi049.stdout:4/726: dwrite d4/d2a/f8c [0,4194304] 0 2024-06-03T00:03:09.867 INFO:tasks.workunit.client.0.smithi049.stdout:4/727: stat d4/d3f/d14/d2b/d84/d1c/d24/f42 0 2024-06-03T00:03:09.867 INFO:tasks.workunit.client.0.smithi049.stdout:4/728: truncate d4/d3f/d14/d2b/ff4 528104 0 2024-06-03T00:03:09.867 INFO:tasks.workunit.client.0.smithi049.stdout:7/633: dread d3/dd8/d86/fa9 [0,4194304] 0 2024-06-03T00:03:09.868 INFO:tasks.workunit.client.0.smithi049.stdout:7/634: dread d3/dd8/d9/f2b [0,4194304] 0 2024-06-03T00:03:09.868 INFO:tasks.workunit.client.0.smithi049.stdout:2/669: mkdir da/d52/d40/dce 0 2024-06-03T00:03:09.868 INFO:tasks.workunit.client.0.smithi049.stdout:4/729: getdents d4/d3f/d14/d7f/ddb/df5 0 2024-06-03T00:03:09.869 INFO:tasks.workunit.client.0.smithi049.stdout:7/635: link d3/dd8/d13/d3c/d4b/d5a/l71 d3/dd8/d13/d54/daa/le1 0 2024-06-03T00:03:09.870 INFO:tasks.workunit.client.0.smithi049.stdout:7/636: link d3/dd8/d13/d3c/fc7 d3/d14/d6e/fe2 0 2024-06-03T00:03:09.871 INFO:tasks.workunit.client.0.smithi049.stdout:2/670: rename f1 to da/d52/df/d3c/d60/dc6/fcf 0 2024-06-03T00:03:09.872 INFO:tasks.workunit.client.0.smithi049.stdout:2/671: creat da/d52/d40/d93/fd0 x:0 0 0 2024-06-03T00:03:09.874 INFO:tasks.workunit.client.0.smithi049.stdout:2/672: rename da/d52/c12 to da/d43/cd1 0 2024-06-03T00:03:09.875 INFO:tasks.workunit.client.0.smithi049.stdout:2/673: mknod da/d52/d37/dac/cd2 0 2024-06-03T00:03:09.877 INFO:tasks.workunit.client.0.smithi049.stdout:2/674: mkdir da/d52/dd3 0 2024-06-03T00:03:09.877 INFO:tasks.workunit.client.0.smithi049.stdout:2/675: write da/d52/f82 [4913565,7690] 0 2024-06-03T00:03:09.877 INFO:tasks.workunit.client.0.smithi049.stdout:2/676: chown da/d52/d40/l8c 9827340 1 2024-06-03T00:03:09.878 INFO:tasks.workunit.client.0.smithi049.stdout:2/677: truncate da/d52/d37/d70/fb1 84012 0 2024-06-03T00:03:09.878 INFO:tasks.workunit.client.0.smithi049.stdout:2/678: write da/d52/df/d3c/d60/dc6/fcf [5215274,126584] 0 2024-06-03T00:03:09.878 INFO:tasks.workunit.client.0.smithi049.stdout:2/679: truncate da/d52/d40/f8a 4255362 0 2024-06-03T00:03:09.881 INFO:tasks.workunit.client.0.smithi049.stdout:2/680: link da/d52/d40/f64 da/d52/df/fd4 0 2024-06-03T00:03:09.885 INFO:tasks.workunit.client.0.smithi049.stdout:2/681: mknod da/d52/cd5 0 2024-06-03T00:03:09.889 INFO:tasks.workunit.client.0.smithi049.stdout:2/682: fdatasync da/d52/f82 0 2024-06-03T00:03:09.889 INFO:tasks.workunit.client.0.smithi049.stdout:2/683: dread - da/d52/d37/f84 zero size 2024-06-03T00:03:09.889 INFO:tasks.workunit.client.0.smithi049.stdout:2/684: stat da/d52/d37/d70/fb1 0 2024-06-03T00:03:09.889 INFO:tasks.workunit.client.0.smithi049.stdout:1/876: dwrite d1/d2f/d36/d37/d64/d6c/f92 [4194304,4194304] 0 2024-06-03T00:03:09.890 INFO:tasks.workunit.client.0.smithi049.stdout:1/877: symlink d1/d2f/d50/d6b/l13b 0 2024-06-03T00:03:09.890 INFO:tasks.workunit.client.0.smithi049.stdout:7/637: dwrite d3/dd8/d13/d54/daa/d92/fb8 [0,4194304] 0 2024-06-03T00:03:09.891 INFO:tasks.workunit.client.0.smithi049.stdout:7/638: write d3/dd8/d86/fa9 [1925255,26456] 0 2024-06-03T00:03:09.891 INFO:tasks.workunit.client.0.smithi049.stdout:1/878: mknod d1/d2f/d36/d37/d13/d34/d8f/d94/c13c 0 2024-06-03T00:03:09.892 INFO:tasks.workunit.client.0.smithi049.stdout:4/730: dwrite d4/d3f/d14/fb5 [0,4194304] 0 2024-06-03T00:03:09.892 INFO:tasks.workunit.client.0.smithi049.stdout:4/731: dread - d4/d3f/d14/fd8 zero size 2024-06-03T00:03:09.892 INFO:tasks.workunit.client.0.smithi049.stdout:1/879: symlink d1/d2f/d50/l13d 0 2024-06-03T00:03:09.893 INFO:tasks.workunit.client.0.smithi049.stdout:7/639: mknod d3/dd8/d13/d3c/d48/d7b/d9c/dc8/ce3 0 2024-06-03T00:03:09.894 INFO:tasks.workunit.client.0.smithi049.stdout:7/640: write d3/dd8/d9/f2b [231034,58979] 0 2024-06-03T00:03:09.895 INFO:tasks.workunit.client.0.smithi049.stdout:7/641: mknod d3/dd8/d86/d8d/ce4 0 2024-06-03T00:03:09.898 INFO:tasks.workunit.client.0.smithi049.stdout:7/642: symlink d3/dd8/d86/d90/dae/le5 0 2024-06-03T00:03:09.898 INFO:tasks.workunit.client.0.smithi049.stdout:7/643: chown d3/dd8/d13/d4a/l24 135 1 2024-06-03T00:03:09.898 INFO:tasks.workunit.client.0.smithi049.stdout:7/644: dread - d3/dd8/d13/d3c/d48/d7b/d9c/f9a zero size 2024-06-03T00:03:09.898 INFO:tasks.workunit.client.0.smithi049.stdout:7/645: write d3/dd8/d13/d3c/d4b/d5a/f87 [325846,15458] 0 2024-06-03T00:03:09.899 INFO:tasks.workunit.client.0.smithi049.stdout:7/646: mkdir d3/dd8/d13/d3c/d48/d7b/d9c/dc4/de6 0 2024-06-03T00:03:09.899 INFO:tasks.workunit.client.0.smithi049.stdout:1/880: dread d1/d2f/d36/d57/d72/fa6 [0,4194304] 0 2024-06-03T00:03:09.899 INFO:tasks.workunit.client.0.smithi049.stdout:1/881: chown d1/d2f/df7 551198 1 2024-06-03T00:03:09.900 INFO:tasks.workunit.client.0.smithi049.stdout:7/647: symlink d3/dd8/d13/d3c/d4b/d5a/le7 0 2024-06-03T00:03:09.901 INFO:tasks.workunit.client.0.smithi049.stdout:1/882: truncate d1/d2f/d36/f4e 1041327 0 2024-06-03T00:03:09.901 INFO:tasks.workunit.client.0.smithi049.stdout:7/648: creat d3/dd8/d13/d54/d96/fe8 x:0 0 0 2024-06-03T00:03:09.902 INFO:tasks.workunit.client.0.smithi049.stdout:1/883: mkdir d1/d1a/dd2/d13e 0 2024-06-03T00:03:09.903 INFO:tasks.workunit.client.0.smithi049.stdout:7/649: creat d3/dd8/d86/d8d/fe9 x:0 0 0 2024-06-03T00:03:09.904 INFO:tasks.workunit.client.0.smithi049.stdout:7/650: mkdir d3/dd8/d13/d3c/d4b/dea 0 2024-06-03T00:03:09.904 INFO:tasks.workunit.client.0.smithi049.stdout:7/651: fdatasync d3/dd8/d13/d4a/f2f 0 2024-06-03T00:03:09.904 INFO:tasks.workunit.client.0.smithi049.stdout:7/652: readlink d3/dd8/d13/d54/daa/le1 0 2024-06-03T00:03:09.905 INFO:tasks.workunit.client.0.smithi049.stdout:7/653: mknod d3/dd8/d13/d79/ceb 0 2024-06-03T00:03:09.906 INFO:tasks.workunit.client.0.smithi049.stdout:7/654: rmdir d3/dd8/d13/d3c/d48/d7b/d9c/dc4 39 2024-06-03T00:03:09.906 INFO:tasks.workunit.client.0.smithi049.stdout:7/655: chown d3/dd8/d13/d3c/d48/d7b/d5b/ld3 7817616 1 2024-06-03T00:03:09.906 INFO:tasks.workunit.client.0.smithi049.stdout:7/656: write d3/fac [525540,119853] 0 2024-06-03T00:03:09.906 INFO:tasks.workunit.client.0.smithi049.stdout:7/657: dread - d3/dd8/d13/d54/daa/fb3 zero size 2024-06-03T00:03:09.907 INFO:tasks.workunit.client.0.smithi049.stdout:7/658: mknod d3/dd8/d86/cec 0 2024-06-03T00:03:09.907 INFO:tasks.workunit.client.0.smithi049.stdout:1/884: dread d1/d2f/df7/d122/fbc [0,4194304] 0 2024-06-03T00:03:09.908 INFO:tasks.workunit.client.0.smithi049.stdout:1/885: chown d1/f7 1573 1 2024-06-03T00:03:09.908 INFO:tasks.workunit.client.0.smithi049.stdout:7/659: symlink d3/dd8/d13/d3c/d4b/d8e/led 0 2024-06-03T00:03:09.918 INFO:tasks.workunit.client.0.smithi049.stdout:7/660: dread d3/dd8/d3f/f59 [0,4194304] 0 2024-06-03T00:03:09.919 INFO:tasks.workunit.client.0.smithi049.stdout:8/521: sync 2024-06-03T00:03:09.919 INFO:tasks.workunit.client.0.smithi049.stdout:6/795: sync 2024-06-03T00:03:09.919 INFO:tasks.workunit.client.0.smithi049.stdout:7/661: symlink d3/dd8/d13/d54/lee 0 2024-06-03T00:03:09.920 INFO:tasks.workunit.client.0.smithi049.stdout:8/522: read d4/d27/d3c/d88/d28/d45/f6a [555964,108205] 0 2024-06-03T00:03:09.921 INFO:tasks.workunit.client.0.smithi049.stdout:4/732: dwrite d4/d2a/f81 [0,4194304] 0 2024-06-03T00:03:09.921 INFO:tasks.workunit.client.0.smithi049.stdout:4/733: fdatasync d4/d3f/d14/d7f/ddb/f80 0 2024-06-03T00:03:09.921 INFO:tasks.workunit.client.0.smithi049.stdout:6/796: creat d2/d3/d9/d23/d48/d51/f10c x:0 0 0 2024-06-03T00:03:09.921 INFO:tasks.workunit.client.0.smithi049.stdout:8/523: truncate d4/f6e 2286588 0 2024-06-03T00:03:09.922 INFO:tasks.workunit.client.0.smithi049.stdout:8/524: link d4/d27/d3c/d88/d28/l51 d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/la4 0 2024-06-03T00:03:09.923 INFO:tasks.workunit.client.0.smithi049.stdout:8/525: chown d4/d27/d3c/d88/d4d/l4e 1921 1 2024-06-03T00:03:09.923 INFO:tasks.workunit.client.0.smithi049.stdout:8/526: readlink d4/d27/la1 0 2024-06-03T00:03:09.923 INFO:tasks.workunit.client.0.smithi049.stdout:8/527: rename d4/d27/d3c to d4/d27/d3c/d88/da5 22 2024-06-03T00:03:09.923 INFO:tasks.workunit.client.0.smithi049.stdout:7/662: mkdir d3/dd8/d86/d90/def 0 2024-06-03T00:03:09.923 INFO:tasks.workunit.client.0.smithi049.stdout:8/528: mkdir d4/d27/d3c/d43/d6b/da6 0 2024-06-03T00:03:09.923 INFO:tasks.workunit.client.0.smithi049.stdout:8/529: write d4/d27/d3c/d88/f1e [472940,126807] 0 2024-06-03T00:03:09.924 INFO:tasks.workunit.client.0.smithi049.stdout:8/530: creat d4/d27/d30/fa7 x:0 0 0 2024-06-03T00:03:09.925 INFO:tasks.workunit.client.0.smithi049.stdout:6/797: unlink d2/d3/d17/d57/d6e/d88/dde/ff0 0 2024-06-03T00:03:09.930 INFO:tasks.workunit.client.0.smithi049.stdout:6/798: truncate d2/d3/d9/d23/d29/f59 2909791 0 2024-06-03T00:03:09.930 INFO:tasks.workunit.client.0.smithi049.stdout:6/799: truncate d2/d3/d9/d23/d48/d51/f5f 1352580 0 2024-06-03T00:03:09.931 INFO:tasks.workunit.client.0.smithi049.stdout:6/800: rename d2/d3/d9/d23/d29/d6a/lb3 to d2/d4d/d76/de4/l10d 0 2024-06-03T00:03:09.931 INFO:tasks.workunit.client.0.smithi049.stdout:6/801: truncate d2/d3/d9/d23/d29/fe7 321949 0 2024-06-03T00:03:09.933 INFO:tasks.workunit.client.0.smithi049.stdout:6/802: creat d2/d3/d9/d23/d29/dd4/f10e x:0 0 0 2024-06-03T00:03:09.952 INFO:tasks.workunit.client.0.smithi049.stdout:8/531: dwrite d4/d27/d3c/d88/d28/d52/d66/d53/d7e/f7b [0,4194304] 0 2024-06-03T00:03:09.952 INFO:tasks.workunit.client.0.smithi049.stdout:8/532: dread - d4/f9d zero size 2024-06-03T00:03:09.953 INFO:tasks.workunit.client.0.smithi049.stdout:6/803: dwrite d2/ff9 [0,4194304] 0 2024-06-03T00:03:09.954 INFO:tasks.workunit.client.0.smithi049.stdout:8/533: link d4/l32 d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/la8 0 2024-06-03T00:03:09.954 INFO:tasks.workunit.client.0.smithi049.stdout:8/534: write d4/d27/d3c/d88/d28/d45/f92 [422885,74552] 0 2024-06-03T00:03:09.956 INFO:tasks.workunit.client.0.smithi049.stdout:8/535: mkdir d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/da9 0 2024-06-03T00:03:09.956 INFO:tasks.workunit.client.0.smithi049.stdout:8/536: truncate d4/f6e 2436001 0 2024-06-03T00:03:09.956 INFO:tasks.workunit.client.0.smithi049.stdout:8/537: creat d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/da9/faa x:0 0 0 2024-06-03T00:03:09.957 INFO:tasks.workunit.client.0.smithi049.stdout:6/804: dread d2/d3/d9/d23/f1e [0,4194304] 0 2024-06-03T00:03:09.958 INFO:tasks.workunit.client.0.smithi049.stdout:6/805: mknod d2/d4d/d76/dfd/c10f 0 2024-06-03T00:03:09.959 INFO:tasks.workunit.client.0.smithi049.stdout:8/538: rename d4/d27/d3c/d88/d28/d52/da3 to d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/dab 0 2024-06-03T00:03:09.959 INFO:tasks.workunit.client.0.smithi049.stdout:6/806: mknod d2/d3/d17/d64/d109/c110 0 2024-06-03T00:03:09.959 INFO:tasks.workunit.client.0.smithi049.stdout:8/539: mknod d4/d27/d3c/d88/d48/d8f/cac 0 2024-06-03T00:03:09.960 INFO:tasks.workunit.client.0.smithi049.stdout:6/807: link d2/d3/c8b d2/d3/d9/d23/c111 0 2024-06-03T00:03:09.960 INFO:tasks.workunit.client.0.smithi049.stdout:6/808: dread - d2/d3/d17/d64/fc8 zero size 2024-06-03T00:03:09.960 INFO:tasks.workunit.client.0.smithi049.stdout:8/540: mkdir d4/d27/d3c/d43/d6b/da6/dad 0 2024-06-03T00:03:09.961 INFO:tasks.workunit.client.0.smithi049.stdout:8/541: symlink d4/d27/d3c/d88/d28/d52/d66/d8e/lae 0 2024-06-03T00:03:09.962 INFO:tasks.workunit.client.0.smithi049.stdout:6/809: dread d2/d3/d17/d57/d6e/d88/f94 [0,4194304] 0 2024-06-03T00:03:09.962 INFO:tasks.workunit.client.0.smithi049.stdout:6/810: mkdir d2/d3/d17/d57/d6e/d88/d112 0 2024-06-03T00:03:09.963 INFO:tasks.workunit.client.0.smithi049.stdout:6/811: getdents d2/d4d/de3 0 2024-06-03T00:03:09.964 INFO:tasks.workunit.client.0.smithi049.stdout:6/812: creat d2/d3/f113 x:0 0 0 2024-06-03T00:03:09.964 INFO:tasks.workunit.client.0.smithi049.stdout:6/813: truncate d2/d3/d9/d23/d48/f10a 727651 0 2024-06-03T00:03:09.964 INFO:tasks.workunit.client.0.smithi049.stdout:6/814: truncate d2/ff9 4947080 0 2024-06-03T00:03:09.964 INFO:tasks.workunit.client.0.smithi049.stdout:5/654: sync 2024-06-03T00:03:09.964 INFO:tasks.workunit.client.0.smithi049.stdout:9/815: sync 2024-06-03T00:03:09.971 INFO:tasks.workunit.client.0.smithi049.stdout:8/542: dread d4/d27/d3c/d88/d28/d25/f39 [0,4194304] 0 2024-06-03T00:03:09.971 INFO:tasks.workunit.client.0.smithi049.stdout:8/543: write d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/da9/faa [691516,54063] 0 2024-06-03T00:03:09.971 INFO:tasks.workunit.client.0.smithi049.stdout:8/544: fdatasync d4/d27/d3c/d88/d28/d52/d66/d53/d7e/f8c 0 2024-06-03T00:03:09.974 INFO:tasks.workunit.client.0.smithi049.stdout:8/545: mkdir d4/d27/d3c/d43/d6b/da6/daf 0 2024-06-03T00:03:09.975 INFO:tasks.workunit.client.0.smithi049.stdout:9/816: dread d1/d5/d13/d3b/d7f/dbc/dfc/f4e [0,4194304] 0 2024-06-03T00:03:09.977 INFO:tasks.workunit.client.0.smithi049.stdout:8/546: symlink d4/d27/d30/lb0 0 2024-06-03T00:03:09.978 INFO:tasks.workunit.client.0.smithi049.stdout:8/547: truncate d4/d27/d3c/d88/d28/d52/f65 3068990 0 2024-06-03T00:03:09.978 INFO:tasks.workunit.client.0.smithi049.stdout:8/548: dread - d4/f9d zero size 2024-06-03T00:03:09.985 INFO:tasks.workunit.client.0.smithi049.stdout:5/655: dwrite f1 [0,4194304] 0 2024-06-03T00:03:09.985 INFO:tasks.workunit.client.0.smithi049.stdout:5/656: chown d3/d5/d2d/d4b/f59 341012062 1 2024-06-03T00:03:09.986 INFO:tasks.workunit.client.0.smithi049.stdout:6/815: dwrite d2/d4d/d76/dfd/f104 [4194304,4194304] 0 2024-06-03T00:03:09.986 INFO:tasks.workunit.client.0.smithi049.stdout:9/817: dread d1/da/da8/d50/ff6 [0,4194304] 0 2024-06-03T00:03:09.987 INFO:tasks.workunit.client.0.smithi049.stdout:5/657: unlink d3/d5/da/d55/d14/d16/f2c 0 2024-06-03T00:03:09.987 INFO:tasks.workunit.client.0.smithi049.stdout:9/818: write d1/d5/d13/d3b/d49/f113 [779410,16730] 0 2024-06-03T00:03:09.988 INFO:tasks.workunit.client.0.smithi049.stdout:6/816: stat d2/d4d/l7 0 2024-06-03T00:03:09.988 INFO:tasks.workunit.client.0.smithi049.stdout:9/819: write d1/d5/d13/d3b/dbb/fec [1021357,108741] 0 2024-06-03T00:03:09.989 INFO:tasks.workunit.client.0.smithi049.stdout:5/658: creat d3/d53/dc1/fcc x:0 0 0 2024-06-03T00:03:09.990 INFO:tasks.workunit.client.0.smithi049.stdout:6/817: symlink d2/d3/d9/d23/l114 0 2024-06-03T00:03:09.990 INFO:tasks.workunit.client.0.smithi049.stdout:6/818: stat d2/f15 0 2024-06-03T00:03:09.990 INFO:tasks.workunit.client.0.smithi049.stdout:5/659: mknod d3/d53/d9c/ccd 0 2024-06-03T00:03:09.990 INFO:tasks.workunit.client.0.smithi049.stdout:5/660: write d3/d5/da/d55/d14/f90 [4203082,83235] 0 2024-06-03T00:03:09.990 INFO:tasks.workunit.client.0.smithi049.stdout:5/661: stat d3/d5/d2d/d4b/d62 0 2024-06-03T00:03:09.990 INFO:tasks.workunit.client.0.smithi049.stdout:5/662: symlink d3/lce 0 2024-06-03T00:03:09.991 INFO:tasks.workunit.client.0.smithi049.stdout:6/819: rename d2/d3/d17/f73 to d2/d3b/d103/f115 0 2024-06-03T00:03:09.995 INFO:tasks.workunit.client.0.smithi049.stdout:9/820: read d1/d5/d13/de3/dfe/d87/fb7 [4010299,94668] 0 2024-06-03T00:03:09.996 INFO:tasks.workunit.client.0.smithi049.stdout:8/549: dwrite d4/d27/d3c/f2f [0,4194304] 0 2024-06-03T00:03:09.997 INFO:tasks.workunit.client.0.smithi049.stdout:6/820: dread d2/d3/d9/d23/f26 [0,4194304] 0 2024-06-03T00:03:09.998 INFO:tasks.workunit.client.0.smithi049.stdout:6/821: getdents d2/d3/d17/d57/d6e 0 2024-06-03T00:03:10.003 INFO:tasks.workunit.client.0.smithi049.stdout:9/821: write d1/da/f5e [2472726,61512] 0 2024-06-03T00:03:10.003 INFO:tasks.workunit.client.0.smithi049.stdout:5/663: dwrite d3/d7d/f91 [0,4194304] 0 2024-06-03T00:03:10.005 INFO:tasks.workunit.client.0.smithi049.stdout:6/822: write d2/d3/d17/f77 [2363443,49821] 0 2024-06-03T00:03:10.005 INFO:tasks.workunit.client.0.smithi049.stdout:6/823: readlink d2/lc4 0 2024-06-03T00:03:10.007 INFO:tasks.workunit.client.0.smithi049.stdout:6/824: unlink d2/d3/d17/d57/d6e/dd3/feb 0 2024-06-03T00:03:10.007 INFO:tasks.workunit.client.0.smithi049.stdout:6/825: truncate d2/d3/d9/d23/d29/dd4/f10e 1017104 0 2024-06-03T00:03:10.007 INFO:tasks.workunit.client.0.smithi049.stdout:5/664: mkdir d3/d5/da/dcf 0 2024-06-03T00:03:10.008 INFO:tasks.workunit.client.0.smithi049.stdout:6/826: mkdir d2/d3/d9/d23/d48/d53/d116 0 2024-06-03T00:03:10.010 INFO:tasks.workunit.client.0.smithi049.stdout:6/827: mknod d2/d3/d9/d55/c117 0 2024-06-03T00:03:10.010 INFO:tasks.workunit.client.0.smithi049.stdout:3/586: sync 2024-06-03T00:03:10.010 INFO:tasks.workunit.client.0.smithi049.stdout:0/574: sync 2024-06-03T00:03:10.010 INFO:tasks.workunit.client.0.smithi049.stdout:0/575: chown d6 341 1 2024-06-03T00:03:10.010 INFO:tasks.workunit.client.0.smithi049.stdout:1/886: sync 2024-06-03T00:03:10.010 INFO:tasks.workunit.client.0.smithi049.stdout:2/685: sync 2024-06-03T00:03:10.010 INFO:tasks.workunit.client.0.smithi049.stdout:2/686: write da/d72/d83/fbc [376335,123333] 0 2024-06-03T00:03:10.011 INFO:tasks.workunit.client.0.smithi049.stdout:2/687: readlink da/d72/d83/l9d 0 2024-06-03T00:03:10.011 INFO:tasks.workunit.client.0.smithi049.stdout:2/688: chown da/d52/d37/d59/d80/l88 2557489 1 2024-06-03T00:03:10.011 INFO:tasks.workunit.client.0.smithi049.stdout:1/887: symlink d1/d1a/dd2/d13e/l13f 0 2024-06-03T00:03:10.012 INFO:tasks.workunit.client.0.smithi049.stdout:9/822: dread d1/d5/d13/d3b/d7f/dbc/f9c [0,4194304] 0 2024-06-03T00:03:10.012 INFO:tasks.workunit.client.0.smithi049.stdout:9/823: stat d1/da/d54/l60 0 2024-06-03T00:03:10.012 INFO:tasks.workunit.client.0.smithi049.stdout:2/689: getdents da 0 2024-06-03T00:03:10.012 INFO:tasks.workunit.client.0.smithi049.stdout:0/576: dread d6/d29/f54 [0,4194304] 0 2024-06-03T00:03:10.013 INFO:tasks.workunit.client.0.smithi049.stdout:1/888: rename d1/d2f/d36/d37/d2c/f101 to d1/d2f/d36/d37/d13/f140 0 2024-06-03T00:03:10.013 INFO:tasks.workunit.client.0.smithi049.stdout:1/889: readlink d1/d2f/d36/d37/d13/d34/d6e/lcd 0 2024-06-03T00:03:10.013 INFO:tasks.workunit.client.0.smithi049.stdout:1/890: fdatasync d1/d2f/df7/f11c 0 2024-06-03T00:03:10.014 INFO:tasks.workunit.client.0.smithi049.stdout:0/577: unlink d6/d97/d4b/d67/d6e/d52/d96/db9/c7e 0 2024-06-03T00:03:10.014 INFO:tasks.workunit.client.0.smithi049.stdout:0/578: truncate d6/d97/d4b/d67/d6e/d52/f91 162573 0 2024-06-03T00:03:10.014 INFO:tasks.workunit.client.0.smithi049.stdout:1/891: mkdir d1/d1a/dd2/d13e/d141 0 2024-06-03T00:03:10.016 INFO:tasks.workunit.client.0.smithi049.stdout:0/579: truncate d6/d30/f44 172678 0 2024-06-03T00:03:10.017 INFO:tasks.workunit.client.0.smithi049.stdout:1/892: creat d1/d2f/d36/d37/d13/d34/d6e/f142 x:0 0 0 2024-06-03T00:03:10.019 INFO:tasks.workunit.client.0.smithi049.stdout:9/824: dread d1/f55 [0,4194304] 0 2024-06-03T00:03:10.020 INFO:tasks.workunit.client.0.smithi049.stdout:6/828: dread d2/d3/d9/d40/f87 [0,4194304] 0 2024-06-03T00:03:10.020 INFO:tasks.workunit.client.0.smithi049.stdout:6/829: write d2/d3/d9/d23/d29/f32 [1587261,93440] 0 2024-06-03T00:03:10.020 INFO:tasks.workunit.client.0.smithi049.stdout:6/830: read - d2/d3/d17/d64/fc8 zero size 2024-06-03T00:03:10.021 INFO:tasks.workunit.client.0.smithi049.stdout:9/825: creat d1/da/da8/f114 x:0 0 0 2024-06-03T00:03:10.022 INFO:tasks.workunit.client.0.smithi049.stdout:6/831: mkdir d2/d3/d9/d23/d48/d53/d118 0 2024-06-03T00:03:10.023 INFO:tasks.workunit.client.0.smithi049.stdout:2/690: dread f6 [0,4194304] 0 2024-06-03T00:03:10.023 INFO:tasks.workunit.client.0.smithi049.stdout:2/691: rename da/d52 to da/d52/d40/dce/dd6 22 2024-06-03T00:03:10.024 INFO:tasks.workunit.client.0.smithi049.stdout:6/832: mkdir d2/d3/d17/d57/d6e/d88/d119 0 2024-06-03T00:03:10.024 INFO:tasks.workunit.client.0.smithi049.stdout:6/833: write d2/d4d/fe1 [790893,118562] 0 2024-06-03T00:03:10.024 INFO:tasks.workunit.client.0.smithi049.stdout:2/692: dread da/d52/df/f10 [4194304,4194304] 0 2024-06-03T00:03:10.026 INFO:tasks.workunit.client.0.smithi049.stdout:6/834: stat d2/lbb 0 2024-06-03T00:03:10.026 INFO:tasks.workunit.client.0.smithi049.stdout:6/835: write d2/d3/d17/d57/d6e/d88/dcc/df8/f101 [778223,58908] 0 2024-06-03T00:03:10.027 INFO:tasks.workunit.client.0.smithi049.stdout:2/693: creat da/d72/d83/fd7 x:0 0 0 2024-06-03T00:03:10.028 INFO:tasks.workunit.client.0.smithi049.stdout:3/587: dread d2/fd [4194304,4194304] 0 2024-06-03T00:03:10.029 INFO:tasks.workunit.client.0.smithi049.stdout:2/694: unlink da/d52/df/c21 0 2024-06-03T00:03:10.032 INFO:tasks.workunit.client.0.smithi049.stdout:2/695: dread da/d52/df/d3c/f76 [0,4194304] 0 2024-06-03T00:03:10.032 INFO:tasks.workunit.client.0.smithi049.stdout:2/696: stat da/d52/d40/f6e 0 2024-06-03T00:03:10.033 INFO:tasks.workunit.client.0.smithi049.stdout:1/893: dread d1/d2f/df7/f11c [0,4194304] 0 2024-06-03T00:03:10.033 INFO:tasks.workunit.client.0.smithi049.stdout:5/665: dwrite d3/d5/d2d/d4b/f59 [0,4194304] 0 2024-06-03T00:03:10.034 INFO:tasks.workunit.client.0.smithi049.stdout:5/666: rmdir d3/d5/d2d/d4b/d97 39 2024-06-03T00:03:10.035 INFO:tasks.workunit.client.0.smithi049.stdout:1/894: creat d1/d2f/d36/d37/d13/d34/d52/db1/f143 x:0 0 0 2024-06-03T00:03:10.036 INFO:tasks.workunit.client.0.smithi049.stdout:5/667: rename d3/d9/d68/f83 to d3/d7d/fd0 0 2024-06-03T00:03:10.038 INFO:tasks.workunit.client.0.smithi049.stdout:5/668: mknod d3/d5/da/cd1 0 2024-06-03T00:03:10.038 INFO:tasks.workunit.client.0.smithi049.stdout:1/895: dread d1/d2f/d36/d37/d2c/d45/da0/fe5 [0,4194304] 0 2024-06-03T00:03:10.038 INFO:tasks.workunit.client.0.smithi049.stdout:1/896: write d1/fbe [741246,112522] 0 2024-06-03T00:03:10.040 INFO:tasks.workunit.client.0.smithi049.stdout:5/669: symlink d3/d53/d9c/ld2 0 2024-06-03T00:03:10.042 INFO:tasks.workunit.client.0.smithi049.stdout:5/670: mkdir d3/d53/d9c/dd3 0 2024-06-03T00:03:10.057 INFO:tasks.workunit.client.0.smithi049.stdout:0/580: dwrite d6/d97/f50 [0,4194304] 0 2024-06-03T00:03:10.061 INFO:tasks.workunit.client.0.smithi049.stdout:9/826: dwrite d1/da/d26/f43 [0,4194304] 0 2024-06-03T00:03:10.061 INFO:tasks.workunit.client.0.smithi049.stdout:6/836: dwrite d2/d3/d9/d23/d29/d6a/fa1 [0,4194304] 0 2024-06-03T00:03:10.061 INFO:tasks.workunit.client.0.smithi049.stdout:6/837: truncate d2/d3/d9/d23/d48/d51/fb5 4881383 0 2024-06-03T00:03:10.065 INFO:tasks.workunit.client.0.smithi049.stdout:6/838: dread d2/d3/d9/d23/f1e [0,4194304] 0 2024-06-03T00:03:10.065 INFO:tasks.workunit.client.0.smithi049.stdout:6/839: chown d2/d3/d9/d40/c67 17560 1 2024-06-03T00:03:10.067 INFO:tasks.workunit.client.0.smithi049.stdout:1/897: dread d1/d2f/f44 [0,4194304] 0 2024-06-03T00:03:10.067 INFO:tasks.workunit.client.0.smithi049.stdout:3/588: dwrite d2/fd [4194304,4194304] 0 2024-06-03T00:03:10.069 INFO:tasks.workunit.client.0.smithi049.stdout:2/697: dwrite da/d52/df/fd4 [0,4194304] 0 2024-06-03T00:03:10.069 INFO:tasks.workunit.client.0.smithi049.stdout:5/671: dread d3/d5/d2d/d4b/d62/f6d [0,4194304] 0 2024-06-03T00:03:10.070 INFO:tasks.workunit.client.0.smithi049.stdout:1/898: creat d1/d2f/df7/d122/f144 x:0 0 0 2024-06-03T00:03:10.070 INFO:tasks.workunit.client.0.smithi049.stdout:1/899: chown d1/d1a/ccb 12465103 1 2024-06-03T00:03:10.070 INFO:tasks.workunit.client.0.smithi049.stdout:1/900: truncate d1/d2f/d50/fb8 888420 0 2024-06-03T00:03:10.071 INFO:tasks.workunit.client.0.smithi049.stdout:3/589: rename d2/d1a/d76/d9b to d2/d1a/d31/d75/d94/dd1 0 2024-06-03T00:03:10.074 INFO:tasks.workunit.client.0.smithi049.stdout:3/590: mknod d2/d14/d44/d52/cd2 0 2024-06-03T00:03:10.075 INFO:tasks.workunit.client.0.smithi049.stdout:3/591: creat d2/d1a/d76/d95/fd3 x:0 0 0 2024-06-03T00:03:10.077 INFO:tasks.workunit.client.0.smithi049.stdout:3/592: creat d2/d14/d22/d42/d68/d80/fd4 x:0 0 0 2024-06-03T00:03:10.077 INFO:tasks.workunit.client.0.smithi049.stdout:3/593: truncate d2/d14/d22/d3a/d47/fad 502358 0 2024-06-03T00:03:10.077 INFO:tasks.workunit.client.0.smithi049.stdout:3/594: chown d2/d14/d44/d52/f1e 1335200562 1 2024-06-03T00:03:10.077 INFO:tasks.workunit.client.0.smithi049.stdout:2/698: unlink da/d55/c95 0 2024-06-03T00:03:10.077 INFO:tasks.workunit.client.0.smithi049.stdout:2/699: chown da/d52/d40/d93/da9/fc0 6234493 1 2024-06-03T00:03:10.078 INFO:tasks.workunit.client.0.smithi049.stdout:0/581: dwrite d6/d97/d4b/d67/d6e/f2b [0,4194304] 0 2024-06-03T00:03:10.079 INFO:tasks.workunit.client.0.smithi049.stdout:5/672: write d3/d9/d20/d4c/d5a/d6f/f8b [1529915,56468] 0 2024-06-03T00:03:10.080 INFO:tasks.workunit.client.0.smithi049.stdout:1/901: rename d1/d2f/d36/d37/d13/d34/d52/db1/le1 to d1/d2f/d36/d57/da1/l145 0 2024-06-03T00:03:10.080 INFO:tasks.workunit.client.0.smithi049.stdout:1/902: stat d1/d2f/d36/d37/d13/d34/dd0 0 2024-06-03T00:03:10.080 INFO:tasks.workunit.client.0.smithi049.stdout:0/582: getdents d6/d97/d4b/d67/d6e/d52/d96/db9 0 2024-06-03T00:03:10.081 INFO:tasks.workunit.client.0.smithi049.stdout:5/673: rmdir d3/d5/d2d/d4b/d97/dbf/dca 0 2024-06-03T00:03:10.081 INFO:tasks.workunit.client.0.smithi049.stdout:0/583: creat d6/fc5 x:0 0 0 2024-06-03T00:03:10.082 INFO:tasks.workunit.client.0.smithi049.stdout:5/674: creat d3/d9/d20/d4c/fd4 x:0 0 0 2024-06-03T00:03:10.082 INFO:tasks.workunit.client.0.smithi049.stdout:0/584: truncate f2 7467337 0 2024-06-03T00:03:10.083 INFO:tasks.workunit.client.0.smithi049.stdout:0/585: chown d6/d30/d32/c4d 489125 1 2024-06-03T00:03:10.083 INFO:tasks.workunit.client.0.smithi049.stdout:0/586: dread - d6/d97/d4b/d67/d6e/d52/d96/db9/fa4 zero size 2024-06-03T00:03:10.083 INFO:tasks.workunit.client.0.smithi049.stdout:0/587: write d6/d59/fb6 [3872997,97883] 0 2024-06-03T00:03:10.083 INFO:tasks.workunit.client.0.smithi049.stdout:2/700: creat da/d52/df/d3c/fd8 x:0 0 0 2024-06-03T00:03:10.083 INFO:tasks.workunit.client.0.smithi049.stdout:9/827: dwrite d1/d5/d13/de3/dfe/d87/fb7 [0,4194304] 0 2024-06-03T00:03:10.084 INFO:tasks.workunit.client.0.smithi049.stdout:4/734: sync 2024-06-03T00:03:10.084 INFO:tasks.workunit.client.0.smithi049.stdout:7/663: sync 2024-06-03T00:03:10.084 INFO:tasks.workunit.client.0.smithi049.stdout:0/588: rmdir d6/d97/d4b/d67/d6e 39 2024-06-03T00:03:10.084 INFO:tasks.workunit.client.0.smithi049.stdout:0/589: chown d6/d97/d4b/d67/d6e/d52 25420968 1 2024-06-03T00:03:10.086 INFO:tasks.workunit.client.0.smithi049.stdout:2/701: mknod da/d52/df/d3c/d9a/cd9 0 2024-06-03T00:03:10.086 INFO:tasks.workunit.client.0.smithi049.stdout:2/702: write da/d52/df/d3c/d9a/fa0 [4469232,3365] 0 2024-06-03T00:03:10.086 INFO:tasks.workunit.client.0.smithi049.stdout:2/703: write da/d52/d37/fa4 [198605,50694] 0 2024-06-03T00:03:10.086 INFO:tasks.workunit.client.0.smithi049.stdout:2/704: truncate da/d55/fad 42976 0 2024-06-03T00:03:10.086 INFO:tasks.workunit.client.0.smithi049.stdout:2/705: write da/d52/d40/f8a [1438464,72866] 0 2024-06-03T00:03:10.086 INFO:tasks.workunit.client.0.smithi049.stdout:0/590: creat d6/d29/fc6 x:0 0 0 2024-06-03T00:03:10.090 INFO:tasks.workunit.client.0.smithi049.stdout:5/675: dread d3/d9/d68/f70 [0,4194304] 0 2024-06-03T00:03:10.090 INFO:tasks.workunit.client.0.smithi049.stdout:5/676: write d3/d5/d2d/f92 [2886452,63478] 0 2024-06-03T00:03:10.090 INFO:tasks.workunit.client.0.smithi049.stdout:5/677: dread - d3/d9/d20/d4c/d5a/d6f/fc4 zero size 2024-06-03T00:03:10.090 INFO:tasks.workunit.client.0.smithi049.stdout:5/678: truncate d3/d5/da/d55/d14/f90 5058320 0 2024-06-03T00:03:10.091 INFO:tasks.workunit.client.0.smithi049.stdout:4/735: write d4/fc3 [2612029,58225] 0 2024-06-03T00:03:10.094 INFO:tasks.workunit.client.0.smithi049.stdout:4/736: symlink d4/lfd 0 2024-06-03T00:03:10.094 INFO:tasks.workunit.client.0.smithi049.stdout:4/737: fdatasync d4/d3f/d14/fd9 0 2024-06-03T00:03:10.095 INFO:tasks.workunit.client.0.smithi049.stdout:4/738: mknod d4/d2a/ddf/cfe 0 2024-06-03T00:03:10.095 INFO:tasks.workunit.client.0.smithi049.stdout:4/739: write d4/d3f/ffb [3262483,72198] 0 2024-06-03T00:03:10.096 INFO:tasks.workunit.client.0.smithi049.stdout:2/706: dread da/d52/d37/d59/d80/fa5 [0,4194304] 0 2024-06-03T00:03:10.099 INFO:tasks.workunit.client.0.smithi049.stdout:2/707: rename da/d52/d40/f94 to da/d52/d37/d70/fda 0 2024-06-03T00:03:10.099 INFO:tasks.workunit.client.0.smithi049.stdout:2/708: getdents da/d55 0 2024-06-03T00:03:10.107 INFO:tasks.workunit.client.0.smithi049.stdout:2/709: dread da/f24 [0,4194304] 0 2024-06-03T00:03:10.113 INFO:tasks.workunit.client.0.smithi049.stdout:9/828: dwrite d1/d5/d13/f16 [4194304,4194304] 0 2024-06-03T00:03:10.114 INFO:tasks.workunit.client.0.smithi049.stdout:1/903: dwrite d1/d2f/d50/fa4 [0,4194304] 0 2024-06-03T00:03:10.114 INFO:tasks.workunit.client.0.smithi049.stdout:1/904: truncate d1/d2f/d36/d37/d13/d34/d6e/f142 879834 0 2024-06-03T00:03:10.114 INFO:tasks.workunit.client.0.smithi049.stdout:1/905: dread - d1/d2f/df7/d122/f144 zero size 2024-06-03T00:03:10.114 INFO:tasks.workunit.client.0.smithi049.stdout:7/664: dwrite d3/dd8/d13/d54/daa/f8b [0,4194304] 0 2024-06-03T00:03:10.114 INFO:tasks.workunit.client.0.smithi049.stdout:7/665: dread - d3/dd8/d13/d3c/d48/fb5 zero size 2024-06-03T00:03:10.115 INFO:tasks.workunit.client.0.smithi049.stdout:1/906: getdents d1/d2f/d36/d37/d13/d34/d52/db1 0 2024-06-03T00:03:10.115 INFO:tasks.workunit.client.0.smithi049.stdout:1/907: stat d1/d2f/l43 0 2024-06-03T00:03:10.115 INFO:tasks.workunit.client.0.smithi049.stdout:1/908: dread - d1/d2f/d36/d37/d2c/d45/d61/d67/f11a zero size 2024-06-03T00:03:10.115 INFO:tasks.workunit.client.0.smithi049.stdout:1/909: dread - d1/d2f/d78/dd7/d7d/f113 zero size 2024-06-03T00:03:10.115 INFO:tasks.workunit.client.0.smithi049.stdout:1/910: stat d1/l17 0 2024-06-03T00:03:10.115 INFO:tasks.workunit.client.0.smithi049.stdout:7/666: mknod d3/dd8/d13/d54/daa/cf0 0 2024-06-03T00:03:10.118 INFO:tasks.workunit.client.0.smithi049.stdout:1/911: creat d1/d2f/d36/d37/d13/d71/f146 x:0 0 0 2024-06-03T00:03:10.118 INFO:tasks.workunit.client.0.smithi049.stdout:1/912: symlink d1/d2f/d36/d57/d72/l147 0 2024-06-03T00:03:10.118 INFO:tasks.workunit.client.0.smithi049.stdout:1/913: fsync d1/d2f/d36/d37/d2c/d45/d61/d67/f118 0 2024-06-03T00:03:10.119 INFO:tasks.workunit.client.0.smithi049.stdout:1/914: chown d1/d2f/d36/l4c 34825 1 2024-06-03T00:03:10.120 INFO:tasks.workunit.client.0.smithi049.stdout:1/915: symlink d1/d2f/d36/d37/d13/d34/d8f/l148 0 2024-06-03T00:03:10.124 INFO:tasks.workunit.client.0.smithi049.stdout:1/916: creat d1/d2f/d36/d37/d13/f149 x:0 0 0 2024-06-03T00:03:10.124 INFO:tasks.workunit.client.0.smithi049.stdout:1/917: write d1/d2f/df7/f12a [2289011,50074] 0 2024-06-03T00:03:10.124 INFO:tasks.workunit.client.0.smithi049.stdout:4/740: dwrite d4/d3f/d14/d2b/d84/d69/fe4 [0,4194304] 0 2024-06-03T00:03:10.125 INFO:tasks.workunit.client.0.smithi049.stdout:5/679: dwrite f1 [0,4194304] 0 2024-06-03T00:03:10.125 INFO:tasks.workunit.client.0.smithi049.stdout:0/591: dwrite d6/d97/f7b [0,4194304] 0 2024-06-03T00:03:10.125 INFO:tasks.workunit.client.0.smithi049.stdout:2/710: getdents da/d52/df/d3c/d9a 0 2024-06-03T00:03:10.126 INFO:tasks.workunit.client.0.smithi049.stdout:0/592: getdents d6/d59/d93/db4 0 2024-06-03T00:03:10.126 INFO:tasks.workunit.client.0.smithi049.stdout:0/593: write d6/d29/f33 [4289437,45678] 0 2024-06-03T00:03:10.128 INFO:tasks.workunit.client.0.smithi049.stdout:1/918: mkdir d1/d2f/d36/d37/d13/d34/d8f/d14a 0 2024-06-03T00:03:10.129 INFO:tasks.workunit.client.0.smithi049.stdout:0/594: rename d6/d29/ca5 to d6/d59/d72/d94/cc7 0 2024-06-03T00:03:10.133 INFO:tasks.workunit.client.0.smithi049.stdout:4/741: creat d4/d3f/d14/d2b/d84/d1c/d4f/fff x:0 0 0 2024-06-03T00:03:10.133 INFO:tasks.workunit.client.0.smithi049.stdout:4/742: truncate d4/d3f/d14/d7f/ddb/d8a/fe3 162889 0 2024-06-03T00:03:10.139 INFO:tasks.workunit.client.0.smithi049.stdout:7/667: dwrite d3/dd8/d13/d3c/d4b/d5a/fc2 [0,4194304] 0 2024-06-03T00:03:10.139 INFO:tasks.workunit.client.0.smithi049.stdout:9/829: dwrite d1/da/da8/d5f/d81/fa1 [0,4194304] 0 2024-06-03T00:03:10.139 INFO:tasks.workunit.client.0.smithi049.stdout:9/830: chown d1/d5/d13/de3/dfe/lf8 24898497 1 2024-06-03T00:03:10.141 INFO:tasks.workunit.client.0.smithi049.stdout:1/919: symlink d1/d1a/dd2/d13e/l14b 0 2024-06-03T00:03:10.142 INFO:tasks.workunit.client.0.smithi049.stdout:7/668: creat d3/dd8/d13/d3c/d4b/d5a/ff1 x:0 0 0 2024-06-03T00:03:10.142 INFO:tasks.workunit.client.0.smithi049.stdout:4/743: rename d4/d2a/f94 to d4/d2a/ddf/f100 0 2024-06-03T00:03:10.146 INFO:tasks.workunit.client.0.smithi049.stdout:9/831: symlink d1/da/da8/d50/d70/l115 0 2024-06-03T00:03:10.150 INFO:tasks.workunit.client.0.smithi049.stdout:9/832: creat d1/d5/d13/d3b/d7f/dbc/dfc/f116 x:0 0 0 2024-06-03T00:03:10.150 INFO:tasks.workunit.client.0.smithi049.stdout:9/833: stat d1/da/da8/fb5 0 2024-06-03T00:03:10.150 INFO:tasks.workunit.client.0.smithi049.stdout:9/834: write d1/da/da8/f4c [3576597,52750] 0 2024-06-03T00:03:10.150 INFO:tasks.workunit.client.0.smithi049.stdout:9/835: readlink d1/d5/d13/d3b/d49/lff 0 2024-06-03T00:03:10.151 INFO:tasks.workunit.client.0.smithi049.stdout:7/669: dread d3/d32/f80 [0,4194304] 0 2024-06-03T00:03:10.153 INFO:tasks.workunit.client.0.smithi049.stdout:9/836: mkdir d1/d5/d13/d117 0 2024-06-03T00:03:10.153 INFO:tasks.workunit.client.0.smithi049.stdout:7/670: rename d3/dd8/d13/d3c/d48/d7b/d9c/dc4/fce to d3/dd8/d13/d54/daa/d92/ff2 0 2024-06-03T00:03:10.155 INFO:tasks.workunit.client.0.smithi049.stdout:7/671: creat d3/dd8/d13/d3c/d48/ff3 x:0 0 0 2024-06-03T00:03:10.158 INFO:tasks.workunit.client.0.smithi049.stdout:2/711: dwrite da/d72/d83/fb0 [0,4194304] 0 2024-06-03T00:03:10.158 INFO:tasks.workunit.client.0.smithi049.stdout:2/712: write da/d55/f58 [5203723,2663] 0 2024-06-03T00:03:10.158 INFO:tasks.workunit.client.0.smithi049.stdout:2/713: read - da/d52/d37/f84 zero size 2024-06-03T00:03:10.158 INFO:tasks.workunit.client.0.smithi049.stdout:0/595: dwrite d6/fc5 [0,4194304] 0 2024-06-03T00:03:10.158 INFO:tasks.workunit.client.0.smithi049.stdout:0/596: truncate d6/d97/d4b/d67/d6e/d52/d96/db9/f8c 176698 0 2024-06-03T00:03:10.161 INFO:tasks.workunit.client.0.smithi049.stdout:0/597: rename d6/d97/d4b/d67/d6e to d6/d29/dc8 0 2024-06-03T00:03:10.161 INFO:tasks.workunit.client.0.smithi049.stdout:2/714: creat da/d52/d40/d63/fdb x:0 0 0 2024-06-03T00:03:10.162 INFO:tasks.workunit.client.0.smithi049.stdout:0/598: unlink d6/d59/d93/db4/fba 0 2024-06-03T00:03:10.162 INFO:tasks.workunit.client.0.smithi049.stdout:0/599: write d6/d30/da3/faa [697070,120465] 0 2024-06-03T00:03:10.163 INFO:tasks.workunit.client.0.smithi049.stdout:9/837: dread d1/d5/d13/f53 [0,4194304] 0 2024-06-03T00:03:10.163 INFO:tasks.workunit.client.0.smithi049.stdout:2/715: creat da/d52/d40/d63/daa/fdc x:0 0 0 2024-06-03T00:03:10.164 INFO:tasks.workunit.client.0.smithi049.stdout:0/600: rename d6/d30/d32/c35 to d6/d30/da3/cc9 0 2024-06-03T00:03:10.164 INFO:tasks.workunit.client.0.smithi049.stdout:0/601: dread - d6/d59/d93/f99 zero size 2024-06-03T00:03:10.164 INFO:tasks.workunit.client.0.smithi049.stdout:0/602: readlink d6/d29/dc8/d52/d96/db9/l76 0 2024-06-03T00:03:10.166 INFO:tasks.workunit.client.0.smithi049.stdout:0/603: rename d6/d29/dc8/d52/d96/db9 to d6/d30/d32/dca 0 2024-06-03T00:03:10.166 INFO:tasks.workunit.client.0.smithi049.stdout:0/604: stat d6/d30 0 2024-06-03T00:03:10.167 INFO:tasks.workunit.client.0.smithi049.stdout:2/716: mkdir da/d52/df/ddd 0 2024-06-03T00:03:10.168 INFO:tasks.workunit.client.0.smithi049.stdout:0/605: mkdir d6/d59/d93/dcb 0 2024-06-03T00:03:10.168 INFO:tasks.workunit.client.0.smithi049.stdout:0/606: write d6/fb2 [3959419,112317] 0 2024-06-03T00:03:10.168 INFO:tasks.workunit.client.0.smithi049.stdout:2/717: mknod da/d72/d83/d9f/cde 0 2024-06-03T00:03:10.169 INFO:tasks.workunit.client.0.smithi049.stdout:0/607: dread d6/d29/dc8/f4f [0,4194304] 0 2024-06-03T00:03:10.169 INFO:tasks.workunit.client.0.smithi049.stdout:0/608: readlink d6/d97/l53 0 2024-06-03T00:03:10.171 INFO:tasks.workunit.client.0.smithi049.stdout:2/718: rename da/fb to da/d52/d40/fdf 0 2024-06-03T00:03:10.172 INFO:tasks.workunit.client.0.smithi049.stdout:2/719: mknod da/d52/d37/d59/dca/ce0 0 2024-06-03T00:03:10.173 INFO:tasks.workunit.client.0.smithi049.stdout:2/720: mknod da/d52/df/ddd/ce1 0 2024-06-03T00:03:10.175 INFO:tasks.workunit.client.0.smithi049.stdout:2/721: mknod da/d52/d37/d59/ce2 0 2024-06-03T00:03:10.176 INFO:tasks.workunit.client.0.smithi049.stdout:2/722: truncate da/d52/df/f34 114543 0 2024-06-03T00:03:10.176 INFO:tasks.workunit.client.0.smithi049.stdout:2/723: truncate da/d52/d40/d63/fdb 325211 0 2024-06-03T00:03:10.176 INFO:tasks.workunit.client.0.smithi049.stdout:2/724: chown da/d52/df 358 1 2024-06-03T00:03:10.176 INFO:tasks.workunit.client.0.smithi049.stdout:4/744: dwrite d4/ff [0,4194304] 0 2024-06-03T00:03:10.177 INFO:tasks.workunit.client.0.smithi049.stdout:1/920: dwrite d1/d2f/d36/d37/f68 [0,4194304] 0 2024-06-03T00:03:10.177 INFO:tasks.workunit.client.0.smithi049.stdout:9/838: dwrite d1/da/d54/d5b/d106/f10b [0,4194304] 0 2024-06-03T00:03:10.177 INFO:tasks.workunit.client.0.smithi049.stdout:7/672: dwrite d3/d14/d6e/fe2 [0,4194304] 0 2024-06-03T00:03:10.178 INFO:tasks.workunit.client.0.smithi049.stdout:2/725: rmdir da/d52/df/d3c/d60/dc6 39 2024-06-03T00:03:10.179 INFO:tasks.workunit.client.0.smithi049.stdout:7/673: getdents d3/dd8/d3f 0 2024-06-03T00:03:10.179 INFO:tasks.workunit.client.0.smithi049.stdout:7/674: stat d3/dd8/d9/c31 0 2024-06-03T00:03:10.180 INFO:tasks.workunit.client.0.smithi049.stdout:7/675: rmdir d3/dd8/d13/d54/daa 39 2024-06-03T00:03:10.181 INFO:tasks.workunit.client.0.smithi049.stdout:4/745: rename d4/d3f/d14/d2b/d84/d1c/d24/f42 to d4/d3f/f101 0 2024-06-03T00:03:10.182 INFO:tasks.workunit.client.0.smithi049.stdout:4/746: chown d4/d3f/d14/d7f/d87 2 1 2024-06-03T00:03:10.182 INFO:tasks.workunit.client.0.smithi049.stdout:4/747: fdatasync d4/d3f/d14/d2b/d84/d1c/d4f/ded/ff6 0 2024-06-03T00:03:10.182 INFO:tasks.workunit.client.0.smithi049.stdout:4/748: dread - d4/d3f/d14/d2b/d84/f57 zero size 2024-06-03T00:03:10.182 INFO:tasks.workunit.client.0.smithi049.stdout:4/749: fdatasync d4/f63 0 2024-06-03T00:03:10.182 INFO:tasks.workunit.client.0.smithi049.stdout:7/676: rename d3/f30 to d3/d14/d6e/ff4 0 2024-06-03T00:03:10.184 INFO:tasks.workunit.client.0.smithi049.stdout:1/921: symlink d1/d2f/d36/d37/d13/dc6/l14c 0 2024-06-03T00:03:10.190 INFO:tasks.workunit.client.0.smithi049.stdout:4/750: rename d4/d3f/d14/d2b/d84/d1c/d24/d43/cc5 to d4/d3f/d14/d7f/ddb/c102 0 2024-06-03T00:03:10.192 INFO:tasks.workunit.client.0.smithi049.stdout:1/922: link d1/d2f/d36/d37/f129 d1/d1a/dd2/d11d/f14d 0 2024-06-03T00:03:10.192 INFO:tasks.workunit.client.0.smithi049.stdout:7/677: rename d3/dd8/d13/d3c/d48/d7b/d9c/f66 to d3/dd8/d3f/ff5 0 2024-06-03T00:03:10.192 INFO:tasks.workunit.client.0.smithi049.stdout:7/678: write d3/dd8/d86/d90/dae/fb7 [477806,39064] 0 2024-06-03T00:03:10.192 INFO:tasks.workunit.client.0.smithi049.stdout:4/751: truncate d4/d3f/d14/d2b/d84/d1c/d24/f4a 2508133 0 2024-06-03T00:03:10.193 INFO:tasks.workunit.client.0.smithi049.stdout:7/679: mkdir d3/dd8/d13/d3c/d48/d7b/d9c/df6 0 2024-06-03T00:03:10.194 INFO:tasks.workunit.client.0.smithi049.stdout:4/752: symlink d4/d3f/d14/d2b/d84/d1c/d24/d43/daf/l103 0 2024-06-03T00:03:10.196 INFO:tasks.workunit.client.0.smithi049.stdout:1/923: dread d1/d2f/d78/dd7/d7d/fd3 [0,4194304] 0 2024-06-03T00:03:10.197 INFO:tasks.workunit.client.0.smithi049.stdout:4/753: creat d4/d3f/d14/d2b/d84/f104 x:0 0 0 2024-06-03T00:03:10.197 INFO:tasks.workunit.client.0.smithi049.stdout:4/754: chown d4/d3f/d14/d7f/d87/f8b 165887 1 2024-06-03T00:03:10.202 INFO:tasks.workunit.client.0.smithi049.stdout:9/839: dwrite d1/d5/d13/de3/de8/ffd [0,4194304] 0 2024-06-03T00:03:10.202 INFO:tasks.workunit.client.0.smithi049.stdout:2/726: dwrite da/d52/df/d3c/f53 [0,4194304] 0 2024-06-03T00:03:10.202 INFO:tasks.workunit.client.0.smithi049.stdout:4/755: dread d4/d3f/d14/d2b/d84/d69/f72 [0,4194304] 0 2024-06-03T00:03:10.202 INFO:tasks.workunit.client.0.smithi049.stdout:2/727: read da/d52/d37/fa4 [49957,112440] 0 2024-06-03T00:03:10.207 INFO:tasks.workunit.client.0.smithi049.stdout:9/840: rename d1/d95/lc8 to d1/d5/d13/d3b/dad/dc6/l118 0 2024-06-03T00:03:10.210 INFO:tasks.workunit.client.0.smithi049.stdout:9/841: getdents d1/da/da8/d50/d70 0 2024-06-03T00:03:10.210 INFO:tasks.workunit.client.0.smithi049.stdout:7/680: dwrite d3/dd8/d13/f65 [0,4194304] 0 2024-06-03T00:03:10.212 INFO:tasks.workunit.client.0.smithi049.stdout:9/842: getdents d1/d5/d13/de3/dfe/d87 0 2024-06-03T00:03:10.212 INFO:tasks.workunit.client.0.smithi049.stdout:9/843: fsync d1/da/d54/d5b/d61/f96 0 2024-06-03T00:03:10.212 INFO:tasks.workunit.client.0.smithi049.stdout:9/844: write d1/fe4 [1484823,123503] 0 2024-06-03T00:03:10.214 INFO:tasks.workunit.client.0.smithi049.stdout:9/845: mknod d1/d5/d13/d103/c119 0 2024-06-03T00:03:10.218 INFO:tasks.workunit.client.0.smithi049.stdout:2/728: dread da/d72/d83/fb0 [0,4194304] 0 2024-06-03T00:03:10.220 INFO:tasks.workunit.client.0.smithi049.stdout:2/729: symlink da/d72/d83/le3 0 2024-06-03T00:03:10.220 INFO:tasks.workunit.client.0.smithi049.stdout:2/730: getdents da/d52/d40/dce 0 2024-06-03T00:03:10.228 INFO:tasks.workunit.client.0.smithi049.stdout:1/924: dwrite d1/d2f/d36/d37/d13/d34/d52/db1/f143 [0,4194304] 0 2024-06-03T00:03:10.228 INFO:tasks.workunit.client.0.smithi049.stdout:1/925: chown d1/d2f/d36/l4c 1 1 2024-06-03T00:03:10.228 INFO:tasks.workunit.client.0.smithi049.stdout:4/756: dwrite d4/d3f/d14/d7f/ddb/f80 [0,4194304] 0 2024-06-03T00:03:10.228 INFO:tasks.workunit.client.0.smithi049.stdout:2/731: write da/d72/d83/fb0 [419443,93053] 0 2024-06-03T00:03:10.230 INFO:tasks.workunit.client.0.smithi049.stdout:1/926: creat d1/d2f/d36/d57/f14e x:0 0 0 2024-06-03T00:03:10.232 INFO:tasks.workunit.client.0.smithi049.stdout:4/757: symlink d4/d2a/l105 0 2024-06-03T00:03:10.234 INFO:tasks.workunit.client.0.smithi049.stdout:2/732: mknod da/d52/d73/da6/ce4 0 2024-06-03T00:03:10.235 INFO:tasks.workunit.client.0.smithi049.stdout:7/681: dwrite d3/dd8/d13/d3c/d48/d7b/d9c/fb6 [4194304,4194304] 0 2024-06-03T00:03:10.235 INFO:tasks.workunit.client.0.smithi049.stdout:1/927: link d1/d2f/d36/d37/d13/d34/fee d1/d2f/d78/dd7/d7d/f14f 0 2024-06-03T00:03:10.236 INFO:tasks.workunit.client.0.smithi049.stdout:7/682: rmdir d3/dd8/d13/d54/daa/d92 39 2024-06-03T00:03:10.237 INFO:tasks.workunit.client.0.smithi049.stdout:4/758: creat d4/d2a/d76/f106 x:0 0 0 2024-06-03T00:03:10.238 INFO:tasks.workunit.client.0.smithi049.stdout:2/733: getdents da/d52/d40/d63 0 2024-06-03T00:03:10.238 INFO:tasks.workunit.client.0.smithi049.stdout:1/928: dread d1/d2f/d36/d37/d2c/d45/d61/d70/faa [0,4194304] 0 2024-06-03T00:03:10.239 INFO:tasks.workunit.client.0.smithi049.stdout:7/683: truncate d3/dd8/d3f/f59 262117 0 2024-06-03T00:03:10.239 INFO:tasks.workunit.client.0.smithi049.stdout:7/684: fsync d3/dd8/d13/d54/daa/fd4 0 2024-06-03T00:03:10.239 INFO:tasks.workunit.client.0.smithi049.stdout:7/685: getdents d3/dd8/d13/d4a/dd5 0 2024-06-03T00:03:10.239 INFO:tasks.workunit.client.0.smithi049.stdout:7/686: write d3/f22 [2792373,35414] 0 2024-06-03T00:03:10.240 INFO:tasks.workunit.client.0.smithi049.stdout:7/687: symlink d3/dd8/d13/d54/lf7 0 2024-06-03T00:03:10.241 INFO:tasks.workunit.client.0.smithi049.stdout:4/759: creat d4/d3f/f107 x:0 0 0 2024-06-03T00:03:10.241 INFO:tasks.workunit.client.0.smithi049.stdout:4/760: read - d4/fa8 zero size 2024-06-03T00:03:10.241 INFO:tasks.workunit.client.0.smithi049.stdout:1/929: dread d1/d2f/d36/d37/f22 [0,4194304] 0 2024-06-03T00:03:10.242 INFO:tasks.workunit.client.0.smithi049.stdout:9/846: dwrite d1/d5/fce [0,4194304] 0 2024-06-03T00:03:10.242 INFO:tasks.workunit.client.0.smithi049.stdout:9/847: getdents d1/d5/d13/de3/dfe/d87 0 2024-06-03T00:03:10.243 INFO:tasks.workunit.client.0.smithi049.stdout:7/688: rename d3/d14/f2a to d3/dd8/d13/d3c/d4b/ff8 0 2024-06-03T00:03:10.243 INFO:tasks.workunit.client.0.smithi049.stdout:9/848: mknod d1/d5/c11a 0 2024-06-03T00:03:10.257 INFO:tasks.workunit.client.0.smithi049.stdout:7/689: write d3/dd8/d13/d3c/d48/d7b/d9c/fb6 [4539283,82062] 0 2024-06-03T00:03:10.258 INFO:tasks.workunit.client.0.smithi049.stdout:1/930: dwrite d1/d2f/df7/f12a [0,4194304] 0 2024-06-03T00:03:10.259 INFO:tasks.workunit.client.0.smithi049.stdout:1/931: read - d1/d2f/d36/d57/f14e zero size 2024-06-03T00:03:10.260 INFO:tasks.workunit.client.0.smithi049.stdout:1/932: mknod d1/d2f/d36/d37/d2c/d102/c150 0 2024-06-03T00:03:10.260 INFO:tasks.workunit.client.0.smithi049.stdout:1/933: fsync d1/d2f/d36/d57/fe9 0 2024-06-03T00:03:10.261 INFO:tasks.workunit.client.0.smithi049.stdout:1/934: creat d1/d2f/df7/d122/f151 x:0 0 0 2024-06-03T00:03:10.262 INFO:tasks.workunit.client.0.smithi049.stdout:1/935: truncate d1/d1a/f79 590091 0 2024-06-03T00:03:10.263 INFO:tasks.workunit.client.0.smithi049.stdout:2/734: dwrite da/d72/d83/fb0 [0,4194304] 0 2024-06-03T00:03:10.263 INFO:tasks.workunit.client.0.smithi049.stdout:1/936: getdents d1/d2f/d78/dd7/d7d 0 2024-06-03T00:03:10.264 INFO:tasks.workunit.client.0.smithi049.stdout:1/937: truncate d1/d2f/d36/d57/ffc 118496 0 2024-06-03T00:03:10.265 INFO:tasks.workunit.client.0.smithi049.stdout:4/761: dwrite d4/d3f/d14/d2b/d84/f57 [0,4194304] 0 2024-06-03T00:03:10.265 INFO:tasks.workunit.client.0.smithi049.stdout:2/735: mknod da/d52/df/d3c/d60/dc6/ce5 0 2024-06-03T00:03:10.265 INFO:tasks.workunit.client.0.smithi049.stdout:2/736: stat da/d43/l75 0 2024-06-03T00:03:10.265 INFO:tasks.workunit.client.0.smithi049.stdout:2/737: fsync da/d52/d40/d63/daa/f87 0 2024-06-03T00:03:10.265 INFO:tasks.workunit.client.0.smithi049.stdout:2/738: dread - da/d52/df/d3c/fd8 zero size 2024-06-03T00:03:10.268 INFO:tasks.workunit.client.0.smithi049.stdout:4/762: mkdir d4/d3f/d14/d7f/ddb/d108 0 2024-06-03T00:03:10.269 INFO:tasks.workunit.client.0.smithi049.stdout:7/690: dread d3/dd8/f5e [0,4194304] 0 2024-06-03T00:03:10.270 INFO:tasks.workunit.client.0.smithi049.stdout:7/691: creat d3/dd8/d86/ff9 x:0 0 0 2024-06-03T00:03:10.272 INFO:tasks.workunit.client.0.smithi049.stdout:7/692: rename d3/dd8/d13/ld6 to d3/dd8/d86/lfa 0 2024-06-03T00:03:10.272 INFO:tasks.workunit.client.0.smithi049.stdout:7/693: getdents d3/dd8/d13/d3c/d4b/d8e 0 2024-06-03T00:03:10.274 INFO:tasks.workunit.client.0.smithi049.stdout:7/694: creat d3/dd8/d13/d3c/d48/d7b/ffb x:0 0 0 2024-06-03T00:03:10.274 INFO:tasks.workunit.client.0.smithi049.stdout:1/938: write d1/d2f/d36/d37/d13/dc6/fff [4112965,3178] 0 2024-06-03T00:03:10.278 INFO:tasks.workunit.client.0.smithi049.stdout:1/939: rename d1/d2f/d36/d37/d64/d6c/d8c/l119 to d1/d2f/df7/dde/l152 0 2024-06-03T00:03:10.278 INFO:tasks.workunit.client.0.smithi049.stdout:1/940: stat d1/d2f/d36/d37/d13/d34/d8f/l148 0 2024-06-03T00:03:10.278 INFO:tasks.workunit.client.0.smithi049.stdout:8/550: sync 2024-06-03T00:03:10.279 INFO:tasks.workunit.client.0.smithi049.stdout:2/739: write da/d52/d40/f64 [95670,115142] 0 2024-06-03T00:03:10.279 INFO:tasks.workunit.client.0.smithi049.stdout:9/849: dwrite d1/f78 [0,4194304] 0 2024-06-03T00:03:10.282 INFO:tasks.workunit.client.0.smithi049.stdout:2/740: symlink da/d52/d40/d93/le6 0 2024-06-03T00:03:10.284 INFO:tasks.workunit.client.0.smithi049.stdout:2/741: truncate da/d52/d37/d70/fda 757232 0 2024-06-03T00:03:10.286 INFO:tasks.workunit.client.0.smithi049.stdout:2/742: mkdir da/d72/d83/d9f/de7 0 2024-06-03T00:03:10.286 INFO:tasks.workunit.client.0.smithi049.stdout:2/743: write da/d52/df/d3c/d60/f78 [2663672,32557] 0 2024-06-03T00:03:10.291 INFO:tasks.workunit.client.0.smithi049.stdout:8/551: dread d4/d27/d3c/d88/d28/d52/d66/f5a [0,4194304] 0 2024-06-03T00:03:10.293 INFO:tasks.workunit.client.0.smithi049.stdout:9/850: dread d1/d5/f6c [0,4194304] 0 2024-06-03T00:03:10.293 INFO:tasks.workunit.client.0.smithi049.stdout:8/552: mknod d4/d27/d3c/cb1 0 2024-06-03T00:03:10.295 INFO:tasks.workunit.client.0.smithi049.stdout:8/553: mknod d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/dab/cb2 0 2024-06-03T00:03:10.296 INFO:tasks.workunit.client.0.smithi049.stdout:9/851: getdents d1/da/da8/d5f 0 2024-06-03T00:03:10.296 INFO:tasks.workunit.client.0.smithi049.stdout:9/852: read - d1/da/d54/d5b/d61/f96 zero size 2024-06-03T00:03:10.296 INFO:tasks.workunit.client.0.smithi049.stdout:9/853: fdatasync d1/d5/d13/f4b 0 2024-06-03T00:03:10.296 INFO:tasks.workunit.client.0.smithi049.stdout:9/854: chown d1/d5/c6 1334994211 1 2024-06-03T00:03:10.296 INFO:tasks.workunit.client.0.smithi049.stdout:9/855: fdatasync d1/da/da8/f34 0 2024-06-03T00:03:10.297 INFO:tasks.workunit.client.0.smithi049.stdout:9/856: truncate d1/d5/d13/d3b/d49/fc7 3717538 0 2024-06-03T00:03:10.297 INFO:tasks.workunit.client.0.smithi049.stdout:8/554: rename d4/d27/d3c/d88/d4d/l4e to d4/d27/d3c/d88/d28/d45/lb3 0 2024-06-03T00:03:10.299 INFO:tasks.workunit.client.0.smithi049.stdout:9/857: creat d1/d5/d13/d117/f11b x:0 0 0 2024-06-03T00:03:10.299 INFO:tasks.workunit.client.0.smithi049.stdout:8/555: rmdir d4/d27/d3c/d43/d6b/da6/daf 0 2024-06-03T00:03:10.299 INFO:tasks.workunit.client.0.smithi049.stdout:9/858: write d1/da/f37 [89944,76907] 0 2024-06-03T00:03:10.300 INFO:tasks.workunit.client.0.smithi049.stdout:8/556: symlink d4/d27/d3c/d88/d28/d52/d66/d8e/lb4 0 2024-06-03T00:03:10.300 INFO:tasks.workunit.client.0.smithi049.stdout:8/557: write d4/d27/d3c/d88/d28/d25/f9f [562029,98257] 0 2024-06-03T00:03:10.300 INFO:tasks.workunit.client.0.smithi049.stdout:8/558: chown d4/d27/d3c/d88/d28/d45 1290775 1 2024-06-03T00:03:10.301 INFO:tasks.workunit.client.0.smithi049.stdout:9/859: creat d1/da/d27/f11c x:0 0 0 2024-06-03T00:03:10.301 INFO:tasks.workunit.client.0.smithi049.stdout:9/860: read - d1/da/da8/d5f/d81/da0/fd6 zero size 2024-06-03T00:03:10.301 INFO:tasks.workunit.client.0.smithi049.stdout:1/941: dwrite d1/d2f/d78/dd7/d7d/fd3 [0,4194304] 0 2024-06-03T00:03:10.303 INFO:tasks.workunit.client.0.smithi049.stdout:9/861: rmdir d1/da/da8/d50 39 2024-06-03T00:03:10.303 INFO:tasks.workunit.client.0.smithi049.stdout:9/862: write d1/da/da8/f34 [323299,9112] 0 2024-06-03T00:03:10.303 INFO:tasks.workunit.client.0.smithi049.stdout:9/863: stat d1/d5/d13/de3/dfe/d87/le0 0 2024-06-03T00:03:10.303 INFO:tasks.workunit.client.0.smithi049.stdout:9/864: dread - d1/da/da8/d50/d70/fef zero size 2024-06-03T00:03:10.303 INFO:tasks.workunit.client.0.smithi049.stdout:9/865: chown d1/d5/d13/de3/dfe/df3 4430594 1 2024-06-03T00:03:10.303 INFO:tasks.workunit.client.0.smithi049.stdout:7/695: dwrite d3/dd8/d86/fa9 [0,4194304] 0 2024-06-03T00:03:10.304 INFO:tasks.workunit.client.0.smithi049.stdout:2/744: dwrite da/d72/f81 [0,4194304] 0 2024-06-03T00:03:10.304 INFO:tasks.workunit.client.0.smithi049.stdout:2/745: truncate da/d72/d83/fd7 845467 0 2024-06-03T00:03:10.306 INFO:tasks.workunit.client.0.smithi049.stdout:9/866: creat d1/d5/d13/de3/dfe/df3/f11d x:0 0 0 2024-06-03T00:03:10.306 INFO:tasks.workunit.client.0.smithi049.stdout:8/559: dread d4/d27/d3c/d88/d28/f46 [0,4194304] 0 2024-06-03T00:03:10.306 INFO:tasks.workunit.client.0.smithi049.stdout:8/560: dread - d4/d27/d3c/d88/d28/d25/f57 zero size 2024-06-03T00:03:10.306 INFO:tasks.workunit.client.0.smithi049.stdout:7/696: symlink d3/dd8/d86/lfc 0 2024-06-03T00:03:10.307 INFO:tasks.workunit.client.0.smithi049.stdout:2/746: mkdir da/d52/df/d3c/de8 0 2024-06-03T00:03:10.309 INFO:tasks.workunit.client.0.smithi049.stdout:2/747: rename da/d55/ca2 to da/d52/d40/d93/da9/ce9 0 2024-06-03T00:03:10.309 INFO:tasks.workunit.client.0.smithi049.stdout:2/748: read da/d52/d37/d70/f71 [5481217,104096] 0 2024-06-03T00:03:10.310 INFO:tasks.workunit.client.0.smithi049.stdout:2/749: truncate da/d52/d37/f84 232758 0 2024-06-03T00:03:10.312 INFO:tasks.workunit.client.0.smithi049.stdout:1/942: write d1/d2f/d78/dd7/d7d/fd3 [1554076,33905] 0 2024-06-03T00:03:10.314 INFO:tasks.workunit.client.0.smithi049.stdout:8/561: creat d4/d27/d3c/d88/d4d/fb5 x:0 0 0 2024-06-03T00:03:10.315 INFO:tasks.workunit.client.0.smithi049.stdout:8/562: write d4/d27/d3c/d88/d28/d52/d66/d53/f40 [176987,36134] 0 2024-06-03T00:03:10.315 INFO:tasks.workunit.client.0.smithi049.stdout:8/563: chown d4/d27/d3c/d88/d28/d52/d66/d53 63 1 2024-06-03T00:03:10.315 INFO:tasks.workunit.client.0.smithi049.stdout:8/564: readlink d4/d27/d30/l89 0 2024-06-03T00:03:10.315 INFO:tasks.workunit.client.0.smithi049.stdout:8/565: write d4/d27/d3c/d88/d4d/f95 [4382514,81126] 0 2024-06-03T00:03:10.316 INFO:tasks.workunit.client.0.smithi049.stdout:8/566: dread d4/d27/d3c/d88/d28/d52/f9a [0,4194304] 0 2024-06-03T00:03:10.316 INFO:tasks.workunit.client.0.smithi049.stdout:8/567: read d4/d27/d3c/d88/f10 [5733976,17594] 0 2024-06-03T00:03:10.317 INFO:tasks.workunit.client.0.smithi049.stdout:9/867: read d1/da/f3f [3681794,84481] 0 2024-06-03T00:03:10.318 INFO:tasks.workunit.client.0.smithi049.stdout:9/868: rmdir d1/d5/d13/d3b/d7f/dbc/dd1 39 2024-06-03T00:03:10.319 INFO:tasks.workunit.client.0.smithi049.stdout:8/568: truncate d4/f80 791 0 2024-06-03T00:03:10.319 INFO:tasks.workunit.client.0.smithi049.stdout:8/569: read d4/d27/d3c/d88/f14 [7385149,26884] 0 2024-06-03T00:03:10.319 INFO:tasks.workunit.client.0.smithi049.stdout:9/869: creat d1/d5/d13/d3b/dad/f11e x:0 0 0 2024-06-03T00:03:10.320 INFO:tasks.workunit.client.0.smithi049.stdout:9/870: chown d1/d5/d13/c1f 63 1 2024-06-03T00:03:10.321 INFO:tasks.workunit.client.0.smithi049.stdout:9/871: write d1/d5/d13/d3b/d49/f113 [350783,104062] 0 2024-06-03T00:03:10.321 INFO:tasks.workunit.client.0.smithi049.stdout:9/872: write d1/da/d27/faa [38129,124263] 0 2024-06-03T00:03:10.322 INFO:tasks.workunit.client.0.smithi049.stdout:9/873: mknod d1/da/d27/c11f 0 2024-06-03T00:03:10.323 INFO:tasks.workunit.client.0.smithi049.stdout:8/570: creat d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/dab/fb6 x:0 0 0 2024-06-03T00:03:10.330 INFO:tasks.workunit.client.0.smithi049.stdout:8/571: mknod d4/d27/d3c/d88/d28/d52/cb7 0 2024-06-03T00:03:10.330 INFO:tasks.workunit.client.0.smithi049.stdout:7/697: dwrite d3/f40 [0,4194304] 0 2024-06-03T00:03:10.331 INFO:tasks.workunit.client.0.smithi049.stdout:7/698: mkdir d3/dd8/d9/d8f/dfd 0 2024-06-03T00:03:10.331 INFO:tasks.workunit.client.0.smithi049.stdout:7/699: write d3/dd8/d9/fa6 [235298,102772] 0 2024-06-03T00:03:10.333 INFO:tasks.workunit.client.0.smithi049.stdout:9/874: read d1/da/d26/f5c [738548,18881] 0 2024-06-03T00:03:10.333 INFO:tasks.workunit.client.0.smithi049.stdout:9/875: mknod d1/da/da8/d5f/d81/c120 0 2024-06-03T00:03:10.333 INFO:tasks.workunit.client.0.smithi049.stdout:9/876: truncate d1/d5/d13/d3b/d49/f64 4452160 0 2024-06-03T00:03:10.334 INFO:tasks.workunit.client.0.smithi049.stdout:9/877: rmdir d1/d5/d13/d3b/d7f/dbc/dd1 39 2024-06-03T00:03:10.334 INFO:tasks.workunit.client.0.smithi049.stdout:9/878: chown d1/da/d54/d5b/d61/f96 1723017 1 2024-06-03T00:03:10.335 INFO:tasks.workunit.client.0.smithi049.stdout:8/572: dread d4/f80 [0,4194304] 0 2024-06-03T00:03:10.337 INFO:tasks.workunit.client.0.smithi049.stdout:9/879: rename d1/d5/d13/d3b/d7f/dbc/dd1 to d1/da/da8/d50/d121 0 2024-06-03T00:03:10.337 INFO:tasks.workunit.client.0.smithi049.stdout:9/880: read d1/d5/d13/d3b/dbb/fec [1034377,21935] 0 2024-06-03T00:03:10.337 INFO:tasks.workunit.client.0.smithi049.stdout:2/750: dwrite da/d52/f82 [0,4194304] 0 2024-06-03T00:03:10.338 INFO:tasks.workunit.client.0.smithi049.stdout:8/573: unlink d4/d27/d3c/d88/d28/d52/f71 0 2024-06-03T00:03:10.339 INFO:tasks.workunit.client.0.smithi049.stdout:2/751: unlink da/d52/d37/d59/d80/l88 0 2024-06-03T00:03:10.339 INFO:tasks.workunit.client.0.smithi049.stdout:2/752: read da/d52/f39 [24595,103216] 0 2024-06-03T00:03:10.340 INFO:tasks.workunit.client.0.smithi049.stdout:9/881: dread d1/f55 [0,4194304] 0 2024-06-03T00:03:10.340 INFO:tasks.workunit.client.0.smithi049.stdout:1/943: dwrite d1/d2f/d36/d37/fa7 [0,4194304] 0 2024-06-03T00:03:10.341 INFO:tasks.workunit.client.0.smithi049.stdout:2/753: mknod da/d52/df/d3c/d60/cea 0 2024-06-03T00:03:10.341 INFO:tasks.workunit.client.0.smithi049.stdout:2/754: fdatasync da/d52/d37/d70/f71 0 2024-06-03T00:03:10.348 INFO:tasks.workunit.client.0.smithi049.stdout:1/944: rename d1/d2f/d36/d37/d13/d34/c5b to d1/d2f/d36/d37/d13/dc6/c153 0 2024-06-03T00:03:10.350 INFO:tasks.workunit.client.0.smithi049.stdout:2/755: creat da/feb x:0 0 0 2024-06-03T00:03:10.352 INFO:tasks.workunit.client.0.smithi049.stdout:8/574: creat d4/d27/d3c/d88/d28/d52/d66/fb8 x:0 0 0 2024-06-03T00:03:10.354 INFO:tasks.workunit.client.0.smithi049.stdout:8/575: symlink d4/d27/d3c/d88/d28/d52/d66/d8e/lb9 0 2024-06-03T00:03:10.355 INFO:tasks.workunit.client.0.smithi049.stdout:1/945: mkdir d1/d2f/d36/d37/d13/d34/dd0/de2/d154 0 2024-06-03T00:03:10.358 INFO:tasks.workunit.client.0.smithi049.stdout:2/756: rename da/d52/d37/d59/ce2 to da/d72/cec 0 2024-06-03T00:03:10.359 INFO:tasks.workunit.client.0.smithi049.stdout:1/946: getdents d1/d2f/d36/d37/d13/d34/d6e 0 2024-06-03T00:03:10.359 INFO:tasks.workunit.client.0.smithi049.stdout:8/576: rename d4/d27/d3c/d43/d6b/da6/dad to d4/d27/d3c/d88/d28/d2b/d84/dba 0 2024-06-03T00:03:10.361 INFO:tasks.workunit.client.0.smithi049.stdout:2/757: symlink da/d52/df/d3c/d9a/led 0 2024-06-03T00:03:10.361 INFO:tasks.workunit.client.0.smithi049.stdout:2/758: chown da/d52/df/c41 3 1 2024-06-03T00:03:10.361 INFO:tasks.workunit.client.0.smithi049.stdout:1/947: dread d1/d2f/d36/d37/f129 [0,4194304] 0 2024-06-03T00:03:10.361 INFO:tasks.workunit.client.0.smithi049.stdout:8/577: unlink d4/d27/d3c/d88/f74 0 2024-06-03T00:03:10.362 INFO:tasks.workunit.client.0.smithi049.stdout:2/759: creat da/d52/d9e/fee x:0 0 0 2024-06-03T00:03:10.362 INFO:tasks.workunit.client.0.smithi049.stdout:8/578: link d4/d27/d3c/d88/d28/d52/d66/c63 d4/d27/d3c/d88/d28/d52/d66/d53/cbb 0 2024-06-03T00:03:10.362 INFO:tasks.workunit.client.0.smithi049.stdout:8/579: fsync d4/d27/d3c/d88/d4d/f95 0 2024-06-03T00:03:10.364 INFO:tasks.workunit.client.0.smithi049.stdout:2/760: symlink da/d52/df/d3c/d60/dc6/lef 0 2024-06-03T00:03:10.364 INFO:tasks.workunit.client.0.smithi049.stdout:8/580: creat d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/da9/fbc x:0 0 0 2024-06-03T00:03:10.364 INFO:tasks.workunit.client.0.smithi049.stdout:8/581: chown d4/d27/d3c/f2c 4398723 1 2024-06-03T00:03:10.365 INFO:tasks.workunit.client.0.smithi049.stdout:3/595: sync 2024-06-03T00:03:10.365 INFO:tasks.workunit.client.0.smithi049.stdout:6/840: sync 2024-06-03T00:03:10.366 INFO:tasks.workunit.client.0.smithi049.stdout:5/680: sync 2024-06-03T00:03:10.366 INFO:tasks.workunit.client.0.smithi049.stdout:9/882: dwrite d1/d5/d13/d3b/f65 [4194304,4194304] 0 2024-06-03T00:03:10.366 INFO:tasks.workunit.client.0.smithi049.stdout:8/582: mknod d4/d27/d3c/d88/d28/d2b/d84/cbd 0 2024-06-03T00:03:10.366 INFO:tasks.workunit.client.0.smithi049.stdout:8/583: dread - d4/d27/d3c/d88/d28/d52/d66/d53/f82 zero size 2024-06-03T00:03:10.368 INFO:tasks.workunit.client.0.smithi049.stdout:5/681: creat d3/d53/d9c/dd3/fd5 x:0 0 0 2024-06-03T00:03:10.368 INFO:tasks.workunit.client.0.smithi049.stdout:2/761: creat da/d72/d83/d9f/ff0 x:0 0 0 2024-06-03T00:03:10.369 INFO:tasks.workunit.client.0.smithi049.stdout:9/883: mkdir d1/da/d122 0 2024-06-03T00:03:10.369 INFO:tasks.workunit.client.0.smithi049.stdout:5/682: creat d3/d5/fd6 x:0 0 0 2024-06-03T00:03:10.371 INFO:tasks.workunit.client.0.smithi049.stdout:8/584: dread d4/d27/d3c/d88/f22 [0,4194304] 0 2024-06-03T00:03:10.372 INFO:tasks.workunit.client.0.smithi049.stdout:9/884: symlink d1/da/da8/d5f/d81/l123 0 2024-06-03T00:03:10.373 INFO:tasks.workunit.client.0.smithi049.stdout:8/585: creat d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/fbe x:0 0 0 2024-06-03T00:03:10.374 INFO:tasks.workunit.client.0.smithi049.stdout:8/586: creat d4/d27/d3c/fbf x:0 0 0 2024-06-03T00:03:10.374 INFO:tasks.workunit.client.0.smithi049.stdout:2/762: link da/d55/fab da/d52/d73/ff1 0 2024-06-03T00:03:10.375 INFO:tasks.workunit.client.0.smithi049.stdout:8/587: creat d4/d27/d3c/d88/d28/d45/fc0 x:0 0 0 2024-06-03T00:03:10.376 INFO:tasks.workunit.client.0.smithi049.stdout:9/885: mkdir d1/d5/d13/d117/d124 0 2024-06-03T00:03:10.377 INFO:tasks.workunit.client.0.smithi049.stdout:1/948: dwrite d1/d2f/d78/dd7/d7d/fd3 [4194304,4194304] 0 2024-06-03T00:03:10.378 INFO:tasks.workunit.client.0.smithi049.stdout:6/841: read d2/d3/d9/d23/d48/d51/fb5 [1473633,103860] 0 2024-06-03T00:03:10.378 INFO:tasks.workunit.client.0.smithi049.stdout:2/763: creat da/d52/d40/dce/ff2 x:0 0 0 2024-06-03T00:03:10.379 INFO:tasks.workunit.client.0.smithi049.stdout:9/886: getdents d1/d5 0 2024-06-03T00:03:10.380 INFO:tasks.workunit.client.0.smithi049.stdout:6/842: mkdir d2/d4d/d11a 0 2024-06-03T00:03:10.380 INFO:tasks.workunit.client.0.smithi049.stdout:5/683: write d3/d5/da3/fbd [3252485,43233] 0 2024-06-03T00:03:10.380 INFO:tasks.workunit.client.0.smithi049.stdout:5/684: chown d3/d7d/fc6 102 1 2024-06-03T00:03:10.380 INFO:tasks.workunit.client.0.smithi049.stdout:1/949: truncate d1/d2f/d36/d37/d13/d71/ffd 3111459 0 2024-06-03T00:03:10.380 INFO:tasks.workunit.client.0.smithi049.stdout:5/685: write d3/d9/f13 [3837033,73230] 0 2024-06-03T00:03:10.380 INFO:tasks.workunit.client.0.smithi049.stdout:5/686: stat d3/d9/d20/d4c/d9d 0 2024-06-03T00:03:10.381 INFO:tasks.workunit.client.0.smithi049.stdout:6/843: symlink d2/d3/d9/d23/l11b 0 2024-06-03T00:03:10.381 INFO:tasks.workunit.client.0.smithi049.stdout:6/844: write d2/d3/d9/d40/f87 [748390,106940] 0 2024-06-03T00:03:10.381 INFO:tasks.workunit.client.0.smithi049.stdout:2/764: unlink da/d52/d37/l68 0 2024-06-03T00:03:10.382 INFO:tasks.workunit.client.0.smithi049.stdout:5/687: mknod d3/d9/d20/cd7 0 2024-06-03T00:03:10.382 INFO:tasks.workunit.client.0.smithi049.stdout:9/887: symlink d1/da/d27/l125 0 2024-06-03T00:03:10.383 INFO:tasks.workunit.client.0.smithi049.stdout:1/950: mknod d1/d1a/dd2/d13e/d141/c155 0 2024-06-03T00:03:10.384 INFO:tasks.workunit.client.0.smithi049.stdout:2/765: truncate da/d52/f82 2205517 0 2024-06-03T00:03:10.385 INFO:tasks.workunit.client.0.smithi049.stdout:9/888: creat d1/da/d27/f126 x:0 0 0 2024-06-03T00:03:10.385 INFO:tasks.workunit.client.0.smithi049.stdout:9/889: write d1/da/da8/f34 [206764,34584] 0 2024-06-03T00:03:10.386 INFO:tasks.workunit.client.0.smithi049.stdout:1/951: mknod d1/d1a/dd2/d13e/c156 0 2024-06-03T00:03:10.386 INFO:tasks.workunit.client.0.smithi049.stdout:1/952: chown d1/d2f/d36/d37/l91 21 1 2024-06-03T00:03:10.387 INFO:tasks.workunit.client.0.smithi049.stdout:2/766: creat da/d52/ff3 x:0 0 0 2024-06-03T00:03:10.387 INFO:tasks.workunit.client.0.smithi049.stdout:2/767: write da/d52/d37/f84 [1047249,3424] 0 2024-06-03T00:03:10.388 INFO:tasks.workunit.client.0.smithi049.stdout:2/768: chown da/d72/d83/fb0 3 1 2024-06-03T00:03:10.388 INFO:tasks.workunit.client.0.smithi049.stdout:9/890: getdents d1/d5/d13/d3b/dad 0 2024-06-03T00:03:10.388 INFO:tasks.workunit.client.0.smithi049.stdout:6/845: dread d2/d3b/fd1 [4194304,4194304] 0 2024-06-03T00:03:10.389 INFO:tasks.workunit.client.0.smithi049.stdout:1/953: rmdir d1/d2f/d36/d37/d2c/d45/d83 39 2024-06-03T00:03:10.389 INFO:tasks.workunit.client.0.smithi049.stdout:6/846: symlink d2/d3/d9/d40/l11c 0 2024-06-03T00:03:10.391 INFO:tasks.workunit.client.0.smithi049.stdout:2/769: creat da/d52/d40/d63/ff4 x:0 0 0 2024-06-03T00:03:10.391 INFO:tasks.workunit.client.0.smithi049.stdout:2/770: chown da/d52/d37/dac 601763073 1 2024-06-03T00:03:10.391 INFO:tasks.workunit.client.0.smithi049.stdout:2/771: read - da/d52/ff3 zero size 2024-06-03T00:03:10.392 INFO:tasks.workunit.client.0.smithi049.stdout:9/891: mknod d1/da/da8/d5f/c127 0 2024-06-03T00:03:10.392 INFO:tasks.workunit.client.0.smithi049.stdout:9/892: write d1/da/da8/d5f/fdb [446933,45144] 0 2024-06-03T00:03:10.392 INFO:tasks.workunit.client.0.smithi049.stdout:3/596: dwrite d2/d14/d44/d52/d4c/f30 [0,4194304] 0 2024-06-03T00:03:10.393 INFO:tasks.workunit.client.0.smithi049.stdout:1/954: rename d1/d1a/f8a to d1/d2f/f157 0 2024-06-03T00:03:10.395 INFO:tasks.workunit.client.0.smithi049.stdout:2/772: mkdir da/d52/d40/d93/da9/df5 0 2024-06-03T00:03:10.396 INFO:tasks.workunit.client.0.smithi049.stdout:3/597: dread d2/d1a/f37 [0,4194304] 0 2024-06-03T00:03:10.397 INFO:tasks.workunit.client.0.smithi049.stdout:9/893: symlink d1/d5/d13/d3b/d49/l128 0 2024-06-03T00:03:10.397 INFO:tasks.workunit.client.0.smithi049.stdout:3/598: rename d2/d1a/d31 to d2/d1a/d34/dd5 0 2024-06-03T00:03:10.399 INFO:tasks.workunit.client.0.smithi049.stdout:1/955: creat d1/d1a/dd2/d13e/f158 x:0 0 0 2024-06-03T00:03:10.400 INFO:tasks.workunit.client.0.smithi049.stdout:1/956: write d1/d2f/d36/d37/f33 [8016214,125109] 0 2024-06-03T00:03:10.401 INFO:tasks.workunit.client.0.smithi049.stdout:2/773: unlink da/d52/df/l22 0 2024-06-03T00:03:10.402 INFO:tasks.workunit.client.0.smithi049.stdout:1/957: symlink d1/d2f/d36/d37/d2c/d102/l159 0 2024-06-03T00:03:10.402 INFO:tasks.workunit.client.0.smithi049.stdout:1/958: chown d1/d2f/d36/d37/f2b 28 1 2024-06-03T00:03:10.403 INFO:tasks.workunit.client.0.smithi049.stdout:1/959: chown d1/d1a/dd2/d13e/d141 8282130 1 2024-06-03T00:03:10.404 INFO:tasks.workunit.client.0.smithi049.stdout:2/774: creat da/d52/d9e/ff6 x:0 0 0 2024-06-03T00:03:10.404 INFO:tasks.workunit.client.0.smithi049.stdout:2/775: write da/d52/d37/fa4 [410709,102657] 0 2024-06-03T00:03:10.404 INFO:tasks.workunit.client.0.smithi049.stdout:2/776: chown da/d55/l5a 0 1 2024-06-03T00:03:10.406 INFO:tasks.workunit.client.0.smithi049.stdout:1/960: rename d1/d2f/d36/d37/d13/d34/d6e/lef to d1/d2f/d36/d37/d13/d71/l15a 0 2024-06-03T00:03:10.406 INFO:tasks.workunit.client.0.smithi049.stdout:1/961: fdatasync d1/d2f/d36/d57/d72/fa6 0 2024-06-03T00:03:10.406 INFO:tasks.workunit.client.0.smithi049.stdout:1/962: write d1/d2f/df7/f126 [372593,726] 0 2024-06-03T00:03:10.407 INFO:tasks.workunit.client.0.smithi049.stdout:2/777: truncate da/d55/f58 4738342 0 2024-06-03T00:03:10.408 INFO:tasks.workunit.client.0.smithi049.stdout:1/963: link d1/d2f/d36/d37/d64/d6c/d8c/c9d d1/d2f/d78/dd7/c15b 0 2024-06-03T00:03:10.409 INFO:tasks.workunit.client.0.smithi049.stdout:2/778: symlink da/d72/lf7 0 2024-06-03T00:03:10.411 INFO:tasks.workunit.client.0.smithi049.stdout:2/779: rename da/d52/df/d3c/d60/dc6/fcf to da/d52/d9e/ff8 0 2024-06-03T00:03:10.418 INFO:tasks.workunit.client.0.smithi049.stdout:9/894: dread d1/d5/d13/d3b/d7f/dbc/dfc/fa6 [4194304,4194304] 0 2024-06-03T00:03:10.419 INFO:tasks.workunit.client.0.smithi049.stdout:9/895: getdents d1/da/d122 0 2024-06-03T00:03:10.421 INFO:tasks.workunit.client.0.smithi049.stdout:9/896: creat d1/da/da8/d50/d70/f129 x:0 0 0 2024-06-03T00:03:10.422 INFO:tasks.workunit.client.0.smithi049.stdout:8/588: dwrite d4/d27/d3c/d88/d28/d52/f9a [0,4194304] 0 2024-06-03T00:03:10.425 INFO:tasks.workunit.client.0.smithi049.stdout:9/897: mkdir d1/d5/d13/d103/d12a 0 2024-06-03T00:03:10.426 INFO:tasks.workunit.client.0.smithi049.stdout:8/589: creat d4/d27/fc1 x:0 0 0 2024-06-03T00:03:10.427 INFO:tasks.workunit.client.0.smithi049.stdout:8/590: symlink d4/d27/d3c/d88/d4d/lc2 0 2024-06-03T00:03:10.430 INFO:tasks.workunit.client.0.smithi049.stdout:3/599: dwrite d2/d14/d44/d52/d4c/d4b/d58/fa9 [0,4194304] 0 2024-06-03T00:03:10.431 INFO:tasks.workunit.client.0.smithi049.stdout:1/964: dwrite d1/d2f/d36/d37/d2c/d45/d61/d70/f85 [0,4194304] 0 2024-06-03T00:03:10.432 INFO:tasks.workunit.client.0.smithi049.stdout:1/965: write d1/d2f/d36/d37/d13/d34/d6e/dad/f127 [425488,41119] 0 2024-06-03T00:03:10.432 INFO:tasks.workunit.client.0.smithi049.stdout:3/600: creat d2/d1a/d34/dd5/d75/d94/dd1/db6/fd6 x:0 0 0 2024-06-03T00:03:10.432 INFO:tasks.workunit.client.0.smithi049.stdout:3/601: write d2/d14/f6f [864996,9378] 0 2024-06-03T00:03:10.432 INFO:tasks.workunit.client.0.smithi049.stdout:3/602: dread - d2/d1a/d51/f9c zero size 2024-06-03T00:03:10.434 INFO:tasks.workunit.client.0.smithi049.stdout:8/591: read d4/d27/d3c/d88/d28/d52/d66/d53/d7e/f7b [1761833,71920] 0 2024-06-03T00:03:10.436 INFO:tasks.workunit.client.0.smithi049.stdout:1/966: rename d1/d2f/df7/d122/fbc to d1/d2f/d36/d37/d13/d34/dd0/de2/d154/f15c 0 2024-06-03T00:03:10.436 INFO:tasks.workunit.client.0.smithi049.stdout:1/967: chown d1/d2f/df7/l10c 375414 1 2024-06-03T00:03:10.437 INFO:tasks.workunit.client.0.smithi049.stdout:8/592: dread d4/d27/d3c/d88/d28/d45/f92 [0,4194304] 0 2024-06-03T00:03:10.437 INFO:tasks.workunit.client.0.smithi049.stdout:1/968: creat d1/d2f/d36/d57/da1/d112/f15d x:0 0 0 2024-06-03T00:03:10.438 INFO:tasks.workunit.client.0.smithi049.stdout:1/969: getdents d1 0 2024-06-03T00:03:10.440 INFO:tasks.workunit.client.0.smithi049.stdout:2/780: dwrite da/d52/d37/fa4 [0,4194304] 0 2024-06-03T00:03:10.444 INFO:tasks.workunit.client.0.smithi049.stdout:1/970: read d1/d2f/d36/d37/d13/d71/ffd [196243,28465] 0 2024-06-03T00:03:10.446 INFO:tasks.workunit.client.0.smithi049.stdout:1/971: creat d1/d2f/d36/d37/d13/d34/d8f/f15e x:0 0 0 2024-06-03T00:03:10.447 INFO:tasks.workunit.client.0.smithi049.stdout:9/898: dwrite d1/da/da8/d5f/f7d [0,4194304] 0 2024-06-03T00:03:10.447 INFO:tasks.workunit.client.0.smithi049.stdout:9/899: chown d1/da/d26/lc1 102666391 1 2024-06-03T00:03:10.449 INFO:tasks.workunit.client.0.smithi049.stdout:1/972: rmdir d1/d2f/d36/d37/d13/d34/d11f 0 2024-06-03T00:03:10.449 INFO:tasks.workunit.client.0.smithi049.stdout:1/973: truncate d1/d2f/d78/dd7/f9b 4870629 0 2024-06-03T00:03:10.450 INFO:tasks.workunit.client.0.smithi049.stdout:9/900: mkdir d1/da/da8/d50/d121/d12b 0 2024-06-03T00:03:10.452 INFO:tasks.workunit.client.0.smithi049.stdout:1/974: dread d1/d2f/d50/fce [0,4194304] 0 2024-06-03T00:03:10.452 INFO:tasks.workunit.client.0.smithi049.stdout:1/975: chown d1/d2f/d36/d37/d2c/d45/d61/d70 16947148 1 2024-06-03T00:03:10.452 INFO:tasks.workunit.client.0.smithi049.stdout:1/976: fsync d1/d2f/d36/d57/d72/f93 0 2024-06-03T00:03:10.453 INFO:tasks.workunit.client.0.smithi049.stdout:0/609: sync 2024-06-03T00:03:10.453 INFO:tasks.workunit.client.0.smithi049.stdout:4/763: sync 2024-06-03T00:03:10.453 INFO:tasks.workunit.client.0.smithi049.stdout:4/764: fdatasync d4/d3f/f98 0 2024-06-03T00:03:10.453 INFO:tasks.workunit.client.0.smithi049.stdout:4/765: write d4/d3f/d14/d2b/d84/d1c/d4f/f88 [1007886,121827] 0 2024-06-03T00:03:10.453 INFO:tasks.workunit.client.0.smithi049.stdout:4/766: write d4/d3f/d14/fe6 [527916,49376] 0 2024-06-03T00:03:10.453 INFO:tasks.workunit.client.0.smithi049.stdout:4/767: stat d4/d3f/d14/d2b/d84/d1c/d24/d43/fab 0 2024-06-03T00:03:10.455 INFO:tasks.workunit.client.0.smithi049.stdout:1/977: creat d1/d2f/f15f x:0 0 0 2024-06-03T00:03:10.455 INFO:tasks.workunit.client.0.smithi049.stdout:1/978: dread - d1/d2f/d36/d37/d2c/d45/d61/d67/f118 zero size 2024-06-03T00:03:10.455 INFO:tasks.workunit.client.0.smithi049.stdout:1/979: fsync d1/d2f/f46 0 2024-06-03T00:03:10.455 INFO:tasks.workunit.client.0.smithi049.stdout:0/610: link d6/d97/d4b/f95 d6/d30/d32/dca/fcc 0 2024-06-03T00:03:10.458 INFO:tasks.workunit.client.0.smithi049.stdout:1/980: creat d1/d1a/dd2/d13e/d141/f160 x:0 0 0 2024-06-03T00:03:10.458 INFO:tasks.workunit.client.0.smithi049.stdout:0/611: creat d6/d30/d32/fcd x:0 0 0 2024-06-03T00:03:10.458 INFO:tasks.workunit.client.0.smithi049.stdout:0/612: write d6/fa0 [909552,71789] 0 2024-06-03T00:03:10.460 INFO:tasks.workunit.client.0.smithi049.stdout:0/613: unlink d6/d30/d32/dca/l7d 0 2024-06-03T00:03:10.461 INFO:tasks.workunit.client.0.smithi049.stdout:0/614: symlink d6/d29/dc8/d52/d96/lce 0 2024-06-03T00:03:10.465 INFO:tasks.workunit.client.0.smithi049.stdout:4/768: read d4/d3f/d14/d7f/d87/f92 [3176826,487] 0 2024-06-03T00:03:10.467 INFO:tasks.workunit.client.0.smithi049.stdout:4/769: creat d4/d3f/d14/d7f/ddb/d108/f109 x:0 0 0 2024-06-03T00:03:10.470 INFO:tasks.workunit.client.0.smithi049.stdout:0/615: write d6/d29/dc8/d52/d96/fa6 [1628548,20038] 0 2024-06-03T00:03:10.471 INFO:tasks.workunit.client.0.smithi049.stdout:0/616: mknod d6/d59/d93/dcb/ccf 0 2024-06-03T00:03:10.475 INFO:tasks.workunit.client.0.smithi049.stdout:0/617: dread d6/f4e [0,4194304] 0 2024-06-03T00:03:10.476 INFO:tasks.workunit.client.0.smithi049.stdout:0/618: rename d6/d97/d4b/l6f to d6/d30/da3/ld0 0 2024-06-03T00:03:10.478 INFO:tasks.workunit.client.0.smithi049.stdout:2/781: dwrite da/d52/d40/d63/ff4 [0,4194304] 0 2024-06-03T00:03:10.478 INFO:tasks.workunit.client.0.smithi049.stdout:2/782: truncate da/d52/d40/d93/fd0 194229 0 2024-06-03T00:03:10.478 INFO:tasks.workunit.client.0.smithi049.stdout:0/619: creat d6/d97/d4b/d67/fd1 x:0 0 0 2024-06-03T00:03:10.478 INFO:tasks.workunit.client.0.smithi049.stdout:3/603: dwrite d2/d1a/f20 [0,4194304] 0 2024-06-03T00:03:10.478 INFO:tasks.workunit.client.0.smithi049.stdout:0/620: dread - d6/d30/f9c zero size 2024-06-03T00:03:10.478 INFO:tasks.workunit.client.0.smithi049.stdout:2/783: write da/d52/d9e/fc1 [753880,113170] 0 2024-06-03T00:03:10.478 INFO:tasks.workunit.client.0.smithi049.stdout:2/784: fdatasync da/f1c 0 2024-06-03T00:03:10.478 INFO:tasks.workunit.client.0.smithi049.stdout:2/785: read da/f45 [292305,83645] 0 2024-06-03T00:03:10.481 INFO:tasks.workunit.client.0.smithi049.stdout:9/901: dwrite d1/da/f5e [0,4194304] 0 2024-06-03T00:03:10.481 INFO:tasks.workunit.client.0.smithi049.stdout:1/981: dwrite d1/d2f/d36/d37/d13/d34/dd0/fe8 [0,4194304] 0 2024-06-03T00:03:10.481 INFO:tasks.workunit.client.0.smithi049.stdout:1/982: dread - d1/d2f/d36/d37/d13/d34/dd0/f105 zero size 2024-06-03T00:03:10.481 INFO:tasks.workunit.client.0.smithi049.stdout:2/786: rename da/d52/d9e/ff8 to da/d52/dd3/ff9 0 2024-06-03T00:03:10.481 INFO:tasks.workunit.client.0.smithi049.stdout:2/787: stat da/d52/d73 0 2024-06-03T00:03:10.484 INFO:tasks.workunit.client.0.smithi049.stdout:1/983: link d1/d2f/d36/d37/d2c/c41 d1/d2f/d36/d37/d13/d34/dd0/de2/c161 0 2024-06-03T00:03:10.484 INFO:tasks.workunit.client.0.smithi049.stdout:1/984: chown d1/d2f/d36/d37/d2c/d45/d61/c10d 595288898 1 2024-06-03T00:03:10.486 INFO:tasks.workunit.client.0.smithi049.stdout:9/902: rename d1/da/d27/f126 to d1/d5/d13/d3b/dad/f12c 0 2024-06-03T00:03:10.487 INFO:tasks.workunit.client.0.smithi049.stdout:2/788: creat da/dc2/ffa x:0 0 0 2024-06-03T00:03:10.487 INFO:tasks.workunit.client.0.smithi049.stdout:2/789: readlink da/d52/df/l8e 0 2024-06-03T00:03:10.487 INFO:tasks.workunit.client.0.smithi049.stdout:2/790: dread - da/d55/fab zero size 2024-06-03T00:03:10.487 INFO:tasks.workunit.client.0.smithi049.stdout:2/791: chown da/d52/d40/d93 12703 1 2024-06-03T00:03:10.488 INFO:tasks.workunit.client.0.smithi049.stdout:9/903: creat d1/d5/d13/d3b/f12d x:0 0 0 2024-06-03T00:03:10.489 INFO:tasks.workunit.client.0.smithi049.stdout:0/621: dread d6/d59/d72/f86 [0,4194304] 0 2024-06-03T00:03:10.490 INFO:tasks.workunit.client.0.smithi049.stdout:2/792: symlink da/d52/d40/d93/lfb 0 2024-06-03T00:03:10.490 INFO:tasks.workunit.client.0.smithi049.stdout:9/904: rmdir d1/da/da8/d5f/d81 39 2024-06-03T00:03:10.490 INFO:tasks.workunit.client.0.smithi049.stdout:2/793: truncate f6 4378568 0 2024-06-03T00:03:10.490 INFO:tasks.workunit.client.0.smithi049.stdout:2/794: fdatasync da/d52/d73/da6/fc3 0 2024-06-03T00:03:10.491 INFO:tasks.workunit.client.0.smithi049.stdout:2/795: dread - da/d52/d40/d93/da9/fc0 zero size 2024-06-03T00:03:10.493 INFO:tasks.workunit.client.0.smithi049.stdout:3/604: dwrite d2/d14/d44/d52/d4c/d4b/d58/f85 [0,4194304] 0 2024-06-03T00:03:10.494 INFO:tasks.workunit.client.0.smithi049.stdout:2/796: getdents da/d52/d40/d63/daa 0 2024-06-03T00:03:10.494 INFO:tasks.workunit.client.0.smithi049.stdout:2/797: fdatasync da/d52/d37/f56 0 2024-06-03T00:03:10.494 INFO:tasks.workunit.client.0.smithi049.stdout:2/798: fsync f4 0 2024-06-03T00:03:10.495 INFO:tasks.workunit.client.0.smithi049.stdout:3/605: creat d2/d1a/d34/dd5/d75/fd7 x:0 0 0 2024-06-03T00:03:10.496 INFO:tasks.workunit.client.0.smithi049.stdout:2/799: mknod da/d52/df/d3c/cfc 0 2024-06-03T00:03:10.496 INFO:tasks.workunit.client.0.smithi049.stdout:3/606: creat d2/d14/d22/d3a/fd8 x:0 0 0 2024-06-03T00:03:10.496 INFO:tasks.workunit.client.0.smithi049.stdout:3/607: chown d2/d14/d44/d52/c36 1409040 1 2024-06-03T00:03:10.496 INFO:tasks.workunit.client.0.smithi049.stdout:3/608: getdents d2/d1a/d34/dd5/d75/d94/dd1/db6 0 2024-06-03T00:03:10.499 INFO:tasks.workunit.client.0.smithi049.stdout:2/800: dread da/d52/df/f29 [0,4194304] 0 2024-06-03T00:03:10.504 INFO:tasks.workunit.client.0.smithi049.stdout:1/985: dwrite d1/d2f/d36/d37/d13/d71/ffd [0,4194304] 0 2024-06-03T00:03:10.505 INFO:tasks.workunit.client.0.smithi049.stdout:1/986: readlink d1/d2f/d36/d37/d2c/l81 0 2024-06-03T00:03:10.510 INFO:tasks.workunit.client.0.smithi049.stdout:2/801: dread da/d72/d83/fb0 [0,4194304] 0 2024-06-03T00:03:10.512 INFO:tasks.workunit.client.0.smithi049.stdout:2/802: rmdir da/d52/df/d3c/da8 0 2024-06-03T00:03:10.513 INFO:tasks.workunit.client.0.smithi049.stdout:8/593: dwrite d4/d27/d3c/d88/d28/d2b/f87 [0,4194304] 0 2024-06-03T00:03:10.519 INFO:tasks.workunit.client.0.smithi049.stdout:2/803: dread da/f85 [0,4194304] 0 2024-06-03T00:03:10.520 INFO:tasks.workunit.client.0.smithi049.stdout:3/609: write d2/d14/d44/fa5 [2098479,2696] 0 2024-06-03T00:03:10.521 INFO:tasks.workunit.client.0.smithi049.stdout:2/804: unlink da/d52/d40/l8c 0 2024-06-03T00:03:10.521 INFO:tasks.workunit.client.0.smithi049.stdout:2/805: truncate da/d43/f7e 1111132 0 2024-06-03T00:03:10.526 INFO:tasks.workunit.client.0.smithi049.stdout:9/905: dwrite d1/da/da8/d50/d70/ff2 [0,4194304] 0 2024-06-03T00:03:10.531 INFO:tasks.workunit.client.0.smithi049.stdout:9/906: rename d1/d5/d13/d117/d124 to d1/d5/d13/d3b/d7f/dbc/dfc/d12e 0 2024-06-03T00:03:10.531 INFO:tasks.workunit.client.0.smithi049.stdout:9/907: write d1/d5/d13/d3b/f48 [116285,24615] 0 2024-06-03T00:03:10.531 INFO:tasks.workunit.client.0.smithi049.stdout:9/908: truncate d1/da/d27/f75 1786393 0 2024-06-03T00:03:10.531 INFO:tasks.workunit.client.0.smithi049.stdout:9/909: creat d1/da/d27/f12f x:0 0 0 2024-06-03T00:03:10.532 INFO:tasks.workunit.client.0.smithi049.stdout:9/910: creat d1/da/d122/f130 x:0 0 0 2024-06-03T00:03:10.536 INFO:tasks.workunit.client.0.smithi049.stdout:9/911: unlink d1/c14 0 2024-06-03T00:03:10.536 INFO:tasks.workunit.client.0.smithi049.stdout:8/594: dwrite d4/d27/d3c/d88/f13 [4194304,4194304] 0 2024-06-03T00:03:10.536 INFO:tasks.workunit.client.0.smithi049.stdout:7/700: sync 2024-06-03T00:03:10.537 INFO:tasks.workunit.client.0.smithi049.stdout:1/987: dwrite d1/d2f/d78/f9f [4194304,4194304] 0 2024-06-03T00:03:10.537 INFO:tasks.workunit.client.0.smithi049.stdout:1/988: readlink d1/d2f/d36/d37/d64/l12b 0 2024-06-03T00:03:10.537 INFO:tasks.workunit.client.0.smithi049.stdout:1/989: dread - d1/d2f/d78/dd7/fd6 zero size 2024-06-03T00:03:10.537 INFO:tasks.workunit.client.0.smithi049.stdout:1/990: fdatasync d1/d2f/d36/d37/d13/f140 0 2024-06-03T00:03:10.537 INFO:tasks.workunit.client.0.smithi049.stdout:9/912: mknod d1/da/da8/d50/d70/c131 0 2024-06-03T00:03:10.537 INFO:tasks.workunit.client.0.smithi049.stdout:2/806: read f4 [3491457,45673] 0 2024-06-03T00:03:10.538 INFO:tasks.workunit.client.0.smithi049.stdout:7/701: mkdir d3/dd8/d13/d4a/dd5/dfe 0 2024-06-03T00:03:10.538 INFO:tasks.workunit.client.0.smithi049.stdout:8/595: symlink d4/lc3 0 2024-06-03T00:03:10.538 INFO:tasks.workunit.client.0.smithi049.stdout:8/596: fsync d4/d27/fc1 0 2024-06-03T00:03:10.538 INFO:tasks.workunit.client.0.smithi049.stdout:7/702: mkdir d3/dd8/d13/d4a/dd5/dff 0 2024-06-03T00:03:10.538 INFO:tasks.workunit.client.0.smithi049.stdout:7/703: dread - d3/dd8/d13/d54/fba zero size 2024-06-03T00:03:10.540 INFO:tasks.workunit.client.0.smithi049.stdout:1/991: mknod d1/d2f/d36/d37/d64/c162 0 2024-06-03T00:03:10.541 INFO:tasks.workunit.client.0.smithi049.stdout:7/704: rmdir d3/dd8/d13/d4a/dd5/dff 0 2024-06-03T00:03:10.541 INFO:tasks.workunit.client.0.smithi049.stdout:1/992: creat d1/d2f/d36/d37/f163 x:0 0 0 2024-06-03T00:03:10.541 INFO:tasks.workunit.client.0.smithi049.stdout:1/993: chown d1/d2f/d36/d37/d64/d6c/cf1 679783653 1 2024-06-03T00:03:10.541 INFO:tasks.workunit.client.0.smithi049.stdout:9/913: dread d1/da/d54/d5b/d61/fc4 [0,4194304] 0 2024-06-03T00:03:10.541 INFO:tasks.workunit.client.0.smithi049.stdout:7/705: truncate d3/dd8/f5e 2035574 0 2024-06-03T00:03:10.541 INFO:tasks.workunit.client.0.smithi049.stdout:1/994: mkdir d1/d2f/d36/d37/d13/d34/d5f/d164 0 2024-06-03T00:03:10.542 INFO:tasks.workunit.client.0.smithi049.stdout:1/995: fdatasync d1/f7 0 2024-06-03T00:03:10.542 INFO:tasks.workunit.client.0.smithi049.stdout:7/706: rmdir d3/dd8/d13/d54/daa 39 2024-06-03T00:03:10.542 INFO:tasks.workunit.client.0.smithi049.stdout:7/707: chown d3/dd8/d13 3 1 2024-06-03T00:03:10.542 INFO:tasks.workunit.client.0.smithi049.stdout:9/914: getdents d1/d5/d13/d103 0 2024-06-03T00:03:10.543 INFO:tasks.workunit.client.0.smithi049.stdout:7/708: creat d3/d32/d95/f100 x:0 0 0 2024-06-03T00:03:10.543 INFO:tasks.workunit.client.0.smithi049.stdout:1/996: symlink d1/d2f/d36/d37/d13/dc6/l165 0 2024-06-03T00:03:10.544 INFO:tasks.workunit.client.0.smithi049.stdout:1/997: readlink d1/d1a/dd2/d13e/l13f 0 2024-06-03T00:03:10.544 INFO:tasks.workunit.client.0.smithi049.stdout:9/915: creat d1/d5/d13/d3b/d7f/dbc/f132 x:0 0 0 2024-06-03T00:03:10.545 INFO:tasks.workunit.client.0.smithi049.stdout:7/709: rename d3/d32/d95/cdb to d3/dd8/d13/d3c/d48/d7b/d9c/dc8/c101 0 2024-06-03T00:03:10.546 INFO:tasks.workunit.client.0.smithi049.stdout:8/597: write d4/d27/d3c/d88/d28/d52/d66/d53/d7e/f7f [4406707,95207] 0 2024-06-03T00:03:10.547 INFO:tasks.workunit.client.0.smithi049.stdout:8/598: write d4/d27/fc1 [802390,59912] 0 2024-06-03T00:03:10.547 INFO:tasks.workunit.client.0.smithi049.stdout:1/998: rename d1/d2f/d36/d57/d72/ddf/c128 to d1/d2f/d36/d37/d13/d34/dd0/de2/c166 0 2024-06-03T00:03:10.548 INFO:tasks.workunit.client.0.smithi049.stdout:1/999: write d1/d2f/d36/d37/d13/dc6/fcc [529204,513] 0 2024-06-03T00:03:10.548 INFO:tasks.workunit.client.0.smithi049.stdout:8/599: creat d4/d27/d3c/d88/d28/d52/d66/d53/d7e/fc4 x:0 0 0 2024-06-03T00:03:10.551 INFO:tasks.workunit.client.0.smithi049.stdout:7/710: write d3/dd8/d13/d3c/d4b/f7a [2802835,19474] 0 2024-06-03T00:03:10.552 INFO:tasks.workunit.client.0.smithi049.stdout:7/711: write d3/dd8/d13/d3c/d4b/f7a [1542916,18241] 0 2024-06-03T00:03:10.552 INFO:tasks.workunit.client.0.smithi049.stdout:7/712: write d3/fac [1179995,106501] 0 2024-06-03T00:03:10.553 INFO:tasks.workunit.client.0.smithi049.stdout:7/713: creat d3/dd8/d13/d3c/d48/d7b/f102 x:0 0 0 2024-06-03T00:03:10.553 INFO:tasks.workunit.client.0.smithi049.stdout:2/807: dwrite da/d52/d37/d70/fda [0,4194304] 0 2024-06-03T00:03:10.554 INFO:tasks.workunit.client.0.smithi049.stdout:2/808: creat da/d52/df/d3c/d60/ffd x:0 0 0 2024-06-03T00:03:10.560 INFO:tasks.workunit.client.0.smithi049.stdout:8/600: write d4/d27/d3c/d88/d28/d52/f9a [433711,8489] 0 2024-06-03T00:03:10.561 INFO:tasks.workunit.client.0.smithi049.stdout:8/601: creat d4/d27/d3c/d88/d28/d52/fc5 x:0 0 0 2024-06-03T00:03:10.562 INFO:tasks.workunit.client.0.smithi049.stdout:8/602: creat d4/d27/d3c/d88/d48/fc6 x:0 0 0 2024-06-03T00:03:10.564 INFO:tasks.workunit.client.0.smithi049.stdout:8/603: rename d4/d27/d3c/d88/d28/d45/l85 to d4/d27/d3c/d88/d48/lc7 0 2024-06-03T00:03:10.569 INFO:tasks.workunit.client.0.smithi049.stdout:7/714: dwrite d3/dd8/d13/d54/f55 [0,4194304] 0 2024-06-03T00:03:10.588 INFO:tasks.workunit.client.0.smithi049.stdout:8/604: dwrite d4/d27/d3c/fbf [0,4194304] 0 2024-06-03T00:03:10.588 INFO:tasks.workunit.client.0.smithi049.stdout:8/605: write d4/d27/d3c/d88/d28/d52/f65 [3781022,73916] 0 2024-06-03T00:03:10.592 INFO:tasks.workunit.client.0.smithi049.stdout:8/606: rmdir d4/d27/d3c 39 2024-06-03T00:03:10.592 INFO:tasks.workunit.client.0.smithi049.stdout:8/607: truncate d4/d27/d3c/d88/d28/d52/d66/d53/d7e/fc4 597882 0 2024-06-03T00:03:10.594 INFO:tasks.workunit.client.0.smithi049.stdout:8/608: unlink d4/d27/d3c/d88/d4d/fb5 0 2024-06-03T00:03:10.594 INFO:tasks.workunit.client.0.smithi049.stdout:8/609: read d4/d27/d3c/d88/f10 [6793031,43974] 0 2024-06-03T00:03:10.603 INFO:tasks.workunit.client.0.smithi049.stdout:8/610: dread d4/f73 [0,4194304] 0 2024-06-03T00:03:10.604 INFO:tasks.workunit.client.0.smithi049.stdout:8/611: symlink d4/d27/d3c/d88/d48/lc8 0 2024-06-03T00:03:10.605 INFO:tasks.workunit.client.0.smithi049.stdout:8/612: creat d4/d27/d3c/d88/d28/d52/d66/d53/d6c/fc9 x:0 0 0 2024-06-03T00:03:10.605 INFO:tasks.workunit.client.0.smithi049.stdout:8/613: chown d4/d27/d3c/d88/f10 25549 1 2024-06-03T00:03:10.606 INFO:tasks.workunit.client.0.smithi049.stdout:8/614: truncate d4/d27/d3c/d88/d28/d52/d66/d53/d7e/f7f 3809900 0 2024-06-03T00:03:10.606 INFO:tasks.workunit.client.0.smithi049.stdout:8/615: fsync d4/f15 0 2024-06-03T00:03:10.630 INFO:tasks.workunit.client.0.smithi049.stdout:8/616: dwrite d4/d27/d3c/d88/d48/f5d [0,4194304] 0 2024-06-03T00:03:10.650 INFO:tasks.workunit.client.0.smithi049.stdout:8/617: dwrite d4/d27/d3c/d88/d28/d52/f9a [0,4194304] 0 2024-06-03T00:03:10.650 INFO:tasks.workunit.client.0.smithi049.stdout:8/618: chown d4/d27/d3c/d88/d28/d52/cb7 3 1 2024-06-03T00:03:10.669 INFO:tasks.workunit.client.0.smithi049.stdout:8/619: dwrite d4/d27/d3c/d88/d28/d2b/f87 [0,4194304] 0 2024-06-03T00:03:10.673 INFO:tasks.workunit.client.0.smithi049.stdout:8/620: stat d4/d27/d3c/d88/d28/d52/c60 0 2024-06-03T00:03:10.673 INFO:tasks.workunit.client.0.smithi049.stdout:8/621: fdatasync d4/f9d 0 2024-06-03T00:03:10.673 INFO:tasks.workunit.client.0.smithi049.stdout:8/622: symlink d4/d27/d3c/d88/d28/d52/d66/lca 0 2024-06-03T00:03:10.673 INFO:tasks.workunit.client.0.smithi049.stdout:8/623: dread - d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/fbe zero size 2024-06-03T00:03:10.673 INFO:tasks.workunit.client.0.smithi049.stdout:8/624: truncate d4/f17 4940218 0 2024-06-03T00:03:10.673 INFO:tasks.workunit.client.0.smithi049.stdout:8/625: mknod d4/d27/d3c/d88/d28/d52/d66/d53/d7e/ccb 0 2024-06-03T00:03:10.675 INFO:tasks.workunit.client.0.smithi049.stdout:8/626: unlink d4/d27/d3c/d88/d28/d52/d66/d53/d6c/f9c 0 2024-06-03T00:03:11.318 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:11 smithi049 ceph-mon[32302]: pgmap v477: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 140 MiB/s rd, 183 MiB/s wr, 1.44k op/s 2024-06-03T00:03:11.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:11 smithi107 ceph-mon[37048]: pgmap v477: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 140 MiB/s rd, 183 MiB/s wr, 1.44k op/s 2024-06-03T00:03:11.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:11 smithi057 ceph-mon[36457]: pgmap v477: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 140 MiB/s rd, 183 MiB/s wr, 1.44k op/s 2024-06-03T00:03:11.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.644+0000 7fe937bb1700 1 -- 172.21.15.49:0/4034610609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe930107460 msgr2=0x7fe930107840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:11.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.644+0000 7fe937bb1700 1 --2- 172.21.15.49:0/4034610609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe930107460 0x7fe930107840 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fe92c009990 tx=0x7fe92c009ca0 comp rx=0 tx=0).stop 2024-06-03T00:03:11.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.644+0000 7fe937bb1700 1 -- 172.21.15.49:0/4034610609 shutdown_connections 2024-06-03T00:03:11.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.644+0000 7fe937bb1700 1 --2- 172.21.15.49:0/4034610609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe930101d70 0x7fe93010e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:11.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.644+0000 7fe937bb1700 1 --2- 172.21.15.49:0/4034610609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe930107460 0x7fe930107840 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:11.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.644+0000 7fe937bb1700 1 --2- 172.21.15.49:0/4034610609 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe9301013b0 0x7fe930101830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:11.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.644+0000 7fe937bb1700 1 -- 172.21.15.49:0/4034610609 >> 172.21.15.49:0/4034610609 conn(0x7fe9300783b0 msgr2=0x7fe9300787c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:11.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.644+0000 7fe937bb1700 1 -- 172.21.15.49:0/4034610609 shutdown_connections 2024-06-03T00:03:11.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.644+0000 7fe937bb1700 1 -- 172.21.15.49:0/4034610609 wait complete. 2024-06-03T00:03:11.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.645+0000 7fe937bb1700 1 Processor -- start 2024-06-03T00:03:11.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.645+0000 7fe937bb1700 1 -- start start 2024-06-03T00:03:11.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.645+0000 7fe937bb1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9301013b0 0x7fe93019e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:11.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.645+0000 7fe937bb1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe930101d70 0x7fe93019ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:11.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.645+0000 7fe937bb1700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe930107460 0x7fe930198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:11.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.645+0000 7fe937bb1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe930111680 con 0x7fe9301013b0 2024-06-03T00:03:11.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.645+0000 7fe937bb1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe930111500 con 0x7fe930101d70 2024-06-03T00:03:11.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.645+0000 7fe937bb1700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe930111800 con 0x7fe930107460 2024-06-03T00:03:11.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.645+0000 7fe93594d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9301013b0 0x7fe93019e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:11.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.645+0000 7fe93594d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9301013b0 0x7fe93019e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44700/0 (socket says 172.21.15.49:44700) 2024-06-03T00:03:11.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.645+0000 7fe93594d700 1 -- 172.21.15.49:0/1272293729 learned_addr learned my addr 172.21.15.49:0/1272293729 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:11.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.645+0000 7fe93514c700 1 --2- 172.21.15.49:0/1272293729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe930101d70 0x7fe93019ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:11.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.645+0000 7fe93614e700 1 --2- 172.21.15.49:0/1272293729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe930107460 0x7fe930198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:11.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.645+0000 7fe93594d700 1 -- 172.21.15.49:0/1272293729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe930107460 msgr2=0x7fe930198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:11.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.645+0000 7fe93594d700 1 --2- 172.21.15.49:0/1272293729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe930107460 0x7fe930198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:11.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.645+0000 7fe93594d700 1 -- 172.21.15.49:0/1272293729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe930101d70 msgr2=0x7fe93019ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:11.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.645+0000 7fe93594d700 1 --2- 172.21.15.49:0/1272293729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe930101d70 0x7fe93019ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:11.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.645+0000 7fe93594d700 1 -- 172.21.15.49:0/1272293729 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe930199090 con 0x7fe9301013b0 2024-06-03T00:03:11.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.645+0000 7fe93514c700 1 --2- 172.21.15.49:0/1272293729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe930101d70 0x7fe93019ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:03:11.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.646+0000 7fe93594d700 1 --2- 172.21.15.49:0/1272293729 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9301013b0 0x7fe93019e770 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe92c0038b0 tx=0x7fe92c009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:11.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.646+0000 7fe926ffd700 1 -- 172.21.15.49:0/1272293729 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92c027070 con 0x7fe9301013b0 2024-06-03T00:03:11.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.646+0000 7fe926ffd700 1 -- 172.21.15.49:0/1272293729 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe92c004050 con 0x7fe9301013b0 2024-06-03T00:03:11.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.646+0000 7fe937bb1700 1 -- 172.21.15.49:0/1272293729 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe930199320 con 0x7fe9301013b0 2024-06-03T00:03:11.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.646+0000 7fe926ffd700 1 -- 172.21.15.49:0/1272293729 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92c022cd0 con 0x7fe9301013b0 2024-06-03T00:03:11.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.646+0000 7fe937bb1700 1 -- 172.21.15.49:0/1272293729 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9301a5640 con 0x7fe9301013b0 2024-06-03T00:03:11.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.648+0000 7fe926ffd700 1 -- 172.21.15.49:0/1272293729 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe92c02a070 con 0x7fe9301013b0 2024-06-03T00:03:11.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.649+0000 7fe926ffd700 1 --2- 172.21.15.49:0/1272293729 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe91c0a2cc0 0x7fe91c0a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:11.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.649+0000 7fe93514c700 1 --2- 172.21.15.49:0/1272293729 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe91c0a2cc0 0x7fe91c0a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:11.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.649+0000 7fe926ffd700 1 -- 172.21.15.49:0/1272293729 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fe92c0cfe60 con 0x7fe9301013b0 2024-06-03T00:03:11.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.649+0000 7fe93514c700 1 --2- 172.21.15.49:0/1272293729 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe91c0a2cc0 0x7fe91c0a5180 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe930107bf0 tx=0x7fe92000b5f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:11.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.649+0000 7fe942434b80 1 Processor -- start 2024-06-03T00:03:11.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.650+0000 7fe942434b80 1 -- start start 2024-06-03T00:03:11.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.650+0000 7fe942434b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55be05814590 0x55be05814970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:11.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.650+0000 7fe942434b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55be05814eb0 0x55be0580e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:11.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.650+0000 7fe942434b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55be0580ece0 0x55be0580f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:11.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.650+0000 7fe942434b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55be057010f0 con 0x55be05814eb0 2024-06-03T00:03:11.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.650+0000 7fe942434b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55be0575f9e0 con 0x55be0580ece0 2024-06-03T00:03:11.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.650+0000 7fe942434b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55be056c75f0 con 0x55be05814590 2024-06-03T00:03:11.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.650+0000 7fe93514c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55be05814eb0 0x55be0580e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:11.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.650+0000 7fe93514c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55be05814eb0 0x55be0580e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44710/0 (socket says 172.21.15.49:44710) 2024-06-03T00:03:11.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.650+0000 7fe93514c700 1 -- 172.21.15.49:0/3257333261 learned_addr learned my addr 172.21.15.49:0/3257333261 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:11.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.650+0000 7fe93594d700 1 --2- 172.21.15.49:0/3257333261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55be05814590 0x55be05814970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:11.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.650+0000 7fe93614e700 1 --2- 172.21.15.49:0/3257333261 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55be0580ece0 0x55be0580f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:11.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.650+0000 7fe93514c700 1 -- 172.21.15.49:0/3257333261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55be05814590 msgr2=0x55be05814970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:11.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.650+0000 7fe93514c700 1 --2- 172.21.15.49:0/3257333261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55be05814590 0x55be05814970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:11.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.650+0000 7fe93514c700 1 -- 172.21.15.49:0/3257333261 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55be0580ece0 msgr2=0x55be0580f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:11.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.650+0000 7fe93514c700 1 --2- 172.21.15.49:0/3257333261 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55be0580ece0 0x55be0580f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:11.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.651+0000 7fe93514c700 1 -- 172.21.15.49:0/3257333261 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be056aea60 con 0x55be05814eb0 2024-06-03T00:03:11.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.651+0000 7fe93614e700 1 --2- 172.21.15.49:0/3257333261 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55be0580ece0 0x55be0580f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:03:11.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.651+0000 7fe93514c700 1 --2- 172.21.15.49:0/3257333261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55be05814eb0 0x55be0580e7a0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe92000fce0 tx=0x7fe920012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b63955e404f674 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:11.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.651+0000 7fe91bfff700 1 -- 172.21.15.49:0/3257333261 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe920022070 con 0x55be05814eb0 2024-06-03T00:03:11.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.651+0000 7fe91bfff700 1 -- 172.21.15.49:0/3257333261 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe92001e450 con 0x55be05814eb0 2024-06-03T00:03:11.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.651+0000 7fe91bfff700 1 -- 172.21.15.49:0/3257333261 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92001d610 con 0x55be05814eb0 2024-06-03T00:03:11.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.652+0000 7fe942434b80 1 -- 172.21.15.49:0/3257333261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55be05814eb0 msgr2=0x55be0580e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:11.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.652+0000 7fe942434b80 1 --2- 172.21.15.49:0/3257333261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55be05814eb0 0x55be0580e7a0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe92000fce0 tx=0x7fe920012000 comp rx=0 tx=0).stop 2024-06-03T00:03:11.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.652+0000 7fe942434b80 1 -- 172.21.15.49:0/3257333261 shutdown_connections 2024-06-03T00:03:11.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.652+0000 7fe942434b80 1 --2- 172.21.15.49:0/3257333261 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55be0580ece0 0x55be0580f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:11.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.652+0000 7fe942434b80 1 --2- 172.21.15.49:0/3257333261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55be05814590 0x55be05814970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:11.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.652+0000 7fe942434b80 1 --2- 172.21.15.49:0/3257333261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55be05814eb0 0x55be0580e7a0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:11.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.652+0000 7fe942434b80 1 -- 172.21.15.49:0/3257333261 >> 172.21.15.49:0/3257333261 conn(0x55be0573b210 msgr2=0x55be05809a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:11.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.652+0000 7fe942434b80 1 -- 172.21.15.49:0/3257333261 shutdown_connections 2024-06-03T00:03:11.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.652+0000 7fe942434b80 1 -- 172.21.15.49:0/3257333261 wait complete. 2024-06-03T00:03:11.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.652+0000 7fe942434b80 1 -- start start 2024-06-03T00:03:11.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.652+0000 7fe942434b80 1 Processor -- start 2024-06-03T00:03:11.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.653+0000 7fe942434b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55be0580ece0 0x55be0581ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:11.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.653+0000 7fe942434b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55be05814590 0x55be05817f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:11.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.653+0000 7fe942434b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55be05814eb0 0x55be058184a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:11.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.653+0000 7fe942434b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55be05700150 con 0x55be05814590 2024-06-03T00:03:11.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.653+0000 7fe942434b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55be0575b9a0 con 0x55be05814eb0 2024-06-03T00:03:11.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.653+0000 7fe942434b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55be0581b890 con 0x55be0580ece0 2024-06-03T00:03:11.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.653+0000 7fe942434b80 10 client.0 _ll_register_callbacks cb 0x55be056f5740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:03:11.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.653+0000 7fe93514c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55be05814590 0x55be05817f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:11.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.653+0000 7fe93514c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55be05814590 0x55be05817f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44726/0 (socket says 172.21.15.49:44726) 2024-06-03T00:03:11.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.653+0000 7fe93594d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55be0580ece0 0x55be0581ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:11.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.653+0000 7fe93514c700 1 -- 172.21.15.49:0/3429829771 learned_addr learned my addr 172.21.15.49:0/3429829771 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:11.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.653+0000 7fe93614e700 1 --2- 172.21.15.49:0/3429829771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55be05814eb0 0x55be058184a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:11.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.653+0000 7fe93594d700 1 -- 172.21.15.49:0/3429829771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55be05814eb0 msgr2=0x55be058184a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:11.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.653+0000 7fe93594d700 1 --2- 172.21.15.49:0/3429829771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55be05814eb0 0x55be058184a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:11.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.653+0000 7fe93594d700 1 -- 172.21.15.49:0/3429829771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55be05814590 msgr2=0x55be05817f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:11.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.653+0000 7fe93594d700 1 --2- 172.21.15.49:0/3429829771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55be05814590 0x55be05817f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:11.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.653+0000 7fe93594d700 1 -- 172.21.15.49:0/3429829771 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be057258e0 con 0x55be0580ece0 2024-06-03T00:03:11.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.653+0000 7fe93594d700 1 --2- 172.21.15.49:0/3429829771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55be0580ece0 0x55be0581ac60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe92c00c010 tx=0x7fe92c005a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ecc2a5680af33ce server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:11.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.653+0000 7fe9197fa700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-06-03T00:03:11.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.654+0000 7fe9197fa700 1 -- 172.21.15.49:0/3429829771 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92c09ce50 con 0x55be0580ece0 2024-06-03T00:03:11.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.654+0000 7fe9197fa700 1 -- 172.21.15.49:0/3429829771 <== mon.1 v2:172.21.15.107:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fe92c0094b0 con 0x55be0580ece0 2024-06-03T00:03:11.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.654+0000 7fe942434b80 1 -- 172.21.15.49:0/3429829771 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe92001e450 con 0x55be0580ece0 2024-06-03T00:03:11.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.654+0000 7fe9197fa700 1 -- 172.21.15.49:0/3429829771 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fe92c09c750 con 0x55be0580ece0 2024-06-03T00:03:11.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.654+0000 7fe942434b80 10 client.25579 fetch_fsmap learned FSMap version 31 2024-06-03T00:03:11.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.654+0000 7fe942434b80 1 -- 172.21.15.49:0/3429829771 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55be05826050 con 0x55be0580ece0 2024-06-03T00:03:11.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.654+0000 7fe9197fa700 1 -- 172.21.15.49:0/3429829771 <== mon.1 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe92001e450 con 0x55be0580ece0 2024-06-03T00:03:11.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.654+0000 7fe9197fa700 1 -- 172.21.15.49:0/3429829771 <== mon.1 v2:172.21.15.107:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fe92c085ce0 con 0x55be0580ece0 2024-06-03T00:03:11.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.654+0000 7fe942434b80 10 client.25579 fetch_fsmap finished waiting for FSMap version 31 2024-06-03T00:03:11.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.654+0000 7fe942434b80 10 client.25579 resolve_mds: validated gid 24487 aka daemon mds.i 2024-06-03T00:03:11.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.654+0000 7fe942434b80 20 client.25579 populate_metadata read hostname 'smithi049' 2024-06-03T00:03:11.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.654+0000 7fe942434b80 1 --2- 172.21.15.49:0/3429829771 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55be05828570 0x55be0582a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:11.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.654+0000 7fe942434b80 4 client.25579 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:03:11.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.654+0000 7fe942434b80 1 -- 172.21.15.49:0/3429829771 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be0576cee0 con 0x55be05828570 2024-06-03T00:03:11.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.655+0000 7fe93514c700 1 --2- 172.21.15.49:0/3429829771 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55be05828570 0x55be0582a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:11.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.655+0000 7fe9197fa700 10 client.25579 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:11.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.655+0000 7fe93514c700 1 --2- 172.21.15.49:0/3429829771 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55be05828570 0x55be0582a9a0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46ae5974a62dc846 server_cookie=a6a0750c4649b1a in_seq=0 out_seq=0 2024-06-03T00:03:11.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.656+0000 7fe9197fa700 1 -- 172.21.15.49:0/3429829771 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55be0576cee0 con 0x55be05828570 2024-06-03T00:03:11.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.656+0000 7fe9197fa700 10 client.25579 handle_command_reply: tid=0 2024-06-03T00:03:11.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.656+0000 7fe942434b80 1 client.25579 shutdown 2024-06-03T00:03:11.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.656+0000 7fe942434b80 1 -- 172.21.15.49:0/3429829771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55be0580ece0 msgr2=0x55be0581ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:11.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.656+0000 7fe942434b80 1 --2- 172.21.15.49:0/3429829771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55be0580ece0 0x55be0581ac60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe92c00c010 tx=0x7fe92c005a00 comp rx=0 tx=0).stop 2024-06-03T00:03:11.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.656+0000 7fe942434b80 1 -- 172.21.15.49:0/3429829771 shutdown_connections 2024-06-03T00:03:11.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.656+0000 7fe942434b80 1 --2- 172.21.15.49:0/3429829771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55be05814eb0 0x55be058184a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:11.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.656+0000 7fe942434b80 1 --2- 172.21.15.49:0/3429829771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55be0580ece0 0x55be0581ac60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:11.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.656+0000 7fe942434b80 1 --2- 172.21.15.49:0/3429829771 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55be05828570 0x55be0582a9a0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:11.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.656+0000 7fe942434b80 1 --2- 172.21.15.49:0/3429829771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55be05814590 0x55be05817f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:11.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.656+0000 7fe9197fa700 0 client.25579 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:11.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.656+0000 7fe942434b80 1 -- 172.21.15.49:0/3429829771 >> 172.21.15.49:0/3429829771 conn(0x55be0573b210 msgr2=0x55be05808c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:11.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.656+0000 7fe942434b80 1 -- 172.21.15.49:0/3429829771 shutdown_connections 2024-06-03T00:03:11.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.656+0000 7fe942434b80 1 -- 172.21.15.49:0/3429829771 wait complete. 2024-06-03T00:03:11.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.656+0000 7fe942434b80 20 client.25579 trim_cache size 0 max 16384 2024-06-03T00:03:11.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.676+0000 7fe942434b80 1 Processor -- start 2024-06-03T00:03:11.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.676+0000 7fe942434b80 1 -- start start 2024-06-03T00:03:11.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.676+0000 7fe942434b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55be0580ece0 0x55be0581a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:11.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.676+0000 7fe942434b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55be05814590 0x55be058093c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:11.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.676+0000 7fe942434b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55be05814eb0 0x55be05809900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:11.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.676+0000 7fe942434b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe9301acae0 con 0x55be05814eb0 2024-06-03T00:03:11.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.677+0000 7fe942434b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe9301ae6e0 con 0x55be05814590 2024-06-03T00:03:11.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.677+0000 7fe942434b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe9301ad1b0 con 0x55be0580ece0 2024-06-03T00:03:11.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.677+0000 7fe93614e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55be05814eb0 0x55be05809900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:11.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.677+0000 7fe93614e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55be05814eb0 0x55be05809900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44742/0 (socket says 172.21.15.49:44742) 2024-06-03T00:03:11.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.677+0000 7fe93614e700 1 -- 172.21.15.49:0/2491751757 learned_addr learned my addr 172.21.15.49:0/2491751757 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:11.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.677+0000 7fe93594d700 1 --2- 172.21.15.49:0/2491751757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55be0580ece0 0x55be0581a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:11.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.677+0000 7fe93514c700 1 --2- 172.21.15.49:0/2491751757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55be05814590 0x55be058093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:11.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.677+0000 7fe93614e700 1 -- 172.21.15.49:0/2491751757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55be0580ece0 msgr2=0x55be0581a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:11.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.677+0000 7fe93614e700 1 --2- 172.21.15.49:0/2491751757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55be0580ece0 0x55be0581a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:11.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.677+0000 7fe93614e700 1 -- 172.21.15.49:0/2491751757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55be05814590 msgr2=0x55be058093c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:11.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.677+0000 7fe93614e700 1 --2- 172.21.15.49:0/2491751757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55be05814590 0x55be058093c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:11.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.677+0000 7fe93614e700 1 -- 172.21.15.49:0/2491751757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be05815fe0 con 0x55be05814eb0 2024-06-03T00:03:11.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.677+0000 7fe93514c700 1 --2- 172.21.15.49:0/2491751757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55be05814590 0x55be058093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:03:11.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.677+0000 7fe93614e700 1 --2- 172.21.15.49:0/2491751757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55be05814eb0 0x55be05809900 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe928009ea0 tx=0x7fe928009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b565c04580cfebd9 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:11.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.677+0000 7fe91b7fe700 1 -- 172.21.15.49:0/2491751757 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe928007e60 con 0x55be05814eb0 2024-06-03T00:03:11.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.677+0000 7fe91b7fe700 1 -- 172.21.15.49:0/2491751757 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9280178f0 con 0x55be05814eb0 2024-06-03T00:03:11.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.677+0000 7fe91b7fe700 1 -- 172.21.15.49:0/2491751757 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92801fae0 con 0x55be05814eb0 2024-06-03T00:03:11.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.678+0000 7fe942434b80 1 -- 172.21.15.49:0/2491751757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55be05814eb0 msgr2=0x55be05809900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:11.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.678+0000 7fe942434b80 1 --2- 172.21.15.49:0/2491751757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55be05814eb0 0x55be05809900 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe928009ea0 tx=0x7fe928009ed0 comp rx=0 tx=0).stop 2024-06-03T00:03:11.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.678+0000 7fe942434b80 1 -- 172.21.15.49:0/2491751757 shutdown_connections 2024-06-03T00:03:11.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.678+0000 7fe942434b80 1 --2- 172.21.15.49:0/2491751757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55be05814eb0 0x55be05809900 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:11.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.678+0000 7fe942434b80 1 --2- 172.21.15.49:0/2491751757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55be0580ece0 0x55be0581a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:11.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.678+0000 7fe942434b80 1 --2- 172.21.15.49:0/2491751757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55be05814590 0x55be058093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:11.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.678+0000 7fe942434b80 1 -- 172.21.15.49:0/2491751757 >> 172.21.15.49:0/2491751757 conn(0x55be0573b210 msgr2=0x55be0580e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:11.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.678+0000 7fe942434b80 1 -- 172.21.15.49:0/2491751757 shutdown_connections 2024-06-03T00:03:11.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.678+0000 7fe942434b80 1 -- 172.21.15.49:0/2491751757 wait complete. 2024-06-03T00:03:11.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.678+0000 7fe942434b80 1 -- start start 2024-06-03T00:03:11.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.679+0000 7fe942434b80 1 Processor -- start 2024-06-03T00:03:11.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.679+0000 7fe942434b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55be0580ece0 0x55be05820d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:11.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.679+0000 7fe942434b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55be05814590 0x55be05821270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:11.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.679+0000 7fe942434b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55be05814eb0 0x55be0581db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:11.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.679+0000 7fe942434b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe9301adf50 con 0x55be0580ece0 2024-06-03T00:03:11.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.679+0000 7fe942434b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe9301ad880 con 0x55be05814590 2024-06-03T00:03:11.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.679+0000 7fe942434b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe9301aaa60 con 0x55be05814eb0 2024-06-03T00:03:11.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.679+0000 7fe942434b80 10 client.0 _ll_register_callbacks cb 0x55be056f5740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:03:11.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.679+0000 7fe93594d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55be0580ece0 0x55be05820d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:11.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.679+0000 7fe93594d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55be0580ece0 0x55be05820d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44750/0 (socket says 172.21.15.49:44750) 2024-06-03T00:03:11.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.679+0000 7fe93594d700 1 -- 172.21.15.49:0/3644720781 learned_addr learned my addr 172.21.15.49:0/3644720781 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:11.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.679+0000 7fe93614e700 1 --2- 172.21.15.49:0/3644720781 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55be05814eb0 0x55be0581db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:11.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.679+0000 7fe93514c700 1 --2- 172.21.15.49:0/3644720781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55be05814590 0x55be05821270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:11.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.679+0000 7fe93594d700 1 -- 172.21.15.49:0/3644720781 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55be05814eb0 msgr2=0x55be0581db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:11.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.679+0000 7fe93594d700 1 --2- 172.21.15.49:0/3644720781 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55be05814eb0 0x55be0581db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:11.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.679+0000 7fe93594d700 1 -- 172.21.15.49:0/3644720781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55be05814590 msgr2=0x55be05821270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:11.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.680+0000 7fe93594d700 1 --2- 172.21.15.49:0/3644720781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55be05814590 0x55be05821270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:11.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.680+0000 7fe93594d700 1 -- 172.21.15.49:0/3644720781 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be0581e1e0 con 0x55be0580ece0 2024-06-03T00:03:11.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.680+0000 7fe93614e700 1 --2- 172.21.15.49:0/3644720781 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55be05814eb0 0x55be0581db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:11.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.680+0000 7fe93594d700 1 --2- 172.21.15.49:0/3644720781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55be0580ece0 0x55be05820d30 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe92c098bb0 tx=0x7fe92c00b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=310dbab83484d6cd server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:11.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.680+0000 7fe9197fa700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:03:11.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.680+0000 7fe9197fa700 1 -- 172.21.15.49:0/3644720781 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92c09ce50 con 0x55be0580ece0 2024-06-03T00:03:11.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.680+0000 7fe9197fa700 1 -- 172.21.15.49:0/3644720781 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fe92c003b70 con 0x55be0580ece0 2024-06-03T00:03:11.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.680+0000 7fe942434b80 1 -- 172.21.15.49:0/3644720781 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9280178f0 con 0x55be0580ece0 2024-06-03T00:03:11.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.680+0000 7fe9197fa700 1 -- 172.21.15.49:0/3644720781 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fe92c0a0b00 con 0x55be0580ece0 2024-06-03T00:03:11.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.680+0000 7fe942434b80 10 client.15990 fetch_fsmap learned FSMap version 31 2024-06-03T00:03:11.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.680+0000 7fe942434b80 1 -- 172.21.15.49:0/3644720781 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55be05893c30 con 0x55be0580ece0 2024-06-03T00:03:11.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.680+0000 7fe9197fa700 1 -- 172.21.15.49:0/3644720781 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9280178f0 con 0x55be0580ece0 2024-06-03T00:03:11.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.680+0000 7fe9197fa700 1 -- 172.21.15.49:0/3644720781 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fe92c085ce0 con 0x55be0580ece0 2024-06-03T00:03:11.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.680+0000 7fe942434b80 10 client.15990 fetch_fsmap finished waiting for FSMap version 31 2024-06-03T00:03:11.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.680+0000 7fe942434b80 10 client.15990 resolve_mds: validated gid 24487 aka daemon mds.i 2024-06-03T00:03:11.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.680+0000 7fe942434b80 20 client.15990 populate_metadata read hostname 'smithi049' 2024-06-03T00:03:11.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.680+0000 7fe942434b80 1 --2- 172.21.15.49:0/3644720781 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55be058941f0 0x55be05896610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:11.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.680+0000 7fe942434b80 4 client.15990 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}] 2024-06-03T00:03:11.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.680+0000 7fe942434b80 1 -- 172.21.15.49:0/3644720781 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}) -- 0x55be05767460 con 0x55be058941f0 2024-06-03T00:03:11.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.681+0000 7fe93514c700 1 --2- 172.21.15.49:0/3644720781 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55be058941f0 0x55be05896610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:11.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.681+0000 7fe93514c700 1 --2- 172.21.15.49:0/3644720781 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55be058941f0 0x55be05896610 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea5ba210a270137 server_cookie=339016cb23512fde in_seq=0 out_seq=0 2024-06-03T00:03:11.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:11.681+0000 7fe9197fa700 10 client.15990 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:12.065 INFO:tasks.workunit.client.0.smithi049.stdout:9/916: sync 2024-06-03T00:03:12.065 INFO:tasks.workunit.client.0.smithi049.stdout:3/610: sync 2024-06-03T00:03:12.065 INFO:tasks.workunit.client.0.smithi049.stdout:2/809: sync 2024-06-03T00:03:12.065 INFO:tasks.workunit.client.0.smithi049.stdout:0/622: sync 2024-06-03T00:03:12.065 INFO:tasks.workunit.client.0.smithi049.stdout:7/715: sync 2024-06-03T00:03:12.065 INFO:tasks.workunit.client.0.smithi049.stdout:4/770: sync 2024-06-03T00:03:12.065 INFO:tasks.workunit.client.0.smithi049.stdout:5/688: sync 2024-06-03T00:03:12.065 INFO:tasks.workunit.client.0.smithi049.stdout:6/847: sync 2024-06-03T00:03:12.065 INFO:tasks.workunit.client.0.smithi049.stdout:8/627: sync 2024-06-03T00:03:13.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:13 smithi107 ceph-mon[37048]: pgmap v478: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 150 MiB/s rd, 184 MiB/s wr, 538 op/s 2024-06-03T00:03:13.443 INFO:tasks.workunit.client.0.smithi049.stdout:0/623: chown d6/d30/d32 29777072 1 2024-06-03T00:03:13.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:13 smithi057 ceph-mon[36457]: pgmap v478: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 150 MiB/s rd, 184 MiB/s wr, 538 op/s 2024-06-03T00:03:13.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:13 smithi049 ceph-mon[32302]: pgmap v478: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 150 MiB/s rd, 184 MiB/s wr, 538 op/s 2024-06-03T00:03:13.807 INFO:tasks.workunit.client.0.smithi049.stdout:7/716: dread - d3/dd8/d13/d3c/d48/ff3 zero size 2024-06-03T00:03:13.839 INFO:tasks.workunit.client.0.smithi049.stdout:5/689: readlink d3/d5/da/d55/l4e 0 2024-06-03T00:03:13.875 INFO:tasks.workunit.client.0.smithi049.stdout:7/717: chown d3/dd8/d13/d3c/d48/d7b/d9c/l6b 81 1 2024-06-03T00:03:13.886 INFO:tasks.workunit.client.0.smithi049.stdout:7/718: dread d3/dd8/f1c [4194304,4194304] 0 2024-06-03T00:03:13.959 INFO:tasks.workunit.client.0.smithi049.stdout:3/611: fdatasync d2/d14/d22/d3a/d47/f92 0 2024-06-03T00:03:14.036 INFO:tasks.workunit.client.0.smithi049.stdout:4/771: dread d4/d2a/f81 [0,4194304] 0 2024-06-03T00:03:15.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:15 smithi107 ceph-mon[37048]: pgmap v479: 97 pgs: 97 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 175 MiB/s rd, 212 MiB/s wr, 483 op/s 2024-06-03T00:03:15.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:15 smithi057 ceph-mon[36457]: pgmap v479: 97 pgs: 97 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 175 MiB/s rd, 212 MiB/s wr, 483 op/s 2024-06-03T00:03:15.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:15 smithi049 ceph-mon[32302]: pgmap v479: 97 pgs: 97 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 175 MiB/s rd, 212 MiB/s wr, 483 op/s 2024-06-03T00:03:16.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:16.605+0000 7fe9197fa700 1 -- 172.21.15.49:0/3644720781 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55be05767460 con 0x55be058941f0 2024-06-03T00:03:16.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:16.605+0000 7fe9197fa700 10 client.15990 handle_command_reply: tid=0 2024-06-03T00:03:16.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:16.605+0000 7fe942434b80 1 client.15990 shutdown 2024-06-03T00:03:16.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:16.605+0000 7fe942434b80 1 -- 172.21.15.49:0/3644720781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55be0580ece0 msgr2=0x55be05820d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:16.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:16.605+0000 7fe942434b80 1 --2- 172.21.15.49:0/3644720781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55be0580ece0 0x55be05820d30 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe92c098bb0 tx=0x7fe92c00b540 comp rx=0 tx=0).stop 2024-06-03T00:03:16.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:16.605+0000 7fe942434b80 1 -- 172.21.15.49:0/3644720781 shutdown_connections 2024-06-03T00:03:16.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:16.605+0000 7fe942434b80 1 --2- 172.21.15.49:0/3644720781 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55be05814eb0 0x55be0581db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:16.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:16.605+0000 7fe942434b80 1 --2- 172.21.15.49:0/3644720781 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55be058941f0 0x55be05896610 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:16.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:16.605+0000 7fe9197fa700 0 client.15990 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:16.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:16.605+0000 7fe942434b80 1 --2- 172.21.15.49:0/3644720781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55be0580ece0 0x55be05820d30 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:16.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:16.605+0000 7fe942434b80 1 --2- 172.21.15.49:0/3644720781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55be05814590 0x55be05821270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:16.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:16.605+0000 7fe942434b80 1 -- 172.21.15.49:0/3644720781 >> 172.21.15.49:0/3644720781 conn(0x55be0573b210 msgr2=0x55be058174c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:16.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:16.605+0000 7fe942434b80 1 -- 172.21.15.49:0/3644720781 shutdown_connections 2024-06-03T00:03:16.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:16.605+0000 7fe942434b80 1 -- 172.21.15.49:0/3644720781 wait complete. 2024-06-03T00:03:16.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:16.605+0000 7fe942434b80 20 client.15990 trim_cache size 0 max 16384 2024-06-03T00:03:16.608 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:03:16.608 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 31, 2024-06-03T00:03:16.608 INFO:teuthology.orchestra.run.smithi049.stdout: "leader": 24487, 2024-06-03T00:03:16.608 INFO:teuthology.orchestra.run.smithi049.stdout: "set_version": 6, 2024-06-03T00:03:16.608 INFO:teuthology.orchestra.run.smithi049.stdout: "sets": { 2024-06-03T00:03:16.608 INFO:teuthology.orchestra.run.smithi049.stdout: "f51fb796": { 2024-06-03T00:03:16.608 INFO:teuthology.orchestra.run.smithi049.stdout: "version": 6, 2024-06-03T00:03:16.608 INFO:teuthology.orchestra.run.smithi049.stdout: "age_ref": 0.0, 2024-06-03T00:03:16.608 INFO:teuthology.orchestra.run.smithi049.stdout: "state": { 2024-06-03T00:03:16.608 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "QUIESCED", 2024-06-03T00:03:16.608 INFO:teuthology.orchestra.run.smithi049.stdout: "age": 0.0 2024-06-03T00:03:16.608 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:16.609 INFO:teuthology.orchestra.run.smithi049.stdout: "timeout": 90.0, 2024-06-03T00:03:16.609 INFO:teuthology.orchestra.run.smithi049.stdout: "expiration": 130.0, 2024-06-03T00:03:16.609 INFO:teuthology.orchestra.run.smithi049.stdout: "members": { 2024-06-03T00:03:16.609 INFO:teuthology.orchestra.run.smithi049.stdout: "file:/": { 2024-06-03T00:03:16.609 INFO:teuthology.orchestra.run.smithi049.stdout: "excluded": false, 2024-06-03T00:03:16.609 INFO:teuthology.orchestra.run.smithi049.stdout: "state": { 2024-06-03T00:03:16.609 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "QUIESCED", 2024-06-03T00:03:16.609 INFO:teuthology.orchestra.run.smithi049.stdout: "age": 0.0 2024-06-03T00:03:16.609 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:03:16.609 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:03:16.609 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:03:16.609 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:03:16.609 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:03:16.609 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:03:16.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:16.606+0000 7fe937bb1700 1 -- 172.21.15.49:0/1272293729 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe91c0a2cc0 msgr2=0x7fe91c0a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:16.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:16.606+0000 7fe937bb1700 1 --2- 172.21.15.49:0/1272293729 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe91c0a2cc0 0x7fe91c0a5180 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe930107bf0 tx=0x7fe92000b5f0 comp rx=0 tx=0).stop 2024-06-03T00:03:16.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:16.606+0000 7fe937bb1700 1 -- 172.21.15.49:0/1272293729 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9301013b0 msgr2=0x7fe93019e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:16.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:16.606+0000 7fe937bb1700 1 --2- 172.21.15.49:0/1272293729 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9301013b0 0x7fe93019e770 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe92c0038b0 tx=0x7fe92c009f50 comp rx=0 tx=0).stop 2024-06-03T00:03:16.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:16.606+0000 7fe937bb1700 1 -- 172.21.15.49:0/1272293729 shutdown_connections 2024-06-03T00:03:16.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:16.606+0000 7fe937bb1700 1 --2- 172.21.15.49:0/1272293729 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe91c0a2cc0 0x7fe91c0a5180 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:16.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:16.606+0000 7fe937bb1700 1 --2- 172.21.15.49:0/1272293729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe930107460 0x7fe930198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:16.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:16.606+0000 7fe937bb1700 1 --2- 172.21.15.49:0/1272293729 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9301013b0 0x7fe93019e770 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:16.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:16.606+0000 7fe937bb1700 1 --2- 172.21.15.49:0/1272293729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe930101d70 0x7fe93019ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:16.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:16.606+0000 7fe937bb1700 1 -- 172.21.15.49:0/1272293729 >> 172.21.15.49:0/1272293729 conn(0x7fe9300783b0 msgr2=0x7fe9301005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:16.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:16.606+0000 7fe937bb1700 1 -- 172.21.15.49:0/1272293729 shutdown_connections 2024-06-03T00:03:16.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:16.606+0000 7fe937bb1700 1 -- 172.21.15.49:0/1272293729 wait complete. 2024-06-03T00:03:17.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:17 smithi049 ceph-mon[32302]: pgmap v480: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 167 MiB/s rd, 208 MiB/s wr, 650 op/s 2024-06-03T00:03:17.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:17 smithi107 ceph-mon[37048]: pgmap v480: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 167 MiB/s rd, 208 MiB/s wr, 650 op/s 2024-06-03T00:03:17.395 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f51fb796', quiesce took 15.5 seconds. Will release after: -5.5 2024-06-03T00:03:17.395 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-03T00:03:17.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:17 smithi057 ceph-mon[36457]: pgmap v480: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 167 MiB/s rd, 208 MiB/s wr, 650 op/s 2024-06-03T00:03:17.687 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:03:17.909 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-03T00:03:19.004 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:03:19.091 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:19 smithi049 ceph-mon[32302]: pgmap v481: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 110 MiB/s rd, 131 MiB/s wr, 527 op/s 2024-06-03T00:03:19.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:19 smithi107 ceph-mon[37048]: pgmap v481: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 110 MiB/s rd, 131 MiB/s wr, 527 op/s 2024-06-03T00:03:19.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:19 smithi057 ceph-mon[36457]: pgmap v481: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 110 MiB/s rd, 131 MiB/s wr, 527 op/s 2024-06-03T00:03:19.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.645+0000 7fbcf3ab5700 1 -- 172.21.15.49:0/1200955389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcec101fd0 msgr2=0x7fbcec105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:19.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.645+0000 7fbcf3ab5700 1 --2- 172.21.15.49:0/1200955389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcec101fd0 0x7fbcec105fd0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc0099c0 tx=0x7fbcdc009cd0 comp rx=0 tx=0).stop 2024-06-03T00:03:19.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.645+0000 7fbcf3ab5700 1 -- 172.21.15.49:0/1200955389 shutdown_connections 2024-06-03T00:03:19.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.645+0000 7fbcf3ab5700 1 --2- 172.21.15.49:0/1200955389 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcec1066b0 0x7fbcec10e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:19.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.645+0000 7fbcf3ab5700 1 --2- 172.21.15.49:0/1200955389 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbcec101620 0x7fbcec101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:19.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.645+0000 7fbcf3ab5700 1 --2- 172.21.15.49:0/1200955389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcec101fd0 0x7fbcec105fd0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:19.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.645+0000 7fbcf3ab5700 1 -- 172.21.15.49:0/1200955389 >> 172.21.15.49:0/1200955389 conn(0x7fbcec078340 msgr2=0x7fbcec078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:19.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.645+0000 7fbcf3ab5700 1 -- 172.21.15.49:0/1200955389 shutdown_connections 2024-06-03T00:03:19.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.645+0000 7fbcf3ab5700 1 -- 172.21.15.49:0/1200955389 wait complete. 2024-06-03T00:03:19.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.646+0000 7fbcf3ab5700 1 Processor -- start 2024-06-03T00:03:19.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.646+0000 7fbcf3ab5700 1 -- start start 2024-06-03T00:03:19.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.646+0000 7fbcf3ab5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcec101620 0x7fbcec103070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:19.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.646+0000 7fbcf3ab5700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbcec101fd0 0x7fbcec1035b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:19.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.646+0000 7fbcf3ab5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcec1066b0 0x7fbcec103af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:19.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.646+0000 7fbcf3ab5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbcec111670 con 0x7fbcec101620 2024-06-03T00:03:19.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.646+0000 7fbcf3ab5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fbcec1114f0 con 0x7fbcec1066b0 2024-06-03T00:03:19.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.646+0000 7fbcf3ab5700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbcec1117f0 con 0x7fbcec101fd0 2024-06-03T00:03:19.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.646+0000 7fbcf1851700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcec101620 0x7fbcec103070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:19.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.646+0000 7fbcf1851700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcec101620 0x7fbcec103070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52602/0 (socket says 172.21.15.49:52602) 2024-06-03T00:03:19.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.646+0000 7fbcf1851700 1 -- 172.21.15.49:0/292048802 learned_addr learned my addr 172.21.15.49:0/292048802 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:19.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.646+0000 7fbcf2052700 1 --2- 172.21.15.49:0/292048802 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcec1066b0 0x7fbcec103af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:19.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.647+0000 7fbcf1050700 1 --2- 172.21.15.49:0/292048802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbcec101fd0 0x7fbcec1035b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:19.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.647+0000 7fbcf1851700 1 -- 172.21.15.49:0/292048802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbcec101fd0 msgr2=0x7fbcec1035b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:19.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.647+0000 7fbcf1851700 1 --2- 172.21.15.49:0/292048802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbcec101fd0 0x7fbcec1035b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:19.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.647+0000 7fbcf1851700 1 -- 172.21.15.49:0/292048802 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcec1066b0 msgr2=0x7fbcec103af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:19.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.647+0000 7fbcf1851700 1 --2- 172.21.15.49:0/292048802 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcec1066b0 0x7fbcec103af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:19.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.647+0000 7fbcf1851700 1 -- 172.21.15.49:0/292048802 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcec1a7110 con 0x7fbcec101620 2024-06-03T00:03:19.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.647+0000 7fbcf1050700 1 --2- 172.21.15.49:0/292048802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbcec101fd0 0x7fbcec1035b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:03:19.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.647+0000 7fbcf1851700 1 --2- 172.21.15.49:0/292048802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcec101620 0x7fbcec103070 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbce800d980 tx=0x7fbce800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:19.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.647+0000 7fbce2ffd700 1 -- 172.21.15.49:0/292048802 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce8016070 con 0x7fbcec101620 2024-06-03T00:03:19.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.647+0000 7fbce2ffd700 1 -- 172.21.15.49:0/292048802 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbce8004d10 con 0x7fbcec101620 2024-06-03T00:03:19.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.647+0000 7fbcf3ab5700 1 -- 172.21.15.49:0/292048802 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcec1a7400 con 0x7fbcec101620 2024-06-03T00:03:19.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.647+0000 7fbce2ffd700 1 -- 172.21.15.49:0/292048802 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce80055f0 con 0x7fbcec101620 2024-06-03T00:03:19.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.647+0000 7fbcf3ab5700 1 -- 172.21.15.49:0/292048802 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcec1a7910 con 0x7fbcec101620 2024-06-03T00:03:19.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.648+0000 7fbcf3ab5700 1 -- 172.21.15.49:0/292048802 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcec069180 con 0x7fbcec101620 2024-06-03T00:03:19.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.649+0000 7fbce2ffd700 1 -- 172.21.15.49:0/292048802 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbce8004750 con 0x7fbcec101620 2024-06-03T00:03:19.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.650+0000 7fbce2ffd700 1 --2- 172.21.15.49:0/292048802 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbcd80a2c20 0x7fbcd80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:19.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.650+0000 7fbcf1050700 1 --2- 172.21.15.49:0/292048802 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbcd80a2c20 0x7fbcd80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:19.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.650+0000 7fbce2ffd700 1 -- 172.21.15.49:0/292048802 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fbce80cf400 con 0x7fbcec101620 2024-06-03T00:03:19.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.651+0000 7fbcf1050700 1 --2- 172.21.15.49:0/292048802 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbcd80a2c20 0x7fbcd80a50e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc000c00 tx=0x7fbcdc005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:19.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.654+0000 7fbce2ffd700 1 -- 172.21.15.49:0/292048802 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fbce801f020 con 0x7fbcec101620 2024-06-03T00:03:19.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.913+0000 7fbcf3ab5700 1 -- 172.21.15.49:0/292048802 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbcec02dca0 con 0x7fbcec101620 2024-06-03T00:03:19.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.914+0000 7fbce2ffd700 1 -- 172.21.15.49:0/292048802 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11936 (secure 0 0 0) 0x7fbce809c360 con 0x7fbcec101620 2024-06-03T00:03:19.914 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:03:19.914 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1553264866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1553264866},{"type":"v1","addr":"172.21.15.49:6835","nonce":1553264866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2266285252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2266285252},{"type":"v1","addr":"172.21.15.49:6837","nonce":2266285252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T23:57:16.991201+0000","modified":"2024-06-03T00:02:52.952379+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24485,"mds_2":24466,"mds_3":24464,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6839/1729124617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":1729124617},{"type":"v1","addr":"172.21.15.49:6839","nonce":1729124617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6841/1902772235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":1902772235},{"type":"v1","addr":"172.21.15.49:6841","nonce":1902772235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6833/1633534002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1633534002},{"type":"v1","addr":"172.21.15.57:6833","nonce":1633534002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6835/2254905671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2254905671},{"type":"v1","addr":"172.21.15.57:6835","nonce":2254905671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.107:6835/3693542801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3693542801},{"type":"v1","addr":"172.21.15.107:6835","nonce":3693542801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.57:6837/230452144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":230452144},{"type":"v1","addr":"172.21.15.57:6837","nonce":230452144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":92,"addr":"172.21.15.107:6837/3700593315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":3700593315},{"type":"v1","addr":"172.21.15.107:6837","nonce":3700593315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6839/249825195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":249825195},{"type":"v1","addr":"172.21.15.57:6839","nonce":249825195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6839/1986600681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1986600681},{"type":"v1","addr":"172.21.15.107:6839","nonce":1986600681}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24485,24464,24460,24466,24487]},"id":1}]} 2024-06-03T00:03:19.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.916+0000 7fbcf3ab5700 1 -- 172.21.15.49:0/292048802 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbcd80a2c20 msgr2=0x7fbcd80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:19.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.916+0000 7fbcf3ab5700 1 --2- 172.21.15.49:0/292048802 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbcd80a2c20 0x7fbcd80a50e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc000c00 tx=0x7fbcdc005fd0 comp rx=0 tx=0).stop 2024-06-03T00:03:19.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.916+0000 7fbcf3ab5700 1 -- 172.21.15.49:0/292048802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcec101620 msgr2=0x7fbcec103070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:19.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.916+0000 7fbcf3ab5700 1 --2- 172.21.15.49:0/292048802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcec101620 0x7fbcec103070 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbce800d980 tx=0x7fbce800dc90 comp rx=0 tx=0).stop 2024-06-03T00:03:19.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.916+0000 7fbcf3ab5700 1 -- 172.21.15.49:0/292048802 shutdown_connections 2024-06-03T00:03:19.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.916+0000 7fbcf3ab5700 1 --2- 172.21.15.49:0/292048802 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbcd80a2c20 0x7fbcd80a50e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:19.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.916+0000 7fbcf3ab5700 1 --2- 172.21.15.49:0/292048802 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcec1066b0 0x7fbcec103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:19.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.916+0000 7fbcf3ab5700 1 --2- 172.21.15.49:0/292048802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcec101620 0x7fbcec103070 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:19.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.916+0000 7fbcf3ab5700 1 --2- 172.21.15.49:0/292048802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbcec101fd0 0x7fbcec1035b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:19.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.916+0000 7fbcf3ab5700 1 -- 172.21.15.49:0/292048802 >> 172.21.15.49:0/292048802 conn(0x7fbcec078340 msgr2=0x7fbcec06ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:19.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.916+0000 7fbcf3ab5700 1 -- 172.21.15.49:0/292048802 shutdown_connections 2024-06-03T00:03:19.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:19.916+0000 7fbcf3ab5700 1 -- 172.21.15.49:0/292048802 wait complete. 2024-06-03T00:03:19.918 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 31 2024-06-03T00:03:20.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:20 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/292048802' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:03:20.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:20 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/292048802' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:03:20.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:20 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/292048802' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:03:20.675 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24487 quiesce db --set-id f51fb796 --release --await' 2024-06-03T00:03:20.676 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- timeout 105 ceph tell mds.24487 quiesce db --set-id f51fb796 --release --await 2024-06-03T00:03:21.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:21 smithi107 ceph-mon[37048]: pgmap v482: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 107 MiB/s rd, 126 MiB/s wr, 725 op/s 2024-06-03T00:03:21.393 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:21 smithi049 ceph-mon[32302]: pgmap v482: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 107 MiB/s rd, 126 MiB/s wr, 725 op/s 2024-06-03T00:03:21.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:21 smithi057 ceph-mon[36457]: pgmap v482: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 107 MiB/s rd, 126 MiB/s wr, 725 op/s 2024-06-03T00:03:21.644 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:03:21.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.650+0000 7f772c8b6700 1 -- 172.21.15.49:0/1008063371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7728101440 msgr2=0x7f772810f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:21.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.650+0000 7f772c8b6700 1 --2- 172.21.15.49:0/1008063371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7728101440 0x7f772810f330 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f772000b0a0 tx=0x7f772000b3b0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.650+0000 7f772c8b6700 1 -- 172.21.15.49:0/1008063371 shutdown_connections 2024-06-03T00:03:21.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.650+0000 7f772c8b6700 1 --2- 172.21.15.49:0/1008063371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7728101440 0x7f772810f330 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.650+0000 7f772c8b6700 1 --2- 172.21.15.49:0/1008063371 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7728108510 0x7f77281088f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.650+0000 7f772c8b6700 1 --2- 172.21.15.49:0/1008063371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7728100a80 0x7f7728100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.650+0000 7f772c8b6700 1 -- 172.21.15.49:0/1008063371 >> 172.21.15.49:0/1008063371 conn(0x7f7728077a00 msgr2=0x7f77280fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:21.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.650+0000 7f772c8b6700 1 -- 172.21.15.49:0/1008063371 shutdown_connections 2024-06-03T00:03:21.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.650+0000 7f772c8b6700 1 -- 172.21.15.49:0/1008063371 wait complete. 2024-06-03T00:03:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.651+0000 7f772c8b6700 1 Processor -- start 2024-06-03T00:03:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.651+0000 7f772c8b6700 1 -- start start 2024-06-03T00:03:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.651+0000 7f772c8b6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7728100a80 0x7f772819e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.651+0000 7f772c8b6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7728101440 0x7f772819ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.651+0000 7f772c8b6700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7728108510 0x7f7728198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.651+0000 7f772c8b6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7728112790 con 0x7f7728100a80 2024-06-03T00:03:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.651+0000 7f772c8b6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f7728112610 con 0x7f7728101440 2024-06-03T00:03:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.651+0000 7f772c8b6700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7728112910 con 0x7f7728108510 2024-06-03T00:03:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.652+0000 7f772659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7728100a80 0x7f772819e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:21.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.652+0000 7f772659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7728100a80 0x7f772819e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52620/0 (socket says 172.21.15.49:52620) 2024-06-03T00:03:21.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.652+0000 7f772659c700 1 -- 172.21.15.49:0/3658956482 learned_addr learned my addr 172.21.15.49:0/3658956482 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:21.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.652+0000 7f7725d9b700 1 --2- 172.21.15.49:0/3658956482 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7728101440 0x7f772819ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:21.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.652+0000 7f7726d9d700 1 --2- 172.21.15.49:0/3658956482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7728108510 0x7f7728198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:21.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.652+0000 7f772659c700 1 -- 172.21.15.49:0/3658956482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7728108510 msgr2=0x7f7728198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:21.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.652+0000 7f772659c700 1 --2- 172.21.15.49:0/3658956482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7728108510 0x7f7728198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.652+0000 7f772659c700 1 -- 172.21.15.49:0/3658956482 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7728101440 msgr2=0x7f772819ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:21.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.652+0000 7f772659c700 1 --2- 172.21.15.49:0/3658956482 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7728101440 0x7f772819ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.652+0000 7f772659c700 1 -- 172.21.15.49:0/3658956482 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77281990d0 con 0x7f7728100a80 2024-06-03T00:03:21.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.652+0000 7f7726d9d700 1 --2- 172.21.15.49:0/3658956482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7728108510 0x7f7728198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:03:21.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.652+0000 7f772659c700 1 --2- 172.21.15.49:0/3658956482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7728100a80 0x7f772819e7b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f771800c9b0 tx=0x7f771800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:21.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.652+0000 7f77177fe700 1 -- 172.21.15.49:0/3658956482 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7718007b00 con 0x7f7728100a80 2024-06-03T00:03:21.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.653+0000 7f772c8b6700 1 -- 172.21.15.49:0/3658956482 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77281993c0 con 0x7f7728100a80 2024-06-03T00:03:21.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.653+0000 7f77177fe700 1 -- 172.21.15.49:0/3658956482 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7718007ca0 con 0x7f7728100a80 2024-06-03T00:03:21.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.653+0000 7f77177fe700 1 -- 172.21.15.49:0/3658956482 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7718018730 con 0x7f7728100a80 2024-06-03T00:03:21.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.653+0000 7f772c8b6700 1 -- 172.21.15.49:0/3658956482 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7728101b90 con 0x7f7728100a80 2024-06-03T00:03:21.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.656+0000 7f77177fe700 1 -- 172.21.15.49:0/3658956482 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f77180188d0 con 0x7f7728100a80 2024-06-03T00:03:21.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.656+0000 7f77177fe700 1 --2- 172.21.15.49:0/3658956482 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f77100a2ca0 0x7f77100a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:21.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.657+0000 7f77177fe700 1 -- 172.21.15.49:0/3658956482 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f77180cef10 con 0x7f7728100a80 2024-06-03T00:03:21.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.657+0000 7f7725d9b700 1 --2- 172.21.15.49:0/3658956482 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f77100a2ca0 0x7f77100a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:21.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.657+0000 7f7725d9b700 1 --2- 172.21.15.49:0/3658956482 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f77100a2ca0 0x7f77100a5160 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7728107b10 tx=0x7f771c00b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:21.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.658+0000 7f7737139b80 1 Processor -- start 2024-06-03T00:03:21.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.658+0000 7f7737139b80 1 -- start start 2024-06-03T00:03:21.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.658+0000 7f7737139b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c48b363f60 0x55c48b364340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:21.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.658+0000 7f7737139b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c48b364880 0x55c48b35e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:21.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.658+0000 7f7737139b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c48b35e7a0 0x55c48b35ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:21.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.658+0000 7f7737139b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c48b250f60 con 0x55c48b364880 2024-06-03T00:03:21.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.658+0000 7f7737139b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55c48b2af850 con 0x55c48b363f60 2024-06-03T00:03:21.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.658+0000 7f7737139b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55c48b217460 con 0x55c48b35e7a0 2024-06-03T00:03:21.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.658+0000 7f7725d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c48b364880 0x55c48b35e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:21.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.658+0000 7f7725d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c48b364880 0x55c48b35e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52634/0 (socket says 172.21.15.49:52634) 2024-06-03T00:03:21.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.658+0000 7f7725d9b700 1 -- 172.21.15.49:0/1266948566 learned_addr learned my addr 172.21.15.49:0/1266948566 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:21.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.658+0000 7f772659c700 1 --2- 172.21.15.49:0/1266948566 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c48b363f60 0x55c48b364340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:21.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.658+0000 7f7726d9d700 1 --2- 172.21.15.49:0/1266948566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c48b35e7a0 0x55c48b35ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:21.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.659+0000 7f772659c700 1 -- 172.21.15.49:0/1266948566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c48b35e7a0 msgr2=0x55c48b35ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:21.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.659+0000 7f772659c700 1 --2- 172.21.15.49:0/1266948566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c48b35e7a0 0x55c48b35ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.659+0000 7f772659c700 1 -- 172.21.15.49:0/1266948566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c48b364880 msgr2=0x55c48b35e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:21.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.659+0000 7f772659c700 1 --2- 172.21.15.49:0/1266948566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c48b364880 0x55c48b35e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.659+0000 7f772659c700 1 -- 172.21.15.49:0/1266948566 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c48b1fe8d0 con 0x55c48b363f60 2024-06-03T00:03:21.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.659+0000 7f7725d9b700 1 --2- 172.21.15.49:0/1266948566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c48b364880 0x55c48b35e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:21.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.659+0000 7f772659c700 1 --2- 172.21.15.49:0/1266948566 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c48b363f60 0x55c48b364340 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f771809b470 tx=0x7f7718020000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de4f7efef0faa73c server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:21.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.659+0000 7f7714ff9700 1 -- 172.21.15.49:0/1266948566 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771809b770 con 0x55c48b363f60 2024-06-03T00:03:21.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.659+0000 7f7714ff9700 1 -- 172.21.15.49:0/1266948566 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f771809fb20 con 0x55c48b363f60 2024-06-03T00:03:21.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.659+0000 7f7714ff9700 1 -- 172.21.15.49:0/1266948566 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771809b9d0 con 0x55c48b363f60 2024-06-03T00:03:21.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.660+0000 7f7737139b80 1 -- 172.21.15.49:0/1266948566 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c48b363f60 msgr2=0x55c48b364340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:21.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.660+0000 7f7737139b80 1 --2- 172.21.15.49:0/1266948566 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c48b363f60 0x55c48b364340 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f771809b470 tx=0x7f7718020000 comp rx=0 tx=0).stop 2024-06-03T00:03:21.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.660+0000 7f7737139b80 1 -- 172.21.15.49:0/1266948566 shutdown_connections 2024-06-03T00:03:21.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.660+0000 7f7737139b80 1 --2- 172.21.15.49:0/1266948566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c48b35e7a0 0x55c48b35ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.660+0000 7f7737139b80 1 --2- 172.21.15.49:0/1266948566 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c48b363f60 0x55c48b364340 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.660+0000 7f7737139b80 1 --2- 172.21.15.49:0/1266948566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c48b364880 0x55c48b35e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.660+0000 7f7737139b80 1 -- 172.21.15.49:0/1266948566 >> 172.21.15.49:0/1266948566 conn(0x55c48b28b080 msgr2=0x55c48b359220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:21.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.660+0000 7f7737139b80 1 -- 172.21.15.49:0/1266948566 shutdown_connections 2024-06-03T00:03:21.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.660+0000 7f7737139b80 1 -- 172.21.15.49:0/1266948566 wait complete. 2024-06-03T00:03:21.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.661+0000 7f7737139b80 1 -- start start 2024-06-03T00:03:21.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.661+0000 7f7737139b80 1 Processor -- start 2024-06-03T00:03:21.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.661+0000 7f7737139b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c48b35e7a0 0x55c48b36a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:21.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.661+0000 7f7737139b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c48b363f60 0x55c48b367950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:21.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.661+0000 7f7737139b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c48b364880 0x55c48b367e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:21.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.661+0000 7f7737139b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c48b24ffc0 con 0x55c48b363f60 2024-06-03T00:03:21.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.661+0000 7f7737139b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55c48b2ab810 con 0x55c48b364880 2024-06-03T00:03:21.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.661+0000 7f7737139b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55c48b36b200 con 0x55c48b35e7a0 2024-06-03T00:03:21.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.661+0000 7f7737139b80 10 client.0 _ll_register_callbacks cb 0x55c48b2455b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:03:21.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.662+0000 7f7725d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c48b363f60 0x55c48b367950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:21.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.662+0000 7f7725d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c48b363f60 0x55c48b367950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52640/0 (socket says 172.21.15.49:52640) 2024-06-03T00:03:21.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.662+0000 7f7725d9b700 1 -- 172.21.15.49:0/2412605488 learned_addr learned my addr 172.21.15.49:0/2412605488 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:21.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.662+0000 7f7726d9d700 1 --2- 172.21.15.49:0/2412605488 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c48b364880 0x55c48b367e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:21.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.662+0000 7f772659c700 1 --2- 172.21.15.49:0/2412605488 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c48b35e7a0 0x55c48b36a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:21.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.662+0000 7f7725d9b700 1 -- 172.21.15.49:0/2412605488 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c48b35e7a0 msgr2=0x55c48b36a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:21.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.662+0000 7f7725d9b700 1 --2- 172.21.15.49:0/2412605488 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c48b35e7a0 0x55c48b36a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.662+0000 7f7725d9b700 1 -- 172.21.15.49:0/2412605488 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c48b364880 msgr2=0x55c48b367e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:21.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.662+0000 7f7725d9b700 1 --2- 172.21.15.49:0/2412605488 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c48b364880 0x55c48b367e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.662+0000 7f7725d9b700 1 -- 172.21.15.49:0/2412605488 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c48b275750 con 0x55c48b363f60 2024-06-03T00:03:21.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.662+0000 7f7725d9b700 1 --2- 172.21.15.49:0/2412605488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c48b363f60 0x55c48b367950 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f771c005fb0 tx=0x7f771c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4998af4ee7d96bed server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:21.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.662+0000 7f770dffb700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:03:21.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.662+0000 7f770dffb700 1 -- 172.21.15.49:0/2412605488 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771c011ce0 con 0x55c48b363f60 2024-06-03T00:03:21.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.662+0000 7f770dffb700 1 -- 172.21.15.49:0/2412605488 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f771c028470 con 0x55c48b363f60 2024-06-03T00:03:21.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.662+0000 7f7737139b80 1 -- 172.21.15.49:0/2412605488 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f771809fb20 con 0x55c48b363f60 2024-06-03T00:03:21.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.663+0000 7f770dffb700 1 -- 172.21.15.49:0/2412605488 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f771c004830 con 0x55c48b363f60 2024-06-03T00:03:21.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.663+0000 7f7737139b80 10 client.16008 fetch_fsmap learned FSMap version 31 2024-06-03T00:03:21.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.663+0000 7f7737139b80 1 -- 172.21.15.49:0/2412605488 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55c48b375a10 con 0x55c48b363f60 2024-06-03T00:03:21.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.663+0000 7f770dffb700 1 -- 172.21.15.49:0/2412605488 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f771809fb20 con 0x55c48b363f60 2024-06-03T00:03:21.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.663+0000 7f770dffb700 1 -- 172.21.15.49:0/2412605488 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f771c028670 con 0x55c48b363f60 2024-06-03T00:03:21.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.663+0000 7f7737139b80 10 client.16008 fetch_fsmap finished waiting for FSMap version 31 2024-06-03T00:03:21.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.663+0000 7f7737139b80 10 client.16008 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-03T00:03:21.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.663+0000 7f7737139b80 20 client.16008 populate_metadata read hostname 'smithi049' 2024-06-03T00:03:21.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.663+0000 7f7737139b80 1 --2- 172.21.15.49:0/2412605488 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55c48b3780a0 0x55c48b37a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:21.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.663+0000 7f7737139b80 4 client.16008 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:03:21.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.663+0000 7f7737139b80 1 -- 172.21.15.49:0/2412605488 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c48b2bcd50 con 0x55c48b3780a0 2024-06-03T00:03:21.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.663+0000 7f772659c700 1 --2- 172.21.15.49:0/2412605488 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55c48b3780a0 0x55c48b37a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:21.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.664+0000 7f772659c700 1 --2- 172.21.15.49:0/2412605488 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55c48b3780a0 0x55c48b37a4c0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b09ee9a25f9ce9d server_cookie=373e71a56c35464e in_seq=0 out_seq=0 2024-06-03T00:03:21.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.664+0000 7f770dffb700 10 client.16008 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:21.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.665+0000 7f770dffb700 1 -- 172.21.15.49:0/2412605488 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55c48b2bcd50 con 0x55c48b3780a0 2024-06-03T00:03:21.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.665+0000 7f770dffb700 10 client.16008 handle_command_reply: tid=0 2024-06-03T00:03:21.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.665+0000 7f7737139b80 1 client.16008 shutdown 2024-06-03T00:03:21.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.665+0000 7f7737139b80 1 -- 172.21.15.49:0/2412605488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c48b363f60 msgr2=0x55c48b367950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:21.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.665+0000 7f7737139b80 1 --2- 172.21.15.49:0/2412605488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c48b363f60 0x55c48b367950 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f771c005fb0 tx=0x7f771c0047c0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.665+0000 7f7737139b80 1 -- 172.21.15.49:0/2412605488 shutdown_connections 2024-06-03T00:03:21.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.665+0000 7f7737139b80 1 --2- 172.21.15.49:0/2412605488 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c48b364880 0x55c48b367e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.665+0000 7f7737139b80 1 --2- 172.21.15.49:0/2412605488 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c48b35e7a0 0x55c48b36a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.665+0000 7f7737139b80 1 --2- 172.21.15.49:0/2412605488 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55c48b3780a0 0x55c48b37a4c0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.665+0000 7f7737139b80 1 --2- 172.21.15.49:0/2412605488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c48b363f60 0x55c48b367950 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.665+0000 7f7737139b80 1 -- 172.21.15.49:0/2412605488 >> 172.21.15.49:0/2412605488 conn(0x55c48b28b080 msgr2=0x55c48b358700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:21.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.665+0000 7f770dffb700 0 client.16008 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:21.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.665+0000 7f7737139b80 1 -- 172.21.15.49:0/2412605488 shutdown_connections 2024-06-03T00:03:21.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.665+0000 7f7737139b80 1 -- 172.21.15.49:0/2412605488 wait complete. 2024-06-03T00:03:21.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.665+0000 7f7737139b80 20 client.16008 trim_cache size 0 max 16384 2024-06-03T00:03:21.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.687+0000 7f7737139b80 1 Processor -- start 2024-06-03T00:03:21.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.687+0000 7f7737139b80 1 -- start start 2024-06-03T00:03:21.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.687+0000 7f7737139b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c48b35e7a0 0x55c48b35e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:21.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.687+0000 7f7737139b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c48b363f60 0x55c48b36a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:21.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.687+0000 7f7737139b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c48b364880 0x55c48b358e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:21.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.687+0000 7f7737139b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f77281aeda0 con 0x55c48b35e7a0 2024-06-03T00:03:21.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.687+0000 7f7737139b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f77281b09a0 con 0x55c48b363f60 2024-06-03T00:03:21.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.687+0000 7f7737139b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f77281af470 con 0x55c48b364880 2024-06-03T00:03:21.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.687+0000 7f772659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c48b35e7a0 0x55c48b35e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:21.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.687+0000 7f772659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c48b35e7a0 0x55c48b35e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52642/0 (socket says 172.21.15.49:52642) 2024-06-03T00:03:21.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.687+0000 7f772659c700 1 -- 172.21.15.49:0/1751680561 learned_addr learned my addr 172.21.15.49:0/1751680561 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:21.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.688+0000 7f7725d9b700 1 --2- 172.21.15.49:0/1751680561 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c48b363f60 0x55c48b36a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:21.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.688+0000 7f7726d9d700 1 --2- 172.21.15.49:0/1751680561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c48b364880 0x55c48b358e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:21.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.688+0000 7f772659c700 1 -- 172.21.15.49:0/1751680561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c48b364880 msgr2=0x55c48b358e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:21.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.688+0000 7f772659c700 1 --2- 172.21.15.49:0/1751680561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c48b364880 0x55c48b358e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.688+0000 7f772659c700 1 -- 172.21.15.49:0/1751680561 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c48b363f60 msgr2=0x55c48b36a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:21.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.688+0000 7f772659c700 1 --2- 172.21.15.49:0/1751680561 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c48b363f60 0x55c48b36a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.688+0000 7f772659c700 1 -- 172.21.15.49:0/1751680561 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c48b375820 con 0x55c48b35e7a0 2024-06-03T00:03:21.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.688+0000 7f7725d9b700 1 --2- 172.21.15.49:0/1751680561 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c48b363f60 0x55c48b36a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:21.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.688+0000 7f772659c700 1 --2- 172.21.15.49:0/1751680561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c48b35e7a0 0x55c48b35e260 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f771800a660 tx=0x7f771800fd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1361a70692eff94 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:21.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.688+0000 7f770ffff700 1 -- 172.21.15.49:0/1751680561 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7718099890 con 0x55c48b35e7a0 2024-06-03T00:03:21.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.688+0000 7f770ffff700 1 -- 172.21.15.49:0/1751680561 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77180ba170 con 0x55c48b35e7a0 2024-06-03T00:03:21.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.688+0000 7f770ffff700 1 -- 172.21.15.49:0/1751680561 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771809bc30 con 0x55c48b35e7a0 2024-06-03T00:03:21.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.689+0000 7f7737139b80 1 -- 172.21.15.49:0/1751680561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c48b35e7a0 msgr2=0x55c48b35e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:21.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.689+0000 7f7737139b80 1 --2- 172.21.15.49:0/1751680561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c48b35e7a0 0x55c48b35e260 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f771800a660 tx=0x7f771800fd30 comp rx=0 tx=0).stop 2024-06-03T00:03:21.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.689+0000 7f7737139b80 1 -- 172.21.15.49:0/1751680561 shutdown_connections 2024-06-03T00:03:21.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.689+0000 7f7737139b80 1 --2- 172.21.15.49:0/1751680561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c48b364880 0x55c48b358e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.689+0000 7f7737139b80 1 --2- 172.21.15.49:0/1751680561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c48b35e7a0 0x55c48b35e260 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.689+0000 7f7737139b80 1 --2- 172.21.15.49:0/1751680561 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c48b363f60 0x55c48b36a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.689+0000 7f7737139b80 1 -- 172.21.15.49:0/1751680561 >> 172.21.15.49:0/1751680561 conn(0x55c48b28b080 msgr2=0x55c48b3632f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:21.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.689+0000 7f7737139b80 1 -- 172.21.15.49:0/1751680561 shutdown_connections 2024-06-03T00:03:21.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.689+0000 7f7737139b80 1 -- 172.21.15.49:0/1751680561 wait complete. 2024-06-03T00:03:21.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.689+0000 7f7737139b80 1 -- start start 2024-06-03T00:03:21.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.690+0000 7f7737139b80 1 Processor -- start 2024-06-03T00:03:21.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.690+0000 7f7737139b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c48b35e7a0 0x55c48b370af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:21.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.690+0000 7f7737139b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c48b363f60 0x55c48b37f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:21.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.690+0000 7f7737139b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c48b364880 0x55c48b37fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:21.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.690+0000 7f7737139b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f77281b0210 con 0x55c48b364880 2024-06-03T00:03:21.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.690+0000 7f7737139b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f77281afb40 con 0x55c48b35e7a0 2024-06-03T00:03:21.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.690+0000 7f7737139b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f77281acd20 con 0x55c48b363f60 2024-06-03T00:03:21.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.690+0000 7f7737139b80 10 client.0 _ll_register_callbacks cb 0x55c48b365a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:03:21.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.690+0000 7f7726d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c48b364880 0x55c48b37fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:21.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.690+0000 7f7726d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c48b364880 0x55c48b37fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52654/0 (socket says 172.21.15.49:52654) 2024-06-03T00:03:21.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.690+0000 7f7726d9d700 1 -- 172.21.15.49:0/2836955208 learned_addr learned my addr 172.21.15.49:0/2836955208 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:21.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.690+0000 7f772659c700 1 --2- 172.21.15.49:0/2836955208 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c48b35e7a0 0x55c48b370af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:21.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.690+0000 7f7725d9b700 1 --2- 172.21.15.49:0/2836955208 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c48b363f60 0x55c48b37f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:21.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.690+0000 7f7726d9d700 1 -- 172.21.15.49:0/2836955208 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c48b363f60 msgr2=0x55c48b37f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:21.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.690+0000 7f7726d9d700 1 --2- 172.21.15.49:0/2836955208 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c48b363f60 0x55c48b37f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.690+0000 7f7726d9d700 1 -- 172.21.15.49:0/2836955208 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c48b35e7a0 msgr2=0x55c48b370af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:21.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.690+0000 7f7726d9d700 1 --2- 172.21.15.49:0/2836955208 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c48b35e7a0 0x55c48b370af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.690+0000 7f7726d9d700 1 -- 172.21.15.49:0/2836955208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c48b380160 con 0x55c48b364880 2024-06-03T00:03:21.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.690+0000 7f7725d9b700 1 --2- 172.21.15.49:0/2836955208 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c48b363f60 0x55c48b37f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:03:21.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.691+0000 7f7726d9d700 1 --2- 172.21.15.49:0/2836955208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c48b364880 0x55c48b37fab0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f772000b0a0 tx=0x7f7720004cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca68d6a9a82a299b server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:21.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.691+0000 7f770dffb700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:03:21.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.691+0000 7f770dffb700 1 -- 172.21.15.49:0/2836955208 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77200078f0 con 0x55c48b364880 2024-06-03T00:03:21.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.691+0000 7f7737139b80 1 -- 172.21.15.49:0/2836955208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c48b2b72d0 con 0x55c48b364880 2024-06-03T00:03:21.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.691+0000 7f770dffb700 1 -- 172.21.15.49:0/2836955208 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f7720007a90 con 0x55c48b364880 2024-06-03T00:03:21.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.691+0000 7f770dffb700 1 -- 172.21.15.49:0/2836955208 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7720007c90 con 0x55c48b364880 2024-06-03T00:03:21.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.691+0000 7f7737139b80 10 client.16014 fetch_fsmap learned FSMap version 31 2024-06-03T00:03:21.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.691+0000 7f7737139b80 1 -- 172.21.15.49:0/2836955208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55c48b3e2c40 con 0x55c48b364880 2024-06-03T00:03:21.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.691+0000 7f770dffb700 1 -- 172.21.15.49:0/2836955208 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55c48b2b72d0 con 0x55c48b364880 2024-06-03T00:03:21.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.691+0000 7f770dffb700 1 -- 172.21.15.49:0/2836955208 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f7720024070 con 0x55c48b364880 2024-06-03T00:03:21.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.692+0000 7f7737139b80 10 client.16014 fetch_fsmap finished waiting for FSMap version 31 2024-06-03T00:03:21.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.692+0000 7f7737139b80 10 client.16014 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-03T00:03:21.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.692+0000 7f7737139b80 20 client.16014 populate_metadata read hostname 'smithi049' 2024-06-03T00:03:21.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.692+0000 7f7737139b80 1 --2- 172.21.15.49:0/2836955208 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55c48b3e3420 0x55c48b3e5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:21.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.692+0000 7f7737139b80 4 client.16014 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-03T00:03:21.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.692+0000 7f7737139b80 1 -- 172.21.15.49:0/2836955208 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c48b26af50 con 0x55c48b3e3420 2024-06-03T00:03:21.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.692+0000 7f772659c700 1 --2- 172.21.15.49:0/2836955208 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55c48b3e3420 0x55c48b3e5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:21.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.692+0000 7f772659c700 1 --2- 172.21.15.49:0/2836955208 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55c48b3e3420 0x55c48b3e5840 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f9c74eb731019b7 server_cookie=600dcf3cd50b87c2 in_seq=0 out_seq=0 2024-06-03T00:03:21.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.692+0000 7f770dffb700 10 client.16014 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:21.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.693+0000 7f770dffb700 1 -- 172.21.15.49:0/2836955208 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55c48b26af50 con 0x55c48b3e3420 2024-06-03T00:03:21.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.693+0000 7f770dffb700 10 client.16014 handle_command_reply: tid=0 2024-06-03T00:03:21.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.693+0000 7f7737139b80 1 client.16014 shutdown 2024-06-03T00:03:21.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.693+0000 7f7737139b80 1 -- 172.21.15.49:0/2836955208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c48b364880 msgr2=0x55c48b37fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:21.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.693+0000 7f7737139b80 1 --2- 172.21.15.49:0/2836955208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c48b364880 0x55c48b37fab0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f772000b0a0 tx=0x7f7720004cf0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.693+0000 7f7737139b80 1 -- 172.21.15.49:0/2836955208 shutdown_connections 2024-06-03T00:03:21.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.693+0000 7f7737139b80 1 --2- 172.21.15.49:0/2836955208 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55c48b3e3420 0x55c48b3e5840 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.693+0000 7f7737139b80 1 --2- 172.21.15.49:0/2836955208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c48b364880 0x55c48b37fab0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.693+0000 7f7737139b80 1 --2- 172.21.15.49:0/2836955208 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c48b35e7a0 0x55c48b370af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.693+0000 7f7737139b80 1 --2- 172.21.15.49:0/2836955208 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c48b363f60 0x55c48b37f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.693+0000 7f7737139b80 1 -- 172.21.15.49:0/2836955208 >> 172.21.15.49:0/2836955208 conn(0x55c48b28b080 msgr2=0x55c48b367200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:21.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.693+0000 7f770dffb700 0 client.16014 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:21.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.693+0000 7f7737139b80 1 -- 172.21.15.49:0/2836955208 shutdown_connections 2024-06-03T00:03:21.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.693+0000 7f7737139b80 1 -- 172.21.15.49:0/2836955208 wait complete. 2024-06-03T00:03:21.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.693+0000 7f7737139b80 20 client.16014 trim_cache size 0 max 16384 2024-06-03T00:03:21.698 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:03:21.699 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "no active scrubs running", 2024-06-03T00:03:21.699 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {} 2024-06-03T00:03:21.699 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:03:21.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.693+0000 7f772c8b6700 1 -- 172.21.15.49:0/3658956482 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f77100a2ca0 msgr2=0x7f77100a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:21.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.694+0000 7f772c8b6700 1 --2- 172.21.15.49:0/3658956482 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f77100a2ca0 0x7f77100a5160 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7728107b10 tx=0x7f771c00b3c0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.694+0000 7f772c8b6700 1 -- 172.21.15.49:0/3658956482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7728100a80 msgr2=0x7f772819e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:21.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.694+0000 7f772c8b6700 1 --2- 172.21.15.49:0/3658956482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7728100a80 0x7f772819e7b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f771800c9b0 tx=0x7f771800ccc0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.694+0000 7f772c8b6700 1 -- 172.21.15.49:0/3658956482 shutdown_connections 2024-06-03T00:03:21.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.694+0000 7f772c8b6700 1 --2- 172.21.15.49:0/3658956482 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f77100a2ca0 0x7f77100a5160 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.694+0000 7f772c8b6700 1 --2- 172.21.15.49:0/3658956482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7728108510 0x7f7728198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.694+0000 7f772c8b6700 1 --2- 172.21.15.49:0/3658956482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7728100a80 0x7f772819e7b0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.694+0000 7f772c8b6700 1 --2- 172.21.15.49:0/3658956482 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7728101440 0x7f772819ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.694+0000 7f772c8b6700 1 -- 172.21.15.49:0/3658956482 >> 172.21.15.49:0/3658956482 conn(0x7f7728077a00 msgr2=0x7f77280fef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:21.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.694+0000 7f772c8b6700 1 -- 172.21.15.49:0/3658956482 shutdown_connections 2024-06-03T00:03:21.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:21.694+0000 7f772c8b6700 1 -- 172.21.15.49:0/3658956482 wait complete. 2024-06-03T00:03:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.981+0000 7fae3241c640 1 -- 172.21.15.49:0/1893645068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae2c100900 msgr2=0x7fae2c100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.981+0000 7fae3241c640 1 --2- 172.21.15.49:0/1893645068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae2c100900 0x7fae2c100d20 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fae1c009900 tx=0x7fae1c02a410 comp rx=0 tx=0).stop 2024-06-03T00:03:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.981+0000 7fae3241c640 1 -- 172.21.15.49:0/1893645068 shutdown_connections 2024-06-03T00:03:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.981+0000 7fae3241c640 1 --2- 172.21.15.49:0/1893645068 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae2c1024b0 0x7fae2c108d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.981+0000 7fae3241c640 1 --2- 172.21.15.49:0/1893645068 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae2c101af0 0x7fae2c101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.981+0000 7fae3241c640 1 --2- 172.21.15.49:0/1893645068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae2c100900 0x7fae2c100d20 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.981+0000 7fae3241c640 1 -- 172.21.15.49:0/1893645068 >> 172.21.15.49:0/1893645068 conn(0x7fae2c0fbe70 msgr2=0x7fae2c0fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.981+0000 7fae3241c640 1 -- 172.21.15.49:0/1893645068 shutdown_connections 2024-06-03T00:03:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.981+0000 7fae3241c640 1 -- 172.21.15.49:0/1893645068 wait complete. 2024-06-03T00:03:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.982+0000 7fae3241c640 1 Processor -- start 2024-06-03T00:03:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.982+0000 7fae3241c640 1 -- start start 2024-06-03T00:03:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.982+0000 7fae3241c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae2c100900 0x7fae2c199ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.982+0000 7fae3241c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae2c101af0 0x7fae2c19a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.982+0000 7fae3241c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae2c1024b0 0x7fae2c1a1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.982+0000 7fae3241c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c10d6a0 con 0x7fae2c101af0 2024-06-03T00:03:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.982+0000 7fae3241c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c10d520 con 0x7fae2c1024b0 2024-06-03T00:03:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.982+0000 7fae3241c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c10d820 con 0x7fae2c100900 2024-06-03T00:03:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.982+0000 7fae2b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae2c101af0 0x7fae2c19a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.982+0000 7fae2b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae2c101af0 0x7fae2c19a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52674/0 (socket says 172.21.15.49:52674) 2024-06-03T00:03:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.982+0000 7fae2b7fe640 1 -- 172.21.15.49:0/3092244060 learned_addr learned my addr 172.21.15.49:0/3092244060 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.982+0000 7fae2bfff640 1 --2- 172.21.15.49:0/3092244060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae2c100900 0x7fae2c199ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.983+0000 7fae2b7fe640 1 -- 172.21.15.49:0/3092244060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae2c100900 msgr2=0x7fae2c199ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.983+0000 7fae2b7fe640 1 --2- 172.21.15.49:0/3092244060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae2c100900 0x7fae2c199ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.983+0000 7fae2b7fe640 1 -- 172.21.15.49:0/3092244060 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae2c1024b0 msgr2=0x7fae2c1a1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.983+0000 7fae309b9640 1 --2- 172.21.15.49:0/3092244060 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae2c1024b0 0x7fae2c1a1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.983+0000 7fae2b7fe640 1 --2- 172.21.15.49:0/3092244060 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae2c1024b0 0x7fae2c1a1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.983+0000 7fae2b7fe640 1 -- 172.21.15.49:0/3092244060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae2c1a1b00 con 0x7fae2c101af0 2024-06-03T00:03:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.983+0000 7fae2b7fe640 1 --2- 172.21.15.49:0/3092244060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae2c101af0 0x7fae2c19a420 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fae2000e9f0 tx=0x7fae2000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.983+0000 7fae297fa640 1 -- 172.21.15.49:0/3092244060 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae2000cd80 con 0x7fae2c101af0 2024-06-03T00:03:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.983+0000 7fae297fa640 1 -- 172.21.15.49:0/3092244060 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae20005500 con 0x7fae2c101af0 2024-06-03T00:03:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.983+0000 7fae3241c640 1 -- 172.21.15.49:0/3092244060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae2c1a1df0 con 0x7fae2c101af0 2024-06-03T00:03:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.983+0000 7fae297fa640 1 -- 172.21.15.49:0/3092244060 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae20010690 con 0x7fae2c101af0 2024-06-03T00:03:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.983+0000 7fae3241c640 1 -- 172.21.15.49:0/3092244060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae2c1a2260 con 0x7fae2c101af0 2024-06-03T00:03:21.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.985+0000 7fae297fa640 1 -- 172.21.15.49:0/3092244060 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fae200046c0 con 0x7fae2c101af0 2024-06-03T00:03:21.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.986+0000 7fae35209740 1 Processor -- start 2024-06-03T00:03:21.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.986+0000 7fae35209740 1 -- start start 2024-06-03T00:03:21.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.986+0000 7fae35209740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5617038f8010 0x5617038f8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:21.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.986+0000 7fae35209740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5617038f8a00 0x5617038fd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:21.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.986+0000 7fae35209740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617038fdb70 0x561703900000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:21.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.986+0000 7fae35209740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56170385b4f0 con 0x5617038fdb70 2024-06-03T00:03:21.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.986+0000 7fae35209740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5617037f9870 con 0x5617038f8010 2024-06-03T00:03:21.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.986+0000 7fae35209740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5617038574b0 con 0x5617038f8a00 2024-06-03T00:03:21.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.986+0000 7fae2b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617038fdb70 0x561703900000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:21.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.986+0000 7fae2bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5617038f8a00 0x5617038fd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.986+0000 7fae2b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617038fdb70 0x561703900000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52686/0 (socket says 172.21.15.49:52686) 2024-06-03T00:03:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.986+0000 7fae2bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5617038f8a00 0x5617038fd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:39080/0 (socket says 172.21.15.49:39080) 2024-06-03T00:03:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.986+0000 7fae2b7fe640 1 -- 172.21.15.49:0/1271175537 learned_addr learned my addr 172.21.15.49:0/1271175537 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.986+0000 7fae309b9640 1 --2- 172.21.15.49:0/1271175537 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5617038f8010 0x5617038f8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.986+0000 7fae297fa640 1 --2- 172.21.15.49:0/3092244060 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fae140a2c30 0x7fae140a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.986+0000 7fae309b9640 1 --2- 172.21.15.49:0/3092244060 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fae140a2c30 0x7fae140a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.986+0000 7fae2bfff640 1 -- 172.21.15.49:0/1271175537 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5617038f8010 msgr2=0x5617038f8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.987+0000 7fae2bfff640 1 --2- 172.21.15.49:0/1271175537 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5617038f8010 0x5617038f8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.987+0000 7fae2bfff640 1 -- 172.21.15.49:0/1271175537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617038fdb70 msgr2=0x561703900000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.987+0000 7fae2bfff640 1 --2- 172.21.15.49:0/1271175537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617038fdb70 0x561703900000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.987+0000 7fae297fa640 1 -- 172.21.15.49:0/3092244060 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fae200cf4c0 con 0x7fae2c101af0 2024-06-03T00:03:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.987+0000 7fae2bfff640 1 -- 172.21.15.49:0/1271175537 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617038159b0 con 0x5617038f8a00 2024-06-03T00:03:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.987+0000 7fae2bfff640 1 --2- 172.21.15.49:0/1271175537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5617038f8a00 0x5617038fd500 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fae1c009230 tx=0x7fae1c005e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd08e990341c4af5 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.987+0000 7fae309b9640 1 --2- 172.21.15.49:0/3092244060 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fae140a2c30 0x7fae140a50f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x5617038f9260 tx=0x7fae24004ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.987+0000 7fae127fc640 1 -- 172.21.15.49:0/1271175537 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1c040070 con 0x5617038f8a00 2024-06-03T00:03:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.987+0000 7fae127fc640 1 -- 172.21.15.49:0/1271175537 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae1c004030 con 0x5617038f8a00 2024-06-03T00:03:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.987+0000 7fae127fc640 1 -- 172.21.15.49:0/1271175537 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1c035040 con 0x5617038f8a00 2024-06-03T00:03:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.988+0000 7fae35209740 1 -- 172.21.15.49:0/1271175537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5617038f8a00 msgr2=0x5617038fd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.988+0000 7fae35209740 1 --2- 172.21.15.49:0/1271175537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5617038f8a00 0x5617038fd500 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fae1c009230 tx=0x7fae1c005e20 comp rx=0 tx=0).stop 2024-06-03T00:03:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.988+0000 7fae35209740 1 -- 172.21.15.49:0/1271175537 shutdown_connections 2024-06-03T00:03:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.988+0000 7fae35209740 1 --2- 172.21.15.49:0/1271175537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617038fdb70 0x561703900000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.988+0000 7fae35209740 1 --2- 172.21.15.49:0/1271175537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5617038f8a00 0x5617038fd500 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.988+0000 7fae35209740 1 --2- 172.21.15.49:0/1271175537 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5617038f8010 0x5617038f8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.988+0000 7fae35209740 1 -- 172.21.15.49:0/1271175537 >> 172.21.15.49:0/1271175537 conn(0x5617038f3680 msgr2=0x5617038f3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.988+0000 7fae35209740 1 -- 172.21.15.49:0/1271175537 shutdown_connections 2024-06-03T00:03:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.988+0000 7fae35209740 1 -- 172.21.15.49:0/1271175537 wait complete. 2024-06-03T00:03:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.988+0000 7fae35209740 1 -- start start 2024-06-03T00:03:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.988+0000 7fae35209740 1 Processor -- start 2024-06-03T00:03:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.989+0000 7fae35209740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617038f8010 0x5617039022f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.989+0000 7fae35209740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5617038f8a00 0x561703902830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.989+0000 7fae35209740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5617038fdb70 0x561703909870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.989+0000 7fae35209740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x561703900ac0 con 0x5617038f8010 2024-06-03T00:03:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.989+0000 7fae35209740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5617037e4ae0 con 0x5617038fdb70 2024-06-03T00:03:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.989+0000 7fae35209740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561703900c40 con 0x5617038f8a00 2024-06-03T00:03:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.989+0000 7fae35209740 10 client.0 _ll_register_callbacks cb 0x56170381d9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:03:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.989+0000 7fae2bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617038f8010 0x5617039022f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.989+0000 7fae2bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617038f8010 0x5617039022f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52688/0 (socket says 172.21.15.49:52688) 2024-06-03T00:03:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.989+0000 7fae2b7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5617038f8a00 0x561703902830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.989+0000 7fae2bfff640 1 -- 172.21.15.49:0/1337570652 learned_addr learned my addr 172.21.15.49:0/1337570652 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.989+0000 7fae309b9640 1 --2- 172.21.15.49:0/1337570652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5617038fdb70 0x561703909870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.989+0000 7fae2bfff640 1 -- 172.21.15.49:0/1337570652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5617038f8a00 msgr2=0x561703902830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.989+0000 7fae2bfff640 1 --2- 172.21.15.49:0/1337570652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5617038f8a00 0x561703902830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.989+0000 7fae2bfff640 1 -- 172.21.15.49:0/1337570652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5617038fdb70 msgr2=0x561703909870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.989+0000 7fae2bfff640 1 --2- 172.21.15.49:0/1337570652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5617038fdb70 0x561703909870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.989+0000 7fae2bfff640 1 -- 172.21.15.49:0/1337570652 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56170356f210 con 0x5617038f8010 2024-06-03T00:03:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.989+0000 7fae309b9640 1 --2- 172.21.15.49:0/1337570652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5617038fdb70 0x561703909870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:03:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.989+0000 7fae2bfff640 1 --2- 172.21.15.49:0/1337570652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617038f8010 0x5617039022f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fae1c005ab0 tx=0x7fae1c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6202cb75c2ed9d3e server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.989+0000 7fae0b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:03:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.990+0000 7fae0b7fe640 1 -- 172.21.15.49:0/1337570652 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1c04c020 con 0x5617038f8010 2024-06-03T00:03:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.990+0000 7fae35209740 1 -- 172.21.15.49:0/1337570652 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae1c004030 con 0x5617038f8010 2024-06-03T00:03:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.990+0000 7fae0b7fe640 1 -- 172.21.15.49:0/1337570652 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fae1c0043e0 con 0x5617038f8010 2024-06-03T00:03:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.990+0000 7fae0b7fe640 1 -- 172.21.15.49:0/1337570652 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fae1c040070 con 0x5617038f8010 2024-06-03T00:03:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.990+0000 7fae35209740 10 client.16026 fetch_fsmap learned FSMap version 31 2024-06-03T00:03:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.990+0000 7fae35209740 1 -- 172.21.15.49:0/1337570652 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56170363b620 con 0x5617038f8010 2024-06-03T00:03:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.990+0000 7fae0b7fe640 1 -- 172.21.15.49:0/1337570652 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae1c004030 con 0x5617038f8010 2024-06-03T00:03:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.990+0000 7fae0b7fe640 1 -- 172.21.15.49:0/1337570652 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fae1c0035f0 con 0x5617038f8010 2024-06-03T00:03:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.990+0000 7fae35209740 10 client.16026 fetch_fsmap finished waiting for FSMap version 31 2024-06-03T00:03:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.990+0000 7fae35209740 10 client.16026 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:03:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.990+0000 7fae35209740 20 client.16026 populate_metadata read hostname 'smithi049' 2024-06-03T00:03:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.990+0000 7fae35209740 1 --2- 172.21.15.49:0/1337570652 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x56170390dd60 0x561703910150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.990+0000 7fae35209740 4 client.16026 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:03:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.990+0000 7fae35209740 1 -- 172.21.15.49:0/1337570652 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56170386ef10 con 0x56170390dd60 2024-06-03T00:03:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.990+0000 7fae2b7fe640 1 --2- 172.21.15.49:0/1337570652 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x56170390dd60 0x561703910150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.991+0000 7fae2b7fe640 1 --2- 172.21.15.49:0/1337570652 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x56170390dd60 0x561703910150 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=341de1865b0bbd23 server_cookie=190314a3ce760a5 in_seq=0 out_seq=0 2024-06-03T00:03:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.991+0000 7fae0b7fe640 10 client.16026 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.992+0000 7fae0b7fe640 1 -- 172.21.15.49:0/1337570652 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x56170386ef10 con 0x56170390dd60 2024-06-03T00:03:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.992+0000 7fae0b7fe640 10 client.16026 handle_command_reply: tid=0 2024-06-03T00:03:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.992+0000 7fae35209740 1 client.16026 shutdown 2024-06-03T00:03:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.992+0000 7fae35209740 1 -- 172.21.15.49:0/1337570652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617038f8010 msgr2=0x5617039022f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.992+0000 7fae35209740 1 --2- 172.21.15.49:0/1337570652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617038f8010 0x5617039022f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fae1c005ab0 tx=0x7fae1c009260 comp rx=0 tx=0).stop 2024-06-03T00:03:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.992+0000 7fae35209740 1 -- 172.21.15.49:0/1337570652 shutdown_connections 2024-06-03T00:03:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.992+0000 7fae35209740 1 --2- 172.21.15.49:0/1337570652 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x56170390dd60 0x561703910150 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.992+0000 7fae35209740 1 --2- 172.21.15.49:0/1337570652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5617038fdb70 0x561703909870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.992+0000 7fae35209740 1 --2- 172.21.15.49:0/1337570652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5617038f8a00 0x561703902830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.992+0000 7fae0b7fe640 0 client.16026 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.992+0000 7fae35209740 1 --2- 172.21.15.49:0/1337570652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617038f8010 0x5617039022f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.992+0000 7fae35209740 1 -- 172.21.15.49:0/1337570652 >> 172.21.15.49:0/1337570652 conn(0x5617038f3680 msgr2=0x5617038f27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.992+0000 7fae35209740 1 -- 172.21.15.49:0/1337570652 shutdown_connections 2024-06-03T00:03:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.992+0000 7fae35209740 1 -- 172.21.15.49:0/1337570652 wait complete. 2024-06-03T00:03:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:21.992+0000 7fae35209740 20 client.16026 trim_cache size 0 max 16384 2024-06-03T00:03:22.022 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.007+0000 7fae35209740 1 Processor -- start 2024-06-03T00:03:22.022 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.007+0000 7fae35209740 1 -- start start 2024-06-03T00:03:22.022 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.007+0000 7fae35209740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5617038f8010 0x5617039015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:22.023 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.007+0000 7fae35209740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617038f8a00 0x561703909790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:22.023 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.007+0000 7fae35209740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5617038fdb70 0x561703901b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:22.023 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.007+0000 7fae35209740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c1ab0d0 con 0x5617038f8a00 2024-06-03T00:03:22.023 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.007+0000 7fae35209740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c1accd0 con 0x5617038f8010 2024-06-03T00:03:22.023 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.007+0000 7fae35209740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c1ab7a0 con 0x5617038fdb70 2024-06-03T00:03:22.023 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.007+0000 7fae2b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617038f8a00 0x561703909790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:22.023 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.007+0000 7fae2b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617038f8a00 0x561703909790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52700/0 (socket says 172.21.15.49:52700) 2024-06-03T00:03:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.007+0000 7fae2b7fe640 1 -- 172.21.15.49:0/421475236 learned_addr learned my addr 172.21.15.49:0/421475236 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.008+0000 7fae309b9640 1 --2- 172.21.15.49:0/421475236 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5617038fdb70 0x561703901b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.008+0000 7fae2b7fe640 1 -- 172.21.15.49:0/421475236 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5617038fdb70 msgr2=0x561703901b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.008+0000 7fae2b7fe640 1 --2- 172.21.15.49:0/421475236 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5617038fdb70 0x561703901b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.008+0000 7fae2b7fe640 1 -- 172.21.15.49:0/421475236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5617038f8010 msgr2=0x5617039015e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.008+0000 7fae2b7fe640 1 --2- 172.21.15.49:0/421475236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5617038f8010 0x5617039015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.008+0000 7fae2b7fe640 1 -- 172.21.15.49:0/421475236 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617038fcfd0 con 0x5617038f8a00 2024-06-03T00:03:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.008+0000 7fae2b7fe640 1 --2- 172.21.15.49:0/421475236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617038f8a00 0x561703909790 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fae2000c6a0 tx=0x7fae200980f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ffbe8aa06e197c8 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.008+0000 7fae11ffb640 1 -- 172.21.15.49:0/421475236 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae2009b680 con 0x5617038f8a00 2024-06-03T00:03:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.008+0000 7fae11ffb640 1 -- 172.21.15.49:0/421475236 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae2009c420 con 0x5617038f8a00 2024-06-03T00:03:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.008+0000 7fae11ffb640 1 -- 172.21.15.49:0/421475236 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae200d2d10 con 0x5617038f8a00 2024-06-03T00:03:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.009+0000 7fae35209740 1 -- 172.21.15.49:0/421475236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617038f8a00 msgr2=0x561703909790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.009+0000 7fae35209740 1 --2- 172.21.15.49:0/421475236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617038f8a00 0x561703909790 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fae2000c6a0 tx=0x7fae200980f0 comp rx=0 tx=0).stop 2024-06-03T00:03:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.009+0000 7fae35209740 1 -- 172.21.15.49:0/421475236 shutdown_connections 2024-06-03T00:03:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.009+0000 7fae35209740 1 --2- 172.21.15.49:0/421475236 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5617038fdb70 0x561703901b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:22.027 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.009+0000 7fae35209740 1 --2- 172.21.15.49:0/421475236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617038f8a00 0x561703909790 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:22.027 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.009+0000 7fae35209740 1 --2- 172.21.15.49:0/421475236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5617038f8010 0x5617039015e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:22.027 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.009+0000 7fae35209740 1 -- 172.21.15.49:0/421475236 >> 172.21.15.49:0/421475236 conn(0x5617038f3680 msgr2=0x5617038f6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:22.027 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.009+0000 7fae35209740 1 -- 172.21.15.49:0/421475236 shutdown_connections 2024-06-03T00:03:22.027 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.009+0000 7fae35209740 1 -- 172.21.15.49:0/421475236 wait complete. 2024-06-03T00:03:22.027 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.009+0000 7fae35209740 1 -- start start 2024-06-03T00:03:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.009+0000 7fae35209740 1 Processor -- start 2024-06-03T00:03:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.009+0000 7fae35209740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617038f8010 0x561703906d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.010+0000 7fae35209740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5617038f8a00 0x561703907260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.010+0000 7fae35209740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5617038fdb70 0x561703908270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.010+0000 7fae35209740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c1ac540 con 0x5617038f8010 2024-06-03T00:03:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.010+0000 7fae35209740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c1abe70 con 0x5617038fdb70 2024-06-03T00:03:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.010+0000 7fae35209740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c1a9090 con 0x5617038f8a00 2024-06-03T00:03:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.010+0000 7fae35209740 10 client.0 _ll_register_callbacks cb 0x7fae20098040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:03:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.010+0000 7fae2bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617038f8010 0x561703906d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.010+0000 7fae2bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617038f8010 0x561703906d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52716/0 (socket says 172.21.15.49:52716) 2024-06-03T00:03:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.010+0000 7fae2bfff640 1 -- 172.21.15.49:0/4212022331 learned_addr learned my addr 172.21.15.49:0/4212022331 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:22.031 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.010+0000 7fae2b7fe640 1 --2- 172.21.15.49:0/4212022331 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5617038f8a00 0x561703907260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:22.031 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.010+0000 7fae2bfff640 1 -- 172.21.15.49:0/4212022331 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5617038f8a00 msgr2=0x561703907260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:22.031 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.010+0000 7fae2bfff640 1 --2- 172.21.15.49:0/4212022331 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5617038f8a00 0x561703907260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:22.031 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.010+0000 7fae2bfff640 1 -- 172.21.15.49:0/4212022331 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5617038fdb70 msgr2=0x561703908270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:22.031 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.010+0000 7fae2bfff640 1 --2- 172.21.15.49:0/4212022331 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5617038fdb70 0x561703908270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:22.031 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.010+0000 7fae2bfff640 1 -- 172.21.15.49:0/4212022331 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561703908860 con 0x5617038f8010 2024-06-03T00:03:22.032 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.010+0000 7fae2bfff640 1 --2- 172.21.15.49:0/4212022331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617038f8010 0x561703906d20 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fae1c003a40 tx=0x7fae1c003ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db901e8637538e8 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:22.032 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.010+0000 7fae0b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:03:22.032 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.010+0000 7fae0b7fe640 1 -- 172.21.15.49:0/4212022331 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1c04c040 con 0x5617038f8010 2024-06-03T00:03:22.032 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.010+0000 7fae35209740 1 -- 172.21.15.49:0/4212022331 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae2009c420 con 0x5617038f8010 2024-06-03T00:03:22.032 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.010+0000 7fae0b7fe640 1 -- 172.21.15.49:0/4212022331 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fae1c0043f0 con 0x5617038f8010 2024-06-03T00:03:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.010+0000 7fae0b7fe640 1 -- 172.21.15.49:0/4212022331 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fae1c035040 con 0x5617038f8010 2024-06-03T00:03:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.010+0000 7fae35209740 10 client.16032 fetch_fsmap learned FSMap version 31 2024-06-03T00:03:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.010+0000 7fae35209740 1 -- 172.21.15.49:0/4212022331 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x561703909b70 con 0x5617038f8010 2024-06-03T00:03:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.011+0000 7fae0b7fe640 1 -- 172.21.15.49:0/4212022331 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae2009c420 con 0x5617038f8010 2024-06-03T00:03:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.011+0000 7fae0b7fe640 1 -- 172.21.15.49:0/4212022331 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fae1c03c6e0 con 0x5617038f8010 2024-06-03T00:03:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.011+0000 7fae35209740 10 client.16032 fetch_fsmap finished waiting for FSMap version 31 2024-06-03T00:03:22.034 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.011+0000 7fae35209740 10 client.16032 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:03:22.034 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.011+0000 7fae35209740 20 client.16032 populate_metadata read hostname 'smithi049' 2024-06-03T00:03:22.034 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.011+0000 7fae35209740 1 --2- 172.21.15.49:0/4212022331 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5617039791a0 0x56170397b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:22.034 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.011+0000 7fae35209740 4 client.16032 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-03T00:03:22.034 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.011+0000 7fae35209740 1 -- 172.21.15.49:0/4212022331 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561703868c20 con 0x5617039791a0 2024-06-03T00:03:22.034 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.011+0000 7fae2b7fe640 1 --2- 172.21.15.49:0/4212022331 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5617039791a0 0x56170397b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:22.035 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.011+0000 7fae2b7fe640 1 --2- 172.21.15.49:0/4212022331 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5617039791a0 0x56170397b5c0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=567ba1c7c3877b1f server_cookie=21c7b96077985bb2 in_seq=0 out_seq=0 2024-06-03T00:03:22.035 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.011+0000 7fae0b7fe640 10 client.16032 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:22.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.190+0000 7fae0b7fe640 1 -- 172.21.15.49:0/4212022331 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x561703868c20 con 0x5617039791a0 2024-06-03T00:03:22.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.190+0000 7fae0b7fe640 10 client.16032 handle_command_reply: tid=0 2024-06-03T00:03:22.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.190+0000 7fae35209740 1 client.16032 shutdown 2024-06-03T00:03:22.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.191+0000 7fae35209740 1 -- 172.21.15.49:0/4212022331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617038f8010 msgr2=0x561703906d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:22.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.191+0000 7fae35209740 1 --2- 172.21.15.49:0/4212022331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617038f8010 0x561703906d20 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fae1c003a40 tx=0x7fae1c003ec0 comp rx=0 tx=0).stop 2024-06-03T00:03:22.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.191+0000 7fae35209740 1 -- 172.21.15.49:0/4212022331 shutdown_connections 2024-06-03T00:03:22.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.191+0000 7fae35209740 1 --2- 172.21.15.49:0/4212022331 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5617039791a0 0x56170397b5c0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:22.193 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.191+0000 7fae35209740 1 --2- 172.21.15.49:0/4212022331 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5617038fdb70 0x561703908270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:22.193 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.191+0000 7fae35209740 1 --2- 172.21.15.49:0/4212022331 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5617038f8a00 0x561703907260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:22.193 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.191+0000 7fae35209740 1 --2- 172.21.15.49:0/4212022331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617038f8010 0x561703906d20 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:22.193 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.191+0000 7fae0b7fe640 0 client.16032 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:22.193 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.191+0000 7fae35209740 1 -- 172.21.15.49:0/4212022331 >> 172.21.15.49:0/4212022331 conn(0x5617038f3680 msgr2=0x5617038f1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:22.193 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.191+0000 7fae35209740 1 -- 172.21.15.49:0/4212022331 shutdown_connections 2024-06-03T00:03:22.193 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.191+0000 7fae35209740 1 -- 172.21.15.49:0/4212022331 wait complete. 2024-06-03T00:03:22.193 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.191+0000 7fae35209740 20 client.16032 trim_cache size 0 max 16384 2024-06-03T00:03:22.193 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-06-03T00:03:22.194 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-06-03T00:03:22.194 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-06-03T00:03:22.194 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.191+0000 7fae3241c640 1 -- 172.21.15.49:0/3092244060 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fae140a2c30 msgr2=0x7fae140a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:22.195 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.191+0000 7fae3241c640 1 --2- 172.21.15.49:0/3092244060 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fae140a2c30 0x7fae140a50f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x5617038f9260 tx=0x7fae24004ab0 comp rx=0 tx=0).stop 2024-06-03T00:03:22.195 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.191+0000 7fae3241c640 1 -- 172.21.15.49:0/3092244060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae2c101af0 msgr2=0x7fae2c19a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:22.195 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.191+0000 7fae3241c640 1 --2- 172.21.15.49:0/3092244060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae2c101af0 0x7fae2c19a420 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fae2000e9f0 tx=0x7fae2000edf0 comp rx=0 tx=0).stop 2024-06-03T00:03:22.195 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.192+0000 7fae3241c640 1 -- 172.21.15.49:0/3092244060 shutdown_connections 2024-06-03T00:03:22.195 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.192+0000 7fae3241c640 1 --2- 172.21.15.49:0/3092244060 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fae140a2c30 0x7fae140a50f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:22.195 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.192+0000 7fae3241c640 1 --2- 172.21.15.49:0/3092244060 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae2c1024b0 0x7fae2c1a1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:22.195 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.192+0000 7fae3241c640 1 --2- 172.21.15.49:0/3092244060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae2c101af0 0x7fae2c19a420 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:22.195 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.192+0000 7fae3241c640 1 --2- 172.21.15.49:0/3092244060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae2c100900 0x7fae2c199ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:22.195 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.192+0000 7fae3241c640 1 -- 172.21.15.49:0/3092244060 >> 172.21.15.49:0/3092244060 conn(0x7fae2c0fbe70 msgr2=0x7fae2c109700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:22.195 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.192+0000 7fae3241c640 1 -- 172.21.15.49:0/3092244060 shutdown_connections 2024-06-03T00:03:22.195 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:22.192+0000 7fae3241c640 1 -- 172.21.15.49:0/3092244060 wait complete. 2024-06-03T00:03:22.740 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-03T00:03:22.741 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-03T00:03:23.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:23 smithi107 ceph-mon[37048]: pgmap v483: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 61 MiB/s rd, 73 MiB/s wr, 563 op/s 2024-06-03T00:03:23.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:23 smithi057 ceph-mon[36457]: pgmap v483: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 61 MiB/s rd, 73 MiB/s wr, 563 op/s 2024-06-03T00:03:23.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:23 smithi049 ceph-mon[32302]: pgmap v483: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 61 MiB/s rd, 73 MiB/s wr, 563 op/s 2024-06-03T00:03:23.720 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:03:24.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.489+0000 7f463dfe8700 1 -- 172.21.15.49:0/3113048322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4638101380 msgr2=0x7f4638101800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:24.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.489+0000 7f463dfe8700 1 --2- 172.21.15.49:0/3113048322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4638101380 0x7f4638101800 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f4620009990 tx=0x7f4620009ca0 comp rx=0 tx=0).stop 2024-06-03T00:03:24.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.489+0000 7f463dfe8700 1 -- 172.21.15.49:0/3113048322 shutdown_connections 2024-06-03T00:03:24.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.489+0000 7f463dfe8700 1 --2- 172.21.15.49:0/3113048322 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4638101d40 0x7f463810e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:24.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.489+0000 7f463dfe8700 1 --2- 172.21.15.49:0/3113048322 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46381073f0 0x7f46381077d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:24.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.489+0000 7f463dfe8700 1 --2- 172.21.15.49:0/3113048322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4638101380 0x7f4638101800 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:24.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.489+0000 7f463dfe8700 1 -- 172.21.15.49:0/3113048322 >> 172.21.15.49:0/3113048322 conn(0x7f4638078300 msgr2=0x7f4638078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:24.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.489+0000 7f463dfe8700 1 -- 172.21.15.49:0/3113048322 shutdown_connections 2024-06-03T00:03:24.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.489+0000 7f463dfe8700 1 -- 172.21.15.49:0/3113048322 wait complete. 2024-06-03T00:03:24.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.490+0000 7f463dfe8700 1 Processor -- start 2024-06-03T00:03:24.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.490+0000 7f463dfe8700 1 -- start start 2024-06-03T00:03:24.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.490+0000 7f463dfe8700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4638101380 0x7f4638199a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:24.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.490+0000 7f463dfe8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4638101d40 0x7f4638199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:24.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.490+0000 7f463dfe8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46381073f0 0x7f46381a4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:24.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.490+0000 7f463dfe8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4638111690 con 0x7f4638101d40 2024-06-03T00:03:24.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.490+0000 7f463dfe8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f4638111510 con 0x7f46381073f0 2024-06-03T00:03:24.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.490+0000 7f463dfe8700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4638111810 con 0x7f4638101380 2024-06-03T00:03:24.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.491+0000 7f46377fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4638101380 0x7f4638199a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:24.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.491+0000 7f46377fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4638101380 0x7f4638199a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:41796/0 (socket says 172.21.15.49:41796) 2024-06-03T00:03:24.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.491+0000 7f46377fe700 1 -- 172.21.15.49:0/1808840296 learned_addr learned my addr 172.21.15.49:0/1808840296 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:24.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.491+0000 7f462effd700 1 --2- 172.21.15.49:0/1808840296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4638101d40 0x7f4638199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:24.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.491+0000 7f4637fff700 1 --2- 172.21.15.49:0/1808840296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46381073f0 0x7f46381a4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:24.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.491+0000 7f46377fe700 1 -- 172.21.15.49:0/1808840296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46381073f0 msgr2=0x7f46381a4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:24.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.491+0000 7f46377fe700 1 --2- 172.21.15.49:0/1808840296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46381073f0 0x7f46381a4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:24.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.491+0000 7f46377fe700 1 -- 172.21.15.49:0/1808840296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4638101d40 msgr2=0x7f4638199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:24.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.491+0000 7f46377fe700 1 --2- 172.21.15.49:0/1808840296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4638101d40 0x7f4638199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:24.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.491+0000 7f46377fe700 1 -- 172.21.15.49:0/1808840296 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46381a5030 con 0x7f4638101380 2024-06-03T00:03:24.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.491+0000 7f46377fe700 1 --2- 172.21.15.49:0/1808840296 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4638101380 0x7f4638199a70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4628007e20 tx=0x7f462800a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:24.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.491+0000 7f46357fa700 1 -- 172.21.15.49:0/1808840296 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4628016020 con 0x7f4638101380 2024-06-03T00:03:24.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.491+0000 7f463dfe8700 1 -- 172.21.15.49:0/1808840296 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46381a5260 con 0x7f4638101380 2024-06-03T00:03:24.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.491+0000 7f46357fa700 1 -- 172.21.15.49:0/1808840296 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f462800ad40 con 0x7f4638101380 2024-06-03T00:03:24.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.491+0000 7f46357fa700 1 -- 172.21.15.49:0/1808840296 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4628011700 con 0x7f4638101380 2024-06-03T00:03:24.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.492+0000 7f463dfe8700 1 -- 172.21.15.49:0/1808840296 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46381a57c0 con 0x7f4638101380 2024-06-03T00:03:24.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.494+0000 7f46357fa700 1 -- 172.21.15.49:0/1808840296 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4628019020 con 0x7f4638101380 2024-06-03T00:03:24.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.495+0000 7f46357fa700 1 --2- 172.21.15.49:0/1808840296 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f46240a2c20 0x7f46240a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:24.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.495+0000 7f462effd700 1 --2- 172.21.15.49:0/1808840296 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f46240a2c20 0x7f46240a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:24.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.495+0000 7f46357fa700 1 -- 172.21.15.49:0/1808840296 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f46280cecd0 con 0x7f4638101380 2024-06-03T00:03:24.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.495+0000 7f464886bb80 1 Processor -- start 2024-06-03T00:03:24.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.495+0000 7f462effd700 1 --2- 172.21.15.49:0/1808840296 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f46240a2c20 0x7f46240a50e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f462000b2e0 tx=0x7f4620005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:24.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.495+0000 7f464886bb80 1 -- start start 2024-06-03T00:03:24.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.495+0000 7f464886bb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557776b51500 0x557776b518e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:24.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.496+0000 7f464886bb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557776b51e20 0x557776b4b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:24.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.496+0000 7f464886bb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557776b4bc50 0x557776b4c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:24.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.496+0000 7f464886bb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x557776a3e060 con 0x557776b51500 2024-06-03T00:03:24.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.496+0000 7f464886bb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x557776a9c950 con 0x557776b4bc50 2024-06-03T00:03:24.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.496+0000 7f464886bb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x557776a04560 con 0x557776b51e20 2024-06-03T00:03:24.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.496+0000 7f46377fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557776b51500 0x557776b518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:24.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.496+0000 7f46377fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557776b51500 0x557776b518e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41564/0 (socket says 172.21.15.49:41564) 2024-06-03T00:03:24.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.496+0000 7f46377fe700 1 -- 172.21.15.49:0/3922359963 learned_addr learned my addr 172.21.15.49:0/3922359963 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:24.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.496+0000 7f462effd700 1 --2- 172.21.15.49:0/3922359963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557776b51e20 0x557776b4b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:24.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.496+0000 7f46377fe700 1 -- 172.21.15.49:0/3922359963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557776b51e20 msgr2=0x557776b4b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:24.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.496+0000 7f46377fe700 1 --2- 172.21.15.49:0/3922359963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557776b51e20 0x557776b4b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:24.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.496+0000 7f46377fe700 1 -- 172.21.15.49:0/3922359963 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557776b4bc50 msgr2=0x557776b4c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:24.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.496+0000 7f46377fe700 1 --2- 172.21.15.49:0/3922359963 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557776b4bc50 0x557776b4c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:24.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.496+0000 7f46377fe700 1 -- 172.21.15.49:0/3922359963 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577769eb9d0 con 0x557776b51500 2024-06-03T00:03:24.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.496+0000 7f46377fe700 1 --2- 172.21.15.49:0/3922359963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557776b51500 0x557776b518e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f4628007fd0 tx=0x7f462809ae90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4587271e4243122 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:24.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.496+0000 7f462dffb700 1 -- 172.21.15.49:0/3922359963 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46280b4070 con 0x557776b51500 2024-06-03T00:03:24.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.496+0000 7f462dffb700 1 -- 172.21.15.49:0/3922359963 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f462809b530 con 0x557776b51500 2024-06-03T00:03:24.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.496+0000 7f462dffb700 1 -- 172.21.15.49:0/3922359963 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46280bb050 con 0x557776b51500 2024-06-03T00:03:24.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.497+0000 7f464886bb80 1 -- 172.21.15.49:0/3922359963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557776b51500 msgr2=0x557776b518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:24.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.497+0000 7f464886bb80 1 --2- 172.21.15.49:0/3922359963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557776b51500 0x557776b518e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f4628007fd0 tx=0x7f462809ae90 comp rx=0 tx=0).stop 2024-06-03T00:03:24.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.497+0000 7f464886bb80 1 -- 172.21.15.49:0/3922359963 shutdown_connections 2024-06-03T00:03:24.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.497+0000 7f464886bb80 1 --2- 172.21.15.49:0/3922359963 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557776b4bc50 0x557776b4c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:24.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.497+0000 7f464886bb80 1 --2- 172.21.15.49:0/3922359963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557776b51500 0x557776b518e0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:24.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.497+0000 7f464886bb80 1 --2- 172.21.15.49:0/3922359963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557776b51e20 0x557776b4b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:24.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.497+0000 7f464886bb80 1 -- 172.21.15.49:0/3922359963 >> 172.21.15.49:0/3922359963 conn(0x557776a78180 msgr2=0x557776b46a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:24.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.497+0000 7f464886bb80 1 -- 172.21.15.49:0/3922359963 shutdown_connections 2024-06-03T00:03:24.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.497+0000 7f464886bb80 1 -- 172.21.15.49:0/3922359963 wait complete. 2024-06-03T00:03:24.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.497+0000 7f464886bb80 1 -- start start 2024-06-03T00:03:24.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.498+0000 7f464886bb80 1 Processor -- start 2024-06-03T00:03:24.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.498+0000 7f464886bb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557776b4bc50 0x557776b57bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:24.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.498+0000 7f464886bb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557776b51500 0x557776b54ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:24.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.498+0000 7f464886bb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557776b51e20 0x557776b55430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:24.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.498+0000 7f464886bb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x557776a3d0c0 con 0x557776b4bc50 2024-06-03T00:03:24.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.498+0000 7f464886bb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x557776a98910 con 0x557776b51e20 2024-06-03T00:03:24.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.498+0000 7f464886bb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x557776b586b0 con 0x557776b51500 2024-06-03T00:03:24.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.498+0000 7f464886bb80 10 client.0 _ll_register_callbacks cb 0x557776a326b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:03:24.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.498+0000 7f46377fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557776b4bc50 0x557776b57bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:24.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.498+0000 7f46377fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557776b4bc50 0x557776b57bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41566/0 (socket says 172.21.15.49:41566) 2024-06-03T00:03:24.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.498+0000 7f46377fe700 1 -- 172.21.15.49:0/3259511785 learned_addr learned my addr 172.21.15.49:0/3259511785 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:24.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.498+0000 7f4637fff700 1 --2- 172.21.15.49:0/3259511785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557776b51e20 0x557776b55430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:24.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.498+0000 7f462effd700 1 --2- 172.21.15.49:0/3259511785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557776b51500 0x557776b54ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:24.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.498+0000 7f46377fe700 1 -- 172.21.15.49:0/3259511785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557776b51500 msgr2=0x557776b54ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:24.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.498+0000 7f46377fe700 1 --2- 172.21.15.49:0/3259511785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557776b51500 0x557776b54ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:24.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.498+0000 7f46377fe700 1 -- 172.21.15.49:0/3259511785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557776b51e20 msgr2=0x557776b55430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:24.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.498+0000 7f46377fe700 1 --2- 172.21.15.49:0/3259511785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557776b51e20 0x557776b55430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:24.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.498+0000 7f46377fe700 1 -- 172.21.15.49:0/3259511785 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557776a62850 con 0x557776b4bc50 2024-06-03T00:03:24.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.499+0000 7f46377fe700 1 --2- 172.21.15.49:0/3259511785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557776b4bc50 0x557776b57bf0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f4628014000 tx=0x7f462809f950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17064ee2e2314fe3 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:24.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.499+0000 7f4616ffd700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:03:24.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.499+0000 7f4616ffd700 1 -- 172.21.15.49:0/3259511785 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46280b8020 con 0x557776b4bc50 2024-06-03T00:03:24.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.499+0000 7f4616ffd700 1 -- 172.21.15.49:0/3259511785 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f4628021d50 con 0x557776b4bc50 2024-06-03T00:03:24.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.499+0000 7f464886bb80 1 -- 172.21.15.49:0/3259511785 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f462809b530 con 0x557776b4bc50 2024-06-03T00:03:24.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.499+0000 7f4616ffd700 1 -- 172.21.15.49:0/3259511785 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f46280b4040 con 0x557776b4bc50 2024-06-03T00:03:24.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.499+0000 7f464886bb80 10 client.16044 fetch_fsmap learned FSMap version 31 2024-06-03T00:03:24.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.499+0000 7f464886bb80 1 -- 172.21.15.49:0/3259511785 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x557776b62f10 con 0x557776b4bc50 2024-06-03T00:03:24.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.499+0000 7f4616ffd700 1 -- 172.21.15.49:0/3259511785 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f462809b530 con 0x557776b4bc50 2024-06-03T00:03:24.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.499+0000 7f4616ffd700 1 -- 172.21.15.49:0/3259511785 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f4628023060 con 0x557776b4bc50 2024-06-03T00:03:24.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.499+0000 7f464886bb80 10 client.16044 fetch_fsmap finished waiting for FSMap version 31 2024-06-03T00:03:24.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.499+0000 7f464886bb80 10 client.16044 resolve_mds: validated gid 24487 aka daemon mds.i 2024-06-03T00:03:24.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.499+0000 7f464886bb80 20 client.16044 populate_metadata read hostname 'smithi049' 2024-06-03T00:03:24.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.499+0000 7f464886bb80 1 --2- 172.21.15.49:0/3259511785 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x557776b653e0 0x557776b677d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:24.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.499+0000 7f464886bb80 4 client.16044 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:03:24.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.499+0000 7f464886bb80 1 -- 172.21.15.49:0/3259511785 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557776aa9e50 con 0x557776b653e0 2024-06-03T00:03:24.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.500+0000 7f462effd700 1 --2- 172.21.15.49:0/3259511785 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x557776b653e0 0x557776b677d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:24.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.500+0000 7f462effd700 1 --2- 172.21.15.49:0/3259511785 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x557776b653e0 0x557776b677d0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7835613c106edce server_cookie=50b69367c2362d74 in_seq=0 out_seq=0 2024-06-03T00:03:24.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.500+0000 7f4616ffd700 10 client.16044 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:24.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.501+0000 7f4616ffd700 1 -- 172.21.15.49:0/3259511785 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x557776aa9e50 con 0x557776b653e0 2024-06-03T00:03:24.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.501+0000 7f4616ffd700 10 client.16044 handle_command_reply: tid=0 2024-06-03T00:03:24.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.501+0000 7f464886bb80 1 client.16044 shutdown 2024-06-03T00:03:24.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.501+0000 7f464886bb80 1 -- 172.21.15.49:0/3259511785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557776b4bc50 msgr2=0x557776b57bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:24.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.501+0000 7f464886bb80 1 --2- 172.21.15.49:0/3259511785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557776b4bc50 0x557776b57bf0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f4628014000 tx=0x7f462809f950 comp rx=0 tx=0).stop 2024-06-03T00:03:24.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.501+0000 7f464886bb80 1 -- 172.21.15.49:0/3259511785 shutdown_connections 2024-06-03T00:03:24.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.501+0000 7f464886bb80 1 --2- 172.21.15.49:0/3259511785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557776b51e20 0x557776b55430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:24.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.501+0000 7f464886bb80 1 --2- 172.21.15.49:0/3259511785 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x557776b653e0 0x557776b677d0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:24.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.501+0000 7f464886bb80 1 --2- 172.21.15.49:0/3259511785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557776b4bc50 0x557776b57bf0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:24.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.501+0000 7f464886bb80 1 --2- 172.21.15.49:0/3259511785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557776b51500 0x557776b54ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:24.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.501+0000 7f464886bb80 1 -- 172.21.15.49:0/3259511785 >> 172.21.15.49:0/3259511785 conn(0x557776a78180 msgr2=0x557776b45bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:24.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.501+0000 7f4616ffd700 0 client.16044 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:24.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.501+0000 7f464886bb80 1 -- 172.21.15.49:0/3259511785 shutdown_connections 2024-06-03T00:03:24.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.501+0000 7f464886bb80 1 -- 172.21.15.49:0/3259511785 wait complete. 2024-06-03T00:03:24.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.501+0000 7f464886bb80 20 client.16044 trim_cache size 0 max 16384 2024-06-03T00:03:24.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.522+0000 7f464886bb80 1 Processor -- start 2024-06-03T00:03:24.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.522+0000 7f464886bb80 1 -- start start 2024-06-03T00:03:24.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.522+0000 7f464886bb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557776b4bc50 0x557776b57730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:24.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.522+0000 7f464886bb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557776b51500 0x557776b60f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:24.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.522+0000 7f464886bb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557776b51e20 0x557776b61470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:24.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.522+0000 7f464886bb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f46381acc10 con 0x557776b51e20 2024-06-03T00:03:24.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.522+0000 7f464886bb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f46381ae810 con 0x557776b51500 2024-06-03T00:03:24.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.522+0000 7f464886bb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f46381ad2e0 con 0x557776b4bc50 2024-06-03T00:03:24.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.523+0000 7f4637fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557776b51e20 0x557776b61470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:24.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.523+0000 7f46377fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557776b4bc50 0x557776b57730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:24.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.523+0000 7f4637fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557776b51e20 0x557776b61470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41578/0 (socket says 172.21.15.49:41578) 2024-06-03T00:03:24.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.523+0000 7f4637fff700 1 -- 172.21.15.49:0/3180448167 learned_addr learned my addr 172.21.15.49:0/3180448167 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:24.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.523+0000 7f462effd700 1 --2- 172.21.15.49:0/3180448167 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557776b51500 0x557776b60f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:24.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.523+0000 7f46377fe700 1 -- 172.21.15.49:0/3180448167 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557776b51500 msgr2=0x557776b60f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:24.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.523+0000 7f46377fe700 1 --2- 172.21.15.49:0/3180448167 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557776b51500 0x557776b60f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:24.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.523+0000 7f46377fe700 1 -- 172.21.15.49:0/3180448167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557776b51e20 msgr2=0x557776b61470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:24.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.523+0000 7f46377fe700 1 --2- 172.21.15.49:0/3180448167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557776b51e20 0x557776b61470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:24.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.523+0000 7f46377fe700 1 -- 172.21.15.49:0/3180448167 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557776b47d90 con 0x557776b4bc50 2024-06-03T00:03:24.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.523+0000 7f46377fe700 1 --2- 172.21.15.49:0/3180448167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557776b4bc50 0x557776b57730 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4628007d00 tx=0x7f4628012d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c7af9a3294b32a1 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:24.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.523+0000 7f462d7fa700 1 -- 172.21.15.49:0/3180448167 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46280b8070 con 0x557776b4bc50 2024-06-03T00:03:24.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.523+0000 7f462d7fa700 1 -- 172.21.15.49:0/3180448167 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4628021d50 con 0x557776b4bc50 2024-06-03T00:03:24.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.523+0000 7f462d7fa700 1 -- 172.21.15.49:0/3180448167 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46280bb040 con 0x557776b4bc50 2024-06-03T00:03:24.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.524+0000 7f464886bb80 1 -- 172.21.15.49:0/3180448167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557776b4bc50 msgr2=0x557776b57730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:24.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.524+0000 7f464886bb80 1 --2- 172.21.15.49:0/3180448167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557776b4bc50 0x557776b57730 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4628007d00 tx=0x7f4628012d60 comp rx=0 tx=0).stop 2024-06-03T00:03:24.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.524+0000 7f464886bb80 1 -- 172.21.15.49:0/3180448167 shutdown_connections 2024-06-03T00:03:24.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.524+0000 7f464886bb80 1 --2- 172.21.15.49:0/3180448167 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557776b51e20 0x557776b61470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:24.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.524+0000 7f464886bb80 1 --2- 172.21.15.49:0/3180448167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557776b4bc50 0x557776b57730 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:24.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.524+0000 7f464886bb80 1 --2- 172.21.15.49:0/3180448167 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557776b51500 0x557776b60f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:24.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.524+0000 7f464886bb80 1 -- 172.21.15.49:0/3180448167 >> 172.21.15.49:0/3180448167 conn(0x557776a78180 msgr2=0x557776b60820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:24.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.524+0000 7f464886bb80 1 -- 172.21.15.49:0/3180448167 shutdown_connections 2024-06-03T00:03:24.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.524+0000 7f464886bb80 1 -- 172.21.15.49:0/3180448167 wait complete. 2024-06-03T00:03:24.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.524+0000 7f464886bb80 1 -- start start 2024-06-03T00:03:24.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.525+0000 7f464886bb80 1 Processor -- start 2024-06-03T00:03:24.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.525+0000 7f464886bb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557776b4bc50 0x557776b5bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:24.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.525+0000 7f464886bb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557776b51500 0x557776b5c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:24.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.525+0000 7f464886bb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557776b51e20 0x557776bcede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:24.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.525+0000 7f464886bb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f46381ae080 con 0x557776b51500 2024-06-03T00:03:24.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.525+0000 7f464886bb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f46381ad9b0 con 0x557776b4bc50 2024-06-03T00:03:24.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.525+0000 7f464886bb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f46381aab90 con 0x557776b51e20 2024-06-03T00:03:24.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.525+0000 7f464886bb80 10 client.0 _ll_register_callbacks cb 0x557776a326b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:03:24.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.525+0000 7f462effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557776b51500 0x557776b5c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:24.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.525+0000 7f46377fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557776b4bc50 0x557776b5bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:24.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.525+0000 7f462effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557776b51500 0x557776b5c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41588/0 (socket says 172.21.15.49:41588) 2024-06-03T00:03:24.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.525+0000 7f462effd700 1 -- 172.21.15.49:0/2147005270 learned_addr learned my addr 172.21.15.49:0/2147005270 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:24.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.525+0000 7f4637fff700 1 --2- 172.21.15.49:0/2147005270 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557776b51e20 0x557776bcede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:24.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.525+0000 7f462effd700 1 -- 172.21.15.49:0/2147005270 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557776b51e20 msgr2=0x557776bcede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:24.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.525+0000 7f462effd700 1 --2- 172.21.15.49:0/2147005270 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557776b51e20 0x557776bcede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:24.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.525+0000 7f462effd700 1 -- 172.21.15.49:0/2147005270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557776b4bc50 msgr2=0x557776b5bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:24.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.525+0000 7f462effd700 1 --2- 172.21.15.49:0/2147005270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557776b4bc50 0x557776b5bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:24.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.525+0000 7f462effd700 1 -- 172.21.15.49:0/2147005270 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557776bcf3d0 con 0x557776b51500 2024-06-03T00:03:24.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.525+0000 7f46377fe700 1 --2- 172.21.15.49:0/2147005270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557776b4bc50 0x557776b5bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:24.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.525+0000 7f462effd700 1 --2- 172.21.15.49:0/2147005270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557776b51500 0x557776b5c470 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f4620009990 tx=0x7f462001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b73bb89e8a1a97 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:24.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.525+0000 7f4616ffd700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:03:24.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.526+0000 7f4616ffd700 1 -- 172.21.15.49:0/2147005270 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4620003a90 con 0x557776b51500 2024-06-03T00:03:24.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.526+0000 7f4616ffd700 1 -- 172.21.15.49:0/2147005270 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f4620003c30 con 0x557776b51500 2024-06-03T00:03:24.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.526+0000 7f464886bb80 1 -- 172.21.15.49:0/2147005270 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4628021d50 con 0x557776b51500 2024-06-03T00:03:24.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.526+0000 7f4616ffd700 1 -- 172.21.15.49:0/2147005270 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f4620003e30 con 0x557776b51500 2024-06-03T00:03:24.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.526+0000 7f464886bb80 10 client.16050 fetch_fsmap learned FSMap version 31 2024-06-03T00:03:24.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.526+0000 7f464886bb80 1 -- 172.21.15.49:0/2147005270 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x557776bd0780 con 0x557776b51500 2024-06-03T00:03:24.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.526+0000 7f4616ffd700 1 -- 172.21.15.49:0/2147005270 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4628021d50 con 0x557776b51500 2024-06-03T00:03:24.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.526+0000 7f4616ffd700 1 -- 172.21.15.49:0/2147005270 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f4620038070 con 0x557776b51500 2024-06-03T00:03:24.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.526+0000 7f464886bb80 10 client.16050 fetch_fsmap finished waiting for FSMap version 31 2024-06-03T00:03:24.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.526+0000 7f464886bb80 10 client.16050 resolve_mds: validated gid 24487 aka daemon mds.i 2024-06-03T00:03:24.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.526+0000 7f464886bb80 20 client.16050 populate_metadata read hostname 'smithi049' 2024-06-03T00:03:24.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.526+0000 7f464886bb80 1 --2- 172.21.15.49:0/2147005270 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x557776bd0f30 0x557776bd3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:24.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.526+0000 7f464886bb80 4 client.16050 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f51fb796", "release": true, "await": true}] 2024-06-03T00:03:24.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.526+0000 7f464886bb80 1 -- 172.21.15.49:0/2147005270 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f51fb796", "release": true, "await": true}) -- 0x557776aa43d0 con 0x557776bd0f30 2024-06-03T00:03:24.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.527+0000 7f46377fe700 1 --2- 172.21.15.49:0/2147005270 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x557776bd0f30 0x557776bd3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:24.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.527+0000 7f46377fe700 1 --2- 172.21.15.49:0/2147005270 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x557776bd0f30 0x557776bd3350 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bd1d2d4c98c09f server_cookie=ca61f9b9a31f7c34 in_seq=0 out_seq=0 2024-06-03T00:03:24.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.527+0000 7f4616ffd700 10 client.16050 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:24.649 INFO:tasks.workunit.client.0.smithi049.stdout:5/690: creat d3/d9/d20/d4c/d9d/fd8 x:0 0 0 2024-06-03T00:03:24.667 INFO:tasks.workunit.client.0.smithi049.stdout:3/612: rename d2/d1a/d34/dd5/f91 to d2/d1a/d34/dd5/d75/d94/fd9 0 2024-06-03T00:03:24.667 INFO:tasks.workunit.client.0.smithi049.stdout:3/613: fdatasync d2/d1a/d34/f62 0 2024-06-03T00:03:24.670 INFO:tasks.workunit.client.0.smithi049.stdout:3/614: rmdir d2/d14/d22/d42/d68/d80 39 2024-06-03T00:03:24.671 INFO:tasks.workunit.client.0.smithi049.stdout:3/615: dread - d2/d1a/f66 zero size 2024-06-03T00:03:24.675 INFO:tasks.workunit.client.0.smithi049.stdout:5/691: dread d3/d5/da/f2b [0,4194304] 0 2024-06-03T00:03:24.679 INFO:tasks.workunit.client.0.smithi049.stdout:3/616: mkdir d2/d14/d44/d52/d4c/d4b/daf/dda 0 2024-06-03T00:03:24.681 INFO:tasks.workunit.client.0.smithi049.stdout:5/692: mknod d3/d5/d2d/d4b/d51/cd9 0 2024-06-03T00:03:24.683 INFO:tasks.workunit.client.0.smithi049.stdout:5/693: fsync d3/d9/d20/d4c/d5a/d6f/f8b 0 2024-06-03T00:03:24.693 INFO:tasks.workunit.client.0.smithi049.stdout:0/624: write d6/d59/fb6 [1040794,28576] 0 2024-06-03T00:03:24.695 INFO:tasks.workunit.client.0.smithi049.stdout:5/694: write d3/f66 [707762,124407] 0 2024-06-03T00:03:24.696 INFO:tasks.workunit.client.0.smithi049.stdout:5/695: fsync d3/d7d/fb2 0 2024-06-03T00:03:24.696 INFO:tasks.workunit.client.0.smithi049.stdout:7/719: creat d3/d14/d6e/f103 x:0 0 0 2024-06-03T00:03:24.696 INFO:tasks.workunit.client.0.smithi049.stdout:5/696: dread - d3/d9/d20/fa8 zero size 2024-06-03T00:03:24.699 INFO:tasks.workunit.client.0.smithi049.stdout:5/697: unlink d3/d9/f99 0 2024-06-03T00:03:24.701 INFO:tasks.workunit.client.0.smithi049.stdout:5/698: dread d3/d9/d20/f3d [0,4194304] 0 2024-06-03T00:03:24.701 INFO:tasks.workunit.client.0.smithi049.stdout:3/617: dwrite d2/f15 [0,4194304] 0 2024-06-03T00:03:24.704 INFO:tasks.workunit.client.0.smithi049.stdout:5/699: write d3/d5/da/d55/d14/f47 [5634702,125912] 0 2024-06-03T00:03:24.706 INFO:tasks.workunit.client.0.smithi049.stdout:3/618: creat d2/d1a/d51/fdb x:0 0 0 2024-06-03T00:03:24.713 INFO:tasks.workunit.client.0.smithi049.stdout:3/619: rename d2/d1a/d76/dc6 to d2/d1a/d34/dd5/d75/ddc 0 2024-06-03T00:03:24.715 INFO:tasks.workunit.client.0.smithi049.stdout:3/620: mknod d2/d14/d44/d52/d4c/cdd 0 2024-06-03T00:03:24.715 INFO:tasks.workunit.client.0.smithi049.stdout:3/621: chown d2/d14/d44/d52 1926868561 1 2024-06-03T00:03:24.717 INFO:tasks.workunit.client.0.smithi049.stdout:3/622: creat d2/d1a/d76/fde x:0 0 0 2024-06-03T00:03:24.718 INFO:tasks.workunit.client.0.smithi049.stdout:3/623: creat d2/d14/d44/fdf x:0 0 0 2024-06-03T00:03:24.724 INFO:tasks.workunit.client.0.smithi049.stdout:6/848: symlink d2/d3/d17/d57/d6e/d88/dcc/df8/l11d 0 2024-06-03T00:03:24.732 INFO:tasks.workunit.client.0.smithi049.stdout:5/700: dwrite d3/d9/f13 [0,4194304] 0 2024-06-03T00:03:24.734 INFO:tasks.workunit.client.0.smithi049.stdout:5/701: stat d3/d5/d2d/d4b/d62/f6d 0 2024-06-03T00:03:24.737 INFO:tasks.workunit.client.0.smithi049.stdout:3/624: dwrite d2/d1a/d34/dd5/d75/d94/fc1 [0,4194304] 0 2024-06-03T00:03:24.737 INFO:tasks.workunit.client.0.smithi049.stdout:3/625: write d2/d14/d22/d3a/d47/f92 [33337,52593] 0 2024-06-03T00:03:24.743 INFO:tasks.workunit.client.0.smithi049.stdout:6/849: chown d2/d3/d17/d57/d6e/d88/dcc/df8/ffc 464 1 2024-06-03T00:03:24.743 INFO:tasks.workunit.client.0.smithi049.stdout:3/626: mkdir d2/d14/d44/d52/d4c/d4b/dca/de0 0 2024-06-03T00:03:24.745 INFO:tasks.workunit.client.0.smithi049.stdout:0/625: mknod d6/d59/d93/cd2 0 2024-06-03T00:03:24.745 INFO:tasks.workunit.client.0.smithi049.stdout:3/627: creat d2/d14/d22/d42/d68/d80/fe1 x:0 0 0 2024-06-03T00:03:24.746 INFO:tasks.workunit.client.0.smithi049.stdout:3/628: write d2/d14/d44/d52/d4c/d4b/fb5 [265850,55326] 0 2024-06-03T00:03:24.748 INFO:tasks.workunit.client.0.smithi049.stdout:0/626: creat d6/d30/da3/fd3 x:0 0 0 2024-06-03T00:03:24.749 INFO:tasks.workunit.client.0.smithi049.stdout:7/720: symlink d3/dd8/d13/d54/daa/d92/l104 0 2024-06-03T00:03:24.749 INFO:tasks.workunit.client.0.smithi049.stdout:7/721: chown d3/dd8/d13/d54 125850259 1 2024-06-03T00:03:24.750 INFO:tasks.workunit.client.0.smithi049.stdout:0/627: readlink d6/l8d 0 2024-06-03T00:03:24.750 INFO:tasks.workunit.client.0.smithi049.stdout:7/722: write d3/d14/fde [668512,31944] 0 2024-06-03T00:03:24.750 INFO:tasks.workunit.client.0.smithi049.stdout:7/723: dread - d3/dd8/d13/d3c/d48/ff3 zero size 2024-06-03T00:03:24.751 INFO:tasks.workunit.client.0.smithi049.stdout:6/850: mkdir d2/d4d/d76/de4/d11e 0 2024-06-03T00:03:24.753 INFO:tasks.workunit.client.0.smithi049.stdout:6/851: chown d2/d4d/d76/c7b 1602767 1 2024-06-03T00:03:24.753 INFO:tasks.workunit.client.0.smithi049.stdout:0/628: dread - d6/d30/d32/dca/fa4 zero size 2024-06-03T00:03:24.757 INFO:tasks.workunit.client.0.smithi049.stdout:6/852: creat d2/d3/d17/d57/d6e/dd3/f11f x:0 0 0 2024-06-03T00:03:24.760 INFO:tasks.workunit.client.0.smithi049.stdout:5/702: write d3/d9/d20/f41 [2955766,7422] 0 2024-06-03T00:03:24.760 INFO:tasks.workunit.client.0.smithi049.stdout:0/629: mknod d6/d97/d4b/cd4 0 2024-06-03T00:03:24.760 INFO:tasks.workunit.client.0.smithi049.stdout:5/703: read - d3/d9/d20/d4c/fb8 zero size 2024-06-03T00:03:24.763 INFO:tasks.workunit.client.0.smithi049.stdout:0/630: fsync d6/d59/fb6 0 2024-06-03T00:03:24.763 INFO:tasks.workunit.client.0.smithi049.stdout:6/853: getdents d2/d3/d9/d23/d48/d53/d118 0 2024-06-03T00:03:24.767 INFO:tasks.workunit.client.0.smithi049.stdout:5/704: write d3/d9/d20/d4c/f6a [551454,62028] 0 2024-06-03T00:03:24.768 INFO:tasks.workunit.client.0.smithi049.stdout:3/629: dwrite d2/d1a/d34/f3b [0,4194304] 0 2024-06-03T00:03:24.770 INFO:tasks.workunit.client.0.smithi049.stdout:3/630: creat d2/d14/d22/d42/fe2 x:0 0 0 2024-06-03T00:03:24.773 INFO:tasks.workunit.client.0.smithi049.stdout:5/705: dread - d3/d5/d2d/d4b/d97/dbf/fc3 zero size 2024-06-03T00:03:24.776 INFO:tasks.workunit.client.0.smithi049.stdout:3/631: chown d2/d14/d44/d52/d4c/d4b/d58/fa9 1614869 1 2024-06-03T00:03:24.780 INFO:tasks.workunit.client.0.smithi049.stdout:3/632: dread d2/d14/d44/d52/d4c/d4b/f7f [0,4194304] 0 2024-06-03T00:03:24.780 INFO:tasks.workunit.client.0.smithi049.stdout:3/633: getdents d2/d14/d44/d52/d4c/d4b/daf/dda 0 2024-06-03T00:03:24.790 INFO:tasks.workunit.client.0.smithi049.stdout:3/634: unlink d2/d14/d22/d3a/d47/l49 0 2024-06-03T00:03:24.791 INFO:tasks.workunit.client.0.smithi049.stdout:8/628: rmdir d4/d27/d3c/d88/d48 39 2024-06-03T00:03:24.798 INFO:tasks.workunit.client.0.smithi049.stdout:0/631: dwrite d6/fc5 [0,4194304] 0 2024-06-03T00:03:24.798 INFO:tasks.workunit.client.0.smithi049.stdout:8/629: chown d4/d27/d3c/d88/d28/d52/d66/d53/d7e/fc4 65735 1 2024-06-03T00:03:24.799 INFO:tasks.workunit.client.0.smithi049.stdout:0/632: creat d6/d97/d4b/fd5 x:0 0 0 2024-06-03T00:03:24.801 INFO:tasks.workunit.client.0.smithi049.stdout:0/633: link d6/d59/d72/f85 d6/d97/fd6 0 2024-06-03T00:03:24.802 INFO:tasks.workunit.client.0.smithi049.stdout:5/706: dread d3/d5/da/f1d [0,4194304] 0 2024-06-03T00:03:24.804 INFO:tasks.workunit.client.0.smithi049.stdout:2/810: dwrite da/d43/f7e [0,4194304] 0 2024-06-03T00:03:24.804 INFO:tasks.workunit.client.0.smithi049.stdout:7/724: dwrite d3/dd8/d13/d4a/fb0 [0,4194304] 0 2024-06-03T00:03:24.804 INFO:tasks.workunit.client.0.smithi049.stdout:6/854: dwrite d2/d3/d9/d23/d48/f10a [0,4194304] 0 2024-06-03T00:03:24.805 INFO:tasks.workunit.client.0.smithi049.stdout:3/635: read d2/d14/d44/d52/d4c/d4b/d58/f8d [1818723,13340] 0 2024-06-03T00:03:24.805 INFO:tasks.workunit.client.0.smithi049.stdout:0/634: dread d6/d59/d72/fbe [0,4194304] 0 2024-06-03T00:03:24.809 INFO:tasks.workunit.client.0.smithi049.stdout:4/772: write d4/d3f/d14/fd8 [820863,32083] 0 2024-06-03T00:03:24.811 INFO:tasks.workunit.client.0.smithi049.stdout:0/635: mkdir d6/dd7 0 2024-06-03T00:03:24.812 INFO:tasks.workunit.client.0.smithi049.stdout:7/725: mknod d3/dd8/d13/d54/d96/c105 0 2024-06-03T00:03:24.814 INFO:tasks.workunit.client.0.smithi049.stdout:5/707: write d3/d9/d20/f2e [1717638,20980] 0 2024-06-03T00:03:24.814 INFO:tasks.workunit.client.0.smithi049.stdout:8/630: write d4/d27/d3c/d88/d28/d45/f49 [2373771,36213] 0 2024-06-03T00:03:24.815 INFO:tasks.workunit.client.0.smithi049.stdout:7/726: chown d3/dd8/d13/d54/d96/cb4 1627170 1 2024-06-03T00:03:24.816 INFO:tasks.workunit.client.0.smithi049.stdout:6/855: symlink d2/d3b/d103/l120 0 2024-06-03T00:03:24.817 INFO:tasks.workunit.client.0.smithi049.stdout:6/856: stat d2/d4d/d76/l78 0 2024-06-03T00:03:24.817 INFO:tasks.workunit.client.0.smithi049.stdout:5/708: dread d3/d5/da/d55/d14/d16/f34 [0,4194304] 0 2024-06-03T00:03:24.818 INFO:tasks.workunit.client.0.smithi049.stdout:6/857: chown d2/d3/d9/d23/d29/l7c 14197372 1 2024-06-03T00:03:24.819 INFO:tasks.workunit.client.0.smithi049.stdout:5/709: creat d3/d5/fda x:0 0 0 2024-06-03T00:03:24.819 INFO:tasks.workunit.client.0.smithi049.stdout:5/710: read d3/d5/da/f2b [1621993,127528] 0 2024-06-03T00:03:24.819 INFO:tasks.workunit.client.0.smithi049.stdout:6/858: write d2/d3/d9/d23/d48/ff1 [252459,60946] 0 2024-06-03T00:03:24.821 INFO:tasks.workunit.client.0.smithi049.stdout:6/859: rename d2/d4d/f58 to d2/d3/d17/f121 0 2024-06-03T00:03:24.822 INFO:tasks.workunit.client.0.smithi049.stdout:8/631: symlink d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/dab/lcc 0 2024-06-03T00:03:24.824 INFO:tasks.workunit.client.0.smithi049.stdout:5/711: symlink d3/d9/d20/d4c/d5a/d6f/ldb 0 2024-06-03T00:03:24.824 INFO:tasks.workunit.client.0.smithi049.stdout:6/860: creat d2/d3/d9/d23/d48/d53/d116/f122 x:0 0 0 2024-06-03T00:03:24.825 INFO:tasks.workunit.client.0.smithi049.stdout:6/861: readlink d2/d3/d9/d23/l3f 0 2024-06-03T00:03:24.826 INFO:tasks.workunit.client.0.smithi049.stdout:8/632: creat d4/d27/d3c/d43/fcd x:0 0 0 2024-06-03T00:03:24.826 INFO:tasks.workunit.client.0.smithi049.stdout:0/636: dread d6/d29/f33 [0,4194304] 0 2024-06-03T00:03:24.827 INFO:tasks.workunit.client.0.smithi049.stdout:5/712: symlink d3/d5/da/d55/d14/ldc 0 2024-06-03T00:03:24.828 INFO:tasks.workunit.client.0.smithi049.stdout:8/633: creat d4/d27/d3c/d88/d28/d52/fce x:0 0 0 2024-06-03T00:03:24.828 INFO:tasks.workunit.client.0.smithi049.stdout:7/727: write d3/d14/d6e/fe2 [1373762,115365] 0 2024-06-03T00:03:24.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.829+0000 7f4616ffd700 1 -- 172.21.15.49:0/2147005270 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x557776aa43d0 con 0x557776bd0f30 2024-06-03T00:03:24.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.829+0000 7f4616ffd700 10 client.16050 handle_command_reply: tid=0 2024-06-03T00:03:24.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.829+0000 7f464886bb80 1 client.16050 shutdown 2024-06-03T00:03:24.831 INFO:tasks.workunit.client.0.smithi049.stdout:0/637: unlink d6/d59/d72/d94/cc7 0 2024-06-03T00:03:24.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.830+0000 7f464886bb80 1 -- 172.21.15.49:0/2147005270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557776b51500 msgr2=0x557776b5c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:24.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.830+0000 7f464886bb80 1 --2- 172.21.15.49:0/2147005270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557776b51500 0x557776b5c470 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f4620009990 tx=0x7f462001f000 comp rx=0 tx=0).stop 2024-06-03T00:03:24.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.830+0000 7f464886bb80 1 -- 172.21.15.49:0/2147005270 shutdown_connections 2024-06-03T00:03:24.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.830+0000 7f464886bb80 1 --2- 172.21.15.49:0/2147005270 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557776b51e20 0x557776bcede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:24.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.830+0000 7f464886bb80 1 --2- 172.21.15.49:0/2147005270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557776b4bc50 0x557776b5bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:24.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.830+0000 7f464886bb80 1 --2- 172.21.15.49:0/2147005270 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x557776bd0f30 0x557776bd3350 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:24.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.830+0000 7f464886bb80 1 --2- 172.21.15.49:0/2147005270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557776b51500 0x557776b5c470 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:24.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.830+0000 7f4616ffd700 0 client.16050 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:24.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.830+0000 7f464886bb80 1 -- 172.21.15.49:0/2147005270 >> 172.21.15.49:0/2147005270 conn(0x557776a78180 msgr2=0x557776b610b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:24.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.830+0000 7f464886bb80 1 -- 172.21.15.49:0/2147005270 shutdown_connections 2024-06-03T00:03:24.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.830+0000 7f464886bb80 1 -- 172.21.15.49:0/2147005270 wait complete. 2024-06-03T00:03:24.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.830+0000 7f464886bb80 20 client.16050 trim_cache size 0 max 16384 2024-06-03T00:03:24.833 INFO:tasks.workunit.client.0.smithi049.stdout:5/713: symlink d3/daf/ldd 0 2024-06-03T00:03:24.833 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:03:24.833 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 31, 2024-06-03T00:03:24.833 INFO:teuthology.orchestra.run.smithi049.stdout: "leader": 24487, 2024-06-03T00:03:24.833 INFO:teuthology.orchestra.run.smithi049.stdout: "set_version": 8, 2024-06-03T00:03:24.833 INFO:teuthology.orchestra.run.smithi049.stdout: "sets": { 2024-06-03T00:03:24.834 INFO:teuthology.orchestra.run.smithi049.stdout: "f51fb796": { 2024-06-03T00:03:24.834 INFO:teuthology.orchestra.run.smithi049.stdout: "version": 8, 2024-06-03T00:03:24.834 INFO:teuthology.orchestra.run.smithi049.stdout: "age_ref": 0.0, 2024-06-03T00:03:24.834 INFO:teuthology.orchestra.run.smithi049.stdout: "state": { 2024-06-03T00:03:24.834 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "RELEASED", 2024-06-03T00:03:24.834 INFO:teuthology.orchestra.run.smithi049.stdout: "age": 0.0 2024-06-03T00:03:24.834 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:24.834 INFO:teuthology.orchestra.run.smithi049.stdout: "timeout": 90.0, 2024-06-03T00:03:24.834 INFO:teuthology.orchestra.run.smithi049.stdout: "expiration": 130.0, 2024-06-03T00:03:24.834 INFO:teuthology.orchestra.run.smithi049.stdout: "members": { 2024-06-03T00:03:24.834 INFO:teuthology.orchestra.run.smithi049.stdout: "file:/": { 2024-06-03T00:03:24.834 INFO:teuthology.orchestra.run.smithi049.stdout: "excluded": false, 2024-06-03T00:03:24.834 INFO:teuthology.orchestra.run.smithi049.stdout: "state": { 2024-06-03T00:03:24.834 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "RELEASED", 2024-06-03T00:03:24.835 INFO:teuthology.orchestra.run.smithi049.stdout: "age": 0.0 2024-06-03T00:03:24.835 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:03:24.835 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:03:24.835 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:03:24.835 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:03:24.835 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:03:24.835 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:03:24.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.831+0000 7f463dfe8700 1 -- 172.21.15.49:0/1808840296 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f46240a2c20 msgr2=0x7f46240a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:24.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.831+0000 7f463dfe8700 1 --2- 172.21.15.49:0/1808840296 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f46240a2c20 0x7f46240a50e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f462000b2e0 tx=0x7f4620005960 comp rx=0 tx=0).stop 2024-06-03T00:03:24.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.831+0000 7f463dfe8700 1 -- 172.21.15.49:0/1808840296 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4638101380 msgr2=0x7f4638199a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:24.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.831+0000 7f463dfe8700 1 --2- 172.21.15.49:0/1808840296 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4638101380 0x7f4638199a70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4628007e20 tx=0x7f462800a340 comp rx=0 tx=0).stop 2024-06-03T00:03:24.836 INFO:tasks.workunit.client.0.smithi049.stdout:0/638: dread - d6/d97/fc2 zero size 2024-06-03T00:03:24.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.831+0000 7f463dfe8700 1 -- 172.21.15.49:0/1808840296 shutdown_connections 2024-06-03T00:03:24.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.831+0000 7f463dfe8700 1 --2- 172.21.15.49:0/1808840296 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f46240a2c20 0x7f46240a50e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:24.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.831+0000 7f463dfe8700 1 --2- 172.21.15.49:0/1808840296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46381073f0 0x7f46381a4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:24.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.831+0000 7f463dfe8700 1 --2- 172.21.15.49:0/1808840296 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4638101380 0x7f4638199a70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:24.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.831+0000 7f463dfe8700 1 --2- 172.21.15.49:0/1808840296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4638101d40 0x7f4638199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:24.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.831+0000 7f463dfe8700 1 -- 172.21.15.49:0/1808840296 >> 172.21.15.49:0/1808840296 conn(0x7f4638078300 msgr2=0x7f46380ffe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:24.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.831+0000 7f463dfe8700 1 -- 172.21.15.49:0/1808840296 shutdown_connections 2024-06-03T00:03:24.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:24.831+0000 7f463dfe8700 1 -- 172.21.15.49:0/1808840296 wait complete. 2024-06-03T00:03:24.838 INFO:tasks.workunit.client.0.smithi049.stdout:8/634: truncate d4/d27/d3c/d88/d28/d52/d66/d53/d7e/f7b 3113196 0 2024-06-03T00:03:24.838 INFO:tasks.workunit.client.0.smithi049.stdout:5/714: write d3/d5/fd6 [354785,61301] 0 2024-06-03T00:03:24.838 INFO:tasks.workunit.client.0.smithi049.stdout:7/728: symlink d3/dd8/d13/d3c/d4b/l106 0 2024-06-03T00:03:24.838 INFO:tasks.workunit.client.0.smithi049.stdout:8/635: rmdir d4/d27 39 2024-06-03T00:03:24.838 INFO:tasks.workunit.client.0.smithi049.stdout:5/715: mkdir d3/d5/d2d/d4b/d97/dde 0 2024-06-03T00:03:24.838 INFO:tasks.workunit.client.0.smithi049.stdout:8/636: read - d4/d27/d3c/d88/d28/d52/fc5 zero size 2024-06-03T00:03:24.839 INFO:tasks.workunit.client.0.smithi049.stdout:2/811: write da/d52/d9e/fee [994259,77585] 0 2024-06-03T00:03:24.839 INFO:tasks.workunit.client.0.smithi049.stdout:5/716: chown d3/f3a 496 1 2024-06-03T00:03:24.840 INFO:tasks.workunit.client.0.smithi049.stdout:7/729: creat d3/dd8/d13/d3c/d4b/d8e/f107 x:0 0 0 2024-06-03T00:03:24.841 INFO:tasks.workunit.client.0.smithi049.stdout:8/637: creat d4/d27/d30/fcf x:0 0 0 2024-06-03T00:03:24.842 INFO:tasks.workunit.client.0.smithi049.stdout:5/717: write d3/d9/d68/f78 [90492,12948] 0 2024-06-03T00:03:24.842 INFO:tasks.workunit.client.0.smithi049.stdout:8/638: readlink d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/la4 0 2024-06-03T00:03:24.843 INFO:tasks.workunit.client.0.smithi049.stdout:5/718: creat d3/d9/d20/d4c/d5a/fdf x:0 0 0 2024-06-03T00:03:24.843 INFO:tasks.workunit.client.0.smithi049.stdout:2/812: rename da/d52/d40/d93/da9/fc0 to da/d52/d40/dce/ffe 0 2024-06-03T00:03:24.844 INFO:tasks.workunit.client.0.smithi049.stdout:8/639: chown d4/d27/d3c/d88/d28/d45/lb3 765 1 2024-06-03T00:03:24.847 INFO:tasks.workunit.client.0.smithi049.stdout:7/730: mknod d3/dd8/d9/d8f/c108 0 2024-06-03T00:03:24.849 INFO:tasks.workunit.client.0.smithi049.stdout:2/813: dread da/d52/d73/da6/fc3 [0,4194304] 0 2024-06-03T00:03:24.852 INFO:tasks.workunit.client.0.smithi049.stdout:7/731: mknod d3/d14/d6e/c109 0 2024-06-03T00:03:24.852 INFO:tasks.workunit.client.0.smithi049.stdout:2/814: unlink da/d52/d40/d63/l54 0 2024-06-03T00:03:24.855 INFO:tasks.workunit.client.0.smithi049.stdout:2/815: mknod da/d52/df/d3c/cff 0 2024-06-03T00:03:24.857 INFO:tasks.workunit.client.0.smithi049.stdout:2/816: readlink da/d72/d83/l89 0 2024-06-03T00:03:24.857 INFO:tasks.workunit.client.0.smithi049.stdout:6/862: dwrite d2/d3/d9/d23/d48/ff1 [0,4194304] 0 2024-06-03T00:03:24.858 INFO:tasks.workunit.client.0.smithi049.stdout:2/817: symlink da/d72/d83/l100 0 2024-06-03T00:03:24.859 INFO:tasks.workunit.client.0.smithi049.stdout:2/818: mknod da/d52/d40/d93/da9/df5/c101 0 2024-06-03T00:03:24.862 INFO:tasks.workunit.client.0.smithi049.stdout:2/819: rename da/d52/df/d3c/d9a/cd9 to da/d52/d9e/c102 0 2024-06-03T00:03:24.862 INFO:tasks.workunit.client.0.smithi049.stdout:7/732: symlink d3/dd8/d86/d90/def/l10a 0 2024-06-03T00:03:24.862 INFO:tasks.workunit.client.0.smithi049.stdout:7/733: chown d3/d14/d6e/c109 22405988 1 2024-06-03T00:03:24.863 INFO:tasks.workunit.client.0.smithi049.stdout:6/863: stat d2/d3/d9/d23/d29/d30/c9c 0 2024-06-03T00:03:24.863 INFO:tasks.workunit.client.0.smithi049.stdout:7/734: dread - d3/dd8/d13/d54/daa/fb3 zero size 2024-06-03T00:03:24.868 INFO:tasks.workunit.client.0.smithi049.stdout:7/735: link d3/dd8/d13/d3c/d48/d7b/l64 d3/dd8/l10b 0 2024-06-03T00:03:24.869 INFO:tasks.workunit.client.0.smithi049.stdout:7/736: rmdir d3/dd8/d86 39 2024-06-03T00:03:24.877 INFO:tasks.workunit.client.0.smithi049.stdout:7/737: read d3/dd8/d13/d54/f55 [3575742,22103] 0 2024-06-03T00:03:24.880 INFO:tasks.workunit.client.0.smithi049.stdout:2/820: dread da/d52/d40/d63/ff4 [0,4194304] 0 2024-06-03T00:03:24.882 INFO:tasks.workunit.client.0.smithi049.stdout:5/719: fsync d3/d5/fd6 0 2024-06-03T00:03:24.883 INFO:tasks.workunit.client.0.smithi049.stdout:2/821: truncate da/d72/d83/d9f/ff0 730633 0 2024-06-03T00:03:24.884 INFO:tasks.workunit.client.0.smithi049.stdout:5/720: creat d3/d5/da/fe0 x:0 0 0 2024-06-03T00:03:24.885 INFO:tasks.workunit.client.0.smithi049.stdout:0/639: dwrite d6/d29/dc8/d52/f81 [0,4194304] 0 2024-06-03T00:03:24.886 INFO:tasks.workunit.client.0.smithi049.stdout:5/721: creat d3/d5/da/dcf/fe1 x:0 0 0 2024-06-03T00:03:24.886 INFO:tasks.workunit.client.0.smithi049.stdout:9/917: dwrite d1/da/da8/d50/d70/f129 [0,4194304] 0 2024-06-03T00:03:24.886 INFO:tasks.workunit.client.0.smithi049.stdout:4/773: dwrite d4/d2a/ddf/f100 [0,4194304] 0 2024-06-03T00:03:24.886 INFO:tasks.workunit.client.0.smithi049.stdout:0/640: creat d6/d59/d72/d94/fd8 x:0 0 0 2024-06-03T00:03:24.886 INFO:tasks.workunit.client.0.smithi049.stdout:5/722: chown d3/d9/d20/d4c/c81 5698216 1 2024-06-03T00:03:24.887 INFO:tasks.workunit.client.0.smithi049.stdout:5/723: chown d3/d5/da/d55/c4a 37 1 2024-06-03T00:03:24.887 INFO:tasks.workunit.client.0.smithi049.stdout:5/724: stat d3/d5/da/d55/d14/c42 0 2024-06-03T00:03:24.889 INFO:tasks.workunit.client.0.smithi049.stdout:0/641: symlink d6/d30/d32/dca/ld9 0 2024-06-03T00:03:24.891 INFO:tasks.workunit.client.0.smithi049.stdout:7/738: read d3/dd8/d13/d79/f7e [1714475,99352] 0 2024-06-03T00:03:24.891 INFO:tasks.workunit.client.0.smithi049.stdout:0/642: mknod d6/d59/cda 0 2024-06-03T00:03:24.895 INFO:tasks.workunit.client.0.smithi049.stdout:7/739: stat d3/dd8/d13/d3c/d48/d7b/d9c/dc8/ce3 0 2024-06-03T00:03:24.895 INFO:tasks.workunit.client.0.smithi049.stdout:9/918: mknod d1/da/d26/c133 0 2024-06-03T00:03:24.898 INFO:tasks.workunit.client.0.smithi049.stdout:0/643: rename d6/d29/l42 to d6/d29/dc8/d52/ldb 0 2024-06-03T00:03:24.899 INFO:tasks.workunit.client.0.smithi049.stdout:7/740: truncate d3/dd8/f5e 1558545 0 2024-06-03T00:03:24.899 INFO:tasks.workunit.client.0.smithi049.stdout:9/919: creat d1/da/da8/d50/d70/f134 x:0 0 0 2024-06-03T00:03:24.902 INFO:tasks.workunit.client.0.smithi049.stdout:0/644: unlink d6/f61 0 2024-06-03T00:03:24.903 INFO:tasks.workunit.client.0.smithi049.stdout:7/741: getdents d3/dd8/d3f 0 2024-06-03T00:03:24.903 INFO:tasks.workunit.client.0.smithi049.stdout:0/645: truncate d6/d97/fc0 628440 0 2024-06-03T00:03:24.903 INFO:tasks.workunit.client.0.smithi049.stdout:0/646: stat d6/d59/cda 0 2024-06-03T00:03:24.903 INFO:tasks.workunit.client.0.smithi049.stdout:4/774: getdents d4/d3f/d14/d2b/d84/d1c/d24 0 2024-06-03T00:03:24.903 INFO:tasks.workunit.client.0.smithi049.stdout:5/725: dwrite d3/d5/d2d/d4b/f59 [4194304,4194304] 0 2024-06-03T00:03:24.904 INFO:tasks.workunit.client.0.smithi049.stdout:7/742: chown d3/dd8/d9/d8f/c45 0 1 2024-06-03T00:03:24.905 INFO:tasks.workunit.client.0.smithi049.stdout:7/743: mknod d3/dd8/d13/d3c/c10c 0 2024-06-03T00:03:24.905 INFO:tasks.workunit.client.0.smithi049.stdout:7/744: truncate d3/d14/fde 965026 0 2024-06-03T00:03:24.907 INFO:tasks.workunit.client.0.smithi049.stdout:9/920: mknod d1/da/da8/d50/deb/c135 0 2024-06-03T00:03:24.907 INFO:tasks.workunit.client.0.smithi049.stdout:7/745: mknod d3/dd8/d13/d54/c10d 0 2024-06-03T00:03:24.907 INFO:tasks.workunit.client.0.smithi049.stdout:5/726: rename d3/d5/d2d/d4b/d97/dbf to d3/d5/de2 0 2024-06-03T00:03:24.908 INFO:tasks.workunit.client.0.smithi049.stdout:7/746: mknod d3/dd8/d86/d90/def/c10e 0 2024-06-03T00:03:24.911 INFO:tasks.workunit.client.0.smithi049.stdout:0/647: dread d6/d30/d32/f40 [0,4194304] 0 2024-06-03T00:03:24.912 INFO:tasks.workunit.client.0.smithi049.stdout:4/775: dread d4/d3f/d14/d7f/ddb/d8a/fe3 [0,4194304] 0 2024-06-03T00:03:24.912 INFO:tasks.workunit.client.0.smithi049.stdout:6/864: dwrite d2/d3/d9/d23/d48/ff1 [4194304,4194304] 0 2024-06-03T00:03:24.912 INFO:tasks.workunit.client.0.smithi049.stdout:0/648: dread - d6/d97/d4b/d67/fbc zero size 2024-06-03T00:03:24.913 INFO:tasks.workunit.client.0.smithi049.stdout:9/921: creat d1/d5/d13/d103/f136 x:0 0 0 2024-06-03T00:03:24.915 INFO:tasks.workunit.client.0.smithi049.stdout:9/922: truncate d1/d5/d13/f4b 4646085 0 2024-06-03T00:03:24.915 INFO:tasks.workunit.client.0.smithi049.stdout:4/776: write d4/d3f/d14/d7f/ff9 [131128,77264] 0 2024-06-03T00:03:24.917 INFO:tasks.workunit.client.0.smithi049.stdout:0/649: mknod d6/d59/d93/dcb/cdc 0 2024-06-03T00:03:24.918 INFO:tasks.workunit.client.0.smithi049.stdout:9/923: write d1/d5/d13/de3/f108 [614293,103875] 0 2024-06-03T00:03:24.918 INFO:tasks.workunit.client.0.smithi049.stdout:6/865: symlink d2/d3/d17/d57/d6e/d88/dde/de9/da6/l123 0 2024-06-03T00:03:24.919 INFO:tasks.workunit.client.0.smithi049.stdout:0/650: dread - d6/d29/fc6 zero size 2024-06-03T00:03:24.919 INFO:tasks.workunit.client.0.smithi049.stdout:9/924: chown d1/da/d26/cab 803 1 2024-06-03T00:03:24.923 INFO:tasks.workunit.client.0.smithi049.stdout:0/651: creat d6/d59/d93/db4/fdd x:0 0 0 2024-06-03T00:03:24.923 INFO:tasks.workunit.client.0.smithi049.stdout:9/925: truncate d1/d5/d13/d3b/f12d 732376 0 2024-06-03T00:03:24.924 INFO:tasks.workunit.client.0.smithi049.stdout:6/866: truncate d2/d4d/d76/dfd/f104 2802333 0 2024-06-03T00:03:24.925 INFO:tasks.workunit.client.0.smithi049.stdout:0/652: creat d6/d30/fde x:0 0 0 2024-06-03T00:03:24.926 INFO:tasks.workunit.client.0.smithi049.stdout:5/727: dwrite d3/d9/d20/fac [0,4194304] 0 2024-06-03T00:03:24.926 INFO:tasks.workunit.client.0.smithi049.stdout:9/926: creat d1/d95/f137 x:0 0 0 2024-06-03T00:03:24.929 INFO:tasks.workunit.client.0.smithi049.stdout:0/653: read - d6/d29/dc8/d52/f5c zero size 2024-06-03T00:03:24.929 INFO:tasks.workunit.client.0.smithi049.stdout:9/927: creat d1/da/da8/d5f/f138 x:0 0 0 2024-06-03T00:03:24.930 INFO:tasks.workunit.client.0.smithi049.stdout:0/654: fsync d6/d97/f6a 0 2024-06-03T00:03:24.931 INFO:tasks.workunit.client.0.smithi049.stdout:6/867: truncate d2/d3/d9/d23/d48/d51/f5f 1014244 0 2024-06-03T00:03:24.932 INFO:tasks.workunit.client.0.smithi049.stdout:5/728: write d3/d9/d20/f3d [747057,114278] 0 2024-06-03T00:03:24.932 INFO:tasks.workunit.client.0.smithi049.stdout:5/729: dread - d3/d5/da/fe0 zero size 2024-06-03T00:03:24.933 INFO:tasks.workunit.client.0.smithi049.stdout:0/655: symlink d6/d29/ldf 0 2024-06-03T00:03:24.933 INFO:tasks.workunit.client.0.smithi049.stdout:5/730: read d3/d7d/fd0 [414645,104918] 0 2024-06-03T00:03:24.935 INFO:tasks.workunit.client.0.smithi049.stdout:6/868: rename d2/d3/d17/d57/d6e/fb4 to d2/d3/d9/d23/d48/d53/d118/f124 0 2024-06-03T00:03:24.935 INFO:tasks.workunit.client.0.smithi049.stdout:4/777: write d4/d3f/d14/d2b/d84/d69/dc6/dd3/fef [1028375,41639] 0 2024-06-03T00:03:24.940 INFO:tasks.workunit.client.0.smithi049.stdout:4/778: creat d4/d3f/d14/d7f/ddb/df5/df1/f10a x:0 0 0 2024-06-03T00:03:24.942 INFO:tasks.workunit.client.0.smithi049.stdout:4/779: creat d4/d3f/d14/d2b/d84/d69/dc6/dd3/f10b x:0 0 0 2024-06-03T00:03:24.942 INFO:tasks.workunit.client.0.smithi049.stdout:6/869: write d2/d3/d9/d23/d48/f61 [1213380,66520] 0 2024-06-03T00:03:24.943 INFO:tasks.workunit.client.0.smithi049.stdout:6/870: stat d2/d3/d17/d57/d6e/d88/dcc/cda 0 2024-06-03T00:03:24.943 INFO:tasks.workunit.client.0.smithi049.stdout:9/928: write d1/d5/d13/d3b/d7f/dbc/dfc/fa6 [4978142,416] 0 2024-06-03T00:03:24.944 INFO:tasks.workunit.client.0.smithi049.stdout:6/871: creat d2/d3/d17/d57/d6e/d88/d112/f125 x:0 0 0 2024-06-03T00:03:24.944 INFO:tasks.workunit.client.0.smithi049.stdout:4/780: symlink d4/d3f/d14/d2b/l10c 0 2024-06-03T00:03:24.946 INFO:tasks.workunit.client.0.smithi049.stdout:9/929: chown d1/da/d27/f40 241 1 2024-06-03T00:03:24.946 INFO:tasks.workunit.client.0.smithi049.stdout:9/930: write d1/d5/d13/f4b [5630684,41986] 0 2024-06-03T00:03:24.950 INFO:tasks.workunit.client.0.smithi049.stdout:9/931: stat d1/d5/d13/de3/dfe/df3/f11d 0 2024-06-03T00:03:24.950 INFO:tasks.workunit.client.0.smithi049.stdout:5/731: dwrite d3/d5/da3/fbd [0,4194304] 0 2024-06-03T00:03:24.950 INFO:tasks.workunit.client.0.smithi049.stdout:9/932: chown d1/f55 0 1 2024-06-03T00:03:24.951 INFO:tasks.workunit.client.0.smithi049.stdout:9/933: readlink d1/d5/d13/d3b/dad/ld8 0 2024-06-03T00:03:24.952 INFO:tasks.workunit.client.0.smithi049.stdout:5/732: truncate d3/d5/d2d/d8d/f98 893098 0 2024-06-03T00:03:24.954 INFO:tasks.workunit.client.0.smithi049.stdout:5/733: creat d3/d5/da/d55/d14/fe3 x:0 0 0 2024-06-03T00:03:24.955 INFO:tasks.workunit.client.0.smithi049.stdout:6/872: dread d2/d3/d17/f6b [0,4194304] 0 2024-06-03T00:03:24.956 INFO:tasks.workunit.client.0.smithi049.stdout:6/873: readlink d2/d3/d9/d40/l80 0 2024-06-03T00:03:24.959 INFO:tasks.workunit.client.0.smithi049.stdout:9/934: write d1/d5/d13/d3b/f65 [6405884,103875] 0 2024-06-03T00:03:24.959 INFO:tasks.workunit.client.0.smithi049.stdout:5/734: write d3/d5/da/f50 [3951463,20760] 0 2024-06-03T00:03:24.959 INFO:tasks.workunit.client.0.smithi049.stdout:5/735: fdatasync d3/d5/da/d55/d14/f47 0 2024-06-03T00:03:24.961 INFO:tasks.workunit.client.0.smithi049.stdout:5/736: mknod d3/d5/d24/ce4 0 2024-06-03T00:03:24.962 INFO:tasks.workunit.client.0.smithi049.stdout:5/737: rename d3/d5/da to d3/d5/da/d55/d75/de5 22 2024-06-03T00:03:24.963 INFO:tasks.workunit.client.0.smithi049.stdout:5/738: getdents d3/d5/de2 0 2024-06-03T00:03:24.968 INFO:tasks.workunit.client.0.smithi049.stdout:5/739: rename d3/d53/l61 to d3/d9/le6 0 2024-06-03T00:03:24.970 INFO:tasks.workunit.client.0.smithi049.stdout:5/740: write d3/d9/d20/d4c/d5a/d6f/fc4 [714822,105454] 0 2024-06-03T00:03:24.970 INFO:tasks.workunit.client.0.smithi049.stdout:5/741: fsync d3/d7d/fb2 0 2024-06-03T00:03:24.973 INFO:tasks.workunit.client.0.smithi049.stdout:5/742: rename d3/d9/d20/fac to d3/d5/fe7 0 2024-06-03T00:03:24.975 INFO:tasks.workunit.client.0.smithi049.stdout:5/743: read d3/d9/d20/d4c/f6a [408305,15562] 0 2024-06-03T00:03:24.976 INFO:tasks.workunit.client.0.smithi049.stdout:5/744: chown d3/d5/da/c73 21385 1 2024-06-03T00:03:24.982 INFO:tasks.workunit.client.0.smithi049.stdout:9/935: dwrite d1/da/d26/f43 [4194304,4194304] 0 2024-06-03T00:03:24.984 INFO:tasks.workunit.client.0.smithi049.stdout:9/936: dread d1/da/d26/fd9 [0,4194304] 0 2024-06-03T00:03:24.985 INFO:tasks.workunit.client.0.smithi049.stdout:9/937: dread - d1/da/d122/f130 zero size 2024-06-03T00:03:24.987 INFO:tasks.workunit.client.0.smithi049.stdout:9/938: mkdir d1/d5/d13/de3/dfe/df3/d139 0 2024-06-03T00:03:24.987 INFO:tasks.workunit.client.0.smithi049.stdout:9/939: fsync d1/da/da8/f34 0 2024-06-03T00:03:24.990 INFO:tasks.workunit.client.0.smithi049.stdout:6/874: dwrite d2/d3/d17/d57/fac [4194304,4194304] 0 2024-06-03T00:03:24.992 INFO:tasks.workunit.client.0.smithi049.stdout:6/875: mkdir d2/d3/d9/d23/d29/d126 0 2024-06-03T00:03:24.993 INFO:tasks.workunit.client.0.smithi049.stdout:6/876: getdents d2/d3/d9/d23/d48/d89/d102 0 2024-06-03T00:03:24.993 INFO:tasks.workunit.client.0.smithi049.stdout:6/877: fsync d2/d3/d17/d57/f69 0 2024-06-03T00:03:25.002 INFO:tasks.workunit.client.0.smithi049.stdout:5/745: dread d3/d9/d20/d4c/d5a/d65/f69 [0,4194304] 0 2024-06-03T00:03:25.064 INFO:tasks.workunit.client.0.smithi049.stdout:9/940: dwrite d1/d5/d13/d3b/d49/fd3 [0,4194304] 0 2024-06-03T00:03:25.065 INFO:tasks.workunit.client.0.smithi049.stdout:6/878: dwrite d2/d3/d17/f6b [0,4194304] 0 2024-06-03T00:03:25.065 INFO:tasks.workunit.client.0.smithi049.stdout:5/746: dwrite d3/d9/f28 [0,4194304] 0 2024-06-03T00:03:25.065 INFO:tasks.workunit.client.0.smithi049.stdout:5/747: creat d3/d5/da/dcf/fe8 x:0 0 0 2024-06-03T00:03:25.066 INFO:tasks.workunit.client.0.smithi049.stdout:6/879: mkdir d2/d3/d9/d23/d48/d53/d127 0 2024-06-03T00:03:25.067 INFO:tasks.workunit.client.0.smithi049.stdout:5/748: read d3/d5/da/d55/d75/fa0 [99963,112351] 0 2024-06-03T00:03:25.091 INFO:tasks.workunit.client.0.smithi049.stdout:5/749: dwrite d3/d9/d20/f3d [0,4194304] 0 2024-06-03T00:03:25.091 INFO:tasks.workunit.client.0.smithi049.stdout:9/941: dwrite d1/d5/d13/d3b/d7f/dbc/f9c [0,4194304] 0 2024-06-03T00:03:25.093 INFO:tasks.workunit.client.0.smithi049.stdout:9/942: mknod d1/da/da8/d50/d70/c13a 0 2024-06-03T00:03:25.096 INFO:tasks.workunit.client.0.smithi049.stdout:9/943: mknod d1/d5/d13/de3/c13b 0 2024-06-03T00:03:25.099 INFO:tasks.workunit.client.0.smithi049.stdout:9/944: chown d1/da/d54/d5b/l104 1 1 2024-06-03T00:03:25.116 INFO:tasks.workunit.client.0.smithi049.stdout:5/750: dwrite d3/d5/da/d55/d14/f47 [4194304,4194304] 0 2024-06-03T00:03:25.116 INFO:tasks.workunit.client.0.smithi049.stdout:9/945: dwrite d1/d5/d13/de3/dfe/df3/f11d [0,4194304] 0 2024-06-03T00:03:25.118 INFO:tasks.workunit.client.0.smithi049.stdout:5/751: rename d3/d5/d2d/d8d/f98 to d3/d5/da/d55/d75/fe9 0 2024-06-03T00:03:25.118 INFO:tasks.workunit.client.0.smithi049.stdout:9/946: stat d1/da/d27/f11c 0 2024-06-03T00:03:25.120 INFO:tasks.workunit.client.0.smithi049.stdout:5/752: rename d3/d7d/f91 to d3/d5/d2d/d4b/d51/fea 0 2024-06-03T00:03:25.120 INFO:tasks.workunit.client.0.smithi049.stdout:5/753: dread - d3/d5/de2/fc3 zero size 2024-06-03T00:03:25.120 INFO:tasks.workunit.client.0.smithi049.stdout:5/754: fsync d3/d5/da/d55/d14/fe3 0 2024-06-03T00:03:25.124 INFO:tasks.workunit.client.0.smithi049.stdout:9/947: truncate d1/da/da8/d5f/d81/da0/fc5 212728 0 2024-06-03T00:03:25.125 INFO:tasks.workunit.client.0.smithi049.stdout:9/948: chown d1/d5/d13/d3b/d7f/c8e 391 1 2024-06-03T00:03:25.126 INFO:tasks.workunit.client.0.smithi049.stdout:9/949: readlink d1/da/da8/d50/d70/lc0 0 2024-06-03T00:03:25.137 INFO:tasks.workunit.client.0.smithi049.stdout:5/755: dwrite d3/d5/f58 [0,4194304] 0 2024-06-03T00:03:25.138 INFO:tasks.workunit.client.0.smithi049.stdout:5/756: getdents d3/d9/d20/d4c 0 2024-06-03T00:03:25.139 INFO:tasks.workunit.client.0.smithi049.stdout:5/757: chown d3/d5/da/d55/d75/dad/cb0 0 1 2024-06-03T00:03:25.141 INFO:tasks.workunit.client.0.smithi049.stdout:5/758: link d3/f66 d3/d7d/feb 0 2024-06-03T00:03:25.146 INFO:tasks.workunit.client.0.smithi049.stdout:9/950: dwrite d1/d5/d13/d3b/d49/f64 [4194304,4194304] 0 2024-06-03T00:03:25.161 INFO:tasks.workunit.client.0.smithi049.stdout:9/951: dwrite d1/d5/d13/de3/dfe/df3/f11d [4194304,4194304] 0 2024-06-03T00:03:25.163 INFO:tasks.workunit.client.0.smithi049.stdout:9/952: creat d1/da/d27/f13c x:0 0 0 2024-06-03T00:03:25.164 INFO:tasks.workunit.client.0.smithi049.stdout:9/953: dread d1/da/d26/fd9 [0,4194304] 0 2024-06-03T00:03:25.167 INFO:tasks.workunit.client.0.smithi049.stdout:9/954: rename d1/da/d26/l94 to d1/da/da8/d50/d121/d12b/l13d 0 2024-06-03T00:03:25.167 INFO:tasks.workunit.client.0.smithi049.stdout:9/955: rmdir d1/da/d26 39 2024-06-03T00:03:25.169 INFO:tasks.workunit.client.0.smithi049.stdout:9/956: mknod d1/da/da8/d50/dda/c13e 0 2024-06-03T00:03:25.170 INFO:tasks.workunit.client.0.smithi049.stdout:9/957: truncate d1/da/d54/fc2 1648852 0 2024-06-03T00:03:25.171 INFO:tasks.workunit.client.0.smithi049.stdout:9/958: creat d1/d5/d13/d3b/d7f/f13f x:0 0 0 2024-06-03T00:03:25.172 INFO:tasks.workunit.client.0.smithi049.stdout:9/959: creat d1/da/da8/d5f/d81/f140 x:0 0 0 2024-06-03T00:03:25.173 INFO:tasks.workunit.client.0.smithi049.stdout:9/960: truncate d1/d5/d13/d3b/dbb/fec 1183414 0 2024-06-03T00:03:25.174 INFO:tasks.workunit.client.0.smithi049.stdout:9/961: creat d1/d5/d13/d3b/dbb/d10e/f141 x:0 0 0 2024-06-03T00:03:25.175 INFO:tasks.workunit.client.0.smithi049.stdout:9/962: chown d1/da 396294 1 2024-06-03T00:03:25.176 INFO:tasks.workunit.client.0.smithi049.stdout:9/963: mknod d1/d5/d13/de3/de8/c142 0 2024-06-03T00:03:25.177 INFO:tasks.workunit.client.0.smithi049.stdout:9/964: creat d1/d5/d13/d3b/f143 x:0 0 0 2024-06-03T00:03:25.178 INFO:tasks.workunit.client.0.smithi049.stdout:9/965: fdatasync d1/da/da8/fe7 0 2024-06-03T00:03:25.178 INFO:tasks.workunit.client.0.smithi049.stdout:9/966: dread - d1/da/d27/f11c zero size 2024-06-03T00:03:25.179 INFO:tasks.workunit.client.0.smithi049.stdout:9/967: symlink d1/da/d27/l144 0 2024-06-03T00:03:25.179 INFO:tasks.workunit.client.0.smithi049.stdout:9/968: chown d1/da/da8/d5f/d81/da0/fd6 241781609 1 2024-06-03T00:03:25.180 INFO:tasks.workunit.client.0.smithi049.stdout:9/969: fsync d1/d5/d13/d3b/f10c 0 2024-06-03T00:03:25.180 INFO:tasks.workunit.client.0.smithi049.stdout:9/970: fsync d1/da/da8/d5f/d81/fcb 0 2024-06-03T00:03:25.183 INFO:tasks.workunit.client.0.smithi049.stdout:9/971: rename d1/da/d26/f43 to d1/da/d54/f145 0 2024-06-03T00:03:25.184 INFO:tasks.workunit.client.0.smithi049.stdout:9/972: mkdir d1/da/d26/d146 0 2024-06-03T00:03:25.189 INFO:tasks.workunit.client.0.smithi049.stdout:9/973: rename d1/d5/d13/d3b/f65 to d1/d5/d13/d3b/d7f/dbc/dfc/d52/d72/f147 0 2024-06-03T00:03:25.189 INFO:tasks.workunit.client.0.smithi049.stdout:9/974: fdatasync d1/d5/d13/d3b/f10c 0 2024-06-03T00:03:25.190 INFO:tasks.workunit.client.0.smithi049.stdout:9/975: fdatasync d1/da/da8/d5f/d81/da0/ff7 0 2024-06-03T00:03:25.199 INFO:tasks.workunit.client.0.smithi049.stdout:9/976: dread d1/da/d27/f3c [0,4194304] 0 2024-06-03T00:03:25.200 INFO:tasks.workunit.client.0.smithi049.stdout:9/977: mknod d1/d5/d13/d3b/d49/c148 0 2024-06-03T00:03:25.203 INFO:tasks.workunit.client.0.smithi049.stdout:9/978: rename d1/da/d27/f75 to d1/da/d54/d5b/f149 0 2024-06-03T00:03:25.204 INFO:tasks.workunit.client.0.smithi049.stdout:9/979: creat d1/d5/d13/d103/f14a x:0 0 0 2024-06-03T00:03:25.205 INFO:tasks.workunit.client.0.smithi049.stdout:9/980: unlink d1/da/da8/d50/d70/ff2 0 2024-06-03T00:03:25.206 INFO:tasks.workunit.client.0.smithi049.stdout:9/981: fdatasync d1/d5/d13/d3b/d7f/dbc/dfc/f4e 0 2024-06-03T00:03:25.215 INFO:tasks.workunit.client.0.smithi049.stdout:9/982: write d1/da/da8/d50/d70/f129 [1747540,115330] 0 2024-06-03T00:03:25.216 INFO:tasks.workunit.client.0.smithi049.stdout:9/983: fdatasync d1/da/f5e 0 2024-06-03T00:03:25.217 INFO:tasks.workunit.client.0.smithi049.stdout:9/984: mknod d1/d5/d13/d3b/c14b 0 2024-06-03T00:03:25.217 INFO:tasks.workunit.client.0.smithi049.stdout:9/985: truncate d1/da/fee 793678 0 2024-06-03T00:03:25.218 INFO:tasks.workunit.client.0.smithi049.stdout:9/986: mkdir d1/d5/d13/d14c 0 2024-06-03T00:03:25.220 INFO:tasks.workunit.client.0.smithi049.stdout:9/987: mkdir d1/da/d122/d14d 0 2024-06-03T00:03:25.240 INFO:tasks.workunit.client.0.smithi049.stdout:9/988: dwrite d1/da/da8/d5f/d81/da0/ff7 [0,4194304] 0 2024-06-03T00:03:25.240 INFO:tasks.workunit.client.0.smithi049.stdout:9/989: truncate d1/da/d122/f130 494701 0 2024-06-03T00:03:25.241 INFO:tasks.workunit.client.0.smithi049.stdout:9/990: stat d1/da/d26/l67 0 2024-06-03T00:03:25.249 INFO:tasks.workunit.client.0.smithi049.stdout:9/991: dread d1/da/d54/f145 [0,4194304] 0 2024-06-03T00:03:25.251 INFO:tasks.workunit.client.0.smithi049.stdout:9/992: mkdir d1/d5/d13/d3b/d7f/dbc/dfc/d52/d14e 0 2024-06-03T00:03:25.260 INFO:tasks.workunit.client.0.smithi049.stdout:9/993: write d1/d5/d13/d3b/d7f/dbc/f9c [582128,20201] 0 2024-06-03T00:03:25.262 INFO:tasks.workunit.client.0.smithi049.stdout:9/994: mkdir d1/d5/d13/d3b/d49/d14f 0 2024-06-03T00:03:25.262 INFO:tasks.workunit.client.0.smithi049.stdout:9/995: dread - d1/da/da8/d50/d70/f134 zero size 2024-06-03T00:03:25.262 INFO:tasks.workunit.client.0.smithi049.stdout:9/996: creat d1/da/da8/f150 x:0 0 0 2024-06-03T00:03:25.264 INFO:tasks.workunit.client.0.smithi049.stdout:9/997: dread d1/da/d26/f5c [4194304,4194304] 0 2024-06-03T00:03:25.264 INFO:tasks.workunit.client.0.smithi049.stdout:9/998: fdatasync d1/da/d26/f5c 0 2024-06-03T00:03:25.288 INFO:tasks.workunit.client.0.smithi049.stdout:9/999: dwrite d1/d5/d13/d3b/d7f/dbc/fd7 [0,4194304] 0 2024-06-03T00:03:25.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:25 smithi107 ceph-mon[37048]: pgmap v484: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 MiB/s rd, 64 MiB/s wr, 540 op/s 2024-06-03T00:03:25.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:25 smithi057 ceph-mon[36457]: pgmap v484: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 MiB/s rd, 64 MiB/s wr, 540 op/s 2024-06-03T00:03:25.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:25 smithi049 ceph-mon[32302]: pgmap v484: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 MiB/s rd, 64 MiB/s wr, 540 op/s 2024-06-03T00:03:25.610 INFO:tasks.workunit.client.0.smithi049.stdout:5/759: sync 2024-06-03T00:03:25.764 INFO:tasks.workunit.client.0.smithi049.stdout:2/822: sync 2024-06-03T00:03:25.764 INFO:tasks.workunit.client.0.smithi049.stdout:0/656: sync 2024-06-03T00:03:25.764 INFO:tasks.workunit.client.0.smithi049.stdout:4/781: sync 2024-06-03T00:03:25.764 INFO:tasks.workunit.client.0.smithi049.stdout:8/640: sync 2024-06-03T00:03:25.765 INFO:tasks.workunit.client.0.smithi049.stdout:6/880: sync 2024-06-03T00:03:25.765 INFO:tasks.workunit.client.0.smithi049.stdout:7/747: sync 2024-06-03T00:03:25.765 INFO:tasks.workunit.client.0.smithi049.stdout:3/636: sync 2024-06-03T00:03:25.780 INFO:tasks.workunit.client.0.smithi049.stdout:3/637: fdatasync d2/f13 0 2024-06-03T00:03:25.780 INFO:tasks.workunit.client.0.smithi049.stdout:5/760: dread d3/f66 [0,4194304] 0 2024-06-03T00:03:25.780 INFO:tasks.workunit.client.0.smithi049.stdout:5/761: write d3/d7d/fb2 [278837,101270] 0 2024-06-03T00:03:25.780 INFO:tasks.workunit.client.0.smithi049.stdout:3/638: fsync d2/d14/d22/d42/d68/d80/fd4 0 2024-06-03T00:03:25.780 INFO:tasks.workunit.client.0.smithi049.stdout:6/881: unlink d2/d3/d9/d23/d48/d51/fb5 0 2024-06-03T00:03:25.780 INFO:tasks.workunit.client.0.smithi049.stdout:5/762: mkdir d3/d5/de2/dec 0 2024-06-03T00:03:25.780 INFO:tasks.workunit.client.0.smithi049.stdout:0/657: symlink d6/d29/dc8/d52/d96/le0 0 2024-06-03T00:03:25.781 INFO:tasks.workunit.client.0.smithi049.stdout:6/882: creat d2/d4d/d76/de4/f128 x:0 0 0 2024-06-03T00:03:25.781 INFO:tasks.workunit.client.0.smithi049.stdout:7/748: creat d3/dd8/d13/d4a/dd5/dfe/f10f x:0 0 0 2024-06-03T00:03:25.781 INFO:tasks.workunit.client.0.smithi049.stdout:5/763: truncate d3/d53/dc1/fcc 207118 0 2024-06-03T00:03:25.781 INFO:tasks.workunit.client.0.smithi049.stdout:0/658: read d6/d29/dc8/d52/d96/fa6 [1707177,37400] 0 2024-06-03T00:03:25.781 INFO:tasks.workunit.client.0.smithi049.stdout:3/639: mkdir d2/d1a/d34/dd5/d75/d94/dd1/da0/de3 0 2024-06-03T00:03:25.781 INFO:tasks.workunit.client.0.smithi049.stdout:0/659: creat d6/d97/fe1 x:0 0 0 2024-06-03T00:03:25.781 INFO:tasks.workunit.client.0.smithi049.stdout:6/883: symlink d2/d4d/l129 0 2024-06-03T00:03:25.781 INFO:tasks.workunit.client.0.smithi049.stdout:3/640: fsync d2/d14/d22/d42/d8f/fb4 0 2024-06-03T00:03:25.781 INFO:tasks.workunit.client.0.smithi049.stdout:7/749: mkdir d3/dd8/d13/d3c/d110 0 2024-06-03T00:03:25.781 INFO:tasks.workunit.client.0.smithi049.stdout:0/660: write d6/d30/f9c [956038,41420] 0 2024-06-03T00:03:25.781 INFO:tasks.workunit.client.0.smithi049.stdout:5/764: link d3/d9/d20/d4c/d5a/d65/c74 d3/d9/ced 0 2024-06-03T00:03:25.781 INFO:tasks.workunit.client.0.smithi049.stdout:0/661: creat d6/d30/fe2 x:0 0 0 2024-06-03T00:03:25.781 INFO:tasks.workunit.client.0.smithi049.stdout:7/750: getdents d3/dd8/d13/d3c/d48/d7b/d9c/dc4/de6 0 2024-06-03T00:03:25.781 INFO:tasks.workunit.client.0.smithi049.stdout:3/641: creat d2/d14/d44/d52/d4c/d4b/d58/fe4 x:0 0 0 2024-06-03T00:03:25.782 INFO:tasks.workunit.client.0.smithi049.stdout:0/662: creat d6/d29/fe3 x:0 0 0 2024-06-03T00:03:25.782 INFO:tasks.workunit.client.0.smithi049.stdout:7/751: symlink d3/dd8/d13/d3c/d48/d7b/d9c/dc4/de6/l111 0 2024-06-03T00:03:25.782 INFO:tasks.workunit.client.0.smithi049.stdout:5/765: unlink d3/d9/d20/d4c/fb8 0 2024-06-03T00:03:25.782 INFO:tasks.workunit.client.0.smithi049.stdout:0/663: creat d6/d30/da3/fe4 x:0 0 0 2024-06-03T00:03:25.782 INFO:tasks.workunit.client.0.smithi049.stdout:3/642: creat d2/d1a/d34/dd5/d75/d94/dd1/da0/fe5 x:0 0 0 2024-06-03T00:03:25.782 INFO:tasks.workunit.client.0.smithi049.stdout:0/664: dread d6/d30/d32/dca/fcc [0,4194304] 0 2024-06-03T00:03:25.782 INFO:tasks.workunit.client.0.smithi049.stdout:0/665: creat d6/d59/d72/d94/fe5 x:0 0 0 2024-06-03T00:03:25.782 INFO:tasks.workunit.client.0.smithi049.stdout:0/666: getdents d6/d30/d32/dca 0 2024-06-03T00:03:25.782 INFO:tasks.workunit.client.0.smithi049.stdout:0/667: truncate d6/d29/fe3 761897 0 2024-06-03T00:03:25.782 INFO:tasks.workunit.client.0.smithi049.stdout:6/884: dread d2/d3/d9/d23/d48/d51/f5f [0,4194304] 0 2024-06-03T00:03:25.782 INFO:tasks.workunit.client.0.smithi049.stdout:0/668: dread - d6/d29/dc8/d52/f7c zero size 2024-06-03T00:03:25.782 INFO:tasks.workunit.client.0.smithi049.stdout:0/669: fdatasync f4 0 2024-06-03T00:03:25.782 INFO:tasks.workunit.client.0.smithi049.stdout:6/885: truncate d2/f107 1633779 0 2024-06-03T00:03:25.782 INFO:tasks.workunit.client.0.smithi049.stdout:0/670: unlink d6/f21 0 2024-06-03T00:03:25.783 INFO:tasks.workunit.client.0.smithi049.stdout:2/823: dwrite da/d52/d9e/ff6 [0,4194304] 0 2024-06-03T00:03:25.783 INFO:tasks.workunit.client.0.smithi049.stdout:6/886: chown d2/d3/d17/d57/d6e/d88/d119 887 1 2024-06-03T00:03:25.783 INFO:tasks.workunit.client.0.smithi049.stdout:2/824: getdents da/d52/dd3 0 2024-06-03T00:03:25.783 INFO:tasks.workunit.client.0.smithi049.stdout:8/641: dwrite d4/d27/d30/f41 [0,4194304] 0 2024-06-03T00:03:25.783 INFO:tasks.workunit.client.0.smithi049.stdout:8/642: stat d4/d27/d3c/d88/d28/d25 0 2024-06-03T00:03:25.783 INFO:tasks.workunit.client.0.smithi049.stdout:8/643: write d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/dab/fb6 [139255,29855] 0 2024-06-03T00:03:25.783 INFO:tasks.workunit.client.0.smithi049.stdout:8/644: chown d4/d27/d3c/d88/d28/d25 297004367 1 2024-06-03T00:03:25.783 INFO:tasks.workunit.client.0.smithi049.stdout:6/887: link d2/d3/d9/d55/lb1 d2/d4d/d76/dfd/l12a 0 2024-06-03T00:03:25.783 INFO:tasks.workunit.client.0.smithi049.stdout:2/825: rename da/d52/c2f to da/d55/c103 0 2024-06-03T00:03:25.783 INFO:tasks.workunit.client.0.smithi049.stdout:5/766: dwrite d3/d5/fd [0,4194304] 0 2024-06-03T00:03:25.783 INFO:tasks.workunit.client.0.smithi049.stdout:6/888: chown d2/d3/fdf 2 1 2024-06-03T00:03:25.783 INFO:tasks.workunit.client.0.smithi049.stdout:6/889: creat d2/d3/d9/d40/f12b x:0 0 0 2024-06-03T00:03:25.783 INFO:tasks.workunit.client.0.smithi049.stdout:6/890: chown d2/d3/d17/d57/c8e 100864242 1 2024-06-03T00:03:25.783 INFO:tasks.workunit.client.0.smithi049.stdout:7/752: dwrite d3/dd8/d13/d54/fba [0,4194304] 0 2024-06-03T00:03:25.783 INFO:tasks.workunit.client.0.smithi049.stdout:7/753: mkdir d3/dd8/d13/d3c/d48/d112 0 2024-06-03T00:03:25.783 INFO:tasks.workunit.client.0.smithi049.stdout:7/754: chown d3/cd2 3039 1 2024-06-03T00:03:25.784 INFO:tasks.workunit.client.0.smithi049.stdout:7/755: symlink d3/dd8/d13/d4a/l113 0 2024-06-03T00:03:25.784 INFO:tasks.workunit.client.0.smithi049.stdout:7/756: mkdir d3/dd8/d13/d79/d114 0 2024-06-03T00:03:25.784 INFO:tasks.workunit.client.0.smithi049.stdout:7/757: fdatasync d3/d14/d6e/fe2 0 2024-06-03T00:03:25.784 INFO:tasks.workunit.client.0.smithi049.stdout:7/758: truncate d3/dd8/d13/d3c/d4b/d5a/fc2 3493195 0 2024-06-03T00:03:25.784 INFO:tasks.workunit.client.0.smithi049.stdout:7/759: creat d3/dd8/d13/d4a/dd5/dfe/f115 x:0 0 0 2024-06-03T00:03:25.784 INFO:tasks.workunit.client.0.smithi049.stdout:7/760: rmdir d3/dd8/d13/d3c/d48 39 2024-06-03T00:03:25.784 INFO:tasks.workunit.client.0.smithi049.stdout:7/761: chown d3/dd8/d13/d3c/d4b/d5a/la8 1 1 2024-06-03T00:03:25.784 INFO:tasks.workunit.client.0.smithi049.stdout:5/767: dwrite d3/d5/da/d55/d14/f2a [0,4194304] 0 2024-06-03T00:03:25.784 INFO:tasks.workunit.client.0.smithi049.stdout:0/671: dwrite d6/f4e [0,4194304] 0 2024-06-03T00:03:25.784 INFO:tasks.workunit.client.0.smithi049.stdout:7/762: write d3/dd8/f1c [5753463,30851] 0 2024-06-03T00:03:25.784 INFO:tasks.workunit.client.0.smithi049.stdout:5/768: unlink d3/d5/da/d55/d14/c1f 0 2024-06-03T00:03:25.784 INFO:tasks.workunit.client.0.smithi049.stdout:0/672: unlink d6/d29/dc8/f2b 0 2024-06-03T00:03:25.784 INFO:tasks.workunit.client.0.smithi049.stdout:7/763: mkdir d3/dd8/d13/d3c/d48/d7b/d9c/df6/d116 0 2024-06-03T00:03:25.784 INFO:tasks.workunit.client.0.smithi049.stdout:7/764: creat d3/dd8/d13/d3c/d48/d7b/d9c/dc4/f117 x:0 0 0 2024-06-03T00:03:25.784 INFO:tasks.workunit.client.0.smithi049.stdout:0/673: mknod d6/d30/da3/ce6 0 2024-06-03T00:03:25.784 INFO:tasks.workunit.client.0.smithi049.stdout:8/645: dwrite d4/d27/d3c/d88/d28/f86 [0,4194304] 0 2024-06-03T00:03:25.785 INFO:tasks.workunit.client.0.smithi049.stdout:5/769: read d3/d5/fd [1913796,101044] 0 2024-06-03T00:03:25.785 INFO:tasks.workunit.client.0.smithi049.stdout:5/770: chown d3/d5/da/d55/d14/d16 32052809 1 2024-06-03T00:03:25.785 INFO:tasks.workunit.client.0.smithi049.stdout:5/771: chown d3/d9/d20/d4c/d5a/fdf 9732062 1 2024-06-03T00:03:25.785 INFO:tasks.workunit.client.0.smithi049.stdout:5/772: creat d3/d9/d20/fee x:0 0 0 2024-06-03T00:03:25.785 INFO:tasks.workunit.client.0.smithi049.stdout:3/643: dwrite d2/d14/fac [4194304,4194304] 0 2024-06-03T00:03:25.785 INFO:tasks.workunit.client.0.smithi049.stdout:2/826: dwrite da/d52/df/d3c/f76 [0,4194304] 0 2024-06-03T00:03:25.785 INFO:tasks.workunit.client.0.smithi049.stdout:6/891: dwrite d2/d3/d17/d57/fac [4194304,4194304] 0 2024-06-03T00:03:25.785 INFO:tasks.workunit.client.0.smithi049.stdout:2/827: fdatasync da/f85 0 2024-06-03T00:03:25.785 INFO:tasks.workunit.client.0.smithi049.stdout:7/765: read d3/dd8/d9/f69 [321691,99084] 0 2024-06-03T00:03:25.785 INFO:tasks.workunit.client.0.smithi049.stdout:2/828: read - da/d52/d40/dce/ff2 zero size 2024-06-03T00:03:25.785 INFO:tasks.workunit.client.0.smithi049.stdout:3/644: readlink d2/d14/d44/d52/d4c/d4b/d98/l6e 0 2024-06-03T00:03:25.785 INFO:tasks.workunit.client.0.smithi049.stdout:2/829: creat da/d72/d83/f104 x:0 0 0 2024-06-03T00:03:25.785 INFO:tasks.workunit.client.0.smithi049.stdout:2/830: rmdir da/d52/df 39 2024-06-03T00:03:25.785 INFO:tasks.workunit.client.0.smithi049.stdout:3/645: mknod d2/d1a/d34/dd5/d75/ce6 0 2024-06-03T00:03:25.785 INFO:tasks.workunit.client.0.smithi049.stdout:5/773: dread d3/d9/d20/d4c/d5a/d6f/fc8 [0,4194304] 0 2024-06-03T00:03:25.785 INFO:tasks.workunit.client.0.smithi049.stdout:5/774: write d3/d5/da/d55/d14/f47 [356486,80031] 0 2024-06-03T00:03:25.786 INFO:tasks.workunit.client.0.smithi049.stdout:5/775: dread - d3/d9/d20/fee zero size 2024-06-03T00:03:25.786 INFO:tasks.workunit.client.0.smithi049.stdout:3/646: chown d2/d1a/f20 393 1 2024-06-03T00:03:25.786 INFO:tasks.workunit.client.0.smithi049.stdout:3/647: truncate d2/d14/d22/d42/d8f/fb4 309998 0 2024-06-03T00:03:25.786 INFO:tasks.workunit.client.0.smithi049.stdout:0/674: dwrite d6/d30/d32/dca/fcc [0,4194304] 0 2024-06-03T00:03:25.786 INFO:tasks.workunit.client.0.smithi049.stdout:2/831: rmdir da/d52/df/d3c/d60 39 2024-06-03T00:03:25.786 INFO:tasks.workunit.client.0.smithi049.stdout:7/766: rename d3/dd8/d13/d3c/d48/d7b/d9c/dc4/de6 to d3/dd8/d9/d8f/d118 0 2024-06-03T00:03:25.786 INFO:tasks.workunit.client.0.smithi049.stdout:2/832: chown da/d72/d83/c86 27 1 2024-06-03T00:03:25.786 INFO:tasks.workunit.client.0.smithi049.stdout:3/648: mknod d2/d14/d44/d52/d4c/ce7 0 2024-06-03T00:03:25.786 INFO:tasks.workunit.client.0.smithi049.stdout:3/649: dread - d2/d14/d44/d52/d4c/d4b/fcc zero size 2024-06-03T00:03:25.786 INFO:tasks.workunit.client.0.smithi049.stdout:7/767: chown d3/dd8/d13/d3c/d48/d7b/d9c/c62 10 1 2024-06-03T00:03:25.786 INFO:tasks.workunit.client.0.smithi049.stdout:3/650: unlink d2/d14/d44/d52/d4c/d4b/d58/f8d 0 2024-06-03T00:03:25.786 INFO:tasks.workunit.client.0.smithi049.stdout:3/651: write d2/d14/d22/d3a/fd8 [789024,127198] 0 2024-06-03T00:03:25.786 INFO:tasks.workunit.client.0.smithi049.stdout:8/646: dwrite d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/dab/fb6 [0,4194304] 0 2024-06-03T00:03:25.787 INFO:tasks.workunit.client.0.smithi049.stdout:0/675: link d6/d30/c28 d6/d29/dc8/ce7 0 2024-06-03T00:03:25.787 INFO:tasks.workunit.client.0.smithi049.stdout:0/676: readlink d6/d30/d32/dca/l76 0 2024-06-03T00:03:25.787 INFO:tasks.workunit.client.0.smithi049.stdout:6/892: write d2/f11 [1102259,40225] 0 2024-06-03T00:03:25.787 INFO:tasks.workunit.client.0.smithi049.stdout:5/776: read d3/d5/d2d/d4b/d51/f6c [6587351,20250] 0 2024-06-03T00:03:25.787 INFO:tasks.workunit.client.0.smithi049.stdout:8/647: dread d4/d27/d3c/d88/f22 [0,4194304] 0 2024-06-03T00:03:25.787 INFO:tasks.workunit.client.0.smithi049.stdout:6/893: rmdir d2/d3/d9/d23/d48/d89 39 2024-06-03T00:03:25.787 INFO:tasks.workunit.client.0.smithi049.stdout:6/894: read d2/d3/d17/d57/d6e/d88/dde/de9/f45 [4124950,83160] 0 2024-06-03T00:03:25.787 INFO:tasks.workunit.client.0.smithi049.stdout:5/777: dread d3/d5/da/d55/d75/fe9 [0,4194304] 0 2024-06-03T00:03:25.787 INFO:tasks.workunit.client.0.smithi049.stdout:6/895: mknod d2/d3/d17/d57/d6e/d88/dde/de9/da6/c12c 0 2024-06-03T00:03:25.787 INFO:tasks.workunit.client.0.smithi049.stdout:5/778: fsync d3/d5/da/d55/d14/f47 0 2024-06-03T00:03:25.787 INFO:tasks.workunit.client.0.smithi049.stdout:6/896: creat d2/d3/d17/d57/d6e/d88/d119/f12d x:0 0 0 2024-06-03T00:03:25.787 INFO:tasks.workunit.client.0.smithi049.stdout:3/652: write d2/fd [6319228,19780] 0 2024-06-03T00:03:25.787 INFO:tasks.workunit.client.0.smithi049.stdout:3/653: fsync d2/d14/d44/d52/d4c/d4b/d58/fe4 0 2024-06-03T00:03:25.788 INFO:tasks.workunit.client.0.smithi049.stdout:5/779: rename d3/d5/fda to d3/d5/d2d/d4b/d51/fef 0 2024-06-03T00:03:25.788 INFO:tasks.workunit.client.0.smithi049.stdout:5/780: write d3/d5/fd6 [1402532,125809] 0 2024-06-03T00:03:25.788 INFO:tasks.workunit.client.0.smithi049.stdout:6/897: truncate d2/d3/d17/d64/fc8 631158 0 2024-06-03T00:03:25.788 INFO:tasks.workunit.client.0.smithi049.stdout:6/898: fsync d2/d3/d17/d57/d6e/d88/f94 0 2024-06-03T00:03:25.788 INFO:tasks.workunit.client.0.smithi049.stdout:5/781: symlink d3/d9/d20/d4c/lf0 0 2024-06-03T00:03:25.788 INFO:tasks.workunit.client.0.smithi049.stdout:5/782: stat d3/d5/da/fe0 0 2024-06-03T00:03:25.788 INFO:tasks.workunit.client.0.smithi049.stdout:6/899: chown d2/lc 1081387 1 2024-06-03T00:03:25.788 INFO:tasks.workunit.client.0.smithi049.stdout:6/900: readlink d2/d3/d9/d40/la8 0 2024-06-03T00:03:25.788 INFO:tasks.workunit.client.0.smithi049.stdout:7/768: write d3/dd8/d13/d3c/d48/fb5 [428624,129856] 0 2024-06-03T00:03:25.788 INFO:tasks.workunit.client.0.smithi049.stdout:6/901: symlink d2/d3/d9/d23/d48/d53/d116/l12e 0 2024-06-03T00:03:25.788 INFO:tasks.workunit.client.0.smithi049.stdout:7/769: fdatasync d3/dd8/f25 0 2024-06-03T00:03:25.789 INFO:tasks.workunit.client.0.smithi049.stdout:6/902: fsync d2/d3/d9/f54 0 2024-06-03T00:03:25.789 INFO:tasks.workunit.client.0.smithi049.stdout:2/833: dwrite da/d52/df/d3c/d60/ffd [0,4194304] 0 2024-06-03T00:03:25.789 INFO:tasks.workunit.client.0.smithi049.stdout:2/834: write da/d72/d83/f104 [176538,74199] 0 2024-06-03T00:03:25.789 INFO:tasks.workunit.client.0.smithi049.stdout:7/770: truncate d3/dd8/d86/ff9 291551 0 2024-06-03T00:03:25.789 INFO:tasks.workunit.client.0.smithi049.stdout:5/783: mkdir d3/d53/d9c/da4/db9/df1 0 2024-06-03T00:03:25.789 INFO:tasks.workunit.client.0.smithi049.stdout:8/648: write d4/d27/d3c/d88/f91 [235615,10703] 0 2024-06-03T00:03:25.789 INFO:tasks.workunit.client.0.smithi049.stdout:5/784: unlink d3/d9/d20/c3c 0 2024-06-03T00:03:25.789 INFO:tasks.workunit.client.0.smithi049.stdout:6/903: write d2/d3/d9/d23/d48/d53/d118/f124 [667159,67543] 0 2024-06-03T00:03:25.789 INFO:tasks.workunit.client.0.smithi049.stdout:6/904: symlink d2/d3/d9/d23/d29/l12f 0 2024-06-03T00:03:25.789 INFO:tasks.workunit.client.0.smithi049.stdout:8/649: creat d4/d27/d3c/d88/d28/d2b/d84/fd0 x:0 0 0 2024-06-03T00:03:25.789 INFO:tasks.workunit.client.0.smithi049.stdout:0/677: dwrite d6/d59/d72/d94/fe5 [0,4194304] 0 2024-06-03T00:03:25.789 INFO:tasks.workunit.client.0.smithi049.stdout:0/678: truncate d6/d59/d72/fbe 599328 0 2024-06-03T00:03:25.789 INFO:tasks.workunit.client.0.smithi049.stdout:6/905: creat d2/d3/d17/d57/d6e/dd3/de2/f130 x:0 0 0 2024-06-03T00:03:25.789 INFO:tasks.workunit.client.0.smithi049.stdout:7/771: dread d3/dd8/d13/f94 [0,4194304] 0 2024-06-03T00:03:25.789 INFO:tasks.workunit.client.0.smithi049.stdout:8/650: rename d4/d27/d3c/d88/d28/d2b/d84/f9e to d4/d27/d30/fd1 0 2024-06-03T00:03:25.790 INFO:tasks.workunit.client.0.smithi049.stdout:8/651: symlink d4/d27/d3c/d43/d6b/da6/ld2 0 2024-06-03T00:03:25.790 INFO:tasks.workunit.client.0.smithi049.stdout:0/679: unlink d6/c15 0 2024-06-03T00:03:25.790 INFO:tasks.workunit.client.0.smithi049.stdout:5/785: dread d3/d5/d9a/f9b [0,4194304] 0 2024-06-03T00:03:25.790 INFO:tasks.workunit.client.0.smithi049.stdout:6/906: mknod d2/d4d/c131 0 2024-06-03T00:03:25.790 INFO:tasks.workunit.client.0.smithi049.stdout:5/786: creat d3/d5/da/d55/d75/ff2 x:0 0 0 2024-06-03T00:03:25.791 INFO:tasks.workunit.client.0.smithi049.stdout:7/772: truncate d3/f22 2228057 0 2024-06-03T00:03:25.791 INFO:tasks.workunit.client.0.smithi049.stdout:3/654: dwrite d2/d1a/d34/dd5/f7e [0,4194304] 0 2024-06-03T00:03:25.791 INFO:tasks.workunit.client.0.smithi049.stdout:0/680: getdents d6/d97/d4b/d67 0 2024-06-03T00:03:25.791 INFO:tasks.workunit.client.0.smithi049.stdout:8/652: rename d4/d27/f4b to d4/d27/d3c/d88/fd3 0 2024-06-03T00:03:25.791 INFO:tasks.workunit.client.0.smithi049.stdout:5/787: truncate d3/d5/fc7 330483 0 2024-06-03T00:03:25.791 INFO:tasks.workunit.client.0.smithi049.stdout:6/907: creat d2/d4d/d76/dfd/f132 x:0 0 0 2024-06-03T00:03:25.792 INFO:tasks.workunit.client.0.smithi049.stdout:3/655: dread - d2/d1a/d76/f99 zero size 2024-06-03T00:03:25.792 INFO:tasks.workunit.client.0.smithi049.stdout:3/656: chown d2/d1a/d34/dd5/c67 4641 1 2024-06-03T00:03:25.792 INFO:tasks.workunit.client.0.smithi049.stdout:3/657: chown d2/d1a/d76/fde 1357972 1 2024-06-03T00:03:25.792 INFO:tasks.workunit.client.0.smithi049.stdout:6/908: truncate d2/d4d/fe8 840581 0 2024-06-03T00:03:25.792 INFO:tasks.workunit.client.0.smithi049.stdout:8/653: rename d4/d27/d3c/d88/d28/d52/fce to d4/d27/d3c/d88/d28/d2b/d84/dba/fd4 0 2024-06-03T00:03:25.792 INFO:tasks.workunit.client.0.smithi049.stdout:7/773: symlink d3/dd8/d9/d8f/l119 0 2024-06-03T00:03:25.792 INFO:tasks.workunit.client.0.smithi049.stdout:5/788: mknod d3/d5/d9a/cf3 0 2024-06-03T00:03:25.792 INFO:tasks.workunit.client.0.smithi049.stdout:7/774: readlink d3/dd8/d13/l99 0 2024-06-03T00:03:25.792 INFO:tasks.workunit.client.0.smithi049.stdout:8/654: mknod d4/d27/cd5 0 2024-06-03T00:03:25.792 INFO:tasks.workunit.client.0.smithi049.stdout:5/789: mkdir d3/d5/da/d55/df4 0 2024-06-03T00:03:25.792 INFO:tasks.workunit.client.0.smithi049.stdout:6/909: truncate d2/d3/d17/d57/d6e/d88/dde/de9/fcf 1718710 0 2024-06-03T00:03:25.793 INFO:tasks.workunit.client.0.smithi049.stdout:5/790: readlink d3/d5/da/d55/l72 0 2024-06-03T00:03:25.793 INFO:tasks.workunit.client.0.smithi049.stdout:8/655: symlink d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/dab/ld6 0 2024-06-03T00:03:25.793 INFO:tasks.workunit.client.0.smithi049.stdout:6/910: write d2/d3/d17/d57/d6e/d88/faa [38124,19732] 0 2024-06-03T00:03:25.793 INFO:tasks.workunit.client.0.smithi049.stdout:5/791: mknod d3/d9/d20/d4c/d5a/cf5 0 2024-06-03T00:03:25.793 INFO:tasks.workunit.client.0.smithi049.stdout:8/656: mkdir d4/d27/d30/dd7 0 2024-06-03T00:03:25.793 INFO:tasks.workunit.client.0.smithi049.stdout:8/657: rmdir d4/d27/d3c/d88/d28/d25 39 2024-06-03T00:03:25.793 INFO:tasks.workunit.client.0.smithi049.stdout:5/792: symlink d3/d53/d9c/lf6 0 2024-06-03T00:03:25.793 INFO:tasks.workunit.client.0.smithi049.stdout:5/793: dread - d3/d5/d2d/d4b/d51/fef zero size 2024-06-03T00:03:25.793 INFO:tasks.workunit.client.0.smithi049.stdout:8/658: creat d4/d27/d3c/d88/fd8 x:0 0 0 2024-06-03T00:03:25.793 INFO:tasks.workunit.client.0.smithi049.stdout:5/794: mkdir d3/d5/da/d55/df4/df7 0 2024-06-03T00:03:25.793 INFO:tasks.workunit.client.0.smithi049.stdout:8/659: stat d4/d27/d3c/d88/d28/d52/d66/d53/d6c/l93 0 2024-06-03T00:03:25.795 INFO:tasks.workunit.client.0.smithi049.stdout:8/660: mkdir d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/da9/dd9 0 2024-06-03T00:03:25.795 INFO:tasks.workunit.client.0.smithi049.stdout:6/911: dread d2/d3/d9/d23/d29/f2d [0,4194304] 0 2024-06-03T00:03:25.795 INFO:tasks.workunit.client.0.smithi049.stdout:3/658: dwrite d2/d14/d22/d42/d68/d80/fe1 [0,4194304] 0 2024-06-03T00:03:25.795 INFO:tasks.workunit.client.0.smithi049.stdout:5/795: write d3/d5/f58 [866940,92743] 0 2024-06-03T00:03:25.795 INFO:tasks.workunit.client.0.smithi049.stdout:6/912: rename d2/d4d/d76/dfd to d2/d133 0 2024-06-03T00:03:25.795 INFO:tasks.workunit.client.0.smithi049.stdout:3/659: mkdir d2/d1a/d76/de8 0 2024-06-03T00:03:25.796 INFO:tasks.workunit.client.0.smithi049.stdout:3/660: truncate d2/d1a/d34/dd5/d75/d94/fc1 4784363 0 2024-06-03T00:03:25.796 INFO:tasks.workunit.client.0.smithi049.stdout:6/913: creat d2/f134 x:0 0 0 2024-06-03T00:03:25.796 INFO:tasks.workunit.client.0.smithi049.stdout:6/914: stat d2/d3/d17/ddd/f106 0 2024-06-03T00:03:25.796 INFO:tasks.workunit.client.0.smithi049.stdout:8/661: dread d4/d27/d3c/f38 [0,4194304] 0 2024-06-03T00:03:25.796 INFO:tasks.workunit.client.0.smithi049.stdout:6/915: creat d2/d3/d9/d23/d48/f135 x:0 0 0 2024-06-03T00:03:25.796 INFO:tasks.workunit.client.0.smithi049.stdout:3/661: rename d2/d14/d44/d52/d4c/d4b/dca to d2/d1a/d34/de9 0 2024-06-03T00:03:25.796 INFO:tasks.workunit.client.0.smithi049.stdout:6/916: rmdir d2/d3/d17/d57/d6e/d88/dde/de9 39 2024-06-03T00:03:25.796 INFO:tasks.workunit.client.0.smithi049.stdout:3/662: symlink d2/d1a/d34/de9/de0/lea 0 2024-06-03T00:03:25.796 INFO:tasks.workunit.client.0.smithi049.stdout:8/662: mkdir d4/d27/d3c/d88/d28/d52/d66/d53/d6c/dda 0 2024-06-03T00:03:25.797 INFO:tasks.workunit.client.0.smithi049.stdout:0/681: dwrite d6/d30/d32/fcd [0,4194304] 0 2024-06-03T00:03:25.797 INFO:tasks.workunit.client.0.smithi049.stdout:0/682: fsync d6/d29/dc8/d52/f81 0 2024-06-03T00:03:25.797 INFO:tasks.workunit.client.0.smithi049.stdout:8/663: rmdir d4/d27/d3c/d88/d28/d52/d66/d53 39 2024-06-03T00:03:25.797 INFO:tasks.workunit.client.0.smithi049.stdout:8/664: chown d4/d27/d3c/d88/d28/d2b/d84/dba 627504191 1 2024-06-03T00:03:25.798 INFO:tasks.workunit.client.0.smithi049.stdout:0/683: mknod d6/d97/d4b/ce8 0 2024-06-03T00:03:25.798 INFO:tasks.workunit.client.0.smithi049.stdout:3/663: mkdir d2/d14/d44/deb 0 2024-06-03T00:03:25.799 INFO:tasks.workunit.client.0.smithi049.stdout:8/665: rmdir d4/d27/d3c/d88/d28/d52/d66/d53/d6c 39 2024-06-03T00:03:25.799 INFO:tasks.workunit.client.0.smithi049.stdout:8/666: stat d4/d27/d3c/d88/d28/d45 0 2024-06-03T00:03:25.801 INFO:tasks.workunit.client.0.smithi049.stdout:0/684: symlink d6/d59/le9 0 2024-06-03T00:03:25.802 INFO:tasks.workunit.client.0.smithi049.stdout:6/917: write d2/d3/d9/d23/d48/ff1 [6607216,124711] 0 2024-06-03T00:03:25.804 INFO:tasks.workunit.client.0.smithi049.stdout:3/664: mkdir d2/d14/d44/d52/d4c/d4b/d98/dec 0 2024-06-03T00:03:25.805 INFO:tasks.workunit.client.0.smithi049.stdout:8/667: symlink d4/d27/d3c/d88/d28/d52/ldb 0 2024-06-03T00:03:25.805 INFO:tasks.workunit.client.0.smithi049.stdout:6/918: mkdir d2/d3/d17/d57/d6e/dd3/de2/d136 0 2024-06-03T00:03:25.805 INFO:tasks.workunit.client.0.smithi049.stdout:6/919: readlink d2/d3/d9/d23/l3f 0 2024-06-03T00:03:25.805 INFO:tasks.workunit.client.0.smithi049.stdout:6/920: chown d2/d3/d17/d57/d6e/d88/f94 755996 1 2024-06-03T00:03:25.806 INFO:tasks.workunit.client.0.smithi049.stdout:6/921: truncate d2/d3/d17/f6b 2763137 0 2024-06-03T00:03:25.807 INFO:tasks.workunit.client.0.smithi049.stdout:3/665: mknod d2/d14/d22/d3a/ced 0 2024-06-03T00:03:25.808 INFO:tasks.workunit.client.0.smithi049.stdout:6/922: rmdir d2/d3/d9/d23/d29/dd6 39 2024-06-03T00:03:25.809 INFO:tasks.workunit.client.0.smithi049.stdout:6/923: truncate d2/d3/d9/d23/fc3 1285115 0 2024-06-03T00:03:25.809 INFO:tasks.workunit.client.0.smithi049.stdout:3/666: mkdir d2/d1a/d34/dd5/d75/d94/dd1/da0/de3/dee 0 2024-06-03T00:03:25.811 INFO:tasks.workunit.client.0.smithi049.stdout:5/796: write d3/d5/d2d/d4b/d62/f6d [1427248,90009] 0 2024-06-03T00:03:25.814 INFO:tasks.workunit.client.0.smithi049.stdout:5/797: read - d3/d5/da/d55/d14/fa7 zero size 2024-06-03T00:03:25.814 INFO:tasks.workunit.client.0.smithi049.stdout:5/798: stat d3/d5/d24 0 2024-06-03T00:03:25.814 INFO:tasks.workunit.client.0.smithi049.stdout:5/799: chown d3/d5/d2d/d4b/d51/fea 1 1 2024-06-03T00:03:25.815 INFO:tasks.workunit.client.0.smithi049.stdout:3/667: mknod d2/d1a/d51/d83/cef 0 2024-06-03T00:03:25.815 INFO:tasks.workunit.client.0.smithi049.stdout:6/924: dread d2/d3/d17/f77 [0,4194304] 0 2024-06-03T00:03:25.815 INFO:tasks.workunit.client.0.smithi049.stdout:6/925: chown d2/d3/d9/d23/d48/d51 357411 1 2024-06-03T00:03:25.819 INFO:tasks.workunit.client.0.smithi049.stdout:3/668: rmdir d2/d1a/d34/dd5/d75/d94/dd1 39 2024-06-03T00:03:25.821 INFO:tasks.workunit.client.0.smithi049.stdout:3/669: creat d2/d1a/d51/d83/ff0 x:0 0 0 2024-06-03T00:03:25.821 INFO:tasks.workunit.client.0.smithi049.stdout:0/685: dwrite d6/d30/da3/fd3 [0,4194304] 0 2024-06-03T00:03:25.822 INFO:tasks.workunit.client.0.smithi049.stdout:3/670: write d2/d1a/d51/d83/fcd [280008,26555] 0 2024-06-03T00:03:25.824 INFO:tasks.workunit.client.0.smithi049.stdout:0/686: mknod d6/d97/d4b/cea 0 2024-06-03T00:03:25.826 INFO:tasks.workunit.client.0.smithi049.stdout:0/687: mkdir d6/d29/dc8/d52/deb 0 2024-06-03T00:03:25.828 INFO:tasks.workunit.client.0.smithi049.stdout:5/800: dread d3/d9/d68/f70 [0,4194304] 0 2024-06-03T00:03:25.830 INFO:tasks.workunit.client.0.smithi049.stdout:5/801: unlink d3/d9/d20/d4c/d5a/d6f/f8b 0 2024-06-03T00:03:25.830 INFO:tasks.workunit.client.0.smithi049.stdout:5/802: truncate d3/d7d/fd0 1147259 0 2024-06-03T00:03:25.833 INFO:tasks.workunit.client.0.smithi049.stdout:5/803: rename d3/d5/f4d to d3/d53/dc1/ff8 0 2024-06-03T00:03:25.833 INFO:tasks.workunit.client.0.smithi049.stdout:5/804: fsync d3/d5/d2d/d4b/f59 0 2024-06-03T00:03:25.834 INFO:tasks.workunit.client.0.smithi049.stdout:5/805: write d3/d5/da/d55/d14/d16/f25 [6104169,60245] 0 2024-06-03T00:03:25.834 INFO:tasks.workunit.client.0.smithi049.stdout:5/806: read d3/d9/d20/f41 [738659,106594] 0 2024-06-03T00:03:25.837 INFO:tasks.workunit.client.0.smithi049.stdout:0/688: dread d6/d30/d32/fcd [0,4194304] 0 2024-06-03T00:03:25.845 INFO:tasks.workunit.client.0.smithi049.stdout:3/671: dwrite d2/d1a/d51/d83/ff0 [0,4194304] 0 2024-06-03T00:03:25.845 INFO:tasks.workunit.client.0.smithi049.stdout:8/668: dwrite d4/d27/d3c/d88/d48/f5d [0,4194304] 0 2024-06-03T00:03:25.845 INFO:tasks.workunit.client.0.smithi049.stdout:8/669: write d4/d27/d3c/d88/f91 [1497819,120097] 0 2024-06-03T00:03:25.851 INFO:tasks.workunit.client.0.smithi049.stdout:5/807: dwrite d3/d5/d9a/fb7 [0,4194304] 0 2024-06-03T00:03:25.853 INFO:tasks.workunit.client.0.smithi049.stdout:8/670: symlink d4/d27/d3c/d43/d6b/ldc 0 2024-06-03T00:03:25.856 INFO:tasks.workunit.client.0.smithi049.stdout:5/808: mkdir d3/d5/da/d55/d14/d16/df9 0 2024-06-03T00:03:25.858 INFO:tasks.workunit.client.0.smithi049.stdout:8/671: chown d4/d27/d3c/d88/d48/d8f/cac 423 1 2024-06-03T00:03:25.860 INFO:tasks.workunit.client.0.smithi049.stdout:5/809: creat d3/d5/de2/dec/ffa x:0 0 0 2024-06-03T00:03:25.861 INFO:tasks.workunit.client.0.smithi049.stdout:4/782: sync 2024-06-03T00:03:25.863 INFO:tasks.workunit.client.0.smithi049.stdout:4/783: creat d4/d3f/d14/d7f/d87/f10d x:0 0 0 2024-06-03T00:03:25.863 INFO:tasks.workunit.client.0.smithi049.stdout:4/784: stat d4/d3f/d14/d2b/d84/d69 0 2024-06-03T00:03:25.863 INFO:tasks.workunit.client.0.smithi049.stdout:4/785: readlink d4/d3f/d14/d7f/ddb/le2 0 2024-06-03T00:03:25.863 INFO:tasks.workunit.client.0.smithi049.stdout:8/672: symlink d4/d27/d3c/d88/d48/ldd 0 2024-06-03T00:03:25.865 INFO:tasks.workunit.client.0.smithi049.stdout:4/786: truncate d4/d3f/f4d 378335 0 2024-06-03T00:03:25.866 INFO:tasks.workunit.client.0.smithi049.stdout:4/787: mknod d4/d3f/d14/d7f/ddb/df5/c10e 0 2024-06-03T00:03:25.866 INFO:tasks.workunit.client.0.smithi049.stdout:8/673: mkdir d4/d27/d3c/d88/d48/dde 0 2024-06-03T00:03:25.867 INFO:tasks.workunit.client.0.smithi049.stdout:3/672: dwrite d2/d1a/d34/dd5/d75/d94/dd1/db6/fd6 [0,4194304] 0 2024-06-03T00:03:25.867 INFO:tasks.workunit.client.0.smithi049.stdout:4/788: creat d4/d3f/d14/d2b/d84/d69/dc6/f10f x:0 0 0 2024-06-03T00:03:25.872 INFO:tasks.workunit.client.0.smithi049.stdout:3/673: truncate d2/d1a/d34/dd5/f7e 2487857 0 2024-06-03T00:03:25.874 INFO:tasks.workunit.client.0.smithi049.stdout:4/789: write d4/fa8 [769897,102232] 0 2024-06-03T00:03:25.880 INFO:tasks.workunit.client.0.smithi049.stdout:4/790: write d4/d3f/d14/d2b/d84/f9b [172165,474] 0 2024-06-03T00:03:25.889 INFO:tasks.workunit.client.0.smithi049.stdout:5/810: dwrite d3/d53/dc1/ff8 [4194304,4194304] 0 2024-06-03T00:03:25.891 INFO:tasks.workunit.client.0.smithi049.stdout:5/811: truncate d3/d5/da/d55/d14/f47 2581926 0 2024-06-03T00:03:25.892 INFO:tasks.workunit.client.0.smithi049.stdout:5/812: truncate d3/d5/da/d55/d75/fe9 1820152 0 2024-06-03T00:03:25.893 INFO:tasks.workunit.client.0.smithi049.stdout:8/674: dwrite d4/d27/d3c/d88/d28/d52/d66/d53/d6c/fc9 [0,4194304] 0 2024-06-03T00:03:25.898 INFO:tasks.workunit.client.0.smithi049.stdout:8/675: dread - d4/d27/d3c/d88/d28/d25/f57 zero size 2024-06-03T00:03:25.899 INFO:tasks.workunit.client.0.smithi049.stdout:8/676: creat d4/d27/d3c/d88/d28/d25/fdf x:0 0 0 2024-06-03T00:03:25.900 INFO:tasks.workunit.client.0.smithi049.stdout:8/677: mknod d4/d27/d3c/d88/d28/d2b/d84/dba/ce0 0 2024-06-03T00:03:25.900 INFO:tasks.workunit.client.0.smithi049.stdout:8/678: fsync d4/d27/d3c/d88/d28/d52/fc5 0 2024-06-03T00:03:25.900 INFO:tasks.workunit.client.0.smithi049.stdout:8/679: write d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/fbe [678111,65269] 0 2024-06-03T00:03:25.902 INFO:tasks.workunit.client.0.smithi049.stdout:8/680: creat d4/d27/d3c/d43/d6b/fe1 x:0 0 0 2024-06-03T00:03:25.915 INFO:tasks.workunit.client.0.smithi049.stdout:5/813: dwrite d3/d5/da/f50 [0,4194304] 0 2024-06-03T00:03:25.916 INFO:tasks.workunit.client.0.smithi049.stdout:5/814: write d3/d5/d2d/f92 [1155425,9131] 0 2024-06-03T00:03:25.916 INFO:tasks.workunit.client.0.smithi049.stdout:5/815: chown d3/d5/da/f1d 925 1 2024-06-03T00:03:25.918 INFO:tasks.workunit.client.0.smithi049.stdout:5/816: rename d3/d9/d20/d4c/d5a/d6f/fc8 to d3/d5/d2d/d4b/d97/dde/ffb 0 2024-06-03T00:03:25.920 INFO:tasks.workunit.client.0.smithi049.stdout:4/791: dwrite d4/d3f/d14/d2b/d84/d1c/d4f/f5c [0,4194304] 0 2024-06-03T00:03:25.920 INFO:tasks.workunit.client.0.smithi049.stdout:5/817: creat d3/d9/d20/d4c/d9d/ffc x:0 0 0 2024-06-03T00:03:25.921 INFO:tasks.workunit.client.0.smithi049.stdout:4/792: rmdir d4/d3f/d14/d2b/d84/d69 39 2024-06-03T00:03:25.921 INFO:tasks.workunit.client.0.smithi049.stdout:5/818: readlink d3/l54 0 2024-06-03T00:03:25.923 INFO:tasks.workunit.client.0.smithi049.stdout:5/819: creat d3/d5/d2d/d4b/d51/ffd x:0 0 0 2024-06-03T00:03:25.925 INFO:tasks.workunit.client.0.smithi049.stdout:4/793: link d4/d3f/l70 d4/d3f/d14/d2b/d84/d69/dc6/dd3/l110 0 2024-06-03T00:03:25.925 INFO:tasks.workunit.client.0.smithi049.stdout:4/794: chown d4/d3f/d14/d2b/f48 220281383 1 2024-06-03T00:03:25.925 INFO:tasks.workunit.client.0.smithi049.stdout:4/795: chown d4/d3f/d14/d7f/d87 6067223 1 2024-06-03T00:03:25.926 INFO:tasks.workunit.client.0.smithi049.stdout:4/796: chown d4/d3f/d14/d2b/cd1 912 1 2024-06-03T00:03:25.927 INFO:tasks.workunit.client.0.smithi049.stdout:8/681: dwrite d4/d27/d3c/d88/d48/f5d [0,4194304] 0 2024-06-03T00:03:25.932 INFO:tasks.workunit.client.0.smithi049.stdout:8/682: creat d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/fe2 x:0 0 0 2024-06-03T00:03:25.933 INFO:tasks.workunit.client.0.smithi049.stdout:5/820: dread d3/d5/d2d/d4b/d97/fb6 [0,4194304] 0 2024-06-03T00:03:25.934 INFO:tasks.workunit.client.0.smithi049.stdout:8/683: mkdir d4/d27/d3c/d43/d6b/da6/de3 0 2024-06-03T00:03:25.935 INFO:tasks.workunit.client.0.smithi049.stdout:5/821: getdents d3/d5/d2d/d4b/d62 0 2024-06-03T00:03:25.935 INFO:tasks.workunit.client.0.smithi049.stdout:8/684: readlink d4/d27/d3c/d88/d48/lc8 0 2024-06-03T00:03:25.938 INFO:tasks.workunit.client.0.smithi049.stdout:5/822: mknod d3/d5/de2/cfe 0 2024-06-03T00:03:25.939 INFO:tasks.workunit.client.0.smithi049.stdout:5/823: readlink d3/d5/d24/l33 0 2024-06-03T00:03:25.939 INFO:tasks.workunit.client.0.smithi049.stdout:5/824: stat d3/d5/da/d55/d14/fa7 0 2024-06-03T00:03:25.940 INFO:tasks.workunit.client.0.smithi049.stdout:8/685: symlink d4/d27/d3c/d88/d28/d52/d66/le4 0 2024-06-03T00:03:25.941 INFO:tasks.workunit.client.0.smithi049.stdout:5/825: truncate d3/d9/f49 721570 0 2024-06-03T00:03:25.942 INFO:tasks.workunit.client.0.smithi049.stdout:5/826: mkdir d3/d5/da/d55/d14/d16/df9/dff 0 2024-06-03T00:03:25.944 INFO:tasks.workunit.client.0.smithi049.stdout:5/827: truncate d3/d5/da/d55/d14/f19 658601 0 2024-06-03T00:03:25.945 INFO:tasks.workunit.client.0.smithi049.stdout:5/828: unlink d3/d5/da/d55/d75/fe9 0 2024-06-03T00:03:25.950 INFO:tasks.workunit.client.0.smithi049.stdout:4/797: dwrite d4/d3f/d14/d2b/d84/d69/f72 [0,4194304] 0 2024-06-03T00:03:25.952 INFO:tasks.workunit.client.0.smithi049.stdout:2/835: sync 2024-06-03T00:03:25.952 INFO:tasks.workunit.client.0.smithi049.stdout:7/775: sync 2024-06-03T00:03:25.953 INFO:tasks.workunit.client.0.smithi049.stdout:2/836: fsync da/d52/f2b 0 2024-06-03T00:03:25.955 INFO:tasks.workunit.client.0.smithi049.stdout:7/776: dread d3/d14/fde [0,4194304] 0 2024-06-03T00:03:25.956 INFO:tasks.workunit.client.0.smithi049.stdout:2/837: symlink da/d52/d40/d93/l105 0 2024-06-03T00:03:25.958 INFO:tasks.workunit.client.0.smithi049.stdout:7/777: creat d3/dd8/d13/d3c/d48/d7b/d5b/f11a x:0 0 0 2024-06-03T00:03:25.959 INFO:tasks.workunit.client.0.smithi049.stdout:7/778: write d3/dd8/d13/d3c/d48/d7b/d5b/fc6 [8937181,89940] 0 2024-06-03T00:03:25.965 INFO:tasks.workunit.client.0.smithi049.stdout:3/674: sync 2024-06-03T00:03:25.965 INFO:tasks.workunit.client.0.smithi049.stdout:6/926: sync 2024-06-03T00:03:25.965 INFO:tasks.workunit.client.0.smithi049.stdout:0/689: sync 2024-06-03T00:03:25.965 INFO:tasks.workunit.client.0.smithi049.stdout:6/927: stat d2/d4d/l49 0 2024-06-03T00:03:25.965 INFO:tasks.workunit.client.0.smithi049.stdout:6/928: chown d2/d4d/d76 135 1 2024-06-03T00:03:25.965 INFO:tasks.workunit.client.0.smithi049.stdout:6/929: read - d2/d3/d9/d23/d48/d53/d116/f122 zero size 2024-06-03T00:03:25.967 INFO:tasks.workunit.client.0.smithi049.stdout:3/675: getdents d2/d1a/d34/de9/de0 0 2024-06-03T00:03:25.968 INFO:tasks.workunit.client.0.smithi049.stdout:6/930: unlink d2/d3/d17/d57/f69 0 2024-06-03T00:03:25.969 INFO:tasks.workunit.client.0.smithi049.stdout:2/838: write da/d52/d37/f56 [134443,49610] 0 2024-06-03T00:03:25.970 INFO:tasks.workunit.client.0.smithi049.stdout:4/798: dwrite d4/d3f/d14/d7f/d87/f10d [0,4194304] 0 2024-06-03T00:03:25.972 INFO:tasks.workunit.client.0.smithi049.stdout:8/686: dwrite d4/d27/d3c/d88/d28/d52/f9a [0,4194304] 0 2024-06-03T00:03:25.974 INFO:tasks.workunit.client.0.smithi049.stdout:2/839: rename da/d52/df/d3c/d7a/lb5 to da/d43/l106 0 2024-06-03T00:03:25.975 INFO:tasks.workunit.client.0.smithi049.stdout:8/687: creat d4/d27/d3c/d88/d28/d52/d66/d8e/fe5 x:0 0 0 2024-06-03T00:03:25.975 INFO:tasks.workunit.client.0.smithi049.stdout:2/840: chown da/c20 1159 1 2024-06-03T00:03:25.976 INFO:tasks.workunit.client.0.smithi049.stdout:8/688: write d4/d27/d30/fa7 [72157,27425] 0 2024-06-03T00:03:25.976 INFO:tasks.workunit.client.0.smithi049.stdout:5/829: dwrite d3/d9/d20/d4c/d9d/fd8 [0,4194304] 0 2024-06-03T00:03:25.976 INFO:tasks.workunit.client.0.smithi049.stdout:2/841: write da/f1c [1922012,81683] 0 2024-06-03T00:03:25.976 INFO:tasks.workunit.client.0.smithi049.stdout:2/842: write da/d52/d40/dce/ff2 [819197,119513] 0 2024-06-03T00:03:25.977 INFO:tasks.workunit.client.0.smithi049.stdout:2/843: write da/d55/fad [393006,39569] 0 2024-06-03T00:03:25.977 INFO:tasks.workunit.client.0.smithi049.stdout:3/676: write d2/d14/f24 [3825844,17791] 0 2024-06-03T00:03:25.980 INFO:tasks.workunit.client.0.smithi049.stdout:3/677: dread - d2/d14/d44/fb8 zero size 2024-06-03T00:03:25.980 INFO:tasks.workunit.client.0.smithi049.stdout:3/678: fsync d2/d14/f82 0 2024-06-03T00:03:25.981 INFO:tasks.workunit.client.0.smithi049.stdout:3/679: creat d2/d1a/ff1 x:0 0 0 2024-06-03T00:03:25.984 INFO:tasks.workunit.client.0.smithi049.stdout:4/799: dread d4/d3f/d14/d7f/ddb/f97 [0,4194304] 0 2024-06-03T00:03:25.985 INFO:tasks.workunit.client.0.smithi049.stdout:3/680: mknod d2/d14/d44/d52/d4c/d4b/d58/cf2 0 2024-06-03T00:03:25.986 INFO:tasks.workunit.client.0.smithi049.stdout:2/844: dread da/d52/d40/d63/daa/f6c [0,4194304] 0 2024-06-03T00:03:25.989 INFO:tasks.workunit.client.0.smithi049.stdout:4/800: rename d4/d2a/l4c to d4/d3f/d14/d7f/l111 0 2024-06-03T00:03:25.997 INFO:tasks.workunit.client.0.smithi049.stdout:0/690: dwrite d6/d30/da3/fe4 [0,4194304] 0 2024-06-03T00:03:25.997 INFO:tasks.workunit.client.0.smithi049.stdout:7/779: dwrite d3/dd8/d13/d54/f4d [0,4194304] 0 2024-06-03T00:03:25.999 INFO:tasks.workunit.client.0.smithi049.stdout:0/691: rmdir d6/d30/d32/dca 39 2024-06-03T00:03:26.000 INFO:tasks.workunit.client.0.smithi049.stdout:7/780: mkdir d3/dd8/d13/d79/d114/d11b 0 2024-06-03T00:03:26.001 INFO:tasks.workunit.client.0.smithi049.stdout:7/781: mknod d3/dd8/c11c 0 2024-06-03T00:03:26.003 INFO:tasks.workunit.client.0.smithi049.stdout:7/782: mkdir d3/dd8/d13/d3c/d48/d11d 0 2024-06-03T00:03:26.003 INFO:tasks.workunit.client.0.smithi049.stdout:7/783: mkdir d3/dd8/d13/d3c/d48/d7b/d9c/df6/d11e 0 2024-06-03T00:03:26.008 INFO:tasks.workunit.client.0.smithi049.stdout:3/681: dread d2/d1a/d34/dd5/d75/d94/dd1/db6/fd6 [0,4194304] 0 2024-06-03T00:03:26.014 INFO:tasks.workunit.client.0.smithi049.stdout:0/692: write d6/d29/dc8/d52/f81 [1192577,107174] 0 2024-06-03T00:03:26.015 INFO:tasks.workunit.client.0.smithi049.stdout:5/830: dwrite d3/d7d/fc6 [0,4194304] 0 2024-06-03T00:03:26.015 INFO:tasks.workunit.client.0.smithi049.stdout:5/831: write d3/d5/fd [4195965,98432] 0 2024-06-03T00:03:26.016 INFO:tasks.workunit.client.0.smithi049.stdout:0/693: symlink d6/d29/dc8/lec 0 2024-06-03T00:03:26.016 INFO:tasks.workunit.client.0.smithi049.stdout:0/694: chown d6/d29/f33 2379 1 2024-06-03T00:03:26.017 INFO:tasks.workunit.client.0.smithi049.stdout:3/682: dread d2/d1a/d51/d83/ff0 [0,4194304] 0 2024-06-03T00:03:26.017 INFO:tasks.workunit.client.0.smithi049.stdout:0/695: symlink d6/d97/d4b/led 0 2024-06-03T00:03:26.018 INFO:tasks.workunit.client.0.smithi049.stdout:5/832: creat d3/d9/d20/d4c/d5a/d6f/f100 x:0 0 0 2024-06-03T00:03:26.018 INFO:tasks.workunit.client.0.smithi049.stdout:6/931: dwrite d2/d3/d9/d23/d29/d30/fec [0,4194304] 0 2024-06-03T00:03:26.020 INFO:tasks.workunit.client.0.smithi049.stdout:5/833: unlink d3/d5/d2d/d4b/d51/f6c 0 2024-06-03T00:03:26.021 INFO:tasks.workunit.client.0.smithi049.stdout:5/834: rmdir d3/d5/da/d55/d75 39 2024-06-03T00:03:26.022 INFO:tasks.workunit.client.0.smithi049.stdout:5/835: chown d3/f9f 389243 1 2024-06-03T00:03:26.023 INFO:tasks.workunit.client.0.smithi049.stdout:8/689: dwrite d4/d27/d3c/d88/d28/d2b/d84/fa2 [0,4194304] 0 2024-06-03T00:03:26.024 INFO:tasks.workunit.client.0.smithi049.stdout:4/801: dwrite d4/d3f/d14/d7f/d87/f10d [0,4194304] 0 2024-06-03T00:03:26.024 INFO:tasks.workunit.client.0.smithi049.stdout:2/845: dwrite da/d72/d83/fb0 [0,4194304] 0 2024-06-03T00:03:26.025 INFO:tasks.workunit.client.0.smithi049.stdout:2/846: fsync da/d55/fbf 0 2024-06-03T00:03:26.026 INFO:tasks.workunit.client.0.smithi049.stdout:7/784: dwrite d3/dd8/d13/d4a/f2f [0,4194304] 0 2024-06-03T00:03:26.026 INFO:tasks.workunit.client.0.smithi049.stdout:0/696: write d6/d30/da3/fe4 [2497628,57216] 0 2024-06-03T00:03:26.027 INFO:tasks.workunit.client.0.smithi049.stdout:8/690: creat d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/da9/dd9/fe6 x:0 0 0 2024-06-03T00:03:26.028 INFO:tasks.workunit.client.0.smithi049.stdout:8/691: mknod d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/da9/dd9/ce7 0 2024-06-03T00:03:26.030 INFO:tasks.workunit.client.0.smithi049.stdout:7/785: truncate d3/d14/d6e/ff4 1645496 0 2024-06-03T00:03:26.030 INFO:tasks.workunit.client.0.smithi049.stdout:8/692: mknod d4/d27/ce8 0 2024-06-03T00:03:26.031 INFO:tasks.workunit.client.0.smithi049.stdout:0/697: symlink d6/d30/lee 0 2024-06-03T00:03:26.032 INFO:tasks.workunit.client.0.smithi049.stdout:7/786: readlink d3/lb9 0 2024-06-03T00:03:26.032 INFO:tasks.workunit.client.0.smithi049.stdout:4/802: dread d4/d3f/d14/d2b/d84/d1c/d4f/f88 [0,4194304] 0 2024-06-03T00:03:26.033 INFO:tasks.workunit.client.0.smithi049.stdout:0/698: write d6/d30/fac [230008,120405] 0 2024-06-03T00:03:26.033 INFO:tasks.workunit.client.0.smithi049.stdout:8/693: unlink d4/d27/d3c/d88/d28/d52/d66/d53/d7e/f8c 0 2024-06-03T00:03:26.034 INFO:tasks.workunit.client.0.smithi049.stdout:0/699: unlink d6/d30/fde 0 2024-06-03T00:03:26.034 INFO:tasks.workunit.client.0.smithi049.stdout:0/700: fsync d6/d30/f9c 0 2024-06-03T00:03:26.035 INFO:tasks.workunit.client.0.smithi049.stdout:5/836: dread d3/d5/da/f2b [0,4194304] 0 2024-06-03T00:03:26.035 INFO:tasks.workunit.client.0.smithi049.stdout:5/837: truncate d3/d9/d20/fee 657375 0 2024-06-03T00:03:26.035 INFO:tasks.workunit.client.0.smithi049.stdout:7/787: mknod d3/dd8/d13/d3c/d48/d7b/d5b/c11f 0 2024-06-03T00:03:26.035 INFO:tasks.workunit.client.0.smithi049.stdout:8/694: creat d4/d27/d3c/d88/d28/d52/fe9 x:0 0 0 2024-06-03T00:03:26.036 INFO:tasks.workunit.client.0.smithi049.stdout:4/803: mknod d4/d3f/d14/d7f/ddb/d108/c112 0 2024-06-03T00:03:26.036 INFO:tasks.workunit.client.0.smithi049.stdout:7/788: creat d3/dd8/f120 x:0 0 0 2024-06-03T00:03:26.036 INFO:tasks.workunit.client.0.smithi049.stdout:8/695: dread d4/d27/d3c/d88/d28/d52/d66/d53/d7e/fc4 [0,4194304] 0 2024-06-03T00:03:26.036 INFO:tasks.workunit.client.0.smithi049.stdout:5/838: truncate d3/d53/dc1/ff8 7994586 0 2024-06-03T00:03:26.037 INFO:tasks.workunit.client.0.smithi049.stdout:8/696: truncate d4/f9d 812162 0 2024-06-03T00:03:26.037 INFO:tasks.workunit.client.0.smithi049.stdout:7/789: mkdir d3/dd8/d13/d4a/dd5/d121 0 2024-06-03T00:03:26.037 INFO:tasks.workunit.client.0.smithi049.stdout:7/790: stat d3/dd8 0 2024-06-03T00:03:26.038 INFO:tasks.workunit.client.0.smithi049.stdout:6/932: write d2/d3/d17/d57/d6e/fad [2104148,61549] 0 2024-06-03T00:03:26.038 INFO:tasks.workunit.client.0.smithi049.stdout:5/839: rmdir d3/d9/d20/d4c/d5a 39 2024-06-03T00:03:26.038 INFO:tasks.workunit.client.0.smithi049.stdout:7/791: creat d3/dd8/d13/d4a/dd5/f122 x:0 0 0 2024-06-03T00:03:26.039 INFO:tasks.workunit.client.0.smithi049.stdout:6/933: fdatasync d2/d3/d17/f62 0 2024-06-03T00:03:26.039 INFO:tasks.workunit.client.0.smithi049.stdout:5/840: truncate f1 2603955 0 2024-06-03T00:03:26.040 INFO:tasks.workunit.client.0.smithi049.stdout:6/934: creat d2/d3/d17/f137 x:0 0 0 2024-06-03T00:03:26.043 INFO:tasks.workunit.client.0.smithi049.stdout:0/701: dread d6/d29/f79 [0,4194304] 0 2024-06-03T00:03:26.043 INFO:tasks.workunit.client.0.smithi049.stdout:3/683: dwrite d2/d1a/d76/d95/fd3 [0,4194304] 0 2024-06-03T00:03:26.043 INFO:tasks.workunit.client.0.smithi049.stdout:5/841: write d3/d53/d9c/dd3/fd5 [732403,3873] 0 2024-06-03T00:03:26.045 INFO:tasks.workunit.client.0.smithi049.stdout:0/702: symlink d6/d59/d72/lef 0 2024-06-03T00:03:26.045 INFO:tasks.workunit.client.0.smithi049.stdout:2/847: dwrite da/d52/d40/d93/fc9 [0,4194304] 0 2024-06-03T00:03:26.049 INFO:tasks.workunit.client.0.smithi049.stdout:6/935: link d2/d3/d9/d23/ld8 d2/d4d/de3/l138 0 2024-06-03T00:03:26.049 INFO:tasks.workunit.client.0.smithi049.stdout:2/848: mkdir da/d52/df/d107 0 2024-06-03T00:03:26.050 INFO:tasks.workunit.client.0.smithi049.stdout:5/842: mkdir d3/d101 0 2024-06-03T00:03:26.050 INFO:tasks.workunit.client.0.smithi049.stdout:4/804: dread d4/d3f/d14/d7f/ddb/d8a/fa9 [0,4194304] 0 2024-06-03T00:03:26.053 INFO:tasks.workunit.client.0.smithi049.stdout:2/849: creat da/d52/d40/d93/f108 x:0 0 0 2024-06-03T00:03:26.053 INFO:tasks.workunit.client.0.smithi049.stdout:3/684: rename d2/d14/c59 to d2/d14/d44/d52/d4c/d4b/d58/cf3 0 2024-06-03T00:03:26.058 INFO:tasks.workunit.client.0.smithi049.stdout:6/936: rename d2/d4d/c131 to d2/d3/d9/d23/d29/d30/c139 0 2024-06-03T00:03:26.061 INFO:tasks.workunit.client.0.smithi049.stdout:5/843: symlink d3/d5/da/d55/d75/l102 0 2024-06-03T00:03:26.062 INFO:tasks.workunit.client.0.smithi049.stdout:6/937: creat d2/d3/d9/d23/d29/dd4/f13a x:0 0 0 2024-06-03T00:03:26.062 INFO:tasks.workunit.client.0.smithi049.stdout:6/938: write d2/f134 [863014,84242] 0 2024-06-03T00:03:26.063 INFO:tasks.workunit.client.0.smithi049.stdout:5/844: symlink d3/d5/d2d/l103 0 2024-06-03T00:03:26.063 INFO:tasks.workunit.client.0.smithi049.stdout:6/939: fdatasync d2/f3e 0 2024-06-03T00:03:26.065 INFO:tasks.workunit.client.0.smithi049.stdout:3/685: dread d2/f15 [0,4194304] 0 2024-06-03T00:03:26.067 INFO:tasks.workunit.client.0.smithi049.stdout:3/686: fdatasync d2/d14/d44/fa5 0 2024-06-03T00:03:26.070 INFO:tasks.workunit.client.0.smithi049.stdout:2/850: dread da/d52/f26 [0,4194304] 0 2024-06-03T00:03:26.070 INFO:tasks.workunit.client.0.smithi049.stdout:3/687: unlink d2/d14/f24 0 2024-06-03T00:03:26.072 INFO:tasks.workunit.client.0.smithi049.stdout:2/851: mknod da/d52/d73/da6/c109 0 2024-06-03T00:03:26.072 INFO:tasks.workunit.client.0.smithi049.stdout:5/845: write d3/d9/d20/d4c/d5a/d65/f69 [2065674,24180] 0 2024-06-03T00:03:26.073 INFO:tasks.workunit.client.0.smithi049.stdout:5/846: write d3/d5/da/d55/d14/d16/f8e [1903742,62395] 0 2024-06-03T00:03:26.076 INFO:tasks.workunit.client.0.smithi049.stdout:0/703: dwrite d6/d30/d32/fcd [0,4194304] 0 2024-06-03T00:03:26.077 INFO:tasks.workunit.client.0.smithi049.stdout:5/847: dread d3/d5/da/d55/d14/f60 [0,4194304] 0 2024-06-03T00:03:26.077 INFO:tasks.workunit.client.0.smithi049.stdout:5/848: truncate d3/d5/de2/dec/ffa 385694 0 2024-06-03T00:03:26.081 INFO:tasks.workunit.client.0.smithi049.stdout:3/688: dread d2/d14/d44/d52/f1e [0,4194304] 0 2024-06-03T00:03:26.081 INFO:tasks.workunit.client.0.smithi049.stdout:4/805: dwrite d4/d2a/d76/fd7 [0,4194304] 0 2024-06-03T00:03:26.081 INFO:tasks.workunit.client.0.smithi049.stdout:3/689: chown d2/d1a/d34/dd5/d75/d94/fd9 13 1 2024-06-03T00:03:26.083 INFO:tasks.workunit.client.0.smithi049.stdout:3/690: stat d2/d14/d22/d3a/d47 0 2024-06-03T00:03:26.083 INFO:tasks.workunit.client.0.smithi049.stdout:3/691: truncate d2/d1a/d34/fae 851679 0 2024-06-03T00:03:26.086 INFO:tasks.workunit.client.0.smithi049.stdout:3/692: mknod d2/d14/d22/d42/d8f/cf4 0 2024-06-03T00:03:26.088 INFO:tasks.workunit.client.0.smithi049.stdout:3/693: creat d2/d14/ff5 x:0 0 0 2024-06-03T00:03:26.091 INFO:tasks.workunit.client.0.smithi049.stdout:3/694: mkdir d2/d1a/d76/df6 0 2024-06-03T00:03:26.091 INFO:tasks.workunit.client.0.smithi049.stdout:3/695: creat d2/d1a/d76/de8/ff7 x:0 0 0 2024-06-03T00:03:26.092 INFO:tasks.workunit.client.0.smithi049.stdout:3/696: getdents d2/d14/d44/d52/d4c/d4b/daf 0 2024-06-03T00:03:26.093 INFO:tasks.workunit.client.0.smithi049.stdout:3/697: fsync d2/d1a/d34/dd5/f7e 0 2024-06-03T00:03:26.096 INFO:tasks.workunit.client.0.smithi049.stdout:0/704: dread d6/d59/fb6 [0,4194304] 0 2024-06-03T00:03:26.097 INFO:tasks.workunit.client.0.smithi049.stdout:0/705: symlink d6/d30/da3/lf0 0 2024-06-03T00:03:26.099 INFO:tasks.workunit.client.0.smithi049.stdout:8/697: dwrite d4/d27/d3c/f2c [0,4194304] 0 2024-06-03T00:03:26.099 INFO:tasks.workunit.client.0.smithi049.stdout:6/940: dwrite d2/d3/d9/d23/d48/d51/fc0 [0,4194304] 0 2024-06-03T00:03:26.099 INFO:tasks.workunit.client.0.smithi049.stdout:6/941: fdatasync d2/d4d/d76/de4/f128 0 2024-06-03T00:03:26.100 INFO:tasks.workunit.client.0.smithi049.stdout:8/698: dread - d4/d27/d3c/d88/d28/d52/d66/d53/d7e/f64 zero size 2024-06-03T00:03:26.100 INFO:tasks.workunit.client.0.smithi049.stdout:6/942: creat d2/d4d/d76/de4/d11e/f13b x:0 0 0 2024-06-03T00:03:26.101 INFO:tasks.workunit.client.0.smithi049.stdout:5/849: dwrite d3/d9/d20/d4c/fd4 [0,4194304] 0 2024-06-03T00:03:26.102 INFO:tasks.workunit.client.0.smithi049.stdout:0/706: write d6/d30/d32/f64 [134259,14917] 0 2024-06-03T00:03:26.104 INFO:tasks.workunit.client.0.smithi049.stdout:0/707: mknod d6/d59/d93/cf1 0 2024-06-03T00:03:26.104 INFO:tasks.workunit.client.0.smithi049.stdout:6/943: dread d2/d3/d9/d23/fc3 [0,4194304] 0 2024-06-03T00:03:26.105 INFO:tasks.workunit.client.0.smithi049.stdout:0/708: creat d6/d30/ff2 x:0 0 0 2024-06-03T00:03:26.105 INFO:tasks.workunit.client.0.smithi049.stdout:5/850: link d3/d9/d68/f78 d3/d5/da/d55/df4/f104 0 2024-06-03T00:03:26.106 INFO:tasks.workunit.client.0.smithi049.stdout:6/944: mknod d2/d4d/d76/de4/d11e/c13c 0 2024-06-03T00:03:26.106 INFO:tasks.workunit.client.0.smithi049.stdout:2/852: dwrite da/d52/d40/d93/fd0 [0,4194304] 0 2024-06-03T00:03:26.106 INFO:tasks.workunit.client.0.smithi049.stdout:5/851: symlink d3/d9/d20/d4c/l105 0 2024-06-03T00:03:26.107 INFO:tasks.workunit.client.0.smithi049.stdout:0/709: unlink d6/d59/d72/d94/fd8 0 2024-06-03T00:03:26.107 INFO:tasks.workunit.client.0.smithi049.stdout:6/945: rmdir d2/d3/d17/d57/d6e/d88/dde/de9/da6 39 2024-06-03T00:03:26.107 INFO:tasks.workunit.client.0.smithi049.stdout:0/710: fsync d6/d30/f83 0 2024-06-03T00:03:26.108 INFO:tasks.workunit.client.0.smithi049.stdout:5/852: dread d3/d7d/fb2 [0,4194304] 0 2024-06-03T00:03:26.109 INFO:tasks.workunit.client.0.smithi049.stdout:6/946: creat d2/d3/d17/d57/d6e/d88/dcc/f13d x:0 0 0 2024-06-03T00:03:26.109 INFO:tasks.workunit.client.0.smithi049.stdout:0/711: stat d6/c34 0 2024-06-03T00:03:26.109 INFO:tasks.workunit.client.0.smithi049.stdout:2/853: creat da/d52/df/d3c/d60/f10a x:0 0 0 2024-06-03T00:03:26.109 INFO:tasks.workunit.client.0.smithi049.stdout:4/806: dwrite d4/d3f/d14/d7f/d87/ff7 [4194304,4194304] 0 2024-06-03T00:03:26.110 INFO:tasks.workunit.client.0.smithi049.stdout:0/712: getdents d6/d97/d4b 0 2024-06-03T00:03:26.110 INFO:tasks.workunit.client.0.smithi049.stdout:0/713: truncate d6/d97/d4b/d67/fbc 348563 0 2024-06-03T00:03:26.111 INFO:tasks.workunit.client.0.smithi049.stdout:4/807: rmdir d4/d3f/d14/d7f/d87 39 2024-06-03T00:03:26.111 INFO:tasks.workunit.client.0.smithi049.stdout:6/947: truncate d2/d3/d17/d57/d6e/d88/dde/de9/f4b 4323514 0 2024-06-03T00:03:26.112 INFO:tasks.workunit.client.0.smithi049.stdout:5/853: mkdir d3/d5/d24/d106 0 2024-06-03T00:03:26.112 INFO:tasks.workunit.client.0.smithi049.stdout:6/948: readlink d2/d3b/d103/l120 0 2024-06-03T00:03:26.114 INFO:tasks.workunit.client.0.smithi049.stdout:5/854: mkdir d3/d5/da/d55/d14/d16/df9/dff/d107 0 2024-06-03T00:03:26.114 INFO:tasks.workunit.client.0.smithi049.stdout:0/714: link d6/d30/c38 d6/d59/d93/cf3 0 2024-06-03T00:03:26.117 INFO:tasks.workunit.client.0.smithi049.stdout:0/715: link d6/d29/dc8/l1b d6/d30/d32/lf4 0 2024-06-03T00:03:26.119 INFO:tasks.workunit.client.0.smithi049.stdout:0/716: creat d6/d97/d4b/d67/ff5 x:0 0 0 2024-06-03T00:03:26.119 INFO:tasks.workunit.client.0.smithi049.stdout:0/717: truncate d6/d30/d32/f64 762895 0 2024-06-03T00:03:26.119 INFO:tasks.workunit.client.0.smithi049.stdout:3/698: dwrite d2/d14/fc7 [0,4194304] 0 2024-06-03T00:03:26.122 INFO:tasks.workunit.client.0.smithi049.stdout:3/699: mknod d2/d14/d22/d42/d68/cf8 0 2024-06-03T00:03:26.128 INFO:tasks.workunit.client.0.smithi049.stdout:8/699: dwrite d4/d27/d3c/d88/fd3 [0,4194304] 0 2024-06-03T00:03:26.129 INFO:tasks.workunit.client.0.smithi049.stdout:8/700: rmdir d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/da9/dd9 39 2024-06-03T00:03:26.129 INFO:tasks.workunit.client.0.smithi049.stdout:0/718: dread d6/d29/dc8/d52/f6c [0,4194304] 0 2024-06-03T00:03:26.131 INFO:tasks.workunit.client.0.smithi049.stdout:0/719: rmdir d6/d59 39 2024-06-03T00:03:26.131 INFO:tasks.workunit.client.0.smithi049.stdout:8/701: rename d4/d27/d3c/d88/d48/f5d to d4/d27/d3c/d88/d28/d52/d66/d53/d7e/fea 0 2024-06-03T00:03:26.131 INFO:tasks.workunit.client.0.smithi049.stdout:8/702: chown d4/d27/d3c/d43/d6b/da6/ld2 12148 1 2024-06-03T00:03:26.132 INFO:tasks.workunit.client.0.smithi049.stdout:8/703: dread - d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/da9/fbc zero size 2024-06-03T00:03:26.132 INFO:tasks.workunit.client.0.smithi049.stdout:0/720: creat d6/dd7/ff6 x:0 0 0 2024-06-03T00:03:26.133 INFO:tasks.workunit.client.0.smithi049.stdout:8/704: mknod d4/d27/d3c/d88/d28/d2b/d84/dba/ceb 0 2024-06-03T00:03:26.135 INFO:tasks.workunit.client.0.smithi049.stdout:0/721: rename d6/d29/dc8/d52/d96/cbd to d6/d59/d72/d94/cf7 0 2024-06-03T00:03:26.137 INFO:tasks.workunit.client.0.smithi049.stdout:5/855: dwrite d3/d5/fd6 [0,4194304] 0 2024-06-03T00:03:26.137 INFO:tasks.workunit.client.0.smithi049.stdout:2/854: dwrite da/d52/d73/ff1 [0,4194304] 0 2024-06-03T00:03:26.139 INFO:tasks.workunit.client.0.smithi049.stdout:2/855: creat da/d72/f10b x:0 0 0 2024-06-03T00:03:26.141 INFO:tasks.workunit.client.0.smithi049.stdout:5/856: rmdir d3/d53/d9c 39 2024-06-03T00:03:26.141 INFO:tasks.workunit.client.0.smithi049.stdout:5/857: chown d3/d5/d2d/d4b/d51/fea 406396603 1 2024-06-03T00:03:26.142 INFO:tasks.workunit.client.0.smithi049.stdout:5/858: stat d3/d9/d68/f70 0 2024-06-03T00:03:26.143 INFO:tasks.workunit.client.0.smithi049.stdout:5/859: mkdir d3/d5/de2/d108 0 2024-06-03T00:03:26.144 INFO:tasks.workunit.client.0.smithi049.stdout:3/700: dwrite d2/d1a/d34/dd5/d75/d94/fc1 [4194304,4194304] 0 2024-06-03T00:03:26.144 INFO:tasks.workunit.client.0.smithi049.stdout:5/860: unlink d3/d9/d20/f3d 0 2024-06-03T00:03:26.147 INFO:tasks.workunit.client.0.smithi049.stdout:5/861: truncate d3/d5/d24/f8a 961091 0 2024-06-03T00:03:26.147 INFO:tasks.workunit.client.0.smithi049.stdout:5/862: chown d3/d9/d20/d4c/d5a/d6f/fc4 234 1 2024-06-03T00:03:26.147 INFO:tasks.workunit.client.0.smithi049.stdout:5/863: write d3/d7d/fb2 [1091626,67412] 0 2024-06-03T00:03:26.149 INFO:tasks.workunit.client.0.smithi049.stdout:3/701: rename d2/d14/d44/d52/l18 to d2/d14/d44/d52/d4c/lf9 0 2024-06-03T00:03:26.149 INFO:tasks.workunit.client.0.smithi049.stdout:3/702: dread - d2/d14/d22/d42/d68/d80/fd4 zero size 2024-06-03T00:03:26.149 INFO:tasks.workunit.client.0.smithi049.stdout:3/703: rename d2/d1a/d34 to d2/d1a/d34/dd5/d75/d94/dd1/da0/dfa 22 2024-06-03T00:03:26.149 INFO:tasks.workunit.client.0.smithi049.stdout:8/705: truncate d4/d27/d3c/f2c 1120716 0 2024-06-03T00:03:26.150 INFO:tasks.workunit.client.0.smithi049.stdout:5/864: write d3/d5/d24/f5f [1374388,11723] 0 2024-06-03T00:03:26.151 INFO:tasks.workunit.client.0.smithi049.stdout:3/704: mknod d2/d1a/d34/dd5/d75/d94/dd1/da0/de3/cfb 0 2024-06-03T00:03:26.152 INFO:tasks.workunit.client.0.smithi049.stdout:8/706: creat d4/d27/d3c/d43/d6b/fec x:0 0 0 2024-06-03T00:03:26.153 INFO:tasks.workunit.client.0.smithi049.stdout:2/856: write da/d52/f33 [3851818,28970] 0 2024-06-03T00:03:26.153 INFO:tasks.workunit.client.0.smithi049.stdout:2/857: chown da/f85 6733051 1 2024-06-03T00:03:26.154 INFO:tasks.workunit.client.0.smithi049.stdout:8/707: creat d4/d27/fed x:0 0 0 2024-06-03T00:03:26.156 INFO:tasks.workunit.client.0.smithi049.stdout:2/858: link da/d52/d9e/cb4 da/d52/df/d3c/d60/c10c 0 2024-06-03T00:03:26.156 INFO:tasks.workunit.client.0.smithi049.stdout:8/708: rmdir d4/d27/d30/dd7 0 2024-06-03T00:03:26.158 INFO:tasks.workunit.client.0.smithi049.stdout:8/709: mknod d4/d27/d3c/d43/cee 0 2024-06-03T00:03:26.158 INFO:tasks.workunit.client.0.smithi049.stdout:0/722: dwrite d6/d29/fc6 [0,4194304] 0 2024-06-03T00:03:26.158 INFO:tasks.workunit.client.0.smithi049.stdout:0/723: read - d6/d30/d32/dca/fa4 zero size 2024-06-03T00:03:26.158 INFO:tasks.workunit.client.0.smithi049.stdout:0/724: dread - d6/d59/d93/db4/fdd zero size 2024-06-03T00:03:26.160 INFO:tasks.workunit.client.0.smithi049.stdout:0/725: creat d6/d59/ff8 x:0 0 0 2024-06-03T00:03:26.160 INFO:tasks.workunit.client.0.smithi049.stdout:0/726: chown d6/d59/cda 1647 1 2024-06-03T00:03:26.163 INFO:tasks.workunit.client.0.smithi049.stdout:0/727: symlink d6/d30/d32/lf9 0 2024-06-03T00:03:26.165 INFO:tasks.workunit.client.0.smithi049.stdout:0/728: unlink d6/d29/dc8/d52/f6c 0 2024-06-03T00:03:26.166 INFO:tasks.workunit.client.0.smithi049.stdout:0/729: rmdir d6/d97/d4b/d67 39 2024-06-03T00:03:26.168 INFO:tasks.workunit.client.0.smithi049.stdout:0/730: rename d6/f4e to d6/d29/ffa 0 2024-06-03T00:03:26.173 INFO:tasks.workunit.client.0.smithi049.stdout:3/705: dwrite d2/d1a/d34/f62 [0,4194304] 0 2024-06-03T00:03:26.175 INFO:tasks.workunit.client.0.smithi049.stdout:5/865: dwrite d3/d5/d24/f5f [8388608,4194304] 0 2024-06-03T00:03:26.175 INFO:tasks.workunit.client.0.smithi049.stdout:5/866: read - d3/d9/d20/d4c/d5a/d6f/f100 zero size 2024-06-03T00:03:26.175 INFO:tasks.workunit.client.0.smithi049.stdout:5/867: fdatasync d3/d5/da/d55/d14/d16/f25 0 2024-06-03T00:03:26.176 INFO:tasks.workunit.client.0.smithi049.stdout:0/731: write d6/d97/d4b/f95 [2363057,95150] 0 2024-06-03T00:03:26.177 INFO:tasks.workunit.client.0.smithi049.stdout:3/706: chown d2/d14/d22/d42/d68/cb9 21362 1 2024-06-03T00:03:26.178 INFO:tasks.workunit.client.0.smithi049.stdout:5/868: truncate d3/d7d/feb 264797 0 2024-06-03T00:03:26.178 INFO:tasks.workunit.client.0.smithi049.stdout:5/869: write d3/d5/f58 [3543130,97084] 0 2024-06-03T00:03:26.181 INFO:tasks.workunit.client.0.smithi049.stdout:3/707: rename d2/d1a/f37 to d2/d1a/ffc 0 2024-06-03T00:03:26.183 INFO:tasks.workunit.client.0.smithi049.stdout:3/708: creat d2/d14/d22/d42/d68/ffd x:0 0 0 2024-06-03T00:03:26.184 INFO:tasks.workunit.client.0.smithi049.stdout:8/710: dwrite d4/d27/d3c/d88/d4d/f95 [0,4194304] 0 2024-06-03T00:03:26.185 INFO:tasks.workunit.client.0.smithi049.stdout:3/709: rmdir d2/d14/d44/d52/d4c/d4b/daf/dda 0 2024-06-03T00:03:26.186 INFO:tasks.workunit.client.0.smithi049.stdout:3/710: chown d2/fd 47080 1 2024-06-03T00:03:26.187 INFO:tasks.workunit.client.0.smithi049.stdout:5/870: dread d3/d5/d9a/f9b [0,4194304] 0 2024-06-03T00:03:26.187 INFO:tasks.workunit.client.0.smithi049.stdout:3/711: readlink d2/d14/d22/d42/l9d 0 2024-06-03T00:03:26.187 INFO:tasks.workunit.client.0.smithi049.stdout:3/712: write d2/d14/d44/d52/d4c/d4b/fb5 [1360989,93739] 0 2024-06-03T00:03:26.188 INFO:tasks.workunit.client.0.smithi049.stdout:3/713: mknod d2/d14/d44/d52/d4c/cfe 0 2024-06-03T00:03:26.190 INFO:tasks.workunit.client.0.smithi049.stdout:3/714: rename d2/d1a/d34/fae to d2/d1a/d51/dbe/fff 0 2024-06-03T00:03:26.192 INFO:tasks.workunit.client.0.smithi049.stdout:3/715: getdents d2/d14/d22/d3a/d47 0 2024-06-03T00:03:26.192 INFO:tasks.workunit.client.0.smithi049.stdout:3/716: write d2/d14/d44/fa5 [363923,76766] 0 2024-06-03T00:03:26.192 INFO:tasks.workunit.client.0.smithi049.stdout:3/717: chown d2/d1a/d51 1496640929 1 2024-06-03T00:03:26.195 INFO:tasks.workunit.client.0.smithi049.stdout:3/718: dread d2/d1a/d51/dbe/fff [0,4194304] 0 2024-06-03T00:03:26.196 INFO:tasks.workunit.client.0.smithi049.stdout:3/719: creat d2/d1a/d34/dd5/d75/d94/f100 x:0 0 0 2024-06-03T00:03:26.197 INFO:tasks.workunit.client.0.smithi049.stdout:8/711: write d4/d27/d3c/d88/d28/d52/f76 [569273,19819] 0 2024-06-03T00:03:26.197 INFO:tasks.workunit.client.0.smithi049.stdout:5/871: dread d3/d7d/f8c [0,4194304] 0 2024-06-03T00:03:26.198 INFO:tasks.workunit.client.0.smithi049.stdout:0/732: dwrite d6/d29/dc8/d52/fc3 [0,4194304] 0 2024-06-03T00:03:26.199 INFO:tasks.workunit.client.0.smithi049.stdout:0/733: stat d6/d30/c60 0 2024-06-03T00:03:26.199 INFO:tasks.workunit.client.0.smithi049.stdout:5/872: rename d3/d5/de2 to d3/d5/da/d55/df4/d109 0 2024-06-03T00:03:26.199 INFO:tasks.workunit.client.0.smithi049.stdout:8/712: mknod d4/d27/d3c/d88/d28/d45/cef 0 2024-06-03T00:03:26.200 INFO:tasks.workunit.client.0.smithi049.stdout:0/734: mkdir d6/d29/dc8/d52/d96/dfb 0 2024-06-03T00:03:26.201 INFO:tasks.workunit.client.0.smithi049.stdout:5/873: rmdir d3/d5/d24/d106 0 2024-06-03T00:03:26.201 INFO:tasks.workunit.client.0.smithi049.stdout:0/735: fsync d6/d29/dc8/f87 0 2024-06-03T00:03:26.202 INFO:tasks.workunit.client.0.smithi049.stdout:5/874: mknod d3/d5/da/d55/d14/d16/df9/c10a 0 2024-06-03T00:03:26.202 INFO:tasks.workunit.client.0.smithi049.stdout:0/736: creat d6/d59/d93/ffc x:0 0 0 2024-06-03T00:03:26.202 INFO:tasks.workunit.client.0.smithi049.stdout:8/713: mknod d4/d27/d3c/d88/d28/d52/cf0 0 2024-06-03T00:03:26.204 INFO:tasks.workunit.client.0.smithi049.stdout:0/737: mknod d6/dd7/cfd 0 2024-06-03T00:03:26.205 INFO:tasks.workunit.client.0.smithi049.stdout:5/875: rename d3/d5/fe7 to d3/d5/da/d55/d14/d16/df9/dff/d107/f10b 0 2024-06-03T00:03:26.205 INFO:tasks.workunit.client.0.smithi049.stdout:5/876: chown d3/d9/d20/d4c 0 1 2024-06-03T00:03:26.206 INFO:tasks.workunit.client.0.smithi049.stdout:3/720: dread d2/d14/f54 [0,4194304] 0 2024-06-03T00:03:26.206 INFO:tasks.workunit.client.0.smithi049.stdout:5/877: truncate d3/d5/d9a/fb7 2741022 0 2024-06-03T00:03:26.208 INFO:tasks.workunit.client.0.smithi049.stdout:3/721: symlink d2/d1a/d34/l101 0 2024-06-03T00:03:26.208 INFO:tasks.workunit.client.0.smithi049.stdout:0/738: link d6/d30/da3/fab d6/d97/ffe 0 2024-06-03T00:03:26.208 INFO:tasks.workunit.client.0.smithi049.stdout:0/739: write d6/d30/da3/fe4 [4740082,66956] 0 2024-06-03T00:03:26.210 INFO:tasks.workunit.client.0.smithi049.stdout:0/740: symlink d6/d30/lff 0 2024-06-03T00:03:26.210 INFO:tasks.workunit.client.0.smithi049.stdout:0/741: fdatasync d6/d59/d72/f86 0 2024-06-03T00:03:26.229 INFO:tasks.workunit.client.0.smithi049.stdout:3/722: dwrite d2/d14/d44/d52/d4c/d4b/fcc [0,4194304] 0 2024-06-03T00:03:26.229 INFO:tasks.workunit.client.0.smithi049.stdout:7/792: sync 2024-06-03T00:03:26.230 INFO:tasks.workunit.client.0.smithi049.stdout:7/793: write d3/dd8/d13/d54/daa/fd4 [188074,4607] 0 2024-06-03T00:03:26.231 INFO:tasks.workunit.client.0.smithi049.stdout:3/723: creat d2/d1a/d34/f102 x:0 0 0 2024-06-03T00:03:26.231 INFO:tasks.workunit.client.0.smithi049.stdout:3/724: symlink d2/d14/d44/deb/l103 0 2024-06-03T00:03:26.233 INFO:tasks.workunit.client.0.smithi049.stdout:7/794: link d3/dd8/d13/d54/daa/lcc d3/dd8/d9/d8f/l123 0 2024-06-03T00:03:26.235 INFO:tasks.workunit.client.0.smithi049.stdout:7/795: symlink d3/dd8/d9/d91/l124 0 2024-06-03T00:03:26.240 INFO:tasks.workunit.client.0.smithi049.stdout:7/796: dread d3/dd8/d13/d79/f7e [0,4194304] 0 2024-06-03T00:03:26.241 INFO:tasks.workunit.client.0.smithi049.stdout:8/714: dwrite d4/d27/d3c/d88/d28/d52/f65 [0,4194304] 0 2024-06-03T00:03:26.241 INFO:tasks.workunit.client.0.smithi049.stdout:0/742: dwrite d6/d29/dc8/f87 [0,4194304] 0 2024-06-03T00:03:26.242 INFO:tasks.workunit.client.0.smithi049.stdout:7/797: rename d3/dd8/d13/d3c/d4b/f7a to d3/dd8/d13/d3c/d48/d7b/d9c/df6/d116/f125 0 2024-06-03T00:03:26.246 INFO:tasks.workunit.client.0.smithi049.stdout:0/743: truncate d6/d30/f5a 336608 0 2024-06-03T00:03:26.248 INFO:tasks.workunit.client.0.smithi049.stdout:7/798: dread d3/fac [0,4194304] 0 2024-06-03T00:03:26.250 INFO:tasks.workunit.client.0.smithi049.stdout:7/799: mknod d3/dd8/d9/d8f/d118/c126 0 2024-06-03T00:03:26.250 INFO:tasks.workunit.client.0.smithi049.stdout:7/800: fsync d3/dd8/d86/ff9 0 2024-06-03T00:03:26.250 INFO:tasks.workunit.client.0.smithi049.stdout:7/801: chown d3/dd8/d9/c6f 245929262 1 2024-06-03T00:03:26.251 INFO:tasks.workunit.client.0.smithi049.stdout:8/715: write d4/d27/d3c/d88/f61 [431177,70795] 0 2024-06-03T00:03:26.252 INFO:tasks.workunit.client.0.smithi049.stdout:8/716: creat d4/d27/d3c/d88/d48/dde/ff1 x:0 0 0 2024-06-03T00:03:26.270 INFO:tasks.workunit.client.0.smithi049.stdout:0/744: dwrite d6/d30/fe2 [0,4194304] 0 2024-06-03T00:03:26.276 INFO:tasks.workunit.client.0.smithi049.stdout:8/717: dwrite d4/d27/d3c/d88/d28/d25/f39 [4194304,4194304] 0 2024-06-03T00:03:26.277 INFO:tasks.workunit.client.0.smithi049.stdout:7/802: dwrite d3/dd8/d13/d3c/d48/ff3 [0,4194304] 0 2024-06-03T00:03:26.277 INFO:tasks.workunit.client.0.smithi049.stdout:7/803: chown d3/dd8/d13/d3c/d110 27612449 1 2024-06-03T00:03:26.278 INFO:tasks.workunit.client.0.smithi049.stdout:8/718: rename d4/d27/d3c/d88/d28/d25/f39 to d4/d27/d3c/d88/d28/d52/d66/d8e/ff2 0 2024-06-03T00:03:26.279 INFO:tasks.workunit.client.0.smithi049.stdout:7/804: mkdir d3/dd8/d13/d4a/dd5/dfe/d127 0 2024-06-03T00:03:26.281 INFO:tasks.workunit.client.0.smithi049.stdout:7/805: rmdir d3/dd8/d13/d79/d114/d11b 0 2024-06-03T00:03:26.282 INFO:tasks.workunit.client.0.smithi049.stdout:7/806: read d3/dd8/d13/d3c/d4b/ff8 [3048270,24344] 0 2024-06-03T00:03:26.283 INFO:tasks.workunit.client.0.smithi049.stdout:8/719: rename d4/f80 to d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/ff3 0 2024-06-03T00:03:26.284 INFO:tasks.workunit.client.0.smithi049.stdout:8/720: chown d4/d27/d3c/d88/d28/d52/d66/d53/d7e/fea 6635 1 2024-06-03T00:03:26.284 INFO:tasks.workunit.client.0.smithi049.stdout:7/807: rmdir d3/dd8/d13/d4a 39 2024-06-03T00:03:26.284 INFO:tasks.workunit.client.0.smithi049.stdout:7/808: creat d3/f128 x:0 0 0 2024-06-03T00:03:26.286 INFO:tasks.workunit.client.0.smithi049.stdout:8/721: link d4/d27/f78 d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/da9/dd9/ff4 0 2024-06-03T00:03:26.286 INFO:tasks.workunit.client.0.smithi049.stdout:7/809: mkdir d3/dd8/d86/d90/def/d129 0 2024-06-03T00:03:26.291 INFO:tasks.workunit.client.0.smithi049.stdout:8/722: mknod d4/d27/d3c/d43/cf5 0 2024-06-03T00:03:26.292 INFO:tasks.workunit.client.0.smithi049.stdout:8/723: fsync d4/d27/d3c/d88/d28/d2b/f87 0 2024-06-03T00:03:26.294 INFO:tasks.workunit.client.0.smithi049.stdout:8/724: mknod d4/d27/d3c/cf6 0 2024-06-03T00:03:26.307 INFO:tasks.workunit.client.0.smithi049.stdout:0/745: dwrite d6/d30/d32/dca/f8c [0,4194304] 0 2024-06-03T00:03:26.307 INFO:tasks.workunit.client.0.smithi049.stdout:7/810: dwrite d3/dd8/d13/d54/daa/d92/fb8 [4194304,4194304] 0 2024-06-03T00:03:26.308 INFO:tasks.workunit.client.0.smithi049.stdout:0/746: creat d6/d59/d93/f100 x:0 0 0 2024-06-03T00:03:26.308 INFO:tasks.workunit.client.0.smithi049.stdout:7/811: write d3/dd8/d9/f2b [1055296,69583] 0 2024-06-03T00:03:26.308 INFO:tasks.workunit.client.0.smithi049.stdout:7/812: fsync d3/dd8/d13/d3c/d4b/ff8 0 2024-06-03T00:03:26.308 INFO:tasks.workunit.client.0.smithi049.stdout:7/813: stat d3/dd8/d13/d3c/d4b 0 2024-06-03T00:03:26.309 INFO:tasks.workunit.client.0.smithi049.stdout:0/747: rmdir d6/d59/d72 39 2024-06-03T00:03:26.311 INFO:tasks.workunit.client.0.smithi049.stdout:7/814: readlink d3/dd8/d13/d3c/d4b/d8e/l9f 0 2024-06-03T00:03:26.311 INFO:tasks.workunit.client.0.smithi049.stdout:7/815: chown d3/dd8/d86/ff9 24365575 1 2024-06-03T00:03:26.314 INFO:tasks.workunit.client.0.smithi049.stdout:7/816: rename d3/dd8/d86/lfa to d3/dd8/d13/d3c/d4b/d8e/l12a 0 2024-06-03T00:03:26.316 INFO:tasks.workunit.client.0.smithi049.stdout:7/817: creat d3/dd8/d13/d3c/d48/d7b/d5b/f12b x:0 0 0 2024-06-03T00:03:26.320 INFO:tasks.workunit.client.0.smithi049.stdout:7/818: rename d3/dd8/d13/d54/daa/d92/ff2 to d3/dd8/d13/f12c 0 2024-06-03T00:03:26.324 INFO:tasks.workunit.client.0.smithi049.stdout:0/748: dread d6/d29/dc8/d52/d96/f9f [4194304,4194304] 0 2024-06-03T00:03:26.324 INFO:tasks.workunit.client.0.smithi049.stdout:0/749: rename d6/d30 to d6/d30/d101 22 2024-06-03T00:03:26.325 INFO:tasks.workunit.client.0.smithi049.stdout:0/750: symlink d6/d29/dc8/d52/l102 0 2024-06-03T00:03:26.326 INFO:tasks.workunit.client.0.smithi049.stdout:0/751: creat d6/d30/f103 x:0 0 0 2024-06-03T00:03:26.326 INFO:tasks.workunit.client.0.smithi049.stdout:0/752: dread - d6/d30/ff2 zero size 2024-06-03T00:03:26.327 INFO:tasks.workunit.client.0.smithi049.stdout:0/753: creat d6/f104 x:0 0 0 2024-06-03T00:03:26.328 INFO:tasks.workunit.client.0.smithi049.stdout:0/754: chown d6/d97/d4b/f95 9073 1 2024-06-03T00:03:26.329 INFO:tasks.workunit.client.0.smithi049.stdout:0/755: symlink d6/d59/d93/db4/l105 0 2024-06-03T00:03:26.330 INFO:tasks.workunit.client.0.smithi049.stdout:7/819: dread d3/dd8/d13/d4a/fb0 [0,4194304] 0 2024-06-03T00:03:26.330 INFO:tasks.workunit.client.0.smithi049.stdout:0/756: truncate d6/fb2 2964600 0 2024-06-03T00:03:26.330 INFO:tasks.workunit.client.0.smithi049.stdout:7/820: readlink d3/dd8/d13/d3c/d4b/d8e/led 0 2024-06-03T00:03:26.331 INFO:tasks.workunit.client.0.smithi049.stdout:8/725: dwrite d4/d27/d3c/d88/f11 [0,4194304] 0 2024-06-03T00:03:26.331 INFO:tasks.workunit.client.0.smithi049.stdout:8/726: write d4/d27/d3c/d88/d28/d2b/d84/dba/fd4 [578371,76355] 0 2024-06-03T00:03:26.332 INFO:tasks.workunit.client.0.smithi049.stdout:0/757: mknod d6/c106 0 2024-06-03T00:03:26.333 INFO:tasks.workunit.client.0.smithi049.stdout:7/821: mknod d3/dd8/d13/d4a/dd5/c12d 0 2024-06-03T00:03:26.333 INFO:tasks.workunit.client.0.smithi049.stdout:0/758: fdatasync d6/d97/f90 0 2024-06-03T00:03:26.333 INFO:tasks.workunit.client.0.smithi049.stdout:0/759: getdents d6/d30/d32/dca 0 2024-06-03T00:03:26.334 INFO:tasks.workunit.client.0.smithi049.stdout:8/727: link d4/d27/d3c/d88/d28/d45/f49 d4/d27/d3c/d88/d28/d2b/ff7 0 2024-06-03T00:03:26.334 INFO:tasks.workunit.client.0.smithi049.stdout:0/760: mkdir d6/d29/dc8/d52/d96/dfb/d107 0 2024-06-03T00:03:26.335 INFO:tasks.workunit.client.0.smithi049.stdout:8/728: rmdir d4/d27/d3c/d43/d6b/da6 39 2024-06-03T00:03:26.338 INFO:tasks.workunit.client.0.smithi049.stdout:8/729: rename d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/da9/fbc to d4/d27/d3c/d88/d28/d52/ff8 0 2024-06-03T00:03:26.340 INFO:tasks.workunit.client.0.smithi049.stdout:8/730: stat d4/d27/d3c/d88/d28/d52/d66/d53/f82 0 2024-06-03T00:03:26.341 INFO:tasks.workunit.client.0.smithi049.stdout:8/731: creat d4/d27/d3c/d43/d6b/ff9 x:0 0 0 2024-06-03T00:03:26.341 INFO:tasks.workunit.client.0.smithi049.stdout:8/732: truncate d4/d27/d3c/d43/d6b/fec 317481 0 2024-06-03T00:03:26.343 INFO:tasks.workunit.client.0.smithi049.stdout:0/761: write d6/d30/d32/fcd [552824,126820] 0 2024-06-03T00:03:26.346 INFO:tasks.workunit.client.0.smithi049.stdout:0/762: write d6/d30/d32/dca/fa4 [35864,111017] 0 2024-06-03T00:03:26.351 INFO:tasks.workunit.client.0.smithi049.stdout:8/733: dread d4/d27/d3c/d88/f14 [0,4194304] 0 2024-06-03T00:03:26.353 INFO:tasks.workunit.client.0.smithi049.stdout:8/734: symlink d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/dab/lfa 0 2024-06-03T00:03:26.354 INFO:tasks.workunit.client.0.smithi049.stdout:8/735: link d4/d27/d3c/c70 d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/da9/dd9/cfb 0 2024-06-03T00:03:26.356 INFO:tasks.workunit.client.0.smithi049.stdout:0/763: dread d6/d97/f7b [0,4194304] 0 2024-06-03T00:03:26.385 INFO:tasks.workunit.client.0.smithi049.stdout:4/808: sync 2024-06-03T00:03:26.387 INFO:tasks.workunit.client.0.smithi049.stdout:4/809: link d4/d3f/d14/d2b/f48 d4/d3f/d14/d7f/ddb/f113 0 2024-06-03T00:03:26.388 INFO:tasks.workunit.client.0.smithi049.stdout:4/810: creat d4/d3f/d14/d7f/f114 x:0 0 0 2024-06-03T00:03:26.469 INFO:tasks.workunit.client.0.smithi049.stdout:2/859: sync 2024-06-03T00:03:26.469 INFO:tasks.workunit.client.0.smithi049.stdout:3/725: sync 2024-06-03T00:03:26.469 INFO:tasks.workunit.client.0.smithi049.stdout:5/878: sync 2024-06-03T00:03:26.469 INFO:tasks.workunit.client.0.smithi049.stdout:6/949: sync 2024-06-03T00:03:26.469 INFO:tasks.workunit.client.0.smithi049.stdout:6/950: readlink d2/d3/d9/d23/d29/l7c 0 2024-06-03T00:03:26.470 INFO:tasks.workunit.client.0.smithi049.stdout:5/879: fdatasync d3/d5/da/d55/d14/f29 0 2024-06-03T00:03:26.473 INFO:tasks.workunit.client.0.smithi049.stdout:5/880: mkdir d3/d5/d2d/d4b/d97/d10c 0 2024-06-03T00:03:26.474 INFO:tasks.workunit.client.0.smithi049.stdout:5/881: creat d3/f10d x:0 0 0 2024-06-03T00:03:26.474 INFO:tasks.workunit.client.0.smithi049.stdout:6/951: read d2/d3/d9/d23/d29/f63 [1004568,98835] 0 2024-06-03T00:03:26.475 INFO:tasks.workunit.client.0.smithi049.stdout:5/882: symlink d3/d5/da/d55/d14/d16/df9/dff/l10e 0 2024-06-03T00:03:26.492 INFO:tasks.workunit.client.0.smithi049.stdout:2/860: dwrite da/d55/f91 [0,4194304] 0 2024-06-03T00:03:26.494 INFO:tasks.workunit.client.0.smithi049.stdout:2/861: write da/fcb [666532,33567] 0 2024-06-03T00:03:26.495 INFO:tasks.workunit.client.0.smithi049.stdout:3/726: dwrite d2/d14/f6f [0,4194304] 0 2024-06-03T00:03:26.498 INFO:tasks.workunit.client.0.smithi049.stdout:2/862: truncate da/d55/f91 827043 0 2024-06-03T00:03:26.498 INFO:tasks.workunit.client.0.smithi049.stdout:3/727: creat d2/d14/d44/d52/d4c/d4b/d98/f104 x:0 0 0 2024-06-03T00:03:26.499 INFO:tasks.workunit.client.0.smithi049.stdout:2/863: getdents da/d52/d37/dac 0 2024-06-03T00:03:26.503 INFO:tasks.workunit.client.0.smithi049.stdout:5/883: dwrite d3/d5/da/f50 [0,4194304] 0 2024-06-03T00:03:26.503 INFO:tasks.workunit.client.0.smithi049.stdout:3/728: mkdir d2/d1a/d34/dd5/d75/d94/d9e/d105 0 2024-06-03T00:03:26.503 INFO:tasks.workunit.client.0.smithi049.stdout:3/729: read - d2/d14/d44/fdf zero size 2024-06-03T00:03:26.503 INFO:tasks.workunit.client.0.smithi049.stdout:3/730: write d2/f13 [2838345,97964] 0 2024-06-03T00:03:26.505 INFO:tasks.workunit.client.0.smithi049.stdout:5/884: rmdir d3/d5/da/d55/d75 39 2024-06-03T00:03:26.511 INFO:tasks.workunit.client.0.smithi049.stdout:3/731: mkdir d2/d1a/d76/d95/d106 0 2024-06-03T00:03:26.511 INFO:tasks.workunit.client.0.smithi049.stdout:3/732: chown d2/d14/d44/f5b 1143065355 1 2024-06-03T00:03:26.511 INFO:tasks.workunit.client.0.smithi049.stdout:5/885: dread d3/d5/d24/f8a [0,4194304] 0 2024-06-03T00:03:26.511 INFO:tasks.workunit.client.0.smithi049.stdout:5/886: chown d3/d5/d2d/d4b/d62 574 1 2024-06-03T00:03:26.520 INFO:tasks.workunit.client.0.smithi049.stdout:7/822: sync 2024-06-03T00:03:26.520 INFO:tasks.workunit.client.0.smithi049.stdout:7/823: chown d3/dd8/d13/d3c/d48/d7b/l64 106 1 2024-06-03T00:03:26.520 INFO:tasks.workunit.client.0.smithi049.stdout:7/824: dread - d3/dd8/f120 zero size 2024-06-03T00:03:26.521 INFO:tasks.workunit.client.0.smithi049.stdout:2/864: dwrite da/d43/f7e [0,4194304] 0 2024-06-03T00:03:26.524 INFO:tasks.workunit.client.0.smithi049.stdout:2/865: mknod da/d52/d37/c10d 0 2024-06-03T00:03:26.527 INFO:tasks.workunit.client.0.smithi049.stdout:2/866: dread da/d52/df/f29 [0,4194304] 0 2024-06-03T00:03:26.527 INFO:tasks.workunit.client.0.smithi049.stdout:5/887: dwrite d3/d7d/fb2 [0,4194304] 0 2024-06-03T00:03:26.528 INFO:tasks.workunit.client.0.smithi049.stdout:7/825: write d3/dd8/d13/f65 [2860594,62966] 0 2024-06-03T00:03:26.530 INFO:tasks.workunit.client.0.smithi049.stdout:2/867: rename da/d52/ff3 to da/d52/df/d3c/de8/f10e 0 2024-06-03T00:03:26.530 INFO:tasks.workunit.client.0.smithi049.stdout:5/888: mkdir d3/d5/d10f 0 2024-06-03T00:03:26.531 INFO:tasks.workunit.client.0.smithi049.stdout:2/868: chown da/d52/d40/d93/da9/ce9 70290 1 2024-06-03T00:03:26.532 INFO:tasks.workunit.client.0.smithi049.stdout:7/826: dread d3/dd8/d9/f69 [0,4194304] 0 2024-06-03T00:03:26.534 INFO:tasks.workunit.client.0.smithi049.stdout:5/889: rename d3/d7d to d3/d5/da/d55/d110 0 2024-06-03T00:03:26.535 INFO:tasks.workunit.client.0.smithi049.stdout:5/890: mkdir d3/d5/d2d/d4b/d97/dde/d111 0 2024-06-03T00:03:26.535 INFO:tasks.workunit.client.0.smithi049.stdout:7/827: dread d3/f82 [0,4194304] 0 2024-06-03T00:03:26.536 INFO:tasks.workunit.client.0.smithi049.stdout:5/891: creat d3/d5/da/d55/d110/f112 x:0 0 0 2024-06-03T00:03:26.537 INFO:tasks.workunit.client.0.smithi049.stdout:3/733: dwrite d2/d14/d44/f5b [0,4194304] 0 2024-06-03T00:03:26.537 INFO:tasks.workunit.client.0.smithi049.stdout:5/892: getdents d3/d9/d20/d4c/d5a/d65 0 2024-06-03T00:03:26.537 INFO:tasks.workunit.client.0.smithi049.stdout:7/828: rename d3/dd8/d3f to d3/dd8/d13/d3c/d48/d7b/d9c/df6/d11e/d12e 0 2024-06-03T00:03:26.540 INFO:tasks.workunit.client.0.smithi049.stdout:3/734: link d2/d14/d44/d52/d4c/d4b/d58/fe4 d2/d1a/d76/d95/d106/f107 0 2024-06-03T00:03:26.541 INFO:tasks.workunit.client.0.smithi049.stdout:3/735: mknod d2/d14/c108 0 2024-06-03T00:03:26.544 INFO:tasks.workunit.client.0.smithi049.stdout:3/736: creat d2/d14/d44/d52/d4c/d4b/d58/f109 x:0 0 0 2024-06-03T00:03:26.549 INFO:tasks.workunit.client.0.smithi049.stdout:5/893: dread d3/d5/d2d/d4b/f59 [0,4194304] 0 2024-06-03T00:03:26.550 INFO:tasks.workunit.client.0.smithi049.stdout:5/894: readlink d3/d5/da/d55/d14/ldc 0 2024-06-03T00:03:26.560 INFO:tasks.workunit.client.0.smithi049.stdout:2/869: dwrite da/d52/d40/dce/ffe [0,4194304] 0 2024-06-03T00:03:26.561 INFO:tasks.workunit.client.0.smithi049.stdout:7/829: dwrite d3/dd8/d13/d3c/d4b/d5a/fc2 [0,4194304] 0 2024-06-03T00:03:26.564 INFO:tasks.workunit.client.0.smithi049.stdout:7/830: dread d3/dd8/d9/f2b [0,4194304] 0 2024-06-03T00:03:26.564 INFO:tasks.workunit.client.0.smithi049.stdout:3/737: dwrite d2/d1a/d76/de8/ff7 [0,4194304] 0 2024-06-03T00:03:26.564 INFO:tasks.workunit.client.0.smithi049.stdout:2/870: unlink da/d52/df/ddd/ce1 0 2024-06-03T00:03:26.564 INFO:tasks.workunit.client.0.smithi049.stdout:2/871: read - da/d52/d37/dac/fc4 zero size 2024-06-03T00:03:26.569 INFO:tasks.workunit.client.0.smithi049.stdout:7/831: rename d3/dd8/d13/d4a to d3/dd8/d13/d79/d114/d12f 0 2024-06-03T00:03:26.571 INFO:tasks.workunit.client.0.smithi049.stdout:7/832: mknod d3/dd8/d13/d3c/d4b/dea/c130 0 2024-06-03T00:03:26.572 INFO:tasks.workunit.client.0.smithi049.stdout:7/833: creat d3/f131 x:0 0 0 2024-06-03T00:03:26.574 INFO:tasks.workunit.client.0.smithi049.stdout:2/872: rename da/d52/d40/d93/da9 to da/d10f 0 2024-06-03T00:03:26.576 INFO:tasks.workunit.client.0.smithi049.stdout:2/873: write da/d52/d9e/fee [18617,40330] 0 2024-06-03T00:03:26.576 INFO:tasks.workunit.client.0.smithi049.stdout:7/834: rename d3/dd8/f15 to d3/dd8/d13/d3c/d48/d112/f132 0 2024-06-03T00:03:26.578 INFO:tasks.workunit.client.0.smithi049.stdout:2/874: mkdir da/d52/df/d110 0 2024-06-03T00:03:26.578 INFO:tasks.workunit.client.0.smithi049.stdout:7/835: rename d3/dd8/d13/d3c/d4b/d5a/fd9 to d3/dd8/d9/d8f/dfd/f133 0 2024-06-03T00:03:26.578 INFO:tasks.workunit.client.0.smithi049.stdout:2/875: readlink da/d52/d40/d93/lfb 0 2024-06-03T00:03:26.580 INFO:tasks.workunit.client.0.smithi049.stdout:2/876: mkdir da/d55/d111 0 2024-06-03T00:03:26.582 INFO:tasks.workunit.client.0.smithi049.stdout:0/764: sync 2024-06-03T00:03:26.582 INFO:tasks.workunit.client.0.smithi049.stdout:8/736: sync 2024-06-03T00:03:26.582 INFO:tasks.workunit.client.0.smithi049.stdout:0/765: chown d6/d30/d32/lf4 0 1 2024-06-03T00:03:26.583 INFO:tasks.workunit.client.0.smithi049.stdout:8/737: read - d4/d27/d3c/d88/d48/fc6 zero size 2024-06-03T00:03:26.583 INFO:tasks.workunit.client.0.smithi049.stdout:0/766: mknod d6/d30/d32/dca/c108 0 2024-06-03T00:03:26.583 INFO:tasks.workunit.client.0.smithi049.stdout:2/877: mkdir da/d52/d40/d112 0 2024-06-03T00:03:26.584 INFO:tasks.workunit.client.0.smithi049.stdout:5/895: dwrite d3/d9/f49 [0,4194304] 0 2024-06-03T00:03:26.584 INFO:tasks.workunit.client.0.smithi049.stdout:8/738: mknod d4/d27/d3c/d88/d28/d25/cfc 0 2024-06-03T00:03:26.585 INFO:tasks.workunit.client.0.smithi049.stdout:3/738: dwrite d2/d1a/d34/dd5/d75/d94/fc1 [0,4194304] 0 2024-06-03T00:03:26.587 INFO:tasks.workunit.client.0.smithi049.stdout:5/896: rename d3/d5/da/d55/d75/l102 to d3/d9/d20/d4c/d5a/d65/l113 0 2024-06-03T00:03:26.588 INFO:tasks.workunit.client.0.smithi049.stdout:3/739: creat d2/f10a x:0 0 0 2024-06-03T00:03:26.588 INFO:tasks.workunit.client.0.smithi049.stdout:3/740: write d2/d14/d44/fb8 [670026,99589] 0 2024-06-03T00:03:26.589 INFO:tasks.workunit.client.0.smithi049.stdout:4/811: sync 2024-06-03T00:03:26.590 INFO:tasks.workunit.client.0.smithi049.stdout:4/812: stat d4/ff 0 2024-06-03T00:03:26.591 INFO:tasks.workunit.client.0.smithi049.stdout:5/897: rename d3/d5/d24/f8a to d3/d5/d10f/f114 0 2024-06-03T00:03:26.591 INFO:tasks.workunit.client.0.smithi049.stdout:5/898: fdatasync d3/d5/da/d55/d14/d16/f8e 0 2024-06-03T00:03:26.592 INFO:tasks.workunit.client.0.smithi049.stdout:5/899: fsync d3/d5/da/d55/d110/fd0 0 2024-06-03T00:03:26.592 INFO:tasks.workunit.client.0.smithi049.stdout:5/900: write d3/d5/da/fe0 [819522,29416] 0 2024-06-03T00:03:26.592 INFO:tasks.workunit.client.0.smithi049.stdout:6/952: sync 2024-06-03T00:03:26.592 INFO:tasks.workunit.client.0.smithi049.stdout:6/953: read - d2/d3/d17/f137 zero size 2024-06-03T00:03:26.592 INFO:tasks.workunit.client.0.smithi049.stdout:4/813: truncate d4/d3f/d14/fd8 248649 0 2024-06-03T00:03:26.593 INFO:tasks.workunit.client.0.smithi049.stdout:8/739: mkdir d4/d27/d30/dfd 0 2024-06-03T00:03:26.594 INFO:tasks.workunit.client.0.smithi049.stdout:7/836: read d3/dd8/d13/f7c [1248535,4429] 0 2024-06-03T00:03:26.594 INFO:tasks.workunit.client.0.smithi049.stdout:4/814: unlink d4/d3f/d14/d2b/d84/d69/dc6/dd3/l110 0 2024-06-03T00:03:26.596 INFO:tasks.workunit.client.0.smithi049.stdout:7/837: chown d3/dd8/d13/d3c/d48/d7b/d9c/dc4/lc5 2058009 1 2024-06-03T00:03:26.596 INFO:tasks.workunit.client.0.smithi049.stdout:7/838: dread - d3/dd8/d13/d3c/d48/d7b/d9c/dc4/f117 zero size 2024-06-03T00:03:26.596 INFO:tasks.workunit.client.0.smithi049.stdout:8/740: creat d4/d27/d3c/d88/d4d/ffe x:0 0 0 2024-06-03T00:03:26.596 INFO:tasks.workunit.client.0.smithi049.stdout:7/839: chown d3/dd8/d13/d3c 1406673128 1 2024-06-03T00:03:26.597 INFO:tasks.workunit.client.0.smithi049.stdout:8/741: chown d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/dab/fb6 768 1 2024-06-03T00:03:26.597 INFO:tasks.workunit.client.0.smithi049.stdout:5/901: rename d3/d5/da/d55/d14/f60 to d3/d5/da/d55/f115 0 2024-06-03T00:03:26.600 INFO:tasks.workunit.client.0.smithi049.stdout:4/815: rename d4/d3f/d14/d7f/f8f to d4/d3f/d14/d7f/ddb/dc2/f115 0 2024-06-03T00:03:26.601 INFO:tasks.workunit.client.0.smithi049.stdout:5/902: truncate d3/d5/da/f2b 1169084 0 2024-06-03T00:03:26.602 INFO:tasks.workunit.client.0.smithi049.stdout:4/816: mknod d4/d3f/d14/c116 0 2024-06-03T00:03:26.603 INFO:tasks.workunit.client.0.smithi049.stdout:5/903: creat d3/d5/da/d55/d75/f116 x:0 0 0 2024-06-03T00:03:26.604 INFO:tasks.workunit.client.0.smithi049.stdout:4/817: chown d4/d3f/d14/d2b/d84/d69/l99 128730 1 2024-06-03T00:03:26.604 INFO:tasks.workunit.client.0.smithi049.stdout:7/840: rename d3/dd8/d13/d54/d96/c97 to d3/dd8/d86/d90/def/d129/c134 0 2024-06-03T00:03:26.607 INFO:tasks.workunit.client.0.smithi049.stdout:4/818: dread d4/d3f/f4d [0,4194304] 0 2024-06-03T00:03:26.613 INFO:tasks.workunit.client.0.smithi049.stdout:8/742: dwrite d4/d27/d3c/d88/d28/d45/f49 [0,4194304] 0 2024-06-03T00:03:26.615 INFO:tasks.workunit.client.0.smithi049.stdout:8/743: read - d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/f90 zero size 2024-06-03T00:03:26.617 INFO:tasks.workunit.client.0.smithi049.stdout:8/744: creat d4/d27/d3c/d43/fff x:0 0 0 2024-06-03T00:03:26.617 INFO:tasks.workunit.client.0.smithi049.stdout:8/745: read - d4/d27/d3c/d88/d28/d25/fdf zero size 2024-06-03T00:03:26.620 INFO:tasks.workunit.client.0.smithi049.stdout:5/904: write d3/d5/d2d/d4b/f59 [2767187,55845] 0 2024-06-03T00:03:26.621 INFO:tasks.workunit.client.0.smithi049.stdout:5/905: symlink d3/d53/d9c/l117 0 2024-06-03T00:03:26.622 INFO:tasks.workunit.client.0.smithi049.stdout:3/741: write d2/d1a/f65 [3400686,108189] 0 2024-06-03T00:03:26.622 INFO:tasks.workunit.client.0.smithi049.stdout:2/878: dwrite da/d52/d73/ff1 [4194304,4194304] 0 2024-06-03T00:03:26.622 INFO:tasks.workunit.client.0.smithi049.stdout:5/906: read d3/d5/da/d55/df4/d109/dec/ffa [21195,52541] 0 2024-06-03T00:03:26.623 INFO:tasks.workunit.client.0.smithi049.stdout:3/742: mkdir d2/d1a/d34/dd5/d75/d94/dd1/da0/de3/dee/d10b 0 2024-06-03T00:03:26.623 INFO:tasks.workunit.client.0.smithi049.stdout:2/879: write da/d52/d40/d63/daa/f87 [300834,84290] 0 2024-06-03T00:03:26.625 INFO:tasks.workunit.client.0.smithi049.stdout:3/743: unlink d2/d1a/l61 0 2024-06-03T00:03:26.626 INFO:tasks.workunit.client.0.smithi049.stdout:3/744: getdents d2/d1a/d34/dd5/d75/d94/d9e 0 2024-06-03T00:03:26.626 INFO:tasks.workunit.client.0.smithi049.stdout:3/745: stat d2/d1a/d34/f102 0 2024-06-03T00:03:26.629 INFO:tasks.workunit.client.0.smithi049.stdout:3/746: rename d2/d1a/cc0 to d2/d1a/d34/dd5/d75/d94/c10c 0 2024-06-03T00:03:26.631 INFO:tasks.workunit.client.0.smithi049.stdout:4/819: dread d4/d2a/f6d [0,4194304] 0 2024-06-03T00:03:26.635 INFO:tasks.workunit.client.0.smithi049.stdout:7/841: dwrite d3/dd8/d13/d3c/d4b/d5a/ff1 [0,4194304] 0 2024-06-03T00:03:26.637 INFO:tasks.workunit.client.0.smithi049.stdout:7/842: symlink d3/dd8/d13/d3c/d48/d11d/l135 0 2024-06-03T00:03:26.647 INFO:tasks.workunit.client.0.smithi049.stdout:6/954: dwrite d2/d3/f113 [0,4194304] 0 2024-06-03T00:03:26.647 INFO:tasks.workunit.client.0.smithi049.stdout:0/767: dwrite d6/d29/dc8/d52/f5c [0,4194304] 0 2024-06-03T00:03:26.647 INFO:tasks.workunit.client.0.smithi049.stdout:0/768: dread - d6/d59/d93/ffc zero size 2024-06-03T00:03:26.647 INFO:tasks.workunit.client.0.smithi049.stdout:5/907: dwrite d3/d5/d2d/d4b/d51/fef [0,4194304] 0 2024-06-03T00:03:26.648 INFO:tasks.workunit.client.0.smithi049.stdout:6/955: write d2/d3/d9/d23/d29/f32 [4399767,129982] 0 2024-06-03T00:03:26.650 INFO:tasks.workunit.client.0.smithi049.stdout:4/820: write d4/d3f/d14/d2b/d84/f67 [5128496,75124] 0 2024-06-03T00:03:26.650 INFO:tasks.workunit.client.0.smithi049.stdout:5/908: creat d3/d5/da/d55/df4/d109/d108/f118 x:0 0 0 2024-06-03T00:03:26.652 INFO:tasks.workunit.client.0.smithi049.stdout:6/956: unlink d2/d3/d17/d57/fac 0 2024-06-03T00:03:26.652 INFO:tasks.workunit.client.0.smithi049.stdout:6/957: dread - d2/f3e zero size 2024-06-03T00:03:26.652 INFO:tasks.workunit.client.0.smithi049.stdout:6/958: write d2/d3/d17/d57/d6e/d88/d112/f125 [1001263,78722] 0 2024-06-03T00:03:26.652 INFO:tasks.workunit.client.0.smithi049.stdout:4/821: mkdir d4/d3f/d14/d82/d117 0 2024-06-03T00:03:26.652 INFO:tasks.workunit.client.0.smithi049.stdout:4/822: read - d4/d3f/d14/d2b/d84/d69/dc6/f10f zero size 2024-06-03T00:03:26.652 INFO:tasks.workunit.client.0.smithi049.stdout:4/823: readlink d4/l7d 0 2024-06-03T00:03:26.653 INFO:tasks.workunit.client.0.smithi049.stdout:5/909: symlink d3/d9/l119 0 2024-06-03T00:03:26.655 INFO:tasks.workunit.client.0.smithi049.stdout:5/910: mknod d3/d9/d20/d4c/d5a/d65/c11a 0 2024-06-03T00:03:26.655 INFO:tasks.workunit.client.0.smithi049.stdout:6/959: rename d2/d3b/fd1 to d2/d3/d9/d23/d48/d89/f13e 0 2024-06-03T00:03:26.657 INFO:tasks.workunit.client.0.smithi049.stdout:3/747: dwrite d2/d14/d44/d52/d4c/f97 [0,4194304] 0 2024-06-03T00:03:26.657 INFO:tasks.workunit.client.0.smithi049.stdout:2/880: dwrite da/d52/d40/d63/f48 [0,4194304] 0 2024-06-03T00:03:26.662 INFO:tasks.workunit.client.0.smithi049.stdout:3/748: creat d2/d1a/d76/f10d x:0 0 0 2024-06-03T00:03:26.662 INFO:tasks.workunit.client.0.smithi049.stdout:3/749: fdatasync d2/d14/d22/d3a/fd8 0 2024-06-03T00:03:26.663 INFO:tasks.workunit.client.0.smithi049.stdout:3/750: dread - d2/d14/f2e zero size 2024-06-03T00:03:26.668 INFO:tasks.workunit.client.0.smithi049.stdout:4/824: dread d4/d3f/d14/d7f/d87/f9c [0,4194304] 0 2024-06-03T00:03:26.672 INFO:tasks.workunit.client.0.smithi049.stdout:4/825: mknod d4/d3f/d14/d2b/d84/d1c/c118 0 2024-06-03T00:03:26.682 INFO:tasks.workunit.client.0.smithi049.stdout:0/769: dwrite d6/d30/f27 [0,4194304] 0 2024-06-03T00:03:26.684 INFO:tasks.workunit.client.0.smithi049.stdout:0/770: creat d6/f109 x:0 0 0 2024-06-03T00:03:26.684 INFO:tasks.workunit.client.0.smithi049.stdout:0/771: truncate d6/d30/f9c 1878314 0 2024-06-03T00:03:26.684 INFO:tasks.workunit.client.0.smithi049.stdout:0/772: chown d6/d29/dc8/d52/d96/dfb 2021269 1 2024-06-03T00:03:26.694 INFO:tasks.workunit.client.0.smithi049.stdout:5/911: dwrite d3/d9/d20/f2e [0,4194304] 0 2024-06-03T00:03:26.694 INFO:tasks.workunit.client.0.smithi049.stdout:6/960: dwrite d2/d3/d17/f6b [0,4194304] 0 2024-06-03T00:03:26.694 INFO:tasks.workunit.client.0.smithi049.stdout:5/912: dread - d3/f10d zero size 2024-06-03T00:03:26.695 INFO:tasks.workunit.client.0.smithi049.stdout:5/913: rmdir d3/d5/da/dcf 39 2024-06-03T00:03:26.696 INFO:tasks.workunit.client.0.smithi049.stdout:6/961: mknod d2/d3/d9/d23/d48/d53/c13f 0 2024-06-03T00:03:26.696 INFO:tasks.workunit.client.0.smithi049.stdout:5/914: truncate d3/fba 400018 0 2024-06-03T00:03:26.696 INFO:tasks.workunit.client.0.smithi049.stdout:5/915: fsync d3/d5/da/d55/d75/ff2 0 2024-06-03T00:03:26.696 INFO:tasks.workunit.client.0.smithi049.stdout:5/916: fsync d3/d5/da/d55/df4/d109/dec/ffa 0 2024-06-03T00:03:26.696 INFO:tasks.workunit.client.0.smithi049.stdout:5/917: chown d3/d5/da/d55/d14/d16/f25 99 1 2024-06-03T00:03:26.697 INFO:tasks.workunit.client.0.smithi049.stdout:6/962: mknod d2/d3/c140 0 2024-06-03T00:03:26.699 INFO:tasks.workunit.client.0.smithi049.stdout:6/963: creat d2/d4d/d11a/f141 x:0 0 0 2024-06-03T00:03:26.704 INFO:tasks.workunit.client.0.smithi049.stdout:4/826: dwrite d4/fc3 [0,4194304] 0 2024-06-03T00:03:26.704 INFO:tasks.workunit.client.0.smithi049.stdout:3/751: dwrite d2/d14/d44/fa5 [0,4194304] 0 2024-06-03T00:03:26.706 INFO:tasks.workunit.client.0.smithi049.stdout:3/752: mkdir d2/d1a/d34/dd5/d75/d10e 0 2024-06-03T00:03:26.706 INFO:tasks.workunit.client.0.smithi049.stdout:4/827: getdents d4/d3f/d14/d2b/d84/d1c/d4f/ded 0 2024-06-03T00:03:26.707 INFO:tasks.workunit.client.0.smithi049.stdout:4/828: fdatasync d4/d3f/d14/d2b/d84/d1c/d24/d43/f9d 0 2024-06-03T00:03:26.708 INFO:tasks.workunit.client.0.smithi049.stdout:3/753: symlink d2/d1a/d34/dd5/d75/d94/dd1/da0/de3/l10f 0 2024-06-03T00:03:26.708 INFO:tasks.workunit.client.0.smithi049.stdout:6/964: write d2/d3/d17/f6b [293989,71732] 0 2024-06-03T00:03:26.708 INFO:tasks.workunit.client.0.smithi049.stdout:2/881: dwrite da/d52/d40/d63/fdb [0,4194304] 0 2024-06-03T00:03:26.709 INFO:tasks.workunit.client.0.smithi049.stdout:3/754: chown d2/d14/d22/f9a 185 1 2024-06-03T00:03:26.709 INFO:tasks.workunit.client.0.smithi049.stdout:3/755: write d2/d14/d22/d42/d68/ffd [108143,75123] 0 2024-06-03T00:03:26.711 INFO:tasks.workunit.client.0.smithi049.stdout:3/756: rmdir d2/d14/d44/d52/d4c/d4b/d98/dec 0 2024-06-03T00:03:26.713 INFO:tasks.workunit.client.0.smithi049.stdout:2/882: mkdir da/d52/d37/d59/dca/d113 0 2024-06-03T00:03:26.716 INFO:tasks.workunit.client.0.smithi049.stdout:5/918: dwrite d3/d5/da/f2b [0,4194304] 0 2024-06-03T00:03:26.716 INFO:tasks.workunit.client.0.smithi049.stdout:5/919: fdatasync d3/d5/d24/f5f 0 2024-06-03T00:03:26.718 INFO:tasks.workunit.client.0.smithi049.stdout:3/757: dread d2/d14/f6f [0,4194304] 0 2024-06-03T00:03:26.720 INFO:tasks.workunit.client.0.smithi049.stdout:3/758: creat d2/d1a/f110 x:0 0 0 2024-06-03T00:03:26.724 INFO:tasks.workunit.client.0.smithi049.stdout:2/883: dread da/d52/d40/d63/daa/f7f [0,4194304] 0 2024-06-03T00:03:26.728 INFO:tasks.workunit.client.0.smithi049.stdout:2/884: symlink da/d52/df/d3c/d7a/l114 0 2024-06-03T00:03:26.729 INFO:tasks.workunit.client.0.smithi049.stdout:6/965: dwrite d2/d3/d17/d57/d6e/d88/dcc/df8/ffc [0,4194304] 0 2024-06-03T00:03:26.734 INFO:tasks.workunit.client.0.smithi049.stdout:6/966: rename d2/d3/d9/fd7 to d2/d3/d17/d57/d6e/d88/dde/de9/da6/f142 0 2024-06-03T00:03:26.734 INFO:tasks.workunit.client.0.smithi049.stdout:5/920: read d3/d5/da/f50 [3005299,125704] 0 2024-06-03T00:03:26.736 INFO:tasks.workunit.client.0.smithi049.stdout:6/967: readlink d2/d4d/d76/de4/l10d 0 2024-06-03T00:03:26.737 INFO:tasks.workunit.client.0.smithi049.stdout:6/968: dread - d2/fce zero size 2024-06-03T00:03:26.739 INFO:tasks.workunit.client.0.smithi049.stdout:2/885: write f6 [807016,126768] 0 2024-06-03T00:03:26.743 INFO:tasks.workunit.client.0.smithi049.stdout:2/886: dread da/d52/f33 [0,4194304] 0 2024-06-03T00:03:26.747 INFO:tasks.workunit.client.0.smithi049.stdout:5/921: write d3/d9/f49 [540880,129286] 0 2024-06-03T00:03:26.748 INFO:tasks.workunit.client.0.smithi049.stdout:4/829: dwrite d4/d2a/fbb [0,4194304] 0 2024-06-03T00:03:26.748 INFO:tasks.workunit.client.0.smithi049.stdout:3/759: dwrite d2/d1a/d76/d95/fd3 [0,4194304] 0 2024-06-03T00:03:26.750 INFO:tasks.workunit.client.0.smithi049.stdout:6/969: write d2/d3/d9/d23/d29/f41 [1148892,44129] 0 2024-06-03T00:03:26.750 INFO:tasks.workunit.client.0.smithi049.stdout:3/760: mkdir d2/d1a/d34/de9/de0/d111 0 2024-06-03T00:03:26.751 INFO:tasks.workunit.client.0.smithi049.stdout:6/970: write d2/d3/d9/d23/d48/d51/f10c [843726,5264] 0 2024-06-03T00:03:26.753 INFO:tasks.workunit.client.0.smithi049.stdout:6/971: symlink d2/d3/d17/d57/d6e/dd3/de2/l143 0 2024-06-03T00:03:26.753 INFO:tasks.workunit.client.0.smithi049.stdout:6/972: truncate d2/d3/d17/d57/d6e/dd3/f11f 838419 0 2024-06-03T00:03:26.753 INFO:tasks.workunit.client.0.smithi049.stdout:6/973: write d2/d3/d9/d23/d48/d51/f10c [1509934,101212] 0 2024-06-03T00:03:26.755 INFO:tasks.workunit.client.0.smithi049.stdout:6/974: creat d2/d3/d9/f144 x:0 0 0 2024-06-03T00:03:26.755 INFO:tasks.workunit.client.0.smithi049.stdout:4/830: symlink d4/d2a/ddf/l119 0 2024-06-03T00:03:26.757 INFO:tasks.workunit.client.0.smithi049.stdout:3/761: symlink d2/d14/l112 0 2024-06-03T00:03:26.757 INFO:tasks.workunit.client.0.smithi049.stdout:2/887: dread da/d43/f7e [0,4194304] 0 2024-06-03T00:03:26.757 INFO:tasks.workunit.client.0.smithi049.stdout:3/762: dread - d2/d1a/d34/dd5/d75/d94/f100 zero size 2024-06-03T00:03:26.757 INFO:tasks.workunit.client.0.smithi049.stdout:4/831: creat d4/d3f/d14/d2b/d84/d69/dc6/f11a x:0 0 0 2024-06-03T00:03:26.758 INFO:tasks.workunit.client.0.smithi049.stdout:3/763: creat d2/d1a/d34/dd5/d75/d94/d9e/d105/f113 x:0 0 0 2024-06-03T00:03:26.758 INFO:tasks.workunit.client.0.smithi049.stdout:3/764: fsync d2/fe 0 2024-06-03T00:03:26.760 INFO:tasks.workunit.client.0.smithi049.stdout:4/832: fsync d4/d3f/d14/d2b/d84/d69/dc6/f78 0 2024-06-03T00:03:26.761 INFO:tasks.workunit.client.0.smithi049.stdout:3/765: creat d2/d1a/d34/dd5/d75/d94/dd1/da0/de3/f114 x:0 0 0 2024-06-03T00:03:26.761 INFO:tasks.workunit.client.0.smithi049.stdout:2/888: creat da/d52/d37/d70/f115 x:0 0 0 2024-06-03T00:03:26.763 INFO:tasks.workunit.client.0.smithi049.stdout:3/766: symlink d2/d14/d22/d3a/l115 0 2024-06-03T00:03:26.763 INFO:tasks.workunit.client.0.smithi049.stdout:6/975: dread d2/d3b/d103/f115 [0,4194304] 0 2024-06-03T00:03:26.764 INFO:tasks.workunit.client.0.smithi049.stdout:5/922: dwrite d3/f9f [0,4194304] 0 2024-06-03T00:03:26.764 INFO:tasks.workunit.client.0.smithi049.stdout:5/923: stat d3/d9/d20/d4c/f6a 0 2024-06-03T00:03:26.765 INFO:tasks.workunit.client.0.smithi049.stdout:3/767: mkdir d2/d14/d22/d42/d68/d80/d116 0 2024-06-03T00:03:26.765 INFO:tasks.workunit.client.0.smithi049.stdout:3/768: write d2/d1a/d76/f99 [258612,99869] 0 2024-06-03T00:03:26.766 INFO:tasks.workunit.client.0.smithi049.stdout:2/889: symlink da/d52/d40/dce/l116 0 2024-06-03T00:03:26.768 INFO:tasks.workunit.client.0.smithi049.stdout:5/924: stat d3/d53/d9c/ccd 0 2024-06-03T00:03:26.769 INFO:tasks.workunit.client.0.smithi049.stdout:5/925: rmdir d3/d53/d9c/da4 39 2024-06-03T00:03:26.771 INFO:tasks.workunit.client.0.smithi049.stdout:3/769: mknod d2/d1a/d34/dd5/d75/d94/dd1/c117 0 2024-06-03T00:03:26.772 INFO:tasks.workunit.client.0.smithi049.stdout:6/976: dread d2/d3/d9/d23/d48/d51/f10c [0,4194304] 0 2024-06-03T00:03:26.772 INFO:tasks.workunit.client.0.smithi049.stdout:4/833: write d4/d3f/f101 [184330,19035] 0 2024-06-03T00:03:26.773 INFO:tasks.workunit.client.0.smithi049.stdout:5/926: unlink d3/d5/d2d/d4b/d51/ffd 0 2024-06-03T00:03:26.773 INFO:tasks.workunit.client.0.smithi049.stdout:4/834: getdents d4/d3f/d14/d7f/ddb/d108 0 2024-06-03T00:03:26.774 INFO:tasks.workunit.client.0.smithi049.stdout:6/977: creat d2/d4d/f145 x:0 0 0 2024-06-03T00:03:26.777 INFO:tasks.workunit.client.0.smithi049.stdout:6/978: rmdir d2/d3b/df3 0 2024-06-03T00:03:26.778 INFO:tasks.workunit.client.0.smithi049.stdout:6/979: stat d2/d3/d9/d23/f1e 0 2024-06-03T00:03:26.779 INFO:tasks.workunit.client.0.smithi049.stdout:2/890: dwrite da/d52/d40/d93/f108 [0,4194304] 0 2024-06-03T00:03:26.783 INFO:tasks.workunit.client.0.smithi049.stdout:2/891: link da/d52/df/l14 da/d52/df/ddd/l117 0 2024-06-03T00:03:26.795 INFO:tasks.workunit.client.0.smithi049.stdout:2/892: dread da/d52/d40/dce/ffe [0,4194304] 0 2024-06-03T00:03:26.801 INFO:tasks.workunit.client.0.smithi049.stdout:3/770: dwrite d2/f13 [4194304,4194304] 0 2024-06-03T00:03:26.802 INFO:tasks.workunit.client.0.smithi049.stdout:6/980: dwrite d2/d3/d9/d23/d48/d51/f10c [0,4194304] 0 2024-06-03T00:03:26.802 INFO:tasks.workunit.client.0.smithi049.stdout:3/771: read d2/d14/d44/d52/d4c/d4b/fb5 [95371,97961] 0 2024-06-03T00:03:26.802 INFO:tasks.workunit.client.0.smithi049.stdout:4/835: dwrite d4/d3f/d14/d2b/d84/d69/dc6/f78 [0,4194304] 0 2024-06-03T00:03:26.804 INFO:tasks.workunit.client.0.smithi049.stdout:4/836: truncate f2 1166970 0 2024-06-03T00:03:26.805 INFO:tasks.workunit.client.0.smithi049.stdout:3/772: unlink d2/d1a/d34/dd5/l69 0 2024-06-03T00:03:26.816 INFO:tasks.workunit.client.0.smithi049.stdout:6/981: dwrite d2/d3/d17/d57/d6e/d88/d112/f125 [0,4194304] 0 2024-06-03T00:03:26.819 INFO:tasks.workunit.client.0.smithi049.stdout:6/982: mkdir d2/d4d/de3/d146 0 2024-06-03T00:03:26.826 INFO:tasks.workunit.client.0.smithi049.stdout:4/837: dwrite d4/d3f/f52 [0,4194304] 0 2024-06-03T00:03:26.830 INFO:tasks.workunit.client.0.smithi049.stdout:4/838: rename d4/d3f/d14/d2b/d84/d69/dc6/cb6 to d4/d3f/d14/d2b/d84/d69/dc6/dd3/c11b 0 2024-06-03T00:03:26.832 INFO:tasks.workunit.client.0.smithi049.stdout:4/839: creat d4/d2a/d76/f11c x:0 0 0 2024-06-03T00:03:26.832 INFO:tasks.workunit.client.0.smithi049.stdout:4/840: fsync d4/fa8 0 2024-06-03T00:03:26.832 INFO:tasks.workunit.client.0.smithi049.stdout:4/841: truncate d4/d3f/d14/fd8 1171849 0 2024-06-03T00:03:26.833 INFO:tasks.workunit.client.0.smithi049.stdout:4/842: mknod d4/d3f/d14/d7f/ddb/c11d 0 2024-06-03T00:03:26.836 INFO:tasks.workunit.client.0.smithi049.stdout:4/843: mkdir d4/d3f/d14/d7f/ddb/d8a/d11e 0 2024-06-03T00:03:26.836 INFO:tasks.workunit.client.0.smithi049.stdout:4/844: chown d4/d3f/d14/d7f/ddb/dc2/le7 89286433 1 2024-06-03T00:03:26.836 INFO:tasks.workunit.client.0.smithi049.stdout:4/845: rmdir d4/d2a/d76 39 2024-06-03T00:03:26.836 INFO:tasks.workunit.client.0.smithi049.stdout:4/846: readlink d4/d3f/d14/d2b/d84/l17 0 2024-06-03T00:03:26.837 INFO:tasks.workunit.client.0.smithi049.stdout:4/847: chown d4/fa8 11328 1 2024-06-03T00:03:26.838 INFO:tasks.workunit.client.0.smithi049.stdout:4/848: link d4/ff d4/d3f/d14/d7f/ddb/f11f 0 2024-06-03T00:03:26.845 INFO:tasks.workunit.client.0.smithi049.stdout:4/849: dread d4/d3f/d14/d2b/f48 [4194304,4194304] 0 2024-06-03T00:03:26.847 INFO:tasks.workunit.client.0.smithi049.stdout:6/983: dwrite d2/d133/f132 [0,4194304] 0 2024-06-03T00:03:26.850 INFO:tasks.workunit.client.0.smithi049.stdout:6/984: dread d2/d3/d9/d40/fc1 [0,4194304] 0 2024-06-03T00:03:26.852 INFO:tasks.workunit.client.0.smithi049.stdout:6/985: mknod d2/d3/c147 0 2024-06-03T00:03:26.853 INFO:tasks.workunit.client.0.smithi049.stdout:6/986: creat d2/d3/d9/d23/d29/dd6/f148 x:0 0 0 2024-06-03T00:03:26.854 INFO:tasks.workunit.client.0.smithi049.stdout:4/850: dread d4/d2a/d76/fd7 [0,4194304] 0 2024-06-03T00:03:26.858 INFO:tasks.workunit.client.0.smithi049.stdout:6/987: write d2/d3/d9/d23/f82 [2206241,58990] 0 2024-06-03T00:03:26.858 INFO:tasks.workunit.client.0.smithi049.stdout:4/851: write d4/d3f/d14/d7f/d87/f92 [4503679,84601] 0 2024-06-03T00:03:26.859 INFO:tasks.workunit.client.0.smithi049.stdout:6/988: unlink d2/d4d/f145 0 2024-06-03T00:03:26.859 INFO:tasks.workunit.client.0.smithi049.stdout:4/852: unlink d4/d3f/d14/d2b/cd0 0 2024-06-03T00:03:26.860 INFO:tasks.workunit.client.0.smithi049.stdout:6/989: mknod d2/d3/d9/d23/d48/d53/d127/c149 0 2024-06-03T00:03:26.860 INFO:tasks.workunit.client.0.smithi049.stdout:4/853: getdents d4/d3f/d14/d2b/d84/d69/dc6/dd3 0 2024-06-03T00:03:26.860 INFO:tasks.workunit.client.0.smithi049.stdout:6/990: readlink d2/d3/d17/d57/laf 0 2024-06-03T00:03:26.861 INFO:tasks.workunit.client.0.smithi049.stdout:4/854: mkdir d4/d3f/d14/d82/d117/d120 0 2024-06-03T00:03:26.861 INFO:tasks.workunit.client.0.smithi049.stdout:6/991: symlink d2/d3/d9/l14a 0 2024-06-03T00:03:26.862 INFO:tasks.workunit.client.0.smithi049.stdout:4/855: truncate d4/d3f/ffb 5803106 0 2024-06-03T00:03:26.866 INFO:tasks.workunit.client.0.smithi049.stdout:6/992: write d2/d3/d9/d23/fc3 [2070681,91882] 0 2024-06-03T00:03:26.866 INFO:tasks.workunit.client.0.smithi049.stdout:6/993: rmdir d2/d3b 39 2024-06-03T00:03:26.867 INFO:tasks.workunit.client.0.smithi049.stdout:6/994: rmdir d2/d133 39 2024-06-03T00:03:26.870 INFO:tasks.workunit.client.0.smithi049.stdout:4/856: write d4/d3f/d14/fc1 [772285,49591] 0 2024-06-03T00:03:26.871 INFO:tasks.workunit.client.0.smithi049.stdout:4/857: write d4/d3f/f107 [256695,5506] 0 2024-06-03T00:03:26.874 INFO:tasks.workunit.client.0.smithi049.stdout:4/858: rename d4/d3f/d14/d2b/d84/d1c/d24/f51 to d4/d3f/d14/d2b/d84/d1c/d24/d43/f121 0 2024-06-03T00:03:26.875 INFO:tasks.workunit.client.0.smithi049.stdout:4/859: mknod d4/d3f/d14/d82/d117/c122 0 2024-06-03T00:03:26.888 INFO:tasks.workunit.client.0.smithi049.stdout:4/860: write f2 [2147814,76231] 0 2024-06-03T00:03:26.890 INFO:tasks.workunit.client.0.smithi049.stdout:6/995: dwrite d2/d3/d9/d23/d48/f92 [0,4194304] 0 2024-06-03T00:03:26.890 INFO:tasks.workunit.client.0.smithi049.stdout:6/996: chown d2/d3/d9/d23/d48/f61 456 1 2024-06-03T00:03:26.901 INFO:tasks.workunit.client.0.smithi049.stdout:6/997: dread d2/d3/d9/d55/f5c [0,4194304] 0 2024-06-03T00:03:26.901 INFO:tasks.workunit.client.0.smithi049.stdout:6/998: stat d2/d3/d9/d23/d29/c3c 0 2024-06-03T00:03:26.903 INFO:tasks.workunit.client.0.smithi049.stdout:6/999: link d2/d3/d17/d57/d6e/d88/d119/f12d d2/d3/d9/d23/f14b 0 2024-06-03T00:03:26.907 INFO:tasks.workunit.client.0.smithi049.stdout:4/861: dwrite d4/d2a/ddf/f100 [0,4194304] 0 2024-06-03T00:03:26.909 INFO:tasks.workunit.client.0.smithi049.stdout:4/862: mknod d4/d3f/d14/d2b/d84/c123 0 2024-06-03T00:03:26.910 INFO:tasks.workunit.client.0.smithi049.stdout:4/863: write d4/f63 [283174,53676] 0 2024-06-03T00:03:26.912 INFO:tasks.workunit.client.0.smithi049.stdout:4/864: rename d4/d2a/l9e to d4/d3f/d14/d82/d117/l124 0 2024-06-03T00:03:26.913 INFO:tasks.workunit.client.0.smithi049.stdout:4/865: write d4/d3f/d14/d2b/ff4 [705332,103693] 0 2024-06-03T00:03:26.913 INFO:tasks.workunit.client.0.smithi049.stdout:4/866: write d4/fa8 [1830845,108957] 0 2024-06-03T00:03:26.914 INFO:tasks.workunit.client.0.smithi049.stdout:4/867: creat d4/d3f/d14/d2b/d84/d69/dc6/f125 x:0 0 0 2024-06-03T00:03:26.915 INFO:tasks.workunit.client.0.smithi049.stdout:4/868: creat d4/d3f/d14/d2b/d84/d1c/d4f/ded/f126 x:0 0 0 2024-06-03T00:03:26.916 INFO:tasks.workunit.client.0.smithi049.stdout:4/869: mknod d4/d3f/d14/d2b/d84/c127 0 2024-06-03T00:03:26.916 INFO:tasks.workunit.client.0.smithi049.stdout:4/870: chown d4/l7d 689 1 2024-06-03T00:03:26.916 INFO:tasks.workunit.client.0.smithi049.stdout:4/871: chown d4/d3f/d14/d2b/d84/d1c/d24/d43/l5a 8008 1 2024-06-03T00:03:26.927 INFO:tasks.workunit.client.0.smithi049.stdout:5/927: sync 2024-06-03T00:03:26.927 INFO:tasks.workunit.client.0.smithi049.stdout:0/773: sync 2024-06-03T00:03:26.927 INFO:tasks.workunit.client.0.smithi049.stdout:8/746: sync 2024-06-03T00:03:26.927 INFO:tasks.workunit.client.0.smithi049.stdout:7/843: sync 2024-06-03T00:03:26.927 INFO:tasks.workunit.client.0.smithi049.stdout:8/747: stat d4 0 2024-06-03T00:03:26.928 INFO:tasks.workunit.client.0.smithi049.stdout:8/748: read d4/d27/d3c/d88/d28/d52/d66/d53/f40 [161701,97228] 0 2024-06-03T00:03:26.928 INFO:tasks.workunit.client.0.smithi049.stdout:5/928: mknod d3/c11b 0 2024-06-03T00:03:26.929 INFO:tasks.workunit.client.0.smithi049.stdout:7/844: creat d3/d32/d95/f136 x:0 0 0 2024-06-03T00:03:26.930 INFO:tasks.workunit.client.0.smithi049.stdout:5/929: creat d3/d5/da/d55/d75/dad/f11c x:0 0 0 2024-06-03T00:03:26.930 INFO:tasks.workunit.client.0.smithi049.stdout:7/845: rmdir d3/dd8/d9/d8f/d118 39 2024-06-03T00:03:26.931 INFO:tasks.workunit.client.0.smithi049.stdout:7/846: rmdir d3/dd8/d13/d3c/d48/d7b/d9c/dc8 39 2024-06-03T00:03:26.931 INFO:tasks.workunit.client.0.smithi049.stdout:5/930: creat d3/d5/d10f/f11d x:0 0 0 2024-06-03T00:03:26.931 INFO:tasks.workunit.client.0.smithi049.stdout:7/847: stat d3/dd8/d13/d3c/d48/d7b/d9c/fb6 0 2024-06-03T00:03:26.932 INFO:tasks.workunit.client.0.smithi049.stdout:7/848: creat d3/d14/f137 x:0 0 0 2024-06-03T00:03:26.932 INFO:tasks.workunit.client.0.smithi049.stdout:7/849: chown d3/dd8/d13/d3c/d48/d7b/d5b 12 1 2024-06-03T00:03:26.936 INFO:tasks.workunit.client.0.smithi049.stdout:0/774: write d6/d29/fbb [957328,57447] 0 2024-06-03T00:03:26.936 INFO:tasks.workunit.client.0.smithi049.stdout:5/931: dread f1 [0,4194304] 0 2024-06-03T00:03:26.936 INFO:tasks.workunit.client.0.smithi049.stdout:5/932: fsync d3/d5/da/d55/d75/fa0 0 2024-06-03T00:03:26.937 INFO:tasks.workunit.client.0.smithi049.stdout:5/933: write d3/d5/fd6 [4447877,40784] 0 2024-06-03T00:03:26.937 INFO:tasks.workunit.client.0.smithi049.stdout:5/934: write d3/d5/da/d55/d75/ff2 [611910,63340] 0 2024-06-03T00:03:26.937 INFO:tasks.workunit.client.0.smithi049.stdout:7/850: dread d3/d14/fde [0,4194304] 0 2024-06-03T00:03:26.937 INFO:tasks.workunit.client.0.smithi049.stdout:8/749: write d4/d27/d3c/d88/f13 [111978,58236] 0 2024-06-03T00:03:26.938 INFO:tasks.workunit.client.0.smithi049.stdout:8/750: dread - d4/d27/d3c/d88/d28/d25/fdf zero size 2024-06-03T00:03:26.938 INFO:tasks.workunit.client.0.smithi049.stdout:5/935: creat d3/d5/f11e x:0 0 0 2024-06-03T00:03:26.938 INFO:tasks.workunit.client.0.smithi049.stdout:5/936: chown d3/f9f 676960084 1 2024-06-03T00:03:26.938 INFO:tasks.workunit.client.0.smithi049.stdout:7/851: creat d3/dd8/d13/d3c/d48/d7b/f138 x:0 0 0 2024-06-03T00:03:26.938 INFO:tasks.workunit.client.0.smithi049.stdout:8/751: creat d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/da9/f100 x:0 0 0 2024-06-03T00:03:26.938 INFO:tasks.workunit.client.0.smithi049.stdout:8/752: stat d4/d27/d3c/d88/fd3 0 2024-06-03T00:03:26.939 INFO:tasks.workunit.client.0.smithi049.stdout:0/775: mkdir d6/d97/d10a 0 2024-06-03T00:03:26.939 INFO:tasks.workunit.client.0.smithi049.stdout:7/852: readlink d3/dd8/d13/d3c/d48/d7b/d5b/lbe 0 2024-06-03T00:03:26.939 INFO:tasks.workunit.client.0.smithi049.stdout:5/937: creat d3/d5/da/d55/d75/f11f x:0 0 0 2024-06-03T00:03:26.939 INFO:tasks.workunit.client.0.smithi049.stdout:5/938: readlink d3/d9/d20/d4c/lf0 0 2024-06-03T00:03:26.940 INFO:tasks.workunit.client.0.smithi049.stdout:8/753: link d4/d27/d3c/d88/d48/lc8 d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/da9/dd9/l101 0 2024-06-03T00:03:26.942 INFO:tasks.workunit.client.0.smithi049.stdout:7/853: dread d3/dd8/d9/f2b [0,4194304] 0 2024-06-03T00:03:26.942 INFO:tasks.workunit.client.0.smithi049.stdout:7/854: chown d3/dd8/d9/d8f/c108 472429 1 2024-06-03T00:03:26.942 INFO:tasks.workunit.client.0.smithi049.stdout:5/939: rename d3/d5/d2d/d4b/f59 to d3/d53/d9c/da4/db9/f120 0 2024-06-03T00:03:26.942 INFO:tasks.workunit.client.0.smithi049.stdout:8/754: chown d4/d27/d30/lb0 2750415 1 2024-06-03T00:03:26.955 INFO:tasks.workunit.client.0.smithi049.stdout:5/940: write d3/d9/d20/d4c/d9d/fd8 [2362929,24135] 0 2024-06-03T00:03:26.955 INFO:tasks.workunit.client.0.smithi049.stdout:7/855: dread d3/dd8/d13/d54/fba [0,4194304] 0 2024-06-03T00:03:26.956 INFO:tasks.workunit.client.0.smithi049.stdout:0/776: dwrite d6/d30/da3/fe4 [4194304,4194304] 0 2024-06-03T00:03:26.967 INFO:tasks.workunit.client.0.smithi049.stdout:7/856: dread d3/dd8/d13/d3c/d4b/ff8 [0,4194304] 0 2024-06-03T00:03:26.968 INFO:tasks.workunit.client.0.smithi049.stdout:7/857: creat d3/dd8/d13/d54/f139 x:0 0 0 2024-06-03T00:03:26.969 INFO:tasks.workunit.client.0.smithi049.stdout:7/858: creat d3/dd8/d86/d90/dae/f13a x:0 0 0 2024-06-03T00:03:26.977 INFO:tasks.workunit.client.0.smithi049.stdout:5/941: dwrite d3/d5/da/d55/d75/dad/f11c [0,4194304] 0 2024-06-03T00:03:26.977 INFO:tasks.workunit.client.0.smithi049.stdout:0/777: dwrite d6/d29/dc8/d52/d96/f9f [0,4194304] 0 2024-06-03T00:03:26.978 INFO:tasks.workunit.client.0.smithi049.stdout:0/778: write d6/d29/fe3 [72983,40236] 0 2024-06-03T00:03:26.978 INFO:tasks.workunit.client.0.smithi049.stdout:7/859: read d3/dd8/d86/fa9 [3204063,22331] 0 2024-06-03T00:03:26.980 INFO:tasks.workunit.client.0.smithi049.stdout:7/860: fdatasync d3/dd8/d13/d79/d114/d12f/fa2 0 2024-06-03T00:03:26.980 INFO:tasks.workunit.client.0.smithi049.stdout:7/861: write d3/dd8/d86/fa9 [5155248,55553] 0 2024-06-03T00:03:26.980 INFO:tasks.workunit.client.0.smithi049.stdout:7/862: dread - d3/dd8/d9/d8f/dfd/f133 zero size 2024-06-03T00:03:26.997 INFO:tasks.workunit.client.0.smithi049.stdout:5/942: dwrite d3/d9/d20/d4c/f6a [0,4194304] 0 2024-06-03T00:03:27.000 INFO:tasks.workunit.client.0.smithi049.stdout:5/943: rename d3/d5/d9a to d3/d5/da/d55/df4/d121 0 2024-06-03T00:03:27.000 INFO:tasks.workunit.client.0.smithi049.stdout:5/944: symlink d3/d5/d2d/d4b/l122 0 2024-06-03T00:03:27.001 INFO:tasks.workunit.client.0.smithi049.stdout:0/779: dwrite d6/d59/d93/f100 [0,4194304] 0 2024-06-03T00:03:27.002 INFO:tasks.workunit.client.0.smithi049.stdout:7/863: dwrite d3/dd8/f5e [0,4194304] 0 2024-06-03T00:03:27.003 INFO:tasks.workunit.client.0.smithi049.stdout:7/864: read - d3/d14/d6e/f103 zero size 2024-06-03T00:03:27.005 INFO:tasks.workunit.client.0.smithi049.stdout:0/780: unlink d6/d97/ffe 0 2024-06-03T00:03:27.007 INFO:tasks.workunit.client.0.smithi049.stdout:7/865: creat d3/dd8/d13/d54/daa/d92/f13b x:0 0 0 2024-06-03T00:03:27.009 INFO:tasks.workunit.client.0.smithi049.stdout:0/781: dread d6/d29/dc8/d52/d96/fa6 [0,4194304] 0 2024-06-03T00:03:27.010 INFO:tasks.workunit.client.0.smithi049.stdout:7/866: rmdir d3/dd8/d13/d54/daa/d92 39 2024-06-03T00:03:27.011 INFO:tasks.workunit.client.0.smithi049.stdout:0/782: chown d6/d29/cb3 88987 1 2024-06-03T00:03:27.011 INFO:tasks.workunit.client.0.smithi049.stdout:0/783: fdatasync d6/d30/fac 0 2024-06-03T00:03:27.014 INFO:tasks.workunit.client.0.smithi049.stdout:7/867: creat d3/dd8/d13/d3c/d4b/f13c x:0 0 0 2024-06-03T00:03:27.014 INFO:tasks.workunit.client.0.smithi049.stdout:7/868: write d3/dd8/f1c [5262565,96791] 0 2024-06-03T00:03:27.014 INFO:tasks.workunit.client.0.smithi049.stdout:7/869: readlink d3/dd8/d13/d3c/d4b/d5a/la8 0 2024-06-03T00:03:27.014 INFO:tasks.workunit.client.0.smithi049.stdout:0/784: truncate d6/d29/f33 4022293 0 2024-06-03T00:03:27.021 INFO:tasks.workunit.client.0.smithi049.stdout:7/870: rename d3/dd8/d13/d3c/d48/fda to d3/d14/d6e/f13d 0 2024-06-03T00:03:27.024 INFO:tasks.workunit.client.0.smithi049.stdout:7/871: rename d3/dd8/c11c to d3/c13e 0 2024-06-03T00:03:27.026 INFO:tasks.workunit.client.0.smithi049.stdout:7/872: creat d3/dd8/d9/f13f x:0 0 0 2024-06-03T00:03:27.034 INFO:tasks.workunit.client.0.smithi049.stdout:0/785: dwrite d6/d97/f50 [0,4194304] 0 2024-06-03T00:03:27.040 INFO:tasks.workunit.client.0.smithi049.stdout:0/786: dread d6/d30/d32/fcd [0,4194304] 0 2024-06-03T00:03:27.042 INFO:tasks.workunit.client.0.smithi049.stdout:0/787: mkdir d6/d29/d10b 0 2024-06-03T00:03:27.046 INFO:tasks.workunit.client.0.smithi049.stdout:7/873: dwrite d3/dd8/d86/ff9 [0,4194304] 0 2024-06-03T00:03:27.048 INFO:tasks.workunit.client.0.smithi049.stdout:7/874: readlink d3/dd8/d13/d3c/d48/d7b/d5b/ldf 0 2024-06-03T00:03:27.049 INFO:tasks.workunit.client.0.smithi049.stdout:2/893: sync 2024-06-03T00:03:27.049 INFO:tasks.workunit.client.0.smithi049.stdout:3/773: sync 2024-06-03T00:03:27.049 INFO:tasks.workunit.client.0.smithi049.stdout:3/774: dread - d2/d1a/ff1 zero size 2024-06-03T00:03:27.049 INFO:tasks.workunit.client.0.smithi049.stdout:2/894: dread - da/d52/d37/dac/fc4 zero size 2024-06-03T00:03:27.050 INFO:tasks.workunit.client.0.smithi049.stdout:7/875: unlink d3/dd8/d13/d3c/d48/d7b/d5b/lbe 0 2024-06-03T00:03:27.051 INFO:tasks.workunit.client.0.smithi049.stdout:3/775: getdents d2/d1a/d34/dd5/d75/d94 0 2024-06-03T00:03:27.051 INFO:tasks.workunit.client.0.smithi049.stdout:3/776: stat d2/d1a/d34/de9/de0/d111 0 2024-06-03T00:03:27.051 INFO:tasks.workunit.client.0.smithi049.stdout:3/777: chown d2/d1a/d34/dd5/d75/d94/fc1 410537 1 2024-06-03T00:03:27.051 INFO:tasks.workunit.client.0.smithi049.stdout:3/778: chown d2/d14/d44 3 1 2024-06-03T00:03:27.051 INFO:tasks.workunit.client.0.smithi049.stdout:3/779: truncate d2/d14/d22/d3a/d47/f92 1087511 0 2024-06-03T00:03:27.051 INFO:tasks.workunit.client.0.smithi049.stdout:2/895: creat da/d52/df/d3c/de8/f118 x:0 0 0 2024-06-03T00:03:27.052 INFO:tasks.workunit.client.0.smithi049.stdout:3/780: creat d2/d14/d22/d42/f118 x:0 0 0 2024-06-03T00:03:27.054 INFO:tasks.workunit.client.0.smithi049.stdout:3/781: creat d2/d14/d44/d52/d4c/d4b/d98/f119 x:0 0 0 2024-06-03T00:03:27.054 INFO:tasks.workunit.client.0.smithi049.stdout:2/896: rename da/d52/d37/d59/l67 to da/d10f/l119 0 2024-06-03T00:03:27.054 INFO:tasks.workunit.client.0.smithi049.stdout:2/897: rmdir da/d72/d83 39 2024-06-03T00:03:27.055 INFO:tasks.workunit.client.0.smithi049.stdout:2/898: stat da/d72/cec 0 2024-06-03T00:03:27.055 INFO:tasks.workunit.client.0.smithi049.stdout:3/782: creat d2/d1a/d34/dd5/d75/d94/dd1/da0/de3/dee/d10b/f11a x:0 0 0 2024-06-03T00:03:27.058 INFO:tasks.workunit.client.0.smithi049.stdout:7/876: dread d3/dd8/d13/d3c/d48/d7b/d9c/df6/d11e/d12e/f77 [0,4194304] 0 2024-06-03T00:03:27.058 INFO:tasks.workunit.client.0.smithi049.stdout:7/877: read d3/dd8/d13/d79/d114/d12f/fa2 [1427953,56427] 0 2024-06-03T00:03:27.058 INFO:tasks.workunit.client.0.smithi049.stdout:0/788: dwrite d6/d30/f44 [0,4194304] 0 2024-06-03T00:03:27.058 INFO:tasks.workunit.client.0.smithi049.stdout:0/789: fdatasync d6/d97/fc0 0 2024-06-03T00:03:27.061 INFO:tasks.workunit.client.0.smithi049.stdout:3/783: dread d2/d1a/d34/dd5/f7e [0,4194304] 0 2024-06-03T00:03:27.064 INFO:tasks.workunit.client.0.smithi049.stdout:3/784: dread d2/d14/d22/d3a/fd8 [0,4194304] 0 2024-06-03T00:03:27.066 INFO:tasks.workunit.client.0.smithi049.stdout:3/785: link d2/d1a/d34/dd5/c9f d2/d1a/d34/dd5/d75/ddc/c11b 0 2024-06-03T00:03:27.066 INFO:tasks.workunit.client.0.smithi049.stdout:7/878: dread d3/dd8/d13/d3c/d4b/f9b [0,4194304] 0 2024-06-03T00:03:27.067 INFO:tasks.workunit.client.0.smithi049.stdout:3/786: mkdir d2/d1a/d34/dd5/d75/d94/dd1/da0/de3/dee/d11c 0 2024-06-03T00:03:27.067 INFO:tasks.workunit.client.0.smithi049.stdout:3/787: readlink d2/d14/d44/d52/d4c/d4b/d58/l8c 0 2024-06-03T00:03:27.068 INFO:tasks.workunit.client.0.smithi049.stdout:3/788: creat d2/d14/d22/d3a/d47/d79/f11d x:0 0 0 2024-06-03T00:03:27.068 INFO:tasks.workunit.client.0.smithi049.stdout:3/789: write d2/f10a [391738,39940] 0 2024-06-03T00:03:27.069 INFO:tasks.workunit.client.0.smithi049.stdout:3/790: chown d2/d1a/d34/dd5/d75/d94/dd1/da0/de3/cfb 9 1 2024-06-03T00:03:27.069 INFO:tasks.workunit.client.0.smithi049.stdout:7/879: rename d3/dd8/d13/d3c/d48/d7b/d9c to d3/dd8/d13/d3c/d110/d140 0 2024-06-03T00:03:27.070 INFO:tasks.workunit.client.0.smithi049.stdout:3/791: creat d2/d1a/d34/de9/de0/d111/f11e x:0 0 0 2024-06-03T00:03:27.070 INFO:tasks.workunit.client.0.smithi049.stdout:3/792: fsync d2/d14/f6f 0 2024-06-03T00:03:27.070 INFO:tasks.workunit.client.0.smithi049.stdout:3/793: chown d2/d14 3807433 1 2024-06-03T00:03:27.070 INFO:tasks.workunit.client.0.smithi049.stdout:7/880: dread d3/dd8/f25 [4194304,4194304] 0 2024-06-03T00:03:27.070 INFO:tasks.workunit.client.0.smithi049.stdout:3/794: chown d2/d14/d44/d52/d4c/c4e 2 1 2024-06-03T00:03:27.072 INFO:tasks.workunit.client.0.smithi049.stdout:0/790: write d6/d29/dc8/d52/f5c [2751213,60259] 0 2024-06-03T00:03:27.075 INFO:tasks.workunit.client.0.smithi049.stdout:3/795: fsync d2/d14/d22/d3a/d47/d79/f11d 0 2024-06-03T00:03:27.076 INFO:tasks.workunit.client.0.smithi049.stdout:3/796: write d2/d14/d44/fb8 [1686493,22841] 0 2024-06-03T00:03:27.076 INFO:tasks.workunit.client.0.smithi049.stdout:2/899: dwrite da/d52/f2b [0,4194304] 0 2024-06-03T00:03:27.078 INFO:tasks.workunit.client.0.smithi049.stdout:3/797: link d2/fd d2/d1a/d34/de9/de0/f11f 0 2024-06-03T00:03:27.082 INFO:tasks.workunit.client.0.smithi049.stdout:0/791: write d6/d29/dc8/f87 [2416134,6489] 0 2024-06-03T00:03:27.084 INFO:tasks.workunit.client.0.smithi049.stdout:2/900: dread da/d52/d37/d70/fda [0,4194304] 0 2024-06-03T00:03:27.086 INFO:tasks.workunit.client.0.smithi049.stdout:2/901: read da/d72/d83/fd7 [531075,100764] 0 2024-06-03T00:03:27.087 INFO:tasks.workunit.client.0.smithi049.stdout:0/792: write d6/fb2 [3250248,14085] 0 2024-06-03T00:03:27.089 INFO:tasks.workunit.client.0.smithi049.stdout:0/793: creat d6/d29/dc8/f10c x:0 0 0 2024-06-03T00:03:27.090 INFO:tasks.workunit.client.0.smithi049.stdout:0/794: chown d6/d59/d93/f9d 10 1 2024-06-03T00:03:27.093 INFO:tasks.workunit.client.0.smithi049.stdout:0/795: unlink d6/d97/d4b/l65 0 2024-06-03T00:03:27.096 INFO:tasks.workunit.client.0.smithi049.stdout:0/796: mkdir d6/d29/dc8/d10d 0 2024-06-03T00:03:27.096 INFO:tasks.workunit.client.0.smithi049.stdout:0/797: dread - d6/d29/dc8/d52/f7c zero size 2024-06-03T00:03:27.102 INFO:tasks.workunit.client.0.smithi049.stdout:0/798: dread d6/d29/dc8/d52/f5c [0,4194304] 0 2024-06-03T00:03:27.102 INFO:tasks.workunit.client.0.smithi049.stdout:0/799: chown d6/d29/dc8/c41 1 1 2024-06-03T00:03:27.103 INFO:tasks.workunit.client.0.smithi049.stdout:0/800: chown d6/d30/d32/c4d 56 1 2024-06-03T00:03:27.103 INFO:tasks.workunit.client.0.smithi049.stdout:0/801: getdents d6/d29/dc8/d52/deb 0 2024-06-03T00:03:27.103 INFO:tasks.workunit.client.0.smithi049.stdout:0/802: write d6/d30/d32/fcd [2591321,124767] 0 2024-06-03T00:03:27.104 INFO:tasks.workunit.client.0.smithi049.stdout:0/803: write d6/d97/d4b/d67/ff5 [957034,113006] 0 2024-06-03T00:03:27.104 INFO:tasks.workunit.client.0.smithi049.stdout:0/804: stat d6/d59/d93/dcb/ccf 0 2024-06-03T00:03:27.107 INFO:tasks.workunit.client.0.smithi049.stdout:2/902: dwrite da/d52/df/d3c/f76 [0,4194304] 0 2024-06-03T00:03:27.108 INFO:tasks.workunit.client.0.smithi049.stdout:3/798: dwrite d2/d1a/d34/dd5/d75/d94/fd9 [0,4194304] 0 2024-06-03T00:03:27.110 INFO:tasks.workunit.client.0.smithi049.stdout:2/903: dread da/d52/d37/d70/fb1 [0,4194304] 0 2024-06-03T00:03:27.111 INFO:tasks.workunit.client.0.smithi049.stdout:2/904: truncate da/d52/d40/f64 4242181 0 2024-06-03T00:03:27.113 INFO:tasks.workunit.client.0.smithi049.stdout:3/799: link d2/d1a/d34/dd5/d75/d94/dd1/db6/fce d2/d14/d22/d3a/d47/f120 0 2024-06-03T00:03:27.113 INFO:tasks.workunit.client.0.smithi049.stdout:2/905: mkdir da/d52/d40/d11a 0 2024-06-03T00:03:27.114 INFO:tasks.workunit.client.0.smithi049.stdout:2/906: chown da/d52/d37/d70/lae 1 1 2024-06-03T00:03:27.119 INFO:tasks.workunit.client.0.smithi049.stdout:0/805: dwrite d6/d30/d32/f40 [4194304,4194304] 0 2024-06-03T00:03:27.129 INFO:tasks.workunit.client.0.smithi049.stdout:0/806: write d6/d59/f9e [697242,2059] 0 2024-06-03T00:03:27.131 INFO:tasks.workunit.client.0.smithi049.stdout:0/807: unlink d6/d30/c1d 0 2024-06-03T00:03:27.131 INFO:tasks.workunit.client.0.smithi049.stdout:0/808: write d6/d97/fe1 [235523,80126] 0 2024-06-03T00:03:27.131 INFO:tasks.workunit.client.0.smithi049.stdout:0/809: fdatasync f2 0 2024-06-03T00:03:27.140 INFO:tasks.workunit.client.0.smithi049.stdout:0/810: dread d6/fa0 [0,4194304] 0 2024-06-03T00:03:27.140 INFO:tasks.workunit.client.0.smithi049.stdout:0/811: read d6/d59/fb6 [2329577,127681] 0 2024-06-03T00:03:27.141 INFO:tasks.workunit.client.0.smithi049.stdout:8/755: sync 2024-06-03T00:03:27.141 INFO:tasks.workunit.client.0.smithi049.stdout:4/872: sync 2024-06-03T00:03:27.141 INFO:tasks.workunit.client.0.smithi049.stdout:0/812: getdents d6/d59/d93/db4 0 2024-06-03T00:03:27.141 INFO:tasks.workunit.client.0.smithi049.stdout:8/756: fsync d4/d27/d3c/d88/d28/d45/fc0 0 2024-06-03T00:03:27.142 INFO:tasks.workunit.client.0.smithi049.stdout:4/873: mknod d4/d3f/d14/d2b/d84/d1c/d24/c128 0 2024-06-03T00:03:27.142 INFO:tasks.workunit.client.0.smithi049.stdout:4/874: chown d4/d3f/d14/d7f/ddb/dc2/le7 127574711 1 2024-06-03T00:03:27.142 INFO:tasks.workunit.client.0.smithi049.stdout:2/907: dwrite da/d72/d83/d9f/ff0 [0,4194304] 0 2024-06-03T00:03:27.143 INFO:tasks.workunit.client.0.smithi049.stdout:3/800: dwrite d2/d14/d44/d52/d4c/d4b/d58/fa9 [0,4194304] 0 2024-06-03T00:03:27.143 INFO:tasks.workunit.client.0.smithi049.stdout:2/908: write da/f85 [1051277,123766] 0 2024-06-03T00:03:27.144 INFO:tasks.workunit.client.0.smithi049.stdout:0/813: rename d6/d30/f8e to d6/d97/d10a/f10e 0 2024-06-03T00:03:27.144 INFO:tasks.workunit.client.0.smithi049.stdout:4/875: mkdir d4/d3f/d14/d82/d129 0 2024-06-03T00:03:27.144 INFO:tasks.workunit.client.0.smithi049.stdout:4/876: chown d4/d3f/d14/d7f/d87/f92 0 1 2024-06-03T00:03:27.144 INFO:tasks.workunit.client.0.smithi049.stdout:4/877: chown d4/d3f/d14/d2b/l10c 30 1 2024-06-03T00:03:27.146 INFO:tasks.workunit.client.0.smithi049.stdout:3/801: dread d2/d14/d44/d52/d4c/d4b/d98/f71 [0,4194304] 0 2024-06-03T00:03:27.146 INFO:tasks.workunit.client.0.smithi049.stdout:3/802: stat d2/d1a/d34/dd5/d75/d94/d9e/lb0 0 2024-06-03T00:03:27.146 INFO:tasks.workunit.client.0.smithi049.stdout:0/814: mknod d6/c10f 0 2024-06-03T00:03:27.146 INFO:tasks.workunit.client.0.smithi049.stdout:0/815: chown d6/d30/d32/dca/f8c 4 1 2024-06-03T00:03:27.149 INFO:tasks.workunit.client.0.smithi049.stdout:3/803: rename d2/d14/d44/d52/l74 to d2/d1a/d34/dd5/d75/d94/dd1/l121 0 2024-06-03T00:03:27.150 INFO:tasks.workunit.client.0.smithi049.stdout:3/804: mknod d2/d1a/d34/dd5/d75/d94/dd1/da0/de3/c122 0 2024-06-03T00:03:27.151 INFO:tasks.workunit.client.0.smithi049.stdout:4/878: link d4/d3f/d14/d2b/d84/d1c/d24/d43/daf/fe8 d4/d3f/d14/d82/d117/f12a 0 2024-06-03T00:03:27.151 INFO:tasks.workunit.client.0.smithi049.stdout:3/805: fsync d2/d1a/f73 0 2024-06-03T00:03:27.152 INFO:tasks.workunit.client.0.smithi049.stdout:4/879: symlink d4/d3f/d14/d82/d129/l12b 0 2024-06-03T00:03:27.153 INFO:tasks.workunit.client.0.smithi049.stdout:3/806: symlink d2/d1a/d34/dd5/d75/d94/dd1/db6/l123 0 2024-06-03T00:03:27.153 INFO:tasks.workunit.client.0.smithi049.stdout:2/909: write f9 [1665714,86809] 0 2024-06-03T00:03:27.154 INFO:tasks.workunit.client.0.smithi049.stdout:3/807: rename d2/d14/d22/d42/fe2 to d2/d1a/d34/de9/f124 0 2024-06-03T00:03:27.155 INFO:tasks.workunit.client.0.smithi049.stdout:4/880: link d4/fcc d4/d3f/d14/d7f/d87/f12c 0 2024-06-03T00:03:27.155 INFO:tasks.workunit.client.0.smithi049.stdout:3/808: creat d2/f125 x:0 0 0 2024-06-03T00:03:27.156 INFO:tasks.workunit.client.0.smithi049.stdout:2/910: mknod da/d52/df/d3c/c11b 0 2024-06-03T00:03:27.158 INFO:tasks.workunit.client.0.smithi049.stdout:4/881: mkdir d4/d12d 0 2024-06-03T00:03:27.160 INFO:tasks.workunit.client.0.smithi049.stdout:2/911: link da/d52/d9e/ff6 da/d52/d40/d63/daa/f11c 0 2024-06-03T00:03:27.160 INFO:tasks.workunit.client.0.smithi049.stdout:2/912: fsync da/d52/f26 0 2024-06-03T00:03:27.161 INFO:tasks.workunit.client.0.smithi049.stdout:4/882: unlink d4/d2a/c53 0 2024-06-03T00:03:27.162 INFO:tasks.workunit.client.0.smithi049.stdout:0/816: dwrite d6/d59/d93/ffc [0,4194304] 0 2024-06-03T00:03:27.162 INFO:tasks.workunit.client.0.smithi049.stdout:3/809: dread d2/d14/d44/d52/d4c/f97 [0,4194304] 0 2024-06-03T00:03:27.162 INFO:tasks.workunit.client.0.smithi049.stdout:2/913: mknod da/d52/d40/d63/c11d 0 2024-06-03T00:03:27.163 INFO:tasks.workunit.client.0.smithi049.stdout:3/810: chown d2/d14/f70 595 1 2024-06-03T00:03:27.164 INFO:tasks.workunit.client.0.smithi049.stdout:4/883: getdents d4/d3f 0 2024-06-03T00:03:27.165 INFO:tasks.workunit.client.0.smithi049.stdout:3/811: creat d2/d1a/d34/de9/f126 x:0 0 0 2024-06-03T00:03:27.167 INFO:tasks.workunit.client.0.smithi049.stdout:2/914: fsync da/d55/fab 0 2024-06-03T00:03:27.167 INFO:tasks.workunit.client.0.smithi049.stdout:2/915: fdatasync da/d52/d37/dac/fc4 0 2024-06-03T00:03:27.167 INFO:tasks.workunit.client.0.smithi049.stdout:2/916: write da/f85 [1815341,43897] 0 2024-06-03T00:03:27.167 INFO:tasks.workunit.client.0.smithi049.stdout:2/917: write da/d52/d37/d70/f115 [724080,23183] 0 2024-06-03T00:03:27.168 INFO:tasks.workunit.client.0.smithi049.stdout:4/884: mkdir d4/d3f/d14/d2b/d84/d1c/d24/d12e 0 2024-06-03T00:03:27.168 INFO:tasks.workunit.client.0.smithi049.stdout:4/885: write d4/d3f/d14/d7f/ddb/df5/df1/f10a [978944,97082] 0 2024-06-03T00:03:27.170 INFO:tasks.workunit.client.0.smithi049.stdout:4/886: mkdir d4/d3f/d12f 0 2024-06-03T00:03:27.172 INFO:tasks.workunit.client.0.smithi049.stdout:2/918: rename da/f45 to da/d52/d37/dac/f11e 0 2024-06-03T00:03:27.174 INFO:tasks.workunit.client.0.smithi049.stdout:4/887: mknod d4/d3f/d14/d2b/d84/d69/dc6/c130 0 2024-06-03T00:03:27.177 INFO:tasks.workunit.client.0.smithi049.stdout:4/888: rename d4/d3f/d14/fb5 to d4/d3f/d14/d7f/ddb/dc2/f131 0 2024-06-03T00:03:27.187 INFO:tasks.workunit.client.0.smithi049.stdout:0/817: dwrite d6/d59/d93/f9d [0,4194304] 0 2024-06-03T00:03:27.188 INFO:tasks.workunit.client.0.smithi049.stdout:3/812: dwrite d2/f15 [0,4194304] 0 2024-06-03T00:03:27.189 INFO:tasks.workunit.client.0.smithi049.stdout:0/818: truncate f2 5468851 0 2024-06-03T00:03:27.199 INFO:tasks.workunit.client.0.smithi049.stdout:2/919: dwrite da/d52/d9e/fc1 [0,4194304] 0 2024-06-03T00:03:27.200 INFO:tasks.workunit.client.0.smithi049.stdout:4/889: dwrite d4/d3f/d14/fd9 [0,4194304] 0 2024-06-03T00:03:27.202 INFO:tasks.workunit.client.0.smithi049.stdout:4/890: truncate d4/d3f/d14/d7f/ddb/dc2/f115 451371 0 2024-06-03T00:03:27.202 INFO:tasks.workunit.client.0.smithi049.stdout:4/891: write d4/d3f/d14/d2b/d84/d1c/d4f/ded/f126 [818689,58466] 0 2024-06-03T00:03:27.206 INFO:tasks.workunit.client.0.smithi049.stdout:3/813: dwrite d2/d14/d22/d3a/fd8 [0,4194304] 0 2024-06-03T00:03:27.206 INFO:tasks.workunit.client.0.smithi049.stdout:3/814: chown d2/d14/d22/d42/f118 166112355 1 2024-06-03T00:03:27.207 INFO:tasks.workunit.client.0.smithi049.stdout:5/945: sync 2024-06-03T00:03:27.208 INFO:tasks.workunit.client.0.smithi049.stdout:5/946: write d3/d5/da/d55/d110/fd0 [4941,126372] 0 2024-06-03T00:03:27.210 INFO:tasks.workunit.client.0.smithi049.stdout:5/947: mkdir d3/d5/da/d55/d14/d123 0 2024-06-03T00:03:27.210 INFO:tasks.workunit.client.0.smithi049.stdout:5/948: chown d3/d5/da/d55/l4e 36447817 1 2024-06-03T00:03:27.211 INFO:tasks.workunit.client.0.smithi049.stdout:3/815: truncate d2/fe 4106961 0 2024-06-03T00:03:27.212 INFO:tasks.workunit.client.0.smithi049.stdout:2/920: write da/d52/d40/d63/f48 [2048417,108551] 0 2024-06-03T00:03:27.214 INFO:tasks.workunit.client.0.smithi049.stdout:3/816: rename d2/d1a/d34/dd5/d75/d94/dd1/da0/de3/dee/d11c to d2/d14/d44/d52/d4c/d4b/d98/d127 0 2024-06-03T00:03:27.215 INFO:tasks.workunit.client.0.smithi049.stdout:5/949: write d3/fba [89617,21448] 0 2024-06-03T00:03:27.216 INFO:tasks.workunit.client.0.smithi049.stdout:2/921: rename da/d52/df/d3c/fd8 to da/d52/df/d107/f11f 0 2024-06-03T00:03:27.217 INFO:tasks.workunit.client.0.smithi049.stdout:2/922: stat da/d52/d40/fdf 0 2024-06-03T00:03:27.217 INFO:tasks.workunit.client.0.smithi049.stdout:3/817: dread d2/d1a/d34/dd5/f5f [0,4194304] 0 2024-06-03T00:03:27.218 INFO:tasks.workunit.client.0.smithi049.stdout:5/950: mkdir d3/d5/da/dcf/d124 0 2024-06-03T00:03:27.218 INFO:tasks.workunit.client.0.smithi049.stdout:5/951: chown d3/d5/da/d55/d110/feb 35570 1 2024-06-03T00:03:27.218 INFO:tasks.workunit.client.0.smithi049.stdout:2/923: symlink da/d52/df/d3c/l120 0 2024-06-03T00:03:27.222 INFO:tasks.workunit.client.0.smithi049.stdout:2/924: rename da/d52/d37/cbe to da/d43/c121 0 2024-06-03T00:03:27.223 INFO:tasks.workunit.client.0.smithi049.stdout:2/925: readlink da/d10f/laf 0 2024-06-03T00:03:27.223 INFO:tasks.workunit.client.0.smithi049.stdout:2/926: write da/d52/d40/d63/daa/f6c [3256487,106860] 0 2024-06-03T00:03:27.250 INFO:tasks.workunit.client.0.smithi049.stdout:5/952: dwrite d3/d5/da/d55/d14/fe3 [0,4194304] 0 2024-06-03T00:03:27.250 INFO:tasks.workunit.client.0.smithi049.stdout:3/818: dwrite d2/d14/d44/d52/d4c/d4b/fcc [0,4194304] 0 2024-06-03T00:03:27.250 INFO:tasks.workunit.client.0.smithi049.stdout:5/953: write d3/d9/f28 [1288327,90155] 0 2024-06-03T00:03:27.257 INFO:tasks.workunit.client.0.smithi049.stdout:5/954: dread d3/d5/d24/f5f [0,4194304] 0 2024-06-03T00:03:27.258 INFO:tasks.workunit.client.0.smithi049.stdout:5/955: creat d3/d5/d2d/d4b/d97/dde/d111/f125 x:0 0 0 2024-06-03T00:03:27.272 INFO:tasks.workunit.client.0.smithi049.stdout:3/819: dwrite d2/d1a/d51/dbe/fff [0,4194304] 0 2024-06-03T00:03:27.272 INFO:tasks.workunit.client.0.smithi049.stdout:3/820: chown d2/d1a/d34/de9/de0 13 1 2024-06-03T00:03:27.273 INFO:tasks.workunit.client.0.smithi049.stdout:3/821: dread - d2/d1a/d34/dd5/d75/d94/dd1/da0/de3/f114 zero size 2024-06-03T00:03:27.275 INFO:tasks.workunit.client.0.smithi049.stdout:3/822: symlink d2/d14/d44/l128 0 2024-06-03T00:03:27.275 INFO:tasks.workunit.client.0.smithi049.stdout:5/956: dwrite d3/d5/da/dcf/fe1 [0,4194304] 0 2024-06-03T00:03:27.279 INFO:tasks.workunit.client.0.smithi049.stdout:5/957: readlink d3/d5/da/d55/df4/d121/lc9 0 2024-06-03T00:03:27.279 INFO:tasks.workunit.client.0.smithi049.stdout:5/958: chown d3/f3a 695352 1 2024-06-03T00:03:27.282 INFO:tasks.workunit.client.0.smithi049.stdout:5/959: rename d3/d9/d20/d4c/l105 to d3/d9/d20/l126 0 2024-06-03T00:03:27.288 INFO:tasks.workunit.client.0.smithi049.stdout:5/960: write d3/d5/da/d55/d14/f2a [2637123,69351] 0 2024-06-03T00:03:27.289 INFO:tasks.workunit.client.0.smithi049.stdout:5/961: chown d3/d5/da/c73 665 1 2024-06-03T00:03:27.290 INFO:tasks.workunit.client.0.smithi049.stdout:5/962: mknod d3/d5/d2d/d4b/d62/c127 0 2024-06-03T00:03:27.290 INFO:tasks.workunit.client.0.smithi049.stdout:5/963: fsync d3/d5/d2d/d4b/d51/fef 0 2024-06-03T00:03:27.292 INFO:tasks.workunit.client.0.smithi049.stdout:3/823: dwrite d2/d14/d44/d52/d4c/d4b/f89 [0,4194304] 0 2024-06-03T00:03:27.294 INFO:tasks.workunit.client.0.smithi049.stdout:3/824: creat d2/d1a/d34/dd5/f129 x:0 0 0 2024-06-03T00:03:27.302 INFO:tasks.workunit.client.0.smithi049.stdout:7/881: sync 2024-06-03T00:03:27.302 INFO:tasks.workunit.client.0.smithi049.stdout:7/882: dread - d3/f128 zero size 2024-06-03T00:03:27.317 INFO:tasks.workunit.client.0.smithi049.stdout:3/825: dwrite d2/d1a/d51/d83/fcd [0,4194304] 0 2024-06-03T00:03:27.319 INFO:tasks.workunit.client.0.smithi049.stdout:7/883: dwrite d3/dd8/d9/f69 [0,4194304] 0 2024-06-03T00:03:27.320 INFO:tasks.workunit.client.0.smithi049.stdout:7/884: getdents d3/dd8/d13/d3c/d4b 0 2024-06-03T00:03:27.321 INFO:tasks.workunit.client.0.smithi049.stdout:7/885: readlink d3/dd8/d86/d8d/la5 0 2024-06-03T00:03:27.322 INFO:tasks.workunit.client.0.smithi049.stdout:7/886: chown d3/dd8/d13/f65 312084 1 2024-06-03T00:03:27.322 INFO:tasks.workunit.client.0.smithi049.stdout:7/887: mknod d3/dd8/d13/d79/c141 0 2024-06-03T00:03:27.323 INFO:tasks.workunit.client.0.smithi049.stdout:7/888: mknod d3/dd8/d13/d3c/d48/d112/c142 0 2024-06-03T00:03:27.326 INFO:tasks.workunit.client.0.smithi049.stdout:3/826: dread d2/d1a/d34/f3b [0,4194304] 0 2024-06-03T00:03:27.327 INFO:tasks.workunit.client.0.smithi049.stdout:7/889: write d3/dd8/d13/f12c [438883,62316] 0 2024-06-03T00:03:27.328 INFO:tasks.workunit.client.0.smithi049.stdout:7/890: fsync d3/dd8/d13/d54/daa/fb3 0 2024-06-03T00:03:27.329 INFO:tasks.workunit.client.0.smithi049.stdout:7/891: symlink d3/dd8/d86/d90/dae/l143 0 2024-06-03T00:03:27.330 INFO:tasks.workunit.client.0.smithi049.stdout:7/892: mknod d3/dd8/d13/d3c/d110/d140/dc8/c144 0 2024-06-03T00:03:27.331 INFO:tasks.workunit.client.0.smithi049.stdout:7/893: creat d3/dd8/d13/d3c/d48/d7b/d5b/f145 x:0 0 0 2024-06-03T00:03:27.338 INFO:tasks.workunit.client.0.smithi049.stdout:7/894: write d3/d14/d6e/ff4 [1798677,97149] 0 2024-06-03T00:03:27.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:27 smithi107 ceph-mon[37048]: pgmap v485: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 34 MiB/s wr, 491 op/s 2024-06-03T00:03:27.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:27 smithi057 ceph-mon[36457]: pgmap v485: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 34 MiB/s wr, 491 op/s 2024-06-03T00:03:27.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:27 smithi049 ceph-mon[32302]: pgmap v485: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 34 MiB/s wr, 491 op/s 2024-06-03T00:03:27.629 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f51fb796', total seconds elapsed: 25.7 2024-06-03T00:03:28.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.648+0000 7fade808d700 1 -- 172.21.15.49:0/3531987382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fade0101fd0 msgr2=0x7fade0105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:28.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.648+0000 7fade808d700 1 --2- 172.21.15.49:0/3531987382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fade0101fd0 0x7fade0105fd0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fadd00099c0 tx=0x7fadd0009cd0 comp rx=0 tx=0).stop 2024-06-03T00:03:28.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.648+0000 7fade808d700 1 -- 172.21.15.49:0/3531987382 shutdown_connections 2024-06-03T00:03:28.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.648+0000 7fade808d700 1 --2- 172.21.15.49:0/3531987382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fade01066b0 0x7fade010e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:28.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.648+0000 7fade808d700 1 --2- 172.21.15.49:0/3531987382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fade0101620 0x7fade0101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:28.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.648+0000 7fade808d700 1 --2- 172.21.15.49:0/3531987382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fade0101fd0 0x7fade0105fd0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:28.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.648+0000 7fade808d700 1 -- 172.21.15.49:0/3531987382 >> 172.21.15.49:0/3531987382 conn(0x7fade0078340 msgr2=0x7fade0078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:28.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.648+0000 7fade808d700 1 -- 172.21.15.49:0/3531987382 shutdown_connections 2024-06-03T00:03:28.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.648+0000 7fade808d700 1 -- 172.21.15.49:0/3531987382 wait complete. 2024-06-03T00:03:28.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.649+0000 7fade808d700 1 Processor -- start 2024-06-03T00:03:28.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.649+0000 7fade808d700 1 -- start start 2024-06-03T00:03:28.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.649+0000 7fade808d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fade0101620 0x7fade019e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:28.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.649+0000 7fade808d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fade0101fd0 0x7fade019ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:28.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.649+0000 7fade808d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fade01066b0 0x7fade01989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:28.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.649+0000 7fade808d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fade0111690 con 0x7fade0101fd0 2024-06-03T00:03:28.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.649+0000 7fade808d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fade0111510 con 0x7fade0101620 2024-06-03T00:03:28.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.649+0000 7fade808d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fade0111810 con 0x7fade01066b0 2024-06-03T00:03:28.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.649+0000 7fade5628700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fade0101fd0 0x7fade019ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:28.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.649+0000 7fade5628700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fade0101fd0 0x7fade019ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41608/0 (socket says 172.21.15.49:41608) 2024-06-03T00:03:28.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.649+0000 7fade5628700 1 -- 172.21.15.49:0/973332708 learned_addr learned my addr 172.21.15.49:0/973332708 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:28.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.649+0000 7fade5e29700 1 --2- 172.21.15.49:0/973332708 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fade0101620 0x7fade019e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:28.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.649+0000 7fade662a700 1 --2- 172.21.15.49:0/973332708 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fade01066b0 0x7fade01989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:28.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.649+0000 7fade5628700 1 -- 172.21.15.49:0/973332708 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fade01066b0 msgr2=0x7fade01989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.649+0000 7fade5628700 1 --2- 172.21.15.49:0/973332708 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fade01066b0 0x7fade01989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.649+0000 7fade5628700 1 -- 172.21.15.49:0/973332708 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fade0101620 msgr2=0x7fade019e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.649+0000 7fade5628700 1 --2- 172.21.15.49:0/973332708 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fade0101620 0x7fade019e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.649+0000 7fade5628700 1 -- 172.21.15.49:0/973332708 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade0199120 con 0x7fade0101fd0 2024-06-03T00:03:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.649+0000 7fade662a700 1 --2- 172.21.15.49:0/973332708 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fade01066b0 0x7fade01989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.650+0000 7fade5628700 1 --2- 172.21.15.49:0/973332708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fade0101fd0 0x7fade019ed40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fadd000fa00 tx=0x7fadd000fa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.650+0000 7fadd6ffd700 1 -- 172.21.15.49:0/973332708 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd0027070 con 0x7fade0101fd0 2024-06-03T00:03:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.650+0000 7fade808d700 1 -- 172.21.15.49:0/973332708 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade01993b0 con 0x7fade0101fd0 2024-06-03T00:03:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.650+0000 7fadd6ffd700 1 -- 172.21.15.49:0/973332708 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fadd0003680 con 0x7fade0101fd0 2024-06-03T00:03:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.650+0000 7fadd6ffd700 1 -- 172.21.15.49:0/973332708 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd00173f0 con 0x7fade0101fd0 2024-06-03T00:03:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.650+0000 7fade808d700 1 -- 172.21.15.49:0/973332708 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade01a56d0 con 0x7fade0101fd0 2024-06-03T00:03:28.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.651+0000 7fade808d700 1 -- 172.21.15.49:0/973332708 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fade0069180 con 0x7fade0101fd0 2024-06-03T00:03:28.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.652+0000 7fadd6ffd700 1 -- 172.21.15.49:0/973332708 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fadd002a070 con 0x7fade0101fd0 2024-06-03T00:03:28.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.653+0000 7fadd6ffd700 1 --2- 172.21.15.49:0/973332708 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fadcc0a2c20 0x7fadcc0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:28.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.653+0000 7fadd6ffd700 1 -- 172.21.15.49:0/973332708 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fadd00cffa0 con 0x7fade0101fd0 2024-06-03T00:03:28.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.653+0000 7fade5e29700 1 --2- 172.21.15.49:0/973332708 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fadcc0a2c20 0x7fadcc0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:28.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.653+0000 7fade5e29700 1 --2- 172.21.15.49:0/973332708 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fadcc0a2c20 0x7fadcc0a50e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fade0199b00 tx=0x7faddc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:28.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.656+0000 7fadd6ffd700 1 -- 172.21.15.49:0/973332708 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fadd0013070 con 0x7fade0101fd0 2024-06-03T00:03:28.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.908+0000 7fade808d700 1 -- 172.21.15.49:0/973332708 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fade002dca0 con 0x7fade0101fd0 2024-06-03T00:03:28.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.909+0000 7fadd6ffd700 1 -- 172.21.15.49:0/973332708 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11936 (secure 0 0 0) 0x7fadd009d030 con 0x7fade0101fd0 2024-06-03T00:03:28.909 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:03:28.909 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1553264866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1553264866},{"type":"v1","addr":"172.21.15.49:6835","nonce":1553264866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2266285252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2266285252},{"type":"v1","addr":"172.21.15.49:6837","nonce":2266285252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T23:57:16.991201+0000","modified":"2024-06-03T00:02:52.952379+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24485,"mds_2":24466,"mds_3":24464,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6839/1729124617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":1729124617},{"type":"v1","addr":"172.21.15.49:6839","nonce":1729124617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6841/1902772235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":1902772235},{"type":"v1","addr":"172.21.15.49:6841","nonce":1902772235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6833/1633534002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1633534002},{"type":"v1","addr":"172.21.15.57:6833","nonce":1633534002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6835/2254905671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2254905671},{"type":"v1","addr":"172.21.15.57:6835","nonce":2254905671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.107:6835/3693542801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3693542801},{"type":"v1","addr":"172.21.15.107:6835","nonce":3693542801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.57:6837/230452144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":230452144},{"type":"v1","addr":"172.21.15.57:6837","nonce":230452144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":92,"addr":"172.21.15.107:6837/3700593315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":3700593315},{"type":"v1","addr":"172.21.15.107:6837","nonce":3700593315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6839/249825195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":249825195},{"type":"v1","addr":"172.21.15.57:6839","nonce":249825195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6839/1986600681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1986600681},{"type":"v1","addr":"172.21.15.107:6839","nonce":1986600681}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24485,24464,24460,24466,24487]},"id":1}]} 2024-06-03T00:03:28.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.911+0000 7fade808d700 1 -- 172.21.15.49:0/973332708 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fadcc0a2c20 msgr2=0x7fadcc0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:28.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.911+0000 7fade808d700 1 --2- 172.21.15.49:0/973332708 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fadcc0a2c20 0x7fadcc0a50e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fade0199b00 tx=0x7faddc009260 comp rx=0 tx=0).stop 2024-06-03T00:03:28.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.911+0000 7fade808d700 1 -- 172.21.15.49:0/973332708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fade0101fd0 msgr2=0x7fade019ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:28.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.911+0000 7fade808d700 1 --2- 172.21.15.49:0/973332708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fade0101fd0 0x7fade019ed40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fadd000fa00 tx=0x7fadd000fa30 comp rx=0 tx=0).stop 2024-06-03T00:03:28.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.912+0000 7fade808d700 1 -- 172.21.15.49:0/973332708 shutdown_connections 2024-06-03T00:03:28.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.912+0000 7fade808d700 1 --2- 172.21.15.49:0/973332708 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fadcc0a2c20 0x7fadcc0a50e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:28.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.912+0000 7fade808d700 1 --2- 172.21.15.49:0/973332708 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fade01066b0 0x7fade01989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:28.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.912+0000 7fade808d700 1 --2- 172.21.15.49:0/973332708 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fade0101620 0x7fade019e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:28.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.912+0000 7fade808d700 1 --2- 172.21.15.49:0/973332708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fade0101fd0 0x7fade019ed40 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:28.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.912+0000 7fade808d700 1 -- 172.21.15.49:0/973332708 >> 172.21.15.49:0/973332708 conn(0x7fade0078340 msgr2=0x7fade006ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:28.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.912+0000 7fade808d700 1 -- 172.21.15.49:0/973332708 shutdown_connections 2024-06-03T00:03:28.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:28.912+0000 7fade808d700 1 -- 172.21.15.49:0/973332708 wait complete. 2024-06-03T00:03:28.912 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 31 2024-06-03T00:03:29.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:29 smithi049 ceph-mon[32302]: pgmap v486: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.3 MiB/s wr, 299 op/s 2024-06-03T00:03:29.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:29 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/973332708' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:03:29.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:29 smithi107 ceph-mon[37048]: pgmap v486: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.3 MiB/s wr, 299 op/s 2024-06-03T00:03:29.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:29 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/973332708' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:03:29.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:29 smithi057 ceph-mon[36457]: pgmap v486: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.3 MiB/s wr, 299 op/s 2024-06-03T00:03:29.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:29 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/973332708' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:03:29.691 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-06-03T00:03:29.948 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:03:30.375 INFO:tasks.workunit.client.0.smithi049.stdout:4/892: sync 2024-06-03T00:03:30.375 INFO:tasks.workunit.client.0.smithi049.stdout:2/927: sync 2024-06-03T00:03:30.375 INFO:tasks.workunit.client.0.smithi049.stdout:0/819: sync 2024-06-03T00:03:30.375 INFO:tasks.workunit.client.0.smithi049.stdout:5/964: sync 2024-06-03T00:03:30.375 INFO:tasks.workunit.client.0.smithi049.stdout:8/757: sync 2024-06-03T00:03:30.375 INFO:tasks.workunit.client.0.smithi049.stdout:3/827: sync 2024-06-03T00:03:30.375 INFO:tasks.workunit.client.0.smithi049.stdout:7/895: sync 2024-06-03T00:03:30.375 INFO:tasks.workunit.client.0.smithi049.stdout:5/965: dread - d3/d5/da/d55/df4/d109/d108/f118 zero size 2024-06-03T00:03:30.375 INFO:tasks.workunit.client.0.smithi049.stdout:5/966: fdatasync d3/d5/da/d55/d75/f11f 0 2024-06-03T00:03:30.376 INFO:tasks.workunit.client.0.smithi049.stdout:5/967: write d3/d5/da3/fbd [5038102,83908] 0 2024-06-03T00:03:30.377 INFO:tasks.workunit.client.0.smithi049.stdout:8/758: creat d4/d27/d3c/d88/d28/d2b/f102 x:0 0 0 2024-06-03T00:03:30.380 INFO:tasks.workunit.client.0.smithi049.stdout:5/968: mkdir d3/d5/da/d55/d14/d16/df9/dff/d128 0 2024-06-03T00:03:30.380 INFO:tasks.workunit.client.0.smithi049.stdout:7/896: rename d3/dd8/d13/d3c/d110/d140/dc4 to d3/dd8/d146 0 2024-06-03T00:03:30.380 INFO:tasks.workunit.client.0.smithi049.stdout:7/897: write d3/dd8/d13/f94 [5046554,102788] 0 2024-06-03T00:03:30.381 INFO:tasks.workunit.client.0.smithi049.stdout:7/898: rmdir d3/dd8/d13/d3c/d4b/dea 39 2024-06-03T00:03:30.382 INFO:tasks.workunit.client.0.smithi049.stdout:8/759: creat d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/dab/f103 x:0 0 0 2024-06-03T00:03:30.383 INFO:tasks.workunit.client.0.smithi049.stdout:3/828: link d2/d1a/d34/dd5/d75/fd7 d2/d14/f12a 0 2024-06-03T00:03:30.395 INFO:tasks.workunit.client.0.smithi049.stdout:3/829: dread d2/d14/d22/fa7 [0,4194304] 0 2024-06-03T00:03:30.397 INFO:tasks.workunit.client.0.smithi049.stdout:3/830: read d2/d1a/f1d [5007050,110454] 0 2024-06-03T00:03:30.398 INFO:tasks.workunit.client.0.smithi049.stdout:3/831: readlink d2/d14/d22/d42/l3d 0 2024-06-03T00:03:30.400 INFO:tasks.workunit.client.0.smithi049.stdout:0/820: dwrite d6/d59/d93/ffc [0,4194304] 0 2024-06-03T00:03:30.400 INFO:tasks.workunit.client.0.smithi049.stdout:0/821: write d6/d97/d4b/fd5 [208436,89094] 0 2024-06-03T00:03:30.403 INFO:tasks.workunit.client.0.smithi049.stdout:0/822: unlink d6/d29/c4a 0 2024-06-03T00:03:30.404 INFO:tasks.workunit.client.0.smithi049.stdout:4/893: dwrite d4/d2a/fbb [0,4194304] 0 2024-06-03T00:03:30.413 INFO:tasks.workunit.client.0.smithi049.stdout:5/969: dwrite d3/d5/da/d55/d14/f29 [0,4194304] 0 2024-06-03T00:03:30.414 INFO:tasks.workunit.client.0.smithi049.stdout:8/760: dwrite d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/fe2 [0,4194304] 0 2024-06-03T00:03:30.416 INFO:tasks.workunit.client.0.smithi049.stdout:4/894: write d4/d3f/d14/d2b/d84/d1c/d24/d43/f121 [393280,101926] 0 2024-06-03T00:03:30.417 INFO:tasks.workunit.client.0.smithi049.stdout:4/895: write d4/d3f/d14/d7f/ddb/f113 [5398638,112474] 0 2024-06-03T00:03:30.417 INFO:tasks.workunit.client.0.smithi049.stdout:5/970: symlink d3/d5/da/d55/d14/d16/df9/l129 0 2024-06-03T00:03:30.418 INFO:tasks.workunit.client.0.smithi049.stdout:2/928: dwrite da/d52/d40/f64 [0,4194304] 0 2024-06-03T00:03:30.419 INFO:tasks.workunit.client.0.smithi049.stdout:4/896: symlink d4/d3f/d14/d7f/ddb/df5/l132 0 2024-06-03T00:03:30.420 INFO:tasks.workunit.client.0.smithi049.stdout:4/897: mknod d4/d3f/d14/d82/d117/d120/c133 0 2024-06-03T00:03:30.421 INFO:tasks.workunit.client.0.smithi049.stdout:4/898: creat d4/d3f/d14/d7f/ddb/df5/df1/f134 x:0 0 0 2024-06-03T00:03:30.421 INFO:tasks.workunit.client.0.smithi049.stdout:4/899: chown d4/d3f/d14/fc1 0 1 2024-06-03T00:03:30.421 INFO:tasks.workunit.client.0.smithi049.stdout:8/761: creat d4/d27/d3c/d88/d4d/f104 x:0 0 0 2024-06-03T00:03:30.422 INFO:tasks.workunit.client.0.smithi049.stdout:4/900: chown d4/d3f/d14/d7f/ddb/df5/c8e 4 1 2024-06-03T00:03:30.424 INFO:tasks.workunit.client.0.smithi049.stdout:8/762: mknod d4/d27/d3c/d88/d48/dde/c105 0 2024-06-03T00:03:30.424 INFO:tasks.workunit.client.0.smithi049.stdout:0/823: dwrite d6/d29/dc8/d52/f91 [0,4194304] 0 2024-06-03T00:03:30.424 INFO:tasks.workunit.client.0.smithi049.stdout:2/929: dread da/d52/d40/dce/ff2 [0,4194304] 0 2024-06-03T00:03:30.426 INFO:tasks.workunit.client.0.smithi049.stdout:2/930: unlink da/d72/d83/f104 0 2024-06-03T00:03:30.427 INFO:tasks.workunit.client.0.smithi049.stdout:4/901: dread d4/f63 [0,4194304] 0 2024-06-03T00:03:30.428 INFO:tasks.workunit.client.0.smithi049.stdout:2/931: mknod da/d52/d37/d59/dca/d113/c122 0 2024-06-03T00:03:30.432 INFO:tasks.workunit.client.0.smithi049.stdout:4/902: rename d4/d3f/d14/d2b/d84/d69/dc6/dd3/f10b to d4/d12d/f135 0 2024-06-03T00:03:30.432 INFO:tasks.workunit.client.0.smithi049.stdout:4/903: chown d4/d3f/d14/d7f/d87/f92 113531548 1 2024-06-03T00:03:30.432 INFO:tasks.workunit.client.0.smithi049.stdout:0/824: dread d6/d29/dc8/d52/d96/fa6 [0,4194304] 0 2024-06-03T00:03:30.432 INFO:tasks.workunit.client.0.smithi049.stdout:0/825: chown d6/d97/d4b/l57 14 1 2024-06-03T00:03:30.433 INFO:tasks.workunit.client.0.smithi049.stdout:2/932: truncate da/d52/d9e/ff6 2948216 0 2024-06-03T00:03:30.434 INFO:tasks.workunit.client.0.smithi049.stdout:4/904: dread - d4/d3f/d14/d2b/d84/d1c/d4f/fff zero size 2024-06-03T00:03:30.435 INFO:tasks.workunit.client.0.smithi049.stdout:3/832: dwrite d2/d1a/d34/dd5/f5f [0,4194304] 0 2024-06-03T00:03:30.435 INFO:tasks.workunit.client.0.smithi049.stdout:3/833: stat d2/d1a/f66 0 2024-06-03T00:03:30.436 INFO:tasks.workunit.client.0.smithi049.stdout:2/933: creat da/d10f/f123 x:0 0 0 2024-06-03T00:03:30.437 INFO:tasks.workunit.client.0.smithi049.stdout:4/905: truncate d4/f63 856580 0 2024-06-03T00:03:30.438 INFO:tasks.workunit.client.0.smithi049.stdout:3/834: creat d2/d1a/d76/d95/d106/f12b x:0 0 0 2024-06-03T00:03:30.439 INFO:tasks.workunit.client.0.smithi049.stdout:4/906: rmdir d4/d2a/ddf 39 2024-06-03T00:03:30.439 INFO:tasks.workunit.client.0.smithi049.stdout:4/907: stat d4/fcc 0 2024-06-03T00:03:30.440 INFO:tasks.workunit.client.0.smithi049.stdout:3/835: symlink d2/d1a/d34/dd5/d75/ddc/l12c 0 2024-06-03T00:03:30.441 INFO:tasks.workunit.client.0.smithi049.stdout:2/934: truncate da/d52/d37/fa4 753094 0 2024-06-03T00:03:30.443 INFO:tasks.workunit.client.0.smithi049.stdout:3/836: creat d2/d14/d44/d52/d4c/d4b/d58/f12d x:0 0 0 2024-06-03T00:03:30.443 INFO:tasks.workunit.client.0.smithi049.stdout:2/935: mkdir da/d52/df/d3c/d124 0 2024-06-03T00:03:30.446 INFO:tasks.workunit.client.0.smithi049.stdout:2/936: link da/d52/f33 da/d52/df/f125 0 2024-06-03T00:03:30.446 INFO:tasks.workunit.client.0.smithi049.stdout:2/937: write da/d52/d40/d63/ff4 [4874166,16545] 0 2024-06-03T00:03:30.449 INFO:tasks.workunit.client.0.smithi049.stdout:2/938: rename da/d52/d40/d63/daa/f6c to da/d52/d40/d93/f126 0 2024-06-03T00:03:30.449 INFO:tasks.workunit.client.0.smithi049.stdout:5/971: dwrite d3/d53/dc1/fcc [0,4194304] 0 2024-06-03T00:03:30.451 INFO:tasks.workunit.client.0.smithi049.stdout:2/939: truncate da/feb 638676 0 2024-06-03T00:03:30.452 INFO:tasks.workunit.client.0.smithi049.stdout:2/940: creat da/d52/d40/d93/f127 x:0 0 0 2024-06-03T00:03:30.455 INFO:tasks.workunit.client.0.smithi049.stdout:5/972: link d3/d5/da/c48 d3/d53/d9c/da4/db9/df1/c12a 0 2024-06-03T00:03:30.455 INFO:tasks.workunit.client.0.smithi049.stdout:5/973: readlink d3/d9/l119 0 2024-06-03T00:03:30.455 INFO:tasks.workunit.client.0.smithi049.stdout:5/974: truncate d3/d5/da/d55/d75/f116 381623 0 2024-06-03T00:03:30.455 INFO:tasks.workunit.client.0.smithi049.stdout:5/975: chown d3/d5/d2d/d4b/d51/fef 1442369 1 2024-06-03T00:03:30.457 INFO:tasks.workunit.client.0.smithi049.stdout:2/941: creat da/d52/d37/d59/d80/f128 x:0 0 0 2024-06-03T00:03:30.460 INFO:tasks.workunit.client.0.smithi049.stdout:5/976: rename d3/lce to d3/d5/l12b 0 2024-06-03T00:03:30.461 INFO:tasks.workunit.client.0.smithi049.stdout:5/977: creat d3/d53/d9c/da4/db9/df1/f12c x:0 0 0 2024-06-03T00:03:30.462 INFO:tasks.workunit.client.0.smithi049.stdout:5/978: dread - d3/d9/d20/d4c/d5a/d6f/fb4 zero size 2024-06-03T00:03:30.464 INFO:tasks.workunit.client.0.smithi049.stdout:5/979: creat d3/d5/da/d55/d14/d16/f12d x:0 0 0 2024-06-03T00:03:30.466 INFO:tasks.workunit.client.0.smithi049.stdout:5/980: link d3/d53/d9c/da4/db9/df1/f12c d3/d5/d10f/f12e 0 2024-06-03T00:03:30.466 INFO:tasks.workunit.client.0.smithi049.stdout:5/981: truncate d3/d5/da/d55/d110/fd0 2103979 0 2024-06-03T00:03:30.466 INFO:tasks.workunit.client.0.smithi049.stdout:5/982: dread - d3/d5/da/d55/d14/d16/f12d zero size 2024-06-03T00:03:30.469 INFO:tasks.workunit.client.0.smithi049.stdout:0/826: dwrite d6/d29/fbb [0,4194304] 0 2024-06-03T00:03:30.469 INFO:tasks.workunit.client.0.smithi049.stdout:8/763: dwrite d4/d27/d3c/d88/f91 [0,4194304] 0 2024-06-03T00:03:30.470 INFO:tasks.workunit.client.0.smithi049.stdout:3/837: dwrite d2/d14/d44/d52/d4c/d4b/d58/f109 [0,4194304] 0 2024-06-03T00:03:30.471 INFO:tasks.workunit.client.0.smithi049.stdout:5/983: dread d3/d5/da/d55/d110/fd0 [0,4194304] 0 2024-06-03T00:03:30.473 INFO:tasks.workunit.client.0.smithi049.stdout:8/764: symlink d4/d27/d3c/d88/d28/d52/d66/d53/d6c/l106 0 2024-06-03T00:03:30.474 INFO:tasks.workunit.client.0.smithi049.stdout:3/838: dread d2/d14/d22/f9a [0,4194304] 0 2024-06-03T00:03:30.474 INFO:tasks.workunit.client.0.smithi049.stdout:5/984: mkdir d3/d9/d20/d4c/d5a/d6f/d12f 0 2024-06-03T00:03:30.475 INFO:tasks.workunit.client.0.smithi049.stdout:5/985: creat d3/d53/dc1/f130 x:0 0 0 2024-06-03T00:03:30.477 INFO:tasks.workunit.client.0.smithi049.stdout:8/765: symlink d4/d27/d3c/l107 0 2024-06-03T00:03:30.477 INFO:tasks.workunit.client.0.smithi049.stdout:8/766: readlink d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/dab/lfa 0 2024-06-03T00:03:30.478 INFO:tasks.workunit.client.0.smithi049.stdout:5/986: dread d3/f66 [0,4194304] 0 2024-06-03T00:03:30.478 INFO:tasks.workunit.client.0.smithi049.stdout:5/987: fdatasync d3/f10d 0 2024-06-03T00:03:30.479 INFO:tasks.workunit.client.0.smithi049.stdout:4/908: dwrite d4/d3f/d14/d7f/f114 [0,4194304] 0 2024-06-03T00:03:30.479 INFO:tasks.workunit.client.0.smithi049.stdout:4/909: chown d4/d3f/ffb 26377452 1 2024-06-03T00:03:30.479 INFO:tasks.workunit.client.0.smithi049.stdout:4/910: truncate d4/d3f/d14/d2b/d84/d69/dc6/f11a 463660 0 2024-06-03T00:03:30.483 INFO:tasks.workunit.client.0.smithi049.stdout:2/942: dwrite da/d52/df/d3c/d60/f10a [0,4194304] 0 2024-06-03T00:03:30.486 INFO:tasks.workunit.client.0.smithi049.stdout:8/767: write d4/f73 [3924033,14039] 0 2024-06-03T00:03:30.488 INFO:tasks.workunit.client.0.smithi049.stdout:8/768: mknod d4/d27/d30/c108 0 2024-06-03T00:03:30.488 INFO:tasks.workunit.client.0.smithi049.stdout:8/769: chown d4/d27/d3c/d88/d28/d52/d66/d53/d6c/l93 27 1 2024-06-03T00:03:30.488 INFO:tasks.workunit.client.0.smithi049.stdout:2/943: creat da/d72/d83/d9f/f129 x:0 0 0 2024-06-03T00:03:30.489 INFO:tasks.workunit.client.0.smithi049.stdout:4/911: rename d4/d3f/d14/fd9 to d4/d3f/d14/d7f/f136 0 2024-06-03T00:03:30.489 INFO:tasks.workunit.client.0.smithi049.stdout:2/944: chown da/d52/d40/d63/daa/c6b 1 1 2024-06-03T00:03:30.490 INFO:tasks.workunit.client.0.smithi049.stdout:4/912: read d4/d3f/f107 [180081,36794] 0 2024-06-03T00:03:30.491 INFO:tasks.workunit.client.0.smithi049.stdout:4/913: truncate f2 663934 0 2024-06-03T00:03:30.497 INFO:tasks.workunit.client.0.smithi049.stdout:0/827: dwrite d6/d97/f7b [0,4194304] 0 2024-06-03T00:03:30.497 INFO:tasks.workunit.client.0.smithi049.stdout:2/945: dread da/d52/d40/d93/f108 [0,4194304] 0 2024-06-03T00:03:30.498 INFO:tasks.workunit.client.0.smithi049.stdout:0/828: creat d6/dd7/f110 x:0 0 0 2024-06-03T00:03:30.500 INFO:tasks.workunit.client.0.smithi049.stdout:0/829: truncate d6/d30/d32/dca/fcc 1991581 0 2024-06-03T00:03:30.501 INFO:tasks.workunit.client.0.smithi049.stdout:2/946: mkdir da/d52/d37/d70/d12a 0 2024-06-03T00:03:30.502 INFO:tasks.workunit.client.0.smithi049.stdout:8/770: dwrite d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/da9/dd9/ff4 [0,4194304] 0 2024-06-03T00:03:30.504 INFO:tasks.workunit.client.0.smithi049.stdout:8/771: getdents d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/dab 0 2024-06-03T00:03:30.505 INFO:tasks.workunit.client.0.smithi049.stdout:2/947: read da/d52/d40/d63/fcd [231767,20064] 0 2024-06-03T00:03:30.505 INFO:tasks.workunit.client.0.smithi049.stdout:4/914: dread f2 [0,4194304] 0 2024-06-03T00:03:30.506 INFO:tasks.workunit.client.0.smithi049.stdout:8/772: mknod d4/d27/d3c/d88/d28/c109 0 2024-06-03T00:03:30.516 INFO:tasks.workunit.client.0.smithi049.stdout:8/773: write d4/d27/d3c/d88/f1b [3844158,17717] 0 2024-06-03T00:03:30.518 INFO:tasks.workunit.client.0.smithi049.stdout:8/774: creat d4/d27/d30/dfd/f10a x:0 0 0 2024-06-03T00:03:30.518 INFO:tasks.workunit.client.0.smithi049.stdout:4/915: dread d4/d3f/d14/d2b/d84/d1c/f1f [0,4194304] 0 2024-06-03T00:03:30.519 INFO:tasks.workunit.client.0.smithi049.stdout:8/775: creat d4/d27/d3c/d88/d28/d52/f10b x:0 0 0 2024-06-03T00:03:30.522 INFO:tasks.workunit.client.0.smithi049.stdout:0/830: dwrite d6/dd7/f110 [0,4194304] 0 2024-06-03T00:03:30.524 INFO:tasks.workunit.client.0.smithi049.stdout:4/916: read d4/d3f/d14/d7f/ddb/dc2/fc9 [655338,107255] 0 2024-06-03T00:03:30.525 INFO:tasks.workunit.client.0.smithi049.stdout:0/831: symlink d6/d30/d32/dca/l111 0 2024-06-03T00:03:30.529 INFO:tasks.workunit.client.0.smithi049.stdout:0/832: write d6/fa0 [225281,97493] 0 2024-06-03T00:03:30.534 INFO:tasks.workunit.client.0.smithi049.stdout:2/948: dwrite da/d52/d37/f84 [0,4194304] 0 2024-06-03T00:03:30.535 INFO:tasks.workunit.client.0.smithi049.stdout:4/917: write d4/d3f/fd2 [1674047,12199] 0 2024-06-03T00:03:30.536 INFO:tasks.workunit.client.0.smithi049.stdout:4/918: rmdir d4/d3f/d14/d7f/ddb/dc2 39 2024-06-03T00:03:30.537 INFO:tasks.workunit.client.0.smithi049.stdout:2/949: link da/d52/df/d3c/cff da/d52/df/d3c/d7a/c12b 0 2024-06-03T00:03:30.538 INFO:tasks.workunit.client.0.smithi049.stdout:2/950: truncate da/d52/df/d3c/f76 2797569 0 2024-06-03T00:03:30.539 INFO:tasks.workunit.client.0.smithi049.stdout:2/951: chown da/d52/d40/f64 32251348 1 2024-06-03T00:03:30.539 INFO:tasks.workunit.client.0.smithi049.stdout:2/952: chown da/d52/df/d3c/de8/f118 50906 1 2024-06-03T00:03:30.539 INFO:tasks.workunit.client.0.smithi049.stdout:4/919: rename d4/d3f/d14/d82/d117/d120/c133 to d4/d3f/d14/d7f/ddb/df5/df1/c137 0 2024-06-03T00:03:30.541 INFO:tasks.workunit.client.0.smithi049.stdout:4/920: dread d4/d3f/f79 [0,4194304] 0 2024-06-03T00:03:30.542 INFO:tasks.workunit.client.0.smithi049.stdout:2/953: mknod da/d52/df/d3c/d60/dc6/c12c 0 2024-06-03T00:03:30.542 INFO:tasks.workunit.client.0.smithi049.stdout:2/954: write da/d55/f91 [1013401,73137] 0 2024-06-03T00:03:30.543 INFO:tasks.workunit.client.0.smithi049.stdout:4/921: creat d4/d3f/d14/d2b/d84/d69/dc6/f138 x:0 0 0 2024-06-03T00:03:30.543 INFO:tasks.workunit.client.0.smithi049.stdout:4/922: truncate d4/d3f/d14/d7f/d87/f12c 411447 0 2024-06-03T00:03:30.544 INFO:tasks.workunit.client.0.smithi049.stdout:2/955: rmdir da/d52/df/d3c/d9a 39 2024-06-03T00:03:30.546 INFO:tasks.workunit.client.0.smithi049.stdout:0/833: dwrite d6/d29/fbb [0,4194304] 0 2024-06-03T00:03:30.546 INFO:tasks.workunit.client.0.smithi049.stdout:2/956: rmdir da/d52/df/d3c/d9a 39 2024-06-03T00:03:30.547 INFO:tasks.workunit.client.0.smithi049.stdout:0/834: mkdir d6/dd7/d112 0 2024-06-03T00:03:30.548 INFO:tasks.workunit.client.0.smithi049.stdout:0/835: stat d6/d29/dc8/ce7 0 2024-06-03T00:03:30.548 INFO:tasks.workunit.client.0.smithi049.stdout:0/836: stat d6/d97 0 2024-06-03T00:03:30.548 INFO:tasks.workunit.client.0.smithi049.stdout:4/923: symlink d4/d3f/d14/d2b/l139 0 2024-06-03T00:03:30.550 INFO:tasks.workunit.client.0.smithi049.stdout:4/924: rmdir d4 39 2024-06-03T00:03:30.557 INFO:tasks.workunit.client.0.smithi049.stdout:4/925: dread d4/d3f/d14/fe6 [0,4194304] 0 2024-06-03T00:03:30.557 INFO:tasks.workunit.client.0.smithi049.stdout:4/926: stat d4/d3f/f52 0 2024-06-03T00:03:30.558 INFO:tasks.workunit.client.0.smithi049.stdout:4/927: chown d4/c7c 1899 1 2024-06-03T00:03:30.558 INFO:tasks.workunit.client.0.smithi049.stdout:0/837: dread d6/d30/d32/dca/f8c [0,4194304] 0 2024-06-03T00:03:30.559 INFO:tasks.workunit.client.0.smithi049.stdout:4/928: creat d4/d3f/d14/d2b/f13a x:0 0 0 2024-06-03T00:03:30.560 INFO:tasks.workunit.client.0.smithi049.stdout:4/929: creat d4/f13b x:0 0 0 2024-06-03T00:03:30.567 INFO:tasks.workunit.client.0.smithi049.stdout:2/957: dwrite da/d52/df/d3c/d60/ffd [0,4194304] 0 2024-06-03T00:03:30.569 INFO:tasks.workunit.client.0.smithi049.stdout:2/958: fsync da/f24 0 2024-06-03T00:03:30.573 INFO:tasks.workunit.client.0.smithi049.stdout:2/959: mknod da/d72/d83/c12d 0 2024-06-03T00:03:30.573 INFO:tasks.workunit.client.0.smithi049.stdout:2/960: mknod da/d10f/df5/c12e 0 2024-06-03T00:03:30.575 INFO:tasks.workunit.client.0.smithi049.stdout:2/961: mknod da/d52/d73/c12f 0 2024-06-03T00:03:30.576 INFO:tasks.workunit.client.0.smithi049.stdout:0/838: dwrite d6/d59/f9e [4194304,4194304] 0 2024-06-03T00:03:30.578 INFO:tasks.workunit.client.0.smithi049.stdout:2/962: symlink da/d52/df/d3c/de8/l130 0 2024-06-03T00:03:30.579 INFO:tasks.workunit.client.0.smithi049.stdout:2/963: mkdir da/d72/d131 0 2024-06-03T00:03:30.582 INFO:tasks.workunit.client.0.smithi049.stdout:2/964: dread da/d52/df/f125 [0,4194304] 0 2024-06-03T00:03:30.586 INFO:tasks.workunit.client.0.smithi049.stdout:0/839: dread d6/d29/f33 [0,4194304] 0 2024-06-03T00:03:30.586 INFO:tasks.workunit.client.0.smithi049.stdout:4/930: dwrite d4/d3f/d14/d2b/d84/d1c/d4f/f66 [0,4194304] 0 2024-06-03T00:03:30.586 INFO:tasks.workunit.client.0.smithi049.stdout:4/931: truncate d4/fcc 568678 0 2024-06-03T00:03:30.587 INFO:tasks.workunit.client.0.smithi049.stdout:0/840: truncate d6/d30/d32/f40 80630 0 2024-06-03T00:03:30.587 INFO:tasks.workunit.client.0.smithi049.stdout:0/841: chown d6/d29/dc8/d52/l102 2227548 1 2024-06-03T00:03:30.588 INFO:tasks.workunit.client.0.smithi049.stdout:0/842: creat d6/d30/d32/f113 x:0 0 0 2024-06-03T00:03:30.593 INFO:tasks.workunit.client.0.smithi049.stdout:4/932: dread d4/d3f/d14/d2b/d84/d1c/d24/d43/f9d [0,4194304] 0 2024-06-03T00:03:30.597 INFO:tasks.workunit.client.0.smithi049.stdout:4/933: dread d4/d3f/d14/d2b/d84/d1c/d24/d43/f9d [0,4194304] 0 2024-06-03T00:03:30.599 INFO:tasks.workunit.client.0.smithi049.stdout:2/965: dwrite da/d52/df/f29 [0,4194304] 0 2024-06-03T00:03:30.602 INFO:tasks.workunit.client.0.smithi049.stdout:4/934: chown d4/l3b 698878 1 2024-06-03T00:03:30.603 INFO:tasks.workunit.client.0.smithi049.stdout:2/966: creat da/d52/df/d107/f132 x:0 0 0 2024-06-03T00:03:30.605 INFO:tasks.workunit.client.0.smithi049.stdout:4/935: link d4/d3f/f56 d4/d3f/d14/f13c 0 2024-06-03T00:03:30.606 INFO:tasks.workunit.client.0.smithi049.stdout:2/967: mknod da/d52/c133 0 2024-06-03T00:03:30.608 INFO:tasks.workunit.client.0.smithi049.stdout:2/968: write da/feb [1568262,88316] 0 2024-06-03T00:03:30.610 INFO:tasks.workunit.client.0.smithi049.stdout:4/936: rename d4/d3f/d14/d82/d129 to d4/d3f/d14/d7f/ddb/dc2/d13d 0 2024-06-03T00:03:30.611 INFO:tasks.workunit.client.0.smithi049.stdout:4/937: symlink d4/d12d/l13e 0 2024-06-03T00:03:30.612 INFO:tasks.workunit.client.0.smithi049.stdout:4/938: chown d4/d3f/d14/d2b/d84/d1c/d24/c128 662 1 2024-06-03T00:03:30.613 INFO:tasks.workunit.client.0.smithi049.stdout:2/969: rename da/d52/df/d107/f132 to da/d72/d83/f134 0 2024-06-03T00:03:30.617 INFO:tasks.workunit.client.0.smithi049.stdout:2/970: dread da/feb [0,4194304] 0 2024-06-03T00:03:30.622 INFO:tasks.workunit.client.0.smithi049.stdout:4/939: dread d4/d3f/d14/fa2 [0,4194304] 0 2024-06-03T00:03:30.631 INFO:tasks.workunit.client.0.smithi049.stdout:4/940: read d4/ff [2182619,18572] 0 2024-06-03T00:03:30.632 INFO:tasks.workunit.client.0.smithi049.stdout:4/941: creat d4/d3f/d14/d2b/d84/f13f x:0 0 0 2024-06-03T00:03:30.632 INFO:tasks.workunit.client.0.smithi049.stdout:4/942: chown d4/d3f/d14/d2b/d84/d69/dc6/c4e 21849122 1 2024-06-03T00:03:30.633 INFO:tasks.workunit.client.0.smithi049.stdout:4/943: rmdir d4/d3f/d14/d82/d117 39 2024-06-03T00:03:30.633 INFO:tasks.workunit.client.0.smithi049.stdout:2/971: dwrite da/d52/df/d3c/f53 [0,4194304] 0 2024-06-03T00:03:30.639 INFO:tasks.workunit.client.0.smithi049.stdout:4/944: write d4/d3f/d14/d7f/d87/f8b [1005156,33004] 0 2024-06-03T00:03:30.641 INFO:tasks.workunit.client.0.smithi049.stdout:4/945: rename d4/d3f/d14/d7f/ddb/df5/df1 to d4/d3f/d14/d82/d140 0 2024-06-03T00:03:30.641 INFO:tasks.workunit.client.0.smithi049.stdout:4/946: fsync d4/d3f/d14/fe6 0 2024-06-03T00:03:30.642 INFO:tasks.workunit.client.0.smithi049.stdout:4/947: truncate d4/d3f/d14/d2b/d84/d1c/f6f 950375 0 2024-06-03T00:03:30.643 INFO:tasks.workunit.client.0.smithi049.stdout:4/948: mkdir d4/d3f/d14/d2b/d141 0 2024-06-03T00:03:30.644 INFO:tasks.workunit.client.0.smithi049.stdout:4/949: creat d4/d3f/d14/d2b/d84/d69/f142 x:0 0 0 2024-06-03T00:03:30.646 INFO:tasks.workunit.client.0.smithi049.stdout:4/950: rename d4/d3f/d14/d7f/ddb/c11d to d4/d3f/d14/d2b/d84/d69/dc6/dd3/c143 0 2024-06-03T00:03:30.647 INFO:tasks.workunit.client.0.smithi049.stdout:4/951: creat d4/d3f/d14/d2b/d84/d1c/d4f/ded/f144 x:0 0 0 2024-06-03T00:03:30.648 INFO:tasks.workunit.client.0.smithi049.stdout:4/952: creat d4/d3f/d14/d2b/d84/d1c/d4f/f145 x:0 0 0 2024-06-03T00:03:30.648 INFO:tasks.workunit.client.0.smithi049.stdout:4/953: write d4/d3f/d14/d2b/fda [645503,57997] 0 2024-06-03T00:03:30.654 INFO:tasks.workunit.client.0.smithi049.stdout:2/972: dwrite da/d52/f82 [0,4194304] 0 2024-06-03T00:03:30.655 INFO:tasks.workunit.client.0.smithi049.stdout:2/973: stat da/d55/d111 0 2024-06-03T00:03:30.655 INFO:tasks.workunit.client.0.smithi049.stdout:2/974: fdatasync da/d55/fab 0 2024-06-03T00:03:30.655 INFO:tasks.workunit.client.0.smithi049.stdout:2/975: chown da/d52/d40/d93/lc8 3773813 1 2024-06-03T00:03:30.656 INFO:tasks.workunit.client.0.smithi049.stdout:2/976: getdents da/d52/df/d107 0 2024-06-03T00:03:30.658 INFO:tasks.workunit.client.0.smithi049.stdout:2/977: dread da/d55/fad [0,4194304] 0 2024-06-03T00:03:30.659 INFO:tasks.workunit.client.0.smithi049.stdout:2/978: creat da/d52/df/d107/f135 x:0 0 0 2024-06-03T00:03:30.661 INFO:tasks.workunit.client.0.smithi049.stdout:2/979: creat da/d52/d37/d70/d12a/f136 x:0 0 0 2024-06-03T00:03:30.668 INFO:tasks.workunit.client.0.smithi049.stdout:2/980: read da/f24 [2173899,61398] 0 2024-06-03T00:03:30.670 INFO:tasks.workunit.client.0.smithi049.stdout:2/981: dread da/d52/d37/d70/fda [0,4194304] 0 2024-06-03T00:03:30.671 INFO:tasks.workunit.client.0.smithi049.stdout:2/982: creat da/d52/dd3/f137 x:0 0 0 2024-06-03T00:03:30.677 INFO:tasks.workunit.client.0.smithi049.stdout:2/983: dread da/d52/d40/d63/f48 [0,4194304] 0 2024-06-03T00:03:30.684 INFO:tasks.workunit.client.0.smithi049.stdout:2/984: write da/d52/f26 [3454745,89101] 0 2024-06-03T00:03:30.684 INFO:tasks.workunit.client.0.smithi049.stdout:2/985: chown da/d52/d73/da6/ce4 64 1 2024-06-03T00:03:30.684 INFO:tasks.workunit.client.0.smithi049.stdout:2/986: fsync da/d52/d37/fa4 0 2024-06-03T00:03:30.686 INFO:tasks.workunit.client.0.smithi049.stdout:2/987: mknod da/d55/c138 0 2024-06-03T00:03:30.687 INFO:tasks.workunit.client.0.smithi049.stdout:2/988: truncate da/d52/d9e/fc1 581754 0 2024-06-03T00:03:30.695 INFO:tasks.workunit.client.0.smithi049.stdout:2/989: dread da/d52/f82 [0,4194304] 0 2024-06-03T00:03:30.713 INFO:tasks.workunit.client.0.smithi049.stdout:2/990: dwrite da/d52/df/d3c/f53 [0,4194304] 0 2024-06-03T00:03:30.720 INFO:tasks.workunit.client.0.smithi049.stdout:2/991: dread da/d52/df/d3c/d9a/fa0 [0,4194304] 0 2024-06-03T00:03:30.720 INFO:tasks.workunit.client.0.smithi049.stdout:2/992: fdatasync da/d52/d37/d70/fb1 0 2024-06-03T00:03:30.721 INFO:tasks.workunit.client.0.smithi049.stdout:2/993: symlink da/d52/d40/d63/daa/l139 0 2024-06-03T00:03:30.721 INFO:tasks.workunit.client.0.smithi049.stdout:2/994: write da/d52/df/d3c/d60/ffd [4598223,80740] 0 2024-06-03T00:03:30.723 INFO:tasks.workunit.client.0.smithi049.stdout:7/899: sync 2024-06-03T00:03:30.723 INFO:tasks.workunit.client.0.smithi049.stdout:7/900: truncate d3/d14/d6e/fe2 5116736 0 2024-06-03T00:03:30.723 INFO:tasks.workunit.client.0.smithi049.stdout:7/901: chown d3/dd8/f5e 12 1 2024-06-03T00:03:30.723 INFO:tasks.workunit.client.0.smithi049.stdout:7/902: write d3/dd8/d9/f13f [6699,80193] 0 2024-06-03T00:03:30.723 INFO:tasks.workunit.client.0.smithi049.stdout:7/903: creat d3/dd8/f147 x:0 0 0 2024-06-03T00:03:30.726 INFO:tasks.workunit.client.0.smithi049.stdout:2/995: dread da/d52/d40/f8a [0,4194304] 0 2024-06-03T00:03:30.726 INFO:tasks.workunit.client.0.smithi049.stdout:2/996: fdatasync da/d52/d37/d70/fb1 0 2024-06-03T00:03:30.727 INFO:tasks.workunit.client.0.smithi049.stdout:2/997: unlink da/d52/d37/dac/cd2 0 2024-06-03T00:03:30.728 INFO:tasks.workunit.client.0.smithi049.stdout:2/998: symlink da/d52/dd3/l13a 0 2024-06-03T00:03:30.729 INFO:tasks.workunit.client.0.smithi049.stdout:2/999: creat da/d52/df/d107/f13b x:0 0 0 2024-06-03T00:03:30.746 INFO:tasks.workunit.client.0.smithi049.stdout:7/904: dwrite d3/dd8/d13/d3c/fc7 [0,4194304] 0 2024-06-03T00:03:30.746 INFO:tasks.workunit.client.0.smithi049.stdout:7/905: fsync d3/dd8/f25 0 2024-06-03T00:03:30.747 INFO:tasks.workunit.client.0.smithi049.stdout:7/906: creat d3/dd8/d13/d3c/d110/d140/df6/d11e/f148 x:0 0 0 2024-06-03T00:03:30.749 INFO:tasks.workunit.client.0.smithi049.stdout:7/907: truncate d3/dd8/d13/d3c/d48/d112/f132 16995 0 2024-06-03T00:03:30.749 INFO:tasks.workunit.client.0.smithi049.stdout:7/908: dread - d3/dd8/d13/d3c/d110/d140/df6/d11e/d12e/fad zero size 2024-06-03T00:03:30.749 INFO:tasks.workunit.client.0.smithi049.stdout:7/909: fsync d3/d14/d6e/f103 0 2024-06-03T00:03:30.749 INFO:tasks.workunit.client.0.smithi049.stdout:7/910: fsync d3/dd8/d13/d3c/d110/d140/df6/d11e/d12e/f77 0 2024-06-03T00:03:30.753 INFO:tasks.workunit.client.0.smithi049.stdout:7/911: symlink d3/dd8/d86/d90/l149 0 2024-06-03T00:03:30.754 INFO:tasks.workunit.client.0.smithi049.stdout:7/912: rename d3/dd8/d9/d8f/dfd/f133 to d3/d32/f14a 0 2024-06-03T00:03:30.754 INFO:tasks.workunit.client.0.smithi049.stdout:7/913: dread d3/dd8/d13/d3c/d48/fb5 [0,4194304] 0 2024-06-03T00:03:30.764 INFO:tasks.workunit.client.0.smithi049.stdout:7/914: dread d3/dd8/d86/fa9 [0,4194304] 0 2024-06-03T00:03:30.766 INFO:tasks.workunit.client.0.smithi049.stdout:7/915: symlink d3/dd8/d13/d54/ddc/l14b 0 2024-06-03T00:03:30.766 INFO:tasks.workunit.client.0.smithi049.stdout:7/916: truncate d3/dd8/d13/f65 509840 0 2024-06-03T00:03:30.775 INFO:tasks.workunit.client.0.smithi049.stdout:7/917: dread d3/d14/d6e/fe2 [0,4194304] 0 2024-06-03T00:03:30.782 INFO:tasks.workunit.client.0.smithi049.stdout:7/918: dread d3/dd8/d13/d54/f55 [0,4194304] 0 2024-06-03T00:03:30.783 INFO:tasks.workunit.client.0.smithi049.stdout:7/919: mkdir d3/dd8/d13/d79/d114/d12f/dd5/d121/d14c 0 2024-06-03T00:03:30.783 INFO:tasks.workunit.client.0.smithi049.stdout:7/920: chown d3/dd8/d86/d90/dae/f13a 4 1 2024-06-03T00:03:30.784 INFO:tasks.workunit.client.0.smithi049.stdout:7/921: symlink d3/dd8/d13/d54/daa/d92/l14d 0 2024-06-03T00:03:30.785 INFO:tasks.workunit.client.0.smithi049.stdout:7/922: stat d3/d32/d95/f100 0 2024-06-03T00:03:30.785 INFO:tasks.workunit.client.0.smithi049.stdout:7/923: fsync d3/dd8/d13/d3c/d110/d140/f9a 0 2024-06-03T00:03:30.830 INFO:tasks.workunit.client.0.smithi049.stdout:3/839: sync 2024-06-03T00:03:30.831 INFO:tasks.workunit.client.0.smithi049.stdout:5/988: sync 2024-06-03T00:03:30.831 INFO:tasks.workunit.client.0.smithi049.stdout:5/989: write d3/d5/da/d55/d110/feb [320779,35702] 0 2024-06-03T00:03:30.831 INFO:tasks.workunit.client.0.smithi049.stdout:5/990: dread - d3/d9/d20/d4c/d9d/ffc zero size 2024-06-03T00:03:30.831 INFO:tasks.workunit.client.0.smithi049.stdout:3/840: read - d2/d1a/d51/dbe/fd0 zero size 2024-06-03T00:03:30.831 INFO:tasks.workunit.client.0.smithi049.stdout:3/841: truncate d2/d1a/d34/dd5/d75/d94/fd9 5075083 0 2024-06-03T00:03:30.832 INFO:tasks.workunit.client.0.smithi049.stdout:5/991: link d3/d5/cbe d3/d5/da/d55/df4/c131 0 2024-06-03T00:03:30.840 INFO:tasks.workunit.client.0.smithi049.stdout:3/842: write d2/d1a/d34/de9/de0/f11f [2525152,30052] 0 2024-06-03T00:03:30.843 INFO:tasks.workunit.client.0.smithi049.stdout:5/992: dread d3/d5/da/f2b [0,4194304] 0 2024-06-03T00:03:30.843 INFO:tasks.workunit.client.0.smithi049.stdout:5/993: chown d3/d5/da/d55/d75/ff2 2619 1 2024-06-03T00:03:30.844 INFO:tasks.workunit.client.0.smithi049.stdout:3/843: dread d2/d1a/d34/f48 [0,4194304] 0 2024-06-03T00:03:30.844 INFO:tasks.workunit.client.0.smithi049.stdout:5/994: creat d3/d9/d20/d4c/d5a/d6f/d12f/f132 x:0 0 0 2024-06-03T00:03:30.845 INFO:tasks.workunit.client.0.smithi049.stdout:3/844: creat d2/d1a/d34/dd5/f12e x:0 0 0 2024-06-03T00:03:30.845 INFO:tasks.workunit.client.0.smithi049.stdout:5/995: fdatasync d3/d5/da/d55/d14/f57 0 2024-06-03T00:03:30.845 INFO:tasks.workunit.client.0.smithi049.stdout:5/996: write d3/f10d [730129,113177] 0 2024-06-03T00:03:30.846 INFO:tasks.workunit.client.0.smithi049.stdout:3/845: rmdir d2/d1a/d34/de9 39 2024-06-03T00:03:30.847 INFO:tasks.workunit.client.0.smithi049.stdout:5/997: getdents d3/d9/d20/d4c/d5a/d65 0 2024-06-03T00:03:30.847 INFO:tasks.workunit.client.0.smithi049.stdout:5/998: fsync d3/d9/f13 0 2024-06-03T00:03:30.849 INFO:tasks.workunit.client.0.smithi049.stdout:3/846: rename d2/d1a/d34/f3b to d2/d1a/d34/dd5/d75/d94/d9e/f12f 0 2024-06-03T00:03:30.850 INFO:tasks.workunit.client.0.smithi049.stdout:3/847: rmdir d2/d1a/d51 39 2024-06-03T00:03:30.851 INFO:tasks.workunit.client.0.smithi049.stdout:5/999: mkdir d3/d133 0 2024-06-03T00:03:30.851 INFO:tasks.workunit.client.0.smithi049.stdout:3/848: truncate d2/d1a/d34/dd5/f5f 2784668 0 2024-06-03T00:03:30.856 INFO:tasks.workunit.client.0.smithi049.stdout:3/849: rmdir d2/d1a/d34/de9/de0 39 2024-06-03T00:03:30.857 INFO:tasks.workunit.client.0.smithi049.stdout:3/850: readlink d2/d1a/d34/dd5/d75/d94/dd1/db6/l123 0 2024-06-03T00:03:30.860 INFO:tasks.workunit.client.0.smithi049.stdout:3/851: rename d2/d1a/d34/dd5/c88 to d2/d1a/d76/d95/c130 0 2024-06-03T00:03:30.863 INFO:tasks.workunit.client.0.smithi049.stdout:3/852: mkdir d2/d1a/d34/dd5/d75/d94/dd1/d131 0 2024-06-03T00:03:30.864 INFO:tasks.workunit.client.0.smithi049.stdout:3/853: mknod d2/d1a/d76/d95/d106/c132 0 2024-06-03T00:03:30.869 INFO:tasks.workunit.client.0.smithi049.stdout:8/776: sync 2024-06-03T00:03:30.870 INFO:tasks.workunit.client.0.smithi049.stdout:0/843: sync 2024-06-03T00:03:30.870 INFO:tasks.workunit.client.0.smithi049.stdout:4/954: sync 2024-06-03T00:03:30.870 INFO:tasks.workunit.client.0.smithi049.stdout:8/777: stat d4/d27/d3c/d88/d28/d52/d66/d8e 0 2024-06-03T00:03:30.870 INFO:tasks.workunit.client.0.smithi049.stdout:4/955: chown d4/d3f/d14/d7f/ddb/dc2/lf0 12 1 2024-06-03T00:03:30.871 INFO:tasks.workunit.client.0.smithi049.stdout:0/844: creat d6/d97/d4b/f114 x:0 0 0 2024-06-03T00:03:30.871 INFO:tasks.workunit.client.0.smithi049.stdout:0/845: write d6/d97/fc2 [276468,6027] 0 2024-06-03T00:03:30.872 INFO:tasks.workunit.client.0.smithi049.stdout:4/956: creat d4/d3f/d14/d82/d117/d120/f146 x:0 0 0 2024-06-03T00:03:30.872 INFO:tasks.workunit.client.0.smithi049.stdout:8/778: mkdir d4/d27/d3c/d88/d10c 0 2024-06-03T00:03:30.873 INFO:tasks.workunit.client.0.smithi049.stdout:0/846: creat d6/d29/dc8/d52/d96/f115 x:0 0 0 2024-06-03T00:03:30.873 INFO:tasks.workunit.client.0.smithi049.stdout:4/957: fsync d4/d3f/d14/d7f/ddb/fbd 0 2024-06-03T00:03:30.873 INFO:tasks.workunit.client.0.smithi049.stdout:4/958: dread - d4/d3f/d14/d2b/d84/d1c/d4f/f145 zero size 2024-06-03T00:03:30.874 INFO:tasks.workunit.client.0.smithi049.stdout:0/847: getdents d6/d29/dc8/d52/d96/dfb 0 2024-06-03T00:03:30.875 INFO:tasks.workunit.client.0.smithi049.stdout:8/779: mkdir d4/d10d 0 2024-06-03T00:03:30.875 INFO:tasks.workunit.client.0.smithi049.stdout:8/780: truncate d4/d27/d3c/d88/d28/d2b/d84/fa2 4901461 0 2024-06-03T00:03:30.875 INFO:tasks.workunit.client.0.smithi049.stdout:8/781: chown d4/d27/d3c/d88/d48 83 1 2024-06-03T00:03:30.875 INFO:tasks.workunit.client.0.smithi049.stdout:0/848: mkdir d6/d59/d93/db4/d116 0 2024-06-03T00:03:30.878 INFO:tasks.workunit.client.0.smithi049.stdout:8/782: rename d4/d27/d3c/d88/d28/l51 to d4/d27/d3c/d88/d28/d45/l10e 0 2024-06-03T00:03:30.880 INFO:tasks.workunit.client.0.smithi049.stdout:0/849: rename d6/f104 to d6/d59/f117 0 2024-06-03T00:03:30.888 INFO:tasks.workunit.client.0.smithi049.stdout:8/783: dread d4/d27/d3c/d88/d28/d52/d66/d53/d7e/fea [0,4194304] 0 2024-06-03T00:03:30.889 INFO:tasks.workunit.client.0.smithi049.stdout:3/854: dwrite d2/fd [0,4194304] 0 2024-06-03T00:03:30.889 INFO:tasks.workunit.client.0.smithi049.stdout:3/855: chown d2/d1a/d76/d95/d106/f12b 0 1 2024-06-03T00:03:30.889 INFO:tasks.workunit.client.0.smithi049.stdout:8/784: mkdir d4/d27/d3c/d43/d6b/d10f 0 2024-06-03T00:03:30.890 INFO:tasks.workunit.client.0.smithi049.stdout:8/785: chown d4/d27/d30 39054864 1 2024-06-03T00:03:30.899 INFO:tasks.workunit.client.0.smithi049.stdout:8/786: dread d4/d27/d3c/f2c [0,4194304] 0 2024-06-03T00:03:30.909 INFO:tasks.workunit.client.0.smithi049.stdout:8/787: dread d4/d27/d3c/d88/d28/d52/d66/f5a [0,4194304] 0 2024-06-03T00:03:30.912 INFO:tasks.workunit.client.0.smithi049.stdout:4/959: dwrite d4/d3f/f62 [4194304,4194304] 0 2024-06-03T00:03:30.913 INFO:tasks.workunit.client.0.smithi049.stdout:4/960: read d4/fc3 [6334033,48076] 0 2024-06-03T00:03:30.913 INFO:tasks.workunit.client.0.smithi049.stdout:0/850: dwrite d6/d29/fc6 [0,4194304] 0 2024-06-03T00:03:30.914 INFO:tasks.workunit.client.0.smithi049.stdout:0/851: creat d6/dd7/d112/f118 x:0 0 0 2024-06-03T00:03:30.914 INFO:tasks.workunit.client.0.smithi049.stdout:4/961: symlink d4/l147 0 2024-06-03T00:03:30.915 INFO:tasks.workunit.client.0.smithi049.stdout:3/856: dwrite d2/d1a/d34/dd5/d75/d94/f100 [0,4194304] 0 2024-06-03T00:03:30.915 INFO:tasks.workunit.client.0.smithi049.stdout:3/857: dread - d2/d1a/d34/f102 zero size 2024-06-03T00:03:30.915 INFO:tasks.workunit.client.0.smithi049.stdout:0/852: mknod d6/d29/dc8/d52/d96/c119 0 2024-06-03T00:03:30.918 INFO:tasks.workunit.client.0.smithi049.stdout:3/858: mkdir d2/d14/d44/d133 0 2024-06-03T00:03:30.918 INFO:tasks.workunit.client.0.smithi049.stdout:3/859: stat d2/d1a/d34/dd5/d75/d94/dd1 0 2024-06-03T00:03:30.918 INFO:tasks.workunit.client.0.smithi049.stdout:3/860: dread - d2/d14/f12a zero size 2024-06-03T00:03:30.918 INFO:tasks.workunit.client.0.smithi049.stdout:7/924: sync 2024-06-03T00:03:30.918 INFO:tasks.workunit.client.0.smithi049.stdout:7/925: dread - d3/d32/f14a zero size 2024-06-03T00:03:30.918 INFO:tasks.workunit.client.0.smithi049.stdout:7/926: chown d3/dd8/d13/f7c 50478636 1 2024-06-03T00:03:30.918 INFO:tasks.workunit.client.0.smithi049.stdout:0/853: dread d6/d30/d32/dca/fcc [0,4194304] 0 2024-06-03T00:03:30.919 INFO:tasks.workunit.client.0.smithi049.stdout:3/861: creat d2/d1a/f134 x:0 0 0 2024-06-03T00:03:30.920 INFO:tasks.workunit.client.0.smithi049.stdout:0/854: creat d6/dd7/f11a x:0 0 0 2024-06-03T00:03:30.921 INFO:tasks.workunit.client.0.smithi049.stdout:7/927: rename d3/dd8/d13/d54/c10d to d3/dd8/d13/d3c/d4b/d8e/c14e 0 2024-06-03T00:03:30.922 INFO:tasks.workunit.client.0.smithi049.stdout:0/855: truncate d6/d30/f44 2653695 0 2024-06-03T00:03:30.923 INFO:tasks.workunit.client.0.smithi049.stdout:0/856: fsync f2 0 2024-06-03T00:03:30.923 INFO:tasks.workunit.client.0.smithi049.stdout:0/857: write d6/d29/fe3 [477303,20973] 0 2024-06-03T00:03:30.923 INFO:tasks.workunit.client.0.smithi049.stdout:0/858: readlink d6/d29/dc8/d52/l102 0 2024-06-03T00:03:30.924 INFO:tasks.workunit.client.0.smithi049.stdout:0/859: creat d6/dd7/f11b x:0 0 0 2024-06-03T00:03:30.926 INFO:tasks.workunit.client.0.smithi049.stdout:8/788: write d4/d27/d3c/d88/d28/d2b/f87 [1733332,16939] 0 2024-06-03T00:03:30.936 INFO:tasks.workunit.client.0.smithi049.stdout:7/928: dread d3/dd8/d13/d79/d114/d12f/fb0 [0,4194304] 0 2024-06-03T00:03:30.937 INFO:tasks.workunit.client.0.smithi049.stdout:7/929: getdents d3/d32 0 2024-06-03T00:03:30.937 INFO:tasks.workunit.client.0.smithi049.stdout:7/930: stat d3/dd8/d13/d54/f55 0 2024-06-03T00:03:30.940 INFO:tasks.workunit.client.0.smithi049.stdout:3/862: write d2/d14/fac [5360526,62014] 0 2024-06-03T00:03:30.940 INFO:tasks.workunit.client.0.smithi049.stdout:7/931: unlink d3/dd8/d13/d3c/d4b/d5a/f87 0 2024-06-03T00:03:30.940 INFO:tasks.workunit.client.0.smithi049.stdout:0/860: write d6/d29/f79 [3679681,21326] 0 2024-06-03T00:03:30.941 INFO:tasks.workunit.client.0.smithi049.stdout:7/932: symlink d3/dd8/d13/d3c/d110/d140/df6/d116/l14f 0 2024-06-03T00:03:30.942 INFO:tasks.workunit.client.0.smithi049.stdout:0/861: creat d6/d29/dc8/d52/f11c x:0 0 0 2024-06-03T00:03:30.944 INFO:tasks.workunit.client.0.smithi049.stdout:0/862: rename d6/d29/lc1 to d6/d29/dc8/d52/d96/dfb/l11d 0 2024-06-03T00:03:30.945 INFO:tasks.workunit.client.0.smithi049.stdout:0/863: mkdir d6/dd7/d11e 0 2024-06-03T00:03:30.945 INFO:tasks.workunit.client.0.smithi049.stdout:3/863: write d2/d1a/d34/dd5/f5f [1678645,54953] 0 2024-06-03T00:03:30.946 INFO:tasks.workunit.client.0.smithi049.stdout:3/864: chown d2/f11 2079133 1 2024-06-03T00:03:30.947 INFO:tasks.workunit.client.0.smithi049.stdout:0/864: truncate d6/d59/fb6 287915 0 2024-06-03T00:03:30.948 INFO:tasks.workunit.client.0.smithi049.stdout:0/865: symlink d6/d29/dc8/d52/deb/l11f 0 2024-06-03T00:03:30.948 INFO:tasks.workunit.client.0.smithi049.stdout:0/866: fsync d6/d97/d4b/d67/fd1 0 2024-06-03T00:03:30.948 INFO:tasks.workunit.client.0.smithi049.stdout:4/962: dwrite d4/d2a/d76/f11c [0,4194304] 0 2024-06-03T00:03:30.949 INFO:tasks.workunit.client.0.smithi049.stdout:4/963: read d4/d3f/d14/d2b/d84/d1c/d4f/ded/f126 [178565,78614] 0 2024-06-03T00:03:30.949 INFO:tasks.workunit.client.0.smithi049.stdout:4/964: read d4/d3f/f107 [78394,122452] 0 2024-06-03T00:03:30.951 INFO:tasks.workunit.client.0.smithi049.stdout:3/865: write d2/d14/d22/f33 [316344,91931] 0 2024-06-03T00:03:30.952 INFO:tasks.workunit.client.0.smithi049.stdout:7/933: dread d3/f40 [0,4194304] 0 2024-06-03T00:03:30.952 INFO:tasks.workunit.client.0.smithi049.stdout:0/867: dread d6/d59/f9e [0,4194304] 0 2024-06-03T00:03:30.952 INFO:tasks.workunit.client.0.smithi049.stdout:0/868: fdatasync d6/d59/ff8 0 2024-06-03T00:03:30.952 INFO:tasks.workunit.client.0.smithi049.stdout:3/866: readlink d2/d14/d22/l28 0 2024-06-03T00:03:30.954 INFO:tasks.workunit.client.0.smithi049.stdout:3/867: mknod d2/d14/d44/deb/c135 0 2024-06-03T00:03:30.954 INFO:tasks.workunit.client.0.smithi049.stdout:7/934: rename d3/lb9 to d3/dd8/d86/l150 0 2024-06-03T00:03:30.956 INFO:tasks.workunit.client.0.smithi049.stdout:7/935: mknod d3/c151 0 2024-06-03T00:03:30.956 INFO:tasks.workunit.client.0.smithi049.stdout:8/789: dwrite d4/f17 [4194304,4194304] 0 2024-06-03T00:03:30.957 INFO:tasks.workunit.client.0.smithi049.stdout:4/965: write d4/d3f/d14/d7f/ddb/dc2/fa7 [632770,5948] 0 2024-06-03T00:03:30.957 INFO:tasks.workunit.client.0.smithi049.stdout:8/790: truncate d4/d27/d3c/d88/d28/d52/d66/fb8 578218 0 2024-06-03T00:03:30.958 INFO:tasks.workunit.client.0.smithi049.stdout:7/936: rmdir d3/dd8/d9/d8f 39 2024-06-03T00:03:30.958 INFO:tasks.workunit.client.0.smithi049.stdout:8/791: write d4/d27/d3c/d43/d6b/fec [610215,380] 0 2024-06-03T00:03:30.958 INFO:tasks.workunit.client.0.smithi049.stdout:7/937: dread - d3/dd8/f120 zero size 2024-06-03T00:03:30.958 INFO:tasks.workunit.client.0.smithi049.stdout:7/938: write d3/dd8/d13/d54/f139 [197013,125585] 0 2024-06-03T00:03:30.959 INFO:tasks.workunit.client.0.smithi049.stdout:4/966: symlink d4/d3f/d14/d82/l148 0 2024-06-03T00:03:30.959 INFO:tasks.workunit.client.0.smithi049.stdout:8/792: creat d4/d27/d3c/d88/d4d/f110 x:0 0 0 2024-06-03T00:03:30.960 INFO:tasks.workunit.client.0.smithi049.stdout:7/939: rename d3/dd8/d13/d54/f10 to d3/dd8/d86/d8d/f152 0 2024-06-03T00:03:30.960 INFO:tasks.workunit.client.0.smithi049.stdout:7/940: truncate d3/dd8/f120 236503 0 2024-06-03T00:03:30.960 INFO:tasks.workunit.client.0.smithi049.stdout:8/793: readlink d4/d27/d3c/d88/d28/l55 0 2024-06-03T00:03:30.960 INFO:tasks.workunit.client.0.smithi049.stdout:7/941: write d3/dd8/d86/fa9 [5957635,99412] 0 2024-06-03T00:03:30.960 INFO:tasks.workunit.client.0.smithi049.stdout:0/869: write d6/d30/f27 [1037755,119039] 0 2024-06-03T00:03:30.960 INFO:tasks.workunit.client.0.smithi049.stdout:7/942: chown d3/dd8/d9/d8f 992 1 2024-06-03T00:03:30.962 INFO:tasks.workunit.client.0.smithi049.stdout:7/943: rename d3/dd8/d13/d3c/d4b/f13c to d3/dd8/d13/d54/daa/f153 0 2024-06-03T00:03:30.963 INFO:tasks.workunit.client.0.smithi049.stdout:3/868: write d2/d14/d22/f2a [4001303,6663] 0 2024-06-03T00:03:30.966 INFO:tasks.workunit.client.0.smithi049.stdout:8/794: mknod d4/d27/c111 0 2024-06-03T00:03:30.970 INFO:tasks.workunit.client.0.smithi049.stdout:0/870: dread d6/fb2 [0,4194304] 0 2024-06-03T00:03:30.970 INFO:tasks.workunit.client.0.smithi049.stdout:0/871: readlink d6/d30/lff 0 2024-06-03T00:03:30.972 INFO:tasks.workunit.client.0.smithi049.stdout:3/869: write d2/d14/fac [1683697,62050] 0 2024-06-03T00:03:30.972 INFO:tasks.workunit.client.0.smithi049.stdout:3/870: fdatasync d2/d1a/d34/f62 0 2024-06-03T00:03:30.972 INFO:tasks.workunit.client.0.smithi049.stdout:0/872: rename d6/d29/dc8/l1b to d6/dd7/d112/l120 0 2024-06-03T00:03:30.973 INFO:tasks.workunit.client.0.smithi049.stdout:3/871: rename d2 to d2/d14/d22/d136 22 2024-06-03T00:03:30.975 INFO:tasks.workunit.client.0.smithi049.stdout:8/795: dread d4/d27/d3c/d88/f14 [0,4194304] 0 2024-06-03T00:03:30.975 INFO:tasks.workunit.client.0.smithi049.stdout:3/872: symlink d2/d1a/d34/dd5/d75/d94/d9e/l137 0 2024-06-03T00:03:30.976 INFO:tasks.workunit.client.0.smithi049.stdout:0/873: dread d6/d97/d4b/d67/ff5 [0,4194304] 0 2024-06-03T00:03:30.977 INFO:tasks.workunit.client.0.smithi049.stdout:3/873: symlink d2/d14/d22/d42/d68/d80/l138 0 2024-06-03T00:03:30.977 INFO:tasks.workunit.client.0.smithi049.stdout:3/874: fdatasync d2/d1a/d51/fdb 0 2024-06-03T00:03:30.977 INFO:tasks.workunit.client.0.smithi049.stdout:0/874: mkdir d6/d29/dc8/d10d/d121 0 2024-06-03T00:03:30.977 INFO:tasks.workunit.client.0.smithi049.stdout:0/875: stat d6/d29/dc8/f87 0 2024-06-03T00:03:30.977 INFO:tasks.workunit.client.0.smithi049.stdout:4/967: dwrite d4/d3f/d14/d7f/d87/f8b [0,4194304] 0 2024-06-03T00:03:30.978 INFO:tasks.workunit.client.0.smithi049.stdout:0/876: mknod d6/d97/d4b/c122 0 2024-06-03T00:03:30.979 INFO:tasks.workunit.client.0.smithi049.stdout:4/968: creat d4/d3f/d14/d2b/d84/d1c/f149 x:0 0 0 2024-06-03T00:03:30.980 INFO:tasks.workunit.client.0.smithi049.stdout:0/877: creat d6/d30/d32/f123 x:0 0 0 2024-06-03T00:03:30.981 INFO:tasks.workunit.client.0.smithi049.stdout:0/878: unlink d6/d30/d32/lf4 0 2024-06-03T00:03:30.982 INFO:tasks.workunit.client.0.smithi049.stdout:4/969: unlink d4/d3f/d14/d7f/d87/f10d 0 2024-06-03T00:03:30.983 INFO:tasks.workunit.client.0.smithi049.stdout:7/944: dwrite d3/dd8/d9/f2b [0,4194304] 0 2024-06-03T00:03:30.983 INFO:tasks.workunit.client.0.smithi049.stdout:4/970: stat d4/d3f/d14/d7f/d87/cdd 0 2024-06-03T00:03:30.983 INFO:tasks.workunit.client.0.smithi049.stdout:4/971: fsync d4/d2a/fbb 0 2024-06-03T00:03:30.985 INFO:tasks.workunit.client.0.smithi049.stdout:4/972: read d4/d3f/d14/fe6 [316971,110596] 0 2024-06-03T00:03:30.985 INFO:tasks.workunit.client.0.smithi049.stdout:0/879: dread d6/d30/fac [0,4194304] 0 2024-06-03T00:03:30.986 INFO:tasks.workunit.client.0.smithi049.stdout:4/973: stat d4/d3f/d14/d7f/ddb/f80 0 2024-06-03T00:03:30.986 INFO:tasks.workunit.client.0.smithi049.stdout:4/974: write d4/d3f/d14/d2b/f48 [6101748,126545] 0 2024-06-03T00:03:30.986 INFO:tasks.workunit.client.0.smithi049.stdout:4/975: chown d4/d3f/d14/d2b/d84/d1c/d4f 1419 1 2024-06-03T00:03:30.987 INFO:tasks.workunit.client.0.smithi049.stdout:7/945: unlink d3/d14/f76 0 2024-06-03T00:03:30.987 INFO:tasks.workunit.client.0.smithi049.stdout:8/796: dread d4/d27/d3c/d88/d28/d52/d66/d53/d6c/fc9 [0,4194304] 0 2024-06-03T00:03:30.987 INFO:tasks.workunit.client.0.smithi049.stdout:8/797: truncate d4/d27/d3c/d88/d28/d52/d66/d53/d7e/fc4 1403921 0 2024-06-03T00:03:30.988 INFO:tasks.workunit.client.0.smithi049.stdout:3/875: dread d2/d14/d44/f5b [0,4194304] 0 2024-06-03T00:03:30.988 INFO:tasks.workunit.client.0.smithi049.stdout:3/876: chown d2/d1a/d34/dd5/d75/d94/dd1/da0/de3/dee/d10b 2 1 2024-06-03T00:03:30.991 INFO:tasks.workunit.client.0.smithi049.stdout:3/877: unlink d2/d14/f54 0 2024-06-03T00:03:30.993 INFO:tasks.workunit.client.0.smithi049.stdout:8/798: mknod d4/d27/d3c/d43/d6b/da6/c112 0 2024-06-03T00:03:30.993 INFO:tasks.workunit.client.0.smithi049.stdout:3/878: mkdir d2/d1a/d34/dd5/d75/d94/dd1/da0/d139 0 2024-06-03T00:03:30.994 INFO:tasks.workunit.client.0.smithi049.stdout:0/880: write d6/d59/f9e [4701280,13300] 0 2024-06-03T00:03:30.994 INFO:tasks.workunit.client.0.smithi049.stdout:3/879: chown d2/d14/c23 934628 1 2024-06-03T00:03:30.995 INFO:tasks.workunit.client.0.smithi049.stdout:8/799: symlink d4/d10d/l113 0 2024-06-03T00:03:30.996 INFO:tasks.workunit.client.0.smithi049.stdout:8/800: mkdir d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/dab/d114 0 2024-06-03T00:03:30.996 INFO:tasks.workunit.client.0.smithi049.stdout:8/801: readlink d4/d27/l7d 0 2024-06-03T00:03:30.997 INFO:tasks.workunit.client.0.smithi049.stdout:4/976: read d4/d3f/d14/d7f/fa3 [1356577,100819] 0 2024-06-03T00:03:31.005 INFO:tasks.workunit.client.0.smithi049.stdout:7/946: dwrite d3/dd8/d13/d3c/d110/d140/f9a [0,4194304] 0 2024-06-03T00:03:31.005 INFO:tasks.workunit.client.0.smithi049.stdout:7/947: write d3/dd8/d13/d3c/d110/d140/df6/d11e/f148 [829944,42751] 0 2024-06-03T00:03:31.011 INFO:tasks.workunit.client.0.smithi049.stdout:8/802: write d4/d27/d30/f41 [3565501,82818] 0 2024-06-03T00:03:31.012 INFO:tasks.workunit.client.0.smithi049.stdout:8/803: creat d4/d27/f115 x:0 0 0 2024-06-03T00:03:31.016 INFO:tasks.workunit.client.0.smithi049.stdout:4/977: write d4/d3f/d14/d7f/ddb/dc2/fc9 [836102,117422] 0 2024-06-03T00:03:31.018 INFO:tasks.workunit.client.0.smithi049.stdout:4/978: truncate d4/d3f/d14/d7f/d87/f12c 51968 0 2024-06-03T00:03:31.018 INFO:tasks.workunit.client.0.smithi049.stdout:7/948: dread d3/dd8/f20 [0,4194304] 0 2024-06-03T00:03:31.020 INFO:tasks.workunit.client.0.smithi049.stdout:7/949: symlink d3/dd8/d13/d3c/d48/d7b/d5b/l154 0 2024-06-03T00:03:31.025 INFO:tasks.workunit.client.0.smithi049.stdout:0/881: dwrite d6/d29/fbb [0,4194304] 0 2024-06-03T00:03:31.025 INFO:tasks.workunit.client.0.smithi049.stdout:3/880: dwrite d2/d1a/d34/dd5/d75/d94/dd1/db6/fce [0,4194304] 0 2024-06-03T00:03:31.027 INFO:tasks.workunit.client.0.smithi049.stdout:3/881: getdents d2/d1a/d51/dbe 0 2024-06-03T00:03:31.027 INFO:tasks.workunit.client.0.smithi049.stdout:0/882: creat d6/d29/dc8/d52/d96/f124 x:0 0 0 2024-06-03T00:03:31.027 INFO:tasks.workunit.client.0.smithi049.stdout:3/882: chown d2/d14/d44/c50 9 1 2024-06-03T00:03:31.029 INFO:tasks.workunit.client.0.smithi049.stdout:0/883: dread d6/d97/d10a/f10e [0,4194304] 0 2024-06-03T00:03:31.032 INFO:tasks.workunit.client.0.smithi049.stdout:8/804: dwrite d4/d27/d3c/d43/fff [0,4194304] 0 2024-06-03T00:03:31.035 INFO:tasks.workunit.client.0.smithi049.stdout:4/979: write d4/d3f/d14/d2b/d84/d1c/d24/d43/daf/fcb [3020613,106561] 0 2024-06-03T00:03:31.035 INFO:tasks.workunit.client.0.smithi049.stdout:8/805: rename d4/d27/d3c/d88/d28/d52/d66/d8e to d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d116 0 2024-06-03T00:03:31.042 INFO:tasks.workunit.client.0.smithi049.stdout:7/950: dwrite d3/dd8/d146/f117 [0,4194304] 0 2024-06-03T00:03:31.045 INFO:tasks.workunit.client.0.smithi049.stdout:7/951: rename d3/dd8/d86/fa9 to d3/dd8/d9/d91/f155 0 2024-06-03T00:03:31.045 INFO:tasks.workunit.client.0.smithi049.stdout:7/952: readlink d3/dd8/d13/d54/lf7 0 2024-06-03T00:03:31.050 INFO:tasks.workunit.client.0.smithi049.stdout:8/806: dread d4/d27/d3c/d88/f14 [4194304,4194304] 0 2024-06-03T00:03:31.054 INFO:tasks.workunit.client.0.smithi049.stdout:3/883: dwrite d2/d14/d44/d52/d4c/d4b/f89 [0,4194304] 0 2024-06-03T00:03:31.056 INFO:tasks.workunit.client.0.smithi049.stdout:3/884: rmdir d2/d1a/d34/dd5/d75/d94 39 2024-06-03T00:03:31.057 INFO:tasks.workunit.client.0.smithi049.stdout:8/807: dread d4/d27/d3c/d88/f10 [4194304,4194304] 0 2024-06-03T00:03:31.057 INFO:tasks.workunit.client.0.smithi049.stdout:4/980: dwrite d4/d3f/d14/d7f/d87/f8b [0,4194304] 0 2024-06-03T00:03:31.057 INFO:tasks.workunit.client.0.smithi049.stdout:3/885: getdents d2/d14/d44/d52/d4c/d4b/d98 0 2024-06-03T00:03:31.057 INFO:tasks.workunit.client.0.smithi049.stdout:0/884: dwrite d6/d29/dc8/f1f [0,4194304] 0 2024-06-03T00:03:31.059 INFO:tasks.workunit.client.0.smithi049.stdout:8/808: mkdir d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/dab/d117 0 2024-06-03T00:03:31.060 INFO:tasks.workunit.client.0.smithi049.stdout:4/981: mknod d4/d3f/d14/d2b/d84/c14a 0 2024-06-03T00:03:31.060 INFO:tasks.workunit.client.0.smithi049.stdout:0/885: write d6/d30/da3/faa [850746,19760] 0 2024-06-03T00:03:31.060 INFO:tasks.workunit.client.0.smithi049.stdout:0/886: dread - d6/d97/f90 zero size 2024-06-03T00:03:31.061 INFO:tasks.workunit.client.0.smithi049.stdout:0/887: mknod d6/d29/c125 0 2024-06-03T00:03:31.061 INFO:tasks.workunit.client.0.smithi049.stdout:0/888: write d6/d29/f79 [2515206,60144] 0 2024-06-03T00:03:31.061 INFO:tasks.workunit.client.0.smithi049.stdout:4/982: symlink d4/d3f/d14/d7f/ddb/dc2/l14b 0 2024-06-03T00:03:31.061 INFO:tasks.workunit.client.0.smithi049.stdout:0/889: rmdir d6/d59/d93 39 2024-06-03T00:03:31.062 INFO:tasks.workunit.client.0.smithi049.stdout:3/886: rename d2/d14/d22/d3a/d47/d79/c93 to d2/d14/d44/d52/d4c/d4b/c13a 0 2024-06-03T00:03:31.062 INFO:tasks.workunit.client.0.smithi049.stdout:0/890: unlink d6/d97/d4b/cea 0 2024-06-03T00:03:31.062 INFO:tasks.workunit.client.0.smithi049.stdout:0/891: truncate d6/d97/fc0 1135642 0 2024-06-03T00:03:31.063 INFO:tasks.workunit.client.0.smithi049.stdout:3/887: mknod d2/d1a/d34/dd5/d75/d94/dd1/c13b 0 2024-06-03T00:03:31.063 INFO:tasks.workunit.client.0.smithi049.stdout:0/892: creat d6/d30/f126 x:0 0 0 2024-06-03T00:03:31.063 INFO:tasks.workunit.client.0.smithi049.stdout:4/983: truncate d4/d3f/d14/d2b/d84/d1c/d4f/f86 737318 0 2024-06-03T00:03:31.064 INFO:tasks.workunit.client.0.smithi049.stdout:3/888: rename d2/d14/c108 to d2/d1a/d76/d95/d106/c13c 0 2024-06-03T00:03:31.066 INFO:tasks.workunit.client.0.smithi049.stdout:3/889: mknod d2/d1a/d76/d95/d106/c13d 0 2024-06-03T00:03:31.066 INFO:tasks.workunit.client.0.smithi049.stdout:3/890: getdents d2/d14/d22/d42/d68/d80/d116 0 2024-06-03T00:03:31.066 INFO:tasks.workunit.client.0.smithi049.stdout:3/891: chown d2/d1a/d34/dd5/c9f 382013 1 2024-06-03T00:03:31.067 INFO:tasks.workunit.client.0.smithi049.stdout:0/893: rename d6/d30/c60 to d6/dd7/c127 0 2024-06-03T00:03:31.067 INFO:tasks.workunit.client.0.smithi049.stdout:0/894: readlink d6/d30/d32/lf9 0 2024-06-03T00:03:31.067 INFO:tasks.workunit.client.0.smithi049.stdout:0/895: fsync d6/d29/dc8/f1f 0 2024-06-03T00:03:31.067 INFO:tasks.workunit.client.0.smithi049.stdout:0/896: write d6/f109 [196004,20238] 0 2024-06-03T00:03:31.067 INFO:tasks.workunit.client.0.smithi049.stdout:7/953: dwrite d3/f22 [0,4194304] 0 2024-06-03T00:03:31.067 INFO:tasks.workunit.client.0.smithi049.stdout:8/809: write d4/d27/d3c/d88/d4d/f95 [869012,55053] 0 2024-06-03T00:03:31.068 INFO:tasks.workunit.client.0.smithi049.stdout:8/810: write d4/d27/d30/fa7 [1123105,106761] 0 2024-06-03T00:03:31.068 INFO:tasks.workunit.client.0.smithi049.stdout:3/892: symlink d2/d1a/d34/dd5/d75/d94/dd1/l13e 0 2024-06-03T00:03:31.069 INFO:tasks.workunit.client.0.smithi049.stdout:3/893: stat d2/d14/d22/l28 0 2024-06-03T00:03:31.069 INFO:tasks.workunit.client.0.smithi049.stdout:0/897: fsync d6/d29/fe3 0 2024-06-03T00:03:31.069 INFO:tasks.workunit.client.0.smithi049.stdout:7/954: creat d3/dd8/d86/d8d/f156 x:0 0 0 2024-06-03T00:03:31.069 INFO:tasks.workunit.client.0.smithi049.stdout:3/894: truncate d2/d1a/d76/fbb 319496 0 2024-06-03T00:03:31.069 INFO:tasks.workunit.client.0.smithi049.stdout:3/895: chown d2/d1a/d34/f62 43407 1 2024-06-03T00:03:31.071 INFO:tasks.workunit.client.0.smithi049.stdout:0/898: mknod d6/d29/dc8/d52/d96/dfb/c128 0 2024-06-03T00:03:31.071 INFO:tasks.workunit.client.0.smithi049.stdout:8/811: mknod d4/d27/d3c/d88/d28/d52/c118 0 2024-06-03T00:03:31.072 INFO:tasks.workunit.client.0.smithi049.stdout:0/899: rmdir d6/d30 39 2024-06-03T00:03:31.072 INFO:tasks.workunit.client.0.smithi049.stdout:3/896: write d2/f8b [578949,123460] 0 2024-06-03T00:03:31.074 INFO:tasks.workunit.client.0.smithi049.stdout:0/900: creat d6/d97/d10a/f129 x:0 0 0 2024-06-03T00:03:31.078 INFO:tasks.workunit.client.0.smithi049.stdout:0/901: creat d6/d29/dc8/d10d/f12a x:0 0 0 2024-06-03T00:03:31.081 INFO:tasks.workunit.client.0.smithi049.stdout:8/812: rename d4/d27/l99 to d4/d27/d3c/d88/d28/d52/d66/d53/l119 0 2024-06-03T00:03:31.083 INFO:tasks.workunit.client.0.smithi049.stdout:4/984: dwrite d4/d3f/d14/d2b/d84/f57 [4194304,4194304] 0 2024-06-03T00:03:31.084 INFO:tasks.workunit.client.0.smithi049.stdout:8/813: chown d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/c94 1120 1 2024-06-03T00:03:31.087 INFO:tasks.workunit.client.0.smithi049.stdout:0/902: rename d6/dd7/f11b to d6/d59/f12b 0 2024-06-03T00:03:31.088 INFO:tasks.workunit.client.0.smithi049.stdout:0/903: dread d6/d97/fe1 [0,4194304] 0 2024-06-03T00:03:31.088 INFO:tasks.workunit.client.0.smithi049.stdout:7/955: dwrite d3/dd8/d13/d54/f4d [4194304,4194304] 0 2024-06-03T00:03:31.094 INFO:tasks.workunit.client.0.smithi049.stdout:4/985: dread d4/d3f/d14/fc1 [4194304,4194304] 0 2024-06-03T00:03:31.095 INFO:tasks.workunit.client.0.smithi049.stdout:4/986: rmdir d4/d3f/d14/d7f/ddb/d8a/d11e 0 2024-06-03T00:03:31.097 INFO:tasks.workunit.client.0.smithi049.stdout:7/956: dread d3/dd8/d9/f2b [0,4194304] 0 2024-06-03T00:03:31.097 INFO:tasks.workunit.client.0.smithi049.stdout:7/957: readlink d3/dd8/d13/d54/daa/d92/l104 0 2024-06-03T00:03:31.097 INFO:tasks.workunit.client.0.smithi049.stdout:7/958: dread - d3/dd8/d13/d79/d114/d12f/dd5/f122 zero size 2024-06-03T00:03:31.098 INFO:tasks.workunit.client.0.smithi049.stdout:7/959: creat d3/dd8/d9/d8f/d118/f157 x:0 0 0 2024-06-03T00:03:31.098 INFO:tasks.workunit.client.0.smithi049.stdout:7/960: dread - d3/dd8/d13/d3c/d110/d140/df6/d11e/d12e/ff5 zero size 2024-06-03T00:03:31.103 INFO:tasks.workunit.client.0.smithi049.stdout:4/987: dread d4/d2a/f81 [0,4194304] 0 2024-06-03T00:03:31.104 INFO:tasks.workunit.client.0.smithi049.stdout:4/988: creat d4/d3f/d14/d2b/d84/d1c/d24/f14c x:0 0 0 2024-06-03T00:03:31.105 INFO:tasks.workunit.client.0.smithi049.stdout:8/814: getdents d4/d27/d3c/d88/d28/d52 0 2024-06-03T00:03:31.106 INFO:tasks.workunit.client.0.smithi049.stdout:4/989: mknod d4/d2a/ddf/c14d 0 2024-06-03T00:03:31.106 INFO:tasks.workunit.client.0.smithi049.stdout:8/815: getdents d4/d27/d3c/d88/d28 0 2024-06-03T00:03:31.110 INFO:tasks.workunit.client.0.smithi049.stdout:8/816: unlink d4/f17 0 2024-06-03T00:03:31.110 INFO:tasks.workunit.client.0.smithi049.stdout:8/817: chown d4/d27/cd5 347 1 2024-06-03T00:03:31.112 INFO:tasks.workunit.client.0.smithi049.stdout:8/818: unlink d4/d27/d3c/d88/d28/l55 0 2024-06-03T00:03:31.116 INFO:tasks.workunit.client.0.smithi049.stdout:8/819: link d4/d27/d3c/d88/d28/d52/d66/d53/c47 d4/d27/d3c/d88/d4d/c11a 0 2024-06-03T00:03:31.117 INFO:tasks.workunit.client.0.smithi049.stdout:8/820: symlink d4/d27/d3c/d88/d48/l11b 0 2024-06-03T00:03:31.119 INFO:tasks.workunit.client.0.smithi049.stdout:4/990: dwrite d4/d3f/d14/d2b/d84/d1c/d24/d43/daf/fcb [0,4194304] 0 2024-06-03T00:03:31.119 INFO:tasks.workunit.client.0.smithi049.stdout:8/821: mkdir d4/d27/d3c/d88/d28/d2b/d84/dba/d11c 0 2024-06-03T00:03:31.120 INFO:tasks.workunit.client.0.smithi049.stdout:4/991: mknod d4/d3f/d14/d82/d117/c14e 0 2024-06-03T00:03:31.121 INFO:tasks.workunit.client.0.smithi049.stdout:4/992: readlink d4/l77 0 2024-06-03T00:03:31.122 INFO:tasks.workunit.client.0.smithi049.stdout:8/822: mkdir d4/d27/d3c/d88/d28/d45/d11d 0 2024-06-03T00:03:31.131 INFO:tasks.workunit.client.0.smithi049.stdout:4/993: dread d4/d3f/d14/d2b/d84/d69/fe4 [0,4194304] 0 2024-06-03T00:03:31.135 INFO:tasks.workunit.client.0.smithi049.stdout:4/994: chown d4/d3f/d14/d82/fc7 678834705 1 2024-06-03T00:03:31.136 INFO:tasks.workunit.client.0.smithi049.stdout:8/823: dwrite d4/f15 [4194304,4194304] 0 2024-06-03T00:03:31.151 INFO:tasks.workunit.client.0.smithi049.stdout:4/995: dwrite d4/fc [0,4194304] 0 2024-06-03T00:03:31.151 INFO:tasks.workunit.client.0.smithi049.stdout:4/996: read d4/d3f/d14/d7f/ff9 [204468,112301] 0 2024-06-03T00:03:31.155 INFO:tasks.workunit.client.0.smithi049.stdout:4/997: getdents d4/d3f/d14/d82/d117 0 2024-06-03T00:03:31.163 INFO:tasks.workunit.client.0.smithi049.stdout:4/998: write d4/d3f/d14/d2b/d84/d69/fe4 [4864645,51656] 0 2024-06-03T00:03:31.164 INFO:tasks.workunit.client.0.smithi049.stdout:4/999: symlink d4/d3f/d14/d82/d117/d120/l14f 0 2024-06-03T00:03:31.257 INFO:tasks.workunit.client.0.smithi049.stdout:3/897: sync 2024-06-03T00:03:31.258 INFO:tasks.workunit.client.0.smithi049.stdout:3/898: write d2/d1a/d34/dd5/d75/d94/dd1/da0/de3/dee/d10b/f11a [614376,32235] 0 2024-06-03T00:03:31.258 INFO:tasks.workunit.client.0.smithi049.stdout:3/899: creat d2/d1a/d34/dd5/d75/d94/dd1/da0/d139/f13f x:0 0 0 2024-06-03T00:03:31.258 INFO:tasks.workunit.client.0.smithi049.stdout:3/900: readlink d2/d14/d22/d42/d68/d80/l138 0 2024-06-03T00:03:31.259 INFO:tasks.workunit.client.0.smithi049.stdout:3/901: creat d2/d1a/f140 x:0 0 0 2024-06-03T00:03:31.259 INFO:tasks.workunit.client.0.smithi049.stdout:3/902: dread - d2/d1a/f110 zero size 2024-06-03T00:03:31.274 INFO:tasks.workunit.client.0.smithi049.stdout:3/903: dwrite d2/d1a/d34/f5e [0,4194304] 0 2024-06-03T00:03:31.281 INFO:tasks.workunit.client.0.smithi049.stdout:3/904: dread d2/d1a/d34/dd5/d75/d94/dd1/db6/fce [0,4194304] 0 2024-06-03T00:03:31.282 INFO:tasks.workunit.client.0.smithi049.stdout:3/905: creat d2/d14/d44/d52/d4c/d4b/d98/d127/f141 x:0 0 0 2024-06-03T00:03:31.282 INFO:tasks.workunit.client.0.smithi049.stdout:3/906: truncate d2/d14/fc7 4492943 0 2024-06-03T00:03:31.287 INFO:tasks.workunit.client.0.smithi049.stdout:3/907: dread d2/d1a/d34/dd5/d75/d94/dd1/db6/fd6 [0,4194304] 0 2024-06-03T00:03:31.289 INFO:tasks.workunit.client.0.smithi049.stdout:3/908: creat d2/d1a/d76/d95/d106/f142 x:0 0 0 2024-06-03T00:03:31.406 INFO:tasks.workunit.client.0.smithi049.stdout:8/824: sync 2024-06-03T00:03:31.406 INFO:tasks.workunit.client.0.smithi049.stdout:0/904: sync 2024-06-03T00:03:31.407 INFO:tasks.workunit.client.0.smithi049.stdout:7/961: sync 2024-06-03T00:03:31.407 INFO:tasks.workunit.client.0.smithi049.stdout:8/825: mkdir d4/d27/d3c/d43/d6b/da6/d11e 0 2024-06-03T00:03:31.409 INFO:tasks.workunit.client.0.smithi049.stdout:8/826: mkdir d4/d27/d3c/d88/d11f 0 2024-06-03T00:03:31.411 INFO:tasks.workunit.client.0.smithi049.stdout:8/827: creat d4/d27/d3c/d88/d28/d52/d66/d53/f120 x:0 0 0 2024-06-03T00:03:31.412 INFO:tasks.workunit.client.0.smithi049.stdout:8/828: mkdir d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/dab/d114/d121 0 2024-06-03T00:03:31.413 INFO:tasks.workunit.client.0.smithi049.stdout:8/829: mkdir d4/d27/d3c/d43/d6b/d10f/d122 0 2024-06-03T00:03:31.417 INFO:tasks.workunit.client.0.smithi049.stdout:7/962: write d3/dd8/d13/d3c/d4b/f9b [1155555,105719] 0 2024-06-03T00:03:31.418 INFO:tasks.workunit.client.0.smithi049.stdout:7/963: mkdir d3/dd8/d86/d90/def/d158 0 2024-06-03T00:03:31.418 INFO:tasks.workunit.client.0.smithi049.stdout:7/964: chown d3/d14/d6e/f103 255755 1 2024-06-03T00:03:31.418 INFO:tasks.workunit.client.0.smithi049.stdout:7/965: chown d3/f22 340535502 1 2024-06-03T00:03:31.423 INFO:tasks.workunit.client.0.smithi049.stdout:8/830: dread d4/d27/d3c/f2f [0,4194304] 0 2024-06-03T00:03:31.424 INFO:tasks.workunit.client.0.smithi049.stdout:0/905: dwrite d6/d30/d32/f40 [0,4194304] 0 2024-06-03T00:03:31.426 INFO:tasks.workunit.client.0.smithi049.stdout:0/906: link d6/d29/dc8/f70 d6/f12c 0 2024-06-03T00:03:31.440 INFO:tasks.workunit.client.0.smithi049.stdout:8/831: dwrite d4/d27/d3c/d88/d28/d45/f49 [0,4194304] 0 2024-06-03T00:03:31.441 INFO:tasks.workunit.client.0.smithi049.stdout:8/832: creat d4/d27/d3c/d43/f123 x:0 0 0 2024-06-03T00:03:31.442 INFO:tasks.workunit.client.0.smithi049.stdout:8/833: creat d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/dab/d114/f124 x:0 0 0 2024-06-03T00:03:31.442 INFO:tasks.workunit.client.0.smithi049.stdout:8/834: dread - d4/d27/d3c/d88/d28/d52/ff8 zero size 2024-06-03T00:03:31.447 INFO:tasks.workunit.client.0.smithi049.stdout:8/835: dread d4/d27/d3c/d88/d28/d52/d66/d53/d7e/fea [0,4194304] 0 2024-06-03T00:03:31.447 INFO:tasks.workunit.client.0.smithi049.stdout:0/907: dwrite d6/f109 [0,4194304] 0 2024-06-03T00:03:31.449 INFO:tasks.workunit.client.0.smithi049.stdout:0/908: dread d6/d97/d4b/d67/ff5 [0,4194304] 0 2024-06-03T00:03:31.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:31 smithi057 ceph-mon[36457]: pgmap v487: 97 pgs: 97 active+clean; 1.9 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 MiB/s rd, 47 MiB/s wr, 363 op/s 2024-06-03T00:03:31.450 INFO:tasks.workunit.client.0.smithi049.stdout:8/836: dread d4/d27/fc1 [0,4194304] 0 2024-06-03T00:03:31.450 INFO:tasks.workunit.client.0.smithi049.stdout:0/909: creat d6/d59/d93/db4/f12d x:0 0 0 2024-06-03T00:03:31.451 INFO:tasks.workunit.client.0.smithi049.stdout:8/837: truncate d4/d27/d3c/d88/d48/fc6 846603 0 2024-06-03T00:03:31.458 INFO:tasks.workunit.client.0.smithi049.stdout:8/838: truncate d4/d27/d3c/d88/d28/d45/f49 67049 0 2024-06-03T00:03:31.459 INFO:tasks.workunit.client.0.smithi049.stdout:8/839: unlink d4/d27/d3c/d88/d28/d52/fc5 0 2024-06-03T00:03:31.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:31 smithi049 ceph-mon[32302]: pgmap v487: 97 pgs: 97 active+clean; 1.9 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 MiB/s rd, 47 MiB/s wr, 363 op/s 2024-06-03T00:03:31.482 INFO:tasks.workunit.client.0.smithi049.stdout:8/840: dwrite d4/d27/d3c/d88/d28/d45/f6a [0,4194304] 0 2024-06-03T00:03:31.483 INFO:tasks.workunit.client.0.smithi049.stdout:0/910: dwrite d6/d97/d4b/fb7 [0,4194304] 0 2024-06-03T00:03:31.484 INFO:tasks.workunit.client.0.smithi049.stdout:0/911: truncate d6/d29/dc8/d52/d96/f9f 4940158 0 2024-06-03T00:03:31.484 INFO:tasks.workunit.client.0.smithi049.stdout:0/912: dread - d6/d97/d4b/f114 zero size 2024-06-03T00:03:31.485 INFO:tasks.workunit.client.0.smithi049.stdout:0/913: creat d6/d30/d32/dca/f12e x:0 0 0 2024-06-03T00:03:31.487 INFO:tasks.workunit.client.0.smithi049.stdout:0/914: mkdir d6/d30/d32/d12f 0 2024-06-03T00:03:31.487 INFO:tasks.workunit.client.0.smithi049.stdout:0/915: dread - d6/d30/f126 zero size 2024-06-03T00:03:31.489 INFO:tasks.workunit.client.0.smithi049.stdout:0/916: rmdir d6/d97/d4b/d67 39 2024-06-03T00:03:31.489 INFO:tasks.workunit.client.0.smithi049.stdout:0/917: chown d6/d29/dc8/d52/deb/l11f 0 1 2024-06-03T00:03:31.491 INFO:tasks.workunit.client.0.smithi049.stdout:3/909: sync 2024-06-03T00:03:31.502 INFO:tasks.workunit.client.0.smithi049.stdout:0/918: read d6/d59/d93/f9d [69333,57011] 0 2024-06-03T00:03:31.503 INFO:tasks.workunit.client.0.smithi049.stdout:8/841: dwrite d4/d27/d3c/d88/d28/d45/fc0 [0,4194304] 0 2024-06-03T00:03:31.506 INFO:tasks.workunit.client.0.smithi049.stdout:8/842: symlink d4/d27/d3c/d88/d28/d52/d66/l125 0 2024-06-03T00:03:31.507 INFO:tasks.workunit.client.0.smithi049.stdout:7/966: sync 2024-06-03T00:03:31.508 INFO:tasks.workunit.client.0.smithi049.stdout:3/910: dwrite d2/d1a/d76/fde [0,4194304] 0 2024-06-03T00:03:31.509 INFO:tasks.workunit.client.0.smithi049.stdout:8/843: link d4/d27/d3c/d88/d28/d52/cf0 d4/d27/d3c/d88/d28/d52/d66/c126 0 2024-06-03T00:03:31.510 INFO:tasks.workunit.client.0.smithi049.stdout:7/967: rename d3/dd8/d13/d3c/d4b/d8e to d3/dd8/d13/d3c/d48/d159 0 2024-06-03T00:03:31.510 INFO:tasks.workunit.client.0.smithi049.stdout:7/968: dread - d3/d14/d6e/f103 zero size 2024-06-03T00:03:31.512 INFO:tasks.workunit.client.0.smithi049.stdout:8/844: rename d4/d27/c2d to d4/d27/d3c/d88/d48/dde/c127 0 2024-06-03T00:03:31.514 INFO:tasks.workunit.client.0.smithi049.stdout:8/845: link d4/d27/d3c/d43/f123 d4/d10d/f128 0 2024-06-03T00:03:31.517 INFO:tasks.workunit.client.0.smithi049.stdout:8/846: symlink d4/d27/d3c/d88/d28/d52/d66/d53/l129 0 2024-06-03T00:03:31.517 INFO:tasks.workunit.client.0.smithi049.stdout:3/911: dread d2/d14/d22/d3a/fd8 [0,4194304] 0 2024-06-03T00:03:31.524 INFO:tasks.workunit.client.0.smithi049.stdout:0/919: dwrite f4 [0,4194304] 0 2024-06-03T00:03:31.525 INFO:tasks.workunit.client.0.smithi049.stdout:0/920: rmdir d6/d29 39 2024-06-03T00:03:31.525 INFO:tasks.workunit.client.0.smithi049.stdout:0/921: write d6/d97/f6a [708920,111451] 0 2024-06-03T00:03:31.527 INFO:tasks.workunit.client.0.smithi049.stdout:3/912: dread d2/d14/d44/fa5 [0,4194304] 0 2024-06-03T00:03:31.527 INFO:tasks.workunit.client.0.smithi049.stdout:3/913: rmdir d2/d1a/d51 39 2024-06-03T00:03:31.528 INFO:tasks.workunit.client.0.smithi049.stdout:3/914: mknod d2/d1a/d34/dd5/d75/d94/dd1/da0/d139/c143 0 2024-06-03T00:03:31.529 INFO:tasks.workunit.client.0.smithi049.stdout:3/915: symlink d2/d1a/d76/df6/l144 0 2024-06-03T00:03:31.530 INFO:tasks.workunit.client.0.smithi049.stdout:3/916: rmdir d2/d1a/d34/de9 39 2024-06-03T00:03:31.530 INFO:tasks.workunit.client.0.smithi049.stdout:7/969: dwrite d3/dd8/d13/d79/d114/d12f/f2f [0,4194304] 0 2024-06-03T00:03:31.532 INFO:tasks.workunit.client.0.smithi049.stdout:7/970: creat d3/d14/d6e/f15a x:0 0 0 2024-06-03T00:03:31.560 INFO:tasks.workunit.client.0.smithi049.stdout:8/847: dwrite d4/f9d [0,4194304] 0 2024-06-03T00:03:31.561 INFO:tasks.workunit.client.0.smithi049.stdout:0/922: dwrite d6/d97/fc2 [0,4194304] 0 2024-06-03T00:03:31.561 INFO:tasks.workunit.client.0.smithi049.stdout:7/971: dwrite d3/dd8/d13/d54/fba [0,4194304] 0 2024-06-03T00:03:31.561 INFO:tasks.workunit.client.0.smithi049.stdout:7/972: dread - d3/dd8/d86/d90/dae/f13a zero size 2024-06-03T00:03:31.561 INFO:tasks.workunit.client.0.smithi049.stdout:3/917: dwrite d2/d14/d44/d52/d4c/d4b/d98/d127/f141 [0,4194304] 0 2024-06-03T00:03:31.562 INFO:tasks.workunit.client.0.smithi049.stdout:0/923: chown d6/d29/dc8/c37 137746 1 2024-06-03T00:03:31.563 INFO:tasks.workunit.client.0.smithi049.stdout:8/848: creat d4/d27/d3c/d88/d28/d45/f12a x:0 0 0 2024-06-03T00:03:31.563 INFO:tasks.workunit.client.0.smithi049.stdout:8/849: chown d4/d27/d3c/d88/d28/d45/f6a 381 1 2024-06-03T00:03:31.563 INFO:tasks.workunit.client.0.smithi049.stdout:7/973: dread d3/dd8/d13/f65 [0,4194304] 0 2024-06-03T00:03:31.563 INFO:tasks.workunit.client.0.smithi049.stdout:7/974: write d3/d14/d6e/ff4 [4610461,4682] 0 2024-06-03T00:03:31.566 INFO:tasks.workunit.client.0.smithi049.stdout:3/918: creat d2/d14/d22/d42/d8f/f145 x:0 0 0 2024-06-03T00:03:31.577 INFO:tasks.workunit.client.0.smithi049.stdout:3/919: dread d2/d1a/d34/f5e [0,4194304] 0 2024-06-03T00:03:31.578 INFO:tasks.workunit.client.0.smithi049.stdout:3/920: dread d2/d14/d44/d52/d4c/d4b/fb5 [0,4194304] 0 2024-06-03T00:03:31.580 INFO:tasks.workunit.client.0.smithi049.stdout:3/921: creat d2/d1a/d76/de8/f146 x:0 0 0 2024-06-03T00:03:31.589 INFO:tasks.workunit.client.0.smithi049.stdout:8/850: dwrite d4/f73 [0,4194304] 0 2024-06-03T00:03:31.590 INFO:tasks.workunit.client.0.smithi049.stdout:0/924: dwrite d6/d29/fbb [0,4194304] 0 2024-06-03T00:03:31.591 INFO:tasks.workunit.client.0.smithi049.stdout:8/851: symlink d4/d27/d3c/d88/d10c/l12b 0 2024-06-03T00:03:31.591 INFO:tasks.workunit.client.0.smithi049.stdout:0/925: creat d6/d59/d93/f130 x:0 0 0 2024-06-03T00:03:31.592 INFO:tasks.workunit.client.0.smithi049.stdout:0/926: read - d6/d29/fb1 zero size 2024-06-03T00:03:31.592 INFO:tasks.workunit.client.0.smithi049.stdout:0/927: fdatasync d6/d97/fe1 0 2024-06-03T00:03:31.592 INFO:tasks.workunit.client.0.smithi049.stdout:0/928: write d6/d97/fd6 [526837,75063] 0 2024-06-03T00:03:31.593 INFO:tasks.workunit.client.0.smithi049.stdout:0/929: rename d6/d59/d93/db4/d116 to d6/d29/d131 0 2024-06-03T00:03:31.594 INFO:tasks.workunit.client.0.smithi049.stdout:0/930: symlink d6/dd7/d11e/l132 0 2024-06-03T00:03:31.594 INFO:tasks.workunit.client.0.smithi049.stdout:0/931: truncate d6/dd7/ff6 650411 0 2024-06-03T00:03:31.595 INFO:tasks.workunit.client.0.smithi049.stdout:0/932: mknod d6/dd7/d11e/c133 0 2024-06-03T00:03:31.595 INFO:tasks.workunit.client.0.smithi049.stdout:0/933: write d6/fa0 [2502419,101045] 0 2024-06-03T00:03:31.596 INFO:tasks.workunit.client.0.smithi049.stdout:0/934: creat d6/d30/d32/d12f/f134 x:0 0 0 2024-06-03T00:03:31.596 INFO:tasks.workunit.client.0.smithi049.stdout:0/935: fsync d6/d59/d93/db4/fdd 0 2024-06-03T00:03:31.597 INFO:tasks.workunit.client.0.smithi049.stdout:3/922: dwrite d2/fd [4194304,4194304] 0 2024-06-03T00:03:31.598 INFO:tasks.workunit.client.0.smithi049.stdout:3/923: mknod d2/d1a/d34/dd5/d75/d10e/c147 0 2024-06-03T00:03:31.599 INFO:tasks.workunit.client.0.smithi049.stdout:3/924: getdents d2/d1a/d34/dd5/d75/d94/d9e 0 2024-06-03T00:03:31.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:31 smithi107 ceph-mon[37048]: pgmap v487: 97 pgs: 97 active+clean; 1.9 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 MiB/s rd, 47 MiB/s wr, 363 op/s 2024-06-03T00:03:31.602 INFO:tasks.workunit.client.0.smithi049.stdout:8/852: write d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/dab/fb6 [1433435,29237] 0 2024-06-03T00:03:31.602 INFO:tasks.workunit.client.0.smithi049.stdout:8/853: write d4/d27/fed [29,130343] 0 2024-06-03T00:03:31.604 INFO:tasks.workunit.client.0.smithi049.stdout:8/854: creat d4/d27/d3c/d88/d48/dde/f12c x:0 0 0 2024-06-03T00:03:31.604 INFO:tasks.workunit.client.0.smithi049.stdout:8/855: dread - d4/d27/d30/fcf zero size 2024-06-03T00:03:31.605 INFO:tasks.workunit.client.0.smithi049.stdout:8/856: truncate d4/d27/d3c/d88/d28/d52/ff8 112991 0 2024-06-03T00:03:31.605 INFO:tasks.workunit.client.0.smithi049.stdout:8/857: dread - d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/da9/dd9/fe6 zero size 2024-06-03T00:03:31.607 INFO:tasks.workunit.client.0.smithi049.stdout:8/858: rename d4/d27/d3c/d88/d28/d2b/d84/dba to d4/d27/d3c/d88/d28/d52/d66/d12d 0 2024-06-03T00:03:31.618 INFO:tasks.workunit.client.0.smithi049.stdout:8/859: write d4/d27/d3c/d88/f91 [1634577,44466] 0 2024-06-03T00:03:31.619 INFO:tasks.workunit.client.0.smithi049.stdout:0/936: dwrite f4 [0,4194304] 0 2024-06-03T00:03:31.623 INFO:tasks.workunit.client.0.smithi049.stdout:3/925: dwrite d2/d1a/ffc [0,4194304] 0 2024-06-03T00:03:31.627 INFO:tasks.workunit.client.0.smithi049.stdout:3/926: getdents d2/d1a/d34/dd5/d75/d94/dd1 0 2024-06-03T00:03:31.632 INFO:tasks.workunit.client.0.smithi049.stdout:0/937: dwrite d6/d30/f9c [0,4194304] 0 2024-06-03T00:03:31.634 INFO:tasks.workunit.client.0.smithi049.stdout:0/938: dread d6/d97/d4b/f95 [0,4194304] 0 2024-06-03T00:03:31.637 INFO:tasks.workunit.client.0.smithi049.stdout:7/975: sync 2024-06-03T00:03:31.638 INFO:tasks.workunit.client.0.smithi049.stdout:0/939: dread d6/d30/da3/faa [0,4194304] 0 2024-06-03T00:03:31.642 INFO:tasks.workunit.client.0.smithi049.stdout:7/976: dread d3/dd8/d13/d54/f55 [0,4194304] 0 2024-06-03T00:03:31.642 INFO:tasks.workunit.client.0.smithi049.stdout:0/940: dread d6/d29/f8b [0,4194304] 0 2024-06-03T00:03:31.642 INFO:tasks.workunit.client.0.smithi049.stdout:7/977: truncate d3/dd8/d13/d3c/d4b/d5a/ff1 530247 0 2024-06-03T00:03:31.642 INFO:tasks.workunit.client.0.smithi049.stdout:0/941: mkdir d6/dd7/d112/d135 0 2024-06-03T00:03:31.643 INFO:tasks.workunit.client.0.smithi049.stdout:7/978: chown d3/dd8/d13/d3c/d48/l85 1 1 2024-06-03T00:03:31.644 INFO:tasks.workunit.client.0.smithi049.stdout:0/942: mkdir d6/d59/d93/dcb/d136 0 2024-06-03T00:03:31.644 INFO:tasks.workunit.client.0.smithi049.stdout:0/943: chown d6 2722702 1 2024-06-03T00:03:31.648 INFO:tasks.workunit.client.0.smithi049.stdout:3/927: dwrite d2/d14/d22/f2a [8388608,4194304] 0 2024-06-03T00:03:31.650 INFO:tasks.workunit.client.0.smithi049.stdout:3/928: symlink d2/d1a/d51/d83/l148 0 2024-06-03T00:03:31.651 INFO:tasks.workunit.client.0.smithi049.stdout:3/929: write d2/d1a/d34/dd5/f129 [951452,92727] 0 2024-06-03T00:03:31.654 INFO:tasks.workunit.client.0.smithi049.stdout:3/930: rename d2/d1a/d51/dbe/fff to d2/d1a/d34/dd5/d75/d94/dd1/da0/de3/dee/d10b/f149 0 2024-06-03T00:03:31.654 INFO:tasks.workunit.client.0.smithi049.stdout:3/931: write d2/d14/d22/d42/f118 [133379,58176] 0 2024-06-03T00:03:31.655 INFO:tasks.workunit.client.0.smithi049.stdout:0/944: write d6/d97/f7b [8002266,37716] 0 2024-06-03T00:03:31.656 INFO:tasks.workunit.client.0.smithi049.stdout:3/932: mknod d2/d1a/d51/d83/c14a 0 2024-06-03T00:03:31.659 INFO:tasks.workunit.client.0.smithi049.stdout:3/933: rename d2/d1a/d34/dd5/d75/d94/fc1 to d2/d14/d44/d133/f14b 0 2024-06-03T00:03:31.659 INFO:tasks.workunit.client.0.smithi049.stdout:3/934: mknod d2/d14/d44/d52/d4c/d4b/daf/c14c 0 2024-06-03T00:03:31.660 INFO:tasks.workunit.client.0.smithi049.stdout:3/935: creat d2/d1a/d76/f14d x:0 0 0 2024-06-03T00:03:31.661 INFO:tasks.workunit.client.0.smithi049.stdout:7/979: dwrite d3/dd8/d13/d54/daa/f153 [0,4194304] 0 2024-06-03T00:03:31.668 INFO:tasks.workunit.client.0.smithi049.stdout:7/980: write d3/dd8/d13/d3c/d48/d7b/d5b/fc6 [7346926,66574] 0 2024-06-03T00:03:31.672 INFO:tasks.workunit.client.0.smithi049.stdout:0/945: dwrite d6/d29/dc8/d52/f5c [4194304,4194304] 0 2024-06-03T00:03:31.673 INFO:tasks.workunit.client.0.smithi049.stdout:7/981: write d3/dd8/d13/d79/d114/d12f/fb0 [3813231,130535] 0 2024-06-03T00:03:31.673 INFO:tasks.workunit.client.0.smithi049.stdout:7/982: chown d3/dd8/d13/d3c/d110/d140 12 1 2024-06-03T00:03:31.673 INFO:tasks.workunit.client.0.smithi049.stdout:7/983: write d3/dd8/d13/d54/daa/fd4 [455474,121970] 0 2024-06-03T00:03:31.675 INFO:tasks.workunit.client.0.smithi049.stdout:7/984: link d3/dd8/d13/f94 d3/dd8/d13/d3c/d110/d140/df6/d116/f15b 0 2024-06-03T00:03:31.675 INFO:tasks.workunit.client.0.smithi049.stdout:0/946: mknod d6/d30/da3/c137 0 2024-06-03T00:03:31.676 INFO:tasks.workunit.client.0.smithi049.stdout:0/947: rmdir d6/d29/dc8/d52/d96 39 2024-06-03T00:03:31.677 INFO:tasks.workunit.client.0.smithi049.stdout:0/948: symlink d6/d30/d32/dca/l138 0 2024-06-03T00:03:31.677 INFO:tasks.workunit.client.0.smithi049.stdout:0/949: fdatasync d6/f12c 0 2024-06-03T00:03:31.678 INFO:tasks.workunit.client.0.smithi049.stdout:3/936: dwrite d2/d14/d44/d52/d4c/d4b/fb5 [0,4194304] 0 2024-06-03T00:03:31.682 INFO:tasks.workunit.client.0.smithi049.stdout:0/950: dread d6/fb2 [0,4194304] 0 2024-06-03T00:03:31.682 INFO:tasks.workunit.client.0.smithi049.stdout:0/951: chown d6/d59/ff8 2 1 2024-06-03T00:03:31.682 INFO:tasks.workunit.client.0.smithi049.stdout:0/952: getdents d6/d29/dc8/d52/d96/dfb 0 2024-06-03T00:03:31.684 INFO:tasks.workunit.client.0.smithi049.stdout:0/953: mknod d6/d30/c139 0 2024-06-03T00:03:31.685 INFO:tasks.workunit.client.0.smithi049.stdout:7/985: dread d3/dd8/d9/d91/f155 [0,4194304] 0 2024-06-03T00:03:31.686 INFO:tasks.workunit.client.0.smithi049.stdout:7/986: mknod d3/dd8/d13/d3c/d48/d112/c15c 0 2024-06-03T00:03:31.689 INFO:tasks.workunit.client.0.smithi049.stdout:7/987: rename d3/d32/f14a to d3/d14/f15d 0 2024-06-03T00:03:31.691 INFO:tasks.workunit.client.0.smithi049.stdout:7/988: rename d3/cbf to d3/dd8/d9/d91/c15e 0 2024-06-03T00:03:31.693 INFO:tasks.workunit.client.0.smithi049.stdout:0/954: dread d6/d30/da3/fab [0,4194304] 0 2024-06-03T00:03:31.693 INFO:tasks.workunit.client.0.smithi049.stdout:0/955: write d6/d30/f83 [2595170,129834] 0 2024-06-03T00:03:31.693 INFO:tasks.workunit.client.0.smithi049.stdout:0/956: dread - d6/d59/d93/db4/fdd zero size 2024-06-03T00:03:31.701 INFO:tasks.workunit.client.0.smithi049.stdout:0/957: dread d6/d29/dc8/d52/f81 [0,4194304] 0 2024-06-03T00:03:31.701 INFO:tasks.workunit.client.0.smithi049.stdout:0/958: dread - d6/d97/d10a/f129 zero size 2024-06-03T00:03:31.701 INFO:tasks.workunit.client.0.smithi049.stdout:0/959: chown d6/d97/d4b/d67/ff5 18 1 2024-06-03T00:03:31.701 INFO:tasks.workunit.client.0.smithi049.stdout:0/960: read - d6/d29/dc8/d10d/f12a zero size 2024-06-03T00:03:31.708 INFO:tasks.workunit.client.0.smithi049.stdout:3/937: dwrite d2/d14/d44/d52/d4c/d4b/d98/f71 [0,4194304] 0 2024-06-03T00:03:31.708 INFO:tasks.workunit.client.0.smithi049.stdout:7/989: dwrite d3/dd8/d13/d3c/d110/d140/df6/d116/f125 [0,4194304] 0 2024-06-03T00:03:31.710 INFO:tasks.workunit.client.0.smithi049.stdout:3/938: symlink d2/d1a/d76/df6/l14e 0 2024-06-03T00:03:31.710 INFO:tasks.workunit.client.0.smithi049.stdout:3/939: readlink d2/d14/d44/d52/d4c/lf9 0 2024-06-03T00:03:31.710 INFO:tasks.workunit.client.0.smithi049.stdout:7/990: truncate d3/dd8/d13/d3c/d110/d140/f51 493260 0 2024-06-03T00:03:31.711 INFO:tasks.workunit.client.0.smithi049.stdout:3/940: creat d2/d1a/d51/dbe/f14f x:0 0 0 2024-06-03T00:03:31.711 INFO:tasks.workunit.client.0.smithi049.stdout:7/991: symlink d3/dd8/d13/d3c/d48/d11d/l15f 0 2024-06-03T00:03:31.713 INFO:tasks.workunit.client.0.smithi049.stdout:7/992: symlink d3/dd8/d9/d91/l160 0 2024-06-03T00:03:31.713 INFO:tasks.workunit.client.0.smithi049.stdout:7/993: write d3/d32/d95/f136 [208359,9677] 0 2024-06-03T00:03:31.713 INFO:tasks.workunit.client.0.smithi049.stdout:7/994: fsync d3/d14/fde 0 2024-06-03T00:03:31.714 INFO:tasks.workunit.client.0.smithi049.stdout:0/961: write d6/d30/fe2 [489729,96792] 0 2024-06-03T00:03:31.714 INFO:tasks.workunit.client.0.smithi049.stdout:7/995: unlink d3/d14/d6e/f103 0 2024-06-03T00:03:31.715 INFO:tasks.workunit.client.0.smithi049.stdout:0/962: creat d6/d59/d93/dcb/d136/f13a x:0 0 0 2024-06-03T00:03:31.717 INFO:tasks.workunit.client.0.smithi049.stdout:0/963: rename d6/d30/lee to d6/d30/da3/l13b 0 2024-06-03T00:03:31.717 INFO:tasks.workunit.client.0.smithi049.stdout:0/964: rmdir d6/d29/dc8/d52 39 2024-06-03T00:03:31.726 INFO:tasks.workunit.client.0.smithi049.stdout:3/941: dwrite d2/d1a/f1d [4194304,4194304] 0 2024-06-03T00:03:31.728 INFO:tasks.workunit.client.0.smithi049.stdout:0/965: write d6/d29/dc8/d52/f91 [128380,123271] 0 2024-06-03T00:03:31.735 INFO:tasks.workunit.client.0.smithi049.stdout:7/996: dwrite d3/dd8/d86/d90/dae/f13a [0,4194304] 0 2024-06-03T00:03:31.737 INFO:tasks.workunit.client.0.smithi049.stdout:7/997: dread - d3/dd8/d13/d3c/d48/d7b/f102 zero size 2024-06-03T00:03:31.737 INFO:tasks.workunit.client.0.smithi049.stdout:7/998: write d3/d14/d6e/f15a [283493,68187] 0 2024-06-03T00:03:31.744 INFO:tasks.workunit.client.0.smithi049.stdout:3/942: dwrite d2/d14/d22/d42/d8f/fb4 [0,4194304] 0 2024-06-03T00:03:31.744 INFO:tasks.workunit.client.0.smithi049.stdout:3/943: chown d2/d14/d44/l128 466 1 2024-06-03T00:03:31.745 INFO:tasks.workunit.client.0.smithi049.stdout:7/999: dread d3/d14/d6e/f13d [0,4194304] 0 2024-06-03T00:03:31.747 INFO:tasks.workunit.client.0.smithi049.stdout:3/944: rename d2/d1a/d51/d83/cef to d2/d14/d22/d42/d8f/c150 0 2024-06-03T00:03:31.747 INFO:tasks.workunit.client.0.smithi049.stdout:3/945: fsync d2/d14/d44/d52/d4c/d4b/d98/f119 0 2024-06-03T00:03:31.747 INFO:tasks.workunit.client.0.smithi049.stdout:3/946: chown d2/d14/d22 127388018 1 2024-06-03T00:03:31.748 INFO:tasks.workunit.client.0.smithi049.stdout:3/947: link d2/d14/d44/d52/d4c/cdd d2/d1a/d34/dd5/d75/d94/dd1/da0/de3/dee/d10b/c151 0 2024-06-03T00:03:31.748 INFO:tasks.workunit.client.0.smithi049.stdout:3/948: fdatasync d2/d1a/f73 0 2024-06-03T00:03:31.749 INFO:tasks.workunit.client.0.smithi049.stdout:3/949: creat d2/d14/d22/d42/d68/f152 x:0 0 0 2024-06-03T00:03:31.749 INFO:tasks.workunit.client.0.smithi049.stdout:3/950: chown d2/d1a/d34/dd5/d75/d94/dd1/db6/fd6 2 1 2024-06-03T00:03:31.762 INFO:tasks.workunit.client.0.smithi049.stdout:3/951: write d2/d14/fc7 [1939318,49211] 0 2024-06-03T00:03:31.763 INFO:tasks.workunit.client.0.smithi049.stdout:3/952: creat d2/d14/d44/d52/d4c/d4b/f153 x:0 0 0 2024-06-03T00:03:31.763 INFO:tasks.workunit.client.0.smithi049.stdout:3/953: write d2/d1a/f140 [804589,80687] 0 2024-06-03T00:03:31.763 INFO:tasks.workunit.client.0.smithi049.stdout:3/954: chown d2/f11 17005923 1 2024-06-03T00:03:31.764 INFO:tasks.workunit.client.0.smithi049.stdout:3/955: creat d2/d1a/d34/dd5/d75/d94/f154 x:0 0 0 2024-06-03T00:03:31.765 INFO:tasks.workunit.client.0.smithi049.stdout:3/956: creat d2/d1a/d51/d83/f155 x:0 0 0 2024-06-03T00:03:31.766 INFO:tasks.workunit.client.0.smithi049.stdout:3/957: link d2/d14/d44/fb8 d2/d1a/d76/f156 0 2024-06-03T00:03:31.768 INFO:tasks.workunit.client.0.smithi049.stdout:3/958: mknod d2/d14/d22/d42/d8f/c157 0 2024-06-03T00:03:31.769 INFO:tasks.workunit.client.0.smithi049.stdout:3/959: write d2/d14/d44/fb8 [524698,105364] 0 2024-06-03T00:03:31.769 INFO:tasks.workunit.client.0.smithi049.stdout:3/960: truncate d2/d1a/d51/fdb 844180 0 2024-06-03T00:03:31.770 INFO:tasks.workunit.client.0.smithi049.stdout:3/961: mknod d2/d1a/d34/dd5/d75/d10e/c158 0 2024-06-03T00:03:31.771 INFO:tasks.workunit.client.0.smithi049.stdout:3/962: creat d2/d1a/d34/de9/f159 x:0 0 0 2024-06-03T00:03:31.771 INFO:tasks.workunit.client.0.smithi049.stdout:3/963: stat d2/d14/d22/d42/d68/d80/l86 0 2024-06-03T00:03:31.773 INFO:tasks.workunit.client.0.smithi049.stdout:3/964: unlink d2/d1a/d76/fbb 0 2024-06-03T00:03:31.773 INFO:tasks.workunit.client.0.smithi049.stdout:3/965: read d2/d14/d22/f9a [206890,43487] 0 2024-06-03T00:03:31.774 INFO:tasks.workunit.client.0.smithi049.stdout:3/966: creat d2/d1a/f15a x:0 0 0 2024-06-03T00:03:31.775 INFO:tasks.workunit.client.0.smithi049.stdout:3/967: mkdir d2/d1a/d34/dd5/d75/d94/dd1/d15b 0 2024-06-03T00:03:31.776 INFO:tasks.workunit.client.0.smithi049.stdout:3/968: creat d2/d1a/f15c x:0 0 0 2024-06-03T00:03:31.776 INFO:tasks.workunit.client.0.smithi049.stdout:3/969: fdatasync d2/d1a/d34/dd5/f5f 0 2024-06-03T00:03:31.799 INFO:tasks.workunit.client.0.smithi049.stdout:3/970: dwrite d2/d14/d44/d52/d4c/d4b/fcc [4194304,4194304] 0 2024-06-03T00:03:31.800 INFO:tasks.workunit.client.0.smithi049.stdout:3/971: creat d2/d1a/d34/dd5/d75/d94/dd1/da0/f15d x:0 0 0 2024-06-03T00:03:31.818 INFO:tasks.workunit.client.0.smithi049.stdout:3/972: write d2/d1a/d34/dd5/d75/d94/d9e/fb2 [5747837,18729] 0 2024-06-03T00:03:31.819 INFO:tasks.workunit.client.0.smithi049.stdout:3/973: chown d2/d1a/d34/dd5/d75/ce6 15 1 2024-06-03T00:03:31.819 INFO:tasks.workunit.client.0.smithi049.stdout:3/974: dread - d2/d14/f2e zero size 2024-06-03T00:03:31.820 INFO:tasks.workunit.client.0.smithi049.stdout:3/975: rmdir d2/d14/d22/d3a 39 2024-06-03T00:03:31.824 INFO:tasks.workunit.client.0.smithi049.stdout:8/860: sync 2024-06-03T00:03:31.824 INFO:tasks.workunit.client.0.smithi049.stdout:8/861: read - d4/d27/d3c/d43/d6b/fe1 zero size 2024-06-03T00:03:31.824 INFO:tasks.workunit.client.0.smithi049.stdout:8/862: chown d4/d27/d3c/d43/d6b/d10f 223093 1 2024-06-03T00:03:31.824 INFO:tasks.workunit.client.0.smithi049.stdout:8/863: dread - d4/d27/f115 zero size 2024-06-03T00:03:31.825 INFO:tasks.workunit.client.0.smithi049.stdout:3/976: dread d2/d1a/d34/f5e [0,4194304] 0 2024-06-03T00:03:31.825 INFO:tasks.workunit.client.0.smithi049.stdout:3/977: fdatasync d2/d14/d22/f2a 0 2024-06-03T00:03:31.829 INFO:tasks.workunit.client.0.smithi049.stdout:8/864: dread d4/d27/d3c/d88/f14 [0,4194304] 0 2024-06-03T00:03:31.831 INFO:tasks.workunit.client.0.smithi049.stdout:8/865: symlink d4/l12e 0 2024-06-03T00:03:31.842 INFO:tasks.workunit.client.0.smithi049.stdout:8/866: dwrite d4/d27/d3c/d88/d28/d52/f10b [0,4194304] 0 2024-06-03T00:03:31.842 INFO:tasks.workunit.client.0.smithi049.stdout:8/867: chown d4/d27/ce8 0 1 2024-06-03T00:03:31.845 INFO:tasks.workunit.client.0.smithi049.stdout:8/868: mknod d4/d27/d30/c12f 0 2024-06-03T00:03:31.846 INFO:tasks.workunit.client.0.smithi049.stdout:8/869: readlink d4/d27/d3c/d88/l97 0 2024-06-03T00:03:31.848 INFO:tasks.workunit.client.0.smithi049.stdout:8/870: truncate d4/d27/d3c/d88/d28/d2b/d84/fa2 2875925 0 2024-06-03T00:03:31.852 INFO:tasks.workunit.client.0.smithi049.stdout:8/871: rename d4/d27/d3c/d88/d28/d52/d66/d53/f40 to d4/d27/d3c/d43/d6b/da6/de3/f130 0 2024-06-03T00:03:31.852 INFO:tasks.workunit.client.0.smithi049.stdout:8/872: write d4/d27/d3c/d88/d28/d52/f76 [1062114,84029] 0 2024-06-03T00:03:31.852 INFO:tasks.workunit.client.0.smithi049.stdout:8/873: truncate d4/d27/d3c/d88/f91 5066866 0 2024-06-03T00:03:31.852 INFO:tasks.workunit.client.0.smithi049.stdout:8/874: write d4/d27/d3c/d88/d28/d52/d66/d53/d7e/f64 [593023,2573] 0 2024-06-03T00:03:31.853 INFO:tasks.workunit.client.0.smithi049.stdout:8/875: rmdir d4/d27/d3c/d43 39 2024-06-03T00:03:31.854 INFO:tasks.workunit.client.0.smithi049.stdout:8/876: mknod d4/d27/d3c/d88/d48/dde/c131 0 2024-06-03T00:03:31.857 INFO:tasks.workunit.client.0.smithi049.stdout:8/877: rename d4/d27/d3c/d88/d28/d52/ldb to d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/dab/d114/l132 0 2024-06-03T00:03:31.860 INFO:tasks.workunit.client.0.smithi049.stdout:8/878: rename d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/dab/cb2 to d4/d27/d3c/d88/d28/d52/d66/c133 0 2024-06-03T00:03:31.862 INFO:tasks.workunit.client.0.smithi049.stdout:8/879: mkdir d4/d27/d3c/d43/d6b/da6/d134 0 2024-06-03T00:03:31.881 INFO:tasks.workunit.client.0.smithi049.stdout:8/880: dwrite d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/fbe [0,4194304] 0 2024-06-03T00:03:31.893 INFO:tasks.workunit.client.0.smithi049.stdout:8/881: dwrite d4/d27/d3c/d88/d28/d52/f10b [0,4194304] 0 2024-06-03T00:03:31.902 INFO:tasks.workunit.client.0.smithi049.stdout:8/882: write d4/d27/d3c/d88/f11 [1104274,113794] 0 2024-06-03T00:03:31.904 INFO:tasks.workunit.client.0.smithi049.stdout:8/883: write d4/d27/d3c/d88/d28/d52/d66/d12d/fd4 [243416,114334] 0 2024-06-03T00:03:31.905 INFO:tasks.workunit.client.0.smithi049.stdout:8/884: creat d4/d27/d3c/d88/d28/d52/d66/d53/d7e/f135 x:0 0 0 2024-06-03T00:03:31.905 INFO:tasks.workunit.client.0.smithi049.stdout:8/885: dread - d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/dab/f103 zero size 2024-06-03T00:03:31.907 INFO:tasks.workunit.client.0.smithi049.stdout:8/886: rename d4/d27/d3c/d88/d4d/f95 to d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/da9/dd9/f136 0 2024-06-03T00:03:31.908 INFO:tasks.workunit.client.0.smithi049.stdout:8/887: chown d4/d27/d3c/d88/d28/d45/f92 42 1 2024-06-03T00:03:31.911 INFO:tasks.workunit.client.0.smithi049.stdout:8/888: truncate d4/d27/d3c/d88/d28/f46 1663314 0 2024-06-03T00:03:31.911 INFO:tasks.workunit.client.0.smithi049.stdout:8/889: write d4/d27/fed [108717,32085] 0 2024-06-03T00:03:31.911 INFO:tasks.workunit.client.0.smithi049.stdout:8/890: readlink d4/lc3 0 2024-06-03T00:03:31.911 INFO:tasks.workunit.client.0.smithi049.stdout:8/891: fsync d4/f6e 0 2024-06-03T00:03:31.912 INFO:tasks.workunit.client.0.smithi049.stdout:8/892: write d4/f9d [4367762,54013] 0 2024-06-03T00:03:31.914 INFO:tasks.workunit.client.0.smithi049.stdout:8/893: getdents d4/d27/d30 0 2024-06-03T00:03:31.915 INFO:tasks.workunit.client.0.smithi049.stdout:8/894: creat d4/d27/d30/dfd/f137 x:0 0 0 2024-06-03T00:03:31.916 INFO:tasks.workunit.client.0.smithi049.stdout:8/895: mknod d4/d27/d3c/d88/d28/d2b/c138 0 2024-06-03T00:03:31.916 INFO:tasks.workunit.client.0.smithi049.stdout:8/896: dread - d4/d27/f115 zero size 2024-06-03T00:03:31.917 INFO:tasks.workunit.client.0.smithi049.stdout:8/897: link d4/d27/d30/f41 d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/dab/f139 0 2024-06-03T00:03:31.917 INFO:tasks.workunit.client.0.smithi049.stdout:3/978: sync 2024-06-03T00:03:31.917 INFO:tasks.workunit.client.0.smithi049.stdout:0/966: sync 2024-06-03T00:03:31.918 INFO:tasks.workunit.client.0.smithi049.stdout:8/898: mknod d4/d27/d3c/d88/d28/d52/d66/d53/d6c/dda/c13a 0 2024-06-03T00:03:31.918 INFO:tasks.workunit.client.0.smithi049.stdout:0/967: mknod d6/d97/d4b/c13c 0 2024-06-03T00:03:31.919 INFO:tasks.workunit.client.0.smithi049.stdout:8/899: creat d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/dab/d114/f13b x:0 0 0 2024-06-03T00:03:31.920 INFO:tasks.workunit.client.0.smithi049.stdout:8/900: dread - d4/d27/d3c/d88/d48/dde/ff1 zero size 2024-06-03T00:03:31.920 INFO:tasks.workunit.client.0.smithi049.stdout:0/968: link d6/d97/f50 d6/d97/d4b/f13d 0 2024-06-03T00:03:31.920 INFO:tasks.workunit.client.0.smithi049.stdout:3/979: symlink d2/d1a/d76/d95/l15e 0 2024-06-03T00:03:31.920 INFO:tasks.workunit.client.0.smithi049.stdout:0/969: mkdir d6/d97/d4b/d67/d13e 0 2024-06-03T00:03:31.921 INFO:tasks.workunit.client.0.smithi049.stdout:3/980: symlink d2/d1a/d34/de9/l15f 0 2024-06-03T00:03:31.921 INFO:tasks.workunit.client.0.smithi049.stdout:3/981: write d2/d1a/d34/de9/de0/d111/f11e [180664,68091] 0 2024-06-03T00:03:31.925 INFO:tasks.workunit.client.0.smithi049.stdout:3/982: rename d2/d14/d22/d42 to d2/d1a/d34/de9/d160 0 2024-06-03T00:03:31.925 INFO:tasks.workunit.client.0.smithi049.stdout:3/983: fdatasync d2/d1a/d76/d95/d106/f12b 0 2024-06-03T00:03:31.925 INFO:tasks.workunit.client.0.smithi049.stdout:3/984: mkdir d2/d1a/d34/dd5/d75/d161 0 2024-06-03T00:03:31.925 INFO:tasks.workunit.client.0.smithi049.stdout:3/985: dread - d2/d1a/d34/dd5/d75/d94/d9e/d105/f113 zero size 2024-06-03T00:03:31.925 INFO:tasks.workunit.client.0.smithi049.stdout:3/986: dread - d2/d1a/d76/f10d zero size 2024-06-03T00:03:31.942 INFO:tasks.workunit.client.0.smithi049.stdout:8/901: dwrite d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/dab/d114/f13b [0,4194304] 0 2024-06-03T00:03:31.943 INFO:tasks.workunit.client.0.smithi049.stdout:0/970: dwrite d6/dd7/d112/f118 [0,4194304] 0 2024-06-03T00:03:31.944 INFO:tasks.workunit.client.0.smithi049.stdout:3/987: dwrite d2/f125 [0,4194304] 0 2024-06-03T00:03:31.946 INFO:tasks.workunit.client.0.smithi049.stdout:0/971: mkdir d6/d13f 0 2024-06-03T00:03:31.946 INFO:tasks.workunit.client.0.smithi049.stdout:0/972: fsync d6/d59/f117 0 2024-06-03T00:03:31.953 INFO:tasks.workunit.client.0.smithi049.stdout:3/988: dread d2/d1a/f73 [0,4194304] 0 2024-06-03T00:03:31.954 INFO:tasks.workunit.client.0.smithi049.stdout:3/989: write d2/d1a/d51/dbe/fd0 [1055450,117885] 0 2024-06-03T00:03:31.955 INFO:tasks.workunit.client.0.smithi049.stdout:0/973: write d6/d30/d32/dca/f8c [3852478,49668] 0 2024-06-03T00:03:31.955 INFO:tasks.workunit.client.0.smithi049.stdout:8/902: write d4/f9d [720236,19721] 0 2024-06-03T00:03:31.955 INFO:tasks.workunit.client.0.smithi049.stdout:3/990: mknod d2/d14/d44/d52/d4c/d4b/daf/c162 0 2024-06-03T00:03:31.956 INFO:tasks.workunit.client.0.smithi049.stdout:8/903: creat d4/d27/d3c/d88/d28/d2b/d84/f13c x:0 0 0 2024-06-03T00:03:31.957 INFO:tasks.workunit.client.0.smithi049.stdout:3/991: creat d2/d1a/d51/dbe/f163 x:0 0 0 2024-06-03T00:03:31.958 INFO:tasks.workunit.client.0.smithi049.stdout:8/904: mknod d4/d27/d3c/d88/d28/d45/d11d/c13d 0 2024-06-03T00:03:31.958 INFO:tasks.workunit.client.0.smithi049.stdout:8/905: read - d4/d27/d3c/d88/d28/d52/fe9 zero size 2024-06-03T00:03:31.958 INFO:tasks.workunit.client.0.smithi049.stdout:8/906: write d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/fe2 [4540114,127820] 0 2024-06-03T00:03:31.958 INFO:tasks.workunit.client.0.smithi049.stdout:3/992: creat d2/d1a/f164 x:0 0 0 2024-06-03T00:03:31.960 INFO:tasks.workunit.client.0.smithi049.stdout:8/907: creat d4/d27/d3c/d88/d11f/f13e x:0 0 0 2024-06-03T00:03:31.961 INFO:tasks.workunit.client.0.smithi049.stdout:8/908: chown d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d116/lae 40265 1 2024-06-03T00:03:31.963 INFO:tasks.workunit.client.0.smithi049.stdout:8/909: dread d4/d27/d3c/d88/d28/d45/f49 [0,4194304] 0 2024-06-03T00:03:31.963 INFO:tasks.workunit.client.0.smithi049.stdout:8/910: getdents d4/d27/d3c/d43/d6b/d10f/d122 0 2024-06-03T00:03:31.968 INFO:tasks.workunit.client.0.smithi049.stdout:0/974: write d6/d97/f7b [200185,68611] 0 2024-06-03T00:03:31.972 INFO:tasks.workunit.client.0.smithi049.stdout:8/911: dread d4/f73 [0,4194304] 0 2024-06-03T00:03:31.973 INFO:tasks.workunit.client.0.smithi049.stdout:8/912: write d4/d27/d30/fd1 [65895,114063] 0 2024-06-03T00:03:31.973 INFO:tasks.workunit.client.0.smithi049.stdout:8/913: creat d4/d27/d3c/d43/d6b/da6/d11e/f13f x:0 0 0 2024-06-03T00:03:31.975 INFO:tasks.workunit.client.0.smithi049.stdout:3/993: dwrite d2/d1a/d76/de8/ff7 [0,4194304] 0 2024-06-03T00:03:31.975 INFO:tasks.workunit.client.0.smithi049.stdout:3/994: fsync d2/d14/d22/d3a/d47/f92 0 2024-06-03T00:03:31.976 INFO:tasks.workunit.client.0.smithi049.stdout:3/995: write d2/d14/fc7 [3226396,110478] 0 2024-06-03T00:03:31.976 INFO:tasks.workunit.client.0.smithi049.stdout:3/996: write d2/d1a/f65 [3308556,84007] 0 2024-06-03T00:03:31.976 INFO:tasks.workunit.client.0.smithi049.stdout:0/975: dread d6/d29/fc6 [0,4194304] 0 2024-06-03T00:03:31.976 INFO:tasks.workunit.client.0.smithi049.stdout:3/997: fsync d2/f39 0 2024-06-03T00:03:31.979 INFO:tasks.workunit.client.0.smithi049.stdout:3/998: unlink d2/d14/d44/d52/d4c/f30 0 2024-06-03T00:03:31.979 INFO:tasks.workunit.client.0.smithi049.stdout:0/976: creat d6/d29/dc8/d52/d96/f140 x:0 0 0 2024-06-03T00:03:31.979 INFO:tasks.workunit.client.0.smithi049.stdout:0/977: getdents d6/d13f 0 2024-06-03T00:03:31.979 INFO:tasks.workunit.client.0.smithi049.stdout:0/978: write d6/d30/f126 [806661,43052] 0 2024-06-03T00:03:31.979 INFO:tasks.workunit.client.0.smithi049.stdout:0/979: fsync f4 0 2024-06-03T00:03:31.980 INFO:tasks.workunit.client.0.smithi049.stdout:3/999: unlink d2/d1a/d34/f62 0 2024-06-03T00:03:31.981 INFO:tasks.workunit.client.0.smithi049.stdout:0/980: mkdir d6/d29/d141 0 2024-06-03T00:03:31.989 INFO:tasks.workunit.client.0.smithi049.stdout:8/914: dwrite d4/d27/d3c/f2f [0,4194304] 0 2024-06-03T00:03:31.995 INFO:tasks.workunit.client.0.smithi049.stdout:0/981: write d6/d29/dc8/f6d [535684,22965] 0 2024-06-03T00:03:31.996 INFO:tasks.workunit.client.0.smithi049.stdout:0/982: write d6/d59/d93/f99 [646422,78460] 0 2024-06-03T00:03:31.996 INFO:tasks.workunit.client.0.smithi049.stdout:0/983: chown d6/d59/d93/cf1 1326717 1 2024-06-03T00:03:31.996 INFO:tasks.workunit.client.0.smithi049.stdout:0/984: chown d6/d29 0 1 2024-06-03T00:03:32.006 INFO:tasks.workunit.client.0.smithi049.stdout:8/915: dwrite d4/d27/d3c/d88/d28/d45/f92 [0,4194304] 0 2024-06-03T00:03:32.008 INFO:tasks.workunit.client.0.smithi049.stdout:8/916: rename d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/dab to d4/d27/d30/d140 0 2024-06-03T00:03:32.010 INFO:tasks.workunit.client.0.smithi049.stdout:8/917: creat d4/d27/d30/d140/f141 x:0 0 0 2024-06-03T00:03:32.010 INFO:tasks.workunit.client.0.smithi049.stdout:8/918: dread - d4/d27/d3c/d88/d28/d52/d66/d53/d7e/f135 zero size 2024-06-03T00:03:32.011 INFO:tasks.workunit.client.0.smithi049.stdout:8/919: fsync d4/d27/fc1 0 2024-06-03T00:03:32.011 INFO:tasks.workunit.client.0.smithi049.stdout:8/920: stat d4/d27/d3c/d88/fd3 0 2024-06-03T00:03:32.011 INFO:tasks.workunit.client.0.smithi049.stdout:8/921: rename d4/d27/d3c/d43/d6b to d4/d27/d3c/d43/d6b/da6/de3/d142 22 2024-06-03T00:03:32.013 INFO:tasks.workunit.client.0.smithi049.stdout:8/922: mknod d4/d27/c143 0 2024-06-03T00:03:32.016 INFO:tasks.workunit.client.0.smithi049.stdout:0/985: dwrite d6/d30/f126 [0,4194304] 0 2024-06-03T00:03:32.016 INFO:tasks.workunit.client.0.smithi049.stdout:8/923: symlink d4/d27/d3c/d88/d28/d52/d66/d53/d7e/l144 0 2024-06-03T00:03:32.017 INFO:tasks.workunit.client.0.smithi049.stdout:0/986: creat d6/d30/d32/dca/f142 x:0 0 0 2024-06-03T00:03:32.019 INFO:tasks.workunit.client.0.smithi049.stdout:0/987: dread d6/d97/d4b/fd5 [0,4194304] 0 2024-06-03T00:03:32.019 INFO:tasks.workunit.client.0.smithi049.stdout:8/924: mknod d4/d27/d3c/d88/d28/d52/d66/d53/c145 0 2024-06-03T00:03:32.020 INFO:tasks.workunit.client.0.smithi049.stdout:0/988: symlink d6/d59/d72/l143 0 2024-06-03T00:03:32.021 INFO:tasks.workunit.client.0.smithi049.stdout:8/925: getdents d4/d27/d3c/d88/d28/d45 0 2024-06-03T00:03:32.021 INFO:tasks.workunit.client.0.smithi049.stdout:0/989: creat d6/dd7/d11e/f144 x:0 0 0 2024-06-03T00:03:32.022 INFO:tasks.workunit.client.0.smithi049.stdout:0/990: rmdir d6/d97/d4b 39 2024-06-03T00:03:32.049 INFO:tasks.workunit.client.0.smithi049.stdout:8/926: dwrite d4/d27/d3c/d88/d4d/f110 [0,4194304] 0 2024-06-03T00:03:32.050 INFO:tasks.workunit.client.0.smithi049.stdout:0/991: dwrite d6/d97/d10a/f129 [0,4194304] 0 2024-06-03T00:03:32.050 INFO:tasks.workunit.client.0.smithi049.stdout:0/992: rename d6/dd7/d112/d135 to d6/d30/d32/d145 0 2024-06-03T00:03:32.054 INFO:tasks.workunit.client.0.smithi049.stdout:0/993: rename d6/d30/d32/dca/f8c to d6/d59/d93/db4/f146 0 2024-06-03T00:03:32.058 INFO:tasks.workunit.client.0.smithi049.stdout:0/994: rename d6/d29/dc8/c41 to d6/d29/dc8/d52/d96/c147 0 2024-06-03T00:03:32.058 INFO:tasks.workunit.client.0.smithi049.stdout:0/995: truncate d6/d30/d32/dca/fcc 2066487 0 2024-06-03T00:03:32.058 INFO:tasks.workunit.client.0.smithi049.stdout:0/996: rmdir d6/d29/dc8/d52/deb 39 2024-06-03T00:03:32.059 INFO:tasks.workunit.client.0.smithi049.stdout:0/997: unlink d6/d30/f5a 0 2024-06-03T00:03:32.059 INFO:tasks.workunit.client.0.smithi049.stdout:0/998: stat d6/d30/c139 0 2024-06-03T00:03:32.063 INFO:tasks.workunit.client.0.smithi049.stdout:8/927: dwrite d4/d27/d30/d140/fb6 [4194304,4194304] 0 2024-06-03T00:03:32.064 INFO:tasks.workunit.client.0.smithi049.stdout:8/928: getdents d4/d27/d3c/d88/d28/d45 0 2024-06-03T00:03:32.067 INFO:tasks.workunit.client.0.smithi049.stdout:0/999: read d6/d29/dc8/f70 [2285984,5890] 0 2024-06-03T00:03:32.079 INFO:tasks.workunit.client.0.smithi049.stdout:8/929: dwrite d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d116/fe5 [0,4194304] 0 2024-06-03T00:03:32.081 INFO:tasks.workunit.client.0.smithi049.stdout:8/930: rmdir d4/d27 39 2024-06-03T00:03:32.085 INFO:tasks.workunit.client.0.smithi049.stdout:8/931: dread d4/d27/d3c/d88/d28/d25/f9f [0,4194304] 0 2024-06-03T00:03:32.086 INFO:tasks.workunit.client.0.smithi049.stdout:8/932: mknod d4/d27/d3c/d88/d10c/c146 0 2024-06-03T00:03:32.086 INFO:tasks.workunit.client.0.smithi049.stdout:8/933: stat d4/d27/d3c/d88/d28/d2b/c138 0 2024-06-03T00:03:32.086 INFO:tasks.workunit.client.0.smithi049.stdout:8/934: readlink d4/d27/d3c/d88/d48/ldd 0 2024-06-03T00:03:32.088 INFO:tasks.workunit.client.0.smithi049.stdout:8/935: dread d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/da9/faa [0,4194304] 0 2024-06-03T00:03:32.089 INFO:tasks.workunit.client.0.smithi049.stdout:8/936: symlink d4/d27/d3c/d88/d4d/l147 0 2024-06-03T00:03:32.091 INFO:tasks.workunit.client.0.smithi049.stdout:8/937: link d4/d27/c111 d4/d27/d3c/d43/c148 0 2024-06-03T00:03:32.092 INFO:tasks.workunit.client.0.smithi049.stdout:8/938: rename d4/d27/d3c/d88/d28/d25/f57 to d4/d27/d3c/d43/d6b/da6/d11e/f149 0 2024-06-03T00:03:32.111 INFO:tasks.workunit.client.0.smithi049.stdout:8/939: dwrite d4/d27/d3c/d43/fcd [0,4194304] 0 2024-06-03T00:03:32.115 INFO:tasks.workunit.client.0.smithi049.stdout:8/940: rename d4/d27/d3c/d88/d28/d52/d66/lca to d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/l14a 0 2024-06-03T00:03:32.116 INFO:tasks.workunit.client.0.smithi049.stdout:8/941: link d4/d27/d30/dfd/f137 d4/d27/d3c/d88/d28/d52/d66/d12d/f14b 0 2024-06-03T00:03:32.117 INFO:tasks.workunit.client.0.smithi049.stdout:8/942: symlink d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/da9/dd9/l14c 0 2024-06-03T00:03:32.118 INFO:tasks.workunit.client.0.smithi049.stdout:8/943: read d4/d27/d3c/d88/f1b [1579918,107076] 0 2024-06-03T00:03:32.118 INFO:tasks.workunit.client.0.smithi049.stdout:8/944: chown d4/d27/d3c/d88/d28/d52/d66/d12d 1012033 1 2024-06-03T00:03:32.118 INFO:tasks.workunit.client.0.smithi049.stdout:8/945: chown d4/d27/d3c/d88/d28/d52/d66/d53 7438 1 2024-06-03T00:03:32.118 INFO:tasks.workunit.client.0.smithi049.stdout:8/946: dread - d4/d27/d3c/d88/d48/dde/ff1 zero size 2024-06-03T00:03:32.119 INFO:tasks.workunit.client.0.smithi049.stdout:8/947: getdents d4/d27/d3c/d88/d28/d25 0 2024-06-03T00:03:32.121 INFO:tasks.workunit.client.0.smithi049.stdout:8/948: rename d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/fe2 to d4/d27/d3c/d43/d6b/d10f/d122/f14d 0 2024-06-03T00:03:32.138 INFO:tasks.workunit.client.0.smithi049.stdout:8/949: dwrite d4/d27/d3c/d88/d28/d52/d66/d53/d7e/f135 [0,4194304] 0 2024-06-03T00:03:32.138 INFO:tasks.workunit.client.0.smithi049.stdout:8/950: write d4/d27/d3c/d88/d28/d25/f9f [571838,37174] 0 2024-06-03T00:03:32.138 INFO:tasks.workunit.client.0.smithi049.stdout:8/951: stat d4/d27/d3c/d88/l59 0 2024-06-03T00:03:32.138 INFO:tasks.workunit.client.0.smithi049.stdout:8/952: fsync d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/da9/dd9/f136 0 2024-06-03T00:03:32.139 INFO:tasks.workunit.client.0.smithi049.stdout:8/953: mkdir d4/d27/d3c/d88/d28/d52/d66/d14e 0 2024-06-03T00:03:32.147 INFO:tasks.workunit.client.0.smithi049.stdout:8/954: dread d4/d27/d3c/d88/f1b [0,4194304] 0 2024-06-03T00:03:32.147 INFO:tasks.workunit.client.0.smithi049.stdout:8/955: dread - d4/d27/d30/d140/f103 zero size 2024-06-03T00:03:32.147 INFO:tasks.workunit.client.0.smithi049.stdout:8/956: truncate d4/d27/d3c/d88/d28/d45/f12a 481064 0 2024-06-03T00:03:32.148 INFO:tasks.workunit.client.0.smithi049.stdout:8/957: getdents d4/d27/d3c/d88/d28/d52/d66/d12d 0 2024-06-03T00:03:32.148 INFO:tasks.workunit.client.0.smithi049.stdout:8/958: chown d4/d27/d3c/d88/d28/d52/d66/d53/d6c/fc9 447 1 2024-06-03T00:03:32.148 INFO:tasks.workunit.client.0.smithi049.stdout:8/959: creat d4/d27/d3c/d88/d28/d52/d66/f14f x:0 0 0 2024-06-03T00:03:32.159 INFO:tasks.workunit.client.0.smithi049.stdout:8/960: dwrite d4/d27/d3c/d88/d28/f36 [4194304,4194304] 0 2024-06-03T00:03:32.160 INFO:tasks.workunit.client.0.smithi049.stdout:8/961: readlink d4/d10d/l113 0 2024-06-03T00:03:32.161 INFO:tasks.workunit.client.0.smithi049.stdout:8/962: dread d4/d27/d3c/d88/d48/fc6 [0,4194304] 0 2024-06-03T00:03:32.164 INFO:tasks.workunit.client.0.smithi049.stdout:8/963: dread d4/d27/d3c/d88/d28/d45/f49 [0,4194304] 0 2024-06-03T00:03:32.172 INFO:tasks.workunit.client.0.smithi049.stdout:8/964: write d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/fbe [1295779,118513] 0 2024-06-03T00:03:32.172 INFO:tasks.workunit.client.0.smithi049.stdout:8/965: fdatasync d4/d27/d3c/d88/d28/d52/d66/d53/d7e/d62/d8a/da9/faa 0 2024-06-03T00:03:32.174 INFO:tasks.workunit.client.0.smithi049.stdout:8/966: truncate d4/d27/d3c/d43/fff 3466919 0 2024-06-03T00:03:32.175 INFO:tasks.workunit.client.0.smithi049.stdout:8/967: link d4/d27/ce8 d4/d27/d30/dfd/c150 0 2024-06-03T00:03:32.177 INFO:tasks.workunit.client.0.smithi049.stdout:8/968: mkdir d4/d27/d30/d140/d151 0 2024-06-03T00:03:32.179 INFO:tasks.workunit.client.0.smithi049.stdout:8/969: creat d4/d27/d3c/d88/f152 x:0 0 0 2024-06-03T00:03:32.179 INFO:tasks.workunit.client.0.smithi049.stdout:8/970: chown d4/d27/d3c/d88/d28/d45/f12a 264174 1 2024-06-03T00:03:32.185 INFO:tasks.workunit.client.0.smithi049.stdout:8/971: dread d4/d27/d3c/d88/d28/d2b/f87 [0,4194304] 0 2024-06-03T00:03:32.185 INFO:tasks.workunit.client.0.smithi049.stdout:8/972: chown d4/d27/d3c/d88/d28/d2b/d84 26325 1 2024-06-03T00:03:32.185 INFO:tasks.workunit.client.0.smithi049.stdout:8/973: chown d4/d27/d3c/d88/d28/d52/fe9 1442278 1 2024-06-03T00:03:32.185 INFO:tasks.workunit.client.0.smithi049.stdout:8/974: truncate d4/d27/d30/dfd/f137 306449 0 2024-06-03T00:03:32.186 INFO:tasks.workunit.client.0.smithi049.stdout:8/975: rmdir d4/d27/d3c/d88/d48/d8f 39 2024-06-03T00:03:32.186 INFO:tasks.workunit.client.0.smithi049.stdout:8/976: read - d4/d27/d30/fcf zero size 2024-06-03T00:03:32.188 INFO:tasks.workunit.client.0.smithi049.stdout:8/977: symlink d4/d27/d3c/d88/d10c/l153 0 2024-06-03T00:03:32.189 INFO:tasks.workunit.client.0.smithi049.stdout:8/978: mknod d4/d27/d30/dfd/c154 0 2024-06-03T00:03:32.191 INFO:tasks.workunit.client.0.smithi049.stdout:8/979: creat d4/d10d/f155 x:0 0 0 2024-06-03T00:03:32.198 INFO:tasks.workunit.client.0.smithi049.stdout:8/980: dread d4/d27/f78 [0,4194304] 0 2024-06-03T00:03:32.200 INFO:tasks.workunit.client.0.smithi049.stdout:8/981: creat d4/d27/d3c/d88/d28/d52/d66/d12d/d11c/f156 x:0 0 0 2024-06-03T00:03:32.201 INFO:tasks.workunit.client.0.smithi049.stdout:8/982: creat d4/d27/d3c/d88/d28/d2b/f157 x:0 0 0 2024-06-03T00:03:32.201 INFO:tasks.workunit.client.0.smithi049.stdout:8/983: fsync d4/d27/d3c/d88/d48/dde/ff1 0 2024-06-03T00:03:32.203 INFO:tasks.workunit.client.0.smithi049.stdout:8/984: mkdir d4/d27/d3c/d43/d6b/da6/d11e/d158 0 2024-06-03T00:03:32.203 INFO:tasks.workunit.client.0.smithi049.stdout:8/985: read d4/d27/d3c/d88/d28/d2b/f87 [1795509,68045] 0 2024-06-03T00:03:32.204 INFO:tasks.workunit.client.0.smithi049.stdout:8/986: creat d4/d27/d3c/d43/d6b/da6/d134/f159 x:0 0 0 2024-06-03T00:03:32.205 INFO:tasks.workunit.client.0.smithi049.stdout:8/987: dread d4/d27/d30/dfd/f137 [0,4194304] 0 2024-06-03T00:03:32.207 INFO:tasks.workunit.client.0.smithi049.stdout:8/988: creat d4/d27/d3c/d88/d4d/f15a x:0 0 0 2024-06-03T00:03:32.209 INFO:tasks.workunit.client.0.smithi049.stdout:8/989: truncate d4/d27/d3c/d88/fd3 565389 0 2024-06-03T00:03:32.210 INFO:tasks.workunit.client.0.smithi049.stdout:8/990: mknod d4/d27/d3c/d43/d6b/da6/d134/c15b 0 2024-06-03T00:03:32.388 INFO:tasks.workunit.client.0.smithi049.stdout:8/991: sync 2024-06-03T00:03:32.403 INFO:tasks.workunit.client.0.smithi049.stdout:8/992: dwrite d4/d27/d3c/d88/d48/fc6 [0,4194304] 0 2024-06-03T00:03:32.409 INFO:tasks.workunit.client.0.smithi049.stdout:8/993: dread d4/d27/d3c/d88/d28/d52/d66/f5a [0,4194304] 0 2024-06-03T00:03:32.411 INFO:tasks.workunit.client.0.smithi049.stdout:8/994: symlink d4/d27/d3c/d43/d6b/l15c 0 2024-06-03T00:03:32.411 INFO:tasks.workunit.client.0.smithi049.stdout:8/995: write d4/d27/d3c/d88/d4d/f104 [464109,9695] 0 2024-06-03T00:03:32.412 INFO:tasks.workunit.client.0.smithi049.stdout:8/996: symlink d4/d27/d3c/d88/d28/d52/d66/d53/d7e/l15d 0 2024-06-03T00:03:32.413 INFO:tasks.workunit.client.0.smithi049.stdout:8/997: mknod d4/d27/d3c/d43/c15e 0 2024-06-03T00:03:32.414 INFO:tasks.workunit.client.0.smithi049.stdout:8/998: symlink d4/d27/d3c/d88/d48/dde/l15f 0 2024-06-03T00:03:32.414 INFO:tasks.workunit.client.0.smithi049.stdout:8/999: read - d4/d27/d3c/d88/d28/d52/d66/d12d/d11c/f156 zero size 2024-06-03T00:03:32.418 INFO:tasks.workunit.client.0.smithi049.stderr:+ rm -rf -- ./tmp.WzP4rFu8KA 2024-06-03T00:03:32.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.949+0000 7fd3372ef700 1 -- 172.21.15.49:0/240408723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd330107b60 msgr2=0x7fd33010e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:32.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.949+0000 7fd3372ef700 1 --2- 172.21.15.49:0/240408723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd330107b60 0x7fd33010e320 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd32800b0d0 tx=0x7fd32800b3e0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.949+0000 7fd3372ef700 1 -- 172.21.15.49:0/240408723 shutdown_connections 2024-06-03T00:03:32.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.949+0000 7fd3372ef700 1 --2- 172.21.15.49:0/240408723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd330107b60 0x7fd33010e320 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.949+0000 7fd3372ef700 1 --2- 172.21.15.49:0/240408723 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd330105330 0x7fd330105710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.949+0000 7fd3372ef700 1 --2- 172.21.15.49:0/240408723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3301071a0 0x7fd330107620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.949+0000 7fd3372ef700 1 -- 172.21.15.49:0/240408723 >> 172.21.15.49:0/240408723 conn(0x7fd3300766b0 msgr2=0x7fd330076ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:32.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.949+0000 7fd3372ef700 1 -- 172.21.15.49:0/240408723 shutdown_connections 2024-06-03T00:03:32.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.949+0000 7fd3372ef700 1 -- 172.21.15.49:0/240408723 wait complete. 2024-06-03T00:03:32.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.950+0000 7fd3372ef700 1 Processor -- start 2024-06-03T00:03:32.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.950+0000 7fd3372ef700 1 -- start start 2024-06-03T00:03:32.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.950+0000 7fd3372ef700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd330105330 0x7fd33019d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:32.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.950+0000 7fd3372ef700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3301071a0 0x7fd33019dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:32.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.950+0000 7fd3372ef700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd330107b60 0x7fd330197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:32.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.950+0000 7fd3372ef700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd330111750 con 0x7fd3301071a0 2024-06-03T00:03:32.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.950+0000 7fd3372ef700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd3301115d0 con 0x7fd330107b60 2024-06-03T00:03:32.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.950+0000 7fd3372ef700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd3301118d0 con 0x7fd330105330 2024-06-03T00:03:32.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.950+0000 7fd33488a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3301071a0 0x7fd33019dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:32.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.950+0000 7fd33488a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3301071a0 0x7fd33019dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48808/0 (socket says 172.21.15.49:48808) 2024-06-03T00:03:32.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.950+0000 7fd33488a700 1 -- 172.21.15.49:0/2195666718 learned_addr learned my addr 172.21.15.49:0/2195666718 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:32.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.951+0000 7fd33508b700 1 --2- 172.21.15.49:0/2195666718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd330105330 0x7fd33019d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:32.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.951+0000 7fd33588c700 1 --2- 172.21.15.49:0/2195666718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd330107b60 0x7fd330197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:32.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.951+0000 7fd33488a700 1 -- 172.21.15.49:0/2195666718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd330105330 msgr2=0x7fd33019d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:32.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.951+0000 7fd33488a700 1 --2- 172.21.15.49:0/2195666718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd330105330 0x7fd33019d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.951+0000 7fd33488a700 1 -- 172.21.15.49:0/2195666718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd330107b60 msgr2=0x7fd330197970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:32.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.951+0000 7fd33488a700 1 --2- 172.21.15.49:0/2195666718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd330107b60 0x7fd330197970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.951+0000 7fd33488a700 1 -- 172.21.15.49:0/2195666718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3301980d0 con 0x7fd3301071a0 2024-06-03T00:03:32.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.951+0000 7fd33488a700 1 --2- 172.21.15.49:0/2195666718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3301071a0 0x7fd33019dca0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd32000e9a0 tx=0x7fd32000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:32.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.951+0000 7fd3267fc700 1 -- 172.21.15.49:0/2195666718 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32000ca10 con 0x7fd3301071a0 2024-06-03T00:03:32.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.951+0000 7fd3267fc700 1 -- 172.21.15.49:0/2195666718 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd32000cbb0 con 0x7fd3301071a0 2024-06-03T00:03:32.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.951+0000 7fd3372ef700 1 -- 172.21.15.49:0/2195666718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3301983c0 con 0x7fd3301071a0 2024-06-03T00:03:32.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.951+0000 7fd3267fc700 1 -- 172.21.15.49:0/2195666718 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd320018680 con 0x7fd3301071a0 2024-06-03T00:03:32.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.951+0000 7fd3372ef700 1 -- 172.21.15.49:0/2195666718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3301a4630 con 0x7fd3301071a0 2024-06-03T00:03:32.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.954+0000 7fd3267fc700 1 -- 172.21.15.49:0/2195666718 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd320010430 con 0x7fd3301071a0 2024-06-03T00:03:32.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.954+0000 7fd3267fc700 1 --2- 172.21.15.49:0/2195666718 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fd31c0a2c20 0x7fd31c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:32.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.954+0000 7fd33508b700 1 --2- 172.21.15.49:0/2195666718 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fd31c0a2c20 0x7fd31c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:32.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.954+0000 7fd3267fc700 1 -- 172.21.15.49:0/2195666718 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fd3200cf2b0 con 0x7fd3301071a0 2024-06-03T00:03:32.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.955+0000 7fd341b72b80 1 Processor -- start 2024-06-03T00:03:32.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.955+0000 7fd33508b700 1 --2- 172.21.15.49:0/2195666718 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fd31c0a2c20 0x7fd31c0a50e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd330106a70 tx=0x7fd32c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:32.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.955+0000 7fd341b72b80 1 -- start start 2024-06-03T00:03:32.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.955+0000 7fd341b72b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55778f2e4640 0x55778f2e4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:32.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.955+0000 7fd341b72b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55778f2e4f60 0x55778f2de9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:32.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.955+0000 7fd341b72b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55778f2def20 0x55778f2df340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:32.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.955+0000 7fd341b72b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55778f230810 con 0x55778f2e4f60 2024-06-03T00:03:32.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.955+0000 7fd341b72b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55778f1d8720 con 0x55778f2e4640 2024-06-03T00:03:32.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.955+0000 7fd341b72b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55778f22c7d0 con 0x55778f2def20 2024-06-03T00:03:32.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.955+0000 7fd33488a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55778f2e4f60 0x55778f2de9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:32.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.955+0000 7fd33508b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55778f2e4640 0x55778f2e4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:32.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.955+0000 7fd33488a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55778f2e4f60 0x55778f2de9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48824/0 (socket says 172.21.15.49:48824) 2024-06-03T00:03:32.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.955+0000 7fd33508b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55778f2e4640 0x55778f2e4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.49:46960/0 (socket says 172.21.15.49:46960) 2024-06-03T00:03:32.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.956+0000 7fd33488a700 1 -- 172.21.15.49:0/3588933677 learned_addr learned my addr 172.21.15.49:0/3588933677 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:32.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.956+0000 7fd33588c700 1 --2- 172.21.15.49:0/3588933677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55778f2def20 0x55778f2df340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:32.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.956+0000 7fd33488a700 1 -- 172.21.15.49:0/3588933677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55778f2def20 msgr2=0x55778f2df340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:32.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.956+0000 7fd33488a700 1 --2- 172.21.15.49:0/3588933677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55778f2def20 0x55778f2df340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.956+0000 7fd33488a700 1 -- 172.21.15.49:0/3588933677 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55778f2e4640 msgr2=0x55778f2e4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:32.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.956+0000 7fd33488a700 1 --2- 172.21.15.49:0/3588933677 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55778f2e4640 0x55778f2e4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.956+0000 7fd33488a700 1 -- 172.21.15.49:0/3588933677 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55778f1cef50 con 0x55778f2e4f60 2024-06-03T00:03:32.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.956+0000 7fd33508b700 1 --2- 172.21.15.49:0/3588933677 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55778f2e4640 0x55778f2e4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:32.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.956+0000 7fd33488a700 1 --2- 172.21.15.49:0/3588933677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55778f2e4f60 0x55778f2de9e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd3200a4250 tx=0x7fd32009c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9db63f59d97b73 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:32.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.956+0000 7fd31b7fe700 1 -- 172.21.15.49:0/3588933677 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3200a4780 con 0x55778f2e4f60 2024-06-03T00:03:32.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.956+0000 7fd31b7fe700 1 -- 172.21.15.49:0/3588933677 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd32000cd60 con 0x55778f2e4f60 2024-06-03T00:03:32.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.956+0000 7fd31b7fe700 1 -- 172.21.15.49:0/3588933677 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32009af60 con 0x55778f2e4f60 2024-06-03T00:03:32.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.957+0000 7fd341b72b80 1 -- 172.21.15.49:0/3588933677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55778f2e4f60 msgr2=0x55778f2de9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:32.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.957+0000 7fd341b72b80 1 --2- 172.21.15.49:0/3588933677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55778f2e4f60 0x55778f2de9e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd3200a4250 tx=0x7fd32009c360 comp rx=0 tx=0).stop 2024-06-03T00:03:32.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.957+0000 7fd341b72b80 1 -- 172.21.15.49:0/3588933677 shutdown_connections 2024-06-03T00:03:32.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.957+0000 7fd341b72b80 1 --2- 172.21.15.49:0/3588933677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55778f2def20 0x55778f2df340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.957+0000 7fd341b72b80 1 --2- 172.21.15.49:0/3588933677 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55778f2e4640 0x55778f2e4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.957+0000 7fd341b72b80 1 --2- 172.21.15.49:0/3588933677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55778f2e4f60 0x55778f2de9e0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.957+0000 7fd341b72b80 1 -- 172.21.15.49:0/3588933677 >> 172.21.15.49:0/3588933677 conn(0x55778f209cc0 msgr2=0x55778f2d9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:32.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.957+0000 7fd341b72b80 1 -- 172.21.15.49:0/3588933677 shutdown_connections 2024-06-03T00:03:32.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.957+0000 7fd341b72b80 1 -- 172.21.15.49:0/3588933677 wait complete. 2024-06-03T00:03:32.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.957+0000 7fd341b72b80 1 -- start start 2024-06-03T00:03:32.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.958+0000 7fd341b72b80 1 Processor -- start 2024-06-03T00:03:32.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.958+0000 7fd341b72b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55778f2def20 0x55778f2ead30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:32.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.958+0000 7fd341b72b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55778f2e4640 0x55778f2e8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:32.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.958+0000 7fd341b72b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55778f2e4f60 0x55778f2e8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:32.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.958+0000 7fd341b72b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55778f2eb970 con 0x55778f2def20 2024-06-03T00:03:32.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.958+0000 7fd341b72b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55778f1d0bf0 con 0x55778f2e4640 2024-06-03T00:03:32.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.958+0000 7fd341b72b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55778f2ebaf0 con 0x55778f2e4f60 2024-06-03T00:03:32.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.958+0000 7fd341b72b80 10 client.0 _ll_register_callbacks cb 0x55778f1ca920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:03:32.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.958+0000 7fd33508b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55778f2def20 0x55778f2ead30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:32.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.958+0000 7fd33508b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55778f2def20 0x55778f2ead30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48836/0 (socket says 172.21.15.49:48836) 2024-06-03T00:03:32.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.958+0000 7fd33508b700 1 -- 172.21.15.49:0/695288687 learned_addr learned my addr 172.21.15.49:0/695288687 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:32.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.958+0000 7fd33588c700 1 --2- 172.21.15.49:0/695288687 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55778f2e4f60 0x55778f2e8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:32.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.958+0000 7fd33488a700 1 --2- 172.21.15.49:0/695288687 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55778f2e4640 0x55778f2e8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:32.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.958+0000 7fd33508b700 1 -- 172.21.15.49:0/695288687 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55778f2e4f60 msgr2=0x55778f2e8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:32.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.958+0000 7fd33508b700 1 --2- 172.21.15.49:0/695288687 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55778f2e4f60 0x55778f2e8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.959+0000 7fd33508b700 1 -- 172.21.15.49:0/695288687 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55778f2e4640 msgr2=0x55778f2e8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:32.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.959+0000 7fd33508b700 1 --2- 172.21.15.49:0/695288687 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55778f2e4640 0x55778f2e8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.959+0000 7fd33508b700 1 -- 172.21.15.49:0/695288687 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55778f17f8d0 con 0x55778f2def20 2024-06-03T00:03:32.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.959+0000 7fd33488a700 1 --2- 172.21.15.49:0/695288687 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55778f2e4640 0x55778f2e8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:32.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.959+0000 7fd33508b700 1 --2- 172.21.15.49:0/695288687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55778f2def20 0x55778f2ead30 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd32c004600 tx=0x7fd32c013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ba5b7c08aef5fa0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:32.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.959+0000 7fd318ff9700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:03:32.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.959+0000 7fd318ff9700 1 -- 172.21.15.49:0/695288687 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c01e2d0 con 0x55778f2def20 2024-06-03T00:03:32.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.959+0000 7fd318ff9700 1 -- 172.21.15.49:0/695288687 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fd32c01e470 con 0x55778f2def20 2024-06-03T00:03:32.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.959+0000 7fd341b72b80 1 -- 172.21.15.49:0/695288687 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd32000cd60 con 0x55778f2def20 2024-06-03T00:03:32.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.959+0000 7fd318ff9700 1 -- 172.21.15.49:0/695288687 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd32c01c6b0 con 0x55778f2def20 2024-06-03T00:03:32.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.959+0000 7fd341b72b80 10 client.16068 fetch_fsmap learned FSMap version 31 2024-06-03T00:03:32.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.959+0000 7fd341b72b80 1 -- 172.21.15.49:0/695288687 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55778f2f6370 con 0x55778f2def20 2024-06-03T00:03:32.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.959+0000 7fd318ff9700 1 -- 172.21.15.49:0/695288687 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd32000cd60 con 0x55778f2def20 2024-06-03T00:03:32.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.959+0000 7fd318ff9700 1 -- 172.21.15.49:0/695288687 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fd32c003be0 con 0x55778f2def20 2024-06-03T00:03:32.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.960+0000 7fd341b72b80 10 client.16068 fetch_fsmap finished waiting for FSMap version 31 2024-06-03T00:03:32.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.960+0000 7fd341b72b80 10 client.16068 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-06-03T00:03:32.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.960+0000 7fd341b72b80 20 client.16068 populate_metadata read hostname 'smithi049' 2024-06-03T00:03:32.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.960+0000 7fd341b72b80 1 --2- 172.21.15.49:0/695288687 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x55778f2f89b0 0x55778f2fadf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:32.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.960+0000 7fd341b72b80 4 client.16068 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:03:32.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.960+0000 7fd341b72b80 1 -- 172.21.15.49:0/695288687 --> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55778f23dd10 con 0x55778f2f89b0 2024-06-03T00:03:32.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.960+0000 7fd33488a700 1 --2- 172.21.15.49:0/695288687 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x55778f2f89b0 0x55778f2fadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:32.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.960+0000 7fd33488a700 1 --2- 172.21.15.49:0/695288687 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x55778f2f89b0 0x55778f2fadf0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=dfb39d10134e4e39 server_cookie=4f24eb1744fa5313 in_seq=0 out_seq=0 2024-06-03T00:03:32.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.960+0000 7fd318ff9700 10 client.16068 ms_handle_connect on v2:172.21.15.107:6834/3693542801 2024-06-03T00:03:32.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.961+0000 7fd318ff9700 1 -- 172.21.15.49:0/695288687 <== mds.4 v2:172.21.15.107:6834/3693542801 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55778f23dd10 con 0x55778f2f89b0 2024-06-03T00:03:32.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.961+0000 7fd318ff9700 10 client.16068 handle_command_reply: tid=0 2024-06-03T00:03:32.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.961+0000 7fd341b72b80 1 client.16068 shutdown 2024-06-03T00:03:32.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.961+0000 7fd341b72b80 1 -- 172.21.15.49:0/695288687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55778f2def20 msgr2=0x55778f2ead30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:32.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.961+0000 7fd341b72b80 1 --2- 172.21.15.49:0/695288687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55778f2def20 0x55778f2ead30 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd32c004600 tx=0x7fd32c013040 comp rx=0 tx=0).stop 2024-06-03T00:03:32.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.961+0000 7fd341b72b80 1 -- 172.21.15.49:0/695288687 shutdown_connections 2024-06-03T00:03:32.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.961+0000 7fd341b72b80 1 --2- 172.21.15.49:0/695288687 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x55778f2f89b0 0x55778f2fadf0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.961+0000 7fd341b72b80 1 --2- 172.21.15.49:0/695288687 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55778f2e4f60 0x55778f2e8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.961+0000 7fd341b72b80 1 --2- 172.21.15.49:0/695288687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55778f2def20 0x55778f2ead30 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.961+0000 7fd318ff9700 0 client.16068 ms_handle_reset on v2:172.21.15.107:6834/3693542801 2024-06-03T00:03:32.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.961+0000 7fd341b72b80 1 --2- 172.21.15.49:0/695288687 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55778f2e4640 0x55778f2e8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.961+0000 7fd341b72b80 1 -- 172.21.15.49:0/695288687 >> 172.21.15.49:0/695288687 conn(0x55778f209cc0 msgr2=0x55778f2d95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:32.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.962+0000 7fd341b72b80 1 -- 172.21.15.49:0/695288687 shutdown_connections 2024-06-03T00:03:32.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.962+0000 7fd341b72b80 1 -- 172.21.15.49:0/695288687 wait complete. 2024-06-03T00:03:32.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.962+0000 7fd341b72b80 20 client.16068 trim_cache size 0 max 16384 2024-06-03T00:03:32.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.978+0000 7fd341b72b80 1 Processor -- start 2024-06-03T00:03:32.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.978+0000 7fd341b72b80 1 -- start start 2024-06-03T00:03:32.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.978+0000 7fd341b72b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55778f2def20 0x55778f2de9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:32.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.978+0000 7fd341b72b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55778f2e4640 0x55778f2e5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:32.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.978+0000 7fd341b72b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55778f2e4f60 0x55778f3006c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:32.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.978+0000 7fd341b72b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd3301aaa50 con 0x55778f2e4f60 2024-06-03T00:03:32.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.978+0000 7fd341b72b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd3301ac650 con 0x55778f2def20 2024-06-03T00:03:32.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.978+0000 7fd341b72b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd3301ab120 con 0x55778f2e4640 2024-06-03T00:03:32.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.978+0000 7fd33508b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55778f2def20 0x55778f2de9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:32.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.978+0000 7fd33588c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55778f2e4f60 0x55778f3006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:32.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.978+0000 7fd33588c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55778f2e4f60 0x55778f3006c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48846/0 (socket says 172.21.15.49:48846) 2024-06-03T00:03:32.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.978+0000 7fd33508b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55778f2def20 0x55778f2de9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.49:46970/0 (socket says 172.21.15.49:46970) 2024-06-03T00:03:32.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.978+0000 7fd33588c700 1 -- 172.21.15.49:0/3920370302 learned_addr learned my addr 172.21.15.49:0/3920370302 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:32.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.979+0000 7fd33488a700 1 --2- 172.21.15.49:0/3920370302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55778f2e4640 0x55778f2e5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:32.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.979+0000 7fd33508b700 1 -- 172.21.15.49:0/3920370302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55778f2e4640 msgr2=0x55778f2e5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:32.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.979+0000 7fd33508b700 1 --2- 172.21.15.49:0/3920370302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55778f2e4640 0x55778f2e5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.979+0000 7fd33508b700 1 -- 172.21.15.49:0/3920370302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55778f2e4f60 msgr2=0x55778f3006c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:32.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.979+0000 7fd33508b700 1 --2- 172.21.15.49:0/3920370302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55778f2e4f60 0x55778f3006c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.979+0000 7fd33508b700 1 -- 172.21.15.49:0/3920370302 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55778f2da500 con 0x55778f2def20 2024-06-03T00:03:32.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.979+0000 7fd33488a700 1 --2- 172.21.15.49:0/3920370302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55778f2e4640 0x55778f2e5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:03:32.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.979+0000 7fd33588c700 1 --2- 172.21.15.49:0/3920370302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55778f2e4f60 0x55778f3006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:32.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.979+0000 7fd33508b700 1 --2- 172.21.15.49:0/3920370302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55778f2def20 0x55778f2de9e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd32c031570 tx=0x7fd32c011ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd8ac80ece81578b server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:32.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.979+0000 7fd31affd700 1 -- 172.21.15.49:0/3920370302 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c01e2d0 con 0x55778f2def20 2024-06-03T00:03:32.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.979+0000 7fd31affd700 1 -- 172.21.15.49:0/3920370302 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd32c02d070 con 0x55778f2def20 2024-06-03T00:03:32.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.979+0000 7fd31affd700 1 -- 172.21.15.49:0/3920370302 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c003c80 con 0x55778f2def20 2024-06-03T00:03:32.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.980+0000 7fd341b72b80 1 -- 172.21.15.49:0/3920370302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55778f2def20 msgr2=0x55778f2de9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:32.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.980+0000 7fd341b72b80 1 --2- 172.21.15.49:0/3920370302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55778f2def20 0x55778f2de9e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd32c031570 tx=0x7fd32c011ac0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.980+0000 7fd341b72b80 1 -- 172.21.15.49:0/3920370302 shutdown_connections 2024-06-03T00:03:32.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.980+0000 7fd341b72b80 1 --2- 172.21.15.49:0/3920370302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55778f2e4f60 0x55778f3006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.980+0000 7fd341b72b80 1 --2- 172.21.15.49:0/3920370302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55778f2def20 0x55778f2de9e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.980+0000 7fd341b72b80 1 --2- 172.21.15.49:0/3920370302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55778f2e4640 0x55778f2e5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.980+0000 7fd341b72b80 1 -- 172.21.15.49:0/3920370302 >> 172.21.15.49:0/3920370302 conn(0x55778f209cc0 msgr2=0x55778f2e5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:32.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.980+0000 7fd341b72b80 1 -- 172.21.15.49:0/3920370302 shutdown_connections 2024-06-03T00:03:32.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.980+0000 7fd341b72b80 1 -- 172.21.15.49:0/3920370302 wait complete. 2024-06-03T00:03:32.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.980+0000 7fd341b72b80 1 -- start start 2024-06-03T00:03:32.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.980+0000 7fd341b72b80 1 Processor -- start 2024-06-03T00:03:32.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.981+0000 7fd341b72b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55778f2def20 0x55778f2f0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:32.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.981+0000 7fd341b72b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55778f2e4640 0x55778f2f14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:32.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.981+0000 7fd341b72b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55778f2e4f60 0x55778f2ffa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:32.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.981+0000 7fd341b72b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd3301abec0 con 0x55778f2def20 2024-06-03T00:03:32.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.981+0000 7fd341b72b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd3301ab7f0 con 0x55778f2e4f60 2024-06-03T00:03:32.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.981+0000 7fd341b72b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd3301a89d0 con 0x55778f2e4640 2024-06-03T00:03:32.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.981+0000 7fd341b72b80 10 client.0 _ll_register_callbacks cb 0x55778f1ca920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:03:32.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.981+0000 7fd33508b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55778f2def20 0x55778f2f0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:32.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.981+0000 7fd33508b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55778f2def20 0x55778f2f0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48862/0 (socket says 172.21.15.49:48862) 2024-06-03T00:03:32.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.981+0000 7fd33508b700 1 -- 172.21.15.49:0/3368997977 learned_addr learned my addr 172.21.15.49:0/3368997977 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:32.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.981+0000 7fd33588c700 1 --2- 172.21.15.49:0/3368997977 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55778f2e4f60 0x55778f2ffa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:32.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.981+0000 7fd33488a700 1 --2- 172.21.15.49:0/3368997977 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55778f2e4640 0x55778f2f14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:32.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.981+0000 7fd33508b700 1 -- 172.21.15.49:0/3368997977 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55778f2e4640 msgr2=0x55778f2f14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:32.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.981+0000 7fd33508b700 1 --2- 172.21.15.49:0/3368997977 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55778f2e4640 0x55778f2f14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.981+0000 7fd33508b700 1 -- 172.21.15.49:0/3368997977 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55778f2e4f60 msgr2=0x55778f2ffa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:32.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.981+0000 7fd33508b700 1 --2- 172.21.15.49:0/3368997977 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55778f2e4f60 0x55778f2ffa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.981+0000 7fd33508b700 1 -- 172.21.15.49:0/3368997977 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55778f300130 con 0x55778f2def20 2024-06-03T00:03:32.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.981+0000 7fd33508b700 1 --2- 172.21.15.49:0/3368997977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55778f2def20 0x55778f2f0f90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd32c003f50 tx=0x7fd32c003900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a30a95738ba7f60 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:32.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.981+0000 7fd318ff9700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:03:32.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.982+0000 7fd318ff9700 1 -- 172.21.15.49:0/3368997977 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c01e2d0 con 0x55778f2def20 2024-06-03T00:03:32.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.982+0000 7fd318ff9700 1 -- 172.21.15.49:0/3368997977 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fd32c01e470 con 0x55778f2def20 2024-06-03T00:03:32.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.982+0000 7fd341b72b80 1 -- 172.21.15.49:0/3368997977 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd32c02d070 con 0x55778f2def20 2024-06-03T00:03:32.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.982+0000 7fd318ff9700 1 -- 172.21.15.49:0/3368997977 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd32c01c850 con 0x55778f2def20 2024-06-03T00:03:32.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.982+0000 7fd341b72b80 10 client.16074 fetch_fsmap learned FSMap version 31 2024-06-03T00:03:32.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.982+0000 7fd341b72b80 1 -- 172.21.15.49:0/3368997977 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55778f363090 con 0x55778f2def20 2024-06-03T00:03:32.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.982+0000 7fd318ff9700 1 -- 172.21.15.49:0/3368997977 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd32c02d070 con 0x55778f2def20 2024-06-03T00:03:32.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.982+0000 7fd318ff9700 1 -- 172.21.15.49:0/3368997977 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7fd32c031c40 con 0x55778f2def20 2024-06-03T00:03:32.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.982+0000 7fd341b72b80 10 client.16074 fetch_fsmap finished waiting for FSMap version 31 2024-06-03T00:03:32.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.982+0000 7fd341b72b80 10 client.16074 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-06-03T00:03:32.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.982+0000 7fd341b72b80 20 client.16074 populate_metadata read hostname 'smithi049' 2024-06-03T00:03:32.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.982+0000 7fd341b72b80 1 --2- 172.21.15.49:0/3368997977 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x55778f363630 0x55778f365a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:32.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.982+0000 7fd341b72b80 4 client.16074 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-03T00:03:32.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.982+0000 7fd341b72b80 1 -- 172.21.15.49:0/3368997977 --> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55778f238290 con 0x55778f363630 2024-06-03T00:03:32.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.983+0000 7fd33488a700 1 --2- 172.21.15.49:0/3368997977 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x55778f363630 0x55778f365a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:32.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.983+0000 7fd33488a700 1 --2- 172.21.15.49:0/3368997977 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x55778f363630 0x55778f365a50 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c8d8372232b9b455 server_cookie=3f482c9739af2e81 in_seq=0 out_seq=0 2024-06-03T00:03:32.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.983+0000 7fd318ff9700 10 client.16074 ms_handle_connect on v2:172.21.15.107:6834/3693542801 2024-06-03T00:03:32.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.983+0000 7fd318ff9700 1 -- 172.21.15.49:0/3368997977 <== mds.4 v2:172.21.15.107:6834/3693542801 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55778f238290 con 0x55778f363630 2024-06-03T00:03:32.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.983+0000 7fd318ff9700 10 client.16074 handle_command_reply: tid=0 2024-06-03T00:03:32.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.983+0000 7fd341b72b80 1 client.16074 shutdown 2024-06-03T00:03:32.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.983+0000 7fd341b72b80 1 -- 172.21.15.49:0/3368997977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55778f2def20 msgr2=0x55778f2f0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:32.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.983+0000 7fd341b72b80 1 --2- 172.21.15.49:0/3368997977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55778f2def20 0x55778f2f0f90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd32c003f50 tx=0x7fd32c003900 comp rx=0 tx=0).stop 2024-06-03T00:03:32.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.983+0000 7fd341b72b80 1 -- 172.21.15.49:0/3368997977 shutdown_connections 2024-06-03T00:03:32.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.983+0000 7fd341b72b80 1 --2- 172.21.15.49:0/3368997977 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55778f2e4f60 0x55778f2ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.983+0000 7fd341b72b80 1 --2- 172.21.15.49:0/3368997977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55778f2def20 0x55778f2f0f90 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.983+0000 7fd341b72b80 1 --2- 172.21.15.49:0/3368997977 >> [v2:172.21.15.107:6834/3693542801,v1:172.21.15.107:6835/3693542801] conn(0x55778f363630 0x55778f365a50 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.983+0000 7fd341b72b80 1 --2- 172.21.15.49:0/3368997977 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55778f2e4640 0x55778f2f14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.983+0000 7fd341b72b80 1 -- 172.21.15.49:0/3368997977 >> 172.21.15.49:0/3368997977 conn(0x55778f209cc0 msgr2=0x55778f2e5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:32.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.983+0000 7fd318ff9700 0 client.16074 ms_handle_reset on v2:172.21.15.107:6834/3693542801 2024-06-03T00:03:32.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.983+0000 7fd341b72b80 1 -- 172.21.15.49:0/3368997977 shutdown_connections 2024-06-03T00:03:32.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.983+0000 7fd341b72b80 1 -- 172.21.15.49:0/3368997977 wait complete. 2024-06-03T00:03:32.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.984+0000 7fd341b72b80 20 client.16074 trim_cache size 0 max 16384 2024-06-03T00:03:32.989 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-06-03T00:03:32.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.984+0000 7fd3372ef700 1 -- 172.21.15.49:0/2195666718 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fd31c0a2c20 msgr2=0x7fd31c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:32.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.984+0000 7fd3372ef700 1 --2- 172.21.15.49:0/2195666718 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fd31c0a2c20 0x7fd31c0a50e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd330106a70 tx=0x7fd32c009260 comp rx=0 tx=0).stop 2024-06-03T00:03:32.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.984+0000 7fd3372ef700 1 -- 172.21.15.49:0/2195666718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3301071a0 msgr2=0x7fd33019dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:32.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.984+0000 7fd3372ef700 1 --2- 172.21.15.49:0/2195666718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3301071a0 0x7fd33019dca0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd32000e9a0 tx=0x7fd32000ecb0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.984+0000 7fd3372ef700 1 -- 172.21.15.49:0/2195666718 shutdown_connections 2024-06-03T00:03:32.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.984+0000 7fd3372ef700 1 --2- 172.21.15.49:0/2195666718 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fd31c0a2c20 0x7fd31c0a50e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.984+0000 7fd3372ef700 1 --2- 172.21.15.49:0/2195666718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd330107b60 0x7fd330197970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.984+0000 7fd3372ef700 1 --2- 172.21.15.49:0/2195666718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd330105330 0x7fd33019d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.984+0000 7fd3372ef700 1 --2- 172.21.15.49:0/2195666718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3301071a0 0x7fd33019dca0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:32.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.984+0000 7fd3372ef700 1 -- 172.21.15.49:0/2195666718 >> 172.21.15.49:0/2195666718 conn(0x7fd3300766b0 msgr2=0x7fd3300fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:32.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.984+0000 7fd3372ef700 1 -- 172.21.15.49:0/2195666718 shutdown_connections 2024-06-03T00:03:32.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:32.984+0000 7fd3372ef700 1 -- 172.21.15.49:0/2195666718 wait complete. 2024-06-03T00:03:33.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:33 smithi049 ceph-mon[32302]: pgmap v488: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 MiB/s rd, 56 MiB/s wr, 169 op/s 2024-06-03T00:03:33.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:33 smithi057 ceph-mon[36457]: pgmap v488: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 MiB/s rd, 56 MiB/s wr, 169 op/s 2024-06-03T00:03:33.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:33 smithi107 ceph-mon[37048]: pgmap v488: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 MiB/s rd, 56 MiB/s wr, 169 op/s 2024-06-03T00:03:33.734 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-06-03T00:03:34.017 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:03:34.400 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:34 smithi049 ceph-mon[32302]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:03:34.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:34 smithi057 ceph-mon[36457]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:03:34.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:34 smithi107 ceph-mon[37048]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:03:35.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:35 smithi049 ceph-mon[32302]: pgmap v489: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 51 MiB/s rd, 68 MiB/s wr, 184 op/s 2024-06-03T00:03:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.288+0000 7f225af3b640 1 -- 172.21.15.49:0/2581154151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22541024b0 msgr2=0x7f2254108d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.288+0000 7f225af3b640 1 --2- 172.21.15.49:0/2581154151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22541024b0 0x7f2254108d40 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f224c009ca0 tx=0x7f224c02a8c0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.288+0000 7f225af3b640 1 -- 172.21.15.49:0/2581154151 shutdown_connections 2024-06-03T00:03:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.288+0000 7f225af3b640 1 --2- 172.21.15.49:0/2581154151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22541024b0 0x7f2254108d40 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.288+0000 7f225af3b640 1 --2- 172.21.15.49:0/2581154151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2254101af0 0x7f2254101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.288+0000 7f225af3b640 1 --2- 172.21.15.49:0/2581154151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2254100900 0x7f2254100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.288+0000 7f225af3b640 1 -- 172.21.15.49:0/2581154151 >> 172.21.15.49:0/2581154151 conn(0x7f22540fbe70 msgr2=0x7f22540fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.288+0000 7f225af3b640 1 -- 172.21.15.49:0/2581154151 shutdown_connections 2024-06-03T00:03:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.288+0000 7f225af3b640 1 -- 172.21.15.49:0/2581154151 wait complete. 2024-06-03T00:03:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.288+0000 7f225af3b640 1 Processor -- start 2024-06-03T00:03:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.288+0000 7f225af3b640 1 -- start start 2024-06-03T00:03:35.290 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.288+0000 7f225af3b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2254100900 0x7f2254197be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.290 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.288+0000 7f225af3b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2254101af0 0x7f2254198120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.290 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.289+0000 7f225af3b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22541024b0 0x7f225419f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.290 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.289+0000 7f225af3b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f225410c560 con 0x7f2254101af0 2024-06-03T00:03:35.290 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.289+0000 7f225af3b640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f225410c3e0 con 0x7f2254100900 2024-06-03T00:03:35.290 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.289+0000 7f225af3b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f225410c6e0 con 0x7f22541024b0 2024-06-03T00:03:35.290 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.289+0000 7f2253fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2254101af0 0x7f2254198120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.290 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.289+0000 7f2253fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2254101af0 0x7f2254198120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48874/0 (socket says 172.21.15.49:48874) 2024-06-03T00:03:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.289+0000 7f2253fff640 1 -- 172.21.15.49:0/693482471 learned_addr learned my addr 172.21.15.49:0/693482471 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.289+0000 7f22594d8640 1 --2- 172.21.15.49:0/693482471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22541024b0 0x7f225419f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.289+0000 7f2258cd7640 1 --2- 172.21.15.49:0/693482471 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2254100900 0x7f2254197be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.289+0000 7f2253fff640 1 -- 172.21.15.49:0/693482471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22541024b0 msgr2=0x7f225419f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.289+0000 7f2253fff640 1 --2- 172.21.15.49:0/693482471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22541024b0 0x7f225419f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.289+0000 7f2253fff640 1 -- 172.21.15.49:0/693482471 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2254100900 msgr2=0x7f2254197be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.289+0000 7f2253fff640 1 --2- 172.21.15.49:0/693482471 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2254100900 0x7f2254197be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.289+0000 7f2253fff640 1 -- 172.21.15.49:0/693482471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f225419f800 con 0x7f2254101af0 2024-06-03T00:03:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.289+0000 7f2253fff640 1 --2- 172.21.15.49:0/693482471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2254101af0 0x7f2254198120 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f224000e9f0 tx=0x7f224000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.289+0000 7f2251ffb640 1 -- 172.21.15.49:0/693482471 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224000cd80 con 0x7f2254101af0 2024-06-03T00:03:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.289+0000 7f225af3b640 1 -- 172.21.15.49:0/693482471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f225419faf0 con 0x7f2254101af0 2024-06-03T00:03:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.289+0000 7f2251ffb640 1 -- 172.21.15.49:0/693482471 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2240010910 con 0x7f2254101af0 2024-06-03T00:03:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.289+0000 7f2251ffb640 1 -- 172.21.15.49:0/693482471 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22400188f0 con 0x7f2254101af0 2024-06-03T00:03:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.290+0000 7f225af3b640 1 -- 172.21.15.49:0/693482471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22541a0090 con 0x7f2254101af0 2024-06-03T00:03:35.294 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.292+0000 7f2251ffb640 1 -- 172.21.15.49:0/693482471 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2240010ac0 con 0x7f2254101af0 2024-06-03T00:03:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.292+0000 7f225dc4a740 1 Processor -- start 2024-06-03T00:03:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.292+0000 7f225dc4a740 1 -- start start 2024-06-03T00:03:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.292+0000 7f225dc4a740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e87fd4010 0x559e87fd4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.293+0000 7f225dc4a740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e87fd4a00 0x559e87fd9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.293+0000 7f225dc4a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e87fd9b70 0x559e87fdc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.293+0000 7f225dc4a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559e87f374f0 con 0x559e87fd9b70 2024-06-03T00:03:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.293+0000 7f225dc4a740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x559e87ed5870 con 0x559e87fd4010 2024-06-03T00:03:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.293+0000 7f225dc4a740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x559e87f334b0 con 0x559e87fd4a00 2024-06-03T00:03:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.293+0000 7f2258cd7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e87fd4a00 0x559e87fd9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.293+0000 7f2253fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e87fd9b70 0x559e87fdc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.293+0000 7f2258cd7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e87fd4a00 0x559e87fd9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:34898/0 (socket says 172.21.15.49:34898) 2024-06-03T00:03:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.293+0000 7f2258cd7640 1 -- 172.21.15.49:0/1264625529 learned_addr learned my addr 172.21.15.49:0/1264625529 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.293+0000 7f22594d8640 1 --2- 172.21.15.49:0/1264625529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e87fd4010 0x559e87fd4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.293+0000 7f2251ffb640 1 --2- 172.21.15.49:0/693482471 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f22440a2c30 0x7f22440a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.293+0000 7f2258cd7640 1 -- 172.21.15.49:0/1264625529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e87fd4010 msgr2=0x559e87fd4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.293+0000 7f2258cd7640 1 --2- 172.21.15.49:0/1264625529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e87fd4010 0x559e87fd4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.293+0000 7f2258cd7640 1 -- 172.21.15.49:0/1264625529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e87fd9b70 msgr2=0x559e87fdc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.293+0000 7f2258cd7640 1 --2- 172.21.15.49:0/1264625529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e87fd9b70 0x559e87fdc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.293+0000 7f2258cd7640 1 -- 172.21.15.49:0/1264625529 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e87ef19b0 con 0x559e87fd4a00 2024-06-03T00:03:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.293+0000 7f22594d8640 1 --2- 172.21.15.49:0/693482471 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f22440a2c30 0x7f22440a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.293+0000 7f2251ffb640 1 -- 172.21.15.49:0/693482471 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f22400cf4a0 con 0x7f2254101af0 2024-06-03T00:03:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.293+0000 7f2258cd7640 1 --2- 172.21.15.49:0/1264625529 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e87fd4a00 0x559e87fd9500 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2248009c20 tx=0x7f22480117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c6b5f2068b8e8c3 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.294+0000 7f223effd640 1 -- 172.21.15.49:0/1264625529 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2248012450 con 0x559e87fd4a00 2024-06-03T00:03:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.294+0000 7f22594d8640 1 --2- 172.21.15.49:0/693482471 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f22440a2c30 0x7f22440a50f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x559e87fd5260 tx=0x7f224c03f040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.294+0000 7f223effd640 1 -- 172.21.15.49:0/1264625529 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2248012ad0 con 0x559e87fd4a00 2024-06-03T00:03:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.294+0000 7f223effd640 1 -- 172.21.15.49:0/1264625529 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224800fad0 con 0x559e87fd4a00 2024-06-03T00:03:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.294+0000 7f225dc4a740 1 -- 172.21.15.49:0/1264625529 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e87fd4a00 msgr2=0x559e87fd9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.294+0000 7f225dc4a740 1 --2- 172.21.15.49:0/1264625529 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e87fd4a00 0x559e87fd9500 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2248009c20 tx=0x7f22480117b0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.295+0000 7f225dc4a740 1 -- 172.21.15.49:0/1264625529 shutdown_connections 2024-06-03T00:03:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.295+0000 7f225dc4a740 1 --2- 172.21.15.49:0/1264625529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e87fd9b70 0x559e87fdc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.295+0000 7f225dc4a740 1 --2- 172.21.15.49:0/1264625529 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e87fd4a00 0x559e87fd9500 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.295+0000 7f225dc4a740 1 --2- 172.21.15.49:0/1264625529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e87fd4010 0x559e87fd4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.295+0000 7f225dc4a740 1 -- 172.21.15.49:0/1264625529 >> 172.21.15.49:0/1264625529 conn(0x559e87fcf680 msgr2=0x559e87fcfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.295+0000 7f225dc4a740 1 -- 172.21.15.49:0/1264625529 shutdown_connections 2024-06-03T00:03:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.295+0000 7f225dc4a740 1 -- 172.21.15.49:0/1264625529 wait complete. 2024-06-03T00:03:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.295+0000 7f225dc4a740 1 -- start start 2024-06-03T00:03:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.295+0000 7f225dc4a740 1 Processor -- start 2024-06-03T00:03:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.296+0000 7f225dc4a740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e87fd4010 0x559e87fde520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.296+0000 7f225dc4a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e87fd4a00 0x559e87fdea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.296+0000 7f225dc4a740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e87fd9b70 0x559e87fe5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.296+0000 7f225dc4a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559e87fdcb20 con 0x559e87fd4a00 2024-06-03T00:03:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.296+0000 7f225dc4a740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x559e87ec0ae0 con 0x559e87fd4010 2024-06-03T00:03:35.301 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.296+0000 7f225dc4a740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x559e87fdcca0 con 0x559e87fd9b70 2024-06-03T00:03:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.296+0000 7f225dc4a740 10 client.0 _ll_register_callbacks cb 0x559e87ef99b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:03:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.296+0000 7f2253fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e87fd4a00 0x559e87fdea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.296+0000 7f22594d8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e87fd9b70 0x559e87fe5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.296+0000 7f22594d8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e87fd9b70 0x559e87fe5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:34910/0 (socket says 172.21.15.49:34910) 2024-06-03T00:03:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.296+0000 7f22594d8640 1 -- 172.21.15.49:0/1685557108 learned_addr learned my addr 172.21.15.49:0/1685557108 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.296+0000 7f2258cd7640 1 --2- 172.21.15.49:0/1685557108 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e87fd4010 0x559e87fde520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.296+0000 7f22594d8640 1 -- 172.21.15.49:0/1685557108 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e87fd4010 msgr2=0x559e87fde520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.296+0000 7f22594d8640 1 --2- 172.21.15.49:0/1685557108 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e87fd4010 0x559e87fde520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.296+0000 7f22594d8640 1 -- 172.21.15.49:0/1685557108 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e87fd4a00 msgr2=0x559e87fdea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.296+0000 7f22594d8640 1 --2- 172.21.15.49:0/1685557108 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e87fd4a00 0x559e87fdea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.296+0000 7f22594d8640 1 -- 172.21.15.49:0/1685557108 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e87c4b210 con 0x559e87fd9b70 2024-06-03T00:03:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.296+0000 7f2253fff640 1 --2- 172.21.15.49:0/1685557108 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e87fd4a00 0x559e87fdea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.297+0000 7f22594d8640 1 --2- 172.21.15.49:0/1685557108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e87fd9b70 0x559e87fe5aa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f224c035000 tx=0x7f224c005d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b2fe9c8e07dd9d4 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.297+0000 7f2233fff640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-06-03T00:03:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.297+0000 7f2233fff640 1 -- 172.21.15.49:0/1685557108 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c04a110 con 0x559e87fd9b70 2024-06-03T00:03:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.297+0000 7f2233fff640 1 -- 172.21.15.49:0/1685557108 <== mon.1 v2:172.21.15.107:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f224c04a2b0 con 0x559e87fd9b70 2024-06-03T00:03:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.297+0000 7f225dc4a740 1 -- 172.21.15.49:0/1685557108 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2248012ad0 con 0x559e87fd9b70 2024-06-03T00:03:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.297+0000 7f2233fff640 1 -- 172.21.15.49:0/1685557108 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f224c04a4b0 con 0x559e87fd9b70 2024-06-03T00:03:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.297+0000 7f225dc4a740 10 client.25678 fetch_fsmap learned FSMap version 32 2024-06-03T00:03:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.297+0000 7f225dc4a740 1 -- 172.21.15.49:0/1685557108 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x559e87d17620 con 0x559e87fd9b70 2024-06-03T00:03:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.298+0000 7f2233fff640 1 -- 172.21.15.49:0/1685557108 <== mon.1 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2248012ad0 con 0x559e87fd9b70 2024-06-03T00:03:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.298+0000 7f2233fff640 1 -- 172.21.15.49:0/1685557108 <== mon.1 v2:172.21.15.107:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f224c02fa80 con 0x559e87fd9b70 2024-06-03T00:03:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.298+0000 7f225dc4a740 10 client.25678 fetch_fsmap finished waiting for FSMap version 32 2024-06-03T00:03:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.298+0000 7f225dc4a740 10 client.25678 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:03:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.298+0000 7f225dc4a740 20 client.25678 populate_metadata read hostname 'smithi049' 2024-06-03T00:03:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.298+0000 7f225dc4a740 1 --2- 172.21.15.49:0/1685557108 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x559e87fea490 0x559e87fec8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.298+0000 7f225dc4a740 4 client.25678 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:03:35.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.298+0000 7f225dc4a740 1 -- 172.21.15.49:0/1685557108 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e87f4af10 con 0x559e87fea490 2024-06-03T00:03:35.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.298+0000 7f2258cd7640 1 --2- 172.21.15.49:0/1685557108 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x559e87fea490 0x559e87fec8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.298+0000 7f2258cd7640 1 --2- 172.21.15.49:0/1685557108 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x559e87fea490 0x559e87fec8d0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c57f69b449ef051a server_cookie=30f2152706cdc7c7 in_seq=0 out_seq=0 2024-06-03T00:03:35.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.298+0000 7f2233fff640 10 client.25678 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:35.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.299+0000 7f2233fff640 1 -- 172.21.15.49:0/1685557108 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x559e87f4af10 con 0x559e87fea490 2024-06-03T00:03:35.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.299+0000 7f2233fff640 10 client.25678 handle_command_reply: tid=0 2024-06-03T00:03:35.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.299+0000 7f225dc4a740 1 client.25678 shutdown 2024-06-03T00:03:35.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.299+0000 7f225dc4a740 1 -- 172.21.15.49:0/1685557108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e87fd9b70 msgr2=0x559e87fe5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:35.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.299+0000 7f225dc4a740 1 --2- 172.21.15.49:0/1685557108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e87fd9b70 0x559e87fe5aa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f224c035000 tx=0x7f224c005d80 comp rx=0 tx=0).stop 2024-06-03T00:03:35.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.299+0000 7f225dc4a740 1 -- 172.21.15.49:0/1685557108 shutdown_connections 2024-06-03T00:03:35.305 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.299+0000 7f225dc4a740 1 --2- 172.21.15.49:0/1685557108 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x559e87fea490 0x559e87fec8d0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.305 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.299+0000 7f225dc4a740 1 --2- 172.21.15.49:0/1685557108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e87fd9b70 0x559e87fe5aa0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.305 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.299+0000 7f2233fff640 0 client.25678 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:35.305 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.299+0000 7f225dc4a740 1 --2- 172.21.15.49:0/1685557108 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e87fd4a00 0x559e87fdea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.305 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.299+0000 7f225dc4a740 1 --2- 172.21.15.49:0/1685557108 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e87fd4010 0x559e87fde520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.305 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.299+0000 7f225dc4a740 1 -- 172.21.15.49:0/1685557108 >> 172.21.15.49:0/1685557108 conn(0x559e87fcf680 msgr2=0x559e87fce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:35.305 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.300+0000 7f225dc4a740 1 -- 172.21.15.49:0/1685557108 shutdown_connections 2024-06-03T00:03:35.305 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.300+0000 7f225dc4a740 1 -- 172.21.15.49:0/1685557108 wait complete. 2024-06-03T00:03:35.305 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.300+0000 7f225dc4a740 20 client.25678 trim_cache size 0 max 16384 2024-06-03T00:03:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.326+0000 7f225dc4a740 1 Processor -- start 2024-06-03T00:03:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.326+0000 7f225dc4a740 1 -- start start 2024-06-03T00:03:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.326+0000 7f225dc4a740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e87fd4010 0x559e87fd5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.326+0000 7f225dc4a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e87fd4a00 0x559e87fd63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.326+0000 7f225dc4a740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e87fd9b70 0x559e87fe5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.326+0000 7f225dc4a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f22541a6c40 con 0x559e87fd4a00 2024-06-03T00:03:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.326+0000 7f225dc4a740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f22541a8870 con 0x559e87fd9b70 2024-06-03T00:03:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.326+0000 7f225dc4a740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f22541a7310 con 0x559e87fd4010 2024-06-03T00:03:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.327+0000 7f2253fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e87fd4a00 0x559e87fd63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.327+0000 7f2258cd7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e87fd4010 0x559e87fd5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.327+0000 7f2253fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e87fd4a00 0x559e87fd63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48892/0 (socket says 172.21.15.49:48892) 2024-06-03T00:03:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.327+0000 7f2253fff640 1 -- 172.21.15.49:0/862542087 learned_addr learned my addr 172.21.15.49:0/862542087 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.327+0000 7f22594d8640 1 --2- 172.21.15.49:0/862542087 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e87fd9b70 0x559e87fe5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.327+0000 7f2253fff640 1 -- 172.21.15.49:0/862542087 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e87fd4010 msgr2=0x559e87fd5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:35.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.327+0000 7f2253fff640 1 --2- 172.21.15.49:0/862542087 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e87fd4010 0x559e87fd5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.327+0000 7f2253fff640 1 -- 172.21.15.49:0/862542087 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e87fd9b70 msgr2=0x559e87fe5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:35.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.327+0000 7f2253fff640 1 --2- 172.21.15.49:0/862542087 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e87fd9b70 0x559e87fe5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.327+0000 7f2253fff640 1 -- 172.21.15.49:0/862542087 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e87fc9ae0 con 0x559e87fd4a00 2024-06-03T00:03:35.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.327+0000 7f2253fff640 1 --2- 172.21.15.49:0/862542087 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e87fd4a00 0x559e87fd63a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f22400d2cc0 tx=0x7f224009b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e98c5d9a5a266b server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:35.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.327+0000 7f223e7fc640 1 -- 172.21.15.49:0/862542087 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22400a4970 con 0x559e87fd4a00 2024-06-03T00:03:35.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.327+0000 7f223e7fc640 1 -- 172.21.15.49:0/862542087 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22400a00b0 con 0x559e87fd4a00 2024-06-03T00:03:35.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.327+0000 7f223e7fc640 1 -- 172.21.15.49:0/862542087 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224009b150 con 0x559e87fd4a00 2024-06-03T00:03:35.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.328+0000 7f225dc4a740 1 -- 172.21.15.49:0/862542087 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e87fd4a00 msgr2=0x559e87fd63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:35.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.328+0000 7f225dc4a740 1 --2- 172.21.15.49:0/862542087 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e87fd4a00 0x559e87fd63a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f22400d2cc0 tx=0x7f224009b840 comp rx=0 tx=0).stop 2024-06-03T00:03:35.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.328+0000 7f225dc4a740 1 -- 172.21.15.49:0/862542087 shutdown_connections 2024-06-03T00:03:35.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.328+0000 7f225dc4a740 1 --2- 172.21.15.49:0/862542087 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e87fd9b70 0x559e87fe5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.328+0000 7f225dc4a740 1 --2- 172.21.15.49:0/862542087 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e87fd4a00 0x559e87fd63a0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.328+0000 7f225dc4a740 1 --2- 172.21.15.49:0/862542087 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e87fd4010 0x559e87fd5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.328+0000 7f225dc4a740 1 -- 172.21.15.49:0/862542087 >> 172.21.15.49:0/862542087 conn(0x559e87fcf680 msgr2=0x559e87fde520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.328+0000 7f225dc4a740 1 -- 172.21.15.49:0/862542087 shutdown_connections 2024-06-03T00:03:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.328+0000 7f225dc4a740 1 -- 172.21.15.49:0/862542087 wait complete. 2024-06-03T00:03:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.328+0000 7f225dc4a740 1 -- start start 2024-06-03T00:03:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.329+0000 7f225dc4a740 1 Processor -- start 2024-06-03T00:03:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.329+0000 7f225dc4a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e87fd4010 0x559e87fe2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.329+0000 7f225dc4a740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e87fd4a00 0x559e87fe2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.329+0000 7f225dc4a740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e87fd9b70 0x559e880531a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.329+0000 7f225dc4a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f22541a80e0 con 0x559e87fd4010 2024-06-03T00:03:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.329+0000 7f225dc4a740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f22541a79e0 con 0x559e87fd9b70 2024-06-03T00:03:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.329+0000 7f225dc4a740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f22541a4c00 con 0x559e87fd4a00 2024-06-03T00:03:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.329+0000 7f225dc4a740 10 client.0 _ll_register_callbacks cb 0x7f2240005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:03:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.329+0000 7f2258cd7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e87fd4010 0x559e87fe2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.329+0000 7f2253fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e87fd4a00 0x559e87fe2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.329+0000 7f2258cd7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e87fd4010 0x559e87fe2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48898/0 (socket says 172.21.15.49:48898) 2024-06-03T00:03:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.329+0000 7f22594d8640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e87fd9b70 0x559e880531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.329+0000 7f2258cd7640 1 -- 172.21.15.49:0/473158411 learned_addr learned my addr 172.21.15.49:0/473158411 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.329+0000 7f2253fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e87fd4a00 0x559e87fe2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:34924/0 (socket says 172.21.15.49:34924) 2024-06-03T00:03:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.329+0000 7f2253fff640 1 -- 172.21.15.49:0/473158411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e87fd9b70 msgr2=0x559e880531a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.329+0000 7f2253fff640 1 --2- 172.21.15.49:0/473158411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e87fd9b70 0x559e880531a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.330+0000 7f2253fff640 1 -- 172.21.15.49:0/473158411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e87fd4010 msgr2=0x559e87fe2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.330+0000 7f2253fff640 1 --2- 172.21.15.49:0/473158411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e87fd4010 0x559e87fe2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.330+0000 7f2253fff640 1 -- 172.21.15.49:0/473158411 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e87fe5dd0 con 0x559e87fd4a00 2024-06-03T00:03:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.330+0000 7f2258cd7640 1 --2- 172.21.15.49:0/473158411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e87fd4010 0x559e87fe2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.330+0000 7f2253fff640 1 --2- 172.21.15.49:0/473158411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e87fd4a00 0x559e87fe2d50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f224009ba00 tx=0x7f224009b510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=780338d557057190 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.330+0000 7f2233fff640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-06-03T00:03:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.330+0000 7f2233fff640 1 -- 172.21.15.49:0/473158411 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2240010630 con 0x559e87fd4a00 2024-06-03T00:03:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.330+0000 7f2233fff640 1 -- 172.21.15.49:0/473158411 <== mon.1 v2:172.21.15.107:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f2240097a50 con 0x559e87fd4a00 2024-06-03T00:03:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.330+0000 7f225dc4a740 1 -- 172.21.15.49:0/473158411 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22400a00b0 con 0x559e87fd4a00 2024-06-03T00:03:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.330+0000 7f2233fff640 1 -- 172.21.15.49:0/473158411 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f22400cd0b0 con 0x559e87fd4a00 2024-06-03T00:03:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.330+0000 7f225dc4a740 10 client.25684 fetch_fsmap learned FSMap version 32 2024-06-03T00:03:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.330+0000 7f225dc4a740 1 -- 172.21.15.49:0/473158411 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x559e880547a0 con 0x559e87fd4a00 2024-06-03T00:03:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.330+0000 7f2233fff640 1 -- 172.21.15.49:0/473158411 <== mon.1 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22400a00b0 con 0x559e87fd4a00 2024-06-03T00:03:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.330+0000 7f2233fff640 1 -- 172.21.15.49:0/473158411 <== mon.1 v2:172.21.15.107:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f22400a4bc0 con 0x559e87fd4a00 2024-06-03T00:03:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.330+0000 7f225dc4a740 10 client.25684 fetch_fsmap finished waiting for FSMap version 32 2024-06-03T00:03:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.330+0000 7f225dc4a740 10 client.25684 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:03:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.330+0000 7f225dc4a740 20 client.25684 populate_metadata read hostname 'smithi049' 2024-06-03T00:03:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.331+0000 7f225dc4a740 1 --2- 172.21.15.49:0/473158411 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x559e88055210 0x559e88057630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.331+0000 7f225dc4a740 4 client.25684 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-03T00:03:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.331+0000 7f225dc4a740 1 -- 172.21.15.49:0/473158411 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559e87f44c20 con 0x559e88055210 2024-06-03T00:03:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.331+0000 7f2258cd7640 1 --2- 172.21.15.49:0/473158411 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x559e88055210 0x559e88057630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.331+0000 7f2258cd7640 1 --2- 172.21.15.49:0/473158411 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x559e88055210 0x559e88057630 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db85763c401894a7 server_cookie=a7fe9af3d8e61e65 in_seq=0 out_seq=0 2024-06-03T00:03:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.331+0000 7f2233fff640 10 client.25684 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.363+0000 7f2233fff640 1 -- 172.21.15.49:0/473158411 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x559e87f44c20 con 0x559e88055210 2024-06-03T00:03:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.363+0000 7f2233fff640 10 client.25684 handle_command_reply: tid=0 2024-06-03T00:03:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.364+0000 7f225dc4a740 1 client.25684 shutdown 2024-06-03T00:03:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.364+0000 7f225dc4a740 1 -- 172.21.15.49:0/473158411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e87fd4a00 msgr2=0x559e87fe2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.364+0000 7f225dc4a740 1 --2- 172.21.15.49:0/473158411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e87fd4a00 0x559e87fe2d50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f224009ba00 tx=0x7f224009b510 comp rx=0 tx=0).stop 2024-06-03T00:03:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.364+0000 7f225dc4a740 1 -- 172.21.15.49:0/473158411 shutdown_connections 2024-06-03T00:03:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.364+0000 7f225dc4a740 1 --2- 172.21.15.49:0/473158411 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x559e88055210 0x559e88057630 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.364+0000 7f225dc4a740 1 --2- 172.21.15.49:0/473158411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559e87fd9b70 0x559e880531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.364+0000 7f225dc4a740 1 --2- 172.21.15.49:0/473158411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559e87fd4a00 0x559e87fe2d50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.364+0000 7f2233fff640 0 client.25684 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.364+0000 7f225dc4a740 1 --2- 172.21.15.49:0/473158411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559e87fd4010 0x559e87fe2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.364+0000 7f225dc4a740 1 -- 172.21.15.49:0/473158411 >> 172.21.15.49:0/473158411 conn(0x559e87fcf680 msgr2=0x559e87fde520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.364+0000 7f225dc4a740 1 -- 172.21.15.49:0/473158411 shutdown_connections 2024-06-03T00:03:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.364+0000 7f225dc4a740 1 -- 172.21.15.49:0/473158411 wait complete. 2024-06-03T00:03:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.364+0000 7f225dc4a740 20 client.25684 trim_cache size 0 max 16384 2024-06-03T00:03:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-06-03T00:03:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-06-03T00:03:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-06-03T00:03:35.366 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.365+0000 7f225af3b640 1 -- 172.21.15.49:0/693482471 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f22440a2c30 msgr2=0x7f22440a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:35.366 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.365+0000 7f225af3b640 1 --2- 172.21.15.49:0/693482471 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f22440a2c30 0x7f22440a50f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x559e87fd5260 tx=0x7f224c03f040 comp rx=0 tx=0).stop 2024-06-03T00:03:35.366 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.365+0000 7f225af3b640 1 -- 172.21.15.49:0/693482471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2254101af0 msgr2=0x7f2254198120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:35.366 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.365+0000 7f225af3b640 1 --2- 172.21.15.49:0/693482471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2254101af0 0x7f2254198120 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f224000e9f0 tx=0x7f224000eeb0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.366 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.365+0000 7f225af3b640 1 -- 172.21.15.49:0/693482471 shutdown_connections 2024-06-03T00:03:35.366 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.365+0000 7f225af3b640 1 --2- 172.21.15.49:0/693482471 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f22440a2c30 0x7f22440a50f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.366 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.365+0000 7f225af3b640 1 --2- 172.21.15.49:0/693482471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22541024b0 0x7f225419f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.365+0000 7f225af3b640 1 --2- 172.21.15.49:0/693482471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2254101af0 0x7f2254198120 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.365+0000 7f225af3b640 1 --2- 172.21.15.49:0/693482471 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2254100900 0x7f2254197be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.365+0000 7f225af3b640 1 -- 172.21.15.49:0/693482471 >> 172.21.15.49:0/693482471 conn(0x7f22540fbe70 msgr2=0x7f22540fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.365+0000 7f225af3b640 1 -- 172.21.15.49:0/693482471 shutdown_connections 2024-06-03T00:03:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:35.365+0000 7f225af3b640 1 -- 172.21.15.49:0/693482471 wait complete. 2024-06-03T00:03:35.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:35 smithi057 ceph-mon[36457]: pgmap v489: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 51 MiB/s rd, 68 MiB/s wr, 184 op/s 2024-06-03T00:03:35.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:35 smithi107 ceph-mon[37048]: pgmap v489: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 51 MiB/s rd, 68 MiB/s wr, 184 op/s 2024-06-03T00:03:35.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.851+0000 7f7f9922c700 1 -- 172.21.15.49:0/4084944871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f941086f0 msgr2=0x7f7f94108ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:35.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.851+0000 7f7f9922c700 1 --2- 172.21.15.49:0/4084944871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f941086f0 0x7f7f94108ad0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7f84009990 tx=0x7f7f84009ca0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.851+0000 7f7f9922c700 1 -- 172.21.15.49:0/4084944871 shutdown_connections 2024-06-03T00:03:35.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.851+0000 7f7f9922c700 1 --2- 172.21.15.49:0/4084944871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f94101440 0x7f7f9410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.851+0000 7f7f9922c700 1 --2- 172.21.15.49:0/4084944871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f941086f0 0x7f7f94108ad0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.851+0000 7f7f9922c700 1 --2- 172.21.15.49:0/4084944871 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f94100a80 0x7f7f94100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.851+0000 7f7f9922c700 1 -- 172.21.15.49:0/4084944871 >> 172.21.15.49:0/4084944871 conn(0x7f7f94077a00 msgr2=0x7f7f940fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:35.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.851+0000 7f7f9922c700 1 -- 172.21.15.49:0/4084944871 shutdown_connections 2024-06-03T00:03:35.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.851+0000 7f7f9922c700 1 -- 172.21.15.49:0/4084944871 wait complete. 2024-06-03T00:03:35.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.852+0000 7f7f9922c700 1 Processor -- start 2024-06-03T00:03:35.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.853+0000 7f7f9922c700 1 -- start start 2024-06-03T00:03:35.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.853+0000 7f7f9922c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f94100a80 0x7f7f94198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.853+0000 7f7f9922c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f94101440 0x7f7f94199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.853+0000 7f7f9922c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f941086f0 0x7f7f9419d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.853+0000 7f7f9922c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7f941129b0 con 0x7f7f94101440 2024-06-03T00:03:35.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.853+0000 7f7f9922c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f7f94112830 con 0x7f7f94100a80 2024-06-03T00:03:35.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.853+0000 7f7f9922c700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7f94112b30 con 0x7f7f941086f0 2024-06-03T00:03:35.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.853+0000 7f7f9259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f94101440 0x7f7f94199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.853+0000 7f7f92d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f94100a80 0x7f7f94198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.853+0000 7f7f92d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f94100a80 0x7f7f94198de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.49:47034/0 (socket says 172.21.15.49:47034) 2024-06-03T00:03:35.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.853+0000 7f7f92d9d700 1 -- 172.21.15.49:0/2815819837 learned_addr learned my addr 172.21.15.49:0/2815819837 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:35.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.853+0000 7f7f9359e700 1 --2- 172.21.15.49:0/2815819837 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f941086f0 0x7f7f9419d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.853+0000 7f7f92d9d700 1 -- 172.21.15.49:0/2815819837 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f941086f0 msgr2=0x7f7f9419d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:35.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.853+0000 7f7f92d9d700 1 --2- 172.21.15.49:0/2815819837 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f941086f0 0x7f7f9419d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.853+0000 7f7f92d9d700 1 -- 172.21.15.49:0/2815819837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f94101440 msgr2=0x7f7f94199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:35.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.853+0000 7f7f92d9d700 1 --2- 172.21.15.49:0/2815819837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f94101440 0x7f7f94199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.853+0000 7f7f92d9d700 1 -- 172.21.15.49:0/2815819837 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f9419ddf0 con 0x7f7f94100a80 2024-06-03T00:03:35.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.853+0000 7f7f92d9d700 1 --2- 172.21.15.49:0/2815819837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f94100a80 0x7f7f94198de0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7f84000c00 tx=0x7f7f8400bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:35.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.854+0000 7f7f7bfff700 1 -- 172.21.15.49:0/2815819837 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f84027070 con 0x7f7f94100a80 2024-06-03T00:03:35.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.854+0000 7f7f7bfff700 1 -- 172.21.15.49:0/2815819837 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f84003d70 con 0x7f7f94100a80 2024-06-03T00:03:35.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.854+0000 7f7f9922c700 1 -- 172.21.15.49:0/2815819837 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f9419e080 con 0x7f7f94100a80 2024-06-03T00:03:35.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.854+0000 7f7f7bfff700 1 -- 172.21.15.49:0/2815819837 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8400f460 con 0x7f7f94100a80 2024-06-03T00:03:35.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.854+0000 7f7f9922c700 1 -- 172.21.15.49:0/2815819837 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f941a5960 con 0x7f7f94100a80 2024-06-03T00:03:35.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.856+0000 7f7f7bfff700 1 -- 172.21.15.49:0/2815819837 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7f8402a070 con 0x7f7f94100a80 2024-06-03T00:03:35.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.857+0000 7f7f7bfff700 1 --2- 172.21.15.49:0/2815819837 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7f7c0a2c20 0x7f7f7c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.857+0000 7f7f9259c700 1 --2- 172.21.15.49:0/2815819837 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7f7c0a2c20 0x7f7f7c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.857+0000 7f7f7bfff700 1 -- 172.21.15.49:0/2815819837 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f7f840cfe20 con 0x7f7f94100a80 2024-06-03T00:03:35.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.857+0000 7f7fa3aafb80 1 Processor -- start 2024-06-03T00:03:35.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.857+0000 7f7f9259c700 1 --2- 172.21.15.49:0/2815819837 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7f7c0a2c20 0x7f7f7c0a50e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7f94107d00 tx=0x7f7f88009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:35.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.857+0000 7f7fa3aafb80 1 -- start start 2024-06-03T00:03:35.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.857+0000 7f7fa3aafb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575c93f4f60 0x5575c93f5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.857+0000 7f7fa3aafb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5575c93f5880 0x5575c93ef260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.857+0000 7f7fa3aafb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5575c93ef7a0 0x5575c93efbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.857+0000 7f7fa3aafb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5575c92e1f60 con 0x5575c93f4f60 2024-06-03T00:03:35.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.857+0000 7f7fa3aafb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5575c9340850 con 0x5575c93f5880 2024-06-03T00:03:35.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.857+0000 7f7fa3aafb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5575c92a8460 con 0x5575c93ef7a0 2024-06-03T00:03:35.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.858+0000 7f7f92d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575c93f4f60 0x5575c93f5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.858+0000 7f7f92d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575c93f4f60 0x5575c93f5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48920/0 (socket says 172.21.15.49:48920) 2024-06-03T00:03:35.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.858+0000 7f7f92d9d700 1 -- 172.21.15.49:0/3746533831 learned_addr learned my addr 172.21.15.49:0/3746533831 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:35.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.858+0000 7f7f9259c700 1 --2- 172.21.15.49:0/3746533831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5575c93f5880 0x5575c93ef260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.858+0000 7f7f92d9d700 1 -- 172.21.15.49:0/3746533831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5575c93ef7a0 msgr2=0x5575c93efbc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-03T00:03:35.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.858+0000 7f7f92d9d700 1 --2- 172.21.15.49:0/3746533831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5575c93ef7a0 0x5575c93efbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.858+0000 7f7f92d9d700 1 -- 172.21.15.49:0/3746533831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5575c93f5880 msgr2=0x5575c93ef260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:35.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.858+0000 7f7f92d9d700 1 --2- 172.21.15.49:0/3746533831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5575c93f5880 0x5575c93ef260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.858+0000 7f7f92d9d700 1 -- 172.21.15.49:0/3746533831 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575c928f8d0 con 0x5575c93f4f60 2024-06-03T00:03:35.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.858+0000 7f7f92d9d700 1 --2- 172.21.15.49:0/3746533831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575c93f4f60 0x5575c93f5340 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f7f8409c6a0 tx=0x7f7f840229a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653d012b7b3e4fd server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:35.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.858+0000 7f7f797fa700 1 -- 172.21.15.49:0/3746533831 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8409c070 con 0x5575c93f4f60 2024-06-03T00:03:35.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.858+0000 7f7f797fa700 1 -- 172.21.15.49:0/3746533831 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f840095d0 con 0x5575c93f4f60 2024-06-03T00:03:35.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.858+0000 7f7f797fa700 1 -- 172.21.15.49:0/3746533831 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8409c970 con 0x5575c93f4f60 2024-06-03T00:03:35.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.859+0000 7f7fa3aafb80 1 -- 172.21.15.49:0/3746533831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575c93f4f60 msgr2=0x5575c93f5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:35.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.859+0000 7f7fa3aafb80 1 --2- 172.21.15.49:0/3746533831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575c93f4f60 0x5575c93f5340 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f7f8409c6a0 tx=0x7f7f840229a0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.859+0000 7f7fa3aafb80 1 -- 172.21.15.49:0/3746533831 shutdown_connections 2024-06-03T00:03:35.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.859+0000 7f7fa3aafb80 1 --2- 172.21.15.49:0/3746533831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5575c93ef7a0 0x5575c93efbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.859+0000 7f7fa3aafb80 1 --2- 172.21.15.49:0/3746533831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575c93f4f60 0x5575c93f5340 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.859+0000 7f7fa3aafb80 1 --2- 172.21.15.49:0/3746533831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5575c93f5880 0x5575c93ef260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.859+0000 7f7fa3aafb80 1 -- 172.21.15.49:0/3746533831 >> 172.21.15.49:0/3746533831 conn(0x5575c931c080 msgr2=0x5575c93ea220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:35.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.859+0000 7f7fa3aafb80 1 -- 172.21.15.49:0/3746533831 shutdown_connections 2024-06-03T00:03:35.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.859+0000 7f7fa3aafb80 1 -- 172.21.15.49:0/3746533831 wait complete. 2024-06-03T00:03:35.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.860+0000 7f7fa3aafb80 1 -- start start 2024-06-03T00:03:35.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.860+0000 7f7fa3aafb80 1 Processor -- start 2024-06-03T00:03:35.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.860+0000 7f7fa3aafb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5575c93ef7a0 0x5575c93fb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.860+0000 7f7fa3aafb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5575c93f4f60 0x5575c93f8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.860+0000 7f7fa3aafb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575c93f5880 0x5575c93f8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.860+0000 7f7fa3aafb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5575c92e0fc0 con 0x5575c93f5880 2024-06-03T00:03:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.860+0000 7f7fa3aafb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5575c933c810 con 0x5575c93ef7a0 2024-06-03T00:03:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.860+0000 7f7fa3aafb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5575c93fc010 con 0x5575c93f4f60 2024-06-03T00:03:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.860+0000 7f7fa3aafb80 10 client.0 _ll_register_callbacks cb 0x5575c92d65b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:03:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.860+0000 7f7f9359e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575c93f5880 0x5575c93f8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.861+0000 7f7f9359e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575c93f5880 0x5575c93f8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48930/0 (socket says 172.21.15.49:48930) 2024-06-03T00:03:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.861+0000 7f7f9359e700 1 -- 172.21.15.49:0/377288455 learned_addr learned my addr 172.21.15.49:0/377288455 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.861+0000 7f7f92d9d700 1 --2- 172.21.15.49:0/377288455 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5575c93ef7a0 0x5575c93fb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.861+0000 7f7f9359e700 1 -- 172.21.15.49:0/377288455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5575c93f4f60 msgr2=0x5575c93f8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.861+0000 7f7f9359e700 1 --2- 172.21.15.49:0/377288455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5575c93f4f60 0x5575c93f8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.861+0000 7f7f9359e700 1 -- 172.21.15.49:0/377288455 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5575c93ef7a0 msgr2=0x5575c93fb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.861+0000 7f7f9359e700 1 --2- 172.21.15.49:0/377288455 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5575c93ef7a0 0x5575c93fb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.861+0000 7f7f9359e700 1 -- 172.21.15.49:0/377288455 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575c9306750 con 0x5575c93f5880 2024-06-03T00:03:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.861+0000 7f7f9359e700 1 --2- 172.21.15.49:0/377288455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575c93f5880 0x5575c93f8dd0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c011d80 tx=0x7f7f8c00f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2320ba4fe6f8042 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.861+0000 7f7f76ff5700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:03:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.861+0000 7f7f76ff5700 1 -- 172.21.15.49:0/377288455 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c019030 con 0x5575c93f5880 2024-06-03T00:03:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.861+0000 7f7fa3aafb80 1 -- 172.21.15.49:0/377288455 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f840095d0 con 0x5575c93f5880 2024-06-03T00:03:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.861+0000 7f7f76ff5700 1 -- 172.21.15.49:0/377288455 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f7f8c0092e0 con 0x5575c93f5880 2024-06-03T00:03:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.862+0000 7f7f76ff5700 1 -- 172.21.15.49:0/377288455 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7f8c003a00 con 0x5575c93f5880 2024-06-03T00:03:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.862+0000 7f7fa3aafb80 10 client.16104 fetch_fsmap learned FSMap version 32 2024-06-03T00:03:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.862+0000 7f7fa3aafb80 1 -- 172.21.15.49:0/377288455 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5575c94067f0 con 0x5575c93f5880 2024-06-03T00:03:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.862+0000 7f7f76ff5700 1 -- 172.21.15.49:0/377288455 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f840095d0 con 0x5575c93f5880 2024-06-03T00:03:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.862+0000 7f7f76ff5700 1 -- 172.21.15.49:0/377288455 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f7f8c007bc0 con 0x5575c93f5880 2024-06-03T00:03:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.862+0000 7f7fa3aafb80 10 client.16104 fetch_fsmap finished waiting for FSMap version 32 2024-06-03T00:03:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.862+0000 7f7fa3aafb80 10 client.16104 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-06-03T00:03:35.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.862+0000 7f7fa3aafb80 20 client.16104 populate_metadata read hostname 'smithi049' 2024-06-03T00:03:35.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.862+0000 7f7fa3aafb80 1 --2- 172.21.15.49:0/377288455 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x5575c9408e80 0x5575c940b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.862+0000 7f7fa3aafb80 4 client.16104 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:03:35.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.862+0000 7f7fa3aafb80 1 -- 172.21.15.49:0/377288455 --> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575c934dd50 con 0x5575c9408e80 2024-06-03T00:03:35.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.863+0000 7f7f92d9d700 1 --2- 172.21.15.49:0/377288455 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x5575c9408e80 0x5575c940b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.863+0000 7f7f76ff5700 10 client.16104 ms_handle_connect on v2:172.21.15.57:6836/230452144 2024-06-03T00:03:35.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.863+0000 7f7f92d9d700 1 --2- 172.21.15.49:0/377288455 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x5575c9408e80 0x5575c940b2e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=67f691a139cf7d5 server_cookie=8e45fee0f1ab2d85 in_seq=0 out_seq=0 2024-06-03T00:03:35.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.864+0000 7f7f76ff5700 1 -- 172.21.15.49:0/377288455 <== mds.3 v2:172.21.15.57:6836/230452144 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5575c934dd50 con 0x5575c9408e80 2024-06-03T00:03:35.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.864+0000 7f7f76ff5700 10 client.16104 handle_command_reply: tid=0 2024-06-03T00:03:35.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.864+0000 7f7fa3aafb80 1 client.16104 shutdown 2024-06-03T00:03:35.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.864+0000 7f7fa3aafb80 1 -- 172.21.15.49:0/377288455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575c93f5880 msgr2=0x5575c93f8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:35.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.864+0000 7f7fa3aafb80 1 --2- 172.21.15.49:0/377288455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575c93f5880 0x5575c93f8dd0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c011d80 tx=0x7f7f8c00f490 comp rx=0 tx=0).stop 2024-06-03T00:03:35.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.864+0000 7f7fa3aafb80 1 -- 172.21.15.49:0/377288455 shutdown_connections 2024-06-03T00:03:35.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.864+0000 7f7fa3aafb80 1 --2- 172.21.15.49:0/377288455 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x5575c9408e80 0x5575c940b2e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.864+0000 7f7fa3aafb80 1 --2- 172.21.15.49:0/377288455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575c93f5880 0x5575c93f8dd0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.864+0000 7f7fa3aafb80 1 --2- 172.21.15.49:0/377288455 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5575c93ef7a0 0x5575c93fb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.864+0000 7f7f76ff5700 0 client.16104 ms_handle_reset on v2:172.21.15.57:6836/230452144 2024-06-03T00:03:35.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.864+0000 7f7fa3aafb80 1 --2- 172.21.15.49:0/377288455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5575c93f4f60 0x5575c93f8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.864+0000 7f7fa3aafb80 1 -- 172.21.15.49:0/377288455 >> 172.21.15.49:0/377288455 conn(0x5575c931c080 msgr2=0x5575c93e9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:35.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.864+0000 7f7fa3aafb80 1 -- 172.21.15.49:0/377288455 shutdown_connections 2024-06-03T00:03:35.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.864+0000 7f7fa3aafb80 1 -- 172.21.15.49:0/377288455 wait complete. 2024-06-03T00:03:35.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.864+0000 7f7fa3aafb80 20 client.16104 trim_cache size 0 max 16384 2024-06-03T00:03:35.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.880+0000 7f7fa3aafb80 1 Processor -- start 2024-06-03T00:03:35.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.880+0000 7f7fa3aafb80 1 -- start start 2024-06-03T00:03:35.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.880+0000 7f7fa3aafb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575c93ef7a0 0x5575c93ef260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.880+0000 7f7fa3aafb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5575c93f4f60 0x5575c93e9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.880+0000 7f7fa3aafb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5575c93f5880 0x5575c93ea3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.880+0000 7f7fa3aafb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7f941aee50 con 0x5575c93ef7a0 2024-06-03T00:03:35.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.880+0000 7f7fa3aafb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f7f941b0a80 con 0x5575c93f4f60 2024-06-03T00:03:35.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.880+0000 7f7fa3aafb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7f941af520 con 0x5575c93f5880 2024-06-03T00:03:35.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.881+0000 7f7f92d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575c93ef7a0 0x5575c93ef260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.881+0000 7f7f92d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575c93ef7a0 0x5575c93ef260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48938/0 (socket says 172.21.15.49:48938) 2024-06-03T00:03:35.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.881+0000 7f7f92d9d700 1 -- 172.21.15.49:0/1670467642 learned_addr learned my addr 172.21.15.49:0/1670467642 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:35.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.881+0000 7f7f9359e700 1 --2- 172.21.15.49:0/1670467642 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5575c93f5880 0x5575c93ea3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.881+0000 7f7f9259c700 1 --2- 172.21.15.49:0/1670467642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5575c93f4f60 0x5575c93e9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.881+0000 7f7f92d9d700 1 -- 172.21.15.49:0/1670467642 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5575c93f5880 msgr2=0x5575c93ea3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:35.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.881+0000 7f7f92d9d700 1 --2- 172.21.15.49:0/1670467642 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5575c93f5880 0x5575c93ea3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.881+0000 7f7f92d9d700 1 -- 172.21.15.49:0/1670467642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5575c93f4f60 msgr2=0x5575c93e9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:35.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.881+0000 7f7f92d9d700 1 --2- 172.21.15.49:0/1670467642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5575c93f4f60 0x5575c93e9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.881+0000 7f7f92d9d700 1 -- 172.21.15.49:0/1670467642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575c93ebbe0 con 0x5575c93ef7a0 2024-06-03T00:03:35.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.881+0000 7f7f92d9d700 1 --2- 172.21.15.49:0/1670467642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575c93ef7a0 0x5575c93ef260 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f7f840990e0 tx=0x7f7f84087040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3115e5c464e8adf3 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:35.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.881+0000 7f7f78ff9700 1 -- 172.21.15.49:0/1670467642 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f840ba070 con 0x5575c93ef7a0 2024-06-03T00:03:35.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.881+0000 7f7f78ff9700 1 -- 172.21.15.49:0/1670467642 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f840a52f0 con 0x5575c93ef7a0 2024-06-03T00:03:35.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.881+0000 7f7f78ff9700 1 -- 172.21.15.49:0/1670467642 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8409aa10 con 0x5575c93ef7a0 2024-06-03T00:03:35.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.882+0000 7f7fa3aafb80 1 -- 172.21.15.49:0/1670467642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575c93ef7a0 msgr2=0x5575c93ef260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:35.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.882+0000 7f7fa3aafb80 1 --2- 172.21.15.49:0/1670467642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575c93ef7a0 0x5575c93ef260 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f7f840990e0 tx=0x7f7f84087040 comp rx=0 tx=0).stop 2024-06-03T00:03:35.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.882+0000 7f7fa3aafb80 1 -- 172.21.15.49:0/1670467642 shutdown_connections 2024-06-03T00:03:35.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.882+0000 7f7fa3aafb80 1 --2- 172.21.15.49:0/1670467642 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5575c93f5880 0x5575c93ea3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.882+0000 7f7fa3aafb80 1 --2- 172.21.15.49:0/1670467642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575c93ef7a0 0x5575c93ef260 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.882+0000 7f7fa3aafb80 1 --2- 172.21.15.49:0/1670467642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5575c93f4f60 0x5575c93e9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.882+0000 7f7fa3aafb80 1 -- 172.21.15.49:0/1670467642 >> 172.21.15.49:0/1670467642 conn(0x5575c931c080 msgr2=0x5575c93f7180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:35.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.882+0000 7f7fa3aafb80 1 -- 172.21.15.49:0/1670467642 shutdown_connections 2024-06-03T00:03:35.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.882+0000 7f7fa3aafb80 1 -- 172.21.15.49:0/1670467642 wait complete. 2024-06-03T00:03:35.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.882+0000 7f7fa3aafb80 1 -- start start 2024-06-03T00:03:35.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.883+0000 7f7fa3aafb80 1 Processor -- start 2024-06-03T00:03:35.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.883+0000 7f7fa3aafb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5575c93ef7a0 0x5575c9401600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.883+0000 7f7fa3aafb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575c93f4f60 0x5575c9401b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.883+0000 7f7fa3aafb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5575c93f5880 0x5575c9410330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.883+0000 7f7fa3aafb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7f941b02f0 con 0x5575c93f4f60 2024-06-03T00:03:35.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.883+0000 7f7fa3aafb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f7f941afbf0 con 0x5575c93f5880 2024-06-03T00:03:35.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.883+0000 7f7fa3aafb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7f941acdd0 con 0x5575c93ef7a0 2024-06-03T00:03:35.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.883+0000 7f7fa3aafb80 10 client.0 _ll_register_callbacks cb 0x5575c92d65b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:03:35.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.883+0000 7f7f9259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575c93f4f60 0x5575c9401b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.883+0000 7f7f92d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5575c93ef7a0 0x5575c9401600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.883+0000 7f7f92d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5575c93ef7a0 0x5575c9401600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:34990/0 (socket says 172.21.15.49:34990) 2024-06-03T00:03:35.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.883+0000 7f7f9259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575c93f4f60 0x5575c9401b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48954/0 (socket says 172.21.15.49:48954) 2024-06-03T00:03:35.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.883+0000 7f7f92d9d700 1 -- 172.21.15.49:0/582640035 learned_addr learned my addr 172.21.15.49:0/582640035 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:35.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.883+0000 7f7f9359e700 1 --2- 172.21.15.49:0/582640035 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5575c93f5880 0x5575c9410330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.883+0000 7f7f92d9d700 1 -- 172.21.15.49:0/582640035 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5575c93f5880 msgr2=0x5575c9410330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:35.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.883+0000 7f7f92d9d700 1 --2- 172.21.15.49:0/582640035 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5575c93f5880 0x5575c9410330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.883+0000 7f7f92d9d700 1 -- 172.21.15.49:0/582640035 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575c93f4f60 msgr2=0x5575c9401b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:35.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.883+0000 7f7f92d9d700 1 --2- 172.21.15.49:0/582640035 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575c93f4f60 0x5575c9401b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.883+0000 7f7f92d9d700 1 -- 172.21.15.49:0/582640035 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575c9410b70 con 0x5575c93ef7a0 2024-06-03T00:03:35.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.883+0000 7f7f9259c700 1 --2- 172.21.15.49:0/582640035 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575c93f4f60 0x5575c9401b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:35.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.884+0000 7f7f92d9d700 1 --2- 172.21.15.49:0/582640035 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5575c93ef7a0 0x5575c9401600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7f84087010 tx=0x7f7f840229a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86261c77c797b630 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:35.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.884+0000 7f7f76ff5700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-06-03T00:03:35.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.884+0000 7f7f76ff5700 1 -- 172.21.15.49:0/582640035 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f840ba070 con 0x5575c93ef7a0 2024-06-03T00:03:35.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.884+0000 7f7f76ff5700 1 -- 172.21.15.49:0/582640035 <== mon.1 v2:172.21.15.107:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f7f8409aa10 con 0x5575c93ef7a0 2024-06-03T00:03:35.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.884+0000 7f7fa3aafb80 1 -- 172.21.15.49:0/582640035 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5575c93482d0 con 0x5575c93ef7a0 2024-06-03T00:03:35.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.884+0000 7f7f76ff5700 1 -- 172.21.15.49:0/582640035 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7f840a0ac0 con 0x5575c93ef7a0 2024-06-03T00:03:35.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.884+0000 7f7fa3aafb80 10 client.25696 fetch_fsmap learned FSMap version 32 2024-06-03T00:03:35.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.884+0000 7f7fa3aafb80 1 -- 172.21.15.49:0/582640035 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5575c9473860 con 0x5575c93ef7a0 2024-06-03T00:03:35.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.884+0000 7f7f76ff5700 1 -- 172.21.15.49:0/582640035 <== mon.1 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5575c93482d0 con 0x5575c93ef7a0 2024-06-03T00:03:35.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.884+0000 7f7f76ff5700 1 -- 172.21.15.49:0/582640035 <== mon.1 v2:172.21.15.107:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f7f840b0ba0 con 0x5575c93ef7a0 2024-06-03T00:03:35.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.884+0000 7f7fa3aafb80 10 client.25696 fetch_fsmap finished waiting for FSMap version 32 2024-06-03T00:03:35.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.884+0000 7f7fa3aafb80 10 client.25696 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-06-03T00:03:35.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.884+0000 7f7fa3aafb80 20 client.25696 populate_metadata read hostname 'smithi049' 2024-06-03T00:03:35.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.884+0000 7f7fa3aafb80 1 --2- 172.21.15.49:0/582640035 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x5575c9408e80 0x5575c9475d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:35.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.884+0000 7f7fa3aafb80 4 client.25696 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-03T00:03:35.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.885+0000 7f7fa3aafb80 1 -- 172.21.15.49:0/582640035 --> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5575c92fbf50 con 0x5575c9408e80 2024-06-03T00:03:35.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.885+0000 7f7f9259c700 1 --2- 172.21.15.49:0/582640035 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x5575c9408e80 0x5575c9475d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:35.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.885+0000 7f7f9259c700 1 --2- 172.21.15.49:0/582640035 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x5575c9408e80 0x5575c9475d70 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=dc8191860aef1568 server_cookie=9049b9b26f5864a5 in_seq=0 out_seq=0 2024-06-03T00:03:35.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.885+0000 7f7f76ff5700 10 client.25696 ms_handle_connect on v2:172.21.15.57:6836/230452144 2024-06-03T00:03:35.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.885+0000 7f7f76ff5700 1 -- 172.21.15.49:0/582640035 <== mds.3 v2:172.21.15.57:6836/230452144 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5575c92fbf50 con 0x5575c9408e80 2024-06-03T00:03:35.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.885+0000 7f7f76ff5700 10 client.25696 handle_command_reply: tid=0 2024-06-03T00:03:35.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.885+0000 7f7fa3aafb80 1 client.25696 shutdown 2024-06-03T00:03:35.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.885+0000 7f7fa3aafb80 1 -- 172.21.15.49:0/582640035 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5575c93ef7a0 msgr2=0x5575c9401600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:35.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.885+0000 7f7fa3aafb80 1 --2- 172.21.15.49:0/582640035 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5575c93ef7a0 0x5575c9401600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7f84087010 tx=0x7f7f840229a0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.885+0000 7f7fa3aafb80 1 -- 172.21.15.49:0/582640035 shutdown_connections 2024-06-03T00:03:35.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.885+0000 7f7fa3aafb80 1 --2- 172.21.15.49:0/582640035 >> [v2:172.21.15.57:6836/230452144,v1:172.21.15.57:6837/230452144] conn(0x5575c9408e80 0x5575c9475d70 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.885+0000 7f7fa3aafb80 1 --2- 172.21.15.49:0/582640035 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5575c93f5880 0x5575c9410330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.885+0000 7f7fa3aafb80 1 --2- 172.21.15.49:0/582640035 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5575c93ef7a0 0x5575c9401600 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.885+0000 7f7fa3aafb80 1 --2- 172.21.15.49:0/582640035 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575c93f4f60 0x5575c9401b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.885+0000 7f7fa3aafb80 1 -- 172.21.15.49:0/582640035 >> 172.21.15.49:0/582640035 conn(0x5575c931c080 msgr2=0x5575c93f5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:35.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.885+0000 7f7f76ff5700 0 client.25696 ms_handle_reset on v2:172.21.15.57:6836/230452144 2024-06-03T00:03:35.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.885+0000 7f7fa3aafb80 1 -- 172.21.15.49:0/582640035 shutdown_connections 2024-06-03T00:03:35.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.885+0000 7f7fa3aafb80 1 -- 172.21.15.49:0/582640035 wait complete. 2024-06-03T00:03:35.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.886+0000 7f7fa3aafb80 20 client.25696 trim_cache size 0 max 16384 2024-06-03T00:03:35.891 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-06-03T00:03:35.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.886+0000 7f7f9922c700 1 -- 172.21.15.49:0/2815819837 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7f7c0a2c20 msgr2=0x7f7f7c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:35.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.886+0000 7f7f9922c700 1 --2- 172.21.15.49:0/2815819837 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7f7c0a2c20 0x7f7f7c0a50e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7f94107d00 tx=0x7f7f88009260 comp rx=0 tx=0).stop 2024-06-03T00:03:35.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.886+0000 7f7f9922c700 1 -- 172.21.15.49:0/2815819837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f94100a80 msgr2=0x7f7f94198de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:35.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.886+0000 7f7f9922c700 1 --2- 172.21.15.49:0/2815819837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f94100a80 0x7f7f94198de0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7f84000c00 tx=0x7f7f8400bab0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.886+0000 7f7f9922c700 1 -- 172.21.15.49:0/2815819837 shutdown_connections 2024-06-03T00:03:35.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.886+0000 7f7f9922c700 1 --2- 172.21.15.49:0/2815819837 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7f7c0a2c20 0x7f7f7c0a50e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.886+0000 7f7f9922c700 1 --2- 172.21.15.49:0/2815819837 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f941086f0 0x7f7f9419d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.886+0000 7f7f9922c700 1 --2- 172.21.15.49:0/2815819837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f94100a80 0x7f7f94198de0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.886+0000 7f7f9922c700 1 --2- 172.21.15.49:0/2815819837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f94101440 0x7f7f94199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:35.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.886+0000 7f7f9922c700 1 -- 172.21.15.49:0/2815819837 >> 172.21.15.49:0/2815819837 conn(0x7f7f94077a00 msgr2=0x7f7f940ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:35.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.886+0000 7f7f9922c700 1 -- 172.21.15.49:0/2815819837 shutdown_connections 2024-06-03T00:03:35.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:35.886+0000 7f7f9922c700 1 -- 172.21.15.49:0/2815819837 wait complete. 2024-06-03T00:03:36.745 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-06-03T00:03:37.031 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:03:37.319 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:37 smithi049 ceph-mon[32302]: pgmap v490: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 75 MiB/s rd, 89 MiB/s wr, 226 op/s 2024-06-03T00:03:37.320 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:37 smithi049 ceph-mon[32302]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:03:37.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:37 smithi057 ceph-mon[36457]: pgmap v490: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 75 MiB/s rd, 89 MiB/s wr, 226 op/s 2024-06-03T00:03:37.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:37 smithi057 ceph-mon[36457]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:03:37.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:37 smithi107 ceph-mon[37048]: pgmap v490: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 75 MiB/s rd, 89 MiB/s wr, 226 op/s 2024-06-03T00:03:37.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:37 smithi107 ceph-mon[37048]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:03:38.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:38 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-03T00:03:38.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:38 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-03T00:03:38.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:38 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-03T00:03:38.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:38 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:03:38.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:38 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-03T00:03:38.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:38 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-03T00:03:38.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:38 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-03T00:03:38.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:38 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:03:38.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:38 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-03T00:03:38.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:38 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-03T00:03:38.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:38 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-03T00:03:38.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:38 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:03:38.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.928+0000 7f460e0fe700 1 -- 172.21.15.49:0/63345228 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f460806abc0 msgr2=0x7f460806b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:38.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.928+0000 7f460e0fe700 1 --2- 172.21.15.49:0/63345228 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f460806abc0 0x7f460806b040 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f45fc009990 tx=0x7f45fc009ca0 comp rx=0 tx=0).stop 2024-06-03T00:03:38.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.928+0000 7f460e0fe700 1 -- 172.21.15.49:0/63345228 shutdown_connections 2024-06-03T00:03:38.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.928+0000 7f460e0fe700 1 --2- 172.21.15.49:0/63345228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f460806b580 0x7f460810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:38.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.928+0000 7f460e0fe700 1 --2- 172.21.15.49:0/63345228 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4608108500 0x7f46081088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:38.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.928+0000 7f460e0fe700 1 --2- 172.21.15.49:0/63345228 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f460806abc0 0x7f460806b040 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:38.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.928+0000 7f460e0fe700 1 -- 172.21.15.49:0/63345228 >> 172.21.15.49:0/63345228 conn(0x7f4608078340 msgr2=0x7f4608078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:38.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.928+0000 7f460e0fe700 1 -- 172.21.15.49:0/63345228 shutdown_connections 2024-06-03T00:03:38.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.928+0000 7f460e0fe700 1 -- 172.21.15.49:0/63345228 wait complete. 2024-06-03T00:03:38.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.929+0000 7f460e0fe700 1 Processor -- start 2024-06-03T00:03:38.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.929+0000 7f460e0fe700 1 -- start start 2024-06-03T00:03:38.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.929+0000 7f460e0fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f460806abc0 0x7f4608101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:38.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.929+0000 7f460e0fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f460806b580 0x7f46081019d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:38.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.929+0000 7f460e0fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4608108500 0x7f4608101f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:38.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.929+0000 7f460e0fe700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4608112780 con 0x7f4608108500 2024-06-03T00:03:38.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.929+0000 7f460e0fe700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f4608112600 con 0x7f460806abc0 2024-06-03T00:03:38.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.929+0000 7f460e0fe700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4608112900 con 0x7f460806b580 2024-06-03T00:03:38.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.929+0000 7f46077fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f460806abc0 0x7f4608101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:38.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.929+0000 7f4606ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f460806b580 0x7f46081019d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:38.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.929+0000 7f4607fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4608108500 0x7f4608101f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:38.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.929+0000 7f46077fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f460806abc0 0x7f4608101490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.49:47102/0 (socket says 172.21.15.49:47102) 2024-06-03T00:03:38.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.929+0000 7f46077fe700 1 -- 172.21.15.49:0/3938449212 learned_addr learned my addr 172.21.15.49:0/3938449212 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:38.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.930+0000 7f4606ffd700 1 -- 172.21.15.49:0/3938449212 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f460806abc0 msgr2=0x7f4608101490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:38.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.930+0000 7f4606ffd700 1 --2- 172.21.15.49:0/3938449212 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f460806abc0 0x7f4608101490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:38.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.930+0000 7f4606ffd700 1 -- 172.21.15.49:0/3938449212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4608108500 msgr2=0x7f4608101f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:38.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.930+0000 7f4606ffd700 1 --2- 172.21.15.49:0/3938449212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4608108500 0x7f4608101f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:38.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.930+0000 7f4606ffd700 1 -- 172.21.15.49:0/3938449212 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46081a71e0 con 0x7f460806b580 2024-06-03T00:03:38.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.930+0000 7f46077fe700 1 --2- 172.21.15.49:0/3938449212 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f460806abc0 0x7f4608101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:38.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.930+0000 7f4607fff700 1 --2- 172.21.15.49:0/3938449212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4608108500 0x7f4608101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:38.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.930+0000 7f4606ffd700 1 --2- 172.21.15.49:0/3938449212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f460806b580 0x7f46081019d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f45fc0059d0 tx=0x7f45fc00bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:38.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.930+0000 7f4604ff9700 1 -- 172.21.15.49:0/3938449212 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc027070 con 0x7f460806b580 2024-06-03T00:03:38.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.930+0000 7f460e0fe700 1 -- 172.21.15.49:0/3938449212 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46081a7470 con 0x7f460806b580 2024-06-03T00:03:38.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.930+0000 7f4604ff9700 1 -- 172.21.15.49:0/3938449212 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45fc003d70 con 0x7f460806b580 2024-06-03T00:03:38.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.930+0000 7f460e0fe700 1 -- 172.21.15.49:0/3938449212 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46081a7920 con 0x7f460806b580 2024-06-03T00:03:38.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.931+0000 7f4604ff9700 1 -- 172.21.15.49:0/3938449212 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc022e30 con 0x7f460806b580 2024-06-03T00:03:38.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.933+0000 7f4604ff9700 1 -- 172.21.15.49:0/3938449212 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f45fc02a070 con 0x7f460806b580 2024-06-03T00:03:38.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.933+0000 7f4604ff9700 1 --2- 172.21.15.49:0/3938449212 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f45f00a2ca0 0x7f45f00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:38.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.934+0000 7f46077fe700 1 --2- 172.21.15.49:0/3938449212 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f45f00a2ca0 0x7f45f00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:38.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.934+0000 7f4604ff9700 1 -- 172.21.15.49:0/3938449212 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f45fc0cfd40 con 0x7f460806b580 2024-06-03T00:03:38.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.934+0000 7f46077fe700 1 --2- 172.21.15.49:0/3938449212 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f45f00a2ca0 0x7f45f00a5160 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f45f8011550 tx=0x7f45f8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:38.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.935+0000 7f4618981b80 1 Processor -- start 2024-06-03T00:03:38.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.935+0000 7f4618981b80 1 -- start start 2024-06-03T00:03:38.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.935+0000 7f4618981b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d791aaf640 0x55d791aafa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:38.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.935+0000 7f4618981b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d791aaff60 0x55d791aa99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:38.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.935+0000 7f4618981b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d791aa9f20 0x55d791aaa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:38.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.935+0000 7f4618981b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55d7919fb810 con 0x55d791aaf640 2024-06-03T00:03:38.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.935+0000 7f4618981b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55d7919a3720 con 0x55d791aa9f20 2024-06-03T00:03:38.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.935+0000 7f4618981b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d7919f77d0 con 0x55d791aaff60 2024-06-03T00:03:38.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.935+0000 7f46077fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d791aaf640 0x55d791aafa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:38.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.935+0000 7f46077fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d791aaf640 0x55d791aafa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48992/0 (socket says 172.21.15.49:48992) 2024-06-03T00:03:38.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.935+0000 7f46077fe700 1 -- 172.21.15.49:0/452387470 learned_addr learned my addr 172.21.15.49:0/452387470 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:38.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.935+0000 7f4607fff700 1 --2- 172.21.15.49:0/452387470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d791aa9f20 0x55d791aaa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:38.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.935+0000 7f4606ffd700 1 --2- 172.21.15.49:0/452387470 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d791aaff60 0x55d791aa99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:38.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.936+0000 7f46077fe700 1 -- 172.21.15.49:0/452387470 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d791aaff60 msgr2=0x55d791aa99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:38.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.936+0000 7f46077fe700 1 --2- 172.21.15.49:0/452387470 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d791aaff60 0x55d791aa99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:38.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.936+0000 7f46077fe700 1 -- 172.21.15.49:0/452387470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d791aa9f20 msgr2=0x55d791aaa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:38.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.936+0000 7f46077fe700 1 --2- 172.21.15.49:0/452387470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d791aa9f20 0x55d791aaa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:38.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.936+0000 7f46077fe700 1 -- 172.21.15.49:0/452387470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d791999f50 con 0x55d791aaf640 2024-06-03T00:03:38.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.936+0000 7f46077fe700 1 --2- 172.21.15.49:0/452387470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d791aaf640 0x55d791aafa20 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f45f800f710 tx=0x7f45f8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffbbe1fb90f71f4d server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:38.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.936+0000 7f45edffb700 1 -- 172.21.15.49:0/452387470 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f8026630 con 0x55d791aaf640 2024-06-03T00:03:38.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.936+0000 7f45edffb700 1 -- 172.21.15.49:0/452387470 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45f801c8f0 con 0x55d791aaf640 2024-06-03T00:03:38.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.936+0000 7f45edffb700 1 -- 172.21.15.49:0/452387470 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f801d910 con 0x55d791aaf640 2024-06-03T00:03:38.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.937+0000 7f4618981b80 1 -- 172.21.15.49:0/452387470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d791aaf640 msgr2=0x55d791aafa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:38.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.937+0000 7f4618981b80 1 --2- 172.21.15.49:0/452387470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d791aaf640 0x55d791aafa20 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f45f800f710 tx=0x7f45f8014000 comp rx=0 tx=0).stop 2024-06-03T00:03:38.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.937+0000 7f4618981b80 1 -- 172.21.15.49:0/452387470 shutdown_connections 2024-06-03T00:03:38.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.937+0000 7f4618981b80 1 --2- 172.21.15.49:0/452387470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d791aa9f20 0x55d791aaa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:38.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.937+0000 7f4618981b80 1 --2- 172.21.15.49:0/452387470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d791aaf640 0x55d791aafa20 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:38.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.937+0000 7f4618981b80 1 --2- 172.21.15.49:0/452387470 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d791aaff60 0x55d791aa99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:38.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.937+0000 7f4618981b80 1 -- 172.21.15.49:0/452387470 >> 172.21.15.49:0/452387470 conn(0x55d7919d4cc0 msgr2=0x55d791aa4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:38.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.937+0000 7f4618981b80 1 -- 172.21.15.49:0/452387470 shutdown_connections 2024-06-03T00:03:38.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.937+0000 7f4618981b80 1 -- 172.21.15.49:0/452387470 wait complete. 2024-06-03T00:03:38.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.937+0000 7f4618981b80 1 -- start start 2024-06-03T00:03:38.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.937+0000 7f4618981b80 1 Processor -- start 2024-06-03T00:03:38.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.938+0000 7f4618981b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d791aa9f20 0x55d791ab5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:38.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.938+0000 7f4618981b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d791aaf640 0x55d791ab3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:38.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.938+0000 7f4618981b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d791aaff60 0x55d791ab3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:38.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.938+0000 7f4618981b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55d791ab69d0 con 0x55d791aaf640 2024-06-03T00:03:38.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.938+0000 7f4618981b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55d79199bbf0 con 0x55d791aaff60 2024-06-03T00:03:38.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.938+0000 7f4618981b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d791ab6b50 con 0x55d791aa9f20 2024-06-03T00:03:38.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.938+0000 7f4618981b80 10 client.0 _ll_register_callbacks cb 0x55d791995920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:03:38.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.938+0000 7f4606ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d791aaf640 0x55d791ab3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:38.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.938+0000 7f4606ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d791aaf640 0x55d791ab3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49000/0 (socket says 172.21.15.49:49000) 2024-06-03T00:03:38.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.938+0000 7f4607fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d791aaff60 0x55d791ab3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:38.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.938+0000 7f4606ffd700 1 -- 172.21.15.49:0/533261683 learned_addr learned my addr 172.21.15.49:0/533261683 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:38.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.938+0000 7f46077fe700 1 --2- 172.21.15.49:0/533261683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d791aa9f20 0x55d791ab5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:38.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.938+0000 7f4606ffd700 1 -- 172.21.15.49:0/533261683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d791aa9f20 msgr2=0x55d791ab5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:38.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.938+0000 7f4606ffd700 1 --2- 172.21.15.49:0/533261683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d791aa9f20 0x55d791ab5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:38.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.938+0000 7f4606ffd700 1 -- 172.21.15.49:0/533261683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d791aaff60 msgr2=0x55d791ab3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:38.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.938+0000 7f4606ffd700 1 --2- 172.21.15.49:0/533261683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d791aaff60 0x55d791ab3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:38.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.938+0000 7f4606ffd700 1 -- 172.21.15.49:0/533261683 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d79194a8d0 con 0x55d791aaf640 2024-06-03T00:03:38.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.938+0000 7f46077fe700 1 --2- 172.21.15.49:0/533261683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d791aa9f20 0x55d791ab5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:03:38.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.938+0000 7f4607fff700 1 --2- 172.21.15.49:0/533261683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d791aaff60 0x55d791ab3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:38.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.938+0000 7f4606ffd700 1 --2- 172.21.15.49:0/533261683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d791aaf640 0x55d791ab3030 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f45fc009990 tx=0x7f45fc022850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379fc170542b3860 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:38.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.939+0000 7f45e6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:03:38.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.939+0000 7f45e6ffd700 1 -- 172.21.15.49:0/533261683 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc09bf90 con 0x55d791aaf640 2024-06-03T00:03:38.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.939+0000 7f45e6ffd700 1 -- 172.21.15.49:0/533261683 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f45fc09a930 con 0x55d791aaf640 2024-06-03T00:03:38.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.939+0000 7f4618981b80 1 -- 172.21.15.49:0/533261683 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45f801c8f0 con 0x55d791aaf640 2024-06-03T00:03:38.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.939+0000 7f45e6ffd700 1 -- 172.21.15.49:0/533261683 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f45fc0095d0 con 0x55d791aaf640 2024-06-03T00:03:38.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.939+0000 7f4618981b80 10 client.16122 fetch_fsmap learned FSMap version 34 2024-06-03T00:03:38.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.939+0000 7f4618981b80 1 -- 172.21.15.49:0/533261683 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d791ac13b0 con 0x55d791aaf640 2024-06-03T00:03:38.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.939+0000 7f45e6ffd700 1 -- 172.21.15.49:0/533261683 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45f801c8f0 con 0x55d791aaf640 2024-06-03T00:03:38.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.939+0000 7f45e6ffd700 1 -- 172.21.15.49:0/533261683 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 34) ==== 8390+0+0 (secure 0 0 0) 0x7f45fc085bc0 con 0x55d791aaf640 2024-06-03T00:03:38.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.939+0000 7f4618981b80 10 client.16122 fetch_fsmap finished waiting for FSMap version 34 2024-06-03T00:03:38.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.939+0000 7f4618981b80 10 client.16122 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-03T00:03:38.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.939+0000 7f4618981b80 20 client.16122 populate_metadata read hostname 'smithi049' 2024-06-03T00:03:38.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.939+0000 7f4618981b80 1 --2- 172.21.15.49:0/533261683 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x55d791ac3970 0x55d791ac5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:38.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.939+0000 7f4618981b80 4 client.16122 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:03:38.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.939+0000 7f4618981b80 1 -- 172.21.15.49:0/533261683 --> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d791a08d10 con 0x55d791ac3970 2024-06-03T00:03:38.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.940+0000 7f46077fe700 1 --2- 172.21.15.49:0/533261683 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x55d791ac3970 0x55d791ac5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:38.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.940+0000 7f46077fe700 1 --2- 172.21.15.49:0/533261683 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x55d791ac3970 0x55d791ac5d90 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9c807bdefc895789 server_cookie=6d5ad33f165c05a0 in_seq=0 out_seq=0 2024-06-03T00:03:38.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.940+0000 7f45e6ffd700 10 client.16122 ms_handle_connect on v2:172.21.15.107:6836/3700593315 2024-06-03T00:03:38.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.941+0000 7f45e6ffd700 1 -- 172.21.15.49:0/533261683 <== mds.2 v2:172.21.15.107:6836/3700593315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55d791a08d10 con 0x55d791ac3970 2024-06-03T00:03:38.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.941+0000 7f45e6ffd700 10 client.16122 handle_command_reply: tid=0 2024-06-03T00:03:38.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.941+0000 7f4618981b80 1 client.16122 shutdown 2024-06-03T00:03:38.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.941+0000 7f4618981b80 1 -- 172.21.15.49:0/533261683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d791aaf640 msgr2=0x55d791ab3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:38.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.941+0000 7f4618981b80 1 --2- 172.21.15.49:0/533261683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d791aaf640 0x55d791ab3030 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f45fc009990 tx=0x7f45fc022850 comp rx=0 tx=0).stop 2024-06-03T00:03:38.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.941+0000 7f4618981b80 1 -- 172.21.15.49:0/533261683 shutdown_connections 2024-06-03T00:03:38.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.941+0000 7f4618981b80 1 --2- 172.21.15.49:0/533261683 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x55d791ac3970 0x55d791ac5d90 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:38.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.941+0000 7f4618981b80 1 --2- 172.21.15.49:0/533261683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d791aaff60 0x55d791ab3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:38.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.941+0000 7f4618981b80 1 --2- 172.21.15.49:0/533261683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d791aa9f20 0x55d791ab5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:38.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.941+0000 7f4618981b80 1 --2- 172.21.15.49:0/533261683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d791aaf640 0x55d791ab3030 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:38.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.941+0000 7f4618981b80 1 -- 172.21.15.49:0/533261683 >> 172.21.15.49:0/533261683 conn(0x55d7919d4cc0 msgr2=0x55d791aa45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:38.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.941+0000 7f45e6ffd700 0 client.16122 ms_handle_reset on v2:172.21.15.107:6836/3700593315 2024-06-03T00:03:38.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.941+0000 7f4618981b80 1 -- 172.21.15.49:0/533261683 shutdown_connections 2024-06-03T00:03:38.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.941+0000 7f4618981b80 1 -- 172.21.15.49:0/533261683 wait complete. 2024-06-03T00:03:38.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.941+0000 7f4618981b80 20 client.16122 trim_cache size 0 max 16384 2024-06-03T00:03:38.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.957+0000 7f4618981b80 1 Processor -- start 2024-06-03T00:03:38.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.957+0000 7f4618981b80 1 -- start start 2024-06-03T00:03:38.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.957+0000 7f4618981b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d791aa9f20 0x55d791aa99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:38.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.957+0000 7f4618981b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d791aaf640 0x55d791ab0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:38.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.957+0000 7f4618981b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d791aaff60 0x55d791a9e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:38.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.957+0000 7f4618981b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f46081aec60 con 0x55d791aaf640 2024-06-03T00:03:38.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.957+0000 7f4618981b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f46081b0920 con 0x55d791aa9f20 2024-06-03T00:03:38.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.957+0000 7f4618981b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f46081af330 con 0x55d791aaff60 2024-06-03T00:03:38.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.957+0000 7f4606ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d791aaf640 0x55d791ab0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:38.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.957+0000 7f46077fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d791aa9f20 0x55d791aa99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:38.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.958+0000 7f4606ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d791aaf640 0x55d791ab0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49006/0 (socket says 172.21.15.49:49006) 2024-06-03T00:03:38.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.958+0000 7f4606ffd700 1 -- 172.21.15.49:0/2881926385 learned_addr learned my addr 172.21.15.49:0/2881926385 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:38.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.958+0000 7f46077fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d791aa9f20 0x55d791aa99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.49:47128/0 (socket says 172.21.15.49:47128) 2024-06-03T00:03:38.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.958+0000 7f4607fff700 1 --2- 172.21.15.49:0/2881926385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d791aaff60 0x55d791a9e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:38.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.958+0000 7f4606ffd700 1 -- 172.21.15.49:0/2881926385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d791aaff60 msgr2=0x55d791a9e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:38.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.958+0000 7f4606ffd700 1 --2- 172.21.15.49:0/2881926385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d791aaff60 0x55d791a9e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:38.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.958+0000 7f4606ffd700 1 -- 172.21.15.49:0/2881926385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d791aa9f20 msgr2=0x55d791aa99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:38.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.958+0000 7f4606ffd700 1 --2- 172.21.15.49:0/2881926385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d791aa9f20 0x55d791aa99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:38.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.958+0000 7f4606ffd700 1 -- 172.21.15.49:0/2881926385 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d791a9f3b0 con 0x55d791aaf640 2024-06-03T00:03:38.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.958+0000 7f46077fe700 1 --2- 172.21.15.49:0/2881926385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d791aa9f20 0x55d791aa99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:38.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.958+0000 7f4606ffd700 1 --2- 172.21.15.49:0/2881926385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d791aaf640 0x55d791ab0bd0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f45fc098a90 tx=0x7f45fc0227b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d46c188ab7d6c49 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:38.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.958+0000 7f45ed7fa700 1 -- 172.21.15.49:0/2881926385 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc087070 con 0x55d791aaf640 2024-06-03T00:03:38.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.958+0000 7f45ed7fa700 1 -- 172.21.15.49:0/2881926385 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45fc09cd30 con 0x55d791aaf640 2024-06-03T00:03:38.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.958+0000 7f45ed7fa700 1 -- 172.21.15.49:0/2881926385 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc09a930 con 0x55d791aaf640 2024-06-03T00:03:38.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.959+0000 7f4618981b80 1 -- 172.21.15.49:0/2881926385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d791aaf640 msgr2=0x55d791ab0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:38.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.959+0000 7f4618981b80 1 --2- 172.21.15.49:0/2881926385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d791aaf640 0x55d791ab0bd0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f45fc098a90 tx=0x7f45fc0227b0 comp rx=0 tx=0).stop 2024-06-03T00:03:38.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.959+0000 7f4618981b80 1 -- 172.21.15.49:0/2881926385 shutdown_connections 2024-06-03T00:03:38.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.959+0000 7f4618981b80 1 --2- 172.21.15.49:0/2881926385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d791aaff60 0x55d791a9e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:38.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.959+0000 7f4618981b80 1 --2- 172.21.15.49:0/2881926385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d791aa9f20 0x55d791aa99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:38.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.959+0000 7f4618981b80 1 --2- 172.21.15.49:0/2881926385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d791aaf640 0x55d791ab0bd0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:38.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.959+0000 7f4618981b80 1 -- 172.21.15.49:0/2881926385 >> 172.21.15.49:0/2881926385 conn(0x55d7919d4cc0 msgr2=0x55d791a9de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:38.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.959+0000 7f4618981b80 1 -- 172.21.15.49:0/2881926385 shutdown_connections 2024-06-03T00:03:38.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.959+0000 7f4618981b80 1 -- 172.21.15.49:0/2881926385 wait complete. 2024-06-03T00:03:38.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.959+0000 7f4618981b80 1 -- start start 2024-06-03T00:03:38.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.960+0000 7f4618981b80 1 Processor -- start 2024-06-03T00:03:38.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.960+0000 7f4618981b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d791aa9f20 0x55d791ab6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:38.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.960+0000 7f4618981b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d791aaf640 0x55d791ab7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:38.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.960+0000 7f4618981b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d791aaff60 0x55d791ab7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:38.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.960+0000 7f4618981b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f46081b0190 con 0x55d791aa9f20 2024-06-03T00:03:38.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.960+0000 7f4618981b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f46081afa30 con 0x55d791aaff60 2024-06-03T00:03:38.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.960+0000 7f4618981b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f46081acc20 con 0x55d791aaf640 2024-06-03T00:03:38.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.960+0000 7f46077fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d791aa9f20 0x55d791ab6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:38.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.960+0000 7f46077fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d791aa9f20 0x55d791ab6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49012/0 (socket says 172.21.15.49:49012) 2024-06-03T00:03:38.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.960+0000 7f46077fe700 1 -- 172.21.15.49:0/1412767407 learned_addr learned my addr 172.21.15.49:0/1412767407 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:38.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.960+0000 7f4618981b80 10 client.0 _ll_register_callbacks cb 0x55d791995920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:03:38.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.960+0000 7f4606ffd700 1 --2- 172.21.15.49:0/1412767407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d791aaf640 0x55d791ab7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:38.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.960+0000 7f4607fff700 1 --2- 172.21.15.49:0/1412767407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d791aaff60 0x55d791ab7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:38.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.960+0000 7f46077fe700 1 -- 172.21.15.49:0/1412767407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d791aaf640 msgr2=0x55d791ab7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:38.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.960+0000 7f46077fe700 1 --2- 172.21.15.49:0/1412767407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d791aaf640 0x55d791ab7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:38.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.960+0000 7f46077fe700 1 -- 172.21.15.49:0/1412767407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d791aaff60 msgr2=0x55d791ab7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:38.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.960+0000 7f46077fe700 1 --2- 172.21.15.49:0/1412767407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d791aaff60 0x55d791ab7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:38.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.960+0000 7f46077fe700 1 -- 172.21.15.49:0/1412767407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d791b2c670 con 0x55d791aa9f20 2024-06-03T00:03:38.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.961+0000 7f46077fe700 1 --2- 172.21.15.49:0/1412767407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d791aa9f20 0x55d791ab6e00 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f45f800fd00 tx=0x7f45f8005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d3da8d50155268 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:38.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.961+0000 7f45e6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:03:38.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.961+0000 7f45e6ffd700 1 -- 172.21.15.49:0/1412767407 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f8035070 con 0x55d791aa9f20 2024-06-03T00:03:38.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.961+0000 7f45e6ffd700 1 -- 172.21.15.49:0/1412767407 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f45f800fe30 con 0x55d791aa9f20 2024-06-03T00:03:38.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.961+0000 7f4618981b80 1 -- 172.21.15.49:0/1412767407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45fc09cd30 con 0x55d791aa9f20 2024-06-03T00:03:38.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.961+0000 7f45e6ffd700 1 -- 172.21.15.49:0/1412767407 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f45f8041050 con 0x55d791aa9f20 2024-06-03T00:03:38.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.961+0000 7f4618981b80 10 client.16128 fetch_fsmap learned FSMap version 34 2024-06-03T00:03:38.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.961+0000 7f4618981b80 1 -- 172.21.15.49:0/1412767407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d791b2d970 con 0x55d791aa9f20 2024-06-03T00:03:38.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.961+0000 7f45e6ffd700 1 -- 172.21.15.49:0/1412767407 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45f801c8f0 con 0x55d791aa9f20 2024-06-03T00:03:38.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.961+0000 7f45e6ffd700 1 -- 172.21.15.49:0/1412767407 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 34) ==== 8390+0+0 (secure 0 0 0) 0x7f45f8004710 con 0x55d791aa9f20 2024-06-03T00:03:38.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.961+0000 7f4618981b80 10 client.16128 fetch_fsmap finished waiting for FSMap version 34 2024-06-03T00:03:38.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.961+0000 7f4618981b80 10 client.16128 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-03T00:03:38.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.961+0000 7f4618981b80 20 client.16128 populate_metadata read hostname 'smithi049' 2024-06-03T00:03:38.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.961+0000 7f4618981b80 1 --2- 172.21.15.49:0/1412767407 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x55d791b2dd70 0x55d791b30190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:38.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.961+0000 7f4618981b80 4 client.16128 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-03T00:03:38.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.961+0000 7f4618981b80 1 -- 172.21.15.49:0/1412767407 --> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f45fc09cd30 con 0x55d791b2dd70 2024-06-03T00:03:38.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.962+0000 7f4606ffd700 1 --2- 172.21.15.49:0/1412767407 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x55d791b2dd70 0x55d791b30190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:38.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.962+0000 7f4606ffd700 1 --2- 172.21.15.49:0/1412767407 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x55d791b2dd70 0x55d791b30190 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ab41a7e819e8fdeb server_cookie=1e609e7bb907a4a8 in_seq=0 out_seq=0 2024-06-03T00:03:38.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.962+0000 7f45e6ffd700 10 client.16128 ms_handle_connect on v2:172.21.15.107:6836/3700593315 2024-06-03T00:03:38.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.968+0000 7f45e6ffd700 1 -- 172.21.15.49:0/1412767407 <== mds.2 v2:172.21.15.107:6836/3700593315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+276789 (crc 0 0 0) 0x7f45fc09cd30 con 0x55d791b2dd70 2024-06-03T00:03:38.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.968+0000 7f45e6ffd700 10 client.16128 handle_command_reply: tid=0 2024-06-03T00:03:38.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.968+0000 7f4618981b80 1 client.16128 shutdown 2024-06-03T00:03:38.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.968+0000 7f4618981b80 1 -- 172.21.15.49:0/1412767407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d791aa9f20 msgr2=0x55d791ab6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:38.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.968+0000 7f4618981b80 1 --2- 172.21.15.49:0/1412767407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d791aa9f20 0x55d791ab6e00 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f45f800fd00 tx=0x7f45f8005d30 comp rx=0 tx=0).stop 2024-06-03T00:03:38.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.968+0000 7f4618981b80 1 -- 172.21.15.49:0/1412767407 shutdown_connections 2024-06-03T00:03:38.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.968+0000 7f4618981b80 1 --2- 172.21.15.49:0/1412767407 >> [v2:172.21.15.107:6836/3700593315,v1:172.21.15.107:6837/3700593315] conn(0x55d791b2dd70 0x55d791b30190 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:38.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.968+0000 7f4618981b80 1 --2- 172.21.15.49:0/1412767407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d791aaff60 0x55d791ab7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:38.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.968+0000 7f4618981b80 1 --2- 172.21.15.49:0/1412767407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d791aa9f20 0x55d791ab6e00 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:38.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.968+0000 7f45e6ffd700 0 client.16128 ms_handle_reset on v2:172.21.15.107:6836/3700593315 2024-06-03T00:03:38.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.968+0000 7f4618981b80 1 --2- 172.21.15.49:0/1412767407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d791aaf640 0x55d791ab7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:38.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.968+0000 7f4618981b80 1 -- 172.21.15.49:0/1412767407 >> 172.21.15.49:0/1412767407 conn(0x55d7919d4cc0 msgr2=0x55d791ab0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:38.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.968+0000 7f4618981b80 1 -- 172.21.15.49:0/1412767407 shutdown_connections 2024-06-03T00:03:38.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.968+0000 7f4618981b80 1 -- 172.21.15.49:0/1412767407 wait complete. 2024-06-03T00:03:38.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:38.968+0000 7f4618981b80 20 client.16128 trim_cache size 0 max 16384 2024-06-03T00:03:38.970 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-06-03T00:03:38.970 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.970 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.970 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 54637, 2024-06-03T00:03:38.970 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632018, 2024-06-03T00:03:38.970 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset013.c" 2024-06-03T00:03:38.970 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.970 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.970 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.971 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 12261042, 2024-06-03T00:03:38.971 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632658, 2024-06-03T00:03:38.971 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/6-1.c" 2024-06-03T00:03:38.971 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.971 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.971 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.971 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 16139787, 2024-06-03T00:03:38.971 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632806, 2024-06-03T00:03:38.971 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/11-1.c" 2024-06-03T00:03:38.971 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.971 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.972 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.972 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 17543119, 2024-06-03T00:03:38.972 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631958, 2024-06-03T00:03:38.972 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_event.map" 2024-06-03T00:03:38.972 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.972 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.972 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.972 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 29180956, 2024-06-03T00:03:38.972 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634186, 2024-06-03T00:03:38.972 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-6.c" 2024-06-03T00:03:38.972 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.972 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.973 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.973 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 31395387, 2024-06-03T00:03:38.973 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632807, 2024-06-03T00:03:38.973 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/17-1.c" 2024-06-03T00:03:38.973 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.973 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.973 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.973 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 33827552, 2024-06-03T00:03:38.973 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632032, 2024-06-03T00:03:38.973 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget036.c" 2024-06-03T00:03:38.973 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.973 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.973 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.973 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 41334615, 2024-06-03T00:03:38.974 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634060, 2024-06-03T00:03:38.974 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-13.c" 2024-06-03T00:03:38.974 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.974 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.974 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.974 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 45976560, 2024-06-03T00:03:38.974 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632060, 2024-06-03T00:03:38.974 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset006.c" 2024-06-03T00:03:38.974 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.974 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.974 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.974 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 51593558, 2024-06-03T00:03:38.974 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632173, 2024-06-03T00:03:38.974 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_fumi_func.c" 2024-06-03T00:03:38.975 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.975 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.975 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.975 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 55099919, 2024-06-03T00:03:38.975 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633891, 2024-06-03T00:03:38.975 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-3.c" 2024-06-03T00:03:38.975 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.975 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.975 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.975 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 63739188, 2024-06-03T00:03:38.975 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632677, 2024-06-03T00:03:38.975 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/25-1.c" 2024-06-03T00:03:38.975 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.975 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.976 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.976 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 64738496, 2024-06-03T00:03:38.976 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631888, 2024-06-03T00:03:38.976 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con_smi.h" 2024-06-03T00:03:38.976 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.976 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.976 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.976 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 71271374, 2024-06-03T00:03:38.976 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632168, 2024-06-03T00:03:38.976 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_el.c" 2024-06-03T00:03:38.976 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.976 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.976 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.976 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 72510404, 2024-06-03T00:03:38.977 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632101, 2024-06-03T00:03:38.977 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_annunciator.h" 2024-06-03T00:03:38.977 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.977 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.977 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.977 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 73088634, 2024-06-03T00:03:38.977 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631857, 2024-06-03T00:03:38.977 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_domain.cpp" 2024-06-03T00:03:38.977 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.977 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.977 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.977 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 75491167, 2024-06-03T00:03:38.977 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632141, 2024-06-03T00:03:38.978 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_injector.c" 2024-06-03T00:03:38.978 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.978 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.978 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.978 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 80389055, 2024-06-03T00:03:38.978 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634123, 2024-06-03T00:03:38.978 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-8.c" 2024-06-03T00:03:38.978 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.978 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.978 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.978 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 86961974, 2024-06-03T00:03:38.978 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632863, 2024-06-03T00:03:38.978 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/assertions.xml" 2024-06-03T00:03:38.979 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.979 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.979 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.979 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 87074026, 2024-06-03T00:03:38.979 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632777, 2024-06-03T00:03:38.979 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/48-1.c" 2024-06-03T00:03:38.979 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.979 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.979 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.979 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 87792692, 2024-06-03T00:03:38.979 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633743, 2024-06-03T00:03:38.979 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-89.c" 2024-06-03T00:03:38.979 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.979 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.980 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.980 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 92761791, 2024-06-03T00:03:38.980 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633925, 2024-06-03T00:03:38.980 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-1.c" 2024-06-03T00:03:38.980 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.980 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.980 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.980 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 106151803, 2024-06-03T00:03:38.980 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631889, 2024-06-03T00:03:38.980 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_utils.cpp" 2024-06-03T00:03:38.980 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.980 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.980 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.980 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 109242840, 2024-06-03T00:03:38.980 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631832, 2024-06-03T00:03:38.981 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/ipmi_thres_test.c" 2024-06-03T00:03:38.981 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.981 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.981 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.981 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 110045306, 2024-06-03T00:03:38.981 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633849, 2024-06-03T00:03:38.981 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-11.c" 2024-06-03T00:03:38.981 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.981 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.981 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.981 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 110959580, 2024-06-03T00:03:38.981 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632688, 2024-06-03T00:03:38.981 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/35-2.c" 2024-06-03T00:03:38.981 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.982 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.982 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.982 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 114232626, 2024-06-03T00:03:38.982 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631909, 2024-06-03T00:03:38.982 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con.cpp" 2024-06-03T00:03:38.982 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.982 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.982 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.982 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 114550766, 2024-06-03T00:03:38.982 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632735, 2024-06-03T00:03:38.982 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/31-1.c" 2024-06-03T00:03:38.982 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.982 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.982 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.983 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 123417474, 2024-06-03T00:03:38.983 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633972, 2024-06-03T00:03:38.983 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-17.c" 2024-06-03T00:03:38.983 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.983 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.983 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.983 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 128935442, 2024-06-03T00:03:38.983 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631918, 2024-06-03T00:03:38.983 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_event.h" 2024-06-03T00:03:38.983 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.983 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.983 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.983 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 129501298, 2024-06-03T00:03:38.983 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634162, 2024-06-03T00:03:38.984 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-13.c" 2024-06-03T00:03:38.984 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.984 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.984 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.984 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 132386555, 2024-06-03T00:03:38.984 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632003, 2024-06-03T00:03:38.984 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/sim_resources.c" 2024-06-03T00:03:38.984 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.984 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.984 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.984 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 142916149, 2024-06-03T00:03:38.984 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632638, 2024-06-03T00:03:38.984 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/4-1.c" 2024-06-03T00:03:38.984 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.985 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.985 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.985 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 148563083, 2024-06-03T00:03:38.985 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632053, 2024-06-03T00:03:38.985 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsnmp_bc_getset.c" 2024-06-03T00:03:38.985 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.985 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.985 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.985 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 149785335, 2024-06-03T00:03:38.985 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632648, 2024-06-03T00:03:38.985 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/24-1.c" 2024-06-03T00:03:38.985 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.985 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.985 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.986 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 151709130, 2024-06-03T00:03:38.986 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631997, 2024-06-03T00:03:38.986 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/sim_file.c" 2024-06-03T00:03:38.986 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.986 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.986 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.986 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 158063279, 2024-06-03T00:03:38.986 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632182, 2024-06-03T00:03:38.986 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_013.c" 2024-06-03T00:03:38.986 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.986 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.986 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.986 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 161851472, 2024-06-03T00:03:38.987 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634023, 2024-06-03T00:03:38.987 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-20.c" 2024-06-03T00:03:38.987 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.987 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.987 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.987 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 172890539, 2024-06-03T00:03:38.987 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632624, 2024-06-03T00:03:38.987 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/unistd_h/2-1.c" 2024-06-03T00:03:38.987 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.987 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.987 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.987 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 182446541, 2024-06-03T00:03:38.987 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632228, 2024-06-03T00:03:38.987 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_037.c" 2024-06-03T00:03:38.988 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.988 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.988 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.988 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 186046609, 2024-06-03T00:03:38.988 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634199, 2024-06-03T00:03:38.988 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/11-1.c" 2024-06-03T00:03:38.988 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.988 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.988 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.988 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 191906293, 2024-06-03T00:03:38.988 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631899, 2024-06-03T00:03:38.988 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/array.h" 2024-06-03T00:03:38.988 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.988 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.989 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.989 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 194292123, 2024-06-03T00:03:38.989 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634170, 2024-06-03T00:03:38.989 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-5.c" 2024-06-03T00:03:38.989 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.989 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.989 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.989 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 197859930, 2024-06-03T00:03:38.989 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634188, 2024-06-03T00:03:38.989 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-5.c" 2024-06-03T00:03:38.989 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.989 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.989 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.989 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 206140719, 2024-06-03T00:03:38.990 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631922, 2024-06-03T00:03:38.990 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t" 2024-06-03T00:03:38.990 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.990 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.990 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.990 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 207457197, 2024-06-03T00:03:38.990 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633815, 2024-06-03T00:03:38.990 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-37.c" 2024-06-03T00:03:38.990 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.990 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.990 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.990 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 207732118, 2024-06-03T00:03:38.990 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632767, 2024-06-03T00:03:38.990 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/49-1.c" 2024-06-03T00:03:38.991 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.991 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.991 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.991 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 218348154, 2024-06-03T00:03:38.991 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631903, 2024-06-03T00:03:38.991 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sel.cpp" 2024-06-03T00:03:38.991 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.991 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.991 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.991 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 232216448, 2024-06-03T00:03:38.991 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632164, 2024-06-03T00:03:38.991 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_hotswap.c" 2024-06-03T00:03:38.991 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.992 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.992 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.992 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 235826801, 2024-06-03T00:03:38.992 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631951, 2024-06-03T00:03:38.992 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_hotswap.h" 2024-06-03T00:03:38.992 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.992 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.992 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.992 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 243043129, 2024-06-03T00:03:38.992 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634044, 2024-06-03T00:03:38.992 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-8.c" 2024-06-03T00:03:38.992 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.992 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.992 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.993 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 244230190, 2024-06-03T00:03:38.993 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632000, 2024-06-03T00:03:38.993 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset010.c" 2024-06-03T00:03:38.993 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.993 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.993 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.993 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 245430495, 2024-06-03T00:03:38.993 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634217, 2024-06-03T00:03:38.993 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-13.c" 2024-06-03T00:03:38.993 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.993 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.993 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.993 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 248814960, 2024-06-03T00:03:38.993 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632627, 2024-06-03T00:03:38.993 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h" 2024-06-03T00:03:38.994 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.994 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.994 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.994 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 250392679, 2024-06-03T00:03:38.994 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632666, 2024-06-03T00:03:38.994 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/8-1.c" 2024-06-03T00:03:38.994 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.994 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.994 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.994 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 250746357, 2024-06-03T00:03:38.994 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632193, 2024-06-03T00:03:38.994 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_018.c" 2024-06-03T00:03:38.994 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.995 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.995 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.995 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 252232035, 2024-06-03T00:03:38.995 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634166, 2024-06-03T00:03:38.995 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-21.c" 2024-06-03T00:03:38.995 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.995 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.995 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.995 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 258156979, 2024-06-03T00:03:38.995 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632630, 2024-06-03T00:03:38.995 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/10-1.c" 2024-06-03T00:03:38.995 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.995 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.995 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.996 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 259871290, 2024-06-03T00:03:38.996 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632208, 2024-06-03T00:03:38.996 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_006.c" 2024-06-03T00:03:38.996 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.996 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.996 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.996 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 270955611, 2024-06-03T00:03:38.996 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631973, 2024-06-03T00:03:38.996 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_resources_rsa.c" 2024-06-03T00:03:38.996 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.996 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.996 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.996 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 276823329, 2024-06-03T00:03:38.997 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632852, 2024-06-03T00:03:38.997 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h" 2024-06-03T00:03:38.997 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.997 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.997 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.997 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 277240546, 2024-06-03T00:03:38.997 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632840, 2024-06-03T00:03:38.997 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/17-1.c" 2024-06-03T00:03:38.997 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.997 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.997 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.997 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 278341881, 2024-06-03T00:03:38.997 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632196, 2024-06-03T00:03:38.997 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_044.c" 2024-06-03T00:03:38.998 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.998 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.998 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.998 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 290067550, 2024-06-03T00:03:38.998 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631966, 2024-06-03T00:03:38.998 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc.h" 2024-06-03T00:03:38.998 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.998 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.998 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.998 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 290512184, 2024-06-03T00:03:38.998 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632847, 2024-06-03T00:03:38.998 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/1-1.c" 2024-06-03T00:03:38.998 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.999 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.999 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.999 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 297570082, 2024-06-03T00:03:38.999 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633831, 2024-06-03T00:03:38.999 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-3.c" 2024-06-03T00:03:38.999 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.999 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.999 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:38.999 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 299515966, 2024-06-03T00:03:38.999 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632775, 2024-06-03T00:03:38.999 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-37.c" 2024-06-03T00:03:38.999 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:38.999 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:38.999 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.000 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 299657505, 2024-06-03T00:03:39.000 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632889, 2024-06-03T00:03:39.000 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/6-1.c" 2024-06-03T00:03:39.000 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.000 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.000 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.000 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 301600258, 2024-06-03T00:03:39.000 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632741, 2024-06-03T00:03:39.000 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-27.c" 2024-06-03T00:03:39.000 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.000 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.000 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.000 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 303485794, 2024-06-03T00:03:39.001 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632254, 2024-06-03T00:03:39.001 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_annunciator.c" 2024-06-03T00:03:39.001 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.001 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.001 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.001 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 310080879, 2024-06-03T00:03:39.001 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633746, 2024-06-03T00:03:39.001 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-18.c" 2024-06-03T00:03:39.001 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.001 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.001 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.001 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 315543412, 2024-06-03T00:03:39.001 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632013, 2024-06-03T00:03:39.002 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget016.c" 2024-06-03T00:03:39.002 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.002 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.002 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.002 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 323023897, 2024-06-03T00:03:39.002 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633793, 2024-06-03T00:03:39.002 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-67.c" 2024-06-03T00:03:39.002 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.002 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.002 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.002 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 324403374, 2024-06-03T00:03:39.002 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632839, 2024-06-03T00:03:39.002 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/11-1.c" 2024-06-03T00:03:39.002 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.003 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.003 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.003 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 336115842, 2024-06-03T00:03:39.003 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633742, 2024-06-03T00:03:39.003 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-14.c" 2024-06-03T00:03:39.003 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.003 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.003 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.003 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 338003230, 2024-06-03T00:03:39.003 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632023, 2024-06-03T00:03:39.003 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/snmp_utils.c" 2024-06-03T00:03:39.003 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.003 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.004 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.004 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 348440545, 2024-06-03T00:03:39.004 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632153, 2024-06-03T00:03:39.004 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_controls.h" 2024-06-03T00:03:39.004 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.004 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.004 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.004 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 352554818, 2024-06-03T00:03:39.004 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633892, 2024-06-03T00:03:39.004 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-13.c" 2024-06-03T00:03:39.004 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.004 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.004 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.004 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 353142183, 2024-06-03T00:03:39.005 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633791, 2024-06-03T00:03:39.005 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-6.c" 2024-06-03T00:03:39.005 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.005 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.005 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.005 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 354981749, 2024-06-03T00:03:39.005 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632236, 2024-06-03T00:03:39.005 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_watchdog.c" 2024-06-03T00:03:39.005 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.005 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.005 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.005 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 357135045, 2024-06-03T00:03:39.005 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633745, 2024-06-03T00:03:39.006 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-48.c" 2024-06-03T00:03:39.006 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.006 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.006 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.006 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 363906489, 2024-06-03T00:03:39.006 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633949, 2024-06-03T00:03:39.006 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-18.c" 2024-06-03T00:03:39.006 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.006 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.006 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.006 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 368072027, 2024-06-03T00:03:39.006 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633882, 2024-06-03T00:03:39.006 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-26.c" 2024-06-03T00:03:39.007 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.007 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.007 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.007 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 380424830, 2024-06-03T00:03:39.007 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632204, 2024-06-03T00:03:39.007 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_041.c" 2024-06-03T00:03:39.007 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.009 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.009 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.009 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 383174411, 2024-06-03T00:03:39.009 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632717, 2024-06-03T00:03:39.009 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-2.c" 2024-06-03T00:03:39.010 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.010 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.010 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.010 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 383388290, 2024-06-03T00:03:39.010 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631830, 2024-06-03T00:03:39.010 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_slot_rdrs.c" 2024-06-03T00:03:39.010 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.010 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.010 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.010 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 384919773, 2024-06-03T00:03:39.010 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633991, 2024-06-03T00:03:39.012 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-26.c" 2024-06-03T00:03:39.012 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.012 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.012 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.012 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 392467402, 2024-06-03T00:03:39.013 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631845, 2024-06-03T00:03:39.013 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con_smi.cpp" 2024-06-03T00:03:39.013 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.013 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.013 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.013 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 395902921, 2024-06-03T00:03:39.013 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631819, 2024-06-03T00:03:39.013 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/posix_vlog.c" 2024-06-03T00:03:39.013 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.013 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.013 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.013 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 397434866, 2024-06-03T00:03:39.013 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632759, 2024-06-03T00:03:39.013 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-12.c" 2024-06-03T00:03:39.014 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.014 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.014 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.014 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 397736548, 2024-06-03T00:03:39.014 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631838, 2024-06-03T00:03:39.014 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/watchdog/watchdog.c" 2024-06-03T00:03:39.014 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.014 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.014 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.014 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 400490852, 2024-06-03T00:03:39.014 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632147, 2024-06-03T00:03:39.014 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_sensors.c" 2024-06-03T00:03:39.014 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.014 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.015 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.015 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 403520695, 2024-06-03T00:03:39.015 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632757, 2024-06-03T00:03:39.015 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-5.c" 2024-06-03T00:03:39.015 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.015 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.015 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.015 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 404547891, 2024-06-03T00:03:39.015 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632221, 2024-06-03T00:03:39.015 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_038.c" 2024-06-03T00:03:39.015 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.015 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.015 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.015 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 407362729, 2024-06-03T00:03:39.016 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631974, 2024-06-03T00:03:39.016 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/Makefile.in" 2024-06-03T00:03:39.016 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.016 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.016 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.016 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 411058658, 2024-06-03T00:03:39.016 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633942, 2024-06-03T00:03:39.016 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-23.c" 2024-06-03T00:03:39.016 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.016 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.016 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.016 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 415771109, 2024-06-03T00:03:39.016 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632914, 2024-06-03T00:03:39.016 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/2-3.c" 2024-06-03T00:03:39.017 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.017 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.017 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.017 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 418502319, 2024-06-03T00:03:39.017 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631897, 2024-06-03T00:03:39.017 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sdr.h" 2024-06-03T00:03:39.017 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.017 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.017 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.017 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 419359038, 2024-06-03T00:03:39.017 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632070, 2024-06-03T00:03:39.017 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_discover.c" 2024-06-03T00:03:39.017 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.017 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.017 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.018 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 421869118, 2024-06-03T00:03:39.018 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632167, 2024-06-03T00:03:39.018 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_watchdog.h" 2024-06-03T00:03:39.018 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.018 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.018 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.018 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 428185470, 2024-06-03T00:03:39.018 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632086, 2024-06-03T00:03:39.018 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_sel.c" 2024-06-03T00:03:39.018 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.018 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.018 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.018 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 428490675, 2024-06-03T00:03:39.018 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633893, 2024-06-03T00:03:39.019 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-23.c" 2024-06-03T00:03:39.019 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.019 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.019 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.019 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 431441285, 2024-06-03T00:03:39.019 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632136, 2024-06-03T00:03:39.019 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_idr.h" 2024-06-03T00:03:39.019 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.019 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.019 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.019 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 433641678, 2024-06-03T00:03:39.019 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631950, 2024-06-03T00:03:39.019 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_utils.c" 2024-06-03T00:03:39.019 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.020 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.020 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.020 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 439127129, 2024-06-03T00:03:39.020 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631946, 2024-06-03T00:03:39.020 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_annunciator.h" 2024-06-03T00:03:39.020 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.020 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.020 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.020 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 439274729, 2024-06-03T00:03:39.020 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631836, 2024-06-03T00:03:39.020 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sensor.c" 2024-06-03T00:03:39.020 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.020 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.020 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.020 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 439492761, 2024-06-03T00:03:39.021 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634106, 2024-06-03T00:03:39.021 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-7.c" 2024-06-03T00:03:39.021 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.021 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.021 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.021 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 441709729, 2024-06-03T00:03:39.021 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632740, 2024-06-03T00:03:39.021 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-36.c" 2024-06-03T00:03:39.021 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.021 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.021 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.021 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 443518694, 2024-06-03T00:03:39.021 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632730, 2024-06-03T00:03:39.021 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-25.c" 2024-06-03T00:03:39.022 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.022 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.022 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.022 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 444629282, 2024-06-03T00:03:39.022 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632039, 2024-06-03T00:03:39.022 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel007.c" 2024-06-03T00:03:39.022 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.022 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.022 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.022 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 444895004, 2024-06-03T00:03:39.022 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632242, 2024-06-03T00:03:39.022 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_utils.c" 2024-06-03T00:03:39.022 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.022 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.023 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.023 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 445423037, 2024-06-03T00:03:39.023 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632701, 2024-06-03T00:03:39.023 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/3-1.c" 2024-06-03T00:03:39.023 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.023 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.023 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.023 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 448517534, 2024-06-03T00:03:39.023 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631859, 2024-06-03T00:03:39.023 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_resource.h" 2024-06-03T00:03:39.023 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.023 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.023 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.023 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 452364459, 2024-06-03T00:03:39.024 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631989, 2024-06-03T00:03:39.024 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset020.c" 2024-06-03T00:03:39.024 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.024 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.024 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.024 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 459261782, 2024-06-03T00:03:39.024 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632027, 2024-06-03T00:03:39.024 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget034.c" 2024-06-03T00:03:39.024 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.024 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.024 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.024 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 465621045, 2024-06-03T00:03:39.024 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632846, 2024-06-03T00:03:39.024 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/2-1.c" 2024-06-03T00:03:39.024 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.025 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.025 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.025 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 465807005, 2024-06-03T00:03:39.025 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631996, 2024-06-03T00:03:39.025 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget013.c" 2024-06-03T00:03:39.025 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.025 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.025 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.025 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 474977694, 2024-06-03T00:03:39.025 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631878, 2024-06-03T00:03:39.025 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_threshold.h" 2024-06-03T00:03:39.025 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.025 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.025 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.026 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 475766285, 2024-06-03T00:03:39.026 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634028, 2024-06-03T00:03:39.026 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-7.c" 2024-06-03T00:03:39.026 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.026 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.026 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.026 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 477767026, 2024-06-03T00:03:39.026 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632626, 2024-06-03T00:03:39.026 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/unistd_h/assertions.xml" 2024-06-03T00:03:39.026 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.026 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.026 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.026 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 485740191, 2024-06-03T00:03:39.027 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632248, 2024-06-03T00:03:39.027 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_discover.c" 2024-06-03T00:03:39.027 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.027 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.027 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.027 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 486114883, 2024-06-03T00:03:39.027 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633876, 2024-06-03T00:03:39.027 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-4.c" 2024-06-03T00:03:39.027 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.027 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.027 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.027 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 503631481, 2024-06-03T00:03:39.027 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633973, 2024-06-03T00:03:39.027 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-24.c" 2024-06-03T00:03:39.028 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.028 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.028 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.028 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 504430519, 2024-06-03T00:03:39.028 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632874, 2024-06-03T00:03:39.028 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/8-3.c" 2024-06-03T00:03:39.028 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.028 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.028 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.028 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 510787501, 2024-06-03T00:03:39.028 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632211, 2024-06-03T00:03:39.028 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_010.c" 2024-06-03T00:03:39.028 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.028 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.028 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.029 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 512955302, 2024-06-03T00:03:39.029 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633862, 2024-06-03T00:03:39.029 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-3.c" 2024-06-03T00:03:39.029 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.029 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.029 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.029 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 513564757, 2024-06-03T00:03:39.029 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634224, 2024-06-03T00:03:39.029 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-14.c" 2024-06-03T00:03:39.029 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.029 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.029 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.029 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 513984616, 2024-06-03T00:03:39.029 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632157, 2024-06-03T00:03:39.030 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_fumi.h" 2024-06-03T00:03:39.030 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.030 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.030 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.030 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 514937761, 2024-06-03T00:03:39.030 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631885, 2024-06-03T00:03:39.030 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con_lan.cpp" 2024-06-03T00:03:39.030 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.030 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.030 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.030 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 518163121, 2024-06-03T00:03:39.030 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632178, 2024-06-03T00:03:39.030 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_injector.h" 2024-06-03T00:03:39.030 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.031 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.031 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.031 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 525858959, 2024-06-03T00:03:39.031 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631898, 2024-06-03T00:03:39.031 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor.cpp" 2024-06-03T00:03:39.031 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.031 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.031 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.031 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 526253247, 2024-06-03T00:03:39.031 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631817, 2024-06-03T00:03:39.031 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_drv.c" 2024-06-03T00:03:39.031 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.031 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.031 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.032 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 530104535, 2024-06-03T00:03:39.032 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631965, 2024-06-03T00:03:39.032 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_control.h" 2024-06-03T00:03:39.032 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.032 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.032 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.032 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 535286734, 2024-06-03T00:03:39.032 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633971, 2024-06-03T00:03:39.032 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-36.c" 2024-06-03T00:03:39.032 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.032 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.032 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.032 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 535762494, 2024-06-03T00:03:39.032 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632905, 2024-06-03T00:03:39.033 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/22-1.c" 2024-06-03T00:03:39.033 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.033 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.033 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.033 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 538129111, 2024-06-03T00:03:39.033 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632014, 2024-06-03T00:03:39.033 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget004.c" 2024-06-03T00:03:39.033 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.033 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.033 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.033 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 550542694, 2024-06-03T00:03:39.033 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631884, 2024-06-03T00:03:39.033 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control.cpp" 2024-06-03T00:03:39.033 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.033 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.034 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.034 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 567111273, 2024-06-03T00:03:39.034 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631998, 2024-06-03T00:03:39.034 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv004.c" 2024-06-03T00:03:39.034 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.034 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.034 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.034 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 568973399, 2024-06-03T00:03:39.034 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634151, 2024-06-03T00:03:39.034 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-32.c" 2024-06-03T00:03:39.034 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.034 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.034 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.034 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 581326184, 2024-06-03T00:03:39.035 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633781, 2024-06-03T00:03:39.035 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-5.c" 2024-06-03T00:03:39.035 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.035 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.035 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.035 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 584084482, 2024-06-03T00:03:39.035 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634203, 2024-06-03T00:03:39.035 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-6.c" 2024-06-03T00:03:39.035 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.035 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.035 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.035 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 584287592, 2024-06-03T00:03:39.035 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633704, 2024-06-03T00:03:39.035 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-3.c" 2024-06-03T00:03:39.035 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.036 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.036 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.036 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 594649656, 2024-06-03T00:03:39.036 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632063, 2024-06-03T00:03:39.036 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_re_discover.h" 2024-06-03T00:03:39.036 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.036 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.036 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.036 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 597678390, 2024-06-03T00:03:39.036 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634149, 2024-06-03T00:03:39.036 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-14.c" 2024-06-03T00:03:39.036 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.036 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.036 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.037 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 598948843, 2024-06-03T00:03:39.037 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632718, 2024-06-03T00:03:39.037 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/coverage.txt" 2024-06-03T00:03:39.037 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.037 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.037 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.037 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 599406266, 2024-06-03T00:03:39.037 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632100, 2024-06-03T00:03:39.037 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_load_id.h" 2024-06-03T00:03:39.037 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.037 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.037 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.037 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 608901867, 2024-06-03T00:03:39.037 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633783, 2024-06-03T00:03:39.038 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-7.c" 2024-06-03T00:03:39.038 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.038 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.038 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.038 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 610724312, 2024-06-03T00:03:39.038 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631855, 2024-06-03T00:03:39.038 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sel.h" 2024-06-03T00:03:39.038 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.038 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.038 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.038 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 611382661, 2024-06-03T00:03:39.038 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632161, 2024-06-03T00:03:39.038 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_annunciator_func.c" 2024-06-03T00:03:39.038 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.039 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.039 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.039 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 611462333, 2024-06-03T00:03:39.039 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631984, 2024-06-03T00:03:39.039 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget033.c" 2024-06-03T00:03:39.039 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.039 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.039 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.039 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 612774951, 2024-06-03T00:03:39.039 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631863, 2024-06-03T00:03:39.039 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_discover.h" 2024-06-03T00:03:39.039 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.039 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.040 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.040 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 613572785, 2024-06-03T00:03:39.040 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632636, 2024-06-03T00:03:39.040 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/assertions.xml" 2024-06-03T00:03:39.040 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.040 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.040 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.040 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 614047918, 2024-06-03T00:03:39.040 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632134, 2024-06-03T00:03:39.040 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_sensor.h" 2024-06-03T00:03:39.040 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.040 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.040 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.040 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 616411031, 2024-06-03T00:03:39.041 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632654, 2024-06-03T00:03:39.041 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/28-1.c" 2024-06-03T00:03:39.041 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.041 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.041 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.041 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 617366618, 2024-06-03T00:03:39.041 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632903, 2024-06-03T00:03:39.041 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/2-4.c" 2024-06-03T00:03:39.041 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.041 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.041 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.041 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 625629189, 2024-06-03T00:03:39.041 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632229, 2024-06-03T00:03:39.041 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/Makefile.am" 2024-06-03T00:03:39.041 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.042 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.042 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.042 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 625869697, 2024-06-03T00:03:39.042 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634096, 2024-06-03T00:03:39.042 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-33.c" 2024-06-03T00:03:39.042 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.042 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.042 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.042 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 645090647, 2024-06-03T00:03:39.042 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634306, 2024-06-03T00:03:39.042 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-13.c" 2024-06-03T00:03:39.042 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.042 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.042 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.043 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 655872491, 2024-06-03T00:03:39.043 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631882, 2024-06-03T00:03:39.043 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/thread.h" 2024-06-03T00:03:39.043 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.043 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.043 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.043 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 657288262, 2024-06-03T00:03:39.043 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632899, 2024-06-03T00:03:39.043 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/7-1.c" 2024-06-03T00:03:39.043 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.043 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.043 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.043 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 658889728, 2024-06-03T00:03:39.043 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634223, 2024-06-03T00:03:39.044 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-11.c" 2024-06-03T00:03:39.044 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.044 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.044 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.044 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 661876759, 2024-06-03T00:03:39.044 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632067, 2024-06-03T00:03:39.044 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_calls.h" 2024-06-03T00:03:39.044 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.044 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.044 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.044 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 663412741, 2024-06-03T00:03:39.044 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632184, 2024-06-03T00:03:39.044 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_024.c" 2024-06-03T00:03:39.044 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.045 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.045 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.045 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 667197155, 2024-06-03T00:03:39.045 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632213, 2024-06-03T00:03:39.045 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_004.c" 2024-06-03T00:03:39.045 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.045 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.045 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.045 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 671883960, 2024-06-03T00:03:39.045 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632855, 2024-06-03T00:03:39.045 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/10-1.c" 2024-06-03T00:03:39.045 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.045 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.045 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.046 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 678599349, 2024-06-03T00:03:39.046 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632716, 2024-06-03T00:03:39.046 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/24-1.c" 2024-06-03T00:03:39.046 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.046 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.046 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.046 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 684693544, 2024-06-03T00:03:39.046 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632828, 2024-06-03T00:03:39.046 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/12-1.c" 2024-06-03T00:03:39.046 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.046 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.046 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.046 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 688273014, 2024-06-03T00:03:39.046 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632818, 2024-06-03T00:03:39.046 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-12.c" 2024-06-03T00:03:39.047 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.047 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.047 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.047 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 691144454, 2024-06-03T00:03:39.047 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632049, 2024-06-03T00:03:39.047 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsptime002.c" 2024-06-03T00:03:39.047 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.047 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.047 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.047 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 707450138, 2024-06-03T00:03:39.047 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632148, 2024-06-03T00:03:39.047 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_reset.c" 2024-06-03T00:03:39.047 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.047 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.048 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.048 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 711032636, 2024-06-03T00:03:39.048 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632907, 2024-06-03T00:03:39.048 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/8-2.c" 2024-06-03T00:03:39.048 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.048 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.048 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.048 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 713603912, 2024-06-03T00:03:39.048 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631992, 2024-06-03T00:03:39.048 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel004.c" 2024-06-03T00:03:39.048 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.048 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.048 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.048 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 714205835, 2024-06-03T00:03:39.048 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632703, 2024-06-03T00:03:39.049 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-38.c" 2024-06-03T00:03:39.049 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.049 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.049 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.049 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 716848409, 2024-06-03T00:03:39.049 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631861, 2024-06-03T00:03:39.049 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_inventory.cpp" 2024-06-03T00:03:39.049 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.049 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.049 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.049 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 716956163, 2024-06-03T00:03:39.049 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631934, 2024-06-03T00:03:39.049 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc.c" 2024-06-03T00:03:39.050 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.050 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.050 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.050 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 725852633, 2024-06-03T00:03:39.050 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632235, 2024-06-03T00:03:39.050 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_inventory.h" 2024-06-03T00:03:39.050 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.050 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.050 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.050 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 738483779, 2024-06-03T00:03:39.050 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634246, 2024-06-03T00:03:39.050 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-14.c" 2024-06-03T00:03:39.050 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.050 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.051 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.051 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 741907832, 2024-06-03T00:03:39.051 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633947, 2024-06-03T00:03:39.051 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-13.c" 2024-06-03T00:03:39.051 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.051 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.051 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.051 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 747175692, 2024-06-03T00:03:39.051 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633980, 2024-06-03T00:03:39.051 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-12.c" 2024-06-03T00:03:39.051 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.051 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.051 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.051 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 747587086, 2024-06-03T00:03:39.052 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632761, 2024-06-03T00:03:39.052 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-7.c" 2024-06-03T00:03:39.052 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.052 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.052 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.052 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 753517234, 2024-06-03T00:03:39.052 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632170, 2024-06-03T00:03:39.052 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/Makefile.in" 2024-06-03T00:03:39.052 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.052 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.052 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.052 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 760004980, 2024-06-03T00:03:39.052 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631814, 2024-06-03T00:03:39.052 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_inventory.c" 2024-06-03T00:03:39.053 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.053 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.053 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.053 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 762076467, 2024-06-03T00:03:39.053 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632004, 2024-06-03T00:03:39.053 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsetup.h" 2024-06-03T00:03:39.053 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.053 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.053 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.053 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 782017891, 2024-06-03T00:03:39.053 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632035, 2024-06-03T00:03:39.053 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget035.c" 2024-06-03T00:03:39.053 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.053 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.053 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.054 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 782031619, 2024-06-03T00:03:39.054 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632083, 2024-06-03T00:03:39.054 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_watchdog.h" 2024-06-03T00:03:39.054 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.054 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.054 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.054 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 791213704, 2024-06-03T00:03:39.054 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634134, 2024-06-03T00:03:39.054 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-12.c" 2024-06-03T00:03:39.054 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.054 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.054 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.054 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 792429802, 2024-06-03T00:03:39.055 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631847, 2024-06-03T00:03:39.055 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_fan.cpp" 2024-06-03T00:03:39.055 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.055 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.055 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.055 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 803784030, 2024-06-03T00:03:39.055 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632047, 2024-06-03T00:03:39.055 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset022.c" 2024-06-03T00:03:39.055 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.055 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.055 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.055 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 805402823, 2024-06-03T00:03:39.055 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633757, 2024-06-03T00:03:39.055 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-45.c" 2024-06-03T00:03:39.056 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.056 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.056 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.056 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 807204719, 2024-06-03T00:03:39.056 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631835, 2024-06-03T00:03:39.056 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/Makefile.am" 2024-06-03T00:03:39.056 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.056 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.056 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.056 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 815900716, 2024-06-03T00:03:39.056 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634035, 2024-06-03T00:03:39.056 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-7.c" 2024-06-03T00:03:39.056 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.056 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.056 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.057 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 818183612, 2024-06-03T00:03:39.057 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633865, 2024-06-03T00:03:39.057 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-87.c" 2024-06-03T00:03:39.057 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.057 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.057 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.057 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 826123561, 2024-06-03T00:03:39.057 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632223, 2024-06-03T00:03:39.057 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_032.c" 2024-06-03T00:03:39.057 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.057 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.057 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.057 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 827859753, 2024-06-03T00:03:39.058 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632189, 2024-06-03T00:03:39.058 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_042.c" 2024-06-03T00:03:39.058 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.058 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.058 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.058 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 829388836, 2024-06-03T00:03:39.058 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632197, 2024-06-03T00:03:39.058 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/openhpi.conf" 2024-06-03T00:03:39.058 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.058 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.058 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.058 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 829579815, 2024-06-03T00:03:39.058 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631895, 2024-06-03T00:03:39.058 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_fix_sdr.cpp" 2024-06-03T00:03:39.059 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.059 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.059 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.059 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 830903347, 2024-06-03T00:03:39.059 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632209, 2024-06-03T00:03:39.059 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_043.c" 2024-06-03T00:03:39.059 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.059 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.059 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.059 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 832580883, 2024-06-03T00:03:39.059 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634087, 2024-06-03T00:03:39.059 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-20.c" 2024-06-03T00:03:39.059 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.059 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.060 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.060 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 838331873, 2024-06-03T00:03:39.060 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632142, 2024-06-03T00:03:39.060 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_init.c" 2024-06-03T00:03:39.060 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.060 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.060 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.060 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 838393884, 2024-06-03T00:03:39.060 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632111, 2024-06-03T00:03:39.060 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_control.c" 2024-06-03T00:03:39.060 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.060 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.060 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.060 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 839856500, 2024-06-03T00:03:39.060 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632231, 2024-06-03T00:03:39.061 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas.c" 2024-06-03T00:03:39.061 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.061 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.061 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.061 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 841026595, 2024-06-03T00:03:39.061 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632732, 2024-06-03T00:03:39.061 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/42-1.c" 2024-06-03T00:03:39.061 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.061 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.061 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.061 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 845093480, 2024-06-03T00:03:39.061 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634214, 2024-06-03T00:03:39.061 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-24.c" 2024-06-03T00:03:39.061 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.062 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.062 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.062 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 845407521, 2024-06-03T00:03:39.062 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632191, 2024-06-03T00:03:39.062 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_045.c" 2024-06-03T00:03:39.062 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.062 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.062 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.062 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 847026706, 2024-06-03T00:03:39.062 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632020, 2024-06-03T00:03:39.062 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel003.c" 2024-06-03T00:03:39.062 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.062 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.062 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.063 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 848269181, 2024-06-03T00:03:39.063 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632634, 2024-06-03T00:03:39.063 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/1-1.c" 2024-06-03T00:03:39.063 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.063 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.063 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.063 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 850166297, 2024-06-03T00:03:39.063 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631860, 2024-06-03T00:03:39.063 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_factors.h" 2024-06-03T00:03:39.063 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.063 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.063 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.063 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 851303358, 2024-06-03T00:03:39.063 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632867, 2024-06-03T00:03:39.064 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/2-2.c" 2024-06-03T00:03:39.064 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.064 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.064 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.064 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 851439257, 2024-06-03T00:03:39.064 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632808, 2024-06-03T00:03:39.064 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h" 2024-06-03T00:03:39.064 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.064 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.064 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.064 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 866053591, 2024-06-03T00:03:39.064 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632143, 2024-06-03T00:03:39.064 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_dimi_func.c" 2024-06-03T00:03:39.064 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.065 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.065 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.065 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 866483656, 2024-06-03T00:03:39.065 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633939, 2024-06-03T00:03:39.065 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-17.c" 2024-06-03T00:03:39.065 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.065 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.065 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.065 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 871455079, 2024-06-03T00:03:39.065 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632913, 2024-06-03T00:03:39.065 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/7-3.c" 2024-06-03T00:03:39.065 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.065 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.066 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.066 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 873984298, 2024-06-03T00:03:39.066 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632836, 2024-06-03T00:03:39.066 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/4-1.c" 2024-06-03T00:03:39.066 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.066 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.066 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.066 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 874338301, 2024-06-03T00:03:39.066 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634059, 2024-06-03T00:03:39.066 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-16.c" 2024-06-03T00:03:39.066 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.066 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.066 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.066 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 876262180, 2024-06-03T00:03:39.067 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632814, 2024-06-03T00:03:39.067 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/coverage.txt" 2024-06-03T00:03:39.067 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.067 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.067 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.067 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 876661418, 2024-06-03T00:03:39.067 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632649, 2024-06-03T00:03:39.067 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/6-2.c" 2024-06-03T00:03:39.067 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.067 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.067 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.067 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 876713066, 2024-06-03T00:03:39.067 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631874, 2024-06-03T00:03:39.067 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_msg.cpp" 2024-06-03T00:03:39.068 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.068 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.068 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.068 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 891406239, 2024-06-03T00:03:39.068 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631826, 2024-06-03T00:03:39.068 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/Makefile.in" 2024-06-03T00:03:39.068 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.068 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.068 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.068 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 897251827, 2024-06-03T00:03:39.068 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632876, 2024-06-03T00:03:39.068 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/9-1.c" 2024-06-03T00:03:39.068 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.068 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.068 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.069 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 901200984, 2024-06-03T00:03:39.069 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632214, 2024-06-03T00:03:39.069 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/Makefile.in" 2024-06-03T00:03:39.069 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.069 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.069 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.069 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 907944963, 2024-06-03T00:03:39.069 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631926, 2024-06-03T00:03:39.069 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/sensor_factors_000.cpp" 2024-06-03T00:03:39.069 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.069 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.069 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.069 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 916097539, 2024-06-03T00:03:39.069 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632851, 2024-06-03T00:03:39.070 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys" 2024-06-03T00:03:39.070 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.070 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.070 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.070 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 918916390, 2024-06-03T00:03:39.070 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632103, 2024-06-03T00:03:39.070 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_event.h" 2024-06-03T00:03:39.070 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.070 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.070 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.070 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 922698856, 2024-06-03T00:03:39.070 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632085, 2024-06-03T00:03:39.070 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap.c" 2024-06-03T00:03:39.070 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.071 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.071 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.071 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 935825759, 2024-06-03T00:03:39.071 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632037, 2024-06-03T00:03:39.071 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/sim_test_file" 2024-06-03T00:03:39.071 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.071 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.071 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.071 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 936035585, 2024-06-03T00:03:39.071 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632160, 2024-06-03T00:03:39.071 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_init.h" 2024-06-03T00:03:39.071 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.071 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.071 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.071 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 937038156, 2024-06-03T00:03:39.072 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631834, 2024-06-03T00:03:39.072 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/Makefile.am" 2024-06-03T00:03:39.072 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.072 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.072 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.072 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 943011985, 2024-06-03T00:03:39.072 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632820, 2024-06-03T00:03:39.072 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/6-1.c" 2024-06-03T00:03:39.072 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.072 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.072 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.072 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 946622572, 2024-06-03T00:03:39.072 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634173, 2024-06-03T00:03:39.072 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-19.c" 2024-06-03T00:03:39.073 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.073 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.073 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.073 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 952565490, 2024-06-03T00:03:39.073 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632838, 2024-06-03T00:03:39.073 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/16-1.c" 2024-06-03T00:03:39.073 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.073 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.073 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.073 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 968180029, 2024-06-03T00:03:39.073 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631905, 2024-06-03T00:03:39.073 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con_lan.h" 2024-06-03T00:03:39.073 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.073 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.073 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.074 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 974655807, 2024-06-03T00:03:39.074 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633749, 2024-06-03T00:03:39.074 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-20.c" 2024-06-03T00:03:39.074 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.074 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.074 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.074 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 974734088, 2024-06-03T00:03:39.074 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632155, 2024-06-03T00:03:39.074 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_dimi_func.h" 2024-06-03T00:03:39.074 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.074 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.074 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.074 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 976592414, 2024-06-03T00:03:39.074 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632203, 2024-06-03T00:03:39.075 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_005.c" 2024-06-03T00:03:39.075 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.075 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.075 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.075 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 981059973, 2024-06-03T00:03:39.075 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632036, 2024-06-03T00:03:39.075 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/thotswap-mhs001.c" 2024-06-03T00:03:39.075 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.075 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.075 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.075 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 984231239, 2024-06-03T00:03:39.075 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632016, 2024-06-03T00:03:39.075 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv002.c" 2024-06-03T00:03:39.075 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.076 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.076 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.076 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 992040805, 2024-06-03T00:03:39.076 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631883, 2024-06-03T00:03:39.076 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_rdr.cpp" 2024-06-03T00:03:39.076 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.076 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.076 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.076 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 994368763, 2024-06-03T00:03:39.076 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631886, 2024-06-03T00:03:39.076 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_discrete.h" 2024-06-03T00:03:39.076 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.076 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.076 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.077 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 995821994, 2024-06-03T00:03:39.077 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632726, 2024-06-03T00:03:39.077 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/14-1.c" 2024-06-03T00:03:39.077 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.077 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.077 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.077 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1000840683, 2024-06-03T00:03:39.077 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634204, 2024-06-03T00:03:39.077 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-13.c" 2024-06-03T00:03:39.077 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.077 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.077 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.077 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1014569755, 2024-06-03T00:03:39.078 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631979, 2024-06-03T00:03:39.078 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_event.c" 2024-06-03T00:03:39.078 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.078 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.078 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.078 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1022549745, 2024-06-03T00:03:39.078 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632044, 2024-06-03T00:03:39.078 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset007.c" 2024-06-03T00:03:39.078 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.078 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.078 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.078 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1026713962, 2024-06-03T00:03:39.078 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632773, 2024-06-03T00:03:39.078 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/36-1.c" 2024-06-03T00:03:39.079 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.079 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.079 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.079 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1028899374, 2024-06-03T00:03:39.079 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634027, 2024-06-03T00:03:39.079 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-16.c" 2024-06-03T00:03:39.079 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.079 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.079 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.079 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1031502091, 2024-06-03T00:03:39.079 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634222, 2024-06-03T00:03:39.079 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-20.c" 2024-06-03T00:03:39.079 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.079 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.080 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.080 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1031845238, 2024-06-03T00:03:39.080 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634210, 2024-06-03T00:03:39.080 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-9.c" 2024-06-03T00:03:39.080 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.080 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.080 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.080 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1040896670, 2024-06-03T00:03:39.080 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632645, 2024-06-03T00:03:39.080 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/10-1.c" 2024-06-03T00:03:39.080 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.080 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.080 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.080 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1044344430, 2024-06-03T00:03:39.081 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632670, 2024-06-03T00:03:39.081 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/7-1.c" 2024-06-03T00:03:39.081 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.081 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.081 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.081 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1049017548, 2024-06-03T00:03:39.081 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634116, 2024-06-03T00:03:39.081 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-17.c" 2024-06-03T00:03:39.081 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.081 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.081 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.081 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1049401961, 2024-06-03T00:03:39.081 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632078, 2024-06-03T00:03:39.082 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_load_id.c" 2024-06-03T00:03:39.082 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.082 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.082 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.082 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1049479775, 2024-06-03T00:03:39.082 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631991, 2024-06-03T00:03:39.082 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget003.c" 2024-06-03T00:03:39.082 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.082 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.082 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.082 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1050757348, 2024-06-03T00:03:39.082 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632249, 2024-06-03T00:03:39.082 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_resource.c" 2024-06-03T00:03:39.082 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.083 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.083 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.083 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1061665138, 2024-06-03T00:03:39.083 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632158, 2024-06-03T00:03:39.083 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_dimi.c" 2024-06-03T00:03:39.083 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.083 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.083 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.083 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1063563098, 2024-06-03T00:03:39.083 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634249, 2024-06-03T00:03:39.083 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-16.c" 2024-06-03T00:03:39.083 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.083 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.083 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.083 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1064852038, 2024-06-03T00:03:39.084 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634017, 2024-06-03T00:03:39.084 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-12.c" 2024-06-03T00:03:39.084 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.084 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.084 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.084 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1067997626, 2024-06-03T00:03:39.084 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631850, 2024-06-03T00:03:39.084 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_rdr.h" 2024-06-03T00:03:39.084 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.084 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.084 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.084 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1068367139, 2024-06-03T00:03:39.084 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632792, 2024-06-03T00:03:39.084 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/18-1.c" 2024-06-03T00:03:39.085 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.085 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.085 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.085 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1069412401, 2024-06-03T00:03:39.085 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632246, 2024-06-03T00:03:39.085 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_sensor.h" 2024-06-03T00:03:39.085 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.085 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.085 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.085 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1072021446, 2024-06-03T00:03:39.085 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632232, 2024-06-03T00:03:39.085 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_sensor.c" 2024-06-03T00:03:39.085 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.085 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.085 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.086 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1080845971, 2024-06-03T00:03:39.086 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634153, 2024-06-03T00:03:39.086 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-13.c" 2024-06-03T00:03:39.086 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.086 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.086 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.086 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1081789439, 2024-06-03T00:03:39.086 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632848, 2024-06-03T00:03:39.086 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/assertions.xml" 2024-06-03T00:03:39.086 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.086 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.086 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.086 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1090397604, 2024-06-03T00:03:39.087 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634215, 2024-06-03T00:03:39.087 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-9.c" 2024-06-03T00:03:39.087 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.087 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.087 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.087 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1093391105, 2024-06-03T00:03:39.087 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634016, 2024-06-03T00:03:39.087 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-6.c" 2024-06-03T00:03:39.087 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.087 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.087 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.087 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1105458316, 2024-06-03T00:03:39.087 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634231, 2024-06-03T00:03:39.088 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-21.c" 2024-06-03T00:03:39.088 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.088 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.088 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.088 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1107966794, 2024-06-03T00:03:39.088 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632798, 2024-06-03T00:03:39.088 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/8-1.c" 2024-06-03T00:03:39.088 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.088 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.088 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.088 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1108548395, 2024-06-03T00:03:39.088 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632090, 2024-06-03T00:03:39.088 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_hotswap.h" 2024-06-03T00:03:39.088 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.088 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.089 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.089 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1111281521, 2024-06-03T00:03:39.089 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631877, 2024-06-03T00:03:39.089 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc.h" 2024-06-03T00:03:39.089 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.089 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.089 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.089 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1112034492, 2024-06-03T00:03:39.089 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631928, 2024-06-03T00:03:39.089 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/Makefile.in" 2024-06-03T00:03:39.089 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.089 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.089 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.089 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1114052232, 2024-06-03T00:03:39.090 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632708, 2024-06-03T00:03:39.090 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/39-1.c" 2024-06-03T00:03:39.090 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.090 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.090 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.090 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1114413547, 2024-06-03T00:03:39.090 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633840, 2024-06-03T00:03:39.090 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-102.c" 2024-06-03T00:03:39.090 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.090 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.090 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.090 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1125913399, 2024-06-03T00:03:39.090 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633703, 2024-06-03T00:03:39.091 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-16.c" 2024-06-03T00:03:39.091 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.091 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.091 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.091 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1129549966, 2024-06-03T00:03:39.091 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631910, 2024-06-03T00:03:39.091 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/thread.cpp" 2024-06-03T00:03:39.091 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.091 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.091 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.091 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1134657164, 2024-06-03T00:03:39.091 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633884, 2024-06-03T00:03:39.091 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-9.c" 2024-06-03T00:03:39.091 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.091 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.092 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.092 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1138283969, 2024-06-03T00:03:39.092 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632734, 2024-06-03T00:03:39.092 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/32-1.c" 2024-06-03T00:03:39.092 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.092 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.092 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.092 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1144312117, 2024-06-03T00:03:39.092 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631988, 2024-06-03T00:03:39.092 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv003.c" 2024-06-03T00:03:39.092 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.092 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.092 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.092 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1153133749, 2024-06-03T00:03:39.093 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631982, 2024-06-03T00:03:39.093 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget031.c" 2024-06-03T00:03:39.093 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.093 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.093 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.093 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1154364361, 2024-06-03T00:03:39.093 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632097, 2024-06-03T00:03:39.093 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_server_event.c" 2024-06-03T00:03:39.093 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.093 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.093 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.093 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1155529353, 2024-06-03T00:03:39.093 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632893, 2024-06-03T00:03:39.094 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/7-5.c" 2024-06-03T00:03:39.094 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.094 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.094 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.094 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1156588749, 2024-06-03T00:03:39.094 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632747, 2024-06-03T00:03:39.094 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-33.c" 2024-06-03T00:03:39.094 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.094 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.094 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.094 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1159077598, 2024-06-03T00:03:39.094 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632875, 2024-06-03T00:03:39.094 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/3-1.c" 2024-06-03T00:03:39.094 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.095 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.095 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.095 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1166073362, 2024-06-03T00:03:39.095 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632823, 2024-06-03T00:03:39.095 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/10.c" 2024-06-03T00:03:39.095 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.095 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.095 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.095 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1172774374, 2024-06-03T00:03:39.095 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632146, 2024-06-03T00:03:39.095 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_control_func.h" 2024-06-03T00:03:39.095 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.095 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.095 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.096 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1176390193, 2024-06-03T00:03:39.096 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632076, 2024-06-03T00:03:39.096 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_lcd_event.c" 2024-06-03T00:03:39.096 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.096 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.096 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.096 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1177094377, 2024-06-03T00:03:39.096 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631927, 2024-06-03T00:03:39.096 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/con_001.c" 2024-06-03T00:03:39.096 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.096 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.096 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.096 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1188353752, 2024-06-03T00:03:39.096 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632655, 2024-06-03T00:03:39.096 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/14-1.c" 2024-06-03T00:03:39.097 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.097 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.097 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.097 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1196743525, 2024-06-03T00:03:39.097 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632195, 2024-06-03T00:03:39.097 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_026.c" 2024-06-03T00:03:39.097 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.097 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.097 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.097 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1197861089, 2024-06-03T00:03:39.097 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632010, 2024-06-03T00:03:39.097 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel002.c" 2024-06-03T00:03:39.097 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.097 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.098 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.098 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1203304104, 2024-06-03T00:03:39.098 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632092, 2024-06-03T00:03:39.098 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_oa_event.h" 2024-06-03T00:03:39.098 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.098 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.098 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.098 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1204124976, 2024-06-03T00:03:39.098 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632641, 2024-06-03T00:03:39.098 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/27-1.c" 2024-06-03T00:03:39.098 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.098 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.098 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.098 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1205426799, 2024-06-03T00:03:39.099 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632869, 2024-06-03T00:03:39.101 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/11-1.c" 2024-06-03T00:03:39.101 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.101 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.101 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.101 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1207563683, 2024-06-03T00:03:39.101 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632817, 2024-06-03T00:03:39.102 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/2-1.c" 2024-06-03T00:03:39.102 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.102 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.102 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.102 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1207667843, 2024-06-03T00:03:39.102 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632878, 2024-06-03T00:03:39.102 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/4-2.c" 2024-06-03T00:03:39.102 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.102 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.102 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.102 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1208141519, 2024-06-03T00:03:39.102 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632200, 2024-06-03T00:03:39.102 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_029.c" 2024-06-03T00:03:39.103 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.103 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.103 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.103 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1218091904, 2024-06-03T00:03:39.103 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632769, 2024-06-03T00:03:39.103 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/26-1.c" 2024-06-03T00:03:39.103 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.103 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.103 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.103 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1219750526, 2024-06-03T00:03:39.103 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632821, 2024-06-03T00:03:39.103 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/1-1.c" 2024-06-03T00:03:39.103 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.103 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.104 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.104 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1226072016, 2024-06-03T00:03:39.104 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634043, 2024-06-03T00:03:39.104 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-14.c" 2024-06-03T00:03:39.104 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.104 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.104 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.104 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1231336836, 2024-06-03T00:03:39.104 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631824, 2024-06-03T00:03:39.104 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_mc_event.c" 2024-06-03T00:03:39.104 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.104 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.104 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.104 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1233053551, 2024-06-03T00:03:39.105 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631916, 2024-06-03T00:03:39.105 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_sun_led.h" 2024-06-03T00:03:39.105 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.105 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.105 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.105 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1241982158, 2024-06-03T00:03:39.105 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632156, 2024-06-03T00:03:39.105 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_resources.h" 2024-06-03T00:03:39.105 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.105 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.105 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.105 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1242253229, 2024-06-03T00:03:39.105 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632709, 2024-06-03T00:03:39.105 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-35.c" 2024-06-03T00:03:39.106 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.106 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.106 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.106 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1249003408, 2024-06-03T00:03:39.106 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632152, 2024-06-03T00:03:39.106 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_annunciators.c" 2024-06-03T00:03:39.106 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.106 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.106 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.106 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1249856109, 2024-06-03T00:03:39.106 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632163, 2024-06-03T00:03:39.106 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_inventory.h" 2024-06-03T00:03:39.106 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.107 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.107 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.107 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1250671838, 2024-06-03T00:03:39.107 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632637, 2024-06-03T00:03:39.107 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/7-1.c" 2024-06-03T00:03:39.107 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.107 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.107 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.107 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1254036559, 2024-06-03T00:03:39.107 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632050, 2024-06-03T00:03:39.107 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv001.c" 2024-06-03T00:03:39.107 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.107 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.107 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.108 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1263310275, 2024-06-03T00:03:39.108 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632843, 2024-06-03T00:03:39.108 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-2.c" 2024-06-03T00:03:39.108 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.108 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.108 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.108 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1279170263, 2024-06-03T00:03:39.108 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632776, 2024-06-03T00:03:39.108 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/30-1.c" 2024-06-03T00:03:39.108 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.108 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.108 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.108 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1289205140, 2024-06-03T00:03:39.108 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631868, 2024-06-03T00:03:39.109 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_inventory_parser.h" 2024-06-03T00:03:39.109 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.109 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.109 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.109 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1296361592, 2024-06-03T00:03:39.109 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634001, 2024-06-03T00:03:39.109 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/README" 2024-06-03T00:03:39.109 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.109 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.109 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.109 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1303701912, 2024-06-03T00:03:39.109 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631919, 2024-06-03T00:03:39.109 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_factors.cpp" 2024-06-03T00:03:39.109 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.110 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.110 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.110 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1309322207, 2024-06-03T00:03:39.110 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631980, 2024-06-03T00:03:39.110 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t" 2024-06-03T00:03:39.110 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.110 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.110 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.110 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1309401856, 2024-06-03T00:03:39.110 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633854, 2024-06-03T00:03:39.110 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-17.c" 2024-06-03T00:03:39.110 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.110 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.111 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.111 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1311972259, 2024-06-03T00:03:39.111 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632790, 2024-06-03T00:03:39.111 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/19-1.c" 2024-06-03T00:03:39.111 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.111 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.111 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.111 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1316340073, 2024-06-03T00:03:39.111 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632745, 2024-06-03T00:03:39.111 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/46-1.c" 2024-06-03T00:03:39.111 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.111 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.111 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.111 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1317459977, 2024-06-03T00:03:39.112 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632722, 2024-06-03T00:03:39.112 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/make22tests" 2024-06-03T00:03:39.112 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.112 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.112 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.112 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1317477361, 2024-06-03T00:03:39.112 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631983, 2024-06-03T00:03:39.112 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tdiscover001.c" 2024-06-03T00:03:39.112 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.112 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.112 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.112 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1317534772, 2024-06-03T00:03:39.112 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632080, 2024-06-03T00:03:39.112 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_interconnect_event.c" 2024-06-03T00:03:39.113 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.113 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.113 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.113 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1323329042, 2024-06-03T00:03:39.113 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632770, 2024-06-03T00:03:39.113 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/4-1.c" 2024-06-03T00:03:39.113 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.113 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.113 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.113 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1325334837, 2024-06-03T00:03:39.113 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634165, 2024-06-03T00:03:39.113 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-17.c" 2024-06-03T00:03:39.113 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.113 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.114 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.114 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1327896886, 2024-06-03T00:03:39.114 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632169, 2024-06-03T00:03:39.114 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_resources2.c" 2024-06-03T00:03:39.114 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.114 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.114 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.114 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1332177896, 2024-06-03T00:03:39.114 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631823, 2024-06-03T00:03:39.114 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sel.c" 2024-06-03T00:03:39.114 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.114 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.114 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.114 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1346189145, 2024-06-03T00:03:39.115 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632689, 2024-06-03T00:03:39.115 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h" 2024-06-03T00:03:39.115 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.115 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.115 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.115 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1346952247, 2024-06-03T00:03:39.115 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631911, 2024-06-03T00:03:39.115 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_intel.h" 2024-06-03T00:03:39.115 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.115 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.115 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.115 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1348815371, 2024-06-03T00:03:39.115 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631995, 2024-06-03T00:03:39.116 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset004.c" 2024-06-03T00:03:39.116 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.116 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.116 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.116 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1351736431, 2024-06-03T00:03:39.116 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632885, 2024-06-03T00:03:39.116 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/18-1.c" 2024-06-03T00:03:39.116 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.116 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.116 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.116 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1362919150, 2024-06-03T00:03:39.116 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633898, 2024-06-03T00:03:39.116 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-3.c" 2024-06-03T00:03:39.116 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.116 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.116 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.117 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1384574714, 2024-06-03T00:03:39.117 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632697, 2024-06-03T00:03:39.117 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-9.c" 2024-06-03T00:03:39.117 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.117 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.117 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.117 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1385689529, 2024-06-03T00:03:39.117 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631896, 2024-06-03T00:03:39.117 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_event.cpp" 2024-06-03T00:03:39.117 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.117 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.117 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.117 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1387265102, 2024-06-03T00:03:39.118 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632850, 2024-06-03T00:03:39.118 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/3-2.c" 2024-06-03T00:03:39.118 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.118 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.118 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.118 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1387483756, 2024-06-03T00:03:39.118 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632054, 2024-06-03T00:03:39.118 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel006.c" 2024-06-03T00:03:39.118 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.118 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.118 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.118 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1388094697, 2024-06-03T00:03:39.118 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631967, 2024-06-03T00:03:39.118 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_discover.c" 2024-06-03T00:03:39.119 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.119 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.119 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.119 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1392127756, 2024-06-03T00:03:39.119 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631929, 2024-06-03T00:03:39.119 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/Makefile.am" 2024-06-03T00:03:39.119 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.119 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.119 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.119 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1395741688, 2024-06-03T00:03:39.119 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633860, 2024-06-03T00:03:39.119 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-2.c" 2024-06-03T00:03:39.119 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.119 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.120 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.120 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1400915324, 2024-06-03T00:03:39.120 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633922, 2024-06-03T00:03:39.120 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/testfrmw.h" 2024-06-03T00:03:39.120 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.120 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.120 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.120 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1414440584, 2024-06-03T00:03:39.120 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633847, 2024-06-03T00:03:39.120 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-16.c" 2024-06-03T00:03:39.120 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.120 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.120 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.120 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1417558840, 2024-06-03T00:03:39.121 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634250, 2024-06-03T00:03:39.121 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-2.c" 2024-06-03T00:03:39.121 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.121 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.121 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.121 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1428356719, 2024-06-03T00:03:39.121 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632750, 2024-06-03T00:03:39.121 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/38-1.c" 2024-06-03T00:03:39.121 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.121 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.121 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.121 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1428640456, 2024-06-03T00:03:39.121 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634190, 2024-06-03T00:03:39.122 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-73.c" 2024-06-03T00:03:39.122 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.122 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.122 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.122 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1429535517, 2024-06-03T00:03:39.122 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631993, 2024-06-03T00:03:39.122 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset017.c" 2024-06-03T00:03:39.122 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.122 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.122 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.122 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1430295876, 2024-06-03T00:03:39.122 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631833, 2024-06-03T00:03:39.122 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/Makefile.in" 2024-06-03T00:03:39.122 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.123 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.123 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.123 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1432202022, 2024-06-03T00:03:39.123 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632088, 2024-06-03T00:03:39.123 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_re_discover.c" 2024-06-03T00:03:39.123 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.123 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.123 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.123 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1434884840, 2024-06-03T00:03:39.123 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631822, 2024-06-03T00:03:39.123 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_entity.c" 2024-06-03T00:03:39.123 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.123 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.123 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.124 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1438014001, 2024-06-03T00:03:39.124 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631840, 2024-06-03T00:03:39.124 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/watchdog/Makefile.in" 2024-06-03T00:03:39.124 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.124 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.124 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.124 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1463099424, 2024-06-03T00:03:39.124 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632109, 2024-06-03T00:03:39.124 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_dimi.c" 2024-06-03T00:03:39.124 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.124 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.124 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.124 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1473043557, 2024-06-03T00:03:39.124 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632713, 2024-06-03T00:03:39.124 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-14.c" 2024-06-03T00:03:39.125 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.125 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.125 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.125 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1480316288, 2024-06-03T00:03:39.125 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634045, 2024-06-03T00:03:39.125 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-95.c" 2024-06-03T00:03:39.125 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.125 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.125 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.125 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1485580058, 2024-06-03T00:03:39.125 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634206, 2024-06-03T00:03:39.125 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-11.c" 2024-06-03T00:03:39.125 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.125 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.126 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.126 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1489390057, 2024-06-03T00:03:39.126 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632787, 2024-06-03T00:03:39.126 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/8-3.c" 2024-06-03T00:03:39.126 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.126 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.126 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.126 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1489738211, 2024-06-03T00:03:39.126 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632816, 2024-06-03T00:03:39.126 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/14-1.c" 2024-06-03T00:03:39.126 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.126 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.126 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.126 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1492808482, 2024-06-03T00:03:39.127 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634142, 2024-06-03T00:03:39.127 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-11.c" 2024-06-03T00:03:39.127 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.127 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.127 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.127 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1495442835, 2024-06-03T00:03:39.127 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632190, 2024-06-03T00:03:39.127 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_033.c" 2024-06-03T00:03:39.127 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.127 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.127 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.127 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1498021618, 2024-06-03T00:03:39.127 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631816, 2024-06-03T00:03:39.128 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/sync.c" 2024-06-03T00:03:39.128 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.128 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.128 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.128 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1500964507, 2024-06-03T00:03:39.128 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632699, 2024-06-03T00:03:39.128 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/27-1.c" 2024-06-03T00:03:39.128 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.128 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.128 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.128 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1505409540, 2024-06-03T00:03:39.128 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632714, 2024-06-03T00:03:39.128 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/23-1.c" 2024-06-03T00:03:39.129 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.129 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.129 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.129 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1509853354, 2024-06-03T00:03:39.129 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634181, 2024-06-03T00:03:39.129 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-15.c" 2024-06-03T00:03:39.129 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.129 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.129 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.129 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1511137456, 2024-06-03T00:03:39.129 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632805, 2024-06-03T00:03:39.129 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/16-1.c" 2024-06-03T00:03:39.129 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.129 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.130 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.130 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1512386044, 2024-06-03T00:03:39.130 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634109, 2024-06-03T00:03:39.130 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-19.c" 2024-06-03T00:03:39.130 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.130 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.130 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.130 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1521863689, 2024-06-03T00:03:39.130 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632186, 2024-06-03T00:03:39.130 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_008.c" 2024-06-03T00:03:39.130 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.130 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.130 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.131 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1525628056, 2024-06-03T00:03:39.131 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632030, 2024-06-03T00:03:39.131 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/Makefile.in" 2024-06-03T00:03:39.131 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.131 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.131 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.131 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1531997668, 2024-06-03T00:03:39.131 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631985, 2024-06-03T00:03:39.131 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/sim_init.c" 2024-06-03T00:03:39.131 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.131 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.131 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.131 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1532368299, 2024-06-03T00:03:39.131 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632733, 2024-06-03T00:03:39.132 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-17.c" 2024-06-03T00:03:39.132 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.132 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.132 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.132 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1532395080, 2024-06-03T00:03:39.132 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632104, 2024-06-03T00:03:39.132 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_inventory.c" 2024-06-03T00:03:39.132 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.132 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.132 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.132 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1536786401, 2024-06-03T00:03:39.132 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632058, 2024-06-03T00:03:39.132 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset024.c" 2024-06-03T00:03:39.133 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.133 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.133 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.133 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1542252397, 2024-06-03T00:03:39.133 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634213, 2024-06-03T00:03:39.133 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-10.c" 2024-06-03T00:03:39.133 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.133 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.133 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.133 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1546697547, 2024-06-03T00:03:39.133 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632149, 2024-06-03T00:03:39.133 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_power.h" 2024-06-03T00:03:39.133 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.133 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.134 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.134 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1549051975, 2024-06-03T00:03:39.134 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632766, 2024-06-03T00:03:39.134 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-1.c" 2024-06-03T00:03:39.134 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.134 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.134 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.134 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1557008299, 2024-06-03T00:03:39.134 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632128, 2024-06-03T00:03:39.134 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_ssl.h" 2024-06-03T00:03:39.134 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.134 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.134 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.135 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1557070098, 2024-06-03T00:03:39.135 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631839, 2024-06-03T00:03:39.135 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/watchdog/README" 2024-06-03T00:03:39.135 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.135 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.135 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.135 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1559734411, 2024-06-03T00:03:39.135 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631920, 2024-06-03T00:03:39.135 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_auth.h" 2024-06-03T00:03:39.135 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.135 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.135 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.135 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1568997910, 2024-06-03T00:03:39.135 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632071, 2024-06-03T00:03:39.135 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_reset.h" 2024-06-03T00:03:39.136 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.136 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.136 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.136 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1581249046, 2024-06-03T00:03:39.136 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632660, 2024-06-03T00:03:39.136 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/32-1.c" 2024-06-03T00:03:39.136 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.136 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.136 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.136 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1585667229, 2024-06-03T00:03:39.136 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632255, 2024-06-03T00:03:39.136 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_control.h" 2024-06-03T00:03:39.136 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.136 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.137 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.137 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1590171473, 2024-06-03T00:03:39.137 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632028, 2024-06-03T00:03:39.137 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/thotswap-simple001.c" 2024-06-03T00:03:39.137 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.137 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.137 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.137 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1590751596, 2024-06-03T00:03:39.137 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633850, 2024-06-03T00:03:39.137 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-6.c" 2024-06-03T00:03:39.137 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.137 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.137 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.137 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1596851684, 2024-06-03T00:03:39.138 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633778, 2024-06-03T00:03:39.138 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-15.c" 2024-06-03T00:03:39.138 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.138 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.138 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.138 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1605564279, 2024-06-03T00:03:39.138 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632812, 2024-06-03T00:03:39.138 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-5.c" 2024-06-03T00:03:39.138 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.138 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.138 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.138 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1606199615, 2024-06-03T00:03:39.138 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632884, 2024-06-03T00:03:39.138 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/coverage.txt" 2024-06-03T00:03:39.139 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.139 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.139 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.139 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1606747524, 2024-06-03T00:03:39.139 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632165, 2024-06-03T00:03:39.139 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_sensor_func.c" 2024-06-03T00:03:39.139 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.139 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.139 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.139 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1611579182, 2024-06-03T00:03:39.139 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632723, 2024-06-03T00:03:39.139 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/33-1.c" 2024-06-03T00:03:39.139 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.140 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.140 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.140 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1616659308, 2024-06-03T00:03:39.140 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632760, 2024-06-03T00:03:39.140 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/2-2.c" 2024-06-03T00:03:39.140 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.140 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.140 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.140 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1623779845, 2024-06-03T00:03:39.140 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632024, 2024-06-03T00:03:39.140 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset008.c" 2024-06-03T00:03:39.140 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.140 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.141 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.141 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1624404267, 2024-06-03T00:03:39.141 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631904, 2024-06-03T00:03:39.141 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/Makefile.in" 2024-06-03T00:03:39.141 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.141 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.141 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.141 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1630291086, 2024-06-03T00:03:39.141 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632015, 2024-06-03T00:03:39.141 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel005.c" 2024-06-03T00:03:39.141 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.141 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.141 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.141 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1634965057, 2024-06-03T00:03:39.141 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632811, 2024-06-03T00:03:39.142 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/20-1.c" 2024-06-03T00:03:39.142 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.142 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.142 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.142 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1641447186, 2024-06-03T00:03:39.142 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634029, 2024-06-03T00:03:39.142 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-18.c" 2024-06-03T00:03:39.142 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.142 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.142 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.142 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1644161157, 2024-06-03T00:03:39.142 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634195, 2024-06-03T00:03:39.142 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-19.c" 2024-06-03T00:03:39.143 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.143 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.143 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.143 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1649345852, 2024-06-03T00:03:39.143 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632038, 2024-06-03T00:03:39.143 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsim_file.c" 2024-06-03T00:03:39.143 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.143 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.143 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.143 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1650721945, 2024-06-03T00:03:39.143 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632781, 2024-06-03T00:03:39.143 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-39.c" 2024-06-03T00:03:39.143 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.144 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.144 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.144 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1651512271, 2024-06-03T00:03:39.144 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632898, 2024-06-03T00:03:39.144 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/12-1.c" 2024-06-03T00:03:39.144 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.144 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.144 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.144 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1654378135, 2024-06-03T00:03:39.144 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632098, 2024-06-03T00:03:39.144 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_utils.h" 2024-06-03T00:03:39.144 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.144 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.144 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.144 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1658652306, 2024-06-03T00:03:39.145 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632837, 2024-06-03T00:03:39.145 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-4.c" 2024-06-03T00:03:39.145 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.145 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.145 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.145 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1663309929, 2024-06-03T00:03:39.145 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632832, 2024-06-03T00:03:39.145 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-8.c" 2024-06-03T00:03:39.145 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.145 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.145 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.145 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1667837781, 2024-06-03T00:03:39.145 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631960, 2024-06-03T00:03:39.145 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_resources.c" 2024-06-03T00:03:39.146 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.146 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.146 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.146 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1671111158, 2024-06-03T00:03:39.146 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632724, 2024-06-03T00:03:39.146 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/28-1.c" 2024-06-03T00:03:39.146 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.146 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.146 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.146 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1674516033, 2024-06-03T00:03:39.146 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632859, 2024-06-03T00:03:39.146 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/6-1.c" 2024-06-03T00:03:39.146 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.146 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.147 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.147 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1674562724, 2024-06-03T00:03:39.147 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631807, 2024-06-03T00:03:39.147 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_close.c" 2024-06-03T00:03:39.147 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.147 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.147 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.147 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1685550513, 2024-06-03T00:03:39.147 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633950, 2024-06-03T00:03:39.147 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-9.c" 2024-06-03T00:03:39.147 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.147 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.147 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.148 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1686941271, 2024-06-03T00:03:39.148 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634056, 2024-06-03T00:03:39.148 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-23.c" 2024-06-03T00:03:39.148 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.148 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.148 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.148 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1694702203, 2024-06-03T00:03:39.148 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631870, 2024-06-03T00:03:39.148 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_fru_info.cpp" 2024-06-03T00:03:39.148 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.148 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.148 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.148 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1696471171, 2024-06-03T00:03:39.148 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632068, 2024-06-03T00:03:39.149 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_server_event.h" 2024-06-03T00:03:39.149 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.149 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.149 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.149 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1702875773, 2024-06-03T00:03:39.149 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632721, 2024-06-03T00:03:39.149 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/18-1.c" 2024-06-03T00:03:39.149 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.149 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.149 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.149 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1704502806, 2024-06-03T00:03:39.149 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632665, 2024-06-03T00:03:39.149 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/35-1.c" 2024-06-03T00:03:39.149 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.149 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.150 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.150 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1716144110, 2024-06-03T00:03:39.150 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633788, 2024-06-03T00:03:39.150 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-23.c" 2024-06-03T00:03:39.150 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.150 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.150 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.150 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1722187428, 2024-06-03T00:03:39.150 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633754, 2024-06-03T00:03:39.150 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-7.c" 2024-06-03T00:03:39.150 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.150 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.150 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.151 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1723926949, 2024-06-03T00:03:39.151 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632130, 2024-06-03T00:03:39.151 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_cmnds.h" 2024-06-03T00:03:39.151 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.151 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.151 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.151 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1724718025, 2024-06-03T00:03:39.151 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632159, 2024-06-03T00:03:39.151 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_control_func.c" 2024-06-03T00:03:39.151 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.151 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.151 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.151 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1731560918, 2024-06-03T00:03:39.152 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632075, 2024-06-03T00:03:39.152 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_fumi.h" 2024-06-03T00:03:39.152 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.152 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.152 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.152 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1735701182, 2024-06-03T00:03:39.152 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632241, 2024-06-03T00:03:39.152 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_discover.h" 2024-06-03T00:03:39.152 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.152 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.152 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.152 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1739511860, 2024-06-03T00:03:39.152 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632783, 2024-06-03T00:03:39.153 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-23.c" 2024-06-03T00:03:39.153 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.153 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.153 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.153 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1744202281, 2024-06-03T00:03:39.153 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632012, 2024-06-03T00:03:39.153 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset023.c" 2024-06-03T00:03:39.153 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.153 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.153 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.153 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1745237180, 2024-06-03T00:03:39.153 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634148, 2024-06-03T00:03:39.153 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-3.c" 2024-06-03T00:03:39.153 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.154 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.154 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.154 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1745349233, 2024-06-03T00:03:39.154 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632786, 2024-06-03T00:03:39.154 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h" 2024-06-03T00:03:39.154 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.154 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.154 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.154 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1748187465, 2024-06-03T00:03:39.154 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631917, 2024-06-03T00:03:39.154 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_cmd.h" 2024-06-03T00:03:39.154 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.154 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.154 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.155 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1750658886, 2024-06-03T00:03:39.155 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631930, 2024-06-03T00:03:39.155 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_force.h" 2024-06-03T00:03:39.155 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.155 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.155 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.155 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1751966802, 2024-06-03T00:03:39.155 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632264, 2024-06-03T00:03:39.155 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/sysfs/README" 2024-06-03T00:03:39.155 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.155 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.155 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.155 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1764868610, 2024-06-03T00:03:39.155 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632736, 2024-06-03T00:03:39.156 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/15-1.c" 2024-06-03T00:03:39.156 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.156 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.156 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.156 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1766872039, 2024-06-03T00:03:39.156 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632205, 2024-06-03T00:03:39.156 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_020.c" 2024-06-03T00:03:39.156 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.156 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.156 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.156 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1773572993, 2024-06-03T00:03:39.156 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631942, 2024-06-03T00:03:39.156 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_plugin.h" 2024-06-03T00:03:39.156 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.157 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.157 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.157 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1775333002, 2024-06-03T00:03:39.157 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632138, 2024-06-03T00:03:39.157 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/Makefile.am" 2024-06-03T00:03:39.157 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.157 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.157 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.157 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1775566225, 2024-06-03T00:03:39.157 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632652, 2024-06-03T00:03:39.157 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/35-3.c" 2024-06-03T00:03:39.157 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.157 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.157 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.158 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1776309640, 2024-06-03T00:03:39.158 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633959, 2024-06-03T00:03:39.158 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-8.c" 2024-06-03T00:03:39.158 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.158 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.158 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.158 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1789704311, 2024-06-03T00:03:39.158 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632122, 2024-06-03T00:03:39.158 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_sensor.c" 2024-06-03T00:03:39.158 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.158 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.158 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.158 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1790094843, 2024-06-03T00:03:39.158 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632827, 2024-06-03T00:03:39.159 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/assertions.xml" 2024-06-03T00:03:39.159 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.159 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.159 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.159 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1791179353, 2024-06-03T00:03:39.159 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634227, 2024-06-03T00:03:39.159 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-64.c" 2024-06-03T00:03:39.159 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.159 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.159 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.159 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1799275334, 2024-06-03T00:03:39.159 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634187, 2024-06-03T00:03:39.159 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-23.c" 2024-06-03T00:03:39.159 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.159 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.160 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.160 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1805261189, 2024-06-03T00:03:39.160 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633769, 2024-06-03T00:03:39.160 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-5.c" 2024-06-03T00:03:39.160 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.160 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.160 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.160 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1821040097, 2024-06-03T00:03:39.160 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632799, 2024-06-03T00:03:39.160 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/assertions.xml" 2024-06-03T00:03:39.160 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.160 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.160 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.160 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1831470687, 2024-06-03T00:03:39.161 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632696, 2024-06-03T00:03:39.161 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h" 2024-06-03T00:03:39.161 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.161 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.161 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.161 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1836195628, 2024-06-03T00:03:39.161 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632084, 2024-06-03T00:03:39.161 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_ps_event.c" 2024-06-03T00:03:39.161 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.161 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.161 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.161 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1852274731, 2024-06-03T00:03:39.161 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632909, 2024-06-03T00:03:39.161 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/11-1.c" 2024-06-03T00:03:39.161 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.162 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.162 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.162 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1863514031, 2024-06-03T00:03:39.162 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632175, 2024-06-03T00:03:39.162 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_watchdog.c" 2024-06-03T00:03:39.162 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.162 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.162 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.162 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1871295512, 2024-06-03T00:03:39.162 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631941, 2024-06-03T00:03:39.162 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_watchdog.c" 2024-06-03T00:03:39.162 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.162 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.162 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.163 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1872985187, 2024-06-03T00:03:39.163 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632881, 2024-06-03T00:03:39.163 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/23-1.c" 2024-06-03T00:03:39.163 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.163 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.163 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.163 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1889667293, 2024-06-03T00:03:39.163 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634075, 2024-06-03T00:03:39.163 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-7.c" 2024-06-03T00:03:39.163 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.163 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.163 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.163 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1893024882, 2024-06-03T00:03:39.163 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632715, 2024-06-03T00:03:39.164 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/19-1.c" 2024-06-03T00:03:39.164 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.164 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.164 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.164 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1903838880, 2024-06-03T00:03:39.164 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633748, 2024-06-03T00:03:39.164 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-20.c" 2024-06-03T00:03:39.164 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.164 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.164 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.164 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1909875908, 2024-06-03T00:03:39.164 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631981, 2024-06-03T00:03:39.164 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tcontrol001.c" 2024-06-03T00:03:39.164 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.165 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.165 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.165 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1909909894, 2024-06-03T00:03:39.165 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633856, 2024-06-03T00:03:39.165 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-16.c" 2024-06-03T00:03:39.165 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.165 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.165 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.165 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1915887455, 2024-06-03T00:03:39.165 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631851, 2024-06-03T00:03:39.165 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sdr.cpp" 2024-06-03T00:03:39.165 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.165 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.165 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.165 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1922782395, 2024-06-03T00:03:39.166 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633917, 2024-06-03T00:03:39.166 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-23.c" 2024-06-03T00:03:39.166 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.166 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.166 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.166 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1925728712, 2024-06-03T00:03:39.166 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632793, 2024-06-03T00:03:39.166 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/8-4.c" 2024-06-03T00:03:39.166 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.166 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.166 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.166 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1928685330, 2024-06-03T00:03:39.166 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632061, 2024-06-03T00:03:39.166 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/Makefile.am" 2024-06-03T00:03:39.167 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.167 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.167 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.167 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1935289842, 2024-06-03T00:03:39.167 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632043, 2024-06-03T00:03:39.167 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset018.c" 2024-06-03T00:03:39.167 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.167 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.167 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.167 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1936228155, 2024-06-03T00:03:39.167 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631867, 2024-06-03T00:03:39.167 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con.h" 2024-06-03T00:03:39.167 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.168 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.168 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.168 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1936515624, 2024-06-03T00:03:39.168 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632066, 2024-06-03T00:03:39.168 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_enclosure_event.h" 2024-06-03T00:03:39.168 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.168 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.168 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.168 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1942758516, 2024-06-03T00:03:39.168 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633920, 2024-06-03T00:03:39.168 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-25.c" 2024-06-03T00:03:39.168 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.168 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.168 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.169 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1943739276, 2024-06-03T00:03:39.169 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632181, 2024-06-03T00:03:39.169 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_036.c" 2024-06-03T00:03:39.169 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.169 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.169 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.169 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1943920902, 2024-06-03T00:03:39.169 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631935, 2024-06-03T00:03:39.169 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_inventory.h" 2024-06-03T00:03:39.169 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.169 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.169 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.169 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1950280911, 2024-06-03T00:03:39.169 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634018, 2024-06-03T00:03:39.170 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-58.c" 2024-06-03T00:03:39.170 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.170 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.170 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.170 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1951014945, 2024-06-03T00:03:39.170 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631880, 2024-06-03T00:03:39.170 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor.h" 2024-06-03T00:03:39.170 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.170 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.170 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.170 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1957776009, 2024-06-03T00:03:39.170 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632220, 2024-06-03T00:03:39.170 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_009.c" 2024-06-03T00:03:39.170 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.170 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.171 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.171 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1963092115, 2024-06-03T00:03:39.171 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633952, 2024-06-03T00:03:39.171 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-23.c" 2024-06-03T00:03:39.171 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.171 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.171 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.171 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1964939747, 2024-06-03T00:03:39.171 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632897, 2024-06-03T00:03:39.171 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/assertions.xml" 2024-06-03T00:03:39.171 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.171 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.171 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.171 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1968222541, 2024-06-03T00:03:39.172 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632225, 2024-06-03T00:03:39.172 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_023.c" 2024-06-03T00:03:39.172 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.172 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.172 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.172 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1974642356, 2024-06-03T00:03:39.172 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634137, 2024-06-03T00:03:39.172 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-15.c" 2024-06-03T00:03:39.172 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.172 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.172 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.172 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1980104701, 2024-06-03T00:03:39.172 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632779, 2024-06-03T00:03:39.172 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-13.c" 2024-06-03T00:03:39.173 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.173 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.173 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.173 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1982720831, 2024-06-03T00:03:39.173 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633954, 2024-06-03T00:03:39.173 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-23.c" 2024-06-03T00:03:39.173 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.173 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.173 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.173 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1982975110, 2024-06-03T00:03:39.173 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632125, 2024-06-03T00:03:39.173 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_xml.h" 2024-06-03T00:03:39.173 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.173 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.174 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.174 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1984927926, 2024-06-03T00:03:39.174 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632267, 2024-06-03T00:03:39.174 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/sysfs/Makefile.am" 2024-06-03T00:03:39.174 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.174 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.174 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.174 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1987795630, 2024-06-03T00:03:39.174 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632694, 2024-06-03T00:03:39.174 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/assertions.xml" 2024-06-03T00:03:39.174 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.174 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.174 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.175 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 1999103087, 2024-06-03T00:03:39.175 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632132, 2024-06-03T00:03:39.175 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_idr.c" 2024-06-03T00:03:39.175 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.175 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.175 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.175 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2000109922, 2024-06-03T00:03:39.175 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633974, 2024-06-03T00:03:39.175 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-4.c" 2024-06-03T00:03:39.175 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.175 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.175 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.175 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2000686106, 2024-06-03T00:03:39.175 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633780, 2024-06-03T00:03:39.175 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-22.c" 2024-06-03T00:03:39.176 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.176 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.176 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.176 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2003256680, 2024-06-03T00:03:39.176 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632106, 2024-06-03T00:03:39.176 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_reset.c" 2024-06-03T00:03:39.176 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.176 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.176 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.176 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2005547265, 2024-06-03T00:03:39.176 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632171, 2024-06-03T00:03:39.176 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_el.h" 2024-06-03T00:03:39.176 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.176 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.176 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.177 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2005662235, 2024-06-03T00:03:39.177 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632639, 2024-06-03T00:03:39.177 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/11-1.c" 2024-06-03T00:03:39.177 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.177 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.177 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.177 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2009688545, 2024-06-03T00:03:39.177 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632886, 2024-06-03T00:03:39.177 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/14-1.c" 2024-06-03T00:03:39.177 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.177 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.177 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.177 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2013200383, 2024-06-03T00:03:39.178 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631900, 2024-06-03T00:03:39.178 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_addr.h" 2024-06-03T00:03:39.178 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.178 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.178 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.178 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2016048586, 2024-06-03T00:03:39.178 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632727, 2024-06-03T00:03:39.178 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/2-1.c" 2024-06-03T00:03:39.178 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.178 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.178 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.178 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2032455794, 2024-06-03T00:03:39.178 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632176, 2024-06-03T00:03:39.179 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_controls.c" 2024-06-03T00:03:39.179 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.179 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.179 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.179 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2035428210, 2024-06-03T00:03:39.179 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633708, 2024-06-03T00:03:39.179 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-21.c" 2024-06-03T00:03:39.179 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.179 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.179 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.179 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2035522483, 2024-06-03T00:03:39.179 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632862, 2024-06-03T00:03:39.179 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/8-1.c" 2024-06-03T00:03:39.180 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.180 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.180 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.180 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2039643565, 2024-06-03T00:03:39.180 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633839, 2024-06-03T00:03:39.180 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-7.c" 2024-06-03T00:03:39.180 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.180 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.180 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.180 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2040778865, 2024-06-03T00:03:39.180 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632706, 2024-06-03T00:03:39.180 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/41-1.c" 2024-06-03T00:03:39.180 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.181 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.181 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.181 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2042203259, 2024-06-03T00:03:39.181 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632006, 2024-06-03T00:03:39.181 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/openhpi.conf" 2024-06-03T00:03:39.181 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.181 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.181 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.181 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2045756599, 2024-06-03T00:03:39.181 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632866, 2024-06-03T00:03:39.181 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/12-3.c" 2024-06-03T00:03:39.181 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.181 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.182 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.182 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2049942773, 2024-06-03T00:03:39.182 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632108, 2024-06-03T00:03:39.182 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap.h" 2024-06-03T00:03:39.182 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.182 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.182 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.182 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2051013683, 2024-06-03T00:03:39.182 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632861, 2024-06-03T00:03:39.182 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/7-4.c" 2024-06-03T00:03:39.182 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.182 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.182 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.183 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2051088032, 2024-06-03T00:03:39.183 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632746, 2024-06-03T00:03:39.183 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-21.c" 2024-06-03T00:03:39.183 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.183 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.183 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.183 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2054592706, 2024-06-03T00:03:39.183 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631963, 2024-06-03T00:03:39.183 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_annunciator.c" 2024-06-03T00:03:39.183 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.183 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.183 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.183 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2079810457, 2024-06-03T00:03:39.183 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631923, 2024-06-03T00:03:39.184 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/test.h" 2024-06-03T00:03:39.184 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.184 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.184 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.184 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2084467854, 2024-06-03T00:03:39.184 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632731, 2024-06-03T00:03:39.184 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/1-1.c" 2024-06-03T00:03:39.184 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.184 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.184 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.184 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2085063771, 2024-06-03T00:03:39.184 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634141, 2024-06-03T00:03:39.184 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-12.c" 2024-06-03T00:03:39.184 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.184 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.185 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.185 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2094173191, 2024-06-03T00:03:39.185 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634111, 2024-06-03T00:03:39.185 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-15.c" 2024-06-03T00:03:39.185 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.185 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.185 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.185 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2094734528, 2024-06-03T00:03:39.185 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633912, 2024-06-03T00:03:39.185 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-2.c" 2024-06-03T00:03:39.185 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.185 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.185 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.185 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2094944633, 2024-06-03T00:03:39.186 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631858, 2024-06-03T00:03:39.186 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_fix_sdr.h" 2024-06-03T00:03:39.186 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.186 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.186 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.186 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2095126932, 2024-06-03T00:03:39.186 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632845, 2024-06-03T00:03:39.186 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/3-1.c" 2024-06-03T00:03:39.186 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.186 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.186 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.186 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2096967966, 2024-06-03T00:03:39.186 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632113, 2024-06-03T00:03:39.186 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_fan_event.c" 2024-06-03T00:03:39.186 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.187 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.187 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.187 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2097001319, 2024-06-03T00:03:39.187 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631968, 2024-06-03T00:03:39.187 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_reset.h" 2024-06-03T00:03:39.187 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.187 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.187 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.187 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2103065923, 2024-06-03T00:03:39.187 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632668, 2024-06-03T00:03:39.187 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/34-1.c" 2024-06-03T00:03:39.187 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.187 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.187 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.188 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2105428439, 2024-06-03T00:03:39.188 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631811, 2024-06-03T00:03:39.188 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ekeyfru.h" 2024-06-03T00:03:39.188 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.188 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.188 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.188 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2108149016, 2024-06-03T00:03:39.188 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632834, 2024-06-03T00:03:39.188 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-10.c" 2024-06-03T00:03:39.188 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.188 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.188 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.188 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2110041806, 2024-06-03T00:03:39.188 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634003, 2024-06-03T00:03:39.189 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-3.c" 2024-06-03T00:03:39.189 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.189 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.189 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.189 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2112908137, 2024-06-03T00:03:39.189 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632105, 2024-06-03T00:03:39.189 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_utils.c" 2024-06-03T00:03:39.189 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.189 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.189 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.189 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2114401101, 2024-06-03T00:03:39.189 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631825, 2024-06-03T00:03:39.189 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_fru_rdrs.c" 2024-06-03T00:03:39.189 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.190 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.190 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.190 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2116300652, 2024-06-03T00:03:39.190 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631866, 2024-06-03T00:03:39.190 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_resource.cpp" 2024-06-03T00:03:39.190 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.190 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.190 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.190 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2121785095, 2024-06-03T00:03:39.190 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632879, 2024-06-03T00:03:39.190 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/20-1.c" 2024-06-03T00:03:39.190 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.191 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.191 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.191 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2122068184, 2024-06-03T00:03:39.191 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633763, 2024-06-03T00:03:39.191 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-24.c" 2024-06-03T00:03:39.191 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.191 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.191 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.191 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2122441709, 2024-06-03T00:03:39.191 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632206, 2024-06-03T00:03:39.191 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_011.c" 2024-06-03T00:03:39.191 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.191 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.192 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.192 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2130160023, 2024-06-03T00:03:39.192 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634010, 2024-06-03T00:03:39.192 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-9.c" 2024-06-03T00:03:39.192 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.192 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.192 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.192 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2133024197, 2024-06-03T00:03:39.192 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631957, 2024-06-03T00:03:39.192 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_power.h" 2024-06-03T00:03:39.192 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.192 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.192 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.192 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2137532415, 2024-06-03T00:03:39.193 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632187, 2024-06-03T00:03:39.193 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_016.c" 2024-06-03T00:03:39.193 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.193 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.193 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.193 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2139322100, 2024-06-03T00:03:39.193 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632180, 2024-06-03T00:03:39.193 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_039.c" 2024-06-03T00:03:39.193 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.193 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.193 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.193 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2140346287, 2024-06-03T00:03:39.193 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631954, 2024-06-03T00:03:39.193 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_discover.h" 2024-06-03T00:03:39.193 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.194 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.194 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.194 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2144936146, 2024-06-03T00:03:39.194 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632682, 2024-06-03T00:03:39.194 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/7-2.c" 2024-06-03T00:03:39.194 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.194 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.194 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.194 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2147164031, 2024-06-03T00:03:39.194 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632906, 2024-06-03T00:03:39.194 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/4-1.c" 2024-06-03T00:03:39.194 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.194 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.195 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.195 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2149211484, 2024-06-03T00:03:39.195 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634058, 2024-06-03T00:03:39.195 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-8.c" 2024-06-03T00:03:39.195 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.195 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.195 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.195 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2150798875, 2024-06-03T00:03:39.195 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632233, 2024-06-03T00:03:39.195 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_hotswap.h" 2024-06-03T00:03:39.195 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.195 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.195 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.196 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2155535285, 2024-06-03T00:03:39.196 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632227, 2024-06-03T00:03:39.196 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/Makefile.am" 2024-06-03T00:03:39.196 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.196 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.196 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.196 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2155951518, 2024-06-03T00:03:39.196 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632151, 2024-06-03T00:03:39.196 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_sensor_func.h" 2024-06-03T00:03:39.196 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.196 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.196 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.196 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2158083215, 2024-06-03T00:03:39.196 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631881, 2024-06-03T00:03:39.197 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_hotswap.h" 2024-06-03T00:03:39.197 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.197 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.197 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.197 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2161412818, 2024-06-03T00:03:39.197 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631846, 2024-06-03T00:03:39.197 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_log.cpp" 2024-06-03T00:03:39.197 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.197 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.197 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.197 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2164522441, 2024-06-03T00:03:39.197 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634094, 2024-06-03T00:03:39.197 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-3.c" 2024-06-03T00:03:39.197 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.198 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.198 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.198 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2166230076, 2024-06-03T00:03:39.198 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634237, 2024-06-03T00:03:39.198 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-20.c" 2024-06-03T00:03:39.198 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.198 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.198 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.198 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2167640264, 2024-06-03T00:03:39.198 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633802, 2024-06-03T00:03:39.198 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-11.c" 2024-06-03T00:03:39.198 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.198 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.198 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.199 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2168520530, 2024-06-03T00:03:39.199 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632756, 2024-06-03T00:03:39.199 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/21-1.c" 2024-06-03T00:03:39.199 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.199 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.199 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.199 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2169771223, 2024-06-03T00:03:39.199 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632647, 2024-06-03T00:03:39.199 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/19-1.c" 2024-06-03T00:03:39.199 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.199 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.199 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.199 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2171935622, 2024-06-03T00:03:39.199 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632901, 2024-06-03T00:03:39.199 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/4-3.c" 2024-06-03T00:03:39.200 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.200 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.200 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.200 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2180690119, 2024-06-03T00:03:39.200 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631971, 2024-06-03T00:03:39.200 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_el.h" 2024-06-03T00:03:39.200 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.200 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.200 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.200 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2190672005, 2024-06-03T00:03:39.200 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633957, 2024-06-03T00:03:39.200 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-1.c" 2024-06-03T00:03:39.200 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.200 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.201 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.201 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2195191846, 2024-06-03T00:03:39.201 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632107, 2024-06-03T00:03:39.201 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_annunciator.c" 2024-06-03T00:03:39.201 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.201 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.201 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.201 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2217872503, 2024-06-03T00:03:39.201 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631852, 2024-06-03T00:03:39.201 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_sun_led.cpp" 2024-06-03T00:03:39.201 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.201 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.201 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.202 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2218822639, 2024-06-03T00:03:39.202 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633765, 2024-06-03T00:03:39.202 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-18.c" 2024-06-03T00:03:39.202 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.202 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.202 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.202 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2222204727, 2024-06-03T00:03:39.202 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632194, 2024-06-03T00:03:39.202 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_021.c" 2024-06-03T00:03:39.202 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.202 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.202 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.202 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2228873541, 2024-06-03T00:03:39.202 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633976, 2024-06-03T00:03:39.203 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-101.c" 2024-06-03T00:03:39.203 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.203 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.203 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.203 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2233499765, 2024-06-03T00:03:39.203 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633833, 2024-06-03T00:03:39.203 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-13.c" 2024-06-03T00:03:39.203 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.203 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.203 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.203 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2241735764, 2024-06-03T00:03:39.203 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632133, 2024-06-03T00:03:39.203 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_xml.c" 2024-06-03T00:03:39.203 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.204 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.204 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.204 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2258060728, 2024-06-03T00:03:39.204 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632633, 2024-06-03T00:03:39.204 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/6-1.c" 2024-06-03T00:03:39.204 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.204 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.204 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.204 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2258866797, 2024-06-03T00:03:39.204 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632623, 2024-06-03T00:03:39.204 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/unistd_h" 2024-06-03T00:03:39.204 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.204 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.204 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.204 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2271906744, 2024-06-03T00:03:39.205 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632763, 2024-06-03T00:03:39.205 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-30.c" 2024-06-03T00:03:39.205 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.205 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.205 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.205 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2274593188, 2024-06-03T00:03:39.205 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632019, 2024-06-03T00:03:39.205 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tset_resource_tag.c" 2024-06-03T00:03:39.205 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.205 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.205 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.205 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2278216275, 2024-06-03T00:03:39.205 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632212, 2024-06-03T00:03:39.205 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_000.c" 2024-06-03T00:03:39.206 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.206 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.206 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.206 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2280080699, 2024-06-03T00:03:39.206 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632720, 2024-06-03T00:03:39.206 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/sigmacrolist.txt" 2024-06-03T00:03:39.206 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.206 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.206 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.206 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2301931460, 2024-06-03T00:03:39.206 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632126, 2024-06-03T00:03:39.206 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_ssl.c" 2024-06-03T00:03:39.206 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.206 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.207 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.207 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2305944553, 2024-06-03T00:03:39.207 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634198, 2024-06-03T00:03:39.207 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-35.c" 2024-06-03T00:03:39.207 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.207 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.207 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.207 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2306398464, 2024-06-03T00:03:39.207 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632742, 2024-06-03T00:03:39.207 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-20.c" 2024-06-03T00:03:39.207 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.207 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.207 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.207 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2306920332, 2024-06-03T00:03:39.208 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631849, 2024-06-03T00:03:39.208 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_discrete.cpp" 2024-06-03T00:03:39.208 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.208 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.208 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.208 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2315919081, 2024-06-03T00:03:39.208 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632183, 2024-06-03T00:03:39.208 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_028.c" 2024-06-03T00:03:39.208 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.208 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.208 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.208 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2327398378, 2024-06-03T00:03:39.208 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632174, 2024-06-03T00:03:39.208 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_annunciators.h" 2024-06-03T00:03:39.208 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.209 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.209 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.209 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2329708011, 2024-06-03T00:03:39.209 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631902, 2024-06-03T00:03:39.209 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_domain.h" 2024-06-03T00:03:39.209 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.209 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.209 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.209 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2330762727, 2024-06-03T00:03:39.209 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632031, 2024-06-03T00:03:39.209 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv006.c" 2024-06-03T00:03:39.209 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.209 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.209 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.210 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2334573757, 2024-06-03T00:03:39.210 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632791, 2024-06-03T00:03:39.210 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/coverage.txt" 2024-06-03T00:03:39.210 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.210 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.210 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.210 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2350250319, 2024-06-03T00:03:39.210 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631806, 2024-06-03T00:03:39.210 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sensor_event.c" 2024-06-03T00:03:39.210 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.210 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.210 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.210 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2351074004, 2024-06-03T00:03:39.210 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632222, 2024-06-03T00:03:39.211 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_030.c" 2024-06-03T00:03:39.211 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.211 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.211 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.211 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2356371170, 2024-06-03T00:03:39.211 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632673, 2024-06-03T00:03:39.211 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/13-1.c" 2024-06-03T00:03:39.211 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.211 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.211 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.211 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2365002566, 2024-06-03T00:03:39.211 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633993, 2024-06-03T00:03:39.211 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-21.c" 2024-06-03T00:03:39.211 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.211 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.212 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.212 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2374398933, 2024-06-03T00:03:39.212 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631972, 2024-06-03T00:03:39.212 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_hotswap.c" 2024-06-03T00:03:39.212 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.212 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.212 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.212 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2380246257, 2024-06-03T00:03:39.212 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632785, 2024-06-03T00:03:39.212 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/2-3.c" 2024-06-03T00:03:39.212 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.212 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.212 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.212 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2381371774, 2024-06-03T00:03:39.213 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631892, 2024-06-03T00:03:39.213 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control.h" 2024-06-03T00:03:39.213 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.213 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.213 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.213 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2385119700, 2024-06-03T00:03:39.213 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632065, 2024-06-03T00:03:39.213 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_callsupport.h" 2024-06-03T00:03:39.213 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.213 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.213 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.213 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2393385099, 2024-06-03T00:03:39.213 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632002, 2024-06-03T00:03:39.213 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsptime001.c" 2024-06-03T00:03:39.213 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.214 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.214 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.214 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2399785561, 2024-06-03T00:03:39.214 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632780, 2024-06-03T00:03:39.214 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/17-1.c" 2024-06-03T00:03:39.214 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.214 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.214 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.214 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2402624824, 2024-06-03T00:03:39.214 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632854, 2024-06-03T00:03:39.214 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/9-1.c" 2024-06-03T00:03:39.214 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.214 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.214 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.215 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2405884984, 2024-06-03T00:03:39.215 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634251, 2024-06-03T00:03:39.215 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-17.c" 2024-06-03T00:03:39.215 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.215 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.215 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.215 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2409311351, 2024-06-03T00:03:39.215 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632011, 2024-06-03T00:03:39.215 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget005.c" 2024-06-03T00:03:39.215 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.215 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.215 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.215 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2411441628, 2024-06-03T00:03:39.215 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632007, 2024-06-03T00:03:39.216 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/sim_resources.h" 2024-06-03T00:03:39.216 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.216 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.216 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.216 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2420331225, 2024-06-03T00:03:39.216 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632719, 2024-06-03T00:03:39.216 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-32.c" 2024-06-03T00:03:39.216 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.216 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.216 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.216 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2422203022, 2024-06-03T00:03:39.216 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632045, 2024-06-03T00:03:39.216 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset001.c" 2024-06-03T00:03:39.216 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.216 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.217 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.217 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2428368660, 2024-06-03T00:03:39.217 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632743, 2024-06-03T00:03:39.217 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-16.c" 2024-06-03T00:03:39.217 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.217 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.217 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.217 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2436838099, 2024-06-03T00:03:39.217 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632258, 2024-06-03T00:03:39.217 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_hotswap.c" 2024-06-03T00:03:39.217 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.217 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.217 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.217 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2445627310, 2024-06-03T00:03:39.218 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631876, 2024-06-03T00:03:39.218 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_text_buffer.cpp" 2024-06-03T00:03:39.218 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.218 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.218 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.218 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2447275696, 2024-06-03T00:03:39.218 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634236, 2024-06-03T00:03:39.218 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-24.c" 2024-06-03T00:03:39.218 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.218 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.218 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.218 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2448895740, 2024-06-03T00:03:39.218 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632057, 2024-06-03T00:03:39.218 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset002.c" 2024-06-03T00:03:39.219 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.219 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.219 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.219 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2450379519, 2024-06-03T00:03:39.219 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634144, 2024-06-03T00:03:39.219 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-1.c" 2024-06-03T00:03:39.219 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.219 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.219 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.219 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2451715444, 2024-06-03T00:03:39.219 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633740, 2024-06-03T00:03:39.219 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-6.c" 2024-06-03T00:03:39.219 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.219 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.220 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.220 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2452389036, 2024-06-03T00:03:39.220 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631841, 2024-06-03T00:03:39.220 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/watchdog/Makefile.am" 2024-06-03T00:03:39.220 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.220 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.220 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.220 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2454401159, 2024-06-03T00:03:39.220 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632629, 2024-06-03T00:03:39.220 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/9-1.c" 2024-06-03T00:03:39.220 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.220 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.220 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.220 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2457117931, 2024-06-03T00:03:39.220 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632059, 2024-06-03T00:03:39.221 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset003.c" 2024-06-03T00:03:39.221 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.221 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.221 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.221 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2457316509, 2024-06-03T00:03:39.221 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633881, 2024-06-03T00:03:39.221 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-14.c" 2024-06-03T00:03:39.221 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.221 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.221 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.221 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2457888060, 2024-06-03T00:03:39.221 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634038, 2024-06-03T00:03:39.221 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-38.c" 2024-06-03T00:03:39.221 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.222 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.222 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.222 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2460736054, 2024-06-03T00:03:39.222 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632667, 2024-06-03T00:03:39.222 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/assertions.xml" 2024-06-03T00:03:39.222 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.222 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.222 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.222 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2462339970, 2024-06-03T00:03:39.222 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631805, 2024-06-03T00:03:39.222 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_vshm_rdrs.c" 2024-06-03T00:03:39.222 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.222 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.222 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.223 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2464747661, 2024-06-03T00:03:39.223 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632765, 2024-06-03T00:03:39.223 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-6.c" 2024-06-03T00:03:39.223 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.223 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.223 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.223 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2466771082, 2024-06-03T00:03:39.223 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632755, 2024-06-03T00:03:39.223 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-29.c" 2024-06-03T00:03:39.223 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.223 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.223 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.223 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2471037119, 2024-06-03T00:03:39.223 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632711, 2024-06-03T00:03:39.224 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/40-1.c" 2024-06-03T00:03:39.224 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.224 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.224 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.224 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2471799577, 2024-06-03T00:03:39.224 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631990, 2024-06-03T00:03:39.224 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tcontrol003.c" 2024-06-03T00:03:39.224 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.224 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.224 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.224 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2474323198, 2024-06-03T00:03:39.224 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632819, 2024-06-03T00:03:39.224 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/5-1.c" 2024-06-03T00:03:39.224 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.225 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.225 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.225 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2494524597, 2024-06-03T00:03:39.225 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631856, 2024-06-03T00:03:39.225 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_log.h" 2024-06-03T00:03:39.225 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.225 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.225 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.225 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2495027739, 2024-06-03T00:03:39.225 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632825, 2024-06-03T00:03:39.225 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/8-1.c" 2024-06-03T00:03:39.225 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.225 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.226 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.226 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2496123570, 2024-06-03T00:03:39.226 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632252, 2024-06-03T00:03:39.226 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/Makefile.in" 2024-06-03T00:03:39.226 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.226 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.226 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.226 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2505843406, 2024-06-03T00:03:39.226 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632266, 2024-06-03T00:03:39.226 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/sysfs/sysfs2hpi.c" 2024-06-03T00:03:39.226 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.226 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.227 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.227 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2507347595, 2024-06-03T00:03:39.227 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632017, 2024-06-03T00:03:39.227 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/treset001.c" 2024-06-03T00:03:39.227 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.227 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.227 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.227 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2511892536, 2024-06-03T00:03:39.227 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632055, 2024-06-03T00:03:39.227 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget040.c" 2024-06-03T00:03:39.227 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.227 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.227 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.227 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2519890816, 2024-06-03T00:03:39.227 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632758, 2024-06-03T00:03:39.228 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/29-1.c" 2024-06-03T00:03:39.228 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.228 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.228 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.228 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2521649275, 2024-06-03T00:03:39.228 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632797, 2024-06-03T00:03:39.228 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/15-1.c" 2024-06-03T00:03:39.228 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.228 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.228 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.228 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2525493259, 2024-06-03T00:03:39.228 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632188, 2024-06-03T00:03:39.228 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_040.c" 2024-06-03T00:03:39.228 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.229 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.229 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.229 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2529501845, 2024-06-03T00:03:39.229 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633880, 2024-06-03T00:03:39.229 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-8.c" 2024-06-03T00:03:39.229 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.229 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.229 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.229 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2531080391, 2024-06-03T00:03:39.229 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634052, 2024-06-03T00:03:39.229 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-22.c" 2024-06-03T00:03:39.229 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.229 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.229 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.230 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2531522087, 2024-06-03T00:03:39.230 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631908, 2024-06-03T00:03:39.230 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor.h" 2024-06-03T00:03:39.230 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.230 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.230 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.230 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2531826210, 2024-06-03T00:03:39.230 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633928, 2024-06-03T00:03:39.230 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-10.c" 2024-06-03T00:03:39.230 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.230 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.230 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.230 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2537348226, 2024-06-03T00:03:39.230 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634051, 2024-06-03T00:03:39.231 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-22.c" 2024-06-03T00:03:39.231 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.231 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.231 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.231 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2539364846, 2024-06-03T00:03:39.231 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631956, 2024-06-03T00:03:39.231 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_event.h" 2024-06-03T00:03:39.231 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.231 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.231 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.231 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2540232046, 2024-06-03T00:03:39.231 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634184, 2024-06-03T00:03:39.231 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-13.c" 2024-06-03T00:03:39.231 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.232 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.232 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.232 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2541110840, 2024-06-03T00:03:39.232 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631901, 2024-06-03T00:03:39.232 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_inventory.h" 2024-06-03T00:03:39.232 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.232 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.232 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.232 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2547456812, 2024-06-03T00:03:39.232 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632094, 2024-06-03T00:03:39.232 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_enclosure_event.c" 2024-06-03T00:03:39.232 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.232 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.232 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.232 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2553785272, 2024-06-03T00:03:39.233 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632056, 2024-06-03T00:03:39.233 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/Makefile.am" 2024-06-03T00:03:39.233 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.233 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.233 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.233 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2556088951, 2024-06-03T00:03:39.233 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632915, 2024-06-03T00:03:39.233 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/3-2.c" 2024-06-03T00:03:39.233 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.233 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.233 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.233 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2558909192, 2024-06-03T00:03:39.233 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632656, 2024-06-03T00:03:39.233 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/2-1.c" 2024-06-03T00:03:39.233 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.234 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.234 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.234 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2559342970, 2024-06-03T00:03:39.234 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631961, 2024-06-03T00:03:39.234 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/sim_init.h" 2024-06-03T00:03:39.234 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.234 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.234 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.234 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2571602657, 2024-06-03T00:03:39.234 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632890, 2024-06-03T00:03:39.234 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/1-1.c" 2024-06-03T00:03:39.234 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.234 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.234 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.235 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2579665814, 2024-06-03T00:03:39.235 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632659, 2024-06-03T00:03:39.235 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/1-1.c" 2024-06-03T00:03:39.235 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.235 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.235 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.235 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2580720510, 2024-06-03T00:03:39.235 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634219, 2024-06-03T00:03:39.235 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-3.c" 2024-06-03T00:03:39.235 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.235 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.235 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.235 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2616183773, 2024-06-03T00:03:39.235 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632887, 2024-06-03T00:03:39.235 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/2-1.c" 2024-06-03T00:03:39.236 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.236 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.236 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.236 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2624140312, 2024-06-03T00:03:39.236 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634201, 2024-06-03T00:03:39.236 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-1.c" 2024-06-03T00:03:39.236 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.236 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.236 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.236 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2625572854, 2024-06-03T00:03:39.236 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631875, 2024-06-03T00:03:39.236 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_inventory_parser.cpp" 2024-06-03T00:03:39.236 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.236 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.236 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.237 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2626436011, 2024-06-03T00:03:39.237 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632259, 2024-06-03T00:03:39.237 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas.h" 2024-06-03T00:03:39.237 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.237 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.237 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.237 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2627611863, 2024-06-03T00:03:39.237 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632219, 2024-06-03T00:03:39.237 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_002.c" 2024-06-03T00:03:39.237 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.237 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.237 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.237 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2629063517, 2024-06-03T00:03:39.237 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632150, 2024-06-03T00:03:39.238 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_fumi.c" 2024-06-03T00:03:39.238 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.238 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.238 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.238 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2630296576, 2024-06-03T00:03:39.238 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632789, 2024-06-03T00:03:39.238 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/10-1.c" 2024-06-03T00:03:39.238 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.238 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.238 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.238 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2632076391, 2024-06-03T00:03:39.238 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632117, 2024-06-03T00:03:39.238 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_event.c" 2024-06-03T00:03:39.238 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.239 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.239 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.239 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2643329917, 2024-06-03T00:03:39.239 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632635, 2024-06-03T00:03:39.239 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/8-1.c" 2024-06-03T00:03:39.239 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.239 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.239 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.239 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2653923837, 2024-06-03T00:03:39.239 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632102, 2024-06-03T00:03:39.239 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_sensor.h" 2024-06-03T00:03:39.239 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.239 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.239 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.240 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2659187940, 2024-06-03T00:03:39.240 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633933, 2024-06-03T00:03:39.240 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-91.c" 2024-06-03T00:03:39.240 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.240 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.240 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.240 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2662122436, 2024-06-03T00:03:39.240 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634168, 2024-06-03T00:03:39.240 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-1.c" 2024-06-03T00:03:39.240 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.240 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.240 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.240 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2669316004, 2024-06-03T00:03:39.240 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631931, 2024-06-03T00:03:39.241 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/Makefile.am" 2024-06-03T00:03:39.241 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.241 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.241 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.241 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2670478200, 2024-06-03T00:03:39.241 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632849, 2024-06-03T00:03:39.241 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/4-1.c" 2024-06-03T00:03:39.241 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.241 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.241 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.241 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2672753389, 2024-06-03T00:03:39.241 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634232, 2024-06-03T00:03:39.241 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-26.c" 2024-06-03T00:03:39.241 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.241 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.242 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.242 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2673654346, 2024-06-03T00:03:39.242 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632112, 2024-06-03T00:03:39.242 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_resources.c" 2024-06-03T00:03:39.242 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.242 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.242 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.242 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2673782761, 2024-06-03T00:03:39.242 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631812, 2024-06-03T00:03:39.242 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_controls.c" 2024-06-03T00:03:39.242 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.242 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.242 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.242 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2698270032, 2024-06-03T00:03:39.243 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632048, 2024-06-03T00:03:39.243 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tpower001.c" 2024-06-03T00:03:39.243 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.243 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.243 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.243 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2701261228, 2024-06-03T00:03:39.243 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632244, 2024-06-03T00:03:39.243 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_inventory.c" 2024-06-03T00:03:39.243 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.243 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.243 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.243 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2707841517, 2024-06-03T00:03:39.243 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632631, 2024-06-03T00:03:39.243 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/2-1.c" 2024-06-03T00:03:39.244 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.244 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.244 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.244 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2708119671, 2024-06-03T00:03:39.244 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632120, 2024-06-03T00:03:39.244 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_power.c" 2024-06-03T00:03:39.244 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.244 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.244 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.244 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2711637696, 2024-06-03T00:03:39.244 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632712, 2024-06-03T00:03:39.244 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-31.c" 2024-06-03T00:03:39.244 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.244 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.245 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.245 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2712453146, 2024-06-03T00:03:39.245 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634154, 2024-06-03T00:03:39.245 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-4.c" 2024-06-03T00:03:39.245 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.245 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.245 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.245 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2719195783, 2024-06-03T00:03:39.245 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632796, 2024-06-03T00:03:39.245 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/1-1.c" 2024-06-03T00:03:39.245 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.245 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.245 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.245 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2729087858, 2024-06-03T00:03:39.245 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631952, 2024-06-03T00:03:39.246 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_discover_bc.h" 2024-06-03T00:03:39.246 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.246 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.246 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.246 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2745063037, 2024-06-03T00:03:39.246 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631891, 2024-06-03T00:03:39.246 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc.cpp" 2024-06-03T00:03:39.246 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.246 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.246 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.246 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2745523911, 2024-06-03T00:03:39.246 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632179, 2024-06-03T00:03:39.246 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t" 2024-06-03T00:03:39.247 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.247 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.247 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.247 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2750402626, 2024-06-03T00:03:39.247 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632911, 2024-06-03T00:03:39.247 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/17-1.c" 2024-06-03T00:03:39.247 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.247 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.247 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.247 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2750617416, 2024-06-03T00:03:39.247 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631937, 2024-06-03T00:03:39.247 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/sim_init.c" 2024-06-03T00:03:39.247 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.247 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.248 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.248 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2762760181, 2024-06-03T00:03:39.248 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632882, 2024-06-03T00:03:39.248 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/19-1.c" 2024-06-03T00:03:39.248 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.248 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.248 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.248 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2772541364, 2024-06-03T00:03:39.248 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632082, 2024-06-03T00:03:39.248 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_power.c" 2024-06-03T00:03:39.248 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.248 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.248 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.248 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2777496927, 2024-06-03T00:03:39.249 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632099, 2024-06-03T00:03:39.249 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/Makefile.in" 2024-06-03T00:03:39.249 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.249 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.249 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.249 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2777722283, 2024-06-03T00:03:39.249 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631890, 2024-06-03T00:03:39.249 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_watchdog.cpp" 2024-06-03T00:03:39.249 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.249 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.249 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.249 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2779787912, 2024-06-03T00:03:39.249 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632676, 2024-06-03T00:03:39.250 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/4-1.c" 2024-06-03T00:03:39.250 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.250 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.250 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.250 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2787392697, 2024-06-03T00:03:39.250 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632858, 2024-06-03T00:03:39.250 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/5-1.c" 2024-06-03T00:03:39.250 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.250 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.250 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.250 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2795112346, 2024-06-03T00:03:39.250 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632810, 2024-06-03T00:03:39.250 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/9-1.c" 2024-06-03T00:03:39.250 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.251 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.251 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.251 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2798941582, 2024-06-03T00:03:39.251 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633868, 2024-06-03T00:03:39.251 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-18.c" 2024-06-03T00:03:39.251 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.251 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.251 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.251 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2799569580, 2024-06-03T00:03:39.251 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634212, 2024-06-03T00:03:39.251 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-3.c" 2024-06-03T00:03:39.251 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.251 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.252 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.252 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2801870964, 2024-06-03T00:03:39.252 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632177, 2024-06-03T00:03:39.252 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_sensors.h" 2024-06-03T00:03:39.252 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.252 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.252 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.252 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2802420346, 2024-06-03T00:03:39.252 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632052, 2024-06-03T00:03:39.252 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset009.c" 2024-06-03T00:03:39.252 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.252 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.252 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.252 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2810913664, 2024-06-03T00:03:39.253 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632653, 2024-06-03T00:03:39.253 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/33-1.c" 2024-06-03T00:03:39.253 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.253 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.253 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.253 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2817555485, 2024-06-03T00:03:39.253 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632064, 2024-06-03T00:03:39.253 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_dimi.h" 2024-06-03T00:03:39.253 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.253 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.253 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.253 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2823121827, 2024-06-03T00:03:39.253 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633941, 2024-06-03T00:03:39.253 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-99.c" 2024-06-03T00:03:39.254 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.254 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.254 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.254 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2826678000, 2024-06-03T00:03:39.254 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632198, 2024-06-03T00:03:39.254 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_025.c" 2024-06-03T00:03:39.254 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.254 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.254 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.254 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2828731908, 2024-06-03T00:03:39.254 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631804, 2024-06-03T00:03:39.254 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_entity_event.c" 2024-06-03T00:03:39.254 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.255 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.255 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.255 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2828811479, 2024-06-03T00:03:39.255 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632009, 2024-06-03T00:03:39.255 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset011.c" 2024-06-03T00:03:39.255 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.255 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.255 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.255 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2839665195, 2024-06-03T00:03:39.255 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632625, 2024-06-03T00:03:39.255 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/unistd_h/1-1.c" 2024-06-03T00:03:39.255 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.255 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.256 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.256 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2840319766, 2024-06-03T00:03:39.256 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632853, 2024-06-03T00:03:39.256 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/3-1.c" 2024-06-03T00:03:39.256 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.256 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.256 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.256 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2843499966, 2024-06-03T00:03:39.256 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631828, 2024-06-03T00:03:39.256 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_shelf_rdrs.c" 2024-06-03T00:03:39.256 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.256 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.256 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.256 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2845476824, 2024-06-03T00:03:39.257 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634189, 2024-06-03T00:03:39.257 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-2.c" 2024-06-03T00:03:39.257 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.257 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.257 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.257 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2846179873, 2024-06-03T00:03:39.257 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631810, 2024-06-03T00:03:39.257 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_connection.c" 2024-06-03T00:03:39.257 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.257 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.257 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.257 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2851149883, 2024-06-03T00:03:39.257 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632118, 2024-06-03T00:03:39.257 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_lcd_event.h" 2024-06-03T00:03:39.258 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.258 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.258 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.258 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2853255379, 2024-06-03T00:03:39.258 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632686, 2024-06-03T00:03:39.258 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/7-3.c" 2024-06-03T00:03:39.258 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.258 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.258 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.258 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2860023404, 2024-06-03T00:03:39.258 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634167, 2024-06-03T00:03:39.258 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-25.c" 2024-06-03T00:03:39.258 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.258 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.259 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.259 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2868180103, 2024-06-03T00:03:39.259 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633969, 2024-06-03T00:03:39.259 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-17.c" 2024-06-03T00:03:39.259 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.259 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.259 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.259 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2869367687, 2024-06-03T00:03:39.259 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632704, 2024-06-03T00:03:39.259 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-28.c" 2024-06-03T00:03:39.259 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.259 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.259 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.259 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2879954135, 2024-06-03T00:03:39.260 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632260, 2024-06-03T00:03:39.260 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_control.c" 2024-06-03T00:03:39.260 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.260 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.260 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.260 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2887720307, 2024-06-03T00:03:39.260 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633929, 2024-06-03T00:03:39.260 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-12.c" 2024-06-03T00:03:39.260 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.260 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.260 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.260 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2892754526, 2024-06-03T00:03:39.260 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631970, 2024-06-03T00:03:39.260 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_control.c" 2024-06-03T00:03:39.261 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.261 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.261 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.261 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2899479036, 2024-06-03T00:03:39.261 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632892, 2024-06-03T00:03:39.261 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/7-4.c" 2024-06-03T00:03:39.261 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.261 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.261 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.261 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2905684920, 2024-06-03T00:03:39.261 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632008, 2024-06-03T00:03:39.261 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget002.c" 2024-06-03T00:03:39.261 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.261 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.261 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.262 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2909317345, 2024-06-03T00:03:39.262 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634057, 2024-06-03T00:03:39.262 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-51.c" 2024-06-03T00:03:39.262 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.262 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.262 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.262 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2909925707, 2024-06-03T00:03:39.262 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631925, 2024-06-03T00:03:39.262 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/thread_000.cpp" 2024-06-03T00:03:39.262 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.262 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.262 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.262 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2912173305, 2024-06-03T00:03:39.262 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632813, 2024-06-03T00:03:39.264 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/19-1.c" 2024-06-03T00:03:39.264 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.264 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.264 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.264 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2918011334, 2024-06-03T00:03:39.264 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632121, 2024-06-03T00:03:39.264 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_reset.c" 2024-06-03T00:03:39.264 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.264 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.264 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.264 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2918107302, 2024-06-03T00:03:39.265 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632782, 2024-06-03T00:03:39.265 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-26.c" 2024-06-03T00:03:39.265 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.265 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.265 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.265 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2918236057, 2024-06-03T00:03:39.265 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634200, 2024-06-03T00:03:39.265 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-12.c" 2024-06-03T00:03:39.265 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.265 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.265 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.265 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2919851366, 2024-06-03T00:03:39.265 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632912, 2024-06-03T00:03:39.265 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/3-3.c" 2024-06-03T00:03:39.266 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.266 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.266 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.266 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2920449977, 2024-06-03T00:03:39.266 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632046, 2024-06-03T00:03:39.266 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tevent.c" 2024-06-03T00:03:39.266 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.266 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.266 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.266 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2921326240, 2024-06-03T00:03:39.266 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631976, 2024-06-03T00:03:39.266 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_lock.h" 2024-06-03T00:03:39.266 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.266 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.267 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.267 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2926713606, 2024-06-03T00:03:39.267 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632250, 2024-06-03T00:03:39.267 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_power.c" 2024-06-03T00:03:39.267 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.267 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.267 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.267 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2930574206, 2024-06-03T00:03:39.267 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632072, 2024-06-03T00:03:39.267 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_sensor.c" 2024-06-03T00:03:39.267 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.267 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.267 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.267 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2940751922, 2024-06-03T00:03:39.267 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632802, 2024-06-03T00:03:39.268 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/13-1.c" 2024-06-03T00:03:39.268 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.268 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.268 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.268 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2954019481, 2024-06-03T00:03:39.268 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632690, 2024-06-03T00:03:39.268 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/3-1.c" 2024-06-03T00:03:39.268 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.268 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.268 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.268 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2958810706, 2024-06-03T00:03:39.268 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632662, 2024-06-03T00:03:39.268 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/7-4.c" 2024-06-03T00:03:39.269 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.269 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.269 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.269 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2961428172, 2024-06-03T00:03:39.269 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632771, 2024-06-03T00:03:39.269 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-34.c" 2024-06-03T00:03:39.269 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.269 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.269 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.269 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2968387500, 2024-06-03T00:03:39.269 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634088, 2024-06-03T00:03:39.269 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-19.c" 2024-06-03T00:03:39.269 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.269 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.269 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.270 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2974424720, 2024-06-03T00:03:39.270 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633837, 2024-06-03T00:03:39.270 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-21.c" 2024-06-03T00:03:39.270 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.270 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.270 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.270 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2977966707, 2024-06-03T00:03:39.270 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632001, 2024-06-03T00:03:39.270 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tcontrolfailover.c" 2024-06-03T00:03:39.270 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.270 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.270 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.270 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2987114705, 2024-06-03T00:03:39.270 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631947, 2024-06-03T00:03:39.271 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_sensor.c" 2024-06-03T00:03:39.271 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.271 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.271 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.271 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2988473842, 2024-06-03T00:03:39.271 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633812, 2024-06-03T00:03:39.271 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-29.c" 2024-06-03T00:03:39.271 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.271 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.271 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.271 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2991155601, 2024-06-03T00:03:39.271 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634042, 2024-06-03T00:03:39.271 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-10.c" 2024-06-03T00:03:39.271 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.272 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.272 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.272 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2993464520, 2024-06-03T00:03:39.272 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634005, 2024-06-03T00:03:39.272 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-11.c" 2024-06-03T00:03:39.272 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.272 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.272 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.272 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3001217487, 2024-06-03T00:03:39.272 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633870, 2024-06-03T00:03:39.272 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-20.c" 2024-06-03T00:03:39.272 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.272 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.272 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.273 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3002560015, 2024-06-03T00:03:39.273 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632218, 2024-06-03T00:03:39.273 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_027.c" 2024-06-03T00:03:39.273 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.273 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.273 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.273 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3006308452, 2024-06-03T00:03:39.273 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632685, 2024-06-03T00:03:39.273 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/6-3.c" 2024-06-03T00:03:39.273 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.273 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.273 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.273 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3007909338, 2024-06-03T00:03:39.273 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632707, 2024-06-03T00:03:39.273 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/47-1.c" 2024-06-03T00:03:39.274 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.274 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.274 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.274 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3011514138, 2024-06-03T00:03:39.274 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631924, 2024-06-03T00:03:39.274 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/con_000.cpp" 2024-06-03T00:03:39.274 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.274 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.274 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.274 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3020326553, 2024-06-03T00:03:39.274 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633883, 2024-06-03T00:03:39.274 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-2.c" 2024-06-03T00:03:39.274 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.274 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.275 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.275 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3021113350, 2024-06-03T00:03:39.275 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632640, 2024-06-03T00:03:39.275 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h" 2024-06-03T00:03:39.275 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.275 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.275 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.275 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3022282696, 2024-06-03T00:03:39.275 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633761, 2024-06-03T00:03:39.275 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/9-1.c" 2024-06-03T00:03:39.275 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.275 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.275 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.275 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3044357495, 2024-06-03T00:03:39.276 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631894, 2024-06-03T00:03:39.276 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_entity.cpp" 2024-06-03T00:03:39.276 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.276 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.276 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.276 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3054402594, 2024-06-03T00:03:39.276 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633816, 2024-06-03T00:03:39.276 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-57.c" 2024-06-03T00:03:39.276 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.276 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.276 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.276 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3062301934, 2024-06-03T00:03:39.276 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632891, 2024-06-03T00:03:39.276 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/5-2.c" 2024-06-03T00:03:39.277 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.277 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.277 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.277 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3075468938, 2024-06-03T00:03:39.277 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633988, 2024-06-03T00:03:39.277 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-80.c" 2024-06-03T00:03:39.277 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.277 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.277 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.277 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3075594120, 2024-06-03T00:03:39.277 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632127, 2024-06-03T00:03:39.277 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_discover.h" 2024-06-03T00:03:39.277 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.277 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.277 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.277 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3078303269, 2024-06-03T00:03:39.278 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632728, 2024-06-03T00:03:39.278 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/5-1.c" 2024-06-03T00:03:39.278 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.278 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.278 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.278 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3081513949, 2024-06-03T00:03:39.278 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631969, 2024-06-03T00:03:39.278 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_resources.h" 2024-06-03T00:03:39.278 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.278 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.278 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.278 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3082266670, 2024-06-03T00:03:39.278 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632074, 2024-06-03T00:03:39.279 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_watchdog.c" 2024-06-03T00:03:39.279 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.279 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.279 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.279 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3083841413, 2024-06-03T00:03:39.279 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631986, 2024-06-03T00:03:39.279 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget041.c" 2024-06-03T00:03:39.279 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.279 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.279 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.279 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3099795126, 2024-06-03T00:03:39.279 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633805, 2024-06-03T00:03:39.279 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-22.c" 2024-06-03T00:03:39.279 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.280 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.280 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.280 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3099986418, 2024-06-03T00:03:39.280 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632679, 2024-06-03T00:03:39.280 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/30-1.c" 2024-06-03T00:03:39.280 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.280 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.280 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.280 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3101217076, 2024-06-03T00:03:39.280 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634197, 2024-06-03T00:03:39.280 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-13.c" 2024-06-03T00:03:39.280 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.280 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.280 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.281 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3101780982, 2024-06-03T00:03:39.281 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634128, 2024-06-03T00:03:39.281 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-10.c" 2024-06-03T00:03:39.281 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.281 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.281 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.281 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3102859695, 2024-06-03T00:03:39.281 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631864, 2024-06-03T00:03:39.281 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_intel.cpp" 2024-06-03T00:03:39.281 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.281 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.281 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.281 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3108533744, 2024-06-03T00:03:39.281 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631818, 2024-06-03T00:03:39.281 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_inventory_event.c" 2024-06-03T00:03:39.282 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.282 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.282 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.282 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3114241720, 2024-06-03T00:03:39.282 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632110, 2024-06-03T00:03:39.282 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_oa_event.c" 2024-06-03T00:03:39.282 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.282 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.282 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.282 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3114833928, 2024-06-03T00:03:39.282 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633989, 2024-06-03T00:03:39.282 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-20.c" 2024-06-03T00:03:39.282 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.282 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.283 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.283 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3116984347, 2024-06-03T00:03:39.283 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632904, 2024-06-03T00:03:39.283 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/13-1.c" 2024-06-03T00:03:39.283 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.283 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.283 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.283 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3122961073, 2024-06-03T00:03:39.283 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632729, 2024-06-03T00:03:39.283 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-24.c" 2024-06-03T00:03:39.283 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.283 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.283 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.283 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3125214866, 2024-06-03T00:03:39.283 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631821, 2024-06-03T00:03:39.283 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_event.c" 2024-06-03T00:03:39.284 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.284 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.284 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.284 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3130730110, 2024-06-03T00:03:39.284 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632700, 2024-06-03T00:03:39.284 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-4.c" 2024-06-03T00:03:39.284 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.284 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.284 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.284 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3132776889, 2024-06-03T00:03:39.284 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633844, 2024-06-03T00:03:39.284 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-8.c" 2024-06-03T00:03:39.284 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.284 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.285 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.285 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3143723770, 2024-06-03T00:03:39.285 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631994, 2024-06-03T00:03:39.285 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tcontrol_parms.c" 2024-06-03T00:03:39.285 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.285 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.285 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.285 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3145359431, 2024-06-03T00:03:39.285 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632737, 2024-06-03T00:03:39.285 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/35-1.c" 2024-06-03T00:03:39.285 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.285 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.285 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.285 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3146500472, 2024-06-03T00:03:39.285 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632826, 2024-06-03T00:03:39.285 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-7.c" 2024-06-03T00:03:39.286 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.286 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.286 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.286 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3152327523, 2024-06-03T00:03:39.286 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632234, 2024-06-03T00:03:39.286 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_indicator.h" 2024-06-03T00:03:39.286 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.286 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.286 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.286 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3160679717, 2024-06-03T00:03:39.286 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632794, 2024-06-03T00:03:39.286 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/14-1.c" 2024-06-03T00:03:39.286 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.286 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.287 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.287 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3162876598, 2024-06-03T00:03:39.287 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632651, 2024-06-03T00:03:39.287 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/18-1.c" 2024-06-03T00:03:39.287 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.287 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.287 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.287 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3164673057, 2024-06-03T00:03:39.287 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631844, 2024-06-03T00:03:39.287 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_fan.h" 2024-06-03T00:03:39.287 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.287 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.287 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.287 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3165569555, 2024-06-03T00:03:39.287 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632135, 2024-06-03T00:03:39.287 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_rpt.c" 2024-06-03T00:03:39.288 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.288 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.288 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.288 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3168203886, 2024-06-03T00:03:39.288 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632663, 2024-06-03T00:03:39.288 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/7-5.c" 2024-06-03T00:03:39.288 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.288 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.288 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.288 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3168631228, 2024-06-03T00:03:39.288 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631914, 2024-06-03T00:03:39.288 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_watchdog.h" 2024-06-03T00:03:39.288 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.288 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.288 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.289 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3171190638, 2024-06-03T00:03:39.289 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632091, 2024-06-03T00:03:39.289 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_resources.h" 2024-06-03T00:03:39.289 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.289 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.289 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.289 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3187454147, 2024-06-03T00:03:39.289 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632744, 2024-06-03T00:03:39.289 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-3.c" 2024-06-03T00:03:39.289 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.289 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.289 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.289 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3189333379, 2024-06-03T00:03:39.289 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631932, 2024-06-03T00:03:39.290 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_text_buffer.h" 2024-06-03T00:03:39.290 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.290 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.290 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.290 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3198159344, 2024-06-03T00:03:39.290 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632784, 2024-06-03T00:03:39.290 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-40.c" 2024-06-03T00:03:39.290 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.290 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.290 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.290 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3204094120, 2024-06-03T00:03:39.290 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631999, 2024-06-03T00:03:39.290 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tset_resource_sev.c" 2024-06-03T00:03:39.290 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.291 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.291 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.291 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3215418058, 2024-06-03T00:03:39.291 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632833, 2024-06-03T00:03:39.291 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/2-2.c" 2024-06-03T00:03:39.291 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.291 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.291 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.291 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3218338307, 2024-06-03T00:03:39.291 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633962, 2024-06-03T00:03:39.291 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-12.c" 2024-06-03T00:03:39.291 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.291 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.291 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.292 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3220388991, 2024-06-03T00:03:39.292 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632753, 2024-06-03T00:03:39.292 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-8.c" 2024-06-03T00:03:39.292 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.292 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.292 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.292 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3220662051, 2024-06-03T00:03:39.292 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632245, 2024-06-03T00:03:39.292 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_watchdog.h" 2024-06-03T00:03:39.292 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.292 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.292 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.292 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3227620245, 2024-06-03T00:03:39.292 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631977, 2024-06-03T00:03:39.293 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_discover_rsa.c" 2024-06-03T00:03:39.293 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.293 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.293 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.293 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3228515823, 2024-06-03T00:03:39.293 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631869, 2024-06-03T00:03:39.293 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_fru_info.h" 2024-06-03T00:03:39.293 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.293 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.293 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.293 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3232459407, 2024-06-03T00:03:39.293 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633978, 2024-06-03T00:03:39.293 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-25.c" 2024-06-03T00:03:39.293 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.294 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.294 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.294 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3233216082, 2024-06-03T00:03:39.294 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631906, 2024-06-03T00:03:39.294 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_atca_led.cpp" 2024-06-03T00:03:39.294 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.294 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.294 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.294 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3233865938, 2024-06-03T00:03:39.294 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632192, 2024-06-03T00:03:39.294 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_012.c" 2024-06-03T00:03:39.294 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.294 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.295 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.295 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3238255616, 2024-06-03T00:03:39.295 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634130, 2024-06-03T00:03:39.295 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-14.c" 2024-06-03T00:03:39.295 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.295 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.295 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.295 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3238595671, 2024-06-03T00:03:39.295 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632664, 2024-06-03T00:03:39.295 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/15-1.c" 2024-06-03T00:03:39.295 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.295 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.295 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.295 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3242986261, 2024-06-03T00:03:39.295 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632207, 2024-06-03T00:03:39.296 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_035.c" 2024-06-03T00:03:39.296 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.296 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.296 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.296 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3249944832, 2024-06-03T00:03:39.296 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632674, 2024-06-03T00:03:39.296 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/22-1.c" 2024-06-03T00:03:39.296 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.296 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.296 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.296 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3252967444, 2024-06-03T00:03:39.296 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632042, 2024-06-03T00:03:39.296 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset005.c" 2024-06-03T00:03:39.296 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.296 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.297 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.297 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3253999583, 2024-06-03T00:03:39.297 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632687, 2024-06-03T00:03:39.297 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/3-2.c" 2024-06-03T00:03:39.297 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.297 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.297 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.297 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3256549205, 2024-06-03T00:03:39.297 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632644, 2024-06-03T00:03:39.297 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/20-1.c" 2024-06-03T00:03:39.297 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.297 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.297 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.297 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3256943333, 2024-06-03T00:03:39.298 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633961, 2024-06-03T00:03:39.298 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-2.c" 2024-06-03T00:03:39.298 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.298 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.298 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.298 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3258330486, 2024-06-03T00:03:39.298 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634078, 2024-06-03T00:03:39.298 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-13.c" 2024-06-03T00:03:39.298 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.298 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.298 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.298 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3265120955, 2024-06-03T00:03:39.298 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632804, 2024-06-03T00:03:39.298 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/8-2.c" 2024-06-03T00:03:39.299 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.299 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.299 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.299 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3266930790, 2024-06-03T00:03:39.299 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632752, 2024-06-03T00:03:39.299 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/34-1.c" 2024-06-03T00:03:39.299 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.299 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.299 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.299 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3269354975, 2024-06-03T00:03:39.299 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632172, 2024-06-03T00:03:39.299 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_reset.h" 2024-06-03T00:03:39.299 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.299 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.299 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.300 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3271637978, 2024-06-03T00:03:39.300 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632201, 2024-06-03T00:03:39.300 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_014.c" 2024-06-03T00:03:39.300 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.300 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.300 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.300 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3274538239, 2024-06-03T00:03:39.300 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632238, 2024-06-03T00:03:39.300 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_reset.c" 2024-06-03T00:03:39.300 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.300 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.300 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.300 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3281064859, 2024-06-03T00:03:39.300 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631944, 2024-06-03T00:03:39.301 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_inventory.c" 2024-06-03T00:03:39.301 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.301 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.301 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.301 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3281421762, 2024-06-03T00:03:39.301 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632872, 2024-06-03T00:03:39.301 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/12-2.c" 2024-06-03T00:03:39.301 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.301 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.301 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.301 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3285410208, 2024-06-03T00:03:39.301 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634177, 2024-06-03T00:03:39.301 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-47.c" 2024-06-03T00:03:39.301 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.302 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.302 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.302 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3286072056, 2024-06-03T00:03:39.302 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632210, 2024-06-03T00:03:39.302 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_022.c" 2024-06-03T00:03:39.302 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.302 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.302 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.302 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3295212286, 2024-06-03T00:03:39.302 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632124, 2024-06-03T00:03:39.302 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_control.c" 2024-06-03T00:03:39.302 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.302 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.302 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.303 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3295583799, 2024-06-03T00:03:39.303 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632873, 2024-06-03T00:03:39.303 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h" 2024-06-03T00:03:39.303 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.303 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.303 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.303 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3301107047, 2024-06-03T00:03:39.303 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633904, 2024-06-03T00:03:39.303 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-33.c" 2024-06-03T00:03:39.303 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.303 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.303 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.303 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3302047771, 2024-06-03T00:03:39.303 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634055, 2024-06-03T00:03:39.303 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-7.c" 2024-06-03T00:03:39.304 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.304 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.304 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.304 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3303823334, 2024-06-03T00:03:39.304 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633875, 2024-06-03T00:03:39.304 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-8.c" 2024-06-03T00:03:39.304 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.304 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.304 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.304 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3306439432, 2024-06-03T00:03:39.304 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634036, 2024-06-03T00:03:39.304 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-11.c" 2024-06-03T00:03:39.304 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.305 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.305 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.305 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3311269276, 2024-06-03T00:03:39.305 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632835, 2024-06-03T00:03:39.305 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/13-1.c" 2024-06-03T00:03:39.305 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.305 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.305 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.305 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3316174577, 2024-06-03T00:03:39.305 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632883, 2024-06-03T00:03:39.305 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/24-1.c" 2024-06-03T00:03:39.305 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.305 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.305 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.305 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3324510254, 2024-06-03T00:03:39.306 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634216, 2024-06-03T00:03:39.306 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-8.c" 2024-06-03T00:03:39.306 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.306 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.306 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.306 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3328261684, 2024-06-03T00:03:39.306 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632896, 2024-06-03T00:03:39.306 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/8-1.c" 2024-06-03T00:03:39.306 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.306 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.306 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.306 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3329400453, 2024-06-03T00:03:39.306 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632803, 2024-06-03T00:03:39.306 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/4-1.c" 2024-06-03T00:03:39.307 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.307 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.307 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.307 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3334649302, 2024-06-03T00:03:39.307 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632114, 2024-06-03T00:03:39.307 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_hotswap.c" 2024-06-03T00:03:39.307 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.307 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.307 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.307 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3345832442, 2024-06-03T00:03:39.307 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633932, 2024-06-03T00:03:39.307 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-4.c" 2024-06-03T00:03:39.307 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.307 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.308 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.308 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3351621780, 2024-06-03T00:03:39.308 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632800, 2024-06-03T00:03:39.308 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/12-1.c" 2024-06-03T00:03:39.308 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.308 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.308 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.308 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3354356319, 2024-06-03T00:03:39.308 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632705, 2024-06-03T00:03:39.308 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/20-1.c" 2024-06-03T00:03:39.308 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.308 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.308 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.308 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3355737387, 2024-06-03T00:03:39.309 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632262, 2024-06-03T00:03:39.309 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_resource.h" 2024-06-03T00:03:39.309 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.309 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.309 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.309 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3364820108, 2024-06-03T00:03:39.309 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632895, 2024-06-03T00:03:39.309 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/15-1.c" 2024-06-03T00:03:39.309 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.309 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.309 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.309 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3369763633, 2024-06-03T00:03:39.309 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633866, 2024-06-03T00:03:39.309 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-15.c" 2024-06-03T00:03:39.310 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.310 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.310 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.310 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3373120975, 2024-06-03T00:03:39.310 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632202, 2024-06-03T00:03:39.310 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_034.c" 2024-06-03T00:03:39.310 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.310 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.310 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.310 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3373838184, 2024-06-03T00:03:39.310 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632678, 2024-06-03T00:03:39.310 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/3-4.c" 2024-06-03T00:03:39.310 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.311 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.311 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.311 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3378220433, 2024-06-03T00:03:39.311 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633814, 2024-06-03T00:03:39.311 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-20.c" 2024-06-03T00:03:39.311 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.311 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.311 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.311 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3382531391, 2024-06-03T00:03:39.311 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633906, 2024-06-03T00:03:39.311 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-4.c" 2024-06-03T00:03:39.311 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.311 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.312 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.312 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3387717616, 2024-06-03T00:03:39.312 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631813, 2024-06-03T00:03:39.312 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.h" 2024-06-03T00:03:39.312 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.312 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.312 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.312 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3404139684, 2024-06-03T00:03:39.312 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632650, 2024-06-03T00:03:39.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:39.112+0000 7f460e0fe700 1 -- 172.21.15.49:0/3938449212 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f45f00a2ca0 msgr2=0x7f45f00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:39.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:39.112+0000 7f460e0fe700 1 --2- 172.21.15.49:0/3938449212 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f45f00a2ca0 0x7f45f00a5160 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f45f8011550 tx=0x7f45f8009260 comp rx=0 tx=0).stop 2024-06-03T00:03:39.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:39.112+0000 7f460e0fe700 1 -- 172.21.15.49:0/3938449212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f460806b580 msgr2=0x7f46081019d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:39.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:39.112+0000 7f460e0fe700 1 --2- 172.21.15.49:0/3938449212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f460806b580 0x7f46081019d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f45fc0059d0 tx=0x7f45fc00bab0 comp rx=0 tx=0).stop 2024-06-03T00:03:39.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:39.112+0000 7f460e0fe700 1 -- 172.21.15.49:0/3938449212 shutdown_connections 2024-06-03T00:03:39.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:39.112+0000 7f460e0fe700 1 --2- 172.21.15.49:0/3938449212 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f45f00a2ca0 0x7f45f00a5160 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:39.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:39.112+0000 7f460e0fe700 1 --2- 172.21.15.49:0/3938449212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4608108500 0x7f4608101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:39.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:39.112+0000 7f460e0fe700 1 --2- 172.21.15.49:0/3938449212 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f460806abc0 0x7f4608101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:39.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:39.112+0000 7f460e0fe700 1 --2- 172.21.15.49:0/3938449212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f460806b580 0x7f46081019d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:39.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:39.112+0000 7f460e0fe700 1 -- 172.21.15.49:0/3938449212 >> 172.21.15.49:0/3938449212 conn(0x7f4608078340 msgr2=0x7f46081000f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:39.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:39.112+0000 7f460e0fe700 1 -- 172.21.15.49:0/3938449212 shutdown_connections 2024-06-03T00:03:39.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:39.112+0000 7f460e0fe700 1 -- 172.21.15.49:0/3938449212 wait complete. 2024-06-03T00:03:39.314 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/coverage.txt" 2024-06-03T00:03:39.315 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.315 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.315 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.315 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3404389676, 2024-06-03T00:03:39.315 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634155, 2024-06-03T00:03:39.315 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-7.c" 2024-06-03T00:03:39.315 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.315 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.315 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.315 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3408429747, 2024-06-03T00:03:39.315 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632788, 2024-06-03T00:03:39.315 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/3-1.c" 2024-06-03T00:03:39.315 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.315 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.316 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.316 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3414400569, 2024-06-03T00:03:39.316 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632691, 2024-06-03T00:03:39.316 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/1-2.c" 2024-06-03T00:03:39.316 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.316 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.316 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.316 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3415072428, 2024-06-03T00:03:39.316 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634025, 2024-06-03T00:03:39.316 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-25.c" 2024-06-03T00:03:39.316 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.316 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.316 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.316 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3420725342, 2024-06-03T00:03:39.317 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632247, 2024-06-03T00:03:39.317 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_eventlog.h" 2024-06-03T00:03:39.317 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.317 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.317 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.317 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3431099653, 2024-06-03T00:03:39.317 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631871, 2024-06-03T00:03:39.317 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_utils.h" 2024-06-03T00:03:39.317 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.317 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.317 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.317 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3435835784, 2024-06-03T00:03:39.317 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632115, 2024-06-03T00:03:39.317 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/Makefile.am" 2024-06-03T00:03:39.317 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.318 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.318 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.318 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3440500441, 2024-06-03T00:03:39.318 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632669, 2024-06-03T00:03:39.318 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/12-1.c" 2024-06-03T00:03:39.318 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.318 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.318 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.318 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3441827822, 2024-06-03T00:03:39.318 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633919, 2024-06-03T00:03:39.318 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-31.c" 2024-06-03T00:03:39.318 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.319 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.319 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.319 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3448235060, 2024-06-03T00:03:39.319 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631865, 2024-06-03T00:03:39.319 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_threshold.cpp" 2024-06-03T00:03:39.319 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.319 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.319 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.319 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3450944299, 2024-06-03T00:03:39.319 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632137, 2024-06-03T00:03:39.319 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl.c" 2024-06-03T00:03:39.319 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.319 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.319 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.320 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3454684699, 2024-06-03T00:03:39.320 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632815, 2024-06-03T00:03:39.320 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/18-1.c" 2024-06-03T00:03:39.320 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.320 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.320 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.320 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3455137895, 2024-06-03T00:03:39.320 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632772, 2024-06-03T00:03:39.320 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-22.c" 2024-06-03T00:03:39.320 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.320 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.320 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.320 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3455656828, 2024-06-03T00:03:39.320 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632029, 2024-06-03T00:03:39.321 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv005.c" 2024-06-03T00:03:39.321 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.321 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.321 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.321 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3457320178, 2024-06-03T00:03:39.321 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633800, 2024-06-03T00:03:39.321 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-10.c" 2024-06-03T00:03:39.321 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.321 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.321 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.321 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3463919257, 2024-06-03T00:03:39.321 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631959, 2024-06-03T00:03:39.321 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_power.c" 2024-06-03T00:03:39.322 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.322 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.322 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.322 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3465753046, 2024-06-03T00:03:39.322 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631815, 2024-06-03T00:03:39.322 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.sym" 2024-06-03T00:03:39.322 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.322 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.322 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.322 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3474626169, 2024-06-03T00:03:39.322 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632144, 2024-06-03T00:03:39.322 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_hotswap.h" 2024-06-03T00:03:39.322 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.322 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.323 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.323 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3478080736, 2024-06-03T00:03:39.323 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631820, 2024-06-03T00:03:39.323 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.c" 2024-06-03T00:03:39.323 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.323 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.323 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.323 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3479498228, 2024-06-03T00:03:39.323 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632040, 2024-06-03T00:03:39.323 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel001.c" 2024-06-03T00:03:39.323 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.323 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.323 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.323 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3479817506, 2024-06-03T00:03:39.323 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631936, 2024-06-03T00:03:39.324 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/eventmap2code.pl" 2024-06-03T00:03:39.324 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.324 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.324 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.324 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3481483022, 2024-06-03T00:03:39.324 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631962, 2024-06-03T00:03:39.324 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_discover_bc.c" 2024-06-03T00:03:39.324 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.324 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.324 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.324 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3489299789, 2024-06-03T00:03:39.324 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634239, 2024-06-03T00:03:39.324 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-19.c" 2024-06-03T00:03:39.324 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.324 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.325 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.325 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3494942776, 2024-06-03T00:03:39.325 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631943, 2024-06-03T00:03:39.325 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_time.c" 2024-06-03T00:03:39.325 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.325 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.325 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.325 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3502758269, 2024-06-03T00:03:39.325 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631921, 2024-06-03T00:03:39.325 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_entity.h" 2024-06-03T00:03:39.325 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.325 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.325 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.325 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3511271618, 2024-06-03T00:03:39.326 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632710, 2024-06-03T00:03:39.326 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-10.c" 2024-06-03T00:03:39.326 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.326 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.326 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.326 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3514652162, 2024-06-03T00:03:39.326 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631964, 2024-06-03T00:03:39.326 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_reset.c" 2024-06-03T00:03:39.326 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.326 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.326 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.326 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3516693524, 2024-06-03T00:03:39.326 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634048, 2024-06-03T00:03:39.326 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-17.c" 2024-06-03T00:03:39.327 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.327 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.327 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.327 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3518505960, 2024-06-03T00:03:39.327 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632778, 2024-06-03T00:03:39.327 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/16-1.c" 2024-06-03T00:03:39.327 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.327 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.327 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.327 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3525800071, 2024-06-03T00:03:39.327 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633834, 2024-06-03T00:03:39.327 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-14.c" 2024-06-03T00:03:39.327 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.327 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.328 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.328 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3525801351, 2024-06-03T00:03:39.328 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632900, 2024-06-03T00:03:39.328 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/21-1.c" 2024-06-03T00:03:39.328 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.328 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.328 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.328 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3525826779, 2024-06-03T00:03:39.328 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632762, 2024-06-03T00:03:39.328 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/2-4.c" 2024-06-03T00:03:39.328 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.328 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.328 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.329 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3535400992, 2024-06-03T00:03:39.329 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634021, 2024-06-03T00:03:39.329 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-26.c" 2024-06-03T00:03:39.329 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.329 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.329 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.329 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3546997158, 2024-06-03T00:03:39.329 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631987, 2024-06-03T00:03:39.329 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tcontrol002.c" 2024-06-03T00:03:39.329 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.329 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.329 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.329 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3556794228, 2024-06-03T00:03:39.329 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631907, 2024-06-03T00:03:39.330 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_addr.cpp" 2024-06-03T00:03:39.330 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.330 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.330 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.330 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3557411347, 2024-06-03T00:03:39.330 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632243, 2024-06-03T00:03:39.330 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_reset.h" 2024-06-03T00:03:39.330 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.330 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.330 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.330 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3561823753, 2024-06-03T00:03:39.330 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633752, 2024-06-03T00:03:39.330 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-4.c" 2024-06-03T00:03:39.330 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.331 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.331 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.331 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3562142355, 2024-06-03T00:03:39.331 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632910, 2024-06-03T00:03:39.331 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/7-2.c" 2024-06-03T00:03:39.331 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.331 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.331 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.331 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3564210960, 2024-06-03T00:03:39.331 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632265, 2024-06-03T00:03:39.331 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/sysfs/Makefile.in" 2024-06-03T00:03:39.331 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.331 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.331 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.332 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3564377125, 2024-06-03T00:03:39.332 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632185, 2024-06-03T00:03:39.332 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_015.c" 2024-06-03T00:03:39.332 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.332 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.332 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.332 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3584990969, 2024-06-03T00:03:39.332 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631893, 2024-06-03T00:03:39.332 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_force.cpp" 2024-06-03T00:03:39.332 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.332 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.332 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.332 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3587552542, 2024-06-03T00:03:39.332 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631887, 2024-06-03T00:03:39.333 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/hotswap.cpp" 2024-06-03T00:03:39.333 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.333 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.333 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.333 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3589630798, 2024-06-03T00:03:39.333 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632089, 2024-06-03T00:03:39.333 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_interconnect_event.h" 2024-06-03T00:03:39.333 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.333 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.333 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.333 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3594816608, 2024-06-03T00:03:39.333 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631939, 2024-06-03T00:03:39.333 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_session.h" 2024-06-03T00:03:39.333 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.334 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.334 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.334 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3600368532, 2024-06-03T00:03:39.334 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634245, 2024-06-03T00:03:39.334 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-66.c" 2024-06-03T00:03:39.334 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.334 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.334 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.334 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3601022075, 2024-06-03T00:03:39.334 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632253, 2024-06-03T00:03:39.334 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_power.h" 2024-06-03T00:03:39.334 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.334 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.334 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.335 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3606261705, 2024-06-03T00:03:39.335 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631831, 2024-06-03T00:03:39.335 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t" 2024-06-03T00:03:39.335 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.335 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.335 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.335 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3609517546, 2024-06-03T00:03:39.335 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631949, 2024-06-03T00:03:39.335 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_sel.h" 2024-06-03T00:03:39.335 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.335 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.335 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.335 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3609648867, 2024-06-03T00:03:39.335 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633707, 2024-06-03T00:03:39.335 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-25.c" 2024-06-03T00:03:39.336 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.336 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.336 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.336 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3613099219, 2024-06-03T00:03:39.336 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632081, 2024-06-03T00:03:39.336 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_inventory.h" 2024-06-03T00:03:39.336 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.336 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.336 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.336 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3614968721, 2024-06-03T00:03:39.336 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631913, 2024-06-03T00:03:39.336 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_discover.cpp" 2024-06-03T00:03:39.336 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.336 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.337 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.337 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3617495106, 2024-06-03T00:03:39.337 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634244, 2024-06-03T00:03:39.337 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-59.c" 2024-06-03T00:03:39.337 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.337 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.337 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.337 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3620441585, 2024-06-03T00:03:39.337 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634000, 2024-06-03T00:03:39.337 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-11.c" 2024-06-03T00:03:39.337 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.337 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.337 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.337 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3620706668, 2024-06-03T00:03:39.337 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631854, 2024-06-03T00:03:39.338 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor.cpp" 2024-06-03T00:03:39.338 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.338 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.338 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.338 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3622632103, 2024-06-03T00:03:39.338 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632749, 2024-06-03T00:03:39.338 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-11.c" 2024-06-03T00:03:39.338 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.338 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.338 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.338 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3631104616, 2024-06-03T00:03:39.338 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632888, 2024-06-03T00:03:39.338 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/5-1.c" 2024-06-03T00:03:39.338 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.339 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.339 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.339 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3631913042, 2024-06-03T00:03:39.339 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631862, 2024-06-03T00:03:39.339 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_auth.cpp" 2024-06-03T00:03:39.339 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.339 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.339 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.339 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3634878490, 2024-06-03T00:03:39.339 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632751, 2024-06-03T00:03:39.339 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/assertions.xml" 2024-06-03T00:03:39.339 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.339 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.339 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.339 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3645952742, 2024-06-03T00:03:39.340 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631940, 2024-06-03T00:03:39.340 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_sensor.h" 2024-06-03T00:03:39.340 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.340 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.340 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.340 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3652110847, 2024-06-03T00:03:39.340 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632764, 2024-06-03T00:03:39.340 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/13-1.c" 2024-06-03T00:03:39.340 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.340 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.340 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.340 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3658876733, 2024-06-03T00:03:39.340 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632069, 2024-06-03T00:03:39.340 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_sel.h" 2024-06-03T00:03:39.341 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.341 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.341 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.341 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3659273317, 2024-06-03T00:03:39.341 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634102, 2024-06-03T00:03:39.341 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-18.c" 2024-06-03T00:03:39.341 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.341 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.341 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.341 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3662877388, 2024-06-03T00:03:39.341 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632632, 2024-06-03T00:03:39.341 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/5-1.c" 2024-06-03T00:03:39.341 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.342 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.342 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.342 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3664309501, 2024-06-03T00:03:39.342 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634243, 2024-06-03T00:03:39.342 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-6.c" 2024-06-03T00:03:39.342 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.342 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.342 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.342 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3673694109, 2024-06-03T00:03:39.342 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632251, 2024-06-03T00:03:39.342 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_indicator.c" 2024-06-03T00:03:39.342 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.342 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.342 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.343 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3679043841, 2024-06-03T00:03:39.343 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632671, 2024-06-03T00:03:39.343 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/21-1.c" 2024-06-03T00:03:39.343 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.343 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.343 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.343 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3680399266, 2024-06-03T00:03:39.343 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632140, 2024-06-03T00:03:39.343 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_fumi_func.h" 2024-06-03T00:03:39.343 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.343 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.343 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.343 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3682217240, 2024-06-03T00:03:39.343 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632684, 2024-06-03T00:03:39.343 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/3-3.c" 2024-06-03T00:03:39.344 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.344 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.344 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.344 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3719984497, 2024-06-03T00:03:39.344 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631827, 2024-06-03T00:03:39.344 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_shelf_fru.c" 2024-06-03T00:03:39.344 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.344 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.344 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.344 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3720409926, 2024-06-03T00:03:39.344 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632877, 2024-06-03T00:03:39.344 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/9-2.c" 2024-06-03T00:03:39.344 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.345 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.345 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.345 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3724961781, 2024-06-03T00:03:39.345 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631843, 2024-06-03T00:03:39.345 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_hotswap.cpp" 2024-06-03T00:03:39.345 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.345 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.345 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.345 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3726600591, 2024-06-03T00:03:39.345 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632256, 2024-06-03T00:03:39.345 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_event.h" 2024-06-03T00:03:39.345 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.345 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.345 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.346 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3726615837, 2024-06-03T00:03:39.346 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631809, 2024-06-03T00:03:39.346 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_control_event.c" 2024-06-03T00:03:39.346 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.346 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.346 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.346 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3734840947, 2024-06-03T00:03:39.346 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632239, 2024-06-03T00:03:39.346 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_annunciator.h" 2024-06-03T00:03:39.346 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.346 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.346 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.347 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3739226555, 2024-06-03T00:03:39.347 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631953, 2024-06-03T00:03:39.347 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_watchdog.h" 2024-06-03T00:03:39.347 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.347 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.347 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.347 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3741456798, 2024-06-03T00:03:39.347 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631938, 2024-06-03T00:03:39.347 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_session.c" 2024-06-03T00:03:39.347 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.347 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.347 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.347 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3743922405, 2024-06-03T00:03:39.347 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632860, 2024-06-03T00:03:39.348 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/1-1.c" 2024-06-03T00:03:39.348 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.348 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.348 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.348 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3750920149, 2024-06-03T00:03:39.348 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633910, 2024-06-03T00:03:39.348 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-98.c" 2024-06-03T00:03:39.348 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.348 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.348 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.348 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3751877390, 2024-06-03T00:03:39.348 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632865, 2024-06-03T00:03:39.348 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/7-1.c" 2024-06-03T00:03:39.349 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.349 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.349 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.349 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3753002795, 2024-06-03T00:03:39.349 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634011, 2024-06-03T00:03:39.349 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-1.c" 2024-06-03T00:03:39.349 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.349 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.349 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.349 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3755357531, 2024-06-03T00:03:39.349 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632702, 2024-06-03T00:03:39.349 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-15.c" 2024-06-03T00:03:39.349 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.349 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.350 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.350 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3755958168, 2024-06-03T00:03:39.350 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633983, 2024-06-03T00:03:39.350 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-40.c" 2024-06-03T00:03:39.350 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.350 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.350 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.350 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3759059344, 2024-06-03T00:03:39.350 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631978, 2024-06-03T00:03:39.350 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_el2event.h" 2024-06-03T00:03:39.350 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.350 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.350 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.351 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3760147700, 2024-06-03T00:03:39.351 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634138, 2024-06-03T00:03:39.351 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-23.c" 2024-06-03T00:03:39.351 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.351 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.351 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.351 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3769735301, 2024-06-03T00:03:39.351 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633753, 2024-06-03T00:03:39.351 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-15.c" 2024-06-03T00:03:39.351 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.351 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.351 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.351 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3774156709, 2024-06-03T00:03:39.351 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632683, 2024-06-03T00:03:39.352 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/17-1.c" 2024-06-03T00:03:39.352 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.352 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.352 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.352 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3776744287, 2024-06-03T00:03:39.352 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632022, 2024-06-03T00:03:39.352 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget001.c" 2024-06-03T00:03:39.352 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.352 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.352 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.352 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3781740364, 2024-06-03T00:03:39.352 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634089, 2024-06-03T00:03:39.352 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-38.c" 2024-06-03T00:03:39.352 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.353 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.353 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.353 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3805357436, 2024-06-03T00:03:39.353 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632073, 2024-06-03T00:03:39.353 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_calls.c" 2024-06-03T00:03:39.353 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.353 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.353 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.353 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3809192718, 2024-06-03T00:03:39.353 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632902, 2024-06-03T00:03:39.353 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/2-2.c" 2024-06-03T00:03:39.353 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.353 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.354 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.354 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3817587048, 2024-06-03T00:03:39.354 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633885, 2024-06-03T00:03:39.354 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-10.c" 2024-06-03T00:03:39.354 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.354 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.354 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.354 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3825421911, 2024-06-03T00:03:39.354 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633813, 2024-06-03T00:03:39.354 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-4.c" 2024-06-03T00:03:39.354 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.354 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.354 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.355 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3831741996, 2024-06-03T00:03:39.355 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632831, 2024-06-03T00:03:39.355 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-6.c" 2024-06-03T00:03:39.355 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.355 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.355 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.355 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3841687209, 2024-06-03T00:03:39.355 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632657, 2024-06-03T00:03:39.355 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/5-1.c" 2024-06-03T00:03:39.355 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.355 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.355 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.355 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3845945484, 2024-06-03T00:03:39.355 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633764, 2024-06-03T00:03:39.355 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-103.c" 2024-06-03T00:03:39.356 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.356 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.356 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.356 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3848627603, 2024-06-03T00:03:39.356 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632681, 2024-06-03T00:03:39.356 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/11-1.c" 2024-06-03T00:03:39.356 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.356 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.356 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.356 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3851446819, 2024-06-03T00:03:39.356 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632096, 2024-06-03T00:03:39.356 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_callsupport.c" 2024-06-03T00:03:39.356 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.356 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.357 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.357 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3853750107, 2024-06-03T00:03:39.357 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632738, 2024-06-03T00:03:39.357 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/44-1.c" 2024-06-03T00:03:39.357 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.357 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.357 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.357 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3856729932, 2024-06-03T00:03:39.357 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632095, 2024-06-03T00:03:39.357 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_control.h" 2024-06-03T00:03:39.357 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.357 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.357 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.357 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3858479858, 2024-06-03T00:03:39.358 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632739, 2024-06-03T00:03:39.358 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/45-1.c" 2024-06-03T00:03:39.358 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.358 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.358 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.358 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3861451695, 2024-06-03T00:03:39.358 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631829, 2024-06-03T00:03:39.358 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_util.c" 2024-06-03T00:03:39.358 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.358 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.358 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.358 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3861788018, 2024-06-03T00:03:39.358 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632123, 2024-06-03T00:03:39.358 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_discover.c" 2024-06-03T00:03:39.359 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.359 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.359 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.359 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3867916988, 2024-06-03T00:03:39.359 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632908, 2024-06-03T00:03:39.359 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/16-1.c" 2024-06-03T00:03:39.359 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.359 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.359 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.359 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3868491761, 2024-06-03T00:03:39.359 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632864, 2024-06-03T00:03:39.359 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/12-1.c" 2024-06-03T00:03:39.359 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.359 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.360 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.360 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3869897512, 2024-06-03T00:03:39.360 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631948, 2024-06-03T00:03:39.360 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_time.h" 2024-06-03T00:03:39.360 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.360 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.360 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.360 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3883959566, 2024-06-03T00:03:39.360 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632026, 2024-06-03T00:03:39.360 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv007.c" 2024-06-03T00:03:39.360 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.360 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.360 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.360 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3887355108, 2024-06-03T00:03:39.361 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632216, 2024-06-03T00:03:39.361 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_001.c" 2024-06-03T00:03:39.361 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.361 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.361 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.361 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3887804932, 2024-06-03T00:03:39.361 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631975, 2024-06-03T00:03:39.361 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_utils.h" 2024-06-03T00:03:39.361 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.361 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.361 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.361 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3892306256, 2024-06-03T00:03:39.361 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634235, 2024-06-03T00:03:39.361 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-15.c" 2024-06-03T00:03:39.362 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.362 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.362 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.362 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3895749200, 2024-06-03T00:03:39.362 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632675, 2024-06-03T00:03:39.362 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/26-1.c" 2024-06-03T00:03:39.362 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.362 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.362 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.362 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3895939926, 2024-06-03T00:03:39.362 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632145, 2024-06-03T00:03:39.362 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_annunciator_func.h" 2024-06-03T00:03:39.362 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.362 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.362 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.363 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3905007848, 2024-06-03T00:03:39.363 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633869, 2024-06-03T00:03:39.363 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/coverage.txt" 2024-06-03T00:03:39.363 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.363 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.363 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.363 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3907877332, 2024-06-03T00:03:39.363 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632868, 2024-06-03T00:03:39.363 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/4-1.c" 2024-06-03T00:03:39.363 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.363 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.363 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.363 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3910223986, 2024-06-03T00:03:39.363 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632215, 2024-06-03T00:03:39.364 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_017.c" 2024-06-03T00:03:39.364 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.364 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.364 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.364 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3916985553, 2024-06-03T00:03:39.364 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632829, 2024-06-03T00:03:39.364 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/7-1.c" 2024-06-03T00:03:39.364 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.364 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.364 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.364 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3917188839, 2024-06-03T00:03:39.364 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632830, 2024-06-03T00:03:39.364 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-13.c" 2024-06-03T00:03:39.364 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.365 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.365 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.365 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3917712567, 2024-06-03T00:03:39.365 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632695, 2024-06-03T00:03:39.365 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/4-1.c" 2024-06-03T00:03:39.365 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.365 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.365 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.365 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3917915880, 2024-06-03T00:03:39.365 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634108, 2024-06-03T00:03:39.365 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-14.c" 2024-06-03T00:03:39.365 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.365 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.365 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.366 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3918036284, 2024-06-03T00:03:39.366 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632217, 2024-06-03T00:03:39.366 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_003.c" 2024-06-03T00:03:39.366 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.366 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.366 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.366 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3920665412, 2024-06-03T00:03:39.366 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632131, 2024-06-03T00:03:39.366 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/Makefile.in" 2024-06-03T00:03:39.366 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.366 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.366 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.366 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3931880352, 2024-06-03T00:03:39.367 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633990, 2024-06-03T00:03:39.367 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-42.c" 2024-06-03T00:03:39.367 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.367 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.367 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.367 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3931901789, 2024-06-03T00:03:39.367 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632809, 2024-06-03T00:03:39.367 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-1.c" 2024-06-03T00:03:39.367 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.367 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.367 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.367 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3948233783, 2024-06-03T00:03:39.367 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632041, 2024-06-03T00:03:39.367 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset012.c" 2024-06-03T00:03:39.367 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.368 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.368 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.368 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3948281470, 2024-06-03T00:03:39.368 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631848, 2024-06-03T00:03:39.368 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi.cpp" 2024-06-03T00:03:39.368 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.368 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.368 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.368 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3955941099, 2024-06-03T00:03:39.368 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632116, 2024-06-03T00:03:39.368 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_ps_event.h" 2024-06-03T00:03:39.368 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.368 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.368 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.369 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3960091525, 2024-06-03T00:03:39.369 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632871, 2024-06-03T00:03:39.369 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/7-3.c" 2024-06-03T00:03:39.369 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.369 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.369 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.369 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3962015259, 2024-06-03T00:03:39.369 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631955, 2024-06-03T00:03:39.369 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_sel.c" 2024-06-03T00:03:39.369 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.369 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.369 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.369 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3967670902, 2024-06-03T00:03:39.369 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632643, 2024-06-03T00:03:39.370 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/9-1.c" 2024-06-03T00:03:39.370 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.370 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.370 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.370 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3971069431, 2024-06-03T00:03:39.370 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632857, 2024-06-03T00:03:39.370 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/2-1.c" 2024-06-03T00:03:39.370 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.370 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.370 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.370 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3971934681, 2024-06-03T00:03:39.370 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632240, 2024-06-03T00:03:39.370 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_event.c" 2024-06-03T00:03:39.370 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.371 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.371 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.371 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3973705242, 2024-06-03T00:03:39.371 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632199, 2024-06-03T00:03:39.371 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_031.c" 2024-06-03T00:03:39.371 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.371 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.371 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.371 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3990094395, 2024-06-03T00:03:39.371 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632672, 2024-06-03T00:03:39.371 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/29-1.c" 2024-06-03T00:03:39.371 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.371 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.371 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.372 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4000600395, 2024-06-03T00:03:39.372 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633977, 2024-06-03T00:03:39.372 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-15.c" 2024-06-03T00:03:39.372 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.372 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.372 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.372 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4004657016, 2024-06-03T00:03:39.372 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631808, 2024-06-03T00:03:39.372 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/hotswap.c" 2024-06-03T00:03:39.372 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.372 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.372 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.372 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4005134433, 2024-06-03T00:03:39.372 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632079, 2024-06-03T00:03:39.372 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_fan_event.h" 2024-06-03T00:03:39.373 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.373 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.373 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.373 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4010580232, 2024-06-03T00:03:39.373 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632841, 2024-06-03T00:03:39.373 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-9.c" 2024-06-03T00:03:39.373 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.373 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.373 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.373 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4012645223, 2024-06-03T00:03:39.373 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632237, 2024-06-03T00:03:39.373 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_utils.h" 2024-06-03T00:03:39.373 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.373 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.374 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.374 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4020383561, 2024-06-03T00:03:39.374 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632077, 2024-06-03T00:03:39.374 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_fumi.c" 2024-06-03T00:03:39.374 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.374 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.374 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.374 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4040936716, 2024-06-03T00:03:39.374 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632856, 2024-06-03T00:03:39.374 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/coverage.txt" 2024-06-03T00:03:39.374 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.374 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.374 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.374 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4042212048, 2024-06-03T00:03:39.375 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632005, 2024-06-03T00:03:39.375 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset019.c" 2024-06-03T00:03:39.375 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.375 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.375 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.375 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4046359369, 2024-06-03T00:03:39.375 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632822, 2024-06-03T00:03:39.375 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/15-1.c" 2024-06-03T00:03:39.375 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.375 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.375 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.375 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4053285086, 2024-06-03T00:03:39.375 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632021, 2024-06-03T00:03:39.376 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget010.c" 2024-06-03T00:03:39.376 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.376 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.376 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.376 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4056118285, 2024-06-03T00:03:39.376 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632087, 2024-06-03T00:03:39.376 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_discover.h" 2024-06-03T00:03:39.376 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.376 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.376 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.376 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4076810465, 2024-06-03T00:03:39.376 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632646, 2024-06-03T00:03:39.376 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/23-1.c" 2024-06-03T00:03:39.376 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.377 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.377 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.377 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4078331621, 2024-06-03T00:03:39.377 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632154, 2024-06-03T00:03:39.377 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_inventory.c" 2024-06-03T00:03:39.377 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.377 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.377 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.377 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4080792476, 2024-06-03T00:03:39.377 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632224, 2024-06-03T00:03:39.377 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_019.c" 2024-06-03T00:03:39.377 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.377 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.377 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.377 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4081458936, 2024-06-03T00:03:39.378 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631915, 2024-06-03T00:03:39.378 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_atca_led.h" 2024-06-03T00:03:39.378 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.378 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.378 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.378 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4084580664, 2024-06-03T00:03:39.378 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632870, 2024-06-03T00:03:39.378 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/7-2.c" 2024-06-03T00:03:39.378 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.378 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.378 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.378 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4095125811, 2024-06-03T00:03:39.378 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632692, 2024-06-03T00:03:39.379 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/2-1.c" 2024-06-03T00:03:39.379 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.379 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.379 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.379 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4097013356, 2024-06-03T00:03:39.379 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631872, 2024-06-03T00:03:39.379 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_msg.h" 2024-06-03T00:03:39.379 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.379 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.379 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.379 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4105434856, 2024-06-03T00:03:39.379 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632795, 2024-06-03T00:03:39.379 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/2-1.c" 2024-06-03T00:03:39.379 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.379 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.380 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.380 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4108054989, 2024-06-03T00:03:39.380 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634158, 2024-06-03T00:03:39.380 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-6.c" 2024-06-03T00:03:39.380 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.380 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.380 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.380 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4110553177, 2024-06-03T00:03:39.380 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632129, 2024-06-03T00:03:39.380 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl.h" 2024-06-03T00:03:39.380 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.380 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.380 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.380 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4112816435, 2024-06-03T00:03:39.381 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632824, 2024-06-03T00:03:39.381 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-11.c" 2024-06-03T00:03:39.381 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.381 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.381 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.381 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4113305847, 2024-06-03T00:03:39.381 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631912, 2024-06-03T00:03:39.381 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_sun.h" 2024-06-03T00:03:39.381 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.381 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.381 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.381 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4115219340, 2024-06-03T00:03:39.381 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632748, 2024-06-03T00:03:39.382 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/43-1.c" 2024-06-03T00:03:39.382 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.382 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.382 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.382 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4117033904, 2024-06-03T00:03:39.382 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632628, 2024-06-03T00:03:39.382 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/3-1.c" 2024-06-03T00:03:39.382 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.382 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.382 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.382 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4118607437, 2024-06-03T00:03:39.382 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631873, 2024-06-03T00:03:39.382 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi.h" 2024-06-03T00:03:39.382 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.382 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.383 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.383 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4127782657, 2024-06-03T00:03:39.383 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631879, 2024-06-03T00:03:39.383 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_cmd.cpp" 2024-06-03T00:03:39.383 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.383 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.383 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.383 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4128379166, 2024-06-03T00:03:39.383 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633841, 2024-06-03T00:03:39.383 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-26.c" 2024-06-03T00:03:39.383 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.383 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.383 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.383 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4129902371, 2024-06-03T00:03:39.384 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632698, 2024-06-03T00:03:39.384 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/37-1.c" 2024-06-03T00:03:39.384 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.384 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.384 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.384 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4130609762, 2024-06-03T00:03:39.384 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633811, 2024-06-03T00:03:39.384 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-10.c" 2024-06-03T00:03:39.384 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.384 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.384 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.384 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4135515319, 2024-06-03T00:03:39.384 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633877, 2024-06-03T00:03:39.384 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-19.c" 2024-06-03T00:03:39.385 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.385 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.385 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.385 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4147280228, 2024-06-03T00:03:39.385 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632034, 2024-06-03T00:03:39.385 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset021.c" 2024-06-03T00:03:39.385 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.385 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.385 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.385 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4150315439, 2024-06-03T00:03:39.385 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632754, 2024-06-03T00:03:39.385 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/50-1.c" 2024-06-03T00:03:39.385 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.385 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.385 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.386 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4152221991, 2024-06-03T00:03:39.386 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634163, 2024-06-03T00:03:39.386 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-4.c" 2024-06-03T00:03:39.386 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.386 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.386 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.386 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4172632702, 2024-06-03T00:03:39.386 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632166, 2024-06-03T00:03:39.386 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_power.c" 2024-06-03T00:03:39.386 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.386 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.386 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.386 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4174931218, 2024-06-03T00:03:39.386 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632693, 2024-06-03T00:03:39.387 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/1-1.c" 2024-06-03T00:03:39.387 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.387 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.387 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.387 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4179821224, 2024-06-03T00:03:39.387 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632725, 2024-06-03T00:03:39.387 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-18.c" 2024-06-03T00:03:39.387 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.387 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.387 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.387 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4180055686, 2024-06-03T00:03:39.387 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631945, 2024-06-03T00:03:39.387 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_xml2event.c" 2024-06-03T00:03:39.387 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.387 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.388 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.388 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4181618717, 2024-06-03T00:03:39.388 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632025, 2024-06-03T00:03:39.388 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsetup.c" 2024-06-03T00:03:39.388 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.388 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.388 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.388 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4183199182, 2024-06-03T00:03:39.388 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633830, 2024-06-03T00:03:39.388 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-27.c" 2024-06-03T00:03:39.388 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.388 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.388 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.388 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4187402729, 2024-06-03T00:03:39.388 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633776, 2024-06-03T00:03:39.389 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-60.c" 2024-06-03T00:03:39.389 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.389 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.389 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.389 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4194302202, 2024-06-03T00:03:39.389 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633795, 2024-06-03T00:03:39.389 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-11.c" 2024-06-03T00:03:39.389 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.389 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.389 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.389 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4194680194, 2024-06-03T00:03:39.389 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633794, 2024-06-03T00:03:39.389 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-26.c" 2024-06-03T00:03:39.389 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.390 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.390 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.390 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4199544288, 2024-06-03T00:03:39.390 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632844, 2024-06-03T00:03:39.390 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h" 2024-06-03T00:03:39.390 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.390 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.390 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.390 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4207056120, 2024-06-03T00:03:39.390 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632093, 2024-06-03T00:03:39.390 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_power.h" 2024-06-03T00:03:39.390 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.390 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.390 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.391 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4207562327, 2024-06-03T00:03:39.391 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634221, 2024-06-03T00:03:39.391 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-14.c" 2024-06-03T00:03:39.391 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.391 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.391 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.391 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4210468893, 2024-06-03T00:03:39.391 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632680, 2024-06-03T00:03:39.391 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/16-1.c" 2024-06-03T00:03:39.391 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.391 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.391 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.391 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4212651165, 2024-06-03T00:03:39.391 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632051, 2024-06-03T00:03:39.392 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset015.c" 2024-06-03T00:03:39.392 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.392 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.392 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.392 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4213844288, 2024-06-03T00:03:39.392 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632661, 2024-06-03T00:03:39.392 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/31-1.c" 2024-06-03T00:03:39.392 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.392 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.392 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.392 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4214194268, 2024-06-03T00:03:39.392 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634156, 2024-06-03T00:03:39.392 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-25.c" 2024-06-03T00:03:39.392 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4216542702, 2024-06-03T00:03:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511633711, 2024-06-03T00:03:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-7.c" 2024-06-03T00:03:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4220315613, 2024-06-03T00:03:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632162, 2024-06-03T00:03:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_dimi.h" 2024-06-03T00:03:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.393 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4226584084, 2024-06-03T00:03:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632880, 2024-06-03T00:03:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/10-1.c" 2024-06-03T00:03:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4231203292, 2024-06-03T00:03:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632894, 2024-06-03T00:03:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/9-3.c" 2024-06-03T00:03:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4234731516, 2024-06-03T00:03:39.394 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632261, 2024-06-03T00:03:39.395 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/Makefile.am" 2024-06-03T00:03:39.395 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.395 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.395 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.395 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4235409126, 2024-06-03T00:03:39.395 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632768, 2024-06-03T00:03:39.395 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-19.c" 2024-06-03T00:03:39.395 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.395 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.395 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.395 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4236054143, 2024-06-03T00:03:39.395 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632842, 2024-06-03T00:03:39.395 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-3.c" 2024-06-03T00:03:39.395 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.395 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4236829857, 2024-06-03T00:03:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511634098, 2024-06-03T00:03:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-2.c" 2024-06-03T00:03:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4239383874, 2024-06-03T00:03:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632257, 2024-06-03T00:03:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_eventlog.c" 2024-06-03T00:03:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4241114684, 2024-06-03T00:03:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632774, 2024-06-03T00:03:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/25-1.c" 2024-06-03T00:03:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4241688082, 2024-06-03T00:03:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632226, 2024-06-03T00:03:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_007.c" 2024-06-03T00:03:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4253652793, 2024-06-03T00:03:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511631853, 2024-06-03T00:03:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_sun.cpp" 2024-06-03T00:03:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4272352323, 2024-06-03T00:03:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632642, 2024-06-03T00:03:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/3-1.c" 2024-06-03T00:03:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:03:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: "damage_type": "backtrace", 2024-06-03T00:03:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4284350962, 2024-06-03T00:03:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 1099511632033, 2024-06-03T00:03:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/thotswap001.c" 2024-06-03T00:03:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:03:39.398 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-06-03T00:03:39.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:39 smithi057 ceph-mon[36457]: pgmap v491: 97 pgs: 97 active+clean; 1.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 74 MiB/s rd, 89 MiB/s wr, 172 op/s 2024-06-03T00:03:39.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:39 smithi057 ceph-mon[36457]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:03:39.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:39 smithi049 ceph-mon[32302]: pgmap v491: 97 pgs: 97 active+clean; 1.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 74 MiB/s rd, 89 MiB/s wr, 172 op/s 2024-06-03T00:03:39.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:39 smithi049 ceph-mon[32302]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:03:39.501 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:39 smithi107 ceph-mon[37048]: pgmap v491: 97 pgs: 97 active+clean; 1.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 74 MiB/s rd, 89 MiB/s wr, 172 op/s 2024-06-03T00:03:39.501 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:39 smithi107 ceph-mon[37048]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:03:40.396 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-06-03T00:03:40.662 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:03:41.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:41 smithi057 ceph-mon[36457]: pgmap v492: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 72 MiB/s rd, 86 MiB/s wr, 218 op/s 2024-06-03T00:03:41.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:41 smithi057 ceph-mon[36457]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:03:41.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:41 smithi049 ceph-mon[32302]: pgmap v492: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 72 MiB/s rd, 86 MiB/s wr, 218 op/s 2024-06-03T00:03:41.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:41 smithi049 ceph-mon[32302]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:03:41.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:41 smithi107 ceph-mon[37048]: pgmap v492: 97 pgs: 97 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 72 MiB/s rd, 86 MiB/s wr, 218 op/s 2024-06-03T00:03:41.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:41 smithi107 ceph-mon[37048]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:03:42.001 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-06-03T00:03:42.002 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-06-03T00:03:42.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.543+0000 7f5d2c519700 1 -- 172.21.15.49:0/313923528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d24101390 msgr2=0x7f5d24101810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:42.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.543+0000 7f5d2c519700 1 --2- 172.21.15.49:0/313923528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d24101390 0x7f5d24101810 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f5d14009990 tx=0x7f5d14009ca0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.543+0000 7f5d2c519700 1 -- 172.21.15.49:0/313923528 shutdown_connections 2024-06-03T00:03:42.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.543+0000 7f5d2c519700 1 --2- 172.21.15.49:0/313923528 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d24101d50 0x7f5d2410e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.543+0000 7f5d2c519700 1 --2- 172.21.15.49:0/313923528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d24107400 0x7f5d241077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.543+0000 7f5d2c519700 1 --2- 172.21.15.49:0/313923528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d24101390 0x7f5d24101810 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.543+0000 7f5d2c519700 1 -- 172.21.15.49:0/313923528 >> 172.21.15.49:0/313923528 conn(0x7f5d24078340 msgr2=0x7f5d24078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:42.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.543+0000 7f5d2c519700 1 -- 172.21.15.49:0/313923528 shutdown_connections 2024-06-03T00:03:42.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.543+0000 7f5d2c519700 1 -- 172.21.15.49:0/313923528 wait complete. 2024-06-03T00:03:42.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.544+0000 7f5d2c519700 1 Processor -- start 2024-06-03T00:03:42.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.544+0000 7f5d2c519700 1 -- start start 2024-06-03T00:03:42.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.544+0000 7f5d2c519700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d24101390 0x7f5d2419d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:42.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.544+0000 7f5d2c519700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d24101d50 0x7f5d2419dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:42.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.544+0000 7f5d2c519700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d24107400 0x7f5d24197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:42.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.544+0000 7f5d2c519700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5d24111670 con 0x7f5d24101d50 2024-06-03T00:03:42.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.544+0000 7f5d2c519700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5d241114f0 con 0x7f5d24107400 2024-06-03T00:03:42.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.544+0000 7f5d2c519700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5d241117f0 con 0x7f5d24101390 2024-06-03T00:03:42.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.544+0000 7f5d29ab4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d24101d50 0x7f5d2419dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:42.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.545+0000 7f5d29ab4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d24101d50 0x7f5d2419dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49022/0 (socket says 172.21.15.49:49022) 2024-06-03T00:03:42.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.545+0000 7f5d2a2b5700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d24101390 0x7f5d2419d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:42.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.545+0000 7f5d29ab4700 1 -- 172.21.15.49:0/1639466789 learned_addr learned my addr 172.21.15.49:0/1639466789 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:42.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.545+0000 7f5d2aab6700 1 --2- 172.21.15.49:0/1639466789 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d24107400 0x7f5d24197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:42.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.545+0000 7f5d29ab4700 1 -- 172.21.15.49:0/1639466789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d24101390 msgr2=0x7f5d2419d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:42.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.545+0000 7f5d29ab4700 1 --2- 172.21.15.49:0/1639466789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d24101390 0x7f5d2419d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.545+0000 7f5d29ab4700 1 -- 172.21.15.49:0/1639466789 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d24107400 msgr2=0x7f5d24197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:42.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.545+0000 7f5d29ab4700 1 --2- 172.21.15.49:0/1639466789 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d24107400 0x7f5d24197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.545+0000 7f5d29ab4700 1 -- 172.21.15.49:0/1639466789 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d24198090 con 0x7f5d24101d50 2024-06-03T00:03:42.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.545+0000 7f5d29ab4700 1 --2- 172.21.15.49:0/1639466789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d24101d50 0x7f5d2419dcb0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f5d14000c00 tx=0x7f5d1400bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:42.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.545+0000 7f5d1b7fe700 1 -- 172.21.15.49:0/1639466789 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d14027070 con 0x7f5d24101d50 2024-06-03T00:03:42.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.545+0000 7f5d1b7fe700 1 -- 172.21.15.49:0/1639466789 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d14003d70 con 0x7f5d24101d50 2024-06-03T00:03:42.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.545+0000 7f5d1b7fe700 1 -- 172.21.15.49:0/1639466789 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1400f460 con 0x7f5d24101d50 2024-06-03T00:03:42.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.545+0000 7f5d2c519700 1 -- 172.21.15.49:0/1639466789 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d24198320 con 0x7f5d24101d50 2024-06-03T00:03:42.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.545+0000 7f5d2c519700 1 -- 172.21.15.49:0/1639466789 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d241a4640 con 0x7f5d24101d50 2024-06-03T00:03:42.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.547+0000 7f5d1b7fe700 1 -- 172.21.15.49:0/1639466789 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5d1402a070 con 0x7f5d24101d50 2024-06-03T00:03:42.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.548+0000 7f5d1b7fe700 1 --2- 172.21.15.49:0/1639466789 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f5d100a2ca0 0x7f5d100a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:42.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.548+0000 7f5d2a2b5700 1 --2- 172.21.15.49:0/1639466789 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f5d100a2ca0 0x7f5d100a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:42.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.548+0000 7f5d1b7fe700 1 -- 172.21.15.49:0/1639466789 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f5d140cfd60 con 0x7f5d24101d50 2024-06-03T00:03:42.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.549+0000 7f5d2a2b5700 1 --2- 172.21.15.49:0/1639466789 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f5d100a2ca0 0x7f5d100a5160 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5d24198a70 tx=0x7f5d20009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:42.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.549+0000 7f5d36d9cb80 1 Processor -- start 2024-06-03T00:03:42.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.549+0000 7f5d36d9cb80 1 -- start start 2024-06-03T00:03:42.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.549+0000 7f5d36d9cb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592d6309170 0x5592d6309550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:42.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.549+0000 7f5d36d9cb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5592d6309a90 0x5592d6303470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:42.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.549+0000 7f5d36d9cb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5592d63039b0 0x5592d6303dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:42.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.549+0000 7f5d36d9cb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5592d61f3f60 con 0x5592d63039b0 2024-06-03T00:03:42.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.549+0000 7f5d36d9cb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5592d6252850 con 0x5592d6309170 2024-06-03T00:03:42.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.549+0000 7f5d36d9cb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5592d61ba460 con 0x5592d6309a90 2024-06-03T00:03:42.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.550+0000 7f5d29ab4700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5592d6309a90 0x5592d6303470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:42.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.550+0000 7f5d29ab4700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5592d6309a90 0x5592d6303470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:35078/0 (socket says 172.21.15.49:35078) 2024-06-03T00:03:42.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.550+0000 7f5d29ab4700 1 -- 172.21.15.49:0/1762196262 learned_addr learned my addr 172.21.15.49:0/1762196262 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:42.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.550+0000 7f5d2aab6700 1 --2- 172.21.15.49:0/1762196262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5592d63039b0 0x5592d6303dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:42.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.550+0000 7f5d2a2b5700 1 --2- 172.21.15.49:0/1762196262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592d6309170 0x5592d6309550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:42.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.550+0000 7f5d29ab4700 1 -- 172.21.15.49:0/1762196262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592d6309170 msgr2=0x5592d6309550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:42.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.550+0000 7f5d29ab4700 1 --2- 172.21.15.49:0/1762196262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592d6309170 0x5592d6309550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.550+0000 7f5d29ab4700 1 -- 172.21.15.49:0/1762196262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5592d63039b0 msgr2=0x5592d6303dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:42.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.550+0000 7f5d29ab4700 1 --2- 172.21.15.49:0/1762196262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5592d63039b0 0x5592d6303dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.550+0000 7f5d29ab4700 1 -- 172.21.15.49:0/1762196262 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592d61a18d0 con 0x5592d6309a90 2024-06-03T00:03:42.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.550+0000 7f5d29ab4700 1 --2- 172.21.15.49:0/1762196262 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5592d6309a90 0x5592d6303470 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5d14098ab0 tx=0x7f5d1409c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4622599359c56c07 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:42.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.550+0000 7f5d18ff9700 1 -- 172.21.15.49:0/1762196262 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d140043d0 con 0x5592d6309a90 2024-06-03T00:03:42.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.550+0000 7f5d18ff9700 1 -- 172.21.15.49:0/1762196262 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d140095d0 con 0x5592d6309a90 2024-06-03T00:03:42.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.550+0000 7f5d18ff9700 1 -- 172.21.15.49:0/1762196262 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d14085be0 con 0x5592d6309a90 2024-06-03T00:03:42.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.551+0000 7f5d36d9cb80 1 -- 172.21.15.49:0/1762196262 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5592d6309a90 msgr2=0x5592d6303470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:42.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.551+0000 7f5d36d9cb80 1 --2- 172.21.15.49:0/1762196262 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5592d6309a90 0x5592d6303470 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5d14098ab0 tx=0x7f5d1409c4a0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.551+0000 7f5d36d9cb80 1 -- 172.21.15.49:0/1762196262 shutdown_connections 2024-06-03T00:03:42.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.551+0000 7f5d36d9cb80 1 --2- 172.21.15.49:0/1762196262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5592d63039b0 0x5592d6303dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.551+0000 7f5d36d9cb80 1 --2- 172.21.15.49:0/1762196262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592d6309170 0x5592d6309550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.551+0000 7f5d36d9cb80 1 --2- 172.21.15.49:0/1762196262 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5592d6309a90 0x5592d6303470 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.551+0000 7f5d36d9cb80 1 -- 172.21.15.49:0/1762196262 >> 172.21.15.49:0/1762196262 conn(0x5592d622e080 msgr2=0x5592d62fc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:42.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.551+0000 7f5d36d9cb80 1 -- 172.21.15.49:0/1762196262 shutdown_connections 2024-06-03T00:03:42.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.551+0000 7f5d36d9cb80 1 -- 172.21.15.49:0/1762196262 wait complete. 2024-06-03T00:03:42.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.552+0000 7f5d36d9cb80 1 -- start start 2024-06-03T00:03:42.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.552+0000 7f5d36d9cb80 1 Processor -- start 2024-06-03T00:03:42.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.552+0000 7f5d36d9cb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5592d63039b0 0x5592d630f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:42.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.552+0000 7f5d36d9cb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592d6309170 0x5592d630cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:42.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.552+0000 7f5d36d9cb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5592d6309a90 0x5592d630d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:42.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.552+0000 7f5d36d9cb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5592d61f2fc0 con 0x5592d6309a90 2024-06-03T00:03:42.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.552+0000 7f5d36d9cb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5592d624e810 con 0x5592d6309170 2024-06-03T00:03:42.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.552+0000 7f5d36d9cb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5592d6310220 con 0x5592d63039b0 2024-06-03T00:03:42.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.552+0000 7f5d36d9cb80 10 client.0 _ll_register_callbacks cb 0x5592d61e85b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:03:42.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.552+0000 7f5d2aab6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5592d6309a90 0x5592d630d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:42.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.552+0000 7f5d2a2b5700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5592d63039b0 0x5592d630f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:42.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.552+0000 7f5d2a2b5700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5592d63039b0 0x5592d630f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:35084/0 (socket says 172.21.15.49:35084) 2024-06-03T00:03:42.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.552+0000 7f5d2aab6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5592d6309a90 0x5592d630d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49034/0 (socket says 172.21.15.49:49034) 2024-06-03T00:03:42.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.552+0000 7f5d2a2b5700 1 -- 172.21.15.49:0/3310059525 learned_addr learned my addr 172.21.15.49:0/3310059525 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:42.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.552+0000 7f5d29ab4700 1 --2- 172.21.15.49:0/3310059525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592d6309170 0x5592d630cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:42.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.553+0000 7f5d2aab6700 1 -- 172.21.15.49:0/3310059525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5592d63039b0 msgr2=0x5592d630f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:42.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.553+0000 7f5d2aab6700 1 --2- 172.21.15.49:0/3310059525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5592d63039b0 0x5592d630f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.553+0000 7f5d2aab6700 1 -- 172.21.15.49:0/3310059525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592d6309170 msgr2=0x5592d630cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:42.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.553+0000 7f5d2aab6700 1 --2- 172.21.15.49:0/3310059525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592d6309170 0x5592d630cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.553+0000 7f5d2aab6700 1 -- 172.21.15.49:0/3310059525 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592d6218750 con 0x5592d6309a90 2024-06-03T00:03:42.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.553+0000 7f5d2aab6700 1 --2- 172.21.15.49:0/3310059525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5592d6309a90 0x5592d630d160 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c011e90 tx=0x7f5d1c014600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b40851ee4dafe7 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:42.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.553+0000 7f5d0dffb700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:03:42.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.553+0000 7f5d0dffb700 1 -- 172.21.15.49:0/3310059525 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c004db0 con 0x5592d6309a90 2024-06-03T00:03:42.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.553+0000 7f5d0dffb700 1 -- 172.21.15.49:0/3310059525 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f5d1c014a80 con 0x5592d6309a90 2024-06-03T00:03:42.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.553+0000 7f5d36d9cb80 1 -- 172.21.15.49:0/3310059525 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d140095d0 con 0x5592d6309a90 2024-06-03T00:03:42.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.553+0000 7f5d0dffb700 1 -- 172.21.15.49:0/3310059525 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5d1c0093a0 con 0x5592d6309a90 2024-06-03T00:03:42.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.553+0000 7f5d36d9cb80 10 client.16140 fetch_fsmap learned FSMap version 35 2024-06-03T00:03:42.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.553+0000 7f5d36d9cb80 1 -- 172.21.15.49:0/3310059525 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5592d631aa10 con 0x5592d6309a90 2024-06-03T00:03:42.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.553+0000 7f5d0dffb700 1 -- 172.21.15.49:0/3310059525 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d140095d0 con 0x5592d6309a90 2024-06-03T00:03:42.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.554+0000 7f5d0dffb700 1 -- 172.21.15.49:0/3310059525 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7f5d1c004450 con 0x5592d6309a90 2024-06-03T00:03:42.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.554+0000 7f5d36d9cb80 10 client.16140 fetch_fsmap finished waiting for FSMap version 35 2024-06-03T00:03:42.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.554+0000 7f5d36d9cb80 10 client.16140 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-06-03T00:03:42.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.554+0000 7f5d36d9cb80 20 client.16140 populate_metadata read hostname 'smithi049' 2024-06-03T00:03:42.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.554+0000 7f5d36d9cb80 1 --2- 172.21.15.49:0/3310059525 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x5592d631d0f0 0x5592d631f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:42.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.554+0000 7f5d36d9cb80 4 client.16140 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:03:42.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.554+0000 7f5d36d9cb80 1 -- 172.21.15.49:0/3310059525 --> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592d625fd50 con 0x5592d631d0f0 2024-06-03T00:03:42.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.554+0000 7f5d2a2b5700 1 --2- 172.21.15.49:0/3310059525 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x5592d631d0f0 0x5592d631f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:42.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.554+0000 7f5d0dffb700 10 client.16140 ms_handle_connect on v2:172.21.15.57:6838/249825195 2024-06-03T00:03:42.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.554+0000 7f5d2a2b5700 1 --2- 172.21.15.49:0/3310059525 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x5592d631d0f0 0x5592d631f4e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cd50f30645c5b4d3 server_cookie=704fe54bd96fe76b in_seq=0 out_seq=0 2024-06-03T00:03:42.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.555+0000 7f5d0dffb700 1 -- 172.21.15.49:0/3310059525 <== mds.1 v2:172.21.15.57:6838/249825195 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5592d625fd50 con 0x5592d631d0f0 2024-06-03T00:03:42.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.555+0000 7f5d0dffb700 10 client.16140 handle_command_reply: tid=0 2024-06-03T00:03:42.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.555+0000 7f5d36d9cb80 1 client.16140 shutdown 2024-06-03T00:03:42.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.555+0000 7f5d36d9cb80 1 -- 172.21.15.49:0/3310059525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5592d6309a90 msgr2=0x5592d630d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:42.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.555+0000 7f5d36d9cb80 1 --2- 172.21.15.49:0/3310059525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5592d6309a90 0x5592d630d160 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c011e90 tx=0x7f5d1c014600 comp rx=0 tx=0).stop 2024-06-03T00:03:42.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.555+0000 7f5d36d9cb80 1 -- 172.21.15.49:0/3310059525 shutdown_connections 2024-06-03T00:03:42.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.555+0000 7f5d36d9cb80 1 --2- 172.21.15.49:0/3310059525 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x5592d631d0f0 0x5592d631f4e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.555+0000 7f5d36d9cb80 1 --2- 172.21.15.49:0/3310059525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5592d6309a90 0x5592d630d160 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.555+0000 7f5d36d9cb80 1 --2- 172.21.15.49:0/3310059525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5592d63039b0 0x5592d630f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.555+0000 7f5d36d9cb80 1 --2- 172.21.15.49:0/3310059525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592d6309170 0x5592d630cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.555+0000 7f5d0dffb700 0 client.16140 ms_handle_reset on v2:172.21.15.57:6838/249825195 2024-06-03T00:03:42.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.555+0000 7f5d36d9cb80 1 -- 172.21.15.49:0/3310059525 >> 172.21.15.49:0/3310059525 conn(0x5592d622e080 msgr2=0x5592d62fb700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:42.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.555+0000 7f5d36d9cb80 1 -- 172.21.15.49:0/3310059525 shutdown_connections 2024-06-03T00:03:42.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.555+0000 7f5d36d9cb80 1 -- 172.21.15.49:0/3310059525 wait complete. 2024-06-03T00:03:42.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.555+0000 7f5d36d9cb80 20 client.16140 trim_cache size 0 max 16384 2024-06-03T00:03:42.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.571+0000 7f5d36d9cb80 1 Processor -- start 2024-06-03T00:03:42.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.571+0000 7f5d36d9cb80 1 -- start start 2024-06-03T00:03:42.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.571+0000 7f5d36d9cb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592d63039b0 0x5592d630d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:42.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.571+0000 7f5d36d9cb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5592d6309170 0x5592d62fbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:42.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.571+0000 7f5d36d9cb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5592d6309a90 0x5592d630f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:42.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.571+0000 7f5d36d9cb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5d241aa960 con 0x5592d6309a90 2024-06-03T00:03:42.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.571+0000 7f5d36d9cb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5d241ac650 con 0x5592d63039b0 2024-06-03T00:03:42.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.571+0000 7f5d36d9cb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5d241ab060 con 0x5592d6309170 2024-06-03T00:03:42.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.571+0000 7f5d2aab6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5592d6309a90 0x5592d630f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:42.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.571+0000 7f5d2a2b5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592d63039b0 0x5592d630d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:42.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.571+0000 7f5d29ab4700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5592d6309170 0x5592d62fbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:42.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.571+0000 7f5d2a2b5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592d63039b0 0x5592d630d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.49:47206/0 (socket says 172.21.15.49:47206) 2024-06-03T00:03:42.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.571+0000 7f5d2aab6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5592d6309a90 0x5592d630f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49038/0 (socket says 172.21.15.49:49038) 2024-06-03T00:03:42.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.571+0000 7f5d2a2b5700 1 -- 172.21.15.49:0/160452294 learned_addr learned my addr 172.21.15.49:0/160452294 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:42.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.572+0000 7f5d2a2b5700 1 -- 172.21.15.49:0/160452294 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5592d6309170 msgr2=0x5592d62fbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:42.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.572+0000 7f5d2a2b5700 1 --2- 172.21.15.49:0/160452294 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5592d6309170 0x5592d62fbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.572+0000 7f5d2a2b5700 1 -- 172.21.15.49:0/160452294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5592d6309a90 msgr2=0x5592d630f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:42.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.572+0000 7f5d2a2b5700 1 --2- 172.21.15.49:0/160452294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5592d6309a90 0x5592d630f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.572+0000 7f5d2a2b5700 1 -- 172.21.15.49:0/160452294 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592d62f8810 con 0x5592d63039b0 2024-06-03T00:03:42.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.572+0000 7f5d29ab4700 1 --2- 172.21.15.49:0/160452294 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5592d6309170 0x5592d62fbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:42.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.572+0000 7f5d2aab6700 1 --2- 172.21.15.49:0/160452294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5592d6309a90 0x5592d630f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:42.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.572+0000 7f5d2a2b5700 1 --2- 172.21.15.49:0/160452294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592d63039b0 0x5592d630d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5d20009a50 tx=0x7f5d20017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5154e08bf1af722 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:42.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.572+0000 7f5d0ffff700 1 -- 172.21.15.49:0/160452294 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d20020b80 con 0x5592d63039b0 2024-06-03T00:03:42.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.572+0000 7f5d0ffff700 1 -- 172.21.15.49:0/160452294 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d20004510 con 0x5592d63039b0 2024-06-03T00:03:42.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.572+0000 7f5d0ffff700 1 -- 172.21.15.49:0/160452294 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d20004e20 con 0x5592d63039b0 2024-06-03T00:03:42.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.573+0000 7f5d36d9cb80 1 -- 172.21.15.49:0/160452294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592d63039b0 msgr2=0x5592d630d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:42.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.573+0000 7f5d36d9cb80 1 --2- 172.21.15.49:0/160452294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592d63039b0 0x5592d630d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5d20009a50 tx=0x7f5d20017000 comp rx=0 tx=0).stop 2024-06-03T00:03:42.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.573+0000 7f5d36d9cb80 1 -- 172.21.15.49:0/160452294 shutdown_connections 2024-06-03T00:03:42.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.573+0000 7f5d36d9cb80 1 --2- 172.21.15.49:0/160452294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5592d6309a90 0x5592d630f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.573+0000 7f5d36d9cb80 1 --2- 172.21.15.49:0/160452294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592d63039b0 0x5592d630d190 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.573+0000 7f5d36d9cb80 1 --2- 172.21.15.49:0/160452294 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5592d6309170 0x5592d62fbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.573+0000 7f5d36d9cb80 1 -- 172.21.15.49:0/160452294 >> 172.21.15.49:0/160452294 conn(0x5592d622e080 msgr2=0x5592d6308580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:42.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.573+0000 7f5d36d9cb80 1 -- 172.21.15.49:0/160452294 shutdown_connections 2024-06-03T00:03:42.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.573+0000 7f5d36d9cb80 1 -- 172.21.15.49:0/160452294 wait complete. 2024-06-03T00:03:42.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.573+0000 7f5d36d9cb80 1 -- start start 2024-06-03T00:03:42.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.573+0000 7f5d36d9cb80 1 Processor -- start 2024-06-03T00:03:42.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.574+0000 7f5d36d9cb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5592d63039b0 0x5592d6315c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:42.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.574+0000 7f5d36d9cb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5592d6309170 0x5592d6324780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:42.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.574+0000 7f5d36d9cb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592d6309a90 0x5592d6324d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:42.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.574+0000 7f5d36d9cb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5d241abec0 con 0x5592d6309170 2024-06-03T00:03:42.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.574+0000 7f5d36d9cb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5d241ab760 con 0x5592d6309a90 2024-06-03T00:03:42.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.574+0000 7f5d36d9cb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5d241a88e0 con 0x5592d63039b0 2024-06-03T00:03:42.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.574+0000 7f5d36d9cb80 10 client.0 _ll_register_callbacks cb 0x5592d61e85b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:03:42.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.574+0000 7f5d2a2b5700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5592d63039b0 0x5592d6315c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:42.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.574+0000 7f5d29ab4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5592d6309170 0x5592d6324780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:42.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.574+0000 7f5d2aab6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592d6309a90 0x5592d6324d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:42.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.574+0000 7f5d2a2b5700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5592d63039b0 0x5592d6315c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:35100/0 (socket says 172.21.15.49:35100) 2024-06-03T00:03:42.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.574+0000 7f5d29ab4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5592d6309170 0x5592d6324780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49050/0 (socket says 172.21.15.49:49050) 2024-06-03T00:03:42.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.574+0000 7f5d2a2b5700 1 -- 172.21.15.49:0/3230576264 learned_addr learned my addr 172.21.15.49:0/3230576264 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:42.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.574+0000 7f5d2a2b5700 1 -- 172.21.15.49:0/3230576264 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592d6309a90 msgr2=0x5592d6324d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:42.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.574+0000 7f5d2a2b5700 1 --2- 172.21.15.49:0/3230576264 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592d6309a90 0x5592d6324d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.574+0000 7f5d2a2b5700 1 -- 172.21.15.49:0/3230576264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5592d6309170 msgr2=0x5592d6324780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:42.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.574+0000 7f5d2a2b5700 1 --2- 172.21.15.49:0/3230576264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5592d6309170 0x5592d6324780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.574+0000 7f5d2a2b5700 1 -- 172.21.15.49:0/3230576264 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592d6325540 con 0x5592d63039b0 2024-06-03T00:03:42.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.574+0000 7f5d2a2b5700 1 --2- 172.21.15.49:0/3230576264 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5592d63039b0 0x5592d6315c40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5d20009aa0 tx=0x7f5d20020b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33b50954961cf09 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.574+0000 7f5d0dffb700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-06-03T00:03:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.575+0000 7f5d0dffb700 1 -- 172.21.15.49:0/3230576264 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d20038070 con 0x5592d63039b0 2024-06-03T00:03:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.575+0000 7f5d36d9cb80 1 -- 172.21.15.49:0/3230576264 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d20004510 con 0x5592d63039b0 2024-06-03T00:03:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.575+0000 7f5d0dffb700 1 -- 172.21.15.49:0/3230576264 <== mon.1 v2:172.21.15.107:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f5d20004750 con 0x5592d63039b0 2024-06-03T00:03:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.575+0000 7f5d0dffb700 1 -- 172.21.15.49:0/3230576264 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5d20044050 con 0x5592d63039b0 2024-06-03T00:03:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.575+0000 7f5d36d9cb80 10 client.25732 fetch_fsmap learned FSMap version 35 2024-06-03T00:03:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.575+0000 7f5d36d9cb80 1 -- 172.21.15.49:0/3230576264 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5592d6387e30 con 0x5592d63039b0 2024-06-03T00:03:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.575+0000 7f5d0dffb700 1 -- 172.21.15.49:0/3230576264 <== mon.1 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d20004510 con 0x5592d63039b0 2024-06-03T00:03:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.575+0000 7f5d0dffb700 1 -- 172.21.15.49:0/3230576264 <== mon.1 v2:172.21.15.107:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7f5d20028070 con 0x5592d63039b0 2024-06-03T00:03:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.575+0000 7f5d36d9cb80 10 client.25732 fetch_fsmap finished waiting for FSMap version 35 2024-06-03T00:03:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.575+0000 7f5d36d9cb80 10 client.25732 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-06-03T00:03:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.575+0000 7f5d36d9cb80 20 client.25732 populate_metadata read hostname 'smithi049' 2024-06-03T00:03:42.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.575+0000 7f5d36d9cb80 1 --2- 172.21.15.49:0/3230576264 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x5592d6388570 0x5592d638a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:42.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.575+0000 7f5d36d9cb80 4 client.25732 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-03T00:03:42.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.575+0000 7f5d36d9cb80 1 -- 172.21.15.49:0/3230576264 --> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5592d630bf90 con 0x5592d6388570 2024-06-03T00:03:42.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.575+0000 7f5d29ab4700 1 --2- 172.21.15.49:0/3230576264 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x5592d6388570 0x5592d638a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:42.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.576+0000 7f5d29ab4700 1 --2- 172.21.15.49:0/3230576264 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x5592d6388570 0x5592d638a990 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=890072fb54fa05a0 server_cookie=1f5a20c82ed47545 in_seq=0 out_seq=0 2024-06-03T00:03:42.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.576+0000 7f5d0dffb700 10 client.25732 ms_handle_connect on v2:172.21.15.57:6838/249825195 2024-06-03T00:03:42.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.576+0000 7f5d0dffb700 1 -- 172.21.15.49:0/3230576264 <== mds.1 v2:172.21.15.57:6838/249825195 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5592d630bf90 con 0x5592d6388570 2024-06-03T00:03:42.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.576+0000 7f5d0dffb700 10 client.25732 handle_command_reply: tid=0 2024-06-03T00:03:42.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.576+0000 7f5d36d9cb80 1 client.25732 shutdown 2024-06-03T00:03:42.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.576+0000 7f5d36d9cb80 1 -- 172.21.15.49:0/3230576264 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5592d63039b0 msgr2=0x5592d6315c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:42.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.576+0000 7f5d36d9cb80 1 --2- 172.21.15.49:0/3230576264 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5592d63039b0 0x5592d6315c40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5d20009aa0 tx=0x7f5d20020b80 comp rx=0 tx=0).stop 2024-06-03T00:03:42.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.576+0000 7f5d36d9cb80 1 -- 172.21.15.49:0/3230576264 shutdown_connections 2024-06-03T00:03:42.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.576+0000 7f5d36d9cb80 1 --2- 172.21.15.49:0/3230576264 >> [v2:172.21.15.57:6838/249825195,v1:172.21.15.57:6839/249825195] conn(0x5592d6388570 0x5592d638a990 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.576+0000 7f5d36d9cb80 1 --2- 172.21.15.49:0/3230576264 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5592d6309a90 0x5592d6324d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.576+0000 7f5d36d9cb80 1 --2- 172.21.15.49:0/3230576264 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5592d63039b0 0x5592d6315c40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.576+0000 7f5d0dffb700 0 client.25732 ms_handle_reset on v2:172.21.15.57:6838/249825195 2024-06-03T00:03:42.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.576+0000 7f5d36d9cb80 1 --2- 172.21.15.49:0/3230576264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5592d6309170 0x5592d6324780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.576+0000 7f5d36d9cb80 1 -- 172.21.15.49:0/3230576264 >> 172.21.15.49:0/3230576264 conn(0x5592d622e080 msgr2=0x5592d6302460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:42.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.576+0000 7f5d36d9cb80 1 -- 172.21.15.49:0/3230576264 shutdown_connections 2024-06-03T00:03:42.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.576+0000 7f5d36d9cb80 1 -- 172.21.15.49:0/3230576264 wait complete. 2024-06-03T00:03:42.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.576+0000 7f5d36d9cb80 20 client.25732 trim_cache size 0 max 16384 2024-06-03T00:03:42.586 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-06-03T00:03:42.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.577+0000 7f5d2c519700 1 -- 172.21.15.49:0/1639466789 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f5d100a2ca0 msgr2=0x7f5d100a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:42.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.577+0000 7f5d2c519700 1 --2- 172.21.15.49:0/1639466789 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f5d100a2ca0 0x7f5d100a5160 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5d24198a70 tx=0x7f5d20009260 comp rx=0 tx=0).stop 2024-06-03T00:03:42.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.577+0000 7f5d2c519700 1 -- 172.21.15.49:0/1639466789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d24101d50 msgr2=0x7f5d2419dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:42.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.577+0000 7f5d2c519700 1 --2- 172.21.15.49:0/1639466789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d24101d50 0x7f5d2419dcb0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f5d14000c00 tx=0x7f5d1400bab0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.577+0000 7f5d2c519700 1 -- 172.21.15.49:0/1639466789 shutdown_connections 2024-06-03T00:03:42.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.577+0000 7f5d2c519700 1 --2- 172.21.15.49:0/1639466789 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f5d100a2ca0 0x7f5d100a5160 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.577+0000 7f5d2c519700 1 --2- 172.21.15.49:0/1639466789 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d24107400 0x7f5d24197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.577+0000 7f5d2c519700 1 --2- 172.21.15.49:0/1639466789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d24101390 0x7f5d2419d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.577+0000 7f5d2c519700 1 --2- 172.21.15.49:0/1639466789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d24101d50 0x7f5d2419dcb0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:42.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.577+0000 7f5d2c519700 1 -- 172.21.15.49:0/1639466789 >> 172.21.15.49:0/1639466789 conn(0x7f5d24078340 msgr2=0x7f5d240ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:42.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.577+0000 7f5d2c519700 1 -- 172.21.15.49:0/1639466789 shutdown_connections 2024-06-03T00:03:42.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:42.577+0000 7f5d2c519700 1 -- 172.21.15.49:0/1639466789 wait complete. 2024-06-03T00:03:43.371 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:43 smithi049 ceph-mon[32302]: pgmap v493: 97 pgs: 97 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 MiB/s rd, 43 MiB/s wr, 178 op/s 2024-06-03T00:03:43.399 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-06-03T00:03:43.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:43 smithi057 ceph-mon[36457]: pgmap v493: 97 pgs: 97 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 MiB/s rd, 43 MiB/s wr, 178 op/s 2024-06-03T00:03:43.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:43 smithi107 ceph-mon[37048]: pgmap v493: 97 pgs: 97 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 MiB/s rd, 43 MiB/s wr, 178 op/s 2024-06-03T00:03:43.652 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:03:45.409 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:45 smithi049 ceph-mon[32302]: pgmap v494: 97 pgs: 97 active+clean; 675 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 MiB/s rd, 34 MiB/s wr, 192 op/s 2024-06-03T00:03:45.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.419+0000 7fa0969c9700 1 -- 172.21.15.49:0/2146453463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa090107400 msgr2=0x7fa0901077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:45.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.419+0000 7fa0969c9700 1 --2- 172.21.15.49:0/2146453463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa090107400 0x7fa0901077e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa080009990 tx=0x7fa080009ca0 comp rx=0 tx=0).stop 2024-06-03T00:03:45.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.420+0000 7fa0969c9700 1 -- 172.21.15.49:0/2146453463 shutdown_connections 2024-06-03T00:03:45.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.420+0000 7fa0969c9700 1 --2- 172.21.15.49:0/2146453463 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa090101d50 0x7fa09010e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:45.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.420+0000 7fa0969c9700 1 --2- 172.21.15.49:0/2146453463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa090107400 0x7fa0901077e0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:45.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.420+0000 7fa0969c9700 1 --2- 172.21.15.49:0/2146453463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa090101390 0x7fa090101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:45.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.420+0000 7fa0969c9700 1 -- 172.21.15.49:0/2146453463 >> 172.21.15.49:0/2146453463 conn(0x7fa090078340 msgr2=0x7fa090078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:45.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.420+0000 7fa0969c9700 1 -- 172.21.15.49:0/2146453463 shutdown_connections 2024-06-03T00:03:45.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.420+0000 7fa0969c9700 1 -- 172.21.15.49:0/2146453463 wait complete. 2024-06-03T00:03:45.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.420+0000 7fa0969c9700 1 Processor -- start 2024-06-03T00:03:45.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.420+0000 7fa0969c9700 1 -- start start 2024-06-03T00:03:45.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.421+0000 7fa0969c9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa090101390 0x7fa090199a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:45.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.421+0000 7fa0969c9700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa090101d50 0x7fa090199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:45.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.421+0000 7fa0969c9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa090107400 0x7fa0901a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:45.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.421+0000 7fa0969c9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa090111670 con 0x7fa090101390 2024-06-03T00:03:45.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.421+0000 7fa0969c9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa0901114f0 con 0x7fa090107400 2024-06-03T00:03:45.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.421+0000 7fa0969c9700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa0901117f0 con 0x7fa090101d50 2024-06-03T00:03:45.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.421+0000 7fa08ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa090101390 0x7fa090199a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:45.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.421+0000 7fa08ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa090101390 0x7fa090199a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60632/0 (socket says 172.21.15.49:60632) 2024-06-03T00:03:45.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.421+0000 7fa08f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa090101d50 0x7fa090199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:45.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.421+0000 7fa08ffff700 1 -- 172.21.15.49:0/2579771977 learned_addr learned my addr 172.21.15.49:0/2579771977 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:45.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.421+0000 7fa094f66700 1 --2- 172.21.15.49:0/2579771977 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa090107400 0x7fa0901a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:45.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.421+0000 7fa08ffff700 1 -- 172.21.15.49:0/2579771977 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa090101d50 msgr2=0x7fa090199f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:45.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.421+0000 7fa08ffff700 1 --2- 172.21.15.49:0/2579771977 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa090101d50 0x7fa090199f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:45.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.421+0000 7fa08ffff700 1 -- 172.21.15.49:0/2579771977 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa090107400 msgr2=0x7fa0901a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:45.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.421+0000 7fa08ffff700 1 --2- 172.21.15.49:0/2579771977 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa090107400 0x7fa0901a4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:45.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.421+0000 7fa08ffff700 1 -- 172.21.15.49:0/2579771977 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0901a5010 con 0x7fa090101390 2024-06-03T00:03:45.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.421+0000 7fa08f7fe700 1 --2- 172.21.15.49:0/2579771977 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa090101d50 0x7fa090199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:45.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.421+0000 7fa08ffff700 1 --2- 172.21.15.49:0/2579771977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa090101390 0x7fa090199a50 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa08000bae0 tx=0x7fa08000bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:45.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.422+0000 7fa08d7fa700 1 -- 172.21.15.49:0/2579771977 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa080026070 con 0x7fa090101390 2024-06-03T00:03:45.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.422+0000 7fa0969c9700 1 -- 172.21.15.49:0/2579771977 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0901a51e0 con 0x7fa090101390 2024-06-03T00:03:45.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.422+0000 7fa08d7fa700 1 -- 172.21.15.49:0/2579771977 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa080003d70 con 0x7fa090101390 2024-06-03T00:03:45.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.422+0000 7fa08d7fa700 1 -- 172.21.15.49:0/2579771977 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa080021410 con 0x7fa090101390 2024-06-03T00:03:45.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.422+0000 7fa0969c9700 1 -- 172.21.15.49:0/2579771977 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0901a56e0 con 0x7fa090101390 2024-06-03T00:03:45.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.424+0000 7fa08d7fa700 1 -- 172.21.15.49:0/2579771977 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa080029070 con 0x7fa090101390 2024-06-03T00:03:45.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.425+0000 7fa08d7fa700 1 --2- 172.21.15.49:0/2579771977 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa0780a2c20 0x7fa0780a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:45.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.425+0000 7fa08f7fe700 1 --2- 172.21.15.49:0/2579771977 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa0780a2c20 0x7fa0780a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:45.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.425+0000 7fa08d7fa700 1 -- 172.21.15.49:0/2579771977 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fa0800cfd80 con 0x7fa090101390 2024-06-03T00:03:45.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.425+0000 7fa08f7fe700 1 --2- 172.21.15.49:0/2579771977 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa0780a2c20 0x7fa0780a50e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa084009680 tx=0x7fa084009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:45.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.425+0000 7fa0a124cb80 1 Processor -- start 2024-06-03T00:03:45.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.426+0000 7fa0a124cb80 1 -- start start 2024-06-03T00:03:45.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.426+0000 7fa0a124cb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cfe634640 0x559cfe634a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:45.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.426+0000 7fa0a124cb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559cfe634f60 0x559cfe62e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:45.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.426+0000 7fa0a124cb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559cfe62ef20 0x559cfe62f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:45.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.426+0000 7fa0a124cb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559cfe580810 con 0x559cfe634640 2024-06-03T00:03:45.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.426+0000 7fa0a124cb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x559cfe528720 con 0x559cfe62ef20 2024-06-03T00:03:45.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.426+0000 7fa0a124cb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x559cfe57c7d0 con 0x559cfe634f60 2024-06-03T00:03:45.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.426+0000 7fa08ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cfe634640 0x559cfe634a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:45.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.426+0000 7fa08f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559cfe634f60 0x559cfe62e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:45.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.426+0000 7fa08ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cfe634640 0x559cfe634a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60644/0 (socket says 172.21.15.49:60644) 2024-06-03T00:03:45.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.426+0000 7fa08ffff700 1 -- 172.21.15.49:0/1506022061 learned_addr learned my addr 172.21.15.49:0/1506022061 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:45.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.426+0000 7fa08f7fe700 1 --2- 172.21.15.49:0/1506022061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559cfe634f60 0x559cfe62e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:57162/0 (socket says 172.21.15.49:57162) 2024-06-03T00:03:45.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.426+0000 7fa094f66700 1 --2- 172.21.15.49:0/1506022061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559cfe62ef20 0x559cfe62f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:45.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.426+0000 7fa08f7fe700 1 -- 172.21.15.49:0/1506022061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559cfe62ef20 msgr2=0x559cfe62f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:45.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.426+0000 7fa08f7fe700 1 --2- 172.21.15.49:0/1506022061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559cfe62ef20 0x559cfe62f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:45.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.426+0000 7fa08f7fe700 1 -- 172.21.15.49:0/1506022061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cfe634640 msgr2=0x559cfe634a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:45.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.426+0000 7fa08f7fe700 1 --2- 172.21.15.49:0/1506022061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cfe634640 0x559cfe634a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:45.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.426+0000 7fa08f7fe700 1 -- 172.21.15.49:0/1506022061 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cfe51ef50 con 0x559cfe634f60 2024-06-03T00:03:45.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.426+0000 7fa08ffff700 1 --2- 172.21.15.49:0/1506022061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cfe634640 0x559cfe634a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:45.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.426+0000 7fa094f66700 1 --2- 172.21.15.49:0/1506022061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559cfe62ef20 0x559cfe62f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:03:45.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.427+0000 7fa08f7fe700 1 --2- 172.21.15.49:0/1506022061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559cfe634f60 0x559cfe62e9e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa084009870 tx=0x7fa084014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=437455d1078c0d34 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:45.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.427+0000 7fa0767fc700 1 -- 172.21.15.49:0/1506022061 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08400edc0 con 0x559cfe634f60 2024-06-03T00:03:45.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.427+0000 7fa0767fc700 1 -- 172.21.15.49:0/1506022061 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa08401c8f0 con 0x559cfe634f60 2024-06-03T00:03:45.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.427+0000 7fa0767fc700 1 -- 172.21.15.49:0/1506022061 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08401daf0 con 0x559cfe634f60 2024-06-03T00:03:45.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.427+0000 7fa0a124cb80 1 -- 172.21.15.49:0/1506022061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559cfe634f60 msgr2=0x559cfe62e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:45.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.427+0000 7fa0a124cb80 1 --2- 172.21.15.49:0/1506022061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559cfe634f60 0x559cfe62e9e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa084009870 tx=0x7fa084014000 comp rx=0 tx=0).stop 2024-06-03T00:03:45.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.427+0000 7fa0a124cb80 1 -- 172.21.15.49:0/1506022061 shutdown_connections 2024-06-03T00:03:45.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.427+0000 7fa0a124cb80 1 --2- 172.21.15.49:0/1506022061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559cfe62ef20 0x559cfe62f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:45.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.427+0000 7fa0a124cb80 1 --2- 172.21.15.49:0/1506022061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cfe634640 0x559cfe634a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:45.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.427+0000 7fa0a124cb80 1 --2- 172.21.15.49:0/1506022061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559cfe634f60 0x559cfe62e9e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:45.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.427+0000 7fa0a124cb80 1 -- 172.21.15.49:0/1506022061 >> 172.21.15.49:0/1506022061 conn(0x559cfe559cc0 msgr2=0x559cfe629850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:45.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.428+0000 7fa0a124cb80 1 -- 172.21.15.49:0/1506022061 shutdown_connections 2024-06-03T00:03:45.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.428+0000 7fa0a124cb80 1 -- 172.21.15.49:0/1506022061 wait complete. 2024-06-03T00:03:45.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.428+0000 7fa0a124cb80 1 -- start start 2024-06-03T00:03:45.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.428+0000 7fa0a124cb80 1 Processor -- start 2024-06-03T00:03:45.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.428+0000 7fa0a124cb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cfe62ef20 0x559cfe63ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:45.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.428+0000 7fa0a124cb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559cfe634640 0x559cfe638040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:45.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.428+0000 7fa0a124cb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559cfe634f60 0x559cfe638580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:45.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.428+0000 7fa0a124cb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559cfe63b9d0 con 0x559cfe62ef20 2024-06-03T00:03:45.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.428+0000 7fa0a124cb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x559cfe520bf0 con 0x559cfe634640 2024-06-03T00:03:45.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.428+0000 7fa0a124cb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x559cfe63bb50 con 0x559cfe634f60 2024-06-03T00:03:45.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.429+0000 7fa0a124cb80 10 client.0 _ll_register_callbacks cb 0x559cfe51a920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:03:45.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.429+0000 7fa08ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cfe62ef20 0x559cfe63ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:45.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.429+0000 7fa08ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cfe62ef20 0x559cfe63ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60646/0 (socket says 172.21.15.49:60646) 2024-06-03T00:03:45.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.429+0000 7fa08ffff700 1 -- 172.21.15.49:0/217112856 learned_addr learned my addr 172.21.15.49:0/217112856 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:45.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.429+0000 7fa08f7fe700 1 --2- 172.21.15.49:0/217112856 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559cfe634640 0x559cfe638040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:45.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.429+0000 7fa094f66700 1 --2- 172.21.15.49:0/217112856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559cfe634f60 0x559cfe638580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:45.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.429+0000 7fa08f7fe700 1 -- 172.21.15.49:0/217112856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559cfe634f60 msgr2=0x559cfe638580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:45.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.429+0000 7fa08f7fe700 1 --2- 172.21.15.49:0/217112856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559cfe634f60 0x559cfe638580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:45.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.429+0000 7fa08f7fe700 1 -- 172.21.15.49:0/217112856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cfe62ef20 msgr2=0x559cfe63ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:45.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.429+0000 7fa08f7fe700 1 --2- 172.21.15.49:0/217112856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cfe62ef20 0x559cfe63ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:45.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.429+0000 7fa08f7fe700 1 -- 172.21.15.49:0/217112856 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cfe4cf8d0 con 0x559cfe634640 2024-06-03T00:03:45.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.429+0000 7fa08ffff700 1 --2- 172.21.15.49:0/217112856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cfe62ef20 0x559cfe63ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:45.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.429+0000 7fa08f7fe700 1 --2- 172.21.15.49:0/217112856 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559cfe634640 0x559cfe638040 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa084009650 tx=0x7fa08400ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29afca5c815e824c server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:45.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.429+0000 7fa06f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2024-06-03T00:03:45.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.429+0000 7fa06f7fe700 1 -- 172.21.15.49:0/217112856 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08401caa0 con 0x559cfe634640 2024-06-03T00:03:45.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.429+0000 7fa0a124cb80 1 -- 172.21.15.49:0/217112856 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa08401c8f0 con 0x559cfe634640 2024-06-03T00:03:45.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.429+0000 7fa06f7fe700 1 -- 172.21.15.49:0/217112856 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fa08401cc40 con 0x559cfe634640 2024-06-03T00:03:45.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.430+0000 7fa06f7fe700 1 -- 172.21.15.49:0/217112856 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa08401ce40 con 0x559cfe634640 2024-06-03T00:03:45.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.430+0000 7fa0a124cb80 10 client.25658 fetch_fsmap learned FSMap version 35 2024-06-03T00:03:45.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.430+0000 7fa0a124cb80 1 -- 172.21.15.49:0/217112856 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x559cfe6462c0 con 0x559cfe634640 2024-06-03T00:03:45.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.430+0000 7fa06f7fe700 1 -- 172.21.15.49:0/217112856 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa08401c8f0 con 0x559cfe634640 2024-06-03T00:03:45.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.430+0000 7fa06f7fe700 1 -- 172.21.15.49:0/217112856 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7fa08401dc30 con 0x559cfe634640 2024-06-03T00:03:45.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.430+0000 7fa0a124cb80 10 client.25658 fetch_fsmap finished waiting for FSMap version 35 2024-06-03T00:03:45.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.430+0000 7fa0a124cb80 10 client.25658 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-03T00:03:45.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.430+0000 7fa0a124cb80 20 client.25658 populate_metadata read hostname 'smithi049' 2024-06-03T00:03:45.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.430+0000 7fa0a124cb80 1 --2- 172.21.15.49:0/217112856 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x559cfe6487f0 0x559cfe64abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:45.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.430+0000 7fa0a124cb80 4 client.25658 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:03:45.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.430+0000 7fa0a124cb80 1 -- 172.21.15.49:0/217112856 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559cfe58dd10 con 0x559cfe6487f0 2024-06-03T00:03:45.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.430+0000 7fa08ffff700 1 --2- 172.21.15.49:0/217112856 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x559cfe6487f0 0x559cfe64abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:45.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.431+0000 7fa08ffff700 1 --2- 172.21.15.49:0/217112856 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x559cfe6487f0 0x559cfe64abe0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9cd9ec64db2f931 server_cookie=cccc2adc2cf65a27 in_seq=0 out_seq=0 2024-06-03T00:03:45.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.431+0000 7fa06f7fe700 10 client.25658 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:45.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.431+0000 7fa06f7fe700 1 -- 172.21.15.49:0/217112856 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x559cfe58dd10 con 0x559cfe6487f0 2024-06-03T00:03:45.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.431+0000 7fa06f7fe700 10 client.25658 handle_command_reply: tid=0 2024-06-03T00:03:45.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.431+0000 7fa0a124cb80 1 client.25658 shutdown 2024-06-03T00:03:45.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.431+0000 7fa0a124cb80 1 -- 172.21.15.49:0/217112856 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559cfe634640 msgr2=0x559cfe638040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:45.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.431+0000 7fa0a124cb80 1 --2- 172.21.15.49:0/217112856 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559cfe634640 0x559cfe638040 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa084009650 tx=0x7fa08400ee60 comp rx=0 tx=0).stop 2024-06-03T00:03:45.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.431+0000 7fa0a124cb80 1 -- 172.21.15.49:0/217112856 shutdown_connections 2024-06-03T00:03:45.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.431+0000 7fa0a124cb80 1 --2- 172.21.15.49:0/217112856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559cfe634f60 0x559cfe638580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:45.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.431+0000 7fa0a124cb80 1 --2- 172.21.15.49:0/217112856 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x559cfe6487f0 0x559cfe64abe0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:45.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.431+0000 7fa0a124cb80 1 --2- 172.21.15.49:0/217112856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cfe62ef20 0x559cfe63ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:45.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.431+0000 7fa0a124cb80 1 --2- 172.21.15.49:0/217112856 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559cfe634640 0x559cfe638040 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:45.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.431+0000 7fa06f7fe700 0 client.25658 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:45.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.432+0000 7fa0a124cb80 1 -- 172.21.15.49:0/217112856 >> 172.21.15.49:0/217112856 conn(0x559cfe559cc0 msgr2=0x559cfe62d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:45.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.432+0000 7fa0a124cb80 1 -- 172.21.15.49:0/217112856 shutdown_connections 2024-06-03T00:03:45.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.432+0000 7fa0a124cb80 1 -- 172.21.15.49:0/217112856 wait complete. 2024-06-03T00:03:45.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.432+0000 7fa0a124cb80 20 client.25658 trim_cache size 0 max 16384 2024-06-03T00:03:45.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.447+0000 7fa0a124cb80 1 Processor -- start 2024-06-03T00:03:45.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.447+0000 7fa0a124cb80 1 -- start start 2024-06-03T00:03:45.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.448+0000 7fa0a124cb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cfe62ef20 0x559cfe62e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:45.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.448+0000 7fa0a124cb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559cfe634640 0x559cfe6299f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:45.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.448+0000 7fa0a124cb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559cfe634f60 0x559cfe638710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:45.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.448+0000 7fa0a124cb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa0901acc60 con 0x559cfe62ef20 2024-06-03T00:03:45.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.448+0000 7fa0a124cb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa0901ae950 con 0x559cfe634f60 2024-06-03T00:03:45.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.448+0000 7fa0a124cb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa0901ad360 con 0x559cfe634640 2024-06-03T00:03:45.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.448+0000 7fa08ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cfe62ef20 0x559cfe62e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:45.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.448+0000 7fa08f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559cfe634640 0x559cfe6299f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:45.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.448+0000 7fa08ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cfe62ef20 0x559cfe62e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60648/0 (socket says 172.21.15.49:60648) 2024-06-03T00:03:45.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.448+0000 7fa08ffff700 1 -- 172.21.15.49:0/3768744761 learned_addr learned my addr 172.21.15.49:0/3768744761 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:45.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.448+0000 7fa094f66700 1 --2- 172.21.15.49:0/3768744761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559cfe634f60 0x559cfe638710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:45.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.448+0000 7fa08f7fe700 1 -- 172.21.15.49:0/3768744761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559cfe634f60 msgr2=0x559cfe638710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:45.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.448+0000 7fa08f7fe700 1 --2- 172.21.15.49:0/3768744761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559cfe634f60 0x559cfe638710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:45.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.448+0000 7fa08f7fe700 1 -- 172.21.15.49:0/3768744761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cfe62ef20 msgr2=0x559cfe62e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:45.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.448+0000 7fa08f7fe700 1 --2- 172.21.15.49:0/3768744761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cfe62ef20 0x559cfe62e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:45.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.448+0000 7fa08f7fe700 1 -- 172.21.15.49:0/3768744761 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cfe63b0b0 con 0x559cfe634640 2024-06-03T00:03:45.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.448+0000 7fa08ffff700 1 --2- 172.21.15.49:0/3768744761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cfe62ef20 0x559cfe62e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:45.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.448+0000 7fa08f7fe700 1 --2- 172.21.15.49:0/3768744761 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559cfe634640 0x559cfe6299f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa084016040 tx=0x7fa08400ed40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=557845fa4094c82e server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:45.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.448+0000 7fa075ffb700 1 -- 172.21.15.49:0/3768744761 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0840092d0 con 0x559cfe634640 2024-06-03T00:03:45.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.449+0000 7fa075ffb700 1 -- 172.21.15.49:0/3768744761 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa084004860 con 0x559cfe634640 2024-06-03T00:03:45.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.449+0000 7fa075ffb700 1 -- 172.21.15.49:0/3768744761 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08401dde0 con 0x559cfe634640 2024-06-03T00:03:45.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:45 smithi057 ceph-mon[36457]: pgmap v494: 97 pgs: 97 active+clean; 675 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 MiB/s rd, 34 MiB/s wr, 192 op/s 2024-06-03T00:03:45.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.449+0000 7fa0a124cb80 1 -- 172.21.15.49:0/3768744761 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559cfe634640 msgr2=0x559cfe6299f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:45.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.449+0000 7fa0a124cb80 1 --2- 172.21.15.49:0/3768744761 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559cfe634640 0x559cfe6299f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa084016040 tx=0x7fa08400ed40 comp rx=0 tx=0).stop 2024-06-03T00:03:45.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.449+0000 7fa0a124cb80 1 -- 172.21.15.49:0/3768744761 shutdown_connections 2024-06-03T00:03:45.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.449+0000 7fa0a124cb80 1 --2- 172.21.15.49:0/3768744761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559cfe634f60 0x559cfe638710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:45.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.449+0000 7fa0a124cb80 1 --2- 172.21.15.49:0/3768744761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cfe62ef20 0x559cfe62e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:45.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.449+0000 7fa0a124cb80 1 --2- 172.21.15.49:0/3768744761 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559cfe634640 0x559cfe6299f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:45.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.449+0000 7fa0a124cb80 1 -- 172.21.15.49:0/3768744761 >> 172.21.15.49:0/3768744761 conn(0x559cfe559cc0 msgr2=0x559cfe638000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:45.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.449+0000 7fa0a124cb80 1 -- 172.21.15.49:0/3768744761 shutdown_connections 2024-06-03T00:03:45.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.449+0000 7fa0a124cb80 1 -- 172.21.15.49:0/3768744761 wait complete. 2024-06-03T00:03:45.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.450+0000 7fa0a124cb80 1 -- start start 2024-06-03T00:03:45.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.450+0000 7fa0a124cb80 1 Processor -- start 2024-06-03T00:03:45.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.450+0000 7fa0a124cb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559cfe62ef20 0x559cfe640e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:45.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.450+0000 7fa0a124cb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cfe634640 0x559cfe641350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:45.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.450+0000 7fa0a124cb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559cfe634f60 0x559cfe64f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:45.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.450+0000 7fa0a124cb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa0901ae1c0 con 0x559cfe634640 2024-06-03T00:03:45.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.450+0000 7fa0a124cb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa0901ada60 con 0x559cfe634f60 2024-06-03T00:03:45.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.450+0000 7fa0a124cb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa0901aabe0 con 0x559cfe62ef20 2024-06-03T00:03:45.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.450+0000 7fa0a124cb80 10 client.0 _ll_register_callbacks cb 0x559cfe51a920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:03:45.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.450+0000 7fa08ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559cfe62ef20 0x559cfe640e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:45.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.450+0000 7fa08ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559cfe62ef20 0x559cfe640e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:57188/0 (socket says 172.21.15.49:57188) 2024-06-03T00:03:45.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.450+0000 7fa08ffff700 1 -- 172.21.15.49:0/1799693072 learned_addr learned my addr 172.21.15.49:0/1799693072 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:45.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.450+0000 7fa08f7fe700 1 --2- 172.21.15.49:0/1799693072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cfe634640 0x559cfe641350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:45.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.450+0000 7fa094f66700 1 --2- 172.21.15.49:0/1799693072 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559cfe634f60 0x559cfe64f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:45.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.451+0000 7fa08ffff700 1 -- 172.21.15.49:0/1799693072 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559cfe634f60 msgr2=0x559cfe64f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:45.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.451+0000 7fa08ffff700 1 --2- 172.21.15.49:0/1799693072 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559cfe634f60 0x559cfe64f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:45.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.451+0000 7fa08ffff700 1 -- 172.21.15.49:0/1799693072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cfe634640 msgr2=0x559cfe641350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:45.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.451+0000 7fa08ffff700 1 --2- 172.21.15.49:0/1799693072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cfe634640 0x559cfe641350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:45.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.451+0000 7fa08ffff700 1 -- 172.21.15.49:0/1799693072 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cfe64f740 con 0x559cfe62ef20 2024-06-03T00:03:45.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.451+0000 7fa08ffff700 1 --2- 172.21.15.49:0/1799693072 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559cfe62ef20 0x559cfe640e10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa080099040 tx=0x7fa08000fa20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6d2ef0b694f5842 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:45.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.451+0000 7fa06f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-06-03T00:03:45.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.451+0000 7fa06f7fe700 1 -- 172.21.15.49:0/1799693072 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08009cd70 con 0x559cfe62ef20 2024-06-03T00:03:45.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.451+0000 7fa06f7fe700 1 -- 172.21.15.49:0/1799693072 <== mon.1 v2:172.21.15.107:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fa08009a710 con 0x559cfe62ef20 2024-06-03T00:03:45.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.451+0000 7fa0a124cb80 1 -- 172.21.15.49:0/1799693072 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa084004860 con 0x559cfe62ef20 2024-06-03T00:03:45.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.451+0000 7fa06f7fe700 1 -- 172.21.15.49:0/1799693072 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa08009c670 con 0x559cfe62ef20 2024-06-03T00:03:45.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.451+0000 7fa0a124cb80 10 client.25750 fetch_fsmap learned FSMap version 35 2024-06-03T00:03:45.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.451+0000 7fa0a124cb80 1 -- 172.21.15.49:0/1799693072 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x559cfe6b2870 con 0x559cfe62ef20 2024-06-03T00:03:45.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.451+0000 7fa06f7fe700 1 -- 172.21.15.49:0/1799693072 <== mon.1 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa084004860 con 0x559cfe62ef20 2024-06-03T00:03:45.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.451+0000 7fa06f7fe700 1 -- 172.21.15.49:0/1799693072 <== mon.1 v2:172.21.15.107:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7fa0800a1bb0 con 0x559cfe62ef20 2024-06-03T00:03:45.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.452+0000 7fa0a124cb80 10 client.25750 fetch_fsmap finished waiting for FSMap version 35 2024-06-03T00:03:45.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.452+0000 7fa0a124cb80 10 client.25750 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-03T00:03:45.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.452+0000 7fa0a124cb80 20 client.25750 populate_metadata read hostname 'smithi049' 2024-06-03T00:03:45.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.452+0000 7fa0a124cb80 1 --2- 172.21.15.49:0/1799693072 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x559cfe6b2fc0 0x559cfe6b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:45.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.452+0000 7fa0a124cb80 4 client.25750 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-03T00:03:45.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.452+0000 7fa0a124cb80 1 -- 172.21.15.49:0/1799693072 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559cfe588290 con 0x559cfe6b2fc0 2024-06-03T00:03:45.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.452+0000 7fa08f7fe700 1 --2- 172.21.15.49:0/1799693072 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x559cfe6b2fc0 0x559cfe6b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:45.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.452+0000 7fa06f7fe700 10 client.25750 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:45.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.452+0000 7fa08f7fe700 1 --2- 172.21.15.49:0/1799693072 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x559cfe6b2fc0 0x559cfe6b53e0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=631954ca9bb959e server_cookie=677585528b3373b7 in_seq=0 out_seq=0 2024-06-03T00:03:45.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.452+0000 7fa06f7fe700 1 -- 172.21.15.49:0/1799693072 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559cfe588290 con 0x559cfe6b2fc0 2024-06-03T00:03:45.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.452+0000 7fa06f7fe700 10 client.25750 handle_command_reply: tid=0 2024-06-03T00:03:45.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.452+0000 7fa0a124cb80 1 client.25750 shutdown 2024-06-03T00:03:45.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.452+0000 7fa0a124cb80 1 -- 172.21.15.49:0/1799693072 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559cfe62ef20 msgr2=0x559cfe640e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:45.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.452+0000 7fa0a124cb80 1 --2- 172.21.15.49:0/1799693072 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559cfe62ef20 0x559cfe640e10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa080099040 tx=0x7fa08000fa20 comp rx=0 tx=0).stop 2024-06-03T00:03:45.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.453+0000 7fa0a124cb80 1 -- 172.21.15.49:0/1799693072 shutdown_connections 2024-06-03T00:03:45.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.453+0000 7fa0a124cb80 1 --2- 172.21.15.49:0/1799693072 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559cfe634f60 0x559cfe64f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:45.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.453+0000 7fa0a124cb80 1 --2- 172.21.15.49:0/1799693072 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559cfe62ef20 0x559cfe640e10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:45.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.453+0000 7fa0a124cb80 1 --2- 172.21.15.49:0/1799693072 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x559cfe6b2fc0 0x559cfe6b53e0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:45.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.453+0000 7fa0a124cb80 1 --2- 172.21.15.49:0/1799693072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559cfe634640 0x559cfe641350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:45.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.453+0000 7fa06f7fe700 0 client.25750 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:45.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.453+0000 7fa0a124cb80 1 -- 172.21.15.49:0/1799693072 >> 172.21.15.49:0/1799693072 conn(0x559cfe559cc0 msgr2=0x559cfe622e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:45.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.453+0000 7fa0a124cb80 1 -- 172.21.15.49:0/1799693072 shutdown_connections 2024-06-03T00:03:45.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.453+0000 7fa0a124cb80 1 -- 172.21.15.49:0/1799693072 wait complete. 2024-06-03T00:03:45.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.453+0000 7fa0a124cb80 20 client.25750 trim_cache size 0 max 16384 2024-06-03T00:03:45.459 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-06-03T00:03:45.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.453+0000 7fa0969c9700 1 -- 172.21.15.49:0/2579771977 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa0780a2c20 msgr2=0x7fa0780a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:45.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.453+0000 7fa0969c9700 1 --2- 172.21.15.49:0/2579771977 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa0780a2c20 0x7fa0780a50e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa084009680 tx=0x7fa084009260 comp rx=0 tx=0).stop 2024-06-03T00:03:45.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.453+0000 7fa0969c9700 1 -- 172.21.15.49:0/2579771977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa090101390 msgr2=0x7fa090199a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:45.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.453+0000 7fa0969c9700 1 --2- 172.21.15.49:0/2579771977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa090101390 0x7fa090199a50 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa08000bae0 tx=0x7fa08000bb10 comp rx=0 tx=0).stop 2024-06-03T00:03:45.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.454+0000 7fa0969c9700 1 -- 172.21.15.49:0/2579771977 shutdown_connections 2024-06-03T00:03:45.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.454+0000 7fa0969c9700 1 --2- 172.21.15.49:0/2579771977 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa0780a2c20 0x7fa0780a50e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:45.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.454+0000 7fa0969c9700 1 --2- 172.21.15.49:0/2579771977 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa090107400 0x7fa0901a4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:45.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.454+0000 7fa0969c9700 1 --2- 172.21.15.49:0/2579771977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa090101390 0x7fa090199a50 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:45.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.454+0000 7fa0969c9700 1 --2- 172.21.15.49:0/2579771977 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa090101d50 0x7fa090199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:45.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.454+0000 7fa0969c9700 1 -- 172.21.15.49:0/2579771977 >> 172.21.15.49:0/2579771977 conn(0x7fa090078340 msgr2=0x7fa0900fff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:45.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.454+0000 7fa0969c9700 1 -- 172.21.15.49:0/2579771977 shutdown_connections 2024-06-03T00:03:45.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:45.454+0000 7fa0969c9700 1 -- 172.21.15.49:0/2579771977 wait complete. 2024-06-03T00:03:45.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:45 smithi107 ceph-mon[37048]: pgmap v494: 97 pgs: 97 active+clean; 675 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 MiB/s rd, 34 MiB/s wr, 192 op/s 2024-06-03T00:03:46.146 ERROR:tasks.fwd_scrub:rank 2 damaged: [{'damage_type': 'backtrace', 'id': 54637, 'ino': 1099511632018, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset013.c'}, {'damage_type': 'backtrace', 'id': 12261042, 'ino': 1099511632658, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/6-1.c'}, {'damage_type': 'backtrace', 'id': 16139787, 'ino': 1099511632806, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/11-1.c'}, {'damage_type': 'backtrace', 'id': 17543119, 'ino': 1099511631958, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_event.map'}, {'damage_type': 'backtrace', 'id': 29180956, 'ino': 1099511634186, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-6.c'}, {'damage_type': 'backtrace', 'id': 31395387, 'ino': 1099511632807, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/17-1.c'}, {'damage_type': 'backtrace', 'id': 33827552, 'ino': 1099511632032, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget036.c'}, {'damage_type': 'backtrace', 'id': 41334615, 'ino': 1099511634060, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-13.c'}, {'damage_type': 'backtrace', 'id': 45976560, 'ino': 1099511632060, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset006.c'}, {'damage_type': 'backtrace', 'id': 51593558, 'ino': 1099511632173, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_fumi_func.c'}, {'damage_type': 'backtrace', 'id': 55099919, 'ino': 1099511633891, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-3.c'}, {'damage_type': 'backtrace', 'id': 63739188, 'ino': 1099511632677, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/25-1.c'}, {'damage_type': 'backtrace', 'id': 64738496, 'ino': 1099511631888, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con_smi.h'}, {'damage_type': 'backtrace', 'id': 71271374, 'ino': 1099511632168, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_el.c'}, {'damage_type': 'backtrace', 'id': 72510404, 'ino': 1099511632101, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_annunciator.h'}, {'damage_type': 'backtrace', 'id': 73088634, 'ino': 1099511631857, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_domain.cpp'}, {'damage_type': 'backtrace', 'id': 75491167, 'ino': 1099511632141, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_injector.c'}, {'damage_type': 'backtrace', 'id': 80389055, 'ino': 1099511634123, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-8.c'}, {'damage_type': 'backtrace', 'id': 86961974, 'ino': 1099511632863, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/assertions.xml'}, {'damage_type': 'backtrace', 'id': 87074026, 'ino': 1099511632777, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/48-1.c'}, {'damage_type': 'backtrace', 'id': 87792692, 'ino': 1099511633743, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-89.c'}, {'damage_type': 'backtrace', 'id': 92761791, 'ino': 1099511633925, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-1.c'}, {'damage_type': 'backtrace', 'id': 106151803, 'ino': 1099511631889, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_utils.cpp'}, {'damage_type': 'backtrace', 'id': 109242840, 'ino': 1099511631832, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/ipmi_thres_test.c'}, {'damage_type': 'backtrace', 'id': 110045306, 'ino': 1099511633849, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-11.c'}, {'damage_type': 'backtrace', 'id': 110959580, 'ino': 1099511632688, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/35-2.c'}, {'damage_type': 'backtrace', 'id': 114232626, 'ino': 1099511631909, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con.cpp'}, {'damage_type': 'backtrace', 'id': 114550766, 'ino': 1099511632735, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/31-1.c'}, {'damage_type': 'backtrace', 'id': 123417474, 'ino': 1099511633972, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-17.c'}, {'damage_type': 'backtrace', 'id': 128935442, 'ino': 1099511631918, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_event.h'}, {'damage_type': 'backtrace', 'id': 129501298, 'ino': 1099511634162, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-13.c'}, {'damage_type': 'backtrace', 'id': 132386555, 'ino': 1099511632003, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/sim_resources.c'}, {'damage_type': 'backtrace', 'id': 142916149, 'ino': 1099511632638, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/4-1.c'}, {'damage_type': 'backtrace', 'id': 148563083, 'ino': 1099511632053, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsnmp_bc_getset.c'}, {'damage_type': 'backtrace', 'id': 149785335, 'ino': 1099511632648, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/24-1.c'}, {'damage_type': 'backtrace', 'id': 151709130, 'ino': 1099511631997, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/sim_file.c'}, {'damage_type': 'backtrace', 'id': 158063279, 'ino': 1099511632182, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_013.c'}, {'damage_type': 'backtrace', 'id': 161851472, 'ino': 1099511634023, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-20.c'}, {'damage_type': 'backtrace', 'id': 172890539, 'ino': 1099511632624, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/unistd_h/2-1.c'}, {'damage_type': 'backtrace', 'id': 182446541, 'ino': 1099511632228, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_037.c'}, {'damage_type': 'backtrace', 'id': 186046609, 'ino': 1099511634199, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/11-1.c'}, {'damage_type': 'backtrace', 'id': 191906293, 'ino': 1099511631899, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/array.h'}, {'damage_type': 'backtrace', 'id': 194292123, 'ino': 1099511634170, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-5.c'}, {'damage_type': 'backtrace', 'id': 197859930, 'ino': 1099511634188, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-5.c'}, {'damage_type': 'backtrace', 'id': 206140719, 'ino': 1099511631922, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t'}, {'damage_type': 'backtrace', 'id': 207457197, 'ino': 1099511633815, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-37.c'}, {'damage_type': 'backtrace', 'id': 207732118, 'ino': 1099511632767, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/49-1.c'}, {'damage_type': 'backtrace', 'id': 218348154, 'ino': 1099511631903, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sel.cpp'}, {'damage_type': 'backtrace', 'id': 232216448, 'ino': 1099511632164, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_hotswap.c'}, {'damage_type': 'backtrace', 'id': 235826801, 'ino': 1099511631951, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_hotswap.h'}, {'damage_type': 'backtrace', 'id': 243043129, 'ino': 1099511634044, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-8.c'}, {'damage_type': 'backtrace', 'id': 244230190, 'ino': 1099511632000, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset010.c'}, {'damage_type': 'backtrace', 'id': 245430495, 'ino': 1099511634217, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-13.c'}, {'damage_type': 'backtrace', 'id': 248814960, 'ino': 1099511632627, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h'}, {'damage_type': 'backtrace', 'id': 250392679, 'ino': 1099511632666, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/8-1.c'}, {'damage_type': 'backtrace', 'id': 250746357, 'ino': 1099511632193, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_018.c'}, {'damage_type': 'backtrace', 'id': 252232035, 'ino': 1099511634166, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-21.c'}, {'damage_type': 'backtrace', 'id': 258156979, 'ino': 1099511632630, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/10-1.c'}, {'damage_type': 'backtrace', 'id': 259871290, 'ino': 1099511632208, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_006.c'}, {'damage_type': 'backtrace', 'id': 270955611, 'ino': 1099511631973, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_resources_rsa.c'}, {'damage_type': 'backtrace', 'id': 276823329, 'ino': 1099511632852, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h'}, {'damage_type': 'backtrace', 'id': 277240546, 'ino': 1099511632840, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/17-1.c'}, {'damage_type': 'backtrace', 'id': 278341881, 'ino': 1099511632196, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_044.c'}, {'damage_type': 'backtrace', 'id': 290067550, 'ino': 1099511631966, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc.h'}, {'damage_type': 'backtrace', 'id': 290512184, 'ino': 1099511632847, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/1-1.c'}, {'damage_type': 'backtrace', 'id': 297570082, 'ino': 1099511633831, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-3.c'}, {'damage_type': 'backtrace', 'id': 299515966, 'ino': 1099511632775, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-37.c'}, {'damage_type': 'backtrace', 'id': 299657505, 'ino': 1099511632889, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/6-1.c'}, {'damage_type': 'backtrace', 'id': 301600258, 'ino': 1099511632741, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-27.c'}, {'damage_type': 'backtrace', 'id': 303485794, 'ino': 1099511632254, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_annunciator.c'}, {'damage_type': 'backtrace', 'id': 310080879, 'ino': 1099511633746, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-18.c'}, {'damage_type': 'backtrace', 'id': 315543412, 'ino': 1099511632013, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget016.c'}, {'damage_type': 'backtrace', 'id': 323023897, 'ino': 1099511633793, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-67.c'}, {'damage_type': 'backtrace', 'id': 324403374, 'ino': 1099511632839, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/11-1.c'}, {'damage_type': 'backtrace', 'id': 336115842, 'ino': 1099511633742, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-14.c'}, {'damage_type': 'backtrace', 'id': 338003230, 'ino': 1099511632023, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/snmp_utils.c'}, {'damage_type': 'backtrace', 'id': 348440545, 'ino': 1099511632153, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_controls.h'}, {'damage_type': 'backtrace', 'id': 352554818, 'ino': 1099511633892, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-13.c'}, {'damage_type': 'backtrace', 'id': 353142183, 'ino': 1099511633791, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-6.c'}, {'damage_type': 'backtrace', 'id': 354981749, 'ino': 1099511632236, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_watchdog.c'}, {'damage_type': 'backtrace', 'id': 357135045, 'ino': 1099511633745, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-48.c'}, {'damage_type': 'backtrace', 'id': 363906489, 'ino': 1099511633949, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-18.c'}, {'damage_type': 'backtrace', 'id': 368072027, 'ino': 1099511633882, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-26.c'}, {'damage_type': 'backtrace', 'id': 380424830, 'ino': 1099511632204, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_041.c'}, {'damage_type': 'backtrace', 'id': 383174411, 'ino': 1099511632717, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-2.c'}, {'damage_type': 'backtrace', 'id': 383388290, 'ino': 1099511631830, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_slot_rdrs.c'}, {'damage_type': 'backtrace', 'id': 384919773, 'ino': 1099511633991, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-26.c'}, {'damage_type': 'backtrace', 'id': 392467402, 'ino': 1099511631845, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con_smi.cpp'}, {'damage_type': 'backtrace', 'id': 395902921, 'ino': 1099511631819, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/posix_vlog.c'}, {'damage_type': 'backtrace', 'id': 397434866, 'ino': 1099511632759, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-12.c'}, {'damage_type': 'backtrace', 'id': 397736548, 'ino': 1099511631838, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/watchdog/watchdog.c'}, {'damage_type': 'backtrace', 'id': 400490852, 'ino': 1099511632147, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_sensors.c'}, {'damage_type': 'backtrace', 'id': 403520695, 'ino': 1099511632757, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-5.c'}, {'damage_type': 'backtrace', 'id': 404547891, 'ino': 1099511632221, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_038.c'}, {'damage_type': 'backtrace', 'id': 407362729, 'ino': 1099511631974, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/Makefile.in'}, {'damage_type': 'backtrace', 'id': 411058658, 'ino': 1099511633942, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-23.c'}, {'damage_type': 'backtrace', 'id': 415771109, 'ino': 1099511632914, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/2-3.c'}, {'damage_type': 'backtrace', 'id': 418502319, 'ino': 1099511631897, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sdr.h'}, {'damage_type': 'backtrace', 'id': 419359038, 'ino': 1099511632070, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_discover.c'}, {'damage_type': 'backtrace', 'id': 421869118, 'ino': 1099511632167, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_watchdog.h'}, {'damage_type': 'backtrace', 'id': 428185470, 'ino': 1099511632086, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_sel.c'}, {'damage_type': 'backtrace', 'id': 428490675, 'ino': 1099511633893, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-23.c'}, {'damage_type': 'backtrace', 'id': 431441285, 'ino': 1099511632136, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_idr.h'}, {'damage_type': 'backtrace', 'id': 433641678, 'ino': 1099511631950, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_utils.c'}, {'damage_type': 'backtrace', 'id': 439127129, 'ino': 1099511631946, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_annunciator.h'}, {'damage_type': 'backtrace', 'id': 439274729, 'ino': 1099511631836, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sensor.c'}, {'damage_type': 'backtrace', 'id': 439492761, 'ino': 1099511634106, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-7.c'}, {'damage_type': 'backtrace', 'id': 441709729, 'ino': 1099511632740, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-36.c'}, {'damage_type': 'backtrace', 'id': 443518694, 'ino': 1099511632730, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-25.c'}, {'damage_type': 'backtrace', 'id': 444629282, 'ino': 1099511632039, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel007.c'}, {'damage_type': 'backtrace', 'id': 444895004, 'ino': 1099511632242, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_utils.c'}, {'damage_type': 'backtrace', 'id': 445423037, 'ino': 1099511632701, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/3-1.c'}, {'damage_type': 'backtrace', 'id': 448517534, 'ino': 1099511631859, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_resource.h'}, {'damage_type': 'backtrace', 'id': 452364459, 'ino': 1099511631989, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset020.c'}, {'damage_type': 'backtrace', 'id': 459261782, 'ino': 1099511632027, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget034.c'}, {'damage_type': 'backtrace', 'id': 465621045, 'ino': 1099511632846, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/2-1.c'}, {'damage_type': 'backtrace', 'id': 465807005, 'ino': 1099511631996, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget013.c'}, {'damage_type': 'backtrace', 'id': 474977694, 'ino': 1099511631878, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_threshold.h'}, {'damage_type': 'backtrace', 'id': 475766285, 'ino': 1099511634028, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-7.c'}, {'damage_type': 'backtrace', 'id': 477767026, 'ino': 1099511632626, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/unistd_h/assertions.xml'}, {'damage_type': 'backtrace', 'id': 485740191, 'ino': 1099511632248, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_discover.c'}, {'damage_type': 'backtrace', 'id': 486114883, 'ino': 1099511633876, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-4.c'}, {'damage_type': 'backtrace', 'id': 503631481, 'ino': 1099511633973, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-24.c'}, {'damage_type': 'backtrace', 'id': 504430519, 'ino': 1099511632874, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/8-3.c'}, {'damage_type': 'backtrace', 'id': 510787501, 'ino': 1099511632211, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_010.c'}, {'damage_type': 'backtrace', 'id': 512955302, 'ino': 1099511633862, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-3.c'}, {'damage_type': 'backtrace', 'id': 513564757, 'ino': 1099511634224, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-14.c'}, {'damage_type': 'backtrace', 'id': 513984616, 'ino': 1099511632157, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_fumi.h'}, {'damage_type': 'backtrace', 'id': 514937761, 'ino': 1099511631885, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con_lan.cpp'}, {'damage_type': 'backtrace', 'id': 518163121, 'ino': 1099511632178, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_injector.h'}, {'damage_type': 'backtrace', 'id': 525858959, 'ino': 1099511631898, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor.cpp'}, {'damage_type': 'backtrace', 'id': 526253247, 'ino': 1099511631817, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_drv.c'}, {'damage_type': 'backtrace', 'id': 530104535, 'ino': 1099511631965, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_control.h'}, {'damage_type': 'backtrace', 'id': 535286734, 'ino': 1099511633971, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-36.c'}, {'damage_type': 'backtrace', 'id': 535762494, 'ino': 1099511632905, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/22-1.c'}, {'damage_type': 'backtrace', 'id': 538129111, 'ino': 1099511632014, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget004.c'}, {'damage_type': 'backtrace', 'id': 550542694, 'ino': 1099511631884, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control.cpp'}, {'damage_type': 'backtrace', 'id': 567111273, 'ino': 1099511631998, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv004.c'}, {'damage_type': 'backtrace', 'id': 568973399, 'ino': 1099511634151, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-32.c'}, {'damage_type': 'backtrace', 'id': 581326184, 'ino': 1099511633781, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-5.c'}, {'damage_type': 'backtrace', 'id': 584084482, 'ino': 1099511634203, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-6.c'}, {'damage_type': 'backtrace', 'id': 584287592, 'ino': 1099511633704, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-3.c'}, {'damage_type': 'backtrace', 'id': 594649656, 'ino': 1099511632063, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_re_discover.h'}, {'damage_type': 'backtrace', 'id': 597678390, 'ino': 1099511634149, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-14.c'}, {'damage_type': 'backtrace', 'id': 598948843, 'ino': 1099511632718, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/coverage.txt'}, {'damage_type': 'backtrace', 'id': 599406266, 'ino': 1099511632100, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_load_id.h'}, {'damage_type': 'backtrace', 'id': 608901867, 'ino': 1099511633783, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-7.c'}, {'damage_type': 'backtrace', 'id': 610724312, 'ino': 1099511631855, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sel.h'}, {'damage_type': 'backtrace', 'id': 611382661, 'ino': 1099511632161, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_annunciator_func.c'}, {'damage_type': 'backtrace', 'id': 611462333, 'ino': 1099511631984, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget033.c'}, {'damage_type': 'backtrace', 'id': 612774951, 'ino': 1099511631863, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_discover.h'}, {'damage_type': 'backtrace', 'id': 613572785, 'ino': 1099511632636, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/assertions.xml'}, {'damage_type': 'backtrace', 'id': 614047918, 'ino': 1099511632134, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_sensor.h'}, {'damage_type': 'backtrace', 'id': 616411031, 'ino': 1099511632654, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/28-1.c'}, {'damage_type': 'backtrace', 'id': 617366618, 'ino': 1099511632903, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/2-4.c'}, {'damage_type': 'backtrace', 'id': 625629189, 'ino': 1099511632229, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/Makefile.am'}, {'damage_type': 'backtrace', 'id': 625869697, 'ino': 1099511634096, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-33.c'}, {'damage_type': 'backtrace', 'id': 645090647, 'ino': 1099511634306, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-13.c'}, {'damage_type': 'backtrace', 'id': 655872491, 'ino': 1099511631882, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/thread.h'}, {'damage_type': 'backtrace', 'id': 657288262, 'ino': 1099511632899, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/7-1.c'}, {'damage_type': 'backtrace', 'id': 658889728, 'ino': 1099511634223, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-11.c'}, {'damage_type': 'backtrace', 'id': 661876759, 'ino': 1099511632067, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_calls.h'}, {'damage_type': 'backtrace', 'id': 663412741, 'ino': 1099511632184, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_024.c'}, {'damage_type': 'backtrace', 'id': 667197155, 'ino': 1099511632213, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_004.c'}, {'damage_type': 'backtrace', 'id': 671883960, 'ino': 1099511632855, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/10-1.c'}, {'damage_type': 'backtrace', 'id': 678599349, 'ino': 1099511632716, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/24-1.c'}, {'damage_type': 'backtrace', 'id': 684693544, 'ino': 1099511632828, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/12-1.c'}, {'damage_type': 'backtrace', 'id': 688273014, 'ino': 1099511632818, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-12.c'}, {'damage_type': 'backtrace', 'id': 691144454, 'ino': 1099511632049, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsptime002.c'}, {'damage_type': 'backtrace', 'id': 707450138, 'ino': 1099511632148, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_reset.c'}, {'damage_type': 'backtrace', 'id': 711032636, 'ino': 1099511632907, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/8-2.c'}, {'damage_type': 'backtrace', 'id': 713603912, 'ino': 1099511631992, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel004.c'}, {'damage_type': 'backtrace', 'id': 714205835, 'ino': 1099511632703, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-38.c'}, {'damage_type': 'backtrace', 'id': 716848409, 'ino': 1099511631861, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_inventory.cpp'}, {'damage_type': 'backtrace', 'id': 716956163, 'ino': 1099511631934, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc.c'}, {'damage_type': 'backtrace', 'id': 725852633, 'ino': 1099511632235, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_inventory.h'}, {'damage_type': 'backtrace', 'id': 738483779, 'ino': 1099511634246, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-14.c'}, {'damage_type': 'backtrace', 'id': 741907832, 'ino': 1099511633947, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-13.c'}, {'damage_type': 'backtrace', 'id': 747175692, 'ino': 1099511633980, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-12.c'}, {'damage_type': 'backtrace', 'id': 747587086, 'ino': 1099511632761, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-7.c'}, {'damage_type': 'backtrace', 'id': 753517234, 'ino': 1099511632170, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/Makefile.in'}, {'damage_type': 'backtrace', 'id': 760004980, 'ino': 1099511631814, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_inventory.c'}, {'damage_type': 'backtrace', 'id': 762076467, 'ino': 1099511632004, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsetup.h'}, {'damage_type': 'backtrace', 'id': 782017891, 'ino': 1099511632035, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget035.c'}, {'damage_type': 'backtrace', 'id': 782031619, 'ino': 1099511632083, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_watchdog.h'}, {'damage_type': 'backtrace', 'id': 791213704, 'ino': 1099511634134, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-12.c'}, {'damage_type': 'backtrace', 'id': 792429802, 'ino': 1099511631847, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_fan.cpp'}, {'damage_type': 'backtrace', 'id': 803784030, 'ino': 1099511632047, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset022.c'}, {'damage_type': 'backtrace', 'id': 805402823, 'ino': 1099511633757, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-45.c'}, {'damage_type': 'backtrace', 'id': 807204719, 'ino': 1099511631835, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/Makefile.am'}, {'damage_type': 'backtrace', 'id': 815900716, 'ino': 1099511634035, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-7.c'}, {'damage_type': 'backtrace', 'id': 818183612, 'ino': 1099511633865, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-87.c'}, {'damage_type': 'backtrace', 'id': 826123561, 'ino': 1099511632223, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_032.c'}, {'damage_type': 'backtrace', 'id': 827859753, 'ino': 1099511632189, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_042.c'}, {'damage_type': 'backtrace', 'id': 829388836, 'ino': 1099511632197, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/openhpi.conf'}, {'damage_type': 'backtrace', 'id': 829579815, 'ino': 1099511631895, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_fix_sdr.cpp'}, {'damage_type': 'backtrace', 'id': 830903347, 'ino': 1099511632209, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_043.c'}, {'damage_type': 'backtrace', 'id': 832580883, 'ino': 1099511634087, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-20.c'}, {'damage_type': 'backtrace', 'id': 838331873, 'ino': 1099511632142, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_init.c'}, {'damage_type': 'backtrace', 'id': 838393884, 'ino': 1099511632111, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_control.c'}, {'damage_type': 'backtrace', 'id': 839856500, 'ino': 1099511632231, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas.c'}, {'damage_type': 'backtrace', 'id': 841026595, 'ino': 1099511632732, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/42-1.c'}, {'damage_type': 'backtrace', 'id': 845093480, 'ino': 1099511634214, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-24.c'}, {'damage_type': 'backtrace', 'id': 845407521, 'ino': 1099511632191, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_045.c'}, {'damage_type': 'backtrace', 'id': 847026706, 'ino': 1099511632020, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel003.c'}, {'damage_type': 'backtrace', 'id': 848269181, 'ino': 1099511632634, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/1-1.c'}, {'damage_type': 'backtrace', 'id': 850166297, 'ino': 1099511631860, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_factors.h'}, {'damage_type': 'backtrace', 'id': 851303358, 'ino': 1099511632867, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/2-2.c'}, {'damage_type': 'backtrace', 'id': 851439257, 'ino': 1099511632808, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h'}, {'damage_type': 'backtrace', 'id': 866053591, 'ino': 1099511632143, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_dimi_func.c'}, {'damage_type': 'backtrace', 'id': 866483656, 'ino': 1099511633939, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-17.c'}, {'damage_type': 'backtrace', 'id': 871455079, 'ino': 1099511632913, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/7-3.c'}, {'damage_type': 'backtrace', 'id': 873984298, 'ino': 1099511632836, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/4-1.c'}, {'damage_type': 'backtrace', 'id': 874338301, 'ino': 1099511634059, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-16.c'}, {'damage_type': 'backtrace', 'id': 876262180, 'ino': 1099511632814, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/coverage.txt'}, {'damage_type': 'backtrace', 'id': 876661418, 'ino': 1099511632649, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/6-2.c'}, {'damage_type': 'backtrace', 'id': 876713066, 'ino': 1099511631874, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_msg.cpp'}, {'damage_type': 'backtrace', 'id': 891406239, 'ino': 1099511631826, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/Makefile.in'}, {'damage_type': 'backtrace', 'id': 897251827, 'ino': 1099511632876, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/9-1.c'}, {'damage_type': 'backtrace', 'id': 901200984, 'ino': 1099511632214, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/Makefile.in'}, {'damage_type': 'backtrace', 'id': 907944963, 'ino': 1099511631926, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/sensor_factors_000.cpp'}, {'damage_type': 'backtrace', 'id': 916097539, 'ino': 1099511632851, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys'}, {'damage_type': 'backtrace', 'id': 918916390, 'ino': 1099511632103, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_event.h'}, {'damage_type': 'backtrace', 'id': 922698856, 'ino': 1099511632085, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap.c'}, {'damage_type': 'backtrace', 'id': 935825759, 'ino': 1099511632037, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/sim_test_file'}, {'damage_type': 'backtrace', 'id': 936035585, 'ino': 1099511632160, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_init.h'}, {'damage_type': 'backtrace', 'id': 937038156, 'ino': 1099511631834, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/Makefile.am'}, {'damage_type': 'backtrace', 'id': 943011985, 'ino': 1099511632820, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/6-1.c'}, {'damage_type': 'backtrace', 'id': 946622572, 'ino': 1099511634173, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-19.c'}, {'damage_type': 'backtrace', 'id': 952565490, 'ino': 1099511632838, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/16-1.c'}, {'damage_type': 'backtrace', 'id': 968180029, 'ino': 1099511631905, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con_lan.h'}, {'damage_type': 'backtrace', 'id': 974655807, 'ino': 1099511633749, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-20.c'}, {'damage_type': 'backtrace', 'id': 974734088, 'ino': 1099511632155, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_dimi_func.h'}, {'damage_type': 'backtrace', 'id': 976592414, 'ino': 1099511632203, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_005.c'}, {'damage_type': 'backtrace', 'id': 981059973, 'ino': 1099511632036, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/thotswap-mhs001.c'}, {'damage_type': 'backtrace', 'id': 984231239, 'ino': 1099511632016, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv002.c'}, {'damage_type': 'backtrace', 'id': 992040805, 'ino': 1099511631883, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_rdr.cpp'}, {'damage_type': 'backtrace', 'id': 994368763, 'ino': 1099511631886, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_discrete.h'}, {'damage_type': 'backtrace', 'id': 995821994, 'ino': 1099511632726, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/14-1.c'}, {'damage_type': 'backtrace', 'id': 1000840683, 'ino': 1099511634204, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-13.c'}, {'damage_type': 'backtrace', 'id': 1014569755, 'ino': 1099511631979, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_event.c'}, {'damage_type': 'backtrace', 'id': 1022549745, 'ino': 1099511632044, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset007.c'}, {'damage_type': 'backtrace', 'id': 1026713962, 'ino': 1099511632773, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/36-1.c'}, {'damage_type': 'backtrace', 'id': 1028899374, 'ino': 1099511634027, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-16.c'}, {'damage_type': 'backtrace', 'id': 1031502091, 'ino': 1099511634222, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-20.c'}, {'damage_type': 'backtrace', 'id': 1031845238, 'ino': 1099511634210, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-9.c'}, {'damage_type': 'backtrace', 'id': 1040896670, 'ino': 1099511632645, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/10-1.c'}, {'damage_type': 'backtrace', 'id': 1044344430, 'ino': 1099511632670, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/7-1.c'}, {'damage_type': 'backtrace', 'id': 1049017548, 'ino': 1099511634116, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-17.c'}, {'damage_type': 'backtrace', 'id': 1049401961, 'ino': 1099511632078, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_load_id.c'}, {'damage_type': 'backtrace', 'id': 1049479775, 'ino': 1099511631991, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget003.c'}, {'damage_type': 'backtrace', 'id': 1050757348, 'ino': 1099511632249, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_resource.c'}, {'damage_type': 'backtrace', 'id': 1061665138, 'ino': 1099511632158, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_dimi.c'}, {'damage_type': 'backtrace', 'id': 1063563098, 'ino': 1099511634249, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-16.c'}, {'damage_type': 'backtrace', 'id': 1064852038, 'ino': 1099511634017, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-12.c'}, {'damage_type': 'backtrace', 'id': 1067997626, 'ino': 1099511631850, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_rdr.h'}, {'damage_type': 'backtrace', 'id': 1068367139, 'ino': 1099511632792, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/18-1.c'}, {'damage_type': 'backtrace', 'id': 1069412401, 'ino': 1099511632246, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_sensor.h'}, {'damage_type': 'backtrace', 'id': 1072021446, 'ino': 1099511632232, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_sensor.c'}, {'damage_type': 'backtrace', 'id': 1080845971, 'ino': 1099511634153, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-13.c'}, {'damage_type': 'backtrace', 'id': 1081789439, 'ino': 1099511632848, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/assertions.xml'}, {'damage_type': 'backtrace', 'id': 1090397604, 'ino': 1099511634215, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-9.c'}, {'damage_type': 'backtrace', 'id': 1093391105, 'ino': 1099511634016, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-6.c'}, {'damage_type': 'backtrace', 'id': 1105458316, 'ino': 1099511634231, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-21.c'}, {'damage_type': 'backtrace', 'id': 1107966794, 'ino': 1099511632798, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/8-1.c'}, {'damage_type': 'backtrace', 'id': 1108548395, 'ino': 1099511632090, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_hotswap.h'}, {'damage_type': 'backtrace', 'id': 1111281521, 'ino': 1099511631877, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc.h'}, {'damage_type': 'backtrace', 'id': 1112034492, 'ino': 1099511631928, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/Makefile.in'}, {'damage_type': 'backtrace', 'id': 1114052232, 'ino': 1099511632708, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/39-1.c'}, {'damage_type': 'backtrace', 'id': 1114413547, 'ino': 1099511633840, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-102.c'}, {'damage_type': 'backtrace', 'id': 1125913399, 'ino': 1099511633703, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-16.c'}, {'damage_type': 'backtrace', 'id': 1129549966, 'ino': 1099511631910, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/thread.cpp'}, {'damage_type': 'backtrace', 'id': 1134657164, 'ino': 1099511633884, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-9.c'}, {'damage_type': 'backtrace', 'id': 1138283969, 'ino': 1099511632734, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/32-1.c'}, {'damage_type': 'backtrace', 'id': 1144312117, 'ino': 1099511631988, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv003.c'}, {'damage_type': 'backtrace', 'id': 1153133749, 'ino': 1099511631982, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget031.c'}, {'damage_type': 'backtrace', 'id': 1154364361, 'ino': 1099511632097, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_server_event.c'}, {'damage_type': 'backtrace', 'id': 1155529353, 'ino': 1099511632893, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/7-5.c'}, {'damage_type': 'backtrace', 'id': 1156588749, 'ino': 1099511632747, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-33.c'}, {'damage_type': 'backtrace', 'id': 1159077598, 'ino': 1099511632875, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/3-1.c'}, {'damage_type': 'backtrace', 'id': 1166073362, 'ino': 1099511632823, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/10.c'}, {'damage_type': 'backtrace', 'id': 1172774374, 'ino': 1099511632146, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_control_func.h'}, {'damage_type': 'backtrace', 'id': 1176390193, 'ino': 1099511632076, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_lcd_event.c'}, {'damage_type': 'backtrace', 'id': 1177094377, 'ino': 1099511631927, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/con_001.c'}, {'damage_type': 'backtrace', 'id': 1188353752, 'ino': 1099511632655, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/14-1.c'}, {'damage_type': 'backtrace', 'id': 1196743525, 'ino': 1099511632195, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_026.c'}, {'damage_type': 'backtrace', 'id': 1197861089, 'ino': 1099511632010, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel002.c'}, {'damage_type': 'backtrace', 'id': 1203304104, 'ino': 1099511632092, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_oa_event.h'}, {'damage_type': 'backtrace', 'id': 1204124976, 'ino': 1099511632641, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/27-1.c'}, {'damage_type': 'backtrace', 'id': 1205426799, 'ino': 1099511632869, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/11-1.c'}, {'damage_type': 'backtrace', 'id': 1207563683, 'ino': 1099511632817, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/2-1.c'}, {'damage_type': 'backtrace', 'id': 1207667843, 'ino': 1099511632878, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/4-2.c'}, {'damage_type': 'backtrace', 'id': 1208141519, 'ino': 1099511632200, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_029.c'}, {'damage_type': 'backtrace', 'id': 1218091904, 'ino': 1099511632769, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/26-1.c'}, {'damage_type': 'backtrace', 'id': 1219750526, 'ino': 1099511632821, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/1-1.c'}, {'damage_type': 'backtrace', 'id': 1226072016, 'ino': 1099511634043, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-14.c'}, {'damage_type': 'backtrace', 'id': 1231336836, 'ino': 1099511631824, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_mc_event.c'}, {'damage_type': 'backtrace', 'id': 1233053551, 'ino': 1099511631916, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_sun_led.h'}, {'damage_type': 'backtrace', 'id': 1241982158, 'ino': 1099511632156, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_resources.h'}, {'damage_type': 'backtrace', 'id': 1242253229, 'ino': 1099511632709, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-35.c'}, {'damage_type': 'backtrace', 'id': 1249003408, 'ino': 1099511632152, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_annunciators.c'}, {'damage_type': 'backtrace', 'id': 1249856109, 'ino': 1099511632163, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_inventory.h'}, {'damage_type': 'backtrace', 'id': 1250671838, 'ino': 1099511632637, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/7-1.c'}, {'damage_type': 'backtrace', 'id': 1254036559, 'ino': 1099511632050, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv001.c'}, {'damage_type': 'backtrace', 'id': 1263310275, 'ino': 1099511632843, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-2.c'}, {'damage_type': 'backtrace', 'id': 1279170263, 'ino': 1099511632776, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/30-1.c'}, {'damage_type': 'backtrace', 'id': 1289205140, 'ino': 1099511631868, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_inventory_parser.h'}, {'damage_type': 'backtrace', 'id': 1296361592, 'ino': 1099511634001, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/README'}, {'damage_type': 'backtrace', 'id': 1303701912, 'ino': 1099511631919, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_factors.cpp'}, {'damage_type': 'backtrace', 'id': 1309322207, 'ino': 1099511631980, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t'}, {'damage_type': 'backtrace', 'id': 1309401856, 'ino': 1099511633854, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-17.c'}, {'damage_type': 'backtrace', 'id': 1311972259, 'ino': 1099511632790, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/19-1.c'}, {'damage_type': 'backtrace', 'id': 1316340073, 'ino': 1099511632745, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/46-1.c'}, {'damage_type': 'backtrace', 'id': 1317459977, 'ino': 1099511632722, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/make22tests'}, {'damage_type': 'backtrace', 'id': 1317477361, 'ino': 1099511631983, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tdiscover001.c'}, {'damage_type': 'backtrace', 'id': 1317534772, 'ino': 1099511632080, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_interconnect_event.c'}, {'damage_type': 'backtrace', 'id': 1323329042, 'ino': 1099511632770, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/4-1.c'}, {'damage_type': 'backtrace', 'id': 1325334837, 'ino': 1099511634165, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-17.c'}, {'damage_type': 'backtrace', 'id': 1327896886, 'ino': 1099511632169, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_resources2.c'}, {'damage_type': 'backtrace', 'id': 1332177896, 'ino': 1099511631823, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sel.c'}, {'damage_type': 'backtrace', 'id': 1346189145, 'ino': 1099511632689, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h'}, {'damage_type': 'backtrace', 'id': 1346952247, 'ino': 1099511631911, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_intel.h'}, {'damage_type': 'backtrace', 'id': 1348815371, 'ino': 1099511631995, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset004.c'}, {'damage_type': 'backtrace', 'id': 1351736431, 'ino': 1099511632885, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/18-1.c'}, {'damage_type': 'backtrace', 'id': 1362919150, 'ino': 1099511633898, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-3.c'}, {'damage_type': 'backtrace', 'id': 1384574714, 'ino': 1099511632697, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-9.c'}, {'damage_type': 'backtrace', 'id': 1385689529, 'ino': 1099511631896, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_event.cpp'}, {'damage_type': 'backtrace', 'id': 1387265102, 'ino': 1099511632850, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/3-2.c'}, {'damage_type': 'backtrace', 'id': 1387483756, 'ino': 1099511632054, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel006.c'}, {'damage_type': 'backtrace', 'id': 1388094697, 'ino': 1099511631967, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_discover.c'}, {'damage_type': 'backtrace', 'id': 1392127756, 'ino': 1099511631929, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/Makefile.am'}, {'damage_type': 'backtrace', 'id': 1395741688, 'ino': 1099511633860, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-2.c'}, {'damage_type': 'backtrace', 'id': 1400915324, 'ino': 1099511633922, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/testfrmw.h'}, {'damage_type': 'backtrace', 'id': 1414440584, 'ino': 1099511633847, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-16.c'}, {'damage_type': 'backtrace', 'id': 1417558840, 'ino': 1099511634250, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-2.c'}, {'damage_type': 'backtrace', 'id': 1428356719, 'ino': 1099511632750, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/38-1.c'}, {'damage_type': 'backtrace', 'id': 1428640456, 'ino': 1099511634190, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-73.c'}, {'damage_type': 'backtrace', 'id': 1429535517, 'ino': 1099511631993, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset017.c'}, {'damage_type': 'backtrace', 'id': 1430295876, 'ino': 1099511631833, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/Makefile.in'}, {'damage_type': 'backtrace', 'id': 1432202022, 'ino': 1099511632088, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_re_discover.c'}, {'damage_type': 'backtrace', 'id': 1434884840, 'ino': 1099511631822, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_entity.c'}, {'damage_type': 'backtrace', 'id': 1438014001, 'ino': 1099511631840, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/watchdog/Makefile.in'}, {'damage_type': 'backtrace', 'id': 1463099424, 'ino': 1099511632109, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_dimi.c'}, {'damage_type': 'backtrace', 'id': 1473043557, 'ino': 1099511632713, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-14.c'}, {'damage_type': 'backtrace', 'id': 1480316288, 'ino': 1099511634045, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-95.c'}, {'damage_type': 'backtrace', 'id': 1485580058, 'ino': 1099511634206, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-11.c'}, {'damage_type': 'backtrace', 'id': 1489390057, 'ino': 1099511632787, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/8-3.c'}, {'damage_type': 'backtrace', 'id': 1489738211, 'ino': 1099511632816, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/14-1.c'}, {'damage_type': 'backtrace', 'id': 1492808482, 'ino': 1099511634142, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-11.c'}, {'damage_type': 'backtrace', 'id': 1495442835, 'ino': 1099511632190, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_033.c'}, {'damage_type': 'backtrace', 'id': 1498021618, 'ino': 1099511631816, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/sync.c'}, {'damage_type': 'backtrace', 'id': 1500964507, 'ino': 1099511632699, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/27-1.c'}, {'damage_type': 'backtrace', 'id': 1505409540, 'ino': 1099511632714, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/23-1.c'}, {'damage_type': 'backtrace', 'id': 1509853354, 'ino': 1099511634181, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-15.c'}, {'damage_type': 'backtrace', 'id': 1511137456, 'ino': 1099511632805, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/16-1.c'}, {'damage_type': 'backtrace', 'id': 1512386044, 'ino': 1099511634109, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-19.c'}, {'damage_type': 'backtrace', 'id': 1521863689, 'ino': 1099511632186, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_008.c'}, {'damage_type': 'backtrace', 'id': 1525628056, 'ino': 1099511632030, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/Makefile.in'}, {'damage_type': 'backtrace', 'id': 1531997668, 'ino': 1099511631985, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/sim_init.c'}, {'damage_type': 'backtrace', 'id': 1532368299, 'ino': 1099511632733, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-17.c'}, {'damage_type': 'backtrace', 'id': 1532395080, 'ino': 1099511632104, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_inventory.c'}, {'damage_type': 'backtrace', 'id': 1536786401, 'ino': 1099511632058, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset024.c'}, {'damage_type': 'backtrace', 'id': 1542252397, 'ino': 1099511634213, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-10.c'}, {'damage_type': 'backtrace', 'id': 1546697547, 'ino': 1099511632149, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_power.h'}, {'damage_type': 'backtrace', 'id': 1549051975, 'ino': 1099511632766, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-1.c'}, {'damage_type': 'backtrace', 'id': 1557008299, 'ino': 1099511632128, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_ssl.h'}, {'damage_type': 'backtrace', 'id': 1557070098, 'ino': 1099511631839, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/watchdog/README'}, {'damage_type': 'backtrace', 'id': 1559734411, 'ino': 1099511631920, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_auth.h'}, {'damage_type': 'backtrace', 'id': 1568997910, 'ino': 1099511632071, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_reset.h'}, {'damage_type': 'backtrace', 'id': 1581249046, 'ino': 1099511632660, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/32-1.c'}, {'damage_type': 'backtrace', 'id': 1585667229, 'ino': 1099511632255, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_control.h'}, {'damage_type': 'backtrace', 'id': 1590171473, 'ino': 1099511632028, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/thotswap-simple001.c'}, {'damage_type': 'backtrace', 'id': 1590751596, 'ino': 1099511633850, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-6.c'}, {'damage_type': 'backtrace', 'id': 1596851684, 'ino': 1099511633778, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-15.c'}, {'damage_type': 'backtrace', 'id': 1605564279, 'ino': 1099511632812, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-5.c'}, {'damage_type': 'backtrace', 'id': 1606199615, 'ino': 1099511632884, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/coverage.txt'}, {'damage_type': 'backtrace', 'id': 1606747524, 'ino': 1099511632165, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_sensor_func.c'}, {'damage_type': 'backtrace', 'id': 1611579182, 'ino': 1099511632723, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/33-1.c'}, {'damage_type': 'backtrace', 'id': 1616659308, 'ino': 1099511632760, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/2-2.c'}, {'damage_type': 'backtrace', 'id': 1623779845, 'ino': 1099511632024, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset008.c'}, {'damage_type': 'backtrace', 'id': 1624404267, 'ino': 1099511631904, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/Makefile.in'}, {'damage_type': 'backtrace', 'id': 1630291086, 'ino': 1099511632015, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel005.c'}, {'damage_type': 'backtrace', 'id': 1634965057, 'ino': 1099511632811, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/20-1.c'}, {'damage_type': 'backtrace', 'id': 1641447186, 'ino': 1099511634029, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-18.c'}, {'damage_type': 'backtrace', 'id': 1644161157, 'ino': 1099511634195, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-19.c'}, {'damage_type': 'backtrace', 'id': 1649345852, 'ino': 1099511632038, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsim_file.c'}, {'damage_type': 'backtrace', 'id': 1650721945, 'ino': 1099511632781, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-39.c'}, {'damage_type': 'backtrace', 'id': 1651512271, 'ino': 1099511632898, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/12-1.c'}, {'damage_type': 'backtrace', 'id': 1654378135, 'ino': 1099511632098, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_utils.h'}, {'damage_type': 'backtrace', 'id': 1658652306, 'ino': 1099511632837, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-4.c'}, {'damage_type': 'backtrace', 'id': 1663309929, 'ino': 1099511632832, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-8.c'}, {'damage_type': 'backtrace', 'id': 1667837781, 'ino': 1099511631960, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_resources.c'}, {'damage_type': 'backtrace', 'id': 1671111158, 'ino': 1099511632724, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/28-1.c'}, {'damage_type': 'backtrace', 'id': 1674516033, 'ino': 1099511632859, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/6-1.c'}, {'damage_type': 'backtrace', 'id': 1674562724, 'ino': 1099511631807, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_close.c'}, {'damage_type': 'backtrace', 'id': 1685550513, 'ino': 1099511633950, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-9.c'}, {'damage_type': 'backtrace', 'id': 1686941271, 'ino': 1099511634056, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-23.c'}, {'damage_type': 'backtrace', 'id': 1694702203, 'ino': 1099511631870, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_fru_info.cpp'}, {'damage_type': 'backtrace', 'id': 1696471171, 'ino': 1099511632068, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_server_event.h'}, {'damage_type': 'backtrace', 'id': 1702875773, 'ino': 1099511632721, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/18-1.c'}, {'damage_type': 'backtrace', 'id': 1704502806, 'ino': 1099511632665, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/35-1.c'}, {'damage_type': 'backtrace', 'id': 1716144110, 'ino': 1099511633788, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-23.c'}, {'damage_type': 'backtrace', 'id': 1722187428, 'ino': 1099511633754, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-7.c'}, {'damage_type': 'backtrace', 'id': 1723926949, 'ino': 1099511632130, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_cmnds.h'}, {'damage_type': 'backtrace', 'id': 1724718025, 'ino': 1099511632159, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_control_func.c'}, {'damage_type': 'backtrace', 'id': 1731560918, 'ino': 1099511632075, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_fumi.h'}, {'damage_type': 'backtrace', 'id': 1735701182, 'ino': 1099511632241, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_discover.h'}, {'damage_type': 'backtrace', 'id': 1739511860, 'ino': 1099511632783, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-23.c'}, {'damage_type': 'backtrace', 'id': 1744202281, 'ino': 1099511632012, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset023.c'}, {'damage_type': 'backtrace', 'id': 1745237180, 'ino': 1099511634148, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-3.c'}, {'damage_type': 'backtrace', 'id': 1745349233, 'ino': 1099511632786, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h'}, {'damage_type': 'backtrace', 'id': 1748187465, 'ino': 1099511631917, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_cmd.h'}, {'damage_type': 'backtrace', 'id': 1750658886, 'ino': 1099511631930, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_force.h'}, {'damage_type': 'backtrace', 'id': 1751966802, 'ino': 1099511632264, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/sysfs/README'}, {'damage_type': 'backtrace', 'id': 1764868610, 'ino': 1099511632736, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/15-1.c'}, {'damage_type': 'backtrace', 'id': 1766872039, 'ino': 1099511632205, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_020.c'}, {'damage_type': 'backtrace', 'id': 1773572993, 'ino': 1099511631942, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_plugin.h'}, {'damage_type': 'backtrace', 'id': 1775333002, 'ino': 1099511632138, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/Makefile.am'}, {'damage_type': 'backtrace', 'id': 1775566225, 'ino': 1099511632652, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/35-3.c'}, {'damage_type': 'backtrace', 'id': 1776309640, 'ino': 1099511633959, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-8.c'}, {'damage_type': 'backtrace', 'id': 1789704311, 'ino': 1099511632122, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_sensor.c'}, {'damage_type': 'backtrace', 'id': 1790094843, 'ino': 1099511632827, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/assertions.xml'}, {'damage_type': 'backtrace', 'id': 1791179353, 'ino': 1099511634227, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-64.c'}, {'damage_type': 'backtrace', 'id': 1799275334, 'ino': 1099511634187, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-23.c'}, {'damage_type': 'backtrace', 'id': 1805261189, 'ino': 1099511633769, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-5.c'}, {'damage_type': 'backtrace', 'id': 1821040097, 'ino': 1099511632799, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/assertions.xml'}, {'damage_type': 'backtrace', 'id': 1831470687, 'ino': 1099511632696, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h'}, {'damage_type': 'backtrace', 'id': 1836195628, 'ino': 1099511632084, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_ps_event.c'}, {'damage_type': 'backtrace', 'id': 1852274731, 'ino': 1099511632909, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/11-1.c'}, {'damage_type': 'backtrace', 'id': 1863514031, 'ino': 1099511632175, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_watchdog.c'}, {'damage_type': 'backtrace', 'id': 1871295512, 'ino': 1099511631941, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_watchdog.c'}, {'damage_type': 'backtrace', 'id': 1872985187, 'ino': 1099511632881, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/23-1.c'}, {'damage_type': 'backtrace', 'id': 1889667293, 'ino': 1099511634075, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-7.c'}, {'damage_type': 'backtrace', 'id': 1893024882, 'ino': 1099511632715, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/19-1.c'}, {'damage_type': 'backtrace', 'id': 1903838880, 'ino': 1099511633748, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-20.c'}, {'damage_type': 'backtrace', 'id': 1909875908, 'ino': 1099511631981, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tcontrol001.c'}, {'damage_type': 'backtrace', 'id': 1909909894, 'ino': 1099511633856, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-16.c'}, {'damage_type': 'backtrace', 'id': 1915887455, 'ino': 1099511631851, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sdr.cpp'}, {'damage_type': 'backtrace', 'id': 1922782395, 'ino': 1099511633917, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-23.c'}, {'damage_type': 'backtrace', 'id': 1925728712, 'ino': 1099511632793, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/8-4.c'}, {'damage_type': 'backtrace', 'id': 1928685330, 'ino': 1099511632061, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/Makefile.am'}, {'damage_type': 'backtrace', 'id': 1935289842, 'ino': 1099511632043, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset018.c'}, {'damage_type': 'backtrace', 'id': 1936228155, 'ino': 1099511631867, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_con.h'}, {'damage_type': 'backtrace', 'id': 1936515624, 'ino': 1099511632066, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_enclosure_event.h'}, {'damage_type': 'backtrace', 'id': 1942758516, 'ino': 1099511633920, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-25.c'}, {'damage_type': 'backtrace', 'id': 1943739276, 'ino': 1099511632181, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_036.c'}, {'damage_type': 'backtrace', 'id': 1943920902, 'ino': 1099511631935, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_inventory.h'}, {'damage_type': 'backtrace', 'id': 1950280911, 'ino': 1099511634018, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-58.c'}, {'damage_type': 'backtrace', 'id': 1951014945, 'ino': 1099511631880, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor.h'}, {'damage_type': 'backtrace', 'id': 1957776009, 'ino': 1099511632220, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_009.c'}, {'damage_type': 'backtrace', 'id': 1963092115, 'ino': 1099511633952, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-23.c'}, {'damage_type': 'backtrace', 'id': 1964939747, 'ino': 1099511632897, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/assertions.xml'}, {'damage_type': 'backtrace', 'id': 1968222541, 'ino': 1099511632225, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_023.c'}, {'damage_type': 'backtrace', 'id': 1974642356, 'ino': 1099511634137, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-15.c'}, {'damage_type': 'backtrace', 'id': 1980104701, 'ino': 1099511632779, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-13.c'}, {'damage_type': 'backtrace', 'id': 1982720831, 'ino': 1099511633954, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-23.c'}, {'damage_type': 'backtrace', 'id': 1982975110, 'ino': 1099511632125, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_xml.h'}, {'damage_type': 'backtrace', 'id': 1984927926, 'ino': 1099511632267, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/sysfs/Makefile.am'}, {'damage_type': 'backtrace', 'id': 1987795630, 'ino': 1099511632694, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/assertions.xml'}, {'damage_type': 'backtrace', 'id': 1999103087, 'ino': 1099511632132, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_idr.c'}, {'damage_type': 'backtrace', 'id': 2000109922, 'ino': 1099511633974, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-4.c'}, {'damage_type': 'backtrace', 'id': 2000686106, 'ino': 1099511633780, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-22.c'}, {'damage_type': 'backtrace', 'id': 2003256680, 'ino': 1099511632106, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_reset.c'}, {'damage_type': 'backtrace', 'id': 2005547265, 'ino': 1099511632171, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_el.h'}, {'damage_type': 'backtrace', 'id': 2005662235, 'ino': 1099511632639, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/11-1.c'}, {'damage_type': 'backtrace', 'id': 2009688545, 'ino': 1099511632886, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/14-1.c'}, {'damage_type': 'backtrace', 'id': 2013200383, 'ino': 1099511631900, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_addr.h'}, {'damage_type': 'backtrace', 'id': 2016048586, 'ino': 1099511632727, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/2-1.c'}, {'damage_type': 'backtrace', 'id': 2032455794, 'ino': 1099511632176, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_controls.c'}, {'damage_type': 'backtrace', 'id': 2035428210, 'ino': 1099511633708, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-21.c'}, {'damage_type': 'backtrace', 'id': 2035522483, 'ino': 1099511632862, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/8-1.c'}, {'damage_type': 'backtrace', 'id': 2039643565, 'ino': 1099511633839, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-7.c'}, {'damage_type': 'backtrace', 'id': 2040778865, 'ino': 1099511632706, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/41-1.c'}, {'damage_type': 'backtrace', 'id': 2042203259, 'ino': 1099511632006, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/openhpi.conf'}, {'damage_type': 'backtrace', 'id': 2045756599, 'ino': 1099511632866, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/12-3.c'}, {'damage_type': 'backtrace', 'id': 2049942773, 'ino': 1099511632108, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap.h'}, {'damage_type': 'backtrace', 'id': 2051013683, 'ino': 1099511632861, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/7-4.c'}, {'damage_type': 'backtrace', 'id': 2051088032, 'ino': 1099511632746, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-21.c'}, {'damage_type': 'backtrace', 'id': 2054592706, 'ino': 1099511631963, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_annunciator.c'}, {'damage_type': 'backtrace', 'id': 2079810457, 'ino': 1099511631923, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/test.h'}, {'damage_type': 'backtrace', 'id': 2084467854, 'ino': 1099511632731, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/1-1.c'}, {'damage_type': 'backtrace', 'id': 2085063771, 'ino': 1099511634141, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-12.c'}, {'damage_type': 'backtrace', 'id': 2094173191, 'ino': 1099511634111, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-15.c'}, {'damage_type': 'backtrace', 'id': 2094734528, 'ino': 1099511633912, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-2.c'}, {'damage_type': 'backtrace', 'id': 2094944633, 'ino': 1099511631858, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_fix_sdr.h'}, {'damage_type': 'backtrace', 'id': 2095126932, 'ino': 1099511632845, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/3-1.c'}, {'damage_type': 'backtrace', 'id': 2096967966, 'ino': 1099511632113, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_fan_event.c'}, {'damage_type': 'backtrace', 'id': 2097001319, 'ino': 1099511631968, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_reset.h'}, {'damage_type': 'backtrace', 'id': 2103065923, 'ino': 1099511632668, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/34-1.c'}, {'damage_type': 'backtrace', 'id': 2105428439, 'ino': 1099511631811, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ekeyfru.h'}, {'damage_type': 'backtrace', 'id': 2108149016, 'ino': 1099511632834, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-10.c'}, {'damage_type': 'backtrace', 'id': 2110041806, 'ino': 1099511634003, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-3.c'}, {'damage_type': 'backtrace', 'id': 2112908137, 'ino': 1099511632105, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_utils.c'}, {'damage_type': 'backtrace', 'id': 2114401101, 'ino': 1099511631825, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_fru_rdrs.c'}, {'damage_type': 'backtrace', 'id': 2116300652, 'ino': 1099511631866, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_resource.cpp'}, {'damage_type': 'backtrace', 'id': 2121785095, 'ino': 1099511632879, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/20-1.c'}, {'damage_type': 'backtrace', 'id': 2122068184, 'ino': 1099511633763, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-24.c'}, {'damage_type': 'backtrace', 'id': 2122441709, 'ino': 1099511632206, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_011.c'}, {'damage_type': 'backtrace', 'id': 2130160023, 'ino': 1099511634010, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-9.c'}, {'damage_type': 'backtrace', 'id': 2133024197, 'ino': 1099511631957, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_power.h'}, {'damage_type': 'backtrace', 'id': 2137532415, 'ino': 1099511632187, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_016.c'}, {'damage_type': 'backtrace', 'id': 2139322100, 'ino': 1099511632180, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_039.c'}, {'damage_type': 'backtrace', 'id': 2140346287, 'ino': 1099511631954, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_discover.h'}, {'damage_type': 'backtrace', 'id': 2144936146, 'ino': 1099511632682, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/7-2.c'}, {'damage_type': 'backtrace', 'id': 2147164031, 'ino': 1099511632906, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/4-1.c'}, {'damage_type': 'backtrace', 'id': 2149211484, 'ino': 1099511634058, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-8.c'}, {'damage_type': 'backtrace', 'id': 2150798875, 'ino': 1099511632233, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_hotswap.h'}, {'damage_type': 'backtrace', 'id': 2155535285, 'ino': 1099511632227, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/Makefile.am'}, {'damage_type': 'backtrace', 'id': 2155951518, 'ino': 1099511632151, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_sensor_func.h'}, {'damage_type': 'backtrace', 'id': 2158083215, 'ino': 1099511631881, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_hotswap.h'}, {'damage_type': 'backtrace', 'id': 2161412818, 'ino': 1099511631846, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_log.cpp'}, {'damage_type': 'backtrace', 'id': 2164522441, 'ino': 1099511634094, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-3.c'}, {'damage_type': 'backtrace', 'id': 2166230076, 'ino': 1099511634237, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-20.c'}, {'damage_type': 'backtrace', 'id': 2167640264, 'ino': 1099511633802, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-11.c'}, {'damage_type': 'backtrace', 'id': 2168520530, 'ino': 1099511632756, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/21-1.c'}, {'damage_type': 'backtrace', 'id': 2169771223, 'ino': 1099511632647, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/19-1.c'}, {'damage_type': 'backtrace', 'id': 2171935622, 'ino': 1099511632901, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/4-3.c'}, {'damage_type': 'backtrace', 'id': 2180690119, 'ino': 1099511631971, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_el.h'}, {'damage_type': 'backtrace', 'id': 2190672005, 'ino': 1099511633957, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-1.c'}, {'damage_type': 'backtrace', 'id': 2195191846, 'ino': 1099511632107, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_annunciator.c'}, {'damage_type': 'backtrace', 'id': 2217872503, 'ino': 1099511631852, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_sun_led.cpp'}, {'damage_type': 'backtrace', 'id': 2218822639, 'ino': 1099511633765, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-18.c'}, {'damage_type': 'backtrace', 'id': 2222204727, 'ino': 1099511632194, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_021.c'}, {'damage_type': 'backtrace', 'id': 2228873541, 'ino': 1099511633976, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-101.c'}, {'damage_type': 'backtrace', 'id': 2233499765, 'ino': 1099511633833, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-13.c'}, {'damage_type': 'backtrace', 'id': 2241735764, 'ino': 1099511632133, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_xml.c'}, {'damage_type': 'backtrace', 'id': 2258060728, 'ino': 1099511632633, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/6-1.c'}, {'damage_type': 'backtrace', 'id': 2258866797, 'ino': 1099511632623, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/unistd_h'}, {'damage_type': 'backtrace', 'id': 2271906744, 'ino': 1099511632763, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-30.c'}, {'damage_type': 'backtrace', 'id': 2274593188, 'ino': 1099511632019, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tset_resource_tag.c'}, {'damage_type': 'backtrace', 'id': 2278216275, 'ino': 1099511632212, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_000.c'}, {'damage_type': 'backtrace', 'id': 2280080699, 'ino': 1099511632720, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/sigmacrolist.txt'}, {'damage_type': 'backtrace', 'id': 2301931460, 'ino': 1099511632126, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_ssl.c'}, {'damage_type': 'backtrace', 'id': 2305944553, 'ino': 1099511634198, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-35.c'}, {'damage_type': 'backtrace', 'id': 2306398464, 'ino': 1099511632742, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-20.c'}, {'damage_type': 'backtrace', 'id': 2306920332, 'ino': 1099511631849, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_discrete.cpp'}, {'damage_type': 'backtrace', 'id': 2315919081, 'ino': 1099511632183, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_028.c'}, {'damage_type': 'backtrace', 'id': 2327398378, 'ino': 1099511632174, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_annunciators.h'}, {'damage_type': 'backtrace', 'id': 2329708011, 'ino': 1099511631902, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_domain.h'}, {'damage_type': 'backtrace', 'id': 2330762727, 'ino': 1099511632031, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv006.c'}, {'damage_type': 'backtrace', 'id': 2334573757, 'ino': 1099511632791, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/coverage.txt'}, {'damage_type': 'backtrace', 'id': 2350250319, 'ino': 1099511631806, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sensor_event.c'}, {'damage_type': 'backtrace', 'id': 2351074004, 'ino': 1099511632222, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_030.c'}, {'damage_type': 'backtrace', 'id': 2356371170, 'ino': 1099511632673, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/13-1.c'}, {'damage_type': 'backtrace', 'id': 2365002566, 'ino': 1099511633993, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-21.c'}, {'damage_type': 'backtrace', 'id': 2374398933, 'ino': 1099511631972, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_hotswap.c'}, {'damage_type': 'backtrace', 'id': 2380246257, 'ino': 1099511632785, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/2-3.c'}, {'damage_type': 'backtrace', 'id': 2381371774, 'ino': 1099511631892, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control.h'}, {'damage_type': 'backtrace', 'id': 2385119700, 'ino': 1099511632065, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_callsupport.h'}, {'damage_type': 'backtrace', 'id': 2393385099, 'ino': 1099511632002, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsptime001.c'}, {'damage_type': 'backtrace', 'id': 2399785561, 'ino': 1099511632780, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/17-1.c'}, {'damage_type': 'backtrace', 'id': 2402624824, 'ino': 1099511632854, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/9-1.c'}, {'damage_type': 'backtrace', 'id': 2405884984, 'ino': 1099511634251, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-17.c'}, {'damage_type': 'backtrace', 'id': 2409311351, 'ino': 1099511632011, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget005.c'}, {'damage_type': 'backtrace', 'id': 2411441628, 'ino': 1099511632007, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/sim_resources.h'}, {'damage_type': 'backtrace', 'id': 2420331225, 'ino': 1099511632719, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-32.c'}, {'damage_type': 'backtrace', 'id': 2422203022, 'ino': 1099511632045, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset001.c'}, {'damage_type': 'backtrace', 'id': 2428368660, 'ino': 1099511632743, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-16.c'}, {'damage_type': 'backtrace', 'id': 2436838099, 'ino': 1099511632258, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_hotswap.c'}, {'damage_type': 'backtrace', 'id': 2445627310, 'ino': 1099511631876, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_text_buffer.cpp'}, {'damage_type': 'backtrace', 'id': 2447275696, 'ino': 1099511634236, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-24.c'}, {'damage_type': 'backtrace', 'id': 2448895740, 'ino': 1099511632057, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset002.c'}, {'damage_type': 'backtrace', 'id': 2450379519, 'ino': 1099511634144, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-1.c'}, {'damage_type': 'backtrace', 'id': 2451715444, 'ino': 1099511633740, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-6.c'}, {'damage_type': 'backtrace', 'id': 2452389036, 'ino': 1099511631841, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/watchdog/Makefile.am'}, {'damage_type': 'backtrace', 'id': 2454401159, 'ino': 1099511632629, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/9-1.c'}, {'damage_type': 'backtrace', 'id': 2457117931, 'ino': 1099511632059, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset003.c'}, {'damage_type': 'backtrace', 'id': 2457316509, 'ino': 1099511633881, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-14.c'}, {'damage_type': 'backtrace', 'id': 2457888060, 'ino': 1099511634038, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-38.c'}, {'damage_type': 'backtrace', 'id': 2460736054, 'ino': 1099511632667, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/assertions.xml'}, {'damage_type': 'backtrace', 'id': 2462339970, 'ino': 1099511631805, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_vshm_rdrs.c'}, {'damage_type': 'backtrace', 'id': 2464747661, 'ino': 1099511632765, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-6.c'}, {'damage_type': 'backtrace', 'id': 2466771082, 'ino': 1099511632755, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-29.c'}, {'damage_type': 'backtrace', 'id': 2471037119, 'ino': 1099511632711, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/40-1.c'}, {'damage_type': 'backtrace', 'id': 2471799577, 'ino': 1099511631990, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tcontrol003.c'}, {'damage_type': 'backtrace', 'id': 2474323198, 'ino': 1099511632819, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/5-1.c'}, {'damage_type': 'backtrace', 'id': 2494524597, 'ino': 1099511631856, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_log.h'}, {'damage_type': 'backtrace', 'id': 2495027739, 'ino': 1099511632825, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/8-1.c'}, {'damage_type': 'backtrace', 'id': 2496123570, 'ino': 1099511632252, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/Makefile.in'}, {'damage_type': 'backtrace', 'id': 2505843406, 'ino': 1099511632266, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/sysfs/sysfs2hpi.c'}, {'damage_type': 'backtrace', 'id': 2507347595, 'ino': 1099511632017, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/treset001.c'}, {'damage_type': 'backtrace', 'id': 2511892536, 'ino': 1099511632055, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget040.c'}, {'damage_type': 'backtrace', 'id': 2519890816, 'ino': 1099511632758, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/29-1.c'}, {'damage_type': 'backtrace', 'id': 2521649275, 'ino': 1099511632797, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/15-1.c'}, {'damage_type': 'backtrace', 'id': 2525493259, 'ino': 1099511632188, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_040.c'}, {'damage_type': 'backtrace', 'id': 2529501845, 'ino': 1099511633880, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-8.c'}, {'damage_type': 'backtrace', 'id': 2531080391, 'ino': 1099511634052, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-22.c'}, {'damage_type': 'backtrace', 'id': 2531522087, 'ino': 1099511631908, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor.h'}, {'damage_type': 'backtrace', 'id': 2531826210, 'ino': 1099511633928, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-10.c'}, {'damage_type': 'backtrace', 'id': 2537348226, 'ino': 1099511634051, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-22.c'}, {'damage_type': 'backtrace', 'id': 2539364846, 'ino': 1099511631956, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_event.h'}, {'damage_type': 'backtrace', 'id': 2540232046, 'ino': 1099511634184, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-13.c'}, {'damage_type': 'backtrace', 'id': 2541110840, 'ino': 1099511631901, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_inventory.h'}, {'damage_type': 'backtrace', 'id': 2547456812, 'ino': 1099511632094, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_enclosure_event.c'}, {'damage_type': 'backtrace', 'id': 2553785272, 'ino': 1099511632056, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/Makefile.am'}, {'damage_type': 'backtrace', 'id': 2556088951, 'ino': 1099511632915, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/3-2.c'}, {'damage_type': 'backtrace', 'id': 2558909192, 'ino': 1099511632656, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/2-1.c'}, {'damage_type': 'backtrace', 'id': 2559342970, 'ino': 1099511631961, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/sim_init.h'}, {'damage_type': 'backtrace', 'id': 2571602657, 'ino': 1099511632890, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/1-1.c'}, {'damage_type': 'backtrace', 'id': 2579665814, 'ino': 1099511632659, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/1-1.c'}, {'damage_type': 'backtrace', 'id': 2580720510, 'ino': 1099511634219, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-3.c'}, {'damage_type': 'backtrace', 'id': 2616183773, 'ino': 1099511632887, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/2-1.c'}, {'damage_type': 'backtrace', 'id': 2624140312, 'ino': 1099511634201, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-1.c'}, {'damage_type': 'backtrace', 'id': 2625572854, 'ino': 1099511631875, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_inventory_parser.cpp'}, {'damage_type': 'backtrace', 'id': 2626436011, 'ino': 1099511632259, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas.h'}, {'damage_type': 'backtrace', 'id': 2627611863, 'ino': 1099511632219, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_002.c'}, {'damage_type': 'backtrace', 'id': 2629063517, 'ino': 1099511632150, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_fumi.c'}, {'damage_type': 'backtrace', 'id': 2630296576, 'ino': 1099511632789, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/10-1.c'}, {'damage_type': 'backtrace', 'id': 2632076391, 'ino': 1099511632117, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_event.c'}, {'damage_type': 'backtrace', 'id': 2643329917, 'ino': 1099511632635, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/8-1.c'}, {'damage_type': 'backtrace', 'id': 2653923837, 'ino': 1099511632102, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_sensor.h'}, {'damage_type': 'backtrace', 'id': 2659187940, 'ino': 1099511633933, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-91.c'}, {'damage_type': 'backtrace', 'id': 2662122436, 'ino': 1099511634168, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-1.c'}, {'damage_type': 'backtrace', 'id': 2669316004, 'ino': 1099511631931, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/Makefile.am'}, {'damage_type': 'backtrace', 'id': 2670478200, 'ino': 1099511632849, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h/4-1.c'}, {'damage_type': 'backtrace', 'id': 2672753389, 'ino': 1099511634232, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-26.c'}, {'damage_type': 'backtrace', 'id': 2673654346, 'ino': 1099511632112, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_resources.c'}, {'damage_type': 'backtrace', 'id': 2673782761, 'ino': 1099511631812, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_controls.c'}, {'damage_type': 'backtrace', 'id': 2698270032, 'ino': 1099511632048, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tpower001.c'}, {'damage_type': 'backtrace', 'id': 2701261228, 'ino': 1099511632244, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_inventory.c'}, {'damage_type': 'backtrace', 'id': 2707841517, 'ino': 1099511632631, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/2-1.c'}, {'damage_type': 'backtrace', 'id': 2708119671, 'ino': 1099511632120, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_power.c'}, {'damage_type': 'backtrace', 'id': 2711637696, 'ino': 1099511632712, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-31.c'}, {'damage_type': 'backtrace', 'id': 2712453146, 'ino': 1099511634154, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-4.c'}, {'damage_type': 'backtrace', 'id': 2719195783, 'ino': 1099511632796, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/1-1.c'}, {'damage_type': 'backtrace', 'id': 2729087858, 'ino': 1099511631952, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_discover_bc.h'}, {'damage_type': 'backtrace', 'id': 2745063037, 'ino': 1099511631891, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc.cpp'}, {'damage_type': 'backtrace', 'id': 2745523911, 'ino': 1099511632179, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t'}, {'damage_type': 'backtrace', 'id': 2750402626, 'ino': 1099511632911, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/17-1.c'}, {'damage_type': 'backtrace', 'id': 2750617416, 'ino': 1099511631937, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/sim_init.c'}, {'damage_type': 'backtrace', 'id': 2762760181, 'ino': 1099511632882, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/19-1.c'}, {'damage_type': 'backtrace', 'id': 2772541364, 'ino': 1099511632082, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_power.c'}, {'damage_type': 'backtrace', 'id': 2777496927, 'ino': 1099511632099, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/Makefile.in'}, {'damage_type': 'backtrace', 'id': 2777722283, 'ino': 1099511631890, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_watchdog.cpp'}, {'damage_type': 'backtrace', 'id': 2779787912, 'ino': 1099511632676, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/4-1.c'}, {'damage_type': 'backtrace', 'id': 2787392697, 'ino': 1099511632858, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/5-1.c'}, {'damage_type': 'backtrace', 'id': 2795112346, 'ino': 1099511632810, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/9-1.c'}, {'damage_type': 'backtrace', 'id': 2798941582, 'ino': 1099511633868, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-18.c'}, {'damage_type': 'backtrace', 'id': 2799569580, 'ino': 1099511634212, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-3.c'}, {'damage_type': 'backtrace', 'id': 2801870964, 'ino': 1099511632177, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_sensors.h'}, {'damage_type': 'backtrace', 'id': 2802420346, 'ino': 1099511632052, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset009.c'}, {'damage_type': 'backtrace', 'id': 2810913664, 'ino': 1099511632653, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/33-1.c'}, {'damage_type': 'backtrace', 'id': 2817555485, 'ino': 1099511632064, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_dimi.h'}, {'damage_type': 'backtrace', 'id': 2823121827, 'ino': 1099511633941, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-99.c'}, {'damage_type': 'backtrace', 'id': 2826678000, 'ino': 1099511632198, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_025.c'}, {'damage_type': 'backtrace', 'id': 2828731908, 'ino': 1099511631804, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_entity_event.c'}, {'damage_type': 'backtrace', 'id': 2828811479, 'ino': 1099511632009, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset011.c'}, {'damage_type': 'backtrace', 'id': 2839665195, 'ino': 1099511632625, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/unistd_h/1-1.c'}, {'damage_type': 'backtrace', 'id': 2840319766, 'ino': 1099511632853, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/3-1.c'}, {'damage_type': 'backtrace', 'id': 2843499966, 'ino': 1099511631828, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_shelf_rdrs.c'}, {'damage_type': 'backtrace', 'id': 2845476824, 'ino': 1099511634189, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-2.c'}, {'damage_type': 'backtrace', 'id': 2846179873, 'ino': 1099511631810, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_connection.c'}, {'damage_type': 'backtrace', 'id': 2851149883, 'ino': 1099511632118, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_lcd_event.h'}, {'damage_type': 'backtrace', 'id': 2853255379, 'ino': 1099511632686, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/7-3.c'}, {'damage_type': 'backtrace', 'id': 2860023404, 'ino': 1099511634167, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-25.c'}, {'damage_type': 'backtrace', 'id': 2868180103, 'ino': 1099511633969, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-17.c'}, {'damage_type': 'backtrace', 'id': 2869367687, 'ino': 1099511632704, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-28.c'}, {'damage_type': 'backtrace', 'id': 2879954135, 'ino': 1099511632260, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_control.c'}, {'damage_type': 'backtrace', 'id': 2887720307, 'ino': 1099511633929, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-12.c'}, {'damage_type': 'backtrace', 'id': 2892754526, 'ino': 1099511631970, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_control.c'}, {'damage_type': 'backtrace', 'id': 2899479036, 'ino': 1099511632892, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/7-4.c'}, {'damage_type': 'backtrace', 'id': 2905684920, 'ino': 1099511632008, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget002.c'}, {'damage_type': 'backtrace', 'id': 2909317345, 'ino': 1099511634057, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-51.c'}, {'damage_type': 'backtrace', 'id': 2909925707, 'ino': 1099511631925, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/thread_000.cpp'}, {'damage_type': 'backtrace', 'id': 2912173305, 'ino': 1099511632813, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/19-1.c'}, {'damage_type': 'backtrace', 'id': 2918011334, 'ino': 1099511632121, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_reset.c'}, {'damage_type': 'backtrace', 'id': 2918107302, 'ino': 1099511632782, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-26.c'}, {'damage_type': 'backtrace', 'id': 2918236057, 'ino': 1099511634200, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-12.c'}, {'damage_type': 'backtrace', 'id': 2919851366, 'ino': 1099511632912, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/3-3.c'}, {'damage_type': 'backtrace', 'id': 2920449977, 'ino': 1099511632046, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tevent.c'}, {'damage_type': 'backtrace', 'id': 2921326240, 'ino': 1099511631976, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_lock.h'}, {'damage_type': 'backtrace', 'id': 2926713606, 'ino': 1099511632250, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_power.c'}, {'damage_type': 'backtrace', 'id': 2930574206, 'ino': 1099511632072, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_sensor.c'}, {'damage_type': 'backtrace', 'id': 2940751922, 'ino': 1099511632802, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/13-1.c'}, {'damage_type': 'backtrace', 'id': 2954019481, 'ino': 1099511632690, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/3-1.c'}, {'damage_type': 'backtrace', 'id': 2958810706, 'ino': 1099511632662, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/7-4.c'}, {'damage_type': 'backtrace', 'id': 2961428172, 'ino': 1099511632771, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-34.c'}, {'damage_type': 'backtrace', 'id': 2968387500, 'ino': 1099511634088, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-19.c'}, {'damage_type': 'backtrace', 'id': 2974424720, 'ino': 1099511633837, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-21.c'}, {'damage_type': 'backtrace', 'id': 2977966707, 'ino': 1099511632001, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tcontrolfailover.c'}, {'damage_type': 'backtrace', 'id': 2987114705, 'ino': 1099511631947, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_sensor.c'}, {'damage_type': 'backtrace', 'id': 2988473842, 'ino': 1099511633812, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-29.c'}, {'damage_type': 'backtrace', 'id': 2991155601, 'ino': 1099511634042, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-10.c'}, {'damage_type': 'backtrace', 'id': 2993464520, 'ino': 1099511634005, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-11.c'}, {'damage_type': 'backtrace', 'id': 3001217487, 'ino': 1099511633870, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-20.c'}, {'damage_type': 'backtrace', 'id': 3002560015, 'ino': 1099511632218, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_027.c'}, {'damage_type': 'backtrace', 'id': 3006308452, 'ino': 1099511632685, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/6-3.c'}, {'damage_type': 'backtrace', 'id': 3007909338, 'ino': 1099511632707, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/47-1.c'}, {'damage_type': 'backtrace', 'id': 3011514138, 'ino': 1099511631924, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/con_000.cpp'}, {'damage_type': 'backtrace', 'id': 3020326553, 'ino': 1099511633883, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-2.c'}, {'damage_type': 'backtrace', 'id': 3021113350, 'ino': 1099511632640, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h'}, {'damage_type': 'backtrace', 'id': 3022282696, 'ino': 1099511633761, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/9-1.c'}, {'damage_type': 'backtrace', 'id': 3044357495, 'ino': 1099511631894, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_entity.cpp'}, {'damage_type': 'backtrace', 'id': 3054402594, 'ino': 1099511633816, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-57.c'}, {'damage_type': 'backtrace', 'id': 3062301934, 'ino': 1099511632891, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/5-2.c'}, {'damage_type': 'backtrace', 'id': 3075468938, 'ino': 1099511633988, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-80.c'}, {'damage_type': 'backtrace', 'id': 3075594120, 'ino': 1099511632127, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_discover.h'}, {'damage_type': 'backtrace', 'id': 3078303269, 'ino': 1099511632728, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/5-1.c'}, {'damage_type': 'backtrace', 'id': 3081513949, 'ino': 1099511631969, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_resources.h'}, {'damage_type': 'backtrace', 'id': 3082266670, 'ino': 1099511632074, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_watchdog.c'}, {'damage_type': 'backtrace', 'id': 3083841413, 'ino': 1099511631986, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget041.c'}, {'damage_type': 'backtrace', 'id': 3099795126, 'ino': 1099511633805, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-22.c'}, {'damage_type': 'backtrace', 'id': 3099986418, 'ino': 1099511632679, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/30-1.c'}, {'damage_type': 'backtrace', 'id': 3101217076, 'ino': 1099511634197, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-13.c'}, {'damage_type': 'backtrace', 'id': 3101780982, 'ino': 1099511634128, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-10.c'}, {'damage_type': 'backtrace', 'id': 3102859695, 'ino': 1099511631864, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_intel.cpp'}, {'damage_type': 'backtrace', 'id': 3108533744, 'ino': 1099511631818, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_inventory_event.c'}, {'damage_type': 'backtrace', 'id': 3114241720, 'ino': 1099511632110, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_oa_event.c'}, {'damage_type': 'backtrace', 'id': 3114833928, 'ino': 1099511633989, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-20.c'}, {'damage_type': 'backtrace', 'id': 3116984347, 'ino': 1099511632904, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/13-1.c'}, {'damage_type': 'backtrace', 'id': 3122961073, 'ino': 1099511632729, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-24.c'}, {'damage_type': 'backtrace', 'id': 3125214866, 'ino': 1099511631821, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_event.c'}, {'damage_type': 'backtrace', 'id': 3130730110, 'ino': 1099511632700, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-4.c'}, {'damage_type': 'backtrace', 'id': 3132776889, 'ino': 1099511633844, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-8.c'}, {'damage_type': 'backtrace', 'id': 3143723770, 'ino': 1099511631994, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tcontrol_parms.c'}, {'damage_type': 'backtrace', 'id': 3145359431, 'ino': 1099511632737, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/35-1.c'}, {'damage_type': 'backtrace', 'id': 3146500472, 'ino': 1099511632826, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-7.c'}, {'damage_type': 'backtrace', 'id': 3152327523, 'ino': 1099511632234, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_indicator.h'}, {'damage_type': 'backtrace', 'id': 3160679717, 'ino': 1099511632794, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/14-1.c'}, {'damage_type': 'backtrace', 'id': 3162876598, 'ino': 1099511632651, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/18-1.c'}, {'damage_type': 'backtrace', 'id': 3164673057, 'ino': 1099511631844, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_fan.h'}, {'damage_type': 'backtrace', 'id': 3165569555, 'ino': 1099511632135, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_rpt.c'}, {'damage_type': 'backtrace', 'id': 3168203886, 'ino': 1099511632663, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/7-5.c'}, {'damage_type': 'backtrace', 'id': 3168631228, 'ino': 1099511631914, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_watchdog.h'}, {'damage_type': 'backtrace', 'id': 3171190638, 'ino': 1099511632091, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_resources.h'}, {'damage_type': 'backtrace', 'id': 3187454147, 'ino': 1099511632744, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-3.c'}, {'damage_type': 'backtrace', 'id': 3189333379, 'ino': 1099511631932, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_text_buffer.h'}, {'damage_type': 'backtrace', 'id': 3198159344, 'ino': 1099511632784, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-40.c'}, {'damage_type': 'backtrace', 'id': 3204094120, 'ino': 1099511631999, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tset_resource_sev.c'}, {'damage_type': 'backtrace', 'id': 3215418058, 'ino': 1099511632833, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/2-2.c'}, {'damage_type': 'backtrace', 'id': 3218338307, 'ino': 1099511633962, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-12.c'}, {'damage_type': 'backtrace', 'id': 3220388991, 'ino': 1099511632753, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-8.c'}, {'damage_type': 'backtrace', 'id': 3220662051, 'ino': 1099511632245, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_watchdog.h'}, {'damage_type': 'backtrace', 'id': 3227620245, 'ino': 1099511631977, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_discover_rsa.c'}, {'damage_type': 'backtrace', 'id': 3228515823, 'ino': 1099511631869, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_fru_info.h'}, {'damage_type': 'backtrace', 'id': 3232459407, 'ino': 1099511633978, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-25.c'}, {'damage_type': 'backtrace', 'id': 3233216082, 'ino': 1099511631906, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_atca_led.cpp'}, {'damage_type': 'backtrace', 'id': 3233865938, 'ino': 1099511632192, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_012.c'}, {'damage_type': 'backtrace', 'id': 3238255616, 'ino': 1099511634130, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-14.c'}, {'damage_type': 'backtrace', 'id': 3238595671, 'ino': 1099511632664, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/15-1.c'}, {'damage_type': 'backtrace', 'id': 3242986261, 'ino': 1099511632207, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_035.c'}, {'damage_type': 'backtrace', 'id': 3249944832, 'ino': 1099511632674, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/22-1.c'}, {'damage_type': 'backtrace', 'id': 3252967444, 'ino': 1099511632042, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset005.c'}, {'damage_type': 'backtrace', 'id': 3253999583, 'ino': 1099511632687, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/3-2.c'}, {'damage_type': 'backtrace', 'id': 3256549205, 'ino': 1099511632644, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/20-1.c'}, {'damage_type': 'backtrace', 'id': 3256943333, 'ino': 1099511633961, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-2.c'}, {'damage_type': 'backtrace', 'id': 3258330486, 'ino': 1099511634078, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-13.c'}, {'damage_type': 'backtrace', 'id': 3265120955, 'ino': 1099511632804, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/8-2.c'}, {'damage_type': 'backtrace', 'id': 3266930790, 'ino': 1099511632752, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/34-1.c'}, {'damage_type': 'backtrace', 'id': 3269354975, 'ino': 1099511632172, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_reset.h'}, {'damage_type': 'backtrace', 'id': 3271637978, 'ino': 1099511632201, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_014.c'}, {'damage_type': 'backtrace', 'id': 3274538239, 'ino': 1099511632238, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_reset.c'}, {'damage_type': 'backtrace', 'id': 3281064859, 'ino': 1099511631944, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_inventory.c'}, {'damage_type': 'backtrace', 'id': 3281421762, 'ino': 1099511632872, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/12-2.c'}, {'damage_type': 'backtrace', 'id': 3285410208, 'ino': 1099511634177, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-47.c'}, {'damage_type': 'backtrace', 'id': 3286072056, 'ino': 1099511632210, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_022.c'}, {'damage_type': 'backtrace', 'id': 3295212286, 'ino': 1099511632124, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_control.c'}, {'damage_type': 'backtrace', 'id': 3295583799, 'ino': 1099511632873, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h'}, {'damage_type': 'backtrace', 'id': 3301107047, 'ino': 1099511633904, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-33.c'}, {'damage_type': 'backtrace', 'id': 3302047771, 'ino': 1099511634055, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-7.c'}, {'damage_type': 'backtrace', 'id': 3303823334, 'ino': 1099511633875, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-8.c'}, {'damage_type': 'backtrace', 'id': 3306439432, 'ino': 1099511634036, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-11.c'}, {'damage_type': 'backtrace', 'id': 3311269276, 'ino': 1099511632835, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/13-1.c'}, {'damage_type': 'backtrace', 'id': 3316174577, 'ino': 1099511632883, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/24-1.c'}, {'damage_type': 'backtrace', 'id': 3324510254, 'ino': 1099511634216, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-8.c'}, {'damage_type': 'backtrace', 'id': 3328261684, 'ino': 1099511632896, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/8-1.c'}, {'damage_type': 'backtrace', 'id': 3329400453, 'ino': 1099511632803, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/4-1.c'}, {'damage_type': 'backtrace', 'id': 3334649302, 'ino': 1099511632114, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_hotswap.c'}, {'damage_type': 'backtrace', 'id': 3345832442, 'ino': 1099511633932, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-4.c'}, {'damage_type': 'backtrace', 'id': 3351621780, 'ino': 1099511632800, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/12-1.c'}, {'damage_type': 'backtrace', 'id': 3354356319, 'ino': 1099511632705, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/20-1.c'}, {'damage_type': 'backtrace', 'id': 3355737387, 'ino': 1099511632262, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_resource.h'}, {'damage_type': 'backtrace', 'id': 3364820108, 'ino': 1099511632895, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/15-1.c'}, {'damage_type': 'backtrace', 'id': 3369763633, 'ino': 1099511633866, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-15.c'}, {'damage_type': 'backtrace', 'id': 3373120975, 'ino': 1099511632202, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_034.c'}, {'damage_type': 'backtrace', 'id': 3373838184, 'ino': 1099511632678, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/3-4.c'}, {'damage_type': 'backtrace', 'id': 3378220433, 'ino': 1099511633814, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-20.c'}, {'damage_type': 'backtrace', 'id': 3382531391, 'ino': 1099511633906, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-4.c'}, {'damage_type': 'backtrace', 'id': 3387717616, 'ino': 1099511631813, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.h'}, {'damage_type': 'backtrace', 'id': 3404139684, 'ino': 1099511632650, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/coverage.txt'}, {'damage_type': 'backtrace', 'id': 3404389676, 'ino': 1099511634155, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-7.c'}, {'damage_type': 'backtrace', 'id': 3408429747, 'ino': 1099511632788, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/3-1.c'}, {'damage_type': 'backtrace', 'id': 3414400569, 'ino': 1099511632691, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/1-2.c'}, {'damage_type': 'backtrace', 'id': 3415072428, 'ino': 1099511634025, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-25.c'}, {'damage_type': 'backtrace', 'id': 3420725342, 'ino': 1099511632247, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_eventlog.h'}, {'damage_type': 'backtrace', 'id': 3431099653, 'ino': 1099511631871, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_utils.h'}, {'damage_type': 'backtrace', 'id': 3435835784, 'ino': 1099511632115, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/Makefile.am'}, {'damage_type': 'backtrace', 'id': 3440500441, 'ino': 1099511632669, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/12-1.c'}, {'damage_type': 'backtrace', 'id': 3441827822, 'ino': 1099511633919, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-31.c'}, {'damage_type': 'backtrace', 'id': 3448235060, 'ino': 1099511631865, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_threshold.cpp'}, {'damage_type': 'backtrace', 'id': 3450944299, 'ino': 1099511632137, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl.c'}, {'damage_type': 'backtrace', 'id': 3454684699, 'ino': 1099511632815, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/18-1.c'}, {'damage_type': 'backtrace', 'id': 3455137895, 'ino': 1099511632772, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-22.c'}, {'damage_type': 'backtrace', 'id': 3455656828, 'ino': 1099511632029, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv005.c'}, {'damage_type': 'backtrace', 'id': 3457320178, 'ino': 1099511633800, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-10.c'}, {'damage_type': 'backtrace', 'id': 3463919257, 'ino': 1099511631959, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_power.c'}, {'damage_type': 'backtrace', 'id': 3465753046, 'ino': 1099511631815, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.sym'}, {'damage_type': 'backtrace', 'id': 3474626169, 'ino': 1099511632144, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_hotswap.h'}, {'damage_type': 'backtrace', 'id': 3478080736, 'ino': 1099511631820, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.c'}, {'damage_type': 'backtrace', 'id': 3479498228, 'ino': 1099511632040, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tel001.c'}, {'damage_type': 'backtrace', 'id': 3479817506, 'ino': 1099511631936, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/eventmap2code.pl'}, {'damage_type': 'backtrace', 'id': 3481483022, 'ino': 1099511631962, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_discover_bc.c'}, {'damage_type': 'backtrace', 'id': 3489299789, 'ino': 1099511634239, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-19.c'}, {'damage_type': 'backtrace', 'id': 3494942776, 'ino': 1099511631943, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_time.c'}, {'damage_type': 'backtrace', 'id': 3502758269, 'ino': 1099511631921, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_entity.h'}, {'damage_type': 'backtrace', 'id': 3511271618, 'ino': 1099511632710, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-10.c'}, {'damage_type': 'backtrace', 'id': 3514652162, 'ino': 1099511631964, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_reset.c'}, {'damage_type': 'backtrace', 'id': 3516693524, 'ino': 1099511634048, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-17.c'}, {'damage_type': 'backtrace', 'id': 3518505960, 'ino': 1099511632778, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/16-1.c'}, {'damage_type': 'backtrace', 'id': 3525800071, 'ino': 1099511633834, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-14.c'}, {'damage_type': 'backtrace', 'id': 3525801351, 'ino': 1099511632900, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/21-1.c'}, {'damage_type': 'backtrace', 'id': 3525826779, 'ino': 1099511632762, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/2-4.c'}, {'damage_type': 'backtrace', 'id': 3535400992, 'ino': 1099511634021, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-26.c'}, {'damage_type': 'backtrace', 'id': 3546997158, 'ino': 1099511631987, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tcontrol002.c'}, {'damage_type': 'backtrace', 'id': 3556794228, 'ino': 1099511631907, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_addr.cpp'}, {'damage_type': 'backtrace', 'id': 3557411347, 'ino': 1099511632243, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_reset.h'}, {'damage_type': 'backtrace', 'id': 3561823753, 'ino': 1099511633752, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-4.c'}, {'damage_type': 'backtrace', 'id': 3562142355, 'ino': 1099511632910, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/7-2.c'}, {'damage_type': 'backtrace', 'id': 3564210960, 'ino': 1099511632265, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/sysfs/Makefile.in'}, {'damage_type': 'backtrace', 'id': 3564377125, 'ino': 1099511632185, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_015.c'}, {'damage_type': 'backtrace', 'id': 3584990969, 'ino': 1099511631893, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_force.cpp'}, {'damage_type': 'backtrace', 'id': 3587552542, 'ino': 1099511631887, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/hotswap.cpp'}, {'damage_type': 'backtrace', 'id': 3589630798, 'ino': 1099511632089, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_interconnect_event.h'}, {'damage_type': 'backtrace', 'id': 3594816608, 'ino': 1099511631939, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_session.h'}, {'damage_type': 'backtrace', 'id': 3600368532, 'ino': 1099511634245, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-66.c'}, {'damage_type': 'backtrace', 'id': 3601022075, 'ino': 1099511632253, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_power.h'}, {'damage_type': 'backtrace', 'id': 3606261705, 'ino': 1099511631831, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t'}, {'damage_type': 'backtrace', 'id': 3609517546, 'ino': 1099511631949, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_sel.h'}, {'damage_type': 'backtrace', 'id': 3609648867, 'ino': 1099511633707, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-25.c'}, {'damage_type': 'backtrace', 'id': 3613099219, 'ino': 1099511632081, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_inventory.h'}, {'damage_type': 'backtrace', 'id': 3614968721, 'ino': 1099511631913, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_discover.cpp'}, {'damage_type': 'backtrace', 'id': 3617495106, 'ino': 1099511634244, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-59.c'}, {'damage_type': 'backtrace', 'id': 3620441585, 'ino': 1099511634000, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-11.c'}, {'damage_type': 'backtrace', 'id': 3620706668, 'ino': 1099511631854, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor.cpp'}, {'damage_type': 'backtrace', 'id': 3622632103, 'ino': 1099511632749, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-11.c'}, {'damage_type': 'backtrace', 'id': 3631104616, 'ino': 1099511632888, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/5-1.c'}, {'damage_type': 'backtrace', 'id': 3631913042, 'ino': 1099511631862, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_auth.cpp'}, {'damage_type': 'backtrace', 'id': 3634878490, 'ino': 1099511632751, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/assertions.xml'}, {'damage_type': 'backtrace', 'id': 3645952742, 'ino': 1099511631940, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_sensor.h'}, {'damage_type': 'backtrace', 'id': 3652110847, 'ino': 1099511632764, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/13-1.c'}, {'damage_type': 'backtrace', 'id': 3658876733, 'ino': 1099511632069, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_sel.h'}, {'damage_type': 'backtrace', 'id': 3659273317, 'ino': 1099511634102, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-18.c'}, {'damage_type': 'backtrace', 'id': 3662877388, 'ino': 1099511632632, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/5-1.c'}, {'damage_type': 'backtrace', 'id': 3664309501, 'ino': 1099511634243, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-6.c'}, {'damage_type': 'backtrace', 'id': 3673694109, 'ino': 1099511632251, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_indicator.c'}, {'damage_type': 'backtrace', 'id': 3679043841, 'ino': 1099511632671, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/21-1.c'}, {'damage_type': 'backtrace', 'id': 3680399266, 'ino': 1099511632140, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_fumi_func.h'}, {'damage_type': 'backtrace', 'id': 3682217240, 'ino': 1099511632684, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/3-3.c'}, {'damage_type': 'backtrace', 'id': 3719984497, 'ino': 1099511631827, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_shelf_fru.c'}, {'damage_type': 'backtrace', 'id': 3720409926, 'ino': 1099511632877, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/9-2.c'}, {'damage_type': 'backtrace', 'id': 3724961781, 'ino': 1099511631843, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_sensor_hotswap.cpp'}, {'damage_type': 'backtrace', 'id': 3726600591, 'ino': 1099511632256, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_event.h'}, {'damage_type': 'backtrace', 'id': 3726615837, 'ino': 1099511631809, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_control_event.c'}, {'damage_type': 'backtrace', 'id': 3734840947, 'ino': 1099511632239, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_annunciator.h'}, {'damage_type': 'backtrace', 'id': 3739226555, 'ino': 1099511631953, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_watchdog.h'}, {'damage_type': 'backtrace', 'id': 3741456798, 'ino': 1099511631938, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_session.c'}, {'damage_type': 'backtrace', 'id': 3743922405, 'ino': 1099511632860, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/1-1.c'}, {'damage_type': 'backtrace', 'id': 3750920149, 'ino': 1099511633910, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-98.c'}, {'damage_type': 'backtrace', 'id': 3751877390, 'ino': 1099511632865, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/7-1.c'}, {'damage_type': 'backtrace', 'id': 3753002795, 'ino': 1099511634011, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-1.c'}, {'damage_type': 'backtrace', 'id': 3755357531, 'ino': 1099511632702, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-15.c'}, {'damage_type': 'backtrace', 'id': 3755958168, 'ino': 1099511633983, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-40.c'}, {'damage_type': 'backtrace', 'id': 3759059344, 'ino': 1099511631978, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_el2event.h'}, {'damage_type': 'backtrace', 'id': 3760147700, 'ino': 1099511634138, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-23.c'}, {'damage_type': 'backtrace', 'id': 3769735301, 'ino': 1099511633753, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-15.c'}, {'damage_type': 'backtrace', 'id': 3774156709, 'ino': 1099511632683, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/17-1.c'}, {'damage_type': 'backtrace', 'id': 3776744287, 'ino': 1099511632022, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget001.c'}, {'damage_type': 'backtrace', 'id': 3781740364, 'ino': 1099511634089, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-38.c'}, {'damage_type': 'backtrace', 'id': 3805357436, 'ino': 1099511632073, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_calls.c'}, {'damage_type': 'backtrace', 'id': 3809192718, 'ino': 1099511632902, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/2-2.c'}, {'damage_type': 'backtrace', 'id': 3817587048, 'ino': 1099511633885, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-10.c'}, {'damage_type': 'backtrace', 'id': 3825421911, 'ino': 1099511633813, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-4.c'}, {'damage_type': 'backtrace', 'id': 3831741996, 'ino': 1099511632831, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-6.c'}, {'damage_type': 'backtrace', 'id': 3841687209, 'ino': 1099511632657, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/5-1.c'}, {'damage_type': 'backtrace', 'id': 3845945484, 'ino': 1099511633764, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-103.c'}, {'damage_type': 'backtrace', 'id': 3848627603, 'ino': 1099511632681, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/11-1.c'}, {'damage_type': 'backtrace', 'id': 3851446819, 'ino': 1099511632096, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_callsupport.c'}, {'damage_type': 'backtrace', 'id': 3853750107, 'ino': 1099511632738, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/44-1.c'}, {'damage_type': 'backtrace', 'id': 3856729932, 'ino': 1099511632095, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_control.h'}, {'damage_type': 'backtrace', 'id': 3858479858, 'ino': 1099511632739, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/45-1.c'}, {'damage_type': 'backtrace', 'id': 3861451695, 'ino': 1099511631829, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_util.c'}, {'damage_type': 'backtrace', 'id': 3861788018, 'ino': 1099511632123, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl_discover.c'}, {'damage_type': 'backtrace', 'id': 3867916988, 'ino': 1099511632908, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/16-1.c'}, {'damage_type': 'backtrace', 'id': 3868491761, 'ino': 1099511632864, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/12-1.c'}, {'damage_type': 'backtrace', 'id': 3869897512, 'ino': 1099511631948, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_time.h'}, {'damage_type': 'backtrace', 'id': 3883959566, 'ino': 1099511632026, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tinv007.c'}, {'damage_type': 'backtrace', 'id': 3887355108, 'ino': 1099511632216, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_001.c'}, {'damage_type': 'backtrace', 'id': 3887804932, 'ino': 1099511631975, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_utils.h'}, {'damage_type': 'backtrace', 'id': 3892306256, 'ino': 1099511634235, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-15.c'}, {'damage_type': 'backtrace', 'id': 3895749200, 'ino': 1099511632675, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/26-1.c'}, {'damage_type': 'backtrace', 'id': 3895939926, 'ino': 1099511632145, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_annunciator_func.h'}, {'damage_type': 'backtrace', 'id': 3905007848, 'ino': 1099511633869, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/coverage.txt'}, {'damage_type': 'backtrace', 'id': 3907877332, 'ino': 1099511632868, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/4-1.c'}, {'damage_type': 'backtrace', 'id': 3910223986, 'ino': 1099511632215, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_017.c'}, {'damage_type': 'backtrace', 'id': 3916985553, 'ino': 1099511632829, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/7-1.c'}, {'damage_type': 'backtrace', 'id': 3917188839, 'ino': 1099511632830, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-13.c'}, {'damage_type': 'backtrace', 'id': 3917712567, 'ino': 1099511632695, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/4-1.c'}, {'damage_type': 'backtrace', 'id': 3917915880, 'ino': 1099511634108, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-14.c'}, {'damage_type': 'backtrace', 'id': 3918036284, 'ino': 1099511632217, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_003.c'}, {'damage_type': 'backtrace', 'id': 3920665412, 'ino': 1099511632131, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/Makefile.in'}, {'damage_type': 'backtrace', 'id': 3931880352, 'ino': 1099511633990, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-42.c'}, {'damage_type': 'backtrace', 'id': 3931901789, 'ino': 1099511632809, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-1.c'}, {'damage_type': 'backtrace', 'id': 3948233783, 'ino': 1099511632041, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset012.c'}, {'damage_type': 'backtrace', 'id': 3948281470, 'ino': 1099511631848, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi.cpp'}, {'damage_type': 'backtrace', 'id': 3955941099, 'ino': 1099511632116, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_ps_event.h'}, {'damage_type': 'backtrace', 'id': 3960091525, 'ino': 1099511632871, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/7-3.c'}, {'damage_type': 'backtrace', 'id': 3962015259, 'ino': 1099511631955, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_sel.c'}, {'damage_type': 'backtrace', 'id': 3967670902, 'ino': 1099511632643, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/9-1.c'}, {'damage_type': 'backtrace', 'id': 3971069431, 'ino': 1099511632857, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/2-1.c'}, {'damage_type': 'backtrace', 'id': 3971934681, 'ino': 1099511632240, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_event.c'}, {'damage_type': 'backtrace', 'id': 3973705242, 'ino': 1099511632199, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_031.c'}, {'damage_type': 'backtrace', 'id': 3990094395, 'ino': 1099511632672, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/29-1.c'}, {'damage_type': 'backtrace', 'id': 4000600395, 'ino': 1099511633977, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-15.c'}, {'damage_type': 'backtrace', 'id': 4004657016, 'ino': 1099511631808, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/hotswap.c'}, {'damage_type': 'backtrace', 'id': 4005134433, 'ino': 1099511632079, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_fan_event.h'}, {'damage_type': 'backtrace', 'id': 4010580232, 'ino': 1099511632841, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-9.c'}, {'damage_type': 'backtrace', 'id': 4012645223, 'ino': 1099511632237, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_utils.h'}, {'damage_type': 'backtrace', 'id': 4020383561, 'ino': 1099511632077, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_fumi.c'}, {'damage_type': 'backtrace', 'id': 4040936716, 'ino': 1099511632856, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/coverage.txt'}, {'damage_type': 'backtrace', 'id': 4042212048, 'ino': 1099511632005, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset019.c'}, {'damage_type': 'backtrace', 'id': 4046359369, 'ino': 1099511632822, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/15-1.c'}, {'damage_type': 'backtrace', 'id': 4053285086, 'ino': 1099511632021, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorget010.c'}, {'damage_type': 'backtrace', 'id': 4056118285, 'ino': 1099511632087, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_discover.h'}, {'damage_type': 'backtrace', 'id': 4076810465, 'ino': 1099511632646, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/23-1.c'}, {'damage_type': 'backtrace', 'id': 4078331621, 'ino': 1099511632154, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_inventory.c'}, {'damage_type': 'backtrace', 'id': 4080792476, 'ino': 1099511632224, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_019.c'}, {'damage_type': 'backtrace', 'id': 4081458936, 'ino': 1099511631915, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_control_atca_led.h'}, {'damage_type': 'backtrace', 'id': 4084580664, 'ino': 1099511632870, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/shm_h/7-2.c'}, {'damage_type': 'backtrace', 'id': 4095125811, 'ino': 1099511632692, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/2-1.c'}, {'damage_type': 'backtrace', 'id': 4097013356, 'ino': 1099511631872, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_msg.h'}, {'damage_type': 'backtrace', 'id': 4105434856, 'ino': 1099511632795, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sched_h/2-1.c'}, {'damage_type': 'backtrace', 'id': 4108054989, 'ino': 1099511634158, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-6.c'}, {'damage_type': 'backtrace', 'id': 4110553177, 'ino': 1099511632129, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ilo2_ribcl.h'}, {'damage_type': 'backtrace', 'id': 4112816435, 'ino': 1099511632824, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-11.c'}, {'damage_type': 'backtrace', 'id': 4113305847, 'ino': 1099511631912, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_sun.h'}, {'damage_type': 'backtrace', 'id': 4115219340, 'ino': 1099511632748, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/43-1.c'}, {'damage_type': 'backtrace', 'id': 4117033904, 'ino': 1099511632628, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/mqueue_h/3-1.c'}, {'damage_type': 'backtrace', 'id': 4118607437, 'ino': 1099511631873, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi.h'}, {'damage_type': 'backtrace', 'id': 4127782657, 'ino': 1099511631879, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_cmd.cpp'}, {'damage_type': 'backtrace', 'id': 4128379166, 'ino': 1099511633841, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-26.c'}, {'damage_type': 'backtrace', 'id': 4129902371, 'ino': 1099511632698, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/37-1.c'}, {'damage_type': 'backtrace', 'id': 4130609762, 'ino': 1099511633811, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-10.c'}, {'damage_type': 'backtrace', 'id': 4135515319, 'ino': 1099511633877, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-19.c'}, {'damage_type': 'backtrace', 'id': 4147280228, 'ino': 1099511632034, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset021.c'}, {'damage_type': 'backtrace', 'id': 4150315439, 'ino': 1099511632754, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/50-1.c'}, {'damage_type': 'backtrace', 'id': 4152221991, 'ino': 1099511634163, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-4.c'}, {'damage_type': 'backtrace', 'id': 4172632702, 'ino': 1099511632166, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_power.c'}, {'damage_type': 'backtrace', 'id': 4174931218, 'ino': 1099511632693, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/aio_h/1-1.c'}, {'damage_type': 'backtrace', 'id': 4179821224, 'ino': 1099511632725, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-18.c'}, {'damage_type': 'backtrace', 'id': 4180055686, 'ino': 1099511631945, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/snmp_bc_xml2event.c'}, {'damage_type': 'backtrace', 'id': 4181618717, 'ino': 1099511632025, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsetup.c'}, {'damage_type': 'backtrace', 'id': 4183199182, 'ino': 1099511633830, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-27.c'}, {'damage_type': 'backtrace', 'id': 4187402729, 'ino': 1099511633776, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-60.c'}, {'damage_type': 'backtrace', 'id': 4194302202, 'ino': 1099511633795, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-11.c'}, {'damage_type': 'backtrace', 'id': 4194680194, 'ino': 1099511633794, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-26.c'}, {'damage_type': 'backtrace', 'id': 4199544288, 'ino': 1099511632844, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/errno_h'}, {'damage_type': 'backtrace', 'id': 4207056120, 'ino': 1099511632093, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/oa_soap_power.h'}, {'damage_type': 'backtrace', 'id': 4207562327, 'ino': 1099511634221, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-14.c'}, {'damage_type': 'backtrace', 'id': 4210468893, 'ino': 1099511632680, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/16-1.c'}, {'damage_type': 'backtrace', 'id': 4212651165, 'ino': 1099511632051, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/tsensorset015.c'}, {'damage_type': 'backtrace', 'id': 4213844288, 'ino': 1099511632661, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/31-1.c'}, {'damage_type': 'backtrace', 'id': 4214194268, 'ino': 1099511634156, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-25.c'}, {'damage_type': 'backtrace', 'id': 4216542702, 'ino': 1099511633711, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-7.c'}, {'damage_type': 'backtrace', 'id': 4220315613, 'ino': 1099511632162, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/sim_dimi.h'}, {'damage_type': 'backtrace', 'id': 4226584084, 'ino': 1099511632880, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/10-1.c'}, {'damage_type': 'backtrace', 'id': 4231203292, 'ino': 1099511632894, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/sys/mman_h/9-3.c'}, {'damage_type': 'backtrace', 'id': 4234731516, 'ino': 1099511632261, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/Makefile.am'}, {'damage_type': 'backtrace', 'id': 4235409126, 'ino': 1099511632768, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/22-19.c'}, {'damage_type': 'backtrace', 'id': 4236054143, 'ino': 1099511632842, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/pthread_h/3-3.c'}, {'damage_type': 'backtrace', 'id': 4236829857, 'ino': 1099511634098, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-2.c'}, {'damage_type': 'backtrace', 'id': 4239383874, 'ino': 1099511632257, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/rtas_eventlog.c'}, {'damage_type': 'backtrace', 'id': 4241114684, 'ino': 1099511632774, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h/25-1.c'}, {'damage_type': 'backtrace', 'id': 4241688082, 'ino': 1099511632226, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/t/sim_sanity_007.c'}, {'damage_type': 'backtrace', 'id': 4253652793, 'ino': 1099511631853, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ipmi_mc_vendor_sun.cpp'}, {'damage_type': 'backtrace', 'id': 4272352323, 'ino': 1099511632642, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/time_h/3-1.c'}, {'damage_type': 'backtrace', 'id': 4284350962, 'ino': 1099511632033, 'path': '/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/t/thotswap001.c'}] 2024-06-03T00:03:46.197 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/fwd_scrub.py", line 48, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/fwd_scrub.py", line 70, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/fwd_scrub.py", line 81, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2024-06-03T00:03:46.202 INFO:tasks.quiescer.fs.[cephfs]:Total duration (55.5) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-06-03T00:03:46.202 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.75 2024-06-03T00:03:46.202 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-03T00:03:46.456 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:03:47.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:47 smithi057 ceph-mon[36457]: pgmap v495: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 22 MiB/s wr, 247 op/s 2024-06-03T00:03:47.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:47 smithi049 ceph-mon[32302]: pgmap v495: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 22 MiB/s wr, 247 op/s 2024-06-03T00:03:47.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:47 smithi107 ceph-mon[37048]: pgmap v495: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 22 MiB/s wr, 247 op/s 2024-06-03T00:03:48.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.462+0000 7f4276122640 1 -- 172.21.15.49:0/3110707285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4270101af0 msgr2=0x7f4270101f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:48.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.462+0000 7f4276122640 1 --2- 172.21.15.49:0/3110707285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4270101af0 0x7f4270101f70 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4258009900 tx=0x7f425802a410 comp rx=0 tx=0).stop 2024-06-03T00:03:48.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.462+0000 7f4276122640 1 -- 172.21.15.49:0/3110707285 shutdown_connections 2024-06-03T00:03:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.462+0000 7f4276122640 1 --2- 172.21.15.49:0/3110707285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42701024b0 0x7f4270108d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.462+0000 7f4276122640 1 --2- 172.21.15.49:0/3110707285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4270101af0 0x7f4270101f70 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.462+0000 7f4276122640 1 --2- 172.21.15.49:0/3110707285 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4270100900 0x7f4270100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.462+0000 7f4276122640 1 -- 172.21.15.49:0/3110707285 >> 172.21.15.49:0/3110707285 conn(0x7f42700fbe70 msgr2=0x7f42700fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.462+0000 7f4276122640 1 -- 172.21.15.49:0/3110707285 shutdown_connections 2024-06-03T00:03:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.462+0000 7f4276122640 1 -- 172.21.15.49:0/3110707285 wait complete. 2024-06-03T00:03:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.463+0000 7f4276122640 1 Processor -- start 2024-06-03T00:03:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.463+0000 7f4276122640 1 -- start start 2024-06-03T00:03:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.463+0000 7f4276122640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4270100900 0x7f4270104890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.463+0000 7f4276122640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4270101af0 0x7f4270102ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.463+0000 7f4276122640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42701024b0 0x7f4270103410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.463+0000 7f4276122640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f427010c560 con 0x7f4270100900 2024-06-03T00:03:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.463+0000 7f4276122640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f427010c3e0 con 0x7f4270101af0 2024-06-03T00:03:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.463+0000 7f4276122640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f427010c6e0 con 0x7f42701024b0 2024-06-03T00:03:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.463+0000 7f426f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4270100900 0x7f4270104890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.463+0000 7f426f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4270100900 0x7f4270104890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60676/0 (socket says 172.21.15.49:60676) 2024-06-03T00:03:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.463+0000 7f426f7fe640 1 -- 172.21.15.49:0/643572869 learned_addr learned my addr 172.21.15.49:0/643572869 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.463+0000 7f426ffff640 1 --2- 172.21.15.49:0/643572869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42701024b0 0x7f4270103410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.463+0000 7f4267fff640 1 --2- 172.21.15.49:0/643572869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4270101af0 0x7f4270102ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.463+0000 7f426f7fe640 1 -- 172.21.15.49:0/643572869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42701024b0 msgr2=0x7f4270103410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.463+0000 7f426f7fe640 1 --2- 172.21.15.49:0/643572869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42701024b0 0x7f4270103410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.463+0000 7f426f7fe640 1 -- 172.21.15.49:0/643572869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4270101af0 msgr2=0x7f4270102ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.463+0000 7f426f7fe640 1 --2- 172.21.15.49:0/643572869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4270101af0 0x7f4270102ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.463+0000 7f426f7fe640 1 -- 172.21.15.49:0/643572869 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4270103ca0 con 0x7f4270100900 2024-06-03T00:03:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.463+0000 7f426ffff640 1 --2- 172.21.15.49:0/643572869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42701024b0 0x7f4270103410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.463+0000 7f426f7fe640 1 --2- 172.21.15.49:0/643572869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4270100900 0x7f4270104890 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f426000e9c0 tx=0x7f426000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.464+0000 7f426d7fa640 1 -- 172.21.15.49:0/643572869 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426000cde0 con 0x7f4270100900 2024-06-03T00:03:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.464+0000 7f426d7fa640 1 -- 172.21.15.49:0/643572869 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4260010910 con 0x7f4270100900 2024-06-03T00:03:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.464+0000 7f4276122640 1 -- 172.21.15.49:0/643572869 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42701a1d80 con 0x7f4270100900 2024-06-03T00:03:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.464+0000 7f426d7fa640 1 -- 172.21.15.49:0/643572869 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42600189c0 con 0x7f4270100900 2024-06-03T00:03:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.464+0000 7f4276122640 1 -- 172.21.15.49:0/643572869 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42701a2190 con 0x7f4270100900 2024-06-03T00:03:48.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.466+0000 7f426d7fa640 1 -- 172.21.15.49:0/643572869 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4260010ac0 con 0x7f4270100900 2024-06-03T00:03:48.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.466+0000 7f4278e34740 1 Processor -- start 2024-06-03T00:03:48.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.467+0000 7f426d7fa640 1 --2- 172.21.15.49:0/643572869 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f425c0a2c30 0x7f425c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:48.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.467+0000 7f4278e34740 1 -- start start 2024-06-03T00:03:48.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.467+0000 7f426ffff640 1 --2- 172.21.15.49:0/643572869 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f425c0a2c30 0x7f425c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:48.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.467+0000 7f4278e34740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f507bd6010 0x55f507bd6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:48.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.467+0000 7f426d7fa640 1 -- 172.21.15.49:0/643572869 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f42600cf590 con 0x7f4270100900 2024-06-03T00:03:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.467+0000 7f4278e34740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f507bd6a00 0x55f507bdb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.467+0000 7f4278e34740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f507bdbb70 0x55f507bde000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.467+0000 7f4278e34740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f507b394f0 con 0x55f507bd6a00 2024-06-03T00:03:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.467+0000 7f4278e34740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55f507ad7870 con 0x55f507bdbb70 2024-06-03T00:03:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.467+0000 7f4278e34740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f507b354b0 con 0x55f507bd6010 2024-06-03T00:03:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.467+0000 7f4267fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f507bd6a00 0x55f507bdb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.467+0000 7f4267fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f507bd6a00 0x55f507bdb500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60686/0 (socket says 172.21.15.49:60686) 2024-06-03T00:03:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.467+0000 7f426f7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f507bd6010 0x55f507bd6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.467+0000 7f4267fff640 1 -- 172.21.15.49:0/3711416077 learned_addr learned my addr 172.21.15.49:0/3711416077 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.467+0000 7f426ffff640 1 --2- 172.21.15.49:0/3711416077 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f507bdbb70 0x55f507bde000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:48.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.467+0000 7f426f7fe640 1 -- 172.21.15.49:0/3711416077 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f507bdbb70 msgr2=0x55f507bde000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:48.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.467+0000 7f426f7fe640 1 --2- 172.21.15.49:0/3711416077 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f507bdbb70 0x55f507bde000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.467+0000 7f426f7fe640 1 -- 172.21.15.49:0/3711416077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f507bd6a00 msgr2=0x55f507bdb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:48.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.467+0000 7f426f7fe640 1 --2- 172.21.15.49:0/3711416077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f507bd6a00 0x55f507bdb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.467+0000 7f426ffff640 1 --2- 172.21.15.49:0/643572869 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f425c0a2c30 0x7f425c0a50f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4268009fd0 tx=0x7f426800fc50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:48.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.467+0000 7f426f7fe640 1 -- 172.21.15.49:0/3711416077 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f507af39b0 con 0x55f507bd6010 2024-06-03T00:03:48.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.467+0000 7f4267fff640 1 --2- 172.21.15.49:0/3711416077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f507bd6a00 0x55f507bdb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:48.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.467+0000 7f426f7fe640 1 --2- 172.21.15.49:0/3711416077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f507bd6010 0x55f507bd6430 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f42600058c0 tx=0x7f426009b750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d74ef73d255b5d9f server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:48.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.468+0000 7f4265ffb640 1 -- 172.21.15.49:0/3711416077 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42600a01a0 con 0x55f507bd6010 2024-06-03T00:03:48.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.468+0000 7f4265ffb640 1 -- 172.21.15.49:0/3711416077 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42600a4a60 con 0x55f507bd6010 2024-06-03T00:03:48.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.468+0000 7f4265ffb640 1 -- 172.21.15.49:0/3711416077 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426009b240 con 0x55f507bd6010 2024-06-03T00:03:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.468+0000 7f4278e34740 1 -- 172.21.15.49:0/3711416077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f507bd6010 msgr2=0x55f507bd6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.468+0000 7f4278e34740 1 --2- 172.21.15.49:0/3711416077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f507bd6010 0x55f507bd6430 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f42600058c0 tx=0x7f426009b750 comp rx=0 tx=0).stop 2024-06-03T00:03:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.468+0000 7f4278e34740 1 -- 172.21.15.49:0/3711416077 shutdown_connections 2024-06-03T00:03:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.468+0000 7f4278e34740 1 --2- 172.21.15.49:0/3711416077 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f507bdbb70 0x55f507bde000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.468+0000 7f4278e34740 1 --2- 172.21.15.49:0/3711416077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f507bd6a00 0x55f507bdb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.468+0000 7f4278e34740 1 --2- 172.21.15.49:0/3711416077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f507bd6010 0x55f507bd6430 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.468+0000 7f4278e34740 1 -- 172.21.15.49:0/3711416077 >> 172.21.15.49:0/3711416077 conn(0x55f507bd1680 msgr2=0x55f507bd1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.468+0000 7f4278e34740 1 -- 172.21.15.49:0/3711416077 shutdown_connections 2024-06-03T00:03:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.468+0000 7f4278e34740 1 -- 172.21.15.49:0/3711416077 wait complete. 2024-06-03T00:03:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.469+0000 7f4278e34740 1 -- start start 2024-06-03T00:03:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.469+0000 7f4278e34740 1 Processor -- start 2024-06-03T00:03:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.469+0000 7f4278e34740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f507bd6010 0x55f507be0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.469+0000 7f4278e34740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f507bd6a00 0x55f507be0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.469+0000 7f4278e34740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f507bdbb70 0x55f507be7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.469+0000 7f4278e34740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f507bdeac0 con 0x55f507bd6a00 2024-06-03T00:03:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.469+0000 7f4278e34740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55f507ac2ae0 con 0x55f507bdbb70 2024-06-03T00:03:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.469+0000 7f4278e34740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f507bdec40 con 0x55f507bd6010 2024-06-03T00:03:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.469+0000 7f4267fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f507bd6a00 0x55f507be0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.469+0000 7f4278e34740 10 client.0 _ll_register_callbacks cb 0x55f507afb9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:03:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.469+0000 7f4267fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f507bd6a00 0x55f507be0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60700/0 (socket says 172.21.15.49:60700) 2024-06-03T00:03:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.469+0000 7f4267fff640 1 -- 172.21.15.49:0/513017011 learned_addr learned my addr 172.21.15.49:0/513017011 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.469+0000 7f426ffff640 1 --2- 172.21.15.49:0/513017011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f507bdbb70 0x55f507be7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.469+0000 7f426f7fe640 1 --2- 172.21.15.49:0/513017011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f507bd6010 0x55f507be0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:48.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.470+0000 7f4267fff640 1 -- 172.21.15.49:0/513017011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f507bd6010 msgr2=0x55f507be0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:48.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.470+0000 7f4267fff640 1 --2- 172.21.15.49:0/513017011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f507bd6010 0x55f507be0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.470+0000 7f4267fff640 1 -- 172.21.15.49:0/513017011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f507bdbb70 msgr2=0x55f507be7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:48.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.470+0000 7f4267fff640 1 --2- 172.21.15.49:0/513017011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f507bdbb70 0x55f507be7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.470+0000 7f4267fff640 1 -- 172.21.15.49:0/513017011 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f50784d210 con 0x55f507bd6a00 2024-06-03T00:03:48.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.470+0000 7f4267fff640 1 --2- 172.21.15.49:0/513017011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f507bd6a00 0x55f507be0950 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f42580314e0 tx=0x7f42580316b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a80e6af1f4fe0aa server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:48.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.470+0000 7f424effd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:03:48.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.470+0000 7f424effd640 1 -- 172.21.15.49:0/513017011 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4258035040 con 0x55f507bd6a00 2024-06-03T00:03:48.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.470+0000 7f424effd640 1 -- 172.21.15.49:0/513017011 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f4258004040 con 0x55f507bd6a00 2024-06-03T00:03:48.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.470+0000 7f4278e34740 1 -- 172.21.15.49:0/513017011 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42600a4a60 con 0x55f507bd6a00 2024-06-03T00:03:48.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.470+0000 7f424effd640 1 -- 172.21.15.49:0/513017011 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f4258004240 con 0x55f507bd6a00 2024-06-03T00:03:48.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.470+0000 7f4278e34740 10 client.16176 fetch_fsmap learned FSMap version 36 2024-06-03T00:03:48.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.470+0000 7f4278e34740 1 -- 172.21.15.49:0/513017011 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55f507919620 con 0x55f507bd6a00 2024-06-03T00:03:48.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.470+0000 7f424effd640 1 -- 172.21.15.49:0/513017011 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42600a4a60 con 0x55f507bd6a00 2024-06-03T00:03:48.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.470+0000 7f424effd640 1 -- 172.21.15.49:0/513017011 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 36) ==== 8398+0+0 (secure 0 0 0) 0x7f4258004ae0 con 0x55f507bd6a00 2024-06-03T00:03:48.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.470+0000 7f4278e34740 10 client.16176 fetch_fsmap finished waiting for FSMap version 36 2024-06-03T00:03:48.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.470+0000 7f4278e34740 10 client.16176 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:03:48.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.471+0000 7f4278e34740 20 client.16176 populate_metadata read hostname 'smithi049' 2024-06-03T00:03:48.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.471+0000 7f4278e34740 1 --2- 172.21.15.49:0/513017011 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55f507bec3a0 0x55f507bee7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:48.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.471+0000 7f4278e34740 4 client.16176 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:03:48.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.471+0000 7f4278e34740 1 -- 172.21.15.49:0/513017011 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f507b4cf10 con 0x55f507bec3a0 2024-06-03T00:03:48.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.471+0000 7f426f7fe640 1 --2- 172.21.15.49:0/513017011 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55f507bec3a0 0x55f507bee7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:48.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.471+0000 7f426f7fe640 1 --2- 172.21.15.49:0/513017011 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55f507bec3a0 0x55f507bee7e0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=beb17cac721d2028 server_cookie=6622bac44b9df9aa in_seq=0 out_seq=0 2024-06-03T00:03:48.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.471+0000 7f424effd640 10 client.16176 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:48.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.472+0000 7f424effd640 1 -- 172.21.15.49:0/513017011 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55f507b4cf10 con 0x55f507bec3a0 2024-06-03T00:03:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.472+0000 7f424effd640 10 client.16176 handle_command_reply: tid=0 2024-06-03T00:03:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.472+0000 7f4278e34740 1 client.16176 shutdown 2024-06-03T00:03:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.472+0000 7f4278e34740 1 -- 172.21.15.49:0/513017011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f507bd6a00 msgr2=0x55f507be0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.472+0000 7f4278e34740 1 --2- 172.21.15.49:0/513017011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f507bd6a00 0x55f507be0950 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f42580314e0 tx=0x7f42580316b0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.472+0000 7f4278e34740 1 -- 172.21.15.49:0/513017011 shutdown_connections 2024-06-03T00:03:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.472+0000 7f4278e34740 1 --2- 172.21.15.49:0/513017011 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55f507bec3a0 0x55f507bee7e0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.472+0000 7f4278e34740 1 --2- 172.21.15.49:0/513017011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f507bdbb70 0x55f507be7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.472+0000 7f4278e34740 1 --2- 172.21.15.49:0/513017011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f507bd6a00 0x55f507be0950 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.472+0000 7f424effd640 0 client.16176 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.472+0000 7f4278e34740 1 --2- 172.21.15.49:0/513017011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f507bd6010 0x55f507be0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.472+0000 7f4278e34740 1 -- 172.21.15.49:0/513017011 >> 172.21.15.49:0/513017011 conn(0x55f507bd1680 msgr2=0x55f507bd07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.472+0000 7f4278e34740 1 -- 172.21.15.49:0/513017011 shutdown_connections 2024-06-03T00:03:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.472+0000 7f4278e34740 1 -- 172.21.15.49:0/513017011 wait complete. 2024-06-03T00:03:48.483 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.472+0000 7f4278e34740 20 client.16176 trim_cache size 0 max 16384 2024-06-03T00:03:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.488+0000 7f4278e34740 1 Processor -- start 2024-06-03T00:03:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.488+0000 7f4278e34740 1 -- start start 2024-06-03T00:03:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.488+0000 7f4278e34740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f507bd6010 0x55f507be0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.488+0000 7f4278e34740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f507bd6a00 0x55f507be0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.488+0000 7f4278e34740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f507bdbb70 0x55f507be7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.488+0000 7f4278e34740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f42701aafc0 con 0x55f507bd6a00 2024-06-03T00:03:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.488+0000 7f4278e34740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f42701acce0 con 0x55f507bdbb70 2024-06-03T00:03:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.488+0000 7f4278e34740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f42701ab6c0 con 0x55f507bd6010 2024-06-03T00:03:48.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.488+0000 7f426f7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f507bd6010 0x55f507be0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:48.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.488+0000 7f426f7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f507bd6010 0x55f507be0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:57228/0 (socket says 172.21.15.49:57228) 2024-06-03T00:03:48.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.488+0000 7f426f7fe640 1 -- 172.21.15.49:0/236569580 learned_addr learned my addr 172.21.15.49:0/236569580 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:48.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.488+0000 7f426ffff640 1 --2- 172.21.15.49:0/236569580 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f507bdbb70 0x55f507be7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:48.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.489+0000 7f426f7fe640 1 -- 172.21.15.49:0/236569580 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f507bdbb70 msgr2=0x55f507be7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:48.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.489+0000 7f426f7fe640 1 --2- 172.21.15.49:0/236569580 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f507bdbb70 0x55f507be7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.489+0000 7f426f7fe640 1 -- 172.21.15.49:0/236569580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f507bd6a00 msgr2=0x55f507be0950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-03T00:03:48.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.489+0000 7f426f7fe640 1 --2- 172.21.15.49:0/236569580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f507bd6a00 0x55f507be0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.489+0000 7f426f7fe640 1 -- 172.21.15.49:0/236569580 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f507be8e10 con 0x55f507bd6010 2024-06-03T00:03:48.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.489+0000 7f426ffff640 1 --2- 172.21.15.49:0/236569580 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f507bdbb70 0x55f507be7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:48.492 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.489+0000 7f426f7fe640 1 --2- 172.21.15.49:0/236569580 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f507bd6010 0x55f507be0410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f42600cf830 tx=0x7f42600cf040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82bbc068ddbd6959 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:48.492 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.489+0000 7f42657fa640 1 -- 172.21.15.49:0/236569580 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426007e030 con 0x55f507bd6010 2024-06-03T00:03:48.492 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.489+0000 7f42657fa640 1 -- 172.21.15.49:0/236569580 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42600a01a0 con 0x55f507bd6010 2024-06-03T00:03:48.492 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.489+0000 7f42657fa640 1 -- 172.21.15.49:0/236569580 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42600cf3d0 con 0x55f507bd6010 2024-06-03T00:03:48.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.490+0000 7f4278e34740 1 -- 172.21.15.49:0/236569580 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f507bd6010 msgr2=0x55f507be0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:48.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.490+0000 7f4278e34740 1 --2- 172.21.15.49:0/236569580 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f507bd6010 0x55f507be0410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f42600cf830 tx=0x7f42600cf040 comp rx=0 tx=0).stop 2024-06-03T00:03:48.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.490+0000 7f4278e34740 1 -- 172.21.15.49:0/236569580 shutdown_connections 2024-06-03T00:03:48.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.490+0000 7f4278e34740 1 --2- 172.21.15.49:0/236569580 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f507bdbb70 0x55f507be7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.490+0000 7f4278e34740 1 --2- 172.21.15.49:0/236569580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f507bd6a00 0x55f507be0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.490+0000 7f4278e34740 1 --2- 172.21.15.49:0/236569580 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f507bd6010 0x55f507be0410 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.490+0000 7f4278e34740 1 -- 172.21.15.49:0/236569580 >> 172.21.15.49:0/236569580 conn(0x55f507bd1680 msgr2=0x55f507bd7290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:48.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.491+0000 7f4278e34740 1 -- 172.21.15.49:0/236569580 shutdown_connections 2024-06-03T00:03:48.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.491+0000 7f4278e34740 1 -- 172.21.15.49:0/236569580 wait complete. 2024-06-03T00:03:48.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.491+0000 7f4278e34740 1 -- start start 2024-06-03T00:03:48.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.491+0000 7f4278e34740 1 Processor -- start 2024-06-03T00:03:48.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.491+0000 7f4278e34740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f507bd6010 0x55f507be49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:48.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.491+0000 7f4278e34740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f507bd6a00 0x55f507be4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:48.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.491+0000 7f4278e34740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f507bdbb70 0x55f507be5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:48.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.491+0000 7f4278e34740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f42701ac550 con 0x55f507bd6a00 2024-06-03T00:03:48.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.491+0000 7f4278e34740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f42701abdf0 con 0x55f507bdbb70 2024-06-03T00:03:48.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.491+0000 7f4278e34740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f42701a8f80 con 0x55f507bd6010 2024-06-03T00:03:48.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.491+0000 7f4278e34740 10 client.0 _ll_register_callbacks cb 0x7f4258009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:03:48.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.492+0000 7f4267fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f507bd6a00 0x55f507be4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:48.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.492+0000 7f426ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f507bdbb70 0x55f507be5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:48.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.492+0000 7f426ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f507bdbb70 0x55f507be5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.49:37996/0 (socket says 172.21.15.49:37996) 2024-06-03T00:03:48.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.492+0000 7f426ffff640 1 -- 172.21.15.49:0/2590365747 learned_addr learned my addr 172.21.15.49:0/2590365747 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:48.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.492+0000 7f4267fff640 1 --2- 172.21.15.49:0/2590365747 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f507bd6a00 0x55f507be4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60726/0 (socket says 172.21.15.49:60726) 2024-06-03T00:03:48.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.492+0000 7f426f7fe640 1 --2- 172.21.15.49:0/2590365747 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f507bd6010 0x55f507be49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:48.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.492+0000 7f426ffff640 1 -- 172.21.15.49:0/2590365747 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f507bd6010 msgr2=0x55f507be49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:48.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.492+0000 7f426ffff640 1 --2- 172.21.15.49:0/2590365747 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f507bd6010 0x55f507be49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.492+0000 7f426ffff640 1 -- 172.21.15.49:0/2590365747 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f507bd6a00 msgr2=0x55f507be4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:48.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.492+0000 7f426ffff640 1 --2- 172.21.15.49:0/2590365747 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f507bd6a00 0x55f507be4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.492+0000 7f426ffff640 1 -- 172.21.15.49:0/2590365747 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f507be6530 con 0x55f507bdbb70 2024-06-03T00:03:48.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.492+0000 7f4267fff640 1 --2- 172.21.15.49:0/2590365747 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f507bd6a00 0x55f507be4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:48.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.492+0000 7f426ffff640 1 --2- 172.21.15.49:0/2590365747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f507bdbb70 0x55f507be5f40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f42680042a0 tx=0x7f4268004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a432eab604d5b03a server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:48.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.492+0000 7f424effd640 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2024-06-03T00:03:48.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.492+0000 7f424effd640 1 -- 172.21.15.49:0/2590365747 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4268020d60 con 0x55f507bdbb70 2024-06-03T00:03:48.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.492+0000 7f4278e34740 1 -- 172.21.15.49:0/2590365747 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42600a01a0 con 0x55f507bdbb70 2024-06-03T00:03:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.492+0000 7f424effd640 1 -- 172.21.15.49:0/2590365747 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f426801e460 con 0x55f507bdbb70 2024-06-03T00:03:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.493+0000 7f424effd640 1 -- 172.21.15.49:0/2590365747 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f4268004820 con 0x55f507bdbb70 2024-06-03T00:03:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.493+0000 7f4278e34740 10 client.25682 fetch_fsmap learned FSMap version 36 2024-06-03T00:03:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.493+0000 7f4278e34740 1 -- 172.21.15.49:0/2590365747 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55f507be78b0 con 0x55f507bdbb70 2024-06-03T00:03:48.498 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.493+0000 7f424effd640 1 -- 172.21.15.49:0/2590365747 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42600a01a0 con 0x55f507bdbb70 2024-06-03T00:03:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.493+0000 7f424effd640 1 -- 172.21.15.49:0/2590365747 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 36) ==== 8398+0+0 (secure 0 0 0) 0x7f4268027070 con 0x55f507bdbb70 2024-06-03T00:03:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.493+0000 7f4278e34740 10 client.25682 fetch_fsmap finished waiting for FSMap version 36 2024-06-03T00:03:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.493+0000 7f4278e34740 10 client.25682 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:03:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.493+0000 7f4278e34740 20 client.25682 populate_metadata read hostname 'smithi049' 2024-06-03T00:03:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.493+0000 7f4278e34740 1 --2- 172.21.15.49:0/2590365747 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55f507c57550 0x55f507c59940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.493+0000 7f4278e34740 4 client.25682 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-03T00:03:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.493+0000 7f4278e34740 1 -- 172.21.15.49:0/2590365747 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f507b46c20 con 0x55f507c57550 2024-06-03T00:03:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.493+0000 7f426f7fe640 1 --2- 172.21.15.49:0/2590365747 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55f507c57550 0x55f507c59940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.494+0000 7f426f7fe640 1 --2- 172.21.15.49:0/2590365747 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55f507c57550 0x55f507c59940 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3b25eb33807ffe7 server_cookie=a9ffcbe5894a1c68 in_seq=0 out_seq=0 2024-06-03T00:03:48.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.494+0000 7f424effd640 10 client.25682 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:48.515 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.513+0000 7f424effd640 1 -- 172.21.15.49:0/2590365747 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55f507b46c20 con 0x55f507c57550 2024-06-03T00:03:48.515 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.514+0000 7f424effd640 10 client.25682 handle_command_reply: tid=0 2024-06-03T00:03:48.515 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.514+0000 7f4278e34740 1 client.25682 shutdown 2024-06-03T00:03:48.515 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.514+0000 7f4278e34740 1 -- 172.21.15.49:0/2590365747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f507bdbb70 msgr2=0x55f507be5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:48.515 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.514+0000 7f4278e34740 1 --2- 172.21.15.49:0/2590365747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f507bdbb70 0x55f507be5f40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f42680042a0 tx=0x7f4268004ab0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.515 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.514+0000 7f4278e34740 1 -- 172.21.15.49:0/2590365747 shutdown_connections 2024-06-03T00:03:48.515 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.514+0000 7f4278e34740 1 --2- 172.21.15.49:0/2590365747 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55f507c57550 0x55f507c59940 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.515 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.514+0000 7f4278e34740 1 --2- 172.21.15.49:0/2590365747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f507bdbb70 0x55f507be5f40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.516 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.514+0000 7f4278e34740 1 --2- 172.21.15.49:0/2590365747 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f507bd6a00 0x55f507be4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.516 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.514+0000 7f4278e34740 1 --2- 172.21.15.49:0/2590365747 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f507bd6010 0x55f507be49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.516 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.514+0000 7f424effd640 0 client.25682 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:48.516 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.514+0000 7f4278e34740 1 -- 172.21.15.49:0/2590365747 >> 172.21.15.49:0/2590365747 conn(0x55f507bd1680 msgr2=0x55f507be03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:48.516 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.514+0000 7f4278e34740 1 -- 172.21.15.49:0/2590365747 shutdown_connections 2024-06-03T00:03:48.516 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.514+0000 7f4278e34740 1 -- 172.21.15.49:0/2590365747 wait complete. 2024-06-03T00:03:48.516 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.514+0000 7f4278e34740 20 client.25682 trim_cache size 0 max 16384 2024-06-03T00:03:48.516 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-06-03T00:03:48.516 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-06-03T00:03:48.516 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-06-03T00:03:48.517 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.514+0000 7f4276122640 1 -- 172.21.15.49:0/643572869 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f425c0a2c30 msgr2=0x7f425c0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:48.517 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.515+0000 7f4276122640 1 --2- 172.21.15.49:0/643572869 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f425c0a2c30 0x7f425c0a50f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4268009fd0 tx=0x7f426800fc50 comp rx=0 tx=0).stop 2024-06-03T00:03:48.517 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.515+0000 7f4276122640 1 -- 172.21.15.49:0/643572869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4270100900 msgr2=0x7f4270104890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:48.517 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.515+0000 7f4276122640 1 --2- 172.21.15.49:0/643572869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4270100900 0x7f4270104890 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f426000e9c0 tx=0x7f426000ee80 comp rx=0 tx=0).stop 2024-06-03T00:03:48.517 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.515+0000 7f4276122640 1 -- 172.21.15.49:0/643572869 shutdown_connections 2024-06-03T00:03:48.518 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.515+0000 7f4276122640 1 --2- 172.21.15.49:0/643572869 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f425c0a2c30 0x7f425c0a50f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.518 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.515+0000 7f4276122640 1 --2- 172.21.15.49:0/643572869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4270101af0 0x7f4270102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.518 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.515+0000 7f4276122640 1 --2- 172.21.15.49:0/643572869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42701024b0 0x7f4270103410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.518 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.515+0000 7f4276122640 1 --2- 172.21.15.49:0/643572869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4270100900 0x7f4270104890 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.518 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.515+0000 7f4276122640 1 -- 172.21.15.49:0/643572869 >> 172.21.15.49:0/643572869 conn(0x7f42700fbe70 msgr2=0x7f42700fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:48.518 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.515+0000 7f4276122640 1 -- 172.21.15.49:0/643572869 shutdown_connections 2024-06-03T00:03:48.518 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:03:48.515+0000 7f4276122640 1 -- 172.21.15.49:0/643572869 wait complete. 2024-06-03T00:03:48.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.600+0000 7f660db85700 1 -- 172.21.15.49:0/3606867710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6608101d50 msgr2=0x7f660810e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:48.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.600+0000 7f660db85700 1 --2- 172.21.15.49:0/3606867710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6608101d50 0x7f660810e240 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f660000b0a0 tx=0x7f660000b3b0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.600+0000 7f660db85700 1 -- 172.21.15.49:0/3606867710 shutdown_connections 2024-06-03T00:03:48.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.600+0000 7f660db85700 1 --2- 172.21.15.49:0/3606867710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6608101d50 0x7f660810e240 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.600+0000 7f660db85700 1 --2- 172.21.15.49:0/3606867710 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6608107400 0x7f66081077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.600+0000 7f660db85700 1 --2- 172.21.15.49:0/3606867710 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6608101390 0x7f6608101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.600+0000 7f660db85700 1 -- 172.21.15.49:0/3606867710 >> 172.21.15.49:0/3606867710 conn(0x7f6608078340 msgr2=0x7f6608078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:48.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.600+0000 7f660db85700 1 -- 172.21.15.49:0/3606867710 shutdown_connections 2024-06-03T00:03:48.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.600+0000 7f660db85700 1 -- 172.21.15.49:0/3606867710 wait complete. 2024-06-03T00:03:48.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.601+0000 7f660db85700 1 Processor -- start 2024-06-03T00:03:48.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.601+0000 7f660db85700 1 -- start start 2024-06-03T00:03:48.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.601+0000 7f660db85700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6608101390 0x7f6608103070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:48.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.601+0000 7f660db85700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6608101d50 0x7f66081035b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:48.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.601+0000 7f660db85700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6608107400 0x7f6608103af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:48.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.601+0000 7f660db85700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6608111670 con 0x7f6608107400 2024-06-03T00:03:48.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.601+0000 7f660db85700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f66081114f0 con 0x7f6608101d50 2024-06-03T00:03:48.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.601+0000 7f660db85700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f66081117f0 con 0x7f6608101390 2024-06-03T00:03:48.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.601+0000 7f6607fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6608107400 0x7f6608103af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:48.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.601+0000 7f6607fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6608107400 0x7f6608103af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60746/0 (socket says 172.21.15.49:60746) 2024-06-03T00:03:48.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.601+0000 7f6607fff700 1 -- 172.21.15.49:0/85312045 learned_addr learned my addr 172.21.15.49:0/85312045 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:48.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.601+0000 7f6606ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6608101d50 0x7f66081035b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:48.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.601+0000 7f66077fe700 1 --2- 172.21.15.49:0/85312045 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6608101390 0x7f6608103070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:48.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.602+0000 7f6607fff700 1 -- 172.21.15.49:0/85312045 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6608101390 msgr2=0x7f6608103070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:48.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.602+0000 7f6607fff700 1 --2- 172.21.15.49:0/85312045 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6608101390 0x7f6608103070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.602+0000 7f6607fff700 1 -- 172.21.15.49:0/85312045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6608101d50 msgr2=0x7f66081035b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:48.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.602+0000 7f6607fff700 1 --2- 172.21.15.49:0/85312045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6608101d50 0x7f66081035b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.602+0000 7f6607fff700 1 -- 172.21.15.49:0/85312045 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66081a70c0 con 0x7f6608107400 2024-06-03T00:03:48.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.602+0000 7f6607fff700 1 --2- 172.21.15.49:0/85312045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6608107400 0x7f6608103af0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f660000b780 tx=0x7f6600004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:48.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.602+0000 7f6604ff9700 1 -- 172.21.15.49:0/85312045 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6600021070 con 0x7f6608107400 2024-06-03T00:03:48.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.602+0000 7f660db85700 1 -- 172.21.15.49:0/85312045 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66081a7350 con 0x7f6608107400 2024-06-03T00:03:48.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.602+0000 7f6604ff9700 1 -- 172.21.15.49:0/85312045 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6600007b80 con 0x7f6608107400 2024-06-03T00:03:48.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.602+0000 7f6604ff9700 1 -- 172.21.15.49:0/85312045 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66000052a0 con 0x7f6608107400 2024-06-03T00:03:48.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.602+0000 7f660db85700 1 -- 172.21.15.49:0/85312045 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66081a7800 con 0x7f6608107400 2024-06-03T00:03:48.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.603+0000 7f660db85700 1 -- 172.21.15.49:0/85312045 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6608069180 con 0x7f6608107400 2024-06-03T00:03:48.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.605+0000 7f6604ff9700 1 -- 172.21.15.49:0/85312045 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6600024070 con 0x7f6608107400 2024-06-03T00:03:48.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.605+0000 7f6604ff9700 1 --2- 172.21.15.49:0/85312045 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f65f00a2c20 0x7f65f00a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:48.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.605+0000 7f66077fe700 1 --2- 172.21.15.49:0/85312045 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f65f00a2c20 0x7f65f00a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:48.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.605+0000 7f6604ff9700 1 -- 172.21.15.49:0/85312045 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f660000f020 con 0x7f6608107400 2024-06-03T00:03:48.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.606+0000 7f66077fe700 1 --2- 172.21.15.49:0/85312045 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f65f00a2c20 0x7f65f00a50e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f65f8009680 tx=0x7f65f8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:48.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.609+0000 7f6604ff9700 1 -- 172.21.15.49:0/85312045 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f660002b020 con 0x7f6608107400 2024-06-03T00:03:48.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.927+0000 7f660db85700 1 -- 172.21.15.49:0/85312045 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f66081a7ad0 con 0x7f6608107400 2024-06-03T00:03:48.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.928+0000 7f6604ff9700 1 -- 172.21.15.49:0/85312045 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11946 (secure 0 0 0) 0x7f6600007d30 con 0x7f6608107400 2024-06-03T00:03:48.929 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:03:48.930 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1553264866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1553264866},{"type":"v1","addr":"172.21.15.49:6835","nonce":1553264866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2266285252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2266285252},{"type":"v1","addr":"172.21.15.49:6837","nonce":2266285252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T23:57:16.991201+0000","modified":"2024-06-03T00:03:47.426031+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24485,"mds_2":24466,"mds_3":24464,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6839/1729124617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":1729124617},{"type":"v1","addr":"172.21.15.49:6839","nonce":1729124617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6841/1902772235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":1902772235},{"type":"v1","addr":"172.21.15.49:6841","nonce":1902772235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6833/1633534002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1633534002},{"type":"v1","addr":"172.21.15.57:6833","nonce":1633534002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6835/2254905671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2254905671},{"type":"v1","addr":"172.21.15.57:6835","nonce":2254905671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.107:6835/3693542801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3693542801},{"type":"v1","addr":"172.21.15.107:6835","nonce":3693542801}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.57:6837/230452144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":230452144},{"type":"v1","addr":"172.21.15.57:6837","nonce":230452144}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":92,"addr":"172.21.15.107:6837/3700593315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":3700593315},{"type":"v1","addr":"172.21.15.107:6837","nonce":3700593315}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6839/249825195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":249825195},{"type":"v1","addr":"172.21.15.57:6839","nonce":249825195}]},"join_fscid":-1,"export_targets":[0,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6839/1986600681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1986600681},{"type":"v1","addr":"172.21.15.107:6839","nonce":1986600681}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487,24466,24460,24485,24464]},"id":1}]} 2024-06-03T00:03:48.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.930+0000 7f660db85700 1 -- 172.21.15.49:0/85312045 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f65f00a2c20 msgr2=0x7f65f00a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:48.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.931+0000 7f660db85700 1 --2- 172.21.15.49:0/85312045 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f65f00a2c20 0x7f65f00a50e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f65f8009680 tx=0x7f65f8009260 comp rx=0 tx=0).stop 2024-06-03T00:03:48.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.931+0000 7f660db85700 1 -- 172.21.15.49:0/85312045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6608107400 msgr2=0x7f6608103af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:48.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.931+0000 7f660db85700 1 --2- 172.21.15.49:0/85312045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6608107400 0x7f6608103af0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f660000b780 tx=0x7f6600004d00 comp rx=0 tx=0).stop 2024-06-03T00:03:48.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.931+0000 7f660db85700 1 -- 172.21.15.49:0/85312045 shutdown_connections 2024-06-03T00:03:48.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.931+0000 7f660db85700 1 --2- 172.21.15.49:0/85312045 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f65f00a2c20 0x7f65f00a50e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.931+0000 7f660db85700 1 --2- 172.21.15.49:0/85312045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6608107400 0x7f6608103af0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.931+0000 7f660db85700 1 --2- 172.21.15.49:0/85312045 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6608101390 0x7f6608103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.931+0000 7f660db85700 1 --2- 172.21.15.49:0/85312045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6608101d50 0x7f66081035b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:48.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.931+0000 7f660db85700 1 -- 172.21.15.49:0/85312045 >> 172.21.15.49:0/85312045 conn(0x7f6608078340 msgr2=0x7f66081005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:48.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.931+0000 7f660db85700 1 -- 172.21.15.49:0/85312045 shutdown_connections 2024-06-03T00:03:48.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:48.931+0000 7f660db85700 1 -- 172.21.15.49:0/85312045 wait complete. 2024-06-03T00:03:48.933 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 36 2024-06-03T00:03:49.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:49 smithi049 ceph-mon[32302]: pgmap v496: 97 pgs: 97 active+clean; 127 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 187 op/s 2024-06-03T00:03:49.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:49 smithi049 ceph-mon[32302]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:03:49.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:49 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/85312045' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:03:49.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:49 smithi057 ceph-mon[36457]: pgmap v496: 97 pgs: 97 active+clean; 127 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 187 op/s 2024-06-03T00:03:49.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:49 smithi057 ceph-mon[36457]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:03:49.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:49 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/85312045' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:03:49.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:49 smithi107 ceph-mon[37048]: pgmap v496: 97 pgs: 97 active+clean; 127 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 187 op/s 2024-06-03T00:03:49.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:49 smithi107 ceph-mon[37048]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:03:49.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:49 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/85312045' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:03:49.661 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24487 quiesce db / --timeout 90 --expiration 147.75 --await-for 45.0' 2024-06-03T00:03:49.661 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- timeout 105 ceph tell mds.24487 quiesce db / --timeout 90 --expiration 147.75 --await-for 45.0 2024-06-03T00:03:49.963 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:03:51.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:51 smithi057 ceph-mon[36457]: pgmap v497: 97 pgs: 97 active+clean; 110 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 291 op/s 2024-06-03T00:03:51.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:51 smithi049 ceph-mon[32302]: pgmap v497: 97 pgs: 97 active+clean; 110 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 291 op/s 2024-06-03T00:03:51.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:51 smithi107 ceph-mon[37048]: pgmap v497: 97 pgs: 97 active+clean; 110 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 291 op/s 2024-06-03T00:03:51.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.763+0000 7efddb5cf700 1 -- 172.21.15.49:0/4027758010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdd41015f0 msgr2=0x7efdd41019d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:51.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.763+0000 7efddb5cf700 1 --2- 172.21.15.49:0/4027758010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdd41015f0 0x7efdd41019d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7efdd0009990 tx=0x7efdd0009ca0 comp rx=0 tx=0).stop 2024-06-03T00:03:51.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.763+0000 7efddb5cf700 1 -- 172.21.15.49:0/4027758010 shutdown_connections 2024-06-03T00:03:51.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.763+0000 7efddb5cf700 1 --2- 172.21.15.49:0/4027758010 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdd41066b0 0x7efdd410e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:51.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.763+0000 7efddb5cf700 1 --2- 172.21.15.49:0/4027758010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdd41015f0 0x7efdd41019d0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:51.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.763+0000 7efddb5cf700 1 --2- 172.21.15.49:0/4027758010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efdd4101fa0 0x7efdd4105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:51.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.763+0000 7efddb5cf700 1 -- 172.21.15.49:0/4027758010 >> 172.21.15.49:0/4027758010 conn(0x7efdd4078300 msgr2=0x7efdd4078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:51.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.763+0000 7efddb5cf700 1 -- 172.21.15.49:0/4027758010 shutdown_connections 2024-06-03T00:03:51.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.763+0000 7efddb5cf700 1 -- 172.21.15.49:0/4027758010 wait complete. 2024-06-03T00:03:51.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.764+0000 7efddb5cf700 1 Processor -- start 2024-06-03T00:03:51.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.764+0000 7efddb5cf700 1 -- start start 2024-06-03T00:03:51.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.764+0000 7efddb5cf700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdd41015f0 0x7efdd419e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:51.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.764+0000 7efddb5cf700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdd4101fa0 0x7efdd419ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:51.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.764+0000 7efddb5cf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efdd41066b0 0x7efdd4198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:51.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.764+0000 7efddb5cf700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7efdd41116a0 con 0x7efdd4101fa0 2024-06-03T00:03:51.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.764+0000 7efddb5cf700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7efdd4111520 con 0x7efdd41066b0 2024-06-03T00:03:51.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.764+0000 7efddb5cf700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7efdd4111820 con 0x7efdd41015f0 2024-06-03T00:03:51.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.764+0000 7efdd8b6a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdd4101fa0 0x7efdd419ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:51.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.764+0000 7efdd936b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdd41015f0 0x7efdd419e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:51.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.764+0000 7efdd8b6a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdd4101fa0 0x7efdd419ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60752/0 (socket says 172.21.15.49:60752) 2024-06-03T00:03:51.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.764+0000 7efdd936b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdd41015f0 0x7efdd419e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:57262/0 (socket says 172.21.15.49:57262) 2024-06-03T00:03:51.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.764+0000 7efdd8b6a700 1 -- 172.21.15.49:0/645028876 learned_addr learned my addr 172.21.15.49:0/645028876 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:51.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.764+0000 7efdd9b6c700 1 --2- 172.21.15.49:0/645028876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efdd41066b0 0x7efdd4198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:51.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.765+0000 7efdd936b700 1 -- 172.21.15.49:0/645028876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efdd41066b0 msgr2=0x7efdd4198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:51.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.765+0000 7efdd936b700 1 --2- 172.21.15.49:0/645028876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efdd41066b0 0x7efdd4198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:51.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.765+0000 7efdd936b700 1 -- 172.21.15.49:0/645028876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdd4101fa0 msgr2=0x7efdd419ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:51.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.765+0000 7efdd936b700 1 --2- 172.21.15.49:0/645028876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdd4101fa0 0x7efdd419ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:51.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.765+0000 7efdd936b700 1 -- 172.21.15.49:0/645028876 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd41990b0 con 0x7efdd41015f0 2024-06-03T00:03:51.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.765+0000 7efdd8b6a700 1 --2- 172.21.15.49:0/645028876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdd4101fa0 0x7efdd419ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:51.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.765+0000 7efdd936b700 1 --2- 172.21.15.49:0/645028876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdd41015f0 0x7efdd419e790 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efdd00059d0 tx=0x7efdd000bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:51.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.765+0000 7efdca7fc700 1 -- 172.21.15.49:0/645028876 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd0027070 con 0x7efdd41015f0 2024-06-03T00:03:51.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.765+0000 7efddb5cf700 1 -- 172.21.15.49:0/645028876 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdd4199340 con 0x7efdd41015f0 2024-06-03T00:03:51.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.765+0000 7efdca7fc700 1 -- 172.21.15.49:0/645028876 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdd0003d70 con 0x7efdd41015f0 2024-06-03T00:03:51.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.765+0000 7efdca7fc700 1 -- 172.21.15.49:0/645028876 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd000f460 con 0x7efdd41015f0 2024-06-03T00:03:51.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.765+0000 7efddb5cf700 1 -- 172.21.15.49:0/645028876 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdd41a5660 con 0x7efdd41015f0 2024-06-03T00:03:51.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.767+0000 7efdca7fc700 1 -- 172.21.15.49:0/645028876 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7efdd002a070 con 0x7efdd41015f0 2024-06-03T00:03:51.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.768+0000 7efdca7fc700 1 --2- 172.21.15.49:0/645028876 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7efdc00a2cc0 0x7efdc00a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:51.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.768+0000 7efdd8b6a700 1 --2- 172.21.15.49:0/645028876 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7efdc00a2cc0 0x7efdc00a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:51.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.769+0000 7efdca7fc700 1 -- 172.21.15.49:0/645028876 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7efdd00cffc0 con 0x7efdd41015f0 2024-06-03T00:03:51.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.769+0000 7efdd8b6a700 1 --2- 172.21.15.49:0/645028876 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7efdc00a2cc0 0x7efdc00a5180 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7efdd4107b70 tx=0x7efdc400a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:51.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.769+0000 7efde5e52b80 1 Processor -- start 2024-06-03T00:03:51.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.769+0000 7efde5e52b80 1 -- start start 2024-06-03T00:03:51.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.770+0000 7efde5e52b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f633ec9b0 0x564f633ecd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:51.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.770+0000 7efde5e52b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f633ed2d0 0x564f633e6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:51.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.770+0000 7efde5e52b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f633e7100 0x564f633e7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:51.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.770+0000 7efde5e52b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564f632d5100 con 0x564f633ec9b0 2024-06-03T00:03:51.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.770+0000 7efde5e52b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x564f633339f0 con 0x564f633ed2d0 2024-06-03T00:03:51.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.770+0000 7efde5e52b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564f6329b600 con 0x564f633e7100 2024-06-03T00:03:51.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.770+0000 7efdd936b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f633ec9b0 0x564f633ecd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:51.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.770+0000 7efdd936b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f633ec9b0 0x564f633ecd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60756/0 (socket says 172.21.15.49:60756) 2024-06-03T00:03:51.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.770+0000 7efdd936b700 1 -- 172.21.15.49:0/3390330923 learned_addr learned my addr 172.21.15.49:0/3390330923 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:51.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.770+0000 7efdd8b6a700 1 --2- 172.21.15.49:0/3390330923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f633ed2d0 0x564f633e6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:51.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.770+0000 7efdd9b6c700 1 --2- 172.21.15.49:0/3390330923 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f633e7100 0x564f633e7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:51.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.770+0000 7efdd936b700 1 -- 172.21.15.49:0/3390330923 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f633e7100 msgr2=0x564f633e7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:51.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.770+0000 7efdd936b700 1 --2- 172.21.15.49:0/3390330923 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f633e7100 0x564f633e7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:51.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.770+0000 7efdd936b700 1 -- 172.21.15.49:0/3390330923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f633ed2d0 msgr2=0x564f633e6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:51.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.770+0000 7efdd936b700 1 --2- 172.21.15.49:0/3390330923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f633ed2d0 0x564f633e6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:51.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.770+0000 7efdd936b700 1 -- 172.21.15.49:0/3390330923 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f63282a70 con 0x564f633ec9b0 2024-06-03T00:03:51.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.770+0000 7efdd8b6a700 1 --2- 172.21.15.49:0/3390330923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f633ed2d0 0x564f633e6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:51.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.770+0000 7efdd936b700 1 --2- 172.21.15.49:0/3390330923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f633ec9b0 0x564f633ecd90 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7efdd0098cd0 tx=0x7efdd0005ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=723168d3caee86a9 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:51.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.770+0000 7efdbf7fe700 1 -- 172.21.15.49:0/3390330923 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd009cf70 con 0x564f633ec9b0 2024-06-03T00:03:51.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.770+0000 7efdbf7fe700 1 -- 172.21.15.49:0/3390330923 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdd009c870 con 0x564f633ec9b0 2024-06-03T00:03:51.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.770+0000 7efdbf7fe700 1 -- 172.21.15.49:0/3390330923 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd00870e0 con 0x564f633ec9b0 2024-06-03T00:03:51.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.771+0000 7efde5e52b80 1 -- 172.21.15.49:0/3390330923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f633ec9b0 msgr2=0x564f633ecd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:51.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.771+0000 7efde5e52b80 1 --2- 172.21.15.49:0/3390330923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f633ec9b0 0x564f633ecd90 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7efdd0098cd0 tx=0x7efdd0005ad0 comp rx=0 tx=0).stop 2024-06-03T00:03:51.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.771+0000 7efde5e52b80 1 -- 172.21.15.49:0/3390330923 shutdown_connections 2024-06-03T00:03:51.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.771+0000 7efde5e52b80 1 --2- 172.21.15.49:0/3390330923 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f633e7100 0x564f633e7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:51.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.771+0000 7efde5e52b80 1 --2- 172.21.15.49:0/3390330923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f633ec9b0 0x564f633ecd90 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:51.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.771+0000 7efde5e52b80 1 --2- 172.21.15.49:0/3390330923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f633ed2d0 0x564f633e6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:51.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.771+0000 7efde5e52b80 1 -- 172.21.15.49:0/3390330923 >> 172.21.15.49:0/3390330923 conn(0x564f6330f220 msgr2=0x564f633ddaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:51.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.771+0000 7efde5e52b80 1 -- 172.21.15.49:0/3390330923 shutdown_connections 2024-06-03T00:03:51.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.771+0000 7efde5e52b80 1 -- 172.21.15.49:0/3390330923 wait complete. 2024-06-03T00:03:51.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.772+0000 7efde5e52b80 1 -- start start 2024-06-03T00:03:51.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.772+0000 7efde5e52b80 1 Processor -- start 2024-06-03T00:03:51.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.772+0000 7efde5e52b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f633e7100 0x564f633f3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:51.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.772+0000 7efde5e52b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f633ec9b0 0x564f633f0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:51.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.772+0000 7efde5e52b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f633ed2d0 0x564f633f0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:51.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.772+0000 7efde5e52b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564f632d4160 con 0x564f633e7100 2024-06-03T00:03:51.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.772+0000 7efde5e52b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x564f6332f9b0 con 0x564f633ed2d0 2024-06-03T00:03:51.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.772+0000 7efde5e52b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564f633f3a60 con 0x564f633ec9b0 2024-06-03T00:03:51.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.772+0000 7efde5e52b80 10 client.0 _ll_register_callbacks cb 0x564f632c9750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:03:51.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.772+0000 7efdd936b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f633e7100 0x564f633f3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:51.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.772+0000 7efdd936b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f633e7100 0x564f633f3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60770/0 (socket says 172.21.15.49:60770) 2024-06-03T00:03:51.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.772+0000 7efdd936b700 1 -- 172.21.15.49:0/1649806985 learned_addr learned my addr 172.21.15.49:0/1649806985 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:51.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.772+0000 7efdd8b6a700 1 --2- 172.21.15.49:0/1649806985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f633ec9b0 0x564f633f0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:51.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.772+0000 7efdd9b6c700 1 --2- 172.21.15.49:0/1649806985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f633ed2d0 0x564f633f0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:51.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.773+0000 7efdd936b700 1 -- 172.21.15.49:0/1649806985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f633ec9b0 msgr2=0x564f633f0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:51.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.773+0000 7efdd936b700 1 --2- 172.21.15.49:0/1649806985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f633ec9b0 0x564f633f0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:51.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.773+0000 7efdd936b700 1 -- 172.21.15.49:0/1649806985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f633ed2d0 msgr2=0x564f633f0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:51.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.773+0000 7efdd936b700 1 --2- 172.21.15.49:0/1649806985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f633ed2d0 0x564f633f0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:51.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.773+0000 7efdd936b700 1 -- 172.21.15.49:0/1649806985 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f632f98f0 con 0x564f633e7100 2024-06-03T00:03:51.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.773+0000 7efdd8b6a700 1 --2- 172.21.15.49:0/1649806985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f633ec9b0 0x564f633f0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:51.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.773+0000 7efdd9b6c700 1 --2- 172.21.15.49:0/1649806985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f633ed2d0 0x564f633f0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:51.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.773+0000 7efdd936b700 1 --2- 172.21.15.49:0/1649806985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f633e7100 0x564f633f3040 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7efdd009c800 tx=0x7efdd0098b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de87cfffd2c7883 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:51.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.773+0000 7efdbcff9700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:03:51.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.773+0000 7efdbcff9700 1 -- 172.21.15.49:0/1649806985 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd00b5060 con 0x564f633e7100 2024-06-03T00:03:51.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.773+0000 7efdbcff9700 1 -- 172.21.15.49:0/1649806985 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7efdd00870e0 con 0x564f633e7100 2024-06-03T00:03:51.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.773+0000 7efde5e52b80 1 -- 172.21.15.49:0/1649806985 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdd009c870 con 0x564f633e7100 2024-06-03T00:03:51.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.773+0000 7efdbcff9700 1 -- 172.21.15.49:0/1649806985 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7efdd00a5450 con 0x564f633e7100 2024-06-03T00:03:51.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.773+0000 7efde5e52b80 10 client.16197 fetch_fsmap learned FSMap version 37 2024-06-03T00:03:51.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.773+0000 7efde5e52b80 1 -- 172.21.15.49:0/1649806985 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x564f633fe160 con 0x564f633e7100 2024-06-03T00:03:51.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.773+0000 7efdbcff9700 1 -- 172.21.15.49:0/1649806985 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdd009c870 con 0x564f633e7100 2024-06-03T00:03:51.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.773+0000 7efdbcff9700 1 -- 172.21.15.49:0/1649806985 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7efdd00a5050 con 0x564f633e7100 2024-06-03T00:03:51.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.774+0000 7efde5e52b80 10 client.16197 fetch_fsmap finished waiting for FSMap version 37 2024-06-03T00:03:51.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.774+0000 7efde5e52b80 10 client.16197 resolve_mds: validated gid 24487 aka daemon mds.i 2024-06-03T00:03:51.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.774+0000 7efde5e52b80 20 client.16197 populate_metadata read hostname 'smithi049' 2024-06-03T00:03:51.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.774+0000 7efde5e52b80 1 --2- 172.21.15.49:0/1649806985 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x564f63400630 0x564f63402a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:51.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.774+0000 7efde5e52b80 4 client.16197 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:03:51.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.774+0000 7efde5e52b80 1 -- 172.21.15.49:0/1649806985 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f63340ef0 con 0x564f63400630 2024-06-03T00:03:51.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.774+0000 7efdd8b6a700 1 --2- 172.21.15.49:0/1649806985 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x564f63400630 0x564f63402a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:51.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.774+0000 7efdd8b6a700 1 --2- 172.21.15.49:0/1649806985 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x564f63400630 0x564f63402a20 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32ef6279b8979cd0 server_cookie=8b33051e586070a5 in_seq=0 out_seq=0 2024-06-03T00:03:51.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.774+0000 7efdbcff9700 10 client.16197 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:51.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.775+0000 7efdbcff9700 1 -- 172.21.15.49:0/1649806985 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x564f63340ef0 con 0x564f63400630 2024-06-03T00:03:51.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.775+0000 7efdbcff9700 10 client.16197 handle_command_reply: tid=0 2024-06-03T00:03:51.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.775+0000 7efde5e52b80 1 client.16197 shutdown 2024-06-03T00:03:51.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.775+0000 7efde5e52b80 1 -- 172.21.15.49:0/1649806985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f633e7100 msgr2=0x564f633f3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:51.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.775+0000 7efde5e52b80 1 --2- 172.21.15.49:0/1649806985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f633e7100 0x564f633f3040 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7efdd009c800 tx=0x7efdd0098b10 comp rx=0 tx=0).stop 2024-06-03T00:03:51.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.775+0000 7efde5e52b80 1 -- 172.21.15.49:0/1649806985 shutdown_connections 2024-06-03T00:03:51.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.775+0000 7efde5e52b80 1 --2- 172.21.15.49:0/1649806985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f633ed2d0 0x564f633f0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:51.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.775+0000 7efde5e52b80 1 --2- 172.21.15.49:0/1649806985 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x564f63400630 0x564f63402a20 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:51.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.775+0000 7efde5e52b80 1 --2- 172.21.15.49:0/1649806985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f633e7100 0x564f633f3040 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:51.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.775+0000 7efde5e52b80 1 --2- 172.21.15.49:0/1649806985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f633ec9b0 0x564f633f0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:51.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.775+0000 7efde5e52b80 1 -- 172.21.15.49:0/1649806985 >> 172.21.15.49:0/1649806985 conn(0x564f6330f220 msgr2=0x564f633e17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:51.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.776+0000 7efdbcff9700 0 client.16197 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:51.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.776+0000 7efde5e52b80 1 -- 172.21.15.49:0/1649806985 shutdown_connections 2024-06-03T00:03:51.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.776+0000 7efde5e52b80 1 -- 172.21.15.49:0/1649806985 wait complete. 2024-06-03T00:03:51.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.776+0000 7efde5e52b80 20 client.16197 trim_cache size 0 max 16384 2024-06-03T00:03:51.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.798+0000 7efde5e52b80 1 Processor -- start 2024-06-03T00:03:51.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.798+0000 7efde5e52b80 1 -- start start 2024-06-03T00:03:51.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.798+0000 7efde5e52b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f6330f220 0x564f633f08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:51.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.798+0000 7efde5e52b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f633e7100 0x564f633dd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:51.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.798+0000 7efde5e52b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f633ec9b0 0x564f633dd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:51.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.798+0000 7efde5e52b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7efdd41aa840 con 0x564f633e7100 2024-06-03T00:03:51.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.798+0000 7efde5e52b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7efdd41ac560 con 0x564f633ec9b0 2024-06-03T00:03:51.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.798+0000 7efde5e52b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7efdd41aaf40 con 0x564f6330f220 2024-06-03T00:03:51.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.798+0000 7efdd8b6a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f633e7100 0x564f633dd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:51.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.798+0000 7efdd936b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f6330f220 0x564f633f08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:51.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.798+0000 7efdd8b6a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f633e7100 0x564f633dd3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60774/0 (socket says 172.21.15.49:60774) 2024-06-03T00:03:51.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.798+0000 7efdd8b6a700 1 -- 172.21.15.49:0/4186155821 learned_addr learned my addr 172.21.15.49:0/4186155821 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:51.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.799+0000 7efdd9b6c700 1 --2- 172.21.15.49:0/4186155821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f633ec9b0 0x564f633dd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:51.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.799+0000 7efdd8b6a700 1 -- 172.21.15.49:0/4186155821 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f6330f220 msgr2=0x564f633f08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:51.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.799+0000 7efdd8b6a700 1 --2- 172.21.15.49:0/4186155821 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f6330f220 0x564f633f08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:51.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.799+0000 7efdd8b6a700 1 -- 172.21.15.49:0/4186155821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f633ec9b0 msgr2=0x564f633dd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:51.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.799+0000 7efdd8b6a700 1 --2- 172.21.15.49:0/4186155821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f633ec9b0 0x564f633dd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:51.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.799+0000 7efdd8b6a700 1 -- 172.21.15.49:0/4186155821 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f633ee8b0 con 0x564f633e7100 2024-06-03T00:03:51.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.799+0000 7efdd936b700 1 --2- 172.21.15.49:0/4186155821 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f6330f220 0x564f633f08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:51.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.799+0000 7efdd8b6a700 1 --2- 172.21.15.49:0/4186155821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f633e7100 0x564f633dd3d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7efdc400ae50 tx=0x7efdc4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40950372ebd7df70 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:51.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.799+0000 7efdbeffd700 1 -- 172.21.15.49:0/4186155821 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc4016070 con 0x564f633e7100 2024-06-03T00:03:51.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.799+0000 7efdbeffd700 1 -- 172.21.15.49:0/4186155821 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdc401cb40 con 0x564f633e7100 2024-06-03T00:03:51.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.799+0000 7efdbeffd700 1 -- 172.21.15.49:0/4186155821 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc401b650 con 0x564f633e7100 2024-06-03T00:03:51.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.800+0000 7efde5e52b80 1 -- 172.21.15.49:0/4186155821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f633e7100 msgr2=0x564f633dd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:51.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.800+0000 7efde5e52b80 1 --2- 172.21.15.49:0/4186155821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f633e7100 0x564f633dd3d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7efdc400ae50 tx=0x7efdc4016000 comp rx=0 tx=0).stop 2024-06-03T00:03:51.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.800+0000 7efde5e52b80 1 -- 172.21.15.49:0/4186155821 shutdown_connections 2024-06-03T00:03:51.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.800+0000 7efde5e52b80 1 --2- 172.21.15.49:0/4186155821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f633ec9b0 0x564f633dd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:51.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.800+0000 7efde5e52b80 1 --2- 172.21.15.49:0/4186155821 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f6330f220 0x564f633f08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:51.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.800+0000 7efde5e52b80 1 --2- 172.21.15.49:0/4186155821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f633e7100 0x564f633dd3d0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:51.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.800+0000 7efde5e52b80 1 -- 172.21.15.49:0/4186155821 >> 172.21.15.49:0/4186155821 conn(0x564f633eabf0 msgr2=0x564f633e2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:51.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.800+0000 7efde5e52b80 1 -- 172.21.15.49:0/4186155821 shutdown_connections 2024-06-03T00:03:51.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.800+0000 7efde5e52b80 1 -- 172.21.15.49:0/4186155821 wait complete. 2024-06-03T00:03:51.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.800+0000 7efde5e52b80 1 -- start start 2024-06-03T00:03:51.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.801+0000 7efde5e52b80 1 Processor -- start 2024-06-03T00:03:51.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.801+0000 7efde5e52b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f6330f220 0x564f633f8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:51.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.801+0000 7efde5e52b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f633e7100 0x564f633f91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:51.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.801+0000 7efde5e52b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f633ec9b0 0x564f633f5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:51.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.801+0000 7efde5e52b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7efdd41abdd0 con 0x564f633ec9b0 2024-06-03T00:03:51.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.801+0000 7efde5e52b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7efdd41ab670 con 0x564f633e7100 2024-06-03T00:03:51.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.801+0000 7efde5e52b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7efdd41a87c0 con 0x564f6330f220 2024-06-03T00:03:51.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.801+0000 7efde5e52b80 10 client.0 _ll_register_callbacks cb 0x564f632c9750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:03:51.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.801+0000 7efdd9b6c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f633ec9b0 0x564f633f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:51.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.801+0000 7efdd936b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f6330f220 0x564f633f8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:51.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.801+0000 7efdd936b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f6330f220 0x564f633f8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:57284/0 (socket says 172.21.15.49:57284) 2024-06-03T00:03:51.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.801+0000 7efdd936b700 1 -- 172.21.15.49:0/3427559116 learned_addr learned my addr 172.21.15.49:0/3427559116 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:03:51.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.801+0000 7efdd8b6a700 1 --2- 172.21.15.49:0/3427559116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f633e7100 0x564f633f91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:51.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.802+0000 7efdd9b6c700 1 -- 172.21.15.49:0/3427559116 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f6330f220 msgr2=0x564f633f8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:51.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.802+0000 7efdd9b6c700 1 --2- 172.21.15.49:0/3427559116 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f6330f220 0x564f633f8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:51.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.802+0000 7efdd9b6c700 1 -- 172.21.15.49:0/3427559116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f633e7100 msgr2=0x564f633f91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:03:51.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.802+0000 7efdd9b6c700 1 --2- 172.21.15.49:0/3427559116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f633e7100 0x564f633f91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:51.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.802+0000 7efdd9b6c700 1 -- 172.21.15.49:0/3427559116 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f633f61c0 con 0x564f633ec9b0 2024-06-03T00:03:51.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.802+0000 7efdd936b700 1 --2- 172.21.15.49:0/3427559116 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f6330f220 0x564f633f8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:03:51.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.802+0000 7efdd9b6c700 1 --2- 172.21.15.49:0/3427559116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f633ec9b0 0x564f633f5c80 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7efdcc007500 tx=0x7efdcc007810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6dc66b044451b58 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:03:51.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.802+0000 7efdbcff9700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:03:51.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.802+0000 7efdbcff9700 1 -- 172.21.15.49:0/3427559116 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc004bb0 con 0x564f633ec9b0 2024-06-03T00:03:51.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.802+0000 7efdbcff9700 1 -- 172.21.15.49:0/3427559116 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7efdcc004d50 con 0x564f633ec9b0 2024-06-03T00:03:51.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.802+0000 7efde5e52b80 1 -- 172.21.15.49:0/3427559116 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdc401cb40 con 0x564f633ec9b0 2024-06-03T00:03:51.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.803+0000 7efdbcff9700 1 -- 172.21.15.49:0/3427559116 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7efdcc003a00 con 0x564f633ec9b0 2024-06-03T00:03:51.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.804+0000 7efde5e52b80 10 client.16203 fetch_fsmap learned FSMap version 37 2024-06-03T00:03:51.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.804+0000 7efde5e52b80 1 -- 172.21.15.49:0/3427559116 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x564f6346b970 con 0x564f633ec9b0 2024-06-03T00:03:51.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.804+0000 7efdbcff9700 1 -- 172.21.15.49:0/3427559116 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdc401cb40 con 0x564f633ec9b0 2024-06-03T00:03:51.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.804+0000 7efdbcff9700 1 -- 172.21.15.49:0/3427559116 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7efdcc02b070 con 0x564f633ec9b0 2024-06-03T00:03:51.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.804+0000 7efde5e52b80 10 client.16203 fetch_fsmap finished waiting for FSMap version 37 2024-06-03T00:03:51.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.804+0000 7efde5e52b80 10 client.16203 resolve_mds: validated gid 24487 aka daemon mds.i 2024-06-03T00:03:51.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.805+0000 7efde5e52b80 20 client.16203 populate_metadata read hostname 'smithi049' 2024-06-03T00:03:51.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.805+0000 7efde5e52b80 1 --2- 172.21.15.49:0/3427559116 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x564f633ed2d0 0x564f6346e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:03:51.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.805+0000 7efde5e52b80 4 client.16203 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.75, "await_for": 45.0}] 2024-06-03T00:03:51.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.805+0000 7efde5e52b80 1 -- 172.21.15.49:0/3427559116 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.75, "await_for": 45.0}) -- 0x564f6333b470 con 0x564f633ed2d0 2024-06-03T00:03:51.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.805+0000 7efdd936b700 1 --2- 172.21.15.49:0/3427559116 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x564f633ed2d0 0x564f6346e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:03:51.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.805+0000 7efdd936b700 1 --2- 172.21.15.49:0/3427559116 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x564f633ed2d0 0x564f6346e220 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc9e4d9e477dfe1b server_cookie=5a2e34933644103d in_seq=0 out_seq=0 2024-06-03T00:03:51.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:51.805+0000 7efdbcff9700 10 client.16203 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:52.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:52 smithi057 ceph-mon[36457]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:03:52.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:52 smithi057 ceph-mon[36457]: pgmap v498: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 264 op/s 2024-06-03T00:03:52.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:52 smithi049 ceph-mon[32302]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:03:52.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:52 smithi049 ceph-mon[32302]: pgmap v498: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 264 op/s 2024-06-03T00:03:52.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:52 smithi107 ceph-mon[37048]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:03:52.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:52 smithi107 ceph-mon[37048]: pgmap v498: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 264 op/s 2024-06-03T00:03:52.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:52.831+0000 7efdbcff9700 1 -- 172.21.15.49:0/3427559116 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x564f6333b470 con 0x564f633ed2d0 2024-06-03T00:03:52.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:52.831+0000 7efdbcff9700 10 client.16203 handle_command_reply: tid=0 2024-06-03T00:03:52.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:52.831+0000 7efde5e52b80 1 client.16203 shutdown 2024-06-03T00:03:52.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:52.831+0000 7efde5e52b80 1 -- 172.21.15.49:0/3427559116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f633ec9b0 msgr2=0x564f633f5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:52.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:52.831+0000 7efde5e52b80 1 --2- 172.21.15.49:0/3427559116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f633ec9b0 0x564f633f5c80 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7efdcc007500 tx=0x7efdcc007810 comp rx=0 tx=0).stop 2024-06-03T00:03:52.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:52.831+0000 7efde5e52b80 1 -- 172.21.15.49:0/3427559116 shutdown_connections 2024-06-03T00:03:52.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:52.831+0000 7efde5e52b80 1 --2- 172.21.15.49:0/3427559116 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x564f633ed2d0 0x564f6346e220 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:52.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:52.831+0000 7efde5e52b80 1 --2- 172.21.15.49:0/3427559116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564f633ec9b0 0x564f633f5c80 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:52.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:52.831+0000 7efde5e52b80 1 --2- 172.21.15.49:0/3427559116 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f6330f220 0x564f633f8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:52.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:52.831+0000 7efde5e52b80 1 --2- 172.21.15.49:0/3427559116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564f633e7100 0x564f633f91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:52.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:52.831+0000 7efde5e52b80 1 -- 172.21.15.49:0/3427559116 >> 172.21.15.49:0/3427559116 conn(0x564f633eabf0 msgr2=0x564f633f1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:52.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:52.831+0000 7efdbcff9700 0 client.16203 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:03:52.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:52.832+0000 7efde5e52b80 1 -- 172.21.15.49:0/3427559116 shutdown_connections 2024-06-03T00:03:52.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:52.832+0000 7efde5e52b80 1 -- 172.21.15.49:0/3427559116 wait complete. 2024-06-03T00:03:52.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:52.832+0000 7efde5e52b80 20 client.16203 trim_cache size 0 max 16384 2024-06-03T00:03:52.834 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:03:52.834 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 37, 2024-06-03T00:03:52.834 INFO:teuthology.orchestra.run.smithi049.stdout: "leader": 24487, 2024-06-03T00:03:52.834 INFO:teuthology.orchestra.run.smithi049.stdout: "set_version": 10, 2024-06-03T00:03:52.834 INFO:teuthology.orchestra.run.smithi049.stdout: "sets": { 2024-06-03T00:03:52.834 INFO:teuthology.orchestra.run.smithi049.stdout: "6d4ca031": { 2024-06-03T00:03:52.834 INFO:teuthology.orchestra.run.smithi049.stdout: "version": 10, 2024-06-03T00:03:52.834 INFO:teuthology.orchestra.run.smithi049.stdout: "age_ref": 0.0, 2024-06-03T00:03:52.834 INFO:teuthology.orchestra.run.smithi049.stdout: "state": { 2024-06-03T00:03:52.835 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "QUIESCED", 2024-06-03T00:03:52.835 INFO:teuthology.orchestra.run.smithi049.stdout: "age": 0.0 2024-06-03T00:03:52.835 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:03:52.835 INFO:teuthology.orchestra.run.smithi049.stdout: "timeout": 90.0, 2024-06-03T00:03:52.835 INFO:teuthology.orchestra.run.smithi049.stdout: "expiration": 147.8, 2024-06-03T00:03:52.835 INFO:teuthology.orchestra.run.smithi049.stdout: "members": { 2024-06-03T00:03:52.835 INFO:teuthology.orchestra.run.smithi049.stdout: "file:/": { 2024-06-03T00:03:52.835 INFO:teuthology.orchestra.run.smithi049.stdout: "excluded": false, 2024-06-03T00:03:52.835 INFO:teuthology.orchestra.run.smithi049.stdout: "state": { 2024-06-03T00:03:52.835 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "QUIESCED", 2024-06-03T00:03:52.835 INFO:teuthology.orchestra.run.smithi049.stdout: "age": 0.0 2024-06-03T00:03:52.835 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:03:52.835 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:03:52.835 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:03:52.835 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:03:52.836 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:03:52.836 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:03:52.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:52.833+0000 7efddb5cf700 1 -- 172.21.15.49:0/645028876 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7efdc00a2cc0 msgr2=0x7efdc00a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:52.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:52.833+0000 7efddb5cf700 1 --2- 172.21.15.49:0/645028876 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7efdc00a2cc0 0x7efdc00a5180 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7efdd4107b70 tx=0x7efdc400a3b0 comp rx=0 tx=0).stop 2024-06-03T00:03:52.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:52.833+0000 7efddb5cf700 1 -- 172.21.15.49:0/645028876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdd41015f0 msgr2=0x7efdd419e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:03:52.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:52.833+0000 7efddb5cf700 1 --2- 172.21.15.49:0/645028876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdd41015f0 0x7efdd419e790 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efdd00059d0 tx=0x7efdd000bab0 comp rx=0 tx=0).stop 2024-06-03T00:03:52.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:52.833+0000 7efddb5cf700 1 -- 172.21.15.49:0/645028876 shutdown_connections 2024-06-03T00:03:52.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:52.833+0000 7efddb5cf700 1 --2- 172.21.15.49:0/645028876 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7efdc00a2cc0 0x7efdc00a5180 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:52.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:52.833+0000 7efddb5cf700 1 --2- 172.21.15.49:0/645028876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efdd41066b0 0x7efdd4198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:52.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:52.833+0000 7efddb5cf700 1 --2- 172.21.15.49:0/645028876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdd41015f0 0x7efdd419e790 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:52.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:52.833+0000 7efddb5cf700 1 --2- 172.21.15.49:0/645028876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdd4101fa0 0x7efdd419ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:03:52.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:52.833+0000 7efddb5cf700 1 -- 172.21.15.49:0/645028876 >> 172.21.15.49:0/645028876 conn(0x7efdd4078300 msgr2=0x7efdd406a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:03:52.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:52.833+0000 7efddb5cf700 1 -- 172.21.15.49:0/645028876 shutdown_connections 2024-06-03T00:03:52.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:03:52.834+0000 7efddb5cf700 1 -- 172.21.15.49:0/645028876 wait complete. 2024-06-03T00:03:54.001 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6d4ca031', quiesce took 7.8 seconds. Will release after: 19.95 2024-06-03T00:03:54.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:54 smithi057 ceph-mon[36457]: pgmap v499: 97 pgs: 97 active+clean; 111 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 289 op/s 2024-06-03T00:03:54.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:54 smithi049 ceph-mon[32302]: pgmap v499: 97 pgs: 97 active+clean; 111 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 289 op/s 2024-06-03T00:03:54.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:54 smithi107 ceph-mon[37048]: pgmap v499: 97 pgs: 97 active+clean; 111 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 289 op/s 2024-06-03T00:03:56.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:56 smithi057 ceph-mon[36457]: pgmap v500: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 338 op/s 2024-06-03T00:03:56.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:56 smithi049 ceph-mon[32302]: pgmap v500: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 338 op/s 2024-06-03T00:03:56.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:56 smithi107 ceph-mon[37048]: pgmap v500: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 338 op/s 2024-06-03T00:03:58.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:03:58 smithi057 ceph-mon[36457]: pgmap v501: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 851 KiB/s wr, 271 op/s 2024-06-03T00:03:58.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:03:58 smithi049 ceph-mon[32302]: pgmap v501: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 851 KiB/s wr, 271 op/s 2024-06-03T00:03:58.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:03:58 smithi107 ceph-mon[37048]: pgmap v501: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 851 KiB/s wr, 271 op/s 2024-06-03T00:04:00.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:00 smithi057 ceph-mon[36457]: pgmap v502: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 875 KiB/s wr, 281 op/s 2024-06-03T00:04:00.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:00 smithi049 ceph-mon[32302]: pgmap v502: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 875 KiB/s wr, 281 op/s 2024-06-03T00:04:00.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:00 smithi107 ceph-mon[37048]: pgmap v502: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 875 KiB/s wr, 281 op/s 2024-06-03T00:04:01.620 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.617+0000 7f124fb77640 1 -- 172.21.15.49:0/3307668050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12481024b0 msgr2=0x7f1248108d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:01.620 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.617+0000 7f124fb77640 1 --2- 172.21.15.49:0/3307668050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12481024b0 0x7f1248108d40 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f1240009ca0 tx=0x7f124002a8c0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.617+0000 7f124fb77640 1 -- 172.21.15.49:0/3307668050 shutdown_connections 2024-06-03T00:04:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.617+0000 7f124fb77640 1 --2- 172.21.15.49:0/3307668050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1248101af0 0x7f1248101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.617+0000 7f124fb77640 1 --2- 172.21.15.49:0/3307668050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12481024b0 0x7f1248108d40 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.617+0000 7f124fb77640 1 --2- 172.21.15.49:0/3307668050 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1248100900 0x7f1248100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.617+0000 7f124fb77640 1 -- 172.21.15.49:0/3307668050 >> 172.21.15.49:0/3307668050 conn(0x7f12480fbe70 msgr2=0x7f12480fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.617+0000 7f124fb77640 1 -- 172.21.15.49:0/3307668050 shutdown_connections 2024-06-03T00:04:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.618+0000 7f124fb77640 1 -- 172.21.15.49:0/3307668050 wait complete. 2024-06-03T00:04:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.618+0000 7f124fb77640 1 Processor -- start 2024-06-03T00:04:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.618+0000 7f124fb77640 1 -- start start 2024-06-03T00:04:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.618+0000 7f124fb77640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1248100900 0x7f1248197ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.618+0000 7f124fb77640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1248101af0 0x7f12481980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.618+0000 7f124fb77640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12481024b0 0x7f124819f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.618+0000 7f124fb77640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f124810d6a0 con 0x7f1248101af0 2024-06-03T00:04:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.618+0000 7f124fb77640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f124810d520 con 0x7f12481024b0 2024-06-03T00:04:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.618+0000 7f124fb77640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f124810d820 con 0x7f1248100900 2024-06-03T00:04:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.618+0000 7f124d112640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1248101af0 0x7f12481980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.619+0000 7f124d112640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1248101af0 0x7f12481980e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58734/0 (socket says 172.21.15.49:58734) 2024-06-03T00:04:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.619+0000 7f124d112640 1 -- 172.21.15.49:0/1752895327 learned_addr learned my addr 172.21.15.49:0/1752895327 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.619+0000 7f124e114640 1 --2- 172.21.15.49:0/1752895327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12481024b0 0x7f124819f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.619+0000 7f124d913640 1 --2- 172.21.15.49:0/1752895327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1248100900 0x7f1248197ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.619+0000 7f124d112640 1 -- 172.21.15.49:0/1752895327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1248100900 msgr2=0x7f1248197ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.619+0000 7f124d112640 1 --2- 172.21.15.49:0/1752895327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1248100900 0x7f1248197ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.619+0000 7f124d112640 1 -- 172.21.15.49:0/1752895327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12481024b0 msgr2=0x7f124819f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.619+0000 7f124d112640 1 --2- 172.21.15.49:0/1752895327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12481024b0 0x7f124819f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.619+0000 7f124d112640 1 -- 172.21.15.49:0/1752895327 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f124819f7c0 con 0x7f1248101af0 2024-06-03T00:04:01.623 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.619+0000 7f124d112640 1 --2- 172.21.15.49:0/1752895327 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1248101af0 0x7f12481980e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f123800c920 tx=0x7f123800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:01.623 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.619+0000 7f123effd640 1 -- 172.21.15.49:0/1752895327 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1238007c70 con 0x7f1248101af0 2024-06-03T00:04:01.623 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.619+0000 7f123effd640 1 -- 172.21.15.49:0/1752895327 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1238007e10 con 0x7f1248101af0 2024-06-03T00:04:01.623 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.619+0000 7f124fb77640 1 -- 172.21.15.49:0/1752895327 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f124819fab0 con 0x7f1248101af0 2024-06-03T00:04:01.623 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.619+0000 7f123effd640 1 -- 172.21.15.49:0/1752895327 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1238018890 con 0x7f1248101af0 2024-06-03T00:04:01.623 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.619+0000 7f124fb77640 1 -- 172.21.15.49:0/1752895327 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12481a0050 con 0x7f1248101af0 2024-06-03T00:04:01.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.622+0000 7f123effd640 1 -- 172.21.15.49:0/1752895327 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1238018a70 con 0x7f1248101af0 2024-06-03T00:04:01.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.622+0000 7f1252963740 1 Processor -- start 2024-06-03T00:04:01.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.622+0000 7f1252963740 1 -- start start 2024-06-03T00:04:01.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.622+0000 7f1252963740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55602a640010 0x55602a640430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:01.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.623+0000 7f1252963740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55602a640a00 0x55602a645500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:01.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.623+0000 7f1252963740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55602a645b70 0x55602a648000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:01.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.623+0000 7f1252963740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55602a5a34f0 con 0x55602a640a00 2024-06-03T00:04:01.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.623+0000 7f1252963740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55602a541870 con 0x55602a640010 2024-06-03T00:04:01.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.623+0000 7f1252963740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55602a59f4b0 con 0x55602a645b70 2024-06-03T00:04:01.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.623+0000 7f124d913640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55602a640a00 0x55602a645500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:01.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.623+0000 7f124d913640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55602a640a00 0x55602a645500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58740/0 (socket says 172.21.15.49:58740) 2024-06-03T00:04:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.623+0000 7f124d913640 1 -- 172.21.15.49:0/1752735327 learned_addr learned my addr 172.21.15.49:0/1752735327 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.623+0000 7f124e114640 1 --2- 172.21.15.49:0/1752735327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55602a640010 0x55602a640430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.623+0000 7f124d112640 1 --2- 172.21.15.49:0/1752735327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55602a645b70 0x55602a648000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.623+0000 7f123effd640 1 --2- 172.21.15.49:0/1752895327 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f12340a2cb0 0x7f12340a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.623+0000 7f124d913640 1 -- 172.21.15.49:0/1752735327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55602a645b70 msgr2=0x55602a648000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.623+0000 7f124d913640 1 --2- 172.21.15.49:0/1752735327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55602a645b70 0x55602a648000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.623+0000 7f124d913640 1 -- 172.21.15.49:0/1752735327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55602a640010 msgr2=0x55602a640430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.623+0000 7f124d913640 1 --2- 172.21.15.49:0/1752735327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55602a640010 0x55602a640430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.623+0000 7f124d913640 1 -- 172.21.15.49:0/1752735327 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55602a55d9b0 con 0x55602a640a00 2024-06-03T00:04:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.623+0000 7f124d112640 1 --2- 172.21.15.49:0/1752735327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55602a645b70 0x55602a648000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:04:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.623+0000 7f124e114640 1 --2- 172.21.15.49:0/1752895327 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f12340a2cb0 0x7f12340a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.623+0000 7f123effd640 1 -- 172.21.15.49:0/1752895327 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f12380cf100 con 0x7f1248101af0 2024-06-03T00:04:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.623+0000 7f124d913640 1 --2- 172.21.15.49:0/1752735327 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55602a640a00 0x55602a645500 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f124400cbc0 tx=0x7f124400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979c26703ad11514 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.624+0000 7f1233fff640 1 -- 172.21.15.49:0/1752735327 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1244010630 con 0x55602a640a00 2024-06-03T00:04:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.624+0000 7f1233fff640 1 -- 172.21.15.49:0/1752735327 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1244010cb0 con 0x55602a640a00 2024-06-03T00:04:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.624+0000 7f1233fff640 1 -- 172.21.15.49:0/1752735327 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124401ac40 con 0x55602a640a00 2024-06-03T00:04:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.624+0000 7f1252963740 1 -- 172.21.15.49:0/1752735327 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55602a640a00 msgr2=0x55602a645500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.624+0000 7f1252963740 1 --2- 172.21.15.49:0/1752735327 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55602a640a00 0x55602a645500 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f124400cbc0 tx=0x7f124400e720 comp rx=0 tx=0).stop 2024-06-03T00:04:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.624+0000 7f124e114640 1 --2- 172.21.15.49:0/1752895327 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f12340a2cb0 0x7f12340a5170 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1240009430 tx=0x7f12400095c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.624+0000 7f1252963740 1 -- 172.21.15.49:0/1752735327 shutdown_connections 2024-06-03T00:04:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.624+0000 7f1252963740 1 --2- 172.21.15.49:0/1752735327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55602a645b70 0x55602a648000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.624+0000 7f1252963740 1 --2- 172.21.15.49:0/1752735327 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55602a640a00 0x55602a645500 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.624+0000 7f1252963740 1 --2- 172.21.15.49:0/1752735327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55602a640010 0x55602a640430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.624+0000 7f1252963740 1 -- 172.21.15.49:0/1752735327 >> 172.21.15.49:0/1752735327 conn(0x55602a63b680 msgr2=0x55602a63ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.625+0000 7f1252963740 1 -- 172.21.15.49:0/1752735327 shutdown_connections 2024-06-03T00:04:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.625+0000 7f1252963740 1 -- 172.21.15.49:0/1752735327 wait complete. 2024-06-03T00:04:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.625+0000 7f1252963740 1 -- start start 2024-06-03T00:04:01.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.625+0000 7f1252963740 1 Processor -- start 2024-06-03T00:04:01.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.625+0000 7f1252963740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55602a640010 0x55602a64a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:01.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.625+0000 7f1252963740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55602a640a00 0x55602a64a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:01.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.626+0000 7f1252963740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55602a645b70 0x55602a6517a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:01.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.626+0000 7f1252963740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55602a648b20 con 0x55602a640a00 2024-06-03T00:04:01.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.626+0000 7f1252963740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55602a52cae0 con 0x55602a640010 2024-06-03T00:04:01.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.626+0000 7f1252963740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55602a648ca0 con 0x55602a645b70 2024-06-03T00:04:01.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.626+0000 7f1252963740 10 client.0 _ll_register_callbacks cb 0x55602a5659b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:04:01.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.626+0000 7f124d112640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55602a640a00 0x55602a64a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:01.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.626+0000 7f124d112640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55602a640a00 0x55602a64a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58744/0 (socket says 172.21.15.49:58744) 2024-06-03T00:04:01.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.626+0000 7f124d112640 1 -- 172.21.15.49:0/410630369 learned_addr learned my addr 172.21.15.49:0/410630369 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:01.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.626+0000 7f124d913640 1 --2- 172.21.15.49:0/410630369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55602a640010 0x55602a64a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:01.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.626+0000 7f124d112640 1 -- 172.21.15.49:0/410630369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55602a645b70 msgr2=0x55602a6517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:01.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.626+0000 7f124e114640 1 --2- 172.21.15.49:0/410630369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55602a645b70 0x55602a6517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:01.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.626+0000 7f124d112640 1 --2- 172.21.15.49:0/410630369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55602a645b70 0x55602a6517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.626+0000 7f124d112640 1 -- 172.21.15.49:0/410630369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55602a640010 msgr2=0x55602a64a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:01.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.626+0000 7f124d112640 1 --2- 172.21.15.49:0/410630369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55602a640010 0x55602a64a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.626+0000 7f124d112640 1 -- 172.21.15.49:0/410630369 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55602a2b7210 con 0x55602a640a00 2024-06-03T00:04:01.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.626+0000 7f124e114640 1 --2- 172.21.15.49:0/410630369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55602a645b70 0x55602a6517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:04:01.634 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.626+0000 7f124d112640 1 --2- 172.21.15.49:0/410630369 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55602a640a00 0x55602a64a760 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f123809b8f0 tx=0x7f123809b380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc0eac365e8566c server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:01.634 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.626+0000 7f12317fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:04:01.634 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.626+0000 7f12317fa640 1 -- 172.21.15.49:0/410630369 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123809b960 con 0x55602a640a00 2024-06-03T00:04:01.634 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.626+0000 7f12317fa640 1 -- 172.21.15.49:0/410630369 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f123800fb30 con 0x55602a640a00 2024-06-03T00:04:01.634 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.626+0000 7f1252963740 1 -- 172.21.15.49:0/410630369 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1244010cb0 con 0x55602a640a00 2024-06-03T00:04:01.634 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.626+0000 7f12317fa640 1 -- 172.21.15.49:0/410630369 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f12380a45d0 con 0x55602a640a00 2024-06-03T00:04:01.634 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.627+0000 7f1252963740 10 client.16215 fetch_fsmap learned FSMap version 37 2024-06-03T00:04:01.634 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.627+0000 7f1252963740 1 -- 172.21.15.49:0/410630369 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55602a383620 con 0x55602a640a00 2024-06-03T00:04:01.634 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.627+0000 7f12317fa640 1 -- 172.21.15.49:0/410630369 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1244010cb0 con 0x55602a640a00 2024-06-03T00:04:01.634 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.627+0000 7f12317fa640 1 -- 172.21.15.49:0/410630369 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f12380860e0 con 0x55602a640a00 2024-06-03T00:04:01.634 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.627+0000 7f1252963740 10 client.16215 fetch_fsmap finished waiting for FSMap version 37 2024-06-03T00:04:01.634 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.627+0000 7f1252963740 10 client.16215 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:04:01.634 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.627+0000 7f1252963740 20 client.16215 populate_metadata read hostname 'smithi049' 2024-06-03T00:04:01.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.627+0000 7f1252963740 1 --2- 172.21.15.49:0/410630369 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55602a656160 0x55602a6585b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:01.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.627+0000 7f1252963740 4 client.16215 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:04:01.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.627+0000 7f1252963740 1 -- 172.21.15.49:0/410630369 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55602a5b6f10 con 0x55602a656160 2024-06-03T00:04:01.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.627+0000 7f124d913640 1 --2- 172.21.15.49:0/410630369 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55602a656160 0x55602a6585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:01.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.628+0000 7f12317fa640 10 client.16215 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:04:01.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.628+0000 7f124d913640 1 --2- 172.21.15.49:0/410630369 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55602a656160 0x55602a6585b0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2a719790658fc02 server_cookie=c9b6a54e456611f1 in_seq=0 out_seq=0 2024-06-03T00:04:01.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.629+0000 7f12317fa640 1 -- 172.21.15.49:0/410630369 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55602a5b6f10 con 0x55602a656160 2024-06-03T00:04:01.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.629+0000 7f12317fa640 10 client.16215 handle_command_reply: tid=0 2024-06-03T00:04:01.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.629+0000 7f1252963740 1 client.16215 shutdown 2024-06-03T00:04:01.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.629+0000 7f1252963740 1 -- 172.21.15.49:0/410630369 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55602a640a00 msgr2=0x55602a64a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:01.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.629+0000 7f1252963740 1 --2- 172.21.15.49:0/410630369 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55602a640a00 0x55602a64a760 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f123809b8f0 tx=0x7f123809b380 comp rx=0 tx=0).stop 2024-06-03T00:04:01.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.629+0000 7f1252963740 1 -- 172.21.15.49:0/410630369 shutdown_connections 2024-06-03T00:04:01.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.629+0000 7f1252963740 1 --2- 172.21.15.49:0/410630369 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55602a656160 0x55602a6585b0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.629+0000 7f1252963740 1 --2- 172.21.15.49:0/410630369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55602a645b70 0x55602a6517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.636 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.629+0000 7f1252963740 1 --2- 172.21.15.49:0/410630369 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55602a640a00 0x55602a64a760 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.636 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.629+0000 7f12317fa640 0 client.16215 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:04:01.636 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.629+0000 7f1252963740 1 --2- 172.21.15.49:0/410630369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55602a640010 0x55602a64a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.636 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.629+0000 7f1252963740 1 -- 172.21.15.49:0/410630369 >> 172.21.15.49:0/410630369 conn(0x55602a63b680 msgr2=0x55602a63a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:01.636 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.629+0000 7f1252963740 1 -- 172.21.15.49:0/410630369 shutdown_connections 2024-06-03T00:04:01.636 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.629+0000 7f1252963740 1 -- 172.21.15.49:0/410630369 wait complete. 2024-06-03T00:04:01.636 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.629+0000 7f1252963740 20 client.16215 trim_cache size 0 max 16384 2024-06-03T00:04:01.650 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.645+0000 7f1252963740 1 Processor -- start 2024-06-03T00:04:01.650 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.645+0000 7f1252963740 1 -- start start 2024-06-03T00:04:01.650 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.645+0000 7f1252963740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55602a640010 0x55602a64a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:01.650 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.645+0000 7f1252963740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55602a640a00 0x55602a64a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:01.650 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.645+0000 7f1252963740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55602a645b70 0x55602a651760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:01.650 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.645+0000 7f1252963740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f12481a8d00 con 0x55602a645b70 2024-06-03T00:04:01.650 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.645+0000 7f1252963740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f12481aaa20 con 0x55602a640a00 2024-06-03T00:04:01.650 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.645+0000 7f1252963740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f12481a9400 con 0x55602a640010 2024-06-03T00:04:01.650 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.645+0000 7f124e114640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55602a645b70 0x55602a651760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:01.650 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.645+0000 7f124e114640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55602a645b70 0x55602a651760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58752/0 (socket says 172.21.15.49:58752) 2024-06-03T00:04:01.651 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.645+0000 7f124e114640 1 -- 172.21.15.49:0/1107468189 learned_addr learned my addr 172.21.15.49:0/1107468189 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:01.651 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.645+0000 7f124d913640 1 --2- 172.21.15.49:0/1107468189 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55602a640010 0x55602a64a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:01.651 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.645+0000 7f124d112640 1 --2- 172.21.15.49:0/1107468189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55602a640a00 0x55602a64a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:01.651 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.645+0000 7f124e114640 1 -- 172.21.15.49:0/1107468189 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55602a640010 msgr2=0x55602a64a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:01.651 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.645+0000 7f124e114640 1 --2- 172.21.15.49:0/1107468189 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55602a640010 0x55602a64a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.651 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.645+0000 7f124e114640 1 -- 172.21.15.49:0/1107468189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55602a640a00 msgr2=0x55602a64a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:01.651 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.645+0000 7f124e114640 1 --2- 172.21.15.49:0/1107468189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55602a640a00 0x55602a64a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.651 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.645+0000 7f124e114640 1 -- 172.21.15.49:0/1107468189 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55602a63b490 con 0x55602a645b70 2024-06-03T00:04:01.651 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.645+0000 7f124d112640 1 --2- 172.21.15.49:0/1107468189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55602a640a00 0x55602a64a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:04:01.651 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.646+0000 7f124e114640 1 --2- 172.21.15.49:0/1107468189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55602a645b70 0x55602a651760 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f1240035000 tx=0x7f1240044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef41d457d8dc73d server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:01.651 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.646+0000 7f12337fe640 1 -- 172.21.15.49:0/1107468189 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124002fe90 con 0x55602a645b70 2024-06-03T00:04:01.651 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.646+0000 7f12337fe640 1 -- 172.21.15.49:0/1107468189 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1240036040 con 0x55602a645b70 2024-06-03T00:04:01.651 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.646+0000 7f12337fe640 1 -- 172.21.15.49:0/1107468189 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12400469a0 con 0x55602a645b70 2024-06-03T00:04:01.651 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.646+0000 7f1252963740 1 -- 172.21.15.49:0/1107468189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55602a645b70 msgr2=0x55602a651760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.646+0000 7f1252963740 1 --2- 172.21.15.49:0/1107468189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55602a645b70 0x55602a651760 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f1240035000 tx=0x7f1240044000 comp rx=0 tx=0).stop 2024-06-03T00:04:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.646+0000 7f1252963740 1 -- 172.21.15.49:0/1107468189 shutdown_connections 2024-06-03T00:04:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.646+0000 7f1252963740 1 --2- 172.21.15.49:0/1107468189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55602a640a00 0x55602a64a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.646+0000 7f1252963740 1 --2- 172.21.15.49:0/1107468189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55602a645b70 0x55602a651760 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.646+0000 7f1252963740 1 --2- 172.21.15.49:0/1107468189 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55602a640010 0x55602a64a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.646+0000 7f1252963740 1 -- 172.21.15.49:0/1107468189 >> 172.21.15.49:0/1107468189 conn(0x55602a63b680 msgr2=0x55602a645210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.646+0000 7f1252963740 1 -- 172.21.15.49:0/1107468189 shutdown_connections 2024-06-03T00:04:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.646+0000 7f1252963740 1 -- 172.21.15.49:0/1107468189 wait complete. 2024-06-03T00:04:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.647+0000 7f1252963740 1 -- start start 2024-06-03T00:04:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.647+0000 7f1252963740 1 Processor -- start 2024-06-03T00:04:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.647+0000 7f1252963740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55602a640010 0x55602a64e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.647+0000 7f1252963740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55602a640a00 0x55602a64e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.647+0000 7f1252963740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55602a645b70 0x55602a6bee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.647+0000 7f1252963740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f12481aa290 con 0x55602a640a00 2024-06-03T00:04:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.647+0000 7f1252963740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f12481a9b30 con 0x55602a645b70 2024-06-03T00:04:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.647+0000 7f1252963740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f12481a6cc0 con 0x55602a640010 2024-06-03T00:04:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.647+0000 7f1252963740 10 client.0 _ll_register_callbacks cb 0x7f123809b820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:04:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.647+0000 7f124d112640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55602a640a00 0x55602a64e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.647+0000 7f124d112640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55602a640a00 0x55602a64e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58766/0 (socket says 172.21.15.49:58766) 2024-06-03T00:04:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.647+0000 7f124d112640 1 -- 172.21.15.49:0/2703433477 learned_addr learned my addr 172.21.15.49:0/2703433477 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.647+0000 7f124d913640 1 --2- 172.21.15.49:0/2703433477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55602a640010 0x55602a64e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.648+0000 7f124e114640 1 --2- 172.21.15.49:0/2703433477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55602a645b70 0x55602a6bee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.648+0000 7f124d112640 1 -- 172.21.15.49:0/2703433477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55602a640010 msgr2=0x55602a64e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.648+0000 7f124d112640 1 --2- 172.21.15.49:0/2703433477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55602a640010 0x55602a64e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.648+0000 7f124d112640 1 -- 172.21.15.49:0/2703433477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55602a645b70 msgr2=0x55602a6bee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.648+0000 7f124d112640 1 --2- 172.21.15.49:0/2703433477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55602a645b70 0x55602a6bee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.648+0000 7f124d112640 1 -- 172.21.15.49:0/2703433477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55602a64f080 con 0x55602a640a00 2024-06-03T00:04:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.648+0000 7f124d112640 1 --2- 172.21.15.49:0/2703433477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55602a640a00 0x55602a64e9e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f123800c8f0 tx=0x7f123809c190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe49a2e52fa85dd0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.648+0000 7f12317fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:04:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.648+0000 7f12317fa640 1 -- 172.21.15.49:0/2703433477 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123809fd10 con 0x55602a640a00 2024-06-03T00:04:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.648+0000 7f12317fa640 1 -- 172.21.15.49:0/2703433477 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f12380a4140 con 0x55602a640a00 2024-06-03T00:04:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.648+0000 7f1252963740 1 -- 172.21.15.49:0/2703433477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1240036040 con 0x55602a640a00 2024-06-03T00:04:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.648+0000 7f12317fa640 1 -- 172.21.15.49:0/2703433477 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f12380ba1a0 con 0x55602a640a00 2024-06-03T00:04:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.648+0000 7f1252963740 10 client.16221 fetch_fsmap learned FSMap version 37 2024-06-03T00:04:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.648+0000 7f1252963740 1 -- 172.21.15.49:0/2703433477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55602a6c04c0 con 0x55602a640a00 2024-06-03T00:04:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.649+0000 7f12317fa640 1 -- 172.21.15.49:0/2703433477 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1240036040 con 0x55602a640a00 2024-06-03T00:04:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.649+0000 7f12317fa640 1 -- 172.21.15.49:0/2703433477 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f12380d2120 con 0x55602a640a00 2024-06-03T00:04:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.649+0000 7f1252963740 10 client.16221 fetch_fsmap finished waiting for FSMap version 37 2024-06-03T00:04:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.649+0000 7f1252963740 10 client.16221 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:04:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.649+0000 7f1252963740 20 client.16221 populate_metadata read hostname 'smithi049' 2024-06-03T00:04:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.649+0000 7f1252963740 1 --2- 172.21.15.49:0/2703433477 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55602a6c0ea0 0x55602a6c32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.649+0000 7f1252963740 4 client.16221 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-03T00:04:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.649+0000 7f1252963740 1 -- 172.21.15.49:0/2703433477 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55602a5b0c20 con 0x55602a6c0ea0 2024-06-03T00:04:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.649+0000 7f124d913640 1 --2- 172.21.15.49:0/2703433477 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55602a6c0ea0 0x55602a6c32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.649+0000 7f124d913640 1 --2- 172.21.15.49:0/2703433477 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55602a6c0ea0 0x55602a6c32c0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=baecffc74f67d319 server_cookie=19a556dd853ed07c in_seq=0 out_seq=0 2024-06-03T00:04:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.649+0000 7f12317fa640 10 client.16221 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:04:01.667 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.667+0000 7f12317fa640 1 -- 172.21.15.49:0/2703433477 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55602a5b0c20 con 0x55602a6c0ea0 2024-06-03T00:04:01.667 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.667+0000 7f12317fa640 10 client.16221 handle_command_reply: tid=0 2024-06-03T00:04:01.667 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.667+0000 7f1252963740 1 client.16221 shutdown 2024-06-03T00:04:01.667 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.667+0000 7f1252963740 1 -- 172.21.15.49:0/2703433477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55602a640a00 msgr2=0x55602a64e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:01.667 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.667+0000 7f1252963740 1 --2- 172.21.15.49:0/2703433477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55602a640a00 0x55602a64e9e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f123800c8f0 tx=0x7f123809c190 comp rx=0 tx=0).stop 2024-06-03T00:04:01.667 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.667+0000 7f1252963740 1 -- 172.21.15.49:0/2703433477 shutdown_connections 2024-06-03T00:04:01.667 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.667+0000 7f1252963740 1 --2- 172.21.15.49:0/2703433477 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55602a6c0ea0 0x55602a6c32c0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.668 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.667+0000 7f12317fa640 0 client.16221 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:04:01.668 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.667+0000 7f1252963740 1 --2- 172.21.15.49:0/2703433477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55602a645b70 0x55602a6bee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.668 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.667+0000 7f1252963740 1 --2- 172.21.15.49:0/2703433477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55602a640a00 0x55602a64e9e0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.668 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.667+0000 7f1252963740 1 --2- 172.21.15.49:0/2703433477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55602a640010 0x55602a64e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.668 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.667+0000 7f1252963740 1 -- 172.21.15.49:0/2703433477 >> 172.21.15.49:0/2703433477 conn(0x55602a63b680 msgr2=0x55602a64a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:01.668 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.667+0000 7f1252963740 1 -- 172.21.15.49:0/2703433477 shutdown_connections 2024-06-03T00:04:01.668 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.667+0000 7f1252963740 1 -- 172.21.15.49:0/2703433477 wait complete. 2024-06-03T00:04:01.668 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.667+0000 7f1252963740 20 client.16221 trim_cache size 0 max 16384 2024-06-03T00:04:01.668 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-06-03T00:04:01.668 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-06-03T00:04:01.668 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-06-03T00:04:01.669 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.667+0000 7f124fb77640 1 -- 172.21.15.49:0/1752895327 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f12340a2cb0 msgr2=0x7f12340a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:01.669 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.667+0000 7f124fb77640 1 --2- 172.21.15.49:0/1752895327 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f12340a2cb0 0x7f12340a5170 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1240009430 tx=0x7f12400095c0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.669 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.667+0000 7f124fb77640 1 -- 172.21.15.49:0/1752895327 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1248101af0 msgr2=0x7f12481980e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:01.669 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.667+0000 7f124fb77640 1 --2- 172.21.15.49:0/1752895327 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1248101af0 0x7f12481980e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f123800c920 tx=0x7f123800cde0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.669 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.667+0000 7f124fb77640 1 -- 172.21.15.49:0/1752895327 shutdown_connections 2024-06-03T00:04:01.669 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.667+0000 7f124fb77640 1 --2- 172.21.15.49:0/1752895327 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f12340a2cb0 0x7f12340a5170 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.669 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.667+0000 7f124fb77640 1 --2- 172.21.15.49:0/1752895327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12481024b0 0x7f124819f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.667+0000 7f124fb77640 1 --2- 172.21.15.49:0/1752895327 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1248101af0 0x7f12481980e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.667+0000 7f124fb77640 1 --2- 172.21.15.49:0/1752895327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1248100900 0x7f1248197ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.667+0000 7f124fb77640 1 -- 172.21.15.49:0/1752895327 >> 172.21.15.49:0/1752895327 conn(0x7f12480fbe70 msgr2=0x7f1248104d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.667+0000 7f124fb77640 1 -- 172.21.15.49:0/1752895327 shutdown_connections 2024-06-03T00:04:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:01.667+0000 7f124fb77640 1 -- 172.21.15.49:0/1752895327 wait complete. 2024-06-03T00:04:02.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:02 smithi057 ceph-mon[36457]: pgmap v503: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 404 KiB/s wr, 176 op/s 2024-06-03T00:04:02.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:02 smithi049 ceph-mon[32302]: pgmap v503: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 404 KiB/s wr, 176 op/s 2024-06-03T00:04:02.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:02 smithi107 ceph-mon[37048]: pgmap v503: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 404 KiB/s wr, 176 op/s 2024-06-03T00:04:04.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:04 smithi057 ceph-mon[36457]: pgmap v504: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 242 KiB/s wr, 151 op/s 2024-06-03T00:04:04.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:04 smithi049 ceph-mon[32302]: pgmap v504: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 242 KiB/s wr, 151 op/s 2024-06-03T00:04:04.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:04 smithi107 ceph-mon[37048]: pgmap v504: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 242 KiB/s wr, 151 op/s 2024-06-03T00:04:06.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:06 smithi057 ceph-mon[36457]: pgmap v505: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 230 KiB/s wr, 107 op/s 2024-06-03T00:04:06.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:06 smithi049 ceph-mon[32302]: pgmap v505: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 230 KiB/s wr, 107 op/s 2024-06-03T00:04:06.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:06 smithi107 ceph-mon[37048]: pgmap v505: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 230 KiB/s wr, 107 op/s 2024-06-03T00:04:08.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:08 smithi057 ceph-mon[36457]: pgmap v506: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 40 KiB/s wr, 35 op/s 2024-06-03T00:04:08.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:08 smithi049 ceph-mon[32302]: pgmap v506: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 40 KiB/s wr, 35 op/s 2024-06-03T00:04:08.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:08 smithi107 ceph-mon[37048]: pgmap v506: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 40 KiB/s wr, 35 op/s 2024-06-03T00:04:10.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:10 smithi057 ceph-mon[36457]: pgmap v507: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 32 op/s 2024-06-03T00:04:10.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:10 smithi049 ceph-mon[32302]: pgmap v507: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 32 op/s 2024-06-03T00:04:10.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:10 smithi107 ceph-mon[37048]: pgmap v507: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 32 op/s 2024-06-03T00:04:12.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:12 smithi057 ceph-mon[36457]: pgmap v508: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-06-03T00:04:12.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:12 smithi049 ceph-mon[32302]: pgmap v508: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-06-03T00:04:12.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:12 smithi107 ceph-mon[37048]: pgmap v508: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-06-03T00:04:13.952 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-03T00:04:14.220 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:04:14.646 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:14 smithi049 ceph-mon[32302]: pgmap v509: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.7 KiB/s wr, 15 op/s 2024-06-03T00:04:14.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:14 smithi057 ceph-mon[36457]: pgmap v509: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.7 KiB/s wr, 15 op/s 2024-06-03T00:04:14.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.759+0000 7f9d41329640 1 -- 172.21.15.49:0/942826601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d3c1024b0 msgr2=0x7f9d3c108d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:14.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.759+0000 7f9d41329640 1 --2- 172.21.15.49:0/942826601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d3c1024b0 0x7f9d3c108d40 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9d34009ca0 tx=0x7f9d3402a8c0 comp rx=0 tx=0).stop 2024-06-03T00:04:14.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.759+0000 7f9d41329640 1 -- 172.21.15.49:0/942826601 shutdown_connections 2024-06-03T00:04:14.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.759+0000 7f9d41329640 1 --2- 172.21.15.49:0/942826601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d3c101af0 0x7f9d3c101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:14.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.759+0000 7f9d41329640 1 --2- 172.21.15.49:0/942826601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d3c1024b0 0x7f9d3c108d40 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:14.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.759+0000 7f9d41329640 1 --2- 172.21.15.49:0/942826601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d3c100900 0x7f9d3c100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:14.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.759+0000 7f9d41329640 1 -- 172.21.15.49:0/942826601 >> 172.21.15.49:0/942826601 conn(0x7f9d3c0fbe70 msgr2=0x7f9d3c0fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:14.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.759+0000 7f9d41329640 1 -- 172.21.15.49:0/942826601 shutdown_connections 2024-06-03T00:04:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.759+0000 7f9d41329640 1 -- 172.21.15.49:0/942826601 wait complete. 2024-06-03T00:04:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.760+0000 7f9d41329640 1 Processor -- start 2024-06-03T00:04:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.760+0000 7f9d41329640 1 -- start start 2024-06-03T00:04:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.760+0000 7f9d41329640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d3c100900 0x7f9d3c197c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.760+0000 7f9d41329640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d3c101af0 0x7f9d3c198160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.760+0000 7f9d41329640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d3c1024b0 0x7f9d3c19f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.760+0000 7f9d41329640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c10d6a0 con 0x7f9d3c100900 2024-06-03T00:04:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.760+0000 7f9d41329640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c10d520 con 0x7f9d3c101af0 2024-06-03T00:04:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.760+0000 7f9d41329640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c10d820 con 0x7f9d3c1024b0 2024-06-03T00:04:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.760+0000 7f9d3affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d3c100900 0x7f9d3c197c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.760+0000 7f9d3affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d3c100900 0x7f9d3c197c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58100/0 (socket says 172.21.15.49:58100) 2024-06-03T00:04:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.760+0000 7f9d3affd640 1 -- 172.21.15.49:0/1765672101 learned_addr learned my addr 172.21.15.49:0/1765672101 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.760+0000 7f9d3b7fe640 1 --2- 172.21.15.49:0/1765672101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d3c1024b0 0x7f9d3c19f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.760+0000 7f9d33fff640 1 --2- 172.21.15.49:0/1765672101 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d3c101af0 0x7f9d3c198160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.760+0000 7f9d3affd640 1 -- 172.21.15.49:0/1765672101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d3c1024b0 msgr2=0x7f9d3c19f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.760+0000 7f9d3affd640 1 --2- 172.21.15.49:0/1765672101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d3c1024b0 0x7f9d3c19f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.760+0000 7f9d3affd640 1 -- 172.21.15.49:0/1765672101 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d3c101af0 msgr2=0x7f9d3c198160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.760+0000 7f9d3affd640 1 --2- 172.21.15.49:0/1765672101 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d3c101af0 0x7f9d3c198160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.760+0000 7f9d3affd640 1 -- 172.21.15.49:0/1765672101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d3c19f830 con 0x7f9d3c100900 2024-06-03T00:04:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.761+0000 7f9d3affd640 1 --2- 172.21.15.49:0/1765672101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d3c100900 0x7f9d3c197c20 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c00e9c0 tx=0x7f9d2c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.761+0000 7f9d38ff9640 1 -- 172.21.15.49:0/1765672101 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c00cd80 con 0x7f9d3c100900 2024-06-03T00:04:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.761+0000 7f9d38ff9640 1 -- 172.21.15.49:0/1765672101 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d2c0035f0 con 0x7f9d3c100900 2024-06-03T00:04:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.761+0000 7f9d41329640 1 -- 172.21.15.49:0/1765672101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d3c19fb20 con 0x7f9d3c100900 2024-06-03T00:04:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.761+0000 7f9d38ff9640 1 -- 172.21.15.49:0/1765672101 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c010690 con 0x7f9d3c100900 2024-06-03T00:04:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.761+0000 7f9d41329640 1 -- 172.21.15.49:0/1765672101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d3c1a0020 con 0x7f9d3c100900 2024-06-03T00:04:14.769 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.763+0000 7f9d38ff9640 1 -- 172.21.15.49:0/1765672101 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9d2c0037a0 con 0x7f9d3c100900 2024-06-03T00:04:14.770 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.763+0000 7f9d44038740 1 Processor -- start 2024-06-03T00:04:14.770 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.763+0000 7f9d44038740 1 -- start start 2024-06-03T00:04:14.770 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.764+0000 7f9d44038740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc8a4d5010 0x55dc8a4d5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:14.770 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.764+0000 7f9d44038740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dc8a4d5a00 0x55dc8a4da500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:14.770 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.764+0000 7f9d44038740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dc8a4dab70 0x55dc8a4dd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:14.770 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.764+0000 7f9d44038740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55dc8a4384f0 con 0x55dc8a4dab70 2024-06-03T00:04:14.770 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.764+0000 7f9d44038740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55dc8a3d6870 con 0x55dc8a4d5010 2024-06-03T00:04:14.770 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.764+0000 7f9d44038740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55dc8a4344b0 con 0x55dc8a4d5a00 2024-06-03T00:04:14.770 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.764+0000 7f9d33fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dc8a4dab70 0x55dc8a4dd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:14.770 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.764+0000 7f9d33fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dc8a4dab70 0x55dc8a4dd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58116/0 (socket says 172.21.15.49:58116) 2024-06-03T00:04:14.770 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.764+0000 7f9d33fff640 1 -- 172.21.15.49:0/1108499196 learned_addr learned my addr 172.21.15.49:0/1108499196 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:14.770 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.764+0000 7f9d3b7fe640 1 --2- 172.21.15.49:0/1108499196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc8a4d5010 0x55dc8a4d5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:14.771 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.764+0000 7f9d3affd640 1 --2- 172.21.15.49:0/1108499196 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dc8a4d5a00 0x55dc8a4da500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:14.771 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.764+0000 7f9d33fff640 1 -- 172.21.15.49:0/1108499196 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dc8a4d5a00 msgr2=0x55dc8a4da500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:14.771 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.764+0000 7f9d33fff640 1 --2- 172.21.15.49:0/1108499196 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dc8a4d5a00 0x55dc8a4da500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:14.771 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.764+0000 7f9d33fff640 1 -- 172.21.15.49:0/1108499196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc8a4d5010 msgr2=0x55dc8a4d5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:14.771 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.764+0000 7f9d33fff640 1 --2- 172.21.15.49:0/1108499196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc8a4d5010 0x55dc8a4d5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:14.771 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.764+0000 7f9d33fff640 1 -- 172.21.15.49:0/1108499196 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc8a3f29b0 con 0x55dc8a4dab70 2024-06-03T00:04:14.771 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.764+0000 7f9d38ff9640 1 --2- 172.21.15.49:0/1765672101 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9d280a2c30 0x7f9d280a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:14.771 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.764+0000 7f9d3b7fe640 1 --2- 172.21.15.49:0/1765672101 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9d280a2c30 0x7f9d280a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:14.771 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.764+0000 7f9d33fff640 1 --2- 172.21.15.49:0/1108499196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dc8a4dab70 0x55dc8a4dd000 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9d2400dcb0 tx=0x7f9d2400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c7a5eb6d9d764c3 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:14.771 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.764+0000 7f9d38ff9640 1 -- 172.21.15.49:0/1765672101 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f9d2c0cf4d0 con 0x7f9d3c100900 2024-06-03T00:04:14.771 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.765+0000 7f9d317fa640 1 -- 172.21.15.49:0/1108499196 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d24011440 con 0x55dc8a4dab70 2024-06-03T00:04:14.771 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.765+0000 7f9d317fa640 1 -- 172.21.15.49:0/1108499196 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d24011ac0 con 0x55dc8a4dab70 2024-06-03T00:04:14.771 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.765+0000 7f9d317fa640 1 -- 172.21.15.49:0/1108499196 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2401baf0 con 0x55dc8a4dab70 2024-06-03T00:04:14.772 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.765+0000 7f9d44038740 1 -- 172.21.15.49:0/1108499196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dc8a4dab70 msgr2=0x55dc8a4dd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:14.772 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.765+0000 7f9d3b7fe640 1 --2- 172.21.15.49:0/1765672101 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9d280a2c30 0x7f9d280a50f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9d34005e30 tx=0x7f9d3403d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:14.772 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.765+0000 7f9d44038740 1 --2- 172.21.15.49:0/1108499196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dc8a4dab70 0x55dc8a4dd000 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9d2400dcb0 tx=0x7f9d2400f730 comp rx=0 tx=0).stop 2024-06-03T00:04:14.772 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.766+0000 7f9d44038740 1 -- 172.21.15.49:0/1108499196 shutdown_connections 2024-06-03T00:04:14.772 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.766+0000 7f9d44038740 1 --2- 172.21.15.49:0/1108499196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dc8a4dab70 0x55dc8a4dd000 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:14.772 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.766+0000 7f9d44038740 1 --2- 172.21.15.49:0/1108499196 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dc8a4d5a00 0x55dc8a4da500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:14.772 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.766+0000 7f9d44038740 1 --2- 172.21.15.49:0/1108499196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc8a4d5010 0x55dc8a4d5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:14.772 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.766+0000 7f9d44038740 1 -- 172.21.15.49:0/1108499196 >> 172.21.15.49:0/1108499196 conn(0x55dc8a4d0680 msgr2=0x55dc8a4d0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:14.772 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.766+0000 7f9d44038740 1 -- 172.21.15.49:0/1108499196 shutdown_connections 2024-06-03T00:04:14.772 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.766+0000 7f9d44038740 1 -- 172.21.15.49:0/1108499196 wait complete. 2024-06-03T00:04:14.772 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.766+0000 7f9d44038740 1 -- start start 2024-06-03T00:04:14.772 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.766+0000 7f9d44038740 1 Processor -- start 2024-06-03T00:04:14.772 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.766+0000 7f9d44038740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dc8a4d5010 0x55dc8a4df250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:14.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.766+0000 7f9d44038740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dc8a4d5a00 0x55dc8a4df790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:14.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.766+0000 7f9d44038740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc8a4dab70 0x55dc8a4e67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:14.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.766+0000 7f9d44038740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55dc8a4ddb20 con 0x55dc8a4d5010 2024-06-03T00:04:14.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.766+0000 7f9d44038740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55dc8a3c1ae0 con 0x55dc8a4dab70 2024-06-03T00:04:14.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.766+0000 7f9d44038740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55dc8a4ddca0 con 0x55dc8a4d5a00 2024-06-03T00:04:14.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.766+0000 7f9d3affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dc8a4d5010 0x55dc8a4df250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:14.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.766+0000 7f9d44038740 10 client.0 _ll_register_callbacks cb 0x55dc8a3fa9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:04:14.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.766+0000 7f9d3affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dc8a4d5010 0x55dc8a4df250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58132/0 (socket says 172.21.15.49:58132) 2024-06-03T00:04:14.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.766+0000 7f9d3affd640 1 -- 172.21.15.49:0/3511789994 learned_addr learned my addr 172.21.15.49:0/3511789994 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:14.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.766+0000 7f9d33fff640 1 --2- 172.21.15.49:0/3511789994 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dc8a4d5a00 0x55dc8a4df790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:14.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.767+0000 7f9d3b7fe640 1 --2- 172.21.15.49:0/3511789994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc8a4dab70 0x55dc8a4e67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:14.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.767+0000 7f9d3affd640 1 -- 172.21.15.49:0/3511789994 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dc8a4d5a00 msgr2=0x55dc8a4df790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:14.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.767+0000 7f9d3affd640 1 --2- 172.21.15.49:0/3511789994 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dc8a4d5a00 0x55dc8a4df790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:14.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.767+0000 7f9d3affd640 1 -- 172.21.15.49:0/3511789994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc8a4dab70 msgr2=0x55dc8a4e67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:14.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.767+0000 7f9d3affd640 1 --2- 172.21.15.49:0/3511789994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc8a4dab70 0x55dc8a4e67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:14.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.767+0000 7f9d3affd640 1 -- 172.21.15.49:0/3511789994 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc8a14c210 con 0x55dc8a4d5010 2024-06-03T00:04:14.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.767+0000 7f9d3affd640 1 --2- 172.21.15.49:0/3511789994 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dc8a4d5010 0x55dc8a4df250 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c098670 tx=0x7f9d2c098000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada80b443059ccf9 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:14.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.767+0000 7f9d227fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:04:14.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.767+0000 7f9d227fc640 1 -- 172.21.15.49:0/3511789994 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c099e70 con 0x55dc8a4d5010 2024-06-03T00:04:14.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.767+0000 7f9d227fc640 1 -- 172.21.15.49:0/3511789994 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f9d2c0cf0d0 con 0x55dc8a4d5010 2024-06-03T00:04:14.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.767+0000 7f9d44038740 1 -- 172.21.15.49:0/3511789994 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d24011ac0 con 0x55dc8a4d5010 2024-06-03T00:04:14.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.767+0000 7f9d227fc640 1 -- 172.21.15.49:0/3511789994 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f9d2c09c430 con 0x55dc8a4d5010 2024-06-03T00:04:14.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.767+0000 7f9d44038740 10 client.16233 fetch_fsmap learned FSMap version 37 2024-06-03T00:04:14.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.767+0000 7f9d44038740 1 -- 172.21.15.49:0/3511789994 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55dc8a218620 con 0x55dc8a4d5010 2024-06-03T00:04:14.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.767+0000 7f9d227fc640 1 -- 172.21.15.49:0/3511789994 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d24011ac0 con 0x55dc8a4d5010 2024-06-03T00:04:14.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.767+0000 7f9d227fc640 1 -- 172.21.15.49:0/3511789994 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f9d2c0b2020 con 0x55dc8a4d5010 2024-06-03T00:04:14.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.767+0000 7f9d44038740 10 client.16233 fetch_fsmap finished waiting for FSMap version 37 2024-06-03T00:04:14.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.767+0000 7f9d44038740 10 client.16233 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:04:14.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.767+0000 7f9d44038740 20 client.16233 populate_metadata read hostname 'smithi049' 2024-06-03T00:04:14.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.767+0000 7f9d44038740 1 --2- 172.21.15.49:0/3511789994 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55dc8a4eb120 0x55dc8a4ed5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:14.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.767+0000 7f9d44038740 4 client.16233 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:04:14.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.767+0000 7f9d44038740 1 -- 172.21.15.49:0/3511789994 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc8a44bf10 con 0x55dc8a4eb120 2024-06-03T00:04:14.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.768+0000 7f9d33fff640 1 --2- 172.21.15.49:0/3511789994 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55dc8a4eb120 0x55dc8a4ed5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:14.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.768+0000 7f9d33fff640 1 --2- 172.21.15.49:0/3511789994 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55dc8a4eb120 0x55dc8a4ed5c0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84cb8d790c3e23bc server_cookie=bf969852f17d52b4 in_seq=0 out_seq=0 2024-06-03T00:04:14.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.768+0000 7f9d227fc640 10 client.16233 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:04:14.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.769+0000 7f9d227fc640 1 -- 172.21.15.49:0/3511789994 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55dc8a44bf10 con 0x55dc8a4eb120 2024-06-03T00:04:14.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.769+0000 7f9d227fc640 10 client.16233 handle_command_reply: tid=0 2024-06-03T00:04:14.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.769+0000 7f9d44038740 1 client.16233 shutdown 2024-06-03T00:04:14.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.769+0000 7f9d44038740 1 -- 172.21.15.49:0/3511789994 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dc8a4d5010 msgr2=0x55dc8a4df250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:14.776 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.769+0000 7f9d44038740 1 --2- 172.21.15.49:0/3511789994 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dc8a4d5010 0x55dc8a4df250 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c098670 tx=0x7f9d2c098000 comp rx=0 tx=0).stop 2024-06-03T00:04:14.776 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.769+0000 7f9d44038740 1 -- 172.21.15.49:0/3511789994 shutdown_connections 2024-06-03T00:04:14.776 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.769+0000 7f9d44038740 1 --2- 172.21.15.49:0/3511789994 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55dc8a4eb120 0x55dc8a4ed5c0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:14.776 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.769+0000 7f9d44038740 1 --2- 172.21.15.49:0/3511789994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc8a4dab70 0x55dc8a4e67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:14.776 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.769+0000 7f9d227fc640 0 client.16233 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:04:14.776 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.769+0000 7f9d44038740 1 --2- 172.21.15.49:0/3511789994 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dc8a4d5a00 0x55dc8a4df790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:14.776 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.769+0000 7f9d44038740 1 --2- 172.21.15.49:0/3511789994 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dc8a4d5010 0x55dc8a4df250 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:14.776 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.769+0000 7f9d44038740 1 -- 172.21.15.49:0/3511789994 >> 172.21.15.49:0/3511789994 conn(0x55dc8a4d0680 msgr2=0x55dc8a4cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:14.776 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.769+0000 7f9d44038740 1 -- 172.21.15.49:0/3511789994 shutdown_connections 2024-06-03T00:04:14.776 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.769+0000 7f9d44038740 1 -- 172.21.15.49:0/3511789994 wait complete. 2024-06-03T00:04:14.776 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.770+0000 7f9d44038740 20 client.16233 trim_cache size 0 max 16384 2024-06-03T00:04:14.785 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.785+0000 7f9d44038740 1 Processor -- start 2024-06-03T00:04:14.786 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.785+0000 7f9d44038740 1 -- start start 2024-06-03T00:04:14.786 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.785+0000 7f9d44038740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dc8a4d5010 0x55dc8a4da240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:14.786 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.785+0000 7f9d44038740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc8a4d5a00 0x55dc8a4d3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:14.786 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.785+0000 7f9d44038740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dc8a4dab70 0x55dc8a4d3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:14.786 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.785+0000 7f9d44038740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c1a8ef0 con 0x55dc8a4d5010 2024-06-03T00:04:14.786 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.785+0000 7f9d44038740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c1aac10 con 0x55dc8a4d5a00 2024-06-03T00:04:14.786 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.785+0000 7f9d44038740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c1a95f0 con 0x55dc8a4dab70 2024-06-03T00:04:14.786 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.785+0000 7f9d3affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dc8a4d5010 0x55dc8a4da240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:14.786 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.785+0000 7f9d3affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dc8a4d5010 0x55dc8a4da240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58148/0 (socket says 172.21.15.49:58148) 2024-06-03T00:04:14.786 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.785+0000 7f9d3affd640 1 -- 172.21.15.49:0/1210287368 learned_addr learned my addr 172.21.15.49:0/1210287368 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:14.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.785+0000 7f9d3b7fe640 1 --2- 172.21.15.49:0/1210287368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dc8a4dab70 0x55dc8a4d3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:14.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.785+0000 7f9d33fff640 1 --2- 172.21.15.49:0/1210287368 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc8a4d5a00 0x55dc8a4d3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:14.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.785+0000 7f9d3affd640 1 -- 172.21.15.49:0/1210287368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dc8a4dab70 msgr2=0x55dc8a4d3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:14.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.785+0000 7f9d3affd640 1 --2- 172.21.15.49:0/1210287368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dc8a4dab70 0x55dc8a4d3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:14.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.785+0000 7f9d3affd640 1 -- 172.21.15.49:0/1210287368 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc8a4d5a00 msgr2=0x55dc8a4d3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:14.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.785+0000 7f9d3affd640 1 --2- 172.21.15.49:0/1210287368 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc8a4d5a00 0x55dc8a4d3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:14.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.786+0000 7f9d3affd640 1 -- 172.21.15.49:0/1210287368 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc8a4d04b0 con 0x55dc8a4d5010 2024-06-03T00:04:14.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.786+0000 7f9d33fff640 1 --2- 172.21.15.49:0/1210287368 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc8a4d5a00 0x55dc8a4d3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:04:14.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.786+0000 7f9d3affd640 1 --2- 172.21.15.49:0/1210287368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dc8a4d5010 0x55dc8a4da240 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c003ec0 tx=0x7f9d2c099d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f26c5d3087068c52 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:14.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.786+0000 7f9d30ff9640 1 -- 172.21.15.49:0/1210287368 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c099e70 con 0x55dc8a4d5010 2024-06-03T00:04:14.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.786+0000 7f9d30ff9640 1 -- 172.21.15.49:0/1210287368 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d2c09bd30 con 0x55dc8a4d5010 2024-06-03T00:04:14.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.786+0000 7f9d30ff9640 1 -- 172.21.15.49:0/1210287368 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c09b180 con 0x55dc8a4d5010 2024-06-03T00:04:14.790 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.786+0000 7f9d44038740 1 -- 172.21.15.49:0/1210287368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dc8a4d5010 msgr2=0x55dc8a4da240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:14.790 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.786+0000 7f9d44038740 1 --2- 172.21.15.49:0/1210287368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dc8a4d5010 0x55dc8a4da240 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c003ec0 tx=0x7f9d2c099d40 comp rx=0 tx=0).stop 2024-06-03T00:04:14.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.787+0000 7f9d44038740 1 -- 172.21.15.49:0/1210287368 shutdown_connections 2024-06-03T00:04:14.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.787+0000 7f9d44038740 1 --2- 172.21.15.49:0/1210287368 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc8a4d5a00 0x55dc8a4d3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:14.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.787+0000 7f9d44038740 1 --2- 172.21.15.49:0/1210287368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dc8a4dab70 0x55dc8a4d3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:14.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.787+0000 7f9d44038740 1 --2- 172.21.15.49:0/1210287368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dc8a4d5010 0x55dc8a4da240 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:14.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.787+0000 7f9d44038740 1 -- 172.21.15.49:0/1210287368 >> 172.21.15.49:0/1210287368 conn(0x55dc8a4d0680 msgr2=0x55dc8a4d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:14.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.787+0000 7f9d44038740 1 -- 172.21.15.49:0/1210287368 shutdown_connections 2024-06-03T00:04:14.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.787+0000 7f9d44038740 1 -- 172.21.15.49:0/1210287368 wait complete. 2024-06-03T00:04:14.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.787+0000 7f9d44038740 1 -- start start 2024-06-03T00:04:14.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.787+0000 7f9d44038740 1 Processor -- start 2024-06-03T00:04:14.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.787+0000 7f9d44038740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dc8a4d5010 0x55dc8a550ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:14.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.787+0000 7f9d44038740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dc8a4d5a00 0x55dc8a5510e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:14.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.787+0000 7f9d44038740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc8a4dab70 0x55dc8a558120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:14.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.787+0000 7f9d44038740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c1aa480 con 0x55dc8a4d5010 2024-06-03T00:04:14.792 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.787+0000 7f9d44038740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c1a9d20 con 0x55dc8a4dab70 2024-06-03T00:04:14.792 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.787+0000 7f9d44038740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c1a6eb0 con 0x55dc8a4d5a00 2024-06-03T00:04:14.792 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.787+0000 7f9d44038740 10 client.0 _ll_register_callbacks cb 0x7f9d2c003e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:04:14.792 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.787+0000 7f9d3affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dc8a4d5010 0x55dc8a550ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:14.792 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.787+0000 7f9d3affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dc8a4d5010 0x55dc8a550ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58162/0 (socket says 172.21.15.49:58162) 2024-06-03T00:04:14.792 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.787+0000 7f9d3affd640 1 -- 172.21.15.49:0/766611923 learned_addr learned my addr 172.21.15.49:0/766611923 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:14.792 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.787+0000 7f9d33fff640 1 --2- 172.21.15.49:0/766611923 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dc8a4d5a00 0x55dc8a5510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:14.792 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.788+0000 7f9d3affd640 1 -- 172.21.15.49:0/766611923 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dc8a4d5a00 msgr2=0x55dc8a5510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:14.792 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.788+0000 7f9d3b7fe640 1 --2- 172.21.15.49:0/766611923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc8a4dab70 0x55dc8a558120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:14.792 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.788+0000 7f9d3affd640 1 --2- 172.21.15.49:0/766611923 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dc8a4d5a00 0x55dc8a5510e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:14.792 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.788+0000 7f9d3affd640 1 -- 172.21.15.49:0/766611923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc8a4dab70 msgr2=0x55dc8a558120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:14.792 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.788+0000 7f9d3affd640 1 --2- 172.21.15.49:0/766611923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc8a4dab70 0x55dc8a558120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:14.792 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.788+0000 7f9d3affd640 1 -- 172.21.15.49:0/766611923 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc8a4d4b70 con 0x55dc8a4d5010 2024-06-03T00:04:14.792 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.788+0000 7f9d3affd640 1 --2- 172.21.15.49:0/766611923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dc8a4d5010 0x55dc8a550ba0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c0d4040 tx=0x7f9d2c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38617e022faa715b server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:14.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.788+0000 7f9d227fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:04:14.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.788+0000 7f9d227fc640 1 -- 172.21.15.49:0/766611923 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c099e70 con 0x55dc8a4d5010 2024-06-03T00:04:14.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.788+0000 7f9d227fc640 1 -- 172.21.15.49:0/766611923 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f9d2c07ad10 con 0x55dc8a4d5010 2024-06-03T00:04:14.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.788+0000 7f9d44038740 1 -- 172.21.15.49:0/766611923 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d2c09bd30 con 0x55dc8a4d5010 2024-06-03T00:04:14.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.788+0000 7f9d227fc640 1 -- 172.21.15.49:0/766611923 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f9d2c0a00e0 con 0x55dc8a4d5010 2024-06-03T00:04:14.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.788+0000 7f9d44038740 10 client.16239 fetch_fsmap learned FSMap version 37 2024-06-03T00:04:14.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.788+0000 7f9d44038740 1 -- 172.21.15.49:0/766611923 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55dc8a559850 con 0x55dc8a4d5010 2024-06-03T00:04:14.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.788+0000 7f9d227fc640 1 -- 172.21.15.49:0/766611923 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d2c09bd30 con 0x55dc8a4d5010 2024-06-03T00:04:14.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.788+0000 7f9d227fc640 1 -- 172.21.15.49:0/766611923 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f9d2c064030 con 0x55dc8a4d5010 2024-06-03T00:04:14.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.788+0000 7f9d44038740 10 client.16239 fetch_fsmap finished waiting for FSMap version 37 2024-06-03T00:04:14.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.788+0000 7f9d44038740 10 client.16239 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:04:14.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.788+0000 7f9d44038740 20 client.16239 populate_metadata read hostname 'smithi049' 2024-06-03T00:04:14.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.788+0000 7f9d44038740 1 --2- 172.21.15.49:0/766611923 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55dc8a4eb120 0x55dc8a55c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:14.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.788+0000 7f9d44038740 4 client.16239 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-03T00:04:14.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.788+0000 7f9d44038740 1 -- 172.21.15.49:0/766611923 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dc8a445c20 con 0x55dc8a4eb120 2024-06-03T00:04:14.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.789+0000 7f9d33fff640 1 --2- 172.21.15.49:0/766611923 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55dc8a4eb120 0x55dc8a55c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:14.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.789+0000 7f9d227fc640 10 client.16239 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:04:14.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.789+0000 7f9d33fff640 1 --2- 172.21.15.49:0/766611923 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55dc8a4eb120 0x55dc8a55c0a0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a18131b74bcbb6c0 server_cookie=abf67400d29cc8df in_seq=0 out_seq=0 2024-06-03T00:04:14.804 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.803+0000 7f9d227fc640 1 -- 172.21.15.49:0/766611923 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55dc8a445c20 con 0x55dc8a4eb120 2024-06-03T00:04:14.804 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.803+0000 7f9d227fc640 10 client.16239 handle_command_reply: tid=0 2024-06-03T00:04:14.804 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.803+0000 7f9d44038740 1 client.16239 shutdown 2024-06-03T00:04:14.804 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.803+0000 7f9d44038740 1 -- 172.21.15.49:0/766611923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dc8a4d5010 msgr2=0x55dc8a550ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:14.804 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.803+0000 7f9d44038740 1 --2- 172.21.15.49:0/766611923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dc8a4d5010 0x55dc8a550ba0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c0d4040 tx=0x7f9d2c003d40 comp rx=0 tx=0).stop 2024-06-03T00:04:14.804 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.803+0000 7f9d44038740 1 -- 172.21.15.49:0/766611923 shutdown_connections 2024-06-03T00:04:14.804 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.803+0000 7f9d44038740 1 --2- 172.21.15.49:0/766611923 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55dc8a4eb120 0x55dc8a55c0a0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:14.804 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.803+0000 7f9d44038740 1 --2- 172.21.15.49:0/766611923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc8a4dab70 0x55dc8a558120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:14.804 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.803+0000 7f9d44038740 1 --2- 172.21.15.49:0/766611923 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dc8a4d5a00 0x55dc8a5510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:14.804 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.803+0000 7f9d44038740 1 --2- 172.21.15.49:0/766611923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dc8a4d5010 0x55dc8a550ba0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:14.804 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.803+0000 7f9d227fc640 0 client.16239 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:04:14.805 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.803+0000 7f9d44038740 1 -- 172.21.15.49:0/766611923 >> 172.21.15.49:0/766611923 conn(0x55dc8a4d0680 msgr2=0x55dc8a4da240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:14.805 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.803+0000 7f9d44038740 1 -- 172.21.15.49:0/766611923 shutdown_connections 2024-06-03T00:04:14.805 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.803+0000 7f9d44038740 1 -- 172.21.15.49:0/766611923 wait complete. 2024-06-03T00:04:14.805 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.803+0000 7f9d44038740 20 client.16239 trim_cache size 0 max 16384 2024-06-03T00:04:14.805 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-06-03T00:04:14.805 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-06-03T00:04:14.805 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-06-03T00:04:14.806 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.804+0000 7f9d41329640 1 -- 172.21.15.49:0/1765672101 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9d280a2c30 msgr2=0x7f9d280a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:14.806 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.804+0000 7f9d41329640 1 --2- 172.21.15.49:0/1765672101 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9d280a2c30 0x7f9d280a50f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9d34005e30 tx=0x7f9d3403d040 comp rx=0 tx=0).stop 2024-06-03T00:04:14.806 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.804+0000 7f9d41329640 1 -- 172.21.15.49:0/1765672101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d3c100900 msgr2=0x7f9d3c197c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:14.806 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.804+0000 7f9d41329640 1 --2- 172.21.15.49:0/1765672101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d3c100900 0x7f9d3c197c20 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c00e9c0 tx=0x7f9d2c00ee80 comp rx=0 tx=0).stop 2024-06-03T00:04:14.806 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.804+0000 7f9d41329640 1 -- 172.21.15.49:0/1765672101 shutdown_connections 2024-06-03T00:04:14.806 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.804+0000 7f9d41329640 1 --2- 172.21.15.49:0/1765672101 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f9d280a2c30 0x7f9d280a50f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:14.806 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.804+0000 7f9d41329640 1 --2- 172.21.15.49:0/1765672101 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d3c101af0 0x7f9d3c198160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:14.807 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.804+0000 7f9d41329640 1 --2- 172.21.15.49:0/1765672101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d3c1024b0 0x7f9d3c19f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:14.807 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.804+0000 7f9d41329640 1 --2- 172.21.15.49:0/1765672101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d3c100900 0x7f9d3c197c20 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:14.807 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.804+0000 7f9d41329640 1 -- 172.21.15.49:0/1765672101 >> 172.21.15.49:0/1765672101 conn(0x7f9d3c0fbe70 msgr2=0x7f9d3c104d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:14.807 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.804+0000 7f9d41329640 1 -- 172.21.15.49:0/1765672101 shutdown_connections 2024-06-03T00:04:14.807 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:14.804+0000 7f9d41329640 1 -- 172.21.15.49:0/1765672101 wait complete. 2024-06-03T00:04:14.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:14 smithi107 ceph-mon[37048]: pgmap v509: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.7 KiB/s wr, 15 op/s 2024-06-03T00:04:15.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.943+0000 7f34a7ccc700 1 -- 172.21.15.49:0/1241261691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34a0107840 msgr2=0x7f34a010f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:15.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.943+0000 7f34a7ccc700 1 --2- 172.21.15.49:0/1241261691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34a0107840 0x7f34a010f3c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f349800b0d0 tx=0x7f349800b3e0 comp rx=0 tx=0).stop 2024-06-03T00:04:15.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.943+0000 7f34a7ccc700 1 -- 172.21.15.49:0/1241261691 shutdown_connections 2024-06-03T00:04:15.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.943+0000 7f34a7ccc700 1 --2- 172.21.15.49:0/1241261691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34a0107840 0x7f34a010f3c0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:15.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.943+0000 7f34a7ccc700 1 --2- 172.21.15.49:0/1241261691 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34a0102740 0x7f34a0102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:15.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.943+0000 7f34a7ccc700 1 --2- 172.21.15.49:0/1241261691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34a01030f0 0x7f34a0107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:15.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.943+0000 7f34a7ccc700 1 -- 172.21.15.49:0/1241261691 >> 172.21.15.49:0/1241261691 conn(0x7f34a00795f0 msgr2=0x7f34a0079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:15.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.943+0000 7f34a7ccc700 1 -- 172.21.15.49:0/1241261691 shutdown_connections 2024-06-03T00:04:15.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.943+0000 7f34a7ccc700 1 -- 172.21.15.49:0/1241261691 wait complete. 2024-06-03T00:04:15.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.943+0000 7f34a7ccc700 1 Processor -- start 2024-06-03T00:04:15.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.943+0000 7f34a7ccc700 1 -- start start 2024-06-03T00:04:15.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.944+0000 7f34a7ccc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34a0102740 0x7f34a019e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:15.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.944+0000 7f34a7ccc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34a01030f0 0x7f34a019ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:15.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.944+0000 7f34a7ccc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34a0107840 0x7f34a0198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:15.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.944+0000 7f34a7ccc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f34a0112760 con 0x7f34a0107840 2024-06-03T00:04:15.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.944+0000 7f34a7ccc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f34a01125e0 con 0x7f34a0102740 2024-06-03T00:04:15.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.944+0000 7f34a7ccc700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f34a01128e0 con 0x7f34a01030f0 2024-06-03T00:04:15.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.944+0000 7f34a6269700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34a0107840 0x7f34a0198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:15.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.944+0000 7f34a6269700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34a0107840 0x7f34a0198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58180/0 (socket says 172.21.15.49:58180) 2024-06-03T00:04:15.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.944+0000 7f34a6269700 1 -- 172.21.15.49:0/1432735636 learned_addr learned my addr 172.21.15.49:0/1432735636 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:15.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.944+0000 7f34a5a68700 1 --2- 172.21.15.49:0/1432735636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34a0102740 0x7f34a019e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:15.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.944+0000 7f34a5267700 1 --2- 172.21.15.49:0/1432735636 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34a01030f0 0x7f34a019ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:15.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.944+0000 7f34a6269700 1 -- 172.21.15.49:0/1432735636 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34a01030f0 msgr2=0x7f34a019ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:15.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.944+0000 7f34a6269700 1 --2- 172.21.15.49:0/1432735636 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34a01030f0 0x7f34a019ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:15.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.944+0000 7f34a6269700 1 -- 172.21.15.49:0/1432735636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34a0102740 msgr2=0x7f34a019e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:15.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.944+0000 7f34a6269700 1 --2- 172.21.15.49:0/1432735636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34a0102740 0x7f34a019e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:15.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.944+0000 7f34a6269700 1 -- 172.21.15.49:0/1432735636 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34a01990c0 con 0x7f34a0107840 2024-06-03T00:04:15.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.944+0000 7f34a6269700 1 --2- 172.21.15.49:0/1432735636 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34a0107840 0x7f34a0198960 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f3498006070 tx=0x7f3498004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:15.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.945+0000 7f3496ffd700 1 -- 172.21.15.49:0/1432735636 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3498021070 con 0x7f34a0107840 2024-06-03T00:04:15.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.945+0000 7f3496ffd700 1 -- 172.21.15.49:0/1432735636 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3498007b80 con 0x7f34a0107840 2024-06-03T00:04:15.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.945+0000 7f3496ffd700 1 -- 172.21.15.49:0/1432735636 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3498005330 con 0x7f34a0107840 2024-06-03T00:04:15.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.945+0000 7f34a7ccc700 1 -- 172.21.15.49:0/1432735636 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34a0199350 con 0x7f34a0107840 2024-06-03T00:04:15.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.945+0000 7f34a7ccc700 1 -- 172.21.15.49:0/1432735636 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34a01a5670 con 0x7f34a0107840 2024-06-03T00:04:15.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.946+0000 7f34a7ccc700 1 -- 172.21.15.49:0/1432735636 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34a0069180 con 0x7f34a0107840 2024-06-03T00:04:15.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.947+0000 7f3496ffd700 1 -- 172.21.15.49:0/1432735636 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3498024070 con 0x7f34a0107840 2024-06-03T00:04:15.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.948+0000 7f3496ffd700 1 --2- 172.21.15.49:0/1432735636 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f348c0a2c20 0x7f348c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:15.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.948+0000 7f34a5a68700 1 --2- 172.21.15.49:0/1432735636 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f348c0a2c20 0x7f348c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:15.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.948+0000 7f3496ffd700 1 -- 172.21.15.49:0/1432735636 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f349800f020 con 0x7f34a0107840 2024-06-03T00:04:15.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.948+0000 7f34a5a68700 1 --2- 172.21.15.49:0/1432735636 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f348c0a2c20 0x7f348c0a50e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f349c005950 tx=0x7f349c00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:15.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:15.951+0000 7f3496ffd700 1 -- 172.21.15.49:0/1432735636 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f349802b020 con 0x7f34a0107840 2024-06-03T00:04:16.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:16.206+0000 7f34a7ccc700 1 -- 172.21.15.49:0/1432735636 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f34a002dca0 con 0x7f34a0107840 2024-06-03T00:04:16.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:16.207+0000 7f3496ffd700 1 -- 172.21.15.49:0/1432735636 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11948 (secure 0 0 0) 0x7f349809db10 con 0x7f34a0107840 2024-06-03T00:04:16.207 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:04:16.207 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1553264866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1553264866},{"type":"v1","addr":"172.21.15.49:6835","nonce":1553264866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2266285252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2266285252},{"type":"v1","addr":"172.21.15.49:6837","nonce":2266285252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T23:57:16.991201+0000","modified":"2024-06-03T00:03:50.303719+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24485,"mds_2":24466,"mds_3":24464,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6839/1729124617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":1729124617},{"type":"v1","addr":"172.21.15.49:6839","nonce":1729124617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6841/1902772235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":1902772235},{"type":"v1","addr":"172.21.15.49:6841","nonce":1902772235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6833/1633534002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1633534002},{"type":"v1","addr":"172.21.15.57:6833","nonce":1633534002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6835/2254905671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2254905671},{"type":"v1","addr":"172.21.15.57:6835","nonce":2254905671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.107:6835/3693542801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3693542801},{"type":"v1","addr":"172.21.15.107:6835","nonce":3693542801}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.57:6837/230452144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":230452144},{"type":"v1","addr":"172.21.15.57:6837","nonce":230452144}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":92,"addr":"172.21.15.107:6837/3700593315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":3700593315},{"type":"v1","addr":"172.21.15.107:6837","nonce":3700593315}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6839/249825195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":249825195},{"type":"v1","addr":"172.21.15.57:6839","nonce":249825195}]},"join_fscid":-1,"export_targets":[0,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6839/1986600681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1986600681},{"type":"v1","addr":"172.21.15.107:6839","nonce":1986600681}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24464,24485,24460,24487,24466]},"id":1}]} 2024-06-03T00:04:16.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:16.210+0000 7f34a7ccc700 1 -- 172.21.15.49:0/1432735636 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f348c0a2c20 msgr2=0x7f348c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:16.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:16.210+0000 7f34a7ccc700 1 --2- 172.21.15.49:0/1432735636 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f348c0a2c20 0x7f348c0a50e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f349c005950 tx=0x7f349c00a300 comp rx=0 tx=0).stop 2024-06-03T00:04:16.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:16.210+0000 7f34a7ccc700 1 -- 172.21.15.49:0/1432735636 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34a0107840 msgr2=0x7f34a0198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:16.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:16.210+0000 7f34a7ccc700 1 --2- 172.21.15.49:0/1432735636 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34a0107840 0x7f34a0198960 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f3498006070 tx=0x7f3498004d00 comp rx=0 tx=0).stop 2024-06-03T00:04:16.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:16.211+0000 7f34a7ccc700 1 -- 172.21.15.49:0/1432735636 shutdown_connections 2024-06-03T00:04:16.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:16.211+0000 7f34a7ccc700 1 --2- 172.21.15.49:0/1432735636 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f348c0a2c20 0x7f348c0a50e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:16.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:16.211+0000 7f34a7ccc700 1 --2- 172.21.15.49:0/1432735636 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34a0107840 0x7f34a0198960 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:16.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:16.211+0000 7f34a7ccc700 1 --2- 172.21.15.49:0/1432735636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34a0102740 0x7f34a019e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:16.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:16.211+0000 7f34a7ccc700 1 --2- 172.21.15.49:0/1432735636 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34a01030f0 0x7f34a019ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:16.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:16.211+0000 7f34a7ccc700 1 -- 172.21.15.49:0/1432735636 >> 172.21.15.49:0/1432735636 conn(0x7f34a00795f0 msgr2=0x7f34a0100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:16.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:16.211+0000 7f34a7ccc700 1 -- 172.21.15.49:0/1432735636 shutdown_connections 2024-06-03T00:04:16.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:16.211+0000 7f34a7ccc700 1 -- 172.21.15.49:0/1432735636 wait complete. 2024-06-03T00:04:16.211 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 37 2024-06-03T00:04:16.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:16 smithi049 ceph-mon[32302]: pgmap v510: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.1 KiB/s wr, 14 op/s 2024-06-03T00:04:16.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:16 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/1432735636' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:04:16.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:16 smithi057 ceph-mon[36457]: pgmap v510: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.1 KiB/s wr, 14 op/s 2024-06-03T00:04:16.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:16 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/1432735636' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:04:16.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:16 smithi107 ceph-mon[37048]: pgmap v510: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.1 KiB/s wr, 14 op/s 2024-06-03T00:04:16.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:16 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/1432735636' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:04:16.979 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24487 quiesce db --set-id 6d4ca031 --release --await' 2024-06-03T00:04:16.980 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- timeout 105 ceph tell mds.24487 quiesce db --set-id 6d4ca031 --release --await 2024-06-03T00:04:17.238 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:04:18.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:18 smithi057 ceph-mon[36457]: pgmap v511: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-06-03T00:04:18.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:18 smithi049 ceph-mon[32302]: pgmap v511: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-06-03T00:04:18.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:18 smithi107 ceph-mon[37048]: pgmap v511: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-06-03T00:04:19.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.118+0000 7f74c1a8e700 1 -- 172.21.15.49:0/3832905993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74bc108500 msgr2=0x7f74bc1088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:19.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.118+0000 7f74c1a8e700 1 --2- 172.21.15.49:0/3832905993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74bc108500 0x7f74bc1088e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f74ac00b0a0 tx=0x7f74ac00b3b0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.118+0000 7f74c1a8e700 1 -- 172.21.15.49:0/3832905993 shutdown_connections 2024-06-03T00:04:19.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.118+0000 7f74c1a8e700 1 --2- 172.21.15.49:0/3832905993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74bc06ab30 0x7f74bc10f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.118+0000 7f74c1a8e700 1 --2- 172.21.15.49:0/3832905993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74bc108500 0x7f74bc1088e0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.118+0000 7f74c1a8e700 1 --2- 172.21.15.49:0/3832905993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74bc06a170 0x7f74bc06a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.118+0000 7f74c1a8e700 1 -- 172.21.15.49:0/3832905993 >> 172.21.15.49:0/3832905993 conn(0x7f74bc078340 msgr2=0x7f74bc078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:19.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.118+0000 7f74c1a8e700 1 -- 172.21.15.49:0/3832905993 shutdown_connections 2024-06-03T00:04:19.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.118+0000 7f74c1a8e700 1 -- 172.21.15.49:0/3832905993 wait complete. 2024-06-03T00:04:19.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.119+0000 7f74c1a8e700 1 Processor -- start 2024-06-03T00:04:19.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.119+0000 7f74c1a8e700 1 -- start start 2024-06-03T00:04:19.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.119+0000 7f74c1a8e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74bc06a170 0x7f74bc101460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:19.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.119+0000 7f74c1a8e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74bc06ab30 0x7f74bc1019a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:19.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.119+0000 7f74c1a8e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74bc108500 0x7f74bc101ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:19.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.119+0000 7f74c1a8e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f74bc1127e0 con 0x7f74bc06a170 2024-06-03T00:04:19.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.119+0000 7f74c1a8e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f74bc112660 con 0x7f74bc108500 2024-06-03T00:04:19.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.119+0000 7f74c1a8e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f74bc112960 con 0x7f74bc06ab30 2024-06-03T00:04:19.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.119+0000 7f74bb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74bc06a170 0x7f74bc101460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:19.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.119+0000 7f74bb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74bc06a170 0x7f74bc101460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58186/0 (socket says 172.21.15.49:58186) 2024-06-03T00:04:19.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.120+0000 7f74bb7fe700 1 -- 172.21.15.49:0/2190622878 learned_addr learned my addr 172.21.15.49:0/2190622878 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:19.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.120+0000 7f74baffd700 1 --2- 172.21.15.49:0/2190622878 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74bc06ab30 0x7f74bc1019a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:19.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.120+0000 7f74bbfff700 1 --2- 172.21.15.49:0/2190622878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74bc108500 0x7f74bc101ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:19.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.120+0000 7f74bb7fe700 1 -- 172.21.15.49:0/2190622878 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74bc06ab30 msgr2=0x7f74bc1019a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:19.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.120+0000 7f74bb7fe700 1 --2- 172.21.15.49:0/2190622878 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74bc06ab30 0x7f74bc1019a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.120+0000 7f74bb7fe700 1 -- 172.21.15.49:0/2190622878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74bc108500 msgr2=0x7f74bc101ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:19.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.120+0000 7f74bb7fe700 1 --2- 172.21.15.49:0/2190622878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74bc108500 0x7f74bc101ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.120+0000 7f74bb7fe700 1 -- 172.21.15.49:0/2190622878 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74bc1a71b0 con 0x7f74bc06a170 2024-06-03T00:04:19.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.120+0000 7f74baffd700 1 --2- 172.21.15.49:0/2190622878 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74bc06ab30 0x7f74bc1019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:04:19.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.120+0000 7f74bbfff700 1 --2- 172.21.15.49:0/2190622878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74bc108500 0x7f74bc101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:04:19.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.120+0000 7f74bb7fe700 1 --2- 172.21.15.49:0/2190622878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74bc06a170 0x7f74bc101460 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f74ac00b070 tx=0x7f74ac004ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:19.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.120+0000 7f74b8ff9700 1 -- 172.21.15.49:0/2190622878 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ac021070 con 0x7f74bc06a170 2024-06-03T00:04:19.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.120+0000 7f74c1a8e700 1 -- 172.21.15.49:0/2190622878 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74bc1a7440 con 0x7f74bc06a170 2024-06-03T00:04:19.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.120+0000 7f74b8ff9700 1 -- 172.21.15.49:0/2190622878 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74ac01d930 con 0x7f74bc06a170 2024-06-03T00:04:19.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.120+0000 7f74b8ff9700 1 -- 172.21.15.49:0/2190622878 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ac005440 con 0x7f74bc06a170 2024-06-03T00:04:19.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.120+0000 7f74c1a8e700 1 -- 172.21.15.49:0/2190622878 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74bc1a7940 con 0x7f74bc06a170 2024-06-03T00:04:19.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.123+0000 7f74b8ff9700 1 -- 172.21.15.49:0/2190622878 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f74ac024070 con 0x7f74bc06a170 2024-06-03T00:04:19.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.123+0000 7f74b8ff9700 1 --2- 172.21.15.49:0/2190622878 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f74a80a2c20 0x7f74a80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:19.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.124+0000 7f74baffd700 1 --2- 172.21.15.49:0/2190622878 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f74a80a2c20 0x7f74a80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:19.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.124+0000 7f74b8ff9700 1 -- 172.21.15.49:0/2190622878 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f74ac00f020 con 0x7f74bc06a170 2024-06-03T00:04:19.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.124+0000 7f74baffd700 1 --2- 172.21.15.49:0/2190622878 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f74a80a2c20 0x7f74a80a50e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f74bc0789b0 tx=0x7f74a4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:19.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.124+0000 7f74cc311b80 1 Processor -- start 2024-06-03T00:04:19.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.124+0000 7f74cc311b80 1 -- start start 2024-06-03T00:04:19.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.124+0000 7f74cc311b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f9e58d8500 0x55f9e58d88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:19.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.124+0000 7f74cc311b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e58d8e20 0x55f9e58d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:19.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.124+0000 7f74cc311b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e58d2c50 0x55f9e58d3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:19.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.124+0000 7f74cc311b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f9e57c5060 con 0x55f9e58d8500 2024-06-03T00:04:19.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.124+0000 7f74cc311b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55f9e5823950 con 0x55f9e58d8e20 2024-06-03T00:04:19.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.124+0000 7f74cc311b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f9e578b560 con 0x55f9e58d2c50 2024-06-03T00:04:19.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.124+0000 7f74bb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f9e58d8500 0x55f9e58d88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:19.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.125+0000 7f74bb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f9e58d8500 0x55f9e58d88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58188/0 (socket says 172.21.15.49:58188) 2024-06-03T00:04:19.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.125+0000 7f74bb7fe700 1 -- 172.21.15.49:0/1422312846 learned_addr learned my addr 172.21.15.49:0/1422312846 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:19.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.125+0000 7f74baffd700 1 --2- 172.21.15.49:0/1422312846 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e58d8e20 0x55f9e58d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:19.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.125+0000 7f74bbfff700 1 --2- 172.21.15.49:0/1422312846 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e58d2c50 0x55f9e58d3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:19.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.125+0000 7f74bb7fe700 1 -- 172.21.15.49:0/1422312846 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e58d2c50 msgr2=0x55f9e58d3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:19.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.125+0000 7f74bb7fe700 1 --2- 172.21.15.49:0/1422312846 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e58d2c50 0x55f9e58d3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.125+0000 7f74bb7fe700 1 -- 172.21.15.49:0/1422312846 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e58d8e20 msgr2=0x55f9e58d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:19.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.125+0000 7f74bb7fe700 1 --2- 172.21.15.49:0/1422312846 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e58d8e20 0x55f9e58d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.125+0000 7f74bb7fe700 1 -- 172.21.15.49:0/1422312846 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9e57729d0 con 0x55f9e58d8500 2024-06-03T00:04:19.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.125+0000 7f74bb7fe700 1 --2- 172.21.15.49:0/1422312846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f9e58d8500 0x55f9e58d88e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f74ac09d1b0 tx=0x7f74ac009c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c7e1edaa6411650 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:19.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.125+0000 7f74b1ffb700 1 -- 172.21.15.49:0/1422312846 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ac09d220 con 0x55f9e58d8500 2024-06-03T00:04:19.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.125+0000 7f74b1ffb700 1 -- 172.21.15.49:0/1422312846 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74ac0a15d0 con 0x55f9e58d8500 2024-06-03T00:04:19.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.125+0000 7f74b1ffb700 1 -- 172.21.15.49:0/1422312846 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ac0a1170 con 0x55f9e58d8500 2024-06-03T00:04:19.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.126+0000 7f74cc311b80 1 -- 172.21.15.49:0/1422312846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f9e58d8500 msgr2=0x55f9e58d88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:19.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.126+0000 7f74cc311b80 1 --2- 172.21.15.49:0/1422312846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f9e58d8500 0x55f9e58d88e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f74ac09d1b0 tx=0x7f74ac009c70 comp rx=0 tx=0).stop 2024-06-03T00:04:19.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.126+0000 7f74cc311b80 1 -- 172.21.15.49:0/1422312846 shutdown_connections 2024-06-03T00:04:19.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.126+0000 7f74cc311b80 1 --2- 172.21.15.49:0/1422312846 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e58d2c50 0x55f9e58d3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.126+0000 7f74cc311b80 1 --2- 172.21.15.49:0/1422312846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f9e58d8500 0x55f9e58d88e0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.126+0000 7f74cc311b80 1 --2- 172.21.15.49:0/1422312846 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e58d8e20 0x55f9e58d2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.126+0000 7f74cc311b80 1 -- 172.21.15.49:0/1422312846 >> 172.21.15.49:0/1422312846 conn(0x55f9e57ff180 msgr2=0x55f9e58cda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:19.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.126+0000 7f74cc311b80 1 -- 172.21.15.49:0/1422312846 shutdown_connections 2024-06-03T00:04:19.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.126+0000 7f74cc311b80 1 -- 172.21.15.49:0/1422312846 wait complete. 2024-06-03T00:04:19.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.126+0000 7f74cc311b80 1 -- start start 2024-06-03T00:04:19.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.127+0000 7f74cc311b80 1 Processor -- start 2024-06-03T00:04:19.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.127+0000 7f74cc311b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e58d2c50 0x55f9e58debf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:19.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.127+0000 7f74cc311b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f9e58d8500 0x55f9e58dbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:19.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.127+0000 7f74cc311b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e58d8e20 0x55f9e58dc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:19.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.127+0000 7f74cc311b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f9e57c40c0 con 0x55f9e58d8500 2024-06-03T00:04:19.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.127+0000 7f74cc311b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55f9e581f910 con 0x55f9e58d8e20 2024-06-03T00:04:19.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.127+0000 7f74cc311b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f9e58df5b0 con 0x55f9e58d2c50 2024-06-03T00:04:19.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.127+0000 7f74cc311b80 10 client.0 _ll_register_callbacks cb 0x55f9e57b96b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:04:19.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.127+0000 7f74baffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f9e58d8500 0x55f9e58dbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:19.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.127+0000 7f74baffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f9e58d8500 0x55f9e58dbef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58194/0 (socket says 172.21.15.49:58194) 2024-06-03T00:04:19.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.127+0000 7f74baffd700 1 -- 172.21.15.49:0/4240694859 learned_addr learned my addr 172.21.15.49:0/4240694859 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:19.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.127+0000 7f74bb7fe700 1 --2- 172.21.15.49:0/4240694859 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e58d2c50 0x55f9e58debf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:19.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.127+0000 7f74bbfff700 1 --2- 172.21.15.49:0/4240694859 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e58d8e20 0x55f9e58dc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:19.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.128+0000 7f74baffd700 1 -- 172.21.15.49:0/4240694859 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e58d2c50 msgr2=0x55f9e58debf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:19.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.128+0000 7f74baffd700 1 --2- 172.21.15.49:0/4240694859 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e58d2c50 0x55f9e58debf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.128+0000 7f74baffd700 1 -- 172.21.15.49:0/4240694859 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e58d8e20 msgr2=0x55f9e58dc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:19.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.128+0000 7f74baffd700 1 --2- 172.21.15.49:0/4240694859 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e58d8e20 0x55f9e58dc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.128+0000 7f74baffd700 1 -- 172.21.15.49:0/4240694859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9e57e9850 con 0x55f9e58d8500 2024-06-03T00:04:19.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.128+0000 7f74bb7fe700 1 --2- 172.21.15.49:0/4240694859 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e58d2c50 0x55f9e58debf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:04:19.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.128+0000 7f74baffd700 1 --2- 172.21.15.49:0/4240694859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f9e58d8500 0x55f9e58dbef0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f74a400de10 tx=0x7f74a4004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b5e1e70d2f3afe server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:19.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.128+0000 7f749affd700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:04:19.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.128+0000 7f749affd700 1 -- 172.21.15.49:0/4240694859 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a4024020 con 0x55f9e58d8500 2024-06-03T00:04:19.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.128+0000 7f749affd700 1 -- 172.21.15.49:0/4240694859 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f74a400f040 con 0x55f9e58d8500 2024-06-03T00:04:19.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.128+0000 7f74cc311b80 1 -- 172.21.15.49:0/4240694859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74ac0a15d0 con 0x55f9e58d8500 2024-06-03T00:04:19.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.128+0000 7f749affd700 1 -- 172.21.15.49:0/4240694859 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f74a400de40 con 0x55f9e58d8500 2024-06-03T00:04:19.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.128+0000 7f74cc311b80 10 client.16257 fetch_fsmap learned FSMap version 37 2024-06-03T00:04:19.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.128+0000 7f74cc311b80 1 -- 172.21.15.49:0/4240694859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55f9e58e9cc0 con 0x55f9e58d8500 2024-06-03T00:04:19.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.128+0000 7f749affd700 1 -- 172.21.15.49:0/4240694859 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74ac0a15d0 con 0x55f9e58d8500 2024-06-03T00:04:19.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.129+0000 7f749affd700 1 -- 172.21.15.49:0/4240694859 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f74a4013070 con 0x55f9e58d8500 2024-06-03T00:04:19.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.129+0000 7f74cc311b80 10 client.16257 fetch_fsmap finished waiting for FSMap version 37 2024-06-03T00:04:19.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.129+0000 7f74cc311b80 10 client.16257 resolve_mds: validated gid 24487 aka daemon mds.i 2024-06-03T00:04:19.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.129+0000 7f74cc311b80 20 client.16257 populate_metadata read hostname 'smithi049' 2024-06-03T00:04:19.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.129+0000 7f74cc311b80 1 --2- 172.21.15.49:0/4240694859 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55f9e58ec300 0x55f9e58ee760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:19.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.129+0000 7f74cc311b80 4 client.16257 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:04:19.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.129+0000 7f74cc311b80 1 -- 172.21.15.49:0/4240694859 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9e5830e50 con 0x55f9e58ec300 2024-06-03T00:04:19.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.129+0000 7f74bb7fe700 1 --2- 172.21.15.49:0/4240694859 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55f9e58ec300 0x55f9e58ee760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:19.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.129+0000 7f749affd700 10 client.16257 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:04:19.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.129+0000 7f74bb7fe700 1 --2- 172.21.15.49:0/4240694859 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55f9e58ec300 0x55f9e58ee760 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8c8463605d54c0d server_cookie=ab5e4dcd4b15213a in_seq=0 out_seq=0 2024-06-03T00:04:19.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.130+0000 7f749affd700 1 -- 172.21.15.49:0/4240694859 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55f9e5830e50 con 0x55f9e58ec300 2024-06-03T00:04:19.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.130+0000 7f749affd700 10 client.16257 handle_command_reply: tid=0 2024-06-03T00:04:19.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.130+0000 7f74cc311b80 1 client.16257 shutdown 2024-06-03T00:04:19.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.130+0000 7f74cc311b80 1 -- 172.21.15.49:0/4240694859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f9e58d8500 msgr2=0x55f9e58dbef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:19.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.130+0000 7f74cc311b80 1 --2- 172.21.15.49:0/4240694859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f9e58d8500 0x55f9e58dbef0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f74a400de10 tx=0x7f74a4004860 comp rx=0 tx=0).stop 2024-06-03T00:04:19.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.130+0000 7f74cc311b80 1 -- 172.21.15.49:0/4240694859 shutdown_connections 2024-06-03T00:04:19.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.130+0000 7f74cc311b80 1 --2- 172.21.15.49:0/4240694859 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e58d8e20 0x55f9e58dc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.130+0000 7f74cc311b80 1 --2- 172.21.15.49:0/4240694859 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e58d2c50 0x55f9e58debf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.130+0000 7f74cc311b80 1 --2- 172.21.15.49:0/4240694859 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55f9e58ec300 0x55f9e58ee760 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.130+0000 7f74cc311b80 1 --2- 172.21.15.49:0/4240694859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f9e58d8500 0x55f9e58dbef0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.130+0000 7f749affd700 0 client.16257 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:04:19.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.130+0000 7f74cc311b80 1 -- 172.21.15.49:0/4240694859 >> 172.21.15.49:0/4240694859 conn(0x55f9e57ff180 msgr2=0x55f9e58cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:19.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.131+0000 7f74cc311b80 1 -- 172.21.15.49:0/4240694859 shutdown_connections 2024-06-03T00:04:19.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.131+0000 7f74cc311b80 1 -- 172.21.15.49:0/4240694859 wait complete. 2024-06-03T00:04:19.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.131+0000 7f74cc311b80 20 client.16257 trim_cache size 0 max 16384 2024-06-03T00:04:19.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.151+0000 7f74cc311b80 1 Processor -- start 2024-06-03T00:04:19.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.151+0000 7f74cc311b80 1 -- start start 2024-06-03T00:04:19.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.152+0000 7f74cc311b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e57ff180 0x55f9e58d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:19.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.152+0000 7f74cc311b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e58d2c50 0x55f9e58cdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:19.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.152+0000 7f74cc311b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f9e58d8500 0x55f9e58de730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:19.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.152+0000 7f74cc311b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f74bc1aee30 con 0x55f9e58d8500 2024-06-03T00:04:19.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.152+0000 7f74cc311b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f74bc1b0b50 con 0x55f9e57ff180 2024-06-03T00:04:19.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.152+0000 7f74cc311b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f74bc1af530 con 0x55f9e58d2c50 2024-06-03T00:04:19.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.152+0000 7f74bbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f9e58d8500 0x55f9e58de730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:19.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.152+0000 7f74bbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f9e58d8500 0x55f9e58de730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58202/0 (socket says 172.21.15.49:58202) 2024-06-03T00:04:19.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.152+0000 7f74bbfff700 1 -- 172.21.15.49:0/1601829358 learned_addr learned my addr 172.21.15.49:0/1601829358 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:19.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.152+0000 7f74bb7fe700 1 --2- 172.21.15.49:0/1601829358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e57ff180 0x55f9e58d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:19.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.152+0000 7f74baffd700 1 --2- 172.21.15.49:0/1601829358 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e58d2c50 0x55f9e58cdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:19.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.152+0000 7f74bbfff700 1 -- 172.21.15.49:0/1601829358 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e58d2c50 msgr2=0x55f9e58cdaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:19.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.152+0000 7f74bbfff700 1 --2- 172.21.15.49:0/1601829358 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e58d2c50 0x55f9e58cdaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.152+0000 7f74bbfff700 1 -- 172.21.15.49:0/1601829358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e57ff180 msgr2=0x55f9e58d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:19.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.152+0000 7f74bbfff700 1 --2- 172.21.15.49:0/1601829358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e57ff180 0x55f9e58d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.152+0000 7f74bbfff700 1 -- 172.21.15.49:0/1601829358 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9e58da460 con 0x55f9e58d8500 2024-06-03T00:04:19.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.152+0000 7f74baffd700 1 --2- 172.21.15.49:0/1601829358 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e58d2c50 0x55f9e58cdaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:04:19.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.152+0000 7f74bbfff700 1 --2- 172.21.15.49:0/1601829358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f9e58d8500 0x55f9e58de730 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f74b4012480 tx=0x7f74b4012790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e7a9b5fecfee47 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:19.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.152+0000 7f74b17fa700 1 -- 172.21.15.49:0/1601829358 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b401c420 con 0x55f9e58d8500 2024-06-03T00:04:19.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.153+0000 7f74b17fa700 1 -- 172.21.15.49:0/1601829358 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74b4011920 con 0x55f9e58d8500 2024-06-03T00:04:19.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.153+0000 7f74b17fa700 1 -- 172.21.15.49:0/1601829358 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b401baa0 con 0x55f9e58d8500 2024-06-03T00:04:19.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.153+0000 7f74cc311b80 1 -- 172.21.15.49:0/1601829358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f9e58d8500 msgr2=0x55f9e58de730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:19.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.153+0000 7f74cc311b80 1 --2- 172.21.15.49:0/1601829358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f9e58d8500 0x55f9e58de730 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f74b4012480 tx=0x7f74b4012790 comp rx=0 tx=0).stop 2024-06-03T00:04:19.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.153+0000 7f74cc311b80 1 -- 172.21.15.49:0/1601829358 shutdown_connections 2024-06-03T00:04:19.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.153+0000 7f74cc311b80 1 --2- 172.21.15.49:0/1601829358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f9e58d8500 0x55f9e58de730 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.153+0000 7f74cc311b80 1 --2- 172.21.15.49:0/1601829358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e57ff180 0x55f9e58d2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.153+0000 7f74cc311b80 1 --2- 172.21.15.49:0/1601829358 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e58d2c50 0x55f9e58cdaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.153+0000 7f74cc311b80 1 -- 172.21.15.49:0/1601829358 >> 172.21.15.49:0/1601829358 conn(0x55f9e58d6810 msgr2=0x55f9e58d9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:19.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.153+0000 7f74cc311b80 1 -- 172.21.15.49:0/1601829358 shutdown_connections 2024-06-03T00:04:19.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.153+0000 7f74cc311b80 1 -- 172.21.15.49:0/1601829358 wait complete. 2024-06-03T00:04:19.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.154+0000 7f74cc311b80 1 -- start start 2024-06-03T00:04:19.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.154+0000 7f74cc311b80 1 Processor -- start 2024-06-03T00:04:19.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.154+0000 7f74cc311b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e57ff180 0x55f9e58e46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:19.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.154+0000 7f74cc311b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f9e58d2c50 0x55f9e58e4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:19.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.154+0000 7f74cc311b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e58d8500 0x55f9e58e16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:19.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.154+0000 7f74cc311b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f74bc1b03c0 con 0x55f9e58d2c50 2024-06-03T00:04:19.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.154+0000 7f74cc311b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f74bc1afc60 con 0x55f9e58d8500 2024-06-03T00:04:19.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.154+0000 7f74cc311b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f74bc1acdb0 con 0x55f9e57ff180 2024-06-03T00:04:19.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.154+0000 7f74cc311b80 10 client.0 _ll_register_callbacks cb 0x55f9e58dc8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:04:19.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.154+0000 7f74baffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f9e58d2c50 0x55f9e58e4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:19.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.154+0000 7f74baffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f9e58d2c50 0x55f9e58e4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58208/0 (socket says 172.21.15.49:58208) 2024-06-03T00:04:19.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.154+0000 7f74baffd700 1 -- 172.21.15.49:0/1970875765 learned_addr learned my addr 172.21.15.49:0/1970875765 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:19.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.154+0000 7f74bb7fe700 1 --2- 172.21.15.49:0/1970875765 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e57ff180 0x55f9e58e46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:19.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.154+0000 7f74bbfff700 1 --2- 172.21.15.49:0/1970875765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e58d8500 0x55f9e58e16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:19.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.155+0000 7f74baffd700 1 -- 172.21.15.49:0/1970875765 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e57ff180 msgr2=0x55f9e58e46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:19.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.155+0000 7f74baffd700 1 --2- 172.21.15.49:0/1970875765 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e57ff180 0x55f9e58e46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.155+0000 7f74baffd700 1 -- 172.21.15.49:0/1970875765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e58d8500 msgr2=0x55f9e58e16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:19.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.155+0000 7f74baffd700 1 --2- 172.21.15.49:0/1970875765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e58d8500 0x55f9e58e16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.155+0000 7f74baffd700 1 -- 172.21.15.49:0/1970875765 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9e58e1bf0 con 0x55f9e58d2c50 2024-06-03T00:04:19.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.155+0000 7f74baffd700 1 --2- 172.21.15.49:0/1970875765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f9e58d2c50 0x55f9e58e4c20 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f74a4020410 tx=0x7f74a400d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4678b67024415b42 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:19.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.155+0000 7f749affd700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:04:19.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.155+0000 7f749affd700 1 -- 172.21.15.49:0/1970875765 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a4024070 con 0x55f9e58d2c50 2024-06-03T00:04:19.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.155+0000 7f749affd700 1 -- 172.21.15.49:0/1970875765 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f74a402b430 con 0x55f9e58d2c50 2024-06-03T00:04:19.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.155+0000 7f74cc311b80 1 -- 172.21.15.49:0/1970875765 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74b4011920 con 0x55f9e58d2c50 2024-06-03T00:04:19.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.155+0000 7f749affd700 1 -- 172.21.15.49:0/1970875765 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f74a4005a50 con 0x55f9e58d2c50 2024-06-03T00:04:19.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.155+0000 7f74cc311b80 10 client.16263 fetch_fsmap learned FSMap version 37 2024-06-03T00:04:19.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.155+0000 7f74cc311b80 1 -- 172.21.15.49:0/1970875765 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55f9e5957750 con 0x55f9e58d2c50 2024-06-03T00:04:19.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.155+0000 7f749affd700 1 -- 172.21.15.49:0/1970875765 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74b4011920 con 0x55f9e58d2c50 2024-06-03T00:04:19.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.156+0000 7f749affd700 1 -- 172.21.15.49:0/1970875765 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f74a4006140 con 0x55f9e58d2c50 2024-06-03T00:04:19.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.156+0000 7f74cc311b80 10 client.16263 fetch_fsmap finished waiting for FSMap version 37 2024-06-03T00:04:19.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.156+0000 7f74cc311b80 10 client.16263 resolve_mds: validated gid 24487 aka daemon mds.i 2024-06-03T00:04:19.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.156+0000 7f74cc311b80 20 client.16263 populate_metadata read hostname 'smithi049' 2024-06-03T00:04:19.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.156+0000 7f74cc311b80 1 --2- 172.21.15.49:0/1970875765 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55f9e58d8e20 0x55f9e5959f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:19.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.156+0000 7f74cc311b80 4 client.16263 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6d4ca031", "release": true, "await": true}] 2024-06-03T00:04:19.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.156+0000 7f74cc311b80 1 -- 172.21.15.49:0/1970875765 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6d4ca031", "release": true, "await": true}) -- 0x55f9e582b3d0 con 0x55f9e58d8e20 2024-06-03T00:04:19.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.156+0000 7f74bb7fe700 1 --2- 172.21.15.49:0/1970875765 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55f9e58d8e20 0x55f9e5959f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:19.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.156+0000 7f749affd700 10 client.16263 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:04:19.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.156+0000 7f74bb7fe700 1 --2- 172.21.15.49:0/1970875765 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55f9e58d8e20 0x55f9e5959f30 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5b43bf300ca18f0 server_cookie=a11c04be68894b5e in_seq=0 out_seq=0 2024-06-03T00:04:19.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.364+0000 7f749affd700 1 -- 172.21.15.49:0/1970875765 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55f9e582b3d0 con 0x55f9e58d8e20 2024-06-03T00:04:19.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.364+0000 7f749affd700 10 client.16263 handle_command_reply: tid=0 2024-06-03T00:04:19.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.364+0000 7f74cc311b80 1 client.16263 shutdown 2024-06-03T00:04:19.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.364+0000 7f74cc311b80 1 -- 172.21.15.49:0/1970875765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f9e58d2c50 msgr2=0x55f9e58e4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:19.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.364+0000 7f74cc311b80 1 --2- 172.21.15.49:0/1970875765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f9e58d2c50 0x55f9e58e4c20 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f74a4020410 tx=0x7f74a400d710 comp rx=0 tx=0).stop 2024-06-03T00:04:19.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.364+0000 7f74cc311b80 1 -- 172.21.15.49:0/1970875765 shutdown_connections 2024-06-03T00:04:19.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.365+0000 7f74cc311b80 1 --2- 172.21.15.49:0/1970875765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9e58d8500 0x55f9e58e16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.365+0000 7f74cc311b80 1 --2- 172.21.15.49:0/1970875765 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e57ff180 0x55f9e58e46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.365+0000 7f74cc311b80 1 --2- 172.21.15.49:0/1970875765 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55f9e58d8e20 0x55f9e5959f30 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.365+0000 7f74cc311b80 1 --2- 172.21.15.49:0/1970875765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f9e58d2c50 0x55f9e58e4c20 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.365+0000 7f74cc311b80 1 -- 172.21.15.49:0/1970875765 >> 172.21.15.49:0/1970875765 conn(0x55f9e58d6810 msgr2=0x55f9e58d7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:19.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.365+0000 7f749affd700 0 client.16263 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:04:19.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.365+0000 7f74cc311b80 1 -- 172.21.15.49:0/1970875765 shutdown_connections 2024-06-03T00:04:19.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.365+0000 7f74cc311b80 1 -- 172.21.15.49:0/1970875765 wait complete. 2024-06-03T00:04:19.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.365+0000 7f74cc311b80 20 client.16263 trim_cache size 0 max 16384 2024-06-03T00:04:19.366 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:04:19.366 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 37, 2024-06-03T00:04:19.366 INFO:teuthology.orchestra.run.smithi049.stdout: "leader": 24487, 2024-06-03T00:04:19.366 INFO:teuthology.orchestra.run.smithi049.stdout: "set_version": 12, 2024-06-03T00:04:19.366 INFO:teuthology.orchestra.run.smithi049.stdout: "sets": { 2024-06-03T00:04:19.366 INFO:teuthology.orchestra.run.smithi049.stdout: "6d4ca031": { 2024-06-03T00:04:19.367 INFO:teuthology.orchestra.run.smithi049.stdout: "version": 12, 2024-06-03T00:04:19.367 INFO:teuthology.orchestra.run.smithi049.stdout: "age_ref": 0.0, 2024-06-03T00:04:19.367 INFO:teuthology.orchestra.run.smithi049.stdout: "state": { 2024-06-03T00:04:19.367 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "RELEASED", 2024-06-03T00:04:19.367 INFO:teuthology.orchestra.run.smithi049.stdout: "age": 0.0 2024-06-03T00:04:19.367 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:04:19.367 INFO:teuthology.orchestra.run.smithi049.stdout: "timeout": 90.0, 2024-06-03T00:04:19.367 INFO:teuthology.orchestra.run.smithi049.stdout: "expiration": 147.8, 2024-06-03T00:04:19.367 INFO:teuthology.orchestra.run.smithi049.stdout: "members": { 2024-06-03T00:04:19.367 INFO:teuthology.orchestra.run.smithi049.stdout: "file:/": { 2024-06-03T00:04:19.367 INFO:teuthology.orchestra.run.smithi049.stdout: "excluded": false, 2024-06-03T00:04:19.367 INFO:teuthology.orchestra.run.smithi049.stdout: "state": { 2024-06-03T00:04:19.367 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "RELEASED", 2024-06-03T00:04:19.368 INFO:teuthology.orchestra.run.smithi049.stdout: "age": 0.0 2024-06-03T00:04:19.368 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:04:19.368 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:04:19.368 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:04:19.368 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:04:19.368 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:04:19.368 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:04:19.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.365+0000 7f74c1a8e700 1 -- 172.21.15.49:0/2190622878 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f74a80a2c20 msgr2=0x7f74a80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:19.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.365+0000 7f74c1a8e700 1 --2- 172.21.15.49:0/2190622878 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f74a80a2c20 0x7f74a80a50e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f74bc0789b0 tx=0x7f74a4008040 comp rx=0 tx=0).stop 2024-06-03T00:04:19.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.365+0000 7f74c1a8e700 1 -- 172.21.15.49:0/2190622878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74bc06a170 msgr2=0x7f74bc101460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:19.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.365+0000 7f74c1a8e700 1 --2- 172.21.15.49:0/2190622878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74bc06a170 0x7f74bc101460 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f74ac00b070 tx=0x7f74ac004ef0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.366+0000 7f74c1a8e700 1 -- 172.21.15.49:0/2190622878 shutdown_connections 2024-06-03T00:04:19.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.366+0000 7f74c1a8e700 1 --2- 172.21.15.49:0/2190622878 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f74a80a2c20 0x7f74a80a50e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.366+0000 7f74c1a8e700 1 --2- 172.21.15.49:0/2190622878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74bc108500 0x7f74bc101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.366+0000 7f74c1a8e700 1 --2- 172.21.15.49:0/2190622878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74bc06a170 0x7f74bc101460 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.366+0000 7f74c1a8e700 1 --2- 172.21.15.49:0/2190622878 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74bc06ab30 0x7f74bc1019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:19.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.366+0000 7f74c1a8e700 1 -- 172.21.15.49:0/2190622878 >> 172.21.15.49:0/2190622878 conn(0x7f74bc078340 msgr2=0x7f74bc100030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:19.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.366+0000 7f74c1a8e700 1 -- 172.21.15.49:0/2190622878 shutdown_connections 2024-06-03T00:04:19.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:19.366+0000 7f74c1a8e700 1 -- 172.21.15.49:0/2190622878 wait complete. 2024-06-03T00:04:20.122 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6d4ca031', total seconds elapsed: 33.9 2024-06-03T00:04:20.123 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.75 2024-06-03T00:04:20.123 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-03T00:04:20.380 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:04:20.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:20 smithi057 ceph-mon[36457]: pgmap v512: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.6 KiB/s wr, 14 op/s 2024-06-03T00:04:20.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:20 smithi049 ceph-mon[32302]: pgmap v512: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.6 KiB/s wr, 14 op/s 2024-06-03T00:04:20.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:20 smithi107 ceph-mon[37048]: pgmap v512: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.6 KiB/s wr, 14 op/s 2024-06-03T00:04:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.193+0000 7f6167ae0700 1 -- 172.21.15.49:0/133440727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6160101d50 msgr2=0x7f616010e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.193+0000 7f6167ae0700 1 --2- 172.21.15.49:0/133440727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6160101d50 0x7f616010e240 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f615800b0a0 tx=0x7f615800b3b0 comp rx=0 tx=0).stop 2024-06-03T00:04:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.193+0000 7f6167ae0700 1 -- 172.21.15.49:0/133440727 shutdown_connections 2024-06-03T00:04:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.193+0000 7f6167ae0700 1 --2- 172.21.15.49:0/133440727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6160101d50 0x7f616010e240 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.193+0000 7f6167ae0700 1 --2- 172.21.15.49:0/133440727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6160107400 0x7f61601077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.193+0000 7f6167ae0700 1 --2- 172.21.15.49:0/133440727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6160101390 0x7f6160101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.193+0000 7f6167ae0700 1 -- 172.21.15.49:0/133440727 >> 172.21.15.49:0/133440727 conn(0x7f6160078340 msgr2=0x7f6160078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.194+0000 7f6167ae0700 1 -- 172.21.15.49:0/133440727 shutdown_connections 2024-06-03T00:04:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.194+0000 7f6167ae0700 1 -- 172.21.15.49:0/133440727 wait complete. 2024-06-03T00:04:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.194+0000 7f6167ae0700 1 Processor -- start 2024-06-03T00:04:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.194+0000 7f6167ae0700 1 -- start start 2024-06-03T00:04:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.194+0000 7f6167ae0700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6160101390 0x7f6160103070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.195+0000 7f6167ae0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6160101d50 0x7f61601035b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.195+0000 7f6167ae0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6160107400 0x7f6160103af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.195+0000 7f6167ae0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6160111690 con 0x7f6160101d50 2024-06-03T00:04:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.195+0000 7f6167ae0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6160111510 con 0x7f6160107400 2024-06-03T00:04:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.195+0000 7f6167ae0700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6160111810 con 0x7f6160101390 2024-06-03T00:04:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.195+0000 7f616507b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6160101d50 0x7f61601035b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.195+0000 7f616587c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6160101390 0x7f6160103070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.195+0000 7f616587c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6160101390 0x7f6160103070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:44458/0 (socket says 172.21.15.49:44458) 2024-06-03T00:04:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.195+0000 7f616507b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6160101d50 0x7f61601035b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58220/0 (socket says 172.21.15.49:58220) 2024-06-03T00:04:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.195+0000 7f616587c700 1 -- 172.21.15.49:0/3786376923 learned_addr learned my addr 172.21.15.49:0/3786376923 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.195+0000 7f616607d700 1 --2- 172.21.15.49:0/3786376923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6160107400 0x7f6160103af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.195+0000 7f616587c700 1 -- 172.21.15.49:0/3786376923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6160107400 msgr2=0x7f6160103af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.195+0000 7f616587c700 1 --2- 172.21.15.49:0/3786376923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6160107400 0x7f6160103af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:22.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.195+0000 7f616587c700 1 -- 172.21.15.49:0/3786376923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6160101d50 msgr2=0x7f61601035b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:22.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.195+0000 7f616587c700 1 --2- 172.21.15.49:0/3786376923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6160101d50 0x7f61601035b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:22.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.195+0000 7f616587c700 1 -- 172.21.15.49:0/3786376923 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61601a70d0 con 0x7f6160101390 2024-06-03T00:04:22.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.195+0000 7f616507b700 1 --2- 172.21.15.49:0/3786376923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6160101d50 0x7f61601035b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:04:22.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.195+0000 7f616587c700 1 --2- 172.21.15.49:0/3786376923 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6160101390 0x7f6160103070 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f615c00e9c0 tx=0x7f615c00ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:22.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.195+0000 7f6156ffd700 1 -- 172.21.15.49:0/3786376923 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f615c00cbd0 con 0x7f6160101390 2024-06-03T00:04:22.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.195+0000 7f6167ae0700 1 -- 172.21.15.49:0/3786376923 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61601a73c0 con 0x7f6160101390 2024-06-03T00:04:22.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.196+0000 7f6156ffd700 1 -- 172.21.15.49:0/3786376923 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f615c00ee60 con 0x7f6160101390 2024-06-03T00:04:22.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.196+0000 7f6167ae0700 1 -- 172.21.15.49:0/3786376923 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61601a7900 con 0x7f6160101390 2024-06-03T00:04:22.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.196+0000 7f6156ffd700 1 -- 172.21.15.49:0/3786376923 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f615c005630 con 0x7f6160101390 2024-06-03T00:04:22.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.197+0000 7f6167ae0700 1 -- 172.21.15.49:0/3786376923 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6160069180 con 0x7f6160101390 2024-06-03T00:04:22.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.198+0000 7f6156ffd700 1 -- 172.21.15.49:0/3786376923 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f615c044b30 con 0x7f6160101390 2024-06-03T00:04:22.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.199+0000 7f6156ffd700 1 --2- 172.21.15.49:0/3786376923 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f614c0a2c20 0x7f614c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:22.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.199+0000 7f616507b700 1 --2- 172.21.15.49:0/3786376923 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f614c0a2c20 0x7f614c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:22.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.199+0000 7f6156ffd700 1 -- 172.21.15.49:0/3786376923 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f615c0cf270 con 0x7f6160101390 2024-06-03T00:04:22.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.199+0000 7f616507b700 1 --2- 172.21.15.49:0/3786376923 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f614c0a2c20 0x7f614c0a50e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6160078940 tx=0x7f615000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:22.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.206+0000 7f6156ffd700 1 -- 172.21.15.49:0/3786376923 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f615c09c190 con 0x7f6160101390 2024-06-03T00:04:22.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:22 smithi049 ceph-mon[32302]: pgmap v513: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 45 KiB/s wr, 14 op/s 2024-06-03T00:04:22.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.473+0000 7f6167ae0700 1 -- 172.21.15.49:0/3786376923 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61601a7c20 con 0x7f6160101390 2024-06-03T00:04:22.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.474+0000 7f6156ffd700 1 -- 172.21.15.49:0/3786376923 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11948 (secure 0 0 0) 0x7f615c044e20 con 0x7f6160101390 2024-06-03T00:04:22.474 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:04:22.474 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1553264866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1553264866},{"type":"v1","addr":"172.21.15.49:6835","nonce":1553264866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2266285252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2266285252},{"type":"v1","addr":"172.21.15.49:6837","nonce":2266285252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T23:57:16.991201+0000","modified":"2024-06-03T00:03:50.303719+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24485,"mds_2":24466,"mds_3":24464,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6839/1729124617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":1729124617},{"type":"v1","addr":"172.21.15.49:6839","nonce":1729124617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6841/1902772235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":1902772235},{"type":"v1","addr":"172.21.15.49:6841","nonce":1902772235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6833/1633534002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1633534002},{"type":"v1","addr":"172.21.15.57:6833","nonce":1633534002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6835/2254905671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2254905671},{"type":"v1","addr":"172.21.15.57:6835","nonce":2254905671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.107:6835/3693542801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3693542801},{"type":"v1","addr":"172.21.15.107:6835","nonce":3693542801}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.57:6837/230452144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":230452144},{"type":"v1","addr":"172.21.15.57:6837","nonce":230452144}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":92,"addr":"172.21.15.107:6837/3700593315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":3700593315},{"type":"v1","addr":"172.21.15.107:6837","nonce":3700593315}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6839/249825195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":249825195},{"type":"v1","addr":"172.21.15.57:6839","nonce":249825195}]},"join_fscid":-1,"export_targets":[0,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6839/1986600681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1986600681},{"type":"v1","addr":"172.21.15.107:6839","nonce":1986600681}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24464,24485,24460,24487,24466]},"id":1}]} 2024-06-03T00:04:22.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.477+0000 7f6167ae0700 1 -- 172.21.15.49:0/3786376923 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f614c0a2c20 msgr2=0x7f614c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:22.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.477+0000 7f6167ae0700 1 --2- 172.21.15.49:0/3786376923 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f614c0a2c20 0x7f614c0a50e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6160078940 tx=0x7f615000b410 comp rx=0 tx=0).stop 2024-06-03T00:04:22.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.477+0000 7f6167ae0700 1 -- 172.21.15.49:0/3786376923 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6160101390 msgr2=0x7f6160103070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:22.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.477+0000 7f6167ae0700 1 --2- 172.21.15.49:0/3786376923 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6160101390 0x7f6160103070 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f615c00e9c0 tx=0x7f615c00ecd0 comp rx=0 tx=0).stop 2024-06-03T00:04:22.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.477+0000 7f6167ae0700 1 -- 172.21.15.49:0/3786376923 shutdown_connections 2024-06-03T00:04:22.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.477+0000 7f6167ae0700 1 --2- 172.21.15.49:0/3786376923 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f614c0a2c20 0x7f614c0a50e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:22.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.477+0000 7f6167ae0700 1 --2- 172.21.15.49:0/3786376923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6160107400 0x7f6160103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:22.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.477+0000 7f6167ae0700 1 --2- 172.21.15.49:0/3786376923 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6160101390 0x7f6160103070 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:22.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.477+0000 7f6167ae0700 1 --2- 172.21.15.49:0/3786376923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6160101d50 0x7f61601035b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:22.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.477+0000 7f6167ae0700 1 -- 172.21.15.49:0/3786376923 >> 172.21.15.49:0/3786376923 conn(0x7f6160078340 msgr2=0x7f61601005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:22.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.477+0000 7f6167ae0700 1 -- 172.21.15.49:0/3786376923 shutdown_connections 2024-06-03T00:04:22.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:22.477+0000 7f6167ae0700 1 -- 172.21.15.49:0/3786376923 wait complete. 2024-06-03T00:04:22.477 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 37 2024-06-03T00:04:22.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:22 smithi057 ceph-mon[36457]: pgmap v513: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 45 KiB/s wr, 14 op/s 2024-06-03T00:04:22.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:22 smithi107 ceph-mon[37048]: pgmap v513: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 45 KiB/s wr, 14 op/s 2024-06-03T00:04:23.239 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24487 quiesce db / --timeout 90 --expiration 147.75 --await-for 45.0' 2024-06-03T00:04:23.239 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- timeout 105 ceph tell mds.24487 quiesce db / --timeout 90 --expiration 147.75 --await-for 45.0 2024-06-03T00:04:23.497 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:04:23.619 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:23 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3786376923' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:04:23.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:23 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/3786376923' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:04:23.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:23 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/3786376923' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:04:24.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:24 smithi057 ceph-mon[36457]: pgmap v514: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 84 KiB/s wr, 43 op/s 2024-06-03T00:04:24.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:24 smithi049 ceph-mon[32302]: pgmap v514: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 84 KiB/s wr, 43 op/s 2024-06-03T00:04:24.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:24 smithi107 ceph-mon[37048]: pgmap v514: 97 pgs: 97 active+clean; 112 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 84 KiB/s wr, 43 op/s 2024-06-03T00:04:25.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.454+0000 7f20e2b3f700 1 -- 172.21.15.49:0/2378238662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20dc1027a0 msgr2=0x7f20dc102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:25.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.454+0000 7f20e2b3f700 1 --2- 172.21.15.49:0/2378238662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20dc1027a0 0x7f20dc102b80 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f20d00099c0 tx=0x7f20d0009cd0 comp rx=0 tx=0).stop 2024-06-03T00:04:25.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.454+0000 7f20e2b3f700 1 -- 172.21.15.49:0/2378238662 shutdown_connections 2024-06-03T00:04:25.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.454+0000 7f20e2b3f700 1 --2- 172.21.15.49:0/2378238662 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20dc107790 0x7f20dc10f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:25.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.454+0000 7f20e2b3f700 1 --2- 172.21.15.49:0/2378238662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20dc1027a0 0x7f20dc102b80 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:25.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.454+0000 7f20e2b3f700 1 --2- 172.21.15.49:0/2378238662 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20dc103150 0x7f20dc1070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:25.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.454+0000 7f20e2b3f700 1 -- 172.21.15.49:0/2378238662 >> 172.21.15.49:0/2378238662 conn(0x7f20dc079560 msgr2=0x7f20dc079970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:25.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.454+0000 7f20e2b3f700 1 -- 172.21.15.49:0/2378238662 shutdown_connections 2024-06-03T00:04:25.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.454+0000 7f20e2b3f700 1 -- 172.21.15.49:0/2378238662 wait complete. 2024-06-03T00:04:25.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.454+0000 7f20e2b3f700 1 Processor -- start 2024-06-03T00:04:25.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.455+0000 7f20e2b3f700 1 -- start start 2024-06-03T00:04:25.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.455+0000 7f20e2b3f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20dc1027a0 0x7f20dc074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:25.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.455+0000 7f20e2b3f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20dc103150 0x7f20dc074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:25.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.455+0000 7f20e2b3f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20dc107790 0x7f20dc075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:25.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.455+0000 7f20e2b3f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc1127b0 con 0x7f20dc103150 2024-06-03T00:04:25.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.455+0000 7f20e2b3f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc112630 con 0x7f20dc107790 2024-06-03T00:04:25.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.455+0000 7f20e2b3f700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc112930 con 0x7f20dc1027a0 2024-06-03T00:04:25.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.455+0000 7f20dbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20dc103150 0x7f20dc074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:25.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.455+0000 7f20e08db700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20dc1027a0 0x7f20dc074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:25.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.455+0000 7f20e08db700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20dc1027a0 0x7f20dc074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:56080/0 (socket says 172.21.15.49:56080) 2024-06-03T00:04:25.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.455+0000 7f20dbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20dc103150 0x7f20dc074cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50944/0 (socket says 172.21.15.49:50944) 2024-06-03T00:04:25.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.455+0000 7f20e08db700 1 -- 172.21.15.49:0/2936704442 learned_addr learned my addr 172.21.15.49:0/2936704442 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:25.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.455+0000 7f20e10dc700 1 --2- 172.21.15.49:0/2936704442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20dc107790 0x7f20dc075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:25.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.455+0000 7f20e08db700 1 -- 172.21.15.49:0/2936704442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20dc107790 msgr2=0x7f20dc075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:25.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.455+0000 7f20e08db700 1 --2- 172.21.15.49:0/2936704442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20dc107790 0x7f20dc075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:25.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.455+0000 7f20e08db700 1 -- 172.21.15.49:0/2936704442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20dc103150 msgr2=0x7f20dc074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:25.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.455+0000 7f20e08db700 1 --2- 172.21.15.49:0/2936704442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20dc103150 0x7f20dc074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:25.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.455+0000 7f20e08db700 1 -- 172.21.15.49:0/2936704442 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20dc1a70b0 con 0x7f20dc1027a0 2024-06-03T00:04:25.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.455+0000 7f20dbfff700 1 --2- 172.21.15.49:0/2936704442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20dc103150 0x7f20dc074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:04:25.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.456+0000 7f20e08db700 1 --2- 172.21.15.49:0/2936704442 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20dc1027a0 0x7f20dc074790 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f20d00059d0 tx=0x7f20d000fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:25.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.456+0000 7f20d9ffb700 1 -- 172.21.15.49:0/2936704442 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d0027070 con 0x7f20dc1027a0 2024-06-03T00:04:25.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.456+0000 7f20d9ffb700 1 -- 172.21.15.49:0/2936704442 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20d0003680 con 0x7f20dc1027a0 2024-06-03T00:04:25.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.456+0000 7f20d9ffb700 1 -- 172.21.15.49:0/2936704442 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d00173f0 con 0x7f20dc1027a0 2024-06-03T00:04:25.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.456+0000 7f20e2b3f700 1 -- 172.21.15.49:0/2936704442 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20dc1a7340 con 0x7f20dc1027a0 2024-06-03T00:04:25.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.456+0000 7f20e2b3f700 1 -- 172.21.15.49:0/2936704442 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20dc1a77f0 con 0x7f20dc1027a0 2024-06-03T00:04:25.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.458+0000 7f20d9ffb700 1 -- 172.21.15.49:0/2936704442 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f20d002a070 con 0x7f20dc1027a0 2024-06-03T00:04:25.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.459+0000 7f20d9ffb700 1 --2- 172.21.15.49:0/2936704442 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f20cc0a2d40 0x7f20cc0a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:25.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.459+0000 7f20dbfff700 1 --2- 172.21.15.49:0/2936704442 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f20cc0a2d40 0x7f20cc0a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:25.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.459+0000 7f20d9ffb700 1 -- 172.21.15.49:0/2936704442 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f20d00cfb70 con 0x7f20dc1027a0 2024-06-03T00:04:25.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.459+0000 7f20dbfff700 1 --2- 172.21.15.49:0/2936704442 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f20cc0a2d40 0x7f20cc0a5200 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f20dc108ae0 tx=0x7f20c800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:25.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.460+0000 7f20ed3c2b80 1 Processor -- start 2024-06-03T00:04:25.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.460+0000 7f20ed3c2b80 1 -- start start 2024-06-03T00:04:25.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.460+0000 7f20ed3c2b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a58adc5a0 0x556a58adc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:25.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.460+0000 7f20ed3c2b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a58adcec0 0x556a58ad67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:25.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.460+0000 7f20ed3c2b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a58ad6cf0 0x556a58ad7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:25.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.460+0000 7f20ed3c2b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556a589c9100 con 0x556a58adc5a0 2024-06-03T00:04:25.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.460+0000 7f20ed3c2b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x556a58a279f0 con 0x556a58ad6cf0 2024-06-03T00:04:25.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.460+0000 7f20ed3c2b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556a5898f600 con 0x556a58adcec0 2024-06-03T00:04:25.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.460+0000 7f20e08db700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a58adc5a0 0x556a58adc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:25.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.460+0000 7f20e08db700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a58adc5a0 0x556a58adc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50946/0 (socket says 172.21.15.49:50946) 2024-06-03T00:04:25.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.460+0000 7f20e08db700 1 -- 172.21.15.49:0/278711907 learned_addr learned my addr 172.21.15.49:0/278711907 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:25.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.461+0000 7f20dbfff700 1 --2- 172.21.15.49:0/278711907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a58adcec0 0x556a58ad67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:25.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.461+0000 7f20e10dc700 1 --2- 172.21.15.49:0/278711907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a58ad6cf0 0x556a58ad7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:25.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.461+0000 7f20e08db700 1 -- 172.21.15.49:0/278711907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a58adcec0 msgr2=0x556a58ad67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:25.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.461+0000 7f20e08db700 1 --2- 172.21.15.49:0/278711907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a58adcec0 0x556a58ad67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:25.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.461+0000 7f20e08db700 1 -- 172.21.15.49:0/278711907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a58ad6cf0 msgr2=0x556a58ad7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:25.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.461+0000 7f20e08db700 1 --2- 172.21.15.49:0/278711907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a58ad6cf0 0x556a58ad7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:25.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.461+0000 7f20e08db700 1 -- 172.21.15.49:0/278711907 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a58976a70 con 0x556a58adc5a0 2024-06-03T00:04:25.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.461+0000 7f20e08db700 1 --2- 172.21.15.49:0/278711907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a58adc5a0 0x556a58adc980 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f20d0009d70 tx=0x7f20d0096f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1724bb9cfc9febc6 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:25.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.461+0000 7f20c6ffd700 1 -- 172.21.15.49:0/278711907 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d009bd80 con 0x556a58adc5a0 2024-06-03T00:04:25.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.461+0000 7f20c6ffd700 1 -- 172.21.15.49:0/278711907 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20d009cb20 con 0x556a58adc5a0 2024-06-03T00:04:25.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.461+0000 7f20c6ffd700 1 -- 172.21.15.49:0/278711907 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d009b870 con 0x556a58adc5a0 2024-06-03T00:04:25.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.462+0000 7f20ed3c2b80 1 -- 172.21.15.49:0/278711907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a58adc5a0 msgr2=0x556a58adc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:25.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.462+0000 7f20ed3c2b80 1 --2- 172.21.15.49:0/278711907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a58adc5a0 0x556a58adc980 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f20d0009d70 tx=0x7f20d0096f90 comp rx=0 tx=0).stop 2024-06-03T00:04:25.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.462+0000 7f20ed3c2b80 1 -- 172.21.15.49:0/278711907 shutdown_connections 2024-06-03T00:04:25.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.462+0000 7f20ed3c2b80 1 --2- 172.21.15.49:0/278711907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a58ad6cf0 0x556a58ad7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:25.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.462+0000 7f20ed3c2b80 1 --2- 172.21.15.49:0/278711907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a58adc5a0 0x556a58adc980 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:25.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.462+0000 7f20ed3c2b80 1 --2- 172.21.15.49:0/278711907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a58adcec0 0x556a58ad67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:25.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.462+0000 7f20ed3c2b80 1 -- 172.21.15.49:0/278711907 >> 172.21.15.49:0/278711907 conn(0x556a58a03220 msgr2=0x556a58ad1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:25.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.462+0000 7f20ed3c2b80 1 -- 172.21.15.49:0/278711907 shutdown_connections 2024-06-03T00:04:25.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.462+0000 7f20ed3c2b80 1 -- 172.21.15.49:0/278711907 wait complete. 2024-06-03T00:04:25.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.462+0000 7f20ed3c2b80 1 -- start start 2024-06-03T00:04:25.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.463+0000 7f20ed3c2b80 1 Processor -- start 2024-06-03T00:04:25.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.463+0000 7f20ed3c2b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a58ad6cf0 0x556a58ae2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:25.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.463+0000 7f20ed3c2b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a58adc5a0 0x556a58adffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:25.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.463+0000 7f20ed3c2b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a58adcec0 0x556a58ae04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:25.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.463+0000 7f20ed3c2b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556a589c8160 con 0x556a58adc5a0 2024-06-03T00:04:25.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.463+0000 7f20ed3c2b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x556a58a239b0 con 0x556a58ad6cf0 2024-06-03T00:04:25.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.463+0000 7f20ed3c2b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556a58ae3650 con 0x556a58adcec0 2024-06-03T00:04:25.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.463+0000 7f20ed3c2b80 10 client.0 _ll_register_callbacks cb 0x556a589bd750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:04:25.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.463+0000 7f20dbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a58adc5a0 0x556a58adffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:25.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.463+0000 7f20dbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a58adc5a0 0x556a58adffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50958/0 (socket says 172.21.15.49:50958) 2024-06-03T00:04:25.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.463+0000 7f20dbfff700 1 -- 172.21.15.49:0/3143914924 learned_addr learned my addr 172.21.15.49:0/3143914924 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:25.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.463+0000 7f20e10dc700 1 --2- 172.21.15.49:0/3143914924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a58adcec0 0x556a58ae04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:25.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.463+0000 7f20e08db700 1 --2- 172.21.15.49:0/3143914924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a58ad6cf0 0x556a58ae2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:25.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.464+0000 7f20e10dc700 1 -- 172.21.15.49:0/3143914924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a58ad6cf0 msgr2=0x556a58ae2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:25.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.464+0000 7f20e10dc700 1 --2- 172.21.15.49:0/3143914924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a58ad6cf0 0x556a58ae2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:25.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.464+0000 7f20e10dc700 1 -- 172.21.15.49:0/3143914924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a58adc5a0 msgr2=0x556a58adffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:25.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.464+0000 7f20e10dc700 1 --2- 172.21.15.49:0/3143914924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a58adc5a0 0x556a58adffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:25.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.464+0000 7f20e10dc700 1 -- 172.21.15.49:0/3143914924 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a589ed8f0 con 0x556a58adcec0 2024-06-03T00:04:25.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.464+0000 7f20dbfff700 1 --2- 172.21.15.49:0/3143914924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a58adc5a0 0x556a58adffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:04:25.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.464+0000 7f20e10dc700 1 --2- 172.21.15.49:0/3143914924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a58adcec0 0x556a58ae04f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f20d4007b20 tx=0x7f20d4007b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8ff8aad7dd84dba server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:25.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.464+0000 7f20bbfff700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-06-03T00:04:25.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.464+0000 7f20bbfff700 1 -- 172.21.15.49:0/3143914924 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d401a070 con 0x556a58adcec0 2024-06-03T00:04:25.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.464+0000 7f20bbfff700 1 -- 172.21.15.49:0/3143914924 <== mon.1 v2:172.21.15.107:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f20d4004db0 con 0x556a58adcec0 2024-06-03T00:04:25.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.464+0000 7f20ed3c2b80 1 -- 172.21.15.49:0/3143914924 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20d009cb20 con 0x556a58adcec0 2024-06-03T00:04:25.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.464+0000 7f20bbfff700 1 -- 172.21.15.49:0/3143914924 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f20d4025050 con 0x556a58adcec0 2024-06-03T00:04:25.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.464+0000 7f20ed3c2b80 10 client.25858 fetch_fsmap learned FSMap version 38 2024-06-03T00:04:25.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.464+0000 7f20ed3c2b80 1 -- 172.21.15.49:0/3143914924 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x556a58aedd80 con 0x556a58adcec0 2024-06-03T00:04:25.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.464+0000 7f20bbfff700 1 -- 172.21.15.49:0/3143914924 <== mon.1 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20d009cb20 con 0x556a58adcec0 2024-06-03T00:04:25.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.464+0000 7f20bbfff700 1 -- 172.21.15.49:0/3143914924 <== mon.1 v2:172.21.15.107:3300/0 5 ==== fsmap(e 38) ==== 8406+0+0 (secure 0 0 0) 0x7f20d4016920 con 0x556a58adcec0 2024-06-03T00:04:25.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.465+0000 7f20ed3c2b80 10 client.25858 fetch_fsmap finished waiting for FSMap version 38 2024-06-03T00:04:25.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.465+0000 7f20ed3c2b80 10 client.25858 resolve_mds: validated gid 24487 aka daemon mds.i 2024-06-03T00:04:25.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.465+0000 7f20ed3c2b80 20 client.25858 populate_metadata read hostname 'smithi049' 2024-06-03T00:04:25.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.465+0000 7f20ed3c2b80 1 --2- 172.21.15.49:0/3143914924 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x556a58af07f0 0x556a58af2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:25.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.465+0000 7f20ed3c2b80 4 client.25858 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:04:25.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.465+0000 7f20ed3c2b80 1 -- 172.21.15.49:0/3143914924 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a58a34ef0 con 0x556a58af07f0 2024-06-03T00:04:25.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.465+0000 7f20e08db700 1 --2- 172.21.15.49:0/3143914924 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x556a58af07f0 0x556a58af2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:25.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.465+0000 7f20bbfff700 10 client.25858 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:04:25.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.465+0000 7f20e08db700 1 --2- 172.21.15.49:0/3143914924 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x556a58af07f0 0x556a58af2c10 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4138f85b818fe673 server_cookie=9e988eba69251fa2 in_seq=0 out_seq=0 2024-06-03T00:04:25.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.466+0000 7f20bbfff700 1 -- 172.21.15.49:0/3143914924 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x556a58a34ef0 con 0x556a58af07f0 2024-06-03T00:04:25.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.466+0000 7f20bbfff700 10 client.25858 handle_command_reply: tid=0 2024-06-03T00:04:25.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.466+0000 7f20ed3c2b80 1 client.25858 shutdown 2024-06-03T00:04:25.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.466+0000 7f20ed3c2b80 1 -- 172.21.15.49:0/3143914924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a58adcec0 msgr2=0x556a58ae04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:25.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.466+0000 7f20ed3c2b80 1 --2- 172.21.15.49:0/3143914924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a58adcec0 0x556a58ae04f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f20d4007b20 tx=0x7f20d4007b50 comp rx=0 tx=0).stop 2024-06-03T00:04:25.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.466+0000 7f20ed3c2b80 1 -- 172.21.15.49:0/3143914924 shutdown_connections 2024-06-03T00:04:25.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.466+0000 7f20ed3c2b80 1 --2- 172.21.15.49:0/3143914924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a58adcec0 0x556a58ae04f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:25.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.466+0000 7f20ed3c2b80 1 --2- 172.21.15.49:0/3143914924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a58ad6cf0 0x556a58ae2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:25.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.466+0000 7f20ed3c2b80 1 --2- 172.21.15.49:0/3143914924 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x556a58af07f0 0x556a58af2c10 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:25.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.466+0000 7f20ed3c2b80 1 --2- 172.21.15.49:0/3143914924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a58adc5a0 0x556a58adffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:25.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.466+0000 7f20bbfff700 0 client.25858 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:04:25.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.466+0000 7f20ed3c2b80 1 -- 172.21.15.49:0/3143914924 >> 172.21.15.49:0/3143914924 conn(0x556a58a03220 msgr2=0x556a58ad03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:25.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.467+0000 7f20ed3c2b80 1 -- 172.21.15.49:0/3143914924 shutdown_connections 2024-06-03T00:04:25.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.467+0000 7f20ed3c2b80 1 -- 172.21.15.49:0/3143914924 wait complete. 2024-06-03T00:04:25.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.467+0000 7f20ed3c2b80 20 client.25858 trim_cache size 0 max 16384 2024-06-03T00:04:25.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.487+0000 7f20ed3c2b80 1 Processor -- start 2024-06-03T00:04:25.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.487+0000 7f20ed3c2b80 1 -- start start 2024-06-03T00:04:25.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.488+0000 7f20ed3c2b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a58ad6cf0 0x556a58ae2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:25.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.488+0000 7f20ed3c2b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a58adc5a0 0x556a58ae2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:25.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.488+0000 7f20ed3c2b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a58adcec0 0x556a58adff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:25.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.488+0000 7f20ed3c2b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc1aed30 con 0x556a58ad6cf0 2024-06-03T00:04:25.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.488+0000 7f20ed3c2b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc1b0a80 con 0x556a58adc5a0 2024-06-03T00:04:25.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.488+0000 7f20ed3c2b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc1af460 con 0x556a58adcec0 2024-06-03T00:04:25.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.488+0000 7f20e08db700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a58ad6cf0 0x556a58ae2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:25.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.488+0000 7f20e08db700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a58ad6cf0 0x556a58ae2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50964/0 (socket says 172.21.15.49:50964) 2024-06-03T00:04:25.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.488+0000 7f20e08db700 1 -- 172.21.15.49:0/1747098530 learned_addr learned my addr 172.21.15.49:0/1747098530 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:25.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.488+0000 7f20dbfff700 1 --2- 172.21.15.49:0/1747098530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a58adc5a0 0x556a58ae2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:25.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.488+0000 7f20e10dc700 1 --2- 172.21.15.49:0/1747098530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a58adcec0 0x556a58adff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:25.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.488+0000 7f20dbfff700 1 -- 172.21.15.49:0/1747098530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a58adcec0 msgr2=0x556a58adff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:25.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.488+0000 7f20dbfff700 1 --2- 172.21.15.49:0/1747098530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a58adcec0 0x556a58adff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:25.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.488+0000 7f20dbfff700 1 -- 172.21.15.49:0/1747098530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a58ad6cf0 msgr2=0x556a58ae2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:25.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.488+0000 7f20dbfff700 1 --2- 172.21.15.49:0/1747098530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a58ad6cf0 0x556a58ae2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:25.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.488+0000 7f20dbfff700 1 -- 172.21.15.49:0/1747098530 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a58adaa60 con 0x556a58adc5a0 2024-06-03T00:04:25.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.488+0000 7f20e08db700 1 --2- 172.21.15.49:0/1747098530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a58ad6cf0 0x556a58ae2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:04:25.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.488+0000 7f20dbfff700 1 --2- 172.21.15.49:0/1747098530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a58adc5a0 0x556a58ae2ab0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f20c800aae0 tx=0x7f20c8012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45b059b6e2e3a055 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:25.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.489+0000 7f20c67fc700 1 -- 172.21.15.49:0/1747098530 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c802b070 con 0x556a58adc5a0 2024-06-03T00:04:25.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.489+0000 7f20c67fc700 1 -- 172.21.15.49:0/1747098530 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20c8010be0 con 0x556a58adc5a0 2024-06-03T00:04:25.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.489+0000 7f20c67fc700 1 -- 172.21.15.49:0/1747098530 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c8016070 con 0x556a58adc5a0 2024-06-03T00:04:25.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.489+0000 7f20ed3c2b80 1 -- 172.21.15.49:0/1747098530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a58adc5a0 msgr2=0x556a58ae2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:25.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.489+0000 7f20ed3c2b80 1 --2- 172.21.15.49:0/1747098530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a58adc5a0 0x556a58ae2ab0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f20c800aae0 tx=0x7f20c8012000 comp rx=0 tx=0).stop 2024-06-03T00:04:25.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.489+0000 7f20ed3c2b80 1 -- 172.21.15.49:0/1747098530 shutdown_connections 2024-06-03T00:04:25.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.489+0000 7f20ed3c2b80 1 --2- 172.21.15.49:0/1747098530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a58adcec0 0x556a58adff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:25.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.489+0000 7f20ed3c2b80 1 --2- 172.21.15.49:0/1747098530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a58ad6cf0 0x556a58ae2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:25.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.489+0000 7f20ed3c2b80 1 --2- 172.21.15.49:0/1747098530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a58adc5a0 0x556a58ae2ab0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:25.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.489+0000 7f20ed3c2b80 1 -- 172.21.15.49:0/1747098530 >> 172.21.15.49:0/1747098530 conn(0x556a58a03220 msgr2=0x556a58adf860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:25.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.489+0000 7f20ed3c2b80 1 -- 172.21.15.49:0/1747098530 shutdown_connections 2024-06-03T00:04:25.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.489+0000 7f20ed3c2b80 1 -- 172.21.15.49:0/1747098530 wait complete. 2024-06-03T00:04:25.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.490+0000 7f20ed3c2b80 1 -- start start 2024-06-03T00:04:25.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.490+0000 7f20ed3c2b80 1 Processor -- start 2024-06-03T00:04:25.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.490+0000 7f20ed3c2b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a58ad6cf0 0x556a58af7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:25.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.490+0000 7f20ed3c2b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a58adc5a0 0x556a58af84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:25.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.490+0000 7f20ed3c2b80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a58adcec0 0x556a58af8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:25.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.490+0000 7f20ed3c2b80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc1b02f0 con 0x556a58adcec0 2024-06-03T00:04:25.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.490+0000 7f20ed3c2b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc1afb90 con 0x556a58ad6cf0 2024-06-03T00:04:25.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.490+0000 7f20ed3c2b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc1accb0 con 0x556a58adc5a0 2024-06-03T00:04:25.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.490+0000 7f20ed3c2b80 10 client.0 _ll_register_callbacks cb 0x556a589bd750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:04:25.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.490+0000 7f20dbfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a58adc5a0 0x556a58af84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:25.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.490+0000 7f20dbfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a58adc5a0 0x556a58af84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:56108/0 (socket says 172.21.15.49:56108) 2024-06-03T00:04:25.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.490+0000 7f20dbfff700 1 -- 172.21.15.49:0/2385995438 learned_addr learned my addr 172.21.15.49:0/2385995438 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:25.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.491+0000 7f20e10dc700 1 --2- 172.21.15.49:0/2385995438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a58adcec0 0x556a58af8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:25.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.491+0000 7f20e08db700 1 --2- 172.21.15.49:0/2385995438 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a58ad6cf0 0x556a58af7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:25.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.491+0000 7f20dbfff700 1 -- 172.21.15.49:0/2385995438 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a58ad6cf0 msgr2=0x556a58af7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:25.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.491+0000 7f20dbfff700 1 --2- 172.21.15.49:0/2385995438 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a58ad6cf0 0x556a58af7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:25.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.491+0000 7f20dbfff700 1 -- 172.21.15.49:0/2385995438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a58adcec0 msgr2=0x556a58af8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:25.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.491+0000 7f20dbfff700 1 --2- 172.21.15.49:0/2385995438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a58adcec0 0x556a58af8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:25.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.491+0000 7f20dbfff700 1 -- 172.21.15.49:0/2385995438 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a58b5a370 con 0x556a58adc5a0 2024-06-03T00:04:25.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.491+0000 7f20e08db700 1 --2- 172.21.15.49:0/2385995438 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a58ad6cf0 0x556a58af7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:04:25.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.491+0000 7f20dbfff700 1 --2- 172.21.15.49:0/2385995438 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a58adc5a0 0x556a58af84f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f20c8000c00 tx=0x7f20c8010930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35c2842493d99a7e server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:25.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.491+0000 7f20bbfff700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-06-03T00:04:25.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.491+0000 7f20bbfff700 1 -- 172.21.15.49:0/2385995438 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c802b070 con 0x556a58adc5a0 2024-06-03T00:04:25.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.491+0000 7f20ed3c2b80 1 -- 172.21.15.49:0/2385995438 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20c8010be0 con 0x556a58adc5a0 2024-06-03T00:04:25.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.491+0000 7f20bbfff700 1 -- 172.21.15.49:0/2385995438 <== mon.1 v2:172.21.15.107:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f20c8026dc0 con 0x556a58adc5a0 2024-06-03T00:04:25.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.491+0000 7f20bbfff700 1 -- 172.21.15.49:0/2385995438 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f20c8005070 con 0x556a58adc5a0 2024-06-03T00:04:25.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.491+0000 7f20ed3c2b80 10 client.25864 fetch_fsmap learned FSMap version 38 2024-06-03T00:04:25.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.491+0000 7f20ed3c2b80 1 -- 172.21.15.49:0/2385995438 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x556a58b5b630 con 0x556a58adc5a0 2024-06-03T00:04:25.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.492+0000 7f20bbfff700 1 -- 172.21.15.49:0/2385995438 <== mon.1 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20c8010be0 con 0x556a58adc5a0 2024-06-03T00:04:25.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.492+0000 7f20bbfff700 1 -- 172.21.15.49:0/2385995438 <== mon.1 v2:172.21.15.107:3300/0 5 ==== fsmap(e 38) ==== 8406+0+0 (secure 0 0 0) 0x7f20c8025070 con 0x556a58adc5a0 2024-06-03T00:04:25.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.492+0000 7f20ed3c2b80 10 client.25864 fetch_fsmap finished waiting for FSMap version 38 2024-06-03T00:04:25.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.492+0000 7f20ed3c2b80 10 client.25864 resolve_mds: validated gid 24487 aka daemon mds.i 2024-06-03T00:04:25.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.492+0000 7f20ed3c2b80 20 client.25864 populate_metadata read hostname 'smithi049' 2024-06-03T00:04:25.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.492+0000 7f20ed3c2b80 1 --2- 172.21.15.49:0/2385995438 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x556a58b5bdf0 0x556a58b5e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:25.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.492+0000 7f20ed3c2b80 4 client.25864 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.75, "await_for": 45.0}] 2024-06-03T00:04:25.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.492+0000 7f20ed3c2b80 1 -- 172.21.15.49:0/2385995438 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.75, "await_for": 45.0}) -- 0x556a58a2f470 con 0x556a58b5bdf0 2024-06-03T00:04:25.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.492+0000 7f20e08db700 1 --2- 172.21.15.49:0/2385995438 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x556a58b5bdf0 0x556a58b5e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:25.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.492+0000 7f20e08db700 1 --2- 172.21.15.49:0/2385995438 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x556a58b5bdf0 0x556a58b5e210 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=927a9c82958a6704 server_cookie=b0e0a65e1614f3cb in_seq=0 out_seq=0 2024-06-03T00:04:25.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:25.492+0000 7f20bbfff700 10 client.25864 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:04:26.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:26 smithi057 ceph-mon[36457]: pgmap v515: 97 pgs: 97 active+clean; 111 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 503 KiB/s wr, 128 op/s 2024-06-03T00:04:26.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:26 smithi057 ceph-mon[36457]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:04:26.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:26 smithi049 ceph-mon[32302]: pgmap v515: 97 pgs: 97 active+clean; 111 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 503 KiB/s wr, 128 op/s 2024-06-03T00:04:26.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:26 smithi049 ceph-mon[32302]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:04:26.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:26 smithi107 ceph-mon[37048]: pgmap v515: 97 pgs: 97 active+clean; 111 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 503 KiB/s wr, 128 op/s 2024-06-03T00:04:26.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:26 smithi107 ceph-mon[37048]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:04:27.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:27.464+0000 7f20bbfff700 1 -- 172.21.15.49:0/2385995438 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x556a58a2f470 con 0x556a58b5bdf0 2024-06-03T00:04:27.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:27.464+0000 7f20bbfff700 10 client.25864 handle_command_reply: tid=0 2024-06-03T00:04:27.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:27.464+0000 7f20ed3c2b80 1 client.25864 shutdown 2024-06-03T00:04:27.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:27.465+0000 7f20ed3c2b80 1 -- 172.21.15.49:0/2385995438 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a58adc5a0 msgr2=0x556a58af84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:27.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:27.465+0000 7f20ed3c2b80 1 --2- 172.21.15.49:0/2385995438 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a58adc5a0 0x556a58af84f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f20c8000c00 tx=0x7f20c8010930 comp rx=0 tx=0).stop 2024-06-03T00:04:27.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:27.465+0000 7f20ed3c2b80 1 -- 172.21.15.49:0/2385995438 shutdown_connections 2024-06-03T00:04:27.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:27.465+0000 7f20ed3c2b80 1 --2- 172.21.15.49:0/2385995438 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x556a58b5bdf0 0x556a58b5e210 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:27.465+0000 7f20bbfff700 0 client.25864 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:04:27.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:27.465+0000 7f20ed3c2b80 1 --2- 172.21.15.49:0/2385995438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a58adcec0 0x556a58af8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:27.465+0000 7f20ed3c2b80 1 --2- 172.21.15.49:0/2385995438 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a58ad6cf0 0x556a58af7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:27.465+0000 7f20ed3c2b80 1 --2- 172.21.15.49:0/2385995438 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556a58adc5a0 0x556a58af84f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:27.465+0000 7f20ed3c2b80 1 -- 172.21.15.49:0/2385995438 >> 172.21.15.49:0/2385995438 conn(0x556a58a03220 msgr2=0x556a58ae00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:27.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:27.465+0000 7f20ed3c2b80 1 -- 172.21.15.49:0/2385995438 shutdown_connections 2024-06-03T00:04:27.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:27.465+0000 7f20ed3c2b80 1 -- 172.21.15.49:0/2385995438 wait complete. 2024-06-03T00:04:27.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:27.465+0000 7f20ed3c2b80 20 client.25864 trim_cache size 0 max 16384 2024-06-03T00:04:27.467 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:04:27.467 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 38, 2024-06-03T00:04:27.468 INFO:teuthology.orchestra.run.smithi049.stdout: "leader": 24487, 2024-06-03T00:04:27.468 INFO:teuthology.orchestra.run.smithi049.stdout: "set_version": 14, 2024-06-03T00:04:27.468 INFO:teuthology.orchestra.run.smithi049.stdout: "sets": { 2024-06-03T00:04:27.468 INFO:teuthology.orchestra.run.smithi049.stdout: "33d9be6": { 2024-06-03T00:04:27.468 INFO:teuthology.orchestra.run.smithi049.stdout: "version": 14, 2024-06-03T00:04:27.468 INFO:teuthology.orchestra.run.smithi049.stdout: "age_ref": 0.0, 2024-06-03T00:04:27.468 INFO:teuthology.orchestra.run.smithi049.stdout: "state": { 2024-06-03T00:04:27.468 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "QUIESCED", 2024-06-03T00:04:27.468 INFO:teuthology.orchestra.run.smithi049.stdout: "age": 0.0 2024-06-03T00:04:27.468 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:04:27.468 INFO:teuthology.orchestra.run.smithi049.stdout: "timeout": 90.0, 2024-06-03T00:04:27.468 INFO:teuthology.orchestra.run.smithi049.stdout: "expiration": 147.8, 2024-06-03T00:04:27.468 INFO:teuthology.orchestra.run.smithi049.stdout: "members": { 2024-06-03T00:04:27.469 INFO:teuthology.orchestra.run.smithi049.stdout: "file:/": { 2024-06-03T00:04:27.469 INFO:teuthology.orchestra.run.smithi049.stdout: "excluded": false, 2024-06-03T00:04:27.469 INFO:teuthology.orchestra.run.smithi049.stdout: "state": { 2024-06-03T00:04:27.469 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "QUIESCED", 2024-06-03T00:04:27.469 INFO:teuthology.orchestra.run.smithi049.stdout: "age": 0.0 2024-06-03T00:04:27.469 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:04:27.469 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:04:27.469 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:04:27.469 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:04:27.469 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:04:27.469 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:04:27.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:27.466+0000 7f20e2b3f700 1 -- 172.21.15.49:0/2936704442 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f20cc0a2d40 msgr2=0x7f20cc0a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:27.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:27.466+0000 7f20e2b3f700 1 --2- 172.21.15.49:0/2936704442 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f20cc0a2d40 0x7f20cc0a5200 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f20dc108ae0 tx=0x7f20c800a300 comp rx=0 tx=0).stop 2024-06-03T00:04:27.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:27.466+0000 7f20e2b3f700 1 -- 172.21.15.49:0/2936704442 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20dc1027a0 msgr2=0x7f20dc074790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:27.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:27.466+0000 7f20e2b3f700 1 --2- 172.21.15.49:0/2936704442 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20dc1027a0 0x7f20dc074790 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f20d00059d0 tx=0x7f20d000fa00 comp rx=0 tx=0).stop 2024-06-03T00:04:27.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:27.466+0000 7f20e2b3f700 1 -- 172.21.15.49:0/2936704442 shutdown_connections 2024-06-03T00:04:27.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:27.466+0000 7f20e2b3f700 1 --2- 172.21.15.49:0/2936704442 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f20cc0a2d40 0x7f20cc0a5200 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:27.466+0000 7f20e2b3f700 1 --2- 172.21.15.49:0/2936704442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20dc107790 0x7f20dc075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:27.466+0000 7f20e2b3f700 1 --2- 172.21.15.49:0/2936704442 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20dc1027a0 0x7f20dc074790 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:27.466+0000 7f20e2b3f700 1 --2- 172.21.15.49:0/2936704442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20dc103150 0x7f20dc074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:27.466+0000 7f20e2b3f700 1 -- 172.21.15.49:0/2936704442 >> 172.21.15.49:0/2936704442 conn(0x7f20dc079560 msgr2=0x7f20dc1004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:27.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:27.466+0000 7f20e2b3f700 1 -- 172.21.15.49:0/2936704442 shutdown_connections 2024-06-03T00:04:27.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:27.466+0000 7f20e2b3f700 1 -- 172.21.15.49:0/2936704442 wait complete. 2024-06-03T00:04:27.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.922+0000 7f1a7268c640 1 -- 172.21.15.49:0/4161812658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a6c101af0 msgr2=0x7f1a6c101f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:27.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.922+0000 7f1a7268c640 1 --2- 172.21.15.49:0/4161812658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a6c101af0 0x7f1a6c101f70 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009900 tx=0x7f1a5402a410 comp rx=0 tx=0).stop 2024-06-03T00:04:27.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.922+0000 7f1a7268c640 1 -- 172.21.15.49:0/4161812658 shutdown_connections 2024-06-03T00:04:27.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.922+0000 7f1a7268c640 1 --2- 172.21.15.49:0/4161812658 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a6c1024b0 0x7f1a6c108d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.922+0000 7f1a7268c640 1 --2- 172.21.15.49:0/4161812658 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a6c101af0 0x7f1a6c101f70 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.922+0000 7f1a7268c640 1 --2- 172.21.15.49:0/4161812658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a6c100900 0x7f1a6c100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.922+0000 7f1a7268c640 1 -- 172.21.15.49:0/4161812658 >> 172.21.15.49:0/4161812658 conn(0x7f1a6c0fbe90 msgr2=0x7f1a6c0fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:27.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.922+0000 7f1a7268c640 1 -- 172.21.15.49:0/4161812658 shutdown_connections 2024-06-03T00:04:27.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.922+0000 7f1a7268c640 1 -- 172.21.15.49:0/4161812658 wait complete. 2024-06-03T00:04:27.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.923+0000 7f1a7268c640 1 Processor -- start 2024-06-03T00:04:27.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.923+0000 7f1a7268c640 1 -- start start 2024-06-03T00:04:27.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.923+0000 7f1a7268c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a6c100900 0x7f1a6c197c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:27.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.923+0000 7f1a7268c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a6c101af0 0x7f1a6c198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:27.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.923+0000 7f1a7268c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a6c1024b0 0x7f1a6c19f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:27.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.923+0000 7f1a7268c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6c10c580 con 0x7f1a6c101af0 2024-06-03T00:04:27.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.923+0000 7f1a7268c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6c10c400 con 0x7f1a6c1024b0 2024-06-03T00:04:27.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.923+0000 7f1a7268c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6c10c700 con 0x7f1a6c100900 2024-06-03T00:04:27.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.923+0000 7f1a63fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a6c101af0 0x7f1a6c198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:27.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.923+0000 7f1a63fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a6c101af0 0x7f1a6c198170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50998/0 (socket says 172.21.15.49:50998) 2024-06-03T00:04:27.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.923+0000 7f1a63fff640 1 -- 172.21.15.49:0/2879853622 learned_addr learned my addr 172.21.15.49:0/2879853622 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:27.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.923+0000 7f1a6bfff640 1 --2- 172.21.15.49:0/2879853622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a6c100900 0x7f1a6c197c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:27.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.923+0000 7f1a70c29640 1 --2- 172.21.15.49:0/2879853622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a6c1024b0 0x7f1a6c19f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:27.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.923+0000 7f1a63fff640 1 -- 172.21.15.49:0/2879853622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a6c100900 msgr2=0x7f1a6c197c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:27.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.923+0000 7f1a63fff640 1 --2- 172.21.15.49:0/2879853622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a6c100900 0x7f1a6c197c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.923+0000 7f1a63fff640 1 -- 172.21.15.49:0/2879853622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a6c1024b0 msgr2=0x7f1a6c19f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:27.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.923+0000 7f1a63fff640 1 --2- 172.21.15.49:0/2879853622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a6c1024b0 0x7f1a6c19f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.923+0000 7f1a63fff640 1 -- 172.21.15.49:0/2879853622 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a6c19f840 con 0x7f1a6c101af0 2024-06-03T00:04:27.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.923+0000 7f1a70c29640 1 --2- 172.21.15.49:0/2879853622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a6c1024b0 0x7f1a6c19f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:04:27.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.923+0000 7f1a6bfff640 1 --2- 172.21.15.49:0/2879853622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a6c100900 0x7f1a6c197c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:04:27.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.924+0000 7f1a63fff640 1 --2- 172.21.15.49:0/2879853622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a6c101af0 0x7f1a6c198170 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009230 tx=0x7f1a54031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:27.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.924+0000 7f1a69ffb640 1 -- 172.21.15.49:0/2879853622 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5403f030 con 0x7f1a6c101af0 2024-06-03T00:04:27.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.924+0000 7f1a7268c640 1 -- 172.21.15.49:0/2879853622 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a6c19fad0 con 0x7f1a6c101af0 2024-06-03T00:04:27.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.924+0000 7f1a69ffb640 1 -- 172.21.15.49:0/2879853622 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a54003ad0 con 0x7f1a6c101af0 2024-06-03T00:04:27.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.924+0000 7f1a69ffb640 1 -- 172.21.15.49:0/2879853622 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a54035070 con 0x7f1a6c101af0 2024-06-03T00:04:27.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.924+0000 7f1a7268c640 1 -- 172.21.15.49:0/2879853622 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a6c19ffc0 con 0x7f1a6c101af0 2024-06-03T00:04:27.930 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.927+0000 7f1a69ffb640 1 -- 172.21.15.49:0/2879853622 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1a54042030 con 0x7f1a6c101af0 2024-06-03T00:04:27.930 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.927+0000 7f1a75398740 1 Processor -- start 2024-06-03T00:04:27.930 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.927+0000 7f1a75398740 1 -- start start 2024-06-03T00:04:27.930 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.927+0000 7f1a75398740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561645d1010 0x5561645d1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:27.930 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.927+0000 7f1a75398740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5561645d1a00 0x5561645d6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:27.930 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.927+0000 7f1a75398740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561645d6b70 0x5561645d9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:27.930 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.927+0000 7f1a75398740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5561645344f0 con 0x5561645d1010 2024-06-03T00:04:27.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.927+0000 7f1a75398740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5561644d2870 con 0x5561645d1a00 2024-06-03T00:04:27.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.927+0000 7f1a75398740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5561645304b0 con 0x5561645d6b70 2024-06-03T00:04:27.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.927+0000 7f1a70c29640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561645d1010 0x5561645d1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:27.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.927+0000 7f1a70c29640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561645d1010 0x5561645d1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51000/0 (socket says 172.21.15.49:51000) 2024-06-03T00:04:27.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.928+0000 7f1a70c29640 1 -- 172.21.15.49:0/287568362 learned_addr learned my addr 172.21.15.49:0/287568362 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:27.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.928+0000 7f1a63fff640 1 --2- 172.21.15.49:0/287568362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561645d6b70 0x5561645d9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:27.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.928+0000 7f1a6bfff640 1 --2- 172.21.15.49:0/287568362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5561645d1a00 0x5561645d6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:27.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.928+0000 7f1a69ffb640 1 --2- 172.21.15.49:0/2879853622 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1a580a2c30 0x7f1a580a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:27.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.928+0000 7f1a6bfff640 1 -- 172.21.15.49:0/287568362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561645d6b70 msgr2=0x5561645d9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:27.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.928+0000 7f1a6bfff640 1 --2- 172.21.15.49:0/287568362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561645d6b70 0x5561645d9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.928+0000 7f1a6bfff640 1 -- 172.21.15.49:0/287568362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561645d1010 msgr2=0x5561645d1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:27.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.928+0000 7f1a6bfff640 1 --2- 172.21.15.49:0/287568362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561645d1010 0x5561645d1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.928+0000 7f1a6bfff640 1 -- 172.21.15.49:0/287568362 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561644ee9b0 con 0x5561645d1a00 2024-06-03T00:04:27.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.928+0000 7f1a70c29640 1 --2- 172.21.15.49:0/287568362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561645d1010 0x5561645d1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:04:27.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.928+0000 7f1a70c29640 1 --2- 172.21.15.49:0/2879853622 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1a580a2c30 0x7f1a580a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:27.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.928+0000 7f1a69ffb640 1 -- 172.21.15.49:0/2879853622 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f1a540ef730 con 0x7f1a6c101af0 2024-06-03T00:04:27.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.928+0000 7f1a6bfff640 1 --2- 172.21.15.49:0/287568362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5561645d1a00 0x5561645d6500 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c199100 tx=0x7f1a5c00f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3ca92da81b6f7dc server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:27.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.928+0000 7f1a70c29640 1 --2- 172.21.15.49:0/2879853622 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1a580a2c30 0x7f1a580a50f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x5561645d2260 tx=0x7f1a64004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:27.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.929+0000 7f1a627fc640 1 -- 172.21.15.49:0/287568362 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c015070 con 0x5561645d1a00 2024-06-03T00:04:27.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.929+0000 7f1a627fc640 1 -- 172.21.15.49:0/287568362 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a5c01a940 con 0x5561645d1a00 2024-06-03T00:04:27.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.929+0000 7f1a627fc640 1 -- 172.21.15.49:0/287568362 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c011900 con 0x5561645d1a00 2024-06-03T00:04:27.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.929+0000 7f1a75398740 1 -- 172.21.15.49:0/287568362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5561645d1a00 msgr2=0x5561645d6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:27.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.929+0000 7f1a75398740 1 --2- 172.21.15.49:0/287568362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5561645d1a00 0x5561645d6500 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c199100 tx=0x7f1a5c00f730 comp rx=0 tx=0).stop 2024-06-03T00:04:27.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.929+0000 7f1a75398740 1 -- 172.21.15.49:0/287568362 shutdown_connections 2024-06-03T00:04:27.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.929+0000 7f1a75398740 1 --2- 172.21.15.49:0/287568362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5561645d1a00 0x5561645d6500 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.929+0000 7f1a75398740 1 --2- 172.21.15.49:0/287568362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561645d6b70 0x5561645d9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.929+0000 7f1a75398740 1 --2- 172.21.15.49:0/287568362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561645d1010 0x5561645d1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.929+0000 7f1a75398740 1 -- 172.21.15.49:0/287568362 >> 172.21.15.49:0/287568362 conn(0x5561645cc680 msgr2=0x5561645cca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:27.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.929+0000 7f1a75398740 1 -- 172.21.15.49:0/287568362 shutdown_connections 2024-06-03T00:04:27.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.929+0000 7f1a75398740 1 -- 172.21.15.49:0/287568362 wait complete. 2024-06-03T00:04:27.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.930+0000 7f1a75398740 1 -- start start 2024-06-03T00:04:27.937 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.930+0000 7f1a75398740 1 Processor -- start 2024-06-03T00:04:27.937 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.930+0000 7f1a75398740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561645d1010 0x5561645df6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:27.938 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.930+0000 7f1a75398740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5561645d1a00 0x5561645dfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:27.938 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.930+0000 7f1a75398740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561645d6b70 0x5561645e6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:27.938 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.930+0000 7f1a75398740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5561645ddf30 con 0x5561645d1010 2024-06-03T00:04:27.938 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.930+0000 7f1a75398740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5561644bdae0 con 0x5561645d1a00 2024-06-03T00:04:27.938 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.930+0000 7f1a75398740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5561645de0b0 con 0x5561645d6b70 2024-06-03T00:04:27.938 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.930+0000 7f1a75398740 10 client.0 _ll_register_callbacks cb 0x5561644f69b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:04:27.938 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.930+0000 7f1a6bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561645d1010 0x5561645df6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:27.938 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.930+0000 7f1a6bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561645d1010 0x5561645df6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51012/0 (socket says 172.21.15.49:51012) 2024-06-03T00:04:27.938 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.930+0000 7f1a6bfff640 1 -- 172.21.15.49:0/2136697889 learned_addr learned my addr 172.21.15.49:0/2136697889 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:27.938 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.931+0000 7f1a63fff640 1 --2- 172.21.15.49:0/2136697889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5561645d1a00 0x5561645dfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:27.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.931+0000 7f1a70c29640 1 --2- 172.21.15.49:0/2136697889 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561645d6b70 0x5561645e6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:27.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.931+0000 7f1a6bfff640 1 -- 172.21.15.49:0/2136697889 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561645d6b70 msgr2=0x5561645e6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:27.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.931+0000 7f1a6bfff640 1 --2- 172.21.15.49:0/2136697889 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561645d6b70 0x5561645e6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.931+0000 7f1a6bfff640 1 -- 172.21.15.49:0/2136697889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5561645d1a00 msgr2=0x5561645dfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:27.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.931+0000 7f1a6bfff640 1 --2- 172.21.15.49:0/2136697889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5561645d1a00 0x5561645dfc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.931+0000 7f1a6bfff640 1 -- 172.21.15.49:0/2136697889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556164248210 con 0x5561645d1010 2024-06-03T00:04:27.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.931+0000 7f1a6bfff640 1 --2- 172.21.15.49:0/2136697889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561645d1010 0x5561645df6c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00b9f0 tx=0x7f1a5c00ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22684c67d13fb302 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:27.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.931+0000 7f1a4b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:04:27.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.931+0000 7f1a4b7fe640 1 -- 172.21.15.49:0/2136697889 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c015070 con 0x5561645d1010 2024-06-03T00:04:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.931+0000 7f1a4b7fe640 1 -- 172.21.15.49:0/2136697889 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f1a5c01a460 con 0x5561645d1010 2024-06-03T00:04:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.931+0000 7f1a75398740 1 -- 172.21.15.49:0/2136697889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a5c01a940 con 0x5561645d1010 2024-06-03T00:04:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.931+0000 7f1a4b7fe640 1 -- 172.21.15.49:0/2136697889 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f1a5c01a660 con 0x5561645d1010 2024-06-03T00:04:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.931+0000 7f1a75398740 10 client.16299 fetch_fsmap learned FSMap version 38 2024-06-03T00:04:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.931+0000 7f1a75398740 1 -- 172.21.15.49:0/2136697889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x556164314620 con 0x5561645d1010 2024-06-03T00:04:27.941 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.932+0000 7f1a4b7fe640 1 -- 172.21.15.49:0/2136697889 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a5c01a940 con 0x5561645d1010 2024-06-03T00:04:27.941 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.932+0000 7f1a4b7fe640 1 -- 172.21.15.49:0/2136697889 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 38) ==== 8406+0+0 (secure 0 0 0) 0x7f1a5c0046c0 con 0x5561645d1010 2024-06-03T00:04:27.941 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.932+0000 7f1a75398740 10 client.16299 fetch_fsmap finished waiting for FSMap version 38 2024-06-03T00:04:27.941 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.932+0000 7f1a75398740 10 client.16299 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:04:27.941 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.932+0000 7f1a75398740 20 client.16299 populate_metadata read hostname 'smithi049' 2024-06-03T00:04:27.941 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.932+0000 7f1a75398740 1 --2- 172.21.15.49:0/2136697889 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5561645eb260 0x5561645ed700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:27.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.932+0000 7f1a75398740 4 client.16299 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:04:27.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.932+0000 7f1a75398740 1 -- 172.21.15.49:0/2136697889 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556164547f10 con 0x5561645eb260 2024-06-03T00:04:27.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.932+0000 7f1a63fff640 1 --2- 172.21.15.49:0/2136697889 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5561645eb260 0x5561645ed700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:27.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.932+0000 7f1a63fff640 1 --2- 172.21.15.49:0/2136697889 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5561645eb260 0x5561645ed700 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8a8dd80ca2bd4e5 server_cookie=2e12f4a584ac1ae6 in_seq=0 out_seq=0 2024-06-03T00:04:27.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.932+0000 7f1a4b7fe640 10 client.16299 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:04:27.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.933+0000 7f1a4b7fe640 1 -- 172.21.15.49:0/2136697889 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x556164547f10 con 0x5561645eb260 2024-06-03T00:04:27.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.933+0000 7f1a4b7fe640 10 client.16299 handle_command_reply: tid=0 2024-06-03T00:04:27.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.933+0000 7f1a75398740 1 client.16299 shutdown 2024-06-03T00:04:27.943 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.933+0000 7f1a75398740 1 -- 172.21.15.49:0/2136697889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561645d1010 msgr2=0x5561645df6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:27.943 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.933+0000 7f1a75398740 1 --2- 172.21.15.49:0/2136697889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561645d1010 0x5561645df6c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00b9f0 tx=0x7f1a5c00ba20 comp rx=0 tx=0).stop 2024-06-03T00:04:27.943 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.933+0000 7f1a75398740 1 -- 172.21.15.49:0/2136697889 shutdown_connections 2024-06-03T00:04:27.943 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.933+0000 7f1a75398740 1 --2- 172.21.15.49:0/2136697889 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x5561645eb260 0x5561645ed700 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.943 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.933+0000 7f1a75398740 1 --2- 172.21.15.49:0/2136697889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5561645d1a00 0x5561645dfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.943 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.933+0000 7f1a75398740 1 --2- 172.21.15.49:0/2136697889 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561645d6b70 0x5561645e6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.943 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.933+0000 7f1a75398740 1 --2- 172.21.15.49:0/2136697889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561645d1010 0x5561645df6c0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.943 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.933+0000 7f1a4b7fe640 0 client.16299 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:04:27.943 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.933+0000 7f1a75398740 1 -- 172.21.15.49:0/2136697889 >> 172.21.15.49:0/2136697889 conn(0x5561645cc680 msgr2=0x5561645cb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:27.944 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.933+0000 7f1a75398740 1 -- 172.21.15.49:0/2136697889 shutdown_connections 2024-06-03T00:04:27.944 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.933+0000 7f1a75398740 1 -- 172.21.15.49:0/2136697889 wait complete. 2024-06-03T00:04:27.944 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.933+0000 7f1a75398740 20 client.16299 trim_cache size 0 max 16384 2024-06-03T00:04:27.954 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.949+0000 7f1a75398740 1 Processor -- start 2024-06-03T00:04:27.954 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.949+0000 7f1a75398740 1 -- start start 2024-06-03T00:04:27.954 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.949+0000 7f1a75398740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5561645d1010 0x5561645dece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:27.954 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.949+0000 7f1a75398740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561645d1a00 0x5561645e6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:27.954 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.949+0000 7f1a75398740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561645d6b70 0x5561645df220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:27.954 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.949+0000 7f1a75398740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6c1a6c70 con 0x5561645d1a00 2024-06-03T00:04:27.955 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.949+0000 7f1a75398740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6c1a89c0 con 0x5561645d1010 2024-06-03T00:04:27.955 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.949+0000 7f1a75398740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6c1a73a0 con 0x5561645d6b70 2024-06-03T00:04:27.955 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.949+0000 7f1a63fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561645d1a00 0x5561645e6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:27.955 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.949+0000 7f1a63fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561645d1a00 0x5561645e6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51024/0 (socket says 172.21.15.49:51024) 2024-06-03T00:04:27.955 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.949+0000 7f1a63fff640 1 -- 172.21.15.49:0/1158854759 learned_addr learned my addr 172.21.15.49:0/1158854759 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:27.955 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.949+0000 7f1a70c29640 1 --2- 172.21.15.49:0/1158854759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561645d6b70 0x5561645df220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:27.955 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.949+0000 7f1a6bfff640 1 --2- 172.21.15.49:0/1158854759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5561645d1010 0x5561645dece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:27.955 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.949+0000 7f1a63fff640 1 -- 172.21.15.49:0/1158854759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561645d6b70 msgr2=0x5561645df220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:27.955 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.949+0000 7f1a63fff640 1 --2- 172.21.15.49:0/1158854759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561645d6b70 0x5561645df220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.955 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.949+0000 7f1a63fff640 1 -- 172.21.15.49:0/1158854759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5561645d1010 msgr2=0x5561645dece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:27.955 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.949+0000 7f1a63fff640 1 --2- 172.21.15.49:0/1158854759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5561645d1010 0x5561645dece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.955 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.949+0000 7f1a63fff640 1 -- 172.21.15.49:0/1158854759 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561645c7fe0 con 0x5561645d1a00 2024-06-03T00:04:27.956 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.949+0000 7f1a70c29640 1 --2- 172.21.15.49:0/1158854759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561645d6b70 0x5561645df220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:04:27.956 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.949+0000 7f1a6bfff640 1 --2- 172.21.15.49:0/1158854759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5561645d1010 0x5561645dece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:04:27.956 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.949+0000 7f1a63fff640 1 --2- 172.21.15.49:0/1158854759 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561645d1a00 0x5561645e6c00 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1a540bbc90 tx=0x7f1a540dc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=761d25e48ed2a2f3 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:27.956 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.950+0000 7f1a61ffb640 1 -- 172.21.15.49:0/1158854759 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a54049040 con 0x5561645d1a00 2024-06-03T00:04:27.956 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.950+0000 7f1a61ffb640 1 -- 172.21.15.49:0/1158854759 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a540bc690 con 0x5561645d1a00 2024-06-03T00:04:27.956 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.950+0000 7f1a61ffb640 1 -- 172.21.15.49:0/1158854759 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a540c0340 con 0x5561645d1a00 2024-06-03T00:04:27.956 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.950+0000 7f1a75398740 1 -- 172.21.15.49:0/1158854759 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561645d1a00 msgr2=0x5561645e6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:27.956 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.950+0000 7f1a75398740 1 --2- 172.21.15.49:0/1158854759 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561645d1a00 0x5561645e6c00 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1a540bbc90 tx=0x7f1a540dc040 comp rx=0 tx=0).stop 2024-06-03T00:04:27.956 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.950+0000 7f1a75398740 1 -- 172.21.15.49:0/1158854759 shutdown_connections 2024-06-03T00:04:27.956 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.950+0000 7f1a75398740 1 --2- 172.21.15.49:0/1158854759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561645d6b70 0x5561645df220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.956 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.950+0000 7f1a75398740 1 --2- 172.21.15.49:0/1158854759 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561645d1a00 0x5561645e6c00 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.956 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.950+0000 7f1a75398740 1 --2- 172.21.15.49:0/1158854759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5561645d1010 0x5561645dece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.956 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.950+0000 7f1a75398740 1 -- 172.21.15.49:0/1158854759 >> 172.21.15.49:0/1158854759 conn(0x5561645cc680 msgr2=0x5561645cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:27.956 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.950+0000 7f1a75398740 1 -- 172.21.15.49:0/1158854759 shutdown_connections 2024-06-03T00:04:27.956 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.950+0000 7f1a75398740 1 -- 172.21.15.49:0/1158854759 wait complete. 2024-06-03T00:04:27.957 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.951+0000 7f1a75398740 1 -- start start 2024-06-03T00:04:27.957 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.951+0000 7f1a75398740 1 Processor -- start 2024-06-03T00:04:27.957 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.951+0000 7f1a75398740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561645d1010 0x5561645e3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:27.957 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.951+0000 7f1a75398740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561645d1a00 0x5561645e3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:27.957 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.951+0000 7f1a75398740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5561645d6b70 0x556164653fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:27.957 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.951+0000 7f1a75398740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6c1a8230 con 0x5561645d1a00 2024-06-03T00:04:27.957 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.951+0000 7f1a75398740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6c1a7ad0 con 0x5561645d6b70 2024-06-03T00:04:27.957 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.951+0000 7f1a75398740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6c1a4c30 con 0x5561645d1010 2024-06-03T00:04:27.957 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.951+0000 7f1a75398740 10 client.0 _ll_register_callbacks cb 0x7f1a64009aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:04:27.957 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.951+0000 7f1a63fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561645d1a00 0x5561645e3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:27.958 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.951+0000 7f1a6bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561645d1010 0x5561645e3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:27.958 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.951+0000 7f1a63fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561645d1a00 0x5561645e3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51028/0 (socket says 172.21.15.49:51028) 2024-06-03T00:04:27.958 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.951+0000 7f1a6bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561645d1010 0x5561645e3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:56178/0 (socket says 172.21.15.49:56178) 2024-06-03T00:04:27.958 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.951+0000 7f1a63fff640 1 -- 172.21.15.49:0/1709047503 learned_addr learned my addr 172.21.15.49:0/1709047503 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:27.958 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.951+0000 7f1a70c29640 1 --2- 172.21.15.49:0/1709047503 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5561645d6b70 0x556164653fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:27.958 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.951+0000 7f1a6bfff640 1 -- 172.21.15.49:0/1709047503 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5561645d6b70 msgr2=0x556164653fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:27.958 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.951+0000 7f1a6bfff640 1 --2- 172.21.15.49:0/1709047503 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5561645d6b70 0x556164653fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.958 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.951+0000 7f1a6bfff640 1 -- 172.21.15.49:0/1709047503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561645d1a00 msgr2=0x5561645e3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:27.958 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.951+0000 7f1a6bfff640 1 --2- 172.21.15.49:0/1709047503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561645d1a00 0x5561645e3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.958 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.952+0000 7f1a6bfff640 1 -- 172.21.15.49:0/1709047503 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561645e6d40 con 0x5561645d1010 2024-06-03T00:04:27.958 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.952+0000 7f1a63fff640 1 --2- 172.21.15.49:0/1709047503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561645d1a00 0x5561645e3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:04:27.958 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.952+0000 7f1a6bfff640 1 --2- 172.21.15.49:0/1709047503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561645d1010 0x5561645e3730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c004d20 tx=0x7f1a5c011670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a01a0cad9c1be9a server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:27.959 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.952+0000 7f1a4b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-06-03T00:04:27.959 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.952+0000 7f1a4b7fe640 1 -- 172.21.15.49:0/1709047503 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c032030 con 0x5561645d1010 2024-06-03T00:04:27.959 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.952+0000 7f1a75398740 1 -- 172.21.15.49:0/1709047503 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a540bc690 con 0x5561645d1010 2024-06-03T00:04:27.959 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.952+0000 7f1a4b7fe640 1 -- 172.21.15.49:0/1709047503 <== mon.1 v2:172.21.15.107:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f1a5c020070 con 0x5561645d1010 2024-06-03T00:04:27.959 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.952+0000 7f1a4b7fe640 1 -- 172.21.15.49:0/1709047503 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f1a5c015070 con 0x5561645d1010 2024-06-03T00:04:27.959 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.952+0000 7f1a75398740 10 client.25882 fetch_fsmap learned FSMap version 38 2024-06-03T00:04:27.959 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.952+0000 7f1a75398740 1 -- 172.21.15.49:0/1709047503 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x556164655350 con 0x5561645d1010 2024-06-03T00:04:27.959 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.952+0000 7f1a4b7fe640 1 -- 172.21.15.49:0/1709047503 <== mon.1 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a540bc690 con 0x5561645d1010 2024-06-03T00:04:27.959 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.952+0000 7f1a4b7fe640 1 -- 172.21.15.49:0/1709047503 <== mon.1 v2:172.21.15.107:3300/0 5 ==== fsmap(e 38) ==== 8406+0+0 (secure 0 0 0) 0x7f1a5c004da0 con 0x5561645d1010 2024-06-03T00:04:27.959 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.952+0000 7f1a75398740 10 client.25882 fetch_fsmap finished waiting for FSMap version 38 2024-06-03T00:04:27.959 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.952+0000 7f1a75398740 10 client.25882 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:04:27.959 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.952+0000 7f1a75398740 20 client.25882 populate_metadata read hostname 'smithi049' 2024-06-03T00:04:27.960 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.952+0000 7f1a75398740 1 --2- 172.21.15.49:0/1709047503 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x556164655d50 0x556164658170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:27.960 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.952+0000 7f1a75398740 4 client.25882 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-03T00:04:27.960 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.952+0000 7f1a75398740 1 -- 172.21.15.49:0/1709047503 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556164541c20 con 0x556164655d50 2024-06-03T00:04:27.960 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.953+0000 7f1a63fff640 1 --2- 172.21.15.49:0/1709047503 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x556164655d50 0x556164658170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:27.960 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.953+0000 7f1a63fff640 1 --2- 172.21.15.49:0/1709047503 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x556164655d50 0x556164658170 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=912a907abe3fda0 server_cookie=804713ecf3c016fc in_seq=0 out_seq=0 2024-06-03T00:04:27.960 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.953+0000 7f1a4b7fe640 10 client.25882 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:04:27.966 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.964+0000 7f1a4b7fe640 1 -- 172.21.15.49:0/1709047503 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x556164541c20 con 0x556164655d50 2024-06-03T00:04:27.966 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.964+0000 7f1a4b7fe640 10 client.25882 handle_command_reply: tid=0 2024-06-03T00:04:27.966 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.964+0000 7f1a75398740 1 client.25882 shutdown 2024-06-03T00:04:27.966 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.965+0000 7f1a75398740 1 -- 172.21.15.49:0/1709047503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561645d1010 msgr2=0x5561645e3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:27.966 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.965+0000 7f1a75398740 1 --2- 172.21.15.49:0/1709047503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561645d1010 0x5561645e3730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c004d20 tx=0x7f1a5c011670 comp rx=0 tx=0).stop 2024-06-03T00:04:27.966 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.965+0000 7f1a75398740 1 -- 172.21.15.49:0/1709047503 shutdown_connections 2024-06-03T00:04:27.966 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.965+0000 7f1a75398740 1 --2- 172.21.15.49:0/1709047503 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x556164655d50 0x556164658170 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.966 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.965+0000 7f1a75398740 1 --2- 172.21.15.49:0/1709047503 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5561645d6b70 0x556164653fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.966 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.965+0000 7f1a75398740 1 --2- 172.21.15.49:0/1709047503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561645d1a00 0x5561645e3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.966 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.965+0000 7f1a4b7fe640 0 client.25882 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:04:27.966 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.965+0000 7f1a75398740 1 --2- 172.21.15.49:0/1709047503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561645d1010 0x5561645e3730 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.967 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.965+0000 7f1a75398740 1 -- 172.21.15.49:0/1709047503 >> 172.21.15.49:0/1709047503 conn(0x5561645cc680 msgr2=0x5561645caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:27.967 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.965+0000 7f1a75398740 1 -- 172.21.15.49:0/1709047503 shutdown_connections 2024-06-03T00:04:27.967 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.965+0000 7f1a75398740 1 -- 172.21.15.49:0/1709047503 wait complete. 2024-06-03T00:04:27.967 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.965+0000 7f1a75398740 20 client.25882 trim_cache size 0 max 16384 2024-06-03T00:04:27.968 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-06-03T00:04:27.968 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-06-03T00:04:27.968 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-06-03T00:04:27.968 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.965+0000 7f1a7268c640 1 -- 172.21.15.49:0/2879853622 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1a580a2c30 msgr2=0x7f1a580a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:27.968 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.965+0000 7f1a7268c640 1 --2- 172.21.15.49:0/2879853622 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1a580a2c30 0x7f1a580a50f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x5561645d2260 tx=0x7f1a64004a40 comp rx=0 tx=0).stop 2024-06-03T00:04:27.969 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.965+0000 7f1a7268c640 1 -- 172.21.15.49:0/2879853622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a6c101af0 msgr2=0x7f1a6c198170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:27.969 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.965+0000 7f1a7268c640 1 --2- 172.21.15.49:0/2879853622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a6c101af0 0x7f1a6c198170 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009230 tx=0x7f1a54031b60 comp rx=0 tx=0).stop 2024-06-03T00:04:27.969 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.966+0000 7f1a7268c640 1 -- 172.21.15.49:0/2879853622 shutdown_connections 2024-06-03T00:04:27.969 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.966+0000 7f1a7268c640 1 --2- 172.21.15.49:0/2879853622 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f1a580a2c30 0x7f1a580a50f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.969 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.966+0000 7f1a7268c640 1 --2- 172.21.15.49:0/2879853622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a6c1024b0 0x7f1a6c19f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.969 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.966+0000 7f1a7268c640 1 --2- 172.21.15.49:0/2879853622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a6c101af0 0x7f1a6c198170 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.969 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.966+0000 7f1a7268c640 1 --2- 172.21.15.49:0/2879853622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a6c100900 0x7f1a6c197c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:27.969 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.966+0000 7f1a7268c640 1 -- 172.21.15.49:0/2879853622 >> 172.21.15.49:0/2879853622 conn(0x7f1a6c0fbe90 msgr2=0x7f1a6c06a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:27.969 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.966+0000 7f1a7268c640 1 -- 172.21.15.49:0/2879853622 shutdown_connections 2024-06-03T00:04:27.969 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:27.966+0000 7f1a7268c640 1 -- 172.21.15.49:0/2879853622 wait complete. 2024-06-03T00:04:28.216 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '33d9be6', quiesce took 8.1 seconds. Will release after: 19.65 2024-06-03T00:04:28.710 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:28 smithi049 ceph-mon[32302]: pgmap v516: 97 pgs: 97 active+clean; 111 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 506 KiB/s wr, 134 op/s 2024-06-03T00:04:28.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:28 smithi107 ceph-mon[37048]: pgmap v516: 97 pgs: 97 active+clean; 111 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 506 KiB/s wr, 134 op/s 2024-06-03T00:04:28.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:28 smithi057 ceph-mon[36457]: pgmap v516: 97 pgs: 97 active+clean; 111 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 506 KiB/s wr, 134 op/s 2024-06-03T00:04:30.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:30 smithi049 ceph-mon[32302]: pgmap v517: 97 pgs: 97 active+clean; 108 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 652 KiB/s wr, 194 op/s 2024-06-03T00:04:30.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:30 smithi107 ceph-mon[37048]: pgmap v517: 97 pgs: 97 active+clean; 108 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 652 KiB/s wr, 194 op/s 2024-06-03T00:04:30.949 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:30 smithi057 ceph-mon[36457]: pgmap v517: 97 pgs: 97 active+clean; 108 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 652 KiB/s wr, 194 op/s 2024-06-03T00:04:32.711 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:32 smithi049 ceph-mon[32302]: pgmap v518: 97 pgs: 97 active+clean; 107 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 660 KiB/s wr, 201 op/s 2024-06-03T00:04:32.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:32 smithi107 ceph-mon[37048]: pgmap v518: 97 pgs: 97 active+clean; 107 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 660 KiB/s wr, 201 op/s 2024-06-03T00:04:32.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:32 smithi057 ceph-mon[36457]: pgmap v518: 97 pgs: 97 active+clean; 107 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 660 KiB/s wr, 201 op/s 2024-06-03T00:04:34.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:34 smithi107 ceph-mon[37048]: pgmap v519: 97 pgs: 97 active+clean; 102 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 622 KiB/s wr, 205 op/s 2024-06-03T00:04:34.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:34 smithi057 ceph-mon[36457]: pgmap v519: 97 pgs: 97 active+clean; 102 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 622 KiB/s wr, 205 op/s 2024-06-03T00:04:34.960 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:34 smithi049 ceph-mon[32302]: pgmap v519: 97 pgs: 97 active+clean; 102 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 622 KiB/s wr, 205 op/s 2024-06-03T00:04:36.763 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:36 smithi049 ceph-mon[32302]: pgmap v520: 97 pgs: 97 active+clean; 102 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 589 KiB/s wr, 180 op/s 2024-06-03T00:04:36.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:36 smithi107 ceph-mon[37048]: pgmap v520: 97 pgs: 97 active+clean; 102 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 589 KiB/s wr, 180 op/s 2024-06-03T00:04:36.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:36 smithi057 ceph-mon[36457]: pgmap v520: 97 pgs: 97 active+clean; 102 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 589 KiB/s wr, 180 op/s 2024-06-03T00:04:38.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:38 smithi107 ceph-mon[37048]: pgmap v521: 97 pgs: 97 active+clean; 102 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 169 KiB/s wr, 93 op/s 2024-06-03T00:04:38.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:38 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-03T00:04:38.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:38 smithi057 ceph-mon[36457]: pgmap v521: 97 pgs: 97 active+clean; 102 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 169 KiB/s wr, 93 op/s 2024-06-03T00:04:38.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:38 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-03T00:04:38.960 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:38 smithi049 ceph-mon[32302]: pgmap v521: 97 pgs: 97 active+clean; 102 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 169 KiB/s wr, 93 op/s 2024-06-03T00:04:38.960 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:38 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-03T00:04:39.850 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:39 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-03T00:04:39.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:39 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-03T00:04:39.851 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:39 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:04:39.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:39 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-03T00:04:39.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:39 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-03T00:04:39.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:39 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:04:39.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:39 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-03T00:04:39.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:39 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-03T00:04:39.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:39 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:04:41.070 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.068+0000 7f91579e7640 1 -- 172.21.15.49:0/304586305 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9150107790 msgr2=0x7f9150109be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:41.071 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.068+0000 7f91579e7640 1 --2- 172.21.15.49:0/304586305 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9150107790 0x7f9150109be0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f9148009ca0 tx=0x7f914802a8c0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.071 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.068+0000 7f91579e7640 1 -- 172.21.15.49:0/304586305 shutdown_connections 2024-06-03T00:04:41.071 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.068+0000 7f91579e7640 1 --2- 172.21.15.49:0/304586305 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9150104e60 0x7f9150107250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.071 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.068+0000 7f91579e7640 1 --2- 172.21.15.49:0/304586305 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9150107790 0x7f9150109be0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.071 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.068+0000 7f91579e7640 1 --2- 172.21.15.49:0/304586305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9150102530 0x7f9150104920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.071 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.068+0000 7f91579e7640 1 -- 172.21.15.49:0/304586305 >> 172.21.15.49:0/304586305 conn(0x7f91500fbf20 msgr2=0x7f91500fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:41.071 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.068+0000 7f91579e7640 1 -- 172.21.15.49:0/304586305 shutdown_connections 2024-06-03T00:04:41.071 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.068+0000 7f91579e7640 1 -- 172.21.15.49:0/304586305 wait complete. 2024-06-03T00:04:41.072 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.069+0000 7f91579e7640 1 Processor -- start 2024-06-03T00:04:41.072 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.069+0000 7f91579e7640 1 -- start start 2024-06-03T00:04:41.072 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.069+0000 7f91579e7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9150102530 0x7f9150199e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:41.072 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.069+0000 7f91579e7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9150104e60 0x7f915019a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:41.072 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.069+0000 7f91579e7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9150107790 0x7f91501a13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:41.072 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.069+0000 7f91579e7640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f915010d6e0 con 0x7f9150102530 2024-06-03T00:04:41.072 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.069+0000 7f91579e7640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f915010d560 con 0x7f9150104e60 2024-06-03T00:04:41.072 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.069+0000 7f91579e7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f915010d860 con 0x7f9150107790 2024-06-03T00:04:41.072 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.069+0000 7f9155783640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9150102530 0x7f9150199e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:41.072 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.069+0000 7f9155783640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9150102530 0x7f9150199e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35384/0 (socket says 172.21.15.49:35384) 2024-06-03T00:04:41.072 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.069+0000 7f9155783640 1 -- 172.21.15.49:0/2942298142 learned_addr learned my addr 172.21.15.49:0/2942298142 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:41.072 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.069+0000 7f9155f84640 1 --2- 172.21.15.49:0/2942298142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9150107790 0x7f91501a13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:41.072 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.069+0000 7f9154f82640 1 --2- 172.21.15.49:0/2942298142 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9150104e60 0x7f915019a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:41.073 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.070+0000 7f9155783640 1 -- 172.21.15.49:0/2942298142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9150107790 msgr2=0x7f91501a13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:41.073 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.070+0000 7f9155783640 1 --2- 172.21.15.49:0/2942298142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9150107790 0x7f91501a13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.073 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.070+0000 7f9155783640 1 -- 172.21.15.49:0/2942298142 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9150104e60 msgr2=0x7f915019a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:41.073 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.070+0000 7f9155783640 1 --2- 172.21.15.49:0/2942298142 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9150104e60 0x7f915019a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.073 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.070+0000 7f9155783640 1 -- 172.21.15.49:0/2942298142 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91501a1a50 con 0x7f9150102530 2024-06-03T00:04:41.073 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.070+0000 7f9155783640 1 --2- 172.21.15.49:0/2942298142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9150102530 0x7f9150199e30 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f914c00e9f0 tx=0x7f914c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:41.073 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.070+0000 7f91427fc640 1 -- 172.21.15.49:0/2942298142 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f914c00cd80 con 0x7f9150102530 2024-06-03T00:04:41.073 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.070+0000 7f91579e7640 1 -- 172.21.15.49:0/2942298142 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91501a1d40 con 0x7f9150102530 2024-06-03T00:04:41.073 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.070+0000 7f91427fc640 1 -- 172.21.15.49:0/2942298142 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f914c005500 con 0x7f9150102530 2024-06-03T00:04:41.073 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.070+0000 7f91427fc640 1 -- 172.21.15.49:0/2942298142 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f914c010690 con 0x7f9150102530 2024-06-03T00:04:41.073 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.070+0000 7f91579e7640 1 -- 172.21.15.49:0/2942298142 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91501a2180 con 0x7f9150102530 2024-06-03T00:04:41.076 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.073+0000 7f91427fc640 1 -- 172.21.15.49:0/2942298142 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f914c0046c0 con 0x7f9150102530 2024-06-03T00:04:41.076 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.073+0000 7f915a7d4740 1 Processor -- start 2024-06-03T00:04:41.077 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.073+0000 7f915a7d4740 1 -- start start 2024-06-03T00:04:41.077 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.073+0000 7f915a7d4740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c927738010 0x55c927738430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:41.077 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.073+0000 7f915a7d4740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c927738a00 0x55c92773d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:41.077 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.073+0000 7f915a7d4740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c92773db70 0x55c927740000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:41.077 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.073+0000 7f915a7d4740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c92769b4f0 con 0x55c92773db70 2024-06-03T00:04:41.077 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.073+0000 7f915a7d4740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55c927639870 con 0x55c927738a00 2024-06-03T00:04:41.077 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.073+0000 7f915a7d4740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55c9276974b0 con 0x55c927738010 2024-06-03T00:04:41.077 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.074+0000 7f9154f82640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c92773db70 0x55c927740000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:41.077 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.074+0000 7f9155f84640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c927738010 0x55c927738430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:41.077 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.074+0000 7f9154f82640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c92773db70 0x55c927740000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35398/0 (socket says 172.21.15.49:35398) 2024-06-03T00:04:41.077 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.074+0000 7f9154f82640 1 -- 172.21.15.49:0/2966535697 learned_addr learned my addr 172.21.15.49:0/2966535697 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:41.077 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.074+0000 7f9155783640 1 --2- 172.21.15.49:0/2966535697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c927738a00 0x55c92773d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:41.077 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.074+0000 7f9155f84640 1 -- 172.21.15.49:0/2966535697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c927738a00 msgr2=0x55c92773d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:41.077 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.074+0000 7f9155f84640 1 --2- 172.21.15.49:0/2966535697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c927738a00 0x55c92773d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.078 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.074+0000 7f9155f84640 1 -- 172.21.15.49:0/2966535697 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c92773db70 msgr2=0x55c927740000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:41.078 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.074+0000 7f9155f84640 1 --2- 172.21.15.49:0/2966535697 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c92773db70 0x55c927740000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.078 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.074+0000 7f9155f84640 1 -- 172.21.15.49:0/2966535697 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9276559b0 con 0x55c927738010 2024-06-03T00:04:41.078 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.074+0000 7f91427fc640 1 --2- 172.21.15.49:0/2942298142 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f913c0a2c30 0x7f913c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:41.078 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.074+0000 7f9155783640 1 --2- 172.21.15.49:0/2942298142 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f913c0a2c30 0x7f913c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:41.078 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.074+0000 7f9155f84640 1 --2- 172.21.15.49:0/2966535697 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c927738010 0x55c927738430 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9148031ae0 tx=0x7f9148009360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4560419bcf66d735 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:41.078 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.074+0000 7f91427fc640 1 -- 172.21.15.49:0/2942298142 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f914c0cf460 con 0x7f9150102530 2024-06-03T00:04:41.078 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.075+0000 7f913b7fe640 1 -- 172.21.15.49:0/2966535697 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91480098c0 con 0x55c927738010 2024-06-03T00:04:41.078 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.075+0000 7f913b7fe640 1 -- 172.21.15.49:0/2966535697 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9148036040 con 0x55c927738010 2024-06-03T00:04:41.078 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.075+0000 7f913b7fe640 1 -- 172.21.15.49:0/2966535697 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9148004290 con 0x55c927738010 2024-06-03T00:04:41.078 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.075+0000 7f915a7d4740 1 -- 172.21.15.49:0/2966535697 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c927738010 msgr2=0x55c927738430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:41.078 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.075+0000 7f915a7d4740 1 --2- 172.21.15.49:0/2966535697 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c927738010 0x55c927738430 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9148031ae0 tx=0x7f9148009360 comp rx=0 tx=0).stop 2024-06-03T00:04:41.079 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.075+0000 7f9155783640 1 --2- 172.21.15.49:0/2942298142 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f913c0a2c30 0x7f913c0a50f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f914c0a4400 tx=0x7f914c04a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:41.079 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.075+0000 7f915a7d4740 1 -- 172.21.15.49:0/2966535697 shutdown_connections 2024-06-03T00:04:41.079 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.075+0000 7f915a7d4740 1 --2- 172.21.15.49:0/2966535697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c927738a00 0x55c92773d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.079 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.075+0000 7f915a7d4740 1 --2- 172.21.15.49:0/2966535697 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c92773db70 0x55c927740000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.079 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.075+0000 7f915a7d4740 1 --2- 172.21.15.49:0/2966535697 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c927738010 0x55c927738430 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.079 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.075+0000 7f915a7d4740 1 -- 172.21.15.49:0/2966535697 >> 172.21.15.49:0/2966535697 conn(0x55c927733680 msgr2=0x55c927733a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:41.079 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.075+0000 7f915a7d4740 1 -- 172.21.15.49:0/2966535697 shutdown_connections 2024-06-03T00:04:41.079 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.075+0000 7f915a7d4740 1 -- 172.21.15.49:0/2966535697 wait complete. 2024-06-03T00:04:41.079 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.076+0000 7f915a7d4740 1 -- start start 2024-06-03T00:04:41.079 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.076+0000 7f915a7d4740 1 Processor -- start 2024-06-03T00:04:41.082 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.076+0000 7f915a7d4740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c927738010 0x55c927742070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.076+0000 7f915a7d4740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c927738a00 0x55c9277425b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.076+0000 7f915a7d4740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c92773db70 0x55c9277495f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.076+0000 7f915a7d4740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c9277408e0 con 0x55c92773db70 2024-06-03T00:04:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.076+0000 7f915a7d4740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55c927624ae0 con 0x55c927738010 2024-06-03T00:04:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.076+0000 7f915a7d4740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55c927740a60 con 0x55c927738a00 2024-06-03T00:04:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.076+0000 7f915a7d4740 10 client.0 _ll_register_callbacks cb 0x55c92765d9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:04:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.077+0000 7f9155f84640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c92773db70 0x55c9277495f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.077+0000 7f9154f82640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c927738a00 0x55c9277425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.077+0000 7f9155f84640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c927738010 0x55c927742070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.077+0000 7f9154f82640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c927738a00 0x55c9277425b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:46128/0 (socket says 172.21.15.49:46128) 2024-06-03T00:04:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.077+0000 7f9154f82640 1 -- 172.21.15.49:0/1863879439 learned_addr learned my addr 172.21.15.49:0/1863879439 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.077+0000 7f9155f84640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c927738010 0x55c927742070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.49:52454/0 (socket says 172.21.15.49:52454) 2024-06-03T00:04:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.077+0000 7f9154f82640 1 -- 172.21.15.49:0/1863879439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c927738010 msgr2=0x55c927742070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.077+0000 7f9154f82640 1 --2- 172.21.15.49:0/1863879439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c927738010 0x55c927742070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.077+0000 7f9154f82640 1 -- 172.21.15.49:0/1863879439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c92773db70 msgr2=0x55c9277495f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.077+0000 7f9154f82640 1 --2- 172.21.15.49:0/1863879439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c92773db70 0x55c9277495f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.077+0000 7f9154f82640 1 -- 172.21.15.49:0/1863879439 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9273af210 con 0x55c927738a00 2024-06-03T00:04:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.077+0000 7f9154f82640 1 --2- 172.21.15.49:0/1863879439 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c927738a00 0x55c9277425b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f914400bfd0 tx=0x7f91440118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d24b9654f7ca5bc5 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.077+0000 7f9138ff9640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-06-03T00:04:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.077+0000 7f9138ff9640 1 -- 172.21.15.49:0/1863879439 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9144005020 con 0x55c927738a00 2024-06-03T00:04:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.077+0000 7f9138ff9640 1 -- 172.21.15.49:0/1863879439 <== mon.1 v2:172.21.15.107:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f91440051c0 con 0x55c927738a00 2024-06-03T00:04:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.077+0000 7f915a7d4740 1 -- 172.21.15.49:0/1863879439 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9148036040 con 0x55c927738a00 2024-06-03T00:04:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.078+0000 7f9138ff9640 1 -- 172.21.15.49:0/1863879439 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f91440053c0 con 0x55c927738a00 2024-06-03T00:04:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.078+0000 7f915a7d4740 10 client.25894 fetch_fsmap learned FSMap version 38 2024-06-03T00:04:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.078+0000 7f915a7d4740 1 -- 172.21.15.49:0/1863879439 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55c92747b620 con 0x55c927738a00 2024-06-03T00:04:41.085 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.078+0000 7f9138ff9640 1 -- 172.21.15.49:0/1863879439 <== mon.1 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9148036040 con 0x55c927738a00 2024-06-03T00:04:41.085 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.078+0000 7f9138ff9640 1 -- 172.21.15.49:0/1863879439 <== mon.1 v2:172.21.15.107:3300/0 5 ==== fsmap(e 38) ==== 8406+0+0 (secure 0 0 0) 0x7f9144010b10 con 0x55c927738a00 2024-06-03T00:04:41.085 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.078+0000 7f915a7d4740 10 client.25894 fetch_fsmap finished waiting for FSMap version 38 2024-06-03T00:04:41.085 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.078+0000 7f915a7d4740 10 client.25894 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:04:41.085 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.078+0000 7f915a7d4740 20 client.25894 populate_metadata read hostname 'smithi049' 2024-06-03T00:04:41.085 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.078+0000 7f915a7d4740 1 --2- 172.21.15.49:0/1863879439 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55c92774e050 0x55c927750490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:41.085 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.078+0000 7f915a7d4740 4 client.25894 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:04:41.085 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.078+0000 7f915a7d4740 1 -- 172.21.15.49:0/1863879439 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9276aef10 con 0x55c92774e050 2024-06-03T00:04:41.085 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.078+0000 7f9155f84640 1 --2- 172.21.15.49:0/1863879439 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55c92774e050 0x55c927750490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:41.085 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.079+0000 7f9155f84640 1 --2- 172.21.15.49:0/1863879439 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55c92774e050 0x55c927750490 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34de11276af8e572 server_cookie=5f2288392bb2354e in_seq=0 out_seq=0 2024-06-03T00:04:41.085 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.079+0000 7f9138ff9640 10 client.25894 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:04:41.085 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.080+0000 7f9138ff9640 1 -- 172.21.15.49:0/1863879439 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55c9276aef10 con 0x55c92774e050 2024-06-03T00:04:41.086 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.080+0000 7f9138ff9640 10 client.25894 handle_command_reply: tid=0 2024-06-03T00:04:41.086 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.080+0000 7f915a7d4740 1 client.25894 shutdown 2024-06-03T00:04:41.086 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.080+0000 7f915a7d4740 1 -- 172.21.15.49:0/1863879439 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c927738a00 msgr2=0x55c9277425b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:41.086 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.080+0000 7f915a7d4740 1 --2- 172.21.15.49:0/1863879439 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c927738a00 0x55c9277425b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f914400bfd0 tx=0x7f91440118d0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.086 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.080+0000 7f915a7d4740 1 -- 172.21.15.49:0/1863879439 shutdown_connections 2024-06-03T00:04:41.086 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.080+0000 7f915a7d4740 1 --2- 172.21.15.49:0/1863879439 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55c92774e050 0x55c927750490 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.086 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.080+0000 7f915a7d4740 1 --2- 172.21.15.49:0/1863879439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c92773db70 0x55c9277495f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.086 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.080+0000 7f915a7d4740 1 --2- 172.21.15.49:0/1863879439 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c927738a00 0x55c9277425b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.086 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.080+0000 7f915a7d4740 1 --2- 172.21.15.49:0/1863879439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c927738010 0x55c927742070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.086 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.080+0000 7f9138ff9640 0 client.25894 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:04:41.086 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.080+0000 7f915a7d4740 1 -- 172.21.15.49:0/1863879439 >> 172.21.15.49:0/1863879439 conn(0x55c927733680 msgr2=0x55c9277327e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:41.087 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.080+0000 7f915a7d4740 1 -- 172.21.15.49:0/1863879439 shutdown_connections 2024-06-03T00:04:41.087 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.080+0000 7f915a7d4740 1 -- 172.21.15.49:0/1863879439 wait complete. 2024-06-03T00:04:41.087 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.080+0000 7f915a7d4740 20 client.25894 trim_cache size 0 max 16384 2024-06-03T00:04:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.096+0000 7f915a7d4740 1 Processor -- start 2024-06-03T00:04:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.096+0000 7f915a7d4740 1 -- start start 2024-06-03T00:04:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.096+0000 7f915a7d4740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c927738010 0x55c927740e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.096+0000 7f915a7d4740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c927738a00 0x55c9277495b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.096+0000 7f915a7d4740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c92773db70 0x55c927739c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.096+0000 7f915a7d4740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f91501aaf90 con 0x55c927738010 2024-06-03T00:04:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.096+0000 7f915a7d4740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f91501acce0 con 0x55c92773db70 2024-06-03T00:04:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.096+0000 7f915a7d4740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f91501ab6c0 con 0x55c927738a00 2024-06-03T00:04:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.096+0000 7f9155f84640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c927738010 0x55c927740e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.096+0000 7f9155f84640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c927738010 0x55c927740e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35426/0 (socket says 172.21.15.49:35426) 2024-06-03T00:04:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.096+0000 7f9155f84640 1 -- 172.21.15.49:0/1656733843 learned_addr learned my addr 172.21.15.49:0/1656733843 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.096+0000 7f9154f82640 1 --2- 172.21.15.49:0/1656733843 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c927738a00 0x55c9277495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.096+0000 7f9155f84640 1 -- 172.21.15.49:0/1656733843 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c927738a00 msgr2=0x55c9277495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.096+0000 7f9155f84640 1 --2- 172.21.15.49:0/1656733843 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c927738a00 0x55c9277495b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.096+0000 7f9155f84640 1 -- 172.21.15.49:0/1656733843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c92773db70 msgr2=0x55c927739c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:41.099 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.096+0000 7f9155f84640 1 --2- 172.21.15.49:0/1656733843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c92773db70 0x55c927739c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.099 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.096+0000 7f9155f84640 1 -- 172.21.15.49:0/1656733843 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9277334b0 con 0x55c927738010 2024-06-03T00:04:41.099 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.096+0000 7f9155f84640 1 --2- 172.21.15.49:0/1656733843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c927738010 0x55c927740e00 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f9148031ae0 tx=0x7f91480098c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ebfd6a10e731ec server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:41.099 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.097+0000 7f913affd640 1 -- 172.21.15.49:0/1656733843 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91480315e0 con 0x55c927738010 2024-06-03T00:04:41.099 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.097+0000 7f913affd640 1 -- 172.21.15.49:0/1656733843 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9148036040 con 0x55c927738010 2024-06-03T00:04:41.099 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.097+0000 7f913affd640 1 -- 172.21.15.49:0/1656733843 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9148030820 con 0x55c927738010 2024-06-03T00:04:41.102 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.097+0000 7f915a7d4740 1 -- 172.21.15.49:0/1656733843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c927738010 msgr2=0x55c927740e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:41.102 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.097+0000 7f915a7d4740 1 --2- 172.21.15.49:0/1656733843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c927738010 0x55c927740e00 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f9148031ae0 tx=0x7f91480098c0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.102 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.097+0000 7f915a7d4740 1 -- 172.21.15.49:0/1656733843 shutdown_connections 2024-06-03T00:04:41.102 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.097+0000 7f915a7d4740 1 --2- 172.21.15.49:0/1656733843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c92773db70 0x55c927739c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.102 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.097+0000 7f915a7d4740 1 --2- 172.21.15.49:0/1656733843 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c927738a00 0x55c9277495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.102 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.097+0000 7f915a7d4740 1 --2- 172.21.15.49:0/1656733843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c927738010 0x55c927740e00 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.103 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.097+0000 7f915a7d4740 1 -- 172.21.15.49:0/1656733843 >> 172.21.15.49:0/1656733843 conn(0x55c927733680 msgr2=0x55c927733a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:41.103 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.097+0000 7f915a7d4740 1 -- 172.21.15.49:0/1656733843 shutdown_connections 2024-06-03T00:04:41.103 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.097+0000 7f915a7d4740 1 -- 172.21.15.49:0/1656733843 wait complete. 2024-06-03T00:04:41.103 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.098+0000 7f915a7d4740 1 -- start start 2024-06-03T00:04:41.103 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.098+0000 7f915a7d4740 1 Processor -- start 2024-06-03T00:04:41.103 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.098+0000 7f915a7d4740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c927738010 0x55c927746290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:41.103 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.098+0000 7f915a7d4740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c927738a00 0x55c9277467d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:41.103 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.098+0000 7f915a7d4740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c92773db70 0x55c9277b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:41.103 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.098+0000 7f915a7d4740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f91501ac550 con 0x55c927738a00 2024-06-03T00:04:41.103 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.098+0000 7f915a7d4740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f91501abdf0 con 0x55c92773db70 2024-06-03T00:04:41.103 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.098+0000 7f915a7d4740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f91501a8f50 con 0x55c927738010 2024-06-03T00:04:41.103 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.098+0000 7f915a7d4740 10 client.0 _ll_register_callbacks cb 0x7f914400bc10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:04:41.103 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.098+0000 7f9154f82640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c927738a00 0x55c9277467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:41.104 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.098+0000 7f9154f82640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c927738a00 0x55c9277467d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35440/0 (socket says 172.21.15.49:35440) 2024-06-03T00:04:41.104 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.098+0000 7f9154f82640 1 -- 172.21.15.49:0/3694144219 learned_addr learned my addr 172.21.15.49:0/3694144219 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:41.104 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.098+0000 7f9155f84640 1 --2- 172.21.15.49:0/3694144219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c927738010 0x55c927746290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:41.104 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.099+0000 7f9155f84640 1 --2- 172.21.15.49:0/3694144219 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c92773db70 0x55c9277b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:41.104 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.099+0000 7f9155f84640 1 -- 172.21.15.49:0/3694144219 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c92773db70 msgr2=0x55c9277b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:41.104 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.099+0000 7f9155f84640 1 --2- 172.21.15.49:0/3694144219 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c92773db70 0x55c9277b6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.104 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.099+0000 7f9155f84640 1 -- 172.21.15.49:0/3694144219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c927738a00 msgr2=0x55c9277467d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:41.104 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.099+0000 7f9155f84640 1 --2- 172.21.15.49:0/3694144219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c927738a00 0x55c9277467d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.104 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.099+0000 7f9155f84640 1 -- 172.21.15.49:0/3694144219 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c927749830 con 0x55c927738010 2024-06-03T00:04:41.104 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.099+0000 7f9154f82640 1 --2- 172.21.15.49:0/3694144219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c927738a00 0x55c9277467d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:04:41.104 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.099+0000 7f9155f84640 1 --2- 172.21.15.49:0/3694144219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c927738010 0x55c927746290 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9148000f80 tx=0x7f9148009540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49609c3fa5e2fab8 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:41.104 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.099+0000 7f9138ff9640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-06-03T00:04:41.104 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.099+0000 7f9138ff9640 1 -- 172.21.15.49:0/3694144219 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9148004d50 con 0x55c927738010 2024-06-03T00:04:41.105 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.099+0000 7f915a7d4740 1 -- 172.21.15.49:0/3694144219 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9148036040 con 0x55c927738010 2024-06-03T00:04:41.105 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.099+0000 7f9138ff9640 1 -- 172.21.15.49:0/3694144219 <== mon.1 v2:172.21.15.107:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f9148031450 con 0x55c927738010 2024-06-03T00:04:41.105 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.099+0000 7f9138ff9640 1 -- 172.21.15.49:0/3694144219 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f9148031650 con 0x55c927738010 2024-06-03T00:04:41.105 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.099+0000 7f915a7d4740 10 client.25900 fetch_fsmap learned FSMap version 38 2024-06-03T00:04:41.105 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.099+0000 7f915a7d4740 1 -- 172.21.15.49:0/3694144219 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55c9277b8250 con 0x55c927738010 2024-06-03T00:04:41.105 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.099+0000 7f9138ff9640 1 -- 172.21.15.49:0/3694144219 <== mon.1 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9148036040 con 0x55c927738010 2024-06-03T00:04:41.105 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.100+0000 7f9138ff9640 1 -- 172.21.15.49:0/3694144219 <== mon.1 v2:172.21.15.107:3300/0 5 ==== fsmap(e 38) ==== 8406+0+0 (secure 0 0 0) 0x7f91480562d0 con 0x55c927738010 2024-06-03T00:04:41.105 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.100+0000 7f915a7d4740 10 client.25900 fetch_fsmap finished waiting for FSMap version 38 2024-06-03T00:04:41.105 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.100+0000 7f915a7d4740 10 client.25900 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:04:41.105 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.100+0000 7f915a7d4740 20 client.25900 populate_metadata read hostname 'smithi049' 2024-06-03T00:04:41.105 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.100+0000 7f915a7d4740 1 --2- 172.21.15.49:0/3694144219 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55c9277b89b0 0x55c9277badd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:41.105 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.100+0000 7f915a7d4740 4 client.25900 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-03T00:04:41.105 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.100+0000 7f915a7d4740 1 -- 172.21.15.49:0/3694144219 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c9276a8c20 con 0x55c9277b89b0 2024-06-03T00:04:41.105 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.100+0000 7f9154f82640 1 --2- 172.21.15.49:0/3694144219 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55c9277b89b0 0x55c9277badd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:41.106 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.100+0000 7f9138ff9640 10 client.25900 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:04:41.106 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.100+0000 7f9154f82640 1 --2- 172.21.15.49:0/3694144219 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55c9277b89b0 0x55c9277badd0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f53de62910af508b server_cookie=12385e729ca038f0 in_seq=0 out_seq=0 2024-06-03T00:04:41.112 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.111+0000 7f9138ff9640 1 -- 172.21.15.49:0/3694144219 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55c9276a8c20 con 0x55c9277b89b0 2024-06-03T00:04:41.112 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.111+0000 7f9138ff9640 10 client.25900 handle_command_reply: tid=0 2024-06-03T00:04:41.113 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.111+0000 7f915a7d4740 1 client.25900 shutdown 2024-06-03T00:04:41.113 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.111+0000 7f915a7d4740 1 -- 172.21.15.49:0/3694144219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c927738010 msgr2=0x55c927746290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:41.113 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.111+0000 7f915a7d4740 1 --2- 172.21.15.49:0/3694144219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c927738010 0x55c927746290 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9148000f80 tx=0x7f9148009540 comp rx=0 tx=0).stop 2024-06-03T00:04:41.113 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.111+0000 7f915a7d4740 1 -- 172.21.15.49:0/3694144219 shutdown_connections 2024-06-03T00:04:41.113 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.111+0000 7f915a7d4740 1 --2- 172.21.15.49:0/3694144219 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55c9277b89b0 0x55c9277badd0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.113 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.111+0000 7f915a7d4740 1 --2- 172.21.15.49:0/3694144219 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c92773db70 0x55c9277b6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.113 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.111+0000 7f915a7d4740 1 --2- 172.21.15.49:0/3694144219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c927738a00 0x55c9277467d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.113 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.111+0000 7f915a7d4740 1 --2- 172.21.15.49:0/3694144219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c927738010 0x55c927746290 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.113 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.111+0000 7f9138ff9640 0 client.25900 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:04:41.113 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.111+0000 7f915a7d4740 1 -- 172.21.15.49:0/3694144219 >> 172.21.15.49:0/3694144219 conn(0x55c927733680 msgr2=0x55c927742070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:41.113 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.112+0000 7f915a7d4740 1 -- 172.21.15.49:0/3694144219 shutdown_connections 2024-06-03T00:04:41.113 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.112+0000 7f915a7d4740 1 -- 172.21.15.49:0/3694144219 wait complete. 2024-06-03T00:04:41.114 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.112+0000 7f915a7d4740 20 client.25900 trim_cache size 0 max 16384 2024-06-03T00:04:41.114 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-06-03T00:04:41.114 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-06-03T00:04:41.114 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-06-03T00:04:41.115 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.112+0000 7f91579e7640 1 -- 172.21.15.49:0/2942298142 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f913c0a2c30 msgr2=0x7f913c0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:41.115 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.112+0000 7f91579e7640 1 --2- 172.21.15.49:0/2942298142 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f913c0a2c30 0x7f913c0a50f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f914c0a4400 tx=0x7f914c04a040 comp rx=0 tx=0).stop 2024-06-03T00:04:41.115 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.112+0000 7f91579e7640 1 -- 172.21.15.49:0/2942298142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9150102530 msgr2=0x7f9150199e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:41.115 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.112+0000 7f91579e7640 1 --2- 172.21.15.49:0/2942298142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9150102530 0x7f9150199e30 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f914c00e9f0 tx=0x7f914c00edf0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.115 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.112+0000 7f91579e7640 1 -- 172.21.15.49:0/2942298142 shutdown_connections 2024-06-03T00:04:41.115 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.112+0000 7f91579e7640 1 --2- 172.21.15.49:0/2942298142 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f913c0a2c30 0x7f913c0a50f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.115 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.112+0000 7f91579e7640 1 --2- 172.21.15.49:0/2942298142 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9150104e60 0x7f915019a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.115 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.112+0000 7f91579e7640 1 --2- 172.21.15.49:0/2942298142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9150107790 0x7f91501a13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.115 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.112+0000 7f91579e7640 1 --2- 172.21.15.49:0/2942298142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9150102530 0x7f9150199e30 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:41.116 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.112+0000 7f91579e7640 1 -- 172.21.15.49:0/2942298142 >> 172.21.15.49:0/2942298142 conn(0x7f91500fbf20 msgr2=0x7f9150101b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:41.116 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.112+0000 7f91579e7640 1 -- 172.21.15.49:0/2942298142 shutdown_connections 2024-06-03T00:04:41.116 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:41.112+0000 7f91579e7640 1 -- 172.21.15.49:0/2942298142 wait complete. 2024-06-03T00:04:41.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:40 smithi057 ceph-mon[36457]: pgmap v522: 97 pgs: 97 active+clean; 102 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 166 KiB/s wr, 87 op/s 2024-06-03T00:04:41.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:40 smithi049 ceph-mon[32302]: pgmap v522: 97 pgs: 97 active+clean; 102 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 166 KiB/s wr, 87 op/s 2024-06-03T00:04:41.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:40 smithi107 ceph-mon[37048]: pgmap v522: 97 pgs: 97 active+clean; 102 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 166 KiB/s wr, 87 op/s 2024-06-03T00:04:43.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:42 smithi057 ceph-mon[36457]: pgmap v523: 97 pgs: 97 active+clean; 102 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 26 op/s 2024-06-03T00:04:43.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:42 smithi049 ceph-mon[32302]: pgmap v523: 97 pgs: 97 active+clean; 102 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 26 op/s 2024-06-03T00:04:43.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:42 smithi107 ceph-mon[37048]: pgmap v523: 97 pgs: 97 active+clean; 102 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 26 op/s 2024-06-03T00:04:45.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:44 smithi057 ceph-mon[36457]: pgmap v524: 97 pgs: 97 active+clean; 102 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.6 KiB/s wr, 17 op/s 2024-06-03T00:04:45.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:44 smithi049 ceph-mon[32302]: pgmap v524: 97 pgs: 97 active+clean; 102 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.6 KiB/s wr, 17 op/s 2024-06-03T00:04:45.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:44 smithi107 ceph-mon[37048]: pgmap v524: 97 pgs: 97 active+clean; 102 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.6 KiB/s wr, 17 op/s 2024-06-03T00:04:47.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:46 smithi057 ceph-mon[36457]: pgmap v525: 97 pgs: 97 active+clean; 103 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 16 op/s 2024-06-03T00:04:47.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:46 smithi049 ceph-mon[32302]: pgmap v525: 97 pgs: 97 active+clean; 103 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 16 op/s 2024-06-03T00:04:47.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:46 smithi107 ceph-mon[37048]: pgmap v525: 97 pgs: 97 active+clean; 103 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 16 op/s 2024-06-03T00:04:47.866 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-03T00:04:48.130 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:04:49.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:48 smithi057 ceph-mon[36457]: pgmap v526: 97 pgs: 97 active+clean; 103 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 4.9 KiB/s wr, 13 op/s 2024-06-03T00:04:49.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:48 smithi049 ceph-mon[32302]: pgmap v526: 97 pgs: 97 active+clean; 103 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 4.9 KiB/s wr, 13 op/s 2024-06-03T00:04:49.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:48 smithi107 ceph-mon[37048]: pgmap v526: 97 pgs: 97 active+clean; 103 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 4.9 KiB/s wr, 13 op/s 2024-06-03T00:04:49.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.816+0000 7f630f913700 1 -- 172.21.15.49:0/4020222228 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6308102740 msgr2=0x7f6308102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:49.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.816+0000 7f630f913700 1 --2- 172.21.15.49:0/4020222228 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6308102740 0x7f6308102b20 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f630000b0d0 tx=0x7f630000b3e0 comp rx=0 tx=0).stop 2024-06-03T00:04:49.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.816+0000 7f630f913700 1 -- 172.21.15.49:0/4020222228 shutdown_connections 2024-06-03T00:04:49.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.816+0000 7f630f913700 1 --2- 172.21.15.49:0/4020222228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6308107840 0x7f630810f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:49.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.816+0000 7f630f913700 1 --2- 172.21.15.49:0/4020222228 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6308102740 0x7f6308102b20 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:49.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.816+0000 7f630f913700 1 --2- 172.21.15.49:0/4020222228 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63081030f0 0x7f6308107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:49.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.816+0000 7f630f913700 1 -- 172.21.15.49:0/4020222228 >> 172.21.15.49:0/4020222228 conn(0x7f63080795f0 msgr2=0x7f6308079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:49.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.816+0000 7f630f913700 1 -- 172.21.15.49:0/4020222228 shutdown_connections 2024-06-03T00:04:49.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.816+0000 7f630f913700 1 -- 172.21.15.49:0/4020222228 wait complete. 2024-06-03T00:04:49.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.816+0000 7f630f913700 1 Processor -- start 2024-06-03T00:04:49.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.816+0000 7f630f913700 1 -- start start 2024-06-03T00:04:49.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.817+0000 7f630f913700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6308102740 0x7f6308074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:49.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.817+0000 7f630f913700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63081030f0 0x7f6308074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:49.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.817+0000 7f630f913700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6308107840 0x7f6308075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:49.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.817+0000 7f630f913700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6308112800 con 0x7f63081030f0 2024-06-03T00:04:49.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.817+0000 7f630f913700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6308112680 con 0x7f6308102740 2024-06-03T00:04:49.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.817+0000 7f630f913700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6308112980 con 0x7f6308107840 2024-06-03T00:04:49.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.817+0000 7f630ceae700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63081030f0 0x7f6308074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:49.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.817+0000 7f630d6af700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6308102740 0x7f6308074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:49.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.817+0000 7f630ceae700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63081030f0 0x7f6308074cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34488/0 (socket says 172.21.15.49:34488) 2024-06-03T00:04:49.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.817+0000 7f630ceae700 1 -- 172.21.15.49:0/1276329157 learned_addr learned my addr 172.21.15.49:0/1276329157 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:49.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.817+0000 7f630deb0700 1 --2- 172.21.15.49:0/1276329157 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6308107840 0x7f6308075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:49.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.817+0000 7f630ceae700 1 -- 172.21.15.49:0/1276329157 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6308107840 msgr2=0x7f6308075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:49.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.817+0000 7f630ceae700 1 --2- 172.21.15.49:0/1276329157 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6308107840 0x7f6308075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:49.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.817+0000 7f630ceae700 1 -- 172.21.15.49:0/1276329157 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6308102740 msgr2=0x7f6308074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:49.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.817+0000 7f630ceae700 1 --2- 172.21.15.49:0/1276329157 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6308102740 0x7f6308074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:49.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.817+0000 7f630ceae700 1 -- 172.21.15.49:0/1276329157 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63081a7140 con 0x7f63081030f0 2024-06-03T00:04:49.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.817+0000 7f630d6af700 1 --2- 172.21.15.49:0/1276329157 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6308102740 0x7f6308074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:04:49.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.817+0000 7f630ceae700 1 --2- 172.21.15.49:0/1276329157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63081030f0 0x7f6308074cd0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00d980 tx=0x7f62fc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:49.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.818+0000 7f63067fc700 1 -- 172.21.15.49:0/1276329157 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62fc017070 con 0x7f63081030f0 2024-06-03T00:04:49.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.818+0000 7f63067fc700 1 -- 172.21.15.49:0/1276329157 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62fc005020 con 0x7f63081030f0 2024-06-03T00:04:49.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.818+0000 7f630f913700 1 -- 172.21.15.49:0/1276329157 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63081a7430 con 0x7f63081030f0 2024-06-03T00:04:49.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.818+0000 7f63067fc700 1 -- 172.21.15.49:0/1276329157 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62fc00fbf0 con 0x7f63081030f0 2024-06-03T00:04:49.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.818+0000 7f630f913700 1 -- 172.21.15.49:0/1276329157 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63081a7970 con 0x7f63081030f0 2024-06-03T00:04:49.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.819+0000 7f630f913700 1 -- 172.21.15.49:0/1276329157 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f630810aa80 con 0x7f63081030f0 2024-06-03T00:04:49.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.820+0000 7f63067fc700 1 -- 172.21.15.49:0/1276329157 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f62fc0051d0 con 0x7f63081030f0 2024-06-03T00:04:49.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.821+0000 7f63067fc700 1 --2- 172.21.15.49:0/1276329157 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f62f00a2ca0 0x7f62f00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:49.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.821+0000 7f630d6af700 1 --2- 172.21.15.49:0/1276329157 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f62f00a2ca0 0x7f62f00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:49.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.821+0000 7f63067fc700 1 -- 172.21.15.49:0/1276329157 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f62fc0cf1c0 con 0x7f63081030f0 2024-06-03T00:04:49.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.821+0000 7f630d6af700 1 --2- 172.21.15.49:0/1276329157 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f62f00a2ca0 0x7f62f00a5160 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6300009fd0 tx=0x7f630000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:49.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:49.824+0000 7f63067fc700 1 -- 172.21.15.49:0/1276329157 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f62fc020020 con 0x7f63081030f0 2024-06-03T00:04:50.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:50.077+0000 7f630f913700 1 -- 172.21.15.49:0/1276329157 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6308069180 con 0x7f63081030f0 2024-06-03T00:04:50.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:50.077+0000 7f63067fc700 1 -- 172.21.15.49:0/1276329157 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+11950 (secure 0 0 0) 0x7f62fc09c1a0 con 0x7f63081030f0 2024-06-03T00:04:50.077 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:04:50.078 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1553264866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1553264866},{"type":"v1","addr":"172.21.15.49:6835","nonce":1553264866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2266285252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2266285252},{"type":"v1","addr":"172.21.15.49:6837","nonce":2266285252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":38,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T23:57:16.991201+0000","modified":"2024-06-03T00:04:24.724466+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24485,"mds_2":24466,"mds_3":24464,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6839/1729124617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":1729124617},{"type":"v1","addr":"172.21.15.49:6839","nonce":1729124617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6841/1902772235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":1902772235},{"type":"v1","addr":"172.21.15.49:6841","nonce":1902772235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6833/1633534002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1633534002},{"type":"v1","addr":"172.21.15.57:6833","nonce":1633534002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6835/2254905671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2254905671},{"type":"v1","addr":"172.21.15.57:6835","nonce":2254905671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.107:6835/3693542801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3693542801},{"type":"v1","addr":"172.21.15.107:6835","nonce":3693542801}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.57:6837/230452144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":230452144},{"type":"v1","addr":"172.21.15.57:6837","nonce":230452144}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":92,"addr":"172.21.15.107:6837/3700593315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":3700593315},{"type":"v1","addr":"172.21.15.107:6837","nonce":3700593315}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6839/249825195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":249825195},{"type":"v1","addr":"172.21.15.57:6839","nonce":249825195}]},"join_fscid":-1,"export_targets":[0,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6839/1986600681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1986600681},{"type":"v1","addr":"172.21.15.107:6839","nonce":1986600681}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24466,24487,24460,24464,24485]},"id":1}]} 2024-06-03T00:04:50.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:50.080+0000 7f630f913700 1 -- 172.21.15.49:0/1276329157 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f62f00a2ca0 msgr2=0x7f62f00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:50.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:50.080+0000 7f630f913700 1 --2- 172.21.15.49:0/1276329157 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f62f00a2ca0 0x7f62f00a5160 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6300009fd0 tx=0x7f630000b040 comp rx=0 tx=0).stop 2024-06-03T00:04:50.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:50.080+0000 7f630f913700 1 -- 172.21.15.49:0/1276329157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63081030f0 msgr2=0x7f6308074cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:50.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:50.080+0000 7f630f913700 1 --2- 172.21.15.49:0/1276329157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63081030f0 0x7f6308074cd0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00d980 tx=0x7f62fc00dc90 comp rx=0 tx=0).stop 2024-06-03T00:04:50.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:50.080+0000 7f630f913700 1 -- 172.21.15.49:0/1276329157 shutdown_connections 2024-06-03T00:04:50.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:50.080+0000 7f630f913700 1 --2- 172.21.15.49:0/1276329157 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f62f00a2ca0 0x7f62f00a5160 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:50.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:50.080+0000 7f630f913700 1 --2- 172.21.15.49:0/1276329157 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6308107840 0x7f6308075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:50.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:50.080+0000 7f630f913700 1 --2- 172.21.15.49:0/1276329157 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6308102740 0x7f6308074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:50.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:50.080+0000 7f630f913700 1 --2- 172.21.15.49:0/1276329157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63081030f0 0x7f6308074cd0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:50.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:50.080+0000 7f630f913700 1 -- 172.21.15.49:0/1276329157 >> 172.21.15.49:0/1276329157 conn(0x7f63080795f0 msgr2=0x7f6308101c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:50.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:50.080+0000 7f630f913700 1 -- 172.21.15.49:0/1276329157 shutdown_connections 2024-06-03T00:04:50.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:50.080+0000 7f630f913700 1 -- 172.21.15.49:0/1276329157 wait complete. 2024-06-03T00:04:50.081 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 38 2024-06-03T00:04:50.750 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24487 quiesce db --set-id 33d9be6 --release --await' 2024-06-03T00:04:50.750 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- timeout 105 ceph tell mds.24487 quiesce db --set-id 33d9be6 --release --await 2024-06-03T00:04:51.010 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:04:51.133 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:50 smithi049 ceph-mon[32302]: pgmap v527: 97 pgs: 97 active+clean; 103 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.9 KiB/s wr, 13 op/s 2024-06-03T00:04:51.133 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:50 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/1276329157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:04:51.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:50 smithi057 ceph-mon[36457]: pgmap v527: 97 pgs: 97 active+clean; 103 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.9 KiB/s wr, 13 op/s 2024-06-03T00:04:51.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:50 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/1276329157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:04:51.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:50 smithi107 ceph-mon[37048]: pgmap v527: 97 pgs: 97 active+clean; 103 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.9 KiB/s wr, 13 op/s 2024-06-03T00:04:51.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:50 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/1276329157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:04:52.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.741+0000 7f80e628a700 1 -- 172.21.15.49:0/2313223773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80e0106720 msgr2=0x7f80e010e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:52.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.741+0000 7f80e628a700 1 --2- 172.21.15.49:0/2313223773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80e0106720 0x7f80e010e2c0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f80d800b0d0 tx=0x7f80d800b3e0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.741+0000 7f80e628a700 1 -- 172.21.15.49:0/2313223773 shutdown_connections 2024-06-03T00:04:52.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.741+0000 7f80e628a700 1 --2- 172.21.15.49:0/2313223773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80e0106720 0x7f80e010e2c0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.741+0000 7f80e628a700 1 --2- 172.21.15.49:0/2313223773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80e01019d0 0x7f80e0101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.741+0000 7f80e628a700 1 --2- 172.21.15.49:0/2313223773 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80e0102380 0x7f80e0105ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.741+0000 7f80e628a700 1 -- 172.21.15.49:0/2313223773 >> 172.21.15.49:0/2313223773 conn(0x7f80e0078340 msgr2=0x7f80e0078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:52.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.741+0000 7f80e628a700 1 -- 172.21.15.49:0/2313223773 shutdown_connections 2024-06-03T00:04:52.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.741+0000 7f80e628a700 1 -- 172.21.15.49:0/2313223773 wait complete. 2024-06-03T00:04:52.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.741+0000 7f80e628a700 1 Processor -- start 2024-06-03T00:04:52.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.742+0000 7f80e628a700 1 -- start start 2024-06-03T00:04:52.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.742+0000 7f80e628a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80e01019d0 0x7f80e0103090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:52.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.742+0000 7f80e628a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80e0102380 0x7f80e01035d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:52.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.742+0000 7f80e628a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80e0106720 0x7f80e0103b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:52.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.742+0000 7f80e628a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f80e01116e0 con 0x7f80e0102380 2024-06-03T00:04:52.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.742+0000 7f80e628a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f80e0111560 con 0x7f80e01019d0 2024-06-03T00:04:52.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.742+0000 7f80e628a700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f80e0111860 con 0x7f80e0106720 2024-06-03T00:04:52.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.742+0000 7f80df7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80e0102380 0x7f80e01035d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:52.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.742+0000 7f80df7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80e0102380 0x7f80e01035d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34506/0 (socket says 172.21.15.49:34506) 2024-06-03T00:04:52.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.742+0000 7f80df7fe700 1 -- 172.21.15.49:0/704362142 learned_addr learned my addr 172.21.15.49:0/704362142 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:52.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.742+0000 7f80e4827700 1 --2- 172.21.15.49:0/704362142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80e0106720 0x7f80e0103b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:52.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.742+0000 7f80dffff700 1 --2- 172.21.15.49:0/704362142 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80e01019d0 0x7f80e0103090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:52.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.742+0000 7f80df7fe700 1 -- 172.21.15.49:0/704362142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80e0106720 msgr2=0x7f80e0103b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:52.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.742+0000 7f80df7fe700 1 --2- 172.21.15.49:0/704362142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80e0106720 0x7f80e0103b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.742+0000 7f80df7fe700 1 -- 172.21.15.49:0/704362142 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80e01019d0 msgr2=0x7f80e0103090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:52.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.742+0000 7f80df7fe700 1 --2- 172.21.15.49:0/704362142 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80e01019d0 0x7f80e0103090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.743+0000 7f80df7fe700 1 -- 172.21.15.49:0/704362142 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e01a70b0 con 0x7f80e0102380 2024-06-03T00:04:52.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.743+0000 7f80df7fe700 1 --2- 172.21.15.49:0/704362142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80e0102380 0x7f80e01035d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f80d400d950 tx=0x7f80d400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:52.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.743+0000 7f80dd7fa700 1 -- 172.21.15.49:0/704362142 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d4017070 con 0x7f80e0102380 2024-06-03T00:04:52.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.743+0000 7f80dd7fa700 1 -- 172.21.15.49:0/704362142 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80d4009e10 con 0x7f80e0102380 2024-06-03T00:04:52.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.743+0000 7f80e628a700 1 -- 172.21.15.49:0/704362142 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80e01a73a0 con 0x7f80e0102380 2024-06-03T00:04:52.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.743+0000 7f80dd7fa700 1 -- 172.21.15.49:0/704362142 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d400f3c0 con 0x7f80e0102380 2024-06-03T00:04:52.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.743+0000 7f80e628a700 1 -- 172.21.15.49:0/704362142 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80e01a78e0 con 0x7f80e0102380 2024-06-03T00:04:52.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.745+0000 7f80dd7fa700 1 -- 172.21.15.49:0/704362142 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f80d401a070 con 0x7f80e0102380 2024-06-03T00:04:52.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.746+0000 7f80dd7fa700 1 --2- 172.21.15.49:0/704362142 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f80c80a2c20 0x7f80c80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:52.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.746+0000 7f80dffff700 1 --2- 172.21.15.49:0/704362142 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f80c80a2c20 0x7f80c80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:52.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.746+0000 7f80dd7fa700 1 -- 172.21.15.49:0/704362142 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f80d40ce860 con 0x7f80e0102380 2024-06-03T00:04:52.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.746+0000 7f80dffff700 1 --2- 172.21.15.49:0/704362142 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f80c80a2c20 0x7f80c80a50e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f80d0005ea0 tx=0x7f80d0005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:52.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.747+0000 7f80f0b0db80 1 Processor -- start 2024-06-03T00:04:52.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.747+0000 7f80f0b0db80 1 -- start start 2024-06-03T00:04:52.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.747+0000 7f80f0b0db80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561066aedc40 0x561066aee020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:52.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.747+0000 7f80f0b0db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561066aee560 0x561066ae7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:52.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.747+0000 7f80f0b0db80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561066ae83d0 0x561066ae8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:52.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.747+0000 7f80f0b0db80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x561066a39910 con 0x561066ae83d0 2024-06-03T00:04:52.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.747+0000 7f80f0b0db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5610669e1820 con 0x561066aee560 2024-06-03T00:04:52.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.747+0000 7f80f0b0db80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561066a358d0 con 0x561066aedc40 2024-06-03T00:04:52.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.747+0000 7f80e4827700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561066ae83d0 0x561066ae8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:52.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.747+0000 7f80e4827700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561066ae83d0 0x561066ae8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34520/0 (socket says 172.21.15.49:34520) 2024-06-03T00:04:52.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.747+0000 7f80e4827700 1 -- 172.21.15.49:0/3558278847 learned_addr learned my addr 172.21.15.49:0/3558278847 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:52.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.747+0000 7f80dffff700 1 --2- 172.21.15.49:0/3558278847 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561066aedc40 0x561066aee020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:52.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.747+0000 7f80df7fe700 1 --2- 172.21.15.49:0/3558278847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561066aee560 0x561066ae7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:52.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.747+0000 7f80e4827700 1 -- 172.21.15.49:0/3558278847 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561066aedc40 msgr2=0x561066aee020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:52.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.747+0000 7f80e4827700 1 --2- 172.21.15.49:0/3558278847 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561066aedc40 0x561066aee020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.747+0000 7f80e4827700 1 -- 172.21.15.49:0/3558278847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561066aee560 msgr2=0x561066ae7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:52.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.747+0000 7f80e4827700 1 --2- 172.21.15.49:0/3558278847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561066aee560 0x561066ae7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.747+0000 7f80e4827700 1 -- 172.21.15.49:0/3558278847 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610669d8050 con 0x561066ae83d0 2024-06-03T00:04:52.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.747+0000 7f80df7fe700 1 --2- 172.21.15.49:0/3558278847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561066aee560 0x561066ae7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:04:52.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.747+0000 7f80e4827700 1 --2- 172.21.15.49:0/3558278847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561066ae83d0 0x561066ae8810 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009e40 tx=0x7f80d8006210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d7dc4970219f9b server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:52.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.748+0000 7f80c67fc700 1 -- 172.21.15.49:0/3558278847 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d80093d0 con 0x561066ae83d0 2024-06-03T00:04:52.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.748+0000 7f80c67fc700 1 -- 172.21.15.49:0/3558278847 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80d80074e0 con 0x561066ae83d0 2024-06-03T00:04:52.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.748+0000 7f80c67fc700 1 -- 172.21.15.49:0/3558278847 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d8005240 con 0x561066ae83d0 2024-06-03T00:04:52.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.748+0000 7f80f0b0db80 1 -- 172.21.15.49:0/3558278847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561066ae83d0 msgr2=0x561066ae8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:52.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.748+0000 7f80f0b0db80 1 --2- 172.21.15.49:0/3558278847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561066ae83d0 0x561066ae8810 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009e40 tx=0x7f80d8006210 comp rx=0 tx=0).stop 2024-06-03T00:04:52.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.748+0000 7f80f0b0db80 1 -- 172.21.15.49:0/3558278847 shutdown_connections 2024-06-03T00:04:52.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.748+0000 7f80f0b0db80 1 --2- 172.21.15.49:0/3558278847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561066ae83d0 0x561066ae8810 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.748+0000 7f80f0b0db80 1 --2- 172.21.15.49:0/3558278847 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561066aedc40 0x561066aee020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.748+0000 7f80f0b0db80 1 --2- 172.21.15.49:0/3558278847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561066aee560 0x561066ae7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.748+0000 7f80f0b0db80 1 -- 172.21.15.49:0/3558278847 >> 172.21.15.49:0/3558278847 conn(0x561066a12dc0 msgr2=0x561066ae3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:52.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.749+0000 7f80f0b0db80 1 -- 172.21.15.49:0/3558278847 shutdown_connections 2024-06-03T00:04:52.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.749+0000 7f80f0b0db80 1 -- 172.21.15.49:0/3558278847 wait complete. 2024-06-03T00:04:52.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.749+0000 7f80f0b0db80 1 -- start start 2024-06-03T00:04:52.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.749+0000 7f80f0b0db80 1 Processor -- start 2024-06-03T00:04:52.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.749+0000 7f80f0b0db80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561066ae83d0 0x561066af4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:52.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.749+0000 7f80f0b0db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561066aedc40 0x561066af1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:52.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.749+0000 7f80f0b0db80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561066aee560 0x561066af1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:52.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.749+0000 7f80f0b0db80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x561066af4f70 con 0x561066ae83d0 2024-06-03T00:04:52.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.749+0000 7f80f0b0db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5610669d9cf0 con 0x561066aedc40 2024-06-03T00:04:52.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.749+0000 7f80f0b0db80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561066af50f0 con 0x561066aee560 2024-06-03T00:04:52.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.750+0000 7f80f0b0db80 10 client.0 _ll_register_callbacks cb 0x5610669d3a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:04:52.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.750+0000 7f80dffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561066ae83d0 0x561066af4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:52.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.750+0000 7f80dffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561066ae83d0 0x561066af4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34528/0 (socket says 172.21.15.49:34528) 2024-06-03T00:04:52.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.750+0000 7f80dffff700 1 -- 172.21.15.49:0/816882119 learned_addr learned my addr 172.21.15.49:0/816882119 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:52.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.750+0000 7f80df7fe700 1 --2- 172.21.15.49:0/816882119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561066aedc40 0x561066af1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:52.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.750+0000 7f80e4827700 1 --2- 172.21.15.49:0/816882119 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561066aee560 0x561066af1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:52.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.750+0000 7f80dffff700 1 -- 172.21.15.49:0/816882119 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561066aee560 msgr2=0x561066af1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:52.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.750+0000 7f80dffff700 1 --2- 172.21.15.49:0/816882119 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561066aee560 0x561066af1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.750+0000 7f80dffff700 1 -- 172.21.15.49:0/816882119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561066aedc40 msgr2=0x561066af1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:52.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.750+0000 7f80dffff700 1 --2- 172.21.15.49:0/816882119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561066aedc40 0x561066af1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.750+0000 7f80dffff700 1 -- 172.21.15.49:0/816882119 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610669889d0 con 0x561066ae83d0 2024-06-03T00:04:52.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.750+0000 7f80dffff700 1 --2- 172.21.15.49:0/816882119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561066ae83d0 0x561066af4260 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f80d00109e0 tx=0x7f80d00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2855d87f969e58d server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:52.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.750+0000 7f80bf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:04:52.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.750+0000 7f80bf7fe700 1 -- 172.21.15.49:0/816882119 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d001dc60 con 0x561066ae83d0 2024-06-03T00:04:52.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.750+0000 7f80bf7fe700 1 -- 172.21.15.49:0/816882119 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f80d001de00 con 0x561066ae83d0 2024-06-03T00:04:52.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.750+0000 7f80f0b0db80 1 -- 172.21.15.49:0/816882119 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80d80074e0 con 0x561066ae83d0 2024-06-03T00:04:52.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.750+0000 7f80bf7fe700 1 -- 172.21.15.49:0/816882119 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f80d0010e50 con 0x561066ae83d0 2024-06-03T00:04:52.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.750+0000 7f80f0b0db80 10 client.16341 fetch_fsmap learned FSMap version 38 2024-06-03T00:04:52.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.750+0000 7f80f0b0db80 1 -- 172.21.15.49:0/816882119 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x561066aff8b0 con 0x561066ae83d0 2024-06-03T00:04:52.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.751+0000 7f80bf7fe700 1 -- 172.21.15.49:0/816882119 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80d80074e0 con 0x561066ae83d0 2024-06-03T00:04:52.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.751+0000 7f80bf7fe700 1 -- 172.21.15.49:0/816882119 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 38) ==== 8406+0+0 (secure 0 0 0) 0x7f80d0026510 con 0x561066ae83d0 2024-06-03T00:04:52.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.751+0000 7f80f0b0db80 10 client.16341 fetch_fsmap finished waiting for FSMap version 38 2024-06-03T00:04:52.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.751+0000 7f80f0b0db80 10 client.16341 resolve_mds: validated gid 24487 aka daemon mds.i 2024-06-03T00:04:52.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.751+0000 7f80f0b0db80 20 client.16341 populate_metadata read hostname 'smithi049' 2024-06-03T00:04:52.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.751+0000 7f80f0b0db80 1 --2- 172.21.15.49:0/816882119 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x561066b01f90 0x561066b043e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:52.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.751+0000 7f80f0b0db80 4 client.16341 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:04:52.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.751+0000 7f80f0b0db80 1 -- 172.21.15.49:0/816882119 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561066a46e10 con 0x561066b01f90 2024-06-03T00:04:52.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.751+0000 7f80df7fe700 1 --2- 172.21.15.49:0/816882119 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x561066b01f90 0x561066b043e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:52.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.752+0000 7f80bf7fe700 10 client.16341 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:04:52.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.752+0000 7f80df7fe700 1 --2- 172.21.15.49:0/816882119 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x561066b01f90 0x561066b043e0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e0684ff03f14f29 server_cookie=4336bf80f1d3682f in_seq=0 out_seq=0 2024-06-03T00:04:52.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.752+0000 7f80bf7fe700 1 -- 172.21.15.49:0/816882119 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x561066a46e10 con 0x561066b01f90 2024-06-03T00:04:52.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.752+0000 7f80bf7fe700 10 client.16341 handle_command_reply: tid=0 2024-06-03T00:04:52.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.752+0000 7f80f0b0db80 1 client.16341 shutdown 2024-06-03T00:04:52.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.753+0000 7f80f0b0db80 1 -- 172.21.15.49:0/816882119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561066ae83d0 msgr2=0x561066af4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:52.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.753+0000 7f80f0b0db80 1 --2- 172.21.15.49:0/816882119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561066ae83d0 0x561066af4260 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f80d00109e0 tx=0x7f80d00047c0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.753+0000 7f80f0b0db80 1 -- 172.21.15.49:0/816882119 shutdown_connections 2024-06-03T00:04:52.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.753+0000 7f80f0b0db80 1 --2- 172.21.15.49:0/816882119 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561066aee560 0x561066af1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.753+0000 7f80f0b0db80 1 --2- 172.21.15.49:0/816882119 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x561066b01f90 0x561066b043e0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.753+0000 7f80f0b0db80 1 --2- 172.21.15.49:0/816882119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561066ae83d0 0x561066af4260 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.753+0000 7f80f0b0db80 1 --2- 172.21.15.49:0/816882119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561066aedc40 0x561066af1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.753+0000 7f80f0b0db80 1 -- 172.21.15.49:0/816882119 >> 172.21.15.49:0/816882119 conn(0x561066a12dc0 msgr2=0x561066ae2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:52.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.753+0000 7f80bf7fe700 0 client.16341 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:04:52.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.753+0000 7f80f0b0db80 1 -- 172.21.15.49:0/816882119 shutdown_connections 2024-06-03T00:04:52.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.753+0000 7f80f0b0db80 1 -- 172.21.15.49:0/816882119 wait complete. 2024-06-03T00:04:52.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.753+0000 7f80f0b0db80 20 client.16341 trim_cache size 0 max 16384 2024-06-03T00:04:52.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.773+0000 7f80f0b0db80 1 Processor -- start 2024-06-03T00:04:52.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.773+0000 7f80f0b0db80 1 -- start start 2024-06-03T00:04:52.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.773+0000 7f80f0b0db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561066ae83d0 0x561066ae7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:52.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.773+0000 7f80f0b0db80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561066aedc40 0x561066af1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:52.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.773+0000 7f80f0b0db80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561066aee560 0x561066aef1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:52.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.773+0000 7f80f0b0db80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f80e01aecf0 con 0x561066aee560 2024-06-03T00:04:52.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.773+0000 7f80f0b0db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f80e01b0a40 con 0x561066ae83d0 2024-06-03T00:04:52.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.773+0000 7f80f0b0db80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f80e01af420 con 0x561066aedc40 2024-06-03T00:04:52.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.773+0000 7f80e4827700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561066aee560 0x561066aef1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:52.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.773+0000 7f80e4827700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561066aee560 0x561066aef1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34540/0 (socket says 172.21.15.49:34540) 2024-06-03T00:04:52.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.773+0000 7f80e4827700 1 -- 172.21.15.49:0/881967098 learned_addr learned my addr 172.21.15.49:0/881967098 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:52.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.774+0000 7f80dffff700 1 --2- 172.21.15.49:0/881967098 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561066ae83d0 0x561066ae7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:52.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.774+0000 7f80df7fe700 1 --2- 172.21.15.49:0/881967098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561066aedc40 0x561066af1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:52.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.774+0000 7f80e4827700 1 -- 172.21.15.49:0/881967098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561066aedc40 msgr2=0x561066af1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:52.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.774+0000 7f80e4827700 1 --2- 172.21.15.49:0/881967098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561066aedc40 0x561066af1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.774+0000 7f80e4827700 1 -- 172.21.15.49:0/881967098 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561066ae83d0 msgr2=0x561066ae7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:52.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.774+0000 7f80e4827700 1 --2- 172.21.15.49:0/881967098 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561066ae83d0 0x561066ae7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.774+0000 7f80e4827700 1 -- 172.21.15.49:0/881967098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561066aed6f0 con 0x561066aee560 2024-06-03T00:04:52.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.774+0000 7f80dffff700 1 --2- 172.21.15.49:0/881967098 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561066ae83d0 0x561066ae7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:04:52.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.774+0000 7f80df7fe700 1 --2- 172.21.15.49:0/881967098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561066aedc40 0x561066af1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:04:52.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.774+0000 7f80e4827700 1 --2- 172.21.15.49:0/881967098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561066aee560 0x561066aef1d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009e40 tx=0x7f80d8009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd921eead212a4b2 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:52.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.774+0000 7f80c5ffb700 1 -- 172.21.15.49:0/881967098 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d8031070 con 0x561066aee560 2024-06-03T00:04:52.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.774+0000 7f80c5ffb700 1 -- 172.21.15.49:0/881967098 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80d8003c00 con 0x561066aee560 2024-06-03T00:04:52.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.774+0000 7f80c5ffb700 1 -- 172.21.15.49:0/881967098 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d802c6a0 con 0x561066aee560 2024-06-03T00:04:52.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.775+0000 7f80f0b0db80 1 -- 172.21.15.49:0/881967098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561066aee560 msgr2=0x561066aef1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:52.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.775+0000 7f80f0b0db80 1 --2- 172.21.15.49:0/881967098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561066aee560 0x561066aef1d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009e40 tx=0x7f80d8009360 comp rx=0 tx=0).stop 2024-06-03T00:04:52.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.775+0000 7f80f0b0db80 1 -- 172.21.15.49:0/881967098 shutdown_connections 2024-06-03T00:04:52.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.775+0000 7f80f0b0db80 1 --2- 172.21.15.49:0/881967098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561066aee560 0x561066aef1d0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.775+0000 7f80f0b0db80 1 --2- 172.21.15.49:0/881967098 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561066ae83d0 0x561066ae7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.775+0000 7f80f0b0db80 1 --2- 172.21.15.49:0/881967098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561066aedc40 0x561066af1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.775+0000 7f80f0b0db80 1 -- 172.21.15.49:0/881967098 >> 172.21.15.49:0/881967098 conn(0x561066a12dc0 msgr2=0x561066af2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:52.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.775+0000 7f80f0b0db80 1 -- 172.21.15.49:0/881967098 shutdown_connections 2024-06-03T00:04:52.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.775+0000 7f80f0b0db80 1 -- 172.21.15.49:0/881967098 wait complete. 2024-06-03T00:04:52.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.775+0000 7f80f0b0db80 1 -- start start 2024-06-03T00:04:52.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.775+0000 7f80f0b0db80 1 Processor -- start 2024-06-03T00:04:52.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.776+0000 7f80f0b0db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561066ae83d0 0x561066afa750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:52.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.776+0000 7f80f0b0db80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561066aedc40 0x561066afac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:52.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.776+0000 7f80f0b0db80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561066aee560 0x561066af7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:52.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.776+0000 7f80f0b0db80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f80e01b02b0 con 0x561066aedc40 2024-06-03T00:04:52.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.776+0000 7f80f0b0db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f80e01afb50 con 0x561066ae83d0 2024-06-03T00:04:52.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.776+0000 7f80f0b0db80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f80e01acc70 con 0x561066aee560 2024-06-03T00:04:52.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.776+0000 7f80df7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561066aedc40 0x561066afac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:52.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.776+0000 7f80f0b0db80 10 client.0 _ll_register_callbacks cb 0x5610669d3a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:04:52.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.776+0000 7f80df7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561066aedc40 0x561066afac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34550/0 (socket says 172.21.15.49:34550) 2024-06-03T00:04:52.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.776+0000 7f80df7fe700 1 -- 172.21.15.49:0/3637096908 learned_addr learned my addr 172.21.15.49:0/3637096908 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:52.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.776+0000 7f80dffff700 1 --2- 172.21.15.49:0/3637096908 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561066ae83d0 0x561066afa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:52.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.776+0000 7f80e4827700 1 --2- 172.21.15.49:0/3637096908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561066aee560 0x561066af7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:52.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.776+0000 7f80df7fe700 1 -- 172.21.15.49:0/3637096908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561066aee560 msgr2=0x561066af7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:52.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.776+0000 7f80df7fe700 1 --2- 172.21.15.49:0/3637096908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561066aee560 0x561066af7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.776+0000 7f80df7fe700 1 -- 172.21.15.49:0/3637096908 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561066ae83d0 msgr2=0x561066afa750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:52.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.776+0000 7f80df7fe700 1 --2- 172.21.15.49:0/3637096908 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561066ae83d0 0x561066afa750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.776+0000 7f80df7fe700 1 -- 172.21.15.49:0/3637096908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561066af7d70 con 0x561066aedc40 2024-06-03T00:04:52.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.776+0000 7f80dffff700 1 --2- 172.21.15.49:0/3637096908 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561066ae83d0 0x561066afa750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:04:52.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.776+0000 7f80df7fe700 1 --2- 172.21.15.49:0/3637096908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561066aedc40 0x561066afac90 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f80d4009520 tx=0x7f80d400df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18e9835331b40bd8 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:52.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.776+0000 7f80bf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:04:52.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.776+0000 7f80bf7fe700 1 -- 172.21.15.49:0/3637096908 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d4021040 con 0x561066aedc40 2024-06-03T00:04:52.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.777+0000 7f80bf7fe700 1 -- 172.21.15.49:0/3637096908 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f80d4010460 con 0x561066aedc40 2024-06-03T00:04:52.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.777+0000 7f80f0b0db80 1 -- 172.21.15.49:0/3637096908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80d8003c00 con 0x561066aedc40 2024-06-03T00:04:52.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.777+0000 7f80bf7fe700 1 -- 172.21.15.49:0/3637096908 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f80d4010710 con 0x561066aedc40 2024-06-03T00:04:52.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.777+0000 7f80f0b0db80 10 client.16347 fetch_fsmap learned FSMap version 38 2024-06-03T00:04:52.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.777+0000 7f80f0b0db80 1 -- 172.21.15.49:0/3637096908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x561066b6d900 con 0x561066aedc40 2024-06-03T00:04:52.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.777+0000 7f80bf7fe700 1 -- 172.21.15.49:0/3637096908 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80d8003c00 con 0x561066aedc40 2024-06-03T00:04:52.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.777+0000 7f80bf7fe700 1 -- 172.21.15.49:0/3637096908 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 38) ==== 8406+0+0 (secure 0 0 0) 0x7f80d40a38a0 con 0x561066aedc40 2024-06-03T00:04:52.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.777+0000 7f80f0b0db80 10 client.16347 fetch_fsmap finished waiting for FSMap version 38 2024-06-03T00:04:52.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.777+0000 7f80f0b0db80 10 client.16347 resolve_mds: validated gid 24487 aka daemon mds.i 2024-06-03T00:04:52.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.777+0000 7f80f0b0db80 20 client.16347 populate_metadata read hostname 'smithi049' 2024-06-03T00:04:52.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.777+0000 7f80f0b0db80 1 --2- 172.21.15.49:0/3637096908 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x561066b6e0b0 0x561066b704d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:52.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.777+0000 7f80f0b0db80 4 client.16347 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "33d9be6", "release": true, "await": true}] 2024-06-03T00:04:52.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.777+0000 7f80f0b0db80 1 -- 172.21.15.49:0/3637096908 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "quiesce db", "set_id": "33d9be6", "release": true, "await": true}) -- 0x561066a41390 con 0x561066b6e0b0 2024-06-03T00:04:52.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.778+0000 7f80dffff700 1 --2- 172.21.15.49:0/3637096908 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x561066b6e0b0 0x561066b704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:52.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.778+0000 7f80bf7fe700 10 client.16347 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:04:52.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.778+0000 7f80dffff700 1 --2- 172.21.15.49:0/3637096908 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x561066b6e0b0 0x561066b704d0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c5f22ebc25fef82 server_cookie=fa7d3accfd4db955 in_seq=0 out_seq=0 2024-06-03T00:04:52.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.905+0000 7f80bf7fe700 1 -- 172.21.15.49:0/3637096908 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x561066a41390 con 0x561066b6e0b0 2024-06-03T00:04:52.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.905+0000 7f80bf7fe700 10 client.16347 handle_command_reply: tid=0 2024-06-03T00:04:52.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.905+0000 7f80f0b0db80 1 client.16347 shutdown 2024-06-03T00:04:52.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.905+0000 7f80f0b0db80 1 -- 172.21.15.49:0/3637096908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561066aedc40 msgr2=0x561066afac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:52.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.905+0000 7f80f0b0db80 1 --2- 172.21.15.49:0/3637096908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561066aedc40 0x561066afac90 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f80d4009520 tx=0x7f80d400df90 comp rx=0 tx=0).stop 2024-06-03T00:04:52.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.906+0000 7f80f0b0db80 1 -- 172.21.15.49:0/3637096908 shutdown_connections 2024-06-03T00:04:52.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.906+0000 7f80f0b0db80 1 --2- 172.21.15.49:0/3637096908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561066aee560 0x561066af7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.906+0000 7f80f0b0db80 1 --2- 172.21.15.49:0/3637096908 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561066ae83d0 0x561066afa750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.906+0000 7f80f0b0db80 1 --2- 172.21.15.49:0/3637096908 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x561066b6e0b0 0x561066b704d0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.906+0000 7f80f0b0db80 1 --2- 172.21.15.49:0/3637096908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561066aedc40 0x561066afac90 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.906+0000 7f80f0b0db80 1 -- 172.21.15.49:0/3637096908 >> 172.21.15.49:0/3637096908 conn(0x561066a12dc0 msgr2=0x561066aec6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:52.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.906+0000 7f80bf7fe700 0 client.16347 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:04:52.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.906+0000 7f80f0b0db80 1 -- 172.21.15.49:0/3637096908 shutdown_connections 2024-06-03T00:04:52.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.906+0000 7f80f0b0db80 1 -- 172.21.15.49:0/3637096908 wait complete. 2024-06-03T00:04:52.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.906+0000 7f80f0b0db80 20 client.16347 trim_cache size 0 max 16384 2024-06-03T00:04:52.907 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:04:52.908 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 38, 2024-06-03T00:04:52.908 INFO:teuthology.orchestra.run.smithi049.stdout: "leader": 24487, 2024-06-03T00:04:52.908 INFO:teuthology.orchestra.run.smithi049.stdout: "set_version": 16, 2024-06-03T00:04:52.908 INFO:teuthology.orchestra.run.smithi049.stdout: "sets": { 2024-06-03T00:04:52.908 INFO:teuthology.orchestra.run.smithi049.stdout: "33d9be6": { 2024-06-03T00:04:52.908 INFO:teuthology.orchestra.run.smithi049.stdout: "version": 16, 2024-06-03T00:04:52.909 INFO:teuthology.orchestra.run.smithi049.stdout: "age_ref": 0.0, 2024-06-03T00:04:52.909 INFO:teuthology.orchestra.run.smithi049.stdout: "state": { 2024-06-03T00:04:52.909 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "RELEASED", 2024-06-03T00:04:52.909 INFO:teuthology.orchestra.run.smithi049.stdout: "age": 0.0 2024-06-03T00:04:52.909 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:04:52.909 INFO:teuthology.orchestra.run.smithi049.stdout: "timeout": 90.0, 2024-06-03T00:04:52.909 INFO:teuthology.orchestra.run.smithi049.stdout: "expiration": 147.8, 2024-06-03T00:04:52.909 INFO:teuthology.orchestra.run.smithi049.stdout: "members": { 2024-06-03T00:04:52.909 INFO:teuthology.orchestra.run.smithi049.stdout: "file:/": { 2024-06-03T00:04:52.909 INFO:teuthology.orchestra.run.smithi049.stdout: "excluded": false, 2024-06-03T00:04:52.909 INFO:teuthology.orchestra.run.smithi049.stdout: "state": { 2024-06-03T00:04:52.910 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "RELEASED", 2024-06-03T00:04:52.910 INFO:teuthology.orchestra.run.smithi049.stdout: "age": 0.0 2024-06-03T00:04:52.910 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:04:52.910 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:04:52.910 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:04:52.910 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:04:52.910 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:04:52.910 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:04:52.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.907+0000 7f80e628a700 1 -- 172.21.15.49:0/704362142 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f80c80a2c20 msgr2=0x7f80c80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:52.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.907+0000 7f80e628a700 1 --2- 172.21.15.49:0/704362142 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f80c80a2c20 0x7f80c80a50e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f80d0005ea0 tx=0x7f80d0005e30 comp rx=0 tx=0).stop 2024-06-03T00:04:52.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.907+0000 7f80e628a700 1 -- 172.21.15.49:0/704362142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80e0102380 msgr2=0x7f80e01035d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:52.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.907+0000 7f80e628a700 1 --2- 172.21.15.49:0/704362142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80e0102380 0x7f80e01035d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f80d400d950 tx=0x7f80d400dc60 comp rx=0 tx=0).stop 2024-06-03T00:04:52.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.907+0000 7f80e628a700 1 -- 172.21.15.49:0/704362142 shutdown_connections 2024-06-03T00:04:52.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.907+0000 7f80e628a700 1 --2- 172.21.15.49:0/704362142 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f80c80a2c20 0x7f80c80a50e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.907+0000 7f80e628a700 1 --2- 172.21.15.49:0/704362142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80e0106720 0x7f80e0103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.907+0000 7f80e628a700 1 --2- 172.21.15.49:0/704362142 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80e01019d0 0x7f80e0103090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.907+0000 7f80e628a700 1 --2- 172.21.15.49:0/704362142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80e0102380 0x7f80e01035d0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:52.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.907+0000 7f80e628a700 1 -- 172.21.15.49:0/704362142 >> 172.21.15.49:0/704362142 conn(0x7f80e0078340 msgr2=0x7f80e006ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:52.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.907+0000 7f80e628a700 1 -- 172.21.15.49:0/704362142 shutdown_connections 2024-06-03T00:04:52.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:04:52.907+0000 7f80e628a700 1 -- 172.21.15.49:0/704362142 wait complete. 2024-06-03T00:04:53.199 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:52 smithi057 ceph-mon[36457]: pgmap v528: 97 pgs: 97 active+clean; 103 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.3 KiB/s wr, 13 op/s 2024-06-03T00:04:53.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:52 smithi049 ceph-mon[32302]: pgmap v528: 97 pgs: 97 active+clean; 103 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.3 KiB/s wr, 13 op/s 2024-06-03T00:04:53.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:52 smithi107 ceph-mon[37048]: pgmap v528: 97 pgs: 97 active+clean; 103 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.3 KiB/s wr, 13 op/s 2024-06-03T00:04:53.642 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '33d9be6', total seconds elapsed: 33.5 2024-06-03T00:04:54.207 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.205+0000 7f095f709640 1 -- 172.21.15.49:0/3151501756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0958102500 msgr2=0x7f09581048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:54.207 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.205+0000 7f095f709640 1 --2- 172.21.15.49:0/3151501756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0958102500 0x7f09581048f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f0954009900 tx=0x7f095402a410 comp rx=0 tx=0).stop 2024-06-03T00:04:54.207 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.205+0000 7f095f709640 1 -- 172.21.15.49:0/3151501756 shutdown_connections 2024-06-03T00:04:54.207 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.205+0000 7f095f709640 1 --2- 172.21.15.49:0/3151501756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0958104e30 0x7f0958107220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:54.207 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.205+0000 7f095f709640 1 --2- 172.21.15.49:0/3151501756 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0958107760 0x7f0958109b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:54.207 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.205+0000 7f095f709640 1 --2- 172.21.15.49:0/3151501756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0958102500 0x7f09581048f0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:54.208 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.205+0000 7f095f709640 1 -- 172.21.15.49:0/3151501756 >> 172.21.15.49:0/3151501756 conn(0x7f09580fbeb0 msgr2=0x7f09580fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:54.208 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.205+0000 7f095f709640 1 -- 172.21.15.49:0/3151501756 shutdown_connections 2024-06-03T00:04:54.208 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.206+0000 7f095f709640 1 -- 172.21.15.49:0/3151501756 wait complete. 2024-06-03T00:04:54.208 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.206+0000 7f095f709640 1 Processor -- start 2024-06-03T00:04:54.208 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.206+0000 7f095f709640 1 -- start start 2024-06-03T00:04:54.208 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.206+0000 7f095f709640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0958102500 0x7f0958101e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:54.208 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.206+0000 7f095f709640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0958104e30 0x7f09581004b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:54.208 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.206+0000 7f095f709640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0958107760 0x7f09581009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:54.208 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.206+0000 7f095f709640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f095810d690 con 0x7f0958102500 2024-06-03T00:04:54.208 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.206+0000 7f095f709640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f095810d510 con 0x7f0958104e30 2024-06-03T00:04:54.208 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.206+0000 7f095f709640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f095810d810 con 0x7f0958107760 2024-06-03T00:04:54.208 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.206+0000 7f095d4a5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0958102500 0x7f0958101e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:54.208 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.206+0000 7f095d4a5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0958102500 0x7f0958101e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53762/0 (socket says 172.21.15.49:53762) 2024-06-03T00:04:54.208 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.206+0000 7f095d4a5640 1 -- 172.21.15.49:0/3641596283 learned_addr learned my addr 172.21.15.49:0/3641596283 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:54.209 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.206+0000 7f095dca6640 1 --2- 172.21.15.49:0/3641596283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0958107760 0x7f09581009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:54.209 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.207+0000 7f095cca4640 1 --2- 172.21.15.49:0/3641596283 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0958104e30 0x7f09581004b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:54.209 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.207+0000 7f095d4a5640 1 -- 172.21.15.49:0/3641596283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0958107760 msgr2=0x7f09581009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:54.209 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.207+0000 7f095d4a5640 1 --2- 172.21.15.49:0/3641596283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0958107760 0x7f09581009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:54.209 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.207+0000 7f095d4a5640 1 -- 172.21.15.49:0/3641596283 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0958104e30 msgr2=0x7f09581004b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:54.209 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.207+0000 7f095d4a5640 1 --2- 172.21.15.49:0/3641596283 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0958104e30 0x7f09581004b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:54.209 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.207+0000 7f095d4a5640 1 -- 172.21.15.49:0/3641596283 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0958101280 con 0x7f0958102500 2024-06-03T00:04:54.209 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.207+0000 7f095d4a5640 1 --2- 172.21.15.49:0/3641596283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0958102500 0x7f0958101e70 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f0954009230 tx=0x7f0954031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:54.209 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.207+0000 7f094e7fc640 1 -- 172.21.15.49:0/3641596283 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095403f030 con 0x7f0958102500 2024-06-03T00:04:54.209 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.207+0000 7f095f709640 1 -- 172.21.15.49:0/3641596283 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09581a1d50 con 0x7f0958102500 2024-06-03T00:04:54.209 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.207+0000 7f094e7fc640 1 -- 172.21.15.49:0/3641596283 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0954003ad0 con 0x7f0958102500 2024-06-03T00:04:54.209 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.207+0000 7f094e7fc640 1 -- 172.21.15.49:0/3641596283 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0954035070 con 0x7f0958102500 2024-06-03T00:04:54.209 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.207+0000 7f095f709640 1 -- 172.21.15.49:0/3641596283 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09581a2190 con 0x7f0958102500 2024-06-03T00:04:54.220 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.210+0000 7f094e7fc640 1 -- 172.21.15.49:0/3641596283 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0954042030 con 0x7f0958102500 2024-06-03T00:04:54.220 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.210+0000 7f0962415740 1 Processor -- start 2024-06-03T00:04:54.220 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.210+0000 7f0962415740 1 -- start start 2024-06-03T00:04:54.221 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.211+0000 7f0962415740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f395b17010 0x55f395b17430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:54.221 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.211+0000 7f0962415740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f395b17a00 0x55f395b1c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:54.221 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.211+0000 7f0962415740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f395b1cb70 0x55f395b1f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:54.221 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.211+0000 7f0962415740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f395a7a4f0 con 0x55f395b1cb70 2024-06-03T00:04:54.221 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.211+0000 7f0962415740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55f395a18870 con 0x55f395b17010 2024-06-03T00:04:54.221 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.211+0000 7f0962415740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f395a764b0 con 0x55f395b17a00 2024-06-03T00:04:54.221 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.211+0000 7f095d4a5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f395b17a00 0x55f395b1c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:54.222 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.211+0000 7f095cca4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f395b1cb70 0x55f395b1f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:54.222 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.211+0000 7f095d4a5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f395b17a00 0x55f395b1c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:39590/0 (socket says 172.21.15.49:39590) 2024-06-03T00:04:54.222 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.211+0000 7f095d4a5640 1 -- 172.21.15.49:0/2891451575 learned_addr learned my addr 172.21.15.49:0/2891451575 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:54.222 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.211+0000 7f095dca6640 1 --2- 172.21.15.49:0/2891451575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f395b17010 0x55f395b17430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:54.222 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.211+0000 7f095d4a5640 1 -- 172.21.15.49:0/2891451575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f395b17010 msgr2=0x55f395b17430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:54.222 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.211+0000 7f095d4a5640 1 --2- 172.21.15.49:0/2891451575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f395b17010 0x55f395b17430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:54.222 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.211+0000 7f095d4a5640 1 -- 172.21.15.49:0/2891451575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f395b1cb70 msgr2=0x55f395b1f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:54.222 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.211+0000 7f095d4a5640 1 --2- 172.21.15.49:0/2891451575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f395b1cb70 0x55f395b1f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:54.222 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.211+0000 7f095d4a5640 1 -- 172.21.15.49:0/2891451575 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f395a349b0 con 0x55f395b17a00 2024-06-03T00:04:54.223 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.211+0000 7f094e7fc640 1 --2- 172.21.15.49:0/3641596283 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f09440a2c30 0x7f09440a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:54.223 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.211+0000 7f095dca6640 1 --2- 172.21.15.49:0/2891451575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f395b17010 0x55f395b17430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:04:54.223 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.212+0000 7f095dca6640 1 --2- 172.21.15.49:0/3641596283 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f09440a2c30 0x7f09440a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:54.223 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.212+0000 7f095d4a5640 1 --2- 172.21.15.49:0/2891451575 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f395b17a00 0x55f395b1c500 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f09540f56f0 tx=0x7f09540f57e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1054e9702c35321 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:54.223 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.212+0000 7f094e7fc640 1 -- 172.21.15.49:0/3641596283 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f09540ef5d0 con 0x7f0958102500 2024-06-03T00:04:54.223 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.212+0000 7f09437fe640 1 -- 172.21.15.49:0/2891451575 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0954049070 con 0x55f395b17a00 2024-06-03T00:04:54.223 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.212+0000 7f09437fe640 1 -- 172.21.15.49:0/2891451575 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09540bc530 con 0x55f395b17a00 2024-06-03T00:04:54.223 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.212+0000 7f09437fe640 1 -- 172.21.15.49:0/2891451575 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09540bbe30 con 0x55f395b17a00 2024-06-03T00:04:54.223 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.213+0000 7f0962415740 1 -- 172.21.15.49:0/2891451575 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f395b17a00 msgr2=0x55f395b1c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:54.223 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.213+0000 7f095dca6640 1 --2- 172.21.15.49:0/3641596283 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f09440a2c30 0x7f09440a50f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x55f395b18260 tx=0x7f0950009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:54.223 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.213+0000 7f0962415740 1 --2- 172.21.15.49:0/2891451575 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f395b17a00 0x55f395b1c500 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f09540f56f0 tx=0x7f09540f57e0 comp rx=0 tx=0).stop 2024-06-03T00:04:54.224 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.213+0000 7f0962415740 1 -- 172.21.15.49:0/2891451575 shutdown_connections 2024-06-03T00:04:54.224 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.213+0000 7f0962415740 1 --2- 172.21.15.49:0/2891451575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f395b1cb70 0x55f395b1f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:54.224 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.213+0000 7f0962415740 1 --2- 172.21.15.49:0/2891451575 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f395b17a00 0x55f395b1c500 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:54.224 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.213+0000 7f0962415740 1 --2- 172.21.15.49:0/2891451575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f395b17010 0x55f395b17430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:54.224 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.213+0000 7f0962415740 1 -- 172.21.15.49:0/2891451575 >> 172.21.15.49:0/2891451575 conn(0x55f395b12680 msgr2=0x55f395b12a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:54.224 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.213+0000 7f0962415740 1 -- 172.21.15.49:0/2891451575 shutdown_connections 2024-06-03T00:04:54.224 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.213+0000 7f0962415740 1 -- 172.21.15.49:0/2891451575 wait complete. 2024-06-03T00:04:54.224 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.213+0000 7f0962415740 1 -- start start 2024-06-03T00:04:54.224 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.213+0000 7f0962415740 1 Processor -- start 2024-06-03T00:04:54.224 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.213+0000 7f0962415740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f395b17010 0x55f395b21000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:54.224 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.213+0000 7f0962415740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f395b17a00 0x55f395b21540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:54.224 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.213+0000 7f0962415740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f395b1cb70 0x55f395b28510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:54.225 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.213+0000 7f0962415740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f395b1f8e0 con 0x55f395b17010 2024-06-03T00:04:54.225 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.213+0000 7f0962415740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55f395a03ae0 con 0x55f395b1cb70 2024-06-03T00:04:54.225 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.213+0000 7f0962415740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f395b1fa60 con 0x55f395b17a00 2024-06-03T00:04:54.225 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.213+0000 7f0962415740 10 client.0 _ll_register_callbacks cb 0x55f395a3c9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:04:54.225 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.214+0000 7f095d4a5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f395b17010 0x55f395b21000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:54.225 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.214+0000 7f095d4a5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f395b17010 0x55f395b21000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53784/0 (socket says 172.21.15.49:53784) 2024-06-03T00:04:54.225 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.214+0000 7f095d4a5640 1 -- 172.21.15.49:0/3495142892 learned_addr learned my addr 172.21.15.49:0/3495142892 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:54.225 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.214+0000 7f095cca4640 1 --2- 172.21.15.49:0/3495142892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f395b17a00 0x55f395b21540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:54.225 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.214+0000 7f095d4a5640 1 -- 172.21.15.49:0/3495142892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f395b17a00 msgr2=0x55f395b21540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:54.225 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.214+0000 7f095d4a5640 1 --2- 172.21.15.49:0/3495142892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f395b17a00 0x55f395b21540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:54.225 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.214+0000 7f095d4a5640 1 -- 172.21.15.49:0/3495142892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f395b1cb70 msgr2=0x55f395b28510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:54.225 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.214+0000 7f095dca6640 1 --2- 172.21.15.49:0/3495142892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f395b1cb70 0x55f395b28510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:54.226 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.214+0000 7f095d4a5640 1 --2- 172.21.15.49:0/3495142892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f395b1cb70 0x55f395b28510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:54.226 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.214+0000 7f095d4a5640 1 -- 172.21.15.49:0/3495142892 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f39578e210 con 0x55f395b17010 2024-06-03T00:04:54.226 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.214+0000 7f095d4a5640 1 --2- 172.21.15.49:0/3495142892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f395b17010 0x55f395b21000 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f09540c4570 tx=0x7f09540f2e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9c6e284f974558 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:54.226 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.214+0000 7f0940ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:04:54.226 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.214+0000 7f0940ff9640 1 -- 172.21.15.49:0/3495142892 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0954049040 con 0x55f395b17010 2024-06-03T00:04:54.226 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.214+0000 7f0940ff9640 1 -- 172.21.15.49:0/3495142892 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f095403b460 con 0x55f395b17010 2024-06-03T00:04:54.226 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.214+0000 7f0962415740 1 -- 172.21.15.49:0/3495142892 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09540bc530 con 0x55f395b17010 2024-06-03T00:04:54.226 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.214+0000 7f0940ff9640 1 -- 172.21.15.49:0/3495142892 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f09540bbc00 con 0x55f395b17010 2024-06-03T00:04:54.226 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.214+0000 7f0962415740 10 client.16359 fetch_fsmap learned FSMap version 38 2024-06-03T00:04:54.227 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.214+0000 7f0962415740 1 -- 172.21.15.49:0/3495142892 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55f39585a620 con 0x55f395b17010 2024-06-03T00:04:54.227 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.215+0000 7f0940ff9640 1 -- 172.21.15.49:0/3495142892 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09540bc530 con 0x55f395b17010 2024-06-03T00:04:54.227 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.215+0000 7f0940ff9640 1 -- 172.21.15.49:0/3495142892 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 38) ==== 8406+0+0 (secure 0 0 0) 0x7f0954003c80 con 0x55f395b17010 2024-06-03T00:04:54.227 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.215+0000 7f0962415740 10 client.16359 fetch_fsmap finished waiting for FSMap version 38 2024-06-03T00:04:54.227 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.215+0000 7f0962415740 10 client.16359 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:04:54.227 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.215+0000 7f0962415740 20 client.16359 populate_metadata read hostname 'smithi049' 2024-06-03T00:04:54.227 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.215+0000 7f0962415740 1 --2- 172.21.15.49:0/3495142892 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55f395b2ca00 0x55f395b2ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:54.227 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.215+0000 7f0962415740 4 client.16359 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:04:54.227 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.215+0000 7f0962415740 1 -- 172.21.15.49:0/3495142892 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f395a8df10 con 0x55f395b2ca00 2024-06-03T00:04:54.227 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.215+0000 7f095cca4640 1 --2- 172.21.15.49:0/3495142892 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55f395b2ca00 0x55f395b2ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:54.227 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.215+0000 7f095cca4640 1 --2- 172.21.15.49:0/3495142892 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55f395b2ca00 0x55f395b2ee30 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7dc8e4162906367 server_cookie=b16b27d39e5d80d0 in_seq=0 out_seq=0 2024-06-03T00:04:54.227 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.215+0000 7f0940ff9640 10 client.16359 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:04:54.227 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.216+0000 7f0940ff9640 1 -- 172.21.15.49:0/3495142892 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55f395a8df10 con 0x55f395b2ca00 2024-06-03T00:04:54.228 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.216+0000 7f0940ff9640 10 client.16359 handle_command_reply: tid=0 2024-06-03T00:04:54.228 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.216+0000 7f0962415740 1 client.16359 shutdown 2024-06-03T00:04:54.228 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.216+0000 7f0962415740 1 -- 172.21.15.49:0/3495142892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f395b17010 msgr2=0x55f395b21000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:54.228 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.216+0000 7f0962415740 1 --2- 172.21.15.49:0/3495142892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f395b17010 0x55f395b21000 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f09540c4570 tx=0x7f09540f2e20 comp rx=0 tx=0).stop 2024-06-03T00:04:54.228 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.216+0000 7f0962415740 1 -- 172.21.15.49:0/3495142892 shutdown_connections 2024-06-03T00:04:54.228 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.216+0000 7f0962415740 1 --2- 172.21.15.49:0/3495142892 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55f395b2ca00 0x55f395b2ee30 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:54.228 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.216+0000 7f0962415740 1 --2- 172.21.15.49:0/3495142892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f395b1cb70 0x55f395b28510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:54.228 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.216+0000 7f0962415740 1 --2- 172.21.15.49:0/3495142892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f395b17a00 0x55f395b21540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:54.228 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.216+0000 7f0940ff9640 0 client.16359 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:04:54.228 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.216+0000 7f0962415740 1 --2- 172.21.15.49:0/3495142892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f395b17010 0x55f395b21000 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:54.228 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.216+0000 7f0962415740 1 -- 172.21.15.49:0/3495142892 >> 172.21.15.49:0/3495142892 conn(0x55f395b12680 msgr2=0x55f395b117e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:54.228 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.216+0000 7f0962415740 1 -- 172.21.15.49:0/3495142892 shutdown_connections 2024-06-03T00:04:54.228 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.216+0000 7f0962415740 1 -- 172.21.15.49:0/3495142892 wait complete. 2024-06-03T00:04:54.229 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.216+0000 7f0962415740 20 client.16359 trim_cache size 0 max 16384 2024-06-03T00:04:54.238 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.233+0000 7f0962415740 1 Processor -- start 2024-06-03T00:04:54.238 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.233+0000 7f0962415740 1 -- start start 2024-06-03T00:04:54.238 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.233+0000 7f0962415740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f395b12680 0x55f395b15590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:54.238 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.233+0000 7f0962415740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f395b17010 0x55f395b284a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:54.238 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.233+0000 7f0962415740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f395b17a00 0x55f395b15ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:54.238 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.233+0000 7f0962415740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f09581ab0b0 con 0x55f395b12680 2024-06-03T00:04:54.238 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.233+0000 7f0962415740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f09581ace00 con 0x55f395b17a00 2024-06-03T00:04:54.238 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.233+0000 7f0962415740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f09581ab7e0 con 0x55f395b17010 2024-06-03T00:04:54.239 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.233+0000 7f095d4a5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f395b12680 0x55f395b15590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:54.239 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.233+0000 7f095d4a5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f395b12680 0x55f395b15590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53796/0 (socket says 172.21.15.49:53796) 2024-06-03T00:04:54.239 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.233+0000 7f095d4a5640 1 -- 172.21.15.49:0/1633213407 learned_addr learned my addr 172.21.15.49:0/1633213407 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:54.239 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.233+0000 7f095cca4640 1 --2- 172.21.15.49:0/1633213407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f395b17010 0x55f395b284a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:54.239 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.233+0000 7f095dca6640 1 --2- 172.21.15.49:0/1633213407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f395b17a00 0x55f395b15ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:54.239 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.233+0000 7f095d4a5640 1 -- 172.21.15.49:0/1633213407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f395b17010 msgr2=0x55f395b284a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:54.239 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.233+0000 7f095d4a5640 1 --2- 172.21.15.49:0/1633213407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f395b17010 0x55f395b284a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:54.239 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.233+0000 7f095d4a5640 1 -- 172.21.15.49:0/1633213407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f395b17a00 msgr2=0x55f395b15ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:54.240 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.233+0000 7f095d4a5640 1 --2- 172.21.15.49:0/1633213407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f395b17a00 0x55f395b15ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:54.240 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.233+0000 7f095d4a5640 1 -- 172.21.15.49:0/1633213407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f395b124b0 con 0x55f395b12680 2024-06-03T00:04:54.240 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.233+0000 7f095d4a5640 1 --2- 172.21.15.49:0/1633213407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f395b12680 0x55f395b15590 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f0954009a20 tx=0x7f09540ed150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59868e42bbb2cacc server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:54.240 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.233+0000 7f0942ffd640 1 -- 172.21.15.49:0/1633213407 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0954049070 con 0x55f395b12680 2024-06-03T00:04:54.240 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.234+0000 7f0942ffd640 1 -- 172.21.15.49:0/1633213407 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f095403bdb0 con 0x55f395b12680 2024-06-03T00:04:54.240 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.234+0000 7f0942ffd640 1 -- 172.21.15.49:0/1633213407 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09540c4aa0 con 0x55f395b12680 2024-06-03T00:04:54.240 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.234+0000 7f0962415740 1 -- 172.21.15.49:0/1633213407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f395b12680 msgr2=0x55f395b15590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:54.240 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.234+0000 7f0962415740 1 --2- 172.21.15.49:0/1633213407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f395b12680 0x55f395b15590 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f0954009a20 tx=0x7f09540ed150 comp rx=0 tx=0).stop 2024-06-03T00:04:54.240 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.234+0000 7f0962415740 1 -- 172.21.15.49:0/1633213407 shutdown_connections 2024-06-03T00:04:54.241 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.234+0000 7f0962415740 1 --2- 172.21.15.49:0/1633213407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f395b17a00 0x55f395b15ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:54.241 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.234+0000 7f0962415740 1 --2- 172.21.15.49:0/1633213407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f395b17010 0x55f395b284a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:54.241 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.234+0000 7f0962415740 1 --2- 172.21.15.49:0/1633213407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f395b12680 0x55f395b15590 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:54.241 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.234+0000 7f0962415740 1 -- 172.21.15.49:0/1633213407 >> 172.21.15.49:0/1633213407 conn(0x55f395b1c640 msgr2=0x55f395b12a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:54.241 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.234+0000 7f0962415740 1 -- 172.21.15.49:0/1633213407 shutdown_connections 2024-06-03T00:04:54.241 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.234+0000 7f0962415740 1 -- 172.21.15.49:0/1633213407 wait complete. 2024-06-03T00:04:54.241 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.234+0000 7f0962415740 1 -- start start 2024-06-03T00:04:54.241 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.235+0000 7f0962415740 1 Processor -- start 2024-06-03T00:04:54.241 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.235+0000 7f0962415740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f395b12680 0x55f395b25260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:54.241 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.235+0000 7f0962415740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f395b17010 0x55f395b257a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:54.242 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.235+0000 7f0962415740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f395b17a00 0x55f395b956c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:54.242 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.235+0000 7f0962415740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f09581ac670 con 0x55f395b17a00 2024-06-03T00:04:54.242 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.235+0000 7f0962415740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f09581abf10 con 0x55f395b12680 2024-06-03T00:04:54.242 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.235+0000 7f0962415740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f09581a9070 con 0x55f395b17010 2024-06-03T00:04:54.242 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.235+0000 7f0962415740 10 client.0 _ll_register_callbacks cb 0x7f09540dc020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:04:54.242 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.235+0000 7f095cca4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f395b17010 0x55f395b257a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:54.242 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.235+0000 7f095dca6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f395b17a00 0x55f395b956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:54.242 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.235+0000 7f095cca4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f395b17010 0x55f395b257a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:39616/0 (socket says 172.21.15.49:39616) 2024-06-03T00:04:54.242 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.235+0000 7f095cca4640 1 -- 172.21.15.49:0/3769485215 learned_addr learned my addr 172.21.15.49:0/3769485215 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:04:54.243 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.235+0000 7f095d4a5640 1 --2- 172.21.15.49:0/3769485215 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f395b12680 0x55f395b25260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:54.243 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.235+0000 7f095dca6640 1 -- 172.21.15.49:0/3769485215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f395b17010 msgr2=0x55f395b257a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:54.243 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.235+0000 7f095dca6640 1 --2- 172.21.15.49:0/3769485215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f395b17010 0x55f395b257a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:54.243 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.235+0000 7f095dca6640 1 -- 172.21.15.49:0/3769485215 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f395b12680 msgr2=0x55f395b25260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:04:54.243 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.235+0000 7f095dca6640 1 --2- 172.21.15.49:0/3769485215 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f395b12680 0x55f395b25260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:54.243 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.235+0000 7f095dca6640 1 -- 172.21.15.49:0/3769485215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f395b95c00 con 0x55f395b17a00 2024-06-03T00:04:54.243 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.235+0000 7f095cca4640 1 --2- 172.21.15.49:0/3769485215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f395b17010 0x55f395b257a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:04:54.243 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.236+0000 7f095dca6640 1 --2- 172.21.15.49:0/3769485215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f395b17a00 0x55f395b956c0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f0950005fd0 tx=0x7f0950004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c366758fe9cc951 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:04:54.243 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.236+0000 7f0940ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:04:54.244 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.236+0000 7f0940ff9640 1 -- 172.21.15.49:0/3769485215 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095002d060 con 0x55f395b17a00 2024-06-03T00:04:54.244 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.236+0000 7f0940ff9640 1 -- 172.21.15.49:0/3769485215 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f0950004800 con 0x55f395b17a00 2024-06-03T00:04:54.244 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.236+0000 7f0962415740 1 -- 172.21.15.49:0/3769485215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f095403bdb0 con 0x55f395b17a00 2024-06-03T00:04:54.244 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.236+0000 7f0940ff9640 1 -- 172.21.15.49:0/3769485215 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f095000f6f0 con 0x55f395b17a00 2024-06-03T00:04:54.244 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.236+0000 7f0962415740 10 client.16365 fetch_fsmap learned FSMap version 38 2024-06-03T00:04:54.244 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.236+0000 7f0962415740 1 -- 172.21.15.49:0/3769485215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55f395b96e60 con 0x55f395b17a00 2024-06-03T00:04:54.244 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.236+0000 7f0940ff9640 1 -- 172.21.15.49:0/3769485215 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f095403bdb0 con 0x55f395b17a00 2024-06-03T00:04:54.244 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.236+0000 7f0940ff9640 1 -- 172.21.15.49:0/3769485215 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 38) ==== 8406+0+0 (secure 0 0 0) 0x7f0950032070 con 0x55f395b17a00 2024-06-03T00:04:54.244 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.236+0000 7f0962415740 10 client.16365 fetch_fsmap finished waiting for FSMap version 38 2024-06-03T00:04:54.244 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.236+0000 7f0962415740 10 client.16365 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:04:54.244 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.236+0000 7f0962415740 20 client.16365 populate_metadata read hostname 'smithi049' 2024-06-03T00:04:54.244 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.236+0000 7f0962415740 1 --2- 172.21.15.49:0/3769485215 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55f395b1cb70 0x55f395b99970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:04:54.245 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.236+0000 7f0962415740 4 client.16365 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-03T00:04:54.245 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.236+0000 7f0962415740 1 -- 172.21.15.49:0/3769485215 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f395a87c20 con 0x55f395b1cb70 2024-06-03T00:04:54.245 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.237+0000 7f095d4a5640 1 --2- 172.21.15.49:0/3769485215 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55f395b1cb70 0x55f395b99970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:04:54.245 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.237+0000 7f0940ff9640 10 client.16365 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:04:54.245 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.237+0000 7f095d4a5640 1 --2- 172.21.15.49:0/3769485215 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55f395b1cb70 0x55f395b99970 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb7e22553e0a7aba server_cookie=f3b5044e938b364f in_seq=0 out_seq=0 2024-06-03T00:04:54.246 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.243+0000 7f0940ff9640 1 -- 172.21.15.49:0/3769485215 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55f395a87c20 con 0x55f395b1cb70 2024-06-03T00:04:54.246 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.243+0000 7f0940ff9640 10 client.16365 handle_command_reply: tid=0 2024-06-03T00:04:54.246 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.243+0000 7f0962415740 1 client.16365 shutdown 2024-06-03T00:04:54.246 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.243+0000 7f0962415740 1 -- 172.21.15.49:0/3769485215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f395b17a00 msgr2=0x55f395b956c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:54.246 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.243+0000 7f0962415740 1 --2- 172.21.15.49:0/3769485215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f395b17a00 0x55f395b956c0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f0950005fd0 tx=0x7f0950004a40 comp rx=0 tx=0).stop 2024-06-03T00:04:54.247 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.243+0000 7f0962415740 1 -- 172.21.15.49:0/3769485215 shutdown_connections 2024-06-03T00:04:54.247 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.243+0000 7f0962415740 1 --2- 172.21.15.49:0/3769485215 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55f395b1cb70 0x55f395b99970 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:54.247 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.243+0000 7f0962415740 1 --2- 172.21.15.49:0/3769485215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f395b17a00 0x55f395b956c0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:54.247 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.243+0000 7f0962415740 1 --2- 172.21.15.49:0/3769485215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f395b17010 0x55f395b257a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:54.247 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.243+0000 7f0940ff9640 0 client.16365 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:04:54.247 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.243+0000 7f0962415740 1 --2- 172.21.15.49:0/3769485215 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f395b12680 0x55f395b25260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:54.247 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.243+0000 7f0962415740 1 -- 172.21.15.49:0/3769485215 >> 172.21.15.49:0/3769485215 conn(0x55f395b1c640 msgr2=0x55f395b1bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:54.247 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.243+0000 7f0962415740 1 -- 172.21.15.49:0/3769485215 shutdown_connections 2024-06-03T00:04:54.247 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.243+0000 7f0962415740 1 -- 172.21.15.49:0/3769485215 wait complete. 2024-06-03T00:04:54.247 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.244+0000 7f0962415740 20 client.16365 trim_cache size 0 max 16384 2024-06-03T00:04:54.248 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-06-03T00:04:54.248 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-06-03T00:04:54.248 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-06-03T00:04:54.249 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.244+0000 7f095f709640 1 -- 172.21.15.49:0/3641596283 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f09440a2c30 msgr2=0x7f09440a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:54.249 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.244+0000 7f095f709640 1 --2- 172.21.15.49:0/3641596283 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f09440a2c30 0x7f09440a50f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x55f395b18260 tx=0x7f0950009500 comp rx=0 tx=0).stop 2024-06-03T00:04:54.249 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.244+0000 7f095f709640 1 -- 172.21.15.49:0/3641596283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0958102500 msgr2=0x7f0958101e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:04:54.249 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.244+0000 7f095f709640 1 --2- 172.21.15.49:0/3641596283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0958102500 0x7f0958101e70 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f0954009230 tx=0x7f0954031b60 comp rx=0 tx=0).stop 2024-06-03T00:04:54.249 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.244+0000 7f095f709640 1 -- 172.21.15.49:0/3641596283 shutdown_connections 2024-06-03T00:04:54.249 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.244+0000 7f095f709640 1 --2- 172.21.15.49:0/3641596283 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f09440a2c30 0x7f09440a50f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:54.249 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.244+0000 7f095f709640 1 --2- 172.21.15.49:0/3641596283 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0958104e30 0x7f09581004b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:54.249 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.244+0000 7f095f709640 1 --2- 172.21.15.49:0/3641596283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0958107760 0x7f09581009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:54.249 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.244+0000 7f095f709640 1 --2- 172.21.15.49:0/3641596283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0958102500 0x7f0958101e70 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:04:54.249 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.244+0000 7f095f709640 1 -- 172.21.15.49:0/3641596283 >> 172.21.15.49:0/3641596283 conn(0x7f09580fbeb0 msgr2=0x7f0958102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:04:54.249 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.244+0000 7f095f709640 1 -- 172.21.15.49:0/3641596283 shutdown_connections 2024-06-03T00:04:54.249 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:04:54.244+0000 7f095f709640 1 -- 172.21.15.49:0/3641596283 wait complete. 2024-06-03T00:04:55.199 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:54 smithi057 ceph-mon[36457]: pgmap v529: 97 pgs: 97 active+clean; 102 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-06-03T00:04:55.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:54 smithi049 ceph-mon[32302]: pgmap v529: 97 pgs: 97 active+clean; 102 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-06-03T00:04:55.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:54 smithi107 ceph-mon[37048]: pgmap v529: 97 pgs: 97 active+clean; 102 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-06-03T00:04:57.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:56 smithi057 ceph-mon[36457]: pgmap v530: 97 pgs: 97 active+clean; 103 MiB data, 1014 MiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 24 op/s 2024-06-03T00:04:57.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:56 smithi049 ceph-mon[32302]: pgmap v530: 97 pgs: 97 active+clean; 103 MiB data, 1014 MiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 24 op/s 2024-06-03T00:04:57.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:56 smithi107 ceph-mon[37048]: pgmap v530: 97 pgs: 97 active+clean; 103 MiB data, 1014 MiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 24 op/s 2024-06-03T00:04:59.199 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:04:58 smithi057 ceph-mon[36457]: pgmap v531: 97 pgs: 97 active+clean; 103 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 28 op/s 2024-06-03T00:04:59.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:04:58 smithi049 ceph-mon[32302]: pgmap v531: 97 pgs: 97 active+clean; 103 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 28 op/s 2024-06-03T00:04:59.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:04:58 smithi107 ceph-mon[37048]: pgmap v531: 97 pgs: 97 active+clean; 103 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 28 op/s 2024-06-03T00:05:01.199 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:00 smithi057 ceph-mon[36457]: pgmap v532: 97 pgs: 97 active+clean; 101 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 632 KiB/s wr, 141 op/s 2024-06-03T00:05:01.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:00 smithi049 ceph-mon[32302]: pgmap v532: 97 pgs: 97 active+clean; 101 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 632 KiB/s wr, 141 op/s 2024-06-03T00:05:01.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:00 smithi107 ceph-mon[37048]: pgmap v532: 97 pgs: 97 active+clean; 101 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 632 KiB/s wr, 141 op/s 2024-06-03T00:05:03.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:02 smithi057 ceph-mon[36457]: pgmap v533: 97 pgs: 97 active+clean; 100 MiB data, 1006 MiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 642 KiB/s wr, 166 op/s 2024-06-03T00:05:03.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:02 smithi049 ceph-mon[32302]: pgmap v533: 97 pgs: 97 active+clean; 100 MiB data, 1006 MiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 642 KiB/s wr, 166 op/s 2024-06-03T00:05:03.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:02 smithi107 ceph-mon[37048]: pgmap v533: 97 pgs: 97 active+clean; 100 MiB data, 1006 MiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 642 KiB/s wr, 166 op/s 2024-06-03T00:05:05.199 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:04 smithi057 ceph-mon[36457]: pgmap v534: 97 pgs: 97 active+clean; 99 MiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 643 KiB/s wr, 212 op/s 2024-06-03T00:05:05.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:04 smithi049 ceph-mon[32302]: pgmap v534: 97 pgs: 97 active+clean; 99 MiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 643 KiB/s wr, 212 op/s 2024-06-03T00:05:05.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:04 smithi107 ceph-mon[37048]: pgmap v534: 97 pgs: 97 active+clean; 99 MiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 643 KiB/s wr, 212 op/s 2024-06-03T00:05:07.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:06 smithi049 ceph-mon[32302]: pgmap v535: 97 pgs: 97 active+clean; 102 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 313 op/s 2024-06-03T00:05:07.342 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.339+0000 7f3892c15640 1 -- 172.21.15.49:0/3877098423 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f388c100900 msgr2=0x7f388c100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:07.342 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.339+0000 7f3892c15640 1 --2- 172.21.15.49:0/3877098423 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f388c100900 0x7f388c100d20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3880009900 tx=0x7f388002a410 comp rx=0 tx=0).stop 2024-06-03T00:05:07.342 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.339+0000 7f3892c15640 1 -- 172.21.15.49:0/3877098423 shutdown_connections 2024-06-03T00:05:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.339+0000 7f3892c15640 1 --2- 172.21.15.49:0/3877098423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f388c1024b0 0x7f388c108d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.339+0000 7f3892c15640 1 --2- 172.21.15.49:0/3877098423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f388c101af0 0x7f388c101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.339+0000 7f3892c15640 1 --2- 172.21.15.49:0/3877098423 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f388c100900 0x7f388c100d20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.339+0000 7f3892c15640 1 -- 172.21.15.49:0/3877098423 >> 172.21.15.49:0/3877098423 conn(0x7f388c0fbe70 msgr2=0x7f388c0fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:05:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.339+0000 7f3892c15640 1 -- 172.21.15.49:0/3877098423 shutdown_connections 2024-06-03T00:05:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.339+0000 7f3892c15640 1 -- 172.21.15.49:0/3877098423 wait complete. 2024-06-03T00:05:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.340+0000 7f3892c15640 1 Processor -- start 2024-06-03T00:05:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.340+0000 7f3892c15640 1 -- start start 2024-06-03T00:05:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.340+0000 7f3892c15640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f388c100900 0x7f388c197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.340+0000 7f3892c15640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f388c101af0 0x7f388c198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.340+0000 7f3892c15640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f388c1024b0 0x7f388c19f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.340+0000 7f3892c15640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f388c10c5a0 con 0x7f388c100900 2024-06-03T00:05:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.340+0000 7f3892c15640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f388c10c420 con 0x7f388c1024b0 2024-06-03T00:05:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.340+0000 7f3892c15640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f388c10c720 con 0x7f388c101af0 2024-06-03T00:05:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.340+0000 7f38909b1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f388c100900 0x7f388c197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.340+0000 7f388bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f388c101af0 0x7f388c198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.340+0000 7f38909b1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f388c100900 0x7f388c197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57038/0 (socket says 172.21.15.49:57038) 2024-06-03T00:05:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.340+0000 7f388bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f388c101af0 0x7f388c198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:52028/0 (socket says 172.21.15.49:52028) 2024-06-03T00:05:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.340+0000 7f38909b1640 1 -- 172.21.15.49:0/1248889692 learned_addr learned my addr 172.21.15.49:0/1248889692 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:05:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.340+0000 7f38911b2640 1 --2- 172.21.15.49:0/1248889692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f388c1024b0 0x7f388c19f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.341+0000 7f388bfff640 1 -- 172.21.15.49:0/1248889692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f388c1024b0 msgr2=0x7f388c19f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.341+0000 7f388bfff640 1 --2- 172.21.15.49:0/1248889692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f388c1024b0 0x7f388c19f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.341+0000 7f388bfff640 1 -- 172.21.15.49:0/1248889692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f388c100900 msgr2=0x7f388c197cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.341+0000 7f388bfff640 1 --2- 172.21.15.49:0/1248889692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f388c100900 0x7f388c197cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.341+0000 7f388bfff640 1 -- 172.21.15.49:0/1248889692 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f388c19f900 con 0x7f388c101af0 2024-06-03T00:05:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.341+0000 7f38909b1640 1 --2- 172.21.15.49:0/1248889692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f388c100900 0x7f388c197cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:05:07.345 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.341+0000 7f388bfff640 1 --2- 172.21.15.49:0/1248889692 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f388c101af0 0x7f388c198230 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f387800e9f0 tx=0x7f387800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:05:07.345 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.341+0000 7f3889ffb640 1 -- 172.21.15.49:0/1248889692 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387800ccc0 con 0x7f388c101af0 2024-06-03T00:05:07.345 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.341+0000 7f3892c15640 1 -- 172.21.15.49:0/1248889692 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f388c19fbf0 con 0x7f388c101af0 2024-06-03T00:05:07.345 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.341+0000 7f3889ffb640 1 -- 172.21.15.49:0/1248889692 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3878010910 con 0x7f388c101af0 2024-06-03T00:05:07.345 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.341+0000 7f3889ffb640 1 -- 172.21.15.49:0/1248889692 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3878018960 con 0x7f388c101af0 2024-06-03T00:05:07.345 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.341+0000 7f3892c15640 1 -- 172.21.15.49:0/1248889692 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f388c1a0190 con 0x7f388c101af0 2024-06-03T00:05:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.344+0000 7f3889ffb640 1 -- 172.21.15.49:0/1248889692 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3878010ac0 con 0x7f388c101af0 2024-06-03T00:05:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.344+0000 7f38959ff740 1 Processor -- start 2024-06-03T00:05:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.344+0000 7f38959ff740 1 -- start start 2024-06-03T00:05:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.344+0000 7f38959ff740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56458bbbd010 0x56458bbbd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.344+0000 7f38959ff740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56458bbbda00 0x56458bbc2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.344+0000 7f38959ff740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56458bbc2b70 0x56458bbc5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:07.352 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.344+0000 7f38959ff740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56458bb204f0 con 0x56458bbc2b70 2024-06-03T00:05:07.352 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.344+0000 7f38959ff740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x56458babe870 con 0x56458bbbda00 2024-06-03T00:05:07.352 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.344+0000 7f38959ff740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56458bb1c4b0 con 0x56458bbbd010 2024-06-03T00:05:07.352 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.344+0000 7f388bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56458bbc2b70 0x56458bbc5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:07.352 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.344+0000 7f38911b2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56458bbbd010 0x56458bbbd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:07.352 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.344+0000 7f38909b1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56458bbbda00 0x56458bbc2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:07.352 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.344+0000 7f38911b2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56458bbbd010 0x56458bbbd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:52030/0 (socket says 172.21.15.49:52030) 2024-06-03T00:05:07.352 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.344+0000 7f38911b2640 1 -- 172.21.15.49:0/1164520328 learned_addr learned my addr 172.21.15.49:0/1164520328 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:05:07.352 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.344+0000 7f38911b2640 1 -- 172.21.15.49:0/1164520328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56458bbbda00 msgr2=0x56458bbc2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:05:07.352 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.344+0000 7f38911b2640 1 --2- 172.21.15.49:0/1164520328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56458bbbda00 0x56458bbc2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.352 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.344+0000 7f38911b2640 1 -- 172.21.15.49:0/1164520328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56458bbc2b70 msgr2=0x56458bbc5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:05:07.352 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.344+0000 7f38911b2640 1 --2- 172.21.15.49:0/1164520328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56458bbc2b70 0x56458bbc5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.352 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.344+0000 7f38911b2640 1 -- 172.21.15.49:0/1164520328 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56458bada9b0 con 0x56458bbbd010 2024-06-03T00:05:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.345+0000 7f3889ffb640 1 --2- 172.21.15.49:0/1248889692 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f387c0a2c30 0x7f387c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.345+0000 7f38911b2640 1 --2- 172.21.15.49:0/1164520328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56458bbbd010 0x56458bbbd430 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3884009fd0 tx=0x7f38840118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86aecd8361b3c68f server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:05:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.345+0000 7f38909b1640 1 --2- 172.21.15.49:0/1248889692 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f387c0a2c30 0x7f387c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.345+0000 7f3889ffb640 1 -- 172.21.15.49:0/1248889692 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f38780cf460 con 0x7f388c101af0 2024-06-03T00:05:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.345+0000 7f3876ffd640 1 -- 172.21.15.49:0/1164520328 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3884004d20 con 0x56458bbbd010 2024-06-03T00:05:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.345+0000 7f3876ffd640 1 -- 172.21.15.49:0/1164520328 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3884004050 con 0x56458bbbd010 2024-06-03T00:05:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.345+0000 7f3876ffd640 1 -- 172.21.15.49:0/1164520328 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3884005220 con 0x56458bbbd010 2024-06-03T00:05:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.345+0000 7f38909b1640 1 --2- 172.21.15.49:0/1248889692 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f387c0a2c30 0x7f387c0a50f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3880006010 tx=0x7f38800315b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:05:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.345+0000 7f38959ff740 1 -- 172.21.15.49:0/1164520328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56458bbbd010 msgr2=0x56458bbbd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.345+0000 7f38959ff740 1 --2- 172.21.15.49:0/1164520328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56458bbbd010 0x56458bbbd430 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3884009fd0 tx=0x7f38840118d0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.346+0000 7f38959ff740 1 -- 172.21.15.49:0/1164520328 shutdown_connections 2024-06-03T00:05:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.346+0000 7f38959ff740 1 --2- 172.21.15.49:0/1164520328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56458bbbda00 0x56458bbc2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.346+0000 7f38959ff740 1 --2- 172.21.15.49:0/1164520328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56458bbc2b70 0x56458bbc5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.346+0000 7f38959ff740 1 --2- 172.21.15.49:0/1164520328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56458bbbd010 0x56458bbbd430 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.346+0000 7f38959ff740 1 -- 172.21.15.49:0/1164520328 >> 172.21.15.49:0/1164520328 conn(0x56458bbb8680 msgr2=0x56458bbb8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:05:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.346+0000 7f38959ff740 1 -- 172.21.15.49:0/1164520328 shutdown_connections 2024-06-03T00:05:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.346+0000 7f38959ff740 1 -- 172.21.15.49:0/1164520328 wait complete. 2024-06-03T00:05:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.346+0000 7f38959ff740 1 -- start start 2024-06-03T00:05:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.346+0000 7f38959ff740 1 Processor -- start 2024-06-03T00:05:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.346+0000 7f38959ff740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56458bbbd010 0x56458bbc7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.346+0000 7f38959ff740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56458bbbda00 0x56458bbc77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.346+0000 7f38959ff740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56458bbc2b70 0x56458bbce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.346+0000 7f38959ff740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56458bbc5b20 con 0x56458bbbda00 2024-06-03T00:05:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.346+0000 7f38959ff740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x56458baa9ae0 con 0x56458bbc2b70 2024-06-03T00:05:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.346+0000 7f38959ff740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56458bbc5ca0 con 0x56458bbbd010 2024-06-03T00:05:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.346+0000 7f38959ff740 10 client.0 _ll_register_callbacks cb 0x56458bae29b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:05:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.347+0000 7f38909b1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56458bbbd010 0x56458bbc7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.347+0000 7f388bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56458bbbda00 0x56458bbc77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.347+0000 7f38909b1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56458bbbd010 0x56458bbc7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.49:52036/0 (socket says 172.21.15.49:52036) 2024-06-03T00:05:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.347+0000 7f38909b1640 1 -- 172.21.15.49:0/2378281965 learned_addr learned my addr 172.21.15.49:0/2378281965 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:05:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.347+0000 7f38911b2640 1 --2- 172.21.15.49:0/2378281965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56458bbc2b70 0x56458bbce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.347+0000 7f38909b1640 1 -- 172.21.15.49:0/2378281965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56458bbc2b70 msgr2=0x56458bbce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:05:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.347+0000 7f38909b1640 1 --2- 172.21.15.49:0/2378281965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56458bbc2b70 0x56458bbce800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.347+0000 7f38909b1640 1 -- 172.21.15.49:0/2378281965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56458bbbda00 msgr2=0x56458bbc77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:05:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.347+0000 7f38909b1640 1 --2- 172.21.15.49:0/2378281965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56458bbbda00 0x56458bbc77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.347+0000 7f38909b1640 1 -- 172.21.15.49:0/2378281965 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56458b834210 con 0x56458bbbd010 2024-06-03T00:05:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.347+0000 7f388bfff640 1 --2- 172.21.15.49:0/2378281965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56458bbbda00 0x56458bbc77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:05:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.347+0000 7f38909b1640 1 --2- 172.21.15.49:0/2378281965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56458bbbd010 0x56458bbc7280 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f388002a930 tx=0x7f3880009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c96da914573b7ae2 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:05:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.347+0000 7f386bfff640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-06-03T00:05:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.347+0000 7f386bfff640 1 -- 172.21.15.49:0/2378281965 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3880035040 con 0x56458bbbd010 2024-06-03T00:05:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.347+0000 7f386bfff640 1 -- 172.21.15.49:0/2378281965 <== mon.1 v2:172.21.15.107:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f3880003a00 con 0x56458bbbd010 2024-06-03T00:05:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.347+0000 7f38959ff740 1 -- 172.21.15.49:0/2378281965 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3884004050 con 0x56458bbbd010 2024-06-03T00:05:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.347+0000 7f386bfff640 1 -- 172.21.15.49:0/2378281965 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f3880003c00 con 0x56458bbbd010 2024-06-03T00:05:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.347+0000 7f38959ff740 10 client.25951 fetch_fsmap learned FSMap version 38 2024-06-03T00:05:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.347+0000 7f38959ff740 1 -- 172.21.15.49:0/2378281965 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x56458b900620 con 0x56458bbbd010 2024-06-03T00:05:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.348+0000 7f386bfff640 1 -- 172.21.15.49:0/2378281965 <== mon.1 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3884004050 con 0x56458bbbd010 2024-06-03T00:05:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.348+0000 7f386bfff640 1 -- 172.21.15.49:0/2378281965 <== mon.1 v2:172.21.15.107:3300/0 5 ==== fsmap(e 38) ==== 8406+0+0 (secure 0 0 0) 0x7f3880044030 con 0x56458bbbd010 2024-06-03T00:05:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.348+0000 7f38959ff740 10 client.25951 fetch_fsmap finished waiting for FSMap version 38 2024-06-03T00:05:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.348+0000 7f38959ff740 10 client.25951 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:05:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.348+0000 7f38959ff740 20 client.25951 populate_metadata read hostname 'smithi049' 2024-06-03T00:05:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.348+0000 7f38959ff740 1 --2- 172.21.15.49:0/2378281965 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x56458bbd31a0 0x56458bbd5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.348+0000 7f38959ff740 4 client.25951 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:05:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.348+0000 7f38959ff740 1 -- 172.21.15.49:0/2378281965 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56458bb33f10 con 0x56458bbd31a0 2024-06-03T00:05:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.348+0000 7f388bfff640 1 --2- 172.21.15.49:0/2378281965 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x56458bbd31a0 0x56458bbd5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.348+0000 7f386bfff640 10 client.25951 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:05:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.349+0000 7f388bfff640 1 --2- 172.21.15.49:0/2378281965 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x56458bbd31a0 0x56458bbd5620 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d256496f7488b0f9 server_cookie=c38a9452eff87069 in_seq=0 out_seq=0 2024-06-03T00:05:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.350+0000 7f386bfff640 1 -- 172.21.15.49:0/2378281965 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x56458bb33f10 con 0x56458bbd31a0 2024-06-03T00:05:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.350+0000 7f386bfff640 10 client.25951 handle_command_reply: tid=0 2024-06-03T00:05:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.350+0000 7f38959ff740 1 client.25951 shutdown 2024-06-03T00:05:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.350+0000 7f38959ff740 1 -- 172.21.15.49:0/2378281965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56458bbbd010 msgr2=0x56458bbc7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.350+0000 7f38959ff740 1 --2- 172.21.15.49:0/2378281965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56458bbbd010 0x56458bbc7280 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f388002a930 tx=0x7f3880009260 comp rx=0 tx=0).stop 2024-06-03T00:05:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.350+0000 7f38959ff740 1 -- 172.21.15.49:0/2378281965 shutdown_connections 2024-06-03T00:05:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.350+0000 7f38959ff740 1 --2- 172.21.15.49:0/2378281965 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x56458bbd31a0 0x56458bbd5620 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.350+0000 7f38959ff740 1 --2- 172.21.15.49:0/2378281965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56458bbc2b70 0x56458bbce800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.350+0000 7f386bfff640 0 client.25951 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:05:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.350+0000 7f38959ff740 1 --2- 172.21.15.49:0/2378281965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56458bbbda00 0x56458bbc77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.350+0000 7f38959ff740 1 --2- 172.21.15.49:0/2378281965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56458bbbd010 0x56458bbc7280 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.350+0000 7f38959ff740 1 -- 172.21.15.49:0/2378281965 >> 172.21.15.49:0/2378281965 conn(0x56458bbb8680 msgr2=0x56458bbb77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:05:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.350+0000 7f38959ff740 1 -- 172.21.15.49:0/2378281965 shutdown_connections 2024-06-03T00:05:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.350+0000 7f38959ff740 1 -- 172.21.15.49:0/2378281965 wait complete. 2024-06-03T00:05:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.350+0000 7f38959ff740 20 client.25951 trim_cache size 0 max 16384 2024-06-03T00:05:07.358 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:06 smithi107 ceph-mon[37048]: pgmap v535: 97 pgs: 97 active+clean; 102 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 313 op/s 2024-06-03T00:05:07.367 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.366+0000 7f38959ff740 1 Processor -- start 2024-06-03T00:05:07.367 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.366+0000 7f38959ff740 1 -- start start 2024-06-03T00:05:07.368 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.366+0000 7f38959ff740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56458bbbd010 0x56458bbc6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:07.368 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.366+0000 7f38959ff740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56458bbbda00 0x56458bbce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:07.368 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.366+0000 7f38959ff740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56458bbc2b70 0x56458bbc6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:07.368 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.366+0000 7f38959ff740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f388c1a8e50 con 0x56458bbbda00 2024-06-03T00:05:07.368 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.366+0000 7f38959ff740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f388c1aaba0 con 0x56458bbc2b70 2024-06-03T00:05:07.368 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.366+0000 7f38959ff740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f388c1a9580 con 0x56458bbbd010 2024-06-03T00:05:07.368 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.366+0000 7f388bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56458bbbda00 0x56458bbce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:07.368 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.366+0000 7f388bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56458bbbda00 0x56458bbce7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57068/0 (socket says 172.21.15.49:57068) 2024-06-03T00:05:07.368 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.366+0000 7f388bfff640 1 -- 172.21.15.49:0/2507500204 learned_addr learned my addr 172.21.15.49:0/2507500204 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:05:07.368 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.366+0000 7f38909b1640 1 --2- 172.21.15.49:0/2507500204 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56458bbbd010 0x56458bbc6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:07.368 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.366+0000 7f38911b2640 1 --2- 172.21.15.49:0/2507500204 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56458bbc2b70 0x56458bbc6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:07.368 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.366+0000 7f388bfff640 1 -- 172.21.15.49:0/2507500204 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56458bbbd010 msgr2=0x56458bbc6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:05:07.368 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.366+0000 7f388bfff640 1 --2- 172.21.15.49:0/2507500204 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56458bbbd010 0x56458bbc6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.369 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.366+0000 7f388bfff640 1 -- 172.21.15.49:0/2507500204 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56458bbc2b70 msgr2=0x56458bbc6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:05:07.369 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.366+0000 7f388bfff640 1 --2- 172.21.15.49:0/2507500204 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56458bbc2b70 0x56458bbc6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.369 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.366+0000 7f388bfff640 1 -- 172.21.15.49:0/2507500204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56458bbbf4e0 con 0x56458bbbda00 2024-06-03T00:05:07.369 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.366+0000 7f388bfff640 1 --2- 172.21.15.49:0/2507500204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56458bbbda00 0x56458bbce7c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f3878010f50 tx=0x7f38780d1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2bfbb9d48719f2a server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:05:07.369 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.367+0000 7f38767fc640 1 -- 172.21.15.49:0/2507500204 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387809b8b0 con 0x56458bbbda00 2024-06-03T00:05:07.369 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.367+0000 7f38767fc640 1 -- 172.21.15.49:0/2507500204 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f387809bd70 con 0x56458bbbda00 2024-06-03T00:05:07.369 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.367+0000 7f38767fc640 1 -- 172.21.15.49:0/2507500204 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3878099eb0 con 0x56458bbbda00 2024-06-03T00:05:07.372 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.367+0000 7f38959ff740 1 -- 172.21.15.49:0/2507500204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56458bbbda00 msgr2=0x56458bbce7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:07.372 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.367+0000 7f38959ff740 1 --2- 172.21.15.49:0/2507500204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56458bbbda00 0x56458bbce7c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f3878010f50 tx=0x7f38780d1040 comp rx=0 tx=0).stop 2024-06-03T00:05:07.372 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.367+0000 7f38959ff740 1 -- 172.21.15.49:0/2507500204 shutdown_connections 2024-06-03T00:05:07.372 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.367+0000 7f38959ff740 1 --2- 172.21.15.49:0/2507500204 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56458bbc2b70 0x56458bbc6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.372 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.367+0000 7f38959ff740 1 --2- 172.21.15.49:0/2507500204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56458bbbda00 0x56458bbce7c0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.373 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.367+0000 7f38959ff740 1 --2- 172.21.15.49:0/2507500204 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56458bbbd010 0x56458bbc6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.373 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.367+0000 7f38959ff740 1 -- 172.21.15.49:0/2507500204 >> 172.21.15.49:0/2507500204 conn(0x56458bbb8680 msgr2=0x56458bbb8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:05:07.373 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.368+0000 7f38959ff740 1 -- 172.21.15.49:0/2507500204 shutdown_connections 2024-06-03T00:05:07.373 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.368+0000 7f38959ff740 1 -- 172.21.15.49:0/2507500204 wait complete. 2024-06-03T00:05:07.373 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.368+0000 7f38959ff740 1 -- start start 2024-06-03T00:05:07.373 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.368+0000 7f38959ff740 1 Processor -- start 2024-06-03T00:05:07.373 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.368+0000 7f38959ff740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56458bbbd010 0x56458bbcb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:07.373 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.368+0000 7f38959ff740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56458bbbda00 0x56458bbcb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:07.373 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.368+0000 7f38959ff740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56458bbc2b70 0x56458bc3bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:07.373 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.368+0000 7f38959ff740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f388c1aa410 con 0x56458bbbd010 2024-06-03T00:05:07.373 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.368+0000 7f38959ff740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f388c1a9cb0 con 0x56458bbc2b70 2024-06-03T00:05:07.373 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.368+0000 7f38959ff740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f388c1a6e10 con 0x56458bbbda00 2024-06-03T00:05:07.373 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.368+0000 7f38959ff740 10 client.0 _ll_register_callbacks cb 0x7f3880009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:05:07.373 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.368+0000 7f38909b1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56458bbbd010 0x56458bbcb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:07.374 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.368+0000 7f38909b1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56458bbbd010 0x56458bbcb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57082/0 (socket says 172.21.15.49:57082) 2024-06-03T00:05:07.374 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.368+0000 7f38909b1640 1 -- 172.21.15.49:0/554682765 learned_addr learned my addr 172.21.15.49:0/554682765 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:05:07.374 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.368+0000 7f388bfff640 1 --2- 172.21.15.49:0/554682765 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56458bbbda00 0x56458bbcb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:07.374 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.368+0000 7f38911b2640 1 --2- 172.21.15.49:0/554682765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56458bbc2b70 0x56458bc3bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:07.374 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.369+0000 7f388bfff640 1 -- 172.21.15.49:0/554682765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56458bbc2b70 msgr2=0x56458bc3bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:05:07.374 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.369+0000 7f388bfff640 1 --2- 172.21.15.49:0/554682765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56458bbc2b70 0x56458bc3bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.374 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.369+0000 7f388bfff640 1 -- 172.21.15.49:0/554682765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56458bbbd010 msgr2=0x56458bbcb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:05:07.374 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.369+0000 7f388bfff640 1 --2- 172.21.15.49:0/554682765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56458bbbd010 0x56458bbcb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.374 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.369+0000 7f388bfff640 1 -- 172.21.15.49:0/554682765 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56458bbce9a0 con 0x56458bbbda00 2024-06-03T00:05:07.374 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.369+0000 7f38909b1640 1 --2- 172.21.15.49:0/554682765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56458bbbd010 0x56458bbcb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:05:07.374 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.369+0000 7f388bfff640 1 --2- 172.21.15.49:0/554682765 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56458bbbda00 0x56458bbcb920 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f387809ba70 tx=0x7f38780d2f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a8c5649fcb92c46 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:05:07.374 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.369+0000 7f386bfff640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-06-03T00:05:07.374 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.369+0000 7f386bfff640 1 -- 172.21.15.49:0/554682765 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387809b6d0 con 0x56458bbbda00 2024-06-03T00:05:07.375 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.369+0000 7f386bfff640 1 -- 172.21.15.49:0/554682765 <== mon.1 v2:172.21.15.107:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f387809b3c0 con 0x56458bbbda00 2024-06-03T00:05:07.375 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.369+0000 7f38959ff740 1 -- 172.21.15.49:0/554682765 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f387809bd70 con 0x56458bbbda00 2024-06-03T00:05:07.375 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.369+0000 7f386bfff640 1 -- 172.21.15.49:0/554682765 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f3878099eb0 con 0x56458bbbda00 2024-06-03T00:05:07.375 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.369+0000 7f38959ff740 10 client.25957 fetch_fsmap learned FSMap version 38 2024-06-03T00:05:07.375 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.369+0000 7f38959ff740 1 -- 172.21.15.49:0/554682765 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x56458bc3d350 con 0x56458bbbda00 2024-06-03T00:05:07.375 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.370+0000 7f386bfff640 1 -- 172.21.15.49:0/554682765 <== mon.1 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f387809bd70 con 0x56458bbbda00 2024-06-03T00:05:07.375 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.370+0000 7f386bfff640 1 -- 172.21.15.49:0/554682765 <== mon.1 v2:172.21.15.107:3300/0 5 ==== fsmap(e 38) ==== 8406+0+0 (secure 0 0 0) 0x7f3878097a30 con 0x56458bbbda00 2024-06-03T00:05:07.375 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.370+0000 7f38959ff740 10 client.25957 fetch_fsmap finished waiting for FSMap version 38 2024-06-03T00:05:07.375 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.370+0000 7f38959ff740 10 client.25957 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:05:07.375 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.370+0000 7f38959ff740 20 client.25957 populate_metadata read hostname 'smithi049' 2024-06-03T00:05:07.375 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.370+0000 7f38959ff740 1 --2- 172.21.15.49:0/554682765 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x56458bc3de30 0x56458bc40250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:07.375 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.370+0000 7f38959ff740 4 client.25957 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-03T00:05:07.375 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.370+0000 7f38959ff740 1 -- 172.21.15.49:0/554682765 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56458bb2dc20 con 0x56458bc3de30 2024-06-03T00:05:07.375 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.370+0000 7f38909b1640 1 --2- 172.21.15.49:0/554682765 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x56458bc3de30 0x56458bc40250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:07.375 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.370+0000 7f386bfff640 10 client.25957 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:05:07.376 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.370+0000 7f38909b1640 1 --2- 172.21.15.49:0/554682765 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x56458bc3de30 0x56458bc40250 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d52829012aac389 server_cookie=4a6f8f999abc61d2 in_seq=0 out_seq=0 2024-06-03T00:05:07.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:06 smithi057 ceph-mon[36457]: pgmap v535: 97 pgs: 97 active+clean; 102 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 313 op/s 2024-06-03T00:05:07.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.497+0000 7f386bfff640 1 -- 172.21.15.49:0/554682765 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x56458bb2dc20 con 0x56458bc3de30 2024-06-03T00:05:07.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.497+0000 7f386bfff640 10 client.25957 handle_command_reply: tid=0 2024-06-03T00:05:07.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.497+0000 7f38959ff740 1 client.25957 shutdown 2024-06-03T00:05:07.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.498+0000 7f38959ff740 1 -- 172.21.15.49:0/554682765 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56458bbbda00 msgr2=0x56458bbcb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:07.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.498+0000 7f38959ff740 1 --2- 172.21.15.49:0/554682765 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56458bbbda00 0x56458bbcb920 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f387809ba70 tx=0x7f38780d2f60 comp rx=0 tx=0).stop 2024-06-03T00:05:07.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.498+0000 7f38959ff740 1 -- 172.21.15.49:0/554682765 shutdown_connections 2024-06-03T00:05:07.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.498+0000 7f38959ff740 1 --2- 172.21.15.49:0/554682765 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x56458bc3de30 0x56458bc40250 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.500 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.498+0000 7f38959ff740 1 --2- 172.21.15.49:0/554682765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56458bbc2b70 0x56458bc3bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.500 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.498+0000 7f38959ff740 1 --2- 172.21.15.49:0/554682765 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56458bbbda00 0x56458bbcb920 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.500 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.498+0000 7f386bfff640 0 client.25957 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:05:07.500 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.498+0000 7f38959ff740 1 --2- 172.21.15.49:0/554682765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56458bbbd010 0x56458bbcb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.500 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.498+0000 7f38959ff740 1 -- 172.21.15.49:0/554682765 >> 172.21.15.49:0/554682765 conn(0x56458bbb8680 msgr2=0x56458bbc6040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:05:07.500 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.498+0000 7f38959ff740 1 -- 172.21.15.49:0/554682765 shutdown_connections 2024-06-03T00:05:07.500 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.498+0000 7f38959ff740 1 -- 172.21.15.49:0/554682765 wait complete. 2024-06-03T00:05:07.500 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.498+0000 7f38959ff740 20 client.25957 trim_cache size 0 max 16384 2024-06-03T00:05:07.500 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-06-03T00:05:07.500 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-06-03T00:05:07.501 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-06-03T00:05:07.501 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.498+0000 7f3892c15640 1 -- 172.21.15.49:0/1248889692 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f387c0a2c30 msgr2=0x7f387c0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:07.501 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.498+0000 7f3892c15640 1 --2- 172.21.15.49:0/1248889692 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f387c0a2c30 0x7f387c0a50f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3880006010 tx=0x7f38800315b0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.501 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.498+0000 7f3892c15640 1 -- 172.21.15.49:0/1248889692 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f388c101af0 msgr2=0x7f388c198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:07.501 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.498+0000 7f3892c15640 1 --2- 172.21.15.49:0/1248889692 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f388c101af0 0x7f388c198230 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f387800e9f0 tx=0x7f387800eeb0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.502 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.499+0000 7f3892c15640 1 -- 172.21.15.49:0/1248889692 shutdown_connections 2024-06-03T00:05:07.502 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.499+0000 7f3892c15640 1 --2- 172.21.15.49:0/1248889692 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f387c0a2c30 0x7f387c0a50f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.502 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.499+0000 7f3892c15640 1 --2- 172.21.15.49:0/1248889692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f388c1024b0 0x7f388c19f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.502 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.499+0000 7f3892c15640 1 --2- 172.21.15.49:0/1248889692 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f388c101af0 0x7f388c198230 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.502 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.499+0000 7f3892c15640 1 --2- 172.21.15.49:0/1248889692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f388c100900 0x7f388c197cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:07.502 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.499+0000 7f3892c15640 1 -- 172.21.15.49:0/1248889692 >> 172.21.15.49:0/1248889692 conn(0x7f388c0fbe70 msgr2=0x7f388c0fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:05:07.502 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.499+0000 7f3892c15640 1 -- 172.21.15.49:0/1248889692 shutdown_connections 2024-06-03T00:05:07.502 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:07.499+0000 7f3892c15640 1 -- 172.21.15.49:0/1248889692 wait complete. 2024-06-03T00:05:09.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:08 smithi049 ceph-mon[32302]: pgmap v536: 97 pgs: 97 active+clean; 102 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 1.0 MiB/s wr, 311 op/s 2024-06-03T00:05:09.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:08 smithi107 ceph-mon[37048]: pgmap v536: 97 pgs: 97 active+clean; 102 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 1.0 MiB/s wr, 311 op/s 2024-06-03T00:05:09.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:08 smithi057 ceph-mon[36457]: pgmap v536: 97 pgs: 97 active+clean; 102 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 1.0 MiB/s wr, 311 op/s 2024-06-03T00:05:11.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:10 smithi049 ceph-mon[32302]: pgmap v537: 97 pgs: 97 active+clean; 101 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 443 op/s 2024-06-03T00:05:11.252 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:10 smithi057 ceph-mon[36457]: pgmap v537: 97 pgs: 97 active+clean; 101 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 443 op/s 2024-06-03T00:05:11.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:10 smithi107 ceph-mon[37048]: pgmap v537: 97 pgs: 97 active+clean; 101 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 443 op/s 2024-06-03T00:05:13.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:12 smithi049 ceph-mon[32302]: pgmap v538: 97 pgs: 97 active+clean; 103 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 373 op/s 2024-06-03T00:05:13.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:12 smithi107 ceph-mon[37048]: pgmap v538: 97 pgs: 97 active+clean; 103 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 373 op/s 2024-06-03T00:05:13.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:12 smithi057 ceph-mon[36457]: pgmap v538: 97 pgs: 97 active+clean; 103 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 373 op/s 2024-06-03T00:05:15.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:14 smithi049 ceph-mon[32302]: pgmap v539: 97 pgs: 97 active+clean; 100 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 406 op/s 2024-06-03T00:05:15.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:14 smithi107 ceph-mon[37048]: pgmap v539: 97 pgs: 97 active+clean; 100 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 406 op/s 2024-06-03T00:05:15.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:14 smithi057 ceph-mon[36457]: pgmap v539: 97 pgs: 97 active+clean; 100 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 406 op/s 2024-06-03T00:05:17.109 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-06-03T00:05:17.109 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-06-03T00:05:17.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:16 smithi107 ceph-mon[37048]: pgmap v540: 97 pgs: 97 active+clean; 99 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 461 op/s 2024-06-03T00:05:17.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:16 smithi057 ceph-mon[36457]: pgmap v540: 97 pgs: 97 active+clean; 99 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 461 op/s 2024-06-03T00:05:17.455 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:16 smithi049 ceph-mon[32302]: pgmap v540: 97 pgs: 97 active+clean; 99 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 461 op/s 2024-06-03T00:05:17.457 DEBUG:teuthology.parallel:result is None 2024-06-03T00:05:17.457 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-06-03T00:05:17.494 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-06-03T00:05:17.494 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-06-03T00:05:17.509 INFO:tasks.quiescer:joining Quiescers 2024-06-03T00:05:17.509 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-06-03T00:05:17.510 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-03T00:05:17.785 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:05:19.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:18 smithi049 ceph-mon[32302]: pgmap v541: 97 pgs: 97 active+clean; 98 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 1004 KiB/s wr, 367 op/s 2024-06-03T00:05:19.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:18 smithi107 ceph-mon[37048]: pgmap v541: 97 pgs: 97 active+clean; 98 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 1004 KiB/s wr, 367 op/s 2024-06-03T00:05:19.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:18 smithi057 ceph-mon[36457]: pgmap v541: 97 pgs: 97 active+clean; 98 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 1004 KiB/s wr, 367 op/s 2024-06-03T00:05:19.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.585+0000 7f00e5f6a700 1 -- 172.21.15.49:0/1039871385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00e0102ef0 msgr2=0x7f00e010f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:19.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.585+0000 7f00e5f6a700 1 --2- 172.21.15.49:0/1039871385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00e0102ef0 0x7f00e010f3a0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f00d80099c0 tx=0x7f00d8009cd0 comp rx=0 tx=0).stop 2024-06-03T00:05:19.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.585+0000 7f00e5f6a700 1 -- 172.21.15.49:0/1039871385 shutdown_connections 2024-06-03T00:05:19.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.585+0000 7f00e5f6a700 1 --2- 172.21.15.49:0/1039871385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00e0102ef0 0x7f00e010f3a0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:19.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.585+0000 7f00e5f6a700 1 --2- 172.21.15.49:0/1039871385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00e01085d0 0x7f00e01089b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:19.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.585+0000 7f00e5f6a700 1 --2- 172.21.15.49:0/1039871385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00e0102530 0x7f00e01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:19.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.585+0000 7f00e5f6a700 1 -- 172.21.15.49:0/1039871385 >> 172.21.15.49:0/1039871385 conn(0x7f00e0079640 msgr2=0x7f00e0079a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:05:19.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.585+0000 7f00e5f6a700 1 -- 172.21.15.49:0/1039871385 shutdown_connections 2024-06-03T00:05:19.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.585+0000 7f00e5f6a700 1 -- 172.21.15.49:0/1039871385 wait complete. 2024-06-03T00:05:19.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.585+0000 7f00e5f6a700 1 Processor -- start 2024-06-03T00:05:19.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.585+0000 7f00e5f6a700 1 -- start start 2024-06-03T00:05:19.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.586+0000 7f00e5f6a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00e0102530 0x7f00e019e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:19.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.586+0000 7f00e5f6a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00e0102ef0 0x7f00e019ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:19.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.586+0000 7f00e5f6a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00e01085d0 0x7f00e0198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:19.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.586+0000 7f00e5f6a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f00e01128a0 con 0x7f00e0102ef0 2024-06-03T00:05:19.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.586+0000 7f00e5f6a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f00e0112720 con 0x7f00e0102530 2024-06-03T00:05:19.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.586+0000 7f00e5f6a700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f00e0112a20 con 0x7f00e01085d0 2024-06-03T00:05:19.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.586+0000 7f00d6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00e0102ef0 0x7f00e019ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:19.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.586+0000 7f00d6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00e0102ef0 0x7f00e019ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53754/0 (socket says 172.21.15.49:53754) 2024-06-03T00:05:19.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.586+0000 7f00d6ffd700 1 -- 172.21.15.49:0/1224582389 learned_addr learned my addr 172.21.15.49:0/1224582389 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:05:19.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.586+0000 7f00dffff700 1 --2- 172.21.15.49:0/1224582389 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00e01085d0 0x7f00e0198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:19.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.586+0000 7f00df7fe700 1 --2- 172.21.15.49:0/1224582389 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00e0102530 0x7f00e019e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:19.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.586+0000 7f00d6ffd700 1 -- 172.21.15.49:0/1224582389 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00e01085d0 msgr2=0x7f00e0198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:19.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.586+0000 7f00d6ffd700 1 --2- 172.21.15.49:0/1224582389 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00e01085d0 0x7f00e0198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:19.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.586+0000 7f00d6ffd700 1 -- 172.21.15.49:0/1224582389 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00e0102530 msgr2=0x7f00e019e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:19.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.586+0000 7f00d6ffd700 1 --2- 172.21.15.49:0/1224582389 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00e0102530 0x7f00e019e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:19.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.586+0000 7f00d6ffd700 1 -- 172.21.15.49:0/1224582389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e0199200 con 0x7f00e0102ef0 2024-06-03T00:05:19.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.586+0000 7f00d6ffd700 1 --2- 172.21.15.49:0/1224582389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00e0102ef0 0x7f00e019ee20 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f00c800e9c0 tx=0x7f00c800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:05:19.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.587+0000 7f00dd7fa700 1 -- 172.21.15.49:0/1224582389 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c800cbd0 con 0x7f00e0102ef0 2024-06-03T00:05:19.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.587+0000 7f00dd7fa700 1 -- 172.21.15.49:0/1224582389 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00c800cd70 con 0x7f00e0102ef0 2024-06-03T00:05:19.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.587+0000 7f00dd7fa700 1 -- 172.21.15.49:0/1224582389 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c8010430 con 0x7f00e0102ef0 2024-06-03T00:05:19.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.587+0000 7f00e5f6a700 1 -- 172.21.15.49:0/1224582389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00e01994f0 con 0x7f00e0102ef0 2024-06-03T00:05:19.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.587+0000 7f00e5f6a700 1 -- 172.21.15.49:0/1224582389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00e01a57b0 con 0x7f00e0102ef0 2024-06-03T00:05:19.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.588+0000 7f00e5f6a700 1 -- 172.21.15.49:0/1224582389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00e010aa60 con 0x7f00e0102ef0 2024-06-03T00:05:19.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.589+0000 7f00dd7fa700 1 -- 172.21.15.49:0/1224582389 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f00c8004750 con 0x7f00e0102ef0 2024-06-03T00:05:19.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.590+0000 7f00dd7fa700 1 --2- 172.21.15.49:0/1224582389 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f00cc0a2ca0 0x7f00cc0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:19.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.590+0000 7f00dd7fa700 1 -- 172.21.15.49:0/1224582389 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f00c80cf280 con 0x7f00e0102ef0 2024-06-03T00:05:19.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.590+0000 7f00df7fe700 1 --2- 172.21.15.49:0/1224582389 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f00cc0a2ca0 0x7f00cc0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:19.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.590+0000 7f00df7fe700 1 --2- 172.21.15.49:0/1224582389 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f00cc0a2ca0 0x7f00cc0a5160 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f00e0199be0 tx=0x7f00d00094f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:05:19.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.594+0000 7f00dd7fa700 1 -- 172.21.15.49:0/1224582389 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f00c809c1e0 con 0x7f00e0102ef0 2024-06-03T00:05:19.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.850+0000 7f00e5f6a700 1 -- 172.21.15.49:0/1224582389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00e0199fd0 con 0x7f00e0102ef0 2024-06-03T00:05:19.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.851+0000 7f00dd7fa700 1 -- 172.21.15.49:0/1224582389 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+11950 (secure 0 0 0) 0x7f00c809bae0 con 0x7f00e0102ef0 2024-06-03T00:05:19.852 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:05:19.852 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1553264866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1553264866},{"type":"v1","addr":"172.21.15.49:6835","nonce":1553264866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2266285252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2266285252},{"type":"v1","addr":"172.21.15.49:6837","nonce":2266285252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":38,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T23:57:16.991201+0000","modified":"2024-06-03T00:04:24.724466+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24485,"mds_2":24466,"mds_3":24464,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6839/1729124617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":1729124617},{"type":"v1","addr":"172.21.15.49:6839","nonce":1729124617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6841/1902772235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":1902772235},{"type":"v1","addr":"172.21.15.49:6841","nonce":1902772235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6833/1633534002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1633534002},{"type":"v1","addr":"172.21.15.57:6833","nonce":1633534002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6835/2254905671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2254905671},{"type":"v1","addr":"172.21.15.57:6835","nonce":2254905671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.107:6835/3693542801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3693542801},{"type":"v1","addr":"172.21.15.107:6835","nonce":3693542801}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.57:6837/230452144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":230452144},{"type":"v1","addr":"172.21.15.57:6837","nonce":230452144}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":92,"addr":"172.21.15.107:6837/3700593315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":3700593315},{"type":"v1","addr":"172.21.15.107:6837","nonce":3700593315}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6839/249825195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":249825195},{"type":"v1","addr":"172.21.15.57:6839","nonce":249825195}]},"join_fscid":-1,"export_targets":[0,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6839/1986600681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1986600681},{"type":"v1","addr":"172.21.15.107:6839","nonce":1986600681}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24466,24487,24460,24464,24485]},"id":1}]} 2024-06-03T00:05:19.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.853+0000 7f00e5f6a700 1 -- 172.21.15.49:0/1224582389 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f00cc0a2ca0 msgr2=0x7f00cc0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:19.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.853+0000 7f00e5f6a700 1 --2- 172.21.15.49:0/1224582389 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f00cc0a2ca0 0x7f00cc0a5160 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f00e0199be0 tx=0x7f00d00094f0 comp rx=0 tx=0).stop 2024-06-03T00:05:19.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.853+0000 7f00e5f6a700 1 -- 172.21.15.49:0/1224582389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00e0102ef0 msgr2=0x7f00e019ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:19.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.853+0000 7f00e5f6a700 1 --2- 172.21.15.49:0/1224582389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00e0102ef0 0x7f00e019ee20 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f00c800e9c0 tx=0x7f00c800ecd0 comp rx=0 tx=0).stop 2024-06-03T00:05:19.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.854+0000 7f00e5f6a700 1 -- 172.21.15.49:0/1224582389 shutdown_connections 2024-06-03T00:05:19.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.854+0000 7f00e5f6a700 1 --2- 172.21.15.49:0/1224582389 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f00cc0a2ca0 0x7f00cc0a5160 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:19.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.854+0000 7f00e5f6a700 1 --2- 172.21.15.49:0/1224582389 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00e01085d0 0x7f00e0198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:19.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.854+0000 7f00e5f6a700 1 --2- 172.21.15.49:0/1224582389 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00e0102530 0x7f00e019e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:19.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.854+0000 7f00e5f6a700 1 --2- 172.21.15.49:0/1224582389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00e0102ef0 0x7f00e019ee20 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:19.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.854+0000 7f00e5f6a700 1 -- 172.21.15.49:0/1224582389 >> 172.21.15.49:0/1224582389 conn(0x7f00e0079640 msgr2=0x7f00e0100f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:05:19.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.854+0000 7f00e5f6a700 1 -- 172.21.15.49:0/1224582389 shutdown_connections 2024-06-03T00:05:19.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:19.854+0000 7f00e5f6a700 1 -- 172.21.15.49:0/1224582389 wait complete. 2024-06-03T00:05:19.856 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 38 2024-06-03T00:05:20.208 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:19 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/1224582389' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:05:20.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:19 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/1224582389' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:05:20.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:19 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/1224582389' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:05:20.596 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.595+0000 7f0f3b528640 1 -- 172.21.15.49:0/1501132785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f34101af0 msgr2=0x7f0f34101f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:20.596 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.595+0000 7f0f3b528640 1 --2- 172.21.15.49:0/1501132785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f34101af0 0x7f0f34101f70 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f0f24009900 tx=0x7f0f2402a410 comp rx=0 tx=0).stop 2024-06-03T00:05:20.596 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.595+0000 7f0f3b528640 1 -- 172.21.15.49:0/1501132785 shutdown_connections 2024-06-03T00:05:20.597 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.595+0000 7f0f3b528640 1 --2- 172.21.15.49:0/1501132785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f341024b0 0x7f0f34108d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.597 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.595+0000 7f0f3b528640 1 --2- 172.21.15.49:0/1501132785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f34101af0 0x7f0f34101f70 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.597 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.595+0000 7f0f3b528640 1 --2- 172.21.15.49:0/1501132785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f34100900 0x7f0f34100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.597 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.595+0000 7f0f3b528640 1 -- 172.21.15.49:0/1501132785 >> 172.21.15.49:0/1501132785 conn(0x7f0f340fbe70 msgr2=0x7f0f340fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:05:20.597 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.595+0000 7f0f3b528640 1 -- 172.21.15.49:0/1501132785 shutdown_connections 2024-06-03T00:05:20.597 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.595+0000 7f0f3b528640 1 -- 172.21.15.49:0/1501132785 wait complete. 2024-06-03T00:05:20.597 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.596+0000 7f0f3b528640 1 Processor -- start 2024-06-03T00:05:20.597 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.596+0000 7f0f3b528640 1 -- start start 2024-06-03T00:05:20.600 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.596+0000 7f0f3b528640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f34100900 0x7f0f34104890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:20.600 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.596+0000 7f0f3b528640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f34101af0 0x7f0f34102ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:20.600 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.596+0000 7f0f3b528640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f341024b0 0x7f0f34103410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:20.600 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.596+0000 7f0f3b528640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3410c5d0 con 0x7f0f341024b0 2024-06-03T00:05:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.596+0000 7f0f3b528640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3410c450 con 0x7f0f34101af0 2024-06-03T00:05:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.596+0000 7f0f3b528640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3410c750 con 0x7f0f34100900 2024-06-03T00:05:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.596+0000 7f0f39ac5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f341024b0 0x7f0f34103410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.596+0000 7f0f39ac5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f341024b0 0x7f0f34103410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53766/0 (socket says 172.21.15.49:53766) 2024-06-03T00:05:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.596+0000 7f0f39ac5640 1 -- 172.21.15.49:0/2434861230 learned_addr learned my addr 172.21.15.49:0/2434861230 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:05:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.596+0000 7f0f38ac3640 1 --2- 172.21.15.49:0/2434861230 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f34101af0 0x7f0f34102ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.596+0000 7f0f392c4640 1 --2- 172.21.15.49:0/2434861230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f34100900 0x7f0f34104890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.597+0000 7f0f39ac5640 1 -- 172.21.15.49:0/2434861230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f34100900 msgr2=0x7f0f34104890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.597+0000 7f0f39ac5640 1 --2- 172.21.15.49:0/2434861230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f34100900 0x7f0f34104890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.597+0000 7f0f39ac5640 1 -- 172.21.15.49:0/2434861230 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f34101af0 msgr2=0x7f0f34102ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:20.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.597+0000 7f0f39ac5640 1 --2- 172.21.15.49:0/2434861230 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f34101af0 0x7f0f34102ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.597+0000 7f0f39ac5640 1 -- 172.21.15.49:0/2434861230 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f34103ca0 con 0x7f0f341024b0 2024-06-03T00:05:20.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.597+0000 7f0f39ac5640 1 --2- 172.21.15.49:0/2434861230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f341024b0 0x7f0f34103410 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c00eaa0 tx=0x7f0f2c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:05:20.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.597+0000 7f0f2a7fc640 1 -- 172.21.15.49:0/2434861230 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c00cdb0 con 0x7f0f341024b0 2024-06-03T00:05:20.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.597+0000 7f0f2a7fc640 1 -- 172.21.15.49:0/2434861230 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f2c005020 con 0x7f0f341024b0 2024-06-03T00:05:20.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.597+0000 7f0f3b528640 1 -- 172.21.15.49:0/2434861230 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f341a1d70 con 0x7f0f341024b0 2024-06-03T00:05:20.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.597+0000 7f0f2a7fc640 1 -- 172.21.15.49:0/2434861230 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c0116b0 con 0x7f0f341024b0 2024-06-03T00:05:20.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.597+0000 7f0f3b528640 1 -- 172.21.15.49:0/2434861230 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f341a21d0 con 0x7f0f341024b0 2024-06-03T00:05:20.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.600+0000 7f0f2a7fc640 1 -- 172.21.15.49:0/2434861230 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0f2c011850 con 0x7f0f341024b0 2024-06-03T00:05:20.608 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.600+0000 7f0f3e230740 1 Processor -- start 2024-06-03T00:05:20.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.600+0000 7f0f3e230740 1 -- start start 2024-06-03T00:05:20.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.600+0000 7f0f3e230740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b3709bb010 0x55b3709bb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:20.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.600+0000 7f0f3e230740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b3709bba00 0x55b3709c0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:20.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.600+0000 7f0f3e230740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3709c0b70 0x55b3709c3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:20.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.600+0000 7f0f3e230740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55b37091e4f0 con 0x55b3709c0b70 2024-06-03T00:05:20.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.600+0000 7f0f3e230740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55b3708bc870 con 0x55b3709bba00 2024-06-03T00:05:20.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.600+0000 7f0f3e230740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b37091a4b0 con 0x55b3709bb010 2024-06-03T00:05:20.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.600+0000 7f0f38ac3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3709c0b70 0x55b3709c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:20.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.601+0000 7f0f38ac3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3709c0b70 0x55b3709c3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53774/0 (socket says 172.21.15.49:53774) 2024-06-03T00:05:20.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.601+0000 7f0f38ac3640 1 -- 172.21.15.49:0/3219829727 learned_addr learned my addr 172.21.15.49:0/3219829727 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:05:20.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.601+0000 7f0f2a7fc640 1 --2- 172.21.15.49:0/2434861230 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f0f200a2c30 0x7f0f200a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:20.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.601+0000 7f0f392c4640 1 --2- 172.21.15.49:0/3219829727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b3709bba00 0x55b3709c0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:20.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.601+0000 7f0f38ac3640 1 --2- 172.21.15.49:0/3219829727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b3709bb010 0x55b3709bb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:20.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.601+0000 7f0f39ac5640 1 --2- 172.21.15.49:0/2434861230 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f0f200a2c30 0x7f0f200a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:20.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.601+0000 7f0f392c4640 1 -- 172.21.15.49:0/3219829727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b3709bb010 msgr2=0x55b3709bb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:05:20.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.601+0000 7f0f392c4640 1 --2- 172.21.15.49:0/3219829727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b3709bb010 0x55b3709bb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.601+0000 7f0f392c4640 1 -- 172.21.15.49:0/3219829727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3709c0b70 msgr2=0x55b3709c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:05:20.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.601+0000 7f0f2a7fc640 1 -- 172.21.15.49:0/2434861230 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f0f2c0cf170 con 0x7f0f341024b0 2024-06-03T00:05:20.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.601+0000 7f0f392c4640 1 --2- 172.21.15.49:0/3219829727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3709c0b70 0x55b3709c3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.601+0000 7f0f392c4640 1 -- 172.21.15.49:0/3219829727 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3708d89b0 con 0x55b3709bba00 2024-06-03T00:05:20.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.601+0000 7f0f38ac3640 1 --2- 172.21.15.49:0/3219829727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3709c0b70 0x55b3709c3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:05:20.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.601+0000 7f0f392c4640 1 --2- 172.21.15.49:0/3219829727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b3709bba00 0x55b3709c0500 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0f34101950 tx=0x7f0f3000bbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79bda9113e5898ae server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:05:20.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.601+0000 7f0f39ac5640 1 --2- 172.21.15.49:0/2434861230 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f0f200a2c30 0x7f0f200a50f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c09ba80 tx=0x7f0f2c0c6560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:05:20.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.601+0000 7f0f1f7fe640 1 -- 172.21.15.49:0/3219829727 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f30003dd0 con 0x55b3709bba00 2024-06-03T00:05:20.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.602+0000 7f0f1f7fe640 1 -- 172.21.15.49:0/3219829727 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f30015070 con 0x55b3709bba00 2024-06-03T00:05:20.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.602+0000 7f0f1f7fe640 1 -- 172.21.15.49:0/3219829727 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f300116a0 con 0x55b3709bba00 2024-06-03T00:05:20.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.602+0000 7f0f3e230740 1 -- 172.21.15.49:0/3219829727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b3709bba00 msgr2=0x55b3709c0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:20.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.602+0000 7f0f3e230740 1 --2- 172.21.15.49:0/3219829727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b3709bba00 0x55b3709c0500 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0f34101950 tx=0x7f0f3000bbe0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.602+0000 7f0f3e230740 1 -- 172.21.15.49:0/3219829727 shutdown_connections 2024-06-03T00:05:20.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.602+0000 7f0f3e230740 1 --2- 172.21.15.49:0/3219829727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b3709bba00 0x55b3709c0500 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.602+0000 7f0f3e230740 1 --2- 172.21.15.49:0/3219829727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3709c0b70 0x55b3709c3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.602+0000 7f0f3e230740 1 --2- 172.21.15.49:0/3219829727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b3709bb010 0x55b3709bb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.602+0000 7f0f3e230740 1 -- 172.21.15.49:0/3219829727 >> 172.21.15.49:0/3219829727 conn(0x55b3709b6680 msgr2=0x55b3709b6a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:05:20.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.602+0000 7f0f3e230740 1 -- 172.21.15.49:0/3219829727 shutdown_connections 2024-06-03T00:05:20.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.602+0000 7f0f3e230740 1 -- 172.21.15.49:0/3219829727 wait complete. 2024-06-03T00:05:20.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.603+0000 7f0f3e230740 1 -- start start 2024-06-03T00:05:20.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.603+0000 7f0f3e230740 1 Processor -- start 2024-06-03T00:05:20.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.603+0000 7f0f3e230740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b3709bb010 0x55b3709c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:20.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.603+0000 7f0f3e230740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3709bba00 0x55b3709c5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:20.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.603+0000 7f0f3e230740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b3709c0b70 0x55b3709cc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:20.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.603+0000 7f0f3e230740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55b3709c3b20 con 0x55b3709bba00 2024-06-03T00:05:20.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.603+0000 7f0f3e230740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55b3708a7ae0 con 0x55b3709c0b70 2024-06-03T00:05:20.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.603+0000 7f0f3e230740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55b3709c3ca0 con 0x55b3709bb010 2024-06-03T00:05:20.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.603+0000 7f0f3e230740 10 client.0 _ll_register_callbacks cb 0x55b3708e09b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:05:20.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.603+0000 7f0f392c4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3709bba00 0x55b3709c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:20.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.603+0000 7f0f392c4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3709bba00 0x55b3709c5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53790/0 (socket says 172.21.15.49:53790) 2024-06-03T00:05:20.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.603+0000 7f0f392c4640 1 -- 172.21.15.49:0/34713890 learned_addr learned my addr 172.21.15.49:0/34713890 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:05:20.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.604+0000 7f0f38ac3640 1 --2- 172.21.15.49:0/34713890 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b3709bb010 0x55b3709c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:20.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.604+0000 7f0f38ac3640 1 --2- 172.21.15.49:0/34713890 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b3709c0b70 0x55b3709cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:20.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.604+0000 7f0f392c4640 1 -- 172.21.15.49:0/34713890 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b3709bb010 msgr2=0x55b3709c52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:05:20.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.604+0000 7f0f392c4640 1 --2- 172.21.15.49:0/34713890 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b3709bb010 0x55b3709c52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.604+0000 7f0f392c4640 1 -- 172.21.15.49:0/34713890 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b3709c0b70 msgr2=0x55b3709cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:05:20.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.604+0000 7f0f392c4640 1 --2- 172.21.15.49:0/34713890 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b3709c0b70 0x55b3709cc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.604+0000 7f0f392c4640 1 -- 172.21.15.49:0/34713890 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b370632210 con 0x55b3709bba00 2024-06-03T00:05:20.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.604+0000 7f0f38ac3640 1 --2- 172.21.15.49:0/34713890 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b3709c0b70 0x55b3709cc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:05:20.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.604+0000 7f0f392c4640 1 --2- 172.21.15.49:0/34713890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3709bba00 0x55b3709c5800 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f0f30006010 tx=0x7f0f30003e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec85c7e8d3fbc91a server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:05:20.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.604+0000 7f0f1cff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:05:20.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.604+0000 7f0f1cff9640 1 -- 172.21.15.49:0/34713890 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3000be90 con 0x55b3709bba00 2024-06-03T00:05:20.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.604+0000 7f0f3e230740 1 -- 172.21.15.49:0/34713890 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f30015070 con 0x55b3709bba00 2024-06-03T00:05:20.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.604+0000 7f0f1cff9640 1 -- 172.21.15.49:0/34713890 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f0f3001a680 con 0x55b3709bba00 2024-06-03T00:05:20.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.604+0000 7f0f1cff9640 1 -- 172.21.15.49:0/34713890 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f0f3001a880 con 0x55b3709bba00 2024-06-03T00:05:20.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.604+0000 7f0f3e230740 10 client.16401 fetch_fsmap learned FSMap version 38 2024-06-03T00:05:20.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.604+0000 7f0f3e230740 1 -- 172.21.15.49:0/34713890 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55b3706fe620 con 0x55b3709bba00 2024-06-03T00:05:20.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.605+0000 7f0f1cff9640 1 -- 172.21.15.49:0/34713890 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f30015070 con 0x55b3709bba00 2024-06-03T00:05:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.605+0000 7f0f1cff9640 1 -- 172.21.15.49:0/34713890 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 38) ==== 8406+0+0 (secure 0 0 0) 0x7f0f30026420 con 0x55b3709bba00 2024-06-03T00:05:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.605+0000 7f0f3e230740 10 client.16401 fetch_fsmap finished waiting for FSMap version 38 2024-06-03T00:05:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.605+0000 7f0f3e230740 10 client.16401 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:05:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.605+0000 7f0f3e230740 20 client.16401 populate_metadata read hostname 'smithi049' 2024-06-03T00:05:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.605+0000 7f0f3e230740 1 --2- 172.21.15.49:0/34713890 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55b3709d0fb0 0x55b3709d33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.605+0000 7f0f3e230740 4 client.16401 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:05:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.605+0000 7f0f3e230740 1 -- 172.21.15.49:0/34713890 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b370931f10 con 0x55b3709d0fb0 2024-06-03T00:05:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.605+0000 7f0f38ac3640 1 --2- 172.21.15.49:0/34713890 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55b3709d0fb0 0x55b3709d33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.606+0000 7f0f38ac3640 1 --2- 172.21.15.49:0/34713890 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55b3709d0fb0 0x55b3709d33f0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c35857ce2c7b2469 server_cookie=fd743080386b9cc3 in_seq=0 out_seq=0 2024-06-03T00:05:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.606+0000 7f0f1cff9640 10 client.16401 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:05:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.606+0000 7f0f1cff9640 1 -- 172.21.15.49:0/34713890 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55b370931f10 con 0x55b3709d0fb0 2024-06-03T00:05:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.606+0000 7f0f1cff9640 10 client.16401 handle_command_reply: tid=0 2024-06-03T00:05:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.607+0000 7f0f3e230740 1 client.16401 shutdown 2024-06-03T00:05:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.607+0000 7f0f3e230740 1 -- 172.21.15.49:0/34713890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3709bba00 msgr2=0x55b3709c5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.607+0000 7f0f3e230740 1 --2- 172.21.15.49:0/34713890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3709bba00 0x55b3709c5800 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f0f30006010 tx=0x7f0f30003e00 comp rx=0 tx=0).stop 2024-06-03T00:05:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.607+0000 7f0f3e230740 1 -- 172.21.15.49:0/34713890 shutdown_connections 2024-06-03T00:05:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.607+0000 7f0f3e230740 1 --2- 172.21.15.49:0/34713890 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55b3709d0fb0 0x55b3709d33f0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.607+0000 7f0f3e230740 1 --2- 172.21.15.49:0/34713890 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b3709c0b70 0x55b3709cc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.607+0000 7f0f1cff9640 0 client.16401 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:05:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.607+0000 7f0f3e230740 1 --2- 172.21.15.49:0/34713890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3709bba00 0x55b3709c5800 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.607+0000 7f0f3e230740 1 --2- 172.21.15.49:0/34713890 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b3709bb010 0x55b3709c52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.607+0000 7f0f3e230740 1 -- 172.21.15.49:0/34713890 >> 172.21.15.49:0/34713890 conn(0x55b3709b6680 msgr2=0x55b3709b57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:05:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.607+0000 7f0f3e230740 1 -- 172.21.15.49:0/34713890 shutdown_connections 2024-06-03T00:05:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.607+0000 7f0f3e230740 1 -- 172.21.15.49:0/34713890 wait complete. 2024-06-03T00:05:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.607+0000 7f0f3e230740 20 client.16401 trim_cache size 0 max 16384 2024-06-03T00:05:20.618 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24487 quiesce db --cancel --all' 2024-06-03T00:05:20.618 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- timeout 105 ceph tell mds.24487 quiesce db --cancel --all 2024-06-03T00:05:20.624 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.623+0000 7f0f3e230740 1 Processor -- start 2024-06-03T00:05:20.624 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.623+0000 7f0f3e230740 1 -- start start 2024-06-03T00:05:20.624 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.623+0000 7f0f3e230740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b3709bb010 0x55b3709bcc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:20.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.623+0000 7f0f3e230740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3709bba00 0x55b3709bd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:20.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.623+0000 7f0f3e230740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b3709c0b70 0x55b3709cc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:20.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.623+0000 7f0f3e230740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0f341ab170 con 0x55b3709bba00 2024-06-03T00:05:20.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.623+0000 7f0f3e230740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0f341acec0 con 0x55b3709bb010 2024-06-03T00:05:20.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.623+0000 7f0f3e230740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0f341ab8a0 con 0x55b3709c0b70 2024-06-03T00:05:20.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.623+0000 7f0f392c4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3709bba00 0x55b3709bd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:20.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.623+0000 7f0f392c4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3709bba00 0x55b3709bd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53806/0 (socket says 172.21.15.49:53806) 2024-06-03T00:05:20.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.623+0000 7f0f392c4640 1 -- 172.21.15.49:0/1035172427 learned_addr learned my addr 172.21.15.49:0/1035172427 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:05:20.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.623+0000 7f0f38ac3640 1 --2- 172.21.15.49:0/1035172427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b3709bb010 0x55b3709bcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:20.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.623+0000 7f0f38ac3640 1 --2- 172.21.15.49:0/1035172427 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b3709c0b70 0x55b3709cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:20.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.623+0000 7f0f392c4640 1 -- 172.21.15.49:0/1035172427 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b3709c0b70 msgr2=0x55b3709cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:05:20.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.623+0000 7f0f392c4640 1 --2- 172.21.15.49:0/1035172427 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b3709c0b70 0x55b3709cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.623+0000 7f0f392c4640 1 -- 172.21.15.49:0/1035172427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b3709bb010 msgr2=0x55b3709bcc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:05:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.623+0000 7f0f392c4640 1 --2- 172.21.15.49:0/1035172427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b3709bb010 0x55b3709bcc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.623+0000 7f0f392c4640 1 -- 172.21.15.49:0/1035172427 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3709c3bf0 con 0x55b3709bba00 2024-06-03T00:05:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.623+0000 7f0f38ac3640 1 --2- 172.21.15.49:0/1035172427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b3709bb010 0x55b3709bcc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:05:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.624+0000 7f0f392c4640 1 --2- 172.21.15.49:0/1035172427 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3709bba00 0x55b3709bd160 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f0f30001eb0 tx=0x7f0f300042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae263995e687272f server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:05:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.624+0000 7f0f1effd640 1 -- 172.21.15.49:0/1035172427 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f30003e70 con 0x55b3709bba00 2024-06-03T00:05:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.624+0000 7f0f1effd640 1 -- 172.21.15.49:0/1035172427 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f30035070 con 0x55b3709bba00 2024-06-03T00:05:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.624+0000 7f0f1effd640 1 -- 172.21.15.49:0/1035172427 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f30011440 con 0x55b3709bba00 2024-06-03T00:05:20.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.625+0000 7f0f3e230740 1 -- 172.21.15.49:0/1035172427 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3709bba00 msgr2=0x55b3709bd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:20.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.625+0000 7f0f3e230740 1 --2- 172.21.15.49:0/1035172427 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3709bba00 0x55b3709bd160 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f0f30001eb0 tx=0x7f0f300042c0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.625+0000 7f0f3e230740 1 -- 172.21.15.49:0/1035172427 shutdown_connections 2024-06-03T00:05:20.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.625+0000 7f0f3e230740 1 --2- 172.21.15.49:0/1035172427 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b3709c0b70 0x55b3709cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.625+0000 7f0f3e230740 1 --2- 172.21.15.49:0/1035172427 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3709bba00 0x55b3709bd160 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.625+0000 7f0f3e230740 1 --2- 172.21.15.49:0/1035172427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b3709bb010 0x55b3709bcc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.625+0000 7f0f3e230740 1 -- 172.21.15.49:0/1035172427 >> 172.21.15.49:0/1035172427 conn(0x55b3709b6680 msgr2=0x55b3709c52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:05:20.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.625+0000 7f0f3e230740 1 -- 172.21.15.49:0/1035172427 shutdown_connections 2024-06-03T00:05:20.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.625+0000 7f0f3e230740 1 -- 172.21.15.49:0/1035172427 wait complete. 2024-06-03T00:05:20.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.625+0000 7f0f3e230740 1 -- start start 2024-06-03T00:05:20.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.625+0000 7f0f3e230740 1 Processor -- start 2024-06-03T00:05:20.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.625+0000 7f0f3e230740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b3709bb010 0x55b3709c9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:20.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.625+0000 7f0f3e230740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3709bba00 0x55b3709c9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:20.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.625+0000 7f0f3e230740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b3709c0b70 0x55b370a39cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:20.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.625+0000 7f0f3e230740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0f341ac730 con 0x55b3709bba00 2024-06-03T00:05:20.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.625+0000 7f0f3e230740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0f341abfd0 con 0x55b3709c0b70 2024-06-03T00:05:20.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.625+0000 7f0f3e230740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0f341a9130 con 0x55b3709bb010 2024-06-03T00:05:20.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.626+0000 7f0f3e230740 10 client.0 _ll_register_callbacks cb 0x7f0f24009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:05:20.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.626+0000 7f0f392c4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3709bba00 0x55b3709c9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:20.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.626+0000 7f0f392c4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3709bba00 0x55b3709c9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53818/0 (socket says 172.21.15.49:53818) 2024-06-03T00:05:20.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.626+0000 7f0f392c4640 1 -- 172.21.15.49:0/4121216481 learned_addr learned my addr 172.21.15.49:0/4121216481 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:05:20.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.626+0000 7f0f38ac3640 1 --2- 172.21.15.49:0/4121216481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b3709bb010 0x55b3709c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.626+0000 7f0f38ac3640 1 --2- 172.21.15.49:0/4121216481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b3709c0b70 0x55b370a39cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.626+0000 7f0f392c4640 1 -- 172.21.15.49:0/4121216481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b3709bb010 msgr2=0x55b3709c9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:05:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.626+0000 7f0f392c4640 1 --2- 172.21.15.49:0/4121216481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b3709bb010 0x55b3709c9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.626+0000 7f0f392c4640 1 -- 172.21.15.49:0/4121216481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b3709c0b70 msgr2=0x55b370a39cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:05:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.626+0000 7f0f392c4640 1 --2- 172.21.15.49:0/4121216481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b3709c0b70 0x55b370a39cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.626+0000 7f0f392c4640 1 -- 172.21.15.49:0/4121216481 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3709b64b0 con 0x55b3709bba00 2024-06-03T00:05:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.626+0000 7f0f38ac3640 1 --2- 172.21.15.49:0/4121216481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b3709bb010 0x55b3709c9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:05:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.626+0000 7f0f392c4640 1 --2- 172.21.15.49:0/4121216481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3709bba00 0x55b3709c9d60 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f0f30000c00 tx=0x7f0f30026490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daeedd75046253e1 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:05:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.626+0000 7f0f1cff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:05:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.626+0000 7f0f1cff9640 1 -- 172.21.15.49:0/4121216481 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f30026cc0 con 0x55b3709bba00 2024-06-03T00:05:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.626+0000 7f0f1cff9640 1 -- 172.21.15.49:0/4121216481 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f0f3001a680 con 0x55b3709bba00 2024-06-03T00:05:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.626+0000 7f0f3e230740 1 -- 172.21.15.49:0/4121216481 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f30035070 con 0x55b3709bba00 2024-06-03T00:05:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.627+0000 7f0f1cff9640 1 -- 172.21.15.49:0/4121216481 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f0f30048050 con 0x55b3709bba00 2024-06-03T00:05:20.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.627+0000 7f0f3e230740 10 client.16407 fetch_fsmap learned FSMap version 38 2024-06-03T00:05:20.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.627+0000 7f0f3e230740 1 -- 172.21.15.49:0/4121216481 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55b370a3b350 con 0x55b3709bba00 2024-06-03T00:05:20.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.627+0000 7f0f1cff9640 1 -- 172.21.15.49:0/4121216481 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f30035070 con 0x55b3709bba00 2024-06-03T00:05:20.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.627+0000 7f0f1cff9640 1 -- 172.21.15.49:0/4121216481 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 38) ==== 8406+0+0 (secure 0 0 0) 0x7f0f300118c0 con 0x55b3709bba00 2024-06-03T00:05:20.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.627+0000 7f0f3e230740 10 client.16407 fetch_fsmap finished waiting for FSMap version 38 2024-06-03T00:05:20.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.627+0000 7f0f3e230740 10 client.16407 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-06-03T00:05:20.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.627+0000 7f0f3e230740 20 client.16407 populate_metadata read hostname 'smithi049' 2024-06-03T00:05:20.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.627+0000 7f0f3e230740 1 --2- 172.21.15.49:0/4121216481 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55b370a3bd60 0x55b370a3e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:20.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.627+0000 7f0f3e230740 4 client.16407 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-03T00:05:20.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.627+0000 7f0f3e230740 1 -- 172.21.15.49:0/4121216481 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b37092bc20 con 0x55b370a3bd60 2024-06-03T00:05:20.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.627+0000 7f0f38ac3640 1 --2- 172.21.15.49:0/4121216481 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55b370a3bd60 0x55b370a3e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:20.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.628+0000 7f0f38ac3640 1 --2- 172.21.15.49:0/4121216481 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55b370a3bd60 0x55b370a3e180 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac53c7ccaf782491 server_cookie=ac5e99a73bfb9d45 in_seq=0 out_seq=0 2024-06-03T00:05:20.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.628+0000 7f0f1cff9640 10 client.16407 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:05:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.677+0000 7f0f1cff9640 1 -- 172.21.15.49:0/4121216481 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55b37092bc20 con 0x55b370a3bd60 2024-06-03T00:05:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.677+0000 7f0f1cff9640 10 client.16407 handle_command_reply: tid=0 2024-06-03T00:05:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.677+0000 7f0f3e230740 1 client.16407 shutdown 2024-06-03T00:05:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.677+0000 7f0f3e230740 1 -- 172.21.15.49:0/4121216481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3709bba00 msgr2=0x55b3709c9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.677+0000 7f0f3e230740 1 --2- 172.21.15.49:0/4121216481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3709bba00 0x55b3709c9d60 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f0f30000c00 tx=0x7f0f30026490 comp rx=0 tx=0).stop 2024-06-03T00:05:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.677+0000 7f0f3e230740 1 -- 172.21.15.49:0/4121216481 shutdown_connections 2024-06-03T00:05:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.677+0000 7f0f3e230740 1 --2- 172.21.15.49:0/4121216481 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x55b370a3bd60 0x55b370a3e180 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.677+0000 7f0f3e230740 1 --2- 172.21.15.49:0/4121216481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b3709c0b70 0x55b370a39cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.677+0000 7f0f3e230740 1 --2- 172.21.15.49:0/4121216481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b3709bba00 0x55b3709c9d60 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.677+0000 7f0f1cff9640 0 client.16407 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:05:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.677+0000 7f0f3e230740 1 --2- 172.21.15.49:0/4121216481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b3709bb010 0x55b3709c9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.677+0000 7f0f3e230740 1 -- 172.21.15.49:0/4121216481 >> 172.21.15.49:0/4121216481 conn(0x55b3709b6680 msgr2=0x55b3709bcc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:05:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.677+0000 7f0f3e230740 1 -- 172.21.15.49:0/4121216481 shutdown_connections 2024-06-03T00:05:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.677+0000 7f0f3e230740 1 -- 172.21.15.49:0/4121216481 wait complete. 2024-06-03T00:05:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.677+0000 7f0f3e230740 20 client.16407 trim_cache size 0 max 16384 2024-06-03T00:05:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-06-03T00:05:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-06-03T00:05:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-06-03T00:05:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.678+0000 7f0f3b528640 1 -- 172.21.15.49:0/2434861230 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f0f200a2c30 msgr2=0x7f0f200a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.678+0000 7f0f3b528640 1 --2- 172.21.15.49:0/2434861230 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f0f200a2c30 0x7f0f200a50f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c09ba80 tx=0x7f0f2c0c6560 comp rx=0 tx=0).stop 2024-06-03T00:05:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.678+0000 7f0f3b528640 1 -- 172.21.15.49:0/2434861230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f341024b0 msgr2=0x7f0f34103410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.678+0000 7f0f3b528640 1 --2- 172.21.15.49:0/2434861230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f341024b0 0x7f0f34103410 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c00eaa0 tx=0x7f0f2c00ef60 comp rx=0 tx=0).stop 2024-06-03T00:05:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.678+0000 7f0f3b528640 1 -- 172.21.15.49:0/2434861230 shutdown_connections 2024-06-03T00:05:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.678+0000 7f0f3b528640 1 --2- 172.21.15.49:0/2434861230 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f0f200a2c30 0x7f0f200a50f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.678+0000 7f0f3b528640 1 --2- 172.21.15.49:0/2434861230 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f34101af0 0x7f0f34102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.678+0000 7f0f3b528640 1 --2- 172.21.15.49:0/2434861230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f341024b0 0x7f0f34103410 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.678+0000 7f0f3b528640 1 --2- 172.21.15.49:0/2434861230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f34100900 0x7f0f34104890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.678+0000 7f0f3b528640 1 -- 172.21.15.49:0/2434861230 >> 172.21.15.49:0/2434861230 conn(0x7f0f340fbe70 msgr2=0x7f0f340fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:05:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.678+0000 7f0f3b528640 1 -- 172.21.15.49:0/2434861230 shutdown_connections 2024-06-03T00:05:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-06-03T00:05:20.678+0000 7f0f3b528640 1 -- 172.21.15.49:0/2434861230 wait complete. 2024-06-03T00:05:20.897 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:05:21.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:20 smithi049 ceph-mon[32302]: pgmap v542: 97 pgs: 97 active+clean; 98 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 457 op/s 2024-06-03T00:05:21.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:20 smithi107 ceph-mon[37048]: pgmap v542: 97 pgs: 97 active+clean; 98 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 457 op/s 2024-06-03T00:05:21.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:20 smithi057 ceph-mon[36457]: pgmap v542: 97 pgs: 97 active+clean; 98 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 457 op/s 2024-06-03T00:05:22.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.482+0000 7fa715d69700 1 -- 172.21.15.49:0/2023039490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa710101fc0 msgr2=0x7fa710106010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:22.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.482+0000 7fa715d69700 1 --2- 172.21.15.49:0/2023039490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa710101fc0 0x7fa710106010 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa7040099c0 tx=0x7fa704009cd0 comp rx=0 tx=0).stop 2024-06-03T00:05:22.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.482+0000 7fa715d69700 1 -- 172.21.15.49:0/2023039490 shutdown_connections 2024-06-03T00:05:22.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.483+0000 7fa715d69700 1 --2- 172.21.15.49:0/2023039490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7101066f0 0x7fa71010e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:22.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.483+0000 7fa715d69700 1 --2- 172.21.15.49:0/2023039490 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa710101610 0x7fa7101019f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:22.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.483+0000 7fa715d69700 1 --2- 172.21.15.49:0/2023039490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa710101fc0 0x7fa710106010 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:22.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.483+0000 7fa715d69700 1 -- 172.21.15.49:0/2023039490 >> 172.21.15.49:0/2023039490 conn(0x7fa710078430 msgr2=0x7fa710078840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:05:22.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.483+0000 7fa715d69700 1 -- 172.21.15.49:0/2023039490 shutdown_connections 2024-06-03T00:05:22.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.483+0000 7fa715d69700 1 -- 172.21.15.49:0/2023039490 wait complete. 2024-06-03T00:05:22.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.483+0000 7fa715d69700 1 Processor -- start 2024-06-03T00:05:22.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.484+0000 7fa715d69700 1 -- start start 2024-06-03T00:05:22.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.484+0000 7fa715d69700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa710101610 0x7fa710199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:22.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.484+0000 7fa715d69700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa710101fc0 0x7fa710199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:22.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.484+0000 7fa715d69700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7101066f0 0x7fa7101a4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:22.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.484+0000 7fa715d69700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa7101116b0 con 0x7fa7101066f0 2024-06-03T00:05:22.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.484+0000 7fa715d69700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa710111530 con 0x7fa710101610 2024-06-03T00:05:22.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.484+0000 7fa715d69700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa710111830 con 0x7fa710101fc0 2024-06-03T00:05:22.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.484+0000 7fa70ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7101066f0 0x7fa7101a4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:22.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.484+0000 7fa70ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7101066f0 0x7fa7101a4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53832/0 (socket says 172.21.15.49:53832) 2024-06-03T00:05:22.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.484+0000 7fa70ffff700 1 -- 172.21.15.49:0/2311231845 learned_addr learned my addr 172.21.15.49:0/2311231845 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:05:22.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.484+0000 7fa70effd700 1 --2- 172.21.15.49:0/2311231845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa710101fc0 0x7fa710199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:22.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.484+0000 7fa70f7fe700 1 --2- 172.21.15.49:0/2311231845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa710101610 0x7fa710199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:22.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.484+0000 7fa70ffff700 1 -- 172.21.15.49:0/2311231845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa710101fc0 msgr2=0x7fa710199f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:22.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.484+0000 7fa70ffff700 1 --2- 172.21.15.49:0/2311231845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa710101fc0 0x7fa710199f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:22.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.484+0000 7fa70ffff700 1 -- 172.21.15.49:0/2311231845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa710101610 msgr2=0x7fa710199a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:22.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.484+0000 7fa70ffff700 1 --2- 172.21.15.49:0/2311231845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa710101610 0x7fa710199a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:22.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.484+0000 7fa70ffff700 1 -- 172.21.15.49:0/2311231845 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7101a4ff0 con 0x7fa7101066f0 2024-06-03T00:05:22.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.484+0000 7fa70f7fe700 1 --2- 172.21.15.49:0/2311231845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa710101610 0x7fa710199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:05:22.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.485+0000 7fa70ffff700 1 --2- 172.21.15.49:0/2311231845 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7101066f0 0x7fa7101a4ab0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa708007d70 tx=0x7fa70800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:05:22.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.485+0000 7fa70cff9700 1 -- 172.21.15.49:0/2311231845 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa708016020 con 0x7fa7101066f0 2024-06-03T00:05:22.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.485+0000 7fa715d69700 1 -- 172.21.15.49:0/2311231845 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7101a5220 con 0x7fa7101066f0 2024-06-03T00:05:22.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.485+0000 7fa70cff9700 1 -- 172.21.15.49:0/2311231845 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa70800ad40 con 0x7fa7101066f0 2024-06-03T00:05:22.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.485+0000 7fa70cff9700 1 -- 172.21.15.49:0/2311231845 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa708011600 con 0x7fa7101066f0 2024-06-03T00:05:22.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.485+0000 7fa715d69700 1 -- 172.21.15.49:0/2311231845 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7101a56e0 con 0x7fa7101066f0 2024-06-03T00:05:22.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.487+0000 7fa70cff9700 1 -- 172.21.15.49:0/2311231845 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa708019020 con 0x7fa7101066f0 2024-06-03T00:05:22.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.488+0000 7fa70cff9700 1 --2- 172.21.15.49:0/2311231845 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa6f80a2c20 0x7fa6f80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:22.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.488+0000 7fa70f7fe700 1 --2- 172.21.15.49:0/2311231845 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa6f80a2c20 0x7fa6f80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:22.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.488+0000 7fa70cff9700 1 -- 172.21.15.49:0/2311231845 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fa7080cef80 con 0x7fa7101066f0 2024-06-03T00:05:22.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.488+0000 7fa70f7fe700 1 --2- 172.21.15.49:0/2311231845 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa6f80a2c20 0x7fa6f80a50e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa700005950 tx=0x7fa700005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:05:22.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.489+0000 7fa7205ecb80 1 Processor -- start 2024-06-03T00:05:22.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.489+0000 7fa7205ecb80 1 -- start start 2024-06-03T00:05:22.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.489+0000 7fa7205ecb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ba2afc470 0x558ba2afc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:22.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.489+0000 7fa7205ecb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558ba2afcd90 0x558ba2af6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:22.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.489+0000 7fa7205ecb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ba2af6bc0 0x558ba2af6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:22.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.489+0000 7fa7205ecb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x558ba29e8fd0 con 0x558ba2afc470 2024-06-03T00:05:22.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.489+0000 7fa7205ecb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x558ba2a478c0 con 0x558ba2af6bc0 2024-06-03T00:05:22.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.489+0000 7fa7205ecb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x558ba29af4d0 con 0x558ba2afcd90 2024-06-03T00:05:22.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.489+0000 7fa70f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ba2afc470 0x558ba2afc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:22.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.489+0000 7fa70f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ba2afc470 0x558ba2afc850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53838/0 (socket says 172.21.15.49:53838) 2024-06-03T00:05:22.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.489+0000 7fa70f7fe700 1 -- 172.21.15.49:0/1818095262 learned_addr learned my addr 172.21.15.49:0/1818095262 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:05:22.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.489+0000 7fa70effd700 1 --2- 172.21.15.49:0/1818095262 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558ba2afcd90 0x558ba2af6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:22.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.489+0000 7fa70ffff700 1 --2- 172.21.15.49:0/1818095262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ba2af6bc0 0x558ba2af6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:22.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.489+0000 7fa70f7fe700 1 -- 172.21.15.49:0/1818095262 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558ba2afcd90 msgr2=0x558ba2af6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:05:22.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.489+0000 7fa70f7fe700 1 --2- 172.21.15.49:0/1818095262 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558ba2afcd90 0x558ba2af6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:22.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.490+0000 7fa70f7fe700 1 -- 172.21.15.49:0/1818095262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ba2af6bc0 msgr2=0x558ba2af6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:05:22.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.490+0000 7fa70f7fe700 1 --2- 172.21.15.49:0/1818095262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ba2af6bc0 0x558ba2af6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:22.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.490+0000 7fa70f7fe700 1 -- 172.21.15.49:0/1818095262 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ba2996940 con 0x558ba2afc470 2024-06-03T00:05:22.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.490+0000 7fa70ffff700 1 --2- 172.21.15.49:0/1818095262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ba2af6bc0 0x558ba2af6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:05:22.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.490+0000 7fa70f7fe700 1 --2- 172.21.15.49:0/1818095262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ba2afc470 0x558ba2afc850 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa70000ed30 tx=0x7fa700011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161aed582b3d3d69 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:05:22.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.490+0000 7fa6f5ffb700 1 -- 172.21.15.49:0/1818095262 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa700021070 con 0x558ba2afc470 2024-06-03T00:05:22.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.490+0000 7fa6f5ffb700 1 -- 172.21.15.49:0/1818095262 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa700010d80 con 0x558ba2afc470 2024-06-03T00:05:22.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.490+0000 7fa6f5ffb700 1 -- 172.21.15.49:0/1818095262 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa70001d6b0 con 0x558ba2afc470 2024-06-03T00:05:22.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.491+0000 7fa7205ecb80 1 -- 172.21.15.49:0/1818095262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ba2afc470 msgr2=0x558ba2afc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:22.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.491+0000 7fa7205ecb80 1 --2- 172.21.15.49:0/1818095262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ba2afc470 0x558ba2afc850 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa70000ed30 tx=0x7fa700011000 comp rx=0 tx=0).stop 2024-06-03T00:05:22.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.491+0000 7fa7205ecb80 1 -- 172.21.15.49:0/1818095262 shutdown_connections 2024-06-03T00:05:22.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.491+0000 7fa7205ecb80 1 --2- 172.21.15.49:0/1818095262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ba2af6bc0 0x558ba2af6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:22.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.491+0000 7fa7205ecb80 1 --2- 172.21.15.49:0/1818095262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ba2afc470 0x558ba2afc850 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:22.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.491+0000 7fa7205ecb80 1 --2- 172.21.15.49:0/1818095262 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558ba2afcd90 0x558ba2af6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:22.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.491+0000 7fa7205ecb80 1 -- 172.21.15.49:0/1818095262 >> 172.21.15.49:0/1818095262 conn(0x558ba2a230f0 msgr2=0x558ba2af1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:05:22.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.491+0000 7fa7205ecb80 1 -- 172.21.15.49:0/1818095262 shutdown_connections 2024-06-03T00:05:22.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.491+0000 7fa7205ecb80 1 -- 172.21.15.49:0/1818095262 wait complete. 2024-06-03T00:05:22.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.491+0000 7fa7205ecb80 1 -- start start 2024-06-03T00:05:22.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.491+0000 7fa7205ecb80 1 Processor -- start 2024-06-03T00:05:22.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.492+0000 7fa7205ecb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ba2af6bc0 0x558ba2b02ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:22.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.492+0000 7fa7205ecb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ba2afc470 0x558ba2affdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:22.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.492+0000 7fa7205ecb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558ba2afcd90 0x558ba2b00300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:22.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.492+0000 7fa7205ecb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x558ba29e8030 con 0x558ba2af6bc0 2024-06-03T00:05:22.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.492+0000 7fa7205ecb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x558ba2a43880 con 0x558ba2afc470 2024-06-03T00:05:22.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.492+0000 7fa7205ecb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x558ba2b03770 con 0x558ba2afcd90 2024-06-03T00:05:22.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.492+0000 7fa7205ecb80 10 client.0 _ll_register_callbacks cb 0x558ba29dd620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:05:22.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.492+0000 7fa70f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ba2af6bc0 0x558ba2b02ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:22.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.492+0000 7fa70f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ba2af6bc0 0x558ba2b02ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53848/0 (socket says 172.21.15.49:53848) 2024-06-03T00:05:22.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.492+0000 7fa70f7fe700 1 -- 172.21.15.49:0/1912749778 learned_addr learned my addr 172.21.15.49:0/1912749778 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:05:22.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.492+0000 7fa70effd700 1 --2- 172.21.15.49:0/1912749778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ba2afc470 0x558ba2affdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:22.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.492+0000 7fa70ffff700 1 --2- 172.21.15.49:0/1912749778 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558ba2afcd90 0x558ba2b00300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:22.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.492+0000 7fa70f7fe700 1 -- 172.21.15.49:0/1912749778 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558ba2afcd90 msgr2=0x558ba2b00300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:05:22.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.492+0000 7fa70f7fe700 1 --2- 172.21.15.49:0/1912749778 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558ba2afcd90 0x558ba2b00300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:22.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.492+0000 7fa70f7fe700 1 -- 172.21.15.49:0/1912749778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ba2afc470 msgr2=0x558ba2affdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:05:22.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.492+0000 7fa70f7fe700 1 --2- 172.21.15.49:0/1912749778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ba2afc470 0x558ba2affdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:22.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.492+0000 7fa70f7fe700 1 -- 172.21.15.49:0/1912749778 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ba2a0d7c0 con 0x558ba2af6bc0 2024-06-03T00:05:22.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.492+0000 7fa70f7fe700 1 --2- 172.21.15.49:0/1912749778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ba2af6bc0 0x558ba2b02ac0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa700005440 tx=0x7fa700004970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44144a7c8ffc89eb server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:05:22.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.492+0000 7fa6eeffd700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:05:22.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.493+0000 7fa6eeffd700 1 -- 172.21.15.49:0/1912749778 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa700021040 con 0x558ba2af6bc0 2024-06-03T00:05:22.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.493+0000 7fa6eeffd700 1 -- 172.21.15.49:0/1912749778 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fa700004c30 con 0x558ba2af6bc0 2024-06-03T00:05:22.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.493+0000 7fa7205ecb80 1 -- 172.21.15.49:0/1912749778 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa700010d80 con 0x558ba2af6bc0 2024-06-03T00:05:22.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.493+0000 7fa6eeffd700 1 -- 172.21.15.49:0/1912749778 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fa700004e30 con 0x558ba2af6bc0 2024-06-03T00:05:22.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.493+0000 7fa7205ecb80 10 client.16419 fetch_fsmap learned FSMap version 38 2024-06-03T00:05:22.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.493+0000 7fa7205ecb80 1 -- 172.21.15.49:0/1912749778 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x558ba2b0de50 con 0x558ba2af6bc0 2024-06-03T00:05:22.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.493+0000 7fa6eeffd700 1 -- 172.21.15.49:0/1912749778 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa700010d80 con 0x558ba2af6bc0 2024-06-03T00:05:22.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.493+0000 7fa6eeffd700 1 -- 172.21.15.49:0/1912749778 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 38) ==== 8406+0+0 (secure 0 0 0) 0x7fa700031420 con 0x558ba2af6bc0 2024-06-03T00:05:22.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.493+0000 7fa7205ecb80 10 client.16419 fetch_fsmap finished waiting for FSMap version 38 2024-06-03T00:05:22.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.493+0000 7fa7205ecb80 10 client.16419 resolve_mds: validated gid 24487 aka daemon mds.i 2024-06-03T00:05:22.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.493+0000 7fa7205ecb80 20 client.16419 populate_metadata read hostname 'smithi049' 2024-06-03T00:05:22.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.493+0000 7fa7205ecb80 1 --2- 172.21.15.49:0/1912749778 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x558ba2b10320 0x558ba2b12710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:22.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.493+0000 7fa7205ecb80 4 client.16419 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-03T00:05:22.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.493+0000 7fa7205ecb80 1 -- 172.21.15.49:0/1912749778 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ba2a54dc0 con 0x558ba2b10320 2024-06-03T00:05:22.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.494+0000 7fa70effd700 1 --2- 172.21.15.49:0/1912749778 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x558ba2b10320 0x558ba2b12710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:22.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.494+0000 7fa6eeffd700 10 client.16419 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:05:22.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.494+0000 7fa70effd700 1 --2- 172.21.15.49:0/1912749778 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x558ba2b10320 0x558ba2b12710 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92d0a25d3366e805 server_cookie=e6ea713037b406df in_seq=0 out_seq=0 2024-06-03T00:05:22.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.495+0000 7fa6eeffd700 1 -- 172.21.15.49:0/1912749778 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x558ba2a54dc0 con 0x558ba2b10320 2024-06-03T00:05:22.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.495+0000 7fa6eeffd700 10 client.16419 handle_command_reply: tid=0 2024-06-03T00:05:22.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.495+0000 7fa7205ecb80 1 client.16419 shutdown 2024-06-03T00:05:22.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.495+0000 7fa7205ecb80 1 -- 172.21.15.49:0/1912749778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ba2af6bc0 msgr2=0x558ba2b02ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:22.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.495+0000 7fa7205ecb80 1 --2- 172.21.15.49:0/1912749778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ba2af6bc0 0x558ba2b02ac0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa700005440 tx=0x7fa700004970 comp rx=0 tx=0).stop 2024-06-03T00:05:22.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.495+0000 7fa7205ecb80 1 -- 172.21.15.49:0/1912749778 shutdown_connections 2024-06-03T00:05:22.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.495+0000 7fa7205ecb80 1 --2- 172.21.15.49:0/1912749778 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558ba2afcd90 0x558ba2b00300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:22.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.495+0000 7fa7205ecb80 1 --2- 172.21.15.49:0/1912749778 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x558ba2b10320 0x558ba2b12710 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:22.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.495+0000 7fa6eeffd700 0 client.16419 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:05:22.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.495+0000 7fa7205ecb80 1 --2- 172.21.15.49:0/1912749778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ba2af6bc0 0x558ba2b02ac0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:22.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.495+0000 7fa7205ecb80 1 --2- 172.21.15.49:0/1912749778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ba2afc470 0x558ba2affdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:22.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.495+0000 7fa7205ecb80 1 -- 172.21.15.49:0/1912749778 >> 172.21.15.49:0/1912749778 conn(0x558ba2a230f0 msgr2=0x558ba2af0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:05:22.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.495+0000 7fa7205ecb80 1 -- 172.21.15.49:0/1912749778 shutdown_connections 2024-06-03T00:05:22.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.495+0000 7fa7205ecb80 1 -- 172.21.15.49:0/1912749778 wait complete. 2024-06-03T00:05:22.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.495+0000 7fa7205ecb80 20 client.16419 trim_cache size 0 max 16384 2024-06-03T00:05:22.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.515+0000 7fa7205ecb80 1 Processor -- start 2024-06-03T00:05:22.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.515+0000 7fa7205ecb80 1 -- start start 2024-06-03T00:05:22.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.516+0000 7fa7205ecb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558ba2af6bc0 0x558ba2b02600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:22.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.516+0000 7fa7205ecb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ba2afc470 0x558ba2af5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:22.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.516+0000 7fa7205ecb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ba2afcd90 0x558ba2af12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:22.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.516+0000 7fa7205ecb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa7101accf0 con 0x558ba2afc470 2024-06-03T00:05:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.516+0000 7fa7205ecb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa7101aea40 con 0x558ba2afcd90 2024-06-03T00:05:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.516+0000 7fa7205ecb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa7101ad420 con 0x558ba2af6bc0 2024-06-03T00:05:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.516+0000 7fa70effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ba2afc470 0x558ba2af5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.516+0000 7fa70effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ba2afc470 0x558ba2af5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53862/0 (socket says 172.21.15.49:53862) 2024-06-03T00:05:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.516+0000 7fa70effd700 1 -- 172.21.15.49:0/2040299414 learned_addr learned my addr 172.21.15.49:0/2040299414 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:05:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.516+0000 7fa70f7fe700 1 --2- 172.21.15.49:0/2040299414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558ba2af6bc0 0x558ba2b02600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.516+0000 7fa70ffff700 1 --2- 172.21.15.49:0/2040299414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ba2afcd90 0x558ba2af12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.516+0000 7fa70effd700 1 -- 172.21.15.49:0/2040299414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558ba2af6bc0 msgr2=0x558ba2b02600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:05:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.516+0000 7fa70effd700 1 --2- 172.21.15.49:0/2040299414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558ba2af6bc0 0x558ba2b02600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.516+0000 7fa70effd700 1 -- 172.21.15.49:0/2040299414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ba2afcd90 msgr2=0x558ba2af12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:05:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.516+0000 7fa70effd700 1 --2- 172.21.15.49:0/2040299414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ba2afcd90 0x558ba2af12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.516+0000 7fa70effd700 1 -- 172.21.15.49:0/2040299414 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ba2afe330 con 0x558ba2afc470 2024-06-03T00:05:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.516+0000 7fa70ffff700 1 --2- 172.21.15.49:0/2040299414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ba2afcd90 0x558ba2af12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:05:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.516+0000 7fa70f7fe700 1 --2- 172.21.15.49:0/2040299414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558ba2af6bc0 0x558ba2b02600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:05:22.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.516+0000 7fa70effd700 1 --2- 172.21.15.49:0/2040299414 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ba2afc470 0x558ba2af5f00 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fa704003900 tx=0x7fa704005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb3e20e96ae1c0b server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:05:22.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.516+0000 7fa6f57fa700 1 -- 172.21.15.49:0/2040299414 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7040052b0 con 0x558ba2afc470 2024-06-03T00:05:22.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.516+0000 7fa6f57fa700 1 -- 172.21.15.49:0/2040299414 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa704003e20 con 0x558ba2afc470 2024-06-03T00:05:22.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.516+0000 7fa6f57fa700 1 -- 172.21.15.49:0/2040299414 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa70400f460 con 0x558ba2afc470 2024-06-03T00:05:22.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.517+0000 7fa7205ecb80 1 -- 172.21.15.49:0/2040299414 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ba2afc470 msgr2=0x558ba2af5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:22.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.517+0000 7fa7205ecb80 1 --2- 172.21.15.49:0/2040299414 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ba2afc470 0x558ba2af5f00 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fa704003900 tx=0x7fa704005040 comp rx=0 tx=0).stop 2024-06-03T00:05:22.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.517+0000 7fa7205ecb80 1 -- 172.21.15.49:0/2040299414 shutdown_connections 2024-06-03T00:05:22.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.517+0000 7fa7205ecb80 1 --2- 172.21.15.49:0/2040299414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ba2afcd90 0x558ba2af12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:22.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.517+0000 7fa7205ecb80 1 --2- 172.21.15.49:0/2040299414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558ba2af6bc0 0x558ba2b02600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:22.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.517+0000 7fa7205ecb80 1 --2- 172.21.15.49:0/2040299414 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ba2afc470 0x558ba2af5f00 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:22.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.517+0000 7fa7205ecb80 1 -- 172.21.15.49:0/2040299414 >> 172.21.15.49:0/2040299414 conn(0x558ba2a230f0 msgr2=0x558ba2afb920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:05:22.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.517+0000 7fa7205ecb80 1 -- 172.21.15.49:0/2040299414 shutdown_connections 2024-06-03T00:05:22.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.517+0000 7fa7205ecb80 1 -- 172.21.15.49:0/2040299414 wait complete. 2024-06-03T00:05:22.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.517+0000 7fa7205ecb80 1 -- start start 2024-06-03T00:05:22.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.518+0000 7fa7205ecb80 1 Processor -- start 2024-06-03T00:05:22.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.518+0000 7fa7205ecb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558ba2af6bc0 0x558ba2b17c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:22.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.518+0000 7fa7205ecb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ba2afc470 0x558ba2b181c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:22.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.518+0000 7fa7205ecb80 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ba2afcd90 0x558ba2b18700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:22.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.518+0000 7fa7205ecb80 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa7101ae2b0 con 0x558ba2afcd90 2024-06-03T00:05:22.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.518+0000 7fa7205ecb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa7101adb50 con 0x558ba2afc470 2024-06-03T00:05:22.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.518+0000 7fa7205ecb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa7101aac70 con 0x558ba2af6bc0 2024-06-03T00:05:22.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.518+0000 7fa7205ecb80 10 client.0 _ll_register_callbacks cb 0x558ba29dd620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-03T00:05:22.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.518+0000 7fa70ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ba2afcd90 0x558ba2b18700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:22.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.518+0000 7fa70ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ba2afcd90 0x558ba2b18700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53870/0 (socket says 172.21.15.49:53870) 2024-06-03T00:05:22.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.518+0000 7fa70ffff700 1 -- 172.21.15.49:0/1622912789 learned_addr learned my addr 172.21.15.49:0/1622912789 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:05:22.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.518+0000 7fa70f7fe700 1 --2- 172.21.15.49:0/1622912789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558ba2af6bc0 0x558ba2b17c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:22.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.518+0000 7fa70effd700 1 --2- 172.21.15.49:0/1622912789 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ba2afc470 0x558ba2b181c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:22.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.518+0000 7fa70ffff700 1 -- 172.21.15.49:0/1622912789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558ba2af6bc0 msgr2=0x558ba2b17c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:05:22.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.518+0000 7fa70ffff700 1 --2- 172.21.15.49:0/1622912789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558ba2af6bc0 0x558ba2b17c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:22.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.518+0000 7fa70ffff700 1 -- 172.21.15.49:0/1622912789 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ba2afc470 msgr2=0x558ba2b181c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:05:22.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.518+0000 7fa70ffff700 1 --2- 172.21.15.49:0/1622912789 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ba2afc470 0x558ba2b181c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:22.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.518+0000 7fa70ffff700 1 -- 172.21.15.49:0/1622912789 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ba2b7a020 con 0x558ba2afcd90 2024-06-03T00:05:22.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.519+0000 7fa70effd700 1 --2- 172.21.15.49:0/1622912789 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ba2afc470 0x558ba2b181c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:05:22.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.519+0000 7fa70ffff700 1 --2- 172.21.15.49:0/1622912789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ba2afcd90 0x558ba2b18700 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa70809b4e0 tx=0x7fa70809c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb604c3310e2c96 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:05:22.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.519+0000 7fa6eeffd700 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-06-03T00:05:22.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.519+0000 7fa6eeffd700 1 -- 172.21.15.49:0/1622912789 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7080a4450 con 0x558ba2afcd90 2024-06-03T00:05:22.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.519+0000 7fa6eeffd700 1 -- 172.21.15.49:0/1622912789 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fa708007aa0 con 0x558ba2afcd90 2024-06-03T00:05:22.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.519+0000 7fa7205ecb80 1 -- 172.21.15.49:0/1622912789 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa704003e20 con 0x558ba2afcd90 2024-06-03T00:05:22.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.519+0000 7fa6eeffd700 1 -- 172.21.15.49:0/1622912789 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fa7080ba170 con 0x558ba2afcd90 2024-06-03T00:05:22.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.519+0000 7fa7205ecb80 10 client.16425 fetch_fsmap learned FSMap version 38 2024-06-03T00:05:22.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.519+0000 7fa7205ecb80 1 -- 172.21.15.49:0/1622912789 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x558ba2b7b310 con 0x558ba2afcd90 2024-06-03T00:05:22.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.519+0000 7fa6eeffd700 1 -- 172.21.15.49:0/1622912789 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa704003e20 con 0x558ba2afcd90 2024-06-03T00:05:22.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.519+0000 7fa6eeffd700 1 -- 172.21.15.49:0/1622912789 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 38) ==== 8406+0+0 (secure 0 0 0) 0x7fa70809ac30 con 0x558ba2afcd90 2024-06-03T00:05:22.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.519+0000 7fa7205ecb80 10 client.16425 fetch_fsmap finished waiting for FSMap version 38 2024-06-03T00:05:22.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.519+0000 7fa7205ecb80 10 client.16425 resolve_mds: validated gid 24487 aka daemon mds.i 2024-06-03T00:05:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.519+0000 7fa7205ecb80 20 client.16425 populate_metadata read hostname 'smithi049' 2024-06-03T00:05:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.519+0000 7fa7205ecb80 1 --2- 172.21.15.49:0/1622912789 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x558ba2b10320 0x558ba2b7da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.519+0000 7fa7205ecb80 4 client.16425 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-06-03T00:05:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.520+0000 7fa7205ecb80 1 -- 172.21.15.49:0/1622912789 --> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x558ba2a4f340 con 0x558ba2b10320 2024-06-03T00:05:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.520+0000 7fa70f7fe700 1 --2- 172.21.15.49:0/1622912789 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x558ba2b10320 0x558ba2b7da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.520+0000 7fa70f7fe700 1 --2- 172.21.15.49:0/1622912789 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x558ba2b10320 0x558ba2b7da70 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b29016d5596d642 server_cookie=6c83984034f47a0d in_seq=0 out_seq=0 2024-06-03T00:05:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.520+0000 7fa6eeffd700 10 client.16425 ms_handle_connect on v2:172.21.15.107:6838/1986600681 2024-06-03T00:05:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.521+0000 7fa6eeffd700 1 -- 172.21.15.49:0/1622912789 <== mds.0 v2:172.21.15.107:6838/1986600681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x558ba2a4f340 con 0x558ba2b10320 2024-06-03T00:05:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.521+0000 7fa6eeffd700 10 client.16425 handle_command_reply: tid=0 2024-06-03T00:05:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.521+0000 7fa7205ecb80 1 client.16425 shutdown 2024-06-03T00:05:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.521+0000 7fa7205ecb80 1 -- 172.21.15.49:0/1622912789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ba2afcd90 msgr2=0x558ba2b18700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.521+0000 7fa7205ecb80 1 --2- 172.21.15.49:0/1622912789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ba2afcd90 0x558ba2b18700 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa70809b4e0 tx=0x7fa70809c010 comp rx=0 tx=0).stop 2024-06-03T00:05:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.521+0000 7fa7205ecb80 1 -- 172.21.15.49:0/1622912789 shutdown_connections 2024-06-03T00:05:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.521+0000 7fa7205ecb80 1 --2- 172.21.15.49:0/1622912789 >> [v2:172.21.15.107:6838/1986600681,v1:172.21.15.107:6839/1986600681] conn(0x558ba2b10320 0x558ba2b7da70 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:22.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.521+0000 7fa7205ecb80 1 --2- 172.21.15.49:0/1622912789 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558ba2afcd90 0x558ba2b18700 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:22.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.521+0000 7fa6eeffd700 0 client.16425 ms_handle_reset on v2:172.21.15.107:6838/1986600681 2024-06-03T00:05:22.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.521+0000 7fa7205ecb80 1 --2- 172.21.15.49:0/1622912789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558ba2af6bc0 0x558ba2b17c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:22.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.521+0000 7fa7205ecb80 1 --2- 172.21.15.49:0/1622912789 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ba2afc470 0x558ba2b181c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:22.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.521+0000 7fa7205ecb80 1 -- 172.21.15.49:0/1622912789 >> 172.21.15.49:0/1622912789 conn(0x558ba2a230f0 msgr2=0x558ba2af5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:05:22.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.521+0000 7fa7205ecb80 1 -- 172.21.15.49:0/1622912789 shutdown_connections 2024-06-03T00:05:22.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.521+0000 7fa7205ecb80 1 -- 172.21.15.49:0/1622912789 wait complete. 2024-06-03T00:05:22.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.521+0000 7fa7205ecb80 20 client.16425 trim_cache size 0 max 16384 2024-06-03T00:05:22.526 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:05:22.526 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 38, 2024-06-03T00:05:22.527 INFO:teuthology.orchestra.run.smithi049.stdout: "leader": 24487, 2024-06-03T00:05:22.527 INFO:teuthology.orchestra.run.smithi049.stdout: "set_version": 16, 2024-06-03T00:05:22.527 INFO:teuthology.orchestra.run.smithi049.stdout: "sets": {} 2024-06-03T00:05:22.527 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:05:22.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.522+0000 7fa715d69700 1 -- 172.21.15.49:0/2311231845 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa6f80a2c20 msgr2=0x7fa6f80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:22.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.522+0000 7fa715d69700 1 --2- 172.21.15.49:0/2311231845 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa6f80a2c20 0x7fa6f80a50e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa700005950 tx=0x7fa700005f50 comp rx=0 tx=0).stop 2024-06-03T00:05:22.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.522+0000 7fa715d69700 1 -- 172.21.15.49:0/2311231845 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7101066f0 msgr2=0x7fa7101a4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:22.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.522+0000 7fa715d69700 1 --2- 172.21.15.49:0/2311231845 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7101066f0 0x7fa7101a4ab0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa708007d70 tx=0x7fa70800a340 comp rx=0 tx=0).stop 2024-06-03T00:05:22.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.522+0000 7fa715d69700 1 -- 172.21.15.49:0/2311231845 shutdown_connections 2024-06-03T00:05:22.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.522+0000 7fa715d69700 1 --2- 172.21.15.49:0/2311231845 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fa6f80a2c20 0x7fa6f80a50e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:22.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.522+0000 7fa715d69700 1 --2- 172.21.15.49:0/2311231845 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7101066f0 0x7fa7101a4ab0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:22.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.522+0000 7fa715d69700 1 --2- 172.21.15.49:0/2311231845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa710101610 0x7fa710199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:22.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.522+0000 7fa715d69700 1 --2- 172.21.15.49:0/2311231845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa710101fc0 0x7fa710199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:22.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.522+0000 7fa715d69700 1 -- 172.21.15.49:0/2311231845 >> 172.21.15.49:0/2311231845 conn(0x7fa710078430 msgr2=0x7fa7100ff2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:05:22.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.522+0000 7fa715d69700 1 -- 172.21.15.49:0/2311231845 shutdown_connections 2024-06-03T00:05:22.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:22.522+0000 7fa715d69700 1 -- 172.21.15.49:0/2311231845 wait complete. 2024-06-03T00:05:23.326 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:22 smithi049 ceph-mon[32302]: pgmap v543: 97 pgs: 97 active+clean; 95 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 333 op/s 2024-06-03T00:05:23.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:22 smithi107 ceph-mon[37048]: pgmap v543: 97 pgs: 97 active+clean; 95 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 333 op/s 2024-06-03T00:05:23.355 INFO:tasks.quiescer:done joining Quiescers 2024-06-03T00:05:23.355 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-06-03T00:05:23.365 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi049.front.sepia.ceph.com 2024-06-03T00:05:23.404 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-06-03T00:05:23.414 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-06-03T00:05:23.415 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/fwd_scrub.py", line 155, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/fwd_scrub.py", line 90, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-06-03T00:05:23.415 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-06-03T00:05:23.425 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-03T00:05:23.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:22 smithi057 ceph-mon[36457]: pgmap v543: 97 pgs: 97 active+clean; 95 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 333 op/s 2024-06-03T00:05:23.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.554+0000 7fbfc44fc640 1 -- 172.21.15.49:0/2764436418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfbc100900 msgr2=0x7fbfbc100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:23.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.554+0000 7fbfc44fc640 1 --2- 172.21.15.49:0/2764436418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfbc100900 0x7fbfbc100d20 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8009900 tx=0x7fbfb802a410 comp rx=0 tx=0).stop 2024-06-03T00:05:23.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.554+0000 7fbfc44fc640 1 -- 172.21.15.49:0/2764436418 shutdown_connections 2024-06-03T00:05:23.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.554+0000 7fbfc44fc640 1 --2- 172.21.15.49:0/2764436418 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfbc1024b0 0x7fbfbc108d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:23.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.554+0000 7fbfc44fc640 1 --2- 172.21.15.49:0/2764436418 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfbc101af0 0x7fbfbc101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:23.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.554+0000 7fbfc44fc640 1 --2- 172.21.15.49:0/2764436418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfbc100900 0x7fbfbc100d20 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:23.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.554+0000 7fbfc44fc640 1 -- 172.21.15.49:0/2764436418 >> 172.21.15.49:0/2764436418 conn(0x7fbfbc0fbe70 msgr2=0x7fbfbc0fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:05:23.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.554+0000 7fbfc44fc640 1 -- 172.21.15.49:0/2764436418 shutdown_connections 2024-06-03T00:05:23.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.554+0000 7fbfc44fc640 1 -- 172.21.15.49:0/2764436418 wait complete. 2024-06-03T00:05:23.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.554+0000 7fbfc44fc640 1 Processor -- start 2024-06-03T00:05:23.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.554+0000 7fbfc44fc640 1 -- start start 2024-06-03T00:05:23.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.555+0000 7fbfc44fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfbc100900 0x7fbfbc06ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:23.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.555+0000 7fbfc44fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfbc101af0 0x7fbfbc19ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:23.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.555+0000 7fbfc44fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfbc1024b0 0x7fbfbc19f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:23.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.555+0000 7fbfc44fc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbfbc10c570 con 0x7fbfbc1024b0 2024-06-03T00:05:23.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.555+0000 7fbfc44fc640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fbfbc10c3f0 con 0x7fbfbc100900 2024-06-03T00:05:23.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.555+0000 7fbfc44fc640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbfbc10c6f0 con 0x7fbfbc101af0 2024-06-03T00:05:23.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.555+0000 7fbfc2a99640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfbc1024b0 0x7fbfbc19f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:23.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.555+0000 7fbfc2a99640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfbc1024b0 0x7fbfbc19f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59576/0 (socket says 172.21.15.49:59576) 2024-06-03T00:05:23.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.555+0000 7fbfc2a99640 1 -- 172.21.15.49:0/93968704 learned_addr learned my addr 172.21.15.49:0/93968704 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:05:23.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.555+0000 7fbfc2298640 1 --2- 172.21.15.49:0/93968704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfbc100900 0x7fbfbc06ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.555+0000 7fbfc1a97640 1 --2- 172.21.15.49:0/93968704 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfbc101af0 0x7fbfbc19ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.555+0000 7fbfc2a99640 1 -- 172.21.15.49:0/93968704 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfbc101af0 msgr2=0x7fbfbc19ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.555+0000 7fbfc2a99640 1 --2- 172.21.15.49:0/93968704 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfbc101af0 0x7fbfbc19ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.555+0000 7fbfc2a99640 1 -- 172.21.15.49:0/93968704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfbc100900 msgr2=0x7fbfbc06ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.555+0000 7fbfc2a99640 1 --2- 172.21.15.49:0/93968704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfbc100900 0x7fbfbc06ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.555+0000 7fbfc2a99640 1 -- 172.21.15.49:0/93968704 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfbc19f960 con 0x7fbfbc1024b0 2024-06-03T00:05:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.555+0000 7fbfc2298640 1 --2- 172.21.15.49:0/93968704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfbc100900 0x7fbfbc06ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:05:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.555+0000 7fbfc2a99640 1 --2- 172.21.15.49:0/93968704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfbc1024b0 0x7fbfbc19f050 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400cce0 tx=0x7fbfb400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:05:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.556+0000 7fbfb37fe640 1 -- 172.21.15.49:0/93968704 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb400f450 con 0x7fbfbc1024b0 2024-06-03T00:05:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.556+0000 7fbfb37fe640 1 -- 172.21.15.49:0/93968704 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfb400fad0 con 0x7fbfbc1024b0 2024-06-03T00:05:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.556+0000 7fbfc44fc640 1 -- 172.21.15.49:0/93968704 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfbc19fbf0 con 0x7fbfbc1024b0 2024-06-03T00:05:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.556+0000 7fbfb37fe640 1 -- 172.21.15.49:0/93968704 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4018c10 con 0x7fbfbc1024b0 2024-06-03T00:05:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.556+0000 7fbfc44fc640 1 -- 172.21.15.49:0/93968704 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfbc1a00f0 con 0x7fbfbc1024b0 2024-06-03T00:05:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.556+0000 7fbfc44fc640 1 -- 172.21.15.49:0/93968704 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfbc107c20 con 0x7fbfbc1024b0 2024-06-03T00:05:23.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.558+0000 7fbfb37fe640 1 -- 172.21.15.49:0/93968704 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbfb400f5f0 con 0x7fbfbc1024b0 2024-06-03T00:05:23.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.559+0000 7fbfb37fe640 1 --2- 172.21.15.49:0/93968704 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbfa80a2b90 0x7fbfa80a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:23.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.559+0000 7fbfc2298640 1 --2- 172.21.15.49:0/93968704 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbfa80a2b90 0x7fbfa80a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:23.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.559+0000 7fbfb37fe640 1 -- 172.21.15.49:0/93968704 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7fbfb40cf820 con 0x7fbfbc1024b0 2024-06-03T00:05:23.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.559+0000 7fbfc2298640 1 --2- 172.21.15.49:0/93968704 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbfa80a2b90 0x7fbfa80a5050 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8006010 tx=0x7fbfb8032dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:05:23.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.563+0000 7fbfb37fe640 1 -- 172.21.15.49:0/93968704 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fbfb4014030 con 0x7fbfbc1024b0 2024-06-03T00:05:23.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.750+0000 7fbfc44fc640 1 -- 172.21.15.49:0/93968704 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbfbc02d530 con 0x7fbfbc1024b0 2024-06-03T00:05:23.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.752+0000 7fbfb37fe640 1 -- 172.21.15.49:0/93968704 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+22612 (secure 0 0 0) 0x7fbfb409c810 con 0x7fbfbc1024b0 2024-06-03T00:05:23.752 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:05:23.752 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":90,"fsid":"890dd222-213a-11ef-bc9b-c7b262605968","created":"2024-06-02T23:48:53.323536+0000","modified":"2024-06-02T23:57:56.520324+0000","last_up_change":"2024-06-02T23:56:12.156697+0000","last_in_change":"2024-06-02T23:55:51.667118+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:52:23.676079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:57:10.753178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T23:57:14.240610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e0013e80-07d6-4ad3-87d8-d41988988ef5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6803","nonce":811647073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6805","nonce":811647073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6809","nonce":811647073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6807","nonce":811647073}]},"public_addr":"172.21.15.49:6803/811647073","cluster_addr":"172.21.15.49:6805/811647073","heartbeat_back_addr":"172.21.15.49:6809/811647073","heartbeat_front_addr":"172.21.15.49:6807/811647073","state":["exists","up"]},{"osd":1,"uuid":"f37d9f79-e349-4de7-81e7-385ddb905f58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6801","nonce":1260507785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6803","nonce":1260507785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6807","nonce":1260507785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6805","nonce":1260507785}]},"public_addr":"172.21.15.57:6801/1260507785","cluster_addr":"172.21.15.57:6803/1260507785","heartbeat_back_addr":"172.21.15.57:6807/1260507785","heartbeat_front_addr":"172.21.15.57:6805/1260507785","state":["exists","up"]},{"osd":2,"uuid":"94889281-7d45-4e78-9d37-b98e3fbe8494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6801","nonce":303899951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6803","nonce":303899951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6807","nonce":303899951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6805","nonce":303899951}]},"public_addr":"172.21.15.107:6801/303899951","cluster_addr":"172.21.15.107:6803/303899951","heartbeat_back_addr":"172.21.15.107:6807/303899951","heartbeat_front_addr":"172.21.15.107:6805/303899951","state":["exists","up"]},{"osd":3,"uuid":"31f4c18c-fbda-400d-8b3b-0955b0c4a6a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6811","nonce":60796312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6813","nonce":60796312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6817","nonce":60796312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6815","nonce":60796312}]},"public_addr":"172.21.15.49:6811/60796312","cluster_addr":"172.21.15.49:6813/60796312","heartbeat_back_addr":"172.21.15.49:6817/60796312","heartbeat_front_addr":"172.21.15.49:6815/60796312","state":["exists","up"]},{"osd":4,"uuid":"8076c2f3-0138-459e-89b5-c5c4586a14ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6809","nonce":3106842986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6811","nonce":3106842986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6815","nonce":3106842986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6813","nonce":3106842986}]},"public_addr":"172.21.15.57:6809/3106842986","cluster_addr":"172.21.15.57:6811/3106842986","heartbeat_back_addr":"172.21.15.57:6815/3106842986","heartbeat_front_addr":"172.21.15.57:6813/3106842986","state":["exists","up"]},{"osd":5,"uuid":"68f7abd3-4292-41fa-90ce-4ac34ea2b964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6809","nonce":389294142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6811","nonce":389294142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6815","nonce":389294142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6813","nonce":389294142}]},"public_addr":"172.21.15.107:6809/389294142","cluster_addr":"172.21.15.107:6811/389294142","heartbeat_back_addr":"172.21.15.107:6815/389294142","heartbeat_front_addr":"172.21.15.107:6813/389294142","state":["exists","up"]},{"osd":6,"uuid":"c0345dd0-71b7-436d-88f8-fe3d7cb69d8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6819","nonce":894624552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6821","nonce":894624552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6825","nonce":894624552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6823","nonce":894624552}]},"public_addr":"172.21.15.49:6819/894624552","cluster_addr":"172.21.15.49:6821/894624552","heartbeat_back_addr":"172.21.15.49:6825/894624552","heartbeat_front_addr":"172.21.15.49:6823/894624552","state":["exists","up"]},{"osd":7,"uuid":"9abd81c7-dcc1-4e14-8ab7-9fa0746067ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6817","nonce":3126027900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6819","nonce":3126027900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6823","nonce":3126027900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6821","nonce":3126027900}]},"public_addr":"172.21.15.57:6817/3126027900","cluster_addr":"172.21.15.57:6819/3126027900","heartbeat_back_addr":"172.21.15.57:6823/3126027900","heartbeat_front_addr":"172.21.15.57:6821/3126027900","state":["exists","up"]},{"osd":8,"uuid":"80532119-5de8-45d2-9cb9-bd8a6194199b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6817","nonce":3620047229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6819","nonce":3620047229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6823","nonce":3620047229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6821","nonce":3620047229}]},"public_addr":"172.21.15.107:6817/3620047229","cluster_addr":"172.21.15.107:6819/3620047229","heartbeat_back_addr":"172.21.15.107:6823/3620047229","heartbeat_front_addr":"172.21.15.107:6821/3620047229","state":["exists","up"]},{"osd":9,"uuid":"f0b5dcfa-9fd2-4a98-863b-197defa890af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6827","nonce":3627936526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6829","nonce":3627936526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6833","nonce":3627936526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6831","nonce":3627936526}]},"public_addr":"172.21.15.49:6827/3627936526","cluster_addr":"172.21.15.49:6829/3627936526","heartbeat_back_addr":"172.21.15.49:6833/3627936526","heartbeat_front_addr":"172.21.15.49:6831/3627936526","state":["exists","up"]},{"osd":10,"uuid":"21a75846-adec-41b8-9e1d-e5c61ba30b12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6825","nonce":3013235811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6827","nonce":3013235811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6831","nonce":3013235811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6829","nonce":3013235811}]},"public_addr":"172.21.15.57:6825/3013235811","cluster_addr":"172.21.15.57:6827/3013235811","heartbeat_back_addr":"172.21.15.57:6831/3013235811","heartbeat_front_addr":"172.21.15.57:6829/3013235811","state":["exists","up"]},{"osd":11,"uuid":"eb963b63-2c61-4169-b8fe-31c7f5ec919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6825","nonce":4217534517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6827","nonce":4217534517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6831","nonce":4217534517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6829","nonce":4217534517}]},"public_addr":"172.21.15.107:6825/4217534517","cluster_addr":"172.21.15.107:6827/4217534517","heartbeat_back_addr":"172.21.15.107:6831/4217534517","heartbeat_front_addr":"172.21.15.107:6829/4217534517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:51:31.067312+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:51:56.088456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:52:20.539941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:52:45.055717+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:53:11.178438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:53:35.794217+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:00.775674+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:27.574752+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:52.177634+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:55:17.118854+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:55:44.217535+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:56:10.500970+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/525944311":"2024-06-03T23:49:55.151590+0000","172.21.15.49:0/1841969299":"2024-06-03T23:49:55.151590+0000","172.21.15.49:0/1880506696":"2024-06-03T23:49:55.151590+0000","172.21.15.49:6801/1206062338":"2024-06-03T23:49:55.151590+0000","172.21.15.49:6800/549058216":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/2112783954":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/2183920213":"2024-06-03T23:49:29.042670+0000","172.21.15.49:6801/549058216":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/3350970308":"2024-06-03T23:49:29.042670+0000","172.21.15.49:6800/1206062338":"2024-06-03T23:49:55.151590+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-03T00:05:23.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.754+0000 7fbfc44fc640 1 -- 172.21.15.49:0/93968704 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbfa80a2b90 msgr2=0x7fbfa80a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:23.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.754+0000 7fbfc44fc640 1 --2- 172.21.15.49:0/93968704 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbfa80a2b90 0x7fbfa80a5050 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8006010 tx=0x7fbfb8032dd0 comp rx=0 tx=0).stop 2024-06-03T00:05:23.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.754+0000 7fbfc44fc640 1 -- 172.21.15.49:0/93968704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfbc1024b0 msgr2=0x7fbfbc19f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:23.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.754+0000 7fbfc44fc640 1 --2- 172.21.15.49:0/93968704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfbc1024b0 0x7fbfbc19f050 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400cce0 tx=0x7fbfb400a620 comp rx=0 tx=0).stop 2024-06-03T00:05:23.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.754+0000 7fbfc44fc640 1 -- 172.21.15.49:0/93968704 shutdown_connections 2024-06-03T00:05:23.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.754+0000 7fbfc44fc640 1 --2- 172.21.15.49:0/93968704 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fbfa80a2b90 0x7fbfa80a5050 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:23.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.754+0000 7fbfc44fc640 1 --2- 172.21.15.49:0/93968704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfbc1024b0 0x7fbfbc19f050 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:23.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.754+0000 7fbfc44fc640 1 --2- 172.21.15.49:0/93968704 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfbc101af0 0x7fbfbc19ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:23.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.754+0000 7fbfc44fc640 1 --2- 172.21.15.49:0/93968704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfbc100900 0x7fbfbc06ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:23.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.754+0000 7fbfc44fc640 1 -- 172.21.15.49:0/93968704 >> 172.21.15.49:0/93968704 conn(0x7fbfbc0fbe70 msgr2=0x7fbfbc104df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:05:23.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.755+0000 7fbfc44fc640 1 -- 172.21.15.49:0/93968704 shutdown_connections 2024-06-03T00:05:23.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.755+0000 7fbfc44fc640 1 -- 172.21.15.49:0/93968704 wait complete. 2024-06-03T00:05:23.766 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T23:52:23.676079+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-02T23:57:10.753178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-02T23:57:14.240610+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-03T00:05:23.767 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-03T00:05:23.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.875+0000 7f5acb190640 1 -- 172.21.15.49:0/996922935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ac4101af0 msgr2=0x7f5ac4101f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:23.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.875+0000 7f5acb190640 1 --2- 172.21.15.49:0/996922935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ac4101af0 0x7f5ac4101f70 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4009ca0 tx=0x7f5ab402a8c0 comp rx=0 tx=0).stop 2024-06-03T00:05:23.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.875+0000 7f5acb190640 1 -- 172.21.15.49:0/996922935 shutdown_connections 2024-06-03T00:05:23.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.875+0000 7f5acb190640 1 --2- 172.21.15.49:0/996922935 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ac41024b0 0x7f5ac4108d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:23.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.875+0000 7f5acb190640 1 --2- 172.21.15.49:0/996922935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ac4101af0 0x7f5ac4101f70 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:23.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.875+0000 7f5acb190640 1 --2- 172.21.15.49:0/996922935 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ac4100900 0x7f5ac4100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:23.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.875+0000 7f5acb190640 1 -- 172.21.15.49:0/996922935 >> 172.21.15.49:0/996922935 conn(0x7f5ac40fbe90 msgr2=0x7f5ac40fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:05:23.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.875+0000 7f5acb190640 1 -- 172.21.15.49:0/996922935 shutdown_connections 2024-06-03T00:05:23.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.875+0000 7f5acb190640 1 -- 172.21.15.49:0/996922935 wait complete. 2024-06-03T00:05:23.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.875+0000 7f5acb190640 1 Processor -- start 2024-06-03T00:05:23.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.875+0000 7f5acb190640 1 -- start start 2024-06-03T00:05:23.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.876+0000 7f5acb190640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ac4100900 0x7f5ac4197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:23.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.876+0000 7f5acb190640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ac4101af0 0x7f5ac41982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:23.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.876+0000 7f5acb190640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ac41024b0 0x7f5ac419f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:23.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.876+0000 7f5acb190640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac410c580 con 0x7f5ac4101af0 2024-06-03T00:05:23.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.876+0000 7f5acb190640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac410c400 con 0x7f5ac4100900 2024-06-03T00:05:23.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.876+0000 7f5acb190640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac410c700 con 0x7f5ac41024b0 2024-06-03T00:05:23.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.876+0000 7f5ac3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ac4101af0 0x7f5ac41982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:23.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.876+0000 7f5ac3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ac4101af0 0x7f5ac41982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59588/0 (socket says 172.21.15.49:59588) 2024-06-03T00:05:23.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.876+0000 7f5ac3fff640 1 -- 172.21.15.49:0/4231962782 learned_addr learned my addr 172.21.15.49:0/4231962782 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:05:23.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.876+0000 7f5ac8f2c640 1 --2- 172.21.15.49:0/4231962782 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ac4100900 0x7f5ac4197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:23.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.876+0000 7f5ac972d640 1 --2- 172.21.15.49:0/4231962782 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ac41024b0 0x7f5ac419f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:23.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.876+0000 7f5ac3fff640 1 -- 172.21.15.49:0/4231962782 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ac41024b0 msgr2=0x7f5ac419f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:23.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.876+0000 7f5ac3fff640 1 --2- 172.21.15.49:0/4231962782 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ac41024b0 0x7f5ac419f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:23.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.876+0000 7f5ac3fff640 1 -- 172.21.15.49:0/4231962782 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ac4100900 msgr2=0x7f5ac4197d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:23.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.876+0000 7f5ac3fff640 1 --2- 172.21.15.49:0/4231962782 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ac4100900 0x7f5ac4197d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:23.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.876+0000 7f5ac3fff640 1 -- 172.21.15.49:0/4231962782 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac419f990 con 0x7f5ac4101af0 2024-06-03T00:05:23.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.876+0000 7f5ac972d640 1 --2- 172.21.15.49:0/4231962782 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ac41024b0 0x7f5ac419f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:05:23.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.876+0000 7f5ac3fff640 1 --2- 172.21.15.49:0/4231962782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ac4101af0 0x7f5ac41982b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4031a40 tx=0x7f5ab4031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:05:23.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.876+0000 7f5ac1ffb640 1 -- 172.21.15.49:0/4231962782 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab402fa20 con 0x7f5ac4101af0 2024-06-03T00:05:23.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.876+0000 7f5ac1ffb640 1 -- 172.21.15.49:0/4231962782 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ab402fbc0 con 0x7f5ac4101af0 2024-06-03T00:05:23.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.876+0000 7f5ac1ffb640 1 -- 172.21.15.49:0/4231962782 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab403a780 con 0x7f5ac4101af0 2024-06-03T00:05:23.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.876+0000 7f5acb190640 1 -- 172.21.15.49:0/4231962782 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac419fc20 con 0x7f5ac4101af0 2024-06-03T00:05:23.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.877+0000 7f5acb190640 1 -- 172.21.15.49:0/4231962782 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac41a01c0 con 0x7f5ac4101af0 2024-06-03T00:05:23.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.878+0000 7f5acb190640 1 -- 172.21.15.49:0/4231962782 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ac41a0390 con 0x7f5ac4101af0 2024-06-03T00:05:23.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.879+0000 7f5ac1ffb640 1 -- 172.21.15.49:0/4231962782 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5ab403a920 con 0x7f5ac4101af0 2024-06-03T00:05:23.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.880+0000 7f5ac1ffb640 1 --2- 172.21.15.49:0/4231962782 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f5ab00a2c10 0x7f5ab00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:23.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.880+0000 7f5ac8f2c640 1 --2- 172.21.15.49:0/4231962782 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f5ab00a2c10 0x7f5ab00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:23.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.880+0000 7f5ac1ffb640 1 -- 172.21.15.49:0/4231962782 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f5ab40f05a0 con 0x7f5ac4101af0 2024-06-03T00:05:23.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.880+0000 7f5ac8f2c640 1 --2- 172.21.15.49:0/4231962782 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f5ab00a2c10 0x7f5ab00a50d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4101950 tx=0x7f5aac00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:05:23.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:23.884+0000 7f5ac1ffb640 1 -- 172.21.15.49:0/4231962782 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5ab40bd500 con 0x7f5ac4101af0 2024-06-03T00:05:24.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.068+0000 7f5acb190640 1 -- 172.21.15.49:0/4231962782 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5ac41a0720 con 0x7f5ac4101af0 2024-06-03T00:05:24.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.069+0000 7f5ac1ffb640 1 -- 172.21.15.49:0/4231962782 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) ==== 93+0+10 (secure 0 0 0) 0x7f5ab40bce00 con 0x7f5ac4101af0 2024-06-03T00:05:24.069 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-06-03T00:05:24.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.070+0000 7f5acb190640 1 -- 172.21.15.49:0/4231962782 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f5ab00a2c10 msgr2=0x7f5ab00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:24.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.070+0000 7f5acb190640 1 --2- 172.21.15.49:0/4231962782 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f5ab00a2c10 0x7f5ab00a50d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4101950 tx=0x7f5aac00b390 comp rx=0 tx=0).stop 2024-06-03T00:05:24.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.070+0000 7f5acb190640 1 -- 172.21.15.49:0/4231962782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ac4101af0 msgr2=0x7f5ac41982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:24.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.070+0000 7f5acb190640 1 --2- 172.21.15.49:0/4231962782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ac4101af0 0x7f5ac41982b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4031a40 tx=0x7f5ab4031ee0 comp rx=0 tx=0).stop 2024-06-03T00:05:24.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.071+0000 7f5acb190640 1 -- 172.21.15.49:0/4231962782 shutdown_connections 2024-06-03T00:05:24.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.071+0000 7f5acb190640 1 --2- 172.21.15.49:0/4231962782 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f5ab00a2c10 0x7f5ab00a50d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:24.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.071+0000 7f5acb190640 1 --2- 172.21.15.49:0/4231962782 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ac41024b0 0x7f5ac419f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:24.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.071+0000 7f5acb190640 1 --2- 172.21.15.49:0/4231962782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ac4101af0 0x7f5ac41982b0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:24.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.071+0000 7f5acb190640 1 --2- 172.21.15.49:0/4231962782 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ac4100900 0x7f5ac4197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:24.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.071+0000 7f5acb190640 1 -- 172.21.15.49:0/4231962782 >> 172.21.15.49:0/4231962782 conn(0x7f5ac40fbe90 msgr2=0x7f5ac4069fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:05:24.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.071+0000 7f5acb190640 1 -- 172.21.15.49:0/4231962782 shutdown_connections 2024-06-03T00:05:24.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.071+0000 7f5acb190640 1 -- 172.21.15.49:0/4231962782 wait complete. 2024-06-03T00:05:24.080 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:23 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/93968704' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-03T00:05:24.082 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-03T00:05:24.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.189+0000 7f50659a5640 1 -- 172.21.15.49:0/3843868677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5060102490 msgr2=0x7f5060108d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:24.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.189+0000 7f50659a5640 1 --2- 172.21.15.49:0/3843868677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5060102490 0x7f5060108d20 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f5058009ca0 tx=0x7f505802a8c0 comp rx=0 tx=0).stop 2024-06-03T00:05:24.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.189+0000 7f50659a5640 1 -- 172.21.15.49:0/3843868677 shutdown_connections 2024-06-03T00:05:24.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.189+0000 7f50659a5640 1 --2- 172.21.15.49:0/3843868677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5060102490 0x7f5060108d20 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:24.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.189+0000 7f50659a5640 1 --2- 172.21.15.49:0/3843868677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5060101ad0 0x7f5060101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:24.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.189+0000 7f50659a5640 1 --2- 172.21.15.49:0/3843868677 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50601008e0 0x7f5060100d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:24.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.189+0000 7f50659a5640 1 -- 172.21.15.49:0/3843868677 >> 172.21.15.49:0/3843868677 conn(0x7f50600fbe50 msgr2=0x7f50600fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:05:24.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.189+0000 7f50659a5640 1 -- 172.21.15.49:0/3843868677 shutdown_connections 2024-06-03T00:05:24.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.189+0000 7f50659a5640 1 -- 172.21.15.49:0/3843868677 wait complete. 2024-06-03T00:05:24.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.190+0000 7f50659a5640 1 Processor -- start 2024-06-03T00:05:24.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.190+0000 7f50659a5640 1 -- start start 2024-06-03T00:05:24.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.190+0000 7f50659a5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50601008e0 0x7f5060199ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:24.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.190+0000 7f50659a5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5060101ad0 0x7f506019a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:24.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.190+0000 7f50659a5640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5060102490 0x7f50601a1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:24.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.190+0000 7f50659a5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f506010c560 con 0x7f50601008e0 2024-06-03T00:05:24.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.190+0000 7f50659a5640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f506010c3e0 con 0x7f5060102490 2024-06-03T00:05:24.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.190+0000 7f50659a5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f506010c6e0 con 0x7f5060101ad0 2024-06-03T00:05:24.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.190+0000 7f505effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50601008e0 0x7f5060199ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:24.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.190+0000 7f505effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50601008e0 0x7f5060199ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59602/0 (socket says 172.21.15.49:59602) 2024-06-03T00:05:24.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.190+0000 7f505effd640 1 -- 172.21.15.49:0/1248775917 learned_addr learned my addr 172.21.15.49:0/1248775917 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:05:24.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.191+0000 7f505f7fe640 1 --2- 172.21.15.49:0/1248775917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5060102490 0x7f50601a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:24.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.191+0000 7f505e7fc640 1 --2- 172.21.15.49:0/1248775917 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5060101ad0 0x7f506019a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:24.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.191+0000 7f505effd640 1 -- 172.21.15.49:0/1248775917 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5060101ad0 msgr2=0x7f506019a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:24.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.191+0000 7f505effd640 1 --2- 172.21.15.49:0/1248775917 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5060101ad0 0x7f506019a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:24.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.191+0000 7f505effd640 1 -- 172.21.15.49:0/1248775917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5060102490 msgr2=0x7f50601a1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:24.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.191+0000 7f505effd640 1 --2- 172.21.15.49:0/1248775917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5060102490 0x7f50601a1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:24.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.191+0000 7f505effd640 1 -- 172.21.15.49:0/1248775917 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50601a1ac0 con 0x7f50601008e0 2024-06-03T00:05:24.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.191+0000 7f505e7fc640 1 --2- 172.21.15.49:0/1248775917 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5060101ad0 0x7f506019a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:05:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.191+0000 7f505f7fe640 1 --2- 172.21.15.49:0/1248775917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5060102490 0x7f50601a1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:05:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.191+0000 7f505effd640 1 --2- 172.21.15.49:0/1248775917 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50601008e0 0x7f5060199ea0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f505000e9c0 tx=0x7f505000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:05:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.191+0000 7f50649a3640 1 -- 172.21.15.49:0/1248775917 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505000cd80 con 0x7f50601008e0 2024-06-03T00:05:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.191+0000 7f50649a3640 1 -- 172.21.15.49:0/1248775917 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50500035f0 con 0x7f50601008e0 2024-06-03T00:05:24.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.191+0000 7f50659a5640 1 -- 172.21.15.49:0/1248775917 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50601a1db0 con 0x7f50601008e0 2024-06-03T00:05:24.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.191+0000 7f50649a3640 1 -- 172.21.15.49:0/1248775917 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5050010690 con 0x7f50601008e0 2024-06-03T00:05:24.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.191+0000 7f50659a5640 1 -- 172.21.15.49:0/1248775917 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50601a2270 con 0x7f50601008e0 2024-06-03T00:05:24.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.192+0000 7f50659a5640 1 -- 172.21.15.49:0/1248775917 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50601a2500 con 0x7f50601008e0 2024-06-03T00:05:24.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.193+0000 7f50649a3640 1 -- 172.21.15.49:0/1248775917 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f50500037a0 con 0x7f50601008e0 2024-06-03T00:05:24.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.194+0000 7f50649a3640 1 --2- 172.21.15.49:0/1248775917 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f50480a2c10 0x7f50480a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:24.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.194+0000 7f505e7fc640 1 --2- 172.21.15.49:0/1248775917 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f50480a2c10 0x7f50480a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:24.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.194+0000 7f50649a3640 1 -- 172.21.15.49:0/1248775917 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f50500cf530 con 0x7f50601008e0 2024-06-03T00:05:24.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.194+0000 7f505e7fc640 1 --2- 172.21.15.49:0/1248775917 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f50480a2c10 0x7f50480a50d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f506019b3b0 tx=0x7f5054005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:05:24.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.198+0000 7f50649a3640 1 -- 172.21.15.49:0/1248775917 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f505009c490 con 0x7f50601008e0 2024-06-03T00:05:24.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:23 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/93968704' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-03T00:05:24.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.383+0000 7f50659a5640 1 -- 172.21.15.49:0/1248775917 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f50601a2e60 con 0x7f50601008e0 2024-06-03T00:05:24.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.383+0000 7f50649a3640 1 -- 172.21.15.49:0/1248775917 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) ==== 104+0+11 (secure 0 0 0) 0x7f505009bd90 con 0x7f50601008e0 2024-06-03T00:05:24.383 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-06-03T00:05:24.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.385+0000 7f50659a5640 1 -- 172.21.15.49:0/1248775917 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f50480a2c10 msgr2=0x7f50480a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:24.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.385+0000 7f50659a5640 1 --2- 172.21.15.49:0/1248775917 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f50480a2c10 0x7f50480a50d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f506019b3b0 tx=0x7f5054005f90 comp rx=0 tx=0).stop 2024-06-03T00:05:24.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.385+0000 7f50659a5640 1 -- 172.21.15.49:0/1248775917 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50601008e0 msgr2=0x7f5060199ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:24.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.385+0000 7f50659a5640 1 --2- 172.21.15.49:0/1248775917 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50601008e0 0x7f5060199ea0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f505000e9c0 tx=0x7f505000ee80 comp rx=0 tx=0).stop 2024-06-03T00:05:24.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.385+0000 7f50659a5640 1 -- 172.21.15.49:0/1248775917 shutdown_connections 2024-06-03T00:05:24.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.385+0000 7f50659a5640 1 --2- 172.21.15.49:0/1248775917 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f50480a2c10 0x7f50480a50d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:24.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.385+0000 7f50659a5640 1 --2- 172.21.15.49:0/1248775917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5060102490 0x7f50601a1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:24.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.385+0000 7f50659a5640 1 --2- 172.21.15.49:0/1248775917 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5060101ad0 0x7f506019a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:24.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.385+0000 7f50659a5640 1 --2- 172.21.15.49:0/1248775917 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50601008e0 0x7f5060199ea0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:24.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.385+0000 7f50659a5640 1 -- 172.21.15.49:0/1248775917 >> 172.21.15.49:0/1248775917 conn(0x7f50600fbe50 msgr2=0x7f50600fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:05:24.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.385+0000 7f50659a5640 1 -- 172.21.15.49:0/1248775917 shutdown_connections 2024-06-03T00:05:24.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.385+0000 7f50659a5640 1 -- 172.21.15.49:0/1248775917 wait complete. 2024-06-03T00:05:24.396 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-03T00:05:24.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:23 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/93968704' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-03T00:05:24.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.504+0000 7f4fbb163640 1 -- 172.21.15.49:0/3889153300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fb41008e0 msgr2=0x7f4fb4100d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:24.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.504+0000 7f4fbb163640 1 --2- 172.21.15.49:0/3889153300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fb41008e0 0x7f4fb4100d00 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4009900 tx=0x7f4fa402a410 comp rx=0 tx=0).stop 2024-06-03T00:05:24.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.504+0000 7f4fbb163640 1 -- 172.21.15.49:0/3889153300 shutdown_connections 2024-06-03T00:05:24.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.504+0000 7f4fbb163640 1 --2- 172.21.15.49:0/3889153300 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fb4101ad0 0x7f4fb4101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:24.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.504+0000 7f4fbb163640 1 --2- 172.21.15.49:0/3889153300 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fb4102490 0x7f4fb4108d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:24.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.504+0000 7f4fbb163640 1 --2- 172.21.15.49:0/3889153300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fb41008e0 0x7f4fb4100d00 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:24.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.504+0000 7f4fbb163640 1 -- 172.21.15.49:0/3889153300 >> 172.21.15.49:0/3889153300 conn(0x7f4fb40fbe50 msgr2=0x7f4fb40fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:05:24.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.504+0000 7f4fbb163640 1 -- 172.21.15.49:0/3889153300 shutdown_connections 2024-06-03T00:05:24.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.504+0000 7f4fbb163640 1 -- 172.21.15.49:0/3889153300 wait complete. 2024-06-03T00:05:24.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.504+0000 7f4fbb163640 1 Processor -- start 2024-06-03T00:05:24.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.504+0000 7f4fbb163640 1 -- start start 2024-06-03T00:05:24.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.504+0000 7f4fbb163640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fb41008e0 0x7f4fb410b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:24.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.504+0000 7f4fbb163640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fb4101ad0 0x7f4fb41098a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:24.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.505+0000 7f4fbb163640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fb4102490 0x7f4fb4109de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:24.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.505+0000 7f4fbb163640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb410d680 con 0x7f4fb41008e0 2024-06-03T00:05:24.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.505+0000 7f4fbb163640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb410d500 con 0x7f4fb4101ad0 2024-06-03T00:05:24.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.505+0000 7f4fbb163640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb410d800 con 0x7f4fb4102490 2024-06-03T00:05:24.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.505+0000 7f4fb8eff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fb41008e0 0x7f4fb410b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:24.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.505+0000 7f4fb8eff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fb41008e0 0x7f4fb410b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59612/0 (socket says 172.21.15.49:59612) 2024-06-03T00:05:24.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.505+0000 7f4fb8eff640 1 -- 172.21.15.49:0/2245324628 learned_addr learned my addr 172.21.15.49:0/2245324628 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:05:24.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.505+0000 7f4fb9700640 1 --2- 172.21.15.49:0/2245324628 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fb4102490 0x7f4fb4109de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:24.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.505+0000 7f4fb8eff640 1 -- 172.21.15.49:0/2245324628 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fb4102490 msgr2=0x7f4fb4109de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:24.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.505+0000 7f4fb8eff640 1 --2- 172.21.15.49:0/2245324628 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fb4102490 0x7f4fb4109de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:24.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.505+0000 7f4fb8eff640 1 -- 172.21.15.49:0/2245324628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fb4101ad0 msgr2=0x7f4fb41098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:24.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.505+0000 7f4fb3fff640 1 --2- 172.21.15.49:0/2245324628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fb4101ad0 0x7f4fb41098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:24.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.505+0000 7f4fb8eff640 1 --2- 172.21.15.49:0/2245324628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fb4101ad0 0x7f4fb41098a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:24.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.505+0000 7f4fb8eff640 1 -- 172.21.15.49:0/2245324628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fb410a670 con 0x7f4fb41008e0 2024-06-03T00:05:24.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.505+0000 7f4fb3fff640 1 --2- 172.21.15.49:0/2245324628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fb4101ad0 0x7f4fb41098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:05:24.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.505+0000 7f4fb8eff640 1 --2- 172.21.15.49:0/2245324628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fb41008e0 0x7f4fb410b260 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4031610 tx=0x7f4fa40043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:05:24.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.505+0000 7f4fb1ffb640 1 -- 172.21.15.49:0/2245324628 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa403f030 con 0x7f4fb41008e0 2024-06-03T00:05:24.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.505+0000 7f4fb1ffb640 1 -- 172.21.15.49:0/2245324628 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fa4003ce0 con 0x7f4fb41008e0 2024-06-03T00:05:24.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.505+0000 7f4fb1ffb640 1 -- 172.21.15.49:0/2245324628 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4035070 con 0x7f4fb41008e0 2024-06-03T00:05:24.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.505+0000 7f4fbb163640 1 -- 172.21.15.49:0/2245324628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fb41a1e20 con 0x7f4fb41008e0 2024-06-03T00:05:24.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.506+0000 7f4fbb163640 1 -- 172.21.15.49:0/2245324628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fb41a2230 con 0x7f4fb41008e0 2024-06-03T00:05:24.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.507+0000 7f4fbb163640 1 -- 172.21.15.49:0/2245324628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fb4107cd0 con 0x7f4fb41008e0 2024-06-03T00:05:24.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.509+0000 7f4fb1ffb640 1 -- 172.21.15.49:0/2245324628 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4fa4042030 con 0x7f4fb41008e0 2024-06-03T00:05:24.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.509+0000 7f4fb1ffb640 1 --2- 172.21.15.49:0/2245324628 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f4f9c0a2b90 0x7f4f9c0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:24.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.509+0000 7f4fb3fff640 1 --2- 172.21.15.49:0/2245324628 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f4f9c0a2b90 0x7f4f9c0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:24.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.509+0000 7f4fb1ffb640 1 -- 172.21.15.49:0/2245324628 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f4fa40ef860 con 0x7f4fb41008e0 2024-06-03T00:05:24.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.510+0000 7f4fb3fff640 1 --2- 172.21.15.49:0/2245324628 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f4f9c0a2b90 0x7f4f9c0a5050 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4fb410afd0 tx=0x7f4fa8005d30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:05:24.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.513+0000 7f4fb1ffb640 1 -- 172.21.15.49:0/2245324628 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4fa40bc7c0 con 0x7f4fb41008e0 2024-06-03T00:05:24.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.696+0000 7f4fbb163640 1 -- 172.21.15.49:0/2245324628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4fb402d2e0 con 0x7f4fb41008e0 2024-06-03T00:05:24.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.696+0000 7f4fb1ffb640 1 -- 172.21.15.49:0/2245324628 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) ==== 100+0+11 (secure 0 0 0) 0x7f4fa40bc0c0 con 0x7f4fb41008e0 2024-06-03T00:05:24.696 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-06-03T00:05:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.698+0000 7f4fbb163640 1 -- 172.21.15.49:0/2245324628 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f4f9c0a2b90 msgr2=0x7f4f9c0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.698+0000 7f4fbb163640 1 --2- 172.21.15.49:0/2245324628 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f4f9c0a2b90 0x7f4f9c0a5050 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4fb410afd0 tx=0x7f4fa8005d30 comp rx=0 tx=0).stop 2024-06-03T00:05:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.698+0000 7f4fbb163640 1 -- 172.21.15.49:0/2245324628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fb41008e0 msgr2=0x7f4fb410b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.698+0000 7f4fbb163640 1 --2- 172.21.15.49:0/2245324628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fb41008e0 0x7f4fb410b260 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4031610 tx=0x7f4fa40043b0 comp rx=0 tx=0).stop 2024-06-03T00:05:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.699+0000 7f4fbb163640 1 -- 172.21.15.49:0/2245324628 shutdown_connections 2024-06-03T00:05:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.699+0000 7f4fbb163640 1 --2- 172.21.15.49:0/2245324628 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f4f9c0a2b90 0x7f4f9c0a5050 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.699+0000 7f4fbb163640 1 --2- 172.21.15.49:0/2245324628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fb4101ad0 0x7f4fb41098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.699+0000 7f4fbb163640 1 --2- 172.21.15.49:0/2245324628 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fb4102490 0x7f4fb4109de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.699+0000 7f4fbb163640 1 --2- 172.21.15.49:0/2245324628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fb41008e0 0x7f4fb410b260 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.699+0000 7f4fbb163640 1 -- 172.21.15.49:0/2245324628 >> 172.21.15.49:0/2245324628 conn(0x7f4fb40fbe50 msgr2=0x7f4fb4104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:05:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.699+0000 7f4fbb163640 1 -- 172.21.15.49:0/2245324628 shutdown_connections 2024-06-03T00:05:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.699+0000 7f4fbb163640 1 -- 172.21.15.49:0/2245324628 wait complete. 2024-06-03T00:05:24.709 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-06-03T00:05:24.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.814+0000 7f01d6b9d640 1 -- 172.21.15.49:0/651190549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01d0101ad0 msgr2=0x7f01d0101f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:24.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.814+0000 7f01d6b9d640 1 --2- 172.21.15.49:0/651190549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01d0101ad0 0x7f01d0101f50 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f01c0009900 tx=0x7f01c002a410 comp rx=0 tx=0).stop 2024-06-03T00:05:24.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.815+0000 7f01d6b9d640 1 -- 172.21.15.49:0/651190549 shutdown_connections 2024-06-03T00:05:24.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.815+0000 7f01d6b9d640 1 --2- 172.21.15.49:0/651190549 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01d0102490 0x7f01d0108d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:24.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.815+0000 7f01d6b9d640 1 --2- 172.21.15.49:0/651190549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01d0101ad0 0x7f01d0101f50 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:24.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.815+0000 7f01d6b9d640 1 --2- 172.21.15.49:0/651190549 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01d01008e0 0x7f01d0100d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:24.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.815+0000 7f01d6b9d640 1 -- 172.21.15.49:0/651190549 >> 172.21.15.49:0/651190549 conn(0x7f01d00fbe50 msgr2=0x7f01d00fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:05:24.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.815+0000 7f01d6b9d640 1 -- 172.21.15.49:0/651190549 shutdown_connections 2024-06-03T00:05:24.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.815+0000 7f01d6b9d640 1 -- 172.21.15.49:0/651190549 wait complete. 2024-06-03T00:05:24.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.815+0000 7f01d6b9d640 1 Processor -- start 2024-06-03T00:05:24.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.815+0000 7f01d6b9d640 1 -- start start 2024-06-03T00:05:24.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.815+0000 7f01d6b9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01d01008e0 0x7f01d00696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:24.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.815+0000 7f01d6b9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01d0101ad0 0x7f01d019ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:24.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.815+0000 7f01d6b9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01d0102490 0x7f01d019f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:24.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.815+0000 7f01d6b9d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f01d010c5b0 con 0x7f01d01008e0 2024-06-03T00:05:24.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.815+0000 7f01d6b9d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f01d010c430 con 0x7f01d0102490 2024-06-03T00:05:24.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.815+0000 7f01d6b9d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f01d010c730 con 0x7f01d0101ad0 2024-06-03T00:05:24.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.815+0000 7f01d4939640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01d01008e0 0x7f01d00696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:24.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.815+0000 7f01d4939640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01d01008e0 0x7f01d00696c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59626/0 (socket says 172.21.15.49:59626) 2024-06-03T00:05:24.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.816+0000 7f01d4939640 1 -- 172.21.15.49:0/3925890571 learned_addr learned my addr 172.21.15.49:0/3925890571 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:05:24.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.816+0000 7f01cffff640 1 --2- 172.21.15.49:0/3925890571 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01d0101ad0 0x7f01d019ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:24.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.816+0000 7f01d4939640 1 -- 172.21.15.49:0/3925890571 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01d0101ad0 msgr2=0x7f01d019ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:24.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.816+0000 7f01d4939640 1 --2- 172.21.15.49:0/3925890571 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01d0101ad0 0x7f01d019ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:24.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.816+0000 7f01d4939640 1 -- 172.21.15.49:0/3925890571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01d0102490 msgr2=0x7f01d019f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:24.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.816+0000 7f01d4939640 1 --2- 172.21.15.49:0/3925890571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01d0102490 0x7f01d019f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:24.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.816+0000 7f01d4939640 1 -- 172.21.15.49:0/3925890571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01d019f950 con 0x7f01d01008e0 2024-06-03T00:05:24.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.816+0000 7f01d4939640 1 --2- 172.21.15.49:0/3925890571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01d01008e0 0x7f01d00696c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f01c800ccb0 tx=0x7f01c800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:05:24.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.816+0000 7f01cdffb640 1 -- 172.21.15.49:0/3925890571 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c8004b20 con 0x7f01d01008e0 2024-06-03T00:05:24.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.816+0000 7f01cdffb640 1 -- 172.21.15.49:0/3925890571 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01c8004cc0 con 0x7f01d01008e0 2024-06-03T00:05:24.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.816+0000 7f01d6b9d640 1 -- 172.21.15.49:0/3925890571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01d019fc40 con 0x7f01d01008e0 2024-06-03T00:05:24.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.816+0000 7f01cdffb640 1 -- 172.21.15.49:0/3925890571 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c8005020 con 0x7f01d01008e0 2024-06-03T00:05:24.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.816+0000 7f01d6b9d640 1 -- 172.21.15.49:0/3925890571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01d01a0190 con 0x7f01d01008e0 2024-06-03T00:05:24.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.817+0000 7f01d6b9d640 1 -- 172.21.15.49:0/3925890571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01d0107c00 con 0x7f01d01008e0 2024-06-03T00:05:24.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.818+0000 7f01cdffb640 1 -- 172.21.15.49:0/3925890571 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f01c8004000 con 0x7f01d01008e0 2024-06-03T00:05:24.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.819+0000 7f01cdffb640 1 --2- 172.21.15.49:0/3925890571 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f01bc0a2c10 0x7f01bc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:05:24.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.819+0000 7f01cffff640 1 --2- 172.21.15.49:0/3925890571 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f01bc0a2c10 0x7f01bc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:05:24.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.819+0000 7f01cdffb640 1 -- 172.21.15.49:0/3925890571 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f01c80cf1a0 con 0x7f01d01008e0 2024-06-03T00:05:24.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.820+0000 7f01cffff640 1 --2- 172.21.15.49:0/3925890571 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f01bc0a2c10 0x7f01bc0a50d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f01c0031610 tx=0x7f01c0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:05:24.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:24.823+0000 7f01cdffb640 1 -- 172.21.15.49:0/3925890571 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f01c8014030 con 0x7f01d01008e0 2024-06-03T00:05:25.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:25.062+0000 7f01d6b9d640 1 -- 172.21.15.49:0/3925890571 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f01d0062640 con 0x7f01d01008e0 2024-06-03T00:05:25.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:25.070+0000 7f01cdffb640 1 -- 172.21.15.49:0/3925890571 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+740369 (secure 0 0 0) 0x7f01c809c100 con 0x7f01d01008e0 2024-06-03T00:05:25.081 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:05:25.082 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:05:25.082 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 18, 2024-06-03T00:05:25.082 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.082 INFO:teuthology.orchestra.run.smithi049.stdout: "active_gid": 14152, 2024-06-03T00:05:25.082 INFO:teuthology.orchestra.run.smithi049.stdout: "active_name": "x", 2024-06-03T00:05:25.082 INFO:teuthology.orchestra.run.smithi049.stdout: "active_addrs": { 2024-06-03T00:05:25.082 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2024-06-03T00:05:25.082 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.083 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2024-06-03T00:05:25.083 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6800", 2024-06-03T00:05:25.083 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 2948657177 2024-06-03T00:05:25.083 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.083 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.083 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-06-03T00:05:25.083 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6801", 2024-06-03T00:05:25.083 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 2948657177 2024-06-03T00:05:25.084 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.084 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-06-03T00:05:25.084 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.084 INFO:teuthology.orchestra.run.smithi049.stdout: "active_addr": "172.21.15.49:6801/2948657177", 2024-06-03T00:05:25.084 INFO:teuthology.orchestra.run.smithi049.stdout: "active_change": "2024-06-02T23:49:55.151699+0000", 2024-06-03T00:05:25.084 INFO:teuthology.orchestra.run.smithi049.stdout: "active_mgr_features": 4540701547738038271, 2024-06-03T00:05:25.084 INFO:teuthology.orchestra.run.smithi049.stdout: "available": true, 2024-06-03T00:05:25.084 INFO:teuthology.orchestra.run.smithi049.stdout: "standbys": [ 2024-06-03T00:05:25.084 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.084 INFO:teuthology.orchestra.run.smithi049.stdout: "gid": 24112, 2024-06-03T00:05:25.084 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "z", 2024-06-03T00:05:25.084 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr_features": 4540701547738038271, 2024-06-03T00:05:25.084 INFO:teuthology.orchestra.run.smithi049.stdout: "available_modules": [ 2024-06-03T00:05:25.084 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.085 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "alerts", 2024-06-03T00:05:25.085 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.085 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.085 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.085 INFO:teuthology.orchestra.run.smithi049.stdout: "interval": { 2024-06-03T00:05:25.085 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "interval", 2024-06-03T00:05:25.085 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.085 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.085 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.085 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "60", 2024-06-03T00:05:25.085 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.085 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.085 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.086 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "How frequently to reexamine health status", 2024-06-03T00:05:25.086 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.086 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.086 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.086 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.086 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.086 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.086 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.087 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.087 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.087 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.087 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.087 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.087 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.087 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.087 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.087 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.087 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.088 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.088 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.088 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.088 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.088 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.088 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.088 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.088 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.088 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.088 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.088 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.088 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.088 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.089 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.089 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.089 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.089 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.089 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.089 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.089 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.089 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.089 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.089 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.089 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.090 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.090 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.090 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.090 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.090 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.090 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.091 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.091 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.091 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.091 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.091 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.091 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.091 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.092 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.092 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.092 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.092 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.092 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.092 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.093 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.093 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.093 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.093 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.093 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.093 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.093 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.094 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.094 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.094 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.094 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.094 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.094 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.094 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.095 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_destination": { 2024-06-03T00:05:25.095 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_destination", 2024-06-03T00:05:25.095 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.095 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.095 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.095 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.095 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.096 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.096 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.096 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Email address to send alerts to", 2024-06-03T00:05:25.096 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.096 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.096 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.096 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.097 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_from_name": { 2024-06-03T00:05:25.097 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_from_name", 2024-06-03T00:05:25.097 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.097 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.097 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.097 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "Ceph", 2024-06-03T00:05:25.097 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.097 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.098 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.098 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Email From: name", 2024-06-03T00:05:25.098 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.098 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.098 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.098 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.098 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_host": { 2024-06-03T00:05:25.099 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_host", 2024-06-03T00:05:25.099 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.099 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.099 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.099 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.099 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.099 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.100 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.100 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "SMTP server", 2024-06-03T00:05:25.100 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.100 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.100 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.100 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.100 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_password": { 2024-06-03T00:05:25.101 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_password", 2024-06-03T00:05:25.102 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.102 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.102 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.102 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.102 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.102 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.102 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.102 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Password to authenticate with", 2024-06-03T00:05:25.102 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.102 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.103 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.103 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.103 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_port": { 2024-06-03T00:05:25.103 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_port", 2024-06-03T00:05:25.103 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.103 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.103 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.103 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "465", 2024-06-03T00:05:25.103 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.103 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.103 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.103 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "SMTP port", 2024-06-03T00:05:25.103 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.103 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.104 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.104 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.104 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_sender": { 2024-06-03T00:05:25.104 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_sender", 2024-06-03T00:05:25.104 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.104 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.104 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.104 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.104 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.104 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.104 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.104 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "SMTP envelope sender", 2024-06-03T00:05:25.104 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.104 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.105 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.105 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.105 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_ssl": { 2024-06-03T00:05:25.105 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_ssl", 2024-06-03T00:05:25.105 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.105 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.105 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.105 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.105 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.105 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.105 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.105 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Use SSL to connect to SMTP server", 2024-06-03T00:05:25.105 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.106 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.106 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.106 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.106 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_user": { 2024-06-03T00:05:25.106 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_user", 2024-06-03T00:05:25.106 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.106 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.106 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.106 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.106 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.106 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.106 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.106 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "User to authenticate as", 2024-06-03T00:05:25.107 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.107 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.107 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.107 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.107 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.107 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.107 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.107 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "balancer", 2024-06-03T00:05:25.107 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.107 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.107 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.107 INFO:teuthology.orchestra.run.smithi049.stdout: "active": { 2024-06-03T00:05:25.107 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "active", 2024-06-03T00:05:25.108 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.108 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.108 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.108 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.108 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.108 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.108 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.108 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "automatically balance PGs across cluster", 2024-06-03T00:05:25.108 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.108 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.108 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.108 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.108 INFO:teuthology.orchestra.run.smithi049.stdout: "begin_time": { 2024-06-03T00:05:25.108 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "begin_time", 2024-06-03T00:05:25.108 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.109 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.109 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.109 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0000", 2024-06-03T00:05:25.109 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.109 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.109 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.109 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "beginning time of day to automatically balance", 2024-06-03T00:05:25.109 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-03T00:05:25.109 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.109 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.109 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.109 INFO:teuthology.orchestra.run.smithi049.stdout: "begin_weekday": { 2024-06-03T00:05:25.109 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "begin_weekday", 2024-06-03T00:05:25.110 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "uint", 2024-06-03T00:05:25.110 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.110 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.110 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-06-03T00:05:25.110 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "0", 2024-06-03T00:05:25.110 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "6", 2024-06-03T00:05:25.110 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.110 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-06-03T00:05:25.110 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-03T00:05:25.110 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.110 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.110 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.110 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_compat_max_iterations": { 2024-06-03T00:05:25.111 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "crush_compat_max_iterations", 2024-06-03T00:05:25.111 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "uint", 2024-06-03T00:05:25.111 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.111 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.111 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "25", 2024-06-03T00:05:25.111 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "1", 2024-06-03T00:05:25.111 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "250", 2024-06-03T00:05:25.111 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.111 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-06-03T00:05:25.111 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.111 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.111 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.111 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.111 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_compat_metrics": { 2024-06-03T00:05:25.112 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "crush_compat_metrics", 2024-06-03T00:05:25.112 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.112 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.112 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.112 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "pgs,objects,bytes", 2024-06-03T00:05:25.112 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.112 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.112 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.112 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-06-03T00:05:25.112 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-06-03T00:05:25.112 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.112 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.112 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.112 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_compat_step": { 2024-06-03T00:05:25.113 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "crush_compat_step", 2024-06-03T00:05:25.113 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-06-03T00:05:25.113 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.113 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.113 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0.5", 2024-06-03T00:05:25.113 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "0.001", 2024-06-03T00:05:25.113 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "0.999", 2024-06-03T00:05:25.113 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.113 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "aggressiveness of optimization", 2024-06-03T00:05:25.113 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-06-03T00:05:25.113 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.113 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.113 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.113 INFO:teuthology.orchestra.run.smithi049.stdout: "end_time": { 2024-06-03T00:05:25.114 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "end_time", 2024-06-03T00:05:25.114 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.114 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.114 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.114 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "2359", 2024-06-03T00:05:25.114 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.114 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.114 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.114 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "ending time of day to automatically balance", 2024-06-03T00:05:25.114 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-03T00:05:25.114 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.114 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.114 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.114 INFO:teuthology.orchestra.run.smithi049.stdout: "end_weekday": { 2024-06-03T00:05:25.115 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "end_weekday", 2024-06-03T00:05:25.115 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "uint", 2024-06-03T00:05:25.115 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.115 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.115 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-06-03T00:05:25.115 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "0", 2024-06-03T00:05:25.115 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "6", 2024-06-03T00:05:25.115 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.115 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-06-03T00:05:25.115 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-03T00:05:25.115 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.115 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.115 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.115 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.116 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.116 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.116 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.116 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.116 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.116 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.116 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.116 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.116 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.116 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.116 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.116 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.116 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.116 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.116 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.117 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.117 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.117 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.117 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.117 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.117 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.117 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.117 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.117 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.117 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.117 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.117 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.117 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.117 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.118 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.118 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.118 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.118 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.118 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.118 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.118 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.118 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.118 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.118 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.118 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.118 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.119 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.119 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.119 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.119 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.119 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.119 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.119 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.119 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.119 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.119 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.119 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.119 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.119 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.119 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.120 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.120 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.120 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.120 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.120 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.120 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.120 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.120 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.120 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.120 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.120 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.120 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.120 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.120 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.121 INFO:teuthology.orchestra.run.smithi049.stdout: "min_score": { 2024-06-03T00:05:25.121 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "min_score", 2024-06-03T00:05:25.121 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-06-03T00:05:25.121 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.121 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.121 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-06-03T00:05:25.121 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.121 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.121 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.121 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-06-03T00:05:25.121 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.121 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.121 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.121 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.122 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": { 2024-06-03T00:05:25.122 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mode", 2024-06-03T00:05:25.122 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.122 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.122 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.122 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "upmap", 2024-06-03T00:05:25.122 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.122 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.122 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.122 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-compat", 2024-06-03T00:05:25.122 INFO:teuthology.orchestra.run.smithi049.stdout: "none", 2024-06-03T00:05:25.122 INFO:teuthology.orchestra.run.smithi049.stdout: "read", 2024-06-03T00:05:25.122 INFO:teuthology.orchestra.run.smithi049.stdout: "upmap", 2024-06-03T00:05:25.123 INFO:teuthology.orchestra.run.smithi049.stdout: "upmap-read" 2024-06-03T00:05:25.123 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.123 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Balancer mode", 2024-06-03T00:05:25.123 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.123 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.123 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.123 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.123 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_ids": { 2024-06-03T00:05:25.123 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "pool_ids", 2024-06-03T00:05:25.123 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.123 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.123 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.123 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.123 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.124 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.124 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.124 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-06-03T00:05:25.124 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.124 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.124 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.124 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.124 INFO:teuthology.orchestra.run.smithi049.stdout: "sleep_interval": { 2024-06-03T00:05:25.124 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sleep_interval", 2024-06-03T00:05:25.124 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.124 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.124 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.124 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "60", 2024-06-03T00:05:25.125 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.125 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.125 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.125 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-06-03T00:05:25.125 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.125 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.125 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.125 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.125 INFO:teuthology.orchestra.run.smithi049.stdout: "upmap_max_deviation": { 2024-06-03T00:05:25.125 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "upmap_max_deviation", 2024-06-03T00:05:25.125 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.125 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.125 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.125 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5", 2024-06-03T00:05:25.126 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "1", 2024-06-03T00:05:25.126 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.126 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.126 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "deviation below which no optimization is attempted", 2024-06-03T00:05:25.126 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-06-03T00:05:25.126 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.126 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.126 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.126 INFO:teuthology.orchestra.run.smithi049.stdout: "upmap_max_optimizations": { 2024-06-03T00:05:25.126 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "upmap_max_optimizations", 2024-06-03T00:05:25.126 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "uint", 2024-06-03T00:05:25.126 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.126 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.126 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-06-03T00:05:25.127 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.127 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.127 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.127 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-06-03T00:05:25.127 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.127 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.127 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.127 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.127 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.127 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.127 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.127 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cephadm", 2024-06-03T00:05:25.127 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.127 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.128 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.128 INFO:teuthology.orchestra.run.smithi049.stdout: "agent_down_multiplier": { 2024-06-03T00:05:25.128 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "agent_down_multiplier", 2024-06-03T00:05:25.128 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-06-03T00:05:25.128 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.128 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.128 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "3.0", 2024-06-03T00:05:25.128 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.128 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.128 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.128 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-06-03T00:05:25.128 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.128 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.128 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.129 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.129 INFO:teuthology.orchestra.run.smithi049.stdout: "agent_refresh_rate": { 2024-06-03T00:05:25.129 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "agent_refresh_rate", 2024-06-03T00:05:25.129 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.129 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.129 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.129 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "20", 2024-06-03T00:05:25.129 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.129 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.129 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.129 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-06-03T00:05:25.129 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.129 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.129 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.130 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.130 INFO:teuthology.orchestra.run.smithi049.stdout: "agent_starting_port": { 2024-06-03T00:05:25.130 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "agent_starting_port", 2024-06-03T00:05:25.130 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.130 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.130 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.130 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "4721", 2024-06-03T00:05:25.130 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.130 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.130 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.130 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-06-03T00:05:25.130 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.130 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.131 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.131 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.131 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_ptrace": { 2024-06-03T00:05:25.131 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "allow_ptrace", 2024-06-03T00:05:25.131 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.131 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.131 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.131 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.131 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.131 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.131 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.131 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-06-03T00:05:25.131 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-06-03T00:05:25.132 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.132 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.132 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.132 INFO:teuthology.orchestra.run.smithi049.stdout: "autotune_interval": { 2024-06-03T00:05:25.132 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "autotune_interval", 2024-06-03T00:05:25.132 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.132 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.132 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.132 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "600", 2024-06-03T00:05:25.132 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.132 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.132 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.132 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how frequently to autotune daemon memory", 2024-06-03T00:05:25.133 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.133 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.133 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.133 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.133 INFO:teuthology.orchestra.run.smithi049.stdout: "autotune_memory_target_ratio": { 2024-06-03T00:05:25.133 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "autotune_memory_target_ratio", 2024-06-03T00:05:25.133 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-06-03T00:05:25.133 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.133 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.133 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0.7", 2024-06-03T00:05:25.133 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.133 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.133 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.133 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-06-03T00:05:25.134 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.134 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.134 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.134 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.134 INFO:teuthology.orchestra.run.smithi049.stdout: "cephadm_log_destination": { 2024-06-03T00:05:25.134 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cephadm_log_destination", 2024-06-03T00:05:25.134 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.134 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.134 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.134 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.134 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.134 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.134 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.135 INFO:teuthology.orchestra.run.smithi049.stdout: "file", 2024-06-03T00:05:25.135 INFO:teuthology.orchestra.run.smithi049.stdout: "file,syslog", 2024-06-03T00:05:25.135 INFO:teuthology.orchestra.run.smithi049.stdout: "syslog" 2024-06-03T00:05:25.135 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.135 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-06-03T00:05:25.135 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.135 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.135 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.135 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.135 INFO:teuthology.orchestra.run.smithi049.stdout: "cgroups_split": { 2024-06-03T00:05:25.135 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cgroups_split", 2024-06-03T00:05:25.135 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.135 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.135 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.136 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.136 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.136 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.136 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.136 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-06-03T00:05:25.136 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.136 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.136 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.136 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.136 INFO:teuthology.orchestra.run.smithi049.stdout: "config_checks_enabled": { 2024-06-03T00:05:25.136 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "config_checks_enabled", 2024-06-03T00:05:25.136 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.136 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.136 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.137 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.137 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.137 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.137 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.137 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-06-03T00:05:25.137 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.137 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.137 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.137 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.137 INFO:teuthology.orchestra.run.smithi049.stdout: "config_dashboard": { 2024-06-03T00:05:25.137 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "config_dashboard", 2024-06-03T00:05:25.137 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.137 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.137 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.138 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.138 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.138 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.138 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.138 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-06-03T00:05:25.138 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.138 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.138 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.138 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.138 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_alertmanager": { 2024-06-03T00:05:25.138 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_alertmanager", 2024-06-03T00:05:25.138 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.138 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.138 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.139 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-06-03T00:05:25.139 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.139 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.139 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.139 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Prometheus container image", 2024-06-03T00:05:25.139 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.139 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.139 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.139 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.139 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_base": { 2024-06-03T00:05:25.139 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_base", 2024-06-03T00:05:25.139 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.139 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.139 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.139 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/ceph", 2024-06-03T00:05:25.140 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.140 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.140 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.140 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Container image name, without the tag", 2024-06-03T00:05:25.140 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.140 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.140 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.140 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.140 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_elasticsearch": { 2024-06-03T00:05:25.140 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_elasticsearch", 2024-06-03T00:05:25.140 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.140 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.140 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.141 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-06-03T00:05:25.141 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.141 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.141 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.141 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "elasticsearch container image", 2024-06-03T00:05:25.141 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.141 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.141 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.141 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.141 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_grafana": { 2024-06-03T00:05:25.141 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_grafana", 2024-06-03T00:05:25.141 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.141 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.141 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.141 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-06-03T00:05:25.142 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.142 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.142 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.142 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Prometheus container image", 2024-06-03T00:05:25.142 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.142 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.142 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.142 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.142 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_haproxy": { 2024-06-03T00:05:25.142 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_haproxy", 2024-06-03T00:05:25.142 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.142 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.142 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.143 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-06-03T00:05:25.143 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.143 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.143 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.143 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "HAproxy container image", 2024-06-03T00:05:25.143 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.143 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.143 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.143 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.143 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_jaeger_agent": { 2024-06-03T00:05:25.143 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_jaeger_agent", 2024-06-03T00:05:25.143 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.143 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.144 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.144 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-06-03T00:05:25.144 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.144 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.144 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.144 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Jaeger agent container image", 2024-06-03T00:05:25.144 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.144 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.144 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.144 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.144 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_jaeger_collector": { 2024-06-03T00:05:25.144 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_jaeger_collector", 2024-06-03T00:05:25.144 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.144 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.145 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.145 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-06-03T00:05:25.145 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.145 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.145 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.145 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Jaeger collector container image", 2024-06-03T00:05:25.145 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.145 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.145 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.145 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.145 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_jaeger_query": { 2024-06-03T00:05:25.145 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_jaeger_query", 2024-06-03T00:05:25.145 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.145 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.146 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.146 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-06-03T00:05:25.146 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.146 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.146 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.146 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Jaeger query container image", 2024-06-03T00:05:25.146 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.146 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.146 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.146 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.146 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_keepalived": { 2024-06-03T00:05:25.146 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_keepalived", 2024-06-03T00:05:25.146 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.146 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.147 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.147 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-06-03T00:05:25.147 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.147 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.147 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.147 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Keepalived container image", 2024-06-03T00:05:25.147 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.147 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.147 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.147 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.147 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_loki": { 2024-06-03T00:05:25.147 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_loki", 2024-06-03T00:05:25.147 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.147 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.148 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.148 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-06-03T00:05:25.148 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.148 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.148 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.148 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Loki container image", 2024-06-03T00:05:25.148 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.148 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.148 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.148 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.148 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_node_exporter": { 2024-06-03T00:05:25.148 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_node_exporter", 2024-06-03T00:05:25.148 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.148 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.149 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.149 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-06-03T00:05:25.149 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.149 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.149 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.149 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Prometheus container image", 2024-06-03T00:05:25.149 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.149 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.149 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.149 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.149 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_nvmeof": { 2024-06-03T00:05:25.149 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_nvmeof", 2024-06-03T00:05:25.149 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.149 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.149 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.150 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-06-03T00:05:25.150 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.150 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.150 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.150 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Nvme-of container image", 2024-06-03T00:05:25.150 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.150 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.150 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.150 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.150 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_prometheus": { 2024-06-03T00:05:25.150 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_prometheus", 2024-06-03T00:05:25.150 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.150 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.150 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.151 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-06-03T00:05:25.151 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.151 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.151 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.151 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Prometheus container image", 2024-06-03T00:05:25.151 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.151 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.151 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.151 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.151 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_promtail": { 2024-06-03T00:05:25.151 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_promtail", 2024-06-03T00:05:25.151 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.151 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.151 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.151 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-06-03T00:05:25.152 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.152 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.152 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.152 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Promtail container image", 2024-06-03T00:05:25.152 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.152 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.152 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.152 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.152 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_samba": { 2024-06-03T00:05:25.152 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_samba", 2024-06-03T00:05:25.152 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.152 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.152 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.152 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-06-03T00:05:25.153 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.153 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.153 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.153 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Samba/SMB container image", 2024-06-03T00:05:25.153 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.153 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.153 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.153 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.153 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_snmp_gateway": { 2024-06-03T00:05:25.153 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_snmp_gateway", 2024-06-03T00:05:25.153 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.153 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.153 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.154 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-06-03T00:05:25.154 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.154 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.154 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.154 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "SNMP Gateway container image", 2024-06-03T00:05:25.154 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.154 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.154 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.154 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.154 INFO:teuthology.orchestra.run.smithi049.stdout: "container_init": { 2024-06-03T00:05:25.154 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_init", 2024-06-03T00:05:25.154 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.154 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.154 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.155 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.155 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.155 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.155 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.155 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Run podman/docker with `--init`", 2024-06-03T00:05:25.155 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.155 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.155 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.155 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.155 INFO:teuthology.orchestra.run.smithi049.stdout: "daemon_cache_timeout": { 2024-06-03T00:05:25.155 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "daemon_cache_timeout", 2024-06-03T00:05:25.155 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.156 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.156 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.156 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "600", 2024-06-03T00:05:25.156 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.156 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.156 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.156 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-06-03T00:05:25.156 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.156 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.156 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.156 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.156 INFO:teuthology.orchestra.run.smithi049.stdout: "default_cephadm_command_timeout": { 2024-06-03T00:05:25.156 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "default_cephadm_command_timeout", 2024-06-03T00:05:25.156 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.157 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.157 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.157 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "900", 2024-06-03T00:05:25.157 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.157 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.157 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.157 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-06-03T00:05:25.157 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.157 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.157 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.157 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.157 INFO:teuthology.orchestra.run.smithi049.stdout: "default_registry": { 2024-06-03T00:05:25.157 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "default_registry", 2024-06-03T00:05:25.157 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.158 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.158 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.158 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "docker.io", 2024-06-03T00:05:25.158 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.158 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.158 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.158 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-06-03T00:05:25.158 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.158 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.158 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.158 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.158 INFO:teuthology.orchestra.run.smithi049.stdout: "device_cache_timeout": { 2024-06-03T00:05:25.158 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "device_cache_timeout", 2024-06-03T00:05:25.158 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.159 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.159 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.159 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "1800", 2024-06-03T00:05:25.159 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.159 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.159 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.159 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "seconds to cache device inventory", 2024-06-03T00:05:25.159 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.159 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.159 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.159 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.159 INFO:teuthology.orchestra.run.smithi049.stdout: "device_enhanced_scan": { 2024-06-03T00:05:25.159 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "device_enhanced_scan", 2024-06-03T00:05:25.160 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.160 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.160 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.160 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.160 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.160 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.160 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.160 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Use libstoragemgmt during device scans", 2024-06-03T00:05:25.160 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.160 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.160 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.160 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.160 INFO:teuthology.orchestra.run.smithi049.stdout: "facts_cache_timeout": { 2024-06-03T00:05:25.160 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "facts_cache_timeout", 2024-06-03T00:05:25.161 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.161 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.161 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.161 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "60", 2024-06-03T00:05:25.161 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.161 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.161 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.161 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "seconds to cache host facts data", 2024-06-03T00:05:25.161 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.161 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.161 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.161 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.161 INFO:teuthology.orchestra.run.smithi049.stdout: "grafana_dashboards_path": { 2024-06-03T00:05:25.161 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "grafana_dashboards_path", 2024-06-03T00:05:25.162 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.162 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.162 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.162 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-06-03T00:05:25.162 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.162 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.162 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.162 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-06-03T00:05:25.162 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.162 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.162 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.162 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.162 INFO:teuthology.orchestra.run.smithi049.stdout: "host_check_interval": { 2024-06-03T00:05:25.162 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "host_check_interval", 2024-06-03T00:05:25.163 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.163 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.163 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.163 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "600", 2024-06-03T00:05:25.163 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.163 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.163 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.163 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how frequently to perform a host check", 2024-06-03T00:05:25.163 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.163 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.163 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.163 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.163 INFO:teuthology.orchestra.run.smithi049.stdout: "hw_monitoring": { 2024-06-03T00:05:25.163 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "hw_monitoring", 2024-06-03T00:05:25.164 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.164 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.164 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.164 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.164 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.164 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.164 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.164 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-06-03T00:05:25.164 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.164 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.164 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.164 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.164 INFO:teuthology.orchestra.run.smithi049.stdout: "inventory_list_all": { 2024-06-03T00:05:25.164 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "inventory_list_all", 2024-06-03T00:05:25.165 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.165 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.165 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.165 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.165 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.165 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.165 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.165 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-06-03T00:05:25.165 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.165 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.165 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.165 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.165 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.165 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.165 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.166 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.166 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.166 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.166 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.166 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.166 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.166 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.166 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.166 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.166 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.166 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.166 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.166 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.166 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.167 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.167 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.167 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.167 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.167 INFO:teuthology.orchestra.run.smithi049.stdout: "log_refresh_metadata": { 2024-06-03T00:05:25.167 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_refresh_metadata", 2024-06-03T00:05:25.167 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.167 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.167 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.167 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.167 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.167 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.167 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.167 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-06-03T00:05:25.168 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.168 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.168 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.168 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.168 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.168 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.168 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.168 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.168 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.168 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.168 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.168 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.168 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.168 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-06-03T00:05:25.169 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.169 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.169 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.169 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.169 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.169 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.169 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.169 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.169 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.169 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.169 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.169 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.169 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.169 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.170 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.170 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.170 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.170 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.170 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.170 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.170 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.170 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.170 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.170 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.170 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.170 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.170 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.170 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.171 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.171 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.171 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.171 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.171 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.171 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.171 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.171 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.171 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.171 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.171 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.171 INFO:teuthology.orchestra.run.smithi049.stdout: "manage_etc_ceph_ceph_conf": { 2024-06-03T00:05:25.171 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-06-03T00:05:25.171 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.172 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.172 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.172 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.172 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.172 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.172 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.172 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-06-03T00:05:25.172 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.172 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.172 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.172 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.172 INFO:teuthology.orchestra.run.smithi049.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-06-03T00:05:25.172 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-06-03T00:05:25.172 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.173 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.173 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.173 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "*", 2024-06-03T00:05:25.173 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.173 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.173 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.173 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-06-03T00:05:25.173 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.173 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.173 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.173 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.173 INFO:teuthology.orchestra.run.smithi049.stdout: "max_count_per_host": { 2024-06-03T00:05:25.173 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_count_per_host", 2024-06-03T00:05:25.173 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.174 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.174 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.174 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-06-03T00:05:25.174 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.174 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.174 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.174 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "max number of daemons per service per host", 2024-06-03T00:05:25.174 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.174 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.174 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.174 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.174 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd_draining_count": { 2024-06-03T00:05:25.174 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_osd_draining_count", 2024-06-03T00:05:25.175 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.175 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.175 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.175 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-06-03T00:05:25.175 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.175 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.175 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.175 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-06-03T00:05:25.175 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.175 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.175 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.175 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.175 INFO:teuthology.orchestra.run.smithi049.stdout: "migration_current": { 2024-06-03T00:05:25.175 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "migration_current", 2024-06-03T00:05:25.176 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.176 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.176 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.176 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.176 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.176 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.176 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.176 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "internal - do not modify", 2024-06-03T00:05:25.176 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.176 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.176 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.176 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.176 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": { 2024-06-03T00:05:25.176 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mode", 2024-06-03T00:05:25.177 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.177 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.177 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.177 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "root", 2024-06-03T00:05:25.177 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.177 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.177 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.177 INFO:teuthology.orchestra.run.smithi049.stdout: "cephadm-package", 2024-06-03T00:05:25.177 INFO:teuthology.orchestra.run.smithi049.stdout: "root" 2024-06-03T00:05:25.177 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.177 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "mode for remote execution of cephadm", 2024-06-03T00:05:25.177 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.177 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.177 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.178 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.178 INFO:teuthology.orchestra.run.smithi049.stdout: "oob_default_addr": { 2024-06-03T00:05:25.178 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "oob_default_addr", 2024-06-03T00:05:25.178 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.178 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.178 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.178 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "169.254.1.1", 2024-06-03T00:05:25.178 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.178 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.178 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.178 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Default address for RedFish API (oob management).", 2024-06-03T00:05:25.178 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.178 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.178 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.179 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.179 INFO:teuthology.orchestra.run.smithi049.stdout: "prometheus_alerts_path": { 2024-06-03T00:05:25.179 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "prometheus_alerts_path", 2024-06-03T00:05:25.179 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.179 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.179 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.179 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-06-03T00:05:25.179 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.179 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.179 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.179 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-06-03T00:05:25.179 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.179 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.179 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.180 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.180 INFO:teuthology.orchestra.run.smithi049.stdout: "registry_insecure": { 2024-06-03T00:05:25.180 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "registry_insecure", 2024-06-03T00:05:25.180 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.180 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.180 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.180 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.180 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.180 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.180 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.180 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-06-03T00:05:25.180 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.180 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.181 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.181 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.181 INFO:teuthology.orchestra.run.smithi049.stdout: "registry_password": { 2024-06-03T00:05:25.181 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "registry_password", 2024-06-03T00:05:25.181 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.181 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.181 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.181 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.181 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.181 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.181 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.181 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-06-03T00:05:25.181 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.182 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.182 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.182 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.182 INFO:teuthology.orchestra.run.smithi049.stdout: "registry_url": { 2024-06-03T00:05:25.182 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "registry_url", 2024-06-03T00:05:25.182 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.182 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.182 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.182 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.182 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.182 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.182 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.182 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-06-03T00:05:25.182 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.183 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.183 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.183 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.183 INFO:teuthology.orchestra.run.smithi049.stdout: "registry_username": { 2024-06-03T00:05:25.183 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "registry_username", 2024-06-03T00:05:25.183 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.183 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.183 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.183 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.183 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.183 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.183 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.183 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-06-03T00:05:25.183 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.184 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.184 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.184 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.184 INFO:teuthology.orchestra.run.smithi049.stdout: "secure_monitoring_stack": { 2024-06-03T00:05:25.184 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "secure_monitoring_stack", 2024-06-03T00:05:25.184 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.184 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.184 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.184 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.184 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.184 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.184 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.184 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-06-03T00:05:25.185 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.185 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.185 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.185 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.185 INFO:teuthology.orchestra.run.smithi049.stdout: "service_discovery_port": { 2024-06-03T00:05:25.185 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "service_discovery_port", 2024-06-03T00:05:25.185 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.185 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.185 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.185 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "8765", 2024-06-03T00:05:25.185 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.185 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.185 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.185 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "cephadm service discovery port", 2024-06-03T00:05:25.186 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.186 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.186 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.186 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.186 INFO:teuthology.orchestra.run.smithi049.stdout: "ssh_config_file": { 2024-06-03T00:05:25.186 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ssh_config_file", 2024-06-03T00:05:25.186 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.186 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.186 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.186 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.186 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.186 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.186 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.186 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-06-03T00:05:25.187 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.187 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.187 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.187 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.187 INFO:teuthology.orchestra.run.smithi049.stdout: "use_agent": { 2024-06-03T00:05:25.187 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "use_agent", 2024-06-03T00:05:25.187 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.187 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.187 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.187 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.187 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.187 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.187 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.187 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-06-03T00:05:25.188 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.188 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.188 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.188 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.188 INFO:teuthology.orchestra.run.smithi049.stdout: "use_repo_digest": { 2024-06-03T00:05:25.188 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "use_repo_digest", 2024-06-03T00:05:25.188 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.188 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.188 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.188 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.188 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.188 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.188 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.188 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-06-03T00:05:25.189 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.189 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.189 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.189 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.189 INFO:teuthology.orchestra.run.smithi049.stdout: "warn_on_failed_host_check": { 2024-06-03T00:05:25.189 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "warn_on_failed_host_check", 2024-06-03T00:05:25.189 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.189 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.189 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.189 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.189 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.189 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.189 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.189 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "raise a health warning if the host check fails", 2024-06-03T00:05:25.189 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.190 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.190 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.190 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.190 INFO:teuthology.orchestra.run.smithi049.stdout: "warn_on_stray_daemons": { 2024-06-03T00:05:25.190 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "warn_on_stray_daemons", 2024-06-03T00:05:25.190 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.190 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.190 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.190 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.190 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.190 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.190 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.190 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-06-03T00:05:25.190 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.191 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.191 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.191 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.191 INFO:teuthology.orchestra.run.smithi049.stdout: "warn_on_stray_hosts": { 2024-06-03T00:05:25.191 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "warn_on_stray_hosts", 2024-06-03T00:05:25.191 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.191 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.191 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.191 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.191 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.191 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.191 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.191 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-06-03T00:05:25.191 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.191 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.192 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.192 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.192 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.192 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.192 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.192 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "crash", 2024-06-03T00:05:25.192 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.192 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.192 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.192 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.192 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.192 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.192 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.193 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.193 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.193 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.193 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.193 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.193 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.193 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.193 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.193 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.193 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.193 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.193 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.193 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.194 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.194 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.194 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.194 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.194 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.194 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.194 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.194 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.194 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.194 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.194 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.194 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.194 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.195 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.195 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.195 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.195 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.195 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.195 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.195 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.195 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.195 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.195 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.195 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.195 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.195 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.195 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.195 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.196 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.196 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.196 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.196 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.196 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.196 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.196 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.196 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.196 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.196 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.196 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.196 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.196 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.196 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.197 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.197 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.197 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.197 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.197 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.197 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.197 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.197 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.197 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.197 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.197 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.197 INFO:teuthology.orchestra.run.smithi049.stdout: "retain_interval": { 2024-06-03T00:05:25.197 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "retain_interval", 2024-06-03T00:05:25.198 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.198 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.198 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.198 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "31536000", 2024-06-03T00:05:25.198 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.198 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.198 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.198 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how long to retain crashes before pruning them", 2024-06-03T00:05:25.198 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.198 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.198 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.198 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.198 INFO:teuthology.orchestra.run.smithi049.stdout: "warn_recent_interval": { 2024-06-03T00:05:25.198 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "warn_recent_interval", 2024-06-03T00:05:25.199 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.199 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.199 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.199 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "1209600", 2024-06-03T00:05:25.199 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.199 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.199 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.199 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "time interval in which to warn about recent crashes", 2024-06-03T00:05:25.199 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.199 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.199 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.199 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.199 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.199 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.199 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.200 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "dashboard", 2024-06-03T00:05:25.200 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.200 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.200 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.200 INFO:teuthology.orchestra.run.smithi049.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-06-03T00:05:25.200 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-06-03T00:05:25.200 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.200 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.200 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.200 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-06-03T00:05:25.200 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.200 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.200 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.200 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.201 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.201 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.201 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.201 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.201 INFO:teuthology.orchestra.run.smithi049.stdout: "ALERTMANAGER_API_HOST": { 2024-06-03T00:05:25.201 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ALERTMANAGER_API_HOST", 2024-06-03T00:05:25.201 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.201 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.201 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.201 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.201 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.201 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.201 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.201 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.201 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.202 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.202 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.202 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.202 INFO:teuthology.orchestra.run.smithi049.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-06-03T00:05:25.202 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-06-03T00:05:25.202 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.202 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.202 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.202 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.202 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.202 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.202 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.202 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.203 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.203 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.203 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.203 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.203 INFO:teuthology.orchestra.run.smithi049.stdout: "AUDIT_API_ENABLED": { 2024-06-03T00:05:25.203 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "AUDIT_API_ENABLED", 2024-06-03T00:05:25.203 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.203 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.203 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.203 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.203 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.203 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.203 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.203 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.204 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.204 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.204 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.204 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.204 INFO:teuthology.orchestra.run.smithi049.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-06-03T00:05:25.204 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-06-03T00:05:25.204 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.204 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.204 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.204 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.204 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.204 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.204 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.204 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.205 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.205 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.205 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.205 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.205 INFO:teuthology.orchestra.run.smithi049.stdout: "ENABLE_BROWSABLE_API": { 2024-06-03T00:05:25.205 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ENABLE_BROWSABLE_API", 2024-06-03T00:05:25.205 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.205 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.205 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.205 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.205 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.205 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.205 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.205 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.205 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.206 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.206 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.206 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.206 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-06-03T00:05:25.206 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-06-03T00:05:25.206 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.206 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.206 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.206 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.206 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.206 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.206 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.206 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.207 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.207 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.207 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.207 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.207 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-06-03T00:05:25.207 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-06-03T00:05:25.207 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.207 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.207 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.207 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.207 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.207 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.207 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.207 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.208 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.208 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.208 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.208 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.208 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-06-03T00:05:25.208 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-06-03T00:05:25.208 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.208 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.208 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.208 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.208 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.208 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.208 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.208 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.209 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.209 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.209 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.209 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.209 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-06-03T00:05:25.209 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-06-03T00:05:25.209 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.209 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.209 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.209 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.209 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.209 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.209 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.209 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.210 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.210 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.210 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.210 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.210 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_NFS": { 2024-06-03T00:05:25.210 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-06-03T00:05:25.210 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.210 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.210 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.210 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.210 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.210 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.210 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.211 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.211 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.211 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.211 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.211 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.211 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_RBD": { 2024-06-03T00:05:25.211 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-06-03T00:05:25.211 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.211 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.211 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.211 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.211 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.211 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.211 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.212 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.212 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.212 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.212 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.212 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.212 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_RGW": { 2024-06-03T00:05:25.212 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-06-03T00:05:25.212 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.212 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.212 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.212 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.212 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.212 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.212 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.212 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.213 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.213 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.213 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.213 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.213 INFO:teuthology.orchestra.run.smithi049.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-06-03T00:05:25.213 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-06-03T00:05:25.213 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.213 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.213 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.213 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.213 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.213 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.213 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.213 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.214 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.214 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.214 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.214 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.214 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_API_PASSWORD": { 2024-06-03T00:05:25.214 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_API_PASSWORD", 2024-06-03T00:05:25.214 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.214 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.214 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.214 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "admin", 2024-06-03T00:05:25.214 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.214 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.214 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.214 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.215 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.215 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.215 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.215 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.215 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-06-03T00:05:25.215 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-06-03T00:05:25.215 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.215 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.215 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.215 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.215 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.215 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.215 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.215 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.216 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.216 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.216 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.216 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.216 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_API_URL": { 2024-06-03T00:05:25.216 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_API_URL", 2024-06-03T00:05:25.216 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.216 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.216 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.216 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.216 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.216 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.216 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.216 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.217 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.217 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.217 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.217 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.217 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_API_USERNAME": { 2024-06-03T00:05:25.217 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_API_USERNAME", 2024-06-03T00:05:25.217 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.217 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.217 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.217 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "admin", 2024-06-03T00:05:25.217 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.217 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.217 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.217 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.217 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.218 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.218 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.218 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.218 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-06-03T00:05:25.218 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-06-03T00:05:25.218 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.218 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.218 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.218 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.218 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.218 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.218 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.218 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.218 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.219 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.219 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.219 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.219 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-06-03T00:05:25.219 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-06-03T00:05:25.219 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.219 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.219 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.219 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.219 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.219 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.219 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.219 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.220 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.220 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.220 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.220 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.220 INFO:teuthology.orchestra.run.smithi049.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-06-03T00:05:25.220 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-06-03T00:05:25.220 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.220 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.220 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.220 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.220 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.220 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.220 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.220 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.221 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.221 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.221 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.221 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.221 INFO:teuthology.orchestra.run.smithi049.stdout: "ISSUE_TRACKER_API_KEY": { 2024-06-03T00:05:25.221 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-06-03T00:05:25.221 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.221 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.221 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.221 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.221 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.221 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.221 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.221 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.222 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.222 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.222 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.222 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.222 INFO:teuthology.orchestra.run.smithi049.stdout: "PROMETHEUS_API_HOST": { 2024-06-03T00:05:25.222 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PROMETHEUS_API_HOST", 2024-06-03T00:05:25.222 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.222 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.222 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.222 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.222 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.222 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.222 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.223 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.223 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.223 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.223 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.223 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.223 INFO:teuthology.orchestra.run.smithi049.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-06-03T00:05:25.223 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-06-03T00:05:25.223 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.223 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.223 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.223 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.223 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.223 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.223 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.223 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.224 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.224 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.224 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.224 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.224 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-06-03T00:05:25.224 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-06-03T00:05:25.224 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.224 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.224 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.224 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.224 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.224 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.224 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.224 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.225 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.225 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.225 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.225 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.225 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-06-03T00:05:25.225 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-06-03T00:05:25.225 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.225 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.225 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.225 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.225 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.225 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.225 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.225 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.226 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.226 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.226 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.226 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.226 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-06-03T00:05:25.226 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-06-03T00:05:25.226 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.226 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.226 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.226 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.226 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.226 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.226 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.226 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.227 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.227 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.227 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.227 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.227 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-06-03T00:05:25.227 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-06-03T00:05:25.227 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.227 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.227 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.227 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.227 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.227 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.227 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.227 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.227 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.228 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.228 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.228 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.228 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-06-03T00:05:25.228 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-06-03T00:05:25.228 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.228 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.228 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.228 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.228 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.228 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.228 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.228 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.228 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.229 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.229 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.229 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.229 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-06-03T00:05:25.229 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-06-03T00:05:25.229 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.229 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.229 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.229 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.229 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.229 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.229 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.229 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.229 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.230 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.230 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.230 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.230 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-06-03T00:05:25.230 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-06-03T00:05:25.230 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.230 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.230 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.230 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.230 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.230 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.230 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.230 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.231 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.231 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.231 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.231 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.231 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_ENABLED": { 2024-06-03T00:05:25.231 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_ENABLED", 2024-06-03T00:05:25.231 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.231 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.231 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.231 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.231 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.231 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.231 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.231 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.231 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.232 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.232 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.232 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.232 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-06-03T00:05:25.232 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-06-03T00:05:25.232 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.232 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.232 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.232 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-06-03T00:05:25.232 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.232 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.232 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.233 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.233 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.233 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.233 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.233 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.233 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-06-03T00:05:25.233 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-06-03T00:05:25.233 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.233 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.233 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.233 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-06-03T00:05:25.233 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.233 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.233 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.234 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.234 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.234 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.234 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.234 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.234 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-06-03T00:05:25.234 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-06-03T00:05:25.234 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.234 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.234 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.234 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "8", 2024-06-03T00:05:25.234 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.234 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.234 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.235 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.235 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.235 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.235 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.235 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.235 INFO:teuthology.orchestra.run.smithi049.stdout: "REST_REQUESTS_TIMEOUT": { 2024-06-03T00:05:25.235 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-06-03T00:05:25.235 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.235 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.235 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.235 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "45", 2024-06-03T00:05:25.235 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.235 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.236 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.236 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.236 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.236 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.236 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.236 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.236 INFO:teuthology.orchestra.run.smithi049.stdout: "RGW_API_ACCESS_KEY": { 2024-06-03T00:05:25.236 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "RGW_API_ACCESS_KEY", 2024-06-03T00:05:25.236 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.236 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.236 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.236 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.236 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.236 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.237 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.237 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.237 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.237 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.237 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.237 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.237 INFO:teuthology.orchestra.run.smithi049.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-06-03T00:05:25.237 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-06-03T00:05:25.237 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.237 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.237 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.237 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "admin", 2024-06-03T00:05:25.237 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.237 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.238 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.238 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.238 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.238 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.238 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.238 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.238 INFO:teuthology.orchestra.run.smithi049.stdout: "RGW_API_SECRET_KEY": { 2024-06-03T00:05:25.238 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "RGW_API_SECRET_KEY", 2024-06-03T00:05:25.238 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.238 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.238 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.238 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.238 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.239 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.239 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.239 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.239 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.239 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.239 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.239 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.239 INFO:teuthology.orchestra.run.smithi049.stdout: "RGW_API_SSL_VERIFY": { 2024-06-03T00:05:25.239 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "RGW_API_SSL_VERIFY", 2024-06-03T00:05:25.239 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.239 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.239 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.239 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.240 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.240 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.240 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.240 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.240 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.240 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.240 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.240 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.240 INFO:teuthology.orchestra.run.smithi049.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-06-03T00:05:25.240 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-06-03T00:05:25.240 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.240 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.240 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.240 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-06-03T00:05:25.241 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.241 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.241 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.241 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.241 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.241 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.241 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.241 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.241 INFO:teuthology.orchestra.run.smithi049.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-06-03T00:05:25.241 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-06-03T00:05:25.241 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.241 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.241 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.241 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-06-03T00:05:25.242 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.242 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.242 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.242 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.242 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.242 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.242 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.242 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.242 INFO:teuthology.orchestra.run.smithi049.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-06-03T00:05:25.242 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-06-03T00:05:25.242 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.242 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.242 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.242 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5", 2024-06-03T00:05:25.243 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.243 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.243 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.243 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.243 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.243 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.243 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.243 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.243 INFO:teuthology.orchestra.run.smithi049.stdout: "cross_origin_url": { 2024-06-03T00:05:25.243 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cross_origin_url", 2024-06-03T00:05:25.243 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.243 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.243 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.243 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.244 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.244 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.244 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.244 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.244 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.244 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.244 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.244 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.244 INFO:teuthology.orchestra.run.smithi049.stdout: "crt_file": { 2024-06-03T00:05:25.244 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "crt_file", 2024-06-03T00:05:25.244 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.244 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.244 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.244 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.244 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.245 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.245 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.245 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.245 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.245 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.245 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.245 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.245 INFO:teuthology.orchestra.run.smithi049.stdout: "debug": { 2024-06-03T00:05:25.245 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "debug", 2024-06-03T00:05:25.245 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.245 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.245 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.245 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.246 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.246 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.246 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.246 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Enable/disable debug options", 2024-06-03T00:05:25.246 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.246 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.246 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.246 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.246 INFO:teuthology.orchestra.run.smithi049.stdout: "jwt_token_ttl": { 2024-06-03T00:05:25.246 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "jwt_token_ttl", 2024-06-03T00:05:25.246 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.246 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.247 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.247 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "28800", 2024-06-03T00:05:25.247 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.247 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.247 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.247 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.247 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.247 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.247 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.247 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.247 INFO:teuthology.orchestra.run.smithi049.stdout: "key_file": { 2024-06-03T00:05:25.247 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "key_file", 2024-06-03T00:05:25.247 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.247 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.247 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.248 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.248 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.248 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.248 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.248 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.248 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.248 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.248 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.248 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.248 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.248 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.248 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.248 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.249 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.249 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.249 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.249 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.249 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.249 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.249 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.249 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.249 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.249 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.249 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.249 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.249 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.249 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.250 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.250 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.250 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.250 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.250 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.250 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.250 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.250 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.250 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.250 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.250 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.250 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.250 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.250 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.251 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.251 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.251 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.251 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.251 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.251 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.251 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.251 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.251 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.251 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.251 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.251 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.251 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.251 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.252 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.252 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.252 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.252 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.252 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.252 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.252 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.252 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.252 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.252 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.252 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.252 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.252 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.252 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.252 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.253 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.253 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.253 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.253 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.253 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.253 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.253 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.253 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.253 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.253 INFO:teuthology.orchestra.run.smithi049.stdout: "motd": { 2024-06-03T00:05:25.253 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "motd", 2024-06-03T00:05:25.253 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.253 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.253 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.254 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.254 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.254 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.254 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.254 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "The message of the day", 2024-06-03T00:05:25.254 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.254 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.254 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.254 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.254 INFO:teuthology.orchestra.run.smithi049.stdout: "redirect_resolve_ip_addr": { 2024-06-03T00:05:25.254 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "redirect_resolve_ip_addr", 2024-06-03T00:05:25.254 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.254 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.255 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.255 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.255 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.255 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.255 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.255 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.255 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.255 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.255 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.255 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.255 INFO:teuthology.orchestra.run.smithi049.stdout: "server_addr": { 2024-06-03T00:05:25.255 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_addr", 2024-06-03T00:05:25.255 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.255 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.256 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.256 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "::", 2024-06-03T00:05:25.256 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.256 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.256 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.256 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.256 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.256 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.256 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.256 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.256 INFO:teuthology.orchestra.run.smithi049.stdout: "server_port": { 2024-06-03T00:05:25.256 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_port", 2024-06-03T00:05:25.256 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.256 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.257 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.257 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "8080", 2024-06-03T00:05:25.257 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.257 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.257 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.257 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.257 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.257 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.257 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.257 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.257 INFO:teuthology.orchestra.run.smithi049.stdout: "ssl": { 2024-06-03T00:05:25.257 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ssl", 2024-06-03T00:05:25.257 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.257 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.257 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.258 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.258 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.258 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.258 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.258 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.258 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.258 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.258 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.258 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.258 INFO:teuthology.orchestra.run.smithi049.stdout: "ssl_server_port": { 2024-06-03T00:05:25.258 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ssl_server_port", 2024-06-03T00:05:25.258 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.258 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.258 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.259 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "8443", 2024-06-03T00:05:25.259 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.259 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.259 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.259 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.259 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.259 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.259 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.259 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.259 INFO:teuthology.orchestra.run.smithi049.stdout: "standby_behaviour": { 2024-06-03T00:05:25.259 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "standby_behaviour", 2024-06-03T00:05:25.259 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.259 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.260 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.260 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "redirect", 2024-06-03T00:05:25.260 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.260 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.260 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.260 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.260 INFO:teuthology.orchestra.run.smithi049.stdout: "redirect" 2024-06-03T00:05:25.260 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.260 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.260 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.260 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.260 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.260 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.260 INFO:teuthology.orchestra.run.smithi049.stdout: "standby_error_status_code": { 2024-06-03T00:05:25.261 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "standby_error_status_code", 2024-06-03T00:05:25.261 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.261 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.261 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.261 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "500", 2024-06-03T00:05:25.261 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "400", 2024-06-03T00:05:25.261 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "599", 2024-06-03T00:05:25.261 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.261 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.261 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.261 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.261 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.261 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.261 INFO:teuthology.orchestra.run.smithi049.stdout: "url_prefix": { 2024-06-03T00:05:25.262 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "url_prefix", 2024-06-03T00:05:25.262 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.262 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.262 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.262 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.262 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.262 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.262 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.262 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.262 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.262 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.262 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.262 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.262 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.263 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.263 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.263 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "devicehealth", 2024-06-03T00:05:25.263 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.263 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.263 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.263 INFO:teuthology.orchestra.run.smithi049.stdout: "enable_monitoring": { 2024-06-03T00:05:25.263 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "enable_monitoring", 2024-06-03T00:05:25.263 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.263 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.263 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.263 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.263 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.263 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.264 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.264 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "monitor device health metrics", 2024-06-03T00:05:25.264 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.264 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.264 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.264 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.264 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.264 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.264 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.264 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.264 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.264 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.264 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.264 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.265 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.265 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.265 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.265 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.265 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.265 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.265 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.265 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.265 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.265 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.265 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.265 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.265 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.265 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.265 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.266 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.266 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.266 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.266 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.266 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.266 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.266 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.266 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.266 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.266 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.266 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.266 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.266 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.267 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.267 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.267 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.267 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.267 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.267 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.267 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.267 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.267 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.267 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.267 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.267 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.267 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.267 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.267 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.268 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.268 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.268 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.268 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.268 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.268 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.268 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.268 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.268 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.268 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.268 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.268 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.268 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.268 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.269 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.269 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.269 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.269 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.269 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.269 INFO:teuthology.orchestra.run.smithi049.stdout: "mark_out_threshold": { 2024-06-03T00:05:25.269 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mark_out_threshold", 2024-06-03T00:05:25.269 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.269 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.269 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.269 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "2419200", 2024-06-03T00:05:25.269 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.269 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.269 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.270 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-06-03T00:05:25.270 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.270 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.270 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.270 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.270 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": { 2024-06-03T00:05:25.270 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "pool_name", 2024-06-03T00:05:25.270 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.270 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.270 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.270 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "device_health_metrics", 2024-06-03T00:05:25.270 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.270 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.270 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.271 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "name of pool in which to store device health metrics", 2024-06-03T00:05:25.271 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.271 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.271 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.271 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.271 INFO:teuthology.orchestra.run.smithi049.stdout: "retention_period": { 2024-06-03T00:05:25.271 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "retention_period", 2024-06-03T00:05:25.271 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.271 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.271 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.271 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "15552000", 2024-06-03T00:05:25.271 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.271 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.271 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.272 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how long to retain device health metrics", 2024-06-03T00:05:25.272 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.272 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.272 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.272 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.272 INFO:teuthology.orchestra.run.smithi049.stdout: "scrape_frequency": { 2024-06-03T00:05:25.272 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "scrape_frequency", 2024-06-03T00:05:25.272 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.272 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.272 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.272 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "86400", 2024-06-03T00:05:25.272 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.272 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.272 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.273 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how frequently to scrape device health metrics", 2024-06-03T00:05:25.273 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.273 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.273 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.273 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.273 INFO:teuthology.orchestra.run.smithi049.stdout: "self_heal": { 2024-06-03T00:05:25.273 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "self_heal", 2024-06-03T00:05:25.273 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.273 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.273 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.273 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.273 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.273 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.274 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.274 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-06-03T00:05:25.274 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.274 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.274 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.274 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.274 INFO:teuthology.orchestra.run.smithi049.stdout: "sleep_interval": { 2024-06-03T00:05:25.274 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sleep_interval", 2024-06-03T00:05:25.274 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.274 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.274 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.274 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "600", 2024-06-03T00:05:25.274 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.274 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.275 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.275 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how frequently to wake up and check device health", 2024-06-03T00:05:25.275 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.275 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.275 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.275 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.275 INFO:teuthology.orchestra.run.smithi049.stdout: "warn_threshold": { 2024-06-03T00:05:25.275 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "warn_threshold", 2024-06-03T00:05:25.275 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.275 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.275 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.275 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "7257600", 2024-06-03T00:05:25.275 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.275 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.276 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.276 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-06-03T00:05:25.276 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.276 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.276 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.276 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.276 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.276 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.276 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.276 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "diskprediction_local", 2024-06-03T00:05:25.276 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.276 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.276 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.276 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.277 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.277 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.277 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.277 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.277 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.277 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.277 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.277 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.277 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.277 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.277 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.277 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.277 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.277 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.278 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.278 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.278 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.278 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.278 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.278 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.278 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.278 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.278 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.278 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.278 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.278 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.278 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.279 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.279 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.279 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.279 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.279 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.279 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.279 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.279 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.279 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.279 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.279 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.279 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.279 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.279 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.279 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.280 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.280 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.280 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.280 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.280 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.280 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.280 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.280 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.280 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.280 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.280 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.280 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.280 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.281 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.281 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.281 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.281 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.281 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.281 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.281 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.281 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.281 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.281 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.281 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.281 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.281 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.281 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.282 INFO:teuthology.orchestra.run.smithi049.stdout: "predict_interval": { 2024-06-03T00:05:25.282 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "predict_interval", 2024-06-03T00:05:25.282 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.282 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.282 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.282 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "86400", 2024-06-03T00:05:25.282 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.282 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.282 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.282 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.282 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.282 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.282 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.282 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.283 INFO:teuthology.orchestra.run.smithi049.stdout: "predictor_model": { 2024-06-03T00:05:25.283 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "predictor_model", 2024-06-03T00:05:25.283 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.283 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.283 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.283 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "prophetstor", 2024-06-03T00:05:25.283 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.283 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.283 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.283 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.283 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.283 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.283 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.283 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.284 INFO:teuthology.orchestra.run.smithi049.stdout: "sleep_interval": { 2024-06-03T00:05:25.284 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sleep_interval", 2024-06-03T00:05:25.284 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.284 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.284 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.284 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "600", 2024-06-03T00:05:25.284 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.284 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.284 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.284 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.284 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.284 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.284 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.284 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.285 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.285 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.285 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.285 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "influx", 2024-06-03T00:05:25.285 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": false, 2024-06-03T00:05:25.285 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "influxdb python module not found", 2024-06-03T00:05:25.285 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.285 INFO:teuthology.orchestra.run.smithi049.stdout: "batch_size": { 2024-06-03T00:05:25.285 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "batch_size", 2024-06-03T00:05:25.285 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.285 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.285 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.285 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5000", 2024-06-03T00:05:25.285 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.286 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.286 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.286 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-06-03T00:05:25.286 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.286 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.286 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.286 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.286 INFO:teuthology.orchestra.run.smithi049.stdout: "database": { 2024-06-03T00:05:25.286 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "database", 2024-06-03T00:05:25.286 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.286 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.286 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.286 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "ceph", 2024-06-03T00:05:25.287 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.287 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.287 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.287 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-06-03T00:05:25.287 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.287 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.287 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.287 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.287 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": { 2024-06-03T00:05:25.287 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "hostname", 2024-06-03T00:05:25.287 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.287 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.287 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.287 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.288 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.288 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.288 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.288 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "InfluxDB server hostname", 2024-06-03T00:05:25.288 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.288 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.288 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.288 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.288 INFO:teuthology.orchestra.run.smithi049.stdout: "interval": { 2024-06-03T00:05:25.288 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "interval", 2024-06-03T00:05:25.288 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.288 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.288 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.289 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "30", 2024-06-03T00:05:25.289 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "5", 2024-06-03T00:05:25.289 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.289 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.289 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-06-03T00:05:25.289 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.289 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.289 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.289 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.289 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.289 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.289 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.289 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.289 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.289 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.290 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.290 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.290 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.290 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.290 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.290 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.290 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.290 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.290 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.290 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.290 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.290 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.290 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.291 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.291 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.291 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.291 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.291 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.291 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.291 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.291 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.291 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.291 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.291 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.291 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.291 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.291 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.292 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.292 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.292 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.292 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.292 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.292 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.292 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.292 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.292 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.292 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.292 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.292 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.292 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.292 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.293 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.293 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.293 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.293 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.293 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.293 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.293 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.293 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.293 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.293 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.293 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.293 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.293 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.293 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.294 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.294 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.294 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.294 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.294 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.294 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.294 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.294 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.294 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.294 INFO:teuthology.orchestra.run.smithi049.stdout: "password": { 2024-06-03T00:05:25.294 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "password", 2024-06-03T00:05:25.294 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.294 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.294 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.295 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.295 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.295 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.295 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.295 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "password of InfluxDB server user", 2024-06-03T00:05:25.295 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.295 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.295 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.295 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.295 INFO:teuthology.orchestra.run.smithi049.stdout: "port": { 2024-06-03T00:05:25.295 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "port", 2024-06-03T00:05:25.295 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.295 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.295 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.296 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "8086", 2024-06-03T00:05:25.296 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.296 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.296 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.296 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "InfluxDB server port", 2024-06-03T00:05:25.296 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.296 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.296 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.296 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.296 INFO:teuthology.orchestra.run.smithi049.stdout: "ssl": { 2024-06-03T00:05:25.296 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ssl", 2024-06-03T00:05:25.296 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.296 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.296 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.297 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "false", 2024-06-03T00:05:25.297 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.297 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.297 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.297 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-06-03T00:05:25.297 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.297 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.297 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.297 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.297 INFO:teuthology.orchestra.run.smithi049.stdout: "threads": { 2024-06-03T00:05:25.297 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "threads", 2024-06-03T00:05:25.297 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.297 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.298 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.298 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5", 2024-06-03T00:05:25.298 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "1", 2024-06-03T00:05:25.298 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "32", 2024-06-03T00:05:25.298 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.298 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-06-03T00:05:25.298 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.298 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.298 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.298 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.298 INFO:teuthology.orchestra.run.smithi049.stdout: "username": { 2024-06-03T00:05:25.298 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "username", 2024-06-03T00:05:25.298 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.299 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.299 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.299 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.299 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.299 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.299 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.299 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "username of InfluxDB server user", 2024-06-03T00:05:25.299 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.299 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.299 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.299 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.299 INFO:teuthology.orchestra.run.smithi049.stdout: "verify_ssl": { 2024-06-03T00:05:25.299 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "verify_ssl", 2024-06-03T00:05:25.300 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.300 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.300 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.300 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "true", 2024-06-03T00:05:25.300 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.300 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.300 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.300 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-06-03T00:05:25.300 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.300 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.300 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.300 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.300 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.301 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.301 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.301 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "insights", 2024-06-03T00:05:25.301 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.301 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.301 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.301 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.301 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.301 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.301 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.301 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.301 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.301 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.301 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.301 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.302 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.302 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.302 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.302 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.302 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.302 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.302 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.302 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.302 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.302 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.302 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.302 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.302 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.303 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.303 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.303 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.303 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.303 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.303 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.303 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.303 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.303 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.303 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.303 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.303 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.303 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.304 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.304 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.304 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.304 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.304 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.304 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.304 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.304 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.304 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.304 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.304 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.304 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.304 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.304 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.305 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.305 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.305 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.305 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.305 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.305 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.305 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.305 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.305 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.305 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.305 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.305 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.305 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.305 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.306 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.306 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.306 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.306 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.306 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.306 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.306 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.306 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.306 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.306 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.306 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "iostat", 2024-06-03T00:05:25.306 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.306 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.306 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.307 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.307 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.307 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.307 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.307 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.307 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.307 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.307 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.307 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.307 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.307 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.307 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.307 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.308 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.308 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.308 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.308 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.308 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.308 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.308 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.308 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.308 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.308 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.308 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.308 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.308 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.308 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.308 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.309 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.309 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.309 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.309 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.309 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.309 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.309 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.309 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.309 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.309 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.309 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.309 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.309 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.309 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.310 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.310 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.310 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.310 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.310 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.310 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.310 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.310 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.310 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.310 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.310 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.310 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.310 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.311 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.311 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.311 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.311 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.311 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.311 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.311 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.311 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.311 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.311 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.311 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.311 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.311 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.311 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.311 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.312 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.312 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.312 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.312 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "k8sevents", 2024-06-03T00:05:25.312 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.312 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.312 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.312 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_event_retention_days": { 2024-06-03T00:05:25.312 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ceph_event_retention_days", 2024-06-03T00:05:25.312 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.312 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.312 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.312 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "7", 2024-06-03T00:05:25.312 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.313 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.313 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.313 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Days to hold ceph event information within local cache", 2024-06-03T00:05:25.313 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.313 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.313 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.313 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.313 INFO:teuthology.orchestra.run.smithi049.stdout: "config_check_secs": { 2024-06-03T00:05:25.313 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "config_check_secs", 2024-06-03T00:05:25.313 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.313 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.313 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.313 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-06-03T00:05:25.314 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "10", 2024-06-03T00:05:25.314 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.314 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.314 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-06-03T00:05:25.314 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.314 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.314 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.314 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.314 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.314 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.314 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.314 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.314 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.315 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.315 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.315 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.315 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.315 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.315 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.315 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.315 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.315 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.315 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.315 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.315 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.315 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.315 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.316 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.316 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.316 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.316 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.316 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.316 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.316 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.316 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.316 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.316 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.316 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.316 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.316 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.316 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.317 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.317 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.317 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.317 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.317 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.317 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.317 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.317 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.317 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.317 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.317 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.317 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.317 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.317 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.318 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.318 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.318 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.318 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.318 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.318 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.318 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.318 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.318 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.318 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.318 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.318 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.318 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.318 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.319 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.319 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.319 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.319 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.319 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.319 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.319 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.319 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.319 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.319 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.319 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.319 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.319 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "localpool", 2024-06-03T00:05:25.319 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.320 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.320 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.320 INFO:teuthology.orchestra.run.smithi049.stdout: "failure_domain": { 2024-06-03T00:05:25.320 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "failure_domain", 2024-06-03T00:05:25.320 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.320 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.320 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.320 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "host", 2024-06-03T00:05:25.320 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.320 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.320 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.320 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "failure domain for any created local pool", 2024-06-03T00:05:25.320 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-06-03T00:05:25.320 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.321 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.321 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.321 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.321 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.321 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.321 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.321 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.321 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.321 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.321 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.321 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.321 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.321 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.322 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.322 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.322 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.322 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.322 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.322 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.322 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.322 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.322 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.322 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.322 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.322 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.322 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.322 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.323 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.323 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.323 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.323 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.323 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.323 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.323 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.323 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.323 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.323 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.323 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.323 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.323 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.323 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.324 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.324 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.324 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.324 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.324 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.324 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.324 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.324 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.324 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.324 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.324 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.324 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.324 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.324 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.324 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.325 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.325 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.325 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.325 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.325 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.325 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.325 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.325 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.325 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.325 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.325 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.325 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.325 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.325 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.326 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.326 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.326 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": { 2024-06-03T00:05:25.326 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "min_size", 2024-06-03T00:05:25.326 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.326 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.326 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.326 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.326 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.326 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.326 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.326 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "default min_size for any created local pool", 2024-06-03T00:05:25.326 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-06-03T00:05:25.326 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.327 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.327 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.327 INFO:teuthology.orchestra.run.smithi049.stdout: "num_rep": { 2024-06-03T00:05:25.327 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "num_rep", 2024-06-03T00:05:25.327 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.327 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.327 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.327 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "3", 2024-06-03T00:05:25.327 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.327 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.327 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.327 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "default replica count for any created local pool", 2024-06-03T00:05:25.327 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.328 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.328 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.328 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.328 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": { 2024-06-03T00:05:25.328 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "pg_num", 2024-06-03T00:05:25.328 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.328 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.328 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.328 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "128", 2024-06-03T00:05:25.328 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.328 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.328 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.328 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "default pg_num for any created local pool", 2024-06-03T00:05:25.329 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.329 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.329 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.329 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.329 INFO:teuthology.orchestra.run.smithi049.stdout: "prefix": { 2024-06-03T00:05:25.329 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "prefix", 2024-06-03T00:05:25.329 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.329 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.329 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.329 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.329 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.329 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.329 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.329 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "name prefix for any created local pool", 2024-06-03T00:05:25.330 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.330 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.330 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.330 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.330 INFO:teuthology.orchestra.run.smithi049.stdout: "subtree": { 2024-06-03T00:05:25.330 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "subtree", 2024-06-03T00:05:25.330 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.330 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.330 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.330 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "rack", 2024-06-03T00:05:25.330 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.330 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.331 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.331 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "CRUSH level for which to create a local pool", 2024-06-03T00:05:25.331 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-06-03T00:05:25.331 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.331 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.331 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.331 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.331 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.331 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.331 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mds_autoscaler", 2024-06-03T00:05:25.331 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.331 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.331 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.331 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.332 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.332 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.332 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.332 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.332 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.332 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.332 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.332 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.332 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.332 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.332 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.332 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.332 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.333 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.333 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.333 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.333 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.333 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.333 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.333 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.333 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.333 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.333 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.333 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.333 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.333 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.333 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.334 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.334 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.334 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.334 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.334 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.334 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.334 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.334 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.334 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.334 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.334 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.334 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.334 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.334 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.335 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.335 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.335 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.335 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.335 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.335 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.335 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.335 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.335 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.335 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.335 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.335 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.335 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.335 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.336 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.336 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.336 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.336 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.336 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.336 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.336 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.336 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.336 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.336 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.336 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.336 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.336 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.336 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.337 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.337 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.337 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.337 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mirroring", 2024-06-03T00:05:25.337 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.337 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.337 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.337 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.337 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.337 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.337 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.337 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.337 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.337 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.338 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.338 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.338 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.338 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.338 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.338 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.338 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.338 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.338 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.338 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.338 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.338 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.338 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.339 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.339 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.339 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.339 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.339 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.339 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.339 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.339 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.339 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.339 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.339 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.339 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.339 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.339 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.339 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.340 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.340 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.340 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.340 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.340 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.340 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.340 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.340 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.340 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.340 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.340 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.340 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.340 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.341 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.341 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.341 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.341 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.341 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.341 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.341 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.341 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.341 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.341 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.341 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.341 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.341 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.342 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.342 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.342 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.342 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.342 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.342 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.342 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.342 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.342 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.342 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.342 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.342 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.342 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "nfs", 2024-06-03T00:05:25.343 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.343 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.343 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.343 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.343 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.343 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.343 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.343 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.343 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.343 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.343 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.343 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.343 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.343 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.344 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.344 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.344 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.344 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.344 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.344 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.344 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.344 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.344 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.344 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.344 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.344 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.344 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.344 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.345 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.345 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.345 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.345 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.345 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.345 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.345 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.345 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.345 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.345 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.345 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.345 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.345 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.345 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.346 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.346 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.346 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.346 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.346 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.346 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.346 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.346 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.346 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.346 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.346 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.346 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.346 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.346 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.347 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.347 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.347 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.347 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.347 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.347 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.347 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.347 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.347 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.347 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.347 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.347 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.347 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.347 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.348 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.348 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.348 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.348 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.348 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.348 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.348 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "orchestrator", 2024-06-03T00:05:25.348 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.348 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.348 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.348 INFO:teuthology.orchestra.run.smithi049.stdout: "fail_fs": { 2024-06-03T00:05:25.348 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "fail_fs", 2024-06-03T00:05:25.348 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.348 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.349 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.349 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.349 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.349 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.349 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.349 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-06-03T00:05:25.349 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.349 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.349 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.349 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.349 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.349 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.349 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.349 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.350 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.350 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.350 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.350 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.350 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.350 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.350 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.350 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.350 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.350 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.350 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.350 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.350 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.351 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.351 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.351 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.351 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.351 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.351 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.351 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.351 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.351 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.351 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.351 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.351 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.351 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.351 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.351 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.352 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.352 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.352 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.352 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.352 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.352 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.352 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.352 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.352 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.352 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.352 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.352 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.352 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.352 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.353 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.353 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.353 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.353 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.353 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.353 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.353 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.353 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.353 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.353 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.353 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.353 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.353 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.353 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.353 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.354 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.354 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.354 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.354 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.354 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.354 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.354 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.354 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.354 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.354 INFO:teuthology.orchestra.run.smithi049.stdout: "orchestrator": { 2024-06-03T00:05:25.354 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "orchestrator", 2024-06-03T00:05:25.354 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.354 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.355 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.355 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.355 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.355 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.355 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.355 INFO:teuthology.orchestra.run.smithi049.stdout: "cephadm", 2024-06-03T00:05:25.355 INFO:teuthology.orchestra.run.smithi049.stdout: "rook", 2024-06-03T00:05:25.355 INFO:teuthology.orchestra.run.smithi049.stdout: "test_orchestrator" 2024-06-03T00:05:25.355 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.355 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Orchestrator backend", 2024-06-03T00:05:25.355 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.355 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.355 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.355 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.356 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.356 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.356 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.356 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "osd_perf_query", 2024-06-03T00:05:25.356 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.356 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.356 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.356 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.356 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.356 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.356 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.356 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.356 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.356 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.357 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.357 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.357 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.357 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.357 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.357 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.357 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.357 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.357 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.357 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.357 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.357 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.357 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.357 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.358 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.358 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.358 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.358 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.358 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.358 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.358 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.358 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.358 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.358 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.358 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.358 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.358 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.358 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.359 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.359 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.359 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.359 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.359 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.359 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.359 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.359 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.359 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.359 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.359 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.359 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.359 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.359 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.359 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.360 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.360 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.360 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.360 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.360 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.360 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.360 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.360 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.360 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.360 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.360 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.360 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.360 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.361 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.361 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.361 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.361 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.361 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.361 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.361 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.361 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.361 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.361 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.361 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "osd_support", 2024-06-03T00:05:25.361 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.361 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.361 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.362 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.362 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.362 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.362 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.362 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.362 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.362 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.362 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.362 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.362 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.362 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.362 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.362 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.362 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.363 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.363 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.363 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.363 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.363 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.363 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.363 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.363 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.363 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.363 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.363 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.363 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.363 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.363 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.364 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.364 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.364 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.364 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.364 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.364 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.364 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.364 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.364 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.364 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.364 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.364 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.364 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.364 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.365 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.365 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.365 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.365 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.365 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.365 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.365 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.365 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.365 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.365 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.365 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.365 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.365 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.365 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.365 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.366 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.366 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.366 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.366 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.366 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.366 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.366 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.366 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.366 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.366 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.366 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.366 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.366 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.367 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.367 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.367 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.367 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "pg_autoscaler", 2024-06-03T00:05:25.367 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.367 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.367 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.367 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.367 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.367 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.367 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.367 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.367 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.367 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.368 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.368 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.368 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.368 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.368 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.368 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.368 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.368 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.368 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.368 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.368 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.368 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.368 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.368 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.369 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.369 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.369 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.369 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.369 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.369 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.369 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.369 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.369 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.369 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.369 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.369 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.369 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.369 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.369 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.370 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.370 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.370 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.370 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.370 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.370 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.370 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.370 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.370 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.370 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.370 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.370 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.371 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.371 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.371 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.371 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.371 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.371 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.371 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.371 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.371 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.371 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.371 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.371 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.371 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.371 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.372 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.372 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.372 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.372 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.372 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.372 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.372 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.372 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.372 INFO:teuthology.orchestra.run.smithi049.stdout: "sleep_interval": { 2024-06-03T00:05:25.372 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sleep_interval", 2024-06-03T00:05:25.372 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.372 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.372 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.373 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "60", 2024-06-03T00:05:25.373 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.373 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.373 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.373 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.373 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.373 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.373 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.373 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.373 INFO:teuthology.orchestra.run.smithi049.stdout: "threshold": { 2024-06-03T00:05:25.373 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "threshold", 2024-06-03T00:05:25.373 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-06-03T00:05:25.373 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.373 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.374 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "3.0", 2024-06-03T00:05:25.374 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "1.0", 2024-06-03T00:05:25.374 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.374 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.374 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "scaling threshold", 2024-06-03T00:05:25.374 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-06-03T00:05:25.374 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.374 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.374 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.374 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.374 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.374 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.374 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "progress", 2024-06-03T00:05:25.374 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.375 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.375 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.375 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_pg_recovery_event": { 2024-06-03T00:05:25.375 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "allow_pg_recovery_event", 2024-06-03T00:05:25.375 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.375 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.375 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.375 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.375 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.375 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.375 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.375 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "allow the module to show pg recovery progress", 2024-06-03T00:05:25.375 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.376 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.376 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.376 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.376 INFO:teuthology.orchestra.run.smithi049.stdout: "enabled": { 2024-06-03T00:05:25.376 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "enabled", 2024-06-03T00:05:25.376 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.376 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.376 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.376 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.376 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.376 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.376 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.376 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.376 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.377 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.377 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.377 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.377 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.377 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.377 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.377 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.377 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.377 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.377 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.377 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.377 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.377 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.377 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.377 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.378 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.378 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.378 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.378 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.378 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.378 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.378 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.378 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.378 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.378 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.378 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.378 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.378 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.378 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.379 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.379 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.379 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.379 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.379 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.379 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.379 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.379 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.379 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.379 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.379 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.379 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.379 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.379 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.380 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.380 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.380 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.380 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.380 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.380 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.380 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.380 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.380 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.380 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.380 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.380 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.380 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.381 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.381 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.381 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.381 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.381 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.381 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.381 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.381 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.381 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.381 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.381 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.381 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.381 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.381 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.381 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.382 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.382 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.382 INFO:teuthology.orchestra.run.smithi049.stdout: "max_completed_events": { 2024-06-03T00:05:25.382 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_completed_events", 2024-06-03T00:05:25.382 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.382 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.382 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.382 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "50", 2024-06-03T00:05:25.382 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.382 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.382 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.382 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "number of past completed events to remember", 2024-06-03T00:05:25.383 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.383 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.383 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.383 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.383 INFO:teuthology.orchestra.run.smithi049.stdout: "sleep_interval": { 2024-06-03T00:05:25.383 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sleep_interval", 2024-06-03T00:05:25.383 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.383 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.383 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.383 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5", 2024-06-03T00:05:25.383 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.383 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.383 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.384 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how long the module is going to sleep", 2024-06-03T00:05:25.384 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.384 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.384 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.384 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.384 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.384 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.384 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.384 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "prometheus", 2024-06-03T00:05:25.384 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.384 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.384 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.384 INFO:teuthology.orchestra.run.smithi049.stdout: "cache": { 2024-06-03T00:05:25.384 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cache", 2024-06-03T00:05:25.385 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.385 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.385 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.385 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.385 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.385 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.385 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.385 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.385 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.385 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.385 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.385 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.385 INFO:teuthology.orchestra.run.smithi049.stdout: "exclude_perf_counters": { 2024-06-03T00:05:25.385 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "exclude_perf_counters", 2024-06-03T00:05:25.386 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.386 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.386 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.386 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.386 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.386 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.386 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.386 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-06-03T00:05:25.386 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-06-03T00:05:25.386 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.386 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.386 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.386 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.387 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.387 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.387 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.387 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.387 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.387 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.387 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.387 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.387 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.387 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.387 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.387 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.387 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.387 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.388 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.388 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.388 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.388 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.388 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.388 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.388 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.388 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.388 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.388 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.388 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.388 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.388 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.389 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.389 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.389 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.389 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.389 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.389 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.389 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.389 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.389 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.389 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.389 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.389 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.389 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.389 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.390 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.390 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.390 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.390 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.390 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.390 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.390 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.390 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.390 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.390 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.390 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.390 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.390 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.391 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.391 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.391 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.391 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.391 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.391 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.391 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.391 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.391 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.391 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.391 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.391 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.391 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.391 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.392 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.392 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_stats_pools": { 2024-06-03T00:05:25.392 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rbd_stats_pools", 2024-06-03T00:05:25.392 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.392 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.392 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.392 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.392 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.392 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.392 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.392 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.392 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.392 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.392 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.393 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.393 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_stats_pools_refresh_interval": { 2024-06-03T00:05:25.393 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-06-03T00:05:25.393 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.393 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.393 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.393 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "300", 2024-06-03T00:05:25.393 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.393 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.393 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.393 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.393 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.393 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.393 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.393 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.394 INFO:teuthology.orchestra.run.smithi049.stdout: "scrape_interval": { 2024-06-03T00:05:25.394 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "scrape_interval", 2024-06-03T00:05:25.394 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-06-03T00:05:25.394 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.394 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.394 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "15.0", 2024-06-03T00:05:25.394 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.394 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.394 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.394 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.394 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.394 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.394 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.395 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.395 INFO:teuthology.orchestra.run.smithi049.stdout: "server_addr": { 2024-06-03T00:05:25.395 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_addr", 2024-06-03T00:05:25.395 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.395 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.395 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.395 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "::", 2024-06-03T00:05:25.395 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.395 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.395 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.395 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-06-03T00:05:25.395 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.395 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.395 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.396 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.396 INFO:teuthology.orchestra.run.smithi049.stdout: "server_port": { 2024-06-03T00:05:25.396 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_port", 2024-06-03T00:05:25.396 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.396 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.396 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.396 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "9283", 2024-06-03T00:05:25.396 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.396 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.396 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.396 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-06-03T00:05:25.396 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.396 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.396 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.397 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.397 INFO:teuthology.orchestra.run.smithi049.stdout: "stale_cache_strategy": { 2024-06-03T00:05:25.397 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "stale_cache_strategy", 2024-06-03T00:05:25.397 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.397 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.397 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.397 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "log", 2024-06-03T00:05:25.397 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.397 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.397 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.397 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.397 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.397 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.397 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.398 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.398 INFO:teuthology.orchestra.run.smithi049.stdout: "standby_behaviour": { 2024-06-03T00:05:25.398 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "standby_behaviour", 2024-06-03T00:05:25.398 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.398 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.398 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.398 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "default", 2024-06-03T00:05:25.398 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.398 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.398 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.398 INFO:teuthology.orchestra.run.smithi049.stdout: "default", 2024-06-03T00:05:25.398 INFO:teuthology.orchestra.run.smithi049.stdout: "error" 2024-06-03T00:05:25.398 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.399 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.399 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.399 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.399 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.399 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.399 INFO:teuthology.orchestra.run.smithi049.stdout: "standby_error_status_code": { 2024-06-03T00:05:25.399 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "standby_error_status_code", 2024-06-03T00:05:25.399 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.399 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.399 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.399 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "500", 2024-06-03T00:05:25.399 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "400", 2024-06-03T00:05:25.399 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "599", 2024-06-03T00:05:25.399 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.400 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.400 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.400 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.400 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.400 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.400 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.400 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.400 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.400 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rbd_support", 2024-06-03T00:05:25.400 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.400 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.400 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.400 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.400 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.401 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.401 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.401 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.401 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.401 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.401 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.401 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.401 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.401 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.401 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.401 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.401 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.401 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.401 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.402 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.402 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.402 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.402 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.402 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.402 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.402 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.402 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.402 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.402 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.402 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.402 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.402 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.402 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.403 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.403 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.403 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.403 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.403 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.403 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.403 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.403 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.403 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.403 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.403 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.403 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.403 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.403 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.403 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.404 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.404 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.404 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.404 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.404 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.404 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.404 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.404 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.404 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.404 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.404 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.404 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.404 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.405 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.405 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.405 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.405 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.405 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.405 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.405 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.405 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.405 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.405 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.405 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.405 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.405 INFO:teuthology.orchestra.run.smithi049.stdout: "max_concurrent_snap_create": { 2024-06-03T00:05:25.405 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_concurrent_snap_create", 2024-06-03T00:05:25.406 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.406 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.406 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.406 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-06-03T00:05:25.406 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.406 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.406 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.406 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.406 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.406 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.406 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.406 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.406 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_snapshot_schedule": { 2024-06-03T00:05:25.406 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mirror_snapshot_schedule", 2024-06-03T00:05:25.407 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.407 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.407 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.407 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.407 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.407 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.407 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.407 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.407 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.407 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.407 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.407 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.407 INFO:teuthology.orchestra.run.smithi049.stdout: "trash_purge_schedule": { 2024-06-03T00:05:25.407 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "trash_purge_schedule", 2024-06-03T00:05:25.408 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.408 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.408 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.408 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.408 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.408 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.408 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.408 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.408 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.408 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.408 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.408 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.408 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.408 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.409 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.409 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "restful", 2024-06-03T00:05:25.409 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.409 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.409 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.409 INFO:teuthology.orchestra.run.smithi049.stdout: "enable_auth": { 2024-06-03T00:05:25.409 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "enable_auth", 2024-06-03T00:05:25.409 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.409 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.409 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.409 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.409 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.409 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.409 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.409 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.410 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.410 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.410 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.410 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.410 INFO:teuthology.orchestra.run.smithi049.stdout: "key_file": { 2024-06-03T00:05:25.410 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "key_file", 2024-06-03T00:05:25.410 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.410 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.410 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.410 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.410 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.410 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.411 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.411 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.411 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.411 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.411 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.411 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.411 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.411 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.411 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.411 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.411 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.412 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.412 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.412 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.412 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.412 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.412 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.412 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.412 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.412 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.412 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.412 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.412 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.412 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.413 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.413 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.413 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.413 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.413 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.413 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.413 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.413 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.413 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.413 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.413 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.413 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.413 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.413 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.414 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.414 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.414 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.414 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.414 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.414 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.414 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.414 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.414 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.414 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.414 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.414 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.414 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.414 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.415 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.415 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.415 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.415 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.415 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.415 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.415 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.415 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.415 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.415 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.415 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.415 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.415 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.416 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.416 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.416 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.416 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.416 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.416 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.416 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.416 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.416 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.416 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.416 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.416 INFO:teuthology.orchestra.run.smithi049.stdout: "server_addr": { 2024-06-03T00:05:25.416 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_addr", 2024-06-03T00:05:25.417 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.417 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.417 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.417 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.417 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.417 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.417 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.417 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.417 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.417 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.417 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.417 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.417 INFO:teuthology.orchestra.run.smithi049.stdout: "server_port": { 2024-06-03T00:05:25.417 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_port", 2024-06-03T00:05:25.418 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.418 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.418 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.418 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.418 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.418 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.418 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.418 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.418 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.418 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.418 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.418 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.418 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.418 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.419 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.419 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rgw", 2024-06-03T00:05:25.419 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.419 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.419 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.419 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.419 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.419 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.419 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.419 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.419 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.419 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.419 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.419 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.420 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.420 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.420 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.420 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.420 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.420 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.420 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.420 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.420 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.420 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.420 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.420 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.420 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.421 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.421 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.421 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.421 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.421 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.421 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.421 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.421 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.421 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.421 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.421 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.421 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.421 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.421 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.422 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.422 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.422 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.422 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.422 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.422 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.422 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.422 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.422 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.422 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.422 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.422 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.422 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.423 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.423 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.423 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.423 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.423 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.423 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.423 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.423 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.423 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.423 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.423 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.423 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.423 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.423 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.424 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.424 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.424 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.424 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.424 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.424 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.424 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.424 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.424 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.424 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.424 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rook", 2024-06-03T00:05:25.424 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.424 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.425 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.425 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.425 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.425 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.425 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.425 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.425 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.425 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.425 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.425 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.425 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.425 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.425 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.425 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.426 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.426 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.426 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.426 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.426 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.426 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.426 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.426 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.426 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.426 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.426 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.427 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.427 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.427 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.427 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.427 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.427 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.427 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.427 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.427 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.427 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.427 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.427 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.427 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.427 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.428 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.428 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.428 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.428 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.428 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.428 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.428 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.428 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.428 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.428 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.428 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.428 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.428 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.428 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.429 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.429 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.429 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.429 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.429 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.429 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.429 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.429 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.429 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.429 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.429 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.429 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.429 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.429 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.430 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.430 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.430 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.430 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.430 INFO:teuthology.orchestra.run.smithi049.stdout: "storage_class": { 2024-06-03T00:05:25.430 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "storage_class", 2024-06-03T00:05:25.430 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.430 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.430 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.430 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "local", 2024-06-03T00:05:25.430 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.430 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.430 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.431 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-06-03T00:05:25.431 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.431 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.431 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.431 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.431 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.431 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.431 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.431 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "selftest", 2024-06-03T00:05:25.431 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.431 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.431 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.431 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.432 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.432 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.432 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.432 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.432 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.432 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.432 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.432 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.432 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.432 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.432 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.432 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.432 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.432 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.433 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.433 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.433 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.433 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.433 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.433 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.433 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.433 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.433 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.433 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.433 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.433 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.433 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.433 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.434 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.434 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.434 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.434 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.434 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.434 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.434 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.434 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.434 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.434 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.434 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.434 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.435 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.435 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.435 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.435 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.435 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.435 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.435 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.435 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.435 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.435 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.435 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.435 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.435 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.435 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.435 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.436 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.436 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.436 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.436 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.436 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.436 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.436 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.436 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.436 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.436 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.436 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.436 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.436 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.436 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.437 INFO:teuthology.orchestra.run.smithi049.stdout: "roption1": { 2024-06-03T00:05:25.437 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "roption1", 2024-06-03T00:05:25.437 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.437 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.437 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.437 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.437 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.437 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.437 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.437 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.437 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.437 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.437 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.437 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.438 INFO:teuthology.orchestra.run.smithi049.stdout: "roption2": { 2024-06-03T00:05:25.438 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "roption2", 2024-06-03T00:05:25.438 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.438 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.438 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.438 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "xyz", 2024-06-03T00:05:25.438 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.438 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.438 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.438 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.438 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.438 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.438 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.439 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.439 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption1": { 2024-06-03T00:05:25.439 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption1", 2024-06-03T00:05:25.439 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.439 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.439 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.439 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.439 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.439 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.439 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.439 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.439 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.439 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.439 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.440 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.440 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption2": { 2024-06-03T00:05:25.440 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption2", 2024-06-03T00:05:25.440 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.440 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.440 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.440 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.440 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.440 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.440 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.440 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.440 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.440 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.441 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.441 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.441 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption3": { 2024-06-03T00:05:25.441 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption3", 2024-06-03T00:05:25.441 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-06-03T00:05:25.441 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.441 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.441 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.441 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.441 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.441 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.441 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.441 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.442 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.442 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.442 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.442 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption4": { 2024-06-03T00:05:25.442 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption4", 2024-06-03T00:05:25.442 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.442 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.442 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.442 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.442 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.442 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.442 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.442 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.442 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.443 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.443 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.443 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.443 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption5": { 2024-06-03T00:05:25.443 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption5", 2024-06-03T00:05:25.443 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.443 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.443 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.443 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.443 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.443 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.443 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.443 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.444 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.444 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.444 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.444 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.444 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption6": { 2024-06-03T00:05:25.444 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption6", 2024-06-03T00:05:25.444 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.444 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.444 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.444 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.444 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.444 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.444 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.444 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.445 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.445 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.445 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.445 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.445 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption7": { 2024-06-03T00:05:25.445 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption7", 2024-06-03T00:05:25.445 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.445 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.445 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.445 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.445 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "1", 2024-06-03T00:05:25.445 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "42", 2024-06-03T00:05:25.445 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.445 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.446 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.446 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.446 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.446 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.446 INFO:teuthology.orchestra.run.smithi049.stdout: "testkey": { 2024-06-03T00:05:25.446 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "testkey", 2024-06-03T00:05:25.446 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.446 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.446 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.446 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.446 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.446 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.446 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.446 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.447 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.447 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.447 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.447 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.447 INFO:teuthology.orchestra.run.smithi049.stdout: "testlkey": { 2024-06-03T00:05:25.447 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "testlkey", 2024-06-03T00:05:25.447 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.447 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.447 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.447 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.447 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.447 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.447 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.447 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.448 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.448 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.448 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.448 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.448 INFO:teuthology.orchestra.run.smithi049.stdout: "testnewline": { 2024-06-03T00:05:25.448 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "testnewline", 2024-06-03T00:05:25.448 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.448 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.448 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.448 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.448 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.448 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.448 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.448 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.449 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.449 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.449 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.449 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.449 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.449 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.449 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.449 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snap_schedule", 2024-06-03T00:05:25.449 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.449 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.449 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.449 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_m_granularity": { 2024-06-03T00:05:25.449 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "allow_m_granularity", 2024-06-03T00:05:25.449 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.450 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.450 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.450 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.450 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.450 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.450 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.450 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "allow minute scheduled snapshots", 2024-06-03T00:05:25.450 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.450 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.450 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.450 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.450 INFO:teuthology.orchestra.run.smithi049.stdout: "dump_on_update": { 2024-06-03T00:05:25.450 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "dump_on_update", 2024-06-03T00:05:25.450 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.451 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.451 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.451 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.451 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.451 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.451 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.451 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "dump database to debug log on update", 2024-06-03T00:05:25.451 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.451 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.451 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.451 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.451 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.451 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.451 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.452 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.452 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.452 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.452 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.452 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.452 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.452 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.452 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.452 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.452 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.452 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.452 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.452 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.452 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.453 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.453 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.453 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.453 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.453 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.453 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.453 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.453 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.453 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.453 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.453 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.453 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.453 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.453 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.454 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.454 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.454 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.454 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.454 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.454 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.454 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.454 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.454 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.454 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.454 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.454 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.455 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.455 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.455 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.455 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.455 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.455 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.455 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.455 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.455 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.455 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.455 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.455 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.455 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.456 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.456 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.456 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.456 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.456 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.456 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.456 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.456 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.456 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.456 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.456 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.456 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.456 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.456 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.457 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.457 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.457 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.457 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "stats", 2024-06-03T00:05:25.457 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.457 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.457 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.457 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.457 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.457 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.457 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.457 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.457 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.457 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.457 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.458 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.458 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.458 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.458 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.458 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.458 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.458 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.458 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.458 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.458 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.458 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.458 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.458 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.459 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.459 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.459 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.459 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.459 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.459 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.459 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.459 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.459 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.459 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.459 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.459 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.459 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.459 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.460 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.460 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.460 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.460 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.460 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.460 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.460 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.460 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.460 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.460 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.460 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.460 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.460 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.460 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.461 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.461 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.461 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.461 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.461 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.461 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.461 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.461 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.461 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.461 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.461 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.461 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.461 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.461 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.462 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.462 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.462 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.462 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.462 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.462 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.462 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.462 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.462 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.462 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.462 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "status", 2024-06-03T00:05:25.462 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.462 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.463 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.463 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.463 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.463 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.463 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.463 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.463 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.463 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.463 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.463 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.463 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.463 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.463 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.463 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.464 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.464 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.464 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.464 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.464 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.464 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.464 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.464 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.464 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.464 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.464 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.464 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.464 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.464 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.464 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.465 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.465 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.465 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.465 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.465 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.465 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.465 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.465 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.465 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.465 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.465 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.465 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.465 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.465 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.466 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.466 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.466 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.466 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.466 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.466 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.466 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.466 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.466 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.466 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.466 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.466 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.466 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.466 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.467 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.467 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.467 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.467 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.467 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.467 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.467 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.467 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.467 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.467 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.467 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.467 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.467 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.467 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.468 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.468 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.468 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.468 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "telegraf", 2024-06-03T00:05:25.468 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.468 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.468 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.468 INFO:teuthology.orchestra.run.smithi049.stdout: "address": { 2024-06-03T00:05:25.468 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "address", 2024-06-03T00:05:25.468 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.468 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.468 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.468 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-06-03T00:05:25.469 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.469 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.469 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.469 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.469 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.469 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.469 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.469 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.469 INFO:teuthology.orchestra.run.smithi049.stdout: "interval": { 2024-06-03T00:05:25.469 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "interval", 2024-06-03T00:05:25.469 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.469 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.469 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.470 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "15", 2024-06-03T00:05:25.470 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.470 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.470 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.470 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.470 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.470 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.470 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.470 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.470 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.470 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.470 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.471 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.471 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.471 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.471 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.471 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.471 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.471 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.471 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.471 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.471 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.471 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.471 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.471 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.471 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.472 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.472 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.472 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.472 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.472 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.472 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.472 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.472 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.472 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.472 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.472 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.472 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.472 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.473 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.473 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.473 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.473 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.473 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.473 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.473 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.473 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.473 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.473 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.473 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.473 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.473 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.473 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.474 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.474 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.474 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.474 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.474 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.474 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.474 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.474 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.474 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.474 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.474 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.474 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.474 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.475 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.475 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.475 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.475 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.475 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.475 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.475 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.475 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.475 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.475 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.475 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.475 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.475 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.476 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.476 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.476 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.476 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "telemetry", 2024-06-03T00:05:25.476 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.476 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.476 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.476 INFO:teuthology.orchestra.run.smithi049.stdout: "channel_basic": { 2024-06-03T00:05:25.476 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "channel_basic", 2024-06-03T00:05:25.476 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.476 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.476 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.476 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.476 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.477 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.477 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.477 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Share basic cluster information (size, version)", 2024-06-03T00:05:25.477 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.477 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.477 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.477 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.477 INFO:teuthology.orchestra.run.smithi049.stdout: "channel_crash": { 2024-06-03T00:05:25.477 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "channel_crash", 2024-06-03T00:05:25.477 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.477 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.477 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.477 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.477 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.477 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.478 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.478 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-06-03T00:05:25.478 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.478 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.478 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.478 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.478 INFO:teuthology.orchestra.run.smithi049.stdout: "channel_device": { 2024-06-03T00:05:25.478 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "channel_device", 2024-06-03T00:05:25.478 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.478 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.478 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.478 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.478 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.479 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.479 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.479 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-06-03T00:05:25.479 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.479 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.479 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.479 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.479 INFO:teuthology.orchestra.run.smithi049.stdout: "channel_ident": { 2024-06-03T00:05:25.479 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "channel_ident", 2024-06-03T00:05:25.479 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.479 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.479 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.479 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.479 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.480 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.480 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.480 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-06-03T00:05:25.480 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.480 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.480 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.480 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.480 INFO:teuthology.orchestra.run.smithi049.stdout: "channel_perf": { 2024-06-03T00:05:25.480 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "channel_perf", 2024-06-03T00:05:25.480 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.480 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.480 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.480 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.480 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.481 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.481 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.481 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Share various performance metrics of a cluster", 2024-06-03T00:05:25.481 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.481 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.481 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.481 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.481 INFO:teuthology.orchestra.run.smithi049.stdout: "contact": { 2024-06-03T00:05:25.481 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "contact", 2024-06-03T00:05:25.481 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.481 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.481 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.481 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.481 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.482 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.482 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.482 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.482 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.482 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.482 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.482 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.482 INFO:teuthology.orchestra.run.smithi049.stdout: "description": { 2024-06-03T00:05:25.482 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "description", 2024-06-03T00:05:25.482 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.482 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.482 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.482 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.483 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.483 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.483 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.483 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.483 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.483 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.483 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.483 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.483 INFO:teuthology.orchestra.run.smithi049.stdout: "device_url": { 2024-06-03T00:05:25.483 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "device_url", 2024-06-03T00:05:25.483 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.483 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.483 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.484 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-06-03T00:05:25.484 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.484 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.484 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.484 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.484 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.484 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.484 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.484 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.484 INFO:teuthology.orchestra.run.smithi049.stdout: "enabled": { 2024-06-03T00:05:25.484 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "enabled", 2024-06-03T00:05:25.484 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.484 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.484 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.485 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.485 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.485 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.485 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.485 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.485 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.485 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.485 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.485 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.485 INFO:teuthology.orchestra.run.smithi049.stdout: "interval": { 2024-06-03T00:05:25.485 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "interval", 2024-06-03T00:05:25.485 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.485 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.485 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.486 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "24", 2024-06-03T00:05:25.486 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "8", 2024-06-03T00:05:25.486 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.486 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.486 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.486 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.486 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.486 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.486 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.486 INFO:teuthology.orchestra.run.smithi049.stdout: "last_opt_revision": { 2024-06-03T00:05:25.486 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "last_opt_revision", 2024-06-03T00:05:25.486 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.486 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.487 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.487 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "1", 2024-06-03T00:05:25.487 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.487 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.487 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.487 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.487 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.487 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.487 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.487 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.487 INFO:teuthology.orchestra.run.smithi049.stdout: "leaderboard": { 2024-06-03T00:05:25.487 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "leaderboard", 2024-06-03T00:05:25.487 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.487 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.488 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.488 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.488 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.488 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.488 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.488 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.488 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.488 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.488 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.488 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.488 INFO:teuthology.orchestra.run.smithi049.stdout: "leaderboard_description": { 2024-06-03T00:05:25.488 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "leaderboard_description", 2024-06-03T00:05:25.488 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.488 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.489 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.489 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.489 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.489 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.489 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.489 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.489 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.489 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.489 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.489 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.489 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.489 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.489 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.489 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.490 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.490 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.490 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.490 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.490 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.490 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.490 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.490 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.490 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.490 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.490 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.490 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.490 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.491 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.491 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.491 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.491 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.491 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.491 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.491 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.491 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.491 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.491 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.491 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.491 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.491 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.491 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.491 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.492 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.492 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.492 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.492 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.492 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.492 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.492 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.492 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.492 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.492 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.492 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.492 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.492 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.492 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.493 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.493 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.493 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.493 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.493 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.493 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.493 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.493 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.493 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.493 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.493 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.493 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.493 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.493 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.493 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.494 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.494 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.494 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.494 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.494 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.494 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.494 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.494 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.494 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.494 INFO:teuthology.orchestra.run.smithi049.stdout: "organization": { 2024-06-03T00:05:25.494 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "organization", 2024-06-03T00:05:25.494 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.494 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.494 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.495 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.495 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.495 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.495 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.495 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.495 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.495 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.495 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.495 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.495 INFO:teuthology.orchestra.run.smithi049.stdout: "proxy": { 2024-06-03T00:05:25.495 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "proxy", 2024-06-03T00:05:25.495 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.495 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.496 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.496 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.496 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.496 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.496 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.496 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.496 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.496 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.496 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.496 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.496 INFO:teuthology.orchestra.run.smithi049.stdout: "url": { 2024-06-03T00:05:25.496 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "url", 2024-06-03T00:05:25.496 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.496 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.497 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.497 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-06-03T00:05:25.497 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.497 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.497 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.497 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.497 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.497 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.497 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.497 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.497 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.497 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.497 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.497 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "test_orchestrator", 2024-06-03T00:05:25.498 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.498 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.498 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.498 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.498 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.498 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.498 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.498 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.498 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.498 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.498 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.498 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.498 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.498 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.499 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.499 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.499 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.499 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.499 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.499 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.499 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.499 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.499 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.499 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.499 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.499 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.499 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.500 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.500 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.500 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.500 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.500 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.500 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.500 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.500 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.500 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.500 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.500 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.500 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.500 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.500 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.501 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.501 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.501 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.501 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.501 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.501 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.501 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.501 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.501 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.501 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.501 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.501 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.501 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.502 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.502 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.502 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.502 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.502 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.502 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.502 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.502 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.502 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.502 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.502 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.502 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.502 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.503 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.503 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.503 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.503 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.503 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.503 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.503 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.503 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.503 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.503 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "volumes", 2024-06-03T00:05:25.503 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.503 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.503 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.503 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.504 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.504 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.504 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.504 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.504 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.504 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.504 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.504 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.504 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.504 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.504 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.504 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.504 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.504 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.505 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.505 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.505 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.505 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.505 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.505 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.505 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.505 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.505 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.505 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.505 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.505 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.505 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.505 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.506 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.506 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.506 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.506 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.506 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.506 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.506 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.506 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.506 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.506 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.506 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.506 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.506 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.506 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.507 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.507 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.507 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.507 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.507 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.507 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.507 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.507 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.507 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.507 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.507 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.507 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.507 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.508 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.508 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.508 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.508 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.508 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.508 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.508 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.508 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.508 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.508 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.508 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.508 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.508 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.508 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.509 INFO:teuthology.orchestra.run.smithi049.stdout: "max_concurrent_clones": { 2024-06-03T00:05:25.509 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_concurrent_clones", 2024-06-03T00:05:25.509 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.509 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.509 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.509 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "4", 2024-06-03T00:05:25.509 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.509 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.509 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.509 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Number of asynchronous cloner threads", 2024-06-03T00:05:25.509 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.509 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.509 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.509 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.510 INFO:teuthology.orchestra.run.smithi049.stdout: "periodic_async_work": { 2024-06-03T00:05:25.510 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "periodic_async_work", 2024-06-03T00:05:25.510 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.510 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.510 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.510 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.510 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.510 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.510 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.510 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Periodically check for async work", 2024-06-03T00:05:25.510 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.510 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.511 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.511 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.511 INFO:teuthology.orchestra.run.smithi049.stdout: "snapshot_clone_delay": { 2024-06-03T00:05:25.511 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snapshot_clone_delay", 2024-06-03T00:05:25.511 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.511 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.511 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.511 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-06-03T00:05:25.511 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.511 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.511 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.511 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-06-03T00:05:25.511 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.511 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.512 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.512 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.512 INFO:teuthology.orchestra.run.smithi049.stdout: "snapshot_clone_no_wait": { 2024-06-03T00:05:25.512 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snapshot_clone_no_wait", 2024-06-03T00:05:25.512 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.512 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.512 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.512 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.512 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.512 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.512 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.512 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-06-03T00:05:25.512 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.512 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.513 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.513 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.513 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.513 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.513 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.513 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "zabbix", 2024-06-03T00:05:25.513 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.513 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.513 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.513 INFO:teuthology.orchestra.run.smithi049.stdout: "discovery_interval": { 2024-06-03T00:05:25.513 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "discovery_interval", 2024-06-03T00:05:25.513 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "uint", 2024-06-03T00:05:25.513 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.513 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.514 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "100", 2024-06-03T00:05:25.514 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.514 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.514 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.514 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.514 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.514 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.514 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.514 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.514 INFO:teuthology.orchestra.run.smithi049.stdout: "identifier": { 2024-06-03T00:05:25.514 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "identifier", 2024-06-03T00:05:25.514 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.514 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.515 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.515 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.515 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.515 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.515 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.515 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.515 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.515 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.515 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.515 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.515 INFO:teuthology.orchestra.run.smithi049.stdout: "interval": { 2024-06-03T00:05:25.515 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "interval", 2024-06-03T00:05:25.515 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.516 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.516 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.516 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "60", 2024-06-03T00:05:25.516 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.516 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.516 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.516 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.516 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.516 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.516 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.516 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.516 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.516 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.517 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.517 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.517 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.517 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.517 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.517 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.517 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.517 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.517 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.517 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.517 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.517 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.517 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.517 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.518 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.518 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.518 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.518 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.518 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.518 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.518 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.518 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.518 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.518 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.518 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.518 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.518 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.519 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.519 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.519 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.519 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.519 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.519 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.519 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.519 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.519 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.519 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.519 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.519 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.519 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.519 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.520 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.520 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.520 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.520 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.520 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.520 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.520 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.520 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.520 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.520 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.520 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.520 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.520 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.520 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.521 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.521 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.521 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.521 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.521 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.521 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.521 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.521 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.521 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.521 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.521 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.521 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.521 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.521 INFO:teuthology.orchestra.run.smithi049.stdout: "zabbix_host": { 2024-06-03T00:05:25.522 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "zabbix_host", 2024-06-03T00:05:25.522 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.522 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.522 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.522 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.522 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.522 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.522 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.522 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.522 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.522 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.522 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.522 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.523 INFO:teuthology.orchestra.run.smithi049.stdout: "zabbix_port": { 2024-06-03T00:05:25.523 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "zabbix_port", 2024-06-03T00:05:25.523 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.523 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.523 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.523 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10051", 2024-06-03T00:05:25.523 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.523 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.523 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.523 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.523 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.523 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.523 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.523 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.524 INFO:teuthology.orchestra.run.smithi049.stdout: "zabbix_sender": { 2024-06-03T00:05:25.524 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "zabbix_sender", 2024-06-03T00:05:25.524 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.524 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.524 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.524 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-06-03T00:05:25.524 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.524 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.524 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.524 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.524 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.524 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.524 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.525 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.525 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.525 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.525 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-06-03T00:05:25.525 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.525 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.525 INFO:teuthology.orchestra.run.smithi049.stdout: "gid": 24119, 2024-06-03T00:05:25.525 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "y", 2024-06-03T00:05:25.525 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr_features": 4540701547738038271, 2024-06-03T00:05:25.525 INFO:teuthology.orchestra.run.smithi049.stdout: "available_modules": [ 2024-06-03T00:05:25.525 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.525 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "alerts", 2024-06-03T00:05:25.525 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.525 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.526 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.526 INFO:teuthology.orchestra.run.smithi049.stdout: "interval": { 2024-06-03T00:05:25.526 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "interval", 2024-06-03T00:05:25.526 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.526 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.526 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.526 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "60", 2024-06-03T00:05:25.526 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.526 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.526 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.526 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "How frequently to reexamine health status", 2024-06-03T00:05:25.526 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.526 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.527 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.527 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.527 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.527 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.527 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.527 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.527 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.527 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.527 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.527 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.527 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.527 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.527 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.527 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.527 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.528 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.528 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.528 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.528 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.528 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.528 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.528 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.528 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.528 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.528 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.528 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.528 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.528 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.528 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.529 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.529 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.529 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.529 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.529 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.529 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.529 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.529 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.529 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.529 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.529 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.529 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.529 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.529 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.530 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.530 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.530 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.530 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.530 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.530 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.530 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.530 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.530 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.530 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.530 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.530 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.530 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.530 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.531 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.531 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.531 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.531 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.531 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.531 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.531 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.531 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.531 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.531 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.531 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.531 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.531 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.531 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.532 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.532 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_destination": { 2024-06-03T00:05:25.532 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_destination", 2024-06-03T00:05:25.532 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.532 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.532 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.532 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.532 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.532 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.532 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.532 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Email address to send alerts to", 2024-06-03T00:05:25.532 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.532 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.532 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.532 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.533 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_from_name": { 2024-06-03T00:05:25.533 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_from_name", 2024-06-03T00:05:25.533 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.533 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.533 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.533 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "Ceph", 2024-06-03T00:05:25.533 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.533 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.533 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.533 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Email From: name", 2024-06-03T00:05:25.533 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.533 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.533 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.533 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.534 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_host": { 2024-06-03T00:05:25.534 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_host", 2024-06-03T00:05:25.534 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.534 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.534 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.534 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.534 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.534 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.534 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.534 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "SMTP server", 2024-06-03T00:05:25.534 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.534 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.534 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.535 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.535 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_password": { 2024-06-03T00:05:25.535 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_password", 2024-06-03T00:05:25.535 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.535 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.535 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.535 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.535 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.535 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.535 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.535 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Password to authenticate with", 2024-06-03T00:05:25.535 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.535 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.535 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.536 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.536 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_port": { 2024-06-03T00:05:25.536 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_port", 2024-06-03T00:05:25.536 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.536 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.536 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.536 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "465", 2024-06-03T00:05:25.536 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.536 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.536 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.536 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "SMTP port", 2024-06-03T00:05:25.536 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.536 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.536 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.536 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.537 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_sender": { 2024-06-03T00:05:25.537 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_sender", 2024-06-03T00:05:25.537 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.537 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.537 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.537 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.537 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.537 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.537 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.537 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "SMTP envelope sender", 2024-06-03T00:05:25.537 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.537 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.537 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.537 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.538 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_ssl": { 2024-06-03T00:05:25.538 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_ssl", 2024-06-03T00:05:25.538 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.538 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.538 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.538 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.538 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.538 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.538 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.538 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Use SSL to connect to SMTP server", 2024-06-03T00:05:25.538 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.538 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.538 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.539 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.539 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_user": { 2024-06-03T00:05:25.539 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_user", 2024-06-03T00:05:25.539 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.539 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.539 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.539 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.539 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.539 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.539 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.539 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "User to authenticate as", 2024-06-03T00:05:25.539 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.540 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.540 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.540 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.540 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.540 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.540 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.540 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "balancer", 2024-06-03T00:05:25.540 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.540 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.540 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.540 INFO:teuthology.orchestra.run.smithi049.stdout: "active": { 2024-06-03T00:05:25.540 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "active", 2024-06-03T00:05:25.540 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.541 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.541 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.541 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.541 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.541 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.541 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.541 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "automatically balance PGs across cluster", 2024-06-03T00:05:25.541 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.541 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.541 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.541 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.541 INFO:teuthology.orchestra.run.smithi049.stdout: "begin_time": { 2024-06-03T00:05:25.541 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "begin_time", 2024-06-03T00:05:25.541 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.542 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.542 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.542 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0000", 2024-06-03T00:05:25.542 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.542 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.542 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.542 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "beginning time of day to automatically balance", 2024-06-03T00:05:25.542 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-03T00:05:25.542 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.542 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.542 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.542 INFO:teuthology.orchestra.run.smithi049.stdout: "begin_weekday": { 2024-06-03T00:05:25.543 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "begin_weekday", 2024-06-03T00:05:25.543 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "uint", 2024-06-03T00:05:25.543 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.543 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.543 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-06-03T00:05:25.543 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "0", 2024-06-03T00:05:25.543 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "6", 2024-06-03T00:05:25.543 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.543 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-06-03T00:05:25.543 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-03T00:05:25.543 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.543 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.544 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.544 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_compat_max_iterations": { 2024-06-03T00:05:25.544 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "crush_compat_max_iterations", 2024-06-03T00:05:25.544 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "uint", 2024-06-03T00:05:25.544 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.544 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.544 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "25", 2024-06-03T00:05:25.544 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "1", 2024-06-03T00:05:25.544 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "250", 2024-06-03T00:05:25.544 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.544 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-06-03T00:05:25.544 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.544 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.545 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.545 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.545 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_compat_metrics": { 2024-06-03T00:05:25.545 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "crush_compat_metrics", 2024-06-03T00:05:25.545 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.545 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.545 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.545 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "pgs,objects,bytes", 2024-06-03T00:05:25.545 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.545 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.545 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.545 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-06-03T00:05:25.545 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-06-03T00:05:25.546 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.546 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.546 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.546 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_compat_step": { 2024-06-03T00:05:25.546 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "crush_compat_step", 2024-06-03T00:05:25.546 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-06-03T00:05:25.546 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.546 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.546 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0.5", 2024-06-03T00:05:25.546 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "0.001", 2024-06-03T00:05:25.546 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "0.999", 2024-06-03T00:05:25.546 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.546 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "aggressiveness of optimization", 2024-06-03T00:05:25.546 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-06-03T00:05:25.547 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.547 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.547 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.547 INFO:teuthology.orchestra.run.smithi049.stdout: "end_time": { 2024-06-03T00:05:25.547 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "end_time", 2024-06-03T00:05:25.547 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.547 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.547 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.547 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "2359", 2024-06-03T00:05:25.547 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.547 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.547 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.547 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "ending time of day to automatically balance", 2024-06-03T00:05:25.547 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-03T00:05:25.548 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.548 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.548 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.548 INFO:teuthology.orchestra.run.smithi049.stdout: "end_weekday": { 2024-06-03T00:05:25.548 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "end_weekday", 2024-06-03T00:05:25.548 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "uint", 2024-06-03T00:05:25.548 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.548 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.548 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-06-03T00:05:25.548 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "0", 2024-06-03T00:05:25.548 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "6", 2024-06-03T00:05:25.548 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.548 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-06-03T00:05:25.548 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-03T00:05:25.549 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.549 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.549 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.549 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.549 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.549 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.549 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.549 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.549 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.549 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.549 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.549 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.549 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.549 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.550 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.550 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.550 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.550 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.550 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.550 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.550 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.550 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.550 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.550 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.550 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.550 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.550 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.550 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.551 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.551 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.551 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.551 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.551 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.551 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.551 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.551 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.551 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.551 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.551 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.551 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.551 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.552 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.552 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.552 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.552 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.552 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.552 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.552 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.552 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.552 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.552 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.552 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.552 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.552 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.552 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.553 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.553 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.553 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.553 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.553 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.553 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.553 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.553 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.553 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.553 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.553 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.553 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.553 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.554 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.554 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.554 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.554 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.554 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.554 INFO:teuthology.orchestra.run.smithi049.stdout: "min_score": { 2024-06-03T00:05:25.554 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "min_score", 2024-06-03T00:05:25.554 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-06-03T00:05:25.554 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.554 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.554 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-06-03T00:05:25.554 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.554 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.554 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.555 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-06-03T00:05:25.555 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.555 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.555 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.555 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.555 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": { 2024-06-03T00:05:25.555 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mode", 2024-06-03T00:05:25.555 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.555 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.555 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.555 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "upmap", 2024-06-03T00:05:25.555 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.556 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.556 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.556 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-compat", 2024-06-03T00:05:25.556 INFO:teuthology.orchestra.run.smithi049.stdout: "none", 2024-06-03T00:05:25.556 INFO:teuthology.orchestra.run.smithi049.stdout: "read", 2024-06-03T00:05:25.556 INFO:teuthology.orchestra.run.smithi049.stdout: "upmap", 2024-06-03T00:05:25.556 INFO:teuthology.orchestra.run.smithi049.stdout: "upmap-read" 2024-06-03T00:05:25.556 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.556 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Balancer mode", 2024-06-03T00:05:25.556 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.556 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.556 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.556 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.556 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_ids": { 2024-06-03T00:05:25.557 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "pool_ids", 2024-06-03T00:05:25.557 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.557 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.557 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.557 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.557 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.557 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.557 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.557 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-06-03T00:05:25.557 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.557 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.557 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.557 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.558 INFO:teuthology.orchestra.run.smithi049.stdout: "sleep_interval": { 2024-06-03T00:05:25.558 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sleep_interval", 2024-06-03T00:05:25.558 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.558 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.558 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.558 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "60", 2024-06-03T00:05:25.558 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.558 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.558 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.558 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-06-03T00:05:25.558 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.558 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.558 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.558 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.559 INFO:teuthology.orchestra.run.smithi049.stdout: "upmap_max_deviation": { 2024-06-03T00:05:25.559 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "upmap_max_deviation", 2024-06-03T00:05:25.559 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.559 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.559 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.559 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5", 2024-06-03T00:05:25.559 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "1", 2024-06-03T00:05:25.559 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.559 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.559 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "deviation below which no optimization is attempted", 2024-06-03T00:05:25.559 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-06-03T00:05:25.559 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.560 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.560 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.560 INFO:teuthology.orchestra.run.smithi049.stdout: "upmap_max_optimizations": { 2024-06-03T00:05:25.560 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "upmap_max_optimizations", 2024-06-03T00:05:25.560 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "uint", 2024-06-03T00:05:25.560 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.560 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.560 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-06-03T00:05:25.560 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.560 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.560 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.560 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-06-03T00:05:25.560 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.560 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.561 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.561 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.561 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.561 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.561 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.561 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cephadm", 2024-06-03T00:05:25.561 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.561 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.561 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.561 INFO:teuthology.orchestra.run.smithi049.stdout: "agent_down_multiplier": { 2024-06-03T00:05:25.561 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "agent_down_multiplier", 2024-06-03T00:05:25.561 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-06-03T00:05:25.561 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.561 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.562 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "3.0", 2024-06-03T00:05:25.562 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.562 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.562 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.562 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-06-03T00:05:25.562 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.562 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.562 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.562 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.562 INFO:teuthology.orchestra.run.smithi049.stdout: "agent_refresh_rate": { 2024-06-03T00:05:25.562 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "agent_refresh_rate", 2024-06-03T00:05:25.562 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.562 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.562 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.563 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "20", 2024-06-03T00:05:25.563 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.563 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.563 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.563 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-06-03T00:05:25.563 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.563 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.563 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.563 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.563 INFO:teuthology.orchestra.run.smithi049.stdout: "agent_starting_port": { 2024-06-03T00:05:25.563 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "agent_starting_port", 2024-06-03T00:05:25.563 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.563 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.563 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.563 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "4721", 2024-06-03T00:05:25.564 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.564 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.564 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.564 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-06-03T00:05:25.564 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.564 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.564 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.564 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.564 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_ptrace": { 2024-06-03T00:05:25.564 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "allow_ptrace", 2024-06-03T00:05:25.564 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.564 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.564 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.564 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.565 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.565 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.565 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.565 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-06-03T00:05:25.565 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-06-03T00:05:25.565 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.565 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.565 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.565 INFO:teuthology.orchestra.run.smithi049.stdout: "autotune_interval": { 2024-06-03T00:05:25.565 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "autotune_interval", 2024-06-03T00:05:25.565 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.565 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.566 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.566 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "600", 2024-06-03T00:05:25.566 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.566 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.566 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.566 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how frequently to autotune daemon memory", 2024-06-03T00:05:25.566 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.566 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.566 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.566 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.566 INFO:teuthology.orchestra.run.smithi049.stdout: "autotune_memory_target_ratio": { 2024-06-03T00:05:25.566 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "autotune_memory_target_ratio", 2024-06-03T00:05:25.566 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-06-03T00:05:25.566 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.567 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.567 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0.7", 2024-06-03T00:05:25.567 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.567 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.567 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.567 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-06-03T00:05:25.567 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.567 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.567 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.567 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.567 INFO:teuthology.orchestra.run.smithi049.stdout: "cephadm_log_destination": { 2024-06-03T00:05:25.567 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cephadm_log_destination", 2024-06-03T00:05:25.567 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.568 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.568 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.568 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.568 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.568 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.568 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.568 INFO:teuthology.orchestra.run.smithi049.stdout: "file", 2024-06-03T00:05:25.568 INFO:teuthology.orchestra.run.smithi049.stdout: "file,syslog", 2024-06-03T00:05:25.568 INFO:teuthology.orchestra.run.smithi049.stdout: "syslog" 2024-06-03T00:05:25.568 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.568 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-06-03T00:05:25.568 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.568 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.568 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.569 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.569 INFO:teuthology.orchestra.run.smithi049.stdout: "cgroups_split": { 2024-06-03T00:05:25.569 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cgroups_split", 2024-06-03T00:05:25.569 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.569 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.569 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.569 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.569 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.569 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.569 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.569 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-06-03T00:05:25.569 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.569 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.569 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.570 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.570 INFO:teuthology.orchestra.run.smithi049.stdout: "config_checks_enabled": { 2024-06-03T00:05:25.570 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "config_checks_enabled", 2024-06-03T00:05:25.570 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.570 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.570 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.570 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.570 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.570 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.570 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.570 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-06-03T00:05:25.570 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.570 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.570 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.571 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.571 INFO:teuthology.orchestra.run.smithi049.stdout: "config_dashboard": { 2024-06-03T00:05:25.571 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "config_dashboard", 2024-06-03T00:05:25.571 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.571 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.571 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.571 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.571 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.571 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.571 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.571 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-06-03T00:05:25.571 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.571 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.571 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.572 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.572 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_alertmanager": { 2024-06-03T00:05:25.572 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_alertmanager", 2024-06-03T00:05:25.572 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.572 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.572 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.572 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-06-03T00:05:25.572 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.572 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.572 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.572 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Prometheus container image", 2024-06-03T00:05:25.572 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.572 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.573 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.573 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.573 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_base": { 2024-06-03T00:05:25.573 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_base", 2024-06-03T00:05:25.573 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.573 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.573 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.573 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/ceph", 2024-06-03T00:05:25.573 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.573 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.573 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.573 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Container image name, without the tag", 2024-06-03T00:05:25.573 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.573 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.573 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.574 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.574 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_elasticsearch": { 2024-06-03T00:05:25.574 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_elasticsearch", 2024-06-03T00:05:25.574 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.574 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.574 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.574 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-06-03T00:05:25.574 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.574 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.574 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.574 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "elasticsearch container image", 2024-06-03T00:05:25.574 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.574 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.574 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.575 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.575 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_grafana": { 2024-06-03T00:05:25.575 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_grafana", 2024-06-03T00:05:25.575 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.575 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.575 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.575 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-06-03T00:05:25.575 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.575 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.575 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.575 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Prometheus container image", 2024-06-03T00:05:25.575 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.575 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.576 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.576 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.576 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_haproxy": { 2024-06-03T00:05:25.576 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_haproxy", 2024-06-03T00:05:25.576 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.576 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.576 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.576 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-06-03T00:05:25.576 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.576 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.576 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.576 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "HAproxy container image", 2024-06-03T00:05:25.576 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.576 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.577 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.577 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.577 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_jaeger_agent": { 2024-06-03T00:05:25.577 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_jaeger_agent", 2024-06-03T00:05:25.577 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.577 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.577 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.577 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-06-03T00:05:25.577 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.577 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.577 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.577 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Jaeger agent container image", 2024-06-03T00:05:25.577 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.578 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.578 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.578 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.578 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_jaeger_collector": { 2024-06-03T00:05:25.578 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_jaeger_collector", 2024-06-03T00:05:25.578 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.578 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.578 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.578 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-06-03T00:05:25.578 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.578 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.578 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.578 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Jaeger collector container image", 2024-06-03T00:05:25.579 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.579 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.579 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.579 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.579 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_jaeger_query": { 2024-06-03T00:05:25.579 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_jaeger_query", 2024-06-03T00:05:25.579 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.579 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.579 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.579 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-06-03T00:05:25.579 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.579 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.579 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.579 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Jaeger query container image", 2024-06-03T00:05:25.580 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.580 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.580 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.580 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.580 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_keepalived": { 2024-06-03T00:05:25.580 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_keepalived", 2024-06-03T00:05:25.580 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.580 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.580 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.580 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-06-03T00:05:25.580 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.580 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.580 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.581 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Keepalived container image", 2024-06-03T00:05:25.581 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.581 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.581 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.581 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.581 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_loki": { 2024-06-03T00:05:25.581 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_loki", 2024-06-03T00:05:25.581 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.581 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.581 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.581 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-06-03T00:05:25.581 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.581 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.581 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.582 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Loki container image", 2024-06-03T00:05:25.582 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.582 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.582 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.582 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.582 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_node_exporter": { 2024-06-03T00:05:25.582 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_node_exporter", 2024-06-03T00:05:25.582 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.582 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.582 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.582 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-06-03T00:05:25.582 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.582 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.583 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.583 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Prometheus container image", 2024-06-03T00:05:25.583 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.583 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.583 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.583 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.583 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_nvmeof": { 2024-06-03T00:05:25.583 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_nvmeof", 2024-06-03T00:05:25.583 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.583 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.583 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.583 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-06-03T00:05:25.583 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.583 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.584 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.584 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Nvme-of container image", 2024-06-03T00:05:25.584 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.584 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.584 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.584 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.584 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_prometheus": { 2024-06-03T00:05:25.584 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_prometheus", 2024-06-03T00:05:25.584 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.584 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.584 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.584 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-06-03T00:05:25.584 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.584 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.585 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.585 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Prometheus container image", 2024-06-03T00:05:25.585 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.585 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.585 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.585 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.585 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_promtail": { 2024-06-03T00:05:25.585 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_promtail", 2024-06-03T00:05:25.585 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.585 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.585 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.585 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-06-03T00:05:25.585 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.585 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.586 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.586 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Promtail container image", 2024-06-03T00:05:25.586 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.586 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.586 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.586 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.586 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_samba": { 2024-06-03T00:05:25.586 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_samba", 2024-06-03T00:05:25.586 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.586 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.586 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.586 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-06-03T00:05:25.586 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.587 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.587 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.587 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Samba/SMB container image", 2024-06-03T00:05:25.587 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.587 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.587 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.587 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.587 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_snmp_gateway": { 2024-06-03T00:05:25.587 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_snmp_gateway", 2024-06-03T00:05:25.587 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.587 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.587 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.587 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-06-03T00:05:25.587 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.588 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.588 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.588 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "SNMP Gateway container image", 2024-06-03T00:05:25.588 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.588 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.588 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.588 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.588 INFO:teuthology.orchestra.run.smithi049.stdout: "container_init": { 2024-06-03T00:05:25.588 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_init", 2024-06-03T00:05:25.588 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.588 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.588 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.588 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.589 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.589 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.589 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.589 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Run podman/docker with `--init`", 2024-06-03T00:05:25.589 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.589 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.589 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.589 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.589 INFO:teuthology.orchestra.run.smithi049.stdout: "daemon_cache_timeout": { 2024-06-03T00:05:25.589 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "daemon_cache_timeout", 2024-06-03T00:05:25.589 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.589 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.589 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.590 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "600", 2024-06-03T00:05:25.590 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.590 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.590 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.590 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-06-03T00:05:25.590 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.590 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.590 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.590 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.590 INFO:teuthology.orchestra.run.smithi049.stdout: "default_cephadm_command_timeout": { 2024-06-03T00:05:25.590 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "default_cephadm_command_timeout", 2024-06-03T00:05:25.590 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.590 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.591 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.591 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "900", 2024-06-03T00:05:25.591 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.591 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.591 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.591 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-06-03T00:05:25.591 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.591 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.591 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.591 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.591 INFO:teuthology.orchestra.run.smithi049.stdout: "default_registry": { 2024-06-03T00:05:25.591 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "default_registry", 2024-06-03T00:05:25.591 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.591 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.592 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.592 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "docker.io", 2024-06-03T00:05:25.592 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.592 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.592 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.592 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-06-03T00:05:25.592 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.592 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.592 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.592 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.592 INFO:teuthology.orchestra.run.smithi049.stdout: "device_cache_timeout": { 2024-06-03T00:05:25.592 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "device_cache_timeout", 2024-06-03T00:05:25.592 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.592 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.593 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.593 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "1800", 2024-06-03T00:05:25.593 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.593 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.593 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.593 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "seconds to cache device inventory", 2024-06-03T00:05:25.593 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.593 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.593 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.593 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.593 INFO:teuthology.orchestra.run.smithi049.stdout: "device_enhanced_scan": { 2024-06-03T00:05:25.593 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "device_enhanced_scan", 2024-06-03T00:05:25.593 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.594 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.594 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.594 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.594 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.594 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.594 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.594 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Use libstoragemgmt during device scans", 2024-06-03T00:05:25.594 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.594 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.594 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.594 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.594 INFO:teuthology.orchestra.run.smithi049.stdout: "facts_cache_timeout": { 2024-06-03T00:05:25.594 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "facts_cache_timeout", 2024-06-03T00:05:25.594 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.595 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.595 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.595 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "60", 2024-06-03T00:05:25.595 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.595 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.595 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.595 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "seconds to cache host facts data", 2024-06-03T00:05:25.595 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.595 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.595 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.595 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.595 INFO:teuthology.orchestra.run.smithi049.stdout: "grafana_dashboards_path": { 2024-06-03T00:05:25.595 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "grafana_dashboards_path", 2024-06-03T00:05:25.595 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.595 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.596 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.596 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-06-03T00:05:25.596 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.596 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.596 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.596 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-06-03T00:05:25.596 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.596 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.596 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.596 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.596 INFO:teuthology.orchestra.run.smithi049.stdout: "host_check_interval": { 2024-06-03T00:05:25.596 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "host_check_interval", 2024-06-03T00:05:25.596 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.596 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.597 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.597 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "600", 2024-06-03T00:05:25.597 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.597 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.597 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.597 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how frequently to perform a host check", 2024-06-03T00:05:25.597 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.597 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.597 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.597 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.597 INFO:teuthology.orchestra.run.smithi049.stdout: "hw_monitoring": { 2024-06-03T00:05:25.597 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "hw_monitoring", 2024-06-03T00:05:25.597 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.597 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.598 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.598 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.598 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.598 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.598 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.598 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-06-03T00:05:25.598 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.598 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.598 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.598 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.598 INFO:teuthology.orchestra.run.smithi049.stdout: "inventory_list_all": { 2024-06-03T00:05:25.598 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "inventory_list_all", 2024-06-03T00:05:25.598 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.599 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.599 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.599 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.599 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.599 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.599 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.599 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-06-03T00:05:25.599 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.599 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.599 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.599 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.599 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.601 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.601 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.601 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.601 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.601 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.601 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.601 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.601 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.601 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.601 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.602 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.602 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.602 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.602 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.602 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.602 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.602 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.602 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.602 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.602 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.602 INFO:teuthology.orchestra.run.smithi049.stdout: "log_refresh_metadata": { 2024-06-03T00:05:25.602 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_refresh_metadata", 2024-06-03T00:05:25.602 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.602 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.603 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.603 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.603 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.603 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.603 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.603 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-06-03T00:05:25.603 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.603 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.603 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.603 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.603 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.603 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.603 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.603 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.604 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.604 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.604 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.604 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.604 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.604 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-06-03T00:05:25.604 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.604 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.604 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.604 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.604 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.604 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.604 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.605 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.605 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.605 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.605 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.605 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.605 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.605 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.605 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.605 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.605 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.605 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.605 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.605 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.605 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.606 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.606 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.606 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.606 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.606 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.606 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.606 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.606 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.606 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.606 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.606 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.606 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.606 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.606 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.607 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.607 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.607 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.607 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.607 INFO:teuthology.orchestra.run.smithi049.stdout: "manage_etc_ceph_ceph_conf": { 2024-06-03T00:05:25.607 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-06-03T00:05:25.607 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.607 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.607 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.607 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.607 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.607 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.607 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.608 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-06-03T00:05:25.608 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.608 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.608 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.608 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.608 INFO:teuthology.orchestra.run.smithi049.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-06-03T00:05:25.608 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-06-03T00:05:25.608 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.608 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.608 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.608 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "*", 2024-06-03T00:05:25.608 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.608 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.608 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.609 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-06-03T00:05:25.609 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.609 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.609 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.609 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.609 INFO:teuthology.orchestra.run.smithi049.stdout: "max_count_per_host": { 2024-06-03T00:05:25.609 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_count_per_host", 2024-06-03T00:05:25.609 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.609 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.609 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.609 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-06-03T00:05:25.609 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.610 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.610 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.610 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "max number of daemons per service per host", 2024-06-03T00:05:25.610 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.610 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.610 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.610 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.610 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd_draining_count": { 2024-06-03T00:05:25.610 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_osd_draining_count", 2024-06-03T00:05:25.610 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.610 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.610 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.610 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-06-03T00:05:25.611 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.611 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.611 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.611 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-06-03T00:05:25.611 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.611 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.611 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.611 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.611 INFO:teuthology.orchestra.run.smithi049.stdout: "migration_current": { 2024-06-03T00:05:25.611 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "migration_current", 2024-06-03T00:05:25.611 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.611 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.611 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.611 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.612 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.612 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.612 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.612 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "internal - do not modify", 2024-06-03T00:05:25.612 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.612 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.612 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.612 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.612 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": { 2024-06-03T00:05:25.612 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mode", 2024-06-03T00:05:25.612 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.612 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.612 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.612 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "root", 2024-06-03T00:05:25.613 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.613 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.613 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.613 INFO:teuthology.orchestra.run.smithi049.stdout: "cephadm-package", 2024-06-03T00:05:25.613 INFO:teuthology.orchestra.run.smithi049.stdout: "root" 2024-06-03T00:05:25.613 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.613 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "mode for remote execution of cephadm", 2024-06-03T00:05:25.613 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.613 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.613 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.613 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.613 INFO:teuthology.orchestra.run.smithi049.stdout: "oob_default_addr": { 2024-06-03T00:05:25.613 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "oob_default_addr", 2024-06-03T00:05:25.613 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.614 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.614 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.614 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "169.254.1.1", 2024-06-03T00:05:25.614 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.614 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.614 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.614 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Default address for RedFish API (oob management).", 2024-06-03T00:05:25.614 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.614 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.614 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.614 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.614 INFO:teuthology.orchestra.run.smithi049.stdout: "prometheus_alerts_path": { 2024-06-03T00:05:25.614 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "prometheus_alerts_path", 2024-06-03T00:05:25.615 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.615 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.615 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.615 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-06-03T00:05:25.615 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.615 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.615 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.615 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-06-03T00:05:25.615 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.615 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.615 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.615 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.615 INFO:teuthology.orchestra.run.smithi049.stdout: "registry_insecure": { 2024-06-03T00:05:25.615 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "registry_insecure", 2024-06-03T00:05:25.616 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.616 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.616 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.616 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.616 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.616 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.616 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.616 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-06-03T00:05:25.616 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.616 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.616 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.616 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.616 INFO:teuthology.orchestra.run.smithi049.stdout: "registry_password": { 2024-06-03T00:05:25.617 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "registry_password", 2024-06-03T00:05:25.617 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.617 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.617 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.617 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.617 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.617 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.617 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.617 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-06-03T00:05:25.617 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.617 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.617 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.617 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.618 INFO:teuthology.orchestra.run.smithi049.stdout: "registry_url": { 2024-06-03T00:05:25.618 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "registry_url", 2024-06-03T00:05:25.618 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.618 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.618 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.618 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.618 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.618 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.618 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.618 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-06-03T00:05:25.618 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.618 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.618 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.619 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.619 INFO:teuthology.orchestra.run.smithi049.stdout: "registry_username": { 2024-06-03T00:05:25.619 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "registry_username", 2024-06-03T00:05:25.619 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.619 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.619 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.619 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.619 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.619 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.619 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.619 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-06-03T00:05:25.619 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.619 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.619 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.620 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.620 INFO:teuthology.orchestra.run.smithi049.stdout: "secure_monitoring_stack": { 2024-06-03T00:05:25.620 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "secure_monitoring_stack", 2024-06-03T00:05:25.620 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.620 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.620 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.620 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.620 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.620 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.620 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.620 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-06-03T00:05:25.620 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.620 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.620 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.621 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.621 INFO:teuthology.orchestra.run.smithi049.stdout: "service_discovery_port": { 2024-06-03T00:05:25.621 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "service_discovery_port", 2024-06-03T00:05:25.621 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.621 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.621 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.621 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "8765", 2024-06-03T00:05:25.621 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.621 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.621 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.621 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "cephadm service discovery port", 2024-06-03T00:05:25.621 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.621 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.621 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.622 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.622 INFO:teuthology.orchestra.run.smithi049.stdout: "ssh_config_file": { 2024-06-03T00:05:25.622 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ssh_config_file", 2024-06-03T00:05:25.622 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.622 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.622 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.622 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.622 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.622 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.622 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.622 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-06-03T00:05:25.622 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.622 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.623 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.623 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.623 INFO:teuthology.orchestra.run.smithi049.stdout: "use_agent": { 2024-06-03T00:05:25.623 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "use_agent", 2024-06-03T00:05:25.623 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.623 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.623 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.623 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.623 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.623 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.623 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.623 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-06-03T00:05:25.623 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.623 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.624 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.624 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.624 INFO:teuthology.orchestra.run.smithi049.stdout: "use_repo_digest": { 2024-06-03T00:05:25.624 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "use_repo_digest", 2024-06-03T00:05:25.624 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.624 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.624 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.624 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.624 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.624 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.624 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.624 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-06-03T00:05:25.624 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.625 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.625 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.625 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.625 INFO:teuthology.orchestra.run.smithi049.stdout: "warn_on_failed_host_check": { 2024-06-03T00:05:25.625 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "warn_on_failed_host_check", 2024-06-03T00:05:25.625 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.625 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.625 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.625 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.625 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.625 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.625 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.625 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "raise a health warning if the host check fails", 2024-06-03T00:05:25.625 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.626 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.626 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.626 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.626 INFO:teuthology.orchestra.run.smithi049.stdout: "warn_on_stray_daemons": { 2024-06-03T00:05:25.626 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "warn_on_stray_daemons", 2024-06-03T00:05:25.626 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.626 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.626 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.626 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.626 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.626 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.626 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.626 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-06-03T00:05:25.626 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.627 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.627 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.627 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.627 INFO:teuthology.orchestra.run.smithi049.stdout: "warn_on_stray_hosts": { 2024-06-03T00:05:25.627 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "warn_on_stray_hosts", 2024-06-03T00:05:25.627 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.627 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.627 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.627 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.627 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.627 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.627 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.627 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-06-03T00:05:25.627 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.628 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.628 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.628 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.628 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.628 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.628 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.628 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "crash", 2024-06-03T00:05:25.628 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.628 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.628 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.628 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.628 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.628 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.628 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.628 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.629 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.629 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.629 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.629 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.629 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.629 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.629 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.629 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.629 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.629 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.629 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.629 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.629 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.630 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.630 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.630 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.630 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.630 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.630 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.630 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.630 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.630 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.630 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.630 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.630 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.630 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.631 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.631 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.631 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.631 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.631 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.631 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.631 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.631 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.631 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.631 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.631 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.631 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.631 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.631 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.632 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.632 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.632 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.632 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.632 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.632 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.632 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.632 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.632 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.632 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.632 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.632 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.632 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.632 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.633 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.633 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.633 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.633 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.633 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.633 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.633 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.633 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.633 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.633 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.633 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.633 INFO:teuthology.orchestra.run.smithi049.stdout: "retain_interval": { 2024-06-03T00:05:25.633 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "retain_interval", 2024-06-03T00:05:25.633 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.633 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.634 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.634 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "31536000", 2024-06-03T00:05:25.634 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.634 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.634 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.634 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how long to retain crashes before pruning them", 2024-06-03T00:05:25.634 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.634 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.634 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.634 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.634 INFO:teuthology.orchestra.run.smithi049.stdout: "warn_recent_interval": { 2024-06-03T00:05:25.634 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "warn_recent_interval", 2024-06-03T00:05:25.635 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.635 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.635 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.635 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "1209600", 2024-06-03T00:05:25.635 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.635 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.635 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.635 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "time interval in which to warn about recent crashes", 2024-06-03T00:05:25.635 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.635 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.635 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.635 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.635 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.635 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.636 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.636 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "dashboard", 2024-06-03T00:05:25.636 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.636 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.636 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.636 INFO:teuthology.orchestra.run.smithi049.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-06-03T00:05:25.636 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-06-03T00:05:25.636 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.636 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.636 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.636 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-06-03T00:05:25.636 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.636 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.637 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.637 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.637 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.637 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.637 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.637 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.637 INFO:teuthology.orchestra.run.smithi049.stdout: "ALERTMANAGER_API_HOST": { 2024-06-03T00:05:25.637 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ALERTMANAGER_API_HOST", 2024-06-03T00:05:25.637 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.637 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.637 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.637 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.637 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.637 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.638 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.638 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.638 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.638 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.638 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.638 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.638 INFO:teuthology.orchestra.run.smithi049.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-06-03T00:05:25.638 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-06-03T00:05:25.638 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.638 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.638 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.638 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.638 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.638 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.639 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.639 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.639 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.639 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.639 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.639 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.639 INFO:teuthology.orchestra.run.smithi049.stdout: "AUDIT_API_ENABLED": { 2024-06-03T00:05:25.639 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "AUDIT_API_ENABLED", 2024-06-03T00:05:25.639 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.639 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.639 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.639 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.639 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.639 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.640 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.640 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.640 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.640 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.640 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.640 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.640 INFO:teuthology.orchestra.run.smithi049.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-06-03T00:05:25.640 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-06-03T00:05:25.640 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.640 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.640 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.640 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.640 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.641 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.641 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.641 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.641 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.641 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.641 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.641 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.641 INFO:teuthology.orchestra.run.smithi049.stdout: "ENABLE_BROWSABLE_API": { 2024-06-03T00:05:25.641 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ENABLE_BROWSABLE_API", 2024-06-03T00:05:25.641 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.641 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.641 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.641 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.641 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.642 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.642 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.642 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.642 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.642 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.642 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.642 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.642 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-06-03T00:05:25.642 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-06-03T00:05:25.642 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.642 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.642 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.642 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.642 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.643 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.643 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.643 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.643 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.643 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.643 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.643 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.643 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-06-03T00:05:25.643 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-06-03T00:05:25.643 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.643 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.643 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.643 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.643 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.644 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.644 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.644 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.644 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.644 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.644 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.644 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.644 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-06-03T00:05:25.644 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-06-03T00:05:25.644 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.644 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.644 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.644 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.644 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.645 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.645 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.645 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.645 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.645 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.645 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.645 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.645 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-06-03T00:05:25.645 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-06-03T00:05:25.645 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.645 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.645 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.645 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.645 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.645 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.646 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.646 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.646 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.646 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.646 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.646 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.646 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_NFS": { 2024-06-03T00:05:25.646 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-06-03T00:05:25.646 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.646 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.646 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.646 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.646 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.647 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.647 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.647 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.647 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.647 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.647 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.647 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.647 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_RBD": { 2024-06-03T00:05:25.647 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-06-03T00:05:25.647 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.647 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.647 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.647 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.647 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.648 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.648 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.648 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.648 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.648 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.648 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.648 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.648 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_RGW": { 2024-06-03T00:05:25.648 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-06-03T00:05:25.648 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.648 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.648 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.648 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.649 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.649 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.649 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.649 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.649 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.649 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.649 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.649 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.649 INFO:teuthology.orchestra.run.smithi049.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-06-03T00:05:25.649 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-06-03T00:05:25.649 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.649 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.649 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.649 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.649 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.650 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.650 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.650 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.650 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.650 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.650 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.650 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.650 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_API_PASSWORD": { 2024-06-03T00:05:25.650 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_API_PASSWORD", 2024-06-03T00:05:25.650 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.650 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.650 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.651 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "admin", 2024-06-03T00:05:25.651 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.651 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.651 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.651 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.651 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.651 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.651 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.651 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.651 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-06-03T00:05:25.651 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-06-03T00:05:25.651 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.651 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.651 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.651 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.652 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.652 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.652 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.652 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.652 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.652 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.652 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.652 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.652 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_API_URL": { 2024-06-03T00:05:25.652 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_API_URL", 2024-06-03T00:05:25.652 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.652 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.652 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.652 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.653 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.653 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.653 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.653 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.653 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.653 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.653 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.653 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.653 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_API_USERNAME": { 2024-06-03T00:05:25.653 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_API_USERNAME", 2024-06-03T00:05:25.653 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.653 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.653 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.653 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "admin", 2024-06-03T00:05:25.653 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.654 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.654 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.654 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.654 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.654 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.654 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.654 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.654 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-06-03T00:05:25.654 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-06-03T00:05:25.654 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.654 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.654 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.654 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.655 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.655 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.655 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.655 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.655 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.655 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.655 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.655 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.655 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-06-03T00:05:25.655 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-06-03T00:05:25.655 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.655 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.655 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.655 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.656 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.656 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.656 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.656 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.656 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.656 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.656 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.656 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.656 INFO:teuthology.orchestra.run.smithi049.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-06-03T00:05:25.656 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-06-03T00:05:25.656 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.656 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.656 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.656 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.657 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.657 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.657 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.657 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.657 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.657 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.657 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.657 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.657 INFO:teuthology.orchestra.run.smithi049.stdout: "ISSUE_TRACKER_API_KEY": { 2024-06-03T00:05:25.657 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-06-03T00:05:25.657 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.657 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.657 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.658 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.658 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.658 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.658 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.658 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.658 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.658 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.658 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.658 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.658 INFO:teuthology.orchestra.run.smithi049.stdout: "PROMETHEUS_API_HOST": { 2024-06-03T00:05:25.658 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PROMETHEUS_API_HOST", 2024-06-03T00:05:25.658 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.658 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.659 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.659 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.659 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.659 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.659 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.659 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.659 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.659 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.659 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.659 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.659 INFO:teuthology.orchestra.run.smithi049.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-06-03T00:05:25.659 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-06-03T00:05:25.659 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.659 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.660 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.660 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.660 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.660 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.660 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.660 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.660 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.660 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.660 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.660 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.660 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-06-03T00:05:25.660 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-06-03T00:05:25.660 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.660 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.661 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.661 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.661 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.661 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.661 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.661 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.661 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.661 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.661 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.661 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.661 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-06-03T00:05:25.661 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-06-03T00:05:25.661 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.662 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.662 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.662 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.662 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.662 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.662 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.662 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.662 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.662 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.662 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.662 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.662 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-06-03T00:05:25.662 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-06-03T00:05:25.662 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.663 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.663 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.663 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.663 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.663 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.663 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.663 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.663 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.663 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.663 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.663 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.663 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-06-03T00:05:25.663 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-06-03T00:05:25.663 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.664 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.664 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.664 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.664 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.664 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.664 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.664 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.664 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.664 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.664 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.664 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.664 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-06-03T00:05:25.664 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-06-03T00:05:25.664 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.665 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.665 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.665 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.665 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.665 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.665 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.665 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.665 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.665 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.665 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.665 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.665 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-06-03T00:05:25.665 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-06-03T00:05:25.665 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.666 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.666 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.666 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.666 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.666 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.666 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.666 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.666 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.666 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.666 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.666 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.666 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-06-03T00:05:25.666 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-06-03T00:05:25.666 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.667 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.667 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.667 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.667 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.667 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.667 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.667 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.667 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.667 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.667 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.667 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.667 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_ENABLED": { 2024-06-03T00:05:25.667 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_ENABLED", 2024-06-03T00:05:25.667 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.668 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.668 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.668 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.668 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.668 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.668 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.668 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.668 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.668 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.668 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.668 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.668 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-06-03T00:05:25.668 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-06-03T00:05:25.669 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.669 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.669 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.669 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-06-03T00:05:25.669 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.669 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.669 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.669 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.669 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.669 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.669 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.669 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.669 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-06-03T00:05:25.670 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-06-03T00:05:25.670 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.670 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.670 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.670 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-06-03T00:05:25.670 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.670 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.670 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.670 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.670 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.670 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.670 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.670 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.670 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-06-03T00:05:25.671 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-06-03T00:05:25.671 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.671 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.671 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.671 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "8", 2024-06-03T00:05:25.671 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.671 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.671 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.671 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.671 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.671 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.671 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.671 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.672 INFO:teuthology.orchestra.run.smithi049.stdout: "REST_REQUESTS_TIMEOUT": { 2024-06-03T00:05:25.672 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-06-03T00:05:25.672 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.672 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.672 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.672 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "45", 2024-06-03T00:05:25.672 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.672 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.672 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.672 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.672 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.672 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.672 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.672 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.673 INFO:teuthology.orchestra.run.smithi049.stdout: "RGW_API_ACCESS_KEY": { 2024-06-03T00:05:25.673 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "RGW_API_ACCESS_KEY", 2024-06-03T00:05:25.673 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.673 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.673 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.673 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.673 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.673 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.673 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.673 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.673 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.673 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.673 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.673 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.674 INFO:teuthology.orchestra.run.smithi049.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-06-03T00:05:25.674 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-06-03T00:05:25.674 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.674 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.674 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.674 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "admin", 2024-06-03T00:05:25.674 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.674 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.674 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.674 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.674 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.674 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.674 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.674 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.675 INFO:teuthology.orchestra.run.smithi049.stdout: "RGW_API_SECRET_KEY": { 2024-06-03T00:05:25.675 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "RGW_API_SECRET_KEY", 2024-06-03T00:05:25.675 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.675 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.675 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.675 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.675 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.675 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.675 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.675 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.675 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.675 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.675 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.675 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.676 INFO:teuthology.orchestra.run.smithi049.stdout: "RGW_API_SSL_VERIFY": { 2024-06-03T00:05:25.676 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "RGW_API_SSL_VERIFY", 2024-06-03T00:05:25.676 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.676 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.676 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.676 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.676 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.676 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.676 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.676 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.676 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.676 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.676 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.676 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.677 INFO:teuthology.orchestra.run.smithi049.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-06-03T00:05:25.677 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-06-03T00:05:25.677 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.677 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.677 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.677 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-06-03T00:05:25.677 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.677 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.677 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.677 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.677 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.677 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.677 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.677 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.677 INFO:teuthology.orchestra.run.smithi049.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-06-03T00:05:25.678 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-06-03T00:05:25.678 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.678 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.678 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.678 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-06-03T00:05:25.678 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.678 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.678 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.678 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.678 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.678 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.678 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.678 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.678 INFO:teuthology.orchestra.run.smithi049.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-06-03T00:05:25.679 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-06-03T00:05:25.679 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.679 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.679 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.679 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5", 2024-06-03T00:05:25.679 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.679 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.679 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.679 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.679 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.679 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.679 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.679 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.679 INFO:teuthology.orchestra.run.smithi049.stdout: "cross_origin_url": { 2024-06-03T00:05:25.680 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cross_origin_url", 2024-06-03T00:05:25.680 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.680 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.680 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.680 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.680 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.680 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.680 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.680 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.680 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.680 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.680 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.680 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.680 INFO:teuthology.orchestra.run.smithi049.stdout: "crt_file": { 2024-06-03T00:05:25.681 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "crt_file", 2024-06-03T00:05:25.681 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.681 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.681 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.681 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.681 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.681 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.681 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.681 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.681 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.681 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.681 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.681 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.681 INFO:teuthology.orchestra.run.smithi049.stdout: "debug": { 2024-06-03T00:05:25.682 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "debug", 2024-06-03T00:05:25.682 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.682 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.682 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.682 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.682 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.682 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.682 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.682 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Enable/disable debug options", 2024-06-03T00:05:25.682 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.682 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.682 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.682 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.682 INFO:teuthology.orchestra.run.smithi049.stdout: "jwt_token_ttl": { 2024-06-03T00:05:25.683 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "jwt_token_ttl", 2024-06-03T00:05:25.683 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.683 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.683 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.683 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "28800", 2024-06-03T00:05:25.683 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.683 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.683 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.683 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.683 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.683 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.683 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.683 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.684 INFO:teuthology.orchestra.run.smithi049.stdout: "key_file": { 2024-06-03T00:05:25.684 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "key_file", 2024-06-03T00:05:25.684 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.684 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.684 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.684 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.684 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.684 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.684 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.684 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.684 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.684 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.684 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.685 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.685 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.685 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.685 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.685 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.685 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.685 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.685 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.685 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.685 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.685 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.685 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.685 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.685 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.685 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.686 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.686 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.686 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.686 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.686 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.686 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.686 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.686 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.686 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.686 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.686 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.686 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.686 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.687 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.687 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.687 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.687 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.687 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.687 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.687 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.687 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.687 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.687 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.687 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.687 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.687 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.687 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.688 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.688 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.688 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.688 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.688 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.688 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.688 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.688 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.688 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.688 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.688 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.688 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.688 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.688 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.689 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.689 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.689 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.689 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.689 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.689 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.689 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.689 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.689 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.689 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.689 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.689 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.689 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.690 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.690 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.690 INFO:teuthology.orchestra.run.smithi049.stdout: "motd": { 2024-06-03T00:05:25.690 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "motd", 2024-06-03T00:05:25.690 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.690 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.690 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.690 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.690 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.690 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.690 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.690 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "The message of the day", 2024-06-03T00:05:25.690 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.691 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.691 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.691 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.691 INFO:teuthology.orchestra.run.smithi049.stdout: "redirect_resolve_ip_addr": { 2024-06-03T00:05:25.691 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "redirect_resolve_ip_addr", 2024-06-03T00:05:25.691 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.691 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.691 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.691 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.691 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.691 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.691 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.691 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.691 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.691 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.692 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.692 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.692 INFO:teuthology.orchestra.run.smithi049.stdout: "server_addr": { 2024-06-03T00:05:25.692 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_addr", 2024-06-03T00:05:25.692 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.692 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.692 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.692 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "::", 2024-06-03T00:05:25.692 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.692 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.692 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.692 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.692 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.692 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.693 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.693 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.693 INFO:teuthology.orchestra.run.smithi049.stdout: "server_port": { 2024-06-03T00:05:25.693 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_port", 2024-06-03T00:05:25.693 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.693 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.693 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.693 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "8080", 2024-06-03T00:05:25.693 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.693 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.693 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.693 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.693 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.693 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.694 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.694 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.694 INFO:teuthology.orchestra.run.smithi049.stdout: "ssl": { 2024-06-03T00:05:25.694 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ssl", 2024-06-03T00:05:25.694 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.694 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.694 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.694 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.694 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.694 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.694 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.694 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.694 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.694 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.695 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.695 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.695 INFO:teuthology.orchestra.run.smithi049.stdout: "ssl_server_port": { 2024-06-03T00:05:25.695 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ssl_server_port", 2024-06-03T00:05:25.695 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.695 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.695 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.695 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "8443", 2024-06-03T00:05:25.695 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.695 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.695 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.695 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.695 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.695 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.695 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.696 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.696 INFO:teuthology.orchestra.run.smithi049.stdout: "standby_behaviour": { 2024-06-03T00:05:25.696 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "standby_behaviour", 2024-06-03T00:05:25.696 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.696 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.696 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.696 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "redirect", 2024-06-03T00:05:25.696 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.696 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.696 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.696 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.696 INFO:teuthology.orchestra.run.smithi049.stdout: "redirect" 2024-06-03T00:05:25.696 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.696 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.697 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.697 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.697 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.697 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.697 INFO:teuthology.orchestra.run.smithi049.stdout: "standby_error_status_code": { 2024-06-03T00:05:25.697 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "standby_error_status_code", 2024-06-03T00:05:25.697 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.697 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.697 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.697 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "500", 2024-06-03T00:05:25.697 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "400", 2024-06-03T00:05:25.697 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "599", 2024-06-03T00:05:25.697 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.698 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.698 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.698 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.698 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.698 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.698 INFO:teuthology.orchestra.run.smithi049.stdout: "url_prefix": { 2024-06-03T00:05:25.698 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "url_prefix", 2024-06-03T00:05:25.698 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.698 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.698 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.698 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.698 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.698 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.698 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "devicehealth", 2024-06-03T00:05:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: "enable_monitoring": { 2024-06-03T00:05:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "enable_monitoring", 2024-06-03T00:05:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "monitor device health metrics", 2024-06-03T00:05:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.701 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.701 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.701 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.701 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.701 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.701 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.701 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.701 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.701 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.701 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.701 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.701 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.701 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.701 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.702 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.702 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.702 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.702 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.702 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.702 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.702 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.702 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.702 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.702 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.702 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.702 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.702 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.703 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.703 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.703 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.703 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.703 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.703 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.703 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.703 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.703 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.703 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.703 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.703 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.703 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.703 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.704 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.704 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.704 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.704 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.704 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.704 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.704 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.704 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.704 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.704 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.704 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.704 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.704 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.704 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.704 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.705 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.705 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.705 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.705 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.705 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.705 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.705 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.705 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.705 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.705 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.705 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.705 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.705 INFO:teuthology.orchestra.run.smithi049.stdout: "mark_out_threshold": { 2024-06-03T00:05:25.705 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mark_out_threshold", 2024-06-03T00:05:25.705 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.706 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.706 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.706 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "2419200", 2024-06-03T00:05:25.706 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.706 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.706 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.706 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-06-03T00:05:25.706 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.706 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.706 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.706 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.706 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": { 2024-06-03T00:05:25.706 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "pool_name", 2024-06-03T00:05:25.706 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.707 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.707 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.707 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "device_health_metrics", 2024-06-03T00:05:25.707 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.707 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.707 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.707 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "name of pool in which to store device health metrics", 2024-06-03T00:05:25.707 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.707 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.707 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.707 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.707 INFO:teuthology.orchestra.run.smithi049.stdout: "retention_period": { 2024-06-03T00:05:25.707 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "retention_period", 2024-06-03T00:05:25.707 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.707 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.708 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.708 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "15552000", 2024-06-03T00:05:25.708 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.708 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.708 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.708 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how long to retain device health metrics", 2024-06-03T00:05:25.708 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.708 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.708 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.708 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.708 INFO:teuthology.orchestra.run.smithi049.stdout: "scrape_frequency": { 2024-06-03T00:05:25.708 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "scrape_frequency", 2024-06-03T00:05:25.708 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.708 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.709 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.709 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "86400", 2024-06-03T00:05:25.709 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.709 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.709 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.709 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how frequently to scrape device health metrics", 2024-06-03T00:05:25.709 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.709 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.709 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.709 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.709 INFO:teuthology.orchestra.run.smithi049.stdout: "self_heal": { 2024-06-03T00:05:25.709 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "self_heal", 2024-06-03T00:05:25.709 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.709 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.709 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.710 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.710 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.710 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.710 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.710 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-06-03T00:05:25.710 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.710 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.710 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.710 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.710 INFO:teuthology.orchestra.run.smithi049.stdout: "sleep_interval": { 2024-06-03T00:05:25.710 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sleep_interval", 2024-06-03T00:05:25.710 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.711 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.711 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.711 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "600", 2024-06-03T00:05:25.711 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.711 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.711 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.711 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how frequently to wake up and check device health", 2024-06-03T00:05:25.711 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.711 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.711 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.711 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.711 INFO:teuthology.orchestra.run.smithi049.stdout: "warn_threshold": { 2024-06-03T00:05:25.711 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "warn_threshold", 2024-06-03T00:05:25.712 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.712 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.712 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.712 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "7257600", 2024-06-03T00:05:25.712 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.712 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.712 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.712 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-06-03T00:05:25.712 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.712 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.712 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.712 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.712 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.712 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.713 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.713 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "diskprediction_local", 2024-06-03T00:05:25.713 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.713 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.713 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.713 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.713 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.713 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.713 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.713 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.713 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.713 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.713 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.713 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.713 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.714 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.714 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.714 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.714 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.714 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.714 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.714 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.714 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.714 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.714 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.714 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.714 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.714 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.714 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.715 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.715 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.715 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.715 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.715 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.715 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.715 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.715 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.715 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.715 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.715 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.715 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.715 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.715 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.716 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.716 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.716 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.716 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.716 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.716 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.716 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.716 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.716 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.716 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.716 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.716 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.716 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.716 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.717 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.717 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.717 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.717 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.717 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.717 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.717 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.717 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.717 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.717 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.717 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.717 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.717 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.717 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.718 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.718 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.718 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.718 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.718 INFO:teuthology.orchestra.run.smithi049.stdout: "predict_interval": { 2024-06-03T00:05:25.718 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "predict_interval", 2024-06-03T00:05:25.718 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.718 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.718 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.718 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "86400", 2024-06-03T00:05:25.718 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.718 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.718 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.718 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.719 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.719 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.719 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.719 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.719 INFO:teuthology.orchestra.run.smithi049.stdout: "predictor_model": { 2024-06-03T00:05:25.719 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "predictor_model", 2024-06-03T00:05:25.719 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.719 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.719 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.719 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "prophetstor", 2024-06-03T00:05:25.719 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.719 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.719 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.719 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.720 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.720 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.720 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.720 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.720 INFO:teuthology.orchestra.run.smithi049.stdout: "sleep_interval": { 2024-06-03T00:05:25.720 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sleep_interval", 2024-06-03T00:05:25.720 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.720 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.720 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.720 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "600", 2024-06-03T00:05:25.720 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.720 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.720 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.721 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.721 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.721 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.721 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.721 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.721 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.721 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.721 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.721 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "influx", 2024-06-03T00:05:25.721 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": false, 2024-06-03T00:05:25.721 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "influxdb python module not found", 2024-06-03T00:05:25.721 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.721 INFO:teuthology.orchestra.run.smithi049.stdout: "batch_size": { 2024-06-03T00:05:25.721 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "batch_size", 2024-06-03T00:05:25.722 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.722 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.722 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.722 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5000", 2024-06-03T00:05:25.722 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.722 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.722 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.722 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-06-03T00:05:25.722 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.722 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.722 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.722 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.722 INFO:teuthology.orchestra.run.smithi049.stdout: "database": { 2024-06-03T00:05:25.723 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "database", 2024-06-03T00:05:25.723 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.723 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.723 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.723 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "ceph", 2024-06-03T00:05:25.723 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.723 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.723 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.723 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-06-03T00:05:25.723 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.723 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.723 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.723 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.724 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": { 2024-06-03T00:05:25.724 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "hostname", 2024-06-03T00:05:25.724 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.724 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.724 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.724 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.724 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.724 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.724 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.724 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "InfluxDB server hostname", 2024-06-03T00:05:25.724 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.724 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.724 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.724 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.724 INFO:teuthology.orchestra.run.smithi049.stdout: "interval": { 2024-06-03T00:05:25.725 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "interval", 2024-06-03T00:05:25.725 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.725 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.725 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.725 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "30", 2024-06-03T00:05:25.725 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "5", 2024-06-03T00:05:25.725 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.725 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.725 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-06-03T00:05:25.725 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.725 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.725 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.725 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.726 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.726 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.726 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.726 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.726 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.726 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.726 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.726 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.726 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.726 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.726 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.726 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.726 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.727 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.727 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.727 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.727 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.727 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.727 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.727 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.727 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.727 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.727 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.727 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.727 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.727 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.727 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.728 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.728 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.728 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.728 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.728 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.728 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.728 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.728 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.728 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.728 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.728 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.728 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.728 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.728 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.729 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.729 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.729 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.729 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.729 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.729 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.729 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.729 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.729 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.729 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.729 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.729 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.729 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.729 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.730 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.730 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.730 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.730 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.730 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.730 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.730 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.730 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.730 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.730 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.730 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.730 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.730 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.730 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.731 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.731 INFO:teuthology.orchestra.run.smithi049.stdout: "password": { 2024-06-03T00:05:25.731 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "password", 2024-06-03T00:05:25.731 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.731 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.731 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.731 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.731 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.731 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.731 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.731 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "password of InfluxDB server user", 2024-06-03T00:05:25.731 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.731 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.731 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.732 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.732 INFO:teuthology.orchestra.run.smithi049.stdout: "port": { 2024-06-03T00:05:25.732 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "port", 2024-06-03T00:05:25.732 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.732 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.732 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.732 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "8086", 2024-06-03T00:05:25.732 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.732 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.732 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.732 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "InfluxDB server port", 2024-06-03T00:05:25.732 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.732 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.732 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.733 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.733 INFO:teuthology.orchestra.run.smithi049.stdout: "ssl": { 2024-06-03T00:05:25.733 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ssl", 2024-06-03T00:05:25.733 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.733 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.733 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.733 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "false", 2024-06-03T00:05:25.733 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.733 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.733 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.733 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-06-03T00:05:25.733 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.733 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.733 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.734 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.734 INFO:teuthology.orchestra.run.smithi049.stdout: "threads": { 2024-06-03T00:05:25.734 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "threads", 2024-06-03T00:05:25.734 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.734 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.734 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.734 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5", 2024-06-03T00:05:25.734 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "1", 2024-06-03T00:05:25.734 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "32", 2024-06-03T00:05:25.734 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.734 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-06-03T00:05:25.734 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.734 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.734 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.735 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.735 INFO:teuthology.orchestra.run.smithi049.stdout: "username": { 2024-06-03T00:05:25.735 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "username", 2024-06-03T00:05:25.735 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.735 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.735 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.735 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.735 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.735 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.735 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.735 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "username of InfluxDB server user", 2024-06-03T00:05:25.735 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.735 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.735 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: "verify_ssl": { 2024-06-03T00:05:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "verify_ssl", 2024-06-03T00:05:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "true", 2024-06-03T00:05:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-06-03T00:05:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "insights", 2024-06-03T00:05:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.742 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.742 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.742 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.742 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.742 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.742 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.742 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.742 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.742 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.742 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.742 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.742 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.742 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.743 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "iostat", 2024-06-03T00:05:25.743 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.743 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.743 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.743 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.743 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.743 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.743 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.743 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.743 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.743 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.744 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.744 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.744 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.744 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.744 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.744 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.744 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.744 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.744 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.744 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.745 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.745 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.745 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.745 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.745 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.745 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.745 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.745 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.745 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.745 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.745 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.745 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.746 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.746 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.746 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.746 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.746 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.746 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.746 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.746 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.746 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.746 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.746 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.747 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.747 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.747 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.747 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.747 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.747 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.747 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.747 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.747 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.747 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.747 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.747 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.747 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.748 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.748 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.748 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.748 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.748 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.748 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.748 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.748 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.748 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.748 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.748 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.748 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.749 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.749 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.749 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.749 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.749 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.749 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.749 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.749 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.749 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "k8sevents", 2024-06-03T00:05:25.749 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.749 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.749 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.750 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_event_retention_days": { 2024-06-03T00:05:25.750 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ceph_event_retention_days", 2024-06-03T00:05:25.750 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.750 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.750 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.750 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "7", 2024-06-03T00:05:25.750 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.750 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.750 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.750 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Days to hold ceph event information within local cache", 2024-06-03T00:05:25.750 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.750 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.751 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.751 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.751 INFO:teuthology.orchestra.run.smithi049.stdout: "config_check_secs": { 2024-06-03T00:05:25.751 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "config_check_secs", 2024-06-03T00:05:25.751 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.751 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.751 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.751 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-06-03T00:05:25.751 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "10", 2024-06-03T00:05:25.751 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.751 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.751 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-06-03T00:05:25.751 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.752 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.752 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.752 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.752 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.752 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.752 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.752 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.752 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.752 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.752 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.752 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.753 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.753 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.753 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.753 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.753 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.753 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.753 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.753 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.753 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.753 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.753 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.753 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.754 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.754 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.754 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.754 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.754 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.754 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.754 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.754 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.754 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.754 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.754 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.755 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.755 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.755 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.755 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.755 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.755 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.755 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.755 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.755 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.755 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.755 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.755 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.756 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.756 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.756 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.756 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.756 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.756 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.756 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.756 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.756 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.756 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.756 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.756 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.757 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.757 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.757 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.757 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.757 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.757 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.757 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.757 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.757 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.757 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.757 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.757 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.758 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.758 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.758 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.758 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.758 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.758 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.758 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "localpool", 2024-06-03T00:05:25.758 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.758 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.758 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.758 INFO:teuthology.orchestra.run.smithi049.stdout: "failure_domain": { 2024-06-03T00:05:25.758 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "failure_domain", 2024-06-03T00:05:25.759 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.759 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.759 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.759 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "host", 2024-06-03T00:05:25.759 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.759 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.759 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.759 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "failure domain for any created local pool", 2024-06-03T00:05:25.759 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-06-03T00:05:25.759 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.759 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.759 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.760 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.760 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.760 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.760 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.760 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.760 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.760 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.760 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.760 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.760 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.760 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.760 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.761 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.761 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.761 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.761 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.761 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.761 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.761 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.761 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.761 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.761 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.761 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.762 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.762 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.762 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.762 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.762 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.762 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.762 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.762 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.762 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.762 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.762 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.762 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.763 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.763 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.763 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.763 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.763 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.763 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.763 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.763 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.763 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.763 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.763 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.763 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.763 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.764 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.764 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.764 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.764 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.764 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.764 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.764 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.764 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.764 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.764 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.764 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.764 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.765 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.765 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.765 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.765 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.765 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.765 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.765 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.765 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.765 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.765 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.765 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": { 2024-06-03T00:05:25.765 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "min_size", 2024-06-03T00:05:25.766 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.766 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.766 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.766 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.766 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.766 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.766 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.766 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "default min_size for any created local pool", 2024-06-03T00:05:25.766 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-06-03T00:05:25.766 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.766 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.766 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.766 INFO:teuthology.orchestra.run.smithi049.stdout: "num_rep": { 2024-06-03T00:05:25.767 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "num_rep", 2024-06-03T00:05:25.767 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.767 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.767 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.767 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "3", 2024-06-03T00:05:25.767 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.767 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.767 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.767 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "default replica count for any created local pool", 2024-06-03T00:05:25.767 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.767 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.768 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.768 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.768 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": { 2024-06-03T00:05:25.768 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "pg_num", 2024-06-03T00:05:25.768 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.768 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.768 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.768 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "128", 2024-06-03T00:05:25.768 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.769 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.769 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.769 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "default pg_num for any created local pool", 2024-06-03T00:05:25.769 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.769 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.769 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.769 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.769 INFO:teuthology.orchestra.run.smithi049.stdout: "prefix": { 2024-06-03T00:05:25.769 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "prefix", 2024-06-03T00:05:25.769 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.769 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.769 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.770 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.770 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.770 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.770 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.770 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "name prefix for any created local pool", 2024-06-03T00:05:25.770 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.770 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.770 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.770 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.770 INFO:teuthology.orchestra.run.smithi049.stdout: "subtree": { 2024-06-03T00:05:25.770 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "subtree", 2024-06-03T00:05:25.770 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.771 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.771 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.771 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "rack", 2024-06-03T00:05:25.771 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.771 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.771 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.771 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "CRUSH level for which to create a local pool", 2024-06-03T00:05:25.771 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-06-03T00:05:25.771 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.771 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.771 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.772 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.772 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.772 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.772 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mds_autoscaler", 2024-06-03T00:05:25.772 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.772 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.772 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.772 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.772 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.772 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.772 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.773 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.773 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.773 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.773 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.773 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.773 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.773 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.773 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.773 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.773 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.773 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.773 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.774 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.774 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.774 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.774 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.774 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.774 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.774 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.774 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.774 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.774 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.774 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.774 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.775 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.775 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.775 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.775 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.775 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.775 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.775 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.775 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.775 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.775 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.775 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.775 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.776 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.776 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.776 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.776 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.776 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.776 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.776 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.776 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.776 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.776 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.776 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.776 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.776 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.777 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.777 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.777 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.777 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.777 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.777 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.777 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.777 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.777 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.777 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.777 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.778 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.778 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.778 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.778 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.778 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.778 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.778 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.778 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.778 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.778 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mirroring", 2024-06-03T00:05:25.778 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.778 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.779 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.779 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.779 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.779 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.779 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.779 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.779 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.779 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.779 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.779 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.779 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.780 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.780 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.780 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.780 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.780 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.780 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.780 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.780 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.780 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.780 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.780 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.781 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.781 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.781 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.781 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.781 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.781 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.781 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.781 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.781 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.781 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.781 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.781 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.781 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.782 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.782 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.782 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.782 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.782 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.782 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.782 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.782 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.782 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.782 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.782 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.782 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.783 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.783 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.783 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.783 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.783 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.783 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.783 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.783 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.783 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.783 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.783 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.783 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.784 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.784 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.784 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.784 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.784 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.784 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.784 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.784 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.784 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.784 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.784 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.784 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.785 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.785 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.785 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.785 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "nfs", 2024-06-03T00:05:25.785 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.785 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.785 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.785 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.785 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.785 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.785 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.786 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.786 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.786 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.786 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.786 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.786 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.786 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.786 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.786 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.786 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.786 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.786 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.787 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.787 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.787 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.787 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.787 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.787 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.787 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.787 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.787 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.787 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.787 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.787 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.788 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.788 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.788 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.788 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.788 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.788 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.788 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.788 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.788 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.788 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.788 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.789 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.789 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.789 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.789 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.789 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.789 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.789 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.789 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.789 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.789 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.789 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.789 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.790 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.790 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.790 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.790 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.790 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.790 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.790 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.790 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.790 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.790 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.790 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.791 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.791 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.791 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.791 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.791 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.791 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.791 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.791 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.791 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.791 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.791 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.791 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "orchestrator", 2024-06-03T00:05:25.792 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.792 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.792 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.792 INFO:teuthology.orchestra.run.smithi049.stdout: "fail_fs": { 2024-06-03T00:05:25.792 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "fail_fs", 2024-06-03T00:05:25.792 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.792 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.792 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.792 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.792 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.792 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.792 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.793 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-06-03T00:05:25.793 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.793 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.793 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.793 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.793 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.793 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.793 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.793 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.793 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.793 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.793 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.794 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.794 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.794 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.794 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.794 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.794 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.794 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.794 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.794 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.794 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.794 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.795 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.795 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.795 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.795 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.795 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.795 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.795 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.795 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.795 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.795 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.795 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.795 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.796 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.796 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.796 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.796 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.796 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.796 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.796 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.796 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.796 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.796 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.796 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.796 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.797 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.797 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.797 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.797 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.797 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.797 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.797 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.797 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.797 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.797 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.797 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.797 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.798 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.798 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.798 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.798 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.798 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.798 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.798 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.798 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.798 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.798 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.798 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.798 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.799 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.799 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.799 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.799 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.799 INFO:teuthology.orchestra.run.smithi049.stdout: "orchestrator": { 2024-06-03T00:05:25.799 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "orchestrator", 2024-06-03T00:05:25.799 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.799 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.799 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.799 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.799 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.799 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.800 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.800 INFO:teuthology.orchestra.run.smithi049.stdout: "cephadm", 2024-06-03T00:05:25.800 INFO:teuthology.orchestra.run.smithi049.stdout: "rook", 2024-06-03T00:05:25.800 INFO:teuthology.orchestra.run.smithi049.stdout: "test_orchestrator" 2024-06-03T00:05:25.800 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.800 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Orchestrator backend", 2024-06-03T00:05:25.800 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.800 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.800 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.800 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.800 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.800 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.801 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.801 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "osd_perf_query", 2024-06-03T00:05:25.801 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.801 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.801 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.801 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.801 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.801 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.801 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.801 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.801 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.801 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.802 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.802 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.802 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.802 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.802 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.802 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.802 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.802 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.802 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.802 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.803 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.803 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.803 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.803 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.803 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.803 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.803 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.803 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.803 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.803 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.803 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.803 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.804 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.804 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.804 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.804 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.804 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.804 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.804 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.804 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.804 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.804 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.804 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.804 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.805 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.805 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.805 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.805 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.805 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.805 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.805 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.805 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.805 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.806 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.806 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.806 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.806 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.806 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.806 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.806 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.806 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.806 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.806 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.807 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.807 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.807 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.807 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.807 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.807 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.807 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.807 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.807 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.807 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.807 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.808 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.808 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.808 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "osd_support", 2024-06-03T00:05:25.808 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.808 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.808 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.808 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.808 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.808 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.808 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.808 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.809 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.809 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.809 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.809 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.809 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.809 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.809 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.809 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.809 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.809 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.809 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.809 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.809 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.810 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.810 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.810 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.810 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.810 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.810 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.810 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.810 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.810 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.810 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.810 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.810 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.811 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.811 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.811 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.811 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.811 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.811 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.811 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.811 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.811 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.811 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.811 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.811 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.812 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.812 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.812 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.812 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.812 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.812 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.812 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.812 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.812 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.812 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.812 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.812 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.813 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.813 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.813 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.813 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.813 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.813 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.813 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.813 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.813 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.813 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.813 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.814 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.814 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.814 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.814 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.814 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.814 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.814 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.814 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.814 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "pg_autoscaler", 2024-06-03T00:05:25.814 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.814 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.815 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.815 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.815 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.815 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.815 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.815 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.815 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.815 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.815 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.815 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.816 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.816 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.816 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.816 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.816 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.816 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.816 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.816 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.816 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.816 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.816 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.817 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.817 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.817 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.817 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.817 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.817 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.817 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.817 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.817 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.817 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.818 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.818 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.818 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.818 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.818 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.818 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.818 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.818 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.818 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.818 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.818 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.819 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.819 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.819 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.819 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.819 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.819 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.819 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.819 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.819 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.819 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.820 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.820 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.820 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.820 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.820 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.820 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.820 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.820 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.820 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.820 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.820 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.821 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.821 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.821 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.821 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.821 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.821 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.821 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.821 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.821 INFO:teuthology.orchestra.run.smithi049.stdout: "sleep_interval": { 2024-06-03T00:05:25.821 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sleep_interval", 2024-06-03T00:05:25.822 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.822 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.822 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.822 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "60", 2024-06-03T00:05:25.822 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.822 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.822 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.822 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.822 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.822 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.823 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.823 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.823 INFO:teuthology.orchestra.run.smithi049.stdout: "threshold": { 2024-06-03T00:05:25.823 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "threshold", 2024-06-03T00:05:25.823 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-06-03T00:05:25.823 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.823 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.823 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "3.0", 2024-06-03T00:05:25.823 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "1.0", 2024-06-03T00:05:25.823 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.823 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.824 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "scaling threshold", 2024-06-03T00:05:25.824 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-06-03T00:05:25.824 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.824 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.824 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.824 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.824 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.824 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.824 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "progress", 2024-06-03T00:05:25.824 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.824 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.824 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.825 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_pg_recovery_event": { 2024-06-03T00:05:25.825 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "allow_pg_recovery_event", 2024-06-03T00:05:25.825 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.825 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.825 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.825 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.825 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.825 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.825 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.825 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "allow the module to show pg recovery progress", 2024-06-03T00:05:25.825 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.826 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.826 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.826 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.826 INFO:teuthology.orchestra.run.smithi049.stdout: "enabled": { 2024-06-03T00:05:25.826 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "enabled", 2024-06-03T00:05:25.826 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.826 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.826 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.826 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.826 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.826 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.826 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.827 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.827 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.827 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.827 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.827 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.827 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.827 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.827 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.827 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.827 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.827 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.827 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.828 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.828 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.828 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.828 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.828 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.828 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.828 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.828 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.828 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.828 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.828 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.828 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.829 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.829 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.829 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.829 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.829 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.829 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.829 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.829 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.829 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.829 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.829 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.830 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.830 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.830 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.830 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.830 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.830 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.830 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.830 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.830 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.830 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.830 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.831 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.831 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.831 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.831 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.831 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.831 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.831 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.831 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.831 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.831 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.831 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.832 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.832 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.832 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.832 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.832 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.832 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.832 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.832 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.832 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.832 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.832 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.832 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.832 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.833 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.833 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.833 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.833 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.833 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.833 INFO:teuthology.orchestra.run.smithi049.stdout: "max_completed_events": { 2024-06-03T00:05:25.833 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_completed_events", 2024-06-03T00:05:25.833 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.833 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.833 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.833 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "50", 2024-06-03T00:05:25.833 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.834 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.834 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.834 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "number of past completed events to remember", 2024-06-03T00:05:25.834 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.834 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.834 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.834 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.834 INFO:teuthology.orchestra.run.smithi049.stdout: "sleep_interval": { 2024-06-03T00:05:25.834 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sleep_interval", 2024-06-03T00:05:25.834 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.834 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.834 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.835 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5", 2024-06-03T00:05:25.835 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.835 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.835 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.835 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how long the module is going to sleep", 2024-06-03T00:05:25.835 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.835 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.835 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.835 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.835 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.835 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.835 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.836 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "prometheus", 2024-06-03T00:05:25.836 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.836 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.836 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.836 INFO:teuthology.orchestra.run.smithi049.stdout: "cache": { 2024-06-03T00:05:25.836 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cache", 2024-06-03T00:05:25.836 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.836 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.836 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.836 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.836 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.836 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.837 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.837 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.837 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.837 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.837 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.837 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.837 INFO:teuthology.orchestra.run.smithi049.stdout: "exclude_perf_counters": { 2024-06-03T00:05:25.837 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "exclude_perf_counters", 2024-06-03T00:05:25.837 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.837 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.837 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.837 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.838 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.838 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.838 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.838 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-06-03T00:05:25.838 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-06-03T00:05:25.838 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.838 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.838 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.838 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.838 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.838 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.838 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.839 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.839 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.839 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.839 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.839 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.839 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.840 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.840 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.840 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.840 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.840 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.841 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.841 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.841 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.841 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.841 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.841 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.842 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.842 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.842 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.842 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.842 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.842 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.842 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.842 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.842 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.842 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.843 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.843 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.843 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.843 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.843 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.843 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.843 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.843 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.843 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.843 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.843 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.843 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.845 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.845 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.845 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.845 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.845 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.845 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.845 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.846 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.846 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.846 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.846 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.846 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.846 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.846 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.846 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.846 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.846 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.846 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.847 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.847 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.847 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.847 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.847 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.847 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.847 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.847 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.847 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.847 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_stats_pools": { 2024-06-03T00:05:25.847 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rbd_stats_pools", 2024-06-03T00:05:25.847 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.847 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.848 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.848 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.848 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.848 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.848 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.848 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.848 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.848 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.848 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.848 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.848 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_stats_pools_refresh_interval": { 2024-06-03T00:05:25.849 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-06-03T00:05:25.849 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.849 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.849 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.849 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "300", 2024-06-03T00:05:25.849 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.849 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.849 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.849 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.849 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.849 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.850 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.850 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.850 INFO:teuthology.orchestra.run.smithi049.stdout: "scrape_interval": { 2024-06-03T00:05:25.850 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "scrape_interval", 2024-06-03T00:05:25.850 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-06-03T00:05:25.850 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.850 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.850 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "15.0", 2024-06-03T00:05:25.850 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.850 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.850 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.850 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.851 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.851 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.851 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.851 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.851 INFO:teuthology.orchestra.run.smithi049.stdout: "server_addr": { 2024-06-03T00:05:25.851 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_addr", 2024-06-03T00:05:25.851 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.851 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.851 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.851 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "::", 2024-06-03T00:05:25.851 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.851 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.852 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.852 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-06-03T00:05:25.852 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.852 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.852 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.852 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.852 INFO:teuthology.orchestra.run.smithi049.stdout: "server_port": { 2024-06-03T00:05:25.852 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_port", 2024-06-03T00:05:25.852 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.852 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.852 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.852 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "9283", 2024-06-03T00:05:25.852 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.853 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.853 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.853 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-06-03T00:05:25.853 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.853 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.853 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.853 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.853 INFO:teuthology.orchestra.run.smithi049.stdout: "stale_cache_strategy": { 2024-06-03T00:05:25.853 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "stale_cache_strategy", 2024-06-03T00:05:25.853 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.853 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.853 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.854 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "log", 2024-06-03T00:05:25.854 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.854 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.854 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.854 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.854 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.854 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.854 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.854 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.854 INFO:teuthology.orchestra.run.smithi049.stdout: "standby_behaviour": { 2024-06-03T00:05:25.854 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "standby_behaviour", 2024-06-03T00:05:25.855 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.855 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.855 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.855 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "default", 2024-06-03T00:05:25.855 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.855 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.855 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.855 INFO:teuthology.orchestra.run.smithi049.stdout: "default", 2024-06-03T00:05:25.855 INFO:teuthology.orchestra.run.smithi049.stdout: "error" 2024-06-03T00:05:25.855 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.855 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.855 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.856 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.856 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.856 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.856 INFO:teuthology.orchestra.run.smithi049.stdout: "standby_error_status_code": { 2024-06-03T00:05:25.856 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "standby_error_status_code", 2024-06-03T00:05:25.856 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.856 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.856 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.856 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "500", 2024-06-03T00:05:25.856 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "400", 2024-06-03T00:05:25.856 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "599", 2024-06-03T00:05:25.856 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.857 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.857 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.857 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.857 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.857 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.857 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.857 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.857 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.857 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rbd_support", 2024-06-03T00:05:25.857 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.857 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.857 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.858 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.858 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.858 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.858 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.858 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.858 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.858 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.858 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.858 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.858 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.858 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.859 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.859 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.859 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.859 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.859 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.859 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.859 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.859 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.859 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.859 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.859 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.860 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.860 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.860 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.860 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.860 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.860 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.860 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.860 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.860 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.860 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.860 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.860 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.861 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.861 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.861 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.861 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.861 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.861 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.861 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.861 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.861 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.861 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.861 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.861 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.862 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.862 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.862 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.862 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.862 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.862 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.862 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.862 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.862 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.862 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.862 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.862 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.863 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.863 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.863 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.863 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.863 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.863 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.863 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.863 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.863 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.863 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.863 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.863 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.864 INFO:teuthology.orchestra.run.smithi049.stdout: "max_concurrent_snap_create": { 2024-06-03T00:05:25.864 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_concurrent_snap_create", 2024-06-03T00:05:25.864 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.864 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.864 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.864 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-06-03T00:05:25.864 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.864 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.864 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.864 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.864 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.864 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.865 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.865 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.865 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_snapshot_schedule": { 2024-06-03T00:05:25.865 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mirror_snapshot_schedule", 2024-06-03T00:05:25.865 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.865 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.865 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.865 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.865 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.865 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.865 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.865 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.865 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.866 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.866 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.866 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.866 INFO:teuthology.orchestra.run.smithi049.stdout: "trash_purge_schedule": { 2024-06-03T00:05:25.866 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "trash_purge_schedule", 2024-06-03T00:05:25.866 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.866 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.866 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.866 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.866 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.866 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.867 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.867 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.867 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.867 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.867 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.867 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.867 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.867 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.867 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.867 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "restful", 2024-06-03T00:05:25.867 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.867 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.868 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.868 INFO:teuthology.orchestra.run.smithi049.stdout: "enable_auth": { 2024-06-03T00:05:25.868 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "enable_auth", 2024-06-03T00:05:25.868 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.868 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.868 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.868 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.868 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.868 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.868 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.868 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.868 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.869 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.869 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.869 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.869 INFO:teuthology.orchestra.run.smithi049.stdout: "key_file": { 2024-06-03T00:05:25.869 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "key_file", 2024-06-03T00:05:25.869 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.869 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.869 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.869 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.869 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.869 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.869 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.869 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.870 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.870 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.870 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.870 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.870 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.870 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.870 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.870 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.870 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.870 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.870 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.871 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.871 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.871 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.871 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.871 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.871 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.871 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.871 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.871 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.871 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.871 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.872 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.872 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.872 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.872 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.872 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.872 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.872 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.872 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.872 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.872 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.872 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.872 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.873 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.873 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.873 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.873 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.873 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.873 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.873 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.873 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.873 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.873 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.873 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.873 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.874 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.874 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.874 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.874 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.874 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.874 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.874 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.874 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.874 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.874 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.874 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.874 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.875 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.875 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.875 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.875 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.875 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.875 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.875 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.875 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.875 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.875 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.875 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.875 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.876 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.876 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.876 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.876 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.876 INFO:teuthology.orchestra.run.smithi049.stdout: "server_addr": { 2024-06-03T00:05:25.876 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_addr", 2024-06-03T00:05:25.876 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.876 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.876 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.876 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.876 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.876 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.877 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.877 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.877 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.877 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.877 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.877 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.877 INFO:teuthology.orchestra.run.smithi049.stdout: "server_port": { 2024-06-03T00:05:25.877 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_port", 2024-06-03T00:05:25.877 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.877 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.877 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.878 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.878 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.878 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.878 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.878 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.878 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.878 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.878 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.878 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.878 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.878 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.879 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.879 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rgw", 2024-06-03T00:05:25.879 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.879 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.879 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.879 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.879 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.879 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.879 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.879 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.879 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.879 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.879 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.880 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.880 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.880 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.880 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.880 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.880 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.880 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.880 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.880 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.880 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.880 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.880 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.881 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.881 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.881 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.881 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.881 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.881 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.881 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.881 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.881 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.881 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.881 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.881 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.882 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.882 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.882 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.882 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.882 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.882 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.882 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.882 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.882 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.882 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.883 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.883 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.883 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.883 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.883 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.883 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.883 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.883 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.883 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.883 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.883 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.884 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.884 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.884 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.884 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.884 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.884 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.884 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.884 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.884 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.884 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.884 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.885 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.885 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.885 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.885 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.885 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.885 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.885 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.885 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.885 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.885 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rook", 2024-06-03T00:05:25.885 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.885 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.886 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.886 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.886 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.886 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.886 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.886 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.886 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.886 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.886 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.886 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.886 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.887 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.887 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.887 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.887 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.887 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.887 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.887 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.887 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.887 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.887 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.887 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.887 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.888 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.888 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.888 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.888 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.888 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.888 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.888 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.888 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.888 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.888 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.888 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.889 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.889 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.889 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.889 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.889 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.889 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.889 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.889 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.889 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.889 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.889 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.889 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.890 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.890 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.890 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.890 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.890 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.890 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.890 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.890 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.890 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.890 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.890 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.891 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.891 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.891 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.891 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.891 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.891 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.891 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.891 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.891 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.891 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.891 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.891 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.892 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.892 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.892 INFO:teuthology.orchestra.run.smithi049.stdout: "storage_class": { 2024-06-03T00:05:25.892 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "storage_class", 2024-06-03T00:05:25.892 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.892 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.892 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.892 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "local", 2024-06-03T00:05:25.892 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.892 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.892 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.892 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-06-03T00:05:25.893 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.893 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.893 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.893 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.893 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.893 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.893 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.893 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "selftest", 2024-06-03T00:05:25.893 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.893 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.893 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.893 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.894 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.894 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.894 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.894 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.894 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.894 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.894 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.894 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.894 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.894 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.894 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.895 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.895 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.895 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.895 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.895 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.895 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.895 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.895 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.895 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.895 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.895 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.895 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.896 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.896 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.896 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.896 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.896 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.896 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.896 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.896 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.896 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.896 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.896 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.896 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.897 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.897 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.897 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.897 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.897 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.897 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.897 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.897 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.897 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.897 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.897 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.898 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.898 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.898 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.898 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.898 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.898 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.898 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.898 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.898 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.898 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.898 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.899 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.899 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.899 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.899 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.899 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.899 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.899 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.899 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.899 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.899 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.899 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.900 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.900 INFO:teuthology.orchestra.run.smithi049.stdout: "roption1": { 2024-06-03T00:05:25.900 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "roption1", 2024-06-03T00:05:25.900 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.900 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.900 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.900 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.900 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.900 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.900 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.901 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.901 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.901 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.901 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.901 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.901 INFO:teuthology.orchestra.run.smithi049.stdout: "roption2": { 2024-06-03T00:05:25.901 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "roption2", 2024-06-03T00:05:25.901 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.901 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.901 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.901 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "xyz", 2024-06-03T00:05:25.902 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.902 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.902 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.902 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.902 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.902 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.902 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.902 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.902 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption1": { 2024-06-03T00:05:25.902 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption1", 2024-06-03T00:05:25.902 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.903 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.903 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.903 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.903 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.903 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.903 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.903 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.903 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.903 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.903 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.903 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.903 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption2": { 2024-06-03T00:05:25.904 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption2", 2024-06-03T00:05:25.904 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.904 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.904 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.904 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.904 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.904 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.904 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.904 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.904 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.904 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.905 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.905 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.905 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption3": { 2024-06-03T00:05:25.905 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption3", 2024-06-03T00:05:25.905 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-06-03T00:05:25.905 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.905 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.905 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.905 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.905 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.905 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.905 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.906 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.906 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.906 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.906 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.906 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption4": { 2024-06-03T00:05:25.906 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption4", 2024-06-03T00:05:25.906 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.906 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.906 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.906 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.906 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.907 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.907 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.907 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.907 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.907 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.907 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.907 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.907 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption5": { 2024-06-03T00:05:25.907 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption5", 2024-06-03T00:05:25.907 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.907 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.908 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.908 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.908 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.908 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.908 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.908 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.908 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.908 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.908 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.908 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.908 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption6": { 2024-06-03T00:05:25.908 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption6", 2024-06-03T00:05:25.909 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.909 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.909 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.909 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.909 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.909 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.909 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.909 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.909 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.909 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.909 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.909 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.910 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption7": { 2024-06-03T00:05:25.910 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption7", 2024-06-03T00:05:25.910 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.910 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.910 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.910 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.910 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "1", 2024-06-03T00:05:25.910 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "42", 2024-06-03T00:05:25.910 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.910 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.910 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.911 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.911 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.911 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.911 INFO:teuthology.orchestra.run.smithi049.stdout: "testkey": { 2024-06-03T00:05:25.911 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "testkey", 2024-06-03T00:05:25.911 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.911 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.911 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.911 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.911 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.911 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.911 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.912 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.912 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.912 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.912 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.912 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.912 INFO:teuthology.orchestra.run.smithi049.stdout: "testlkey": { 2024-06-03T00:05:25.912 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "testlkey", 2024-06-03T00:05:25.912 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.912 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.912 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.912 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.912 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.913 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.913 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.913 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.913 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.913 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.913 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.913 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.913 INFO:teuthology.orchestra.run.smithi049.stdout: "testnewline": { 2024-06-03T00:05:25.913 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "testnewline", 2024-06-03T00:05:25.913 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.913 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.913 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.913 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.914 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.914 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.914 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.914 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.914 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.914 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.914 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.914 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.914 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.914 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.914 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.915 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snap_schedule", 2024-06-03T00:05:25.915 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.915 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.915 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.915 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_m_granularity": { 2024-06-03T00:05:25.915 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "allow_m_granularity", 2024-06-03T00:05:25.915 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.915 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.915 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.915 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.915 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.915 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.916 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.916 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "allow minute scheduled snapshots", 2024-06-03T00:05:25.916 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.916 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.916 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.916 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.916 INFO:teuthology.orchestra.run.smithi049.stdout: "dump_on_update": { 2024-06-03T00:05:25.916 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "dump_on_update", 2024-06-03T00:05:25.916 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.916 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.916 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.916 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.916 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.917 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.917 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.917 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "dump database to debug log on update", 2024-06-03T00:05:25.917 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.917 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.917 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.917 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.917 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.917 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.917 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.917 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.917 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.918 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.918 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.918 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.918 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.918 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.918 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.918 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.918 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.918 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.918 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.918 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.919 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.919 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.919 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.919 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.919 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.919 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.919 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.919 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.919 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.919 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.919 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.919 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.919 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.920 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.920 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.920 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.920 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.920 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.920 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.920 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.920 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.920 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.920 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.920 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.921 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.921 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.921 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.921 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.921 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.921 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.921 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.921 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.921 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.921 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.921 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.921 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.922 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.922 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.922 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.922 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.922 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.922 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.922 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.922 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.922 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.922 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.922 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.923 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.923 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.923 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.923 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.923 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.923 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.923 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.923 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.923 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.923 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.923 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "stats", 2024-06-03T00:05:25.923 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.923 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.924 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.924 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.924 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.924 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.924 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.924 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.924 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.924 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.924 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.924 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.924 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.924 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.925 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.925 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.925 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.925 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.925 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.925 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.925 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.925 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.925 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.925 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.925 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.925 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.926 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.926 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.926 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.926 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.926 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.926 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.926 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.926 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.926 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.926 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.926 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.926 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.927 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.927 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.927 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.927 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.927 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.927 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.927 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.927 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.927 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.927 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.927 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.927 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.928 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.928 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.928 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.928 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.928 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.928 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.928 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.928 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.928 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.928 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.928 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.928 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.929 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.929 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.929 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.929 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.929 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.929 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.929 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.929 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.929 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.929 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.929 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.929 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.930 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.930 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.930 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "status", 2024-06-03T00:05:25.930 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.930 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.930 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.930 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.930 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.930 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.930 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.930 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.930 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.931 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.931 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.931 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.931 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.931 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.931 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.931 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.931 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.931 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.931 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.931 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.931 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.932 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.932 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.932 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.932 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.932 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.932 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.932 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.932 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.932 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.932 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.932 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.932 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.933 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.933 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.933 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.933 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.933 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.933 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.933 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.933 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.933 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.933 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.933 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.933 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.933 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.934 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.934 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.934 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.934 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.934 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.934 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.934 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.934 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.934 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.934 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.934 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.934 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.935 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.935 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.935 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.935 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.935 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.935 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.935 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.935 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.935 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.935 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.935 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.936 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.936 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.936 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.936 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.936 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.936 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.936 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.936 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "telegraf", 2024-06-03T00:05:25.936 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.936 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.936 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.936 INFO:teuthology.orchestra.run.smithi049.stdout: "address": { 2024-06-03T00:05:25.936 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "address", 2024-06-03T00:05:25.937 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.937 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.937 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.937 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-06-03T00:05:25.937 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.937 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.937 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.937 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.937 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.937 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.937 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.937 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.938 INFO:teuthology.orchestra.run.smithi049.stdout: "interval": { 2024-06-03T00:05:25.938 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "interval", 2024-06-03T00:05:25.938 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.938 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.938 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.938 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "15", 2024-06-03T00:05:25.938 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.938 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.938 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.938 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.938 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.939 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.939 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.939 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.939 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.939 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.939 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.939 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.939 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.939 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.939 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.939 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.939 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.940 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.940 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.940 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.940 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.940 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.940 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.940 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.940 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.940 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.940 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.940 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.940 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.940 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.941 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.941 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.941 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.941 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.941 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.941 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.941 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.941 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.941 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.941 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.941 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.941 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.942 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.942 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.942 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.942 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.942 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.942 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.942 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.942 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.942 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.942 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.942 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.943 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.943 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.943 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.943 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.943 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.943 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.943 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.943 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.943 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.943 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.943 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.943 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.944 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.944 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.944 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.944 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.944 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.944 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.944 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.944 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.944 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.944 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.944 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.945 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.945 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.945 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.945 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.945 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.945 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "telemetry", 2024-06-03T00:05:25.945 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.945 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.945 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.945 INFO:teuthology.orchestra.run.smithi049.stdout: "channel_basic": { 2024-06-03T00:05:25.945 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "channel_basic", 2024-06-03T00:05:25.945 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.946 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.946 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.946 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.946 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.946 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.946 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.946 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Share basic cluster information (size, version)", 2024-06-03T00:05:25.946 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.946 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.946 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.946 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.947 INFO:teuthology.orchestra.run.smithi049.stdout: "channel_crash": { 2024-06-03T00:05:25.947 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "channel_crash", 2024-06-03T00:05:25.947 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.947 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.947 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.947 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.947 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.947 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.947 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.947 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-06-03T00:05:25.947 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.947 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.948 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.948 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.948 INFO:teuthology.orchestra.run.smithi049.stdout: "channel_device": { 2024-06-03T00:05:25.948 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "channel_device", 2024-06-03T00:05:25.948 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.948 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.948 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.948 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.948 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.948 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.948 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.948 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-06-03T00:05:25.949 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.949 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.949 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.949 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.949 INFO:teuthology.orchestra.run.smithi049.stdout: "channel_ident": { 2024-06-03T00:05:25.949 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "channel_ident", 2024-06-03T00:05:25.949 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.949 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.949 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.949 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.949 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.949 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.950 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.950 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-06-03T00:05:25.950 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.950 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.950 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.950 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.950 INFO:teuthology.orchestra.run.smithi049.stdout: "channel_perf": { 2024-06-03T00:05:25.950 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "channel_perf", 2024-06-03T00:05:25.950 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.950 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.950 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.950 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.951 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.951 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.951 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.951 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Share various performance metrics of a cluster", 2024-06-03T00:05:25.951 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.951 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.951 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.951 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.951 INFO:teuthology.orchestra.run.smithi049.stdout: "contact": { 2024-06-03T00:05:25.951 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "contact", 2024-06-03T00:05:25.951 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.951 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.952 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.952 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.952 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.952 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.952 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.952 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.952 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.952 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.952 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.952 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.952 INFO:teuthology.orchestra.run.smithi049.stdout: "description": { 2024-06-03T00:05:25.952 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "description", 2024-06-03T00:05:25.952 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.953 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.953 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.953 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.953 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.953 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.953 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.953 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.953 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.953 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.953 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.953 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.953 INFO:teuthology.orchestra.run.smithi049.stdout: "device_url": { 2024-06-03T00:05:25.954 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "device_url", 2024-06-03T00:05:25.954 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.954 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.954 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.954 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-06-03T00:05:25.954 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.954 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.954 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.954 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.954 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.955 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.955 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.955 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.955 INFO:teuthology.orchestra.run.smithi049.stdout: "enabled": { 2024-06-03T00:05:25.955 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "enabled", 2024-06-03T00:05:25.955 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.955 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.955 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.955 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.955 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.955 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.955 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.956 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.956 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.956 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.956 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.956 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.956 INFO:teuthology.orchestra.run.smithi049.stdout: "interval": { 2024-06-03T00:05:25.956 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "interval", 2024-06-03T00:05:25.956 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.956 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.956 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.956 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "24", 2024-06-03T00:05:25.957 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "8", 2024-06-03T00:05:25.957 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.957 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.957 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.957 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.957 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.957 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.957 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.957 INFO:teuthology.orchestra.run.smithi049.stdout: "last_opt_revision": { 2024-06-03T00:05:25.957 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "last_opt_revision", 2024-06-03T00:05:25.957 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.957 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.958 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.958 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "1", 2024-06-03T00:05:25.958 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.958 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.958 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.958 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.958 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.958 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.958 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.958 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.958 INFO:teuthology.orchestra.run.smithi049.stdout: "leaderboard": { 2024-06-03T00:05:25.958 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "leaderboard", 2024-06-03T00:05:25.959 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.959 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.959 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.959 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.959 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.959 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.959 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.959 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.959 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.959 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.959 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.959 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.960 INFO:teuthology.orchestra.run.smithi049.stdout: "leaderboard_description": { 2024-06-03T00:05:25.960 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "leaderboard_description", 2024-06-03T00:05:25.960 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.960 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.960 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.960 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.960 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.960 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.960 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.960 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.960 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.961 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.961 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.961 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.961 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.961 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.961 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.961 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.961 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.961 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.961 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.961 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.961 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.962 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.962 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.962 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.962 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.962 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.962 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.962 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.962 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.962 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.962 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.963 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.963 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.963 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.963 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.963 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.963 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.963 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.963 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.963 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.963 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.963 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.963 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.964 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.964 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.964 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.964 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.964 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.964 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.964 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.964 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.964 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.964 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.964 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.964 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.965 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.965 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.965 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.965 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.965 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.965 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.965 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.965 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.965 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.965 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.965 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.965 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.966 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.966 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.966 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.966 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.966 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.966 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.966 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.966 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.966 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.966 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.966 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.967 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.967 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.967 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.967 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.967 INFO:teuthology.orchestra.run.smithi049.stdout: "organization": { 2024-06-03T00:05:25.967 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "organization", 2024-06-03T00:05:25.967 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.967 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.967 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.967 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.967 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.967 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.968 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.968 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.968 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.968 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.968 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.968 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.968 INFO:teuthology.orchestra.run.smithi049.stdout: "proxy": { 2024-06-03T00:05:25.968 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "proxy", 2024-06-03T00:05:25.968 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.968 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.968 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.968 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.969 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.969 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.969 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.969 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.969 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.969 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.969 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.969 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.969 INFO:teuthology.orchestra.run.smithi049.stdout: "url": { 2024-06-03T00:05:25.969 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "url", 2024-06-03T00:05:25.969 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.969 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.969 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.970 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-06-03T00:05:25.970 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.970 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.970 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.970 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.970 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.970 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.970 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.970 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.970 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.971 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.971 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.971 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "test_orchestrator", 2024-06-03T00:05:25.971 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.971 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.971 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.971 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.971 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.971 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.971 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.971 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.971 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.972 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.972 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.972 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.972 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.972 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.972 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.972 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.972 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.972 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.972 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.972 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.972 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.972 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.973 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.973 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.973 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.973 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.973 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.973 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.973 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.973 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.973 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.973 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.973 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.973 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.974 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.974 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.974 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.974 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.974 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.974 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.974 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.974 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.974 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.974 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.974 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.974 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.975 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.975 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.975 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.975 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.975 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.975 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.975 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.975 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.975 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.975 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.975 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.976 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.976 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.976 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.976 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.976 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.976 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.976 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.976 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.976 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.976 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.976 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.977 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.977 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.977 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.977 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.977 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.977 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.978 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.978 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.978 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "volumes", 2024-06-03T00:05:25.978 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.978 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.978 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.978 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.978 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.978 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.978 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.978 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.978 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.979 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.979 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.979 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.979 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.979 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.979 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.979 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.979 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.979 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.979 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.979 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.979 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.980 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.980 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.980 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.980 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.980 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.980 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.980 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.980 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.980 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.980 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.980 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.980 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.981 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.981 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.981 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.981 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.981 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.981 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.981 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.981 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.981 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.981 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.981 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.981 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.982 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.982 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.982 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.982 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.982 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.982 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.982 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.982 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.982 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.982 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.983 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.983 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.983 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.983 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.983 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.983 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.983 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.983 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.983 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.983 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.983 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.984 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.984 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.984 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.984 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.984 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.984 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.984 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.984 INFO:teuthology.orchestra.run.smithi049.stdout: "max_concurrent_clones": { 2024-06-03T00:05:25.984 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_concurrent_clones", 2024-06-03T00:05:25.984 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.984 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.985 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.985 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "4", 2024-06-03T00:05:25.985 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.985 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.985 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.985 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Number of asynchronous cloner threads", 2024-06-03T00:05:25.985 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.985 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.985 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.985 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.985 INFO:teuthology.orchestra.run.smithi049.stdout: "periodic_async_work": { 2024-06-03T00:05:25.985 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "periodic_async_work", 2024-06-03T00:05:25.985 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.986 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.986 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.986 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.986 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.986 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.986 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.986 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Periodically check for async work", 2024-06-03T00:05:25.986 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.986 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.986 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.986 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.986 INFO:teuthology.orchestra.run.smithi049.stdout: "snapshot_clone_delay": { 2024-06-03T00:05:25.987 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snapshot_clone_delay", 2024-06-03T00:05:25.987 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:25.987 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.987 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.987 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-06-03T00:05:25.987 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.987 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.987 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.987 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-06-03T00:05:25.987 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.988 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.988 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.988 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.988 INFO:teuthology.orchestra.run.smithi049.stdout: "snapshot_clone_no_wait": { 2024-06-03T00:05:25.988 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snapshot_clone_no_wait", 2024-06-03T00:05:25.988 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.988 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.988 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.988 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:25.988 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.988 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.988 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.989 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-06-03T00:05:25.989 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.989 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.989 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.989 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.989 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:25.989 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.989 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:25.989 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "zabbix", 2024-06-03T00:05:25.989 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:25.989 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:25.989 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:25.990 INFO:teuthology.orchestra.run.smithi049.stdout: "discovery_interval": { 2024-06-03T00:05:25.990 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "discovery_interval", 2024-06-03T00:05:25.990 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "uint", 2024-06-03T00:05:25.990 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.990 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.990 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "100", 2024-06-03T00:05:25.990 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.990 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.990 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.990 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.990 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.990 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.991 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.991 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.991 INFO:teuthology.orchestra.run.smithi049.stdout: "identifier": { 2024-06-03T00:05:25.991 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "identifier", 2024-06-03T00:05:25.991 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.991 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.991 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.991 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.991 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.991 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.991 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.991 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.992 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.992 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.992 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.992 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.992 INFO:teuthology.orchestra.run.smithi049.stdout: "interval": { 2024-06-03T00:05:25.992 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "interval", 2024-06-03T00:05:25.992 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:25.992 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.992 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:25.992 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "60", 2024-06-03T00:05:25.992 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.993 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.993 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.993 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.993 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.993 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.993 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.993 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.993 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:25.993 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:25.993 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.994 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.994 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.994 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:25.994 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.994 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.994 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.994 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.994 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.994 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.994 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.994 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.995 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.995 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.995 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.995 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.995 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.995 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.995 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.995 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:25.995 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:25.995 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.995 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.996 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.996 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.996 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.996 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.996 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.996 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.996 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.996 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.996 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.996 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.996 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:25.996 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:25.997 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:25.997 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.997 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.997 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:25.997 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.997 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.997 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:25.997 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:25.997 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:25.997 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:25.997 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:25.997 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:25.998 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:25.998 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:25.998 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.998 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.998 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.998 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.998 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.998 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:25.998 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:25.998 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:25.998 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:25.999 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:25.999 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:25.999 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:25.999 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:25.999 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:25.999 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:25.999 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:25.999 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:25.999 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:25.999 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:25.999 INFO:teuthology.orchestra.run.smithi049.stdout: "zabbix_host": { 2024-06-03T00:05:25.999 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "zabbix_host", 2024-06-03T00:05:25.999 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.000 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.000 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.000 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.000 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.000 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.000 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.000 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.000 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.000 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.000 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.000 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.000 INFO:teuthology.orchestra.run.smithi049.stdout: "zabbix_port": { 2024-06-03T00:05:26.001 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "zabbix_port", 2024-06-03T00:05:26.001 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.001 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.001 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.001 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10051", 2024-06-03T00:05:26.001 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.001 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.001 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.001 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.001 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.001 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.002 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.002 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.002 INFO:teuthology.orchestra.run.smithi049.stdout: "zabbix_sender": { 2024-06-03T00:05:26.002 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "zabbix_sender", 2024-06-03T00:05:26.002 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.002 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.002 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.002 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-06-03T00:05:26.002 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.002 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.002 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.002 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.003 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.003 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.003 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.003 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.003 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.003 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.003 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-06-03T00:05:26.003 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.003 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.003 INFO:teuthology.orchestra.run.smithi049.stdout: "modules": [ 2024-06-03T00:05:26.003 INFO:teuthology.orchestra.run.smithi049.stdout: "cephadm", 2024-06-03T00:05:26.003 INFO:teuthology.orchestra.run.smithi049.stdout: "dashboard", 2024-06-03T00:05:26.004 INFO:teuthology.orchestra.run.smithi049.stdout: "iostat", 2024-06-03T00:05:26.004 INFO:teuthology.orchestra.run.smithi049.stdout: "nfs", 2024-06-03T00:05:26.004 INFO:teuthology.orchestra.run.smithi049.stdout: "restful" 2024-06-03T00:05:26.004 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.004 INFO:teuthology.orchestra.run.smithi049.stdout: "available_modules": [ 2024-06-03T00:05:26.004 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.004 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "alerts", 2024-06-03T00:05:26.004 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.004 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.004 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.004 INFO:teuthology.orchestra.run.smithi049.stdout: "interval": { 2024-06-03T00:05:26.004 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "interval", 2024-06-03T00:05:26.005 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:26.005 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.005 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.005 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "60", 2024-06-03T00:05:26.005 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.005 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.005 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.005 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "How frequently to reexamine health status", 2024-06-03T00:05:26.005 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.006 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.006 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.006 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.006 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.006 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.006 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.006 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.006 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.006 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.006 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.006 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.007 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.007 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.007 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.007 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.007 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.007 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.007 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.007 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.007 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.007 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.007 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.008 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.008 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.008 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.008 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.008 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.008 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.008 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.008 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.008 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.008 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.008 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.009 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.009 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.009 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.009 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.009 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.009 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.009 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.009 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.009 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.009 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.009 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.009 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.010 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.010 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.010 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.010 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.010 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.010 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.010 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.010 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.010 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.010 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.010 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.011 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.011 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.011 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.011 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.011 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.011 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.011 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.011 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.011 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.011 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.011 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.011 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.012 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.012 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.012 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.012 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.012 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.012 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_destination": { 2024-06-03T00:05:26.012 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_destination", 2024-06-03T00:05:26.012 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.012 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.012 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.012 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.012 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.013 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.013 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.013 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Email address to send alerts to", 2024-06-03T00:05:26.013 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.013 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.013 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.013 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.013 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_from_name": { 2024-06-03T00:05:26.013 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_from_name", 2024-06-03T00:05:26.013 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.014 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.014 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.014 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "Ceph", 2024-06-03T00:05:26.014 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.014 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.014 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.014 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Email From: name", 2024-06-03T00:05:26.014 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.014 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.014 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.014 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.015 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_host": { 2024-06-03T00:05:26.015 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_host", 2024-06-03T00:05:26.015 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.015 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.015 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.015 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.015 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.015 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.015 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.015 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "SMTP server", 2024-06-03T00:05:26.015 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.015 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.016 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.016 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.016 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_password": { 2024-06-03T00:05:26.016 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_password", 2024-06-03T00:05:26.016 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.016 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.016 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.016 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.016 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.016 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.016 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.016 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Password to authenticate with", 2024-06-03T00:05:26.017 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.017 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.017 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.017 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.017 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_port": { 2024-06-03T00:05:26.017 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_port", 2024-06-03T00:05:26.017 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.017 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.017 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.017 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "465", 2024-06-03T00:05:26.017 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.017 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.018 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.018 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "SMTP port", 2024-06-03T00:05:26.018 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.018 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.018 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.018 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.018 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_sender": { 2024-06-03T00:05:26.018 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_sender", 2024-06-03T00:05:26.018 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.018 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.018 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.018 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.019 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.019 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.019 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.019 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "SMTP envelope sender", 2024-06-03T00:05:26.019 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.019 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.019 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.019 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.019 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_ssl": { 2024-06-03T00:05:26.019 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_ssl", 2024-06-03T00:05:26.020 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.020 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.020 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.020 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.020 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.020 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.020 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.020 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Use SSL to connect to SMTP server", 2024-06-03T00:05:26.020 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.020 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.020 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.020 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.021 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_user": { 2024-06-03T00:05:26.021 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_user", 2024-06-03T00:05:26.021 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.021 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.021 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.021 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.021 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.021 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.021 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.021 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "User to authenticate as", 2024-06-03T00:05:26.022 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.022 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.022 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.022 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.022 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.022 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.022 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.022 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "balancer", 2024-06-03T00:05:26.022 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.022 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.023 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.023 INFO:teuthology.orchestra.run.smithi049.stdout: "active": { 2024-06-03T00:05:26.023 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "active", 2024-06-03T00:05:26.023 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.023 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.023 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.023 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.023 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.023 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.023 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.023 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "automatically balance PGs across cluster", 2024-06-03T00:05:26.023 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.024 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.024 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.024 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.024 INFO:teuthology.orchestra.run.smithi049.stdout: "begin_time": { 2024-06-03T00:05:26.024 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "begin_time", 2024-06-03T00:05:26.024 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.024 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.024 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.024 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0000", 2024-06-03T00:05:26.024 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.024 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.025 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.025 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "beginning time of day to automatically balance", 2024-06-03T00:05:26.025 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-03T00:05:26.025 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.025 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.025 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.025 INFO:teuthology.orchestra.run.smithi049.stdout: "begin_weekday": { 2024-06-03T00:05:26.025 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "begin_weekday", 2024-06-03T00:05:26.025 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "uint", 2024-06-03T00:05:26.025 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.025 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.025 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-06-03T00:05:26.026 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "0", 2024-06-03T00:05:26.026 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "6", 2024-06-03T00:05:26.026 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.026 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-06-03T00:05:26.026 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-03T00:05:26.026 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.026 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.026 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.026 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_compat_max_iterations": { 2024-06-03T00:05:26.026 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "crush_compat_max_iterations", 2024-06-03T00:05:26.026 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "uint", 2024-06-03T00:05:26.027 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.027 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.027 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "25", 2024-06-03T00:05:26.027 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "1", 2024-06-03T00:05:26.027 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "250", 2024-06-03T00:05:26.027 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.027 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-06-03T00:05:26.027 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.027 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.027 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.027 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.027 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_compat_metrics": { 2024-06-03T00:05:26.028 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "crush_compat_metrics", 2024-06-03T00:05:26.028 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.028 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.028 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.028 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "pgs,objects,bytes", 2024-06-03T00:05:26.028 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.028 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.028 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.028 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-06-03T00:05:26.028 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-06-03T00:05:26.028 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.028 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.029 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.029 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_compat_step": { 2024-06-03T00:05:26.029 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "crush_compat_step", 2024-06-03T00:05:26.029 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-06-03T00:05:26.029 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.029 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.029 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0.5", 2024-06-03T00:05:26.029 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "0.001", 2024-06-03T00:05:26.029 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "0.999", 2024-06-03T00:05:26.029 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.029 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "aggressiveness of optimization", 2024-06-03T00:05:26.029 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-06-03T00:05:26.030 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.030 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.030 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.030 INFO:teuthology.orchestra.run.smithi049.stdout: "end_time": { 2024-06-03T00:05:26.030 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "end_time", 2024-06-03T00:05:26.030 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.030 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.030 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.030 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "2359", 2024-06-03T00:05:26.030 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.030 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.030 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.031 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "ending time of day to automatically balance", 2024-06-03T00:05:26.031 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-03T00:05:26.031 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.031 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.031 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.031 INFO:teuthology.orchestra.run.smithi049.stdout: "end_weekday": { 2024-06-03T00:05:26.031 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "end_weekday", 2024-06-03T00:05:26.031 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "uint", 2024-06-03T00:05:26.031 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.031 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.031 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-06-03T00:05:26.031 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "0", 2024-06-03T00:05:26.032 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "6", 2024-06-03T00:05:26.032 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.032 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-06-03T00:05:26.032 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-03T00:05:26.032 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.032 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.032 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.032 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.032 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.032 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.032 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.032 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.032 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.033 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.033 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.033 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.033 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.033 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.033 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.033 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.033 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.033 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.033 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.033 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.033 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.034 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.034 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.034 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.034 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.034 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.034 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.034 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.034 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.034 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.034 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.034 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.035 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.035 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.035 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.035 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.035 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.035 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.035 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.035 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.035 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.035 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.035 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.035 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.036 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.036 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.036 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.036 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.036 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.036 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.036 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.036 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.036 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.036 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.036 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.036 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.037 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.037 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.037 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.037 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.037 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.037 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.037 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.037 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.037 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.037 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.037 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.037 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.038 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.038 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.038 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.038 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.038 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.038 INFO:teuthology.orchestra.run.smithi049.stdout: "min_score": { 2024-06-03T00:05:26.038 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "min_score", 2024-06-03T00:05:26.038 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-06-03T00:05:26.038 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.038 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.038 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-06-03T00:05:26.038 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.039 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.039 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.039 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-06-03T00:05:26.039 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.039 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.039 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.039 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.039 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": { 2024-06-03T00:05:26.039 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mode", 2024-06-03T00:05:26.039 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.039 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.039 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.040 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "upmap", 2024-06-03T00:05:26.040 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.040 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.040 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.040 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-compat", 2024-06-03T00:05:26.040 INFO:teuthology.orchestra.run.smithi049.stdout: "none", 2024-06-03T00:05:26.040 INFO:teuthology.orchestra.run.smithi049.stdout: "read", 2024-06-03T00:05:26.040 INFO:teuthology.orchestra.run.smithi049.stdout: "upmap", 2024-06-03T00:05:26.040 INFO:teuthology.orchestra.run.smithi049.stdout: "upmap-read" 2024-06-03T00:05:26.040 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.040 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Balancer mode", 2024-06-03T00:05:26.040 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.041 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.041 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.041 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.041 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_ids": { 2024-06-03T00:05:26.041 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "pool_ids", 2024-06-03T00:05:26.041 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.041 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.041 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.041 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.041 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.041 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.042 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.042 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-06-03T00:05:26.042 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.042 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.042 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.042 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.042 INFO:teuthology.orchestra.run.smithi049.stdout: "sleep_interval": { 2024-06-03T00:05:26.042 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sleep_interval", 2024-06-03T00:05:26.042 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:26.042 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.042 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.042 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "60", 2024-06-03T00:05:26.043 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.043 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.043 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.043 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-06-03T00:05:26.043 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.043 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.043 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.043 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.043 INFO:teuthology.orchestra.run.smithi049.stdout: "upmap_max_deviation": { 2024-06-03T00:05:26.043 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "upmap_max_deviation", 2024-06-03T00:05:26.043 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.044 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.044 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.044 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5", 2024-06-03T00:05:26.044 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "1", 2024-06-03T00:05:26.044 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.044 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.044 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "deviation below which no optimization is attempted", 2024-06-03T00:05:26.044 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-06-03T00:05:26.044 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.044 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.044 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.044 INFO:teuthology.orchestra.run.smithi049.stdout: "upmap_max_optimizations": { 2024-06-03T00:05:26.045 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "upmap_max_optimizations", 2024-06-03T00:05:26.045 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "uint", 2024-06-03T00:05:26.045 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.045 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.045 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-06-03T00:05:26.045 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.045 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.045 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.045 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-06-03T00:05:26.045 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.045 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.045 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.045 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.046 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.046 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.046 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.046 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cephadm", 2024-06-03T00:05:26.046 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.046 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.046 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.046 INFO:teuthology.orchestra.run.smithi049.stdout: "agent_down_multiplier": { 2024-06-03T00:05:26.046 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "agent_down_multiplier", 2024-06-03T00:05:26.046 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-06-03T00:05:26.046 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.047 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.047 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "3.0", 2024-06-03T00:05:26.047 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.047 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.047 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.047 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-06-03T00:05:26.047 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.047 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.047 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.047 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.047 INFO:teuthology.orchestra.run.smithi049.stdout: "agent_refresh_rate": { 2024-06-03T00:05:26.049 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "agent_refresh_rate", 2024-06-03T00:05:26.049 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:26.049 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.049 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.049 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "20", 2024-06-03T00:05:26.049 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.049 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.049 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.049 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-06-03T00:05:26.050 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.050 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.050 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.050 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.050 INFO:teuthology.orchestra.run.smithi049.stdout: "agent_starting_port": { 2024-06-03T00:05:26.050 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "agent_starting_port", 2024-06-03T00:05:26.050 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.050 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.050 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.050 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "4721", 2024-06-03T00:05:26.050 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.051 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.051 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.051 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-06-03T00:05:26.051 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.051 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.051 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.051 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.051 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_ptrace": { 2024-06-03T00:05:26.051 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "allow_ptrace", 2024-06-03T00:05:26.051 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.051 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.051 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.052 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.052 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.052 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.052 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.052 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-06-03T00:05:26.052 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-06-03T00:05:26.052 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.052 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.052 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.052 INFO:teuthology.orchestra.run.smithi049.stdout: "autotune_interval": { 2024-06-03T00:05:26.052 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "autotune_interval", 2024-06-03T00:05:26.052 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:26.053 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.053 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.053 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "600", 2024-06-03T00:05:26.053 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.053 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.053 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.053 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how frequently to autotune daemon memory", 2024-06-03T00:05:26.053 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.053 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.053 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.053 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.053 INFO:teuthology.orchestra.run.smithi049.stdout: "autotune_memory_target_ratio": { 2024-06-03T00:05:26.053 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "autotune_memory_target_ratio", 2024-06-03T00:05:26.054 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-06-03T00:05:26.054 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.054 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.054 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0.7", 2024-06-03T00:05:26.054 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.054 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.054 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.054 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-06-03T00:05:26.054 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.054 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.054 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.055 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.055 INFO:teuthology.orchestra.run.smithi049.stdout: "cephadm_log_destination": { 2024-06-03T00:05:26.055 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cephadm_log_destination", 2024-06-03T00:05:26.055 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.055 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.055 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.055 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.055 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.055 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.055 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.055 INFO:teuthology.orchestra.run.smithi049.stdout: "file", 2024-06-03T00:05:26.055 INFO:teuthology.orchestra.run.smithi049.stdout: "file,syslog", 2024-06-03T00:05:26.056 INFO:teuthology.orchestra.run.smithi049.stdout: "syslog" 2024-06-03T00:05:26.056 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.056 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-06-03T00:05:26.056 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.056 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.056 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.056 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.056 INFO:teuthology.orchestra.run.smithi049.stdout: "cgroups_split": { 2024-06-03T00:05:26.056 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cgroups_split", 2024-06-03T00:05:26.056 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.056 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.056 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.056 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.057 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.057 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.057 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.057 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-06-03T00:05:26.057 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.057 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.057 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.057 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.057 INFO:teuthology.orchestra.run.smithi049.stdout: "config_checks_enabled": { 2024-06-03T00:05:26.057 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "config_checks_enabled", 2024-06-03T00:05:26.057 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.058 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.058 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.058 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.058 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.058 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.058 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.058 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-06-03T00:05:26.058 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.058 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.058 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.058 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.059 INFO:teuthology.orchestra.run.smithi049.stdout: "config_dashboard": { 2024-06-03T00:05:26.059 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "config_dashboard", 2024-06-03T00:05:26.059 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.059 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.059 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.059 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.059 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.059 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.059 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.059 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-06-03T00:05:26.059 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.059 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.060 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.060 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.060 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_alertmanager": { 2024-06-03T00:05:26.060 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_alertmanager", 2024-06-03T00:05:26.060 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.060 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.060 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.060 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-06-03T00:05:26.060 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.060 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.060 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.060 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Prometheus container image", 2024-06-03T00:05:26.061 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.061 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.061 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.061 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.061 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_base": { 2024-06-03T00:05:26.061 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_base", 2024-06-03T00:05:26.061 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.061 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.061 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.061 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/ceph", 2024-06-03T00:05:26.061 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.061 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.062 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.062 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Container image name, without the tag", 2024-06-03T00:05:26.062 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.062 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.062 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.062 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.062 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_elasticsearch": { 2024-06-03T00:05:26.062 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_elasticsearch", 2024-06-03T00:05:26.062 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.063 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.063 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.063 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-06-03T00:05:26.063 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.063 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.063 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.063 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "elasticsearch container image", 2024-06-03T00:05:26.064 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.064 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.064 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.064 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.064 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_grafana": { 2024-06-03T00:05:26.064 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_grafana", 2024-06-03T00:05:26.064 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.064 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.064 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.064 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-06-03T00:05:26.065 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.065 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.065 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.065 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Prometheus container image", 2024-06-03T00:05:26.065 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.065 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.065 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.065 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.065 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_haproxy": { 2024-06-03T00:05:26.065 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_haproxy", 2024-06-03T00:05:26.065 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.065 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.066 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.066 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-06-03T00:05:26.066 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.066 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.066 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.066 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "HAproxy container image", 2024-06-03T00:05:26.066 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.066 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.066 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.066 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.066 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_jaeger_agent": { 2024-06-03T00:05:26.066 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_jaeger_agent", 2024-06-03T00:05:26.067 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.067 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.067 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.067 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-06-03T00:05:26.067 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.067 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.067 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.067 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Jaeger agent container image", 2024-06-03T00:05:26.067 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.067 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.067 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.068 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.068 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_jaeger_collector": { 2024-06-03T00:05:26.068 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_jaeger_collector", 2024-06-03T00:05:26.068 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.068 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.068 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.068 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-06-03T00:05:26.068 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.068 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.068 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.068 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Jaeger collector container image", 2024-06-03T00:05:26.068 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.069 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.069 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.069 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.069 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_jaeger_query": { 2024-06-03T00:05:26.069 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_jaeger_query", 2024-06-03T00:05:26.069 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.069 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.069 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.069 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-06-03T00:05:26.069 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.069 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.070 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.070 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Jaeger query container image", 2024-06-03T00:05:26.070 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.070 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.070 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.070 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.070 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_keepalived": { 2024-06-03T00:05:26.070 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_keepalived", 2024-06-03T00:05:26.070 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.071 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.071 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.071 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-06-03T00:05:26.071 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.071 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.071 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.071 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Keepalived container image", 2024-06-03T00:05:26.071 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.071 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.071 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.071 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.071 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_loki": { 2024-06-03T00:05:26.072 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_loki", 2024-06-03T00:05:26.072 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.072 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.072 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.072 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-06-03T00:05:26.072 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.072 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.072 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.072 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Loki container image", 2024-06-03T00:05:26.072 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.072 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.072 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.072 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.073 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_node_exporter": { 2024-06-03T00:05:26.073 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_node_exporter", 2024-06-03T00:05:26.073 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.073 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.073 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.073 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-06-03T00:05:26.073 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.073 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.073 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.073 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Prometheus container image", 2024-06-03T00:05:26.073 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.073 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.074 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.074 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.074 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_nvmeof": { 2024-06-03T00:05:26.074 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_nvmeof", 2024-06-03T00:05:26.074 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.074 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.074 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.074 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-06-03T00:05:26.074 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.074 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.074 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.075 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Nvme-of container image", 2024-06-03T00:05:26.075 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.075 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.075 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.075 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.075 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_prometheus": { 2024-06-03T00:05:26.075 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_prometheus", 2024-06-03T00:05:26.075 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.075 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.075 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.075 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-06-03T00:05:26.075 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.075 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.076 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.076 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Prometheus container image", 2024-06-03T00:05:26.076 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.076 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.076 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.076 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.076 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_promtail": { 2024-06-03T00:05:26.076 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_promtail", 2024-06-03T00:05:26.076 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.076 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.076 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.076 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-06-03T00:05:26.077 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.077 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.077 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.077 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Promtail container image", 2024-06-03T00:05:26.077 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.077 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.077 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.077 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.077 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_samba": { 2024-06-03T00:05:26.077 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_samba", 2024-06-03T00:05:26.077 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.077 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.078 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.078 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-06-03T00:05:26.078 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.078 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.078 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.078 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Samba/SMB container image", 2024-06-03T00:05:26.078 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.078 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.078 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.078 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.079 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_snmp_gateway": { 2024-06-03T00:05:26.079 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_snmp_gateway", 2024-06-03T00:05:26.079 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.079 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.079 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.079 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-06-03T00:05:26.079 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.079 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.079 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.079 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "SNMP Gateway container image", 2024-06-03T00:05:26.079 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.079 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.080 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.080 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.080 INFO:teuthology.orchestra.run.smithi049.stdout: "container_init": { 2024-06-03T00:05:26.080 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_init", 2024-06-03T00:05:26.080 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.080 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.080 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.080 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.080 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.080 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.080 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.081 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Run podman/docker with `--init`", 2024-06-03T00:05:26.081 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.081 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.081 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.081 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.081 INFO:teuthology.orchestra.run.smithi049.stdout: "daemon_cache_timeout": { 2024-06-03T00:05:26.081 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "daemon_cache_timeout", 2024-06-03T00:05:26.081 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:26.081 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.081 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.081 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "600", 2024-06-03T00:05:26.081 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.082 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.082 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.082 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-06-03T00:05:26.082 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.082 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.082 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.082 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.082 INFO:teuthology.orchestra.run.smithi049.stdout: "default_cephadm_command_timeout": { 2024-06-03T00:05:26.082 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "default_cephadm_command_timeout", 2024-06-03T00:05:26.082 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.082 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.083 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.083 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "900", 2024-06-03T00:05:26.083 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.083 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.083 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.083 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-06-03T00:05:26.083 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.083 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.083 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.083 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.083 INFO:teuthology.orchestra.run.smithi049.stdout: "default_registry": { 2024-06-03T00:05:26.083 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "default_registry", 2024-06-03T00:05:26.084 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.084 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.084 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.084 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "docker.io", 2024-06-03T00:05:26.084 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.084 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.084 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.084 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-06-03T00:05:26.084 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.084 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.084 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.084 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.085 INFO:teuthology.orchestra.run.smithi049.stdout: "device_cache_timeout": { 2024-06-03T00:05:26.085 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "device_cache_timeout", 2024-06-03T00:05:26.085 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:26.085 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.085 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.085 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "1800", 2024-06-03T00:05:26.085 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.085 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.085 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.085 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "seconds to cache device inventory", 2024-06-03T00:05:26.085 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.086 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.086 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.086 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.086 INFO:teuthology.orchestra.run.smithi049.stdout: "device_enhanced_scan": { 2024-06-03T00:05:26.086 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "device_enhanced_scan", 2024-06-03T00:05:26.086 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.086 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.086 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.086 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.086 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.086 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.087 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.087 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Use libstoragemgmt during device scans", 2024-06-03T00:05:26.087 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.087 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.087 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.087 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.087 INFO:teuthology.orchestra.run.smithi049.stdout: "facts_cache_timeout": { 2024-06-03T00:05:26.087 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "facts_cache_timeout", 2024-06-03T00:05:26.087 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:26.087 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.087 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.087 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "60", 2024-06-03T00:05:26.088 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.088 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.088 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.088 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "seconds to cache host facts data", 2024-06-03T00:05:26.088 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.088 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.088 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.088 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.088 INFO:teuthology.orchestra.run.smithi049.stdout: "grafana_dashboards_path": { 2024-06-03T00:05:26.088 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "grafana_dashboards_path", 2024-06-03T00:05:26.088 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.088 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.089 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.089 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-06-03T00:05:26.089 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.089 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.089 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.089 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-06-03T00:05:26.089 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.089 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.089 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.089 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.089 INFO:teuthology.orchestra.run.smithi049.stdout: "host_check_interval": { 2024-06-03T00:05:26.089 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "host_check_interval", 2024-06-03T00:05:26.090 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:26.090 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.090 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.090 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "600", 2024-06-03T00:05:26.090 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.090 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.090 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.090 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how frequently to perform a host check", 2024-06-03T00:05:26.090 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.090 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.090 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.091 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.091 INFO:teuthology.orchestra.run.smithi049.stdout: "hw_monitoring": { 2024-06-03T00:05:26.091 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "hw_monitoring", 2024-06-03T00:05:26.091 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.091 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.091 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.091 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.091 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.091 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.091 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.091 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-06-03T00:05:26.091 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.092 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.092 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.092 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.092 INFO:teuthology.orchestra.run.smithi049.stdout: "inventory_list_all": { 2024-06-03T00:05:26.092 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "inventory_list_all", 2024-06-03T00:05:26.092 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.092 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.092 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.092 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.092 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.093 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.093 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.093 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-06-03T00:05:26.093 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.093 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.093 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.093 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.093 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.093 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.093 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.093 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.093 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.094 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.094 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.094 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.094 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.094 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.094 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.094 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.094 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.094 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.094 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.094 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.094 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.095 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.095 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.095 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.095 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.095 INFO:teuthology.orchestra.run.smithi049.stdout: "log_refresh_metadata": { 2024-06-03T00:05:26.095 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_refresh_metadata", 2024-06-03T00:05:26.095 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.095 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.095 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.095 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.095 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.095 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.096 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.096 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-06-03T00:05:26.096 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.096 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.096 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.096 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.096 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.096 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.096 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.096 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.096 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.096 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.096 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.097 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.097 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.097 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-06-03T00:05:26.097 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.097 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.097 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.097 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.097 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.097 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.097 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.097 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.097 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.098 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.098 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.098 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.098 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.098 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.098 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.098 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.098 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.098 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.098 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.098 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.099 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.099 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.099 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.099 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.099 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.099 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.099 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.099 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.099 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.099 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.099 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.099 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.100 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.100 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.100 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.100 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.100 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.100 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.100 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.100 INFO:teuthology.orchestra.run.smithi049.stdout: "manage_etc_ceph_ceph_conf": { 2024-06-03T00:05:26.100 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-06-03T00:05:26.100 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.100 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.100 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.101 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.101 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.101 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.101 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.101 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-06-03T00:05:26.101 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.101 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.101 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.101 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.101 INFO:teuthology.orchestra.run.smithi049.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-06-03T00:05:26.101 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-06-03T00:05:26.101 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.102 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.102 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.102 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "*", 2024-06-03T00:05:26.102 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.102 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.102 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.102 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-06-03T00:05:26.102 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.102 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.102 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.102 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.102 INFO:teuthology.orchestra.run.smithi049.stdout: "max_count_per_host": { 2024-06-03T00:05:26.103 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_count_per_host", 2024-06-03T00:05:26.103 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.103 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.103 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.103 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-06-03T00:05:26.103 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.103 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.103 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.103 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "max number of daemons per service per host", 2024-06-03T00:05:26.103 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.103 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.103 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.104 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.104 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd_draining_count": { 2024-06-03T00:05:26.104 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_osd_draining_count", 2024-06-03T00:05:26.104 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.104 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.104 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.104 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-06-03T00:05:26.104 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.104 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.104 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.104 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-06-03T00:05:26.104 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.105 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.105 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.105 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.105 INFO:teuthology.orchestra.run.smithi049.stdout: "migration_current": { 2024-06-03T00:05:26.105 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "migration_current", 2024-06-03T00:05:26.105 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.105 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.105 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.105 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.105 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.105 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.105 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.105 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "internal - do not modify", 2024-06-03T00:05:26.106 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.106 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.106 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.106 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.106 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": { 2024-06-03T00:05:26.106 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mode", 2024-06-03T00:05:26.106 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.106 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.106 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.106 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "root", 2024-06-03T00:05:26.106 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.106 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.107 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.107 INFO:teuthology.orchestra.run.smithi049.stdout: "cephadm-package", 2024-06-03T00:05:26.107 INFO:teuthology.orchestra.run.smithi049.stdout: "root" 2024-06-03T00:05:26.107 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.107 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "mode for remote execution of cephadm", 2024-06-03T00:05:26.107 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.107 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.107 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.107 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.107 INFO:teuthology.orchestra.run.smithi049.stdout: "oob_default_addr": { 2024-06-03T00:05:26.107 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "oob_default_addr", 2024-06-03T00:05:26.107 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.107 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.108 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.108 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "169.254.1.1", 2024-06-03T00:05:26.108 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.108 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.108 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.108 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Default address for RedFish API (oob management).", 2024-06-03T00:05:26.108 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.108 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.108 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.108 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.108 INFO:teuthology.orchestra.run.smithi049.stdout: "prometheus_alerts_path": { 2024-06-03T00:05:26.108 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "prometheus_alerts_path", 2024-06-03T00:05:26.109 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.109 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.109 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.109 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-06-03T00:05:26.109 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.109 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.109 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.109 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-06-03T00:05:26.109 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.109 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.109 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.109 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.110 INFO:teuthology.orchestra.run.smithi049.stdout: "registry_insecure": { 2024-06-03T00:05:26.110 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "registry_insecure", 2024-06-03T00:05:26.110 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.110 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.110 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.110 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.110 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.110 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.110 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.110 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-06-03T00:05:26.110 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.111 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.111 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.111 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.111 INFO:teuthology.orchestra.run.smithi049.stdout: "registry_password": { 2024-06-03T00:05:26.111 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "registry_password", 2024-06-03T00:05:26.111 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.111 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.111 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.111 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.111 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.111 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.111 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.112 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-06-03T00:05:26.112 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.112 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.112 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.112 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.112 INFO:teuthology.orchestra.run.smithi049.stdout: "registry_url": { 2024-06-03T00:05:26.112 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "registry_url", 2024-06-03T00:05:26.112 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.112 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.112 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.112 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.112 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.112 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.113 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.113 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-06-03T00:05:26.113 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.113 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.113 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.113 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.113 INFO:teuthology.orchestra.run.smithi049.stdout: "registry_username": { 2024-06-03T00:05:26.113 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "registry_username", 2024-06-03T00:05:26.113 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.113 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.113 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.113 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.114 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.114 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.114 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.114 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-06-03T00:05:26.114 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.114 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.114 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.114 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.114 INFO:teuthology.orchestra.run.smithi049.stdout: "secure_monitoring_stack": { 2024-06-03T00:05:26.114 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "secure_monitoring_stack", 2024-06-03T00:05:26.114 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.114 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.115 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.115 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.115 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.115 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.115 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.115 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-06-03T00:05:26.115 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.115 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.115 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.115 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.115 INFO:teuthology.orchestra.run.smithi049.stdout: "service_discovery_port": { 2024-06-03T00:05:26.115 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "service_discovery_port", 2024-06-03T00:05:26.116 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.116 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.116 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.116 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "8765", 2024-06-03T00:05:26.116 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.116 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.116 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.116 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "cephadm service discovery port", 2024-06-03T00:05:26.116 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.116 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.116 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.116 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.117 INFO:teuthology.orchestra.run.smithi049.stdout: "ssh_config_file": { 2024-06-03T00:05:26.117 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ssh_config_file", 2024-06-03T00:05:26.117 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.117 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.117 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.117 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.117 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.117 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.117 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.117 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-06-03T00:05:26.117 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.117 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.117 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.118 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.118 INFO:teuthology.orchestra.run.smithi049.stdout: "use_agent": { 2024-06-03T00:05:26.118 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "use_agent", 2024-06-03T00:05:26.118 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.118 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.118 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.118 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.118 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.118 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.118 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.118 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-06-03T00:05:26.119 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.119 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.119 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.119 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.119 INFO:teuthology.orchestra.run.smithi049.stdout: "use_repo_digest": { 2024-06-03T00:05:26.119 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "use_repo_digest", 2024-06-03T00:05:26.119 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.119 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.119 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.119 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.119 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.120 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.120 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.120 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-06-03T00:05:26.120 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.120 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.120 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.120 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.120 INFO:teuthology.orchestra.run.smithi049.stdout: "warn_on_failed_host_check": { 2024-06-03T00:05:26.120 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "warn_on_failed_host_check", 2024-06-03T00:05:26.120 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.120 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.121 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.121 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.121 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.121 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.121 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.121 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "raise a health warning if the host check fails", 2024-06-03T00:05:26.121 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.121 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.121 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.121 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.121 INFO:teuthology.orchestra.run.smithi049.stdout: "warn_on_stray_daemons": { 2024-06-03T00:05:26.122 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "warn_on_stray_daemons", 2024-06-03T00:05:26.122 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.122 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.122 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.122 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.122 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.122 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.122 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.122 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-06-03T00:05:26.122 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.122 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.123 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.123 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.123 INFO:teuthology.orchestra.run.smithi049.stdout: "warn_on_stray_hosts": { 2024-06-03T00:05:26.123 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "warn_on_stray_hosts", 2024-06-03T00:05:26.123 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.123 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.123 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.123 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.123 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.123 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.123 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.123 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-06-03T00:05:26.124 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.124 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.124 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.124 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.124 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.124 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.124 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.124 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "crash", 2024-06-03T00:05:26.124 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.124 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.124 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.125 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.125 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.125 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.125 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.125 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.125 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.125 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.125 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.125 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.125 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.125 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.126 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.126 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.126 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.126 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.126 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.126 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.126 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.126 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.126 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.126 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.126 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.126 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.127 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.127 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.127 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.127 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.127 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.127 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.127 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.127 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.127 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.127 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.127 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.128 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.128 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.128 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.128 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.128 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.128 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.128 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.128 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.128 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.128 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.128 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.128 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.129 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.129 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.129 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.129 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.129 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.129 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.129 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.129 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.129 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.129 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.129 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.129 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.130 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.130 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.130 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.130 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.130 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.130 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.130 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.130 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.130 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.130 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.130 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.130 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.131 INFO:teuthology.orchestra.run.smithi049.stdout: "retain_interval": { 2024-06-03T00:05:26.131 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "retain_interval", 2024-06-03T00:05:26.131 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:26.131 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.131 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.131 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "31536000", 2024-06-03T00:05:26.131 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.131 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.131 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.131 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how long to retain crashes before pruning them", 2024-06-03T00:05:26.131 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.131 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.132 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.132 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.132 INFO:teuthology.orchestra.run.smithi049.stdout: "warn_recent_interval": { 2024-06-03T00:05:26.132 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "warn_recent_interval", 2024-06-03T00:05:26.132 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:26.132 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.132 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.132 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "1209600", 2024-06-03T00:05:26.132 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.132 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.132 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.132 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "time interval in which to warn about recent crashes", 2024-06-03T00:05:26.133 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.133 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.133 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.133 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.133 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.133 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.133 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.133 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "dashboard", 2024-06-03T00:05:26.133 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.133 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.133 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.133 INFO:teuthology.orchestra.run.smithi049.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-06-03T00:05:26.133 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-06-03T00:05:26.134 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.134 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.134 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.134 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-06-03T00:05:26.134 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.134 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.134 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.134 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.134 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.134 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.134 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.134 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.135 INFO:teuthology.orchestra.run.smithi049.stdout: "ALERTMANAGER_API_HOST": { 2024-06-03T00:05:26.135 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ALERTMANAGER_API_HOST", 2024-06-03T00:05:26.135 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.135 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.135 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.135 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.135 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.135 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.135 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.135 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.136 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.136 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.136 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.136 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.136 INFO:teuthology.orchestra.run.smithi049.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-06-03T00:05:26.136 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-06-03T00:05:26.137 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.137 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.137 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.138 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.138 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.138 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.138 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.138 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.138 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.138 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.139 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.139 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.139 INFO:teuthology.orchestra.run.smithi049.stdout: "AUDIT_API_ENABLED": { 2024-06-03T00:05:26.139 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "AUDIT_API_ENABLED", 2024-06-03T00:05:26.139 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.139 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.139 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.139 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.139 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.139 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.139 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.139 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.140 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.140 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.140 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.140 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.140 INFO:teuthology.orchestra.run.smithi049.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-06-03T00:05:26.140 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-06-03T00:05:26.140 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.140 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.140 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.140 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.140 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.140 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.141 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.141 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.141 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.141 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.141 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.141 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.141 INFO:teuthology.orchestra.run.smithi049.stdout: "ENABLE_BROWSABLE_API": { 2024-06-03T00:05:26.141 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ENABLE_BROWSABLE_API", 2024-06-03T00:05:26.141 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.141 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.141 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.141 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.142 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.142 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.142 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.142 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.142 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.142 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.142 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.142 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.142 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-06-03T00:05:26.142 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-06-03T00:05:26.142 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.142 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.143 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.143 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.143 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.143 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.143 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.143 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.143 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.143 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.143 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.143 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.143 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-06-03T00:05:26.143 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-06-03T00:05:26.144 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.144 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.144 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.144 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.144 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.144 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.144 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.144 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.144 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.144 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.144 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.144 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.145 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-06-03T00:05:26.145 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-06-03T00:05:26.145 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.145 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.145 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.145 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.145 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.145 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.145 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.145 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.145 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.145 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.146 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.146 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.146 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-06-03T00:05:26.146 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-06-03T00:05:26.146 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.146 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.146 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.146 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.146 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.146 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.146 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.147 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.147 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.147 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.147 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.147 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.147 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_NFS": { 2024-06-03T00:05:26.147 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-06-03T00:05:26.147 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.147 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.147 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.147 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.147 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.148 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.148 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.148 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.148 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.148 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.148 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.148 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.148 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_RBD": { 2024-06-03T00:05:26.148 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-06-03T00:05:26.148 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.148 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.148 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.149 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.149 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.149 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.149 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.149 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.149 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.149 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.149 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.149 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.149 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_RGW": { 2024-06-03T00:05:26.149 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-06-03T00:05:26.150 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.150 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.150 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.150 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.150 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.150 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.150 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.150 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.150 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.150 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.150 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.151 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.151 INFO:teuthology.orchestra.run.smithi049.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-06-03T00:05:26.151 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-06-03T00:05:26.151 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.151 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.151 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.151 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.151 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.151 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.151 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.152 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.152 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.152 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.152 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.152 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.152 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_API_PASSWORD": { 2024-06-03T00:05:26.152 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_API_PASSWORD", 2024-06-03T00:05:26.152 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.152 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.152 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.152 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "admin", 2024-06-03T00:05:26.153 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.153 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.153 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.153 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.153 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.153 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.153 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.153 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.153 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-06-03T00:05:26.153 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-06-03T00:05:26.153 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.153 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.154 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.154 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.154 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.154 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.154 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.154 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.154 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.154 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.154 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.154 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.154 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_API_URL": { 2024-06-03T00:05:26.155 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_API_URL", 2024-06-03T00:05:26.155 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.155 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.155 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.155 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.155 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.155 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.155 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.155 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.155 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.155 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.155 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.156 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.156 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_API_USERNAME": { 2024-06-03T00:05:26.156 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_API_USERNAME", 2024-06-03T00:05:26.156 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.156 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.156 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.156 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "admin", 2024-06-03T00:05:26.156 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.156 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.156 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.156 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.156 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.157 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.157 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.157 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.157 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-06-03T00:05:26.157 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-06-03T00:05:26.157 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.157 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.157 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.157 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.157 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.157 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.157 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.158 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.158 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.158 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.158 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.158 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.158 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-06-03T00:05:26.158 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-06-03T00:05:26.158 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.158 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.158 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.158 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.159 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.159 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.159 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.159 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.159 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.159 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.159 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.159 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.159 INFO:teuthology.orchestra.run.smithi049.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-06-03T00:05:26.159 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-06-03T00:05:26.159 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.159 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.160 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.160 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.160 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.160 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.160 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.160 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.160 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.160 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.160 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.160 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.160 INFO:teuthology.orchestra.run.smithi049.stdout: "ISSUE_TRACKER_API_KEY": { 2024-06-03T00:05:26.160 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-06-03T00:05:26.161 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.161 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.161 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.161 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.161 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.161 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.161 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.161 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.161 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.161 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.161 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.162 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.162 INFO:teuthology.orchestra.run.smithi049.stdout: "PROMETHEUS_API_HOST": { 2024-06-03T00:05:26.162 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PROMETHEUS_API_HOST", 2024-06-03T00:05:26.162 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.162 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.162 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.162 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.162 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.162 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.162 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.162 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.162 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.163 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.163 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.163 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.163 INFO:teuthology.orchestra.run.smithi049.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-06-03T00:05:26.163 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-06-03T00:05:26.163 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.163 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.163 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.163 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.163 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.163 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.163 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.164 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.164 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.164 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.164 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.164 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.164 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-06-03T00:05:26.164 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-06-03T00:05:26.164 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.164 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.164 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.164 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.164 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.165 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.165 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.165 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.165 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.165 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.165 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.165 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.165 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-06-03T00:05:26.165 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-06-03T00:05:26.165 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.165 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.165 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.165 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.166 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.166 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.166 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.166 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.166 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.166 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.166 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.166 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.166 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-06-03T00:05:26.166 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-06-03T00:05:26.166 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.167 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.167 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.167 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.167 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.167 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.167 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.167 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.167 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.167 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.167 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.167 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.167 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-06-03T00:05:26.167 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-06-03T00:05:26.168 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.168 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.168 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.168 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.168 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.168 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.168 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.168 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.168 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.168 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.168 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.168 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.169 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-06-03T00:05:26.169 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-06-03T00:05:26.169 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.169 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.169 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.169 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.169 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.169 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.169 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.169 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.169 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.169 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.169 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.170 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.170 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-06-03T00:05:26.170 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-06-03T00:05:26.170 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.170 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.170 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.170 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.170 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.170 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.170 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.170 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.171 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.171 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.171 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.171 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.171 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-06-03T00:05:26.171 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-06-03T00:05:26.171 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.171 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.171 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.171 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.171 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.171 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.171 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.172 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.172 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.172 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.172 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.172 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.172 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_ENABLED": { 2024-06-03T00:05:26.172 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_ENABLED", 2024-06-03T00:05:26.172 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.172 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.172 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.172 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.172 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.173 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.173 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.173 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.173 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.173 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.173 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.173 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.173 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-06-03T00:05:26.173 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-06-03T00:05:26.173 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.173 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.173 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.173 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-06-03T00:05:26.174 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.174 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.174 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.174 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.174 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.174 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.174 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.174 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.174 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-06-03T00:05:26.174 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-06-03T00:05:26.174 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.175 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.175 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.175 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-06-03T00:05:26.175 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.175 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.175 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.175 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.175 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.175 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.175 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.175 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.175 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-06-03T00:05:26.176 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-06-03T00:05:26.176 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.176 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.176 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.176 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "8", 2024-06-03T00:05:26.176 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.176 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.176 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.176 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.176 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.176 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.176 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.177 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.177 INFO:teuthology.orchestra.run.smithi049.stdout: "REST_REQUESTS_TIMEOUT": { 2024-06-03T00:05:26.177 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-06-03T00:05:26.177 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.177 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.177 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.177 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "45", 2024-06-03T00:05:26.177 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.177 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.177 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.177 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.177 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.178 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.178 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.178 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.178 INFO:teuthology.orchestra.run.smithi049.stdout: "RGW_API_ACCESS_KEY": { 2024-06-03T00:05:26.178 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "RGW_API_ACCESS_KEY", 2024-06-03T00:05:26.178 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.178 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.178 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.178 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.178 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.178 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.178 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.179 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.179 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.179 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.179 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.179 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.179 INFO:teuthology.orchestra.run.smithi049.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-06-03T00:05:26.179 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-06-03T00:05:26.179 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.179 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.179 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.179 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "admin", 2024-06-03T00:05:26.180 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.180 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.180 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.180 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.180 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.180 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.180 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.180 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.180 INFO:teuthology.orchestra.run.smithi049.stdout: "RGW_API_SECRET_KEY": { 2024-06-03T00:05:26.180 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "RGW_API_SECRET_KEY", 2024-06-03T00:05:26.180 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.180 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.181 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.181 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.181 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.181 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.181 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.181 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.181 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.181 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.181 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.181 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.181 INFO:teuthology.orchestra.run.smithi049.stdout: "RGW_API_SSL_VERIFY": { 2024-06-03T00:05:26.181 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "RGW_API_SSL_VERIFY", 2024-06-03T00:05:26.182 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.182 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.182 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.182 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.182 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.182 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.182 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.182 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.182 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.182 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.182 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.183 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.183 INFO:teuthology.orchestra.run.smithi049.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-06-03T00:05:26.183 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-06-03T00:05:26.183 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.183 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.183 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.183 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-06-03T00:05:26.183 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.183 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.183 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.183 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.184 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.184 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.184 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.184 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.184 INFO:teuthology.orchestra.run.smithi049.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-06-03T00:05:26.184 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-06-03T00:05:26.184 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.184 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.184 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.184 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-06-03T00:05:26.184 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.184 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.185 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.185 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.185 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.185 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.185 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.185 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.185 INFO:teuthology.orchestra.run.smithi049.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-06-03T00:05:26.185 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-06-03T00:05:26.185 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.185 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.185 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.185 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5", 2024-06-03T00:05:26.185 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.186 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.186 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.186 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.186 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.186 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.186 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.186 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.186 INFO:teuthology.orchestra.run.smithi049.stdout: "cross_origin_url": { 2024-06-03T00:05:26.186 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cross_origin_url", 2024-06-03T00:05:26.186 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.186 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.187 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.187 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.187 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.187 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.187 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.187 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.187 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.187 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.187 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.187 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.187 INFO:teuthology.orchestra.run.smithi049.stdout: "crt_file": { 2024-06-03T00:05:26.187 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "crt_file", 2024-06-03T00:05:26.187 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.188 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.188 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.188 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.188 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.188 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.188 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.188 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.188 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.188 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.188 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.188 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.188 INFO:teuthology.orchestra.run.smithi049.stdout: "debug": { 2024-06-03T00:05:26.188 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "debug", 2024-06-03T00:05:26.189 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.189 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.189 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.189 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.189 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.189 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.189 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.189 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Enable/disable debug options", 2024-06-03T00:05:26.189 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.189 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.189 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.189 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.190 INFO:teuthology.orchestra.run.smithi049.stdout: "jwt_token_ttl": { 2024-06-03T00:05:26.190 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "jwt_token_ttl", 2024-06-03T00:05:26.190 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.190 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.190 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.190 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "28800", 2024-06-03T00:05:26.190 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.190 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.190 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.190 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.190 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.190 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.191 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.191 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.191 INFO:teuthology.orchestra.run.smithi049.stdout: "key_file": { 2024-06-03T00:05:26.191 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "key_file", 2024-06-03T00:05:26.191 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.191 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.191 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.191 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.191 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.191 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.191 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.191 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.192 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.192 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.192 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.192 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.192 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.192 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.192 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.192 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.192 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.192 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.192 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.193 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.193 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.193 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.193 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.193 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.193 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.193 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.193 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.193 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.194 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.194 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.194 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.194 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.194 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.194 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.194 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.194 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.194 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.194 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.194 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.194 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.195 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.195 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.195 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.195 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.195 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.195 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.195 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.195 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.195 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.195 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.195 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.196 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.196 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.196 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.196 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.196 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.196 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.196 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.196 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.196 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.196 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.196 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.196 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.197 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.197 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.197 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.197 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.197 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.197 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.197 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.197 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.197 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.197 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.197 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.197 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.198 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.198 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.198 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.198 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.198 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.198 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.198 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.198 INFO:teuthology.orchestra.run.smithi049.stdout: "motd": { 2024-06-03T00:05:26.198 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "motd", 2024-06-03T00:05:26.198 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.198 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.198 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.199 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.199 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.199 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.199 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.199 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "The message of the day", 2024-06-03T00:05:26.199 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.199 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.199 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.199 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.199 INFO:teuthology.orchestra.run.smithi049.stdout: "redirect_resolve_ip_addr": { 2024-06-03T00:05:26.199 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "redirect_resolve_ip_addr", 2024-06-03T00:05:26.199 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.200 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.200 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.200 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.200 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.200 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.200 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.200 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.200 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.200 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.200 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.200 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.201 INFO:teuthology.orchestra.run.smithi049.stdout: "server_addr": { 2024-06-03T00:05:26.201 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_addr", 2024-06-03T00:05:26.201 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.201 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.201 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.201 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "::", 2024-06-03T00:05:26.201 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.201 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.201 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.201 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.201 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.201 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.201 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.202 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.202 INFO:teuthology.orchestra.run.smithi049.stdout: "server_port": { 2024-06-03T00:05:26.202 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_port", 2024-06-03T00:05:26.202 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.202 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.202 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.202 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "8080", 2024-06-03T00:05:26.202 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.202 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.202 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.202 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.202 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.203 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.203 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.203 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.203 INFO:teuthology.orchestra.run.smithi049.stdout: "ssl": { 2024-06-03T00:05:26.203 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ssl", 2024-06-03T00:05:26.203 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.203 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.203 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.203 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.203 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.203 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.203 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.204 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.204 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.204 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.204 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.204 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.204 INFO:teuthology.orchestra.run.smithi049.stdout: "ssl_server_port": { 2024-06-03T00:05:26.204 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ssl_server_port", 2024-06-03T00:05:26.204 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.204 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.204 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.204 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "8443", 2024-06-03T00:05:26.204 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.205 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.205 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.205 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.205 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.205 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.205 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.205 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.205 INFO:teuthology.orchestra.run.smithi049.stdout: "standby_behaviour": { 2024-06-03T00:05:26.205 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "standby_behaviour", 2024-06-03T00:05:26.205 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.205 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.205 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.205 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "redirect", 2024-06-03T00:05:26.206 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.206 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.206 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.206 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.206 INFO:teuthology.orchestra.run.smithi049.stdout: "redirect" 2024-06-03T00:05:26.206 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.206 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.206 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.206 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.206 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.206 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.206 INFO:teuthology.orchestra.run.smithi049.stdout: "standby_error_status_code": { 2024-06-03T00:05:26.207 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "standby_error_status_code", 2024-06-03T00:05:26.207 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.207 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.207 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.207 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "500", 2024-06-03T00:05:26.207 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "400", 2024-06-03T00:05:26.207 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "599", 2024-06-03T00:05:26.207 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.207 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.207 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.207 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.207 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.208 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.208 INFO:teuthology.orchestra.run.smithi049.stdout: "url_prefix": { 2024-06-03T00:05:26.208 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "url_prefix", 2024-06-03T00:05:26.208 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.208 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.208 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.208 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.208 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.208 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.208 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.208 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.208 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.209 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.209 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.209 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.209 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.209 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.209 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.209 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "devicehealth", 2024-06-03T00:05:26.209 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.209 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.209 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.209 INFO:teuthology.orchestra.run.smithi049.stdout: "enable_monitoring": { 2024-06-03T00:05:26.209 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "enable_monitoring", 2024-06-03T00:05:26.209 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.210 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.210 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.210 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.210 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.210 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.210 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.210 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "monitor device health metrics", 2024-06-03T00:05:26.210 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.210 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.210 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.210 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.210 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.211 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.211 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.211 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.211 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.211 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.211 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.211 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.211 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.211 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.211 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.211 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.211 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.212 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.212 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.212 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.212 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.212 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.212 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.212 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.212 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.212 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.212 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.212 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.212 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.213 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.213 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.213 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.213 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.213 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.213 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.213 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.213 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.213 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.214 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.214 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.214 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.214 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.214 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.214 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.214 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.214 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.215 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.215 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.215 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.215 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.215 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.215 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.215 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.215 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.215 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.215 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.215 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.215 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.216 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.216 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.216 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.216 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.216 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.216 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.216 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.216 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.216 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.216 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.216 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.216 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.217 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.217 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.217 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.217 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.217 INFO:teuthology.orchestra.run.smithi049.stdout: "mark_out_threshold": { 2024-06-03T00:05:26.217 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mark_out_threshold", 2024-06-03T00:05:26.217 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:26.217 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.217 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.217 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "2419200", 2024-06-03T00:05:26.217 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.217 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.218 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.218 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-06-03T00:05:26.218 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.218 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.218 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.218 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.218 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": { 2024-06-03T00:05:26.218 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "pool_name", 2024-06-03T00:05:26.218 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.218 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.218 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.218 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "device_health_metrics", 2024-06-03T00:05:26.219 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.219 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.219 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.219 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "name of pool in which to store device health metrics", 2024-06-03T00:05:26.219 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.219 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.219 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.219 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.219 INFO:teuthology.orchestra.run.smithi049.stdout: "retention_period": { 2024-06-03T00:05:26.219 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "retention_period", 2024-06-03T00:05:26.219 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:26.219 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.220 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.220 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "15552000", 2024-06-03T00:05:26.220 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.220 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.220 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.220 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how long to retain device health metrics", 2024-06-03T00:05:26.220 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.220 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.220 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.220 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.220 INFO:teuthology.orchestra.run.smithi049.stdout: "scrape_frequency": { 2024-06-03T00:05:26.220 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "scrape_frequency", 2024-06-03T00:05:26.221 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:26.221 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.221 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.221 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "86400", 2024-06-03T00:05:26.221 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.221 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.221 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.221 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how frequently to scrape device health metrics", 2024-06-03T00:05:26.221 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.221 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.221 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.221 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.222 INFO:teuthology.orchestra.run.smithi049.stdout: "self_heal": { 2024-06-03T00:05:26.222 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "self_heal", 2024-06-03T00:05:26.222 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.222 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.222 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.222 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.222 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.222 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.222 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.222 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-06-03T00:05:26.222 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.223 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.223 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.223 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.223 INFO:teuthology.orchestra.run.smithi049.stdout: "sleep_interval": { 2024-06-03T00:05:26.223 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sleep_interval", 2024-06-03T00:05:26.223 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:26.223 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.223 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.223 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "600", 2024-06-03T00:05:26.223 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.223 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.223 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.224 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how frequently to wake up and check device health", 2024-06-03T00:05:26.224 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.224 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.224 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.224 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.224 INFO:teuthology.orchestra.run.smithi049.stdout: "warn_threshold": { 2024-06-03T00:05:26.224 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "warn_threshold", 2024-06-03T00:05:26.224 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:26.224 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.224 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.224 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "7257600", 2024-06-03T00:05:26.225 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.225 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.225 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.225 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-06-03T00:05:26.225 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.225 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.225 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.225 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.225 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.225 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.225 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.225 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "diskprediction_local", 2024-06-03T00:05:26.226 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.226 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.226 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.226 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.226 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.226 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.226 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.226 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.226 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.226 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.226 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.226 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.226 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.227 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.227 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.227 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.227 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.227 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.227 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.227 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.227 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.227 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.227 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.227 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.228 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.228 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.228 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.228 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.228 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.228 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.228 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.228 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.228 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.228 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.228 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.229 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.229 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.229 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.229 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.229 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.229 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.229 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.229 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.229 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.229 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.229 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.229 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.229 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.230 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.230 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.230 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.230 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.230 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.230 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.230 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.230 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.230 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.230 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.230 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.231 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.231 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.231 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.231 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.231 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.231 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.231 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.231 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.231 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.231 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.232 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.232 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.232 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.232 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.232 INFO:teuthology.orchestra.run.smithi049.stdout: "predict_interval": { 2024-06-03T00:05:26.232 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "predict_interval", 2024-06-03T00:05:26.232 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.232 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.232 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.233 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "86400", 2024-06-03T00:05:26.233 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.233 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.233 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.233 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.233 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.233 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.233 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.233 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.233 INFO:teuthology.orchestra.run.smithi049.stdout: "predictor_model": { 2024-06-03T00:05:26.233 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "predictor_model", 2024-06-03T00:05:26.234 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.234 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.234 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.234 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "prophetstor", 2024-06-03T00:05:26.234 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.234 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.234 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.234 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.234 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.234 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.234 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.234 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.235 INFO:teuthology.orchestra.run.smithi049.stdout: "sleep_interval": { 2024-06-03T00:05:26.235 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sleep_interval", 2024-06-03T00:05:26.235 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.235 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.235 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.235 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "600", 2024-06-03T00:05:26.235 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.235 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.235 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.235 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.235 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.236 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.236 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.236 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.236 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.236 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.236 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.236 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "influx", 2024-06-03T00:05:26.236 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": false, 2024-06-03T00:05:26.236 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "influxdb python module not found", 2024-06-03T00:05:26.236 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.236 INFO:teuthology.orchestra.run.smithi049.stdout: "batch_size": { 2024-06-03T00:05:26.236 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "batch_size", 2024-06-03T00:05:26.237 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.237 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.237 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.237 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5000", 2024-06-03T00:05:26.237 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.237 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.237 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.237 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-06-03T00:05:26.237 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.237 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.237 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.237 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.238 INFO:teuthology.orchestra.run.smithi049.stdout: "database": { 2024-06-03T00:05:26.238 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "database", 2024-06-03T00:05:26.238 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.238 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.238 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.238 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "ceph", 2024-06-03T00:05:26.238 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.238 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.238 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.238 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-06-03T00:05:26.238 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.239 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.239 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.239 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.239 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": { 2024-06-03T00:05:26.239 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "hostname", 2024-06-03T00:05:26.239 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.239 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.239 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.239 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.239 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.239 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.239 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.239 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "InfluxDB server hostname", 2024-06-03T00:05:26.240 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.240 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.240 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.240 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.240 INFO:teuthology.orchestra.run.smithi049.stdout: "interval": { 2024-06-03T00:05:26.240 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "interval", 2024-06-03T00:05:26.240 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:26.240 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.240 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.240 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "30", 2024-06-03T00:05:26.240 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "5", 2024-06-03T00:05:26.240 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.241 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.241 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-06-03T00:05:26.241 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.241 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.241 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.241 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.241 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.241 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.241 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.241 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.241 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.241 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.241 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.242 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.242 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.242 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.242 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.242 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.242 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.242 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.242 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.242 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.242 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.242 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.243 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.243 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.243 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.243 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.243 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.243 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.243 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.243 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.243 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.243 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.243 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.243 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.243 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.244 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.244 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.244 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.244 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.244 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.244 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.244 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.244 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.244 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.244 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.244 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.244 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.245 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.245 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.245 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.245 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.245 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.245 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.245 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.245 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.245 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.245 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.245 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.245 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.245 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.246 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.246 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.246 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.246 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.246 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.246 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.246 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.246 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.246 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.246 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.246 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.246 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.247 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.247 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.247 INFO:teuthology.orchestra.run.smithi049.stdout: "password": { 2024-06-03T00:05:26.247 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "password", 2024-06-03T00:05:26.247 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.247 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.247 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.247 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.247 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.247 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.247 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.247 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "password of InfluxDB server user", 2024-06-03T00:05:26.248 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.248 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.248 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.248 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.248 INFO:teuthology.orchestra.run.smithi049.stdout: "port": { 2024-06-03T00:05:26.248 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "port", 2024-06-03T00:05:26.248 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.248 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.248 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.248 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "8086", 2024-06-03T00:05:26.248 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.248 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.249 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.249 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "InfluxDB server port", 2024-06-03T00:05:26.249 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.249 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.249 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.249 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.249 INFO:teuthology.orchestra.run.smithi049.stdout: "ssl": { 2024-06-03T00:05:26.249 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ssl", 2024-06-03T00:05:26.249 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.249 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.249 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.249 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "false", 2024-06-03T00:05:26.249 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.250 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.250 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.250 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-06-03T00:05:26.250 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.250 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.250 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.250 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.250 INFO:teuthology.orchestra.run.smithi049.stdout: "threads": { 2024-06-03T00:05:26.250 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "threads", 2024-06-03T00:05:26.250 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.250 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.250 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.251 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5", 2024-06-03T00:05:26.251 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "1", 2024-06-03T00:05:26.251 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "32", 2024-06-03T00:05:26.251 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.251 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-06-03T00:05:26.251 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.251 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.251 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.251 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.251 INFO:teuthology.orchestra.run.smithi049.stdout: "username": { 2024-06-03T00:05:26.253 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "username", 2024-06-03T00:05:26.254 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.254 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.254 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.254 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.254 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.254 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.254 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.254 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "username of InfluxDB server user", 2024-06-03T00:05:26.254 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.254 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.254 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.254 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.254 INFO:teuthology.orchestra.run.smithi049.stdout: "verify_ssl": { 2024-06-03T00:05:26.255 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "verify_ssl", 2024-06-03T00:05:26.255 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.255 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.255 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.255 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "true", 2024-06-03T00:05:26.255 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.255 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.255 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.255 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-06-03T00:05:26.255 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.255 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.255 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.255 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.255 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.255 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.256 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.256 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "insights", 2024-06-03T00:05:26.256 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.256 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.256 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.256 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.256 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.256 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.256 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.256 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.256 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.256 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.256 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.256 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.256 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.257 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.257 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.257 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.257 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.257 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.257 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.257 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.257 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.257 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.257 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.257 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.257 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.257 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.257 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.258 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.258 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.258 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.258 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.258 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.258 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.258 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.258 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.258 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.258 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.258 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.258 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.258 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.258 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.259 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.259 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.259 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.259 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.259 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.259 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.259 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.259 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.259 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.259 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.259 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.259 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.259 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.259 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.260 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.260 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.260 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.260 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.260 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.260 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.260 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.260 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.260 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.260 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.260 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.260 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.260 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.260 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.261 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.261 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.261 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.261 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.261 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.261 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.261 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.261 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "iostat", 2024-06-03T00:05:26.261 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.261 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.261 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.261 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.261 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.261 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.261 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.262 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.262 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.262 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.262 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.262 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.262 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.262 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.262 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.262 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.262 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.262 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.262 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.262 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.262 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.263 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.263 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.263 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.263 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.263 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.263 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.263 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.263 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.263 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.263 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.263 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.263 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.263 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.263 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.263 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.264 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.264 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.264 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.264 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.264 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.264 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.264 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.264 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.264 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.264 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.264 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.264 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.264 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.264 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.264 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.265 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.265 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.265 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.265 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.265 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.265 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.265 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.265 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.265 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.265 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.265 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.265 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.265 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.265 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.265 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.266 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.266 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.266 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.266 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.266 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.266 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.266 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.266 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.266 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.266 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.266 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "k8sevents", 2024-06-03T00:05:26.266 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.266 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.267 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.267 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_event_retention_days": { 2024-06-03T00:05:26.267 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ceph_event_retention_days", 2024-06-03T00:05:26.267 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.267 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.267 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.267 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "7", 2024-06-03T00:05:26.267 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.267 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.267 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.267 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Days to hold ceph event information within local cache", 2024-06-03T00:05:26.267 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.267 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.267 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.268 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.268 INFO:teuthology.orchestra.run.smithi049.stdout: "config_check_secs": { 2024-06-03T00:05:26.268 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "config_check_secs", 2024-06-03T00:05:26.268 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.268 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.268 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.268 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-06-03T00:05:26.268 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "10", 2024-06-03T00:05:26.268 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.268 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.268 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-06-03T00:05:26.268 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.268 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.268 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.268 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.269 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.269 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.269 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.269 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.269 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.269 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.269 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.269 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.269 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.269 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.269 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.269 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.269 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.269 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.269 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.270 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.270 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.270 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.270 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.270 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.270 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.270 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.270 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.270 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.270 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.270 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.270 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.270 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.271 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.271 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.271 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.271 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.271 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.271 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.271 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.271 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.271 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.271 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.271 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.271 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.271 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.271 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.272 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.272 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.272 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.272 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.272 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.272 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.272 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.272 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.272 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.272 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.272 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.272 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.272 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.272 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.273 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.273 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.273 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.273 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.273 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.273 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.273 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.273 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.273 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.273 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.273 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.273 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.273 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.273 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.274 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.274 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.274 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.274 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "localpool", 2024-06-03T00:05:26.274 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.274 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.274 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.274 INFO:teuthology.orchestra.run.smithi049.stdout: "failure_domain": { 2024-06-03T00:05:26.274 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "failure_domain", 2024-06-03T00:05:26.274 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.274 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.274 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.274 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "host", 2024-06-03T00:05:26.274 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.275 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.275 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.275 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "failure domain for any created local pool", 2024-06-03T00:05:26.275 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-06-03T00:05:26.275 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.275 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.275 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.275 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.275 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.275 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.275 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.275 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.275 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.275 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.276 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.276 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.276 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.276 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.276 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.276 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.276 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.276 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.276 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.276 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.276 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.276 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.276 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.276 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.277 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.277 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.277 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.277 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.277 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.277 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.277 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.277 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.277 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.277 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.277 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.277 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.277 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.277 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.277 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.278 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.278 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.278 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.278 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.278 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.278 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.278 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.278 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.278 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.278 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.278 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.279 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.279 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.279 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.279 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.279 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.279 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.279 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.279 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.279 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.279 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.279 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.279 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.279 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.279 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.280 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.280 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.280 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.280 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.280 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.280 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.280 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.280 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.280 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.280 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": { 2024-06-03T00:05:26.280 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "min_size", 2024-06-03T00:05:26.280 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.280 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.281 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.281 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.281 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.281 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.281 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.281 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "default min_size for any created local pool", 2024-06-03T00:05:26.281 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-06-03T00:05:26.281 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.281 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.281 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.281 INFO:teuthology.orchestra.run.smithi049.stdout: "num_rep": { 2024-06-03T00:05:26.281 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "num_rep", 2024-06-03T00:05:26.281 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.282 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.282 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.282 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "3", 2024-06-03T00:05:26.282 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.282 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.282 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.282 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "default replica count for any created local pool", 2024-06-03T00:05:26.282 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.282 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.282 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.282 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.282 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": { 2024-06-03T00:05:26.282 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "pg_num", 2024-06-03T00:05:26.282 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.283 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.283 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.283 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "128", 2024-06-03T00:05:26.283 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.283 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.283 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.283 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "default pg_num for any created local pool", 2024-06-03T00:05:26.283 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.283 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.283 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.283 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.283 INFO:teuthology.orchestra.run.smithi049.stdout: "prefix": { 2024-06-03T00:05:26.283 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "prefix", 2024-06-03T00:05:26.283 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.283 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.284 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.284 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.284 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.284 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.284 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.284 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "name prefix for any created local pool", 2024-06-03T00:05:26.284 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.284 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.284 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.284 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.284 INFO:teuthology.orchestra.run.smithi049.stdout: "subtree": { 2024-06-03T00:05:26.284 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "subtree", 2024-06-03T00:05:26.284 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.284 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.284 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.285 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "rack", 2024-06-03T00:05:26.285 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.285 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.285 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.285 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "CRUSH level for which to create a local pool", 2024-06-03T00:05:26.285 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-06-03T00:05:26.285 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.285 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.285 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.285 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.285 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.285 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.285 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mds_autoscaler", 2024-06-03T00:05:26.285 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.286 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.286 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.286 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.286 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.286 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.286 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.286 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.286 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.286 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.286 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.286 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.286 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.286 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.286 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.287 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.287 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.287 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.287 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.287 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.287 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.287 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.287 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.287 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.287 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.287 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.287 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.287 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.288 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.288 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.288 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.288 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.288 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.288 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.288 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.288 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.288 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.288 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.288 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.288 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.288 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.288 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.289 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.289 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.289 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.289 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.289 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.289 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.289 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.289 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.289 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.289 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.289 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.289 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.289 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.289 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.290 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.290 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.290 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.290 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.290 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.290 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.290 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.290 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.290 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.290 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.290 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.290 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.290 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.291 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.291 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.291 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.291 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.291 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.291 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.291 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.291 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mirroring", 2024-06-03T00:05:26.291 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.291 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.291 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.291 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.291 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.291 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.292 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.292 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.292 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.292 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.292 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.292 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.292 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.292 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.292 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.292 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.292 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.292 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.292 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.292 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.293 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.293 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.293 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.293 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.293 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.293 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.293 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.293 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.293 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.293 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.293 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.293 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.293 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.293 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.294 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.294 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.294 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.294 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.294 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.294 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.294 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.294 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.294 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.294 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.294 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.294 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.294 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.295 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.295 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.295 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.295 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.295 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.295 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.295 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.295 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.295 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.295 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.295 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.295 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.295 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.295 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.296 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.296 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.296 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.296 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.296 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.296 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.296 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.296 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.296 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.296 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.296 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.296 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.296 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.296 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.296 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.297 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "nfs", 2024-06-03T00:05:26.297 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.297 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.297 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.297 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.297 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.297 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.297 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.297 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.297 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.297 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.297 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.297 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.297 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.298 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.298 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.298 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.298 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.298 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.298 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.298 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.298 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.298 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.298 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.298 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.298 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.298 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.298 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.299 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.299 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.299 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.299 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.299 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.299 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.299 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.299 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.299 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.299 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.299 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.299 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.299 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.299 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.300 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.300 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.300 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.300 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.300 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.300 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.300 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.300 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.300 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.300 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.300 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.300 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.300 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.300 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.300 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.301 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.301 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.301 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.301 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.301 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.301 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.301 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.301 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.301 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.301 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.301 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.301 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.301 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.302 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.302 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.302 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.302 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.302 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.302 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.302 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.302 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "orchestrator", 2024-06-03T00:05:26.302 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.302 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.302 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.302 INFO:teuthology.orchestra.run.smithi049.stdout: "fail_fs": { 2024-06-03T00:05:26.302 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "fail_fs", 2024-06-03T00:05:26.303 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.303 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.303 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.303 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.303 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.303 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.303 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.303 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-06-03T00:05:26.303 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.303 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.303 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.303 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.303 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.303 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.303 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.304 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.304 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.304 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.304 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.304 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.304 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.304 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.304 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.304 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.304 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.304 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.304 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.304 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.305 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.305 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.305 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.305 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.305 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.305 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.305 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.305 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.305 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.305 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.305 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.305 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.305 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.305 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.306 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.306 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.306 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.306 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.306 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.306 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.306 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.306 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.306 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.306 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.306 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.306 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.306 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.306 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.307 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.307 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.307 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.307 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.307 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.307 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.307 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.307 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.307 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.307 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.307 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.307 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.307 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.307 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.308 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.308 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.308 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.308 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.308 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.308 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.308 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.308 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.308 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.308 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.308 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.308 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.308 INFO:teuthology.orchestra.run.smithi049.stdout: "orchestrator": { 2024-06-03T00:05:26.308 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "orchestrator", 2024-06-03T00:05:26.309 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.309 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.309 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.309 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.309 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.309 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.309 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.309 INFO:teuthology.orchestra.run.smithi049.stdout: "cephadm", 2024-06-03T00:05:26.309 INFO:teuthology.orchestra.run.smithi049.stdout: "rook", 2024-06-03T00:05:26.309 INFO:teuthology.orchestra.run.smithi049.stdout: "test_orchestrator" 2024-06-03T00:05:26.309 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.309 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Orchestrator backend", 2024-06-03T00:05:26.309 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.309 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.310 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.310 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.310 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.310 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.310 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.310 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "osd_perf_query", 2024-06-03T00:05:26.310 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.310 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.310 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.310 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.310 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.310 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.310 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.310 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.311 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.311 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.311 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.311 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.311 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.311 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.311 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.311 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.311 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.311 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.311 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.311 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.311 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.311 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.312 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.312 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.312 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.312 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.312 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.312 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.312 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.312 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.312 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.312 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.312 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.312 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.312 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.312 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.313 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.313 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.313 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.313 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.313 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.313 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.313 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.313 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.313 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.313 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.313 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.313 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.313 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.313 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.314 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.314 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.314 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.314 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.314 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.314 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.314 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.314 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.314 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.314 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.314 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.314 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.314 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.314 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.315 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.315 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.315 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.315 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.315 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.315 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.315 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.315 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.315 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.315 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.315 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.315 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.315 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "osd_support", 2024-06-03T00:05:26.315 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.316 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.316 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.316 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.316 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.316 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.316 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.316 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.316 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.316 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.316 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.316 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.316 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.316 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.316 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.317 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.317 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.317 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.317 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.317 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.317 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.317 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.317 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.317 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.317 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.317 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.317 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.317 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.317 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.317 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.318 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.318 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.318 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.318 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.318 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.318 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.318 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.318 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.318 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.318 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.318 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.318 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.318 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.318 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.319 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.319 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.319 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.319 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.319 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.319 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.319 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.319 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.319 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.319 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.319 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.319 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.319 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.319 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.320 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.320 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.320 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.320 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.320 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.320 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.320 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.320 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.320 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.320 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.320 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.320 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.320 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.320 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.321 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.321 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.321 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.321 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.321 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "pg_autoscaler", 2024-06-03T00:05:26.321 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.321 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.321 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.321 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.321 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.321 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.321 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.321 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.321 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.322 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.322 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.322 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.322 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.322 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.322 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.322 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.322 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.322 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.322 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.322 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.322 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.322 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.323 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.323 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.323 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.323 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.323 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.323 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.323 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.323 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.323 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.323 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.323 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.323 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.323 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.323 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.324 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.324 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.324 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.324 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.324 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.324 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.324 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.324 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.324 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.324 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.324 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.324 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.324 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.324 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.325 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.325 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.325 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.325 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.325 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.325 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.325 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.325 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.325 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.325 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.325 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.325 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.325 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.325 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.326 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.326 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.326 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.326 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.326 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.326 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.326 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.326 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.326 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.326 INFO:teuthology.orchestra.run.smithi049.stdout: "sleep_interval": { 2024-06-03T00:05:26.326 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sleep_interval", 2024-06-03T00:05:26.326 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:26.326 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.327 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.327 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "60", 2024-06-03T00:05:26.327 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.327 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.327 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.327 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.327 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.327 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.327 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.327 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.327 INFO:teuthology.orchestra.run.smithi049.stdout: "threshold": { 2024-06-03T00:05:26.327 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "threshold", 2024-06-03T00:05:26.327 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-06-03T00:05:26.328 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.328 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.328 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "3.0", 2024-06-03T00:05:26.328 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "1.0", 2024-06-03T00:05:26.328 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.328 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.328 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "scaling threshold", 2024-06-03T00:05:26.328 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-06-03T00:05:26.328 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.328 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.328 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.328 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.328 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.328 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.329 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "progress", 2024-06-03T00:05:26.329 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.329 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.329 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.329 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_pg_recovery_event": { 2024-06-03T00:05:26.329 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "allow_pg_recovery_event", 2024-06-03T00:05:26.329 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.329 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.329 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.329 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.329 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.329 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.329 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.329 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "allow the module to show pg recovery progress", 2024-06-03T00:05:26.330 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.330 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.330 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.330 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.330 INFO:teuthology.orchestra.run.smithi049.stdout: "enabled": { 2024-06-03T00:05:26.330 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "enabled", 2024-06-03T00:05:26.330 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.330 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.330 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.330 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.330 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.330 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.330 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.330 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.331 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.331 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.331 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.331 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.331 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.331 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.331 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.331 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.331 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.331 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.331 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.331 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.331 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.331 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.332 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.332 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.332 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.332 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.332 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.332 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.332 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.332 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.332 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.332 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.332 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.332 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.332 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.332 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.332 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.333 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.333 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.333 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.333 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.333 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.333 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.333 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.333 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.333 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.333 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.333 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.333 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.333 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.334 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.334 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.334 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.334 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.334 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.334 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.334 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.334 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.334 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.334 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.334 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.334 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.334 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.334 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.335 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.335 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.335 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.335 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.335 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.335 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.335 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.335 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.335 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.335 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.335 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.335 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.335 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.335 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.336 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.336 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.336 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.336 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.336 INFO:teuthology.orchestra.run.smithi049.stdout: "max_completed_events": { 2024-06-03T00:05:26.336 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_completed_events", 2024-06-03T00:05:26.336 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.336 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.336 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.336 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "50", 2024-06-03T00:05:26.336 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.336 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.336 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.336 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "number of past completed events to remember", 2024-06-03T00:05:26.337 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.337 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.337 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.337 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.337 INFO:teuthology.orchestra.run.smithi049.stdout: "sleep_interval": { 2024-06-03T00:05:26.337 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sleep_interval", 2024-06-03T00:05:26.337 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:26.337 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.337 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.337 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5", 2024-06-03T00:05:26.337 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.337 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.337 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.337 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how long the module is going to sleep", 2024-06-03T00:05:26.338 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.338 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.338 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.338 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.338 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.338 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.338 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.338 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "prometheus", 2024-06-03T00:05:26.338 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.338 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.338 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.338 INFO:teuthology.orchestra.run.smithi049.stdout: "cache": { 2024-06-03T00:05:26.338 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cache", 2024-06-03T00:05:26.338 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.339 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.339 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.339 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.339 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.339 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.339 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.339 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.339 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.339 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.339 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.339 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.339 INFO:teuthology.orchestra.run.smithi049.stdout: "exclude_perf_counters": { 2024-06-03T00:05:26.339 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "exclude_perf_counters", 2024-06-03T00:05:26.340 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.340 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.340 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.340 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.340 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.340 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.340 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.340 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-06-03T00:05:26.340 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-06-03T00:05:26.340 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.340 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.340 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.340 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.341 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.341 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.341 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.341 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.341 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.341 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.341 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.341 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.341 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.341 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.341 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.341 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.341 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.341 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.342 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.342 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.342 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.342 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.342 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.342 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.342 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.342 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.342 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.342 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.342 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.342 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.342 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.342 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.343 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.343 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.343 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.343 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.343 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.343 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.343 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.343 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.343 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.343 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.343 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.343 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.343 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.343 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.344 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.344 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.344 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.344 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.344 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.344 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.344 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.344 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.344 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.344 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.344 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.344 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.344 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.344 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.345 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.345 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.345 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.345 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.345 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.345 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.345 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.345 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.345 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.345 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.345 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.345 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.345 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.345 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_stats_pools": { 2024-06-03T00:05:26.346 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rbd_stats_pools", 2024-06-03T00:05:26.346 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.346 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.346 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.346 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.346 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.346 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.346 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.346 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.346 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.346 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.346 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.346 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.346 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_stats_pools_refresh_interval": { 2024-06-03T00:05:26.347 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-06-03T00:05:26.347 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.347 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.347 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.347 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "300", 2024-06-03T00:05:26.347 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.347 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.347 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.347 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.347 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.347 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.347 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.347 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.347 INFO:teuthology.orchestra.run.smithi049.stdout: "scrape_interval": { 2024-06-03T00:05:26.348 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "scrape_interval", 2024-06-03T00:05:26.348 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-06-03T00:05:26.348 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.348 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.348 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "15.0", 2024-06-03T00:05:26.348 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.348 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.348 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.348 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.348 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.348 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.348 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.348 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.348 INFO:teuthology.orchestra.run.smithi049.stdout: "server_addr": { 2024-06-03T00:05:26.348 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_addr", 2024-06-03T00:05:26.349 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.349 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.349 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.349 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "::", 2024-06-03T00:05:26.349 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.349 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.349 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.349 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-06-03T00:05:26.349 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.349 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.349 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.349 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.349 INFO:teuthology.orchestra.run.smithi049.stdout: "server_port": { 2024-06-03T00:05:26.349 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_port", 2024-06-03T00:05:26.350 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.350 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.350 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.350 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "9283", 2024-06-03T00:05:26.350 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.350 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.350 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.350 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-06-03T00:05:26.350 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.350 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.350 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.350 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.350 INFO:teuthology.orchestra.run.smithi049.stdout: "stale_cache_strategy": { 2024-06-03T00:05:26.350 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "stale_cache_strategy", 2024-06-03T00:05:26.351 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.351 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.351 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.351 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "log", 2024-06-03T00:05:26.351 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.351 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.351 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.351 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.351 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.351 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.351 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.351 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.351 INFO:teuthology.orchestra.run.smithi049.stdout: "standby_behaviour": { 2024-06-03T00:05:26.351 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "standby_behaviour", 2024-06-03T00:05:26.352 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.352 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.352 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.352 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "default", 2024-06-03T00:05:26.352 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.352 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.352 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.352 INFO:teuthology.orchestra.run.smithi049.stdout: "default", 2024-06-03T00:05:26.352 INFO:teuthology.orchestra.run.smithi049.stdout: "error" 2024-06-03T00:05:26.352 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.352 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.352 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.352 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.352 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.353 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.353 INFO:teuthology.orchestra.run.smithi049.stdout: "standby_error_status_code": { 2024-06-03T00:05:26.353 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "standby_error_status_code", 2024-06-03T00:05:26.353 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.353 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.353 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.353 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "500", 2024-06-03T00:05:26.353 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "400", 2024-06-03T00:05:26.353 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "599", 2024-06-03T00:05:26.353 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.353 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.353 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.353 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.354 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.354 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.354 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.354 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.354 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.354 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rbd_support", 2024-06-03T00:05:26.354 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.354 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.354 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.354 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.354 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.354 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.354 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.355 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.355 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.355 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.355 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.355 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.355 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.355 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.355 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.355 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.355 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.355 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.355 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.356 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.356 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.356 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.356 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.356 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.356 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.356 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.356 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.356 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.356 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.356 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.356 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.356 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.356 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.357 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.357 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.357 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.357 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.357 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.357 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.357 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.357 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.357 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.357 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.357 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.357 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.357 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.358 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.358 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.358 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.358 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.358 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.358 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.358 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.358 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.358 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.358 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.358 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.358 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.358 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.359 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.359 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.359 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.359 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.359 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.359 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.359 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.359 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.359 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.359 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.359 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.359 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.359 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.360 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.360 INFO:teuthology.orchestra.run.smithi049.stdout: "max_concurrent_snap_create": { 2024-06-03T00:05:26.360 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_concurrent_snap_create", 2024-06-03T00:05:26.360 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.360 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.360 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.360 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-06-03T00:05:26.360 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.360 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.360 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.360 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.360 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.360 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.360 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.361 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.361 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_snapshot_schedule": { 2024-06-03T00:05:26.361 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mirror_snapshot_schedule", 2024-06-03T00:05:26.361 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.361 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.361 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.361 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.361 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.361 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.361 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.361 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.361 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.361 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.362 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.362 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.362 INFO:teuthology.orchestra.run.smithi049.stdout: "trash_purge_schedule": { 2024-06-03T00:05:26.362 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "trash_purge_schedule", 2024-06-03T00:05:26.362 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.362 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.362 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.362 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.362 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.362 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.362 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.362 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.362 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.362 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.363 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.363 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.363 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.363 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.363 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.363 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "restful", 2024-06-03T00:05:26.363 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.363 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.363 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.363 INFO:teuthology.orchestra.run.smithi049.stdout: "enable_auth": { 2024-06-03T00:05:26.363 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "enable_auth", 2024-06-03T00:05:26.363 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.363 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.364 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.364 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.364 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.364 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.364 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.364 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.364 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.364 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.364 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.364 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.364 INFO:teuthology.orchestra.run.smithi049.stdout: "key_file": { 2024-06-03T00:05:26.364 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "key_file", 2024-06-03T00:05:26.364 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.364 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.364 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.365 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.365 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.365 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.365 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.365 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.365 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.365 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.365 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.365 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.365 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.365 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.365 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.365 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.365 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.366 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.366 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.366 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.366 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.366 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.366 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.366 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.366 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.366 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.366 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.366 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.366 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.366 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.367 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.367 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.367 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.367 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.367 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.367 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.367 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.367 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.367 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.367 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.367 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.367 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.367 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.367 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.368 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.368 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.368 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.368 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.368 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.368 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.368 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.368 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.368 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.368 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.368 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.368 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.368 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.368 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.369 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.369 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.369 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.369 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.369 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.369 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.369 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.369 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.369 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.369 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.369 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.369 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.369 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.369 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.370 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.370 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.370 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.370 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.370 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.370 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.370 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.370 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.370 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.370 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.370 INFO:teuthology.orchestra.run.smithi049.stdout: "server_addr": { 2024-06-03T00:05:26.370 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_addr", 2024-06-03T00:05:26.370 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.371 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.371 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.371 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.371 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.371 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.371 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.371 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.371 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.371 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.371 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.371 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.371 INFO:teuthology.orchestra.run.smithi049.stdout: "server_port": { 2024-06-03T00:05:26.371 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_port", 2024-06-03T00:05:26.371 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.372 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.372 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.372 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.372 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.372 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.372 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.372 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.372 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.372 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.372 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.372 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.372 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.372 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.373 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.373 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rgw", 2024-06-03T00:05:26.373 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.373 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.373 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.373 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.373 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.373 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.373 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.373 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.373 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.373 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.373 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.374 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.374 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.374 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.374 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.374 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.374 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.374 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.374 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.374 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.374 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.374 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.374 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.374 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.375 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.375 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.375 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.375 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.375 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.375 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.375 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.375 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.375 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.375 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.375 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.375 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.375 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.375 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.376 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.376 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.376 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.376 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.376 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.376 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.376 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.376 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.376 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.376 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.376 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.376 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.376 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.377 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.377 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.377 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.377 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.377 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.377 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.377 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.377 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.377 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.377 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.377 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.377 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.377 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.377 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.378 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.378 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.378 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.378 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.378 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.378 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.378 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.378 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.378 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.378 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.378 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.378 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rook", 2024-06-03T00:05:26.378 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.379 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.379 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.379 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.379 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.379 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.379 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.379 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.379 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.379 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.379 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.379 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.379 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.379 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.380 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.380 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.380 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.380 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.380 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.380 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.380 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.380 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.380 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.380 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.380 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.380 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.380 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.380 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.381 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.381 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.381 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.381 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.381 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.381 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.381 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.381 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.381 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.381 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.381 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.381 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.381 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.381 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.382 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.382 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.382 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.382 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.382 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.382 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.382 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.382 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.382 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.382 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.382 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.382 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.382 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.383 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.383 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.383 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.383 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.383 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.383 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.383 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.383 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.383 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.383 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.383 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.383 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.383 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.383 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.384 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.384 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.384 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.384 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.384 INFO:teuthology.orchestra.run.smithi049.stdout: "storage_class": { 2024-06-03T00:05:26.384 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "storage_class", 2024-06-03T00:05:26.384 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.384 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.384 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.384 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "local", 2024-06-03T00:05:26.384 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.384 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.384 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.384 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-06-03T00:05:26.385 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.385 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.385 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.385 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.385 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.385 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.385 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.385 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "selftest", 2024-06-03T00:05:26.385 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.385 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.385 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.385 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.385 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.385 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.386 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.386 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.386 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.386 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.386 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.386 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.386 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.386 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.386 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.386 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.386 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.386 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.386 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.387 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.387 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.387 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.387 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.387 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.387 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.387 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.387 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.387 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.387 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.387 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.387 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.387 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.387 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.388 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.388 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.388 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.388 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.388 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.388 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.388 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.388 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.388 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.388 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.388 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.388 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.388 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.388 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.389 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.389 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.389 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.389 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.389 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.389 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.389 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.389 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.389 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.389 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.389 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.389 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.389 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.389 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.390 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.390 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.390 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.390 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.390 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.390 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.390 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.390 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.390 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.390 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.390 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.390 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.390 INFO:teuthology.orchestra.run.smithi049.stdout: "roption1": { 2024-06-03T00:05:26.390 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "roption1", 2024-06-03T00:05:26.391 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.391 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.391 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.391 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.391 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.391 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.391 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.391 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.391 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.391 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.391 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.391 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.391 INFO:teuthology.orchestra.run.smithi049.stdout: "roption2": { 2024-06-03T00:05:26.392 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "roption2", 2024-06-03T00:05:26.392 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.392 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.392 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.392 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "xyz", 2024-06-03T00:05:26.392 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.392 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.392 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.392 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.392 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.392 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.392 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.392 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.392 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption1": { 2024-06-03T00:05:26.393 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption1", 2024-06-03T00:05:26.393 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.393 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.393 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.393 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.393 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.393 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.393 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.393 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.393 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.393 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.393 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.393 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.394 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption2": { 2024-06-03T00:05:26.394 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption2", 2024-06-03T00:05:26.394 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.394 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.394 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.394 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.394 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.394 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.394 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.394 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.394 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.394 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.394 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.394 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.395 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption3": { 2024-06-03T00:05:26.395 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption3", 2024-06-03T00:05:26.395 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-06-03T00:05:26.395 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.395 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.395 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.395 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.395 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.395 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.395 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.395 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.395 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.395 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.396 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.396 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption4": { 2024-06-03T00:05:26.396 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption4", 2024-06-03T00:05:26.396 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.396 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.396 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.396 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.396 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.396 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.396 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.396 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.396 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.396 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.396 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.397 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.397 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption5": { 2024-06-03T00:05:26.397 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption5", 2024-06-03T00:05:26.397 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.397 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.397 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.397 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.397 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.397 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.397 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.397 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.397 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.397 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.398 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.398 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.398 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption6": { 2024-06-03T00:05:26.398 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption6", 2024-06-03T00:05:26.398 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.398 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.398 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.398 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.398 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.398 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.398 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.398 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.398 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.399 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.399 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.399 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.399 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption7": { 2024-06-03T00:05:26.399 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption7", 2024-06-03T00:05:26.399 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.399 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.399 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.399 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.399 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "1", 2024-06-03T00:05:26.399 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "42", 2024-06-03T00:05:26.399 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.399 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.400 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.400 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.400 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.400 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.400 INFO:teuthology.orchestra.run.smithi049.stdout: "testkey": { 2024-06-03T00:05:26.400 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "testkey", 2024-06-03T00:05:26.400 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.400 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.400 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.400 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.400 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.400 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.400 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.400 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.401 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.401 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.401 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.401 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.401 INFO:teuthology.orchestra.run.smithi049.stdout: "testlkey": { 2024-06-03T00:05:26.401 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "testlkey", 2024-06-03T00:05:26.401 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.401 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.401 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.401 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.401 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.401 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.401 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.401 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.402 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.402 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.402 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.402 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.402 INFO:teuthology.orchestra.run.smithi049.stdout: "testnewline": { 2024-06-03T00:05:26.402 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "testnewline", 2024-06-03T00:05:26.402 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.402 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.402 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.402 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.402 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.402 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.402 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.403 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.403 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.403 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.403 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.403 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.403 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.403 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.403 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.403 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snap_schedule", 2024-06-03T00:05:26.403 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.403 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.403 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.403 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_m_granularity": { 2024-06-03T00:05:26.403 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "allow_m_granularity", 2024-06-03T00:05:26.403 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.404 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.404 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.404 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.404 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.404 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.404 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.404 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "allow minute scheduled snapshots", 2024-06-03T00:05:26.404 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.404 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.404 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.404 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.404 INFO:teuthology.orchestra.run.smithi049.stdout: "dump_on_update": { 2024-06-03T00:05:26.404 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "dump_on_update", 2024-06-03T00:05:26.405 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.405 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.405 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.405 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.405 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.405 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.405 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.405 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "dump database to debug log on update", 2024-06-03T00:05:26.405 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.405 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.405 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.405 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.405 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.405 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.406 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.406 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.406 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.406 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.406 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.406 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.406 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.406 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.406 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.406 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.406 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.406 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.406 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.407 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.407 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.407 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.407 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.407 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.407 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.407 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.407 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.407 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.407 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.407 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.407 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.407 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.407 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.408 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.408 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.408 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.408 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.408 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.408 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.408 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.408 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.408 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.408 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.408 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.408 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.408 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.408 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.409 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.409 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.409 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.409 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.409 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.409 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.409 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.409 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.409 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.409 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.409 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.409 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.409 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.410 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.410 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.410 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.410 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.410 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.410 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.410 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.410 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.410 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.410 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.410 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.410 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.410 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.410 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.411 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.411 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.411 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.411 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "stats", 2024-06-03T00:05:26.411 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.411 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.411 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.411 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.411 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.411 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.411 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.411 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.411 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.411 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.412 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.412 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.412 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.412 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.412 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.412 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.412 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.412 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.412 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.412 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.412 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.412 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.412 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.412 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.413 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.413 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.413 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.413 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.413 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.413 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.413 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.413 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.413 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.413 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.413 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.413 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.413 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.413 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.414 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.414 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.414 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.414 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.414 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.414 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.414 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.414 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.414 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.414 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.414 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.414 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.414 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.414 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.415 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.415 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.415 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.415 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.415 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.415 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.415 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.415 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.415 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.415 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.415 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.415 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.415 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.415 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.416 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.416 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.416 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.416 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.416 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.416 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.416 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.416 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.416 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.416 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.416 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "status", 2024-06-03T00:05:26.416 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.416 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.417 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.417 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.417 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.417 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.417 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.417 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.417 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.417 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.417 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.417 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.417 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.417 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.417 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.417 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.417 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.418 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.418 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.418 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.418 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.418 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.418 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.418 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.418 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.418 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.418 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.418 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.418 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.418 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.419 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.419 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.419 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.419 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.419 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.419 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.419 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.419 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.419 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.419 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.419 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.419 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.419 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.419 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.420 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.420 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.420 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.420 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.420 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.420 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.420 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.420 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.420 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.420 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.420 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.420 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.420 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.420 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.420 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.421 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.421 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.421 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.421 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.421 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.421 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.421 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.421 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.421 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.421 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.421 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.421 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.421 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.421 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.422 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.422 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.422 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.422 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "telegraf", 2024-06-03T00:05:26.422 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.422 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.422 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.422 INFO:teuthology.orchestra.run.smithi049.stdout: "address": { 2024-06-03T00:05:26.422 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "address", 2024-06-03T00:05:26.422 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.422 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.422 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.422 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-06-03T00:05:26.422 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.423 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.423 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.423 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.423 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.423 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.423 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.423 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.423 INFO:teuthology.orchestra.run.smithi049.stdout: "interval": { 2024-06-03T00:05:26.423 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "interval", 2024-06-03T00:05:26.423 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:26.423 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.423 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.423 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "15", 2024-06-03T00:05:26.424 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.424 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.424 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.424 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.424 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.424 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.424 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.424 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.424 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.424 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.424 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.424 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.424 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.424 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.425 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.425 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.425 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.425 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.425 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.425 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.425 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.425 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.425 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.425 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.425 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.425 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.425 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.425 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.426 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.426 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.426 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.426 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.426 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.426 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.426 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.426 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.426 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.426 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.426 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.426 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.427 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.427 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.427 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.427 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.427 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.427 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.427 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.427 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.427 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.427 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.427 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.427 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.427 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.427 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.428 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.428 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.428 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.428 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.428 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.428 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.428 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.428 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.428 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.428 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.428 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.428 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.428 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.428 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.429 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.429 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.429 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.429 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.429 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.429 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.429 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.429 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.429 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.429 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.429 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.429 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.429 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.429 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "telemetry", 2024-06-03T00:05:26.430 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.430 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.430 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.430 INFO:teuthology.orchestra.run.smithi049.stdout: "channel_basic": { 2024-06-03T00:05:26.430 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "channel_basic", 2024-06-03T00:05:26.430 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.430 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.430 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.430 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.430 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.430 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.430 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.430 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Share basic cluster information (size, version)", 2024-06-03T00:05:26.431 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.431 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.431 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.431 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.431 INFO:teuthology.orchestra.run.smithi049.stdout: "channel_crash": { 2024-06-03T00:05:26.431 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "channel_crash", 2024-06-03T00:05:26.431 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.431 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.431 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.431 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.431 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.431 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.431 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.431 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-06-03T00:05:26.432 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.432 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.432 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.432 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.432 INFO:teuthology.orchestra.run.smithi049.stdout: "channel_device": { 2024-06-03T00:05:26.432 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "channel_device", 2024-06-03T00:05:26.432 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.432 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.432 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.432 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.432 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.432 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.432 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.432 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-06-03T00:05:26.433 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.433 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.433 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.433 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.433 INFO:teuthology.orchestra.run.smithi049.stdout: "channel_ident": { 2024-06-03T00:05:26.433 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "channel_ident", 2024-06-03T00:05:26.433 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.433 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.433 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.433 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.433 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.433 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.433 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.433 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-06-03T00:05:26.434 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.434 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.434 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.434 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.434 INFO:teuthology.orchestra.run.smithi049.stdout: "channel_perf": { 2024-06-03T00:05:26.434 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "channel_perf", 2024-06-03T00:05:26.434 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.434 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.434 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.434 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.434 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.434 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.434 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.434 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Share various performance metrics of a cluster", 2024-06-03T00:05:26.435 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.435 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.435 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.435 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.435 INFO:teuthology.orchestra.run.smithi049.stdout: "contact": { 2024-06-03T00:05:26.435 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "contact", 2024-06-03T00:05:26.435 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.435 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.435 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.435 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.435 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.435 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.435 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.435 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.436 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.436 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.436 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.436 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.436 INFO:teuthology.orchestra.run.smithi049.stdout: "description": { 2024-06-03T00:05:26.436 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "description", 2024-06-03T00:05:26.436 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.436 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.436 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.436 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.436 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.436 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.436 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.436 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.437 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.437 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.437 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.437 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.437 INFO:teuthology.orchestra.run.smithi049.stdout: "device_url": { 2024-06-03T00:05:26.437 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "device_url", 2024-06-03T00:05:26.437 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.437 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.437 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.437 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-06-03T00:05:26.437 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.437 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.437 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.437 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.438 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.438 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.438 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.438 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.438 INFO:teuthology.orchestra.run.smithi049.stdout: "enabled": { 2024-06-03T00:05:26.438 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "enabled", 2024-06-03T00:05:26.438 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.438 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.438 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.438 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.438 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.438 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.438 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.438 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.439 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.439 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.439 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.439 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.439 INFO:teuthology.orchestra.run.smithi049.stdout: "interval": { 2024-06-03T00:05:26.439 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "interval", 2024-06-03T00:05:26.439 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.439 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.439 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.439 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "24", 2024-06-03T00:05:26.439 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "8", 2024-06-03T00:05:26.439 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.439 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.439 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.440 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.440 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.440 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.440 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.440 INFO:teuthology.orchestra.run.smithi049.stdout: "last_opt_revision": { 2024-06-03T00:05:26.440 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "last_opt_revision", 2024-06-03T00:05:26.440 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.440 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.440 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.440 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "1", 2024-06-03T00:05:26.440 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.440 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.440 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.440 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.441 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.441 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.441 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.441 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.441 INFO:teuthology.orchestra.run.smithi049.stdout: "leaderboard": { 2024-06-03T00:05:26.441 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "leaderboard", 2024-06-03T00:05:26.441 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.441 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.441 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.441 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.441 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.441 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.441 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.441 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.442 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.442 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.442 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.442 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.442 INFO:teuthology.orchestra.run.smithi049.stdout: "leaderboard_description": { 2024-06-03T00:05:26.442 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "leaderboard_description", 2024-06-03T00:05:26.442 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.442 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.442 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.442 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.442 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.442 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.442 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.443 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.443 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.443 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.443 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.443 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.443 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.443 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.443 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.443 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.443 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.443 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.443 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.443 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.443 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.444 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.444 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.444 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.444 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.444 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.444 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.444 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.444 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.444 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.444 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.444 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.444 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.444 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.444 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.445 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.445 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.445 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.445 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.445 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.445 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.445 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.445 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.445 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.445 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.445 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.445 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.445 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.445 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.446 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.446 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.446 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.446 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.446 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.446 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.446 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.446 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.446 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.446 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.446 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.446 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.446 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.446 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.447 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.447 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.447 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.447 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.447 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.447 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.447 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.447 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.447 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.447 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.447 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.447 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.447 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.447 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.448 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.448 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.448 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.448 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.448 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.448 INFO:teuthology.orchestra.run.smithi049.stdout: "organization": { 2024-06-03T00:05:26.448 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "organization", 2024-06-03T00:05:26.448 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.448 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.448 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.448 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.448 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.448 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.449 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.449 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.449 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.449 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.449 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.449 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.449 INFO:teuthology.orchestra.run.smithi049.stdout: "proxy": { 2024-06-03T00:05:26.449 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "proxy", 2024-06-03T00:05:26.449 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.449 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.449 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.449 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.449 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.449 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.450 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.450 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.450 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.450 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.450 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.450 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.450 INFO:teuthology.orchestra.run.smithi049.stdout: "url": { 2024-06-03T00:05:26.450 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "url", 2024-06-03T00:05:26.450 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.450 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.450 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.450 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-06-03T00:05:26.450 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.450 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.451 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.451 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.451 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.451 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.451 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.451 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.451 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.451 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.451 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.451 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "test_orchestrator", 2024-06-03T00:05:26.451 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.451 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.451 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.451 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.452 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.452 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.452 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.452 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.452 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.452 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.452 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.452 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.452 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.452 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.452 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.452 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.452 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.452 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.452 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.453 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.453 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.453 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.453 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.453 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.453 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.453 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.453 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.453 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.453 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.453 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.453 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.453 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.454 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.454 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.454 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.454 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.454 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.454 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.454 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.454 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.454 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.454 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.454 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.454 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.454 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.454 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.455 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.455 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.455 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.455 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.455 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.455 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.455 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.455 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.455 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.455 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.455 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.455 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.455 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.455 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.456 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.456 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.456 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.456 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.456 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.456 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.456 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.456 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.456 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.456 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.456 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.456 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.456 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.456 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.457 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.457 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.457 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "volumes", 2024-06-03T00:05:26.457 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.457 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.457 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.457 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.457 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.457 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.457 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.457 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.457 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.457 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.457 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.457 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.458 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.458 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.458 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.458 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.458 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.458 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.458 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.458 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.458 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.458 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.458 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.458 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.461 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.461 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.462 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.462 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.462 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.462 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.462 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.462 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.462 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.462 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.462 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.462 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.462 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.462 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.462 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.462 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.463 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.463 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.463 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.463 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.463 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.463 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.463 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.463 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.463 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.463 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.463 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.463 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.463 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.464 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.464 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.464 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.464 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.464 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.464 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.464 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.464 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.464 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.464 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.464 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.464 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.464 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.465 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.465 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.465 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.465 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.465 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.465 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.465 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.465 INFO:teuthology.orchestra.run.smithi049.stdout: "max_concurrent_clones": { 2024-06-03T00:05:26.465 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_concurrent_clones", 2024-06-03T00:05:26.465 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.465 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.465 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.465 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "4", 2024-06-03T00:05:26.466 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.466 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.466 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.466 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Number of asynchronous cloner threads", 2024-06-03T00:05:26.466 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.466 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.466 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.466 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.466 INFO:teuthology.orchestra.run.smithi049.stdout: "periodic_async_work": { 2024-06-03T00:05:26.466 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "periodic_async_work", 2024-06-03T00:05:26.466 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.466 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.466 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.466 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.467 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.467 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.467 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.467 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Periodically check for async work", 2024-06-03T00:05:26.467 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.467 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.467 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.467 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.467 INFO:teuthology.orchestra.run.smithi049.stdout: "snapshot_clone_delay": { 2024-06-03T00:05:26.467 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snapshot_clone_delay", 2024-06-03T00:05:26.467 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.467 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.467 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.467 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-06-03T00:05:26.468 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.468 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.468 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.468 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-06-03T00:05:26.468 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.468 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.468 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.468 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.468 INFO:teuthology.orchestra.run.smithi049.stdout: "snapshot_clone_no_wait": { 2024-06-03T00:05:26.468 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snapshot_clone_no_wait", 2024-06-03T00:05:26.468 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.468 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.469 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.469 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-06-03T00:05:26.469 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.469 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.469 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.469 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-06-03T00:05:26.469 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.469 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.469 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.469 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.469 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.469 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.469 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.469 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "zabbix", 2024-06-03T00:05:26.470 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-06-03T00:05:26.470 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-06-03T00:05:26.470 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-06-03T00:05:26.470 INFO:teuthology.orchestra.run.smithi049.stdout: "discovery_interval": { 2024-06-03T00:05:26.470 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "discovery_interval", 2024-06-03T00:05:26.470 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "uint", 2024-06-03T00:05:26.470 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.470 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.470 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "100", 2024-06-03T00:05:26.470 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.470 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.470 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.470 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.471 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.471 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.471 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.471 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.471 INFO:teuthology.orchestra.run.smithi049.stdout: "identifier": { 2024-06-03T00:05:26.471 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "identifier", 2024-06-03T00:05:26.471 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.471 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.471 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.471 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.471 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.471 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.471 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.471 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.472 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.472 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.472 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.472 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.472 INFO:teuthology.orchestra.run.smithi049.stdout: "interval": { 2024-06-03T00:05:26.472 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "interval", 2024-06-03T00:05:26.472 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-06-03T00:05:26.472 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.472 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.472 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "60", 2024-06-03T00:05:26.472 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.472 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.472 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.472 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.472 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.473 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.473 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.473 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.473 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-06-03T00:05:26.473 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-06-03T00:05:26.473 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.473 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.473 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.473 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.473 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.473 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.473 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.473 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.473 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.473 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.474 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.474 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.474 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.474 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.474 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.474 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.474 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.474 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.474 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.474 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-06-03T00:05:26.474 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-06-03T00:05:26.474 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.474 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.475 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.475 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.475 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.475 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.475 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.475 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.475 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.475 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.475 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.475 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.475 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-06-03T00:05:26.475 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-06-03T00:05:26.475 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.475 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.476 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.476 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-06-03T00:05:26.476 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.476 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.476 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-06-03T00:05:26.476 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-06-03T00:05:26.476 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-06-03T00:05:26.477 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-06-03T00:05:26.477 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-06-03T00:05:26.477 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-06-03T00:05:26.477 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-06-03T00:05:26.477 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.477 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.477 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.477 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.477 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.477 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.477 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-06-03T00:05:26.477 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-06-03T00:05:26.477 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-06-03T00:05:26.477 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.478 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-06-03T00:05:26.478 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-06-03T00:05:26.478 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.478 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.478 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.478 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.478 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.478 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.478 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.478 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.478 INFO:teuthology.orchestra.run.smithi049.stdout: "zabbix_host": { 2024-06-03T00:05:26.478 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "zabbix_host", 2024-06-03T00:05:26.478 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.478 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.479 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.479 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-06-03T00:05:26.479 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.479 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.479 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.479 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.479 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.479 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.479 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.479 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.479 INFO:teuthology.orchestra.run.smithi049.stdout: "zabbix_port": { 2024-06-03T00:05:26.479 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "zabbix_port", 2024-06-03T00:05:26.479 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-06-03T00:05:26.479 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.479 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.480 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10051", 2024-06-03T00:05:26.480 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.480 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.480 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.480 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.480 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.480 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.480 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.480 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.480 INFO:teuthology.orchestra.run.smithi049.stdout: "zabbix_sender": { 2024-06-03T00:05:26.480 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "zabbix_sender", 2024-06-03T00:05:26.480 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-06-03T00:05:26.480 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-06-03T00:05:26.481 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-06-03T00:05:26.481 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-06-03T00:05:26.481 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-06-03T00:05:26.481 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-06-03T00:05:26.481 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-06-03T00:05:26.481 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-06-03T00:05:26.481 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-06-03T00:05:26.481 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-06-03T00:05:26.481 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-06-03T00:05:26.481 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.481 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.481 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.481 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.481 INFO:teuthology.orchestra.run.smithi049.stdout: "services": { 2024-06-03T00:05:26.482 INFO:teuthology.orchestra.run.smithi049.stdout: "dashboard": "https://172.21.15.49:8443/" 2024-06-03T00:05:26.482 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.482 INFO:teuthology.orchestra.run.smithi049.stdout: "always_on_modules": { 2024-06-03T00:05:26.482 INFO:teuthology.orchestra.run.smithi049.stdout: "octopus": [ 2024-06-03T00:05:26.482 INFO:teuthology.orchestra.run.smithi049.stdout: "balancer", 2024-06-03T00:05:26.482 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-06-03T00:05:26.482 INFO:teuthology.orchestra.run.smithi049.stdout: "devicehealth", 2024-06-03T00:05:26.482 INFO:teuthology.orchestra.run.smithi049.stdout: "orchestrator", 2024-06-03T00:05:26.482 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscaler", 2024-06-03T00:05:26.482 INFO:teuthology.orchestra.run.smithi049.stdout: "progress", 2024-06-03T00:05:26.482 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_support", 2024-06-03T00:05:26.482 INFO:teuthology.orchestra.run.smithi049.stdout: "status", 2024-06-03T00:05:26.482 INFO:teuthology.orchestra.run.smithi049.stdout: "telemetry", 2024-06-03T00:05:26.483 INFO:teuthology.orchestra.run.smithi049.stdout: "volumes" 2024-06-03T00:05:26.483 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.483 INFO:teuthology.orchestra.run.smithi049.stdout: "pacific": [ 2024-06-03T00:05:26.483 INFO:teuthology.orchestra.run.smithi049.stdout: "balancer", 2024-06-03T00:05:26.483 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-06-03T00:05:26.483 INFO:teuthology.orchestra.run.smithi049.stdout: "devicehealth", 2024-06-03T00:05:26.483 INFO:teuthology.orchestra.run.smithi049.stdout: "orchestrator", 2024-06-03T00:05:26.483 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscaler", 2024-06-03T00:05:26.483 INFO:teuthology.orchestra.run.smithi049.stdout: "progress", 2024-06-03T00:05:26.483 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_support", 2024-06-03T00:05:26.483 INFO:teuthology.orchestra.run.smithi049.stdout: "status", 2024-06-03T00:05:26.483 INFO:teuthology.orchestra.run.smithi049.stdout: "telemetry", 2024-06-03T00:05:26.483 INFO:teuthology.orchestra.run.smithi049.stdout: "volumes" 2024-06-03T00:05:26.483 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.484 INFO:teuthology.orchestra.run.smithi049.stdout: "quincy": [ 2024-06-03T00:05:26.484 INFO:teuthology.orchestra.run.smithi049.stdout: "balancer", 2024-06-03T00:05:26.484 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-06-03T00:05:26.484 INFO:teuthology.orchestra.run.smithi049.stdout: "devicehealth", 2024-06-03T00:05:26.484 INFO:teuthology.orchestra.run.smithi049.stdout: "orchestrator", 2024-06-03T00:05:26.484 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscaler", 2024-06-03T00:05:26.484 INFO:teuthology.orchestra.run.smithi049.stdout: "progress", 2024-06-03T00:05:26.484 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_support", 2024-06-03T00:05:26.484 INFO:teuthology.orchestra.run.smithi049.stdout: "status", 2024-06-03T00:05:26.484 INFO:teuthology.orchestra.run.smithi049.stdout: "telemetry", 2024-06-03T00:05:26.484 INFO:teuthology.orchestra.run.smithi049.stdout: "volumes" 2024-06-03T00:05:26.484 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.484 INFO:teuthology.orchestra.run.smithi049.stdout: "reef": [ 2024-06-03T00:05:26.484 INFO:teuthology.orchestra.run.smithi049.stdout: "balancer", 2024-06-03T00:05:26.484 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-06-03T00:05:26.485 INFO:teuthology.orchestra.run.smithi049.stdout: "devicehealth", 2024-06-03T00:05:26.485 INFO:teuthology.orchestra.run.smithi049.stdout: "orchestrator", 2024-06-03T00:05:26.485 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscaler", 2024-06-03T00:05:26.485 INFO:teuthology.orchestra.run.smithi049.stdout: "progress", 2024-06-03T00:05:26.485 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_support", 2024-06-03T00:05:26.485 INFO:teuthology.orchestra.run.smithi049.stdout: "status", 2024-06-03T00:05:26.485 INFO:teuthology.orchestra.run.smithi049.stdout: "telemetry", 2024-06-03T00:05:26.485 INFO:teuthology.orchestra.run.smithi049.stdout: "volumes" 2024-06-03T00:05:26.485 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-06-03T00:05:26.485 INFO:teuthology.orchestra.run.smithi049.stdout: "squid": [ 2024-06-03T00:05:26.485 INFO:teuthology.orchestra.run.smithi049.stdout: "balancer", 2024-06-03T00:05:26.485 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-06-03T00:05:26.485 INFO:teuthology.orchestra.run.smithi049.stdout: "devicehealth", 2024-06-03T00:05:26.485 INFO:teuthology.orchestra.run.smithi049.stdout: "orchestrator", 2024-06-03T00:05:26.485 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscaler", 2024-06-03T00:05:26.486 INFO:teuthology.orchestra.run.smithi049.stdout: "progress", 2024-06-03T00:05:26.486 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_support", 2024-06-03T00:05:26.486 INFO:teuthology.orchestra.run.smithi049.stdout: "status", 2024-06-03T00:05:26.486 INFO:teuthology.orchestra.run.smithi049.stdout: "telemetry", 2024-06-03T00:05:26.486 INFO:teuthology.orchestra.run.smithi049.stdout: "volumes" 2024-06-03T00:05:26.486 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-06-03T00:05:26.486 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.486 INFO:teuthology.orchestra.run.smithi049.stdout: "last_failure_osd_epoch": 3, 2024-06-03T00:05:26.486 INFO:teuthology.orchestra.run.smithi049.stdout: "active_clients": [ 2024-06-03T00:05:26.486 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.486 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "devicehealth", 2024-06-03T00:05:26.486 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2024-06-03T00:05:26.486 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.487 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2024-06-03T00:05:26.487 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:0", 2024-06-03T00:05:26.487 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 2082751845 2024-06-03T00:05:26.487 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.487 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-06-03T00:05:26.487 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.487 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.487 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "libcephsqlite", 2024-06-03T00:05:26.487 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2024-06-03T00:05:26.487 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.487 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2024-06-03T00:05:26.487 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:0", 2024-06-03T00:05:26.487 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 220668660 2024-06-03T00:05:26.487 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.487 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-06-03T00:05:26.488 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.488 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.488 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rbd_support", 2024-06-03T00:05:26.488 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2024-06-03T00:05:26.488 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.488 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2024-06-03T00:05:26.488 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:0", 2024-06-03T00:05:26.488 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 4291290287 2024-06-03T00:05:26.488 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.488 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-06-03T00:05:26.488 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:26.488 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.488 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "volumes", 2024-06-03T00:05:26.489 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2024-06-03T00:05:26.489 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-06-03T00:05:26.489 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2024-06-03T00:05:26.489 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:0", 2024-06-03T00:05:26.489 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 464952308 2024-06-03T00:05:26.489 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.489 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-06-03T00:05:26.489 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:26.489 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-06-03T00:05:26.489 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:05:26.491 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:24 smithi057 ceph-mon[36457]: pgmap v544: 97 pgs: 97 active+clean; 95 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 812 KiB/s wr, 301 op/s 2024-06-03T00:05:26.491 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:24 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/4231962782' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-03T00:05:26.491 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:24 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/1248775917' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-03T00:05:26.491 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:24 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/2245324628' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-03T00:05:26.491 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:25 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/3925890571' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-06-03T00:05:26.491 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:24 smithi107 ceph-mon[37048]: pgmap v544: 97 pgs: 97 active+clean; 95 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 812 KiB/s wr, 301 op/s 2024-06-03T00:05:26.491 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:24 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/4231962782' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-03T00:05:26.492 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:24 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/1248775917' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-03T00:05:26.492 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:24 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/2245324628' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-03T00:05:26.492 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:25 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/3925890571' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-06-03T00:05:26.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:25.075+0000 7f01d6b9d640 1 -- 172.21.15.49:0/3925890571 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f01bc0a2c10 msgr2=0x7f01bc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:26.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:25.075+0000 7f01d6b9d640 1 --2- 172.21.15.49:0/3925890571 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f01bc0a2c10 0x7f01bc0a50d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f01c0031610 tx=0x7f01c0005fd0 comp rx=0 tx=0).stop 2024-06-03T00:05:26.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:25.075+0000 7f01d6b9d640 1 -- 172.21.15.49:0/3925890571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01d01008e0 msgr2=0x7f01d00696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:05:26.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:25.075+0000 7f01d6b9d640 1 --2- 172.21.15.49:0/3925890571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01d01008e0 0x7f01d00696c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f01c800ccb0 tx=0x7f01c800a620 comp rx=0 tx=0).stop 2024-06-03T00:05:26.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:25.075+0000 7f01d6b9d640 1 -- 172.21.15.49:0/3925890571 shutdown_connections 2024-06-03T00:05:26.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:25.075+0000 7f01d6b9d640 1 --2- 172.21.15.49:0/3925890571 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f01bc0a2c10 0x7f01bc0a50d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:26.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:25.075+0000 7f01d6b9d640 1 --2- 172.21.15.49:0/3925890571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01d0102490 0x7f01d019f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:26.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:25.075+0000 7f01d6b9d640 1 --2- 172.21.15.49:0/3925890571 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01d0101ad0 0x7f01d019ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:26.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:25.075+0000 7f01d6b9d640 1 --2- 172.21.15.49:0/3925890571 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01d01008e0 0x7f01d00696c0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:05:26.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:25.075+0000 7f01d6b9d640 1 -- 172.21.15.49:0/3925890571 >> 172.21.15.49:0/3925890571 conn(0x7f01d00fbe50 msgr2=0x7f01d0104dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:05:26.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:25.076+0000 7f01d6b9d640 1 -- 172.21.15.49:0/3925890571 shutdown_connections 2024-06-03T00:05:26.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:05:25.076+0000 7f01d6b9d640 1 -- 172.21.15.49:0/3925890571 wait complete. 2024-06-03T00:05:26.554 DEBUG:tasks.check_counter:Getting stats from a 2024-06-03T00:05:26.554 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph daemon mds.a perf dump 2024-06-03T00:05:26.555 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:24 smithi049 ceph-mon[32302]: pgmap v544: 97 pgs: 97 active+clean; 95 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 812 KiB/s wr, 301 op/s 2024-06-03T00:05:26.555 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:24 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/4231962782' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-03T00:05:26.555 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:24 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/1248775917' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-03T00:05:26.555 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:24 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/2245324628' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-03T00:05:26.555 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:25 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3925890571' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-06-03T00:05:26.820 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:05:27.196 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:26 smithi049 ceph-mon[32302]: pgmap v545: 97 pgs: 97 active+clean; 91 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 730 KiB/s wr, 275 op/s 2024-06-03T00:05:27.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:26 smithi107 ceph-mon[37048]: pgmap v545: 97 pgs: 97 active+clean; 91 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 730 KiB/s wr, 275 op/s 2024-06-03T00:05:27.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:26 smithi057 ceph-mon[36457]: pgmap v545: 97 pgs: 97 active+clean; 91 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 730 KiB/s wr, 275 op/s 2024-06-03T00:05:28.616 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:05:28.616 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": { 2024-06-03T00:05:28.616 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 744, 2024-06-03T00:05:28.616 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 725, 2024-06-03T00:05:28.616 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 3332205, 2024-06-03T00:05:28.616 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 269950, 2024-06-03T00:05:28.616 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 6, 2024-06-03T00:05:28.616 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 2, 2024-06-03T00:05:28.616 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.073114342, 2024-06-03T00:05:28.616 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.025471059, 2024-06-03T00:05:28.617 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.024899965, 2024-06-03T00:05:28.617 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.018480488, 2024-06-03T00:05:28.617 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:28.617 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 725, 2024-06-03T00:05:28.617 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.027145262, 2024-06-03T00:05:28.617 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000037441 2024-06-03T00:05:28.617 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.617 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:28.617 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.617 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.617 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.617 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.617 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 570032, 2024-06-03T00:05:28.618 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 86464 2024-06-03T00:05:28.618 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.618 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": { 2024-06-03T00:05:28.618 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 187, 2024-06-03T00:05:28.618 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 291, 2024-06-03T00:05:28.618 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 8437192, 2024-06-03T00:05:28.618 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 318256, 2024-06-03T00:05:28.618 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 5, 2024-06-03T00:05:28.618 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 4, 2024-06-03T00:05:28.618 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.028208830, 2024-06-03T00:05:28.618 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.010517335, 2024-06-03T00:05:28.618 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.011218802, 2024-06-03T00:05:28.619 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.004123773, 2024-06-03T00:05:28.619 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:28.619 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 289, 2024-06-03T00:05:28.619 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.011329506, 2024-06-03T00:05:28.619 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000039202 2024-06-03T00:05:28.619 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.619 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:28.619 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.619 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.619 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.619 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.619 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 160, 2024-06-03T00:05:28.619 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 259040 2024-06-03T00:05:28.619 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.620 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": { 2024-06-03T00:05:28.620 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 405, 2024-06-03T00:05:28.620 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 407, 2024-06-03T00:05:28.620 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 8494135, 2024-06-03T00:05:28.620 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 128791, 2024-06-03T00:05:28.620 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 5, 2024-06-03T00:05:28.620 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 4, 2024-06-03T00:05:28.620 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.035502047, 2024-06-03T00:05:28.620 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.008652574, 2024-06-03T00:05:28.620 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.014997416, 2024-06-03T00:05:28.620 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.009205332, 2024-06-03T00:05:28.620 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:28.620 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 405, 2024-06-03T00:05:28.620 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.012025640, 2024-06-03T00:05:28.621 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000029692 2024-06-03T00:05:28.621 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.621 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:28.621 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.621 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.621 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.621 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.622 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-03T00:05:28.622 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 0 2024-06-03T00:05:28.622 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.622 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": { 2024-06-03T00:05:28.622 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 1, 2024-06-03T00:05:28.622 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-06-03T00:05:28.622 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.622 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-MDSRank": { 2024-06-03T00:05:28.622 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-06-03T00:05:28.622 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-06-03T00:05:28.622 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 2159, 2024-06-03T00:05:28.622 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.051647842, 2024-06-03T00:05:28.623 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000023922 2024-06-03T00:05:28.623 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:28.623 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.623 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-PurgeQueue": { 2024-06-03T00:05:28.623 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-06-03T00:05:28.623 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-06-03T00:05:28.623 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.623 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.623 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.623 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:28.623 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.623 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-06-03T00:05:28.623 INFO:teuthology.orchestra.run.smithi049.stdout: "request": 0, 2024-06-03T00:05:28.624 INFO:teuthology.orchestra.run.smithi049.stdout: "reply": 0, 2024-06-03T00:05:28.624 INFO:teuthology.orchestra.run.smithi049.stdout: "reply_latency": { 2024-06-03T00:05:28.624 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.624 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.624 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.624 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.624 INFO:teuthology.orchestra.run.smithi049.stdout: "slow_reply": 0, 2024-06-03T00:05:28.624 INFO:teuthology.orchestra.run.smithi049.stdout: "forward": 0, 2024-06-03T00:05:28.624 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_fetch_complete": 0, 2024-06-03T00:05:28.624 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_fetch_keys": 0, 2024-06-03T00:05:28.624 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_commit": 0, 2024-06-03T00:05:28.624 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_split": 0, 2024-06-03T00:05:28.624 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_merge": 0, 2024-06-03T00:05:28.624 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes": 2511, 2024-06-03T00:05:28.625 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_top": 0, 2024-06-03T00:05:28.625 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_bottom": 2511, 2024-06-03T00:05:28.625 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_pin_tail": 0, 2024-06-03T00:05:28.625 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_pinned": 2511, 2024-06-03T00:05:28.625 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_expired": 0, 2024-06-03T00:05:28.625 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_with_caps": 0, 2024-06-03T00:05:28.625 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": 0, 2024-06-03T00:05:28.625 INFO:teuthology.orchestra.run.smithi049.stdout: "subtrees": 1, 2024-06-03T00:05:28.625 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse": 0, 2024-06-03T00:05:28.625 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_hit": 0, 2024-06-03T00:05:28.625 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_forward": 0, 2024-06-03T00:05:28.625 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_discover": 0, 2024-06-03T00:05:28.625 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_dir_fetch": 0, 2024-06-03T00:05:28.626 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_remote_ino": 0, 2024-06-03T00:05:28.626 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_lock": 0, 2024-06-03T00:05:28.626 INFO:teuthology.orchestra.run.smithi049.stdout: "load_cent": 0, 2024-06-03T00:05:28.626 INFO:teuthology.orchestra.run.smithi049.stdout: "q": 0, 2024-06-03T00:05:28.626 INFO:teuthology.orchestra.run.smithi049.stdout: "exported": 0, 2024-06-03T00:05:28.626 INFO:teuthology.orchestra.run.smithi049.stdout: "exported_inodes": 0, 2024-06-03T00:05:28.626 INFO:teuthology.orchestra.run.smithi049.stdout: "imported": 0, 2024-06-03T00:05:28.626 INFO:teuthology.orchestra.run.smithi049.stdout: "imported_inodes": 0, 2024-06-03T00:05:28.626 INFO:teuthology.orchestra.run.smithi049.stdout: "openino_dir_fetch": 0, 2024-06-03T00:05:28.626 INFO:teuthology.orchestra.run.smithi049.stdout: "openino_backtrace_fetch": 0, 2024-06-03T00:05:28.626 INFO:teuthology.orchestra.run.smithi049.stdout: "openino_peer_discover": 0, 2024-06-03T00:05:28.626 INFO:teuthology.orchestra.run.smithi049.stdout: "root_rfiles": 0, 2024-06-03T00:05:28.626 INFO:teuthology.orchestra.run.smithi049.stdout: "root_rbytes": 0, 2024-06-03T00:05:28.626 INFO:teuthology.orchestra.run.smithi049.stdout: "root_rsnaps": 0, 2024-06-03T00:05:28.627 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_backtrace_fetch": 0, 2024-06-03T00:05:28.627 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_set_tag": 0, 2024-06-03T00:05:28.627 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_backtrace_repaired": 0, 2024-06-03T00:05:28.627 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_inotable_repaired": 0, 2024-06-03T00:05:28.627 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_dir_inodes": 0, 2024-06-03T00:05:28.627 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_dir_base_inodes": 0, 2024-06-03T00:05:28.627 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_dirfrag_rstats": 0, 2024-06-03T00:05:28.627 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_file_inodes": 0, 2024-06-03T00:05:28.627 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_inode_file_caps": 0, 2024-06-03T00:05:28.627 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_revoke": 0, 2024-06-03T00:05:28.627 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_grant": 0, 2024-06-03T00:05:28.627 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_trunc": 0, 2024-06-03T00:05:28.627 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-03T00:05:28.627 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-03T00:05:28.627 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_caps": 0, 2024-06-03T00:05:28.628 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_caps_dirty": 0, 2024-06-03T00:05:28.628 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_cap_release": 0, 2024-06-03T00:05:28.628 INFO:teuthology.orchestra.run.smithi049.stdout: "process_request_cap_release": 0 2024-06-03T00:05:28.628 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.628 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_cache": { 2024-06-03T00:05:28.628 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_update": 0, 2024-06-03T00:05:28.628 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_update_receipt": 0, 2024-06-03T00:05:28.628 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_try_discover": 0, 2024-06-03T00:05:28.628 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_send_discover": 0, 2024-06-03T00:05:28.628 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_handle_discover": 0, 2024-06-03T00:05:28.628 INFO:teuthology.orchestra.run.smithi049.stdout: "num_strays": 0, 2024-06-03T00:05:28.628 INFO:teuthology.orchestra.run.smithi049.stdout: "num_strays_delayed": 0, 2024-06-03T00:05:28.628 INFO:teuthology.orchestra.run.smithi049.stdout: "num_strays_enqueuing": 0, 2024-06-03T00:05:28.628 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_created": 0, 2024-06-03T00:05:28.629 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_enqueued": 0, 2024-06-03T00:05:28.629 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_reintegrated": 0, 2024-06-03T00:05:28.629 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_migrated": 0, 2024-06-03T00:05:28.629 INFO:teuthology.orchestra.run.smithi049.stdout: "num_recovering_processing": 0, 2024-06-03T00:05:28.629 INFO:teuthology.orchestra.run.smithi049.stdout: "num_recovering_enqueued": 0, 2024-06-03T00:05:28.629 INFO:teuthology.orchestra.run.smithi049.stdout: "num_recovering_prioritized": 0, 2024-06-03T00:05:28.629 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_started": 0, 2024-06-03T00:05:28.629 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_completed": 0, 2024-06-03T00:05:28.629 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_quiesce_path": 0, 2024-06-03T00:05:28.629 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_quiesce_inode": 0, 2024-06-03T00:05:28.629 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_enqueue_scrub": 0, 2024-06-03T00:05:28.629 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_exportdir": 0, 2024-06-03T00:05:28.629 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_flush": 0, 2024-06-03T00:05:28.630 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_fragmentdir": 0, 2024-06-03T00:05:28.630 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_fragstats": 0, 2024-06-03T00:05:28.630 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_inodestats": 0 2024-06-03T00:05:28.630 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.630 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_log": { 2024-06-03T00:05:28.630 INFO:teuthology.orchestra.run.smithi049.stdout: "evlrg": 0, 2024-06-03T00:05:28.630 INFO:teuthology.orchestra.run.smithi049.stdout: "evadd": 0, 2024-06-03T00:05:28.630 INFO:teuthology.orchestra.run.smithi049.stdout: "evex": 0, 2024-06-03T00:05:28.630 INFO:teuthology.orchestra.run.smithi049.stdout: "evtrm": 0, 2024-06-03T00:05:28.630 INFO:teuthology.orchestra.run.smithi049.stdout: "ev": 8715, 2024-06-03T00:05:28.630 INFO:teuthology.orchestra.run.smithi049.stdout: "evexg": 0, 2024-06-03T00:05:28.630 INFO:teuthology.orchestra.run.smithi049.stdout: "evexd": 0, 2024-06-03T00:05:28.630 INFO:teuthology.orchestra.run.smithi049.stdout: "segadd": 0, 2024-06-03T00:05:28.630 INFO:teuthology.orchestra.run.smithi049.stdout: "segex": 0, 2024-06-03T00:05:28.631 INFO:teuthology.orchestra.run.smithi049.stdout: "segtrm": 0, 2024-06-03T00:05:28.631 INFO:teuthology.orchestra.run.smithi049.stdout: "seg": 12, 2024-06-03T00:05:28.631 INFO:teuthology.orchestra.run.smithi049.stdout: "segmjr": 2, 2024-06-03T00:05:28.631 INFO:teuthology.orchestra.run.smithi049.stdout: "segexg": 0, 2024-06-03T00:05:28.631 INFO:teuthology.orchestra.run.smithi049.stdout: "segexd": 0, 2024-06-03T00:05:28.631 INFO:teuthology.orchestra.run.smithi049.stdout: "expos": 4194304, 2024-06-03T00:05:28.631 INFO:teuthology.orchestra.run.smithi049.stdout: "wrpos": 23548835, 2024-06-03T00:05:28.631 INFO:teuthology.orchestra.run.smithi049.stdout: "rdpos": 23547697, 2024-06-03T00:05:28.631 INFO:teuthology.orchestra.run.smithi049.stdout: "jlat": { 2024-06-03T00:05:28.631 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.631 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.631 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.631 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.632 INFO:teuthology.orchestra.run.smithi049.stdout: "replayed": 8715 2024-06-03T00:05:28.632 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.632 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_mem": { 2024-06-03T00:05:28.632 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 13, 2024-06-03T00:05:28.632 INFO:teuthology.orchestra.run.smithi049.stdout: "ino+": 2563, 2024-06-03T00:05:28.632 INFO:teuthology.orchestra.run.smithi049.stdout: "ino-": 2550, 2024-06-03T00:05:28.632 INFO:teuthology.orchestra.run.smithi049.stdout: "dir": 11, 2024-06-03T00:05:28.632 INFO:teuthology.orchestra.run.smithi049.stdout: "dir+": 422, 2024-06-03T00:05:28.632 INFO:teuthology.orchestra.run.smithi049.stdout: "dir-": 411, 2024-06-03T00:05:28.632 INFO:teuthology.orchestra.run.smithi049.stdout: "dn": 2511, 2024-06-03T00:05:28.632 INFO:teuthology.orchestra.run.smithi049.stdout: "dn+": 5311, 2024-06-03T00:05:28.632 INFO:teuthology.orchestra.run.smithi049.stdout: "dn-": 2800, 2024-06-03T00:05:28.632 INFO:teuthology.orchestra.run.smithi049.stdout: "cap": 0, 2024-06-03T00:05:28.632 INFO:teuthology.orchestra.run.smithi049.stdout: "cap+": 0, 2024-06-03T00:05:28.632 INFO:teuthology.orchestra.run.smithi049.stdout: "cap-": 0, 2024-06-03T00:05:28.633 INFO:teuthology.orchestra.run.smithi049.stdout: "rss": 59344, 2024-06-03T00:05:28.633 INFO:teuthology.orchestra.run.smithi049.stdout: "heap": 215420 2024-06-03T00:05:28.633 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.633 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_server": { 2024-06-03T00:05:28.633 INFO:teuthology.orchestra.run.smithi049.stdout: "dispatch_client_request": 0, 2024-06-03T00:05:28.633 INFO:teuthology.orchestra.run.smithi049.stdout: "dispatch_server_request": 0, 2024-06-03T00:05:28.633 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_request": 0, 2024-06-03T00:05:28.633 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_session": 0, 2024-06-03T00:05:28.633 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_peer_request": 0, 2024-06-03T00:05:28.633 INFO:teuthology.orchestra.run.smithi049.stdout: "req_create_latency": { 2024-06-03T00:05:28.633 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.633 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.633 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.633 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.634 INFO:teuthology.orchestra.run.smithi049.stdout: "req_getattr_latency": { 2024-06-03T00:05:28.634 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.634 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.634 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.634 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.634 INFO:teuthology.orchestra.run.smithi049.stdout: "req_getfilelock_latency": { 2024-06-03T00:05:28.634 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.634 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.634 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.634 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.634 INFO:teuthology.orchestra.run.smithi049.stdout: "req_link_latency": { 2024-06-03T00:05:28.634 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.634 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.635 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.635 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.635 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookup_latency": { 2024-06-03T00:05:28.635 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.635 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.635 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.635 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.635 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookuphash_latency": { 2024-06-03T00:05:28.635 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.635 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.635 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.635 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.635 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupino_latency": { 2024-06-03T00:05:28.635 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.636 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.636 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.636 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.636 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupname_latency": { 2024-06-03T00:05:28.636 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.636 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.636 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.636 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.636 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupparent_latency": { 2024-06-03T00:05:28.636 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.636 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.636 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.636 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.636 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupsnap_latency": { 2024-06-03T00:05:28.637 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.637 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.637 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.637 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.637 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lssnap_latency": { 2024-06-03T00:05:28.637 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.637 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.637 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.637 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.637 INFO:teuthology.orchestra.run.smithi049.stdout: "req_mkdir_latency": { 2024-06-03T00:05:28.638 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.638 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.638 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.638 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.638 INFO:teuthology.orchestra.run.smithi049.stdout: "req_mknod_latency": { 2024-06-03T00:05:28.638 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.638 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.638 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.639 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.639 INFO:teuthology.orchestra.run.smithi049.stdout: "req_mksnap_latency": { 2024-06-03T00:05:28.639 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.639 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.639 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.639 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.639 INFO:teuthology.orchestra.run.smithi049.stdout: "req_open_latency": { 2024-06-03T00:05:28.639 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.639 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.639 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.639 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.639 INFO:teuthology.orchestra.run.smithi049.stdout: "req_readdir_latency": { 2024-06-03T00:05:28.640 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.640 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.640 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.640 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.640 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rename_latency": { 2024-06-03T00:05:28.640 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.640 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.640 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.640 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.640 INFO:teuthology.orchestra.run.smithi049.stdout: "req_renamesnap_latency": { 2024-06-03T00:05:28.640 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.640 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.640 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.640 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.641 INFO:teuthology.orchestra.run.smithi049.stdout: "req_snapdiff_latency": { 2024-06-03T00:05:28.641 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.641 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.641 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.641 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.641 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rmdir_latency": { 2024-06-03T00:05:28.641 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.641 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.641 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.641 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.641 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rmsnap_latency": { 2024-06-03T00:05:28.641 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.641 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.642 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.642 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.642 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rmxattr_latency": { 2024-06-03T00:05:28.642 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.642 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.642 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.642 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.642 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setattr_latency": { 2024-06-03T00:05:28.642 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.642 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.642 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.642 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.642 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setdirlayout_latency": { 2024-06-03T00:05:28.642 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.643 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.643 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.643 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.643 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setfilelock_latency": { 2024-06-03T00:05:28.643 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.643 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.643 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.643 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.643 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setlayout_latency": { 2024-06-03T00:05:28.643 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.643 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.643 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.643 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.644 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setxattr_latency": { 2024-06-03T00:05:28.644 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.644 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.644 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.644 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.644 INFO:teuthology.orchestra.run.smithi049.stdout: "req_symlink_latency": { 2024-06-03T00:05:28.644 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.644 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.644 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.644 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.644 INFO:teuthology.orchestra.run.smithi049.stdout: "req_unlink_latency": { 2024-06-03T00:05:28.644 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.644 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.644 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.645 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.645 INFO:teuthology.orchestra.run.smithi049.stdout: "cap_revoke_eviction": 0, 2024-06-03T00:05:28.645 INFO:teuthology.orchestra.run.smithi049.stdout: "cap_acquisition_throttle": 0, 2024-06-03T00:05:28.645 INFO:teuthology.orchestra.run.smithi049.stdout: "req_getvxattr_latency": { 2024-06-03T00:05:28.645 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.645 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.645 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.645 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:28.645 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.645 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_sessions": { 2024-06-03T00:05:28.645 INFO:teuthology.orchestra.run.smithi049.stdout: "session_count": 1, 2024-06-03T00:05:28.645 INFO:teuthology.orchestra.run.smithi049.stdout: "session_add": 1, 2024-06-03T00:05:28.645 INFO:teuthology.orchestra.run.smithi049.stdout: "session_remove": 0, 2024-06-03T00:05:28.645 INFO:teuthology.orchestra.run.smithi049.stdout: "sessions_open": 1, 2024-06-03T00:05:28.646 INFO:teuthology.orchestra.run.smithi049.stdout: "sessions_stale": 0, 2024-06-03T00:05:28.646 INFO:teuthology.orchestra.run.smithi049.stdout: "total_load": 0, 2024-06-03T00:05:28.646 INFO:teuthology.orchestra.run.smithi049.stdout: "average_load": 0, 2024-06-03T00:05:28.646 INFO:teuthology.orchestra.run.smithi049.stdout: "avg_session_uptime": 1504, 2024-06-03T00:05:28.646 INFO:teuthology.orchestra.run.smithi049.stdout: "mdthresh_evicted": 0 2024-06-03T00:05:28.646 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.646 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": { 2024-06-03T00:05:28.646 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-06-03T00:05:28.646 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-06-03T00:05:28.646 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-06-03T00:05:28.646 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-06-03T00:05:28.646 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-06-03T00:05:28.646 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-06-03T00:05:28.646 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-03T00:05:28.647 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-06-03T00:05:28.647 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-03T00:05:28.647 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-06-03T00:05:28.647 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-06-03T00:05:28.647 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-06-03T00:05:28.647 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-03T00:05:28.647 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-06-03T00:05:28.647 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-06-03T00:05:28.647 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-06-03T00:05:28.647 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-06-03T00:05:28.647 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-06-03T00:05:28.647 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-03T00:05:28.647 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-06-03T00:05:28.647 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-03T00:05:28.648 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-06-03T00:05:28.648 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-06-03T00:05:28.648 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-06-03T00:05:28.648 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-06-03T00:05:28.648 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-06-03T00:05:28.648 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-03T00:05:28.648 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-06-03T00:05:28.648 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-06-03T00:05:28.648 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-06-03T00:05:28.648 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-06-03T00:05:28.648 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-06-03T00:05:28.648 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-06-03T00:05:28.648 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-06-03T00:05:28.648 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-06-03T00:05:28.649 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-06-03T00:05:28.649 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 205499, 2024-06-03T00:05:28.649 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 58, 2024-06-03T00:05:28.649 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-06-03T00:05:28.649 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-06-03T00:05:28.649 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-06-03T00:05:28.649 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-06-03T00:05:28.649 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-06-03T00:05:28.649 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-06-03T00:05:28.649 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-06-03T00:05:28.649 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-06-03T00:05:28.649 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 7624, 2024-06-03T00:05:28.649 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 160, 2024-06-03T00:05:28.649 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-06-03T00:05:28.649 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-06-03T00:05:28.650 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-06-03T00:05:28.650 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-06-03T00:05:28.650 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 1811128, 2024-06-03T00:05:28.650 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 10172, 2024-06-03T00:05:28.650 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-06-03T00:05:28.650 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-06-03T00:05:28.650 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-06-03T00:05:28.650 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-06-03T00:05:28.650 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.650 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": { 2024-06-03T00:05:28.650 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-06-03T00:05:28.650 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-06-03T00:05:28.650 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 1168, 2024-06-03T00:05:28.651 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 21, 2024-06-03T00:05:28.651 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 3, 2024-06-03T00:05:28.651 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 1168, 2024-06-03T00:05:28.651 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-06-03T00:05:28.651 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1168, 2024-06-03T00:05:28.651 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 1.217968100, 2024-06-03T00:05:28.651 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001042780 2024-06-03T00:05:28.651 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.651 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-06-03T00:05:28.651 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-06-03T00:05:28.651 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1168, 2024-06-03T00:05:28.651 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 1169 2024-06-03T00:05:28.651 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.651 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 1168, 2024-06-03T00:05:28.651 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 1168, 2024-06-03T00:05:28.652 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-06-03T00:05:28.652 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-06-03T00:05:28.652 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-06-03T00:05:28.652 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 632, 2024-06-03T00:05:28.652 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-06-03T00:05:28.652 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 534, 2024-06-03T00:05:28.652 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-06-03T00:05:28.652 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-06-03T00:05:28.652 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-06-03T00:05:28.652 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-06-03T00:05:28.652 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-06-03T00:05:28.652 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-06-03T00:05:28.652 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-06-03T00:05:28.652 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-06-03T00:05:28.652 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-06-03T00:05:28.653 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-06-03T00:05:28.653 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 1, 2024-06-03T00:05:28.653 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-06-03T00:05:28.653 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-06-03T00:05:28.653 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-06-03T00:05:28.653 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-06-03T00:05:28.653 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-06-03T00:05:28.653 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-06-03T00:05:28.653 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-06-03T00:05:28.653 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-06-03T00:05:28.653 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-06-03T00:05:28.653 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-06-03T00:05:28.653 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-06-03T00:05:28.653 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-06-03T00:05:28.654 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-06-03T00:05:28.654 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-06-03T00:05:28.654 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-06-03T00:05:28.654 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-06-03T00:05:28.654 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-06-03T00:05:28.654 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-06-03T00:05:28.654 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-06-03T00:05:28.654 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-06-03T00:05:28.654 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-06-03T00:05:28.654 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-06-03T00:05:28.654 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-06-03T00:05:28.654 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-06-03T00:05:28.654 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-06-03T00:05:28.654 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-06-03T00:05:28.655 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-06-03T00:05:28.655 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 90, 2024-06-03T00:05:28.655 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-06-03T00:05:28.655 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 2, 2024-06-03T00:05:28.655 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 7, 2024-06-03T00:05:28.655 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 7, 2024-06-03T00:05:28.655 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-06-03T00:05:28.655 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-06-03T00:05:28.655 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-06-03T00:05:28.655 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 2, 2024-06-03T00:05:28.655 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-06-03T00:05:28.655 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.655 INFO:teuthology.orchestra.run.smithi049.stdout: "oft": { 2024-06-03T00:05:28.655 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_objs": 0, 2024-06-03T00:05:28.656 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_kv_pairs": 0, 2024-06-03T00:05:28.656 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_updates": 0, 2024-06-03T00:05:28.656 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_removes": 0 2024-06-03T00:05:28.656 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.656 INFO:teuthology.orchestra.run.smithi049.stdout: "osd-slow-ops": { 2024-06-03T00:05:28.656 INFO:teuthology.orchestra.run.smithi049.stdout: "slow_ops_count": 0 2024-06-03T00:05:28.656 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.656 INFO:teuthology.orchestra.run.smithi049.stdout: "purge_queue": { 2024-06-03T00:05:28.656 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing_ops": 0, 2024-06-03T00:05:28.656 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing_ops_high_water": 0, 2024-06-03T00:05:28.656 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing": 0, 2024-06-03T00:05:28.656 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing_high_water": 0, 2024-06-03T00:05:28.656 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executed_ops": 0, 2024-06-03T00:05:28.657 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executed": 0, 2024-06-03T00:05:28.657 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_item_in_journal": 0 2024-06-03T00:05:28.657 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.657 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-03T00:05:28.657 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-06-03T00:05:28.657 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-06-03T00:05:28.657 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-06-03T00:05:28.657 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 1332, 2024-06-03T00:05:28.657 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 20132347, 2024-06-03T00:05:28.657 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:28.657 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 1332, 2024-06-03T00:05:28.657 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-06-03T00:05:28.657 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-06-03T00:05:28.658 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 1332, 2024-06-03T00:05:28.658 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 20132347, 2024-06-03T00:05:28.658 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-06-03T00:05:28.658 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.658 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.658 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.658 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:28.658 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.658 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": { 2024-06-03T00:05:28.658 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-06-03T00:05:28.658 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-06-03T00:05:28.658 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-06-03T00:05:28.658 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-06-03T00:05:28.658 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-06-03T00:05:28.658 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:28.659 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-06-03T00:05:28.659 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 1168, 2024-06-03T00:05:28.659 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 19354536, 2024-06-03T00:05:28.659 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 1168, 2024-06-03T00:05:28.659 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 19354536, 2024-06-03T00:05:28.659 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-06-03T00:05:28.659 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.659 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.659 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.659 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:28.659 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.659 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": { 2024-06-03T00:05:28.659 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-06-03T00:05:28.659 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-06-03T00:05:28.660 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-06-03T00:05:28.660 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-06-03T00:05:28.660 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-06-03T00:05:28.660 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:28.660 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-06-03T00:05:28.660 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 1168, 2024-06-03T00:05:28.660 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 1168, 2024-06-03T00:05:28.660 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 1168, 2024-06-03T00:05:28.660 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 1168, 2024-06-03T00:05:28.660 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-06-03T00:05:28.660 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.660 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.660 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.660 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:28.661 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.661 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-write_buf_throttle": { 2024-06-03T00:05:28.661 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-06-03T00:05:28.661 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 3758096384, 2024-06-03T00:05:28.661 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-06-03T00:05:28.661 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-06-03T00:05:28.661 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-06-03T00:05:28.661 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:28.661 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-06-03T00:05:28.661 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-06-03T00:05:28.661 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-06-03T00:05:28.661 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-06-03T00:05:28.661 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-06-03T00:05:28.661 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-06-03T00:05:28.661 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.661 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.662 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.662 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:28.662 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:28.662 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-write_buf_throttle-0x56338386a6e0": { 2024-06-03T00:05:28.662 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-06-03T00:05:28.662 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 3758096384, 2024-06-03T00:05:28.662 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-06-03T00:05:28.662 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-06-03T00:05:28.662 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-06-03T00:05:28.662 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:28.662 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-06-03T00:05:28.662 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-06-03T00:05:28.662 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-06-03T00:05:28.663 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-06-03T00:05:28.663 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-06-03T00:05:28.663 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-06-03T00:05:28.663 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:28.663 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:28.663 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:28.663 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:28.663 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:28.663 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:05:29.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:29 smithi107 ceph-mon[37048]: pgmap v546: 97 pgs: 97 active+clean; 91 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 411 KiB/s wr, 175 op/s 2024-06-03T00:05:29.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:29 smithi107 ceph-mon[37048]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:05:29.443 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:29 smithi049 ceph-mon[32302]: pgmap v546: 97 pgs: 97 active+clean; 91 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 411 KiB/s wr, 175 op/s 2024-06-03T00:05:29.444 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:29 smithi049 ceph-mon[32302]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:05:29.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:29 smithi057 ceph-mon[36457]: pgmap v546: 97 pgs: 97 active+clean; 91 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 411 KiB/s wr, 175 op/s 2024-06-03T00:05:29.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:29 smithi057 ceph-mon[36457]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:05:29.472 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-06-03T00:05:29.472 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-06-03T00:05:29.472 DEBUG:tasks.check_counter:Getting stats from d 2024-06-03T00:05:29.472 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph daemon mds.d perf dump 2024-06-03T00:05:29.722 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:05:31.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:31 smithi049 ceph-mon[32302]: pgmap v547: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 409 KiB/s wr, 170 op/s 2024-06-03T00:05:31.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:31 smithi107 ceph-mon[37048]: pgmap v547: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 409 KiB/s wr, 170 op/s 2024-06-03T00:05:31.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:31 smithi057 ceph-mon[36457]: pgmap v547: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 409 KiB/s wr, 170 op/s 2024-06-03T00:05:31.476 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:05:31.476 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": { 2024-06-03T00:05:31.477 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 149, 2024-06-03T00:05:31.477 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 146, 2024-06-03T00:05:31.477 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 457888, 2024-06-03T00:05:31.477 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 88832, 2024-06-03T00:05:31.477 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-06-03T00:05:31.477 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-06-03T00:05:31.477 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.022839645, 2024-06-03T00:05:31.477 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.008914066, 2024-06-03T00:05:31.477 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.011949415, 2024-06-03T00:05:31.477 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.002567406, 2024-06-03T00:05:31.477 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:31.477 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 145, 2024-06-03T00:05:31.478 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.006399388, 2024-06-03T00:05:31.478 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000044133 2024-06-03T00:05:31.478 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:31.478 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:31.478 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:31.478 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:31.478 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:31.478 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:31.478 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 457888, 2024-06-03T00:05:31.478 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 88832 2024-06-03T00:05:31.478 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:31.478 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": { 2024-06-03T00:05:31.478 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 1, 2024-06-03T00:05:31.479 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 110, 2024-06-03T00:05:31.479 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 160, 2024-06-03T00:05:31.479 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 97120, 2024-06-03T00:05:31.479 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-06-03T00:05:31.479 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 2, 2024-06-03T00:05:31.479 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.009122913, 2024-06-03T00:05:31.479 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.006578843, 2024-06-03T00:05:31.479 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.001497960, 2024-06-03T00:05:31.479 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-03T00:05:31.479 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:31.479 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 108, 2024-06-03T00:05:31.479 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.004909684, 2024-06-03T00:05:31.479 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000045460 2024-06-03T00:05:31.480 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:31.480 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:31.480 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:31.480 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:31.480 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:31.480 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:31.480 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 160, 2024-06-03T00:05:31.480 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 97120 2024-06-03T00:05:31.480 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:31.480 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": { 2024-06-03T00:05:31.480 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 4, 2024-06-03T00:05:31.480 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 4, 2024-06-03T00:05:31.480 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 2992, 2024-06-03T00:05:31.480 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 448, 2024-06-03T00:05:31.481 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 2, 2024-06-03T00:05:31.481 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-06-03T00:05:31.481 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.000684195, 2024-06-03T00:05:31.481 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.000041174, 2024-06-03T00:05:31.481 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.000620885, 2024-06-03T00:05:31.481 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-03T00:05:31.481 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:31.481 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 3, 2024-06-03T00:05:31.481 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000792135, 2024-06-03T00:05:31.481 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000264045 2024-06-03T00:05:31.481 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:31.481 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:31.481 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:31.481 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:31.482 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:31.482 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:31.482 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-06-03T00:05:31.482 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 448 2024-06-03T00:05:31.482 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:31.482 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": { 2024-06-03T00:05:31.482 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-06-03T00:05:31.482 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-06-03T00:05:31.482 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:31.482 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": { 2024-06-03T00:05:31.482 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-06-03T00:05:31.482 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-06-03T00:05:31.482 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-06-03T00:05:31.482 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-06-03T00:05:31.483 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-06-03T00:05:31.483 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-06-03T00:05:31.483 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-03T00:05:31.483 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-06-03T00:05:31.483 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-03T00:05:31.483 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-06-03T00:05:31.483 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-06-03T00:05:31.483 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-06-03T00:05:31.483 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-03T00:05:31.483 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-06-03T00:05:31.483 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-06-03T00:05:31.483 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-06-03T00:05:31.483 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-06-03T00:05:31.484 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-06-03T00:05:31.484 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-03T00:05:31.484 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-06-03T00:05:31.484 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-03T00:05:31.484 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-06-03T00:05:31.484 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-06-03T00:05:31.484 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-06-03T00:05:31.484 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-06-03T00:05:31.484 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-06-03T00:05:31.484 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-03T00:05:31.484 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-06-03T00:05:31.484 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-06-03T00:05:31.484 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-06-03T00:05:31.484 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-06-03T00:05:31.485 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-06-03T00:05:31.485 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-06-03T00:05:31.485 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-06-03T00:05:31.485 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-06-03T00:05:31.485 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-06-03T00:05:31.485 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 148967, 2024-06-03T00:05:31.485 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 29, 2024-06-03T00:05:31.485 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-06-03T00:05:31.485 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-06-03T00:05:31.485 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-06-03T00:05:31.485 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-06-03T00:05:31.485 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-06-03T00:05:31.485 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-06-03T00:05:31.485 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-06-03T00:05:31.485 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-06-03T00:05:31.486 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 0, 2024-06-03T00:05:31.486 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 0, 2024-06-03T00:05:31.486 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-06-03T00:05:31.486 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-06-03T00:05:31.486 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-06-03T00:05:31.486 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-06-03T00:05:31.486 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 928, 2024-06-03T00:05:31.486 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 2, 2024-06-03T00:05:31.486 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-06-03T00:05:31.486 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-06-03T00:05:31.486 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-06-03T00:05:31.486 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-06-03T00:05:31.486 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:31.486 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-03T00:05:31.487 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-06-03T00:05:31.487 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-06-03T00:05:31.487 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-06-03T00:05:31.487 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 150, 2024-06-03T00:05:31.487 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 436850, 2024-06-03T00:05:31.487 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:31.487 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 150, 2024-06-03T00:05:31.487 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-06-03T00:05:31.487 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-06-03T00:05:31.487 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 150, 2024-06-03T00:05:31.487 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 436850, 2024-06-03T00:05:31.487 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-06-03T00:05:31.487 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:31.487 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:31.488 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:31.488 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:31.488 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:31.488 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:05:32.104 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-06-03T00:05:32.104 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-06-03T00:05:32.104 DEBUG:tasks.check_counter:Getting stats from g 2024-06-03T00:05:32.104 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph daemon mds.g perf dump 2024-06-03T00:05:32.352 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:05:33.142 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:33 smithi049 ceph-mon[32302]: pgmap v548: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 38 KiB/s wr, 71 op/s 2024-06-03T00:05:33.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:33 smithi107 ceph-mon[37048]: pgmap v548: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 38 KiB/s wr, 71 op/s 2024-06-03T00:05:33.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:33 smithi057 ceph-mon[36457]: pgmap v548: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 38 KiB/s wr, 71 op/s 2024-06-03T00:05:34.071 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:05:34.071 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": { 2024-06-03T00:05:34.071 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 547, 2024-06-03T00:05:34.071 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 549, 2024-06-03T00:05:34.071 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 4372587, 2024-06-03T00:05:34.072 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 173947, 2024-06-03T00:05:34.072 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 7, 2024-06-03T00:05:34.072 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 3, 2024-06-03T00:05:34.072 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.056168623, 2024-06-03T00:05:34.072 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.022747067, 2024-06-03T00:05:34.072 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.013728274, 2024-06-03T00:05:34.072 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.013922821, 2024-06-03T00:05:34.072 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:34.072 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 547, 2024-06-03T00:05:34.072 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.023022945, 2024-06-03T00:05:34.072 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000042089 2024-06-03T00:05:34.072 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.072 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:34.072 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.073 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.073 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.073 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.073 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-03T00:05:34.073 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 0 2024-06-03T00:05:34.073 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.073 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": { 2024-06-03T00:05:34.073 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 749, 2024-06-03T00:05:34.073 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 732, 2024-06-03T00:05:34.073 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 17932810, 2024-06-03T00:05:34.073 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 272907, 2024-06-03T00:05:34.073 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-06-03T00:05:34.073 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 3, 2024-06-03T00:05:34.074 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.069764172, 2024-06-03T00:05:34.074 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.019458529, 2024-06-03T00:05:34.074 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.033663701, 2024-06-03T00:05:34.074 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.015177253, 2024-06-03T00:05:34.074 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:34.074 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 731, 2024-06-03T00:05:34.074 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.019826862, 2024-06-03T00:05:34.074 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000027122 2024-06-03T00:05:34.074 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.074 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:34.074 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.074 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.074 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.074 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.075 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 567920, 2024-06-03T00:05:34.075 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 87456 2024-06-03T00:05:34.075 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.075 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": { 2024-06-03T00:05:34.075 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 67, 2024-06-03T00:05:34.075 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 171, 2024-06-03T00:05:34.075 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 4213654, 2024-06-03T00:05:34.075 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 281183, 2024-06-03T00:05:34.075 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 5, 2024-06-03T00:05:34.075 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 4, 2024-06-03T00:05:34.075 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.016923795, 2024-06-03T00:05:34.075 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.007455174, 2024-06-03T00:05:34.076 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.006540438, 2024-06-03T00:05:34.076 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.001639081, 2024-06-03T00:05:34.076 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:34.076 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 170, 2024-06-03T00:05:34.076 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.008328028, 2024-06-03T00:05:34.076 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000048988 2024-06-03T00:05:34.076 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.076 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:34.076 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.076 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.076 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.076 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.076 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-06-03T00:05:34.076 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 261456 2024-06-03T00:05:34.077 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.077 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": { 2024-06-03T00:05:34.077 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 1, 2024-06-03T00:05:34.077 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-06-03T00:05:34.077 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.077 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-MDSRank": { 2024-06-03T00:05:34.077 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-06-03T00:05:34.077 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-06-03T00:05:34.077 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 2197, 2024-06-03T00:05:34.077 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.051239413, 2024-06-03T00:05:34.077 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000023322 2024-06-03T00:05:34.078 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:34.078 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.078 INFO:teuthology.orchestra.run.smithi049.stdout: "finisher-PurgeQueue": { 2024-06-03T00:05:34.078 INFO:teuthology.orchestra.run.smithi049.stdout: "queue_len": 0, 2024-06-03T00:05:34.078 INFO:teuthology.orchestra.run.smithi049.stdout: "complete_latency": { 2024-06-03T00:05:34.078 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.078 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.079 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.079 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:34.079 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.079 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-06-03T00:05:34.079 INFO:teuthology.orchestra.run.smithi049.stdout: "request": 0, 2024-06-03T00:05:34.079 INFO:teuthology.orchestra.run.smithi049.stdout: "reply": 0, 2024-06-03T00:05:34.079 INFO:teuthology.orchestra.run.smithi049.stdout: "reply_latency": { 2024-06-03T00:05:34.079 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.079 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.079 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.079 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.079 INFO:teuthology.orchestra.run.smithi049.stdout: "slow_reply": 0, 2024-06-03T00:05:34.079 INFO:teuthology.orchestra.run.smithi049.stdout: "forward": 0, 2024-06-03T00:05:34.079 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_fetch_complete": 0, 2024-06-03T00:05:34.079 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_fetch_keys": 0, 2024-06-03T00:05:34.080 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_commit": 0, 2024-06-03T00:05:34.080 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_split": 0, 2024-06-03T00:05:34.080 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_merge": 0, 2024-06-03T00:05:34.080 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes": 4874, 2024-06-03T00:05:34.080 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_top": 0, 2024-06-03T00:05:34.080 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_bottom": 4874, 2024-06-03T00:05:34.080 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_pin_tail": 0, 2024-06-03T00:05:34.081 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_pinned": 4874, 2024-06-03T00:05:34.081 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_expired": 0, 2024-06-03T00:05:34.081 INFO:teuthology.orchestra.run.smithi049.stdout: "inodes_with_caps": 0, 2024-06-03T00:05:34.081 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": 0, 2024-06-03T00:05:34.081 INFO:teuthology.orchestra.run.smithi049.stdout: "subtrees": 1, 2024-06-03T00:05:34.081 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse": 0, 2024-06-03T00:05:34.082 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_hit": 0, 2024-06-03T00:05:34.082 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_forward": 0, 2024-06-03T00:05:34.082 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_discover": 0, 2024-06-03T00:05:34.082 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_dir_fetch": 0, 2024-06-03T00:05:34.082 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_remote_ino": 0, 2024-06-03T00:05:34.083 INFO:teuthology.orchestra.run.smithi049.stdout: "traverse_lock": 0, 2024-06-03T00:05:34.083 INFO:teuthology.orchestra.run.smithi049.stdout: "load_cent": 0, 2024-06-03T00:05:34.083 INFO:teuthology.orchestra.run.smithi049.stdout: "q": 0, 2024-06-03T00:05:34.083 INFO:teuthology.orchestra.run.smithi049.stdout: "exported": 0, 2024-06-03T00:05:34.083 INFO:teuthology.orchestra.run.smithi049.stdout: "exported_inodes": 0, 2024-06-03T00:05:34.083 INFO:teuthology.orchestra.run.smithi049.stdout: "imported": 0, 2024-06-03T00:05:34.083 INFO:teuthology.orchestra.run.smithi049.stdout: "imported_inodes": 0, 2024-06-03T00:05:34.083 INFO:teuthology.orchestra.run.smithi049.stdout: "openino_dir_fetch": 0, 2024-06-03T00:05:34.083 INFO:teuthology.orchestra.run.smithi049.stdout: "openino_backtrace_fetch": 0, 2024-06-03T00:05:34.083 INFO:teuthology.orchestra.run.smithi049.stdout: "openino_peer_discover": 0, 2024-06-03T00:05:34.083 INFO:teuthology.orchestra.run.smithi049.stdout: "root_rfiles": 0, 2024-06-03T00:05:34.084 INFO:teuthology.orchestra.run.smithi049.stdout: "root_rbytes": 0, 2024-06-03T00:05:34.084 INFO:teuthology.orchestra.run.smithi049.stdout: "root_rsnaps": 0, 2024-06-03T00:05:34.084 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_backtrace_fetch": 0, 2024-06-03T00:05:34.084 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_set_tag": 0, 2024-06-03T00:05:34.084 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_backtrace_repaired": 0, 2024-06-03T00:05:34.084 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_inotable_repaired": 0, 2024-06-03T00:05:34.084 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_dir_inodes": 0, 2024-06-03T00:05:34.084 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_dir_base_inodes": 0, 2024-06-03T00:05:34.085 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_dirfrag_rstats": 0, 2024-06-03T00:05:34.085 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_file_inodes": 0, 2024-06-03T00:05:34.085 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_inode_file_caps": 0, 2024-06-03T00:05:34.085 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_revoke": 0, 2024-06-03T00:05:34.085 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_grant": 0, 2024-06-03T00:05:34.085 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_trunc": 0, 2024-06-03T00:05:34.085 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-03T00:05:34.086 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-03T00:05:34.086 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_caps": 0, 2024-06-03T00:05:34.086 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_caps_dirty": 0, 2024-06-03T00:05:34.086 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_cap_release": 0, 2024-06-03T00:05:34.086 INFO:teuthology.orchestra.run.smithi049.stdout: "process_request_cap_release": 0 2024-06-03T00:05:34.086 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.086 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_cache": { 2024-06-03T00:05:34.086 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_update": 0, 2024-06-03T00:05:34.086 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_update_receipt": 0, 2024-06-03T00:05:34.086 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_try_discover": 0, 2024-06-03T00:05:34.086 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_send_discover": 0, 2024-06-03T00:05:34.086 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_handle_discover": 0, 2024-06-03T00:05:34.086 INFO:teuthology.orchestra.run.smithi049.stdout: "num_strays": 0, 2024-06-03T00:05:34.086 INFO:teuthology.orchestra.run.smithi049.stdout: "num_strays_delayed": 0, 2024-06-03T00:05:34.087 INFO:teuthology.orchestra.run.smithi049.stdout: "num_strays_enqueuing": 0, 2024-06-03T00:05:34.087 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_created": 0, 2024-06-03T00:05:34.087 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_enqueued": 0, 2024-06-03T00:05:34.087 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_reintegrated": 0, 2024-06-03T00:05:34.087 INFO:teuthology.orchestra.run.smithi049.stdout: "strays_migrated": 0, 2024-06-03T00:05:34.087 INFO:teuthology.orchestra.run.smithi049.stdout: "num_recovering_processing": 0, 2024-06-03T00:05:34.087 INFO:teuthology.orchestra.run.smithi049.stdout: "num_recovering_enqueued": 0, 2024-06-03T00:05:34.087 INFO:teuthology.orchestra.run.smithi049.stdout: "num_recovering_prioritized": 0, 2024-06-03T00:05:34.087 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_started": 0, 2024-06-03T00:05:34.087 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_completed": 0, 2024-06-03T00:05:34.087 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_quiesce_path": 0, 2024-06-03T00:05:34.088 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_quiesce_inode": 0, 2024-06-03T00:05:34.088 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_enqueue_scrub": 0, 2024-06-03T00:05:34.088 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_exportdir": 0, 2024-06-03T00:05:34.088 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_flush": 0, 2024-06-03T00:05:34.088 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_fragmentdir": 0, 2024-06-03T00:05:34.088 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_fragstats": 0, 2024-06-03T00:05:34.088 INFO:teuthology.orchestra.run.smithi049.stdout: "ireq_inodestats": 0 2024-06-03T00:05:34.088 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.088 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_log": { 2024-06-03T00:05:34.088 INFO:teuthology.orchestra.run.smithi049.stdout: "evlrg": 0, 2024-06-03T00:05:34.088 INFO:teuthology.orchestra.run.smithi049.stdout: "evadd": 0, 2024-06-03T00:05:34.088 INFO:teuthology.orchestra.run.smithi049.stdout: "evex": 0, 2024-06-03T00:05:34.088 INFO:teuthology.orchestra.run.smithi049.stdout: "evtrm": 0, 2024-06-03T00:05:34.089 INFO:teuthology.orchestra.run.smithi049.stdout: "ev": 11353, 2024-06-03T00:05:34.089 INFO:teuthology.orchestra.run.smithi049.stdout: "evexg": 0, 2024-06-03T00:05:34.089 INFO:teuthology.orchestra.run.smithi049.stdout: "evexd": 0, 2024-06-03T00:05:34.089 INFO:teuthology.orchestra.run.smithi049.stdout: "segadd": 0, 2024-06-03T00:05:34.089 INFO:teuthology.orchestra.run.smithi049.stdout: "segex": 0, 2024-06-03T00:05:34.089 INFO:teuthology.orchestra.run.smithi049.stdout: "segtrm": 0, 2024-06-03T00:05:34.089 INFO:teuthology.orchestra.run.smithi049.stdout: "seg": 18, 2024-06-03T00:05:34.089 INFO:teuthology.orchestra.run.smithi049.stdout: "segmjr": 2, 2024-06-03T00:05:34.089 INFO:teuthology.orchestra.run.smithi049.stdout: "segexg": 0, 2024-06-03T00:05:34.089 INFO:teuthology.orchestra.run.smithi049.stdout: "segexd": 0, 2024-06-03T00:05:34.089 INFO:teuthology.orchestra.run.smithi049.stdout: "expos": 4194304, 2024-06-03T00:05:34.089 INFO:teuthology.orchestra.run.smithi049.stdout: "wrpos": 29796912, 2024-06-03T00:05:34.089 INFO:teuthology.orchestra.run.smithi049.stdout: "rdpos": 29795774, 2024-06-03T00:05:34.090 INFO:teuthology.orchestra.run.smithi049.stdout: "jlat": { 2024-06-03T00:05:34.090 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.090 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.090 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.090 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.090 INFO:teuthology.orchestra.run.smithi049.stdout: "replayed": 11353 2024-06-03T00:05:34.090 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.090 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_mem": { 2024-06-03T00:05:34.090 INFO:teuthology.orchestra.run.smithi049.stdout: "ino": 17, 2024-06-03T00:05:34.090 INFO:teuthology.orchestra.run.smithi049.stdout: "ino+": 4694, 2024-06-03T00:05:34.090 INFO:teuthology.orchestra.run.smithi049.stdout: "ino-": 4677, 2024-06-03T00:05:34.090 INFO:teuthology.orchestra.run.smithi049.stdout: "dir": 22, 2024-06-03T00:05:34.090 INFO:teuthology.orchestra.run.smithi049.stdout: "dir+": 542, 2024-06-03T00:05:34.091 INFO:teuthology.orchestra.run.smithi049.stdout: "dir-": 520, 2024-06-03T00:05:34.091 INFO:teuthology.orchestra.run.smithi049.stdout: "dn": 4874, 2024-06-03T00:05:34.091 INFO:teuthology.orchestra.run.smithi049.stdout: "dn+": 9627, 2024-06-03T00:05:34.091 INFO:teuthology.orchestra.run.smithi049.stdout: "dn-": 4753, 2024-06-03T00:05:34.091 INFO:teuthology.orchestra.run.smithi049.stdout: "cap": 0, 2024-06-03T00:05:34.091 INFO:teuthology.orchestra.run.smithi049.stdout: "cap+": 0, 2024-06-03T00:05:34.091 INFO:teuthology.orchestra.run.smithi049.stdout: "cap-": 0, 2024-06-03T00:05:34.091 INFO:teuthology.orchestra.run.smithi049.stdout: "rss": 61316, 2024-06-03T00:05:34.091 INFO:teuthology.orchestra.run.smithi049.stdout: "heap": 215420 2024-06-03T00:05:34.091 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.091 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_server": { 2024-06-03T00:05:34.091 INFO:teuthology.orchestra.run.smithi049.stdout: "dispatch_client_request": 0, 2024-06-03T00:05:34.091 INFO:teuthology.orchestra.run.smithi049.stdout: "dispatch_server_request": 0, 2024-06-03T00:05:34.091 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_request": 0, 2024-06-03T00:05:34.092 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_client_session": 0, 2024-06-03T00:05:34.092 INFO:teuthology.orchestra.run.smithi049.stdout: "handle_peer_request": 0, 2024-06-03T00:05:34.092 INFO:teuthology.orchestra.run.smithi049.stdout: "req_create_latency": { 2024-06-03T00:05:34.092 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.092 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.092 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.092 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.092 INFO:teuthology.orchestra.run.smithi049.stdout: "req_getattr_latency": { 2024-06-03T00:05:34.092 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.092 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.092 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.092 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.092 INFO:teuthology.orchestra.run.smithi049.stdout: "req_getfilelock_latency": { 2024-06-03T00:05:34.093 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.093 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.093 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.093 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.093 INFO:teuthology.orchestra.run.smithi049.stdout: "req_link_latency": { 2024-06-03T00:05:34.093 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.093 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.093 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.093 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.093 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookup_latency": { 2024-06-03T00:05:34.093 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.093 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.093 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.093 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.094 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookuphash_latency": { 2024-06-03T00:05:34.094 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.094 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.094 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.094 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.094 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupino_latency": { 2024-06-03T00:05:34.094 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.094 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.094 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.094 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.094 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupname_latency": { 2024-06-03T00:05:34.094 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.094 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.095 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.095 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.095 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupparent_latency": { 2024-06-03T00:05:34.095 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.095 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.095 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.095 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.095 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lookupsnap_latency": { 2024-06-03T00:05:34.095 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.095 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.095 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.095 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.095 INFO:teuthology.orchestra.run.smithi049.stdout: "req_lssnap_latency": { 2024-06-03T00:05:34.095 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.096 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.096 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.096 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.096 INFO:teuthology.orchestra.run.smithi049.stdout: "req_mkdir_latency": { 2024-06-03T00:05:34.096 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.096 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.096 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.097 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.097 INFO:teuthology.orchestra.run.smithi049.stdout: "req_mknod_latency": { 2024-06-03T00:05:34.097 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.097 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.097 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.097 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.097 INFO:teuthology.orchestra.run.smithi049.stdout: "req_mksnap_latency": { 2024-06-03T00:05:34.097 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.097 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.097 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.097 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.097 INFO:teuthology.orchestra.run.smithi049.stdout: "req_open_latency": { 2024-06-03T00:05:34.097 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.098 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.098 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.098 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.098 INFO:teuthology.orchestra.run.smithi049.stdout: "req_readdir_latency": { 2024-06-03T00:05:34.098 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.098 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.098 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.098 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.098 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rename_latency": { 2024-06-03T00:05:34.098 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.098 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.098 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.099 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.099 INFO:teuthology.orchestra.run.smithi049.stdout: "req_renamesnap_latency": { 2024-06-03T00:05:34.099 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.099 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.099 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.099 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.099 INFO:teuthology.orchestra.run.smithi049.stdout: "req_snapdiff_latency": { 2024-06-03T00:05:34.099 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.099 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.099 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.099 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.099 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rmdir_latency": { 2024-06-03T00:05:34.099 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.100 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.100 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.100 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.100 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rmsnap_latency": { 2024-06-03T00:05:34.100 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.100 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.100 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.100 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.100 INFO:teuthology.orchestra.run.smithi049.stdout: "req_rmxattr_latency": { 2024-06-03T00:05:34.100 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.100 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.100 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.100 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.100 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setattr_latency": { 2024-06-03T00:05:34.101 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.101 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.101 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.101 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.101 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setdirlayout_latency": { 2024-06-03T00:05:34.101 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.101 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.101 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.101 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.101 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setfilelock_latency": { 2024-06-03T00:05:34.101 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.101 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.101 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.101 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.102 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setlayout_latency": { 2024-06-03T00:05:34.102 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.102 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.102 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.102 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.102 INFO:teuthology.orchestra.run.smithi049.stdout: "req_setxattr_latency": { 2024-06-03T00:05:34.102 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.102 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.102 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.102 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.102 INFO:teuthology.orchestra.run.smithi049.stdout: "req_symlink_latency": { 2024-06-03T00:05:34.102 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.102 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.103 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.103 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.103 INFO:teuthology.orchestra.run.smithi049.stdout: "req_unlink_latency": { 2024-06-03T00:05:34.103 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.103 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.103 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.103 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.103 INFO:teuthology.orchestra.run.smithi049.stdout: "cap_revoke_eviction": 0, 2024-06-03T00:05:34.103 INFO:teuthology.orchestra.run.smithi049.stdout: "cap_acquisition_throttle": 0, 2024-06-03T00:05:34.103 INFO:teuthology.orchestra.run.smithi049.stdout: "req_getvxattr_latency": { 2024-06-03T00:05:34.103 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.103 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.103 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.103 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:34.104 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.104 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_sessions": { 2024-06-03T00:05:34.104 INFO:teuthology.orchestra.run.smithi049.stdout: "session_count": 1, 2024-06-03T00:05:34.104 INFO:teuthology.orchestra.run.smithi049.stdout: "session_add": 1, 2024-06-03T00:05:34.104 INFO:teuthology.orchestra.run.smithi049.stdout: "session_remove": 0, 2024-06-03T00:05:34.104 INFO:teuthology.orchestra.run.smithi049.stdout: "sessions_open": 1, 2024-06-03T00:05:34.104 INFO:teuthology.orchestra.run.smithi049.stdout: "sessions_stale": 0, 2024-06-03T00:05:34.104 INFO:teuthology.orchestra.run.smithi049.stdout: "total_load": 0, 2024-06-03T00:05:34.104 INFO:teuthology.orchestra.run.smithi049.stdout: "average_load": 0, 2024-06-03T00:05:34.104 INFO:teuthology.orchestra.run.smithi049.stdout: "avg_session_uptime": 1510, 2024-06-03T00:05:34.104 INFO:teuthology.orchestra.run.smithi049.stdout: "mdthresh_evicted": 0 2024-06-03T00:05:34.105 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.105 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": { 2024-06-03T00:05:34.105 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-06-03T00:05:34.105 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-06-03T00:05:34.105 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-06-03T00:05:34.105 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-06-03T00:05:34.105 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-06-03T00:05:34.105 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-06-03T00:05:34.105 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-03T00:05:34.105 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-06-03T00:05:34.105 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-03T00:05:34.105 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-06-03T00:05:34.105 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-06-03T00:05:34.106 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-06-03T00:05:34.106 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-03T00:05:34.106 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-06-03T00:05:34.106 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-06-03T00:05:34.106 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-06-03T00:05:34.106 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-06-03T00:05:34.106 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-06-03T00:05:34.106 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-03T00:05:34.106 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-06-03T00:05:34.106 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-03T00:05:34.106 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-06-03T00:05:34.106 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-06-03T00:05:34.106 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-06-03T00:05:34.107 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-06-03T00:05:34.107 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-06-03T00:05:34.107 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-03T00:05:34.107 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-06-03T00:05:34.107 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-06-03T00:05:34.107 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-06-03T00:05:34.107 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-06-03T00:05:34.107 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-06-03T00:05:34.107 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-06-03T00:05:34.107 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-06-03T00:05:34.107 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-06-03T00:05:34.107 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-06-03T00:05:34.107 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 205708, 2024-06-03T00:05:34.107 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 63, 2024-06-03T00:05:34.107 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-06-03T00:05:34.108 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-06-03T00:05:34.108 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-06-03T00:05:34.108 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-06-03T00:05:34.108 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-06-03T00:05:34.108 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-06-03T00:05:34.108 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-06-03T00:05:34.108 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-06-03T00:05:34.108 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 7624, 2024-06-03T00:05:34.108 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 160, 2024-06-03T00:05:34.108 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-06-03T00:05:34.108 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-06-03T00:05:34.109 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-06-03T00:05:34.109 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-06-03T00:05:34.109 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 3498342, 2024-06-03T00:05:34.109 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 20029, 2024-06-03T00:05:34.109 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-06-03T00:05:34.109 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-06-03T00:05:34.109 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-06-03T00:05:34.109 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-06-03T00:05:34.109 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.109 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": { 2024-06-03T00:05:34.109 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-06-03T00:05:34.109 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-06-03T00:05:34.109 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 1192, 2024-06-03T00:05:34.109 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 21, 2024-06-03T00:05:34.110 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 3, 2024-06-03T00:05:34.110 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 1192, 2024-06-03T00:05:34.110 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-06-03T00:05:34.110 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1192, 2024-06-03T00:05:34.110 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 1.120970659, 2024-06-03T00:05:34.110 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000940411 2024-06-03T00:05:34.110 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.110 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-06-03T00:05:34.110 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-06-03T00:05:34.110 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 1192, 2024-06-03T00:05:34.110 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 1193 2024-06-03T00:05:34.110 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.110 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 1192, 2024-06-03T00:05:34.110 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 1192, 2024-06-03T00:05:34.111 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-06-03T00:05:34.111 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-06-03T00:05:34.111 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-06-03T00:05:34.111 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 643, 2024-06-03T00:05:34.111 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-06-03T00:05:34.111 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 547, 2024-06-03T00:05:34.111 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-06-03T00:05:34.111 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-06-03T00:05:34.111 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-06-03T00:05:34.111 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-06-03T00:05:34.111 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-06-03T00:05:34.111 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-06-03T00:05:34.111 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-06-03T00:05:34.111 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-06-03T00:05:34.111 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-06-03T00:05:34.111 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-06-03T00:05:34.112 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 1, 2024-06-03T00:05:34.112 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-06-03T00:05:34.112 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-06-03T00:05:34.112 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-06-03T00:05:34.112 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-06-03T00:05:34.112 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-06-03T00:05:34.112 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-06-03T00:05:34.112 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-06-03T00:05:34.112 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-06-03T00:05:34.112 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-06-03T00:05:34.112 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-06-03T00:05:34.112 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-06-03T00:05:34.112 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-06-03T00:05:34.112 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-06-03T00:05:34.112 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-06-03T00:05:34.113 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-06-03T00:05:34.113 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-06-03T00:05:34.113 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-06-03T00:05:34.113 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-06-03T00:05:34.113 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-06-03T00:05:34.113 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-06-03T00:05:34.113 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-06-03T00:05:34.113 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-06-03T00:05:34.113 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-06-03T00:05:34.113 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-06-03T00:05:34.113 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-06-03T00:05:34.113 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-06-03T00:05:34.113 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-06-03T00:05:34.114 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 90, 2024-06-03T00:05:34.114 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-06-03T00:05:34.114 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 2, 2024-06-03T00:05:34.114 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 7, 2024-06-03T00:05:34.114 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 7, 2024-06-03T00:05:34.114 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-06-03T00:05:34.114 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-06-03T00:05:34.114 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-06-03T00:05:34.114 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 2, 2024-06-03T00:05:34.114 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-06-03T00:05:34.114 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.114 INFO:teuthology.orchestra.run.smithi049.stdout: "oft": { 2024-06-03T00:05:34.114 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_objs": 0, 2024-06-03T00:05:34.115 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_kv_pairs": 0, 2024-06-03T00:05:34.115 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_updates": 0, 2024-06-03T00:05:34.115 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_total_removes": 0 2024-06-03T00:05:34.115 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.115 INFO:teuthology.orchestra.run.smithi049.stdout: "osd-slow-ops": { 2024-06-03T00:05:34.115 INFO:teuthology.orchestra.run.smithi049.stdout: "slow_ops_count": 0 2024-06-03T00:05:34.115 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.115 INFO:teuthology.orchestra.run.smithi049.stdout: "purge_queue": { 2024-06-03T00:05:34.115 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing_ops": 0, 2024-06-03T00:05:34.115 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing_ops_high_water": 0, 2024-06-03T00:05:34.115 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing": 0, 2024-06-03T00:05:34.115 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executing_high_water": 0, 2024-06-03T00:05:34.115 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executed_ops": 0, 2024-06-03T00:05:34.115 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_executed": 0, 2024-06-03T00:05:34.115 INFO:teuthology.orchestra.run.smithi049.stdout: "pq_item_in_journal": 0 2024-06-03T00:05:34.116 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.116 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-03T00:05:34.116 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-06-03T00:05:34.116 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-06-03T00:05:34.116 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-06-03T00:05:34.116 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 1359, 2024-06-03T00:05:34.116 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 26385280, 2024-06-03T00:05:34.116 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:34.116 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 1359, 2024-06-03T00:05:34.116 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-06-03T00:05:34.116 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-06-03T00:05:34.116 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 1359, 2024-06-03T00:05:34.116 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 26385280, 2024-06-03T00:05:34.116 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-06-03T00:05:34.117 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.117 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.117 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.117 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:34.117 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.117 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": { 2024-06-03T00:05:34.117 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-06-03T00:05:34.117 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-06-03T00:05:34.117 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-06-03T00:05:34.117 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-06-03T00:05:34.117 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-06-03T00:05:34.117 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:34.117 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-06-03T00:05:34.117 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 1192, 2024-06-03T00:05:34.117 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 25602613, 2024-06-03T00:05:34.118 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 1192, 2024-06-03T00:05:34.118 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 25602613, 2024-06-03T00:05:34.118 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-06-03T00:05:34.118 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.118 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.118 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.118 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:34.118 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.118 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": { 2024-06-03T00:05:34.118 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-06-03T00:05:34.118 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-06-03T00:05:34.118 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-06-03T00:05:34.118 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-06-03T00:05:34.119 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-06-03T00:05:34.119 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:34.119 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-06-03T00:05:34.119 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 1192, 2024-06-03T00:05:34.119 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 1192, 2024-06-03T00:05:34.119 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 1192, 2024-06-03T00:05:34.119 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 1192, 2024-06-03T00:05:34.119 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-06-03T00:05:34.119 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.119 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.119 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.119 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:34.119 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.120 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-write_buf_throttle": { 2024-06-03T00:05:34.120 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-06-03T00:05:34.120 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 3758096384, 2024-06-03T00:05:34.120 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-06-03T00:05:34.120 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-06-03T00:05:34.120 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-06-03T00:05:34.120 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:34.120 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-06-03T00:05:34.120 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-06-03T00:05:34.120 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-06-03T00:05:34.120 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-06-03T00:05:34.120 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-06-03T00:05:34.120 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-06-03T00:05:34.120 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.121 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.121 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.121 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:34.121 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:34.121 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-write_buf_throttle-0x5641cd0866e0": { 2024-06-03T00:05:34.121 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-06-03T00:05:34.121 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 3758096384, 2024-06-03T00:05:34.121 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-06-03T00:05:34.121 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-06-03T00:05:34.121 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-06-03T00:05:34.121 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:34.121 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-06-03T00:05:34.121 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-06-03T00:05:34.121 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-06-03T00:05:34.122 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-06-03T00:05:34.122 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-06-03T00:05:34.122 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-06-03T00:05:34.122 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:34.122 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:34.122 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:34.122 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:34.122 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:34.122 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:05:34.880 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-06-03T00:05:34.881 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-06-03T00:05:34.881 DEBUG:tasks.check_counter:Getting stats from j 2024-06-03T00:05:34.881 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph daemon mds.j perf dump 2024-06-03T00:05:35.134 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:05:35.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:35 smithi049 ceph-mon[32302]: pgmap v549: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 KiB/s wr, 55 op/s 2024-06-03T00:05:35.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:35 smithi107 ceph-mon[37048]: pgmap v549: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 KiB/s wr, 55 op/s 2024-06-03T00:05:35.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:35 smithi057 ceph-mon[36457]: pgmap v549: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 KiB/s wr, 55 op/s 2024-06-03T00:05:36.908 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-06-03T00:05:36.908 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": { 2024-06-03T00:05:36.908 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 4, 2024-06-03T00:05:36.908 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 4, 2024-06-03T00:05:36.908 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 2992, 2024-06-03T00:05:36.909 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 448, 2024-06-03T00:05:36.909 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-06-03T00:05:36.909 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-06-03T00:05:36.909 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.001662203, 2024-06-03T00:05:36.909 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.000044016, 2024-06-03T00:05:36.909 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.000583676, 2024-06-03T00:05:36.909 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-03T00:05:36.909 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:36.909 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 3, 2024-06-03T00:05:36.909 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000714319, 2024-06-03T00:05:36.909 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000238106 2024-06-03T00:05:36.909 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:36.909 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:36.910 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:36.910 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:36.910 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:36.910 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:36.910 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-06-03T00:05:36.910 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 448 2024-06-03T00:05:36.910 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:36.910 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": { 2024-06-03T00:05:36.910 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 1, 2024-06-03T00:05:36.910 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 112, 2024-06-03T00:05:36.910 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 160, 2024-06-03T00:05:36.910 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 97472, 2024-06-03T00:05:36.910 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-06-03T00:05:36.910 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 2, 2024-06-03T00:05:36.911 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.008015917, 2024-06-03T00:05:36.911 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.005815065, 2024-06-03T00:05:36.911 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.001156536, 2024-06-03T00:05:36.911 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-03T00:05:36.911 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:36.911 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 110, 2024-06-03T00:05:36.911 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.004740740, 2024-06-03T00:05:36.911 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000043097 2024-06-03T00:05:36.911 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:36.911 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:36.911 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:36.911 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:36.911 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:36.911 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:36.912 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 160, 2024-06-03T00:05:36.912 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 97472 2024-06-03T00:05:36.912 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:36.912 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": { 2024-06-03T00:05:36.912 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 152, 2024-06-03T00:05:36.912 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 149, 2024-06-03T00:05:36.912 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 459328, 2024-06-03T00:05:36.912 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 90448, 2024-06-03T00:05:36.912 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 2, 2024-06-03T00:05:36.912 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-06-03T00:05:36.912 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.022275942, 2024-06-03T00:05:36.912 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.009174630, 2024-06-03T00:05:36.912 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.011653703, 2024-06-03T00:05:36.912 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.002696172, 2024-06-03T00:05:36.913 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:36.913 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 148, 2024-06-03T00:05:36.913 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.006120293, 2024-06-03T00:05:36.913 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000041353 2024-06-03T00:05:36.913 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:36.913 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:36.913 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:36.913 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:36.913 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:36.913 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:36.913 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 459328, 2024-06-03T00:05:36.913 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 90448 2024-06-03T00:05:36.913 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:36.914 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": { 2024-06-03T00:05:36.914 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-06-03T00:05:36.914 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-06-03T00:05:36.914 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:36.914 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": { 2024-06-03T00:05:36.914 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-06-03T00:05:36.914 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-06-03T00:05:36.914 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-06-03T00:05:36.914 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-06-03T00:05:36.914 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-06-03T00:05:36.914 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-06-03T00:05:36.914 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-03T00:05:36.914 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-06-03T00:05:36.914 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-03T00:05:36.915 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-06-03T00:05:36.915 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-06-03T00:05:36.915 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-06-03T00:05:36.915 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-03T00:05:36.915 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-06-03T00:05:36.915 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-06-03T00:05:36.915 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-06-03T00:05:36.915 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-06-03T00:05:36.915 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-06-03T00:05:36.915 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-03T00:05:36.915 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-06-03T00:05:36.915 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-03T00:05:36.915 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-06-03T00:05:36.915 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-06-03T00:05:36.916 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-06-03T00:05:36.916 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-06-03T00:05:36.916 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-06-03T00:05:36.916 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-03T00:05:36.916 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-06-03T00:05:36.916 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-06-03T00:05:36.916 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-06-03T00:05:36.916 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-06-03T00:05:36.916 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-06-03T00:05:36.916 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-06-03T00:05:36.916 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-06-03T00:05:36.916 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-06-03T00:05:36.916 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-06-03T00:05:36.916 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 148967, 2024-06-03T00:05:36.916 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 29, 2024-06-03T00:05:36.917 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-06-03T00:05:36.917 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-06-03T00:05:36.917 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-06-03T00:05:36.917 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-06-03T00:05:36.917 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-06-03T00:05:36.917 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-06-03T00:05:36.917 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-06-03T00:05:36.917 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-06-03T00:05:36.917 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 0, 2024-06-03T00:05:36.917 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 0, 2024-06-03T00:05:36.917 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-06-03T00:05:36.917 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-06-03T00:05:36.917 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-06-03T00:05:36.917 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-06-03T00:05:36.918 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 928, 2024-06-03T00:05:36.918 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 2, 2024-06-03T00:05:36.918 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-06-03T00:05:36.918 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-06-03T00:05:36.918 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-06-03T00:05:36.918 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-06-03T00:05:36.918 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-06-03T00:05:36.918 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-03T00:05:36.918 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-06-03T00:05:36.918 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-06-03T00:05:36.918 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-06-03T00:05:36.918 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 153, 2024-06-03T00:05:36.918 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 437877, 2024-06-03T00:05:36.919 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:36.919 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 153, 2024-06-03T00:05:36.919 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-06-03T00:05:36.919 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-06-03T00:05:36.919 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 153, 2024-06-03T00:05:36.919 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 437877, 2024-06-03T00:05:36.919 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-06-03T00:05:36.919 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-06-03T00:05:36.919 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-06-03T00:05:36.919 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-06-03T00:05:36.919 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:36.919 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-06-03T00:05:36.919 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-06-03T00:05:37.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:37 smithi049 ceph-mon[32302]: pgmap v550: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 KiB/s wr, 45 op/s 2024-06-03T00:05:37.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:37 smithi107 ceph-mon[37048]: pgmap v550: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 KiB/s wr, 45 op/s 2024-06-03T00:05:37.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:37 smithi057 ceph-mon[36457]: pgmap v550: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 KiB/s wr, 45 op/s 2024-06-03T00:05:37.684 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-06-03T00:05:37.684 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-06-03T00:05:37.684 DEBUG:tasks.check_counter:Getting stats from b 2024-06-03T00:05:37.684 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph daemon mds.b perf dump 2024-06-03T00:05:37.945 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.b/config 2024-06-03T00:05:39.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:39 smithi107 ceph-mon[37048]: pgmap v551: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 13 op/s 2024-06-03T00:05:39.365 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:39 smithi057 ceph-mon[36457]: pgmap v551: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 13 op/s 2024-06-03T00:05:39.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:39 smithi049 ceph-mon[32302]: pgmap v551: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 13 op/s 2024-06-03T00:05:39.635 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-06-03T00:05:39.635 INFO:teuthology.orchestra.run.smithi057.stdout: "AsyncMessenger::Worker-0": { 2024-06-03T00:05:39.636 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_messages": 5778, 2024-06-03T00:05:39.636 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages": 8194, 2024-06-03T00:05:39.636 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_bytes": 5794220, 2024-06-03T00:05:39.636 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_bytes": 18474053, 2024-06-03T00:05:39.636 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_created_connections": 11, 2024-06-03T00:05:39.636 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_active_connections": 3, 2024-06-03T00:05:39.636 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_total_time": 0.456110888, 2024-06-03T00:05:39.636 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_send_time": 0.177658178, 2024-06-03T00:05:39.636 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_recv_time": 0.182486632, 2024-06-03T00:05:39.636 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_fast_dispatch_time": 0.082963055, 2024-06-03T00:05:39.636 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:39.636 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 8194, 2024-06-03T00:05:39.636 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.419235055, 2024-06-03T00:05:39.637 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000051163 2024-06-03T00:05:39.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.637 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:39.637 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 6651, 2024-06-03T00:05:39.637 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.001704312, 2024-06-03T00:05:39.637 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000256 2024-06-03T00:05:39.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.637 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-03T00:05:39.637 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_encrypted_bytes": 0 2024-06-03T00:05:39.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.637 INFO:teuthology.orchestra.run.smithi057.stdout: "AsyncMessenger::Worker-1": { 2024-06-03T00:05:39.637 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_messages": 16046, 2024-06-03T00:05:39.637 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages": 27912, 2024-06-03T00:05:39.638 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_bytes": 6093991, 2024-06-03T00:05:39.638 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_bytes": 17282656, 2024-06-03T00:05:39.638 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_created_connections": 22, 2024-06-03T00:05:39.638 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_active_connections": 9, 2024-06-03T00:05:39.638 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_total_time": 0.902501148, 2024-06-03T00:05:39.638 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_send_time": 0.455121524, 2024-06-03T00:05:39.638 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_recv_time": 0.566980449, 2024-06-03T00:05:39.638 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_fast_dispatch_time": 0.051574716, 2024-06-03T00:05:39.638 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:39.638 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 27907, 2024-06-03T00:05:39.638 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.660902652, 2024-06-03T00:05:39.638 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000023682 2024-06-03T00:05:39.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.639 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:39.639 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 21006, 2024-06-03T00:05:39.639 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.005449223, 2024-06-03T00:05:39.639 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000259 2024-06-03T00:05:39.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.639 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_encrypted_bytes": 593888, 2024-06-03T00:05:39.639 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_encrypted_bytes": 130432 2024-06-03T00:05:39.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.639 INFO:teuthology.orchestra.run.smithi057.stdout: "AsyncMessenger::Worker-2": { 2024-06-03T00:05:39.639 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_messages": 1496, 2024-06-03T00:05:39.639 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages": 1510, 2024-06-03T00:05:39.639 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_bytes": 945303, 2024-06-03T00:05:39.639 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_bytes": 6726292, 2024-06-03T00:05:39.640 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_created_connections": 10, 2024-06-03T00:05:39.640 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_active_connections": 7, 2024-06-03T00:05:39.640 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_total_time": 0.124442248, 2024-06-03T00:05:39.640 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_send_time": 0.046360995, 2024-06-03T00:05:39.640 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_recv_time": 0.041267322, 2024-06-03T00:05:39.640 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_fast_dispatch_time": 0.033271645, 2024-06-03T00:05:39.640 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:39.640 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 1511, 2024-06-03T00:05:39.640 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.072263006, 2024-06-03T00:05:39.640 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000047824 2024-06-03T00:05:39.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.640 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:39.640 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 429, 2024-06-03T00:05:39.640 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000070023, 2024-06-03T00:05:39.641 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000163 2024-06-03T00:05:39.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.641 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-06-03T00:05:39.641 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_encrypted_bytes": 264784 2024-06-03T00:05:39.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.641 INFO:teuthology.orchestra.run.smithi057.stdout: "cct": { 2024-06-03T00:05:39.641 INFO:teuthology.orchestra.run.smithi057.stdout: "total_workers": 1, 2024-06-03T00:05:39.641 INFO:teuthology.orchestra.run.smithi057.stdout: "unhealthy_workers": 0 2024-06-03T00:05:39.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.641 INFO:teuthology.orchestra.run.smithi057.stdout: "finisher-MDSRank": { 2024-06-03T00:05:39.641 INFO:teuthology.orchestra.run.smithi057.stdout: "queue_len": 0, 2024-06-03T00:05:39.641 INFO:teuthology.orchestra.run.smithi057.stdout: "complete_latency": { 2024-06-03T00:05:39.641 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 4010, 2024-06-03T00:05:39.642 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 6.140286107, 2024-06-03T00:05:39.642 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.001531243 2024-06-03T00:05:39.642 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:39.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.642 INFO:teuthology.orchestra.run.smithi057.stdout: "finisher-PurgeQueue": { 2024-06-03T00:05:39.642 INFO:teuthology.orchestra.run.smithi057.stdout: "queue_len": 0, 2024-06-03T00:05:39.642 INFO:teuthology.orchestra.run.smithi057.stdout: "complete_latency": { 2024-06-03T00:05:39.642 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 5232, 2024-06-03T00:05:39.642 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.648584422, 2024-06-03T00:05:39.642 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000123964 2024-06-03T00:05:39.642 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:39.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.643 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-06-03T00:05:39.643 INFO:teuthology.orchestra.run.smithi057.stdout: "request": 7012, 2024-06-03T00:05:39.643 INFO:teuthology.orchestra.run.smithi057.stdout: "reply": 6995, 2024-06-03T00:05:39.643 INFO:teuthology.orchestra.run.smithi057.stdout: "reply_latency": { 2024-06-03T00:05:39.643 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 6995, 2024-06-03T00:05:39.643 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 19.341192508, 2024-06-03T00:05:39.643 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.002765002 2024-06-03T00:05:39.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.643 INFO:teuthology.orchestra.run.smithi057.stdout: "slow_reply": 0, 2024-06-03T00:05:39.644 INFO:teuthology.orchestra.run.smithi057.stdout: "forward": 17, 2024-06-03T00:05:39.644 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_fetch_complete": 0, 2024-06-03T00:05:39.644 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_fetch_keys": 0, 2024-06-03T00:05:39.644 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_commit": 11, 2024-06-03T00:05:39.644 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_split": 0, 2024-06-03T00:05:39.644 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_merge": 0, 2024-06-03T00:05:39.644 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes": 34, 2024-06-03T00:05:39.644 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_top": 9, 2024-06-03T00:05:39.644 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_bottom": 5, 2024-06-03T00:05:39.644 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_pin_tail": 20, 2024-06-03T00:05:39.644 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_pinned": 21, 2024-06-03T00:05:39.644 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_expired": 1684, 2024-06-03T00:05:39.645 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_with_caps": 0, 2024-06-03T00:05:39.645 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": 0, 2024-06-03T00:05:39.645 INFO:teuthology.orchestra.run.smithi057.stdout: "subtrees": 3, 2024-06-03T00:05:39.645 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse": 10204, 2024-06-03T00:05:39.645 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_hit": 9766, 2024-06-03T00:05:39.645 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_forward": 10, 2024-06-03T00:05:39.645 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_discover": 13, 2024-06-03T00:05:39.645 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_dir_fetch": 0, 2024-06-03T00:05:39.645 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_remote_ino": 0, 2024-06-03T00:05:39.645 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_lock": 0, 2024-06-03T00:05:39.645 INFO:teuthology.orchestra.run.smithi057.stdout: "load_cent": 0, 2024-06-03T00:05:39.645 INFO:teuthology.orchestra.run.smithi057.stdout: "q": 0, 2024-06-03T00:05:39.645 INFO:teuthology.orchestra.run.smithi057.stdout: "exported": 8, 2024-06-03T00:05:39.645 INFO:teuthology.orchestra.run.smithi057.stdout: "exported_inodes": 1648, 2024-06-03T00:05:39.646 INFO:teuthology.orchestra.run.smithi057.stdout: "imported": 9, 2024-06-03T00:05:39.646 INFO:teuthology.orchestra.run.smithi057.stdout: "imported_inodes": 3782, 2024-06-03T00:05:39.646 INFO:teuthology.orchestra.run.smithi057.stdout: "openino_dir_fetch": 0, 2024-06-03T00:05:39.646 INFO:teuthology.orchestra.run.smithi057.stdout: "openino_backtrace_fetch": 1533, 2024-06-03T00:05:39.646 INFO:teuthology.orchestra.run.smithi057.stdout: "openino_peer_discover": 0, 2024-06-03T00:05:39.646 INFO:teuthology.orchestra.run.smithi057.stdout: "root_rfiles": 6731, 2024-06-03T00:05:39.646 INFO:teuthology.orchestra.run.smithi057.stdout: "root_rbytes": 44994472, 2024-06-03T00:05:39.646 INFO:teuthology.orchestra.run.smithi057.stdout: "root_rsnaps": 0, 2024-06-03T00:05:39.646 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_backtrace_fetch": 1533, 2024-06-03T00:05:39.646 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_set_tag": 0, 2024-06-03T00:05:39.646 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_backtrace_repaired": 0, 2024-06-03T00:05:39.646 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_inotable_repaired": 0, 2024-06-03T00:05:39.646 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_dir_inodes": 149, 2024-06-03T00:05:39.646 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_dir_base_inodes": 0, 2024-06-03T00:05:39.647 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_dirfrag_rstats": 149, 2024-06-03T00:05:39.647 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_file_inodes": 1384, 2024-06-03T00:05:39.647 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_inode_file_caps": 0, 2024-06-03T00:05:39.647 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_revoke": 4763, 2024-06-03T00:05:39.647 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_grant": 4917, 2024-06-03T00:05:39.647 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_trunc": 62, 2024-06-03T00:05:39.647 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-03T00:05:39.647 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-03T00:05:39.647 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_caps": 6554, 2024-06-03T00:05:39.647 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_caps_dirty": 1571, 2024-06-03T00:05:39.647 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_cap_release": 49, 2024-06-03T00:05:39.647 INFO:teuthology.orchestra.run.smithi057.stdout: "process_request_cap_release": 4146 2024-06-03T00:05:39.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.647 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_cache": { 2024-06-03T00:05:39.647 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_update": 0, 2024-06-03T00:05:39.648 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_update_receipt": 0, 2024-06-03T00:05:39.648 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_try_discover": 0, 2024-06-03T00:05:39.648 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_send_discover": 16, 2024-06-03T00:05:39.648 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_handle_discover": 1, 2024-06-03T00:05:39.648 INFO:teuthology.orchestra.run.smithi057.stdout: "num_strays": 2, 2024-06-03T00:05:39.648 INFO:teuthology.orchestra.run.smithi057.stdout: "num_strays_delayed": 0, 2024-06-03T00:05:39.648 INFO:teuthology.orchestra.run.smithi057.stdout: "num_strays_enqueuing": 0, 2024-06-03T00:05:39.648 INFO:teuthology.orchestra.run.smithi057.stdout: "strays_created": 2810, 2024-06-03T00:05:39.648 INFO:teuthology.orchestra.run.smithi057.stdout: "strays_enqueued": 2774, 2024-06-03T00:05:39.648 INFO:teuthology.orchestra.run.smithi057.stdout: "strays_reintegrated": 34, 2024-06-03T00:05:39.648 INFO:teuthology.orchestra.run.smithi057.stdout: "strays_migrated": 0, 2024-06-03T00:05:39.648 INFO:teuthology.orchestra.run.smithi057.stdout: "num_recovering_processing": 0, 2024-06-03T00:05:39.648 INFO:teuthology.orchestra.run.smithi057.stdout: "num_recovering_enqueued": 0, 2024-06-03T00:05:39.648 INFO:teuthology.orchestra.run.smithi057.stdout: "num_recovering_prioritized": 0, 2024-06-03T00:05:39.649 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_started": 0, 2024-06-03T00:05:39.649 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_completed": 0, 2024-06-03T00:05:39.649 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_quiesce_path": 4, 2024-06-03T00:05:39.649 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_quiesce_inode": 7831, 2024-06-03T00:05:39.649 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_enqueue_scrub": 0, 2024-06-03T00:05:39.649 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_exportdir": 8, 2024-06-03T00:05:39.649 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_flush": 0, 2024-06-03T00:05:39.649 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_fragmentdir": 0, 2024-06-03T00:05:39.649 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_fragstats": 0, 2024-06-03T00:05:39.649 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_inodestats": 0 2024-06-03T00:05:39.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.649 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_log": { 2024-06-03T00:05:39.649 INFO:teuthology.orchestra.run.smithi057.stdout: "evlrg": 2, 2024-06-03T00:05:39.649 INFO:teuthology.orchestra.run.smithi057.stdout: "evadd": 9861, 2024-06-03T00:05:39.650 INFO:teuthology.orchestra.run.smithi057.stdout: "evex": 0, 2024-06-03T00:05:39.650 INFO:teuthology.orchestra.run.smithi057.stdout: "evtrm": 0, 2024-06-03T00:05:39.650 INFO:teuthology.orchestra.run.smithi057.stdout: "ev": 9861, 2024-06-03T00:05:39.650 INFO:teuthology.orchestra.run.smithi057.stdout: "evexg": 0, 2024-06-03T00:05:39.650 INFO:teuthology.orchestra.run.smithi057.stdout: "evexd": 0, 2024-06-03T00:05:39.650 INFO:teuthology.orchestra.run.smithi057.stdout: "segadd": 14, 2024-06-03T00:05:39.650 INFO:teuthology.orchestra.run.smithi057.stdout: "segex": 0, 2024-06-03T00:05:39.650 INFO:teuthology.orchestra.run.smithi057.stdout: "segtrm": 0, 2024-06-03T00:05:39.650 INFO:teuthology.orchestra.run.smithi057.stdout: "seg": 14, 2024-06-03T00:05:39.650 INFO:teuthology.orchestra.run.smithi057.stdout: "segmjr": 2, 2024-06-03T00:05:39.650 INFO:teuthology.orchestra.run.smithi057.stdout: "segexg": 0, 2024-06-03T00:05:39.650 INFO:teuthology.orchestra.run.smithi057.stdout: "segexd": 0, 2024-06-03T00:05:39.650 INFO:teuthology.orchestra.run.smithi057.stdout: "expos": 4194304, 2024-06-03T00:05:39.650 INFO:teuthology.orchestra.run.smithi057.stdout: "wrpos": 27842198, 2024-06-03T00:05:39.651 INFO:teuthology.orchestra.run.smithi057.stdout: "rdpos": 0, 2024-06-03T00:05:39.651 INFO:teuthology.orchestra.run.smithi057.stdout: "jlat": { 2024-06-03T00:05:39.651 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 1949, 2024-06-03T00:05:39.651 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 13.472848331, 2024-06-03T00:05:39.651 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.006912697 2024-06-03T00:05:39.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.651 INFO:teuthology.orchestra.run.smithi057.stdout: "replayed": 0 2024-06-03T00:05:39.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.651 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_mem": { 2024-06-03T00:05:39.651 INFO:teuthology.orchestra.run.smithi057.stdout: "ino": 24, 2024-06-03T00:05:39.651 INFO:teuthology.orchestra.run.smithi057.stdout: "ino+": 4336, 2024-06-03T00:05:39.651 INFO:teuthology.orchestra.run.smithi057.stdout: "ino-": 4312, 2024-06-03T00:05:39.651 INFO:teuthology.orchestra.run.smithi057.stdout: "dir": 22, 2024-06-03T00:05:39.651 INFO:teuthology.orchestra.run.smithi057.stdout: "dir+": 557, 2024-06-03T00:05:39.652 INFO:teuthology.orchestra.run.smithi057.stdout: "dir-": 535, 2024-06-03T00:05:39.652 INFO:teuthology.orchestra.run.smithi057.stdout: "dn": 73, 2024-06-03T00:05:39.652 INFO:teuthology.orchestra.run.smithi057.stdout: "dn+": 7460, 2024-06-03T00:05:39.652 INFO:teuthology.orchestra.run.smithi057.stdout: "dn-": 7387, 2024-06-03T00:05:39.652 INFO:teuthology.orchestra.run.smithi057.stdout: "cap": 0, 2024-06-03T00:05:39.652 INFO:teuthology.orchestra.run.smithi057.stdout: "cap+": 5924, 2024-06-03T00:05:39.652 INFO:teuthology.orchestra.run.smithi057.stdout: "cap-": 5924, 2024-06-03T00:05:39.652 INFO:teuthology.orchestra.run.smithi057.stdout: "rss": 116416, 2024-06-03T00:05:39.652 INFO:teuthology.orchestra.run.smithi057.stdout: "heap": 223612 2024-06-03T00:05:39.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.653 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_server": { 2024-06-03T00:05:39.653 INFO:teuthology.orchestra.run.smithi057.stdout: "dispatch_client_request": 8662, 2024-06-03T00:05:39.653 INFO:teuthology.orchestra.run.smithi057.stdout: "dispatch_server_request": 9, 2024-06-03T00:05:39.653 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_request": 7012, 2024-06-03T00:05:39.653 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_session": 79, 2024-06-03T00:05:39.653 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_peer_request": 112, 2024-06-03T00:05:39.653 INFO:teuthology.orchestra.run.smithi057.stdout: "req_create_latency": { 2024-06-03T00:05:39.653 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 269, 2024-06-03T00:05:39.653 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.580405942, 2024-06-03T00:05:39.653 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.002157642 2024-06-03T00:05:39.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.653 INFO:teuthology.orchestra.run.smithi057.stdout: "req_getattr_latency": { 2024-06-03T00:05:39.653 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 14, 2024-06-03T00:05:39.653 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.056001892, 2024-06-03T00:05:39.654 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.004000135 2024-06-03T00:05:39.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.654 INFO:teuthology.orchestra.run.smithi057.stdout: "req_getfilelock_latency": { 2024-06-03T00:05:39.654 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:39.654 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:39.654 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:39.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.654 INFO:teuthology.orchestra.run.smithi057.stdout: "req_link_latency": { 2024-06-03T00:05:39.654 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 62, 2024-06-03T00:05:39.654 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.186228781, 2024-06-03T00:05:39.654 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.003003690 2024-06-03T00:05:39.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.655 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookup_latency": { 2024-06-03T00:05:39.655 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 2667, 2024-06-03T00:05:39.655 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 8.457137878, 2024-06-03T00:05:39.655 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.003171030 2024-06-03T00:05:39.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.655 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookuphash_latency": { 2024-06-03T00:05:39.655 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:39.655 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:39.655 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:39.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.655 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookupino_latency": { 2024-06-03T00:05:39.655 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:39.655 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:39.655 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:39.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.656 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookupname_latency": { 2024-06-03T00:05:39.656 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:39.656 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:39.656 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:39.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.656 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookupparent_latency": { 2024-06-03T00:05:39.656 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:39.656 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:39.656 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:39.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.656 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookupsnap_latency": { 2024-06-03T00:05:39.656 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:39.656 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:39.657 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:39.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.657 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lssnap_latency": { 2024-06-03T00:05:39.657 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:39.658 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:39.658 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:39.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.658 INFO:teuthology.orchestra.run.smithi057.stdout: "req_mkdir_latency": { 2024-06-03T00:05:39.658 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 109, 2024-06-03T00:05:39.658 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.213180712, 2024-06-03T00:05:39.658 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.001955786 2024-06-03T00:05:39.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.658 INFO:teuthology.orchestra.run.smithi057.stdout: "req_mknod_latency": { 2024-06-03T00:05:39.658 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 144, 2024-06-03T00:05:39.658 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.307208441, 2024-06-03T00:05:39.658 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.002133391 2024-06-03T00:05:39.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.659 INFO:teuthology.orchestra.run.smithi057.stdout: "req_mksnap_latency": { 2024-06-03T00:05:39.659 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:39.659 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:39.659 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:39.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.659 INFO:teuthology.orchestra.run.smithi057.stdout: "req_open_latency": { 2024-06-03T00:05:39.659 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:39.659 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:39.659 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:39.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.659 INFO:teuthology.orchestra.run.smithi057.stdout: "req_readdir_latency": { 2024-06-03T00:05:39.659 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 469, 2024-06-03T00:05:39.659 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.406356433, 2024-06-03T00:05:39.660 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000866431 2024-06-03T00:05:39.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.660 INFO:teuthology.orchestra.run.smithi057.stdout: "req_rename_latency": { 2024-06-03T00:05:39.660 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 163, 2024-06-03T00:05:39.660 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.797352817, 2024-06-03T00:05:39.660 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.004891735 2024-06-03T00:05:39.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.660 INFO:teuthology.orchestra.run.smithi057.stdout: "req_renamesnap_latency": { 2024-06-03T00:05:39.660 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:39.660 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:39.660 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:39.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.660 INFO:teuthology.orchestra.run.smithi057.stdout: "req_snapdiff_latency": { 2024-06-03T00:05:39.660 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:39.661 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:39.661 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:39.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.661 INFO:teuthology.orchestra.run.smithi057.stdout: "req_rmdir_latency": { 2024-06-03T00:05:39.661 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 479, 2024-06-03T00:05:39.661 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 4.412943580, 2024-06-03T00:05:39.661 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.009212825 2024-06-03T00:05:39.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.661 INFO:teuthology.orchestra.run.smithi057.stdout: "req_rmsnap_latency": { 2024-06-03T00:05:39.661 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:39.661 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:39.661 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:39.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.661 INFO:teuthology.orchestra.run.smithi057.stdout: "req_rmxattr_latency": { 2024-06-03T00:05:39.662 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:39.662 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:39.662 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:39.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.662 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setattr_latency": { 2024-06-03T00:05:39.662 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 65, 2024-06-03T00:05:39.662 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.119892279, 2024-06-03T00:05:39.662 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.001844496 2024-06-03T00:05:39.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.662 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setdirlayout_latency": { 2024-06-03T00:05:39.662 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:39.662 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:39.662 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:39.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.663 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setfilelock_latency": { 2024-06-03T00:05:39.663 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:39.663 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:39.663 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:39.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.663 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setlayout_latency": { 2024-06-03T00:05:39.663 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:39.663 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:39.663 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:39.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.663 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setxattr_latency": { 2024-06-03T00:05:39.663 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:39.663 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:39.664 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:39.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.664 INFO:teuthology.orchestra.run.smithi057.stdout: "req_symlink_latency": { 2024-06-03T00:05:39.664 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 129, 2024-06-03T00:05:39.664 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.303358570, 2024-06-03T00:05:39.664 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.002351616 2024-06-03T00:05:39.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.664 INFO:teuthology.orchestra.run.smithi057.stdout: "req_unlink_latency": { 2024-06-03T00:05:39.664 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 2425, 2024-06-03T00:05:39.664 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 3.501125183, 2024-06-03T00:05:39.664 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.001443762 2024-06-03T00:05:39.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.664 INFO:teuthology.orchestra.run.smithi057.stdout: "cap_revoke_eviction": 0, 2024-06-03T00:05:39.664 INFO:teuthology.orchestra.run.smithi057.stdout: "cap_acquisition_throttle": 0, 2024-06-03T00:05:39.665 INFO:teuthology.orchestra.run.smithi057.stdout: "req_getvxattr_latency": { 2024-06-03T00:05:39.665 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:39.665 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:39.665 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:39.665 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:39.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.665 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_sessions": { 2024-06-03T00:05:39.665 INFO:teuthology.orchestra.run.smithi057.stdout: "session_count": 1, 2024-06-03T00:05:39.665 INFO:teuthology.orchestra.run.smithi057.stdout: "session_add": 2, 2024-06-03T00:05:39.665 INFO:teuthology.orchestra.run.smithi057.stdout: "session_remove": 1, 2024-06-03T00:05:39.665 INFO:teuthology.orchestra.run.smithi057.stdout: "sessions_open": 1, 2024-06-03T00:05:39.665 INFO:teuthology.orchestra.run.smithi057.stdout: "sessions_stale": 0, 2024-06-03T00:05:39.665 INFO:teuthology.orchestra.run.smithi057.stdout: "total_load": 4433, 2024-06-03T00:05:39.665 INFO:teuthology.orchestra.run.smithi057.stdout: "average_load": 4433, 2024-06-03T00:05:39.666 INFO:teuthology.orchestra.run.smithi057.stdout: "avg_session_uptime": 1803, 2024-06-03T00:05:39.666 INFO:teuthology.orchestra.run.smithi057.stdout: "mdthresh_evicted": 0 2024-06-03T00:05:39.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.666 INFO:teuthology.orchestra.run.smithi057.stdout: "mempool": { 2024-06-03T00:05:39.666 INFO:teuthology.orchestra.run.smithi057.stdout: "bloom_filter_bytes": 0, 2024-06-03T00:05:39.666 INFO:teuthology.orchestra.run.smithi057.stdout: "bloom_filter_items": 0, 2024-06-03T00:05:39.666 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_alloc_bytes": 0, 2024-06-03T00:05:39.666 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_alloc_items": 0, 2024-06-03T00:05:39.666 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_data_bytes": 0, 2024-06-03T00:05:39.666 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_data_items": 0, 2024-06-03T00:05:39.666 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-03T00:05:39.666 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_onode_items": 0, 2024-06-03T00:05:39.666 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-03T00:05:39.666 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_meta_items": 0, 2024-06-03T00:05:39.667 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_other_bytes": 0, 2024-06-03T00:05:39.667 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_other_items": 0, 2024-06-03T00:05:39.667 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-03T00:05:39.667 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_buffer_items": 0, 2024-06-03T00:05:39.667 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_extent_bytes": 0, 2024-06-03T00:05:39.667 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_extent_items": 0, 2024-06-03T00:05:39.667 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_blob_bytes": 0, 2024-06-03T00:05:39.667 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_blob_items": 0, 2024-06-03T00:05:39.667 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-03T00:05:39.667 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_shared_blob_items": 0, 2024-06-03T00:05:39.667 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-03T00:05:39.667 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_inline_bl_items": 0, 2024-06-03T00:05:39.667 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_fsck_bytes": 0, 2024-06-03T00:05:39.667 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_fsck_items": 0, 2024-06-03T00:05:39.668 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_txc_bytes": 0, 2024-06-03T00:05:39.668 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_txc_items": 0, 2024-06-03T00:05:39.668 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-03T00:05:39.668 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_writing_deferred_items": 0, 2024-06-03T00:05:39.668 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_writing_bytes": 0, 2024-06-03T00:05:39.668 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_writing_items": 0, 2024-06-03T00:05:39.668 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_bytes": 0, 2024-06-03T00:05:39.668 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_items": 0, 2024-06-03T00:05:39.668 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_file_reader_bytes": 0, 2024-06-03T00:05:39.668 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_file_reader_items": 0, 2024-06-03T00:05:39.668 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_file_writer_bytes": 0, 2024-06-03T00:05:39.668 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_file_writer_items": 0, 2024-06-03T00:05:39.668 INFO:teuthology.orchestra.run.smithi057.stdout: "buffer_anon_bytes": 295828, 2024-06-03T00:05:39.668 INFO:teuthology.orchestra.run.smithi057.stdout: "buffer_anon_items": 110, 2024-06-03T00:05:39.669 INFO:teuthology.orchestra.run.smithi057.stdout: "buffer_meta_bytes": 0, 2024-06-03T00:05:39.669 INFO:teuthology.orchestra.run.smithi057.stdout: "buffer_meta_items": 0, 2024-06-03T00:05:39.669 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_bytes": 0, 2024-06-03T00:05:39.669 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_items": 0, 2024-06-03T00:05:39.669 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mapbl_bytes": 0, 2024-06-03T00:05:39.669 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mapbl_items": 0, 2024-06-03T00:05:39.669 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pglog_bytes": 0, 2024-06-03T00:05:39.669 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pglog_items": 0, 2024-06-03T00:05:39.669 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_bytes": 7624, 2024-06-03T00:05:39.669 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_items": 160, 2024-06-03T00:05:39.669 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_mapping_bytes": 0, 2024-06-03T00:05:39.669 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_mapping_items": 0, 2024-06-03T00:05:39.669 INFO:teuthology.orchestra.run.smithi057.stdout: "pgmap_bytes": 0, 2024-06-03T00:05:39.669 INFO:teuthology.orchestra.run.smithi057.stdout: "pgmap_items": 0, 2024-06-03T00:05:39.670 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_co_bytes": 140306, 2024-06-03T00:05:39.670 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_co_items": 1593, 2024-06-03T00:05:39.670 INFO:teuthology.orchestra.run.smithi057.stdout: "unittest_1_bytes": 0, 2024-06-03T00:05:39.670 INFO:teuthology.orchestra.run.smithi057.stdout: "unittest_1_items": 0, 2024-06-03T00:05:39.670 INFO:teuthology.orchestra.run.smithi057.stdout: "unittest_2_bytes": 0, 2024-06-03T00:05:39.670 INFO:teuthology.orchestra.run.smithi057.stdout: "unittest_2_items": 0 2024-06-03T00:05:39.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.670 INFO:teuthology.orchestra.run.smithi057.stdout: "objecter": { 2024-06-03T00:05:39.670 INFO:teuthology.orchestra.run.smithi057.stdout: "op_active": 0, 2024-06-03T00:05:39.670 INFO:teuthology.orchestra.run.smithi057.stdout: "op_laggy": 0, 2024-06-03T00:05:39.670 INFO:teuthology.orchestra.run.smithi057.stdout: "op_send": 6829, 2024-06-03T00:05:39.670 INFO:teuthology.orchestra.run.smithi057.stdout: "op_send_bytes": 24179510, 2024-06-03T00:05:39.670 INFO:teuthology.orchestra.run.smithi057.stdout: "op_resend": 29, 2024-06-03T00:05:39.670 INFO:teuthology.orchestra.run.smithi057.stdout: "op_reply": 6829, 2024-06-03T00:05:39.671 INFO:teuthology.orchestra.run.smithi057.stdout: "op_latency": { 2024-06-03T00:05:39.671 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 6829, 2024-06-03T00:05:39.671 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 18.545717330, 2024-06-03T00:05:39.671 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.002715729 2024-06-03T00:05:39.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.671 INFO:teuthology.orchestra.run.smithi057.stdout: "op_inflight": 0, 2024-06-03T00:05:39.671 INFO:teuthology.orchestra.run.smithi057.stdout: "oplen_avg": { 2024-06-03T00:05:39.671 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 6829, 2024-06-03T00:05:39.671 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 6916 2024-06-03T00:05:39.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.671 INFO:teuthology.orchestra.run.smithi057.stdout: "op": 6829, 2024-06-03T00:05:39.671 INFO:teuthology.orchestra.run.smithi057.stdout: "op_r": 1594, 2024-06-03T00:05:39.671 INFO:teuthology.orchestra.run.smithi057.stdout: "op_w": 5235, 2024-06-03T00:05:39.671 INFO:teuthology.orchestra.run.smithi057.stdout: "op_rmw": 0, 2024-06-03T00:05:39.672 INFO:teuthology.orchestra.run.smithi057.stdout: "op_pg": 0, 2024-06-03T00:05:39.672 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_stat": 0, 2024-06-03T00:05:39.672 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_create": 10, 2024-06-03T00:05:39.672 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_read": 61, 2024-06-03T00:05:39.672 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_write": 2010, 2024-06-03T00:05:39.672 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_writefull": 37, 2024-06-03T00:05:39.672 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_writesame": 0, 2024-06-03T00:05:39.672 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_append": 0, 2024-06-03T00:05:39.672 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_zero": 0, 2024-06-03T00:05:39.672 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_truncate": 0, 2024-06-03T00:05:39.673 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_delete": 3054, 2024-06-03T00:05:39.673 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_mapext": 0, 2024-06-03T00:05:39.673 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_sparse_read": 0, 2024-06-03T00:05:39.673 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_clonerange": 0, 2024-06-03T00:05:39.673 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_getxattr": 1533, 2024-06-03T00:05:39.673 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_setxattr": 20, 2024-06-03T00:05:39.673 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_cmpxattr": 0, 2024-06-03T00:05:39.673 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_rmxattr": 0, 2024-06-03T00:05:39.673 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_resetxattrs": 0, 2024-06-03T00:05:39.673 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_call": 0, 2024-06-03T00:05:39.673 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_watch": 0, 2024-06-03T00:05:39.673 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_notify": 0, 2024-06-03T00:05:39.673 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_src_cmpxattr": 0, 2024-06-03T00:05:39.673 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_pgls": 0, 2024-06-03T00:05:39.674 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_pgls_filter": 0, 2024-06-03T00:05:39.674 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_other": 67, 2024-06-03T00:05:39.674 INFO:teuthology.orchestra.run.smithi057.stdout: "linger_active": 0, 2024-06-03T00:05:39.674 INFO:teuthology.orchestra.run.smithi057.stdout: "linger_send": 0, 2024-06-03T00:05:39.674 INFO:teuthology.orchestra.run.smithi057.stdout: "linger_resend": 0, 2024-06-03T00:05:39.674 INFO:teuthology.orchestra.run.smithi057.stdout: "linger_ping": 0, 2024-06-03T00:05:39.674 INFO:teuthology.orchestra.run.smithi057.stdout: "poolop_active": 0, 2024-06-03T00:05:39.674 INFO:teuthology.orchestra.run.smithi057.stdout: "poolop_send": 0, 2024-06-03T00:05:39.674 INFO:teuthology.orchestra.run.smithi057.stdout: "poolop_resend": 0, 2024-06-03T00:05:39.674 INFO:teuthology.orchestra.run.smithi057.stdout: "poolstat_active": 0, 2024-06-03T00:05:39.674 INFO:teuthology.orchestra.run.smithi057.stdout: "poolstat_send": 0, 2024-06-03T00:05:39.674 INFO:teuthology.orchestra.run.smithi057.stdout: "poolstat_resend": 0, 2024-06-03T00:05:39.674 INFO:teuthology.orchestra.run.smithi057.stdout: "statfs_active": 0, 2024-06-03T00:05:39.675 INFO:teuthology.orchestra.run.smithi057.stdout: "statfs_send": 0, 2024-06-03T00:05:39.675 INFO:teuthology.orchestra.run.smithi057.stdout: "statfs_resend": 0, 2024-06-03T00:05:39.675 INFO:teuthology.orchestra.run.smithi057.stdout: "command_active": 0, 2024-06-03T00:05:39.675 INFO:teuthology.orchestra.run.smithi057.stdout: "command_send": 0, 2024-06-03T00:05:39.675 INFO:teuthology.orchestra.run.smithi057.stdout: "command_resend": 0, 2024-06-03T00:05:39.675 INFO:teuthology.orchestra.run.smithi057.stdout: "map_epoch": 90, 2024-06-03T00:05:39.675 INFO:teuthology.orchestra.run.smithi057.stdout: "map_full": 0, 2024-06-03T00:05:39.675 INFO:teuthology.orchestra.run.smithi057.stdout: "map_inc": 2, 2024-06-03T00:05:39.675 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_sessions": 12, 2024-06-03T00:05:39.675 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_session_open": 12, 2024-06-03T00:05:39.675 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_session_close": 0, 2024-06-03T00:05:39.675 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_laggy": 0, 2024-06-03T00:05:39.675 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_wr": 91, 2024-06-03T00:05:39.675 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_rd": 0, 2024-06-03T00:05:39.676 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_del": 33 2024-06-03T00:05:39.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.676 INFO:teuthology.orchestra.run.smithi057.stdout: "oft": { 2024-06-03T00:05:39.676 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_total_objs": 1, 2024-06-03T00:05:39.676 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_total_kv_pairs": 0, 2024-06-03T00:05:39.676 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_total_updates": 0, 2024-06-03T00:05:39.676 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_total_removes": 0 2024-06-03T00:05:39.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.676 INFO:teuthology.orchestra.run.smithi057.stdout: "osd-slow-ops": { 2024-06-03T00:05:39.676 INFO:teuthology.orchestra.run.smithi057.stdout: "slow_ops_count": 7595 2024-06-03T00:05:39.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.676 INFO:teuthology.orchestra.run.smithi057.stdout: "purge_queue": { 2024-06-03T00:05:39.676 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executing_ops": 0, 2024-06-03T00:05:39.676 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executing_ops_high_water": 14, 2024-06-03T00:05:39.677 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executing": 0, 2024-06-03T00:05:39.677 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executing_high_water": 6, 2024-06-03T00:05:39.677 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executed_ops": 3037, 2024-06-03T00:05:39.677 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executed": 2774, 2024-06-03T00:05:39.677 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_item_in_journal": 0 2024-06-03T00:05:39.677 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.677 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-03T00:05:39.677 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2024-06-03T00:05:39.677 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 104857600, 2024-06-03T00:05:39.677 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2024-06-03T00:05:39.677 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 23316, 2024-06-03T00:05:39.677 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 10940224, 2024-06-03T00:05:39.677 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:39.677 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 23316, 2024-06-03T00:05:39.678 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 0, 2024-06-03T00:05:39.678 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 0, 2024-06-03T00:05:39.678 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 23316, 2024-06-03T00:05:39.678 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 10940224, 2024-06-03T00:05:39.678 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2024-06-03T00:05:39.678 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:39.678 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:39.678 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:39.678 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:39.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.678 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-objecter_bytes": { 2024-06-03T00:05:39.678 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2024-06-03T00:05:39.678 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 104857600, 2024-06-03T00:05:39.679 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2024-06-03T00:05:39.679 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 0, 2024-06-03T00:05:39.679 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 0, 2024-06-03T00:05:39.679 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:39.679 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 0, 2024-06-03T00:05:39.679 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 6829, 2024-06-03T00:05:39.679 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 24459692, 2024-06-03T00:05:39.679 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 6829, 2024-06-03T00:05:39.679 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 24459692, 2024-06-03T00:05:39.679 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2024-06-03T00:05:39.679 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:39.679 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:39.679 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:39.679 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:39.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.680 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-objecter_ops": { 2024-06-03T00:05:39.680 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2024-06-03T00:05:39.680 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 1024, 2024-06-03T00:05:39.680 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2024-06-03T00:05:39.680 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 0, 2024-06-03T00:05:39.680 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 0, 2024-06-03T00:05:39.680 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:39.680 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 0, 2024-06-03T00:05:39.680 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 6829, 2024-06-03T00:05:39.680 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 6829, 2024-06-03T00:05:39.680 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 6829, 2024-06-03T00:05:39.680 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 6829, 2024-06-03T00:05:39.680 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2024-06-03T00:05:39.680 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:39.681 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:39.681 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:39.681 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:39.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.681 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-write_buf_throttle": { 2024-06-03T00:05:39.681 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2024-06-03T00:05:39.681 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 3758096384, 2024-06-03T00:05:39.681 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2024-06-03T00:05:39.681 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 2774, 2024-06-03T00:05:39.681 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 280182, 2024-06-03T00:05:39.681 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:39.681 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 2774, 2024-06-03T00:05:39.681 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 0, 2024-06-03T00:05:39.681 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 0, 2024-06-03T00:05:39.682 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 61, 2024-06-03T00:05:39.682 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 280182, 2024-06-03T00:05:39.682 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2024-06-03T00:05:39.682 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:39.682 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:39.682 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:39.682 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:39.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:39.682 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-write_buf_throttle-0x556647b1a500": { 2024-06-03T00:05:39.682 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2024-06-03T00:05:39.682 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 3758096384, 2024-06-03T00:05:39.682 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2024-06-03T00:05:39.682 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 9861, 2024-06-03T00:05:39.683 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 23647894, 2024-06-03T00:05:39.683 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:39.683 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 9861, 2024-06-03T00:05:39.683 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 0, 2024-06-03T00:05:39.683 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 0, 2024-06-03T00:05:39.683 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 1949, 2024-06-03T00:05:39.683 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 23647894, 2024-06-03T00:05:39.683 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2024-06-03T00:05:39.683 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:39.683 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:39.683 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:39.683 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:39.683 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:39.683 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-06-03T00:05:40.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-03T00:05:40.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-03T00:05:40.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-03T00:05:40.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-03T00:05:40.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-03T00:05:40.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-03T00:05:40.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-03T00:05:40.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:40 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:05:40.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:40 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-03T00:05:40.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:40 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-03T00:05:40.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:40 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-03T00:05:40.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:40 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-03T00:05:40.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:40 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-03T00:05:40.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:40 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-03T00:05:40.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:40 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-03T00:05:40.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:40 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:05:40.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:40 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-03T00:05:40.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:40 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-03T00:05:40.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:40 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-03T00:05:40.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:40 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-03T00:05:40.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:40 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-03T00:05:40.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:40 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-03T00:05:40.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:40 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-03T00:05:40.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:40 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' 2024-06-03T00:05:40.527 INFO:tasks.check_counter:Daemon mds.b mds.exported=8 2024-06-03T00:05:40.528 INFO:tasks.check_counter:Daemon mds.b mds.imported=9 2024-06-03T00:05:40.528 DEBUG:tasks.check_counter:Getting stats from e 2024-06-03T00:05:40.528 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph daemon mds.e perf dump 2024-06-03T00:05:40.782 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.b/config 2024-06-03T00:05:41.084 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:41 smithi057 ceph-mon[36457]: pgmap v552: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 13 op/s 2024-06-03T00:05:41.085 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:41 smithi057 ceph-mon[36457]: Adjusting osd_memory_target on smithi049 to 176.1M 2024-06-03T00:05:41.085 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:41 smithi057 ceph-mon[36457]: Unable to set osd_memory_target on smithi049 to 184710758: error parsing value: Value '184710758' is below minimum 939524096 2024-06-03T00:05:41.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:41 smithi107 ceph-mon[37048]: pgmap v552: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 13 op/s 2024-06-03T00:05:41.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:41 smithi107 ceph-mon[37048]: Adjusting osd_memory_target on smithi049 to 176.1M 2024-06-03T00:05:41.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:41 smithi107 ceph-mon[37048]: Unable to set osd_memory_target on smithi049 to 184710758: error parsing value: Value '184710758' is below minimum 939524096 2024-06-03T00:05:41.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:41 smithi049 ceph-mon[32302]: pgmap v552: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 13 op/s 2024-06-03T00:05:41.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:41 smithi049 ceph-mon[32302]: Adjusting osd_memory_target on smithi049 to 176.1M 2024-06-03T00:05:41.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:41 smithi049 ceph-mon[32302]: Unable to set osd_memory_target on smithi049 to 184710758: error parsing value: Value '184710758' is below minimum 939524096 2024-06-03T00:05:42.670 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-06-03T00:05:42.670 INFO:teuthology.orchestra.run.smithi057.stdout: "AsyncMessenger::Worker-0": { 2024-06-03T00:05:42.670 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_messages": 994, 2024-06-03T00:05:42.670 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages": 996, 2024-06-03T00:05:42.670 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_bytes": 25463052, 2024-06-03T00:05:42.671 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_bytes": 316102, 2024-06-03T00:05:42.671 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_created_connections": 7, 2024-06-03T00:05:42.671 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_active_connections": 3, 2024-06-03T00:05:42.671 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_total_time": 0.108488540, 2024-06-03T00:05:42.671 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_send_time": 0.034217495, 2024-06-03T00:05:42.671 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_recv_time": 0.038273619, 2024-06-03T00:05:42.671 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_fast_dispatch_time": 0.026679583, 2024-06-03T00:05:42.671 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:42.671 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 994, 2024-06-03T00:05:42.671 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.036636683, 2024-06-03T00:05:42.672 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000036857 2024-06-03T00:05:42.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.672 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:42.672 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.672 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.672 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.672 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-03T00:05:42.672 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_encrypted_bytes": 0 2024-06-03T00:05:42.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.672 INFO:teuthology.orchestra.run.smithi057.stdout: "AsyncMessenger::Worker-1": { 2024-06-03T00:05:42.672 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_messages": 256, 2024-06-03T00:05:42.673 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages": 237, 2024-06-03T00:05:42.673 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_bytes": 21565716, 2024-06-03T00:05:42.673 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_bytes": 117110, 2024-06-03T00:05:42.673 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_created_connections": 5, 2024-06-03T00:05:42.673 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_active_connections": 4, 2024-06-03T00:05:42.673 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_total_time": 0.042886501, 2024-06-03T00:05:42.673 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_send_time": 0.011135620, 2024-06-03T00:05:42.673 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_recv_time": 0.027148990, 2024-06-03T00:05:42.673 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_fast_dispatch_time": 0.005602829, 2024-06-03T00:05:42.673 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:42.673 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 237, 2024-06-03T00:05:42.673 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.013853403, 2024-06-03T00:05:42.674 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000058453 2024-06-03T00:05:42.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.674 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:42.674 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.674 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.674 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.674 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_encrypted_bytes": 573600, 2024-06-03T00:05:42.674 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_encrypted_bytes": 92240 2024-06-03T00:05:42.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.674 INFO:teuthology.orchestra.run.smithi057.stdout: "AsyncMessenger::Worker-2": { 2024-06-03T00:05:42.675 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_messages": 570, 2024-06-03T00:05:42.675 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages": 681, 2024-06-03T00:05:42.675 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_bytes": 14296071, 2024-06-03T00:05:42.675 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_bytes": 446063, 2024-06-03T00:05:42.675 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_created_connections": 6, 2024-06-03T00:05:42.675 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_active_connections": 5, 2024-06-03T00:05:42.675 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_total_time": 0.062861451, 2024-06-03T00:05:42.675 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_send_time": 0.017939348, 2024-06-03T00:05:42.675 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_recv_time": 0.022070072, 2024-06-03T00:05:42.675 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_fast_dispatch_time": 0.017475768, 2024-06-03T00:05:42.675 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:42.675 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 679, 2024-06-03T00:05:42.675 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.023151121, 2024-06-03T00:05:42.675 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000034095 2024-06-03T00:05:42.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.676 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:42.676 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.676 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.676 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.676 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_encrypted_bytes": 160, 2024-06-03T00:05:42.676 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_encrypted_bytes": 265120 2024-06-03T00:05:42.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.676 INFO:teuthology.orchestra.run.smithi057.stdout: "cct": { 2024-06-03T00:05:42.676 INFO:teuthology.orchestra.run.smithi057.stdout: "total_workers": 1, 2024-06-03T00:05:42.676 INFO:teuthology.orchestra.run.smithi057.stdout: "unhealthy_workers": 0 2024-06-03T00:05:42.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.677 INFO:teuthology.orchestra.run.smithi057.stdout: "finisher-MDSRank": { 2024-06-03T00:05:42.677 INFO:teuthology.orchestra.run.smithi057.stdout: "queue_len": 0, 2024-06-03T00:05:42.677 INFO:teuthology.orchestra.run.smithi057.stdout: "complete_latency": { 2024-06-03T00:05:42.677 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 2711, 2024-06-03T00:05:42.677 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.247925274, 2024-06-03T00:05:42.677 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000091451 2024-06-03T00:05:42.677 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:42.677 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.677 INFO:teuthology.orchestra.run.smithi057.stdout: "finisher-PurgeQueue": { 2024-06-03T00:05:42.677 INFO:teuthology.orchestra.run.smithi057.stdout: "queue_len": 0, 2024-06-03T00:05:42.677 INFO:teuthology.orchestra.run.smithi057.stdout: "complete_latency": { 2024-06-03T00:05:42.677 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.677 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.678 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.678 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:42.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.678 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-06-03T00:05:42.678 INFO:teuthology.orchestra.run.smithi057.stdout: "request": 0, 2024-06-03T00:05:42.678 INFO:teuthology.orchestra.run.smithi057.stdout: "reply": 0, 2024-06-03T00:05:42.678 INFO:teuthology.orchestra.run.smithi057.stdout: "reply_latency": { 2024-06-03T00:05:42.678 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.678 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.678 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.678 INFO:teuthology.orchestra.run.smithi057.stdout: "slow_reply": 0, 2024-06-03T00:05:42.678 INFO:teuthology.orchestra.run.smithi057.stdout: "forward": 0, 2024-06-03T00:05:42.679 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_fetch_complete": 0, 2024-06-03T00:05:42.679 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_fetch_keys": 0, 2024-06-03T00:05:42.679 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_commit": 0, 2024-06-03T00:05:42.679 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_split": 0, 2024-06-03T00:05:42.679 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_merge": 0, 2024-06-03T00:05:42.679 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes": 1778, 2024-06-03T00:05:42.679 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_top": 1125, 2024-06-03T00:05:42.679 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_bottom": 653, 2024-06-03T00:05:42.679 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_pin_tail": 0, 2024-06-03T00:05:42.679 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_pinned": 170, 2024-06-03T00:05:42.679 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_expired": 0, 2024-06-03T00:05:42.679 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_with_caps": 0, 2024-06-03T00:05:42.679 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": 0, 2024-06-03T00:05:42.679 INFO:teuthology.orchestra.run.smithi057.stdout: "subtrees": 2, 2024-06-03T00:05:42.680 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse": 0, 2024-06-03T00:05:42.680 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_hit": 0, 2024-06-03T00:05:42.680 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_forward": 0, 2024-06-03T00:05:42.680 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_discover": 0, 2024-06-03T00:05:42.680 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_dir_fetch": 0, 2024-06-03T00:05:42.680 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_remote_ino": 0, 2024-06-03T00:05:42.680 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_lock": 0, 2024-06-03T00:05:42.680 INFO:teuthology.orchestra.run.smithi057.stdout: "load_cent": 0, 2024-06-03T00:05:42.680 INFO:teuthology.orchestra.run.smithi057.stdout: "q": 0, 2024-06-03T00:05:42.680 INFO:teuthology.orchestra.run.smithi057.stdout: "exported": 0, 2024-06-03T00:05:42.680 INFO:teuthology.orchestra.run.smithi057.stdout: "exported_inodes": 0, 2024-06-03T00:05:42.680 INFO:teuthology.orchestra.run.smithi057.stdout: "imported": 0, 2024-06-03T00:05:42.680 INFO:teuthology.orchestra.run.smithi057.stdout: "imported_inodes": 0, 2024-06-03T00:05:42.681 INFO:teuthology.orchestra.run.smithi057.stdout: "openino_dir_fetch": 0, 2024-06-03T00:05:42.681 INFO:teuthology.orchestra.run.smithi057.stdout: "openino_backtrace_fetch": 0, 2024-06-03T00:05:42.681 INFO:teuthology.orchestra.run.smithi057.stdout: "openino_peer_discover": 0, 2024-06-03T00:05:42.681 INFO:teuthology.orchestra.run.smithi057.stdout: "root_rfiles": 4, 2024-06-03T00:05:42.681 INFO:teuthology.orchestra.run.smithi057.stdout: "root_rbytes": 234, 2024-06-03T00:05:42.681 INFO:teuthology.orchestra.run.smithi057.stdout: "root_rsnaps": 0, 2024-06-03T00:05:42.681 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_backtrace_fetch": 0, 2024-06-03T00:05:42.681 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_set_tag": 0, 2024-06-03T00:05:42.681 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_backtrace_repaired": 0, 2024-06-03T00:05:42.681 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_inotable_repaired": 0, 2024-06-03T00:05:42.681 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_dir_inodes": 0, 2024-06-03T00:05:42.681 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_dir_base_inodes": 0, 2024-06-03T00:05:42.681 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_dirfrag_rstats": 0, 2024-06-03T00:05:42.681 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_file_inodes": 0, 2024-06-03T00:05:42.682 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_inode_file_caps": 0, 2024-06-03T00:05:42.682 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_revoke": 0, 2024-06-03T00:05:42.682 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_grant": 0, 2024-06-03T00:05:42.682 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_trunc": 0, 2024-06-03T00:05:42.682 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-03T00:05:42.682 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-03T00:05:42.682 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_caps": 0, 2024-06-03T00:05:42.682 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_caps_dirty": 0, 2024-06-03T00:05:42.682 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_cap_release": 0, 2024-06-03T00:05:42.682 INFO:teuthology.orchestra.run.smithi057.stdout: "process_request_cap_release": 0 2024-06-03T00:05:42.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.682 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_cache": { 2024-06-03T00:05:42.682 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_update": 0, 2024-06-03T00:05:42.682 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_update_receipt": 0, 2024-06-03T00:05:42.683 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_try_discover": 0, 2024-06-03T00:05:42.683 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_send_discover": 0, 2024-06-03T00:05:42.683 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_handle_discover": 0, 2024-06-03T00:05:42.683 INFO:teuthology.orchestra.run.smithi057.stdout: "num_strays": 0, 2024-06-03T00:05:42.683 INFO:teuthology.orchestra.run.smithi057.stdout: "num_strays_delayed": 0, 2024-06-03T00:05:42.683 INFO:teuthology.orchestra.run.smithi057.stdout: "num_strays_enqueuing": 0, 2024-06-03T00:05:42.683 INFO:teuthology.orchestra.run.smithi057.stdout: "strays_created": 0, 2024-06-03T00:05:42.683 INFO:teuthology.orchestra.run.smithi057.stdout: "strays_enqueued": 0, 2024-06-03T00:05:42.683 INFO:teuthology.orchestra.run.smithi057.stdout: "strays_reintegrated": 0, 2024-06-03T00:05:42.683 INFO:teuthology.orchestra.run.smithi057.stdout: "strays_migrated": 0, 2024-06-03T00:05:42.683 INFO:teuthology.orchestra.run.smithi057.stdout: "num_recovering_processing": 0, 2024-06-03T00:05:42.683 INFO:teuthology.orchestra.run.smithi057.stdout: "num_recovering_enqueued": 0, 2024-06-03T00:05:42.683 INFO:teuthology.orchestra.run.smithi057.stdout: "num_recovering_prioritized": 0, 2024-06-03T00:05:42.683 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_started": 0, 2024-06-03T00:05:42.684 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_completed": 0, 2024-06-03T00:05:42.684 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_quiesce_path": 0, 2024-06-03T00:05:42.684 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_quiesce_inode": 0, 2024-06-03T00:05:42.684 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_enqueue_scrub": 0, 2024-06-03T00:05:42.684 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_exportdir": 0, 2024-06-03T00:05:42.684 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_flush": 0, 2024-06-03T00:05:42.684 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_fragmentdir": 0, 2024-06-03T00:05:42.684 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_fragstats": 0, 2024-06-03T00:05:42.684 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_inodestats": 0 2024-06-03T00:05:42.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.684 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_log": { 2024-06-03T00:05:42.684 INFO:teuthology.orchestra.run.smithi057.stdout: "evlrg": 0, 2024-06-03T00:05:42.684 INFO:teuthology.orchestra.run.smithi057.stdout: "evadd": 0, 2024-06-03T00:05:42.685 INFO:teuthology.orchestra.run.smithi057.stdout: "evex": 0, 2024-06-03T00:05:42.685 INFO:teuthology.orchestra.run.smithi057.stdout: "evtrm": 0, 2024-06-03T00:05:42.685 INFO:teuthology.orchestra.run.smithi057.stdout: "ev": 27803, 2024-06-03T00:05:42.685 INFO:teuthology.orchestra.run.smithi057.stdout: "evexg": 0, 2024-06-03T00:05:42.685 INFO:teuthology.orchestra.run.smithi057.stdout: "evexd": 0, 2024-06-03T00:05:42.685 INFO:teuthology.orchestra.run.smithi057.stdout: "segadd": 0, 2024-06-03T00:05:42.685 INFO:teuthology.orchestra.run.smithi057.stdout: "segex": 0, 2024-06-03T00:05:42.685 INFO:teuthology.orchestra.run.smithi057.stdout: "segtrm": 0, 2024-06-03T00:05:42.685 INFO:teuthology.orchestra.run.smithi057.stdout: "seg": 2, 2024-06-03T00:05:42.685 INFO:teuthology.orchestra.run.smithi057.stdout: "segmjr": 23, 2024-06-03T00:05:42.685 INFO:teuthology.orchestra.run.smithi057.stdout: "segexg": 0, 2024-06-03T00:05:42.685 INFO:teuthology.orchestra.run.smithi057.stdout: "segexd": 0, 2024-06-03T00:05:42.685 INFO:teuthology.orchestra.run.smithi057.stdout: "expos": 64375184, 2024-06-03T00:05:42.685 INFO:teuthology.orchestra.run.smithi057.stdout: "wrpos": 64485169, 2024-06-03T00:05:42.685 INFO:teuthology.orchestra.run.smithi057.stdout: "rdpos": 64484570, 2024-06-03T00:05:42.686 INFO:teuthology.orchestra.run.smithi057.stdout: "jlat": { 2024-06-03T00:05:42.686 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.686 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.686 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.686 INFO:teuthology.orchestra.run.smithi057.stdout: "replayed": 27803 2024-06-03T00:05:42.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.686 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_mem": { 2024-06-03T00:05:42.686 INFO:teuthology.orchestra.run.smithi057.stdout: "ino": 22, 2024-06-03T00:05:42.686 INFO:teuthology.orchestra.run.smithi057.stdout: "ino+": 12862, 2024-06-03T00:05:42.686 INFO:teuthology.orchestra.run.smithi057.stdout: "ino-": 12840, 2024-06-03T00:05:42.686 INFO:teuthology.orchestra.run.smithi057.stdout: "dir": 24, 2024-06-03T00:05:42.686 INFO:teuthology.orchestra.run.smithi057.stdout: "dir+": 1586, 2024-06-03T00:05:42.686 INFO:teuthology.orchestra.run.smithi057.stdout: "dir-": 1562, 2024-06-03T00:05:42.687 INFO:teuthology.orchestra.run.smithi057.stdout: "dn": 1778, 2024-06-03T00:05:42.687 INFO:teuthology.orchestra.run.smithi057.stdout: "dn+": 14872, 2024-06-03T00:05:42.687 INFO:teuthology.orchestra.run.smithi057.stdout: "dn-": 13094, 2024-06-03T00:05:42.687 INFO:teuthology.orchestra.run.smithi057.stdout: "cap": 0, 2024-06-03T00:05:42.687 INFO:teuthology.orchestra.run.smithi057.stdout: "cap+": 0, 2024-06-03T00:05:42.687 INFO:teuthology.orchestra.run.smithi057.stdout: "cap-": 0, 2024-06-03T00:05:42.687 INFO:teuthology.orchestra.run.smithi057.stdout: "rss": 68728, 2024-06-03T00:05:42.687 INFO:teuthology.orchestra.run.smithi057.stdout: "heap": 215420 2024-06-03T00:05:42.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.687 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_server": { 2024-06-03T00:05:42.687 INFO:teuthology.orchestra.run.smithi057.stdout: "dispatch_client_request": 0, 2024-06-03T00:05:42.687 INFO:teuthology.orchestra.run.smithi057.stdout: "dispatch_server_request": 0, 2024-06-03T00:05:42.687 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_request": 0, 2024-06-03T00:05:42.687 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_session": 0, 2024-06-03T00:05:42.687 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_peer_request": 0, 2024-06-03T00:05:42.688 INFO:teuthology.orchestra.run.smithi057.stdout: "req_create_latency": { 2024-06-03T00:05:42.688 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.688 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.688 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.688 INFO:teuthology.orchestra.run.smithi057.stdout: "req_getattr_latency": { 2024-06-03T00:05:42.688 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.688 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.688 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.688 INFO:teuthology.orchestra.run.smithi057.stdout: "req_getfilelock_latency": { 2024-06-03T00:05:42.688 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.688 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.688 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.689 INFO:teuthology.orchestra.run.smithi057.stdout: "req_link_latency": { 2024-06-03T00:05:42.689 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.689 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.689 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.689 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookup_latency": { 2024-06-03T00:05:42.689 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.689 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.689 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.689 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookuphash_latency": { 2024-06-03T00:05:42.689 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.689 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.690 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.690 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookupino_latency": { 2024-06-03T00:05:42.690 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.690 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.690 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.690 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookupname_latency": { 2024-06-03T00:05:42.690 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.690 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.690 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.690 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookupparent_latency": { 2024-06-03T00:05:42.690 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.691 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.691 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.691 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookupsnap_latency": { 2024-06-03T00:05:42.691 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.691 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.691 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.691 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lssnap_latency": { 2024-06-03T00:05:42.691 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.691 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.691 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.692 INFO:teuthology.orchestra.run.smithi057.stdout: "req_mkdir_latency": { 2024-06-03T00:05:42.692 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.692 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.692 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.692 INFO:teuthology.orchestra.run.smithi057.stdout: "req_mknod_latency": { 2024-06-03T00:05:42.692 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.693 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.693 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.693 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.693 INFO:teuthology.orchestra.run.smithi057.stdout: "req_mksnap_latency": { 2024-06-03T00:05:42.693 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.693 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.693 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.693 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.693 INFO:teuthology.orchestra.run.smithi057.stdout: "req_open_latency": { 2024-06-03T00:05:42.693 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.693 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.693 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.693 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.693 INFO:teuthology.orchestra.run.smithi057.stdout: "req_readdir_latency": { 2024-06-03T00:05:42.693 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.694 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.694 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.694 INFO:teuthology.orchestra.run.smithi057.stdout: "req_rename_latency": { 2024-06-03T00:05:42.694 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.694 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.694 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.694 INFO:teuthology.orchestra.run.smithi057.stdout: "req_renamesnap_latency": { 2024-06-03T00:05:42.694 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.694 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.695 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.695 INFO:teuthology.orchestra.run.smithi057.stdout: "req_snapdiff_latency": { 2024-06-03T00:05:42.695 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.695 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.695 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.695 INFO:teuthology.orchestra.run.smithi057.stdout: "req_rmdir_latency": { 2024-06-03T00:05:42.695 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.695 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.695 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.695 INFO:teuthology.orchestra.run.smithi057.stdout: "req_rmsnap_latency": { 2024-06-03T00:05:42.696 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.696 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.696 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.696 INFO:teuthology.orchestra.run.smithi057.stdout: "req_rmxattr_latency": { 2024-06-03T00:05:42.696 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.696 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.696 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.696 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setattr_latency": { 2024-06-03T00:05:42.696 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.697 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.697 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.698 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setdirlayout_latency": { 2024-06-03T00:05:42.698 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.698 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.698 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.699 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setfilelock_latency": { 2024-06-03T00:05:42.699 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.699 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.699 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.699 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setlayout_latency": { 2024-06-03T00:05:42.700 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.700 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.700 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.701 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setxattr_latency": { 2024-06-03T00:05:42.701 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.701 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.701 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.701 INFO:teuthology.orchestra.run.smithi057.stdout: "req_symlink_latency": { 2024-06-03T00:05:42.701 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.701 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.701 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.701 INFO:teuthology.orchestra.run.smithi057.stdout: "req_unlink_latency": { 2024-06-03T00:05:42.701 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.701 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.701 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.702 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.702 INFO:teuthology.orchestra.run.smithi057.stdout: "cap_revoke_eviction": 0, 2024-06-03T00:05:42.702 INFO:teuthology.orchestra.run.smithi057.stdout: "cap_acquisition_throttle": 0, 2024-06-03T00:05:42.702 INFO:teuthology.orchestra.run.smithi057.stdout: "req_getvxattr_latency": { 2024-06-03T00:05:42.702 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.702 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.702 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.702 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:42.702 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.702 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_sessions": { 2024-06-03T00:05:42.702 INFO:teuthology.orchestra.run.smithi057.stdout: "session_count": 1, 2024-06-03T00:05:42.702 INFO:teuthology.orchestra.run.smithi057.stdout: "session_add": 2, 2024-06-03T00:05:42.702 INFO:teuthology.orchestra.run.smithi057.stdout: "session_remove": 1, 2024-06-03T00:05:42.702 INFO:teuthology.orchestra.run.smithi057.stdout: "sessions_open": 1, 2024-06-03T00:05:42.703 INFO:teuthology.orchestra.run.smithi057.stdout: "sessions_stale": 0, 2024-06-03T00:05:42.703 INFO:teuthology.orchestra.run.smithi057.stdout: "total_load": 0, 2024-06-03T00:05:42.703 INFO:teuthology.orchestra.run.smithi057.stdout: "average_load": 0, 2024-06-03T00:05:42.703 INFO:teuthology.orchestra.run.smithi057.stdout: "avg_session_uptime": 1808, 2024-06-03T00:05:42.703 INFO:teuthology.orchestra.run.smithi057.stdout: "mdthresh_evicted": 0 2024-06-03T00:05:42.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.703 INFO:teuthology.orchestra.run.smithi057.stdout: "mempool": { 2024-06-03T00:05:42.703 INFO:teuthology.orchestra.run.smithi057.stdout: "bloom_filter_bytes": 0, 2024-06-03T00:05:42.703 INFO:teuthology.orchestra.run.smithi057.stdout: "bloom_filter_items": 0, 2024-06-03T00:05:42.703 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_alloc_bytes": 0, 2024-06-03T00:05:42.703 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_alloc_items": 0, 2024-06-03T00:05:42.703 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_data_bytes": 0, 2024-06-03T00:05:42.703 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_data_items": 0, 2024-06-03T00:05:42.703 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-03T00:05:42.704 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_onode_items": 0, 2024-06-03T00:05:42.704 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-03T00:05:42.704 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_meta_items": 0, 2024-06-03T00:05:42.704 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_other_bytes": 0, 2024-06-03T00:05:42.704 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_other_items": 0, 2024-06-03T00:05:42.704 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-03T00:05:42.704 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_buffer_items": 0, 2024-06-03T00:05:42.704 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_extent_bytes": 0, 2024-06-03T00:05:42.704 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_extent_items": 0, 2024-06-03T00:05:42.704 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_blob_bytes": 0, 2024-06-03T00:05:42.704 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_blob_items": 0, 2024-06-03T00:05:42.704 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-03T00:05:42.704 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_shared_blob_items": 0, 2024-06-03T00:05:42.705 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-03T00:05:42.705 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_inline_bl_items": 0, 2024-06-03T00:05:42.705 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_fsck_bytes": 0, 2024-06-03T00:05:42.705 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_fsck_items": 0, 2024-06-03T00:05:42.705 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_txc_bytes": 0, 2024-06-03T00:05:42.705 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_txc_items": 0, 2024-06-03T00:05:42.705 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-03T00:05:42.705 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_writing_deferred_items": 0, 2024-06-03T00:05:42.705 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_writing_bytes": 0, 2024-06-03T00:05:42.705 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_writing_items": 0, 2024-06-03T00:05:42.705 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_bytes": 0, 2024-06-03T00:05:42.705 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_items": 0, 2024-06-03T00:05:42.705 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_file_reader_bytes": 0, 2024-06-03T00:05:42.705 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_file_reader_items": 0, 2024-06-03T00:05:42.706 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_file_writer_bytes": 0, 2024-06-03T00:05:42.706 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_file_writer_items": 0, 2024-06-03T00:05:42.706 INFO:teuthology.orchestra.run.smithi057.stdout: "buffer_anon_bytes": 222524, 2024-06-03T00:05:42.706 INFO:teuthology.orchestra.run.smithi057.stdout: "buffer_anon_items": 69, 2024-06-03T00:05:42.706 INFO:teuthology.orchestra.run.smithi057.stdout: "buffer_meta_bytes": 0, 2024-06-03T00:05:42.706 INFO:teuthology.orchestra.run.smithi057.stdout: "buffer_meta_items": 0, 2024-06-03T00:05:42.706 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_bytes": 0, 2024-06-03T00:05:42.706 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_items": 0, 2024-06-03T00:05:42.706 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mapbl_bytes": 0, 2024-06-03T00:05:42.706 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mapbl_items": 0, 2024-06-03T00:05:42.706 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pglog_bytes": 0, 2024-06-03T00:05:42.706 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pglog_items": 0, 2024-06-03T00:05:42.706 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_bytes": 7624, 2024-06-03T00:05:42.707 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_items": 160, 2024-06-03T00:05:42.707 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_mapping_bytes": 0, 2024-06-03T00:05:42.707 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_mapping_items": 0, 2024-06-03T00:05:42.707 INFO:teuthology.orchestra.run.smithi057.stdout: "pgmap_bytes": 0, 2024-06-03T00:05:42.707 INFO:teuthology.orchestra.run.smithi057.stdout: "pgmap_items": 0, 2024-06-03T00:05:42.707 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_co_bytes": 1331012, 2024-06-03T00:05:42.707 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_co_items": 7513, 2024-06-03T00:05:42.707 INFO:teuthology.orchestra.run.smithi057.stdout: "unittest_1_bytes": 0, 2024-06-03T00:05:42.707 INFO:teuthology.orchestra.run.smithi057.stdout: "unittest_1_items": 0, 2024-06-03T00:05:42.707 INFO:teuthology.orchestra.run.smithi057.stdout: "unittest_2_bytes": 0, 2024-06-03T00:05:42.707 INFO:teuthology.orchestra.run.smithi057.stdout: "unittest_2_items": 0 2024-06-03T00:05:42.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.707 INFO:teuthology.orchestra.run.smithi057.stdout: "objecter": { 2024-06-03T00:05:42.707 INFO:teuthology.orchestra.run.smithi057.stdout: "op_active": 0, 2024-06-03T00:05:42.708 INFO:teuthology.orchestra.run.smithi057.stdout: "op_laggy": 0, 2024-06-03T00:05:42.708 INFO:teuthology.orchestra.run.smithi057.stdout: "op_send": 1641, 2024-06-03T00:05:42.708 INFO:teuthology.orchestra.run.smithi057.stdout: "op_send_bytes": 26, 2024-06-03T00:05:42.708 INFO:teuthology.orchestra.run.smithi057.stdout: "op_resend": 4, 2024-06-03T00:05:42.708 INFO:teuthology.orchestra.run.smithi057.stdout: "op_reply": 1641, 2024-06-03T00:05:42.708 INFO:teuthology.orchestra.run.smithi057.stdout: "op_latency": { 2024-06-03T00:05:42.708 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 1641, 2024-06-03T00:05:42.708 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 1.056983947, 2024-06-03T00:05:42.708 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000644109 2024-06-03T00:05:42.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.708 INFO:teuthology.orchestra.run.smithi057.stdout: "op_inflight": 0, 2024-06-03T00:05:42.708 INFO:teuthology.orchestra.run.smithi057.stdout: "oplen_avg": { 2024-06-03T00:05:42.708 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 1641, 2024-06-03T00:05:42.708 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 1642 2024-06-03T00:05:42.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.709 INFO:teuthology.orchestra.run.smithi057.stdout: "op": 1641, 2024-06-03T00:05:42.709 INFO:teuthology.orchestra.run.smithi057.stdout: "op_r": 1641, 2024-06-03T00:05:42.709 INFO:teuthology.orchestra.run.smithi057.stdout: "op_w": 0, 2024-06-03T00:05:42.709 INFO:teuthology.orchestra.run.smithi057.stdout: "op_rmw": 0, 2024-06-03T00:05:42.709 INFO:teuthology.orchestra.run.smithi057.stdout: "op_pg": 0, 2024-06-03T00:05:42.709 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_stat": 1006, 2024-06-03T00:05:42.709 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_create": 0, 2024-06-03T00:05:42.709 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_read": 632, 2024-06-03T00:05:42.709 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_write": 0, 2024-06-03T00:05:42.709 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_writefull": 0, 2024-06-03T00:05:42.709 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_writesame": 0, 2024-06-03T00:05:42.709 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_append": 0, 2024-06-03T00:05:42.709 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_zero": 0, 2024-06-03T00:05:42.709 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_truncate": 0, 2024-06-03T00:05:42.710 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_delete": 0, 2024-06-03T00:05:42.710 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_mapext": 0, 2024-06-03T00:05:42.710 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_sparse_read": 0, 2024-06-03T00:05:42.710 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_clonerange": 0, 2024-06-03T00:05:42.710 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_getxattr": 2, 2024-06-03T00:05:42.710 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_setxattr": 0, 2024-06-03T00:05:42.710 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_cmpxattr": 0, 2024-06-03T00:05:42.710 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_rmxattr": 0, 2024-06-03T00:05:42.710 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_resetxattrs": 0, 2024-06-03T00:05:42.710 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_call": 0, 2024-06-03T00:05:42.710 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_watch": 0, 2024-06-03T00:05:42.710 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_notify": 0, 2024-06-03T00:05:42.710 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_src_cmpxattr": 0, 2024-06-03T00:05:42.711 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_pgls": 0, 2024-06-03T00:05:42.711 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_pgls_filter": 0, 2024-06-03T00:05:42.711 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_other": 0, 2024-06-03T00:05:42.711 INFO:teuthology.orchestra.run.smithi057.stdout: "linger_active": 0, 2024-06-03T00:05:42.711 INFO:teuthology.orchestra.run.smithi057.stdout: "linger_send": 0, 2024-06-03T00:05:42.711 INFO:teuthology.orchestra.run.smithi057.stdout: "linger_resend": 0, 2024-06-03T00:05:42.711 INFO:teuthology.orchestra.run.smithi057.stdout: "linger_ping": 0, 2024-06-03T00:05:42.711 INFO:teuthology.orchestra.run.smithi057.stdout: "poolop_active": 0, 2024-06-03T00:05:42.711 INFO:teuthology.orchestra.run.smithi057.stdout: "poolop_send": 0, 2024-06-03T00:05:42.711 INFO:teuthology.orchestra.run.smithi057.stdout: "poolop_resend": 0, 2024-06-03T00:05:42.711 INFO:teuthology.orchestra.run.smithi057.stdout: "poolstat_active": 0, 2024-06-03T00:05:42.711 INFO:teuthology.orchestra.run.smithi057.stdout: "poolstat_send": 0, 2024-06-03T00:05:42.711 INFO:teuthology.orchestra.run.smithi057.stdout: "poolstat_resend": 0, 2024-06-03T00:05:42.711 INFO:teuthology.orchestra.run.smithi057.stdout: "statfs_active": 0, 2024-06-03T00:05:42.712 INFO:teuthology.orchestra.run.smithi057.stdout: "statfs_send": 0, 2024-06-03T00:05:42.712 INFO:teuthology.orchestra.run.smithi057.stdout: "statfs_resend": 0, 2024-06-03T00:05:42.712 INFO:teuthology.orchestra.run.smithi057.stdout: "command_active": 0, 2024-06-03T00:05:42.712 INFO:teuthology.orchestra.run.smithi057.stdout: "command_send": 0, 2024-06-03T00:05:42.712 INFO:teuthology.orchestra.run.smithi057.stdout: "command_resend": 0, 2024-06-03T00:05:42.712 INFO:teuthology.orchestra.run.smithi057.stdout: "map_epoch": 90, 2024-06-03T00:05:42.712 INFO:teuthology.orchestra.run.smithi057.stdout: "map_full": 0, 2024-06-03T00:05:42.712 INFO:teuthology.orchestra.run.smithi057.stdout: "map_inc": 2, 2024-06-03T00:05:42.712 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_sessions": 9, 2024-06-03T00:05:42.712 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_session_open": 9, 2024-06-03T00:05:42.712 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_session_close": 0, 2024-06-03T00:05:42.712 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_laggy": 0, 2024-06-03T00:05:42.712 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_wr": 0, 2024-06-03T00:05:42.712 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_rd": 2, 2024-06-03T00:05:42.713 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_del": 0 2024-06-03T00:05:42.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.713 INFO:teuthology.orchestra.run.smithi057.stdout: "oft": { 2024-06-03T00:05:42.713 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_total_objs": 0, 2024-06-03T00:05:42.713 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_total_kv_pairs": 0, 2024-06-03T00:05:42.713 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_total_updates": 0, 2024-06-03T00:05:42.713 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_total_removes": 0 2024-06-03T00:05:42.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.713 INFO:teuthology.orchestra.run.smithi057.stdout: "osd-slow-ops": { 2024-06-03T00:05:42.713 INFO:teuthology.orchestra.run.smithi057.stdout: "slow_ops_count": 0 2024-06-03T00:05:42.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.714 INFO:teuthology.orchestra.run.smithi057.stdout: "purge_queue": { 2024-06-03T00:05:42.714 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executing_ops": 0, 2024-06-03T00:05:42.714 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executing_ops_high_water": 0, 2024-06-03T00:05:42.714 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executing": 0, 2024-06-03T00:05:42.714 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executing_high_water": 0, 2024-06-03T00:05:42.714 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executed_ops": 0, 2024-06-03T00:05:42.714 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executed": 0, 2024-06-03T00:05:42.714 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_item_in_journal": 0 2024-06-03T00:05:42.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.714 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-03T00:05:42.714 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2024-06-03T00:05:42.714 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 104857600, 2024-06-03T00:05:42.715 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2024-06-03T00:05:42.715 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 1816, 2024-06-03T00:05:42.715 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 61149541, 2024-06-03T00:05:42.715 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:42.715 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 1816, 2024-06-03T00:05:42.715 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 0, 2024-06-03T00:05:42.715 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 0, 2024-06-03T00:05:42.715 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 1816, 2024-06-03T00:05:42.715 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 61149541, 2024-06-03T00:05:42.716 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2024-06-03T00:05:42.716 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.716 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.716 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.717 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:42.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.717 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-objecter_bytes": { 2024-06-03T00:05:42.717 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2024-06-03T00:05:42.718 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 104857600, 2024-06-03T00:05:42.718 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2024-06-03T00:05:42.718 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 0, 2024-06-03T00:05:42.718 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 0, 2024-06-03T00:05:42.719 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:42.719 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 0, 2024-06-03T00:05:42.719 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 1641, 2024-06-03T00:05:42.719 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 60293179, 2024-06-03T00:05:42.719 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 1641, 2024-06-03T00:05:42.719 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 60293179, 2024-06-03T00:05:42.719 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2024-06-03T00:05:42.719 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.719 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.720 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.720 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:42.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.720 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-objecter_ops": { 2024-06-03T00:05:42.720 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2024-06-03T00:05:42.720 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 1024, 2024-06-03T00:05:42.720 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2024-06-03T00:05:42.720 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 0, 2024-06-03T00:05:42.720 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 0, 2024-06-03T00:05:42.720 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:42.720 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 0, 2024-06-03T00:05:42.720 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 1641, 2024-06-03T00:05:42.720 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 1641, 2024-06-03T00:05:42.720 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 1641, 2024-06-03T00:05:42.721 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 1641, 2024-06-03T00:05:42.721 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2024-06-03T00:05:42.721 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.721 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.721 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.721 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:42.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.721 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-write_buf_throttle": { 2024-06-03T00:05:42.721 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2024-06-03T00:05:42.721 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 3758096384, 2024-06-03T00:05:42.721 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2024-06-03T00:05:42.721 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 0, 2024-06-03T00:05:42.721 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 0, 2024-06-03T00:05:42.722 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:42.722 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 0, 2024-06-03T00:05:42.722 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 0, 2024-06-03T00:05:42.722 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 0, 2024-06-03T00:05:42.722 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 0, 2024-06-03T00:05:42.722 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 0, 2024-06-03T00:05:42.722 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2024-06-03T00:05:42.722 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.722 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.722 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.722 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:42.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:42.722 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-write_buf_throttle-0x55f5110806e0": { 2024-06-03T00:05:42.723 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2024-06-03T00:05:42.723 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 3758096384, 2024-06-03T00:05:42.723 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2024-06-03T00:05:42.723 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 0, 2024-06-03T00:05:42.723 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 0, 2024-06-03T00:05:42.723 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:42.723 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 0, 2024-06-03T00:05:42.723 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 0, 2024-06-03T00:05:42.723 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 0, 2024-06-03T00:05:42.723 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 0, 2024-06-03T00:05:42.723 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 0, 2024-06-03T00:05:42.723 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2024-06-03T00:05:42.723 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:42.724 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:42.724 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:42.724 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:42.724 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:42.724 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-06-03T00:05:43.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:43 smithi107 ceph-mon[37048]: pgmap v553: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-06-03T00:05:43.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:43 smithi057 ceph-mon[36457]: pgmap v553: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-06-03T00:05:43.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:43 smithi049 ceph-mon[32302]: pgmap v553: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-06-03T00:05:43.581 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-06-03T00:05:43.582 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-06-03T00:05:43.582 DEBUG:tasks.check_counter:Getting stats from h 2024-06-03T00:05:43.582 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph daemon mds.h perf dump 2024-06-03T00:05:43.830 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.b/config 2024-06-03T00:05:45.199 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:45 smithi057 ceph-mon[36457]: pgmap v554: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-03T00:05:45.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:45 smithi107 ceph-mon[37048]: pgmap v554: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-03T00:05:45.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:45 smithi049 ceph-mon[32302]: pgmap v554: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-03T00:05:45.620 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-06-03T00:05:45.620 INFO:teuthology.orchestra.run.smithi057.stdout: "AsyncMessenger::Worker-0": { 2024-06-03T00:05:45.620 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_messages": 12877, 2024-06-03T00:05:45.620 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages": 22012, 2024-06-03T00:05:45.621 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_bytes": 4995109, 2024-06-03T00:05:45.621 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_bytes": 18782182, 2024-06-03T00:05:45.621 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_created_connections": 21, 2024-06-03T00:05:45.621 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_active_connections": 5, 2024-06-03T00:05:45.621 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_total_time": 0.763945938, 2024-06-03T00:05:45.621 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_send_time": 0.376057104, 2024-06-03T00:05:45.621 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_recv_time": 0.616281395, 2024-06-03T00:05:45.621 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_fast_dispatch_time": 0.040722028, 2024-06-03T00:05:45.621 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:45.621 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 22012, 2024-06-03T00:05:45.621 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.568981428, 2024-06-03T00:05:45.621 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000025848 2024-06-03T00:05:45.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.622 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:45.622 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 17424, 2024-06-03T00:05:45.622 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.004290385, 2024-06-03T00:05:45.622 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000246 2024-06-03T00:05:45.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.622 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_encrypted_bytes": 587792, 2024-06-03T00:05:45.622 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_encrypted_bytes": 127776 2024-06-03T00:05:45.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.622 INFO:teuthology.orchestra.run.smithi057.stdout: "AsyncMessenger::Worker-1": { 2024-06-03T00:05:45.622 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_messages": 2391, 2024-06-03T00:05:45.622 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages": 2500, 2024-06-03T00:05:45.623 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_bytes": 748104, 2024-06-03T00:05:45.623 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_bytes": 7828805, 2024-06-03T00:05:45.623 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_created_connections": 10, 2024-06-03T00:05:45.623 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_active_connections": 7, 2024-06-03T00:05:45.623 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_total_time": 0.188164762, 2024-06-03T00:05:45.623 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_send_time": 0.066878124, 2024-06-03T00:05:45.623 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_recv_time": 0.049539702, 2024-06-03T00:05:45.623 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_fast_dispatch_time": 0.056923866, 2024-06-03T00:05:45.623 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:45.623 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 2498, 2024-06-03T00:05:45.623 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.101182077, 2024-06-03T00:05:45.623 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000040505 2024-06-03T00:05:45.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.624 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:45.624 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 52, 2024-06-03T00:05:45.624 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000012933, 2024-06-03T00:05:45.624 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000248 2024-06-03T00:05:45.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.624 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_encrypted_bytes": 160, 2024-06-03T00:05:45.624 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_encrypted_bytes": 264800 2024-06-03T00:05:45.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.624 INFO:teuthology.orchestra.run.smithi057.stdout: "AsyncMessenger::Worker-2": { 2024-06-03T00:05:45.624 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_messages": 5514, 2024-06-03T00:05:45.624 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages": 7032, 2024-06-03T00:05:45.624 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_bytes": 3735030, 2024-06-03T00:05:45.624 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_bytes": 6002447, 2024-06-03T00:05:45.624 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_created_connections": 11, 2024-06-03T00:05:45.625 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_active_connections": 8, 2024-06-03T00:05:45.625 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_total_time": 0.380776391, 2024-06-03T00:05:45.625 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_send_time": 0.148400872, 2024-06-03T00:05:45.625 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_recv_time": 0.214726735, 2024-06-03T00:05:45.625 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_fast_dispatch_time": 0.038832380, 2024-06-03T00:05:45.625 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:45.625 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 7030, 2024-06-03T00:05:45.625 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.175137498, 2024-06-03T00:05:45.625 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000024912 2024-06-03T00:05:45.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.625 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:45.625 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 9497, 2024-06-03T00:05:45.625 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.001850073, 2024-06-03T00:05:45.625 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000194 2024-06-03T00:05:45.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.626 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-03T00:05:45.626 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_encrypted_bytes": 0 2024-06-03T00:05:45.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.626 INFO:teuthology.orchestra.run.smithi057.stdout: "cct": { 2024-06-03T00:05:45.626 INFO:teuthology.orchestra.run.smithi057.stdout: "total_workers": 1, 2024-06-03T00:05:45.626 INFO:teuthology.orchestra.run.smithi057.stdout: "unhealthy_workers": 0 2024-06-03T00:05:45.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.626 INFO:teuthology.orchestra.run.smithi057.stdout: "finisher-MDSRank": { 2024-06-03T00:05:45.626 INFO:teuthology.orchestra.run.smithi057.stdout: "queue_len": 0, 2024-06-03T00:05:45.626 INFO:teuthology.orchestra.run.smithi057.stdout: "complete_latency": { 2024-06-03T00:05:45.626 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 2854, 2024-06-03T00:05:45.626 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 5.012024990, 2024-06-03T00:05:45.627 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.001756140 2024-06-03T00:05:45.627 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:45.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.627 INFO:teuthology.orchestra.run.smithi057.stdout: "finisher-PurgeQueue": { 2024-06-03T00:05:45.627 INFO:teuthology.orchestra.run.smithi057.stdout: "queue_len": 0, 2024-06-03T00:05:45.627 INFO:teuthology.orchestra.run.smithi057.stdout: "complete_latency": { 2024-06-03T00:05:45.627 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 4879, 2024-06-03T00:05:45.627 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.508053449, 2024-06-03T00:05:45.627 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000104130 2024-06-03T00:05:45.627 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:45.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.628 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-06-03T00:05:45.628 INFO:teuthology.orchestra.run.smithi057.stdout: "request": 6363, 2024-06-03T00:05:45.628 INFO:teuthology.orchestra.run.smithi057.stdout: "reply": 6341, 2024-06-03T00:05:45.628 INFO:teuthology.orchestra.run.smithi057.stdout: "reply_latency": { 2024-06-03T00:05:45.629 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 6341, 2024-06-03T00:05:45.629 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 48.049851203, 2024-06-03T00:05:45.629 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.007577645 2024-06-03T00:05:45.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.629 INFO:teuthology.orchestra.run.smithi057.stdout: "slow_reply": 0, 2024-06-03T00:05:45.629 INFO:teuthology.orchestra.run.smithi057.stdout: "forward": 22, 2024-06-03T00:05:45.629 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_fetch_complete": 0, 2024-06-03T00:05:45.629 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_fetch_keys": 0, 2024-06-03T00:05:45.629 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_commit": 11, 2024-06-03T00:05:45.629 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_split": 0, 2024-06-03T00:05:45.629 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_merge": 0, 2024-06-03T00:05:45.629 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes": 24, 2024-06-03T00:05:45.629 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_top": 1, 2024-06-03T00:05:45.629 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_bottom": 2, 2024-06-03T00:05:45.630 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_pin_tail": 21, 2024-06-03T00:05:45.630 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_pinned": 21, 2024-06-03T00:05:45.630 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_expired": 344, 2024-06-03T00:05:45.630 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_with_caps": 0, 2024-06-03T00:05:45.630 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": 0, 2024-06-03T00:05:45.630 INFO:teuthology.orchestra.run.smithi057.stdout: "subtrees": 3, 2024-06-03T00:05:45.630 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse": 10133, 2024-06-03T00:05:45.630 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_hit": 8852, 2024-06-03T00:05:45.631 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_forward": 22, 2024-06-03T00:05:45.631 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_discover": 25, 2024-06-03T00:05:45.631 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_dir_fetch": 0, 2024-06-03T00:05:45.631 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_remote_ino": 0, 2024-06-03T00:05:45.631 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_lock": 2, 2024-06-03T00:05:45.631 INFO:teuthology.orchestra.run.smithi057.stdout: "load_cent": 0, 2024-06-03T00:05:45.631 INFO:teuthology.orchestra.run.smithi057.stdout: "q": 0, 2024-06-03T00:05:45.631 INFO:teuthology.orchestra.run.smithi057.stdout: "exported": 29, 2024-06-03T00:05:45.631 INFO:teuthology.orchestra.run.smithi057.stdout: "exported_inodes": 260, 2024-06-03T00:05:45.631 INFO:teuthology.orchestra.run.smithi057.stdout: "imported": 30, 2024-06-03T00:05:45.631 INFO:teuthology.orchestra.run.smithi057.stdout: "imported_inodes": 1996, 2024-06-03T00:05:45.631 INFO:teuthology.orchestra.run.smithi057.stdout: "openino_dir_fetch": 0, 2024-06-03T00:05:45.632 INFO:teuthology.orchestra.run.smithi057.stdout: "openino_backtrace_fetch": 440, 2024-06-03T00:05:45.632 INFO:teuthology.orchestra.run.smithi057.stdout: "openino_peer_discover": 0, 2024-06-03T00:05:45.632 INFO:teuthology.orchestra.run.smithi057.stdout: "root_rfiles": 6731, 2024-06-03T00:05:45.632 INFO:teuthology.orchestra.run.smithi057.stdout: "root_rbytes": 44994472, 2024-06-03T00:05:45.632 INFO:teuthology.orchestra.run.smithi057.stdout: "root_rsnaps": 0, 2024-06-03T00:05:45.632 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_backtrace_fetch": 440, 2024-06-03T00:05:45.632 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_set_tag": 0, 2024-06-03T00:05:45.632 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_backtrace_repaired": 0, 2024-06-03T00:05:45.632 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_inotable_repaired": 0, 2024-06-03T00:05:45.632 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_dir_inodes": 2, 2024-06-03T00:05:45.633 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_dir_base_inodes": 0, 2024-06-03T00:05:45.633 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_dirfrag_rstats": 2, 2024-06-03T00:05:45.633 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_file_inodes": 438, 2024-06-03T00:05:45.633 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_inode_file_caps": 2, 2024-06-03T00:05:45.633 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_revoke": 3094, 2024-06-03T00:05:45.633 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_grant": 4162, 2024-06-03T00:05:45.633 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_trunc": 50, 2024-06-03T00:05:45.633 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-03T00:05:45.633 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-03T00:05:45.633 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_caps": 4844, 2024-06-03T00:05:45.633 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_caps_dirty": 1555, 2024-06-03T00:05:45.634 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_cap_release": 47, 2024-06-03T00:05:45.634 INFO:teuthology.orchestra.run.smithi057.stdout: "process_request_cap_release": 4287 2024-06-03T00:05:45.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.634 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_cache": { 2024-06-03T00:05:45.634 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_update": 0, 2024-06-03T00:05:45.634 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_update_receipt": 0, 2024-06-03T00:05:45.634 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_try_discover": 0, 2024-06-03T00:05:45.634 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_send_discover": 25, 2024-06-03T00:05:45.634 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_handle_discover": 25, 2024-06-03T00:05:45.634 INFO:teuthology.orchestra.run.smithi057.stdout: "num_strays": 0, 2024-06-03T00:05:45.635 INFO:teuthology.orchestra.run.smithi057.stdout: "num_strays_delayed": 0, 2024-06-03T00:05:45.635 INFO:teuthology.orchestra.run.smithi057.stdout: "num_strays_enqueuing": 0, 2024-06-03T00:05:45.635 INFO:teuthology.orchestra.run.smithi057.stdout: "strays_created": 2516, 2024-06-03T00:05:45.635 INFO:teuthology.orchestra.run.smithi057.stdout: "strays_enqueued": 2493, 2024-06-03T00:05:45.635 INFO:teuthology.orchestra.run.smithi057.stdout: "strays_reintegrated": 25, 2024-06-03T00:05:45.635 INFO:teuthology.orchestra.run.smithi057.stdout: "strays_migrated": 0, 2024-06-03T00:05:45.635 INFO:teuthology.orchestra.run.smithi057.stdout: "num_recovering_processing": 0, 2024-06-03T00:05:45.635 INFO:teuthology.orchestra.run.smithi057.stdout: "num_recovering_enqueued": 0, 2024-06-03T00:05:45.635 INFO:teuthology.orchestra.run.smithi057.stdout: "num_recovering_prioritized": 0, 2024-06-03T00:05:45.635 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_started": 0, 2024-06-03T00:05:45.635 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_completed": 0, 2024-06-03T00:05:45.636 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_quiesce_path": 4, 2024-06-03T00:05:45.636 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_quiesce_inode": 4489, 2024-06-03T00:05:45.636 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_enqueue_scrub": 0, 2024-06-03T00:05:45.636 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_exportdir": 29, 2024-06-03T00:05:45.636 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_flush": 0, 2024-06-03T00:05:45.636 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_fragmentdir": 0, 2024-06-03T00:05:45.636 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_fragstats": 0, 2024-06-03T00:05:45.636 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_inodestats": 0 2024-06-03T00:05:45.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.636 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_log": { 2024-06-03T00:05:45.636 INFO:teuthology.orchestra.run.smithi057.stdout: "evlrg": 0, 2024-06-03T00:05:45.637 INFO:teuthology.orchestra.run.smithi057.stdout: "evadd": 8715, 2024-06-03T00:05:45.637 INFO:teuthology.orchestra.run.smithi057.stdout: "evex": 0, 2024-06-03T00:05:45.637 INFO:teuthology.orchestra.run.smithi057.stdout: "evtrm": 0, 2024-06-03T00:05:45.637 INFO:teuthology.orchestra.run.smithi057.stdout: "ev": 8715, 2024-06-03T00:05:45.637 INFO:teuthology.orchestra.run.smithi057.stdout: "evexg": 0, 2024-06-03T00:05:45.637 INFO:teuthology.orchestra.run.smithi057.stdout: "evexd": 0, 2024-06-03T00:05:45.637 INFO:teuthology.orchestra.run.smithi057.stdout: "segadd": 12, 2024-06-03T00:05:45.637 INFO:teuthology.orchestra.run.smithi057.stdout: "segex": 0, 2024-06-03T00:05:45.637 INFO:teuthology.orchestra.run.smithi057.stdout: "segtrm": 0, 2024-06-03T00:05:45.638 INFO:teuthology.orchestra.run.smithi057.stdout: "seg": 12, 2024-06-03T00:05:45.638 INFO:teuthology.orchestra.run.smithi057.stdout: "segmjr": 2, 2024-06-03T00:05:45.638 INFO:teuthology.orchestra.run.smithi057.stdout: "segexg": 0, 2024-06-03T00:05:45.638 INFO:teuthology.orchestra.run.smithi057.stdout: "segexd": 0, 2024-06-03T00:05:45.638 INFO:teuthology.orchestra.run.smithi057.stdout: "expos": 4194304, 2024-06-03T00:05:45.638 INFO:teuthology.orchestra.run.smithi057.stdout: "wrpos": 23548835, 2024-06-03T00:05:45.638 INFO:teuthology.orchestra.run.smithi057.stdout: "rdpos": 0, 2024-06-03T00:05:45.638 INFO:teuthology.orchestra.run.smithi057.stdout: "jlat": { 2024-06-03T00:05:45.638 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 1534, 2024-06-03T00:05:45.639 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 9.737348070, 2024-06-03T00:05:45.639 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.006347684 2024-06-03T00:05:45.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.639 INFO:teuthology.orchestra.run.smithi057.stdout: "replayed": 0 2024-06-03T00:05:45.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.639 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_mem": { 2024-06-03T00:05:45.639 INFO:teuthology.orchestra.run.smithi057.stdout: "ino": 22, 2024-06-03T00:05:45.639 INFO:teuthology.orchestra.run.smithi057.stdout: "ino+": 2557, 2024-06-03T00:05:45.640 INFO:teuthology.orchestra.run.smithi057.stdout: "ino-": 2535, 2024-06-03T00:05:45.640 INFO:teuthology.orchestra.run.smithi057.stdout: "dir": 22, 2024-06-03T00:05:45.640 INFO:teuthology.orchestra.run.smithi057.stdout: "dir+": 421, 2024-06-03T00:05:45.640 INFO:teuthology.orchestra.run.smithi057.stdout: "dir-": 399, 2024-06-03T00:05:45.640 INFO:teuthology.orchestra.run.smithi057.stdout: "dn": 54, 2024-06-03T00:05:45.640 INFO:teuthology.orchestra.run.smithi057.stdout: "dn+": 5323, 2024-06-03T00:05:45.640 INFO:teuthology.orchestra.run.smithi057.stdout: "dn-": 5269, 2024-06-03T00:05:45.640 INFO:teuthology.orchestra.run.smithi057.stdout: "cap": 0, 2024-06-03T00:05:45.640 INFO:teuthology.orchestra.run.smithi057.stdout: "cap+": 4306, 2024-06-03T00:05:45.640 INFO:teuthology.orchestra.run.smithi057.stdout: "cap-": 4306, 2024-06-03T00:05:45.640 INFO:teuthology.orchestra.run.smithi057.stdout: "rss": 102780, 2024-06-03T00:05:45.641 INFO:teuthology.orchestra.run.smithi057.stdout: "heap": 223612 2024-06-03T00:05:45.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.641 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_server": { 2024-06-03T00:05:45.641 INFO:teuthology.orchestra.run.smithi057.stdout: "dispatch_client_request": 8491, 2024-06-03T00:05:45.641 INFO:teuthology.orchestra.run.smithi057.stdout: "dispatch_server_request": 25, 2024-06-03T00:05:45.641 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_request": 6363, 2024-06-03T00:05:45.641 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_session": 73, 2024-06-03T00:05:45.641 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_peer_request": 839, 2024-06-03T00:05:45.641 INFO:teuthology.orchestra.run.smithi057.stdout: "req_create_latency": { 2024-06-03T00:05:45.641 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 239, 2024-06-03T00:05:45.641 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 11.015891848, 2024-06-03T00:05:45.641 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.046091597 2024-06-03T00:05:45.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.642 INFO:teuthology.orchestra.run.smithi057.stdout: "req_getattr_latency": { 2024-06-03T00:05:45.642 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 9, 2024-06-03T00:05:45.642 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.012325292, 2024-06-03T00:05:45.642 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.001369476 2024-06-03T00:05:45.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.642 INFO:teuthology.orchestra.run.smithi057.stdout: "req_getfilelock_latency": { 2024-06-03T00:05:45.642 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:45.642 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:45.642 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:45.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.642 INFO:teuthology.orchestra.run.smithi057.stdout: "req_link_latency": { 2024-06-03T00:05:45.642 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 44, 2024-06-03T00:05:45.642 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.081308010, 2024-06-03T00:05:45.643 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.001847909 2024-06-03T00:05:45.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.643 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookup_latency": { 2024-06-03T00:05:45.643 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 2542, 2024-06-03T00:05:45.643 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 6.939616933, 2024-06-03T00:05:45.643 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.002729983 2024-06-03T00:05:45.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.643 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookuphash_latency": { 2024-06-03T00:05:45.643 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:45.643 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:45.643 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:45.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.643 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookupino_latency": { 2024-06-03T00:05:45.644 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:45.644 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:45.644 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:45.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.644 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookupname_latency": { 2024-06-03T00:05:45.644 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:45.644 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:45.644 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:45.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.644 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookupparent_latency": { 2024-06-03T00:05:45.644 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:45.644 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:45.644 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:45.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.645 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookupsnap_latency": { 2024-06-03T00:05:45.645 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:45.645 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:45.645 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:45.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.645 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lssnap_latency": { 2024-06-03T00:05:45.645 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:45.646 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:45.646 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:45.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.646 INFO:teuthology.orchestra.run.smithi057.stdout: "req_mkdir_latency": { 2024-06-03T00:05:45.646 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 113, 2024-06-03T00:05:45.646 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.176879178, 2024-06-03T00:05:45.646 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.001565302 2024-06-03T00:05:45.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.646 INFO:teuthology.orchestra.run.smithi057.stdout: "req_mknod_latency": { 2024-06-03T00:05:45.646 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 118, 2024-06-03T00:05:45.646 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.161693805, 2024-06-03T00:05:45.647 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.001370286 2024-06-03T00:05:45.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.647 INFO:teuthology.orchestra.run.smithi057.stdout: "req_mksnap_latency": { 2024-06-03T00:05:45.647 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:45.647 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:45.647 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:45.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.647 INFO:teuthology.orchestra.run.smithi057.stdout: "req_open_latency": { 2024-06-03T00:05:45.647 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:45.647 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:45.647 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:45.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.647 INFO:teuthology.orchestra.run.smithi057.stdout: "req_readdir_latency": { 2024-06-03T00:05:45.647 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 382, 2024-06-03T00:05:45.648 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.286811801, 2024-06-03T00:05:45.648 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000750816 2024-06-03T00:05:45.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.648 INFO:teuthology.orchestra.run.smithi057.stdout: "req_rename_latency": { 2024-06-03T00:05:45.648 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 138, 2024-06-03T00:05:45.648 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 11.249353344, 2024-06-03T00:05:45.648 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.081517053 2024-06-03T00:05:45.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.648 INFO:teuthology.orchestra.run.smithi057.stdout: "req_renamesnap_latency": { 2024-06-03T00:05:45.648 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:45.648 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:45.648 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:45.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.649 INFO:teuthology.orchestra.run.smithi057.stdout: "req_snapdiff_latency": { 2024-06-03T00:05:45.649 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:45.649 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:45.649 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:45.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.649 INFO:teuthology.orchestra.run.smithi057.stdout: "req_rmdir_latency": { 2024-06-03T00:05:45.649 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 380, 2024-06-03T00:05:45.649 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 14.334194547, 2024-06-03T00:05:45.649 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.037721564 2024-06-03T00:05:45.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.649 INFO:teuthology.orchestra.run.smithi057.stdout: "req_rmsnap_latency": { 2024-06-03T00:05:45.649 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:45.649 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:45.649 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:45.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.650 INFO:teuthology.orchestra.run.smithi057.stdout: "req_rmxattr_latency": { 2024-06-03T00:05:45.650 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:45.650 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:45.650 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:45.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.650 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setattr_latency": { 2024-06-03T00:05:45.650 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 53, 2024-06-03T00:05:45.650 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.127336009, 2024-06-03T00:05:45.650 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.002402566 2024-06-03T00:05:45.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.650 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setdirlayout_latency": { 2024-06-03T00:05:45.650 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:45.651 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:45.651 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:45.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.651 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setfilelock_latency": { 2024-06-03T00:05:45.651 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:45.651 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:45.651 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:45.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.651 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setlayout_latency": { 2024-06-03T00:05:45.651 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:45.651 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:45.651 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:45.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.651 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setxattr_latency": { 2024-06-03T00:05:45.652 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:45.652 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:45.652 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:45.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.652 INFO:teuthology.orchestra.run.smithi057.stdout: "req_symlink_latency": { 2024-06-03T00:05:45.652 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 106, 2024-06-03T00:05:45.652 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.170354287, 2024-06-03T00:05:45.652 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.001607115 2024-06-03T00:05:45.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.652 INFO:teuthology.orchestra.run.smithi057.stdout: "req_unlink_latency": { 2024-06-03T00:05:45.652 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 2217, 2024-06-03T00:05:45.652 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 3.494086149, 2024-06-03T00:05:45.653 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.001576042 2024-06-03T00:05:45.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.653 INFO:teuthology.orchestra.run.smithi057.stdout: "cap_revoke_eviction": 0, 2024-06-03T00:05:45.653 INFO:teuthology.orchestra.run.smithi057.stdout: "cap_acquisition_throttle": 0, 2024-06-03T00:05:45.653 INFO:teuthology.orchestra.run.smithi057.stdout: "req_getvxattr_latency": { 2024-06-03T00:05:45.653 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:45.653 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:45.653 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:45.653 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:45.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.653 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_sessions": { 2024-06-03T00:05:45.653 INFO:teuthology.orchestra.run.smithi057.stdout: "session_count": 1, 2024-06-03T00:05:45.653 INFO:teuthology.orchestra.run.smithi057.stdout: "session_add": 1, 2024-06-03T00:05:45.653 INFO:teuthology.orchestra.run.smithi057.stdout: "session_remove": 0, 2024-06-03T00:05:45.654 INFO:teuthology.orchestra.run.smithi057.stdout: "sessions_open": 1, 2024-06-03T00:05:45.654 INFO:teuthology.orchestra.run.smithi057.stdout: "sessions_stale": 0, 2024-06-03T00:05:45.654 INFO:teuthology.orchestra.run.smithi057.stdout: "total_load": 3399, 2024-06-03T00:05:45.654 INFO:teuthology.orchestra.run.smithi057.stdout: "average_load": 3399, 2024-06-03T00:05:45.654 INFO:teuthology.orchestra.run.smithi057.stdout: "avg_session_uptime": 1811, 2024-06-03T00:05:45.654 INFO:teuthology.orchestra.run.smithi057.stdout: "mdthresh_evicted": 0 2024-06-03T00:05:45.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.654 INFO:teuthology.orchestra.run.smithi057.stdout: "mempool": { 2024-06-03T00:05:45.654 INFO:teuthology.orchestra.run.smithi057.stdout: "bloom_filter_bytes": 0, 2024-06-03T00:05:45.654 INFO:teuthology.orchestra.run.smithi057.stdout: "bloom_filter_items": 0, 2024-06-03T00:05:45.654 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_alloc_bytes": 0, 2024-06-03T00:05:45.654 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_alloc_items": 0, 2024-06-03T00:05:45.655 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_data_bytes": 0, 2024-06-03T00:05:45.655 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_data_items": 0, 2024-06-03T00:05:45.655 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-03T00:05:45.655 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_onode_items": 0, 2024-06-03T00:05:45.655 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-03T00:05:45.655 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_meta_items": 0, 2024-06-03T00:05:45.655 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_other_bytes": 0, 2024-06-03T00:05:45.655 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_other_items": 0, 2024-06-03T00:05:45.655 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-03T00:05:45.655 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_buffer_items": 0, 2024-06-03T00:05:45.656 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_extent_bytes": 0, 2024-06-03T00:05:45.656 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_extent_items": 0, 2024-06-03T00:05:45.656 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_blob_bytes": 0, 2024-06-03T00:05:45.656 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_blob_items": 0, 2024-06-03T00:05:45.656 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-03T00:05:45.656 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_shared_blob_items": 0, 2024-06-03T00:05:45.656 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-03T00:05:45.656 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_inline_bl_items": 0, 2024-06-03T00:05:45.656 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_fsck_bytes": 0, 2024-06-03T00:05:45.656 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_fsck_items": 0, 2024-06-03T00:05:45.656 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_txc_bytes": 0, 2024-06-03T00:05:45.656 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_txc_items": 0, 2024-06-03T00:05:45.657 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-03T00:05:45.657 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_writing_deferred_items": 0, 2024-06-03T00:05:45.657 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_writing_bytes": 0, 2024-06-03T00:05:45.657 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_writing_items": 0, 2024-06-03T00:05:45.657 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_bytes": 0, 2024-06-03T00:05:45.657 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_items": 0, 2024-06-03T00:05:45.657 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_file_reader_bytes": 0, 2024-06-03T00:05:45.657 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_file_reader_items": 0, 2024-06-03T00:05:45.657 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_file_writer_bytes": 0, 2024-06-03T00:05:45.657 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_file_writer_items": 0, 2024-06-03T00:05:45.657 INFO:teuthology.orchestra.run.smithi057.stdout: "buffer_anon_bytes": 287701, 2024-06-03T00:05:45.657 INFO:teuthology.orchestra.run.smithi057.stdout: "buffer_anon_items": 106, 2024-06-03T00:05:45.657 INFO:teuthology.orchestra.run.smithi057.stdout: "buffer_meta_bytes": 0, 2024-06-03T00:05:45.658 INFO:teuthology.orchestra.run.smithi057.stdout: "buffer_meta_items": 0, 2024-06-03T00:05:45.658 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_bytes": 0, 2024-06-03T00:05:45.658 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_items": 0, 2024-06-03T00:05:45.658 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mapbl_bytes": 0, 2024-06-03T00:05:45.658 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mapbl_items": 0, 2024-06-03T00:05:45.658 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pglog_bytes": 0, 2024-06-03T00:05:45.658 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pglog_items": 0, 2024-06-03T00:05:45.658 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_bytes": 7624, 2024-06-03T00:05:45.658 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_items": 160, 2024-06-03T00:05:45.658 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_mapping_bytes": 0, 2024-06-03T00:05:45.658 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_mapping_items": 0, 2024-06-03T00:05:45.658 INFO:teuthology.orchestra.run.smithi057.stdout: "pgmap_bytes": 0, 2024-06-03T00:05:45.658 INFO:teuthology.orchestra.run.smithi057.stdout: "pgmap_items": 0, 2024-06-03T00:05:45.659 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_co_bytes": 89421, 2024-06-03T00:05:45.659 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_co_items": 455, 2024-06-03T00:05:45.659 INFO:teuthology.orchestra.run.smithi057.stdout: "unittest_1_bytes": 0, 2024-06-03T00:05:45.659 INFO:teuthology.orchestra.run.smithi057.stdout: "unittest_1_items": 0, 2024-06-03T00:05:45.659 INFO:teuthology.orchestra.run.smithi057.stdout: "unittest_2_bytes": 0, 2024-06-03T00:05:45.659 INFO:teuthology.orchestra.run.smithi057.stdout: "unittest_2_items": 0 2024-06-03T00:05:45.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.659 INFO:teuthology.orchestra.run.smithi057.stdout: "objecter": { 2024-06-03T00:05:45.659 INFO:teuthology.orchestra.run.smithi057.stdout: "op_active": 0, 2024-06-03T00:05:45.659 INFO:teuthology.orchestra.run.smithi057.stdout: "op_laggy": 0, 2024-06-03T00:05:45.659 INFO:teuthology.orchestra.run.smithi057.stdout: "op_send": 5119, 2024-06-03T00:05:45.659 INFO:teuthology.orchestra.run.smithi057.stdout: "op_send_bytes": 19774966, 2024-06-03T00:05:45.659 INFO:teuthology.orchestra.run.smithi057.stdout: "op_resend": 33, 2024-06-03T00:05:45.659 INFO:teuthology.orchestra.run.smithi057.stdout: "op_reply": 5119, 2024-06-03T00:05:45.660 INFO:teuthology.orchestra.run.smithi057.stdout: "op_latency": { 2024-06-03T00:05:45.660 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 5119, 2024-06-03T00:05:45.660 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 14.071785541, 2024-06-03T00:05:45.660 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.002748932 2024-06-03T00:05:45.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.660 INFO:teuthology.orchestra.run.smithi057.stdout: "op_inflight": 0, 2024-06-03T00:05:45.660 INFO:teuthology.orchestra.run.smithi057.stdout: "oplen_avg": { 2024-06-03T00:05:45.660 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 5119, 2024-06-03T00:05:45.660 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 5222 2024-06-03T00:05:45.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.661 INFO:teuthology.orchestra.run.smithi057.stdout: "op": 5119, 2024-06-03T00:05:45.661 INFO:teuthology.orchestra.run.smithi057.stdout: "op_r": 506, 2024-06-03T00:05:45.661 INFO:teuthology.orchestra.run.smithi057.stdout: "op_w": 4613, 2024-06-03T00:05:45.661 INFO:teuthology.orchestra.run.smithi057.stdout: "op_rmw": 0, 2024-06-03T00:05:45.661 INFO:teuthology.orchestra.run.smithi057.stdout: "op_pg": 0, 2024-06-03T00:05:45.661 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_stat": 0, 2024-06-03T00:05:45.661 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_create": 10, 2024-06-03T00:05:45.661 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_read": 66, 2024-06-03T00:05:45.661 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_write": 1600, 2024-06-03T00:05:45.661 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_writefull": 41, 2024-06-03T00:05:45.661 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_writesame": 0, 2024-06-03T00:05:45.662 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_append": 0, 2024-06-03T00:05:45.662 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_zero": 0, 2024-06-03T00:05:45.662 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_truncate": 0, 2024-06-03T00:05:45.662 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_delete": 2833, 2024-06-03T00:05:45.662 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_mapext": 0, 2024-06-03T00:05:45.662 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_sparse_read": 0, 2024-06-03T00:05:45.662 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_clonerange": 0, 2024-06-03T00:05:45.662 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_getxattr": 440, 2024-06-03T00:05:45.662 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_setxattr": 20, 2024-06-03T00:05:45.662 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_cmpxattr": 0, 2024-06-03T00:05:45.663 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_rmxattr": 0, 2024-06-03T00:05:45.663 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_resetxattrs": 0, 2024-06-03T00:05:45.663 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_call": 0, 2024-06-03T00:05:45.663 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_watch": 0, 2024-06-03T00:05:45.663 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_notify": 0, 2024-06-03T00:05:45.663 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_src_cmpxattr": 0, 2024-06-03T00:05:45.663 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_pgls": 0, 2024-06-03T00:05:45.663 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_pgls_filter": 0, 2024-06-03T00:05:45.663 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_other": 60, 2024-06-03T00:05:45.663 INFO:teuthology.orchestra.run.smithi057.stdout: "linger_active": 0, 2024-06-03T00:05:45.663 INFO:teuthology.orchestra.run.smithi057.stdout: "linger_send": 0, 2024-06-03T00:05:45.664 INFO:teuthology.orchestra.run.smithi057.stdout: "linger_resend": 0, 2024-06-03T00:05:45.664 INFO:teuthology.orchestra.run.smithi057.stdout: "linger_ping": 0, 2024-06-03T00:05:45.664 INFO:teuthology.orchestra.run.smithi057.stdout: "poolop_active": 0, 2024-06-03T00:05:45.664 INFO:teuthology.orchestra.run.smithi057.stdout: "poolop_send": 0, 2024-06-03T00:05:45.664 INFO:teuthology.orchestra.run.smithi057.stdout: "poolop_resend": 0, 2024-06-03T00:05:45.664 INFO:teuthology.orchestra.run.smithi057.stdout: "poolstat_active": 0, 2024-06-03T00:05:45.664 INFO:teuthology.orchestra.run.smithi057.stdout: "poolstat_send": 0, 2024-06-03T00:05:45.664 INFO:teuthology.orchestra.run.smithi057.stdout: "poolstat_resend": 0, 2024-06-03T00:05:45.664 INFO:teuthology.orchestra.run.smithi057.stdout: "statfs_active": 0, 2024-06-03T00:05:45.664 INFO:teuthology.orchestra.run.smithi057.stdout: "statfs_send": 0, 2024-06-03T00:05:45.664 INFO:teuthology.orchestra.run.smithi057.stdout: "statfs_resend": 0, 2024-06-03T00:05:45.664 INFO:teuthology.orchestra.run.smithi057.stdout: "command_active": 0, 2024-06-03T00:05:45.664 INFO:teuthology.orchestra.run.smithi057.stdout: "command_send": 0, 2024-06-03T00:05:45.665 INFO:teuthology.orchestra.run.smithi057.stdout: "command_resend": 0, 2024-06-03T00:05:45.665 INFO:teuthology.orchestra.run.smithi057.stdout: "map_epoch": 90, 2024-06-03T00:05:45.665 INFO:teuthology.orchestra.run.smithi057.stdout: "map_full": 0, 2024-06-03T00:05:45.665 INFO:teuthology.orchestra.run.smithi057.stdout: "map_inc": 2, 2024-06-03T00:05:45.665 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_sessions": 12, 2024-06-03T00:05:45.665 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_session_open": 12, 2024-06-03T00:05:45.665 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_session_close": 0, 2024-06-03T00:05:45.665 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_laggy": 0, 2024-06-03T00:05:45.665 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_wr": 115, 2024-06-03T00:05:45.665 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_rd": 0, 2024-06-03T00:05:45.665 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_del": 37 2024-06-03T00:05:45.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.665 INFO:teuthology.orchestra.run.smithi057.stdout: "oft": { 2024-06-03T00:05:45.666 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_total_objs": 1, 2024-06-03T00:05:45.666 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_total_kv_pairs": 0, 2024-06-03T00:05:45.666 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_total_updates": 0, 2024-06-03T00:05:45.666 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_total_removes": 0 2024-06-03T00:05:45.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.666 INFO:teuthology.orchestra.run.smithi057.stdout: "osd-slow-ops": { 2024-06-03T00:05:45.666 INFO:teuthology.orchestra.run.smithi057.stdout: "slow_ops_count": 4496 2024-06-03T00:05:45.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.666 INFO:teuthology.orchestra.run.smithi057.stdout: "purge_queue": { 2024-06-03T00:05:45.666 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executing_ops": 0, 2024-06-03T00:05:45.666 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executing_ops_high_water": 14, 2024-06-03T00:05:45.666 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executing": 0, 2024-06-03T00:05:45.667 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executing_high_water": 6, 2024-06-03T00:05:45.667 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executed_ops": 2817, 2024-06-03T00:05:45.667 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executed": 2493, 2024-06-03T00:05:45.667 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_item_in_journal": 0 2024-06-03T00:05:45.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.667 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-03T00:05:45.667 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2024-06-03T00:05:45.667 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 104857600, 2024-06-03T00:05:45.667 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2024-06-03T00:05:45.667 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 20778, 2024-06-03T00:05:45.667 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 7775772, 2024-06-03T00:05:45.667 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:45.667 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 20778, 2024-06-03T00:05:45.667 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 0, 2024-06-03T00:05:45.668 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 0, 2024-06-03T00:05:45.668 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 20778, 2024-06-03T00:05:45.668 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 7775772, 2024-06-03T00:05:45.668 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2024-06-03T00:05:45.668 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:45.668 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:45.668 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:45.668 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:45.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.668 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-objecter_bytes": { 2024-06-03T00:05:45.668 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2024-06-03T00:05:45.668 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 104857600, 2024-06-03T00:05:45.668 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2024-06-03T00:05:45.668 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 0, 2024-06-03T00:05:45.668 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 0, 2024-06-03T00:05:45.669 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:45.669 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 0, 2024-06-03T00:05:45.669 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 5119, 2024-06-03T00:05:45.669 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 20026767, 2024-06-03T00:05:45.669 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 5119, 2024-06-03T00:05:45.669 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 20026767, 2024-06-03T00:05:45.669 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2024-06-03T00:05:45.669 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:45.669 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:45.669 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:45.669 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:45.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.669 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-objecter_ops": { 2024-06-03T00:05:45.670 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2024-06-03T00:05:45.670 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 1024, 2024-06-03T00:05:45.670 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2024-06-03T00:05:45.670 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 0, 2024-06-03T00:05:45.670 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 0, 2024-06-03T00:05:45.670 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:45.670 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 0, 2024-06-03T00:05:45.670 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 5119, 2024-06-03T00:05:45.670 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 5119, 2024-06-03T00:05:45.670 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 5119, 2024-06-03T00:05:45.670 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 5119, 2024-06-03T00:05:45.670 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2024-06-03T00:05:45.670 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:45.671 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:45.671 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:45.671 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:45.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.671 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-write_buf_throttle": { 2024-06-03T00:05:45.671 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2024-06-03T00:05:45.671 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 3758096384, 2024-06-03T00:05:45.671 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2024-06-03T00:05:45.672 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 2493, 2024-06-03T00:05:45.672 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 251801, 2024-06-03T00:05:45.672 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:45.672 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 2493, 2024-06-03T00:05:45.672 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 0, 2024-06-03T00:05:45.672 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 0, 2024-06-03T00:05:45.672 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 66, 2024-06-03T00:05:45.672 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 251801, 2024-06-03T00:05:45.672 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2024-06-03T00:05:45.672 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:45.672 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:45.672 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:45.672 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:45.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:45.673 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-write_buf_throttle-0x558578e52500": { 2024-06-03T00:05:45.673 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2024-06-03T00:05:45.673 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 3758096384, 2024-06-03T00:05:45.673 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2024-06-03T00:05:45.673 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 8715, 2024-06-03T00:05:45.673 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 19354531, 2024-06-03T00:05:45.673 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:45.673 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 8715, 2024-06-03T00:05:45.673 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 0, 2024-06-03T00:05:45.673 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 0, 2024-06-03T00:05:45.674 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 1534, 2024-06-03T00:05:45.674 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 19354531, 2024-06-03T00:05:45.674 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2024-06-03T00:05:45.674 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:45.674 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:45.674 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:45.674 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:45.674 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:45.674 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-06-03T00:05:46.523 INFO:tasks.check_counter:Daemon mds.h mds.exported=29 2024-06-03T00:05:46.523 INFO:tasks.check_counter:Daemon mds.h mds.imported=30 2024-06-03T00:05:46.523 DEBUG:tasks.check_counter:Getting stats from k 2024-06-03T00:05:46.523 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph daemon mds.k perf dump 2024-06-03T00:05:46.774 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.b/config 2024-06-03T00:05:47.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:47 smithi057 ceph-mon[36457]: pgmap v555: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 12 op/s 2024-06-03T00:05:47.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:47 smithi107 ceph-mon[37048]: pgmap v555: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 12 op/s 2024-06-03T00:05:47.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:47 smithi049 ceph-mon[32302]: pgmap v555: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 12 op/s 2024-06-03T00:05:48.621 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-06-03T00:05:48.621 INFO:teuthology.orchestra.run.smithi057.stdout: "AsyncMessenger::Worker-0": { 2024-06-03T00:05:48.621 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_messages": 476, 2024-06-03T00:05:48.621 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages": 476, 2024-06-03T00:05:48.621 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_bytes": 8514863, 2024-06-03T00:05:48.621 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_bytes": 150608, 2024-06-03T00:05:48.622 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_created_connections": 7, 2024-06-03T00:05:48.622 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_active_connections": 3, 2024-06-03T00:05:48.622 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_total_time": 0.051034816, 2024-06-03T00:05:48.622 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_send_time": 0.016546084, 2024-06-03T00:05:48.622 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_recv_time": 0.016883483, 2024-06-03T00:05:48.622 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_fast_dispatch_time": 0.012273872, 2024-06-03T00:05:48.622 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:48.622 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 475, 2024-06-03T00:05:48.622 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.022606208, 2024-06-03T00:05:48.622 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000047592 2024-06-03T00:05:48.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.622 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:48.623 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.623 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.623 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.623 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-06-03T00:05:48.623 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_encrypted_bytes": 448 2024-06-03T00:05:48.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.623 INFO:teuthology.orchestra.run.smithi057.stdout: "AsyncMessenger::Worker-1": { 2024-06-03T00:05:48.623 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_messages": 365, 2024-06-03T00:05:48.623 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages": 479, 2024-06-03T00:05:48.623 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_bytes": 10273064, 2024-06-03T00:05:48.623 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_bytes": 383021, 2024-06-03T00:05:48.623 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_created_connections": 6, 2024-06-03T00:05:48.623 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_active_connections": 5, 2024-06-03T00:05:48.624 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_total_time": 0.049050214, 2024-06-03T00:05:48.624 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_send_time": 0.015370576, 2024-06-03T00:05:48.624 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_recv_time": 0.017580391, 2024-06-03T00:05:48.624 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_fast_dispatch_time": 0.011437571, 2024-06-03T00:05:48.624 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:48.624 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 477, 2024-06-03T00:05:48.624 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.021712543, 2024-06-03T00:05:48.624 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000045518 2024-06-03T00:05:48.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.624 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:48.624 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.624 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.624 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.625 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_encrypted_bytes": 160, 2024-06-03T00:05:48.625 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_encrypted_bytes": 267264 2024-06-03T00:05:48.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.625 INFO:teuthology.orchestra.run.smithi057.stdout: "AsyncMessenger::Worker-2": { 2024-06-03T00:05:48.625 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_messages": 727, 2024-06-03T00:05:48.625 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages": 710, 2024-06-03T00:05:48.625 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_bytes": 4945846, 2024-06-03T00:05:48.625 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_bytes": 269092, 2024-06-03T00:05:48.625 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_created_connections": 4, 2024-06-03T00:05:48.625 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_active_connections": 3, 2024-06-03T00:05:48.625 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_total_time": 0.092582455, 2024-06-03T00:05:48.625 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_send_time": 0.030069073, 2024-06-03T00:05:48.625 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_recv_time": 0.034120080, 2024-06-03T00:05:48.626 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_fast_dispatch_time": 0.023944982, 2024-06-03T00:05:48.626 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:48.626 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 709, 2024-06-03T00:05:48.626 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.037913209, 2024-06-03T00:05:48.626 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000053474 2024-06-03T00:05:48.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.626 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:48.626 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.626 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.626 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.626 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_encrypted_bytes": 571536, 2024-06-03T00:05:48.626 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_encrypted_bytes": 94192 2024-06-03T00:05:48.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.627 INFO:teuthology.orchestra.run.smithi057.stdout: "cct": { 2024-06-03T00:05:48.627 INFO:teuthology.orchestra.run.smithi057.stdout: "total_workers": 1, 2024-06-03T00:05:48.627 INFO:teuthology.orchestra.run.smithi057.stdout: "unhealthy_workers": 0 2024-06-03T00:05:48.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.627 INFO:teuthology.orchestra.run.smithi057.stdout: "finisher-MDSRank": { 2024-06-03T00:05:48.627 INFO:teuthology.orchestra.run.smithi057.stdout: "queue_len": 0, 2024-06-03T00:05:48.627 INFO:teuthology.orchestra.run.smithi057.stdout: "complete_latency": { 2024-06-03T00:05:48.627 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 2412, 2024-06-03T00:05:48.627 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.069303670, 2024-06-03T00:05:48.627 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000028732 2024-06-03T00:05:48.627 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:48.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.627 INFO:teuthology.orchestra.run.smithi057.stdout: "finisher-PurgeQueue": { 2024-06-03T00:05:48.627 INFO:teuthology.orchestra.run.smithi057.stdout: "queue_len": 0, 2024-06-03T00:05:48.628 INFO:teuthology.orchestra.run.smithi057.stdout: "complete_latency": { 2024-06-03T00:05:48.628 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.628 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.628 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.628 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:48.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.628 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-06-03T00:05:48.628 INFO:teuthology.orchestra.run.smithi057.stdout: "request": 0, 2024-06-03T00:05:48.628 INFO:teuthology.orchestra.run.smithi057.stdout: "reply": 0, 2024-06-03T00:05:48.628 INFO:teuthology.orchestra.run.smithi057.stdout: "reply_latency": { 2024-06-03T00:05:48.628 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.628 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.628 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.629 INFO:teuthology.orchestra.run.smithi057.stdout: "slow_reply": 0, 2024-06-03T00:05:48.629 INFO:teuthology.orchestra.run.smithi057.stdout: "forward": 0, 2024-06-03T00:05:48.629 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_fetch_complete": 0, 2024-06-03T00:05:48.629 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_fetch_keys": 0, 2024-06-03T00:05:48.629 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_commit": 0, 2024-06-03T00:05:48.629 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_split": 0, 2024-06-03T00:05:48.629 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_merge": 0, 2024-06-03T00:05:48.629 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes": 3292, 2024-06-03T00:05:48.629 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_top": 0, 2024-06-03T00:05:48.629 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_bottom": 3292, 2024-06-03T00:05:48.629 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_pin_tail": 0, 2024-06-03T00:05:48.629 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_pinned": 3292, 2024-06-03T00:05:48.630 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_expired": 0, 2024-06-03T00:05:48.630 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_with_caps": 0, 2024-06-03T00:05:48.630 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": 0, 2024-06-03T00:05:48.630 INFO:teuthology.orchestra.run.smithi057.stdout: "subtrees": 1, 2024-06-03T00:05:48.630 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse": 0, 2024-06-03T00:05:48.630 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_hit": 0, 2024-06-03T00:05:48.630 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_forward": 0, 2024-06-03T00:05:48.630 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_discover": 0, 2024-06-03T00:05:48.630 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_dir_fetch": 0, 2024-06-03T00:05:48.630 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_remote_ino": 0, 2024-06-03T00:05:48.630 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_lock": 0, 2024-06-03T00:05:48.630 INFO:teuthology.orchestra.run.smithi057.stdout: "load_cent": 0, 2024-06-03T00:05:48.630 INFO:teuthology.orchestra.run.smithi057.stdout: "q": 0, 2024-06-03T00:05:48.631 INFO:teuthology.orchestra.run.smithi057.stdout: "exported": 0, 2024-06-03T00:05:48.631 INFO:teuthology.orchestra.run.smithi057.stdout: "exported_inodes": 0, 2024-06-03T00:05:48.631 INFO:teuthology.orchestra.run.smithi057.stdout: "imported": 0, 2024-06-03T00:05:48.631 INFO:teuthology.orchestra.run.smithi057.stdout: "imported_inodes": 0, 2024-06-03T00:05:48.631 INFO:teuthology.orchestra.run.smithi057.stdout: "openino_dir_fetch": 0, 2024-06-03T00:05:48.631 INFO:teuthology.orchestra.run.smithi057.stdout: "openino_backtrace_fetch": 0, 2024-06-03T00:05:48.631 INFO:teuthology.orchestra.run.smithi057.stdout: "openino_peer_discover": 0, 2024-06-03T00:05:48.631 INFO:teuthology.orchestra.run.smithi057.stdout: "root_rfiles": 0, 2024-06-03T00:05:48.631 INFO:teuthology.orchestra.run.smithi057.stdout: "root_rbytes": 0, 2024-06-03T00:05:48.631 INFO:teuthology.orchestra.run.smithi057.stdout: "root_rsnaps": 0, 2024-06-03T00:05:48.631 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_backtrace_fetch": 0, 2024-06-03T00:05:48.631 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_set_tag": 0, 2024-06-03T00:05:48.631 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_backtrace_repaired": 0, 2024-06-03T00:05:48.632 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_inotable_repaired": 0, 2024-06-03T00:05:48.632 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_dir_inodes": 0, 2024-06-03T00:05:48.632 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_dir_base_inodes": 0, 2024-06-03T00:05:48.632 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_dirfrag_rstats": 0, 2024-06-03T00:05:48.632 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_file_inodes": 0, 2024-06-03T00:05:48.632 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_inode_file_caps": 0, 2024-06-03T00:05:48.632 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_revoke": 0, 2024-06-03T00:05:48.632 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_grant": 0, 2024-06-03T00:05:48.632 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_trunc": 0, 2024-06-03T00:05:48.632 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-03T00:05:48.632 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-03T00:05:48.632 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_caps": 0, 2024-06-03T00:05:48.632 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_caps_dirty": 0, 2024-06-03T00:05:48.632 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_cap_release": 0, 2024-06-03T00:05:48.632 INFO:teuthology.orchestra.run.smithi057.stdout: "process_request_cap_release": 0 2024-06-03T00:05:48.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.633 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_cache": { 2024-06-03T00:05:48.633 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_update": 0, 2024-06-03T00:05:48.633 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_update_receipt": 0, 2024-06-03T00:05:48.633 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_try_discover": 0, 2024-06-03T00:05:48.633 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_send_discover": 0, 2024-06-03T00:05:48.633 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_handle_discover": 0, 2024-06-03T00:05:48.633 INFO:teuthology.orchestra.run.smithi057.stdout: "num_strays": 0, 2024-06-03T00:05:48.633 INFO:teuthology.orchestra.run.smithi057.stdout: "num_strays_delayed": 0, 2024-06-03T00:05:48.633 INFO:teuthology.orchestra.run.smithi057.stdout: "num_strays_enqueuing": 0, 2024-06-03T00:05:48.633 INFO:teuthology.orchestra.run.smithi057.stdout: "strays_created": 0, 2024-06-03T00:05:48.633 INFO:teuthology.orchestra.run.smithi057.stdout: "strays_enqueued": 0, 2024-06-03T00:05:48.633 INFO:teuthology.orchestra.run.smithi057.stdout: "strays_reintegrated": 0, 2024-06-03T00:05:48.633 INFO:teuthology.orchestra.run.smithi057.stdout: "strays_migrated": 0, 2024-06-03T00:05:48.634 INFO:teuthology.orchestra.run.smithi057.stdout: "num_recovering_processing": 0, 2024-06-03T00:05:48.634 INFO:teuthology.orchestra.run.smithi057.stdout: "num_recovering_enqueued": 0, 2024-06-03T00:05:48.634 INFO:teuthology.orchestra.run.smithi057.stdout: "num_recovering_prioritized": 0, 2024-06-03T00:05:48.634 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_started": 0, 2024-06-03T00:05:48.634 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_completed": 0, 2024-06-03T00:05:48.634 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_quiesce_path": 0, 2024-06-03T00:05:48.634 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_quiesce_inode": 0, 2024-06-03T00:05:48.634 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_enqueue_scrub": 0, 2024-06-03T00:05:48.634 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_exportdir": 0, 2024-06-03T00:05:48.634 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_flush": 0, 2024-06-03T00:05:48.634 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_fragmentdir": 0, 2024-06-03T00:05:48.634 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_fragstats": 0, 2024-06-03T00:05:48.634 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_inodestats": 0 2024-06-03T00:05:48.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.635 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_log": { 2024-06-03T00:05:48.635 INFO:teuthology.orchestra.run.smithi057.stdout: "evlrg": 0, 2024-06-03T00:05:48.635 INFO:teuthology.orchestra.run.smithi057.stdout: "evadd": 0, 2024-06-03T00:05:48.635 INFO:teuthology.orchestra.run.smithi057.stdout: "evex": 0, 2024-06-03T00:05:48.635 INFO:teuthology.orchestra.run.smithi057.stdout: "evtrm": 0, 2024-06-03T00:05:48.635 INFO:teuthology.orchestra.run.smithi057.stdout: "ev": 10142, 2024-06-03T00:05:48.635 INFO:teuthology.orchestra.run.smithi057.stdout: "evexg": 0, 2024-06-03T00:05:48.635 INFO:teuthology.orchestra.run.smithi057.stdout: "evexd": 0, 2024-06-03T00:05:48.635 INFO:teuthology.orchestra.run.smithi057.stdout: "segadd": 0, 2024-06-03T00:05:48.635 INFO:teuthology.orchestra.run.smithi057.stdout: "segex": 0, 2024-06-03T00:05:48.635 INFO:teuthology.orchestra.run.smithi057.stdout: "segtrm": 0, 2024-06-03T00:05:48.635 INFO:teuthology.orchestra.run.smithi057.stdout: "seg": 14, 2024-06-03T00:05:48.635 INFO:teuthology.orchestra.run.smithi057.stdout: "segmjr": 2, 2024-06-03T00:05:48.636 INFO:teuthology.orchestra.run.smithi057.stdout: "segexg": 0, 2024-06-03T00:05:48.636 INFO:teuthology.orchestra.run.smithi057.stdout: "segexd": 0, 2024-06-03T00:05:48.636 INFO:teuthology.orchestra.run.smithi057.stdout: "expos": 4194304, 2024-06-03T00:05:48.636 INFO:teuthology.orchestra.run.smithi057.stdout: "wrpos": 26956790, 2024-06-03T00:05:48.636 INFO:teuthology.orchestra.run.smithi057.stdout: "rdpos": 26955652, 2024-06-03T00:05:48.636 INFO:teuthology.orchestra.run.smithi057.stdout: "jlat": { 2024-06-03T00:05:48.636 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.636 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.636 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.636 INFO:teuthology.orchestra.run.smithi057.stdout: "replayed": 10142 2024-06-03T00:05:48.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.636 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_mem": { 2024-06-03T00:05:48.636 INFO:teuthology.orchestra.run.smithi057.stdout: "ino": 18, 2024-06-03T00:05:48.637 INFO:teuthology.orchestra.run.smithi057.stdout: "ino+": 3161, 2024-06-03T00:05:48.637 INFO:teuthology.orchestra.run.smithi057.stdout: "ino-": 3143, 2024-06-03T00:05:48.637 INFO:teuthology.orchestra.run.smithi057.stdout: "dir": 16, 2024-06-03T00:05:48.637 INFO:teuthology.orchestra.run.smithi057.stdout: "dir+": 442, 2024-06-03T00:05:48.637 INFO:teuthology.orchestra.run.smithi057.stdout: "dir-": 426, 2024-06-03T00:05:48.637 INFO:teuthology.orchestra.run.smithi057.stdout: "dn": 3292, 2024-06-03T00:05:48.637 INFO:teuthology.orchestra.run.smithi057.stdout: "dn+": 6551, 2024-06-03T00:05:48.637 INFO:teuthology.orchestra.run.smithi057.stdout: "dn-": 3259, 2024-06-03T00:05:48.637 INFO:teuthology.orchestra.run.smithi057.stdout: "cap": 0, 2024-06-03T00:05:48.637 INFO:teuthology.orchestra.run.smithi057.stdout: "cap+": 0, 2024-06-03T00:05:48.637 INFO:teuthology.orchestra.run.smithi057.stdout: "cap-": 0, 2024-06-03T00:05:48.637 INFO:teuthology.orchestra.run.smithi057.stdout: "rss": 61304, 2024-06-03T00:05:48.637 INFO:teuthology.orchestra.run.smithi057.stdout: "heap": 215420 2024-06-03T00:05:48.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.638 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_server": { 2024-06-03T00:05:48.638 INFO:teuthology.orchestra.run.smithi057.stdout: "dispatch_client_request": 0, 2024-06-03T00:05:48.638 INFO:teuthology.orchestra.run.smithi057.stdout: "dispatch_server_request": 0, 2024-06-03T00:05:48.638 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_request": 0, 2024-06-03T00:05:48.638 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_session": 0, 2024-06-03T00:05:48.638 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_peer_request": 0, 2024-06-03T00:05:48.638 INFO:teuthology.orchestra.run.smithi057.stdout: "req_create_latency": { 2024-06-03T00:05:48.638 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.638 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.638 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.638 INFO:teuthology.orchestra.run.smithi057.stdout: "req_getattr_latency": { 2024-06-03T00:05:48.638 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.639 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.639 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.639 INFO:teuthology.orchestra.run.smithi057.stdout: "req_getfilelock_latency": { 2024-06-03T00:05:48.639 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.639 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.639 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.639 INFO:teuthology.orchestra.run.smithi057.stdout: "req_link_latency": { 2024-06-03T00:05:48.639 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.639 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.639 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.639 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookup_latency": { 2024-06-03T00:05:48.639 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.640 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.640 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.640 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookuphash_latency": { 2024-06-03T00:05:48.640 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.640 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.640 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.640 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookupino_latency": { 2024-06-03T00:05:48.640 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.640 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.640 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.640 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookupname_latency": { 2024-06-03T00:05:48.640 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.641 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.641 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.641 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookupparent_latency": { 2024-06-03T00:05:48.641 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.641 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.641 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.641 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookupsnap_latency": { 2024-06-03T00:05:48.641 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.641 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.641 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.641 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lssnap_latency": { 2024-06-03T00:05:48.641 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.642 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.642 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.642 INFO:teuthology.orchestra.run.smithi057.stdout: "req_mkdir_latency": { 2024-06-03T00:05:48.642 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.642 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.642 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.642 INFO:teuthology.orchestra.run.smithi057.stdout: "req_mknod_latency": { 2024-06-03T00:05:48.642 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.642 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.642 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.643 INFO:teuthology.orchestra.run.smithi057.stdout: "req_mksnap_latency": { 2024-06-03T00:05:48.643 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.643 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.643 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.643 INFO:teuthology.orchestra.run.smithi057.stdout: "req_open_latency": { 2024-06-03T00:05:48.643 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.643 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.643 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.643 INFO:teuthology.orchestra.run.smithi057.stdout: "req_readdir_latency": { 2024-06-03T00:05:48.643 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.643 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.643 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.644 INFO:teuthology.orchestra.run.smithi057.stdout: "req_rename_latency": { 2024-06-03T00:05:48.644 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.644 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.644 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.644 INFO:teuthology.orchestra.run.smithi057.stdout: "req_renamesnap_latency": { 2024-06-03T00:05:48.644 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.644 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.644 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.644 INFO:teuthology.orchestra.run.smithi057.stdout: "req_snapdiff_latency": { 2024-06-03T00:05:48.644 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.644 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.645 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.645 INFO:teuthology.orchestra.run.smithi057.stdout: "req_rmdir_latency": { 2024-06-03T00:05:48.645 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.645 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.645 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.645 INFO:teuthology.orchestra.run.smithi057.stdout: "req_rmsnap_latency": { 2024-06-03T00:05:48.645 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.645 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.645 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.645 INFO:teuthology.orchestra.run.smithi057.stdout: "req_rmxattr_latency": { 2024-06-03T00:05:48.645 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.646 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.646 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.646 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setattr_latency": { 2024-06-03T00:05:48.646 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.646 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.646 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.646 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setdirlayout_latency": { 2024-06-03T00:05:48.646 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.646 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.646 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.647 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setfilelock_latency": { 2024-06-03T00:05:48.647 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.647 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.647 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.647 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setlayout_latency": { 2024-06-03T00:05:48.647 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.647 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.647 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.647 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setxattr_latency": { 2024-06-03T00:05:48.647 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.647 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.647 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.648 INFO:teuthology.orchestra.run.smithi057.stdout: "req_symlink_latency": { 2024-06-03T00:05:48.648 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.648 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.648 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.648 INFO:teuthology.orchestra.run.smithi057.stdout: "req_unlink_latency": { 2024-06-03T00:05:48.648 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.648 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.648 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.648 INFO:teuthology.orchestra.run.smithi057.stdout: "cap_revoke_eviction": 0, 2024-06-03T00:05:48.648 INFO:teuthology.orchestra.run.smithi057.stdout: "cap_acquisition_throttle": 0, 2024-06-03T00:05:48.648 INFO:teuthology.orchestra.run.smithi057.stdout: "req_getvxattr_latency": { 2024-06-03T00:05:48.648 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.649 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.649 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.649 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:48.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.649 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_sessions": { 2024-06-03T00:05:48.649 INFO:teuthology.orchestra.run.smithi057.stdout: "session_count": 1, 2024-06-03T00:05:48.649 INFO:teuthology.orchestra.run.smithi057.stdout: "session_add": 1, 2024-06-03T00:05:48.649 INFO:teuthology.orchestra.run.smithi057.stdout: "session_remove": 0, 2024-06-03T00:05:48.649 INFO:teuthology.orchestra.run.smithi057.stdout: "sessions_open": 1, 2024-06-03T00:05:48.649 INFO:teuthology.orchestra.run.smithi057.stdout: "sessions_stale": 0, 2024-06-03T00:05:48.649 INFO:teuthology.orchestra.run.smithi057.stdout: "total_load": 0, 2024-06-03T00:05:48.649 INFO:teuthology.orchestra.run.smithi057.stdout: "average_load": 0, 2024-06-03T00:05:48.649 INFO:teuthology.orchestra.run.smithi057.stdout: "avg_session_uptime": 1811, 2024-06-03T00:05:48.649 INFO:teuthology.orchestra.run.smithi057.stdout: "mdthresh_evicted": 0 2024-06-03T00:05:48.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.650 INFO:teuthology.orchestra.run.smithi057.stdout: "mempool": { 2024-06-03T00:05:48.650 INFO:teuthology.orchestra.run.smithi057.stdout: "bloom_filter_bytes": 0, 2024-06-03T00:05:48.650 INFO:teuthology.orchestra.run.smithi057.stdout: "bloom_filter_items": 0, 2024-06-03T00:05:48.650 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_alloc_bytes": 0, 2024-06-03T00:05:48.650 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_alloc_items": 0, 2024-06-03T00:05:48.650 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_data_bytes": 0, 2024-06-03T00:05:48.650 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_data_items": 0, 2024-06-03T00:05:48.650 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-03T00:05:48.650 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_onode_items": 0, 2024-06-03T00:05:48.650 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-03T00:05:48.650 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_meta_items": 0, 2024-06-03T00:05:48.650 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_other_bytes": 0, 2024-06-03T00:05:48.651 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_other_items": 0, 2024-06-03T00:05:48.651 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-03T00:05:48.651 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_buffer_items": 0, 2024-06-03T00:05:48.651 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_extent_bytes": 0, 2024-06-03T00:05:48.651 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_extent_items": 0, 2024-06-03T00:05:48.651 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_blob_bytes": 0, 2024-06-03T00:05:48.651 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_blob_items": 0, 2024-06-03T00:05:48.651 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-03T00:05:48.651 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_shared_blob_items": 0, 2024-06-03T00:05:48.651 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-03T00:05:48.651 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_inline_bl_items": 0, 2024-06-03T00:05:48.651 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_fsck_bytes": 0, 2024-06-03T00:05:48.651 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_fsck_items": 0, 2024-06-03T00:05:48.652 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_txc_bytes": 0, 2024-06-03T00:05:48.652 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_txc_items": 0, 2024-06-03T00:05:48.652 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-03T00:05:48.652 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_writing_deferred_items": 0, 2024-06-03T00:05:48.652 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_writing_bytes": 0, 2024-06-03T00:05:48.652 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_writing_items": 0, 2024-06-03T00:05:48.652 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_bytes": 0, 2024-06-03T00:05:48.652 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_items": 0, 2024-06-03T00:05:48.652 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_file_reader_bytes": 0, 2024-06-03T00:05:48.652 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_file_reader_items": 0, 2024-06-03T00:05:48.652 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_file_writer_bytes": 0, 2024-06-03T00:05:48.652 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_file_writer_items": 0, 2024-06-03T00:05:48.652 INFO:teuthology.orchestra.run.smithi057.stdout: "buffer_anon_bytes": 215430, 2024-06-03T00:05:48.653 INFO:teuthology.orchestra.run.smithi057.stdout: "buffer_anon_items": 73, 2024-06-03T00:05:48.653 INFO:teuthology.orchestra.run.smithi057.stdout: "buffer_meta_bytes": 0, 2024-06-03T00:05:48.653 INFO:teuthology.orchestra.run.smithi057.stdout: "buffer_meta_items": 0, 2024-06-03T00:05:48.653 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_bytes": 0, 2024-06-03T00:05:48.653 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_items": 0, 2024-06-03T00:05:48.653 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mapbl_bytes": 0, 2024-06-03T00:05:48.653 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mapbl_items": 0, 2024-06-03T00:05:48.653 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pglog_bytes": 0, 2024-06-03T00:05:48.653 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pglog_items": 0, 2024-06-03T00:05:48.653 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_bytes": 7624, 2024-06-03T00:05:48.653 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_items": 160, 2024-06-03T00:05:48.653 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_mapping_bytes": 0, 2024-06-03T00:05:48.653 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_mapping_items": 0, 2024-06-03T00:05:48.653 INFO:teuthology.orchestra.run.smithi057.stdout: "pgmap_bytes": 0, 2024-06-03T00:05:48.653 INFO:teuthology.orchestra.run.smithi057.stdout: "pgmap_items": 0, 2024-06-03T00:05:48.654 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_co_bytes": 2381622, 2024-06-03T00:05:48.654 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_co_items": 15497, 2024-06-03T00:05:48.654 INFO:teuthology.orchestra.run.smithi057.stdout: "unittest_1_bytes": 0, 2024-06-03T00:05:48.654 INFO:teuthology.orchestra.run.smithi057.stdout: "unittest_1_items": 0, 2024-06-03T00:05:48.654 INFO:teuthology.orchestra.run.smithi057.stdout: "unittest_2_bytes": 0, 2024-06-03T00:05:48.654 INFO:teuthology.orchestra.run.smithi057.stdout: "unittest_2_items": 0 2024-06-03T00:05:48.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.654 INFO:teuthology.orchestra.run.smithi057.stdout: "objecter": { 2024-06-03T00:05:48.654 INFO:teuthology.orchestra.run.smithi057.stdout: "op_active": 0, 2024-06-03T00:05:48.654 INFO:teuthology.orchestra.run.smithi057.stdout: "op_laggy": 0, 2024-06-03T00:05:48.654 INFO:teuthology.orchestra.run.smithi057.stdout: "op_send": 1386, 2024-06-03T00:05:48.654 INFO:teuthology.orchestra.run.smithi057.stdout: "op_send_bytes": 21, 2024-06-03T00:05:48.654 INFO:teuthology.orchestra.run.smithi057.stdout: "op_resend": 3, 2024-06-03T00:05:48.655 INFO:teuthology.orchestra.run.smithi057.stdout: "op_reply": 1386, 2024-06-03T00:05:48.655 INFO:teuthology.orchestra.run.smithi057.stdout: "op_latency": { 2024-06-03T00:05:48.655 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 1386, 2024-06-03T00:05:48.655 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 1.501977177, 2024-06-03T00:05:48.655 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.001083677 2024-06-03T00:05:48.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.655 INFO:teuthology.orchestra.run.smithi057.stdout: "op_inflight": 0, 2024-06-03T00:05:48.655 INFO:teuthology.orchestra.run.smithi057.stdout: "oplen_avg": { 2024-06-03T00:05:48.655 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 1386, 2024-06-03T00:05:48.655 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 1387 2024-06-03T00:05:48.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.656 INFO:teuthology.orchestra.run.smithi057.stdout: "op": 1386, 2024-06-03T00:05:48.656 INFO:teuthology.orchestra.run.smithi057.stdout: "op_r": 1386, 2024-06-03T00:05:48.656 INFO:teuthology.orchestra.run.smithi057.stdout: "op_w": 0, 2024-06-03T00:05:48.656 INFO:teuthology.orchestra.run.smithi057.stdout: "op_rmw": 0, 2024-06-03T00:05:48.656 INFO:teuthology.orchestra.run.smithi057.stdout: "op_pg": 0, 2024-06-03T00:05:48.656 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_stat": 813, 2024-06-03T00:05:48.656 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_create": 0, 2024-06-03T00:05:48.656 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_read": 571, 2024-06-03T00:05:48.656 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_write": 0, 2024-06-03T00:05:48.656 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_writefull": 0, 2024-06-03T00:05:48.656 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_writesame": 0, 2024-06-03T00:05:48.656 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_append": 0, 2024-06-03T00:05:48.656 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_zero": 0, 2024-06-03T00:05:48.656 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_truncate": 0, 2024-06-03T00:05:48.657 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_delete": 0, 2024-06-03T00:05:48.657 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_mapext": 0, 2024-06-03T00:05:48.657 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_sparse_read": 0, 2024-06-03T00:05:48.657 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_clonerange": 0, 2024-06-03T00:05:48.657 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_getxattr": 1, 2024-06-03T00:05:48.657 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_setxattr": 0, 2024-06-03T00:05:48.657 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_cmpxattr": 0, 2024-06-03T00:05:48.657 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_rmxattr": 0, 2024-06-03T00:05:48.657 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_resetxattrs": 0, 2024-06-03T00:05:48.657 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_call": 0, 2024-06-03T00:05:48.657 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_watch": 0, 2024-06-03T00:05:48.657 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_notify": 0, 2024-06-03T00:05:48.657 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_src_cmpxattr": 0, 2024-06-03T00:05:48.658 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_pgls": 0, 2024-06-03T00:05:48.658 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_pgls_filter": 0, 2024-06-03T00:05:48.658 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_other": 0, 2024-06-03T00:05:48.658 INFO:teuthology.orchestra.run.smithi057.stdout: "linger_active": 0, 2024-06-03T00:05:48.658 INFO:teuthology.orchestra.run.smithi057.stdout: "linger_send": 0, 2024-06-03T00:05:48.658 INFO:teuthology.orchestra.run.smithi057.stdout: "linger_resend": 0, 2024-06-03T00:05:48.658 INFO:teuthology.orchestra.run.smithi057.stdout: "linger_ping": 0, 2024-06-03T00:05:48.658 INFO:teuthology.orchestra.run.smithi057.stdout: "poolop_active": 0, 2024-06-03T00:05:48.658 INFO:teuthology.orchestra.run.smithi057.stdout: "poolop_send": 0, 2024-06-03T00:05:48.658 INFO:teuthology.orchestra.run.smithi057.stdout: "poolop_resend": 0, 2024-06-03T00:05:48.658 INFO:teuthology.orchestra.run.smithi057.stdout: "poolstat_active": 0, 2024-06-03T00:05:48.658 INFO:teuthology.orchestra.run.smithi057.stdout: "poolstat_send": 0, 2024-06-03T00:05:48.658 INFO:teuthology.orchestra.run.smithi057.stdout: "poolstat_resend": 0, 2024-06-03T00:05:48.658 INFO:teuthology.orchestra.run.smithi057.stdout: "statfs_active": 0, 2024-06-03T00:05:48.659 INFO:teuthology.orchestra.run.smithi057.stdout: "statfs_send": 0, 2024-06-03T00:05:48.659 INFO:teuthology.orchestra.run.smithi057.stdout: "statfs_resend": 0, 2024-06-03T00:05:48.659 INFO:teuthology.orchestra.run.smithi057.stdout: "command_active": 0, 2024-06-03T00:05:48.659 INFO:teuthology.orchestra.run.smithi057.stdout: "command_send": 0, 2024-06-03T00:05:48.659 INFO:teuthology.orchestra.run.smithi057.stdout: "command_resend": 0, 2024-06-03T00:05:48.659 INFO:teuthology.orchestra.run.smithi057.stdout: "map_epoch": 90, 2024-06-03T00:05:48.659 INFO:teuthology.orchestra.run.smithi057.stdout: "map_full": 0, 2024-06-03T00:05:48.659 INFO:teuthology.orchestra.run.smithi057.stdout: "map_inc": 2, 2024-06-03T00:05:48.659 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_sessions": 8, 2024-06-03T00:05:48.659 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_session_open": 8, 2024-06-03T00:05:48.659 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_session_close": 0, 2024-06-03T00:05:48.659 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_laggy": 0, 2024-06-03T00:05:48.659 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_wr": 0, 2024-06-03T00:05:48.659 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_rd": 2, 2024-06-03T00:05:48.659 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_del": 0 2024-06-03T00:05:48.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.660 INFO:teuthology.orchestra.run.smithi057.stdout: "oft": { 2024-06-03T00:05:48.660 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_total_objs": 0, 2024-06-03T00:05:48.660 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_total_kv_pairs": 0, 2024-06-03T00:05:48.660 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_total_updates": 0, 2024-06-03T00:05:48.660 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_total_removes": 0 2024-06-03T00:05:48.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.660 INFO:teuthology.orchestra.run.smithi057.stdout: "osd-slow-ops": { 2024-06-03T00:05:48.660 INFO:teuthology.orchestra.run.smithi057.stdout: "slow_ops_count": 0 2024-06-03T00:05:48.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.660 INFO:teuthology.orchestra.run.smithi057.stdout: "purge_queue": { 2024-06-03T00:05:48.660 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executing_ops": 0, 2024-06-03T00:05:48.660 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executing_ops_high_water": 0, 2024-06-03T00:05:48.660 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executing": 0, 2024-06-03T00:05:48.660 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executing_high_water": 0, 2024-06-03T00:05:48.661 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executed_ops": 0, 2024-06-03T00:05:48.661 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executed": 0, 2024-06-03T00:05:48.661 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_item_in_journal": 0 2024-06-03T00:05:48.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.661 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-03T00:05:48.661 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2024-06-03T00:05:48.661 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 104857600, 2024-06-03T00:05:48.661 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2024-06-03T00:05:48.661 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 1564, 2024-06-03T00:05:48.661 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 23580993, 2024-06-03T00:05:48.661 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:48.661 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 1564, 2024-06-03T00:05:48.661 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 0, 2024-06-03T00:05:48.661 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 0, 2024-06-03T00:05:48.661 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 1564, 2024-06-03T00:05:48.662 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 23580993, 2024-06-03T00:05:48.662 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2024-06-03T00:05:48.662 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.662 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.662 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.662 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:48.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.662 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-objecter_bytes": { 2024-06-03T00:05:48.662 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2024-06-03T00:05:48.662 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 104857600, 2024-06-03T00:05:48.662 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2024-06-03T00:05:48.662 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 0, 2024-06-03T00:05:48.662 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 0, 2024-06-03T00:05:48.662 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:48.663 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 0, 2024-06-03T00:05:48.663 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 1386, 2024-06-03T00:05:48.663 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 22764207, 2024-06-03T00:05:48.663 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 1386, 2024-06-03T00:05:48.663 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 22764207, 2024-06-03T00:05:48.663 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2024-06-03T00:05:48.663 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.663 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.663 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.663 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:48.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.663 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-objecter_ops": { 2024-06-03T00:05:48.663 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2024-06-03T00:05:48.663 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 1024, 2024-06-03T00:05:48.664 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2024-06-03T00:05:48.664 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 0, 2024-06-03T00:05:48.664 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 0, 2024-06-03T00:05:48.664 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:48.664 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 0, 2024-06-03T00:05:48.664 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 1386, 2024-06-03T00:05:48.664 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 1386, 2024-06-03T00:05:48.664 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 1386, 2024-06-03T00:05:48.664 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 1386, 2024-06-03T00:05:48.664 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2024-06-03T00:05:48.664 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.664 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.664 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.664 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:48.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.665 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-write_buf_throttle": { 2024-06-03T00:05:48.665 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2024-06-03T00:05:48.665 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 3758096384, 2024-06-03T00:05:48.665 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2024-06-03T00:05:48.665 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 0, 2024-06-03T00:05:48.665 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 0, 2024-06-03T00:05:48.665 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:48.665 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 0, 2024-06-03T00:05:48.665 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 0, 2024-06-03T00:05:48.665 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 0, 2024-06-03T00:05:48.665 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 0, 2024-06-03T00:05:48.665 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 0, 2024-06-03T00:05:48.665 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2024-06-03T00:05:48.666 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.666 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.666 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.666 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:48.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-06-03T00:05:48.666 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-write_buf_throttle-0x5594ba9ca6e0": { 2024-06-03T00:05:48.666 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2024-06-03T00:05:48.666 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 3758096384, 2024-06-03T00:05:48.666 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2024-06-03T00:05:48.666 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 0, 2024-06-03T00:05:48.666 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 0, 2024-06-03T00:05:48.666 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:48.666 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 0, 2024-06-03T00:05:48.666 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 0, 2024-06-03T00:05:48.667 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 0, 2024-06-03T00:05:48.667 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 0, 2024-06-03T00:05:48.667 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 0, 2024-06-03T00:05:48.667 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2024-06-03T00:05:48.667 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2024-06-03T00:05:48.667 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2024-06-03T00:05:48.667 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2024-06-03T00:05:48.667 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:48.667 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-06-03T00:05:48.667 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-06-03T00:05:49.321 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:49 smithi057 ceph-mon[36457]: pgmap v556: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-03T00:05:49.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:49 smithi107 ceph-mon[37048]: pgmap v556: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-03T00:05:49.351 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-06-03T00:05:49.352 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-06-03T00:05:49.352 DEBUG:tasks.check_counter:Getting stats from c 2024-06-03T00:05:49.352 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph daemon mds.c perf dump 2024-06-03T00:05:49.453 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:49 smithi049 ceph-mon[32302]: pgmap v556: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-03T00:05:49.599 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.c/config 2024-06-03T00:05:51.278 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:51 smithi107 ceph-mon[37048]: pgmap v557: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-06-03T00:05:51.307 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-06-03T00:05:51.307 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-0": { 2024-06-03T00:05:51.307 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 15097, 2024-06-03T00:05:51.307 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 25504, 2024-06-03T00:05:51.307 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 4936470, 2024-06-03T00:05:51.307 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 21849063, 2024-06-03T00:05:51.307 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 23, 2024-06-03T00:05:51.307 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 5, 2024-06-03T00:05:51.307 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.792076725, 2024-06-03T00:05:51.308 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.398893165, 2024-06-03T00:05:51.308 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.463835407, 2024-06-03T00:05:51.308 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.048154782, 2024-06-03T00:05:51.308 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:51.308 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 25500, 2024-06-03T00:05:51.308 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.758042083, 2024-06-03T00:05:51.308 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000029727 2024-06-03T00:05:51.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.308 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:51.308 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 20306, 2024-06-03T00:05:51.308 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.004596497, 2024-06-03T00:05:51.308 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000226 2024-06-03T00:05:51.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.308 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-03T00:05:51.309 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 0 2024-06-03T00:05:51.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.309 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-1": { 2024-06-03T00:05:51.309 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 3050, 2024-06-03T00:05:51.309 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 3025, 2024-06-03T00:05:51.309 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 1638827, 2024-06-03T00:05:51.309 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 10023671, 2024-06-03T00:05:51.309 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 9, 2024-06-03T00:05:51.309 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 6, 2024-06-03T00:05:51.309 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.318966564, 2024-06-03T00:05:51.309 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.092223296, 2024-06-03T00:05:51.309 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.066641293, 2024-06-03T00:05:51.309 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.144713899, 2024-06-03T00:05:51.309 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:51.310 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 3025, 2024-06-03T00:05:51.310 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.136651282, 2024-06-03T00:05:51.310 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000045173 2024-06-03T00:05:51.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.310 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:51.310 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 67, 2024-06-03T00:05:51.310 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000024320, 2024-06-03T00:05:51.310 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000362 2024-06-03T00:05:51.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.310 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 593632, 2024-06-03T00:05:51.310 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 532160 2024-06-03T00:05:51.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.310 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-2": { 2024-06-03T00:05:51.311 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 6432, 2024-06-03T00:05:51.311 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 10495, 2024-06-03T00:05:51.311 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 4915607, 2024-06-03T00:05:51.311 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 8572208, 2024-06-03T00:05:51.311 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 10, 2024-06-03T00:05:51.311 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 7, 2024-06-03T00:05:51.311 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.522643892, 2024-06-03T00:05:51.311 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.254279968, 2024-06-03T00:05:51.311 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.257979028, 2024-06-03T00:05:51.311 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.033940827, 2024-06-03T00:05:51.311 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:51.311 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 10495, 2024-06-03T00:05:51.311 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.641896840, 2024-06-03T00:05:51.311 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000061162 2024-06-03T00:05:51.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.312 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:51.312 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 13566, 2024-06-03T00:05:51.312 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.002553274, 2024-06-03T00:05:51.312 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000188 2024-06-03T00:05:51.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.312 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 160, 2024-06-03T00:05:51.312 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 268448 2024-06-03T00:05:51.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.312 INFO:teuthology.orchestra.run.smithi107.stdout: "cct": { 2024-06-03T00:05:51.312 INFO:teuthology.orchestra.run.smithi107.stdout: "total_workers": 1, 2024-06-03T00:05:51.312 INFO:teuthology.orchestra.run.smithi107.stdout: "unhealthy_workers": 0 2024-06-03T00:05:51.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.313 INFO:teuthology.orchestra.run.smithi107.stdout: "finisher-MDSRank": { 2024-06-03T00:05:51.313 INFO:teuthology.orchestra.run.smithi107.stdout: "queue_len": 0, 2024-06-03T00:05:51.313 INFO:teuthology.orchestra.run.smithi107.stdout: "complete_latency": { 2024-06-03T00:05:51.313 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 2992, 2024-06-03T00:05:51.313 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 5.570580392, 2024-06-03T00:05:51.313 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.001861824 2024-06-03T00:05:51.313 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:51.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.313 INFO:teuthology.orchestra.run.smithi107.stdout: "finisher-PurgeQueue": { 2024-06-03T00:05:51.313 INFO:teuthology.orchestra.run.smithi107.stdout: "queue_len": 0, 2024-06-03T00:05:51.313 INFO:teuthology.orchestra.run.smithi107.stdout: "complete_latency": { 2024-06-03T00:05:51.313 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 5981, 2024-06-03T00:05:51.313 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.529034671, 2024-06-03T00:05:51.313 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000088452 2024-06-03T00:05:51.313 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:51.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.314 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": { 2024-06-03T00:05:51.314 INFO:teuthology.orchestra.run.smithi107.stdout: "request": 7497, 2024-06-03T00:05:51.314 INFO:teuthology.orchestra.run.smithi107.stdout: "reply": 7473, 2024-06-03T00:05:51.314 INFO:teuthology.orchestra.run.smithi107.stdout: "reply_latency": { 2024-06-03T00:05:51.314 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 7473, 2024-06-03T00:05:51.314 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 93.045943151, 2024-06-03T00:05:51.314 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.012450949 2024-06-03T00:05:51.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.314 INFO:teuthology.orchestra.run.smithi107.stdout: "slow_reply": 0, 2024-06-03T00:05:51.314 INFO:teuthology.orchestra.run.smithi107.stdout: "forward": 24, 2024-06-03T00:05:51.314 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_fetch_complete": 20, 2024-06-03T00:05:51.314 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_fetch_keys": 0, 2024-06-03T00:05:51.315 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_commit": 11, 2024-06-03T00:05:51.315 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_split": 0, 2024-06-03T00:05:51.315 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_merge": 0, 2024-06-03T00:05:51.315 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes": 201, 2024-06-03T00:05:51.315 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_top": 118, 2024-06-03T00:05:51.315 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_bottom": 63, 2024-06-03T00:05:51.315 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_pin_tail": 20, 2024-06-03T00:05:51.315 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_pinned": 29, 2024-06-03T00:05:51.315 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_expired": 202, 2024-06-03T00:05:51.315 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_with_caps": 2, 2024-06-03T00:05:51.315 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": 2, 2024-06-03T00:05:51.315 INFO:teuthology.orchestra.run.smithi107.stdout: "subtrees": 4, 2024-06-03T00:05:51.315 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse": 11670, 2024-06-03T00:05:51.315 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_hit": 10509, 2024-06-03T00:05:51.316 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_forward": 22, 2024-06-03T00:05:51.316 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_discover": 14, 2024-06-03T00:05:51.316 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_dir_fetch": 0, 2024-06-03T00:05:51.316 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_remote_ino": 0, 2024-06-03T00:05:51.316 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_lock": 1, 2024-06-03T00:05:51.316 INFO:teuthology.orchestra.run.smithi107.stdout: "load_cent": 0, 2024-06-03T00:05:51.316 INFO:teuthology.orchestra.run.smithi107.stdout: "q": 0, 2024-06-03T00:05:51.316 INFO:teuthology.orchestra.run.smithi107.stdout: "exported": 15, 2024-06-03T00:05:51.316 INFO:teuthology.orchestra.run.smithi107.stdout: "exported_inodes": 79, 2024-06-03T00:05:51.316 INFO:teuthology.orchestra.run.smithi107.stdout: "imported": 15, 2024-06-03T00:05:51.316 INFO:teuthology.orchestra.run.smithi107.stdout: "imported_inodes": 2726, 2024-06-03T00:05:51.316 INFO:teuthology.orchestra.run.smithi107.stdout: "openino_dir_fetch": 0, 2024-06-03T00:05:51.316 INFO:teuthology.orchestra.run.smithi107.stdout: "openino_backtrace_fetch": 976, 2024-06-03T00:05:51.316 INFO:teuthology.orchestra.run.smithi107.stdout: "openino_peer_discover": 0, 2024-06-03T00:05:51.317 INFO:teuthology.orchestra.run.smithi107.stdout: "root_rfiles": 6731, 2024-06-03T00:05:51.317 INFO:teuthology.orchestra.run.smithi107.stdout: "root_rbytes": 44994472, 2024-06-03T00:05:51.317 INFO:teuthology.orchestra.run.smithi107.stdout: "root_rsnaps": 0, 2024-06-03T00:05:51.317 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_backtrace_fetch": 976, 2024-06-03T00:05:51.317 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_set_tag": 0, 2024-06-03T00:05:51.317 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_backtrace_repaired": 0, 2024-06-03T00:05:51.317 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_inotable_repaired": 0, 2024-06-03T00:05:51.317 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_dir_inodes": 15, 2024-06-03T00:05:51.317 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_dir_base_inodes": 0, 2024-06-03T00:05:51.317 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_dirfrag_rstats": 15, 2024-06-03T00:05:51.317 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_file_inodes": 961, 2024-06-03T00:05:51.317 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_inode_file_caps": 6, 2024-06-03T00:05:51.317 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_revoke": 3308, 2024-06-03T00:05:51.317 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_grant": 4767, 2024-06-03T00:05:51.318 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_trunc": 52, 2024-06-03T00:05:51.318 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-03T00:05:51.318 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-03T00:05:51.318 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_caps": 5568, 2024-06-03T00:05:51.318 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_caps_dirty": 2089, 2024-06-03T00:05:51.318 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_cap_release": 127, 2024-06-03T00:05:51.318 INFO:teuthology.orchestra.run.smithi107.stdout: "process_request_cap_release": 4601 2024-06-03T00:05:51.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.318 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_cache": { 2024-06-03T00:05:51.318 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_update": 0, 2024-06-03T00:05:51.318 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_update_receipt": 0, 2024-06-03T00:05:51.318 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_try_discover": 0, 2024-06-03T00:05:51.318 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_send_discover": 15, 2024-06-03T00:05:51.318 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_handle_discover": 6, 2024-06-03T00:05:51.319 INFO:teuthology.orchestra.run.smithi107.stdout: "num_strays": 6, 2024-06-03T00:05:51.319 INFO:teuthology.orchestra.run.smithi107.stdout: "num_strays_delayed": 0, 2024-06-03T00:05:51.319 INFO:teuthology.orchestra.run.smithi107.stdout: "num_strays_enqueuing": 0, 2024-06-03T00:05:51.319 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_created": 3133, 2024-06-03T00:05:51.319 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_enqueued": 3101, 2024-06-03T00:05:51.319 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_reintegrated": 27, 2024-06-03T00:05:51.319 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_migrated": 0, 2024-06-03T00:05:51.319 INFO:teuthology.orchestra.run.smithi107.stdout: "num_recovering_processing": 0, 2024-06-03T00:05:51.319 INFO:teuthology.orchestra.run.smithi107.stdout: "num_recovering_enqueued": 0, 2024-06-03T00:05:51.319 INFO:teuthology.orchestra.run.smithi107.stdout: "num_recovering_prioritized": 0, 2024-06-03T00:05:51.319 INFO:teuthology.orchestra.run.smithi107.stdout: "recovery_started": 0, 2024-06-03T00:05:51.319 INFO:teuthology.orchestra.run.smithi107.stdout: "recovery_completed": 0, 2024-06-03T00:05:51.319 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_quiesce_path": 4, 2024-06-03T00:05:51.319 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_quiesce_inode": 5656, 2024-06-03T00:05:51.320 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_enqueue_scrub": 0, 2024-06-03T00:05:51.320 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_exportdir": 15, 2024-06-03T00:05:51.320 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_flush": 0, 2024-06-03T00:05:51.320 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_fragmentdir": 0, 2024-06-03T00:05:51.320 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_fragstats": 0, 2024-06-03T00:05:51.320 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_inodestats": 0 2024-06-03T00:05:51.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.320 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_log": { 2024-06-03T00:05:51.320 INFO:teuthology.orchestra.run.smithi107.stdout: "evlrg": 0, 2024-06-03T00:05:51.320 INFO:teuthology.orchestra.run.smithi107.stdout: "evadd": 10142, 2024-06-03T00:05:51.320 INFO:teuthology.orchestra.run.smithi107.stdout: "evex": 0, 2024-06-03T00:05:51.320 INFO:teuthology.orchestra.run.smithi107.stdout: "evtrm": 0, 2024-06-03T00:05:51.320 INFO:teuthology.orchestra.run.smithi107.stdout: "ev": 10142, 2024-06-03T00:05:51.320 INFO:teuthology.orchestra.run.smithi107.stdout: "evexg": 0, 2024-06-03T00:05:51.321 INFO:teuthology.orchestra.run.smithi107.stdout: "evexd": 0, 2024-06-03T00:05:51.321 INFO:teuthology.orchestra.run.smithi107.stdout: "segadd": 14, 2024-06-03T00:05:51.321 INFO:teuthology.orchestra.run.smithi107.stdout: "segex": 0, 2024-06-03T00:05:51.321 INFO:teuthology.orchestra.run.smithi107.stdout: "segtrm": 0, 2024-06-03T00:05:51.321 INFO:teuthology.orchestra.run.smithi107.stdout: "seg": 14, 2024-06-03T00:05:51.321 INFO:teuthology.orchestra.run.smithi107.stdout: "segmjr": 2, 2024-06-03T00:05:51.321 INFO:teuthology.orchestra.run.smithi107.stdout: "segexg": 0, 2024-06-03T00:05:51.321 INFO:teuthology.orchestra.run.smithi107.stdout: "segexd": 0, 2024-06-03T00:05:51.321 INFO:teuthology.orchestra.run.smithi107.stdout: "expos": 4194304, 2024-06-03T00:05:51.321 INFO:teuthology.orchestra.run.smithi107.stdout: "wrpos": 26956790, 2024-06-03T00:05:51.321 INFO:teuthology.orchestra.run.smithi107.stdout: "rdpos": 0, 2024-06-03T00:05:51.321 INFO:teuthology.orchestra.run.smithi107.stdout: "jlat": { 2024-06-03T00:05:51.321 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 1254, 2024-06-03T00:05:51.321 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 9.025301289, 2024-06-03T00:05:51.322 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.007197209 2024-06-03T00:05:51.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.322 INFO:teuthology.orchestra.run.smithi107.stdout: "replayed": 0 2024-06-03T00:05:51.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.322 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_mem": { 2024-06-03T00:05:51.322 INFO:teuthology.orchestra.run.smithi107.stdout: "ino": 30, 2024-06-03T00:05:51.322 INFO:teuthology.orchestra.run.smithi107.stdout: "ino+": 3220, 2024-06-03T00:05:51.322 INFO:teuthology.orchestra.run.smithi107.stdout: "ino-": 3190, 2024-06-03T00:05:51.322 INFO:teuthology.orchestra.run.smithi107.stdout: "dir": 29, 2024-06-03T00:05:51.322 INFO:teuthology.orchestra.run.smithi107.stdout: "dir+": 438, 2024-06-03T00:05:51.322 INFO:teuthology.orchestra.run.smithi107.stdout: "dir-": 409, 2024-06-03T00:05:51.322 INFO:teuthology.orchestra.run.smithi107.stdout: "dn": 201, 2024-06-03T00:05:51.322 INFO:teuthology.orchestra.run.smithi107.stdout: "dn+": 6654, 2024-06-03T00:05:51.322 INFO:teuthology.orchestra.run.smithi107.stdout: "dn-": 6453, 2024-06-03T00:05:51.323 INFO:teuthology.orchestra.run.smithi107.stdout: "cap": 2, 2024-06-03T00:05:51.323 INFO:teuthology.orchestra.run.smithi107.stdout: "cap+": 4966, 2024-06-03T00:05:51.323 INFO:teuthology.orchestra.run.smithi107.stdout: "cap-": 4964, 2024-06-03T00:05:51.323 INFO:teuthology.orchestra.run.smithi107.stdout: "rss": 109628, 2024-06-03T00:05:51.323 INFO:teuthology.orchestra.run.smithi107.stdout: "heap": 223612 2024-06-03T00:05:51.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.323 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_server": { 2024-06-03T00:05:51.323 INFO:teuthology.orchestra.run.smithi107.stdout: "dispatch_client_request": 10288, 2024-06-03T00:05:51.323 INFO:teuthology.orchestra.run.smithi107.stdout: "dispatch_server_request": 13, 2024-06-03T00:05:51.323 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_request": 7497, 2024-06-03T00:05:51.323 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_session": 55, 2024-06-03T00:05:51.323 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_peer_request": 442, 2024-06-03T00:05:51.323 INFO:teuthology.orchestra.run.smithi107.stdout: "req_create_latency": { 2024-06-03T00:05:51.323 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 202, 2024-06-03T00:05:51.324 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 11.152878410, 2024-06-03T00:05:51.324 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.055212269 2024-06-03T00:05:51.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.324 INFO:teuthology.orchestra.run.smithi107.stdout: "req_getattr_latency": { 2024-06-03T00:05:51.324 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 15, 2024-06-03T00:05:51.324 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.028007238, 2024-06-03T00:05:51.324 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.001867149 2024-06-03T00:05:51.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.324 INFO:teuthology.orchestra.run.smithi107.stdout: "req_getfilelock_latency": { 2024-06-03T00:05:51.324 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:51.324 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:51.324 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:51.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.324 INFO:teuthology.orchestra.run.smithi107.stdout: "req_link_latency": { 2024-06-03T00:05:51.325 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 43, 2024-06-03T00:05:51.325 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.078471049, 2024-06-03T00:05:51.325 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.001824908 2024-06-03T00:05:51.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.325 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookup_latency": { 2024-06-03T00:05:51.325 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 3066, 2024-06-03T00:05:51.325 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 6.663050331, 2024-06-03T00:05:51.325 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.002173206 2024-06-03T00:05:51.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.325 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookuphash_latency": { 2024-06-03T00:05:51.325 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:51.325 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:51.325 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:51.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.326 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupino_latency": { 2024-06-03T00:05:51.326 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 1, 2024-06-03T00:05:51.326 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000150241, 2024-06-03T00:05:51.326 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000150241 2024-06-03T00:05:51.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.326 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupname_latency": { 2024-06-03T00:05:51.326 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:51.326 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:51.326 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:51.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.326 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupparent_latency": { 2024-06-03T00:05:51.326 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:51.326 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:51.327 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:51.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.327 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupsnap_latency": { 2024-06-03T00:05:51.327 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:51.327 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:51.327 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:51.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.327 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lssnap_latency": { 2024-06-03T00:05:51.328 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:51.328 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:51.328 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:51.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.328 INFO:teuthology.orchestra.run.smithi107.stdout: "req_mkdir_latency": { 2024-06-03T00:05:51.328 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 90, 2024-06-03T00:05:51.328 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.122900065, 2024-06-03T00:05:51.328 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.001365556 2024-06-03T00:05:51.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.328 INFO:teuthology.orchestra.run.smithi107.stdout: "req_mknod_latency": { 2024-06-03T00:05:51.328 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 99, 2024-06-03T00:05:51.329 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.119787667, 2024-06-03T00:05:51.329 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.001209976 2024-06-03T00:05:51.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.329 INFO:teuthology.orchestra.run.smithi107.stdout: "req_mksnap_latency": { 2024-06-03T00:05:51.329 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:51.329 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:51.329 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:51.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.329 INFO:teuthology.orchestra.run.smithi107.stdout: "req_open_latency": { 2024-06-03T00:05:51.329 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 18, 2024-06-03T00:05:51.329 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.004524679, 2024-06-03T00:05:51.329 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000251371 2024-06-03T00:05:51.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.329 INFO:teuthology.orchestra.run.smithi107.stdout: "req_readdir_latency": { 2024-06-03T00:05:51.330 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 415, 2024-06-03T00:05:51.330 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.408976249, 2024-06-03T00:05:51.330 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000985484 2024-06-03T00:05:51.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.330 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rename_latency": { 2024-06-03T00:05:51.330 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 145, 2024-06-03T00:05:51.330 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.593516354, 2024-06-03T00:05:51.330 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.004093216 2024-06-03T00:05:51.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.330 INFO:teuthology.orchestra.run.smithi107.stdout: "req_renamesnap_latency": { 2024-06-03T00:05:51.330 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:51.330 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:51.330 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:51.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.331 INFO:teuthology.orchestra.run.smithi107.stdout: "req_snapdiff_latency": { 2024-06-03T00:05:51.331 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:51.331 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:51.331 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:51.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.331 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rmdir_latency": { 2024-06-03T00:05:51.331 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 435, 2024-06-03T00:05:51.331 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 4.610250690, 2024-06-03T00:05:51.331 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.010598277 2024-06-03T00:05:51.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.331 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rmsnap_latency": { 2024-06-03T00:05:51.331 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:51.331 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:51.332 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:51.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.332 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rmxattr_latency": { 2024-06-03T00:05:51.332 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:51.332 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:51.332 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:51.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.332 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setattr_latency": { 2024-06-03T00:05:51.332 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 54, 2024-06-03T00:05:51.332 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.094714032, 2024-06-03T00:05:51.332 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.001753963 2024-06-03T00:05:51.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.332 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setdirlayout_latency": { 2024-06-03T00:05:51.332 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:51.333 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:51.333 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:51.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.333 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setfilelock_latency": { 2024-06-03T00:05:51.333 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:51.333 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:51.333 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:51.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.333 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setlayout_latency": { 2024-06-03T00:05:51.333 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:51.333 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:51.333 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:51.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.334 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setxattr_latency": { 2024-06-03T00:05:51.334 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:51.334 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:51.334 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:51.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.334 INFO:teuthology.orchestra.run.smithi107.stdout: "req_symlink_latency": { 2024-06-03T00:05:51.334 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 102, 2024-06-03T00:05:51.334 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 10.987694666, 2024-06-03T00:05:51.334 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.107722496 2024-06-03T00:05:51.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.334 INFO:teuthology.orchestra.run.smithi107.stdout: "req_unlink_latency": { 2024-06-03T00:05:51.334 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 2788, 2024-06-03T00:05:51.334 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 58.181021480, 2024-06-03T00:05:51.335 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.020868372 2024-06-03T00:05:51.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.335 INFO:teuthology.orchestra.run.smithi107.stdout: "cap_revoke_eviction": 0, 2024-06-03T00:05:51.335 INFO:teuthology.orchestra.run.smithi107.stdout: "cap_acquisition_throttle": 0, 2024-06-03T00:05:51.335 INFO:teuthology.orchestra.run.smithi107.stdout: "req_getvxattr_latency": { 2024-06-03T00:05:51.335 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:51.335 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:51.335 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:51.335 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:51.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.335 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_sessions": { 2024-06-03T00:05:51.335 INFO:teuthology.orchestra.run.smithi107.stdout: "session_count": 1, 2024-06-03T00:05:51.335 INFO:teuthology.orchestra.run.smithi107.stdout: "session_add": 1, 2024-06-03T00:05:51.335 INFO:teuthology.orchestra.run.smithi107.stdout: "session_remove": 0, 2024-06-03T00:05:51.336 INFO:teuthology.orchestra.run.smithi107.stdout: "sessions_open": 1, 2024-06-03T00:05:51.336 INFO:teuthology.orchestra.run.smithi107.stdout: "sessions_stale": 0, 2024-06-03T00:05:51.336 INFO:teuthology.orchestra.run.smithi107.stdout: "total_load": 4253, 2024-06-03T00:05:51.336 INFO:teuthology.orchestra.run.smithi107.stdout: "average_load": 4253, 2024-06-03T00:05:51.336 INFO:teuthology.orchestra.run.smithi107.stdout: "avg_session_uptime": 321, 2024-06-03T00:05:51.336 INFO:teuthology.orchestra.run.smithi107.stdout: "mdthresh_evicted": 0 2024-06-03T00:05:51.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.336 INFO:teuthology.orchestra.run.smithi107.stdout: "mempool": { 2024-06-03T00:05:51.336 INFO:teuthology.orchestra.run.smithi107.stdout: "bloom_filter_bytes": 0, 2024-06-03T00:05:51.336 INFO:teuthology.orchestra.run.smithi107.stdout: "bloom_filter_items": 0, 2024-06-03T00:05:51.336 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_alloc_bytes": 0, 2024-06-03T00:05:51.336 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_alloc_items": 0, 2024-06-03T00:05:51.336 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_data_bytes": 0, 2024-06-03T00:05:51.336 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_data_items": 0, 2024-06-03T00:05:51.337 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-03T00:05:51.337 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_onode_items": 0, 2024-06-03T00:05:51.337 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-03T00:05:51.337 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_meta_items": 0, 2024-06-03T00:05:51.337 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_other_bytes": 0, 2024-06-03T00:05:51.337 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_other_items": 0, 2024-06-03T00:05:51.337 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-03T00:05:51.337 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_buffer_items": 0, 2024-06-03T00:05:51.337 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_extent_bytes": 0, 2024-06-03T00:05:51.337 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_extent_items": 0, 2024-06-03T00:05:51.337 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_blob_bytes": 0, 2024-06-03T00:05:51.337 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_blob_items": 0, 2024-06-03T00:05:51.337 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-03T00:05:51.337 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_shared_blob_items": 0, 2024-06-03T00:05:51.338 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-03T00:05:51.338 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_inline_bl_items": 0, 2024-06-03T00:05:51.338 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_fsck_bytes": 0, 2024-06-03T00:05:51.338 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_fsck_items": 0, 2024-06-03T00:05:51.338 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_txc_bytes": 0, 2024-06-03T00:05:51.338 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_txc_items": 0, 2024-06-03T00:05:51.338 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-03T00:05:51.338 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_deferred_items": 0, 2024-06-03T00:05:51.338 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_bytes": 0, 2024-06-03T00:05:51.338 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_items": 0, 2024-06-03T00:05:51.338 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_bytes": 0, 2024-06-03T00:05:51.338 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_items": 0, 2024-06-03T00:05:51.338 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_reader_bytes": 0, 2024-06-03T00:05:51.339 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_reader_items": 0, 2024-06-03T00:05:51.339 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_writer_bytes": 0, 2024-06-03T00:05:51.339 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_writer_items": 0, 2024-06-03T00:05:51.339 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_anon_bytes": 304245, 2024-06-03T00:05:51.339 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_anon_items": 117, 2024-06-03T00:05:51.339 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_meta_bytes": 0, 2024-06-03T00:05:51.339 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_meta_items": 0, 2024-06-03T00:05:51.339 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_bytes": 0, 2024-06-03T00:05:51.339 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_items": 0, 2024-06-03T00:05:51.339 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_mapbl_bytes": 0, 2024-06-03T00:05:51.339 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_mapbl_items": 0, 2024-06-03T00:05:51.339 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_pglog_bytes": 0, 2024-06-03T00:05:51.339 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_pglog_items": 0, 2024-06-03T00:05:51.339 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_bytes": 7624, 2024-06-03T00:05:51.339 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_items": 160, 2024-06-03T00:05:51.340 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_mapping_bytes": 0, 2024-06-03T00:05:51.340 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_mapping_items": 0, 2024-06-03T00:05:51.340 INFO:teuthology.orchestra.run.smithi107.stdout: "pgmap_bytes": 0, 2024-06-03T00:05:51.340 INFO:teuthology.orchestra.run.smithi107.stdout: "pgmap_items": 0, 2024-06-03T00:05:51.340 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_co_bytes": 261243, 2024-06-03T00:05:51.340 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_co_items": 4698, 2024-06-03T00:05:51.340 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_1_bytes": 0, 2024-06-03T00:05:51.340 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_1_items": 0, 2024-06-03T00:05:51.340 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_bytes": 0, 2024-06-03T00:05:51.340 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_items": 0 2024-06-03T00:05:51.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.340 INFO:teuthology.orchestra.run.smithi107.stdout: "objecter": { 2024-06-03T00:05:51.340 INFO:teuthology.orchestra.run.smithi107.stdout: "op_active": 0, 2024-06-03T00:05:51.341 INFO:teuthology.orchestra.run.smithi107.stdout: "op_laggy": 0, 2024-06-03T00:05:51.341 INFO:teuthology.orchestra.run.smithi107.stdout: "op_send": 5976, 2024-06-03T00:05:51.341 INFO:teuthology.orchestra.run.smithi107.stdout: "op_send_bytes": 23315545, 2024-06-03T00:05:51.341 INFO:teuthology.orchestra.run.smithi107.stdout: "op_resend": 28, 2024-06-03T00:05:51.341 INFO:teuthology.orchestra.run.smithi107.stdout: "op_reply": 5976, 2024-06-03T00:05:51.341 INFO:teuthology.orchestra.run.smithi107.stdout: "op_latency": { 2024-06-03T00:05:51.341 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 5976, 2024-06-03T00:05:51.341 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 20.570668958, 2024-06-03T00:05:51.341 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.003442213 2024-06-03T00:05:51.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.341 INFO:teuthology.orchestra.run.smithi107.stdout: "op_inflight": 0, 2024-06-03T00:05:51.341 INFO:teuthology.orchestra.run.smithi107.stdout: "oplen_avg": { 2024-06-03T00:05:51.341 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 5976, 2024-06-03T00:05:51.342 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 6129 2024-06-03T00:05:51.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.342 INFO:teuthology.orchestra.run.smithi107.stdout: "op": 5976, 2024-06-03T00:05:51.342 INFO:teuthology.orchestra.run.smithi107.stdout: "op_r": 1075, 2024-06-03T00:05:51.342 INFO:teuthology.orchestra.run.smithi107.stdout: "op_w": 4901, 2024-06-03T00:05:51.342 INFO:teuthology.orchestra.run.smithi107.stdout: "op_rmw": 0, 2024-06-03T00:05:51.342 INFO:teuthology.orchestra.run.smithi107.stdout: "op_pg": 0, 2024-06-03T00:05:51.342 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_stat": 0, 2024-06-03T00:05:51.342 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_create": 10, 2024-06-03T00:05:51.342 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_read": 79, 2024-06-03T00:05:51.342 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_write": 1333, 2024-06-03T00:05:51.342 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_writefull": 50, 2024-06-03T00:05:51.342 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_writesame": 0, 2024-06-03T00:05:51.342 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_append": 0, 2024-06-03T00:05:51.343 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_zero": 0, 2024-06-03T00:05:51.343 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_truncate": 0, 2024-06-03T00:05:51.343 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_delete": 3368, 2024-06-03T00:05:51.343 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_mapext": 0, 2024-06-03T00:05:51.343 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_sparse_read": 0, 2024-06-03T00:05:51.343 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_clonerange": 0, 2024-06-03T00:05:51.343 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_getxattr": 996, 2024-06-03T00:05:51.343 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_setxattr": 20, 2024-06-03T00:05:51.343 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_cmpxattr": 0, 2024-06-03T00:05:51.343 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_rmxattr": 0, 2024-06-03T00:05:51.343 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_resetxattrs": 0, 2024-06-03T00:05:51.343 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_call": 0, 2024-06-03T00:05:51.343 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_watch": 0, 2024-06-03T00:05:51.344 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_notify": 0, 2024-06-03T00:05:51.344 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_src_cmpxattr": 0, 2024-06-03T00:05:51.344 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_pgls": 0, 2024-06-03T00:05:51.344 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_pgls_filter": 0, 2024-06-03T00:05:51.344 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_other": 61, 2024-06-03T00:05:51.344 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_active": 0, 2024-06-03T00:05:51.344 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_send": 0, 2024-06-03T00:05:51.344 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_resend": 0, 2024-06-03T00:05:51.344 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_ping": 0, 2024-06-03T00:05:51.344 INFO:teuthology.orchestra.run.smithi107.stdout: "poolop_active": 0, 2024-06-03T00:05:51.344 INFO:teuthology.orchestra.run.smithi107.stdout: "poolop_send": 0, 2024-06-03T00:05:51.344 INFO:teuthology.orchestra.run.smithi107.stdout: "poolop_resend": 0, 2024-06-03T00:05:51.344 INFO:teuthology.orchestra.run.smithi107.stdout: "poolstat_active": 0, 2024-06-03T00:05:51.344 INFO:teuthology.orchestra.run.smithi107.stdout: "poolstat_send": 0, 2024-06-03T00:05:51.345 INFO:teuthology.orchestra.run.smithi107.stdout: "poolstat_resend": 0, 2024-06-03T00:05:51.345 INFO:teuthology.orchestra.run.smithi107.stdout: "statfs_active": 0, 2024-06-03T00:05:51.345 INFO:teuthology.orchestra.run.smithi107.stdout: "statfs_send": 0, 2024-06-03T00:05:51.345 INFO:teuthology.orchestra.run.smithi107.stdout: "statfs_resend": 0, 2024-06-03T00:05:51.345 INFO:teuthology.orchestra.run.smithi107.stdout: "command_active": 0, 2024-06-03T00:05:51.345 INFO:teuthology.orchestra.run.smithi107.stdout: "command_send": 0, 2024-06-03T00:05:51.345 INFO:teuthology.orchestra.run.smithi107.stdout: "command_resend": 0, 2024-06-03T00:05:51.345 INFO:teuthology.orchestra.run.smithi107.stdout: "map_epoch": 90, 2024-06-03T00:05:51.345 INFO:teuthology.orchestra.run.smithi107.stdout: "map_full": 0, 2024-06-03T00:05:51.345 INFO:teuthology.orchestra.run.smithi107.stdout: "map_inc": 2, 2024-06-03T00:05:51.345 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_sessions": 12, 2024-06-03T00:05:51.345 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_session_open": 12, 2024-06-03T00:05:51.345 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_session_close": 0, 2024-06-03T00:05:51.345 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_laggy": 0, 2024-06-03T00:05:51.346 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_wr": 127, 2024-06-03T00:05:51.346 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_rd": 40, 2024-06-03T00:05:51.346 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_del": 45 2024-06-03T00:05:51.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.346 INFO:teuthology.orchestra.run.smithi107.stdout: "oft": { 2024-06-03T00:05:51.346 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_objs": 1, 2024-06-03T00:05:51.346 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_kv_pairs": 0, 2024-06-03T00:05:51.346 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_updates": 0, 2024-06-03T00:05:51.346 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_removes": 0 2024-06-03T00:05:51.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.346 INFO:teuthology.orchestra.run.smithi107.stdout: "osd-slow-ops": { 2024-06-03T00:05:51.346 INFO:teuthology.orchestra.run.smithi107.stdout: "slow_ops_count": 5664 2024-06-03T00:05:51.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.347 INFO:teuthology.orchestra.run.smithi107.stdout: "purge_queue": { 2024-06-03T00:05:51.347 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing_ops": 0, 2024-06-03T00:05:51.347 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing_ops_high_water": 10, 2024-06-03T00:05:51.347 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing": 0, 2024-06-03T00:05:51.347 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing_high_water": 6, 2024-06-03T00:05:51.347 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executed_ops": 3351, 2024-06-03T00:05:51.347 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executed": 3101, 2024-06-03T00:05:51.347 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_item_in_journal": 0 2024-06-03T00:05:51.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.347 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-03T00:05:51.347 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-06-03T00:05:51.347 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 104857600, 2024-06-03T00:05:51.347 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-06-03T00:05:51.347 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 24575, 2024-06-03T00:05:51.348 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 9477446, 2024-06-03T00:05:51.348 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:51.348 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 24575, 2024-06-03T00:05:51.348 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2024-06-03T00:05:51.348 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2024-06-03T00:05:51.348 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 24575, 2024-06-03T00:05:51.348 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 9477446, 2024-06-03T00:05:51.348 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-06-03T00:05:51.348 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:51.348 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:51.348 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:51.348 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:51.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.348 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-objecter_bytes": { 2024-06-03T00:05:51.349 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-06-03T00:05:51.349 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 104857600, 2024-06-03T00:05:51.349 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-06-03T00:05:51.349 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2024-06-03T00:05:51.349 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2024-06-03T00:05:51.349 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:51.349 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2024-06-03T00:05:51.349 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 5976, 2024-06-03T00:05:51.349 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 23628426, 2024-06-03T00:05:51.349 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 5976, 2024-06-03T00:05:51.349 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 23628426, 2024-06-03T00:05:51.349 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-06-03T00:05:51.349 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:51.349 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:51.350 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:51.350 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:51.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.350 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-objecter_ops": { 2024-06-03T00:05:51.350 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-06-03T00:05:51.350 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 1024, 2024-06-03T00:05:51.350 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-06-03T00:05:51.350 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2024-06-03T00:05:51.350 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2024-06-03T00:05:51.350 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:51.350 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2024-06-03T00:05:51.350 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 5976, 2024-06-03T00:05:51.350 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 5976, 2024-06-03T00:05:51.350 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 5976, 2024-06-03T00:05:51.351 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 5976, 2024-06-03T00:05:51.351 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-06-03T00:05:51.351 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:51.351 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:51.351 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:51.351 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:51.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.351 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-write_buf_throttle": { 2024-06-03T00:05:51.351 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-06-03T00:05:51.351 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 3758096384, 2024-06-03T00:05:51.351 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-06-03T00:05:51.351 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 3101, 2024-06-03T00:05:51.351 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 313201, 2024-06-03T00:05:51.351 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:51.352 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 3101, 2024-06-03T00:05:51.352 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2024-06-03T00:05:51.352 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2024-06-03T00:05:51.352 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 79, 2024-06-03T00:05:51.352 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 313201, 2024-06-03T00:05:51.352 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-06-03T00:05:51.352 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:51.352 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:51.352 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:51.352 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:51.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:51.352 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-write_buf_throttle-0x5643cbe1e500": { 2024-06-03T00:05:51.352 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-06-03T00:05:51.353 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 3758096384, 2024-06-03T00:05:51.353 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-06-03T00:05:51.353 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 10142, 2024-06-03T00:05:51.353 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 22762486, 2024-06-03T00:05:51.353 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:51.353 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 10142, 2024-06-03T00:05:51.353 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2024-06-03T00:05:51.353 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2024-06-03T00:05:51.353 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 1254, 2024-06-03T00:05:51.353 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 22762486, 2024-06-03T00:05:51.353 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-06-03T00:05:51.353 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:51.353 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:51.353 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:51.354 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:51.354 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:51.354 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-06-03T00:05:51.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:51 smithi057 ceph-mon[36457]: pgmap v557: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-06-03T00:05:51.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:51 smithi049 ceph-mon[32302]: pgmap v557: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-06-03T00:05:52.088 INFO:tasks.check_counter:Daemon mds.c mds.exported=15 2024-06-03T00:05:52.088 INFO:tasks.check_counter:Daemon mds.c mds.imported=15 2024-06-03T00:05:52.088 DEBUG:tasks.check_counter:Getting stats from f 2024-06-03T00:05:52.088 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph daemon mds.f perf dump 2024-06-03T00:05:52.328 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.c/config 2024-06-03T00:05:53.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:53 smithi107 ceph-mon[37048]: pgmap v558: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-06-03T00:05:53.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:53 smithi057 ceph-mon[36457]: pgmap v558: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-06-03T00:05:53.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:53 smithi049 ceph-mon[32302]: pgmap v558: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-06-03T00:05:54.122 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-06-03T00:05:54.123 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-0": { 2024-06-03T00:05:54.123 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 6676, 2024-06-03T00:05:54.123 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 7719, 2024-06-03T00:05:54.123 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 5545709, 2024-06-03T00:05:54.123 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 14809336, 2024-06-03T00:05:54.123 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 13, 2024-06-03T00:05:54.123 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 6, 2024-06-03T00:05:54.123 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.464531925, 2024-06-03T00:05:54.123 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.192994375, 2024-06-03T00:05:54.123 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.221943657, 2024-06-03T00:05:54.123 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.067869144, 2024-06-03T00:05:54.123 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:54.124 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 7717, 2024-06-03T00:05:54.124 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.235215372, 2024-06-03T00:05:54.124 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000030480 2024-06-03T00:05:54.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.124 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:54.124 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 8429, 2024-06-03T00:05:54.124 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.001296371, 2024-06-03T00:05:54.124 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000153 2024-06-03T00:05:54.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.124 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-03T00:05:54.124 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 0 2024-06-03T00:05:54.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.124 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-1": { 2024-06-03T00:05:54.124 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 2569, 2024-06-03T00:05:54.124 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 2641, 2024-06-03T00:05:54.125 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 2805295, 2024-06-03T00:05:54.125 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 1254597, 2024-06-03T00:05:54.125 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 20, 2024-06-03T00:05:54.125 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 6, 2024-06-03T00:05:54.125 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.196654549, 2024-06-03T00:05:54.125 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.066485616, 2024-06-03T00:05:54.125 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.066109284, 2024-06-03T00:05:54.125 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.052043535, 2024-06-03T00:05:54.125 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:54.125 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 2640, 2024-06-03T00:05:54.125 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.105186226, 2024-06-03T00:05:54.125 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000039843 2024-06-03T00:05:54.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.125 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:54.126 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 385, 2024-06-03T00:05:54.126 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000062712, 2024-06-03T00:05:54.126 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000162 2024-06-03T00:05:54.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.126 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 579616, 2024-06-03T00:05:54.126 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 98064 2024-06-03T00:05:54.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.126 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-2": { 2024-06-03T00:05:54.126 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 15888, 2024-06-03T00:05:54.126 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 29017, 2024-06-03T00:05:54.126 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 4722869, 2024-06-03T00:05:54.126 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 28195437, 2024-06-03T00:05:54.126 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 9, 2024-06-03T00:05:54.127 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 5, 2024-06-03T00:05:54.127 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.870900982, 2024-06-03T00:05:54.127 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.466884918, 2024-06-03T00:05:54.127 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.417368763, 2024-06-03T00:05:54.127 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.044316089, 2024-06-03T00:05:54.127 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:54.127 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 29016, 2024-06-03T00:05:54.127 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.779139796, 2024-06-03T00:05:54.127 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000026852 2024-06-03T00:05:54.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.127 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:54.127 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 23118, 2024-06-03T00:05:54.127 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.004246988, 2024-06-03T00:05:54.127 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000183 2024-06-03T00:05:54.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.128 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-06-03T00:05:54.128 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 268976 2024-06-03T00:05:54.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.128 INFO:teuthology.orchestra.run.smithi107.stdout: "cct": { 2024-06-03T00:05:54.128 INFO:teuthology.orchestra.run.smithi107.stdout: "total_workers": 1, 2024-06-03T00:05:54.128 INFO:teuthology.orchestra.run.smithi107.stdout: "unhealthy_workers": 0 2024-06-03T00:05:54.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.128 INFO:teuthology.orchestra.run.smithi107.stdout: "finisher-MDSRank": { 2024-06-03T00:05:54.128 INFO:teuthology.orchestra.run.smithi107.stdout: "queue_len": 0, 2024-06-03T00:05:54.128 INFO:teuthology.orchestra.run.smithi107.stdout: "complete_latency": { 2024-06-03T00:05:54.128 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 2750, 2024-06-03T00:05:54.128 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 6.401131423, 2024-06-03T00:05:54.128 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.002327684 2024-06-03T00:05:54.128 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:54.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.129 INFO:teuthology.orchestra.run.smithi107.stdout: "finisher-PurgeQueue": { 2024-06-03T00:05:54.129 INFO:teuthology.orchestra.run.smithi107.stdout: "queue_len": 0, 2024-06-03T00:05:54.129 INFO:teuthology.orchestra.run.smithi107.stdout: "complete_latency": { 2024-06-03T00:05:54.129 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 8432, 2024-06-03T00:05:54.129 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 1.244946429, 2024-06-03T00:05:54.129 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000147645 2024-06-03T00:05:54.129 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:54.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.129 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": { 2024-06-03T00:05:54.129 INFO:teuthology.orchestra.run.smithi107.stdout: "request": 9414, 2024-06-03T00:05:54.129 INFO:teuthology.orchestra.run.smithi107.stdout: "reply": 9349, 2024-06-03T00:05:54.129 INFO:teuthology.orchestra.run.smithi107.stdout: "reply_latency": { 2024-06-03T00:05:54.129 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 9349, 2024-06-03T00:05:54.130 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 13.504009208, 2024-06-03T00:05:54.130 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.001444433 2024-06-03T00:05:54.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.130 INFO:teuthology.orchestra.run.smithi107.stdout: "slow_reply": 0, 2024-06-03T00:05:54.130 INFO:teuthology.orchestra.run.smithi107.stdout: "forward": 65, 2024-06-03T00:05:54.130 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_fetch_complete": 3, 2024-06-03T00:05:54.130 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_fetch_keys": 0, 2024-06-03T00:05:54.130 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_commit": 12, 2024-06-03T00:05:54.130 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_split": 0, 2024-06-03T00:05:54.130 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_merge": 1, 2024-06-03T00:05:54.130 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes": 139, 2024-06-03T00:05:54.130 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_top": 84, 2024-06-03T00:05:54.130 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_bottom": 41, 2024-06-03T00:05:54.130 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_pin_tail": 14, 2024-06-03T00:05:54.131 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_pinned": 17, 2024-06-03T00:05:54.131 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_expired": 108, 2024-06-03T00:05:54.131 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_with_caps": 0, 2024-06-03T00:05:54.131 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": 0, 2024-06-03T00:05:54.131 INFO:teuthology.orchestra.run.smithi107.stdout: "subtrees": 3, 2024-06-03T00:05:54.131 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse": 13896, 2024-06-03T00:05:54.131 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_hit": 13626, 2024-06-03T00:05:54.131 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_forward": 39, 2024-06-03T00:05:54.131 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_discover": 9, 2024-06-03T00:05:54.131 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_dir_fetch": 0, 2024-06-03T00:05:54.131 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_remote_ino": 0, 2024-06-03T00:05:54.131 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_lock": 3, 2024-06-03T00:05:54.131 INFO:teuthology.orchestra.run.smithi107.stdout: "load_cent": 0, 2024-06-03T00:05:54.131 INFO:teuthology.orchestra.run.smithi107.stdout: "q": 0, 2024-06-03T00:05:54.132 INFO:teuthology.orchestra.run.smithi107.stdout: "exported": 8, 2024-06-03T00:05:54.132 INFO:teuthology.orchestra.run.smithi107.stdout: "exported_inodes": 39, 2024-06-03T00:05:54.132 INFO:teuthology.orchestra.run.smithi107.stdout: "imported": 37, 2024-06-03T00:05:54.132 INFO:teuthology.orchestra.run.smithi107.stdout: "imported_inodes": 4936, 2024-06-03T00:05:54.132 INFO:teuthology.orchestra.run.smithi107.stdout: "openino_dir_fetch": 0, 2024-06-03T00:05:54.132 INFO:teuthology.orchestra.run.smithi107.stdout: "openino_backtrace_fetch": 0, 2024-06-03T00:05:54.132 INFO:teuthology.orchestra.run.smithi107.stdout: "openino_peer_discover": 0, 2024-06-03T00:05:54.132 INFO:teuthology.orchestra.run.smithi107.stdout: "root_rfiles": 6731, 2024-06-03T00:05:54.132 INFO:teuthology.orchestra.run.smithi107.stdout: "root_rbytes": 44994472, 2024-06-03T00:05:54.132 INFO:teuthology.orchestra.run.smithi107.stdout: "root_rsnaps": 0, 2024-06-03T00:05:54.132 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_backtrace_fetch": 0, 2024-06-03T00:05:54.132 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_set_tag": 0, 2024-06-03T00:05:54.132 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_backtrace_repaired": 0, 2024-06-03T00:05:54.132 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_inotable_repaired": 0, 2024-06-03T00:05:54.132 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_dir_inodes": 0, 2024-06-03T00:05:54.133 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_dir_base_inodes": 0, 2024-06-03T00:05:54.133 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_dirfrag_rstats": 0, 2024-06-03T00:05:54.133 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_file_inodes": 0, 2024-06-03T00:05:54.133 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_inode_file_caps": 48, 2024-06-03T00:05:54.133 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_revoke": 3671, 2024-06-03T00:05:54.133 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_grant": 5545, 2024-06-03T00:05:54.133 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_trunc": 0, 2024-06-03T00:05:54.133 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-03T00:05:54.133 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-03T00:05:54.133 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_caps": 3894, 2024-06-03T00:05:54.133 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_caps_dirty": 229, 2024-06-03T00:05:54.133 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_cap_release": 69, 2024-06-03T00:05:54.133 INFO:teuthology.orchestra.run.smithi107.stdout: "process_request_cap_release": 5739 2024-06-03T00:05:54.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.134 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_cache": { 2024-06-03T00:05:54.134 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_update": 0, 2024-06-03T00:05:54.134 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_update_receipt": 0, 2024-06-03T00:05:54.134 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_try_discover": 0, 2024-06-03T00:05:54.134 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_send_discover": 64, 2024-06-03T00:05:54.134 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_handle_discover": 3, 2024-06-03T00:05:54.134 INFO:teuthology.orchestra.run.smithi107.stdout: "num_strays": 4, 2024-06-03T00:05:54.134 INFO:teuthology.orchestra.run.smithi107.stdout: "num_strays_delayed": 0, 2024-06-03T00:05:54.134 INFO:teuthology.orchestra.run.smithi107.stdout: "num_strays_enqueuing": 0, 2024-06-03T00:05:54.134 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_created": 4660, 2024-06-03T00:05:54.134 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_enqueued": 4644, 2024-06-03T00:05:54.134 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_reintegrated": 12, 2024-06-03T00:05:54.134 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_migrated": 0, 2024-06-03T00:05:54.135 INFO:teuthology.orchestra.run.smithi107.stdout: "num_recovering_processing": 0, 2024-06-03T00:05:54.135 INFO:teuthology.orchestra.run.smithi107.stdout: "num_recovering_enqueued": 0, 2024-06-03T00:05:54.135 INFO:teuthology.orchestra.run.smithi107.stdout: "num_recovering_prioritized": 0, 2024-06-03T00:05:54.135 INFO:teuthology.orchestra.run.smithi107.stdout: "recovery_started": 0, 2024-06-03T00:05:54.135 INFO:teuthology.orchestra.run.smithi107.stdout: "recovery_completed": 0, 2024-06-03T00:05:54.135 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_quiesce_path": 4, 2024-06-03T00:05:54.135 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_quiesce_inode": 6707, 2024-06-03T00:05:54.135 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_enqueue_scrub": 0, 2024-06-03T00:05:54.135 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_exportdir": 8, 2024-06-03T00:05:54.135 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_flush": 0, 2024-06-03T00:05:54.135 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_fragmentdir": 1, 2024-06-03T00:05:54.135 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_fragstats": 0, 2024-06-03T00:05:54.135 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_inodestats": 0 2024-06-03T00:05:54.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.135 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_log": { 2024-06-03T00:05:54.136 INFO:teuthology.orchestra.run.smithi107.stdout: "evlrg": 2, 2024-06-03T00:05:54.136 INFO:teuthology.orchestra.run.smithi107.stdout: "evadd": 11353, 2024-06-03T00:05:54.136 INFO:teuthology.orchestra.run.smithi107.stdout: "evex": 0, 2024-06-03T00:05:54.136 INFO:teuthology.orchestra.run.smithi107.stdout: "evtrm": 0, 2024-06-03T00:05:54.136 INFO:teuthology.orchestra.run.smithi107.stdout: "ev": 11353, 2024-06-03T00:05:54.136 INFO:teuthology.orchestra.run.smithi107.stdout: "evexg": 0, 2024-06-03T00:05:54.136 INFO:teuthology.orchestra.run.smithi107.stdout: "evexd": 0, 2024-06-03T00:05:54.136 INFO:teuthology.orchestra.run.smithi107.stdout: "segadd": 18, 2024-06-03T00:05:54.136 INFO:teuthology.orchestra.run.smithi107.stdout: "segex": 0, 2024-06-03T00:05:54.136 INFO:teuthology.orchestra.run.smithi107.stdout: "segtrm": 0, 2024-06-03T00:05:54.136 INFO:teuthology.orchestra.run.smithi107.stdout: "seg": 18, 2024-06-03T00:05:54.136 INFO:teuthology.orchestra.run.smithi107.stdout: "segmjr": 2, 2024-06-03T00:05:54.136 INFO:teuthology.orchestra.run.smithi107.stdout: "segexg": 0, 2024-06-03T00:05:54.136 INFO:teuthology.orchestra.run.smithi107.stdout: "segexd": 0, 2024-06-03T00:05:54.137 INFO:teuthology.orchestra.run.smithi107.stdout: "expos": 4194304, 2024-06-03T00:05:54.137 INFO:teuthology.orchestra.run.smithi107.stdout: "wrpos": 29796912, 2024-06-03T00:05:54.137 INFO:teuthology.orchestra.run.smithi107.stdout: "rdpos": 0, 2024-06-03T00:05:54.137 INFO:teuthology.orchestra.run.smithi107.stdout: "jlat": { 2024-06-03T00:05:54.137 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 1801, 2024-06-03T00:05:54.137 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 7.251527471, 2024-06-03T00:05:54.137 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.004026389 2024-06-03T00:05:54.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.137 INFO:teuthology.orchestra.run.smithi107.stdout: "replayed": 0 2024-06-03T00:05:54.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.137 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_mem": { 2024-06-03T00:05:54.137 INFO:teuthology.orchestra.run.smithi107.stdout: "ino": 26, 2024-06-03T00:05:54.137 INFO:teuthology.orchestra.run.smithi107.stdout: "ino+": 4690, 2024-06-03T00:05:54.137 INFO:teuthology.orchestra.run.smithi107.stdout: "ino-": 4664, 2024-06-03T00:05:54.137 INFO:teuthology.orchestra.run.smithi107.stdout: "dir": 32, 2024-06-03T00:05:54.138 INFO:teuthology.orchestra.run.smithi107.stdout: "dir+": 536, 2024-06-03T00:05:54.138 INFO:teuthology.orchestra.run.smithi107.stdout: "dir-": 504, 2024-06-03T00:05:54.138 INFO:teuthology.orchestra.run.smithi107.stdout: "dn": 139, 2024-06-03T00:05:54.138 INFO:teuthology.orchestra.run.smithi107.stdout: "dn+": 9637, 2024-06-03T00:05:54.138 INFO:teuthology.orchestra.run.smithi107.stdout: "dn-": 9498, 2024-06-03T00:05:54.138 INFO:teuthology.orchestra.run.smithi107.stdout: "cap": 0, 2024-06-03T00:05:54.138 INFO:teuthology.orchestra.run.smithi107.stdout: "cap+": 7405, 2024-06-03T00:05:54.138 INFO:teuthology.orchestra.run.smithi107.stdout: "cap-": 7405, 2024-06-03T00:05:54.138 INFO:teuthology.orchestra.run.smithi107.stdout: "rss": 93780, 2024-06-03T00:05:54.138 INFO:teuthology.orchestra.run.smithi107.stdout: "heap": 223612 2024-06-03T00:05:54.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.138 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_server": { 2024-06-03T00:05:54.138 INFO:teuthology.orchestra.run.smithi107.stdout: "dispatch_client_request": 11395, 2024-06-03T00:05:54.139 INFO:teuthology.orchestra.run.smithi107.stdout: "dispatch_server_request": 907, 2024-06-03T00:05:54.139 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_request": 9414, 2024-06-03T00:05:54.139 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_session": 4, 2024-06-03T00:05:54.139 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_peer_request": 2025, 2024-06-03T00:05:54.139 INFO:teuthology.orchestra.run.smithi107.stdout: "req_create_latency": { 2024-06-03T00:05:54.139 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:54.139 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:54.139 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:54.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.139 INFO:teuthology.orchestra.run.smithi107.stdout: "req_getattr_latency": { 2024-06-03T00:05:54.139 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 2, 2024-06-03T00:05:54.139 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.014709596, 2024-06-03T00:05:54.139 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.007354798 2024-06-03T00:05:54.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.139 INFO:teuthology.orchestra.run.smithi107.stdout: "req_getfilelock_latency": { 2024-06-03T00:05:54.140 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:54.140 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:54.140 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:54.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.140 INFO:teuthology.orchestra.run.smithi107.stdout: "req_link_latency": { 2024-06-03T00:05:54.140 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:54.140 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:54.140 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:54.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.140 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookup_latency": { 2024-06-03T00:05:54.140 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 4192, 2024-06-03T00:05:54.140 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 1.438786990, 2024-06-03T00:05:54.140 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000343222 2024-06-03T00:05:54.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.141 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookuphash_latency": { 2024-06-03T00:05:54.141 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:54.141 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:54.141 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:54.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.141 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupino_latency": { 2024-06-03T00:05:54.141 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:54.141 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:54.141 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:54.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.141 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupname_latency": { 2024-06-03T00:05:54.141 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:54.141 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:54.141 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:54.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.141 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupparent_latency": { 2024-06-03T00:05:54.142 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:54.142 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:54.142 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:54.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.142 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupsnap_latency": { 2024-06-03T00:05:54.142 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:54.142 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:54.142 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:54.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.142 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lssnap_latency": { 2024-06-03T00:05:54.142 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:54.143 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:54.143 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:54.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.143 INFO:teuthology.orchestra.run.smithi107.stdout: "req_mkdir_latency": { 2024-06-03T00:05:54.143 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:54.143 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:54.143 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:54.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.143 INFO:teuthology.orchestra.run.smithi107.stdout: "req_mknod_latency": { 2024-06-03T00:05:54.143 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:54.143 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:54.144 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:54.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.144 INFO:teuthology.orchestra.run.smithi107.stdout: "req_mksnap_latency": { 2024-06-03T00:05:54.144 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:54.144 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:54.144 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:54.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.144 INFO:teuthology.orchestra.run.smithi107.stdout: "req_open_latency": { 2024-06-03T00:05:54.144 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:54.144 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:54.144 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:54.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.144 INFO:teuthology.orchestra.run.smithi107.stdout: "req_readdir_latency": { 2024-06-03T00:05:54.144 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 473, 2024-06-03T00:05:54.144 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.290454653, 2024-06-03T00:05:54.145 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000614069 2024-06-03T00:05:54.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.145 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rename_latency": { 2024-06-03T00:05:54.145 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 12, 2024-06-03T00:05:54.145 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.121080066, 2024-06-03T00:05:54.145 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.010090005 2024-06-03T00:05:54.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.145 INFO:teuthology.orchestra.run.smithi107.stdout: "req_renamesnap_latency": { 2024-06-03T00:05:54.145 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:54.145 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:54.145 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:54.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.145 INFO:teuthology.orchestra.run.smithi107.stdout: "req_snapdiff_latency": { 2024-06-03T00:05:54.145 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:54.145 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:54.146 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:54.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.146 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rmdir_latency": { 2024-06-03T00:05:54.146 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 461, 2024-06-03T00:05:54.146 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 6.083733902, 2024-06-03T00:05:54.146 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.013196819 2024-06-03T00:05:54.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.146 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rmsnap_latency": { 2024-06-03T00:05:54.146 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:54.146 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:54.146 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:54.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.146 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rmxattr_latency": { 2024-06-03T00:05:54.146 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:54.147 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:54.147 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:54.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.147 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setattr_latency": { 2024-06-03T00:05:54.147 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:54.147 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:54.147 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:54.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.147 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setdirlayout_latency": { 2024-06-03T00:05:54.147 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:54.147 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:54.147 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:54.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.147 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setfilelock_latency": { 2024-06-03T00:05:54.147 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:54.147 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:54.148 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:54.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.148 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setlayout_latency": { 2024-06-03T00:05:54.148 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:54.148 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:54.148 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:54.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.148 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setxattr_latency": { 2024-06-03T00:05:54.148 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:54.148 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:54.148 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:54.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.148 INFO:teuthology.orchestra.run.smithi107.stdout: "req_symlink_latency": { 2024-06-03T00:05:54.148 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:54.149 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:54.149 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:54.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.149 INFO:teuthology.orchestra.run.smithi107.stdout: "req_unlink_latency": { 2024-06-03T00:05:54.149 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 4209, 2024-06-03T00:05:54.149 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 5.555244001, 2024-06-03T00:05:54.149 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.001319848 2024-06-03T00:05:54.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.149 INFO:teuthology.orchestra.run.smithi107.stdout: "cap_revoke_eviction": 0, 2024-06-03T00:05:54.149 INFO:teuthology.orchestra.run.smithi107.stdout: "cap_acquisition_throttle": 0, 2024-06-03T00:05:54.149 INFO:teuthology.orchestra.run.smithi107.stdout: "req_getvxattr_latency": { 2024-06-03T00:05:54.149 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:54.149 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:54.149 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:54.149 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:54.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.150 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_sessions": { 2024-06-03T00:05:54.150 INFO:teuthology.orchestra.run.smithi107.stdout: "session_count": 1, 2024-06-03T00:05:54.150 INFO:teuthology.orchestra.run.smithi107.stdout: "session_add": 1, 2024-06-03T00:05:54.150 INFO:teuthology.orchestra.run.smithi107.stdout: "session_remove": 0, 2024-06-03T00:05:54.150 INFO:teuthology.orchestra.run.smithi107.stdout: "sessions_open": 1, 2024-06-03T00:05:54.150 INFO:teuthology.orchestra.run.smithi107.stdout: "sessions_stale": 0, 2024-06-03T00:05:54.150 INFO:teuthology.orchestra.run.smithi107.stdout: "total_load": 5318, 2024-06-03T00:05:54.150 INFO:teuthology.orchestra.run.smithi107.stdout: "average_load": 5318, 2024-06-03T00:05:54.150 INFO:teuthology.orchestra.run.smithi107.stdout: "avg_session_uptime": 1817, 2024-06-03T00:05:54.150 INFO:teuthology.orchestra.run.smithi107.stdout: "mdthresh_evicted": 0 2024-06-03T00:05:54.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.150 INFO:teuthology.orchestra.run.smithi107.stdout: "mempool": { 2024-06-03T00:05:54.150 INFO:teuthology.orchestra.run.smithi107.stdout: "bloom_filter_bytes": 0, 2024-06-03T00:05:54.151 INFO:teuthology.orchestra.run.smithi107.stdout: "bloom_filter_items": 0, 2024-06-03T00:05:54.151 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_alloc_bytes": 0, 2024-06-03T00:05:54.151 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_alloc_items": 0, 2024-06-03T00:05:54.151 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_data_bytes": 0, 2024-06-03T00:05:54.151 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_data_items": 0, 2024-06-03T00:05:54.151 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-03T00:05:54.151 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_onode_items": 0, 2024-06-03T00:05:54.151 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-03T00:05:54.151 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_meta_items": 0, 2024-06-03T00:05:54.151 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_other_bytes": 0, 2024-06-03T00:05:54.151 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_other_items": 0, 2024-06-03T00:05:54.151 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-03T00:05:54.151 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_buffer_items": 0, 2024-06-03T00:05:54.151 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_extent_bytes": 0, 2024-06-03T00:05:54.151 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_extent_items": 0, 2024-06-03T00:05:54.152 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_blob_bytes": 0, 2024-06-03T00:05:54.152 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_blob_items": 0, 2024-06-03T00:05:54.152 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-03T00:05:54.152 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_shared_blob_items": 0, 2024-06-03T00:05:54.152 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-03T00:05:54.152 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_inline_bl_items": 0, 2024-06-03T00:05:54.152 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_fsck_bytes": 0, 2024-06-03T00:05:54.152 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_fsck_items": 0, 2024-06-03T00:05:54.152 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_txc_bytes": 0, 2024-06-03T00:05:54.152 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_txc_items": 0, 2024-06-03T00:05:54.152 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-03T00:05:54.152 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_deferred_items": 0, 2024-06-03T00:05:54.152 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_bytes": 0, 2024-06-03T00:05:54.152 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_items": 0, 2024-06-03T00:05:54.152 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_bytes": 0, 2024-06-03T00:05:54.153 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_items": 0, 2024-06-03T00:05:54.153 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_reader_bytes": 0, 2024-06-03T00:05:54.153 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_reader_items": 0, 2024-06-03T00:05:54.153 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_writer_bytes": 0, 2024-06-03T00:05:54.153 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_writer_items": 0, 2024-06-03T00:05:54.153 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_anon_bytes": 312729, 2024-06-03T00:05:54.153 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_anon_items": 118, 2024-06-03T00:05:54.153 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_meta_bytes": 0, 2024-06-03T00:05:54.153 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_meta_items": 0, 2024-06-03T00:05:54.153 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_bytes": 0, 2024-06-03T00:05:54.153 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_items": 0, 2024-06-03T00:05:54.153 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_mapbl_bytes": 0, 2024-06-03T00:05:54.153 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_mapbl_items": 0, 2024-06-03T00:05:54.153 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_pglog_bytes": 0, 2024-06-03T00:05:54.153 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_pglog_items": 0, 2024-06-03T00:05:54.154 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_bytes": 7624, 2024-06-03T00:05:54.154 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_items": 160, 2024-06-03T00:05:54.154 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_mapping_bytes": 0, 2024-06-03T00:05:54.154 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_mapping_items": 0, 2024-06-03T00:05:54.154 INFO:teuthology.orchestra.run.smithi107.stdout: "pgmap_bytes": 0, 2024-06-03T00:05:54.154 INFO:teuthology.orchestra.run.smithi107.stdout: "pgmap_items": 0, 2024-06-03T00:05:54.154 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_co_bytes": 202371, 2024-06-03T00:05:54.154 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_co_items": 1688, 2024-06-03T00:05:54.154 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_1_bytes": 0, 2024-06-03T00:05:54.154 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_1_items": 0, 2024-06-03T00:05:54.154 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_bytes": 0, 2024-06-03T00:05:54.154 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_items": 0 2024-06-03T00:05:54.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.154 INFO:teuthology.orchestra.run.smithi107.stdout: "objecter": { 2024-06-03T00:05:54.155 INFO:teuthology.orchestra.run.smithi107.stdout: "op_active": 0, 2024-06-03T00:05:54.155 INFO:teuthology.orchestra.run.smithi107.stdout: "op_laggy": 0, 2024-06-03T00:05:54.155 INFO:teuthology.orchestra.run.smithi107.stdout: "op_send": 6852, 2024-06-03T00:05:54.155 INFO:teuthology.orchestra.run.smithi107.stdout: "op_send_bytes": 26249636, 2024-06-03T00:05:54.155 INFO:teuthology.orchestra.run.smithi107.stdout: "op_resend": 33, 2024-06-03T00:05:54.155 INFO:teuthology.orchestra.run.smithi107.stdout: "op_reply": 6852, 2024-06-03T00:05:54.155 INFO:teuthology.orchestra.run.smithi107.stdout: "op_latency": { 2024-06-03T00:05:54.155 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 6852, 2024-06-03T00:05:54.155 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 16.254738339, 2024-06-03T00:05:54.155 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.002372261 2024-06-03T00:05:54.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.155 INFO:teuthology.orchestra.run.smithi107.stdout: "op_inflight": 0, 2024-06-03T00:05:54.155 INFO:teuthology.orchestra.run.smithi107.stdout: "oplen_avg": { 2024-06-03T00:05:54.155 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 6852, 2024-06-03T00:05:54.156 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 6946 2024-06-03T00:05:54.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.156 INFO:teuthology.orchestra.run.smithi107.stdout: "op": 6852, 2024-06-03T00:05:54.156 INFO:teuthology.orchestra.run.smithi107.stdout: "op_r": 88, 2024-06-03T00:05:54.156 INFO:teuthology.orchestra.run.smithi107.stdout: "op_w": 6764, 2024-06-03T00:05:54.156 INFO:teuthology.orchestra.run.smithi107.stdout: "op_rmw": 0, 2024-06-03T00:05:54.156 INFO:teuthology.orchestra.run.smithi107.stdout: "op_pg": 0, 2024-06-03T00:05:54.156 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_stat": 0, 2024-06-03T00:05:54.156 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_create": 10, 2024-06-03T00:05:54.156 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_read": 85, 2024-06-03T00:05:54.156 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_write": 1886, 2024-06-03T00:05:54.156 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_writefull": 49, 2024-06-03T00:05:54.156 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_writesame": 0, 2024-06-03T00:05:54.156 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_append": 0, 2024-06-03T00:05:54.156 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_zero": 0, 2024-06-03T00:05:54.157 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_truncate": 0, 2024-06-03T00:05:54.157 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_delete": 4758, 2024-06-03T00:05:54.157 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_mapext": 0, 2024-06-03T00:05:54.157 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_sparse_read": 0, 2024-06-03T00:05:54.157 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_clonerange": 0, 2024-06-03T00:05:54.157 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_getxattr": 3, 2024-06-03T00:05:54.157 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_setxattr": 20, 2024-06-03T00:05:54.157 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_cmpxattr": 0, 2024-06-03T00:05:54.157 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_rmxattr": 0, 2024-06-03T00:05:54.157 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_resetxattrs": 0, 2024-06-03T00:05:54.157 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_call": 0, 2024-06-03T00:05:54.157 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_watch": 0, 2024-06-03T00:05:54.157 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_notify": 0, 2024-06-03T00:05:54.157 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_src_cmpxattr": 0, 2024-06-03T00:05:54.157 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_pgls": 0, 2024-06-03T00:05:54.157 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_pgls_filter": 0, 2024-06-03T00:05:54.158 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_other": 0, 2024-06-03T00:05:54.158 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_active": 0, 2024-06-03T00:05:54.158 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_send": 0, 2024-06-03T00:05:54.158 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_resend": 0, 2024-06-03T00:05:54.158 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_ping": 0, 2024-06-03T00:05:54.158 INFO:teuthology.orchestra.run.smithi107.stdout: "poolop_active": 0, 2024-06-03T00:05:54.158 INFO:teuthology.orchestra.run.smithi107.stdout: "poolop_send": 0, 2024-06-03T00:05:54.158 INFO:teuthology.orchestra.run.smithi107.stdout: "poolop_resend": 0, 2024-06-03T00:05:54.158 INFO:teuthology.orchestra.run.smithi107.stdout: "poolstat_active": 0, 2024-06-03T00:05:54.158 INFO:teuthology.orchestra.run.smithi107.stdout: "poolstat_send": 0, 2024-06-03T00:05:54.158 INFO:teuthology.orchestra.run.smithi107.stdout: "poolstat_resend": 0, 2024-06-03T00:05:54.158 INFO:teuthology.orchestra.run.smithi107.stdout: "statfs_active": 0, 2024-06-03T00:05:54.158 INFO:teuthology.orchestra.run.smithi107.stdout: "statfs_send": 0, 2024-06-03T00:05:54.158 INFO:teuthology.orchestra.run.smithi107.stdout: "statfs_resend": 0, 2024-06-03T00:05:54.159 INFO:teuthology.orchestra.run.smithi107.stdout: "command_active": 0, 2024-06-03T00:05:54.159 INFO:teuthology.orchestra.run.smithi107.stdout: "command_send": 0, 2024-06-03T00:05:54.159 INFO:teuthology.orchestra.run.smithi107.stdout: "command_resend": 0, 2024-06-03T00:05:54.159 INFO:teuthology.orchestra.run.smithi107.stdout: "map_epoch": 90, 2024-06-03T00:05:54.159 INFO:teuthology.orchestra.run.smithi107.stdout: "map_full": 0, 2024-06-03T00:05:54.159 INFO:teuthology.orchestra.run.smithi107.stdout: "map_inc": 2, 2024-06-03T00:05:54.159 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_sessions": 12, 2024-06-03T00:05:54.159 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_session_open": 12, 2024-06-03T00:05:54.159 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_session_close": 0, 2024-06-03T00:05:54.159 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_laggy": 0, 2024-06-03T00:05:54.159 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_wr": 96, 2024-06-03T00:05:54.159 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_rd": 6, 2024-06-03T00:05:54.159 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_del": 33 2024-06-03T00:05:54.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.160 INFO:teuthology.orchestra.run.smithi107.stdout: "oft": { 2024-06-03T00:05:54.160 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_objs": 1, 2024-06-03T00:05:54.160 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_kv_pairs": 0, 2024-06-03T00:05:54.160 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_updates": 0, 2024-06-03T00:05:54.160 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_removes": 0 2024-06-03T00:05:54.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.160 INFO:teuthology.orchestra.run.smithi107.stdout: "osd-slow-ops": { 2024-06-03T00:05:54.160 INFO:teuthology.orchestra.run.smithi107.stdout: "slow_ops_count": 6706 2024-06-03T00:05:54.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.160 INFO:teuthology.orchestra.run.smithi107.stdout: "purge_queue": { 2024-06-03T00:05:54.160 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing_ops": 0, 2024-06-03T00:05:54.160 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing_ops_high_water": 14, 2024-06-03T00:05:54.160 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing": 0, 2024-06-03T00:05:54.160 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing_high_water": 6, 2024-06-03T00:05:54.160 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executed_ops": 4736, 2024-06-03T00:05:54.161 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executed": 4644, 2024-06-03T00:05:54.161 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_item_in_journal": 0 2024-06-03T00:05:54.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.161 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-03T00:05:54.161 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-06-03T00:05:54.161 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 104857600, 2024-06-03T00:05:54.161 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-06-03T00:05:54.161 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 25129, 2024-06-03T00:05:54.161 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 11012837, 2024-06-03T00:05:54.161 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:54.161 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 25129, 2024-06-03T00:05:54.161 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2024-06-03T00:05:54.161 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2024-06-03T00:05:54.161 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 25129, 2024-06-03T00:05:54.161 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 11012837, 2024-06-03T00:05:54.161 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-06-03T00:05:54.162 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:54.162 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:54.162 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:54.162 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:54.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.162 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-objecter_bytes": { 2024-06-03T00:05:54.162 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-06-03T00:05:54.162 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 104857600, 2024-06-03T00:05:54.162 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-06-03T00:05:54.162 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2024-06-03T00:05:54.162 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2024-06-03T00:05:54.162 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:54.162 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2024-06-03T00:05:54.162 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 6852, 2024-06-03T00:05:54.163 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 26718672, 2024-06-03T00:05:54.163 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 6852, 2024-06-03T00:05:54.163 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 26718672, 2024-06-03T00:05:54.163 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-06-03T00:05:54.163 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:54.163 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:54.163 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:54.163 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:54.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.163 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-objecter_ops": { 2024-06-03T00:05:54.163 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-06-03T00:05:54.163 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 1024, 2024-06-03T00:05:54.163 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-06-03T00:05:54.163 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2024-06-03T00:05:54.163 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2024-06-03T00:05:54.164 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:54.164 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2024-06-03T00:05:54.164 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 6852, 2024-06-03T00:05:54.164 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 6852, 2024-06-03T00:05:54.164 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 6852, 2024-06-03T00:05:54.164 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 6852, 2024-06-03T00:05:54.164 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-06-03T00:05:54.164 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:54.164 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:54.164 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:54.164 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:54.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.164 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-write_buf_throttle": { 2024-06-03T00:05:54.164 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-06-03T00:05:54.164 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 3758096384, 2024-06-03T00:05:54.165 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-06-03T00:05:54.165 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 4644, 2024-06-03T00:05:54.165 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 469084, 2024-06-03T00:05:54.165 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:54.165 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 4644, 2024-06-03T00:05:54.165 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2024-06-03T00:05:54.165 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2024-06-03T00:05:54.165 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 85, 2024-06-03T00:05:54.165 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 469084, 2024-06-03T00:05:54.165 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-06-03T00:05:54.165 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:54.165 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:54.165 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:54.165 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:54.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:54.166 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-write_buf_throttle-0x5566474e0500": { 2024-06-03T00:05:54.166 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-06-03T00:05:54.166 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 3758096384, 2024-06-03T00:05:54.166 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-06-03T00:05:54.166 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 11353, 2024-06-03T00:05:54.166 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 25602608, 2024-06-03T00:05:54.166 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:54.166 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 11353, 2024-06-03T00:05:54.166 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2024-06-03T00:05:54.166 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2024-06-03T00:05:54.166 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 1801, 2024-06-03T00:05:54.166 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 25602608, 2024-06-03T00:05:54.166 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-06-03T00:05:54.166 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:54.167 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:54.167 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:54.167 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:54.167 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:54.167 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-06-03T00:05:54.990 INFO:tasks.check_counter:Daemon mds.f mds.exported=8 2024-06-03T00:05:54.990 INFO:tasks.check_counter:Daemon mds.f mds.imported=37 2024-06-03T00:05:54.990 DEBUG:tasks.check_counter:Getting stats from i 2024-06-03T00:05:54.990 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph daemon mds.i perf dump 2024-06-03T00:05:55.229 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.c/config 2024-06-03T00:05:55.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:55 smithi107 ceph-mon[37048]: pgmap v559: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-03T00:05:55.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:55 smithi057 ceph-mon[36457]: pgmap v559: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-03T00:05:55.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:55 smithi049 ceph-mon[32302]: pgmap v559: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-03T00:05:56.900 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-06-03T00:05:56.900 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-0": { 2024-06-03T00:05:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 15440, 2024-06-03T00:05:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 11619, 2024-06-03T00:05:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 5801832, 2024-06-03T00:05:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 30724484, 2024-06-03T00:05:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 12, 2024-06-03T00:05:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 3, 2024-06-03T00:05:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.896514158, 2024-06-03T00:05:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.359325933, 2024-06-03T00:05:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.335589870, 2024-06-03T00:05:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.227856717, 2024-06-03T00:05:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 11624, 2024-06-03T00:05:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 4.259806086, 2024-06-03T00:05:56.902 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000366466 2024-06-03T00:05:56.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.902 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:56.902 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 11807, 2024-06-03T00:05:56.902 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.001748951, 2024-06-03T00:05:56.902 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000148 2024-06-03T00:05:56.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.902 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 601376, 2024-06-03T00:05:56.902 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 101056 2024-06-03T00:05:56.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-1": { 2024-06-03T00:05:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 17956, 2024-06-03T00:05:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 14181, 2024-06-03T00:05:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 6958699, 2024-06-03T00:05:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 30340346, 2024-06-03T00:05:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 9, 2024-06-03T00:05:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 6, 2024-06-03T00:05:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 1.011566662, 2024-06-03T00:05:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.397967079, 2024-06-03T00:05:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.526703801, 2024-06-03T00:05:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.298466906, 2024-06-03T00:05:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 14182, 2024-06-03T00:05:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 9.005397332, 2024-06-03T00:05:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000634987 2024-06-03T00:05:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 12519, 2024-06-03T00:05:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.001672846, 2024-06-03T00:05:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000133 2024-06-03T00:05:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 160, 2024-06-03T00:05:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 276784 2024-06-03T00:05:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-2": { 2024-06-03T00:05:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 40229, 2024-06-03T00:05:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 76629, 2024-06-03T00:05:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 13899108, 2024-06-03T00:05:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 67763254, 2024-06-03T00:05:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 100, 2024-06-03T00:05:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 11, 2024-06-03T00:05:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 2.216589102, 2024-06-03T00:05:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 1.045857768, 2024-06-03T00:05:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 1.573069509, 2024-06-03T00:05:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.248570164, 2024-06-03T00:05:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 76619, 2024-06-03T00:05:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 8.112188751, 2024-06-03T00:05:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000105876 2024-06-03T00:05:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 68924, 2024-06-03T00:05:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.013313902, 2024-06-03T00:05:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000193 2024-06-03T00:05:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 55120, 2024-06-03T00:05:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 30192 2024-06-03T00:05:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: "cct": { 2024-06-03T00:05:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: "total_workers": 1, 2024-06-03T00:05:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: "unhealthy_workers": 0 2024-06-03T00:05:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: "finisher-MDSRank": { 2024-06-03T00:05:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: "queue_len": 0, 2024-06-03T00:05:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: "complete_latency": { 2024-06-03T00:05:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 5765, 2024-06-03T00:05:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 25.220305273, 2024-06-03T00:05:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.004374727 2024-06-03T00:05:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: "finisher-PurgeQueue": { 2024-06-03T00:05:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: "queue_len": 0, 2024-06-03T00:05:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: "complete_latency": { 2024-06-03T00:05:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 2922, 2024-06-03T00:05:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.289259911, 2024-06-03T00:05:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000098993 2024-06-03T00:05:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": { 2024-06-03T00:05:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: "request": 16650, 2024-06-03T00:05:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: "reply": 16573, 2024-06-03T00:05:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: "reply_latency": { 2024-06-03T00:05:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 16573, 2024-06-03T00:05:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 54.451371601, 2024-06-03T00:05:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.003285547 2024-06-03T00:05:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: "slow_reply": 0, 2024-06-03T00:05:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: "forward": 77, 2024-06-03T00:05:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_fetch_complete": 0, 2024-06-03T00:05:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_fetch_keys": 0, 2024-06-03T00:05:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_commit": 2290, 2024-06-03T00:05:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_split": 8, 2024-06-03T00:05:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_merge": 0, 2024-06-03T00:05:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes": 218, 2024-06-03T00:05:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_top": 11, 2024-06-03T00:05:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_bottom": 197, 2024-06-03T00:05:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_pin_tail": 10, 2024-06-03T00:05:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_pinned": 171, 2024-06-03T00:05:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_expired": 12135, 2024-06-03T00:05:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_with_caps": 2, 2024-06-03T00:05:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": 2, 2024-06-03T00:05:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: "subtrees": 6, 2024-06-03T00:05:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse": 18478, 2024-06-03T00:05:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_hit": 18164, 2024-06-03T00:05:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_forward": 56, 2024-06-03T00:05:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_discover": 3, 2024-06-03T00:05:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_dir_fetch": 0, 2024-06-03T00:05:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_remote_ino": 0, 2024-06-03T00:05:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_lock": 4, 2024-06-03T00:05:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: "load_cent": 26, 2024-06-03T00:05:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: "q": 0, 2024-06-03T00:05:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: "exported": 62, 2024-06-03T00:05:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: "exported_inodes": 11634, 2024-06-03T00:05:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: "imported": 31, 2024-06-03T00:05:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: "imported_inodes": 220, 2024-06-03T00:05:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: "openino_dir_fetch": 0, 2024-06-03T00:05:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: "openino_backtrace_fetch": 3895, 2024-06-03T00:05:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: "openino_peer_discover": 0, 2024-06-03T00:05:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: "root_rfiles": 4, 2024-06-03T00:05:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: "root_rbytes": 234, 2024-06-03T00:05:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: "root_rsnaps": 0, 2024-06-03T00:05:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_backtrace_fetch": 3895, 2024-06-03T00:05:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_set_tag": 0, 2024-06-03T00:05:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_backtrace_repaired": 0, 2024-06-03T00:05:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_inotable_repaired": 0, 2024-06-03T00:05:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_dir_inodes": 427, 2024-06-03T00:05:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_dir_base_inodes": 3, 2024-06-03T00:05:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_dirfrag_rstats": 424, 2024-06-03T00:05:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_file_inodes": 3468, 2024-06-03T00:05:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_inode_file_caps": 63, 2024-06-03T00:05:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_revoke": 3501, 2024-06-03T00:05:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_grant": 13639, 2024-06-03T00:05:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_trunc": 76, 2024-06-03T00:05:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-03T00:05:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-03T00:05:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_caps": 12603, 2024-06-03T00:05:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_caps_dirty": 8972, 2024-06-03T00:05:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_cap_release": 65, 2024-06-03T00:05:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: "process_request_cap_release": 3863 2024-06-03T00:05:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_cache": { 2024-06-03T00:05:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_update": 0, 2024-06-03T00:05:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_update_receipt": 0, 2024-06-03T00:05:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_try_discover": 0, 2024-06-03T00:05:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_send_discover": 3, 2024-06-03T00:05:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_handle_discover": 88, 2024-06-03T00:05:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: "num_strays": 1, 2024-06-03T00:05:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: "num_strays_delayed": 0, 2024-06-03T00:05:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: "num_strays_enqueuing": 0, 2024-06-03T00:05:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_created": 1545, 2024-06-03T00:05:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_enqueued": 1536, 2024-06-03T00:05:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_reintegrated": 8, 2024-06-03T00:05:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_migrated": 0, 2024-06-03T00:05:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: "num_recovering_processing": 0, 2024-06-03T00:05:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: "num_recovering_enqueued": 0, 2024-06-03T00:05:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: "num_recovering_prioritized": 0, 2024-06-03T00:05:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: "recovery_started": 0, 2024-06-03T00:05:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: "recovery_completed": 0, 2024-06-03T00:05:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_quiesce_path": 4, 2024-06-03T00:05:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_quiesce_inode": 6470, 2024-06-03T00:05:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_enqueue_scrub": 3, 2024-06-03T00:05:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_exportdir": 62, 2024-06-03T00:05:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_flush": 0, 2024-06-03T00:05:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_fragmentdir": 8, 2024-06-03T00:05:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_fragstats": 0, 2024-06-03T00:05:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_inodestats": 0 2024-06-03T00:05:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_log": { 2024-06-03T00:05:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: "evlrg": 0, 2024-06-03T00:05:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: "evadd": 27803, 2024-06-03T00:05:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: "evex": 27642, 2024-06-03T00:05:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: "evtrm": 27642, 2024-06-03T00:05:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: "ev": 161, 2024-06-03T00:05:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: "evexg": 0, 2024-06-03T00:05:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "evexd": 1536, 2024-06-03T00:05:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "segadd": 50, 2024-06-03T00:05:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "segex": 49, 2024-06-03T00:05:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "segtrm": 49, 2024-06-03T00:05:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "seg": 1, 2024-06-03T00:05:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "segmjr": 1, 2024-06-03T00:05:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "segexg": 0, 2024-06-03T00:05:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "segexd": 2, 2024-06-03T00:05:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "expos": 64375184, 2024-06-03T00:05:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "wrpos": 64485169, 2024-06-03T00:05:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "rdpos": 0, 2024-06-03T00:05:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "jlat": { 2024-06-03T00:05:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 3205, 2024-06-03T00:05:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 84.789426237, 2024-06-03T00:05:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.026455359 2024-06-03T00:05:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "replayed": 0 2024-06-03T00:05:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_mem": { 2024-06-03T00:05:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "ino": 39, 2024-06-03T00:05:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "ino+": 12894, 2024-06-03T00:05:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "ino-": 12855, 2024-06-03T00:05:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "dir": 45, 2024-06-03T00:05:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "dir+": 1615, 2024-06-03T00:05:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "dir-": 1570, 2024-06-03T00:05:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "dn": 218, 2024-06-03T00:05:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "dn+": 15411, 2024-06-03T00:05:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "dn-": 15193, 2024-06-03T00:05:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "cap": 2, 2024-06-03T00:05:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "cap+": 14356, 2024-06-03T00:05:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "cap-": 14354, 2024-06-03T00:05:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "rss": 129212, 2024-06-03T00:05:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "heap": 231804 2024-06-03T00:05:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_server": { 2024-06-03T00:05:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "dispatch_client_request": 17670, 2024-06-03T00:05:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "dispatch_server_request": 564, 2024-06-03T00:05:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_request": 16650, 2024-06-03T00:05:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_session": 147, 2024-06-03T00:05:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_peer_request": 1191, 2024-06-03T00:05:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "req_create_latency": { 2024-06-03T00:05:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 10985, 2024-06-03T00:05:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 26.782848522, 2024-06-03T00:05:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.002438129 2024-06-03T00:05:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: "req_getattr_latency": { 2024-06-03T00:05:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 48, 2024-06-03T00:05:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.125161766, 2024-06-03T00:05:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.002607536 2024-06-03T00:05:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: "req_getfilelock_latency": { 2024-06-03T00:05:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: "req_link_latency": { 2024-06-03T00:05:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 83, 2024-06-03T00:05:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.460170636, 2024-06-03T00:05:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.005544224 2024-06-03T00:05:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookup_latency": { 2024-06-03T00:05:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 1419, 2024-06-03T00:05:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 2.102440204, 2024-06-03T00:05:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.001481635 2024-06-03T00:05:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookuphash_latency": { 2024-06-03T00:05:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupino_latency": { 2024-06-03T00:05:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 1, 2024-06-03T00:05:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000284665, 2024-06-03T00:05:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000284665 2024-06-03T00:05:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupname_latency": { 2024-06-03T00:05:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupparent_latency": { 2024-06-03T00:05:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupsnap_latency": { 2024-06-03T00:05:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lssnap_latency": { 2024-06-03T00:05:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "req_mkdir_latency": { 2024-06-03T00:05:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 1512, 2024-06-03T00:05:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 8.701304938, 2024-06-03T00:05:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.005754831 2024-06-03T00:05:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "req_mknod_latency": { 2024-06-03T00:05:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 174, 2024-06-03T00:05:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 1.855161517, 2024-06-03T00:05:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.010661847 2024-06-03T00:05:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "req_mksnap_latency": { 2024-06-03T00:05:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "req_open_latency": { 2024-06-03T00:05:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 28, 2024-06-03T00:05:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.246470774, 2024-06-03T00:05:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.008802527 2024-06-03T00:05:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "req_readdir_latency": { 2024-06-03T00:05:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 251, 2024-06-03T00:05:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 2.633087380, 2024-06-03T00:05:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.010490387 2024-06-03T00:05:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rename_latency": { 2024-06-03T00:05:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 173, 2024-06-03T00:05:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 1.846469169, 2024-06-03T00:05:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.010673232 2024-06-03T00:05:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: "req_renamesnap_latency": { 2024-06-03T00:05:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: "req_snapdiff_latency": { 2024-06-03T00:05:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rmdir_latency": { 2024-06-03T00:05:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 298, 2024-06-03T00:05:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 3.092636903, 2024-06-03T00:05:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.010377976 2024-06-03T00:05:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rmsnap_latency": { 2024-06-03T00:05:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rmxattr_latency": { 2024-06-03T00:05:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setattr_latency": { 2024-06-03T00:05:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 78, 2024-06-03T00:05:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 1.316259283, 2024-06-03T00:05:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.016875119 2024-06-03T00:05:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setdirlayout_latency": { 2024-06-03T00:05:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setfilelock_latency": { 2024-06-03T00:05:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setlayout_latency": { 2024-06-03T00:05:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setxattr_latency": { 2024-06-03T00:05:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 7, 2024-06-03T00:05:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.020712025, 2024-06-03T00:05:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.002958860 2024-06-03T00:05:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "req_symlink_latency": { 2024-06-03T00:05:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 180, 2024-06-03T00:05:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.826173106, 2024-06-03T00:05:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.004589850 2024-06-03T00:05:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "req_unlink_latency": { 2024-06-03T00:05:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 1336, 2024-06-03T00:05:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 4.442190713, 2024-06-03T00:05:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.003324993 2024-06-03T00:05:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "cap_revoke_eviction": 0, 2024-06-03T00:05:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "cap_acquisition_throttle": 0, 2024-06-03T00:05:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "req_getvxattr_latency": { 2024-06-03T00:05:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_sessions": { 2024-06-03T00:05:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: "session_count": 1, 2024-06-03T00:05:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: "session_add": 2, 2024-06-03T00:05:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: "session_remove": 1, 2024-06-03T00:05:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: "sessions_open": 1, 2024-06-03T00:05:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: "sessions_stale": 0, 2024-06-03T00:05:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: "total_load": 4704, 2024-06-03T00:05:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: "average_load": 4704, 2024-06-03T00:05:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: "avg_session_uptime": 327, 2024-06-03T00:05:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: "mdthresh_evicted": 0 2024-06-03T00:05:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: "mempool": { 2024-06-03T00:05:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: "bloom_filter_bytes": 360, 2024-06-03T00:05:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: "bloom_filter_items": 360, 2024-06-03T00:05:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_alloc_bytes": 0, 2024-06-03T00:05:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_alloc_items": 0, 2024-06-03T00:05:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_data_bytes": 0, 2024-06-03T00:05:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_data_items": 0, 2024-06-03T00:05:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-03T00:05:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_onode_items": 0, 2024-06-03T00:05:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-03T00:05:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_meta_items": 0, 2024-06-03T00:05:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_other_bytes": 0, 2024-06-03T00:05:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_other_items": 0, 2024-06-03T00:05:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-03T00:05:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_buffer_items": 0, 2024-06-03T00:05:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_extent_bytes": 0, 2024-06-03T00:05:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_extent_items": 0, 2024-06-03T00:05:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_blob_bytes": 0, 2024-06-03T00:05:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_blob_items": 0, 2024-06-03T00:05:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-03T00:05:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_shared_blob_items": 0, 2024-06-03T00:05:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-03T00:05:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_inline_bl_items": 0, 2024-06-03T00:05:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_fsck_bytes": 0, 2024-06-03T00:05:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_fsck_items": 0, 2024-06-03T00:05:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_txc_bytes": 0, 2024-06-03T00:05:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_txc_items": 0, 2024-06-03T00:05:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-03T00:05:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_deferred_items": 0, 2024-06-03T00:05:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_bytes": 0, 2024-06-03T00:05:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_items": 0, 2024-06-03T00:05:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_bytes": 0, 2024-06-03T00:05:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_items": 0, 2024-06-03T00:05:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_reader_bytes": 0, 2024-06-03T00:05:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_reader_items": 0, 2024-06-03T00:05:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_writer_bytes": 0, 2024-06-03T00:05:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_writer_items": 0, 2024-06-03T00:05:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_anon_bytes": 278714, 2024-06-03T00:05:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_anon_items": 97, 2024-06-03T00:05:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_meta_bytes": 0, 2024-06-03T00:05:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_meta_items": 0, 2024-06-03T00:05:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_bytes": 0, 2024-06-03T00:05:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_items": 0, 2024-06-03T00:05:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_mapbl_bytes": 0, 2024-06-03T00:05:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_mapbl_items": 0, 2024-06-03T00:05:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_pglog_bytes": 0, 2024-06-03T00:05:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_pglog_items": 0, 2024-06-03T00:05:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_bytes": 7624, 2024-06-03T00:05:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_items": 160, 2024-06-03T00:05:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_mapping_bytes": 0, 2024-06-03T00:05:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_mapping_items": 0, 2024-06-03T00:05:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: "pgmap_bytes": 0, 2024-06-03T00:05:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: "pgmap_items": 0, 2024-06-03T00:05:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_co_bytes": 310918, 2024-06-03T00:05:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_co_items": 2482, 2024-06-03T00:05:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_1_bytes": 0, 2024-06-03T00:05:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_1_items": 0, 2024-06-03T00:05:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_bytes": 0, 2024-06-03T00:05:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_items": 0 2024-06-03T00:05:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: "objecter": { 2024-06-03T00:05:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: "op_active": 0, 2024-06-03T00:05:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: "op_laggy": 0, 2024-06-03T00:05:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: "op_send": 23900, 2024-06-03T00:05:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: "op_send_bytes": 80571698, 2024-06-03T00:05:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: "op_resend": 32, 2024-06-03T00:05:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: "op_reply": 23900, 2024-06-03T00:05:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: "op_latency": { 2024-06-03T00:05:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 23900, 2024-06-03T00:05:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 3564.075707927, 2024-06-03T00:05:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.149124506 2024-06-03T00:05:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: "op_inflight": 0, 2024-06-03T00:05:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: "oplen_avg": { 2024-06-03T00:05:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 23900, 2024-06-03T00:05:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 51048 2024-06-03T00:05:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: "op": 23900, 2024-06-03T00:05:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: "op_r": 3970, 2024-06-03T00:05:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: "op_w": 19930, 2024-06-03T00:05:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: "op_rmw": 0, 2024-06-03T00:05:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: "op_pg": 0, 2024-06-03T00:05:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_stat": 964, 2024-06-03T00:05:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_create": 11892, 2024-06-03T00:05:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_read": 72, 2024-06-03T00:05:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_write": 3274, 2024-06-03T00:05:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_writefull": 128, 2024-06-03T00:05:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_writesame": 0, 2024-06-03T00:05:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_append": 0, 2024-06-03T00:05:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_zero": 0, 2024-06-03T00:05:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_truncate": 8, 2024-06-03T00:05:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_delete": 2120, 2024-06-03T00:05:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_mapext": 0, 2024-06-03T00:05:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_sparse_read": 0, 2024-06-03T00:05:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_clonerange": 0, 2024-06-03T00:05:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_getxattr": 3898, 2024-06-03T00:05:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_setxattr": 23784, 2024-06-03T00:05:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_cmpxattr": 0, 2024-06-03T00:05:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_rmxattr": 0, 2024-06-03T00:05:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_resetxattrs": 0, 2024-06-03T00:05:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_call": 0, 2024-06-03T00:05:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_watch": 0, 2024-06-03T00:05:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_notify": 0, 2024-06-03T00:05:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_src_cmpxattr": 0, 2024-06-03T00:05:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_pgls": 0, 2024-06-03T00:05:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_pgls_filter": 0, 2024-06-03T00:05:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_other": 87, 2024-06-03T00:05:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_active": 0, 2024-06-03T00:05:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_send": 0, 2024-06-03T00:05:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_resend": 0, 2024-06-03T00:05:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_ping": 0, 2024-06-03T00:05:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "poolop_active": 0, 2024-06-03T00:05:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "poolop_send": 0, 2024-06-03T00:05:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "poolop_resend": 0, 2024-06-03T00:05:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "poolstat_active": 0, 2024-06-03T00:05:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "poolstat_send": 0, 2024-06-03T00:05:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "poolstat_resend": 0, 2024-06-03T00:05:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: "statfs_active": 0, 2024-06-03T00:05:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: "statfs_send": 0, 2024-06-03T00:05:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: "statfs_resend": 0, 2024-06-03T00:05:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: "command_active": 0, 2024-06-03T00:05:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: "command_send": 0, 2024-06-03T00:05:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: "command_resend": 0, 2024-06-03T00:05:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: "map_epoch": 90, 2024-06-03T00:05:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: "map_full": 0, 2024-06-03T00:05:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: "map_inc": 2, 2024-06-03T00:05:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_sessions": 12, 2024-06-03T00:05:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_session_open": 12, 2024-06-03T00:05:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_session_close": 0, 2024-06-03T00:05:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_laggy": 0, 2024-06-03T00:05:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_wr": 4739, 2024-06-03T00:05:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_rd": 0, 2024-06-03T00:05:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_del": 82 2024-06-03T00:05:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: "oft": { 2024-06-03T00:05:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_objs": 1, 2024-06-03T00:05:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_kv_pairs": 0, 2024-06-03T00:05:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_updates": 0, 2024-06-03T00:05:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_removes": 0 2024-06-03T00:05:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: "osd-slow-ops": { 2024-06-03T00:05:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: "slow_ops_count": 5562 2024-06-03T00:05:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: "purge_queue": { 2024-06-03T00:05:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing_ops": 0, 2024-06-03T00:05:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing_ops_high_water": 10, 2024-06-03T00:05:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing": 0, 2024-06-03T00:05:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing_high_water": 6, 2024-06-03T00:05:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executed_ops": 1580, 2024-06-03T00:05:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executed": 1536, 2024-06-03T00:05:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_item_in_journal": 0 2024-06-03T00:05:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-03T00:05:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-06-03T00:05:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 104857600, 2024-06-03T00:05:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-06-03T00:05:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 73621, 2024-06-03T00:05:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 20485842, 2024-06-03T00:05:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 73621, 2024-06-03T00:05:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2024-06-03T00:05:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2024-06-03T00:05:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 73621, 2024-06-03T00:05:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 20485842, 2024-06-03T00:05:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-06-03T00:05:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-objecter_bytes": { 2024-06-03T00:05:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-06-03T00:05:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 104857600, 2024-06-03T00:05:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-06-03T00:05:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2024-06-03T00:05:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2024-06-03T00:05:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2024-06-03T00:05:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 23900, 2024-06-03T00:05:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 80726834, 2024-06-03T00:05:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 23900, 2024-06-03T00:05:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 80726834, 2024-06-03T00:05:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-06-03T00:05:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-objecter_ops": { 2024-06-03T00:05:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-06-03T00:05:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 1024, 2024-06-03T00:05:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-06-03T00:05:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2024-06-03T00:05:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2024-06-03T00:05:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2024-06-03T00:05:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 23900, 2024-06-03T00:05:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 23900, 2024-06-03T00:05:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 23900, 2024-06-03T00:05:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 23900, 2024-06-03T00:05:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-06-03T00:05:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-write_buf_throttle": { 2024-06-03T00:05:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-06-03T00:05:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 3758096384, 2024-06-03T00:05:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-06-03T00:05:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 1536, 2024-06-03T00:05:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 155136, 2024-06-03T00:05:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 1536, 2024-06-03T00:05:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2024-06-03T00:05:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2024-06-03T00:05:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 69, 2024-06-03T00:05:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 155136, 2024-06-03T00:05:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-06-03T00:05:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-write_buf_throttle-0x55fedc212500": { 2024-06-03T00:05:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-06-03T00:05:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 3758096384, 2024-06-03T00:05:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-06-03T00:05:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 27803, 2024-06-03T00:05:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 60290865, 2024-06-03T00:05:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 27803, 2024-06-03T00:05:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2024-06-03T00:05:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2024-06-03T00:05:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 3205, 2024-06-03T00:05:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 60290865, 2024-06-03T00:05:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-06-03T00:05:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:56.948 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-06-03T00:05:57.353 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:57 smithi107 ceph-mon[37048]: pgmap v560: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 12 op/s 2024-06-03T00:05:57.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:57 smithi057 ceph-mon[36457]: pgmap v560: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 12 op/s 2024-06-03T00:05:57.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:57 smithi049 ceph-mon[32302]: pgmap v560: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 12 op/s 2024-06-03T00:05:57.736 INFO:tasks.check_counter:Daemon mds.i mds.exported=62 2024-06-03T00:05:57.736 INFO:tasks.check_counter:Daemon mds.i mds.imported=31 2024-06-03T00:05:57.736 DEBUG:tasks.check_counter:Getting stats from l 2024-06-03T00:05:57.737 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph daemon mds.l perf dump 2024-06-03T00:05:57.976 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.c/config 2024-06-03T00:05:59.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:59 smithi107 ceph-mon[37048]: pgmap v561: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-03T00:05:59.101 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:05:59 smithi107 ceph-mon[37048]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:05:59.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:59 smithi057 ceph-mon[36457]: pgmap v561: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-03T00:05:59.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:05:59 smithi057 ceph-mon[36457]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:05:59.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:59 smithi049 ceph-mon[32302]: pgmap v561: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-03T00:05:59.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:05:59 smithi049 ceph-mon[32302]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:05:59.683 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-06-03T00:05:59.683 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-0": { 2024-06-03T00:05:59.683 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 690, 2024-06-03T00:05:59.683 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 670, 2024-06-03T00:05:59.683 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 751744, 2024-06-03T00:05:59.683 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 257472, 2024-06-03T00:05:59.683 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 5, 2024-06-03T00:05:59.683 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 1, 2024-06-03T00:05:59.684 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.084583523, 2024-06-03T00:05:59.684 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.027043737, 2024-06-03T00:05:59.684 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.028674091, 2024-06-03T00:05:59.684 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.024084361, 2024-06-03T00:05:59.684 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:59.684 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 670, 2024-06-03T00:05:59.684 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.038676385, 2024-06-03T00:05:59.684 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000057725 2024-06-03T00:05:59.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.684 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:59.684 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.684 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.685 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.685 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 582400, 2024-06-03T00:05:59.685 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 97200 2024-06-03T00:05:59.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.685 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-1": { 2024-06-03T00:05:59.685 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 173, 2024-06-03T00:05:59.685 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 290, 2024-06-03T00:05:59.685 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 4238312, 2024-06-03T00:05:59.685 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 325782, 2024-06-03T00:05:59.685 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 5, 2024-06-03T00:05:59.685 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 4, 2024-06-03T00:05:59.685 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.023499520, 2024-06-03T00:05:59.685 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.008765394, 2024-06-03T00:05:59.686 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.007552477, 2024-06-03T00:05:59.686 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.004760337, 2024-06-03T00:05:59.686 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:59.686 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 288, 2024-06-03T00:05:59.686 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.011991640, 2024-06-03T00:05:59.686 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000041637 2024-06-03T00:05:59.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.686 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:59.686 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.686 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.686 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.687 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 160, 2024-06-03T00:05:59.687 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 271024 2024-06-03T00:05:59.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.687 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-2": { 2024-06-03T00:05:59.687 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 830, 2024-06-03T00:05:59.687 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 832, 2024-06-03T00:05:59.688 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 19665967, 2024-06-03T00:05:59.688 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 263947, 2024-06-03T00:05:59.688 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 5, 2024-06-03T00:05:59.688 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 4, 2024-06-03T00:05:59.688 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.070020720, 2024-06-03T00:05:59.688 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.020577070, 2024-06-03T00:05:59.688 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.024393895, 2024-06-03T00:05:59.688 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.020510705, 2024-06-03T00:05:59.688 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-06-03T00:05:59.689 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 830, 2024-06-03T00:05:59.689 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.030538328, 2024-06-03T00:05:59.689 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000036793 2024-06-03T00:05:59.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.689 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-06-03T00:05:59.689 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.689 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.689 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.689 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-03T00:05:59.689 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 0 2024-06-03T00:05:59.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.690 INFO:teuthology.orchestra.run.smithi107.stdout: "cct": { 2024-06-03T00:05:59.690 INFO:teuthology.orchestra.run.smithi107.stdout: "total_workers": 1, 2024-06-03T00:05:59.690 INFO:teuthology.orchestra.run.smithi107.stdout: "unhealthy_workers": 0 2024-06-03T00:05:59.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.690 INFO:teuthology.orchestra.run.smithi107.stdout: "finisher-MDSRank": { 2024-06-03T00:05:59.690 INFO:teuthology.orchestra.run.smithi107.stdout: "queue_len": 0, 2024-06-03T00:05:59.690 INFO:teuthology.orchestra.run.smithi107.stdout: "complete_latency": { 2024-06-03T00:05:59.690 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 2532, 2024-06-03T00:05:59.690 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.070623249, 2024-06-03T00:05:59.691 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000027892 2024-06-03T00:05:59.691 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:59.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.691 INFO:teuthology.orchestra.run.smithi107.stdout: "finisher-PurgeQueue": { 2024-06-03T00:05:59.691 INFO:teuthology.orchestra.run.smithi107.stdout: "queue_len": 0, 2024-06-03T00:05:59.691 INFO:teuthology.orchestra.run.smithi107.stdout: "complete_latency": { 2024-06-03T00:05:59.691 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.691 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.691 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.691 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:59.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.691 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": { 2024-06-03T00:05:59.691 INFO:teuthology.orchestra.run.smithi107.stdout: "request": 0, 2024-06-03T00:05:59.691 INFO:teuthology.orchestra.run.smithi107.stdout: "reply": 0, 2024-06-03T00:05:59.692 INFO:teuthology.orchestra.run.smithi107.stdout: "reply_latency": { 2024-06-03T00:05:59.692 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.692 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.692 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.692 INFO:teuthology.orchestra.run.smithi107.stdout: "slow_reply": 0, 2024-06-03T00:05:59.692 INFO:teuthology.orchestra.run.smithi107.stdout: "forward": 0, 2024-06-03T00:05:59.692 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_fetch_complete": 0, 2024-06-03T00:05:59.692 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_fetch_keys": 0, 2024-06-03T00:05:59.692 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_commit": 0, 2024-06-03T00:05:59.692 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_split": 0, 2024-06-03T00:05:59.692 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_merge": 0, 2024-06-03T00:05:59.692 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes": 2808, 2024-06-03T00:05:59.692 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_top": 0, 2024-06-03T00:05:59.693 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_bottom": 2808, 2024-06-03T00:05:59.693 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_pin_tail": 0, 2024-06-03T00:05:59.693 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_pinned": 2808, 2024-06-03T00:05:59.693 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_expired": 0, 2024-06-03T00:05:59.693 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_with_caps": 0, 2024-06-03T00:05:59.693 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": 0, 2024-06-03T00:05:59.693 INFO:teuthology.orchestra.run.smithi107.stdout: "subtrees": 1, 2024-06-03T00:05:59.693 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse": 0, 2024-06-03T00:05:59.693 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_hit": 0, 2024-06-03T00:05:59.694 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_forward": 0, 2024-06-03T00:05:59.694 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_discover": 0, 2024-06-03T00:05:59.694 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_dir_fetch": 0, 2024-06-03T00:05:59.694 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_remote_ino": 0, 2024-06-03T00:05:59.694 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_lock": 0, 2024-06-03T00:05:59.694 INFO:teuthology.orchestra.run.smithi107.stdout: "load_cent": 0, 2024-06-03T00:05:59.694 INFO:teuthology.orchestra.run.smithi107.stdout: "q": 0, 2024-06-03T00:05:59.694 INFO:teuthology.orchestra.run.smithi107.stdout: "exported": 0, 2024-06-03T00:05:59.694 INFO:teuthology.orchestra.run.smithi107.stdout: "exported_inodes": 0, 2024-06-03T00:05:59.694 INFO:teuthology.orchestra.run.smithi107.stdout: "imported": 0, 2024-06-03T00:05:59.694 INFO:teuthology.orchestra.run.smithi107.stdout: "imported_inodes": 0, 2024-06-03T00:05:59.694 INFO:teuthology.orchestra.run.smithi107.stdout: "openino_dir_fetch": 0, 2024-06-03T00:05:59.694 INFO:teuthology.orchestra.run.smithi107.stdout: "openino_backtrace_fetch": 0, 2024-06-03T00:05:59.695 INFO:teuthology.orchestra.run.smithi107.stdout: "openino_peer_discover": 0, 2024-06-03T00:05:59.695 INFO:teuthology.orchestra.run.smithi107.stdout: "root_rfiles": 0, 2024-06-03T00:05:59.695 INFO:teuthology.orchestra.run.smithi107.stdout: "root_rbytes": 0, 2024-06-03T00:05:59.695 INFO:teuthology.orchestra.run.smithi107.stdout: "root_rsnaps": 0, 2024-06-03T00:05:59.695 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_backtrace_fetch": 0, 2024-06-03T00:05:59.695 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_set_tag": 0, 2024-06-03T00:05:59.695 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_backtrace_repaired": 0, 2024-06-03T00:05:59.695 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_inotable_repaired": 0, 2024-06-03T00:05:59.695 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_dir_inodes": 0, 2024-06-03T00:05:59.695 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_dir_base_inodes": 0, 2024-06-03T00:05:59.695 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_dirfrag_rstats": 0, 2024-06-03T00:05:59.695 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_file_inodes": 0, 2024-06-03T00:05:59.695 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_inode_file_caps": 0, 2024-06-03T00:05:59.696 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_revoke": 0, 2024-06-03T00:05:59.696 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_grant": 0, 2024-06-03T00:05:59.696 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_trunc": 0, 2024-06-03T00:05:59.696 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-03T00:05:59.696 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-03T00:05:59.697 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_caps": 0, 2024-06-03T00:05:59.697 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_caps_dirty": 0, 2024-06-03T00:05:59.697 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_cap_release": 0, 2024-06-03T00:05:59.697 INFO:teuthology.orchestra.run.smithi107.stdout: "process_request_cap_release": 0 2024-06-03T00:05:59.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.697 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_cache": { 2024-06-03T00:05:59.697 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_update": 0, 2024-06-03T00:05:59.697 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_update_receipt": 0, 2024-06-03T00:05:59.697 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_try_discover": 0, 2024-06-03T00:05:59.697 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_send_discover": 0, 2024-06-03T00:05:59.697 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_handle_discover": 0, 2024-06-03T00:05:59.697 INFO:teuthology.orchestra.run.smithi107.stdout: "num_strays": 0, 2024-06-03T00:05:59.697 INFO:teuthology.orchestra.run.smithi107.stdout: "num_strays_delayed": 0, 2024-06-03T00:05:59.698 INFO:teuthology.orchestra.run.smithi107.stdout: "num_strays_enqueuing": 0, 2024-06-03T00:05:59.698 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_created": 0, 2024-06-03T00:05:59.698 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_enqueued": 0, 2024-06-03T00:05:59.698 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_reintegrated": 0, 2024-06-03T00:05:59.698 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_migrated": 0, 2024-06-03T00:05:59.698 INFO:teuthology.orchestra.run.smithi107.stdout: "num_recovering_processing": 0, 2024-06-03T00:05:59.698 INFO:teuthology.orchestra.run.smithi107.stdout: "num_recovering_enqueued": 0, 2024-06-03T00:05:59.698 INFO:teuthology.orchestra.run.smithi107.stdout: "num_recovering_prioritized": 0, 2024-06-03T00:05:59.698 INFO:teuthology.orchestra.run.smithi107.stdout: "recovery_started": 0, 2024-06-03T00:05:59.698 INFO:teuthology.orchestra.run.smithi107.stdout: "recovery_completed": 0, 2024-06-03T00:05:59.698 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_quiesce_path": 0, 2024-06-03T00:05:59.698 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_quiesce_inode": 0, 2024-06-03T00:05:59.699 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_enqueue_scrub": 0, 2024-06-03T00:05:59.699 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_exportdir": 0, 2024-06-03T00:05:59.699 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_flush": 0, 2024-06-03T00:05:59.699 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_fragmentdir": 0, 2024-06-03T00:05:59.699 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_fragstats": 0, 2024-06-03T00:05:59.699 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_inodestats": 0 2024-06-03T00:05:59.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.699 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_log": { 2024-06-03T00:05:59.699 INFO:teuthology.orchestra.run.smithi107.stdout: "evlrg": 0, 2024-06-03T00:05:59.699 INFO:teuthology.orchestra.run.smithi107.stdout: "evadd": 0, 2024-06-03T00:05:59.699 INFO:teuthology.orchestra.run.smithi107.stdout: "evex": 0, 2024-06-03T00:05:59.699 INFO:teuthology.orchestra.run.smithi107.stdout: "evtrm": 0, 2024-06-03T00:05:59.699 INFO:teuthology.orchestra.run.smithi107.stdout: "ev": 9861, 2024-06-03T00:05:59.699 INFO:teuthology.orchestra.run.smithi107.stdout: "evexg": 0, 2024-06-03T00:05:59.700 INFO:teuthology.orchestra.run.smithi107.stdout: "evexd": 0, 2024-06-03T00:05:59.700 INFO:teuthology.orchestra.run.smithi107.stdout: "segadd": 0, 2024-06-03T00:05:59.700 INFO:teuthology.orchestra.run.smithi107.stdout: "segex": 0, 2024-06-03T00:05:59.700 INFO:teuthology.orchestra.run.smithi107.stdout: "segtrm": 0, 2024-06-03T00:05:59.700 INFO:teuthology.orchestra.run.smithi107.stdout: "seg": 14, 2024-06-03T00:05:59.700 INFO:teuthology.orchestra.run.smithi107.stdout: "segmjr": 2, 2024-06-03T00:05:59.700 INFO:teuthology.orchestra.run.smithi107.stdout: "segexg": 0, 2024-06-03T00:05:59.700 INFO:teuthology.orchestra.run.smithi107.stdout: "segexd": 0, 2024-06-03T00:05:59.700 INFO:teuthology.orchestra.run.smithi107.stdout: "expos": 4194304, 2024-06-03T00:05:59.700 INFO:teuthology.orchestra.run.smithi107.stdout: "wrpos": 27842198, 2024-06-03T00:05:59.700 INFO:teuthology.orchestra.run.smithi107.stdout: "rdpos": 27841599, 2024-06-03T00:05:59.700 INFO:teuthology.orchestra.run.smithi107.stdout: "jlat": { 2024-06-03T00:05:59.700 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.700 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.701 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.701 INFO:teuthology.orchestra.run.smithi107.stdout: "replayed": 9861 2024-06-03T00:05:59.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.701 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_mem": { 2024-06-03T00:05:59.701 INFO:teuthology.orchestra.run.smithi107.stdout: "ino": 15, 2024-06-03T00:05:59.701 INFO:teuthology.orchestra.run.smithi107.stdout: "ino+": 4336, 2024-06-03T00:05:59.701 INFO:teuthology.orchestra.run.smithi107.stdout: "ino-": 4321, 2024-06-03T00:05:59.701 INFO:teuthology.orchestra.run.smithi107.stdout: "dir": 13, 2024-06-03T00:05:59.701 INFO:teuthology.orchestra.run.smithi107.stdout: "dir+": 556, 2024-06-03T00:05:59.701 INFO:teuthology.orchestra.run.smithi107.stdout: "dir-": 543, 2024-06-03T00:05:59.702 INFO:teuthology.orchestra.run.smithi107.stdout: "dn": 2808, 2024-06-03T00:05:59.702 INFO:teuthology.orchestra.run.smithi107.stdout: "dn+": 7443, 2024-06-03T00:05:59.702 INFO:teuthology.orchestra.run.smithi107.stdout: "dn-": 4635, 2024-06-03T00:05:59.702 INFO:teuthology.orchestra.run.smithi107.stdout: "cap": 0, 2024-06-03T00:05:59.702 INFO:teuthology.orchestra.run.smithi107.stdout: "cap+": 0, 2024-06-03T00:05:59.702 INFO:teuthology.orchestra.run.smithi107.stdout: "cap-": 0, 2024-06-03T00:05:59.703 INFO:teuthology.orchestra.run.smithi107.stdout: "rss": 67784, 2024-06-03T00:05:59.703 INFO:teuthology.orchestra.run.smithi107.stdout: "heap": 215420 2024-06-03T00:05:59.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.703 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_server": { 2024-06-03T00:05:59.703 INFO:teuthology.orchestra.run.smithi107.stdout: "dispatch_client_request": 0, 2024-06-03T00:05:59.703 INFO:teuthology.orchestra.run.smithi107.stdout: "dispatch_server_request": 0, 2024-06-03T00:05:59.703 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_request": 0, 2024-06-03T00:05:59.703 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_session": 0, 2024-06-03T00:05:59.703 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_peer_request": 0, 2024-06-03T00:05:59.703 INFO:teuthology.orchestra.run.smithi107.stdout: "req_create_latency": { 2024-06-03T00:05:59.703 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.703 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.704 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.704 INFO:teuthology.orchestra.run.smithi107.stdout: "req_getattr_latency": { 2024-06-03T00:05:59.704 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.704 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.704 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.704 INFO:teuthology.orchestra.run.smithi107.stdout: "req_getfilelock_latency": { 2024-06-03T00:05:59.704 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.704 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.704 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.704 INFO:teuthology.orchestra.run.smithi107.stdout: "req_link_latency": { 2024-06-03T00:05:59.704 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.705 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.705 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.705 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookup_latency": { 2024-06-03T00:05:59.705 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.705 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.705 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.705 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookuphash_latency": { 2024-06-03T00:05:59.705 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.705 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.705 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.706 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupino_latency": { 2024-06-03T00:05:59.706 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.706 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.706 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.706 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupname_latency": { 2024-06-03T00:05:59.706 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.706 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.706 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.706 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupparent_latency": { 2024-06-03T00:05:59.706 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.706 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.707 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.707 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupsnap_latency": { 2024-06-03T00:05:59.707 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.707 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.707 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.707 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lssnap_latency": { 2024-06-03T00:05:59.707 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.707 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.707 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.707 INFO:teuthology.orchestra.run.smithi107.stdout: "req_mkdir_latency": { 2024-06-03T00:05:59.708 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.708 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.708 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.708 INFO:teuthology.orchestra.run.smithi107.stdout: "req_mknod_latency": { 2024-06-03T00:05:59.708 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.709 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.709 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.709 INFO:teuthology.orchestra.run.smithi107.stdout: "req_mksnap_latency": { 2024-06-03T00:05:59.709 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.709 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.709 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.709 INFO:teuthology.orchestra.run.smithi107.stdout: "req_open_latency": { 2024-06-03T00:05:59.709 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.709 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.709 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.710 INFO:teuthology.orchestra.run.smithi107.stdout: "req_readdir_latency": { 2024-06-03T00:05:59.710 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.710 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.710 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.710 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rename_latency": { 2024-06-03T00:05:59.710 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.710 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.711 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.711 INFO:teuthology.orchestra.run.smithi107.stdout: "req_renamesnap_latency": { 2024-06-03T00:05:59.711 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.711 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.711 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.711 INFO:teuthology.orchestra.run.smithi107.stdout: "req_snapdiff_latency": { 2024-06-03T00:05:59.711 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.711 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.712 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.712 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rmdir_latency": { 2024-06-03T00:05:59.712 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.712 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.712 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.712 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rmsnap_latency": { 2024-06-03T00:05:59.712 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.712 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.712 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.713 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rmxattr_latency": { 2024-06-03T00:05:59.713 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.713 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.713 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.713 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setattr_latency": { 2024-06-03T00:05:59.713 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.713 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.713 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.713 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setdirlayout_latency": { 2024-06-03T00:05:59.714 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.714 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.714 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.714 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setfilelock_latency": { 2024-06-03T00:05:59.714 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.714 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.714 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.714 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setlayout_latency": { 2024-06-03T00:05:59.714 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.714 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.714 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.715 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setxattr_latency": { 2024-06-03T00:05:59.715 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.715 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.715 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.715 INFO:teuthology.orchestra.run.smithi107.stdout: "req_symlink_latency": { 2024-06-03T00:05:59.715 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.715 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.715 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.715 INFO:teuthology.orchestra.run.smithi107.stdout: "req_unlink_latency": { 2024-06-03T00:05:59.715 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.715 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.715 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.716 INFO:teuthology.orchestra.run.smithi107.stdout: "cap_revoke_eviction": 0, 2024-06-03T00:05:59.716 INFO:teuthology.orchestra.run.smithi107.stdout: "cap_acquisition_throttle": 0, 2024-06-03T00:05:59.716 INFO:teuthology.orchestra.run.smithi107.stdout: "req_getvxattr_latency": { 2024-06-03T00:05:59.716 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.716 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.716 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.716 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:59.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.716 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_sessions": { 2024-06-03T00:05:59.716 INFO:teuthology.orchestra.run.smithi107.stdout: "session_count": 1, 2024-06-03T00:05:59.716 INFO:teuthology.orchestra.run.smithi107.stdout: "session_add": 2, 2024-06-03T00:05:59.716 INFO:teuthology.orchestra.run.smithi107.stdout: "session_remove": 1, 2024-06-03T00:05:59.716 INFO:teuthology.orchestra.run.smithi107.stdout: "sessions_open": 1, 2024-06-03T00:05:59.717 INFO:teuthology.orchestra.run.smithi107.stdout: "sessions_stale": 0, 2024-06-03T00:05:59.717 INFO:teuthology.orchestra.run.smithi107.stdout: "total_load": 0, 2024-06-03T00:05:59.717 INFO:teuthology.orchestra.run.smithi107.stdout: "average_load": 0, 2024-06-03T00:05:59.717 INFO:teuthology.orchestra.run.smithi107.stdout: "avg_session_uptime": 1825, 2024-06-03T00:05:59.717 INFO:teuthology.orchestra.run.smithi107.stdout: "mdthresh_evicted": 0 2024-06-03T00:05:59.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.717 INFO:teuthology.orchestra.run.smithi107.stdout: "mempool": { 2024-06-03T00:05:59.717 INFO:teuthology.orchestra.run.smithi107.stdout: "bloom_filter_bytes": 0, 2024-06-03T00:05:59.717 INFO:teuthology.orchestra.run.smithi107.stdout: "bloom_filter_items": 0, 2024-06-03T00:05:59.717 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_alloc_bytes": 0, 2024-06-03T00:05:59.717 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_alloc_items": 0, 2024-06-03T00:05:59.717 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_data_bytes": 0, 2024-06-03T00:05:59.717 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_data_items": 0, 2024-06-03T00:05:59.717 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-03T00:05:59.717 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_onode_items": 0, 2024-06-03T00:05:59.718 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-03T00:05:59.718 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_meta_items": 0, 2024-06-03T00:05:59.718 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_other_bytes": 0, 2024-06-03T00:05:59.718 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_other_items": 0, 2024-06-03T00:05:59.718 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-03T00:05:59.718 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_buffer_items": 0, 2024-06-03T00:05:59.718 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_extent_bytes": 0, 2024-06-03T00:05:59.718 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_extent_items": 0, 2024-06-03T00:05:59.718 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_blob_bytes": 0, 2024-06-03T00:05:59.718 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_blob_items": 0, 2024-06-03T00:05:59.718 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-03T00:05:59.718 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_shared_blob_items": 0, 2024-06-03T00:05:59.718 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-03T00:05:59.719 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_inline_bl_items": 0, 2024-06-03T00:05:59.719 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_fsck_bytes": 0, 2024-06-03T00:05:59.719 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_fsck_items": 0, 2024-06-03T00:05:59.719 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_txc_bytes": 0, 2024-06-03T00:05:59.719 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_txc_items": 0, 2024-06-03T00:05:59.719 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-03T00:05:59.719 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_deferred_items": 0, 2024-06-03T00:05:59.719 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_bytes": 0, 2024-06-03T00:05:59.719 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_items": 0, 2024-06-03T00:05:59.719 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_bytes": 0, 2024-06-03T00:05:59.719 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_items": 0, 2024-06-03T00:05:59.719 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_reader_bytes": 0, 2024-06-03T00:05:59.719 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_reader_items": 0, 2024-06-03T00:05:59.719 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_writer_bytes": 0, 2024-06-03T00:05:59.719 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_writer_items": 0, 2024-06-03T00:05:59.719 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_anon_bytes": 198321, 2024-06-03T00:05:59.720 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_anon_items": 58, 2024-06-03T00:05:59.720 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_meta_bytes": 0, 2024-06-03T00:05:59.720 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_meta_items": 0, 2024-06-03T00:05:59.720 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_bytes": 0, 2024-06-03T00:05:59.720 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_items": 0, 2024-06-03T00:05:59.720 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_mapbl_bytes": 0, 2024-06-03T00:05:59.720 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_mapbl_items": 0, 2024-06-03T00:05:59.720 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_pglog_bytes": 0, 2024-06-03T00:05:59.720 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_pglog_items": 0, 2024-06-03T00:05:59.720 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_bytes": 7624, 2024-06-03T00:05:59.720 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_items": 160, 2024-06-03T00:05:59.720 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_mapping_bytes": 0, 2024-06-03T00:05:59.720 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_mapping_items": 0, 2024-06-03T00:05:59.720 INFO:teuthology.orchestra.run.smithi107.stdout: "pgmap_bytes": 0, 2024-06-03T00:05:59.720 INFO:teuthology.orchestra.run.smithi107.stdout: "pgmap_items": 0, 2024-06-03T00:05:59.721 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_co_bytes": 2028044, 2024-06-03T00:05:59.721 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_co_items": 11868, 2024-06-03T00:05:59.721 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_1_bytes": 0, 2024-06-03T00:05:59.721 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_1_items": 0, 2024-06-03T00:05:59.721 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_bytes": 0, 2024-06-03T00:05:59.721 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_items": 0 2024-06-03T00:05:59.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.721 INFO:teuthology.orchestra.run.smithi107.stdout: "objecter": { 2024-06-03T00:05:59.721 INFO:teuthology.orchestra.run.smithi107.stdout: "op_active": 0, 2024-06-03T00:05:59.721 INFO:teuthology.orchestra.run.smithi107.stdout: "op_laggy": 0, 2024-06-03T00:05:59.721 INFO:teuthology.orchestra.run.smithi107.stdout: "op_send": 1506, 2024-06-03T00:05:59.721 INFO:teuthology.orchestra.run.smithi107.stdout: "op_send_bytes": 21, 2024-06-03T00:05:59.721 INFO:teuthology.orchestra.run.smithi107.stdout: "op_resend": 3, 2024-06-03T00:05:59.721 INFO:teuthology.orchestra.run.smithi107.stdout: "op_reply": 1506, 2024-06-03T00:05:59.721 INFO:teuthology.orchestra.run.smithi107.stdout: "op_latency": { 2024-06-03T00:05:59.722 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 1506, 2024-06-03T00:05:59.722 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 2.442960755, 2024-06-03T00:05:59.722 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.001622151 2024-06-03T00:05:59.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.722 INFO:teuthology.orchestra.run.smithi107.stdout: "op_inflight": 0, 2024-06-03T00:05:59.722 INFO:teuthology.orchestra.run.smithi107.stdout: "oplen_avg": { 2024-06-03T00:05:59.722 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 1506, 2024-06-03T00:05:59.722 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 1507 2024-06-03T00:05:59.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.722 INFO:teuthology.orchestra.run.smithi107.stdout: "op": 1506, 2024-06-03T00:05:59.722 INFO:teuthology.orchestra.run.smithi107.stdout: "op_r": 1506, 2024-06-03T00:05:59.722 INFO:teuthology.orchestra.run.smithi107.stdout: "op_w": 0, 2024-06-03T00:05:59.722 INFO:teuthology.orchestra.run.smithi107.stdout: "op_rmw": 0, 2024-06-03T00:05:59.723 INFO:teuthology.orchestra.run.smithi107.stdout: "op_pg": 0, 2024-06-03T00:05:59.723 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_stat": 941, 2024-06-03T00:05:59.723 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_create": 0, 2024-06-03T00:05:59.723 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_read": 563, 2024-06-03T00:05:59.723 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_write": 0, 2024-06-03T00:05:59.723 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_writefull": 0, 2024-06-03T00:05:59.723 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_writesame": 0, 2024-06-03T00:05:59.723 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_append": 0, 2024-06-03T00:05:59.723 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_zero": 0, 2024-06-03T00:05:59.723 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_truncate": 0, 2024-06-03T00:05:59.723 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_delete": 0, 2024-06-03T00:05:59.723 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_mapext": 0, 2024-06-03T00:05:59.723 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_sparse_read": 0, 2024-06-03T00:05:59.723 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_clonerange": 0, 2024-06-03T00:05:59.724 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_getxattr": 1, 2024-06-03T00:05:59.724 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_setxattr": 0, 2024-06-03T00:05:59.724 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_cmpxattr": 0, 2024-06-03T00:05:59.724 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_rmxattr": 0, 2024-06-03T00:05:59.724 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_resetxattrs": 0, 2024-06-03T00:05:59.724 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_call": 0, 2024-06-03T00:05:59.724 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_watch": 0, 2024-06-03T00:05:59.724 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_notify": 0, 2024-06-03T00:05:59.724 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_src_cmpxattr": 0, 2024-06-03T00:05:59.724 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_pgls": 0, 2024-06-03T00:05:59.724 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_pgls_filter": 0, 2024-06-03T00:05:59.724 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_other": 0, 2024-06-03T00:05:59.724 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_active": 0, 2024-06-03T00:05:59.724 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_send": 0, 2024-06-03T00:05:59.725 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_resend": 0, 2024-06-03T00:05:59.725 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_ping": 0, 2024-06-03T00:05:59.725 INFO:teuthology.orchestra.run.smithi107.stdout: "poolop_active": 0, 2024-06-03T00:05:59.725 INFO:teuthology.orchestra.run.smithi107.stdout: "poolop_send": 0, 2024-06-03T00:05:59.725 INFO:teuthology.orchestra.run.smithi107.stdout: "poolop_resend": 0, 2024-06-03T00:05:59.725 INFO:teuthology.orchestra.run.smithi107.stdout: "poolstat_active": 0, 2024-06-03T00:05:59.725 INFO:teuthology.orchestra.run.smithi107.stdout: "poolstat_send": 0, 2024-06-03T00:05:59.725 INFO:teuthology.orchestra.run.smithi107.stdout: "poolstat_resend": 0, 2024-06-03T00:05:59.725 INFO:teuthology.orchestra.run.smithi107.stdout: "statfs_active": 0, 2024-06-03T00:05:59.725 INFO:teuthology.orchestra.run.smithi107.stdout: "statfs_send": 0, 2024-06-03T00:05:59.726 INFO:teuthology.orchestra.run.smithi107.stdout: "statfs_resend": 0, 2024-06-03T00:05:59.726 INFO:teuthology.orchestra.run.smithi107.stdout: "command_active": 0, 2024-06-03T00:05:59.726 INFO:teuthology.orchestra.run.smithi107.stdout: "command_send": 0, 2024-06-03T00:05:59.726 INFO:teuthology.orchestra.run.smithi107.stdout: "command_resend": 0, 2024-06-03T00:05:59.726 INFO:teuthology.orchestra.run.smithi107.stdout: "map_epoch": 90, 2024-06-03T00:05:59.726 INFO:teuthology.orchestra.run.smithi107.stdout: "map_full": 0, 2024-06-03T00:05:59.726 INFO:teuthology.orchestra.run.smithi107.stdout: "map_inc": 2, 2024-06-03T00:05:59.726 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_sessions": 6, 2024-06-03T00:05:59.726 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_session_open": 6, 2024-06-03T00:05:59.726 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_session_close": 0, 2024-06-03T00:05:59.727 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_laggy": 0, 2024-06-03T00:05:59.727 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_wr": 0, 2024-06-03T00:05:59.727 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_rd": 2, 2024-06-03T00:05:59.727 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_del": 0 2024-06-03T00:05:59.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.727 INFO:teuthology.orchestra.run.smithi107.stdout: "oft": { 2024-06-03T00:05:59.727 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_objs": 0, 2024-06-03T00:05:59.727 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_kv_pairs": 0, 2024-06-03T00:05:59.727 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_updates": 0, 2024-06-03T00:05:59.727 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_removes": 0 2024-06-03T00:05:59.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.727 INFO:teuthology.orchestra.run.smithi107.stdout: "osd-slow-ops": { 2024-06-03T00:05:59.727 INFO:teuthology.orchestra.run.smithi107.stdout: "slow_ops_count": 0 2024-06-03T00:05:59.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.728 INFO:teuthology.orchestra.run.smithi107.stdout: "purge_queue": { 2024-06-03T00:05:59.728 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing_ops": 0, 2024-06-03T00:05:59.728 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing_ops_high_water": 0, 2024-06-03T00:05:59.728 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing": 0, 2024-06-03T00:05:59.728 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing_high_water": 0, 2024-06-03T00:05:59.728 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executed_ops": 0, 2024-06-03T00:05:59.728 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executed": 0, 2024-06-03T00:05:59.728 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_item_in_journal": 0 2024-06-03T00:05:59.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.728 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-03T00:05:59.728 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-06-03T00:05:59.728 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 104857600, 2024-06-03T00:05:59.728 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-06-03T00:05:59.728 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 1689, 2024-06-03T00:05:59.729 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 24491732, 2024-06-03T00:05:59.729 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:59.729 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 1689, 2024-06-03T00:05:59.729 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2024-06-03T00:05:59.729 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2024-06-03T00:05:59.729 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 1689, 2024-06-03T00:05:59.729 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 24491732, 2024-06-03T00:05:59.729 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-06-03T00:05:59.729 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.729 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.729 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.729 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:59.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.729 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-objecter_bytes": { 2024-06-03T00:05:59.729 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-06-03T00:05:59.730 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 104857600, 2024-06-03T00:05:59.730 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-06-03T00:05:59.730 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2024-06-03T00:05:59.730 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2024-06-03T00:05:59.730 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:59.730 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2024-06-03T00:05:59.730 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 1506, 2024-06-03T00:05:59.730 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 23647899, 2024-06-03T00:05:59.730 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 1506, 2024-06-03T00:05:59.730 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 23647899, 2024-06-03T00:05:59.730 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-06-03T00:05:59.731 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.731 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.731 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.731 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:59.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.731 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-objecter_ops": { 2024-06-03T00:05:59.731 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-06-03T00:05:59.731 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 1024, 2024-06-03T00:05:59.731 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-06-03T00:05:59.731 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2024-06-03T00:05:59.731 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2024-06-03T00:05:59.731 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:59.731 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2024-06-03T00:05:59.732 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 1506, 2024-06-03T00:05:59.732 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 1506, 2024-06-03T00:05:59.732 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 1506, 2024-06-03T00:05:59.732 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 1506, 2024-06-03T00:05:59.732 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-06-03T00:05:59.732 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.732 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.732 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.732 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:59.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.732 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-write_buf_throttle": { 2024-06-03T00:05:59.732 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-06-03T00:05:59.732 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 3758096384, 2024-06-03T00:05:59.733 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-06-03T00:05:59.733 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2024-06-03T00:05:59.733 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2024-06-03T00:05:59.733 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:59.733 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2024-06-03T00:05:59.733 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2024-06-03T00:05:59.733 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2024-06-03T00:05:59.733 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 0, 2024-06-03T00:05:59.733 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 0, 2024-06-03T00:05:59.733 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-06-03T00:05:59.733 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.733 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.733 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.734 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:59.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-06-03T00:05:59.734 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-write_buf_throttle-0x55bed434e6e0": { 2024-06-03T00:05:59.734 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-06-03T00:05:59.734 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 3758096384, 2024-06-03T00:05:59.734 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-06-03T00:05:59.734 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2024-06-03T00:05:59.734 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2024-06-03T00:05:59.734 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-06-03T00:05:59.734 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2024-06-03T00:05:59.734 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2024-06-03T00:05:59.734 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2024-06-03T00:05:59.734 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 0, 2024-06-03T00:05:59.735 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 0, 2024-06-03T00:05:59.735 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-06-03T00:05:59.735 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-06-03T00:05:59.735 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-06-03T00:05:59.735 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-06-03T00:05:59.735 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:59.735 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-06-03T00:05:59.735 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-06-03T00:06:00.610 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-06-03T00:06:00.610 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-06-03T00:06:00.610 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-06-03T00:06:00.621 INFO:tasks.kclient:Unmounting kernel clients... 2024-06-03T00:06:00.621 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-06-03T00:06:00.621 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-03T00:06:00.643 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-06-03T00:06:00.643 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-03T00:06:00.703 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph osd blocklist ls 2024-06-03T00:06:01.006 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:06:01.337 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:01 smithi049 ceph-mon[32302]: pgmap v562: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-06-03T00:06:01.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:01 smithi107 ceph-mon[37048]: pgmap v562: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-06-03T00:06:01.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:01 smithi057 ceph-mon[36457]: pgmap v562: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-06-03T00:06:02.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.692+0000 7f617fe9c700 1 -- 172.21.15.49:0/1655671969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6178108500 msgr2=0x7f61781088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:02.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.692+0000 7f617fe9c700 1 --2- 172.21.15.49:0/1655671969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6178108500 0x7f61781088e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f6174009990 tx=0x7f6174009ca0 comp rx=0 tx=0).stop 2024-06-03T00:06:02.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.692+0000 7f617fe9c700 1 -- 172.21.15.49:0/1655671969 shutdown_connections 2024-06-03T00:06:02.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.692+0000 7f617fe9c700 1 --2- 172.21.15.49:0/1655671969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f617806ab30 0x7f617810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:02.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.692+0000 7f617fe9c700 1 --2- 172.21.15.49:0/1655671969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6178108500 0x7f61781088e0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:02.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.692+0000 7f617fe9c700 1 --2- 172.21.15.49:0/1655671969 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f617806a170 0x7f617806a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:02.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.692+0000 7f617fe9c700 1 -- 172.21.15.49:0/1655671969 >> 172.21.15.49:0/1655671969 conn(0x7f6178078340 msgr2=0x7f6178078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:06:02.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.692+0000 7f617fe9c700 1 -- 172.21.15.49:0/1655671969 shutdown_connections 2024-06-03T00:06:02.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.692+0000 7f617fe9c700 1 -- 172.21.15.49:0/1655671969 wait complete. 2024-06-03T00:06:02.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.693+0000 7f617fe9c700 1 Processor -- start 2024-06-03T00:06:02.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.693+0000 7f617fe9c700 1 -- start start 2024-06-03T00:06:02.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.694+0000 7f617fe9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f617806a170 0x7f617819e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:06:02.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.694+0000 7f617fe9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f617806ab30 0x7f617819ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:06:02.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.694+0000 7f617fe9c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6178108500 0x7f6178198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:06:02.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.694+0000 7f617fe9c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6178112780 con 0x7f6178108500 2024-06-03T00:06:02.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.694+0000 7f617fe9c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6178112600 con 0x7f617806a170 2024-06-03T00:06:02.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.694+0000 7f617fe9c700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6178112900 con 0x7f617806ab30 2024-06-03T00:06:02.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.694+0000 7f617e439700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6178108500 0x7f6178198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:06:02.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.694+0000 7f617e439700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6178108500 0x7f6178198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37714/0 (socket says 172.21.15.49:37714) 2024-06-03T00:06:02.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.694+0000 7f617e439700 1 -- 172.21.15.49:0/3650857385 learned_addr learned my addr 172.21.15.49:0/3650857385 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:06:02.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.694+0000 7f617dc38700 1 --2- 172.21.15.49:0/3650857385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f617806a170 0x7f617819e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:06:02.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.694+0000 7f617d437700 1 --2- 172.21.15.49:0/3650857385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f617806ab30 0x7f617819ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:06:02.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.694+0000 7f617e439700 1 -- 172.21.15.49:0/3650857385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f617806ab30 msgr2=0x7f617819ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:02.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.694+0000 7f617e439700 1 --2- 172.21.15.49:0/3650857385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f617806ab30 0x7f617819ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:02.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.694+0000 7f617e439700 1 -- 172.21.15.49:0/3650857385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f617806a170 msgr2=0x7f617819e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:02.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.694+0000 7f617e439700 1 --2- 172.21.15.49:0/3650857385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f617806a170 0x7f617819e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:02.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.694+0000 7f617e439700 1 -- 172.21.15.49:0/3650857385 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61781991c0 con 0x7f6178108500 2024-06-03T00:06:02.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.694+0000 7f617e439700 1 --2- 172.21.15.49:0/3650857385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6178108500 0x7f6178198a60 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f6170007ee0 tx=0x7f617000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:06:02.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.694+0000 7f616effd700 1 -- 172.21.15.49:0/3650857385 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617000ddd0 con 0x7f6178108500 2024-06-03T00:06:02.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.694+0000 7f616effd700 1 -- 172.21.15.49:0/3650857385 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6170004020 con 0x7f6178108500 2024-06-03T00:06:02.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.694+0000 7f617fe9c700 1 -- 172.21.15.49:0/3650857385 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61781994b0 con 0x7f6178108500 2024-06-03T00:06:02.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.694+0000 7f616effd700 1 -- 172.21.15.49:0/3650857385 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6170015660 con 0x7f6178108500 2024-06-03T00:06:02.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.695+0000 7f617fe9c700 1 -- 172.21.15.49:0/3650857385 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61781a5770 con 0x7f6178108500 2024-06-03T00:06:02.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.696+0000 7f617fe9c700 1 -- 172.21.15.49:0/3650857385 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f617810a9e0 con 0x7f6178108500 2024-06-03T00:06:02.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.697+0000 7f616effd700 1 -- 172.21.15.49:0/3650857385 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f61700041d0 con 0x7f6178108500 2024-06-03T00:06:02.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.697+0000 7f616effd700 1 --2- 172.21.15.49:0/3650857385 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f61640a2ca0 0x7f61640a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:06:02.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.698+0000 7f617dc38700 1 --2- 172.21.15.49:0/3650857385 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f61640a2ca0 0x7f61640a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:06:02.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.698+0000 7f616effd700 1 -- 172.21.15.49:0/3650857385 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f61700cf210 con 0x7f6178108500 2024-06-03T00:06:02.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.698+0000 7f617dc38700 1 --2- 172.21.15.49:0/3650857385 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f61640a2ca0 0x7f61640a5160 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f617400b5c0 tx=0x7f6174005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:06:02.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.701+0000 7f616effd700 1 -- 172.21.15.49:0/3650857385 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6170010070 con 0x7f6178108500 2024-06-03T00:06:02.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.925+0000 7f617fe9c700 1 -- 172.21.15.49:0/3650857385 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6178069180 con 0x7f6178108500 2024-06-03T00:06:02.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.925+0000 7f616effd700 1 -- 172.21.15.49:0/3650857385 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v90) ==== 81+0+589 (secure 0 0 0) 0x7f617009c130 con 0x7f6178108500 2024-06-03T00:06:02.926 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/525944311 2024-06-03T23:49:55.151590+0000 2024-06-03T00:06:02.926 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1841969299 2024-06-03T23:49:55.151590+0000 2024-06-03T00:06:02.926 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1880506696 2024-06-03T23:49:55.151590+0000 2024-06-03T00:06:02.926 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/1206062338 2024-06-03T23:49:55.151590+0000 2024-06-03T00:06:02.926 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/549058216 2024-06-03T23:49:29.042670+0000 2024-06-03T00:06:02.926 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2112783954 2024-06-03T23:49:29.042670+0000 2024-06-03T00:06:02.927 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2183920213 2024-06-03T23:49:29.042670+0000 2024-06-03T00:06:02.927 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/549058216 2024-06-03T23:49:29.042670+0000 2024-06-03T00:06:02.927 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3350970308 2024-06-03T23:49:29.042670+0000 2024-06-03T00:06:02.927 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/1206062338 2024-06-03T23:49:55.151590+0000 2024-06-03T00:06:02.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.928+0000 7f617fe9c700 1 -- 172.21.15.49:0/3650857385 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f61640a2ca0 msgr2=0x7f61640a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:02.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.928+0000 7f617fe9c700 1 --2- 172.21.15.49:0/3650857385 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f61640a2ca0 0x7f61640a5160 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f617400b5c0 tx=0x7f6174005960 comp rx=0 tx=0).stop 2024-06-03T00:06:02.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.928+0000 7f617fe9c700 1 -- 172.21.15.49:0/3650857385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6178108500 msgr2=0x7f6178198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:02.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.928+0000 7f617fe9c700 1 --2- 172.21.15.49:0/3650857385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6178108500 0x7f6178198a60 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f6170007ee0 tx=0x7f617000d3b0 comp rx=0 tx=0).stop 2024-06-03T00:06:02.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.928+0000 7f617fe9c700 1 -- 172.21.15.49:0/3650857385 shutdown_connections 2024-06-03T00:06:02.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.928+0000 7f617fe9c700 1 --2- 172.21.15.49:0/3650857385 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f61640a2ca0 0x7f61640a5160 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:02.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.928+0000 7f617fe9c700 1 --2- 172.21.15.49:0/3650857385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6178108500 0x7f6178198a60 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:02.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.928+0000 7f617fe9c700 1 --2- 172.21.15.49:0/3650857385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f617806a170 0x7f617819e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:02.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.928+0000 7f617fe9c700 1 --2- 172.21.15.49:0/3650857385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f617806ab30 0x7f617819ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:02.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.928+0000 7f617fe9c700 1 -- 172.21.15.49:0/3650857385 >> 172.21.15.49:0/3650857385 conn(0x7f6178078340 msgr2=0x7f6178100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:06:02.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.928+0000 7f617fe9c700 1 -- 172.21.15.49:0/3650857385 shutdown_connections 2024-06-03T00:06:02.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:02.928+0000 7f617fe9c700 1 -- 172.21.15.49:0/3650857385 wait complete. 2024-06-03T00:06:02.929 INFO:teuthology.orchestra.run.smithi049.stderr:listed 10 entries 2024-06-03T00:06:03.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:03 smithi049 ceph-mon[32302]: pgmap v563: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-06-03T00:06:03.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:03 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3650857385' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-03T00:06:03.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:03 smithi107 ceph-mon[37048]: pgmap v563: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-06-03T00:06:03.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:03 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/3650857385' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-03T00:06:03.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:03 smithi057 ceph-mon[36457]: pgmap v563: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-06-03T00:06:03.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:03 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/3650857385' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-03T00:06:03.649 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-06-03T00:06:03.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-03T00:06:03.650 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-06-03T00:06:03.767 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-06-03T00:06:03.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-03T00:06:03.768 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-03T00:06:03.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-03T00:06:03.814 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-06-03T00:06:03.852 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-03T00:06:03.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-03T00:06:03.853 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-03T00:06:03.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-03T00:06:03.933 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2024-06-03T00:06:04.024 INFO:tasks.kclient:Unmounting kernel clients... 2024-06-03T00:06:04.024 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-06-03T00:06:04.024 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-03T00:06:04.043 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056311,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497608k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18611 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/c6e3af9dd68de5bdc682c61b57c4ce1f9d47e183677790b59c4efbf95e892ed0/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/YSAYY5VKN2UO2UEKHOWWTQ3N7X:/var/lib/containers/storage/overlay/l/DUM7HICUCRZB5GXVGKYIPGIEEG,upperdir=/var/lib/containers/storage/overlay/c6e3af9dd68de5bdc682c61b57c4ce1f9d47e183677790b59c4efbf95e892ed0/diff,workdir=/var/lib/containers/storage/overlay/c6e3af9dd68de5bdc682c61b57c4ce1f9d47e183677790b59c4efbf95e892ed0/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/f9964f0fd310686c539c2b41273599c8a509fe7982b29ceeb6fc837750188a56/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/YSAYY5VKN2UO2UEKHOWWTQ3N7X:/var/lib/containers/storage/overlay/l/DUM7HICUCRZB5GXVGKYIPGIEEG,upperdir=/var/lib/containers/storage/overlay/f9964f0fd310686c539c2b41273599c8a509fe7982b29ceeb6fc837750188a56/diff,workdir=/var/lib/containers/storage/overlay/f9964f0fd310686c539c2b41273599c8a509fe7982b29ceeb6fc837750188a56/work,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,inode64 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0 overlay /var/lib/containers/storage/overlay/df3b1cc071350a257b2dbbcee697bf960eba28ad33a64582fec843d2d91abd21/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/YSAYY5VKN2UO2UEKHOWWTQ3N7X:/var/lib/containers/storage/overlay/l/DUM7HICUCRZB5GXVGKYIPGIEEG,upperdir=/var/lib/containers/storage/overlay/df3b1cc071350a257b2dbbcee697bf960eba28ad33a64582fec843d2d91abd21/diff,workdir=/var/lib/containers/storage/overlay/df3b1cc071350a257b2dbbcee697bf960eba28ad33a64582fec843d2d91abd21/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/ab1b50be0f1e0be7a30dbb09e86fa2123eb25ca72ab70f020d886922e1b4f625/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/YSAYY5VKN2UO2UEKHOWWTQ3N7X:/var/lib/containers/storage/overlay/l/DUM7HICUCRZB5GXVGKYIPGIEEG,upperdir=/var/lib/containers/storage/overlay/ab1b50be0f1e0be7a30dbb09e86fa2123eb25ca72ab70f020d886922e1b4f625/diff,workdir=/var/lib/containers/storage/overlay/ab1b50be0f1e0be7a30dbb09e86fa2123eb25ca72ab70f020d886922e1b4f625/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/6356dca63e51341313fc1e7f780734ffe780ced18954848e56239f5b567225ed/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/YSAYY5VKN2UO2UEKHOWWTQ3N7X:/var/lib/containers/storage/overlay/l/DUM7HICUCRZB5GXVGKYIPGIEEG,upperdir=/var/lib/containers/storage/overlay/6356dca63e51341313fc1e7f780734ffe780ced18954848e56239f5b567225ed/diff,workdir=/var/lib/containers/storage/overlay/6356dca63e51341313fc1e7f780734ffe780ced18954848e56239f5b567225ed/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/8cc09fb99334aa5534c41bf8ea98e43ac0fb97f04573ad15e76497a8d9a1bd2d/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/YSAYY5VKN2UO2UEKHOWWTQ3N7X:/var/lib/containers/storage/overlay/l/DUM7HICUCRZB5GXVGKYIPGIEEG,upperdir=/var/lib/containers/storage/overlay/8cc09fb99334aa5534c41bf8ea98e43ac0fb97f04573ad15e76497a8d9a1bd2d/diff,workdir=/var/lib/containers/storage/overlay/8cc09fb99334aa5534c41bf8ea98e43ac0fb97f04573ad15e76497a8d9a1bd2d/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/69c7983ca35856c11e90a4e83625acb6ab0324e346185cae8a60e33615f4b979/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/YSAYY5VKN2UO2UEKHOWWTQ3N7X:/var/lib/containers/storage/overlay/l/DUM7HICUCRZB5GXVGKYIPGIEEG,upperdir=/var/lib/containers/storage/overlay/69c7983ca35856c11e90a4e83625acb6ab0324e346185cae8a60e33615f4b979/diff,workdir=/var/lib/containers/storage/overlay/69c7983ca35856c11e90a4e83625acb6ab0324e346185cae8a60e33615f4b979/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/d9756d3aa911569f50e575b7b2827f4de72074901ab0eb8d0deb58905a3894cd/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/YSAYY5VKN2UO2UEKHOWWTQ3N7X:/var/lib/containers/storage/overlay/l/DUM7HICUCRZB5GXVGKYIPGIEEG,upperdir=/var/lib/containers/storage/overlay/d9756d3aa911569f50e575b7b2827f4de72074901ab0eb8d0deb58905a3894cd/diff,workdir=/var/lib/containers/storage/overlay/d9756d3aa911569f50e575b7b2827f4de72074901ab0eb8d0deb58905a3894cd/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/79b2ea12b9c66ddf6ded3b55c7e3a92d7fe933d7cedb2ac6936b7105f9723d58/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/YSAYY5VKN2UO2UEKHOWWTQ3N7X:/var/lib/containers/storage/overlay/l/DUM7HICUCRZB5GXVGKYIPGIEEG,upperdir=/var/lib/containers/storage/overlay/79b2ea12b9c66ddf6ded3b55c7e3a92d7fe933d7cedb2ac6936b7105f9723d58/diff,workdir=/var/lib/containers/storage/overlay/79b2ea12b9c66ddf6ded3b55c7e3a92d7fe933d7cedb2ac6936b7105f9723d58/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/8660cac9f02d2c90713d651a32a060f4b72bb55732005effce75470879f74d28/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/YSAYY5VKN2UO2UEKHOWWTQ3N7X:/var/lib/containers/storage/overlay/l/DUM7HICUCRZB5GXVGKYIPGIEEG,upperdir=/var/lib/containers/storage/overlay/8660cac9f02d2c90713d651a32a060f4b72bb55732005effce75470879f74d28/diff,workdir=/var/lib/containers/storage/overlay/8660cac9f02d2c90713d651a32a060f4b72bb55732005effce75470879f74d28/work,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497608k,nr_inodes=819200,mode=755,inode64 0 0 2024-06-03T00:06:04.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-03T00:06:04.043 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-06-03T00:06:04.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-03T00:06:04.100 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2024-06-03T00:06:04.170 INFO:teuthology.orchestra.run.smithi049.stderr:Cannot find device "ceph-brx" 2024-06-03T00:06:04.172 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-03T00:06:04.172 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-06-03T00:06:04.183 INFO:tasks.cephadm:Teardown begin 2024-06-03T00:06:04.183 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-06-03T00:06:04.184 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-03T00:06:04.477 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:06:05.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:05 smithi049 ceph-mon[32302]: pgmap v564: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-03T00:06:05.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:05 smithi107 ceph-mon[37048]: pgmap v564: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-03T00:06:05.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:05 smithi057 ceph-mon[36457]: pgmap v564: 97 pgs: 97 active+clean; 91 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-06-03T00:06:06.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.201+0000 7f7b7fa45700 1 -- 172.21.15.49:0/3539074386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b781013c0 msgr2=0x7f7b78101840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:06.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.201+0000 7f7b7fa45700 1 --2- 172.21.15.49:0/3539074386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b781013c0 0x7f7b78101840 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f7b68009990 tx=0x7f7b68009ca0 comp rx=0 tx=0).stop 2024-06-03T00:06:06.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.201+0000 7f7b7fa45700 1 -- 172.21.15.49:0/3539074386 shutdown_connections 2024-06-03T00:06:06.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.201+0000 7f7b7fa45700 1 --2- 172.21.15.49:0/3539074386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b78101d80 0x7f7b7810e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:06.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.201+0000 7f7b7fa45700 1 --2- 172.21.15.49:0/3539074386 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b78107440 0x7f7b78107820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:06.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.201+0000 7f7b7fa45700 1 --2- 172.21.15.49:0/3539074386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b781013c0 0x7f7b78101840 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:06.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.202+0000 7f7b7fa45700 1 -- 172.21.15.49:0/3539074386 >> 172.21.15.49:0/3539074386 conn(0x7f7b78077400 msgr2=0x7f7b78077810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:06:06.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.202+0000 7f7b7fa45700 1 -- 172.21.15.49:0/3539074386 shutdown_connections 2024-06-03T00:06:06.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.202+0000 7f7b7fa45700 1 -- 172.21.15.49:0/3539074386 wait complete. 2024-06-03T00:06:06.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.202+0000 7f7b7fa45700 1 Processor -- start 2024-06-03T00:06:06.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.202+0000 7f7b7fa45700 1 -- start start 2024-06-03T00:06:06.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.203+0000 7f7b7fa45700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b781013c0 0x7f7b78199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:06:06.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.203+0000 7f7b7fa45700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b78101d80 0x7f7b78199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:06:06.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.203+0000 7f7b7fa45700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b78107440 0x7f7b781a4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:06:06.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.203+0000 7f7b7fa45700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7b78111700 con 0x7f7b781013c0 2024-06-03T00:06:06.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.203+0000 7f7b7fa45700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f7b78111580 con 0x7f7b78101d80 2024-06-03T00:06:06.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.203+0000 7f7b7fa45700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7b78111880 con 0x7f7b78107440 2024-06-03T00:06:06.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.203+0000 7f7b7d7e1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b781013c0 0x7f7b78199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:06:06.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.203+0000 7f7b7d7e1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b781013c0 0x7f7b78199a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39892/0 (socket says 172.21.15.49:39892) 2024-06-03T00:06:06.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.203+0000 7f7b7d7e1700 1 -- 172.21.15.49:0/846239229 learned_addr learned my addr 172.21.15.49:0/846239229 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:06:06.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.203+0000 7f7b7cfe0700 1 --2- 172.21.15.49:0/846239229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b78101d80 0x7f7b78199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:06:06.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.203+0000 7f7b7dfe2700 1 --2- 172.21.15.49:0/846239229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b78107440 0x7f7b781a4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:06:06.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.203+0000 7f7b7d7e1700 1 -- 172.21.15.49:0/846239229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b78107440 msgr2=0x7f7b781a4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:06.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.203+0000 7f7b7d7e1700 1 --2- 172.21.15.49:0/846239229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b78107440 0x7f7b781a4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:06.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.203+0000 7f7b7d7e1700 1 -- 172.21.15.49:0/846239229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b78101d80 msgr2=0x7f7b78199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:06.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.203+0000 7f7b7d7e1700 1 --2- 172.21.15.49:0/846239229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b78101d80 0x7f7b78199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:06.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.203+0000 7f7b7d7e1700 1 -- 172.21.15.49:0/846239229 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b781a5040 con 0x7f7b781013c0 2024-06-03T00:06:06.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.203+0000 7f7b7dfe2700 1 --2- 172.21.15.49:0/846239229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b78107440 0x7f7b781a4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:06:06.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.203+0000 7f7b7d7e1700 1 --2- 172.21.15.49:0/846239229 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b781013c0 0x7f7b78199a80 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400c9b0 tx=0x7f7b7400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:06:06.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.203+0000 7f7b6e7fc700 1 -- 172.21.15.49:0/846239229 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b74007b00 con 0x7f7b781013c0 2024-06-03T00:06:06.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.203+0000 7f7b6e7fc700 1 -- 172.21.15.49:0/846239229 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b74007ca0 con 0x7f7b781013c0 2024-06-03T00:06:06.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.204+0000 7f7b7fa45700 1 -- 172.21.15.49:0/846239229 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b781a5270 con 0x7f7b781013c0 2024-06-03T00:06:06.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.204+0000 7f7b6e7fc700 1 -- 172.21.15.49:0/846239229 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b74018730 con 0x7f7b781013c0 2024-06-03T00:06:06.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.204+0000 7f7b7fa45700 1 -- 172.21.15.49:0/846239229 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b781a5780 con 0x7f7b781013c0 2024-06-03T00:06:06.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.205+0000 7f7b7fa45700 1 -- 172.21.15.49:0/846239229 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b78102ab0 con 0x7f7b781013c0 2024-06-03T00:06:06.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.206+0000 7f7b6e7fc700 1 -- 172.21.15.49:0/846239229 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7b740188d0 con 0x7f7b781013c0 2024-06-03T00:06:06.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.206+0000 7f7b6e7fc700 1 --2- 172.21.15.49:0/846239229 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7b640a2c20 0x7f7b640a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:06:06.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.207+0000 7f7b7cfe0700 1 --2- 172.21.15.49:0/846239229 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7b640a2c20 0x7f7b640a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:06:06.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.207+0000 7f7b6e7fc700 1 -- 172.21.15.49:0/846239229 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f7b740cf020 con 0x7f7b781013c0 2024-06-03T00:06:06.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.207+0000 7f7b7cfe0700 1 --2- 172.21.15.49:0/846239229 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7b640a2c20 0x7f7b640a50e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7b78077ae0 tx=0x7f7b6800b560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:06:06.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.211+0000 7f7b6e7fc700 1 -- 172.21.15.49:0/846239229 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7b74014030 con 0x7f7b781013c0 2024-06-03T00:06:06.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.461+0000 7f7b7fa45700 1 -- 172.21.15.49:0/846239229 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b7802dca0 con 0x7f7b781013c0 2024-06-03T00:06:06.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.462+0000 7f7b6e7fc700 1 -- 172.21.15.49:0/846239229 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11946 (secure 0 0 0) 0x7f7b7409bf80 con 0x7f7b781013c0 2024-06-03T00:06:06.462 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:06:06.462 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1553264866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1553264866},{"type":"v1","addr":"172.21.15.49:6835","nonce":1553264866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2266285252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2266285252},{"type":"v1","addr":"172.21.15.49:6837","nonce":2266285252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T23:57:16.991201+0000","modified":"2024-06-03T00:05:57.937098+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24485,"mds_2":24466,"mds_3":24464,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6839/1729124617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":1729124617},{"type":"v1","addr":"172.21.15.49:6839","nonce":1729124617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6841/1902772235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":1902772235},{"type":"v1","addr":"172.21.15.49:6841","nonce":1902772235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6833/1633534002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1633534002},{"type":"v1","addr":"172.21.15.57:6833","nonce":1633534002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6835/2254905671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2254905671},{"type":"v1","addr":"172.21.15.57:6835","nonce":2254905671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.107:6835/3693542801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3693542801},{"type":"v1","addr":"172.21.15.107:6835","nonce":3693542801}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.57:6837/230452144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":230452144},{"type":"v1","addr":"172.21.15.57:6837","nonce":230452144}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":92,"addr":"172.21.15.107:6837/3700593315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":3700593315},{"type":"v1","addr":"172.21.15.107:6837","nonce":3700593315}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6839/249825195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":249825195},{"type":"v1","addr":"172.21.15.57:6839","nonce":249825195}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6839/1986600681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1986600681},{"type":"v1","addr":"172.21.15.107:6839","nonce":1986600681}]},"join_fscid":-1,"export_targets":[1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487,24466,24460,24485,24464]},"id":1}]} 2024-06-03T00:06:06.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.464+0000 7f7b7fa45700 1 -- 172.21.15.49:0/846239229 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7b640a2c20 msgr2=0x7f7b640a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:06.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.464+0000 7f7b7fa45700 1 --2- 172.21.15.49:0/846239229 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7b640a2c20 0x7f7b640a50e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7b78077ae0 tx=0x7f7b6800b560 comp rx=0 tx=0).stop 2024-06-03T00:06:06.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.464+0000 7f7b7fa45700 1 -- 172.21.15.49:0/846239229 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b781013c0 msgr2=0x7f7b78199a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:06.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.464+0000 7f7b7fa45700 1 --2- 172.21.15.49:0/846239229 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b781013c0 0x7f7b78199a80 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400c9b0 tx=0x7f7b7400ccc0 comp rx=0 tx=0).stop 2024-06-03T00:06:06.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.464+0000 7f7b7fa45700 1 -- 172.21.15.49:0/846239229 shutdown_connections 2024-06-03T00:06:06.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.464+0000 7f7b7fa45700 1 --2- 172.21.15.49:0/846239229 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f7b640a2c20 0x7f7b640a50e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:06.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.464+0000 7f7b7fa45700 1 --2- 172.21.15.49:0/846239229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b78107440 0x7f7b781a4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:06.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.464+0000 7f7b7fa45700 1 --2- 172.21.15.49:0/846239229 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b781013c0 0x7f7b78199a80 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:06.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.464+0000 7f7b7fa45700 1 --2- 172.21.15.49:0/846239229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b78101d80 0x7f7b78199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:06.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.464+0000 7f7b7fa45700 1 -- 172.21.15.49:0/846239229 >> 172.21.15.49:0/846239229 conn(0x7f7b78077400 msgr2=0x7f7b781001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:06:06.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.465+0000 7f7b7fa45700 1 -- 172.21.15.49:0/846239229 shutdown_connections 2024-06-03T00:06:06.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:06.465+0000 7f7b7fa45700 1 -- 172.21.15.49:0/846239229 wait complete. 2024-06-03T00:06:06.466 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 40 2024-06-03T00:06:07.191 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-03T00:06:07.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:07 smithi107 ceph-mon[37048]: pgmap v565: 97 pgs: 97 active+clean; 91 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 12 op/s 2024-06-03T00:06:07.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:07 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/846239229' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:06:07.444 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:06:07.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:07 smithi057 ceph-mon[36457]: pgmap v565: 97 pgs: 97 active+clean; 91 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 12 op/s 2024-06-03T00:06:07.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:07 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/846239229' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:06:07.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:07 smithi049 ceph-mon[32302]: pgmap v565: 97 pgs: 97 active+clean; 91 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 12 op/s 2024-06-03T00:06:07.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:07 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/846239229' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:06:09.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.184+0000 7f7835087700 1 -- 172.21.15.49:0/838910053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7830101880 msgr2=0x7f783010f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:09.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.184+0000 7f7835087700 1 --2- 172.21.15.49:0/838910053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7830101880 0x7f783010f380 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f782800b0a0 tx=0x7f782800b3b0 comp rx=0 tx=0).stop 2024-06-03T00:06:09.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.184+0000 7f7835087700 1 -- 172.21.15.49:0/838910053 shutdown_connections 2024-06-03T00:06:09.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.184+0000 7f7835087700 1 --2- 172.21.15.49:0/838910053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7830101880 0x7f783010f380 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:09.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.184+0000 7f7835087700 1 --2- 172.21.15.49:0/838910053 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7830108670 0x7f7830108a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:09.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.184+0000 7f7835087700 1 --2- 172.21.15.49:0/838910053 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7830100ec0 0x7f7830101340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:09.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.184+0000 7f7835087700 1 -- 172.21.15.49:0/838910053 >> 172.21.15.49:0/838910053 conn(0x7f7830076600 msgr2=0x7f7830076a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:06:09.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.184+0000 7f7835087700 1 -- 172.21.15.49:0/838910053 shutdown_connections 2024-06-03T00:06:09.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.184+0000 7f7835087700 1 -- 172.21.15.49:0/838910053 wait complete. 2024-06-03T00:06:09.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.185+0000 7f7835087700 1 Processor -- start 2024-06-03T00:06:09.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.185+0000 7f7835087700 1 -- start start 2024-06-03T00:06:09.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.186+0000 7f7835087700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7830100ec0 0x7f78301020a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:06:09.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.186+0000 7f7835087700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7830101880 0x7f78301025e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:06:09.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.186+0000 7f7835087700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7830108670 0x7f7830102b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:06:09.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.186+0000 7f7835087700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f78301127f0 con 0x7f7830101880 2024-06-03T00:06:09.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.186+0000 7f7835087700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f7830112670 con 0x7f7830108670 2024-06-03T00:06:09.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.186+0000 7f7835087700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7830112970 con 0x7f7830100ec0 2024-06-03T00:06:09.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.186+0000 7f782e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7830101880 0x7f78301025e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:06:09.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.186+0000 7f782f59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7830108670 0x7f7830102b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:06:09.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.186+0000 7f782e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7830101880 0x7f78301025e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39916/0 (socket says 172.21.15.49:39916) 2024-06-03T00:06:09.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.186+0000 7f782e59c700 1 -- 172.21.15.49:0/99716461 learned_addr learned my addr 172.21.15.49:0/99716461 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:06:09.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.186+0000 7f782ed9d700 1 --2- 172.21.15.49:0/99716461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7830100ec0 0x7f78301020a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:06:09.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.186+0000 7f782f59e700 1 -- 172.21.15.49:0/99716461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7830100ec0 msgr2=0x7f78301020a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:09.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.186+0000 7f782f59e700 1 --2- 172.21.15.49:0/99716461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7830100ec0 0x7f78301020a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:09.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.186+0000 7f782f59e700 1 -- 172.21.15.49:0/99716461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7830101880 msgr2=0x7f78301025e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:09.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.186+0000 7f782f59e700 1 --2- 172.21.15.49:0/99716461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7830101880 0x7f78301025e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:09.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.186+0000 7f782f59e700 1 -- 172.21.15.49:0/99716461 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78301a7230 con 0x7f7830108670 2024-06-03T00:06:09.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.186+0000 7f782e59c700 1 --2- 172.21.15.49:0/99716461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7830101880 0x7f78301025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:06:09.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.186+0000 7f782f59e700 1 --2- 172.21.15.49:0/99716461 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7830108670 0x7f7830102b20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f782800d010 tx=0x7f7828004d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:06:09.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.187+0000 7f7817fff700 1 -- 172.21.15.49:0/99716461 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7828021070 con 0x7f7830108670 2024-06-03T00:06:09.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.187+0000 7f7817fff700 1 -- 172.21.15.49:0/99716461 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7828007b80 con 0x7f7830108670 2024-06-03T00:06:09.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.187+0000 7f7835087700 1 -- 172.21.15.49:0/99716461 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78301a74c0 con 0x7f7830108670 2024-06-03T00:06:09.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.187+0000 7f7817fff700 1 -- 172.21.15.49:0/99716461 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78280052a0 con 0x7f7830108670 2024-06-03T00:06:09.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.187+0000 7f7835087700 1 -- 172.21.15.49:0/99716461 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78301a79c0 con 0x7f7830108670 2024-06-03T00:06:09.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.188+0000 7f7835087700 1 -- 172.21.15.49:0/99716461 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7830069180 con 0x7f7830108670 2024-06-03T00:06:09.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.189+0000 7f7817fff700 1 -- 172.21.15.49:0/99716461 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7828024070 con 0x7f7830108670 2024-06-03T00:06:09.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.189+0000 7f7817fff700 1 --2- 172.21.15.49:0/99716461 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f78180a2ca0 0x7f78180a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:06:09.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.190+0000 7f782ed9d700 1 --2- 172.21.15.49:0/99716461 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f78180a2ca0 0x7f78180a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:06:09.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.190+0000 7f7817fff700 1 -- 172.21.15.49:0/99716461 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f782800f020 con 0x7f7830108670 2024-06-03T00:06:09.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.190+0000 7f782ed9d700 1 --2- 172.21.15.49:0/99716461 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f78180a2ca0 0x7f78180a5160 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7820005950 tx=0x7f782000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:06:09.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.193+0000 7f7817fff700 1 -- 172.21.15.49:0/99716461 <== mon.2 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f782802b020 con 0x7f7830108670 2024-06-03T00:06:09.193 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:09 smithi049 ceph-mon[32302]: pgmap v566: 97 pgs: 97 active+clean; 91 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 938 B/s wr, 11 op/s 2024-06-03T00:06:09.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:09 smithi107 ceph-mon[37048]: pgmap v566: 97 pgs: 97 active+clean; 91 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 938 B/s wr, 11 op/s 2024-06-03T00:06:09.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.448+0000 7f7835087700 1 -- 172.21.15.49:0/99716461 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f783002dca0 con 0x7f7830108670 2024-06-03T00:06:09.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.449+0000 7f7817fff700 1 -- 172.21.15.49:0/99716461 <== mon.2 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11946 (secure 0 0 0) 0x7f782809d610 con 0x7f7830108670 2024-06-03T00:06:09.449 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:06:09.449 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1553264866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1553264866},{"type":"v1","addr":"172.21.15.49:6835","nonce":1553264866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/2266285252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":2266285252},{"type":"v1","addr":"172.21.15.49:6837","nonce":2266285252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T23:57:16.991201+0000","modified":"2024-06-03T00:05:57.937098+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24487,"mds_1":24485,"mds_2":24466,"mds_3":24464,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6839/1729124617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":1729124617},{"type":"v1","addr":"172.21.15.49:6839","nonce":1729124617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6841/1902772235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":1902772235},{"type":"v1","addr":"172.21.15.49:6841","nonce":1902772235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6833/1633534002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1633534002},{"type":"v1","addr":"172.21.15.57:6833","nonce":1633534002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6833/2662998293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2662998293},{"type":"v1","addr":"172.21.15.107:6833","nonce":2662998293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24440":{"gid":24440,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.57:6835/2254905671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2254905671},{"type":"v1","addr":"172.21.15.57:6835","nonce":2254905671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.107:6835/3693542801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3693542801},{"type":"v1","addr":"172.21.15.107:6835","nonce":3693542801}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.57:6837/230452144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":230452144},{"type":"v1","addr":"172.21.15.57:6837","nonce":230452144}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":92,"addr":"172.21.15.107:6837/3700593315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":3700593315},{"type":"v1","addr":"172.21.15.107:6837","nonce":3700593315}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6839/249825195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":249825195},{"type":"v1","addr":"172.21.15.57:6839","nonce":249825195}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.107:6839/1986600681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1986600681},{"type":"v1","addr":"172.21.15.107:6839","nonce":1986600681}]},"join_fscid":-1,"export_targets":[1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24487,"qdb_cluster":[24487,24466,24460,24485,24464]},"id":1}]} 2024-06-03T00:06:09.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:09 smithi057 ceph-mon[36457]: pgmap v566: 97 pgs: 97 active+clean; 91 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 938 B/s wr, 11 op/s 2024-06-03T00:06:09.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.451+0000 7f7835087700 1 -- 172.21.15.49:0/99716461 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f78180a2ca0 msgr2=0x7f78180a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:09.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.451+0000 7f7835087700 1 --2- 172.21.15.49:0/99716461 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f78180a2ca0 0x7f78180a5160 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7820005950 tx=0x7f782000b410 comp rx=0 tx=0).stop 2024-06-03T00:06:09.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.451+0000 7f7835087700 1 -- 172.21.15.49:0/99716461 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7830108670 msgr2=0x7f7830102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:09.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.451+0000 7f7835087700 1 --2- 172.21.15.49:0/99716461 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7830108670 0x7f7830102b20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f782800d010 tx=0x7f7828004d50 comp rx=0 tx=0).stop 2024-06-03T00:06:09.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.451+0000 7f7835087700 1 -- 172.21.15.49:0/99716461 shutdown_connections 2024-06-03T00:06:09.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.451+0000 7f7835087700 1 --2- 172.21.15.49:0/99716461 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f78180a2ca0 0x7f78180a5160 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:09.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.451+0000 7f7835087700 1 --2- 172.21.15.49:0/99716461 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7830108670 0x7f7830102b20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:09.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.451+0000 7f7835087700 1 --2- 172.21.15.49:0/99716461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7830100ec0 0x7f78301020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:09.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.451+0000 7f7835087700 1 --2- 172.21.15.49:0/99716461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7830101880 0x7f78301025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:09.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.451+0000 7f7835087700 1 -- 172.21.15.49:0/99716461 >> 172.21.15.49:0/99716461 conn(0x7f7830076600 msgr2=0x7f78300ff8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:06:09.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.451+0000 7f7835087700 1 -- 172.21.15.49:0/99716461 shutdown_connections 2024-06-03T00:06:09.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:09.452+0000 7f7835087700 1 -- 172.21.15.49:0/99716461 wait complete. 2024-06-03T00:06:09.453 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 40 2024-06-03T00:06:10.180 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-03T00:06:10.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:10 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/99716461' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:06:10.432 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:06:10.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:10 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/99716461' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:06:10.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:10 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/99716461' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-03T00:06:11.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:11 smithi049 ceph-mon[32302]: pgmap v567: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-06-03T00:06:11.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:11 smithi107 ceph-mon[37048]: pgmap v567: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-06-03T00:06:11.351 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:11 smithi057 ceph-mon[36457]: pgmap v567: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-06-03T00:06:12.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.255+0000 7f99c5703700 1 -- 172.21.15.49:0/4055699628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99c0106410 msgr2=0x7f99c01067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:12.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.255+0000 7f99c5703700 1 --2- 172.21.15.49:0/4055699628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99c0106410 0x7f99c01067f0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f99b00099c0 tx=0x7f99b0009cd0 comp rx=0 tx=0).stop 2024-06-03T00:06:12.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.256+0000 7f99c5703700 1 -- 172.21.15.49:0/4055699628 shutdown_connections 2024-06-03T00:06:12.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.256+0000 7f99c5703700 1 --2- 172.21.15.49:0/4055699628 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99c01020a0 0x7f99c010e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:12.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.256+0000 7f99c5703700 1 --2- 172.21.15.49:0/4055699628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99c0106410 0x7f99c01067f0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:12.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.256+0000 7f99c5703700 1 --2- 172.21.15.49:0/4055699628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99c01016e0 0x7f99c0101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:12.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.256+0000 7f99c5703700 1 -- 172.21.15.49:0/4055699628 >> 172.21.15.49:0/4055699628 conn(0x7f99c0077200 msgr2=0x7f99c0077610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:06:12.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.256+0000 7f99c5703700 1 -- 172.21.15.49:0/4055699628 shutdown_connections 2024-06-03T00:06:12.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.256+0000 7f99c5703700 1 -- 172.21.15.49:0/4055699628 wait complete. 2024-06-03T00:06:12.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.256+0000 7f99c5703700 1 Processor -- start 2024-06-03T00:06:12.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.256+0000 7f99c5703700 1 -- start start 2024-06-03T00:06:12.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.257+0000 7f99c5703700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99c01016e0 0x7f99c019e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:06:12.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.257+0000 7f99c5703700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99c01020a0 0x7f99c019ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:06:12.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.257+0000 7f99c5703700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99c0106410 0x7f99c0198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:06:12.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.257+0000 7f99c5703700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f99c0111710 con 0x7f99c01016e0 2024-06-03T00:06:12.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.257+0000 7f99c5703700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f99c0111590 con 0x7f99c01020a0 2024-06-03T00:06:12.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.257+0000 7f99c5703700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f99c0111890 con 0x7f99c0106410 2024-06-03T00:06:12.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.257+0000 7f99beffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99c01016e0 0x7f99c019e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:06:12.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.257+0000 7f99beffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99c01016e0 0x7f99c019e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39940/0 (socket says 172.21.15.49:39940) 2024-06-03T00:06:12.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.257+0000 7f99beffd700 1 -- 172.21.15.49:0/1829611302 learned_addr learned my addr 172.21.15.49:0/1829611302 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:06:12.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.257+0000 7f99be7fc700 1 --2- 172.21.15.49:0/1829611302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99c01020a0 0x7f99c019ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:06:12.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.257+0000 7f99bf7fe700 1 --2- 172.21.15.49:0/1829611302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99c0106410 0x7f99c0198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:06:12.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.257+0000 7f99be7fc700 1 -- 172.21.15.49:0/1829611302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99c0106410 msgr2=0x7f99c0198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:12.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.257+0000 7f99be7fc700 1 --2- 172.21.15.49:0/1829611302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99c0106410 0x7f99c0198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:12.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.257+0000 7f99be7fc700 1 -- 172.21.15.49:0/1829611302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99c01016e0 msgr2=0x7f99c019e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:12.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.257+0000 7f99be7fc700 1 --2- 172.21.15.49:0/1829611302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99c01016e0 0x7f99c019e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:12.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.257+0000 7f99be7fc700 1 -- 172.21.15.49:0/1829611302 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c01991c0 con 0x7f99c01020a0 2024-06-03T00:06:12.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.257+0000 7f99beffd700 1 --2- 172.21.15.49:0/1829611302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99c01016e0 0x7f99c019e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:06:12.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.257+0000 7f99be7fc700 1 --2- 172.21.15.49:0/1829611302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99c01020a0 0x7f99c019ed90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f99b400e7e0 tx=0x7f99b400eaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:06:12.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.258+0000 7f99a7fff700 1 -- 172.21.15.49:0/1829611302 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b4004220 con 0x7f99c01020a0 2024-06-03T00:06:12.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.258+0000 7f99a7fff700 1 -- 172.21.15.49:0/1829611302 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99b4004d10 con 0x7f99c01020a0 2024-06-03T00:06:12.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.258+0000 7f99a7fff700 1 -- 172.21.15.49:0/1829611302 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b4010700 con 0x7f99c01020a0 2024-06-03T00:06:12.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.258+0000 7f99c5703700 1 -- 172.21.15.49:0/1829611302 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99c01994b0 con 0x7f99c01020a0 2024-06-03T00:06:12.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.258+0000 7f99c5703700 1 -- 172.21.15.49:0/1829611302 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99c01a5720 con 0x7f99c01020a0 2024-06-03T00:06:12.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.259+0000 7f99c5703700 1 -- 172.21.15.49:0/1829611302 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99c0102b00 con 0x7f99c01020a0 2024-06-03T00:06:12.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.260+0000 7f99a7fff700 1 -- 172.21.15.49:0/1829611302 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f99b4004750 con 0x7f99c01020a0 2024-06-03T00:06:12.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.260+0000 7f99a7fff700 1 --2- 172.21.15.49:0/1829611302 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f99a80a2c20 0x7f99a80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:06:12.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.261+0000 7f99beffd700 1 --2- 172.21.15.49:0/1829611302 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f99a80a2c20 0x7f99a80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:06:12.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.261+0000 7f99a7fff700 1 -- 172.21.15.49:0/1829611302 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f99b40ced80 con 0x7f99c01020a0 2024-06-03T00:06:12.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.261+0000 7f99beffd700 1 --2- 172.21.15.49:0/1829611302 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f99a80a2c20 0x7f99a80a50e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f99b0009990 tx=0x7f99b0005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:06:12.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.265+0000 7f99a7fff700 1 -- 172.21.15.49:0/1829611302 <== mon.2 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f99b409bd70 con 0x7f99c01020a0 2024-06-03T00:06:12.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.471+0000 7f99c5703700 1 -- 172.21.15.49:0/1829611302 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f99c0199f40 con 0x7f99c01020a0 2024-06-03T00:06:12.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.472+0000 7f99a7fff700 1 -- 172.21.15.49:0/1829611302 <== mon.2 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+22612 (secure 0 0 0) 0x7f99b409b670 con 0x7f99c01020a0 2024-06-03T00:06:12.472 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-06-03T00:06:12.472 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":90,"fsid":"890dd222-213a-11ef-bc9b-c7b262605968","created":"2024-06-02T23:48:53.323536+0000","modified":"2024-06-02T23:57:56.520324+0000","last_up_change":"2024-06-02T23:56:12.156697+0000","last_in_change":"2024-06-02T23:55:51.667118+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:52:23.676079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:57:10.753178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T23:57:14.240610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e0013e80-07d6-4ad3-87d8-d41988988ef5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6803","nonce":811647073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6805","nonce":811647073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6809","nonce":811647073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":811647073},{"type":"v1","addr":"172.21.15.49:6807","nonce":811647073}]},"public_addr":"172.21.15.49:6803/811647073","cluster_addr":"172.21.15.49:6805/811647073","heartbeat_back_addr":"172.21.15.49:6809/811647073","heartbeat_front_addr":"172.21.15.49:6807/811647073","state":["exists","up"]},{"osd":1,"uuid":"f37d9f79-e349-4de7-81e7-385ddb905f58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6801","nonce":1260507785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6803","nonce":1260507785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6807","nonce":1260507785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":1260507785},{"type":"v1","addr":"172.21.15.57:6805","nonce":1260507785}]},"public_addr":"172.21.15.57:6801/1260507785","cluster_addr":"172.21.15.57:6803/1260507785","heartbeat_back_addr":"172.21.15.57:6807/1260507785","heartbeat_front_addr":"172.21.15.57:6805/1260507785","state":["exists","up"]},{"osd":2,"uuid":"94889281-7d45-4e78-9d37-b98e3fbe8494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6801","nonce":303899951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6803","nonce":303899951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6807","nonce":303899951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":303899951},{"type":"v1","addr":"172.21.15.107:6805","nonce":303899951}]},"public_addr":"172.21.15.107:6801/303899951","cluster_addr":"172.21.15.107:6803/303899951","heartbeat_back_addr":"172.21.15.107:6807/303899951","heartbeat_front_addr":"172.21.15.107:6805/303899951","state":["exists","up"]},{"osd":3,"uuid":"31f4c18c-fbda-400d-8b3b-0955b0c4a6a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6811","nonce":60796312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6813","nonce":60796312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6817","nonce":60796312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":60796312},{"type":"v1","addr":"172.21.15.49:6815","nonce":60796312}]},"public_addr":"172.21.15.49:6811/60796312","cluster_addr":"172.21.15.49:6813/60796312","heartbeat_back_addr":"172.21.15.49:6817/60796312","heartbeat_front_addr":"172.21.15.49:6815/60796312","state":["exists","up"]},{"osd":4,"uuid":"8076c2f3-0138-459e-89b5-c5c4586a14ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6809","nonce":3106842986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6811","nonce":3106842986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6815","nonce":3106842986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3106842986},{"type":"v1","addr":"172.21.15.57:6813","nonce":3106842986}]},"public_addr":"172.21.15.57:6809/3106842986","cluster_addr":"172.21.15.57:6811/3106842986","heartbeat_back_addr":"172.21.15.57:6815/3106842986","heartbeat_front_addr":"172.21.15.57:6813/3106842986","state":["exists","up"]},{"osd":5,"uuid":"68f7abd3-4292-41fa-90ce-4ac34ea2b964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6809","nonce":389294142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6811","nonce":389294142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6815","nonce":389294142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":389294142},{"type":"v1","addr":"172.21.15.107:6813","nonce":389294142}]},"public_addr":"172.21.15.107:6809/389294142","cluster_addr":"172.21.15.107:6811/389294142","heartbeat_back_addr":"172.21.15.107:6815/389294142","heartbeat_front_addr":"172.21.15.107:6813/389294142","state":["exists","up"]},{"osd":6,"uuid":"c0345dd0-71b7-436d-88f8-fe3d7cb69d8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6819","nonce":894624552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6821","nonce":894624552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6825","nonce":894624552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":894624552},{"type":"v1","addr":"172.21.15.49:6823","nonce":894624552}]},"public_addr":"172.21.15.49:6819/894624552","cluster_addr":"172.21.15.49:6821/894624552","heartbeat_back_addr":"172.21.15.49:6825/894624552","heartbeat_front_addr":"172.21.15.49:6823/894624552","state":["exists","up"]},{"osd":7,"uuid":"9abd81c7-dcc1-4e14-8ab7-9fa0746067ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6817","nonce":3126027900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6819","nonce":3126027900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6823","nonce":3126027900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":3126027900},{"type":"v1","addr":"172.21.15.57:6821","nonce":3126027900}]},"public_addr":"172.21.15.57:6817/3126027900","cluster_addr":"172.21.15.57:6819/3126027900","heartbeat_back_addr":"172.21.15.57:6823/3126027900","heartbeat_front_addr":"172.21.15.57:6821/3126027900","state":["exists","up"]},{"osd":8,"uuid":"80532119-5de8-45d2-9cb9-bd8a6194199b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6817","nonce":3620047229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6819","nonce":3620047229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6823","nonce":3620047229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3620047229},{"type":"v1","addr":"172.21.15.107:6821","nonce":3620047229}]},"public_addr":"172.21.15.107:6817/3620047229","cluster_addr":"172.21.15.107:6819/3620047229","heartbeat_back_addr":"172.21.15.107:6823/3620047229","heartbeat_front_addr":"172.21.15.107:6821/3620047229","state":["exists","up"]},{"osd":9,"uuid":"f0b5dcfa-9fd2-4a98-863b-197defa890af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6827","nonce":3627936526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6829","nonce":3627936526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6833","nonce":3627936526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3627936526},{"type":"v1","addr":"172.21.15.49:6831","nonce":3627936526}]},"public_addr":"172.21.15.49:6827/3627936526","cluster_addr":"172.21.15.49:6829/3627936526","heartbeat_back_addr":"172.21.15.49:6833/3627936526","heartbeat_front_addr":"172.21.15.49:6831/3627936526","state":["exists","up"]},{"osd":10,"uuid":"21a75846-adec-41b8-9e1d-e5c61ba30b12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6825","nonce":3013235811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6827","nonce":3013235811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6831","nonce":3013235811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":3013235811},{"type":"v1","addr":"172.21.15.57:6829","nonce":3013235811}]},"public_addr":"172.21.15.57:6825/3013235811","cluster_addr":"172.21.15.57:6827/3013235811","heartbeat_back_addr":"172.21.15.57:6831/3013235811","heartbeat_front_addr":"172.21.15.57:6829/3013235811","state":["exists","up"]},{"osd":11,"uuid":"eb963b63-2c61-4169-b8fe-31c7f5ec919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6825","nonce":4217534517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6827","nonce":4217534517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6831","nonce":4217534517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":4217534517},{"type":"v1","addr":"172.21.15.107:6829","nonce":4217534517}]},"public_addr":"172.21.15.107:6825/4217534517","cluster_addr":"172.21.15.107:6827/4217534517","heartbeat_back_addr":"172.21.15.107:6831/4217534517","heartbeat_front_addr":"172.21.15.107:6829/4217534517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:51:31.067312+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:51:56.088456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:52:20.539941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:52:45.055717+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:53:11.178438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:53:35.794217+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:00.775674+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:27.574752+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:54:52.177634+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:55:17.118854+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:55:44.217535+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:56:10.500970+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/525944311":"2024-06-03T23:49:55.151590+0000","172.21.15.49:0/1841969299":"2024-06-03T23:49:55.151590+0000","172.21.15.49:0/1880506696":"2024-06-03T23:49:55.151590+0000","172.21.15.49:6801/1206062338":"2024-06-03T23:49:55.151590+0000","172.21.15.49:6800/549058216":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/2112783954":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/2183920213":"2024-06-03T23:49:29.042670+0000","172.21.15.49:6801/549058216":"2024-06-03T23:49:29.042670+0000","172.21.15.49:0/3350970308":"2024-06-03T23:49:29.042670+0000","172.21.15.49:6800/1206062338":"2024-06-03T23:49:55.151590+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-03T00:06:12.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.474+0000 7f99c5703700 1 -- 172.21.15.49:0/1829611302 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f99a80a2c20 msgr2=0x7f99a80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:12.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.474+0000 7f99c5703700 1 --2- 172.21.15.49:0/1829611302 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f99a80a2c20 0x7f99a80a50e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f99b0009990 tx=0x7f99b0005960 comp rx=0 tx=0).stop 2024-06-03T00:06:12.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.474+0000 7f99c5703700 1 -- 172.21.15.49:0/1829611302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99c01020a0 msgr2=0x7f99c019ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:12.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.474+0000 7f99c5703700 1 --2- 172.21.15.49:0/1829611302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99c01020a0 0x7f99c019ed90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f99b400e7e0 tx=0x7f99b400eaf0 comp rx=0 tx=0).stop 2024-06-03T00:06:12.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.474+0000 7f99c5703700 1 -- 172.21.15.49:0/1829611302 shutdown_connections 2024-06-03T00:06:12.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.474+0000 7f99c5703700 1 --2- 172.21.15.49:0/1829611302 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f99a80a2c20 0x7f99a80a50e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:12.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.474+0000 7f99c5703700 1 --2- 172.21.15.49:0/1829611302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99c0106410 0x7f99c0198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:12.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.474+0000 7f99c5703700 1 --2- 172.21.15.49:0/1829611302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99c01016e0 0x7f99c019e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:12.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.474+0000 7f99c5703700 1 --2- 172.21.15.49:0/1829611302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99c01020a0 0x7f99c019ed90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:12.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.474+0000 7f99c5703700 1 -- 172.21.15.49:0/1829611302 >> 172.21.15.49:0/1829611302 conn(0x7f99c0077200 msgr2=0x7f99c006ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:06:12.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.474+0000 7f99c5703700 1 -- 172.21.15.49:0/1829611302 shutdown_connections 2024-06-03T00:06:12.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:12.475+0000 7f99c5703700 1 -- 172.21.15.49:0/1829611302 wait complete. 2024-06-03T00:06:13.331 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs fail cephfs 2024-06-03T00:06:13.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:13 smithi107 ceph-mon[37048]: pgmap v568: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-06-03T00:06:13.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:13 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/1829611302' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-03T00:06:13.358 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:13 smithi049 ceph-mon[32302]: pgmap v568: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-06-03T00:06:13.358 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:13 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/1829611302' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-03T00:06:13.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:13 smithi057 ceph-mon[36457]: pgmap v568: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-06-03T00:06:13.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:13 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/1829611302' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-03T00:06:13.589 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:06:14.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:14 smithi107 ceph-mon[37048]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:06:14.399 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:14 smithi049 ceph-mon[32302]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:06:14.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:14 smithi057 ceph-mon[36457]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-03T00:06:15.387 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:15 smithi049 ceph-mon[32302]: pgmap v569: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-06-03T00:06:15.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.396+0000 7f27943f0700 1 -- 172.21.15.49:0/795232451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f278c101d50 msgr2=0x7f278c10e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:15.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.396+0000 7f27943f0700 1 --2- 172.21.15.49:0/795232451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f278c101d50 0x7f278c10e240 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f278400b0a0 tx=0x7f278400b3b0 comp rx=0 tx=0).stop 2024-06-03T00:06:15.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.396+0000 7f27943f0700 1 -- 172.21.15.49:0/795232451 shutdown_connections 2024-06-03T00:06:15.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.396+0000 7f27943f0700 1 --2- 172.21.15.49:0/795232451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f278c101d50 0x7f278c10e240 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:15.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.396+0000 7f27943f0700 1 --2- 172.21.15.49:0/795232451 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f278c107400 0x7f278c1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:15.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.396+0000 7f27943f0700 1 --2- 172.21.15.49:0/795232451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f278c101390 0x7f278c101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:15.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.396+0000 7f27943f0700 1 -- 172.21.15.49:0/795232451 >> 172.21.15.49:0/795232451 conn(0x7f278c078340 msgr2=0x7f278c078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:06:15.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.396+0000 7f27943f0700 1 -- 172.21.15.49:0/795232451 shutdown_connections 2024-06-03T00:06:15.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.396+0000 7f27943f0700 1 -- 172.21.15.49:0/795232451 wait complete. 2024-06-03T00:06:15.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.397+0000 7f27943f0700 1 Processor -- start 2024-06-03T00:06:15.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.397+0000 7f27943f0700 1 -- start start 2024-06-03T00:06:15.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.397+0000 7f27943f0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f278c101390 0x7f278c199a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:06:15.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.397+0000 7f27943f0700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f278c101d50 0x7f278c199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:06:15.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.397+0000 7f27943f0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f278c107400 0x7f278c1a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:06:15.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.397+0000 7f27943f0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f278c111670 con 0x7f278c107400 2024-06-03T00:06:15.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.397+0000 7f27943f0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f278c1114f0 con 0x7f278c101390 2024-06-03T00:06:15.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.397+0000 7f27943f0700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f278c1117f0 con 0x7f278c101d50 2024-06-03T00:06:15.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.397+0000 7f279298d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f278c107400 0x7f278c1a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:06:15.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.397+0000 7f279298d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f278c107400 0x7f278c1a4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48498/0 (socket says 172.21.15.49:48498) 2024-06-03T00:06:15.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.397+0000 7f279298d700 1 -- 172.21.15.49:0/3028697113 learned_addr learned my addr 172.21.15.49:0/3028697113 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:06:15.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.398+0000 7f279198b700 1 --2- 172.21.15.49:0/3028697113 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f278c101d50 0x7f278c199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:06:15.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.398+0000 7f279218c700 1 --2- 172.21.15.49:0/3028697113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f278c101390 0x7f278c199a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:06:15.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.398+0000 7f279298d700 1 -- 172.21.15.49:0/3028697113 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f278c101d50 msgr2=0x7f278c199f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:15.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.398+0000 7f279298d700 1 --2- 172.21.15.49:0/3028697113 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f278c101d50 0x7f278c199f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:15.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.398+0000 7f279298d700 1 -- 172.21.15.49:0/3028697113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f278c101390 msgr2=0x7f278c199a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:15.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.398+0000 7f279298d700 1 --2- 172.21.15.49:0/3028697113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f278c101390 0x7f278c199a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:15.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.398+0000 7f279298d700 1 -- 172.21.15.49:0/3028697113 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f278c1a5010 con 0x7f278c107400 2024-06-03T00:06:15.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.398+0000 7f279298d700 1 --2- 172.21.15.49:0/3028697113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f278c107400 0x7f278c1a4ad0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f27840062a0 tx=0x7f2784004d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:06:15.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.398+0000 7f277f7fe700 1 -- 172.21.15.49:0/3028697113 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2784021070 con 0x7f278c107400 2024-06-03T00:06:15.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.398+0000 7f27943f0700 1 -- 172.21.15.49:0/3028697113 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f278c1a51e0 con 0x7f278c107400 2024-06-03T00:06:15.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.398+0000 7f277f7fe700 1 -- 172.21.15.49:0/3028697113 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2784003c00 con 0x7f278c107400 2024-06-03T00:06:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.398+0000 7f277f7fe700 1 -- 172.21.15.49:0/3028697113 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2784004880 con 0x7f278c107400 2024-06-03T00:06:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.398+0000 7f27943f0700 1 -- 172.21.15.49:0/3028697113 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f278c1a5630 con 0x7f278c107400 2024-06-03T00:06:15.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.399+0000 7f27943f0700 1 -- 172.21.15.49:0/3028697113 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f278c069180 con 0x7f278c107400 2024-06-03T00:06:15.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.401+0000 7f277f7fe700 1 -- 172.21.15.49:0/3028697113 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2784007980 con 0x7f278c107400 2024-06-03T00:06:15.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.401+0000 7f277f7fe700 1 --2- 172.21.15.49:0/3028697113 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f27780a2c20 0x7f27780a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:06:15.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.401+0000 7f279218c700 1 --2- 172.21.15.49:0/3028697113 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f27780a2c20 0x7f27780a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:06:15.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.401+0000 7f277f7fe700 1 -- 172.21.15.49:0/3028697113 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8240+0+0 (secure 0 0 0) 0x7f27840d03c0 con 0x7f278c107400 2024-06-03T00:06:15.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.402+0000 7f279218c700 1 --2- 172.21.15.49:0/3028697113 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f27780a2c20 0x7f27780a50e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2788005950 tx=0x7f278800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:06:15.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.405+0000 7f277f7fe700 1 -- 172.21.15.49:0/3028697113 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f278409d3b0 con 0x7f278c107400 2024-06-03T00:06:15.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:15 smithi057 ceph-mon[36457]: pgmap v569: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-06-03T00:06:15.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:15 smithi107 ceph-mon[37048]: pgmap v569: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-06-03T00:06:15.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.660+0000 7f27943f0700 1 -- 172.21.15.49:0/3028697113 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f278c02ddc0 con 0x7f278c107400 2024-06-03T00:06:15.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.662+0000 7f277f7fe700 1 -- 172.21.15.49:0/3028697113 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v42) ==== 161+0+0 (secure 0 0 0) 0x7f278409ccb0 con 0x7f278c107400 2024-06-03T00:06:15.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.666+0000 7f27943f0700 1 -- 172.21.15.49:0/3028697113 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f27780a2c20 msgr2=0x7f27780a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:15.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.666+0000 7f27943f0700 1 --2- 172.21.15.49:0/3028697113 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f27780a2c20 0x7f27780a50e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2788005950 tx=0x7f278800b410 comp rx=0 tx=0).stop 2024-06-03T00:06:15.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.666+0000 7f27943f0700 1 -- 172.21.15.49:0/3028697113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f278c107400 msgr2=0x7f278c1a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:15.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.666+0000 7f27943f0700 1 --2- 172.21.15.49:0/3028697113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f278c107400 0x7f278c1a4ad0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f27840062a0 tx=0x7f2784004d70 comp rx=0 tx=0).stop 2024-06-03T00:06:15.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.666+0000 7f27943f0700 1 -- 172.21.15.49:0/3028697113 shutdown_connections 2024-06-03T00:06:15.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.666+0000 7f27943f0700 1 --2- 172.21.15.49:0/3028697113 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f27780a2c20 0x7f27780a50e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:15.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.666+0000 7f27943f0700 1 --2- 172.21.15.49:0/3028697113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f278c107400 0x7f278c1a4ad0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:15.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.666+0000 7f27943f0700 1 --2- 172.21.15.49:0/3028697113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f278c101390 0x7f278c199a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:15.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.666+0000 7f27943f0700 1 --2- 172.21.15.49:0/3028697113 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f278c101d50 0x7f278c199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:15.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.666+0000 7f27943f0700 1 -- 172.21.15.49:0/3028697113 >> 172.21.15.49:0/3028697113 conn(0x7f278c078340 msgr2=0x7f278c0ffd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:06:15.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.666+0000 7f27943f0700 1 -- 172.21.15.49:0/3028697113 shutdown_connections 2024-06-03T00:06:15.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:15.667+0000 7f27943f0700 1 -- 172.21.15.49:0/3028697113 wait complete. 2024-06-03T00:06:15.667 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-06-03T00:06:15.961 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:15 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mon-a[32298]: 2024-06-03T00:06:15.660+0000 7f435b553700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-03T00:06:15.961 INFO:journalctl@ceph.mds.a.smithi049.stdout:Jun 03 00:06:15 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-a[71984]: ignoring --setuser ceph since I am not root 2024-06-03T00:06:15.962 INFO:journalctl@ceph.mds.a.smithi049.stdout:Jun 03 00:06:15 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-a[71984]: ignoring --setgroup ceph since I am not root 2024-06-03T00:06:15.962 INFO:journalctl@ceph.mds.a.smithi049.stdout:Jun 03 00:06:15 smithi049 ceph-mds[71988]: -- 172.21.15.49:0/2333279858 <== mon.0 v2:172.21.15.49:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5617f12e5a40 con 0x5617f12b9000 2024-06-03T00:06:15.962 INFO:journalctl@ceph.mds.a.smithi049.stdout:Jun 03 00:06:15 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-a[71984]: starting mds.a at 2024-06-03T00:06:15.962 INFO:journalctl@ceph.mds.g.smithi049.stdout:Jun 03 00:06:15 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-g[71567]: ignoring --setuser ceph since I am not root 2024-06-03T00:06:15.962 INFO:journalctl@ceph.mds.g.smithi049.stdout:Jun 03 00:06:15 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-g[71567]: ignoring --setgroup ceph since I am not root 2024-06-03T00:06:15.962 INFO:journalctl@ceph.mds.g.smithi049.stdout:Jun 03 00:06:15 smithi049 ceph-mds[71577]: -- 172.21.15.49:0/774716625 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561530aca4e0 con 0x561530aa1000 2024-06-03T00:06:15.962 INFO:journalctl@ceph.mds.g.smithi049.stdout:Jun 03 00:06:15 smithi049 ceph-mds[71577]: -- 172.21.15.49:0/774716625 <== mon.0 v2:172.21.15.49:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561530acda40 con 0x561530aa1000 2024-06-03T00:06:15.962 INFO:journalctl@ceph.mds.g.smithi049.stdout:Jun 03 00:06:15 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-g[71567]: starting mds.g at 2024-06-03T00:06:16.101 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:06:15 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: ignoring --setuser ceph since I am not root 2024-06-03T00:06:16.101 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:06:15 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: ignoring --setgroup ceph since I am not root 2024-06-03T00:06:16.101 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:06:15 smithi107 ceph-mds[67810]: -- 172.21.15.107:0/1629755574 <== mon.1 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556fbe7b5a40 con 0x556fbe789000 2024-06-03T00:06:16.101 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:06:15 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: starting mds.c at 2024-06-03T00:06:16.101 INFO:journalctl@ceph.mds.l.smithi107.stdout:Jun 03 00:06:15 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-l[67199]: ignoring --setuser ceph since I am not root 2024-06-03T00:06:16.101 INFO:journalctl@ceph.mds.l.smithi107.stdout:Jun 03 00:06:15 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-l[67199]: ignoring --setgroup ceph since I am not root 2024-06-03T00:06:16.101 INFO:journalctl@ceph.mds.l.smithi107.stdout:Jun 03 00:06:15 smithi107 ceph-mds[67203]: -- 172.21.15.107:0/3026812126 <== mon.1 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560243b67a40 con 0x560243b3ac00 2024-06-03T00:06:16.102 INFO:journalctl@ceph.mds.l.smithi107.stdout:Jun 03 00:06:15 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-l[67199]: starting mds.l at 2024-06-03T00:06:16.102 INFO:journalctl@ceph.mds.i.smithi107.stdout:Jun 03 00:06:15 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-i[68110]: ignoring --setuser ceph since I am not root 2024-06-03T00:06:16.102 INFO:journalctl@ceph.mds.i.smithi107.stdout:Jun 03 00:06:15 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-i[68110]: ignoring --setgroup ceph since I am not root 2024-06-03T00:06:16.102 INFO:journalctl@ceph.mds.i.smithi107.stdout:Jun 03 00:06:15 smithi107 ceph-mds[68114]: -- 172.21.15.107:0/2059473981 <== mon.1 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5580087d9a40 con 0x5580087ad000 2024-06-03T00:06:16.102 INFO:journalctl@ceph.mds.i.smithi107.stdout:Jun 03 00:06:15 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-i[68110]: starting mds.i at 2024-06-03T00:06:16.102 INFO:journalctl@ceph.mds.f.smithi107.stdout:Jun 03 00:06:15 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-f[67503]: ignoring --setuser ceph since I am not root 2024-06-03T00:06:16.103 INFO:journalctl@ceph.mds.f.smithi107.stdout:Jun 03 00:06:15 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-f[67503]: ignoring --setgroup ceph since I am not root 2024-06-03T00:06:16.103 INFO:journalctl@ceph.mds.f.smithi107.stdout:Jun 03 00:06:15 smithi107 ceph-mds[67507]: -- 172.21.15.107:0/864463903 <== mon.1 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558dea159a40 con 0x558dea12d000 2024-06-03T00:06:16.103 INFO:journalctl@ceph.mds.f.smithi107.stdout:Jun 03 00:06:15 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-f[67503]: starting mds.f at 2024-06-03T00:06:16.121 INFO:journalctl@ceph.mds.h.smithi057.stdout:Jun 03 00:06:15 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-h[66222]: ignoring --setuser ceph since I am not root 2024-06-03T00:06:16.121 INFO:journalctl@ceph.mds.h.smithi057.stdout:Jun 03 00:06:15 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-h[66222]: ignoring --setgroup ceph since I am not root 2024-06-03T00:06:16.121 INFO:journalctl@ceph.mds.h.smithi057.stdout:Jun 03 00:06:15 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-h[66222]: starting mds.h at 2024-06-03T00:06:16.122 INFO:journalctl@ceph.mds.k.smithi057.stdout:Jun 03 00:06:15 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-k[65607]: ignoring --setuser ceph since I am not root 2024-06-03T00:06:16.122 INFO:journalctl@ceph.mds.k.smithi057.stdout:Jun 03 00:06:15 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-k[65607]: ignoring --setgroup ceph since I am not root 2024-06-03T00:06:16.122 INFO:journalctl@ceph.mds.k.smithi057.stdout:Jun 03 00:06:15 smithi057 ceph-mds[65611]: -- 172.21.15.57:0/2069798547 <== mon.0 v2:172.21.15.49:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fd875f7a40 con 0x55fd875cac00 2024-06-03T00:06:16.122 INFO:journalctl@ceph.mds.k.smithi057.stdout:Jun 03 00:06:15 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-k[65607]: starting mds.k at 2024-06-03T00:06:16.122 INFO:journalctl@ceph.mds.e.smithi057.stdout:Jun 03 00:06:15 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-e[65920]: ignoring --setuser ceph since I am not root 2024-06-03T00:06:16.122 INFO:journalctl@ceph.mds.e.smithi057.stdout:Jun 03 00:06:15 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-e[65920]: ignoring --setgroup ceph since I am not root 2024-06-03T00:06:16.122 INFO:journalctl@ceph.mds.e.smithi057.stdout:Jun 03 00:06:15 smithi057 ceph-mds[65924]: -- 172.21.15.57:0/3634938612 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x562938cce4e0 con 0x562938ca4800 2024-06-03T00:06:16.123 INFO:journalctl@ceph.mds.e.smithi057.stdout:Jun 03 00:06:15 smithi057 ceph-mds[65924]: -- 172.21.15.57:0/3634938612 <== mon.0 v2:172.21.15.49:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562938cd1a40 con 0x562938ca4800 2024-06-03T00:06:16.123 INFO:journalctl@ceph.mds.e.smithi057.stdout:Jun 03 00:06:15 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-e[65920]: starting mds.e at 2024-06-03T00:06:16.123 INFO:journalctl@ceph.mds.b.smithi057.stdout:Jun 03 00:06:15 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-b[66528]: ignoring --setuser ceph since I am not root 2024-06-03T00:06:16.123 INFO:journalctl@ceph.mds.b.smithi057.stdout:Jun 03 00:06:15 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-b[66528]: ignoring --setgroup ceph since I am not root 2024-06-03T00:06:16.123 INFO:journalctl@ceph.mds.b.smithi057.stdout:Jun 03 00:06:15 smithi057 ceph-mds[66532]: -- 172.21.15.57:0/4283207922 <== mon.0 v2:172.21.15.49:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562d5bdbba40 con 0x562d5bd8ec00 2024-06-03T00:06:16.123 INFO:journalctl@ceph.mds.b.smithi057.stdout:Jun 03 00:06:15 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-b[66528]: starting mds.b at 2024-06-03T00:06:16.393 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:16 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3028697113' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-03T00:06:16.393 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:16 smithi049 ceph-mon[32302]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-06-03T00:06:16.393 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:16 smithi049 ceph-mon[32302]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-03T00:06:16.394 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:16 smithi049 ceph-mon[32302]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2024-06-03T00:06:16.394 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:16 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/3028697113' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-06-03T00:06:16.394 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:16 smithi049 ceph-mon[32302]: osdmap e91: 12 total, 12 up, 12 in 2024-06-03T00:06:16.394 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:16 smithi049 ceph-mon[32302]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-06-03T00:06:16.422 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-06-03T00:06:16.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:16 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/3028697113' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-03T00:06:16.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:16 smithi057 ceph-mon[36457]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-06-03T00:06:16.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:16 smithi057 ceph-mon[36457]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-03T00:06:16.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:16 smithi057 ceph-mon[36457]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2024-06-03T00:06:16.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:16 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/3028697113' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-06-03T00:06:16.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:16 smithi057 ceph-mon[36457]: osdmap e91: 12 total, 12 up, 12 in 2024-06-03T00:06:16.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:16 smithi057 ceph-mon[36457]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-06-03T00:06:16.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:16 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/3028697113' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-03T00:06:16.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:16 smithi107 ceph-mon[37048]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-06-03T00:06:16.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:16 smithi107 ceph-mon[37048]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-03T00:06:16.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:16 smithi107 ceph-mon[37048]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2024-06-03T00:06:16.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:16 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/3028697113' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-06-03T00:06:16.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:16 smithi107 ceph-mon[37048]: osdmap e91: 12 total, 12 up, 12 in 2024-06-03T00:06:16.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:16 smithi107 ceph-mon[37048]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-06-03T00:06:16.714 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:06:17.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:17 smithi057 ceph-mon[36457]: pgmap v570: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-06-03T00:06:17.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:17 smithi057 ceph-mon[36457]: mds.? [v2:172.21.15.49:6838/2080470679,v1:172.21.15.49:6839/2080470679] up:boot 2024-06-03T00:06:17.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:17 smithi057 ceph-mon[36457]: mds.? [v2:172.21.15.107:6832/3600375500,v1:172.21.15.107:6834/3600375500] up:boot 2024-06-03T00:06:17.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:17 smithi057 ceph-mon[36457]: mds.? [v2:172.21.15.107:6833/422379181,v1:172.21.15.107:6835/422379181] up:boot 2024-06-03T00:06:17.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:17 smithi057 ceph-mon[36457]: mds.? [v2:172.21.15.57:6832/3954470017,v1:172.21.15.57:6834/3954470017] up:boot 2024-06-03T00:06:17.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:17 smithi057 ceph-mon[36457]: mds.? [v2:172.21.15.57:6833/1220235058,v1:172.21.15.57:6835/1220235058] up:boot 2024-06-03T00:06:17.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:17 smithi057 ceph-mon[36457]: mds.? [v2:172.21.15.49:6840/2929298132,v1:172.21.15.49:6841/2929298132] up:boot 2024-06-03T00:06:17.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:17 smithi057 ceph-mon[36457]: mds.? [v2:172.21.15.107:6836/2435268561,v1:172.21.15.107:6837/2435268561] up:boot 2024-06-03T00:06:17.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:17 smithi057 ceph-mon[36457]: mds.? [v2:172.21.15.107:6838/75952419,v1:172.21.15.107:6839/75952419] up:boot 2024-06-03T00:06:17.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:17 smithi057 ceph-mon[36457]: mds.? [v2:172.21.15.57:6836/968761423,v1:172.21.15.57:6837/968761423] up:boot 2024-06-03T00:06:17.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:17 smithi057 ceph-mon[36457]: mds.? [v2:172.21.15.57:6838/209886350,v1:172.21.15.57:6839/209886350] up:boot 2024-06-03T00:06:17.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:17 smithi057 ceph-mon[36457]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-06-03T00:06:17.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:17 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-03T00:06:17.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:17 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-03T00:06:17.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:17 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-03T00:06:17.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:17 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-03T00:06:17.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:17 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-03T00:06:17.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:17 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-03T00:06:17.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:17 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-03T00:06:17.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:17 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-03T00:06:17.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:17 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-03T00:06:17.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:17 smithi057 ceph-mon[36457]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-03T00:06:17.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:17 smithi049 ceph-mon[32302]: pgmap v570: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-06-03T00:06:17.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:17 smithi049 ceph-mon[32302]: mds.? [v2:172.21.15.49:6838/2080470679,v1:172.21.15.49:6839/2080470679] up:boot 2024-06-03T00:06:17.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:17 smithi049 ceph-mon[32302]: mds.? [v2:172.21.15.107:6832/3600375500,v1:172.21.15.107:6834/3600375500] up:boot 2024-06-03T00:06:17.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:17 smithi049 ceph-mon[32302]: mds.? [v2:172.21.15.107:6833/422379181,v1:172.21.15.107:6835/422379181] up:boot 2024-06-03T00:06:17.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:17 smithi049 ceph-mon[32302]: mds.? [v2:172.21.15.57:6832/3954470017,v1:172.21.15.57:6834/3954470017] up:boot 2024-06-03T00:06:17.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:17 smithi049 ceph-mon[32302]: mds.? [v2:172.21.15.57:6833/1220235058,v1:172.21.15.57:6835/1220235058] up:boot 2024-06-03T00:06:17.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:17 smithi049 ceph-mon[32302]: mds.? [v2:172.21.15.49:6840/2929298132,v1:172.21.15.49:6841/2929298132] up:boot 2024-06-03T00:06:17.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:17 smithi049 ceph-mon[32302]: mds.? [v2:172.21.15.107:6836/2435268561,v1:172.21.15.107:6837/2435268561] up:boot 2024-06-03T00:06:17.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:17 smithi049 ceph-mon[32302]: mds.? [v2:172.21.15.107:6838/75952419,v1:172.21.15.107:6839/75952419] up:boot 2024-06-03T00:06:17.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:17 smithi049 ceph-mon[32302]: mds.? [v2:172.21.15.57:6836/968761423,v1:172.21.15.57:6837/968761423] up:boot 2024-06-03T00:06:17.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:17 smithi049 ceph-mon[32302]: mds.? [v2:172.21.15.57:6838/209886350,v1:172.21.15.57:6839/209886350] up:boot 2024-06-03T00:06:17.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:17 smithi049 ceph-mon[32302]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-06-03T00:06:17.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:17 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-03T00:06:17.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:17 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-03T00:06:17.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:17 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-03T00:06:17.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:17 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-03T00:06:17.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:17 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-03T00:06:17.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:17 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-03T00:06:17.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:17 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-03T00:06:17.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:17 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-03T00:06:17.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:17 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-03T00:06:17.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:17 smithi049 ceph-mon[32302]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-03T00:06:17.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:17 smithi107 ceph-mon[37048]: pgmap v570: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-06-03T00:06:17.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:17 smithi107 ceph-mon[37048]: mds.? [v2:172.21.15.49:6838/2080470679,v1:172.21.15.49:6839/2080470679] up:boot 2024-06-03T00:06:17.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:17 smithi107 ceph-mon[37048]: mds.? [v2:172.21.15.107:6832/3600375500,v1:172.21.15.107:6834/3600375500] up:boot 2024-06-03T00:06:17.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:17 smithi107 ceph-mon[37048]: mds.? [v2:172.21.15.107:6833/422379181,v1:172.21.15.107:6835/422379181] up:boot 2024-06-03T00:06:17.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:17 smithi107 ceph-mon[37048]: mds.? [v2:172.21.15.57:6832/3954470017,v1:172.21.15.57:6834/3954470017] up:boot 2024-06-03T00:06:17.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:17 smithi107 ceph-mon[37048]: mds.? [v2:172.21.15.57:6833/1220235058,v1:172.21.15.57:6835/1220235058] up:boot 2024-06-03T00:06:17.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:17 smithi107 ceph-mon[37048]: mds.? [v2:172.21.15.49:6840/2929298132,v1:172.21.15.49:6841/2929298132] up:boot 2024-06-03T00:06:17.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:17 smithi107 ceph-mon[37048]: mds.? [v2:172.21.15.107:6836/2435268561,v1:172.21.15.107:6837/2435268561] up:boot 2024-06-03T00:06:17.602 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:17 smithi107 ceph-mon[37048]: mds.? [v2:172.21.15.107:6838/75952419,v1:172.21.15.107:6839/75952419] up:boot 2024-06-03T00:06:17.602 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:17 smithi107 ceph-mon[37048]: mds.? [v2:172.21.15.57:6836/968761423,v1:172.21.15.57:6837/968761423] up:boot 2024-06-03T00:06:17.602 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:17 smithi107 ceph-mon[37048]: mds.? [v2:172.21.15.57:6838/209886350,v1:172.21.15.57:6839/209886350] up:boot 2024-06-03T00:06:17.602 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:17 smithi107 ceph-mon[37048]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-06-03T00:06:17.602 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:17 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-03T00:06:17.602 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:17 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-03T00:06:17.602 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:17 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-03T00:06:17.602 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:17 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-03T00:06:17.602 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:17 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-03T00:06:17.602 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:17 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-03T00:06:17.602 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:17 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-03T00:06:17.602 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:17 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-03T00:06:17.603 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:17 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-03T00:06:17.603 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:17 smithi107 ceph-mon[37048]: from='mgr.14152 172.21.15.49:0/3359296453' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-03T00:06:18.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.471+0000 7fe816de6700 1 -- 172.21.15.49:0/2959831741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe81006abc0 msgr2=0x7fe81006b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:18.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.471+0000 7fe816de6700 1 --2- 172.21.15.49:0/2959831741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe81006abc0 0x7fe81006b040 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fe7f80099c0 tx=0x7fe7f8009cd0 comp rx=0 tx=0).stop 2024-06-03T00:06:18.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.471+0000 7fe816de6700 1 -- 172.21.15.49:0/2959831741 shutdown_connections 2024-06-03T00:06:18.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.471+0000 7fe816de6700 1 --2- 172.21.15.49:0/2959831741 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe81006b580 0x7fe81010f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:18.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.471+0000 7fe816de6700 1 --2- 172.21.15.49:0/2959831741 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8101085a0 0x7fe810108980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:18.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.471+0000 7fe816de6700 1 --2- 172.21.15.49:0/2959831741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe81006abc0 0x7fe81006b040 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:18.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.471+0000 7fe816de6700 1 -- 172.21.15.49:0/2959831741 >> 172.21.15.49:0/2959831741 conn(0x7fe810077200 msgr2=0x7fe810077610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:06:18.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.471+0000 7fe816de6700 1 -- 172.21.15.49:0/2959831741 shutdown_connections 2024-06-03T00:06:18.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.471+0000 7fe816de6700 1 -- 172.21.15.49:0/2959831741 wait complete. 2024-06-03T00:06:18.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.472+0000 7fe816de6700 1 Processor -- start 2024-06-03T00:06:18.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.472+0000 7fe816de6700 1 -- start start 2024-06-03T00:06:18.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.472+0000 7fe816de6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe81006abc0 0x7fe8101017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:06:18.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.472+0000 7fe816de6700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe81006b580 0x7fe810101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:06:18.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.472+0000 7fe816de6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8101085a0 0x7fe810102230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:06:18.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.472+0000 7fe816de6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe8101127f0 con 0x7fe8101085a0 2024-06-03T00:06:18.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.472+0000 7fe816de6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe810112670 con 0x7fe81006abc0 2024-06-03T00:06:18.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.472+0000 7fe816de6700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe810112970 con 0x7fe81006b580 2024-06-03T00:06:18.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.472+0000 7fe815383700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8101085a0 0x7fe810102230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:06:18.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.472+0000 7fe815383700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8101085a0 0x7fe810102230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48542/0 (socket says 172.21.15.49:48542) 2024-06-03T00:06:18.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.472+0000 7fe815383700 1 -- 172.21.15.49:0/2221733278 learned_addr learned my addr 172.21.15.49:0/2221733278 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:06:18.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.472+0000 7fe814b82700 1 --2- 172.21.15.49:0/2221733278 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe81006abc0 0x7fe8101017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:06:18.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.472+0000 7fe80ffff700 1 --2- 172.21.15.49:0/2221733278 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe81006b580 0x7fe810101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:06:18.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.473+0000 7fe815383700 1 -- 172.21.15.49:0/2221733278 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe81006b580 msgr2=0x7fe810101cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:18.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.473+0000 7fe815383700 1 --2- 172.21.15.49:0/2221733278 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe81006b580 0x7fe810101cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:18.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.473+0000 7fe815383700 1 -- 172.21.15.49:0/2221733278 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe81006abc0 msgr2=0x7fe8101017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:18.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.473+0000 7fe815383700 1 --2- 172.21.15.49:0/2221733278 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe81006abc0 0x7fe8101017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:18.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.473+0000 7fe815383700 1 -- 172.21.15.49:0/2221733278 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8101a7190 con 0x7fe8101085a0 2024-06-03T00:06:18.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.473+0000 7fe815383700 1 --2- 172.21.15.49:0/2221733278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8101085a0 0x7fe810102230 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fe808007ee0 tx=0x7fe80800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:06:18.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.473+0000 7fe80dffb700 1 -- 172.21.15.49:0/2221733278 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe808004bb0 con 0x7fe8101085a0 2024-06-03T00:06:18.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.473+0000 7fe80dffb700 1 -- 172.21.15.49:0/2221733278 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe808004d50 con 0x7fe8101085a0 2024-06-03T00:06:18.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.473+0000 7fe816de6700 1 -- 172.21.15.49:0/2221733278 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8101a7480 con 0x7fe8101085a0 2024-06-03T00:06:18.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.473+0000 7fe80dffb700 1 -- 172.21.15.49:0/2221733278 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe808005960 con 0x7fe8101085a0 2024-06-03T00:06:18.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.473+0000 7fe816de6700 1 -- 172.21.15.49:0/2221733278 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8101a79e0 con 0x7fe8101085a0 2024-06-03T00:06:18.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.474+0000 7fe816de6700 1 -- 172.21.15.49:0/2221733278 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe810103bf0 con 0x7fe8101085a0 2024-06-03T00:06:18.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.475+0000 7fe80dffb700 1 -- 172.21.15.49:0/2221733278 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe80801a020 con 0x7fe8101085a0 2024-06-03T00:06:18.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.476+0000 7fe80dffb700 1 --2- 172.21.15.49:0/2221733278 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe7fc0a2ca0 0x7fe7fc0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:06:18.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.476+0000 7fe80dffb700 1 -- 172.21.15.49:0/2221733278 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8670+0+0 (secure 0 0 0) 0x7fe8080ce870 con 0x7fe8101085a0 2024-06-03T00:06:18.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.476+0000 7fe814b82700 1 --2- 172.21.15.49:0/2221733278 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe7fc0a2ca0 0x7fe7fc0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:06:18.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.477+0000 7fe814b82700 1 --2- 172.21.15.49:0/2221733278 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe7fc0a2ca0 0x7fe7fc0a5160 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe800005950 tx=0x7fe80000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:06:18.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.481+0000 7fe80dffb700 1 -- 172.21.15.49:0/2221733278 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe808010070 con 0x7fe8101085a0 2024-06-03T00:06:18.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:18.735+0000 7fe816de6700 1 -- 172.21.15.49:0/2221733278 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fe81002dca0 con 0x7fe8101085a0 2024-06-03T00:06:19.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:19.124+0000 7fe80dffb700 1 -- 172.21.15.49:0/2221733278 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v44) ==== 104+0+0 (secure 0 0 0) 0x7fe80809b620 con 0x7fe8101085a0 2024-06-03T00:06:19.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:19.126+0000 7fe816de6700 1 -- 172.21.15.49:0/2221733278 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe7fc0a2ca0 msgr2=0x7fe7fc0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:19.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:19.126+0000 7fe816de6700 1 --2- 172.21.15.49:0/2221733278 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe7fc0a2ca0 0x7fe7fc0a5160 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe800005950 tx=0x7fe80000b410 comp rx=0 tx=0).stop 2024-06-03T00:06:19.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:19.126+0000 7fe816de6700 1 -- 172.21.15.49:0/2221733278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8101085a0 msgr2=0x7fe810102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:19.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:19.126+0000 7fe816de6700 1 --2- 172.21.15.49:0/2221733278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8101085a0 0x7fe810102230 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fe808007ee0 tx=0x7fe80800d3b0 comp rx=0 tx=0).stop 2024-06-03T00:06:19.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:19.126+0000 7fe816de6700 1 -- 172.21.15.49:0/2221733278 shutdown_connections 2024-06-03T00:06:19.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:19.126+0000 7fe816de6700 1 --2- 172.21.15.49:0/2221733278 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe7fc0a2ca0 0x7fe7fc0a5160 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:19.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:19.126+0000 7fe816de6700 1 --2- 172.21.15.49:0/2221733278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe8101085a0 0x7fe810102230 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:19.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:19.126+0000 7fe816de6700 1 --2- 172.21.15.49:0/2221733278 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe81006abc0 0x7fe8101017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:19.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:19.126+0000 7fe816de6700 1 --2- 172.21.15.49:0/2221733278 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe81006b580 0x7fe810101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:19.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:19.126+0000 7fe816de6700 1 -- 172.21.15.49:0/2221733278 >> 172.21.15.49:0/2221733278 conn(0x7fe810077200 msgr2=0x7fe8101002b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:06:19.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:19.126+0000 7fe816de6700 1 -- 172.21.15.49:0/2221733278 shutdown_connections 2024-06-03T00:06:19.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:19.126+0000 7fe816de6700 1 -- 172.21.15.49:0/2221733278 wait complete. 2024-06-03T00:06:19.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:19 smithi057 ceph-mon[36457]: pgmap v572: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 307 B/s wr, 10 op/s 2024-06-03T00:06:19.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:19 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/2221733278' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-03T00:06:19.451 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:19 smithi049 ceph-mon[32302]: pgmap v572: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 307 B/s wr, 10 op/s 2024-06-03T00:06:19.451 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:19 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/2221733278' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-03T00:06:19.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:19 smithi107 ceph-mon[37048]: pgmap v572: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 307 B/s wr, 10 op/s 2024-06-03T00:06:19.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:19 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/2221733278' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-03T00:06:19.838 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-06-03T00:06:20.097 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:06:20.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:20 smithi057 ceph-mon[36457]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-06-03T00:06:20.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:20 smithi057 ceph-mon[36457]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-06-03T00:06:20.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:20 smithi057 ceph-mon[36457]: Cluster is now healthy 2024-06-03T00:06:20.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:20 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/2221733278' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-06-03T00:06:20.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:20 smithi057 ceph-mon[36457]: fsmap 12 up:standby 2024-06-03T00:06:20.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:20 smithi049 ceph-mon[32302]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-06-03T00:06:20.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:20 smithi049 ceph-mon[32302]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-06-03T00:06:20.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:20 smithi049 ceph-mon[32302]: Cluster is now healthy 2024-06-03T00:06:20.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:20 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/2221733278' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-06-03T00:06:20.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:20 smithi049 ceph-mon[32302]: fsmap 12 up:standby 2024-06-03T00:06:20.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:20 smithi107 ceph-mon[37048]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-06-03T00:06:20.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:20 smithi107 ceph-mon[37048]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-06-03T00:06:20.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:20 smithi107 ceph-mon[37048]: Cluster is now healthy 2024-06-03T00:06:20.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:20 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/2221733278' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-06-03T00:06:20.601 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:20 smithi107 ceph-mon[37048]: fsmap 12 up:standby 2024-06-03T00:06:21.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:21 smithi057 ceph-mon[36457]: pgmap v573: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-06-03T00:06:21.450 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:21 smithi049 ceph-mon[32302]: pgmap v573: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-06-03T00:06:21.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:21 smithi107 ceph-mon[37048]: pgmap v573: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-06-03T00:06:21.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.834+0000 7f06fa23c700 1 -- 172.21.15.49:0/3870628682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06f4102770 msgr2=0x7f06f4102b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:21.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.834+0000 7f06fa23c700 1 --2- 172.21.15.49:0/3870628682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06f4102770 0x7f06f4102b50 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f06e40099c0 tx=0x7f06e4009cd0 comp rx=0 tx=0).stop 2024-06-03T00:06:21.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.834+0000 7f06fa23c700 1 -- 172.21.15.49:0/3870628682 shutdown_connections 2024-06-03T00:06:21.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.834+0000 7f06fa23c700 1 --2- 172.21.15.49:0/3870628682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06f4107760 0x7f06f410f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:21.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.834+0000 7f06fa23c700 1 --2- 172.21.15.49:0/3870628682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06f4102770 0x7f06f4102b50 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:21.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.834+0000 7f06fa23c700 1 --2- 172.21.15.49:0/3870628682 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06f4103120 0x7f06f4107080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:21.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.834+0000 7f06fa23c700 1 -- 172.21.15.49:0/3870628682 >> 172.21.15.49:0/3870628682 conn(0x7f06f4079560 msgr2=0x7f06f4079970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:06:21.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.834+0000 7f06fa23c700 1 -- 172.21.15.49:0/3870628682 shutdown_connections 2024-06-03T00:06:21.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.834+0000 7f06fa23c700 1 -- 172.21.15.49:0/3870628682 wait complete. 2024-06-03T00:06:21.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.835+0000 7f06fa23c700 1 Processor -- start 2024-06-03T00:06:21.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.835+0000 7f06fa23c700 1 -- start start 2024-06-03T00:06:21.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.836+0000 7f06fa23c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06f4102770 0x7f06f419e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:06:21.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.836+0000 7f06fa23c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06f4103120 0x7f06f419ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:06:21.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.836+0000 7f06fa23c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06f4107760 0x7f06f4198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:06:21.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.836+0000 7f06fa23c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f06f41127b0 con 0x7f06f4107760 2024-06-03T00:06:21.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.836+0000 7f06fa23c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f06f4112630 con 0x7f06f4102770 2024-06-03T00:06:21.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.836+0000 7f06fa23c700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f06f4112930 con 0x7f06f4103120 2024-06-03T00:06:21.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.836+0000 7f06f3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06f4107760 0x7f06f4198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:06:21.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.836+0000 7f06f3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06f4107760 0x7f06f4198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48562/0 (socket says 172.21.15.49:48562) 2024-06-03T00:06:21.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.836+0000 7f06f3fff700 1 -- 172.21.15.49:0/2299331259 learned_addr learned my addr 172.21.15.49:0/2299331259 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:06:21.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.836+0000 7f06f37fe700 1 --2- 172.21.15.49:0/2299331259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06f4102770 0x7f06f419e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:06:21.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.836+0000 7f06f2ffd700 1 --2- 172.21.15.49:0/2299331259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06f4103120 0x7f06f419ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:06:21.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.836+0000 7f06f3fff700 1 -- 172.21.15.49:0/2299331259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06f4103120 msgr2=0x7f06f419ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:21.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.836+0000 7f06f3fff700 1 --2- 172.21.15.49:0/2299331259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06f4103120 0x7f06f419ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:21.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.836+0000 7f06f3fff700 1 -- 172.21.15.49:0/2299331259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06f4102770 msgr2=0x7f06f419e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:21.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.836+0000 7f06f3fff700 1 --2- 172.21.15.49:0/2299331259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06f4102770 0x7f06f419e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:21.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.836+0000 7f06f3fff700 1 -- 172.21.15.49:0/2299331259 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f4199190 con 0x7f06f4107760 2024-06-03T00:06:21.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.836+0000 7f06f2ffd700 1 --2- 172.21.15.49:0/2299331259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06f4103120 0x7f06f419ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:06:21.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.836+0000 7f06f3fff700 1 --2- 172.21.15.49:0/2299331259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06f4107760 0x7f06f4198a30 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f06ec007ee0 tx=0x7f06ec00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:06:21.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.837+0000 7f06f0ff9700 1 -- 172.21.15.49:0/2299331259 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec00dbd0 con 0x7f06f4107760 2024-06-03T00:06:21.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.837+0000 7f06fa23c700 1 -- 172.21.15.49:0/2299331259 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f4199480 con 0x7f06f4107760 2024-06-03T00:06:21.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.837+0000 7f06f0ff9700 1 -- 172.21.15.49:0/2299331259 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06ec00dd70 con 0x7f06f4107760 2024-06-03T00:06:21.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.837+0000 7f06f0ff9700 1 -- 172.21.15.49:0/2299331259 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec005a60 con 0x7f06f4107760 2024-06-03T00:06:21.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.837+0000 7f06fa23c700 1 -- 172.21.15.49:0/2299331259 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f41a56f0 con 0x7f06f4107760 2024-06-03T00:06:21.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.838+0000 7f06fa23c700 1 -- 172.21.15.49:0/2299331259 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06f4069180 con 0x7f06f4107760 2024-06-03T00:06:21.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.840+0000 7f06f0ff9700 1 -- 172.21.15.49:0/2299331259 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f06ec01a020 con 0x7f06f4107760 2024-06-03T00:06:21.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.840+0000 7f06f0ff9700 1 --2- 172.21.15.49:0/2299331259 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f06dc0a2c20 0x7f06dc0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:06:21.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.840+0000 7f06f37fe700 1 --2- 172.21.15.49:0/2299331259 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f06dc0a2c20 0x7f06dc0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:06:21.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.840+0000 7f06f0ff9700 1 -- 172.21.15.49:0/2299331259 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8670+0+0 (secure 0 0 0) 0x7f06ec0cef10 con 0x7f06f4107760 2024-06-03T00:06:21.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.841+0000 7f06f37fe700 1 --2- 172.21.15.49:0/2299331259 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f06dc0a2c20 0x7f06dc0a50e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f06e4000c00 tx=0x7f06e4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:06:21.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:21.844+0000 7f06f0ff9700 1 -- 172.21.15.49:0/2299331259 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f06ec010070 con 0x7f06f4107760 2024-06-03T00:06:22.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:22.047+0000 7f06fa23c700 1 -- 172.21.15.49:0/2299331259 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f06f402dca0 con 0x7f06f4107760 2024-06-03T00:06:22.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:22.152+0000 7f06f0ff9700 1 -- 172.21.15.49:0/2299331259 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v92) ==== 181+0+0 (secure 0 0 0) 0x7f06ec09bcc0 con 0x7f06f4107760 2024-06-03T00:06:22.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:22.156+0000 7f06fa23c700 1 -- 172.21.15.49:0/2299331259 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f06dc0a2c20 msgr2=0x7f06dc0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:22.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:22.156+0000 7f06fa23c700 1 --2- 172.21.15.49:0/2299331259 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f06dc0a2c20 0x7f06dc0a50e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f06e4000c00 tx=0x7f06e4005fb0 comp rx=0 tx=0).stop 2024-06-03T00:06:22.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:22.156+0000 7f06fa23c700 1 -- 172.21.15.49:0/2299331259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06f4107760 msgr2=0x7f06f4198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:22.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:22.156+0000 7f06fa23c700 1 --2- 172.21.15.49:0/2299331259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06f4107760 0x7f06f4198a30 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f06ec007ee0 tx=0x7f06ec00d3b0 comp rx=0 tx=0).stop 2024-06-03T00:06:22.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:22.156+0000 7f06fa23c700 1 -- 172.21.15.49:0/2299331259 shutdown_connections 2024-06-03T00:06:22.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:22.156+0000 7f06fa23c700 1 --2- 172.21.15.49:0/2299331259 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7f06dc0a2c20 0x7f06dc0a50e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:22.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:22.156+0000 7f06fa23c700 1 --2- 172.21.15.49:0/2299331259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06f4107760 0x7f06f4198a30 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:22.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:22.156+0000 7f06fa23c700 1 --2- 172.21.15.49:0/2299331259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06f4102770 0x7f06f419e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:22.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:22.156+0000 7f06fa23c700 1 --2- 172.21.15.49:0/2299331259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f06f4103120 0x7f06f419ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:22.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:22.156+0000 7f06fa23c700 1 -- 172.21.15.49:0/2299331259 >> 172.21.15.49:0/2299331259 conn(0x7f06f4079560 msgr2=0x7f06f4100560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:06:22.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:22.157+0000 7f06fa23c700 1 -- 172.21.15.49:0/2299331259 shutdown_connections 2024-06-03T00:06:22.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:22.157+0000 7f06fa23c700 1 -- 172.21.15.49:0/2299331259 wait complete. 2024-06-03T00:06:22.159 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2024-06-03T00:06:22.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:22 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/2299331259' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-03T00:06:22.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:22 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/2299331259' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-03T00:06:22.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:22 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/2299331259' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-03T00:06:22.865 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 890dd222-213a-11ef-bc9b-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-06-03T00:06:23.115 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/mon.a/config 2024-06-03T00:06:23.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:23 smithi107 ceph-mon[37048]: pgmap v574: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-03T00:06:23.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:23 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/2299331259' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-06-03T00:06:23.351 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:23 smithi107 ceph-mon[37048]: osdmap e92: 12 total, 12 up, 12 in 2024-06-03T00:06:23.434 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:23 smithi049 ceph-mon[32302]: pgmap v574: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-03T00:06:23.435 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:23 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/2299331259' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-06-03T00:06:23.435 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:23 smithi049 ceph-mon[32302]: osdmap e92: 12 total, 12 up, 12 in 2024-06-03T00:06:23.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:23 smithi057 ceph-mon[36457]: pgmap v574: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-03T00:06:23.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:23 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/2299331259' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-06-03T00:06:23.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:23 smithi057 ceph-mon[36457]: osdmap e92: 12 total, 12 up, 12 in 2024-06-03T00:06:24.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.906+0000 7fe0fae8f700 1 -- 172.21.15.49:0/2091820621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0f4101370 msgr2=0x7fe0f41017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:24.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.906+0000 7fe0fae8f700 1 --2- 172.21.15.49:0/2091820621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0f4101370 0x7fe0f41017f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc009990 tx=0x7fe0dc009ca0 comp rx=0 tx=0).stop 2024-06-03T00:06:24.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.906+0000 7fe0fae8f700 1 -- 172.21.15.49:0/2091820621 shutdown_connections 2024-06-03T00:06:24.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.906+0000 7fe0fae8f700 1 --2- 172.21.15.49:0/2091820621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0f4101d30 0x7fe0f410e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:24.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.906+0000 7fe0fae8f700 1 --2- 172.21.15.49:0/2091820621 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0f4107420 0x7fe0f4107800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:24.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.906+0000 7fe0fae8f700 1 --2- 172.21.15.49:0/2091820621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0f4101370 0x7fe0f41017f0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:24.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.906+0000 7fe0fae8f700 1 -- 172.21.15.49:0/2091820621 >> 172.21.15.49:0/2091820621 conn(0x7fe0f4078340 msgr2=0x7fe0f4078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:06:24.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.906+0000 7fe0fae8f700 1 -- 172.21.15.49:0/2091820621 shutdown_connections 2024-06-03T00:06:24.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.906+0000 7fe0fae8f700 1 -- 172.21.15.49:0/2091820621 wait complete. 2024-06-03T00:06:24.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.906+0000 7fe0fae8f700 1 Processor -- start 2024-06-03T00:06:24.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.907+0000 7fe0fae8f700 1 -- start start 2024-06-03T00:06:24.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.907+0000 7fe0fae8f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0f4101370 0x7fe0f419d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:06:24.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.907+0000 7fe0fae8f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0f4101d30 0x7fe0f419dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:06:24.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.907+0000 7fe0fae8f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0f4107420 0x7fe0f4197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:06:24.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.907+0000 7fe0fae8f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f41116b0 con 0x7fe0f4101370 2024-06-03T00:06:24.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.907+0000 7fe0fae8f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f4111530 con 0x7fe0f4101d30 2024-06-03T00:06:24.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.907+0000 7fe0fae8f700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f4111830 con 0x7fe0f4107420 2024-06-03T00:06:24.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.907+0000 7fe0f8c2b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0f4101370 0x7fe0f419d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:06:24.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.907+0000 7fe0f8c2b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0f4101370 0x7fe0f419d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46598/0 (socket says 172.21.15.49:46598) 2024-06-03T00:06:24.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.907+0000 7fe0f8c2b700 1 -- 172.21.15.49:0/2084862287 learned_addr learned my addr 172.21.15.49:0/2084862287 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-06-03T00:06:24.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.907+0000 7fe0f942c700 1 --2- 172.21.15.49:0/2084862287 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0f4107420 0x7fe0f4197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:06:24.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.907+0000 7fe0f3fff700 1 --2- 172.21.15.49:0/2084862287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0f4101d30 0x7fe0f419dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:06:24.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.907+0000 7fe0f8c2b700 1 -- 172.21.15.49:0/2084862287 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0f4107420 msgr2=0x7fe0f4197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:24.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.907+0000 7fe0f8c2b700 1 --2- 172.21.15.49:0/2084862287 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0f4107420 0x7fe0f4197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:24.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.907+0000 7fe0f8c2b700 1 -- 172.21.15.49:0/2084862287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0f4101d30 msgr2=0x7fe0f419dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:24.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.907+0000 7fe0f8c2b700 1 --2- 172.21.15.49:0/2084862287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0f4101d30 0x7fe0f419dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:24.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.907+0000 7fe0f8c2b700 1 -- 172.21.15.49:0/2084862287 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f4198090 con 0x7fe0f4101370 2024-06-03T00:06:24.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.907+0000 7fe0f942c700 1 --2- 172.21.15.49:0/2084862287 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0f4107420 0x7fe0f4197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:06:24.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.907+0000 7fe0f8c2b700 1 --2- 172.21.15.49:0/2084862287 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0f4101370 0x7fe0f419d770 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40060b0 tx=0x7fe0e4007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:06:24.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.908+0000 7fe0f1ffb700 1 -- 172.21.15.49:0/2084862287 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e401a070 con 0x7fe0f4101370 2024-06-03T00:06:24.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.908+0000 7fe0fae8f700 1 -- 172.21.15.49:0/2084862287 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0f4198380 con 0x7fe0f4101370 2024-06-03T00:06:24.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.908+0000 7fe0f1ffb700 1 -- 172.21.15.49:0/2084862287 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0e400de20 con 0x7fe0f4101370 2024-06-03T00:06:24.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.908+0000 7fe0f1ffb700 1 -- 172.21.15.49:0/2084862287 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e4014790 con 0x7fe0f4101370 2024-06-03T00:06:24.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.908+0000 7fe0fae8f700 1 -- 172.21.15.49:0/2084862287 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0f406abc0 con 0x7fe0f4101370 2024-06-03T00:06:24.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.909+0000 7fe0fae8f700 1 -- 172.21.15.49:0/2084862287 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0f4069180 con 0x7fe0f4101370 2024-06-03T00:06:24.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.910+0000 7fe0f1ffb700 1 -- 172.21.15.49:0/2084862287 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe0e401d070 con 0x7fe0f4101370 2024-06-03T00:06:24.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.911+0000 7fe0f1ffb700 1 --2- 172.21.15.49:0/2084862287 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe0e00a2c20 0x7fe0e00a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:06:24.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.911+0000 7fe0f3fff700 1 --2- 172.21.15.49:0/2084862287 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe0e00a2c20 0x7fe0e00a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:06:24.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.911+0000 7fe0f1ffb700 1 -- 172.21.15.49:0/2084862287 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8116+0+0 (secure 0 0 0) 0x7fe0e40ce8c0 con 0x7fe0f4101370 2024-06-03T00:06:24.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.911+0000 7fe0f3fff700 1 --2- 172.21.15.49:0/2084862287 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe0e00a2c20 0x7fe0e00a50e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc006010 tx=0x7fe0dc00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:06:24.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:24.915+0000 7fe0f1ffb700 1 -- 172.21.15.49:0/2084862287 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe0e4010070 con 0x7fe0f4101370 2024-06-03T00:06:25.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:25.124+0000 7fe0fae8f700 1 -- 172.21.15.49:0/2084862287 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe0f406b650 con 0x7fe0f4101370 2024-06-03T00:06:25.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:25.161+0000 7fe0f1ffb700 1 -- 172.21.15.49:0/2084862287 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v93) ==== 169+0+0 (secure 0 0 0) 0x7fe0e40b9e20 con 0x7fe0f4101370 2024-06-03T00:06:25.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:25.164+0000 7fe0fae8f700 1 -- 172.21.15.49:0/2084862287 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe0e00a2c20 msgr2=0x7fe0e00a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:25.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:25.164+0000 7fe0fae8f700 1 --2- 172.21.15.49:0/2084862287 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe0e00a2c20 0x7fe0e00a50e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc006010 tx=0x7fe0dc00b540 comp rx=0 tx=0).stop 2024-06-03T00:06:25.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:25.164+0000 7fe0fae8f700 1 -- 172.21.15.49:0/2084862287 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0f4101370 msgr2=0x7fe0f419d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:06:25.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:25.164+0000 7fe0fae8f700 1 --2- 172.21.15.49:0/2084862287 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0f4101370 0x7fe0f419d770 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40060b0 tx=0x7fe0e4007f90 comp rx=0 tx=0).stop 2024-06-03T00:06:25.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:25.165+0000 7fe0fae8f700 1 -- 172.21.15.49:0/2084862287 shutdown_connections 2024-06-03T00:06:25.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:25.165+0000 7fe0fae8f700 1 --2- 172.21.15.49:0/2084862287 >> [v2:172.21.15.49:6800/2948657177,v1:172.21.15.49:6801/2948657177] conn(0x7fe0e00a2c20 0x7fe0e00a50e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:25.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:25.165+0000 7fe0fae8f700 1 --2- 172.21.15.49:0/2084862287 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0f4107420 0x7fe0f4197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:25.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:25.165+0000 7fe0fae8f700 1 --2- 172.21.15.49:0/2084862287 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe0f4101370 0x7fe0f419d770 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:25.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:25.165+0000 7fe0fae8f700 1 --2- 172.21.15.49:0/2084862287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0f4101d30 0x7fe0f419dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:06:25.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:25.165+0000 7fe0fae8f700 1 -- 172.21.15.49:0/2084862287 >> 172.21.15.49:0/2084862287 conn(0x7fe0f4078340 msgr2=0x7fe0f41000b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:06:25.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:25.165+0000 7fe0fae8f700 1 -- 172.21.15.49:0/2084862287 shutdown_connections 2024-06-03T00:06:25.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-06-03T00:06:25.166+0000 7fe0fae8f700 1 -- 172.21.15.49:0/2084862287 wait complete. 2024-06-03T00:06:25.168 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2024-06-03T00:06:25.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:25 smithi057 ceph-mon[36457]: pgmap v576: 65 pgs: 65 active+clean; 577 KiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-03T00:06:25.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:25 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/2084862287' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-03T00:06:25.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:25 smithi049 ceph-mon[32302]: pgmap v576: 65 pgs: 65 active+clean; 577 KiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-03T00:06:25.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:25 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/2084862287' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-03T00:06:25.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:25 smithi107 ceph-mon[37048]: pgmap v576: 65 pgs: 65 active+clean; 577 KiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-03T00:06:25.600 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:25 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/2084862287' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-03T00:06:25.913 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-03T00:06:25.941 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-03T00:06:25.976 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-03T00:06:26.009 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-06-03T00:06:26.009 DEBUG:teuthology.orchestra.run.smithi049:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-06-03T00:06:26.025 DEBUG:teuthology.orchestra.run.smithi057:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-06-03T00:06:26.044 DEBUG:teuthology.orchestra.run.smithi107:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-06-03T00:06:26.066 INFO:tasks.cephadm:Stopping all daemons... 2024-06-03T00:06:26.066 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-06-03T00:06:26.066 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-890dd222-213a-11ef-bc9b-c7b262605968@mon.a 2024-06-03T00:06:26.167 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:26 smithi049 systemd[1]: Stopping Ceph mon.a for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-03T00:06:26.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:26 smithi107 ceph-mon[37048]: from='client.? 172.21.15.49:0/2084862287' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-06-03T00:06:26.350 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:26 smithi107 ceph-mon[37048]: osdmap e93: 12 total, 12 up, 12 in 2024-06-03T00:06:26.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:26 smithi057 ceph-mon[36457]: from='client.? 172.21.15.49:0/2084862287' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-06-03T00:06:26.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:26 smithi057 ceph-mon[36457]: osdmap e93: 12 total, 12 up, 12 in 2024-06-03T00:06:26.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:26 smithi049 ceph-mon[32302]: from='client.? 172.21.15.49:0/2084862287' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-06-03T00:06:26.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:26 smithi049 ceph-mon[32302]: osdmap e93: 12 total, 12 up, 12 in 2024-06-03T00:06:26.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:26 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mon-a[32298]: 2024-06-03T00:06:26.362+0000 7f4360d5e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-03T00:06:26.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:26 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mon-a[32298]: 2024-06-03T00:06:26.362+0000 7f4360d5e700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-06-03T00:06:26.863 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:26 smithi049 podman[102144]: 2024-06-03 00:06:26.597793934 +0000 UTC m=+0.339558062 container died d07abbb94eed76190c8896b6ca38899045fa47084bce252b24974e6e3c7ea979 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mon-a, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-03T00:06:27.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:26 smithi049 podman[102144]: 2024-06-03 00:06:26.978775212 +0000 UTC m=+0.720539339 container cleanup d07abbb94eed76190c8896b6ca38899045fa47084bce252b24974e6e3c7ea979 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mon-a, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS) 2024-06-03T00:06:27.211 INFO:journalctl@ceph.mon.a.smithi049.stdout:Jun 03 00:06:26 smithi049 bash[102144]: ceph-890dd222-213a-11ef-bc9b-c7b262605968-mon-a 2024-06-03T00:06:27.463 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mon.a.service' 2024-06-03T00:06:27.509 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-03T00:06:27.509 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-06-03T00:06:27.509 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-06-03T00:06:27.509 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ceph-890dd222-213a-11ef-bc9b-c7b262605968@mon.b 2024-06-03T00:06:27.847 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:27 smithi057 systemd[1]: Stopping Ceph mon.b for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-03T00:06:28.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:27 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mon-b[36453]: 2024-06-03T00:06:27.847+0000 7f4d5170a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-03T00:06:28.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:27 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mon-b[36453]: 2024-06-03T00:06:27.847+0000 7f4d5170a700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-06-03T00:06:28.200 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:27 smithi057 podman[70198]: 2024-06-03 00:06:27.939848252 +0000 UTC m=+0.222175042 container died 498be37079c5322fbfc11cdbacdf0cbcc641e75a94de91cd7bb509acf7132c07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mon-b, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-06-03T00:06:28.606 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:28 smithi057 podman[70198]: 2024-06-03 00:06:28.288961398 +0000 UTC m=+0.571288184 container cleanup 498be37079c5322fbfc11cdbacdf0cbcc641e75a94de91cd7bb509acf7132c07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mon-b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-03T00:06:28.606 INFO:journalctl@ceph.mon.b.smithi057.stdout:Jun 03 00:06:28 smithi057 bash[70198]: ceph-890dd222-213a-11ef-bc9b-c7b262605968-mon-b 2024-06-03T00:06:28.778 DEBUG:teuthology.orchestra.run.smithi057:> sudo pkill -f 'journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mon.b.service' 2024-06-03T00:06:28.830 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-03T00:06:28.830 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-06-03T00:06:28.830 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-06-03T00:06:28.830 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-890dd222-213a-11ef-bc9b-c7b262605968@mon.c 2024-06-03T00:06:29.150 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:28 smithi107 systemd[1]: Stopping Ceph mon.c for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-03T00:06:29.404 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:29 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mon-c[37042]: 2024-06-03T00:06:29.148+0000 7fb96fe83700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-03T00:06:29.404 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:29 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mon-c[37042]: 2024-06-03T00:06:29.148+0000 7fb96fe83700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-06-03T00:06:29.666 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:29 smithi107 podman[71655]: 2024-06-03 00:06:29.404741579 +0000 UTC m=+0.376987313 container died 6b2ebe4e3d4935f7f7417031e4fd8e0294f17536947c967adb4b861a26ace5bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mon-c, RELEASE=squid-3d89acc, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-06-03T00:06:30.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:29 smithi107 podman[71655]: 2024-06-03 00:06:29.724170651 +0000 UTC m=+0.696416369 container cleanup 6b2ebe4e3d4935f7f7417031e4fd8e0294f17536947c967adb4b861a26ace5bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-03T00:06:30.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:29 smithi107 bash[71655]: ceph-890dd222-213a-11ef-bc9b-c7b262605968-mon-c 2024-06-03T00:06:30.100 INFO:journalctl@ceph.mon.c.smithi107.stdout:Jun 03 00:06:29 smithi107 podman[71668]: 2024-06-03 00:06:29.909167503 +0000 UTC m=+0.500647104 container remove 6b2ebe4e3d4935f7f7417031e4fd8e0294f17536947c967adb4b861a26ace5bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mon-c, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-06-03T00:06:30.148 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mon.c.service' 2024-06-03T00:06:30.194 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-03T00:06:30.194 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-06-03T00:06:30.194 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-06-03T00:06:30.194 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-890dd222-213a-11ef-bc9b-c7b262605968@mgr.x 2024-06-03T00:06:30.526 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 03 00:06:30 smithi049 systemd[1]: Stopping Ceph mgr.x for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-03T00:06:30.852 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 03 00:06:30 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x[32529]: 2024-06-03T00:06:30.525+0000 7f042a0b6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-03T00:06:30.852 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 03 00:06:30 smithi049 podman[102265]: 2024-06-03 00:06:30.557314671 +0000 UTC m=+0.155463781 container died 196f847adf9e78f6f06029e260a61fd268a33ee84c49c4277e9f228b0daa2cbf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, ceph=True, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-03T00:06:31.211 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 03 00:06:31 smithi049 podman[102265]: 2024-06-03 00:06:31.027048032 +0000 UTC m=+0.625197133 container cleanup 196f847adf9e78f6f06029e260a61fd268a33ee84c49c4277e9f228b0daa2cbf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS) 2024-06-03T00:06:31.211 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Jun 03 00:06:31 smithi049 bash[102265]: ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-x 2024-06-03T00:06:31.512 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mgr.x.service' 2024-06-03T00:06:31.549 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-03T00:06:31.549 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-06-03T00:06:31.549 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-06-03T00:06:31.550 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ceph-890dd222-213a-11ef-bc9b-c7b262605968@mgr.y 2024-06-03T00:06:31.906 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 03 00:06:31 smithi057 systemd[1]: Stopping Ceph mgr.y for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-03T00:06:32.178 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 03 00:06:31 smithi057 podman[70319]: 2024-06-03 00:06:31.906814553 +0000 UTC m=+0.147719278 container died 05fd17bb1135cc2c4ad652fbcb6d719e9b250b55ba836b97d4a22d68aaea1217 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-y, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240528) 2024-06-03T00:06:32.450 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 03 00:06:32 smithi057 podman[70319]: 2024-06-03 00:06:32.244533809 +0000 UTC m=+0.485438557 container cleanup 05fd17bb1135cc2c4ad652fbcb6d719e9b250b55ba836b97d4a22d68aaea1217 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-06-03T00:06:32.450 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Jun 03 00:06:32 smithi057 bash[70319]: ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-y 2024-06-03T00:06:32.684 DEBUG:teuthology.orchestra.run.smithi057:> sudo pkill -f 'journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mgr.y.service' 2024-06-03T00:06:32.719 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-03T00:06:32.719 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-06-03T00:06:32.719 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-06-03T00:06:32.720 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-890dd222-213a-11ef-bc9b-c7b262605968@mgr.z 2024-06-03T00:06:33.032 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 03 00:06:32 smithi107 systemd[1]: Stopping Ceph mgr.z for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-03T00:06:33.346 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 03 00:06:33 smithi107 podman[71777]: 2024-06-03 00:06:33.033077438 +0000 UTC m=+0.123766791 container died 33a05c8db1e71376d565c270bb42d04ef6ed9de94ca4b9b2f1e008ed18019f48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-z, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-06-03T00:06:33.600 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 03 00:06:33 smithi107 podman[71777]: 2024-06-03 00:06:33.421356921 +0000 UTC m=+0.512046320 container cleanup 33a05c8db1e71376d565c270bb42d04ef6ed9de94ca4b9b2f1e008ed18019f48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-03T00:06:33.600 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Jun 03 00:06:33 smithi107 bash[71777]: ceph-890dd222-213a-11ef-bc9b-c7b262605968-mgr-z 2024-06-03T00:06:33.837 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mgr.z.service' 2024-06-03T00:06:33.871 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-03T00:06:33.871 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-06-03T00:06:33.871 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-06-03T00:06:33.871 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.0 2024-06-03T00:06:34.165 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 03 00:06:33 smithi049 systemd[1]: Stopping Ceph osd.0 for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-03T00:06:34.461 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 03 00:06:34 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-0[44786]: 2024-06-03T00:06:34.164+0000 7ff3c7bca700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-03T00:06:34.461 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 03 00:06:34 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-0[44786]: 2024-06-03T00:06:34.164+0000 7ff3c7bca700 -1 osd.0 93 *** Got signal Terminated *** 2024-06-03T00:06:34.461 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 03 00:06:34 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-0[44786]: 2024-06-03T00:06:34.164+0000 7ff3c7bca700 -1 osd.0 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-03T00:06:39.950 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 03 00:06:39 smithi049 podman[102387]: 2024-06-03 00:06:39.687076648 +0000 UTC m=+5.616469386 container died b54e57989ec48d98743c43481f711586f643bccd2743629fc253b52195e3b24e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-06-03T00:06:40.211 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 03 00:06:40 smithi049 podman[102387]: 2024-06-03 00:06:40.157211016 +0000 UTC m=+6.086603757 container cleanup b54e57989ec48d98743c43481f711586f643bccd2743629fc253b52195e3b24e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, GIT_CLEAN=True) 2024-06-03T00:06:40.211 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 03 00:06:40 smithi049 bash[102387]: ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-0 2024-06-03T00:06:40.711 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 03 00:06:40 smithi049 podman[102402]: 2024-06-03 00:06:40.442377169 +0000 UTC m=+0.749684501 container remove b54e57989ec48d98743c43481f711586f643bccd2743629fc253b52195e3b24e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240528) 2024-06-03T00:06:41.028 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 03 00:06:40 smithi049 podman[102501]: 2024-06-03 00:06:40.703538403 +0000 UTC m=+0.019494940 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-03T00:06:41.028 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 03 00:06:40 smithi049 podman[102501]: 2024-06-03 00:06:40.826670796 +0000 UTC m=+0.142627319 container create 912842cec1dea740058444e5b2c046025735ea5cf9eb15d373d9eaecb10a78e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-0-deactivate, ceph=True, RELEASE=squid-3d89acc, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-06-03T00:06:41.353 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 03 00:06:41 smithi049 podman[102501]: 2024-06-03 00:06:41.028918699 +0000 UTC m=+0.344875230 container init 912842cec1dea740058444e5b2c046025735ea5cf9eb15d373d9eaecb10a78e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-0-deactivate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-06-03T00:06:41.354 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 03 00:06:41 smithi049 podman[102501]: 2024-06-03 00:06:41.03306944 +0000 UTC m=+0.349025979 container start 912842cec1dea740058444e5b2c046025735ea5cf9eb15d373d9eaecb10a78e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, GIT_CLEAN=True) 2024-06-03T00:06:41.354 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 03 00:06:41 smithi049 podman[102501]: 2024-06-03 00:06:41.137625297 +0000 UTC m=+0.453581860 container attach 912842cec1dea740058444e5b2c046025735ea5cf9eb15d373d9eaecb10a78e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-06-03T00:06:41.639 INFO:journalctl@ceph.osd.0.smithi049.stdout:Jun 03 00:06:41 smithi049 podman[102501]: 2024-06-03 00:06:41.354351532 +0000 UTC m=+0.670308070 container died 912842cec1dea740058444e5b2c046025735ea5cf9eb15d373d9eaecb10a78e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-06-03T00:06:41.917 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.0.service' 2024-06-03T00:06:41.959 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-03T00:06:41.959 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-06-03T00:06:41.960 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-06-03T00:06:41.960 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.1 2024-06-03T00:06:42.257 INFO:journalctl@ceph.osd.1.smithi057.stdout:Jun 03 00:06:42 smithi057 systemd[1]: Stopping Ceph osd.1 for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-03T00:06:42.700 INFO:journalctl@ceph.osd.1.smithi057.stdout:Jun 03 00:06:42 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-1[41038]: 2024-06-03T00:06:42.256+0000 7f49ce0ae700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-03T00:06:42.700 INFO:journalctl@ceph.osd.1.smithi057.stdout:Jun 03 00:06:42 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-1[41038]: 2024-06-03T00:06:42.256+0000 7f49ce0ae700 -1 osd.1 93 *** Got signal Terminated *** 2024-06-03T00:06:42.700 INFO:journalctl@ceph.osd.1.smithi057.stdout:Jun 03 00:06:42 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-1[41038]: 2024-06-03T00:06:42.256+0000 7f49ce0ae700 -1 osd.1 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-03T00:06:48.033 INFO:journalctl@ceph.osd.1.smithi057.stdout:Jun 03 00:06:47 smithi057 podman[70453]: 2024-06-03 00:06:47.749082308 +0000 UTC m=+5.587554901 container died 5dfc772de88d095d0f8501c23097b98cc33842d91fefdb33dbbcfb1bd635d82b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-1, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS) 2024-06-03T00:06:48.400 INFO:journalctl@ceph.osd.1.smithi057.stdout:Jun 03 00:06:48 smithi057 podman[70453]: 2024-06-03 00:06:48.12447511 +0000 UTC m=+5.962947692 container cleanup 5dfc772de88d095d0f8501c23097b98cc33842d91fefdb33dbbcfb1bd635d82b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-1, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240528, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-06-03T00:06:48.400 INFO:journalctl@ceph.osd.1.smithi057.stdout:Jun 03 00:06:48 smithi057 bash[70453]: ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-1 2024-06-03T00:06:48.700 INFO:journalctl@ceph.osd.1.smithi057.stdout:Jun 03 00:06:48 smithi057 podman[70470]: 2024-06-03 00:06:48.400730938 +0000 UTC m=+0.645683683 container remove 5dfc772de88d095d0f8501c23097b98cc33842d91fefdb33dbbcfb1bd635d82b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-1, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-06-03T00:06:49.020 INFO:journalctl@ceph.osd.1.smithi057.stdout:Jun 03 00:06:48 smithi057 podman[70562]: 2024-06-03 00:06:48.668311988 +0000 UTC m=+0.017618668 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-03T00:06:49.020 INFO:journalctl@ceph.osd.1.smithi057.stdout:Jun 03 00:06:48 smithi057 podman[70562]: 2024-06-03 00:06:48.793358635 +0000 UTC m=+0.142665296 container create 2517c7f1fcdfe42194427e3efe846a7f730a69e28c55730dce3f790948f2b0eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-06-03T00:06:49.020 INFO:journalctl@ceph.osd.1.smithi057.stdout:Jun 03 00:06:49 smithi057 podman[70562]: 2024-06-03 00:06:49.020827598 +0000 UTC m=+0.370134261 container init 2517c7f1fcdfe42194427e3efe846a7f730a69e28c55730dce3f790948f2b0eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528) 2024-06-03T00:06:49.331 INFO:journalctl@ceph.osd.1.smithi057.stdout:Jun 03 00:06:49 smithi057 podman[70562]: 2024-06-03 00:06:49.024709707 +0000 UTC m=+0.374016370 container start 2517c7f1fcdfe42194427e3efe846a7f730a69e28c55730dce3f790948f2b0eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-06-03T00:06:49.331 INFO:journalctl@ceph.osd.1.smithi057.stdout:Jun 03 00:06:49 smithi057 podman[70562]: 2024-06-03 00:06:49.095901153 +0000 UTC m=+0.445207817 container attach 2517c7f1fcdfe42194427e3efe846a7f730a69e28c55730dce3f790948f2b0eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240528) 2024-06-03T00:06:49.625 INFO:journalctl@ceph.osd.1.smithi057.stdout:Jun 03 00:06:49 smithi057 podman[70562]: 2024-06-03 00:06:49.332500012 +0000 UTC m=+0.681806690 container died 2517c7f1fcdfe42194427e3efe846a7f730a69e28c55730dce3f790948f2b0eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True) 2024-06-03T00:06:49.933 DEBUG:teuthology.orchestra.run.smithi057:> sudo pkill -f 'journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.1.service' 2024-06-03T00:06:49.973 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-03T00:06:49.973 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-06-03T00:06:49.974 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-06-03T00:06:49.974 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.2 2024-06-03T00:06:50.275 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 03 00:06:50 smithi107 systemd[1]: Stopping Ceph osd.2 for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-03T00:06:50.602 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 03 00:06:50 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-2[42135]: 2024-06-03T00:06:50.274+0000 7fcae5046700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-03T00:06:50.602 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 03 00:06:50 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-2[42135]: 2024-06-03T00:06:50.274+0000 7fcae5046700 -1 osd.2 93 *** Got signal Terminated *** 2024-06-03T00:06:50.602 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 03 00:06:50 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-2[42135]: 2024-06-03T00:06:50.274+0000 7fcae5046700 -1 osd.2 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-03T00:06:56.101 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 03 00:06:55 smithi107 podman[71915]: 2024-06-03 00:06:55.815652079 +0000 UTC m=+5.643336127 container died ba33c43a2749de725d293d620cddb2df3bdd8dc5d5bde41ffb0f14c75f412665 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528) 2024-06-03T00:06:56.442 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 03 00:06:56 smithi107 podman[71915]: 2024-06-03 00:06:56.199773715 +0000 UTC m=+6.027457762 container cleanup ba33c43a2749de725d293d620cddb2df3bdd8dc5d5bde41ffb0f14c75f412665 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD) 2024-06-03T00:06:56.442 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 03 00:06:56 smithi107 bash[71915]: ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-2 2024-06-03T00:06:56.777 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 03 00:06:56 smithi107 podman[71934]: 2024-06-03 00:06:56.442952317 +0000 UTC m=+0.626783090 container remove ba33c43a2749de725d293d620cddb2df3bdd8dc5d5bde41ffb0f14c75f412665 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc) 2024-06-03T00:06:57.100 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 03 00:06:56 smithi107 podman[72023]: 2024-06-03 00:06:56.681157429 +0000 UTC m=+0.017179556 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-03T00:06:57.101 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 03 00:06:56 smithi107 podman[72023]: 2024-06-03 00:06:56.785590144 +0000 UTC m=+0.121612255 container create 7a64d8020b51ed0a14583c41f7d255590e245634ef5a021bae5aa953672cf285 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-2-deactivate, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-3d89acc, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-06-03T00:06:57.101 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 03 00:06:57 smithi107 podman[72023]: 2024-06-03 00:06:57.021733794 +0000 UTC m=+0.357755906 container init 7a64d8020b51ed0a14583c41f7d255590e245634ef5a021bae5aa953672cf285 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-03T00:06:57.101 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 03 00:06:57 smithi107 podman[72023]: 2024-06-03 00:06:57.02480394 +0000 UTC m=+0.360826060 container start 7a64d8020b51ed0a14583c41f7d255590e245634ef5a021bae5aa953672cf285 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-06-03T00:06:57.601 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 03 00:06:57 smithi107 podman[72023]: 2024-06-03 00:06:57.104762853 +0000 UTC m=+0.440784985 container attach 7a64d8020b51ed0a14583c41f7d255590e245634ef5a021bae5aa953672cf285 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-06-03T00:06:57.601 INFO:journalctl@ceph.osd.2.smithi107.stdout:Jun 03 00:06:57 smithi107 podman[72023]: 2024-06-03 00:06:57.323610622 +0000 UTC m=+0.659632744 container died 7a64d8020b51ed0a14583c41f7d255590e245634ef5a021bae5aa953672cf285 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-06-03T00:06:58.028 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.2.service' 2024-06-03T00:06:58.066 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-03T00:06:58.067 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-06-03T00:06:58.067 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-06-03T00:06:58.067 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.3 2024-06-03T00:06:58.376 INFO:journalctl@ceph.osd.3.smithi049.stdout:Jun 03 00:06:58 smithi049 systemd[1]: Stopping Ceph osd.3 for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-03T00:06:58.711 INFO:journalctl@ceph.osd.3.smithi049.stdout:Jun 03 00:06:58 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-3[51317]: 2024-06-03T00:06:58.376+0000 7fc3865cf700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-03T00:06:58.711 INFO:journalctl@ceph.osd.3.smithi049.stdout:Jun 03 00:06:58 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-3[51317]: 2024-06-03T00:06:58.376+0000 7fc3865cf700 -1 osd.3 93 *** Got signal Terminated *** 2024-06-03T00:06:58.711 INFO:journalctl@ceph.osd.3.smithi049.stdout:Jun 03 00:06:58 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-3[51317]: 2024-06-03T00:06:58.376+0000 7fc3865cf700 -1 osd.3 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-03T00:07:01.100 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:00 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:00.643+0000 7faa2099f700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.200831+0000 front 2024-06-03T00:06:37.200604+0000 (oldest deadline 2024-06-03T00:07:00.001588+0000) 2024-06-03T00:07:01.461 INFO:journalctl@ceph.osd.3.smithi049.stdout:Jun 03 00:07:01 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-3[51317]: 2024-06-03T00:07:01.002+0000 7fc3833c4700 -1 osd.3 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.878190+0000 front 2024-06-03T00:06:37.878219+0000 (oldest deadline 2024-06-03T00:07:00.778396+0000) 2024-06-03T00:07:02.100 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:01 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:01.679+0000 7faa2099f700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.200831+0000 front 2024-06-03T00:06:37.200604+0000 (oldest deadline 2024-06-03T00:07:00.001588+0000) 2024-06-03T00:07:02.461 INFO:journalctl@ceph.osd.3.smithi049.stdout:Jun 03 00:07:01 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-3[51317]: 2024-06-03T00:07:01.979+0000 7fc3833c4700 -1 osd.3 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.878190+0000 front 2024-06-03T00:06:37.878219+0000 (oldest deadline 2024-06-03T00:07:00.778396+0000) 2024-06-03T00:07:03.100 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:02 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:02.675+0000 7faa2099f700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.200831+0000 front 2024-06-03T00:06:37.200604+0000 (oldest deadline 2024-06-03T00:07:00.001588+0000) 2024-06-03T00:07:03.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:02 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:02.812+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:03.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:02 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:02.780+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:03.461 INFO:journalctl@ceph.osd.3.smithi049.stdout:Jun 03 00:07:03 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-3[51317]: 2024-06-03T00:07:03.019+0000 7fc3833c4700 -1 osd.3 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.878190+0000 front 2024-06-03T00:06:37.878219+0000 (oldest deadline 2024-06-03T00:07:00.778396+0000) 2024-06-03T00:07:03.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:03 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:03.087+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:04.100 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:03 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:03.659+0000 7faa2099f700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.200831+0000 front 2024-06-03T00:06:37.200604+0000 (oldest deadline 2024-06-03T00:07:00.001588+0000) 2024-06-03T00:07:04.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:03 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:03.768+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:04.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:03 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:03.752+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:04.113 INFO:journalctl@ceph.osd.3.smithi049.stdout:Jun 03 00:07:03 smithi049 podman[102611]: 2024-06-03 00:07:03.88976483 +0000 UTC m=+5.608419465 container died 66f73f6fcff869cb16d892dbc7b0c72ee2383e9acb5151ac54446e0468365900 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-3, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-06-03T00:07:04.113 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:03 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:03.740+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.302358+0000 front 2024-06-03T00:06:34.302400+0000 (oldest deadline 2024-06-03T00:07:03.103378+0000) 2024-06-03T00:07:04.460 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:04 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:04.112+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:04.461 INFO:journalctl@ceph.osd.3.smithi049.stdout:Jun 03 00:07:04 smithi049 podman[102611]: 2024-06-03 00:07:04.301017427 +0000 UTC m=+6.019672075 container cleanup 66f73f6fcff869cb16d892dbc7b0c72ee2383e9acb5151ac54446e0468365900 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-3, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-06-03T00:07:04.461 INFO:journalctl@ceph.osd.3.smithi049.stdout:Jun 03 00:07:04 smithi049 bash[102611]: ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-3 2024-06-03T00:07:04.710 INFO:journalctl@ceph.osd.3.smithi049.stdout:Jun 03 00:07:04 smithi049 podman[102640]: 2024-06-03 00:07:04.460698123 +0000 UTC m=+0.564201895 container remove 66f73f6fcff869cb16d892dbc7b0c72ee2383e9acb5151ac54446e0468365900 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-3, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-06-03T00:07:04.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:04 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:04.601+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:05.007 INFO:journalctl@ceph.osd.3.smithi049.stdout:Jun 03 00:07:04 smithi049 podman[102728]: 2024-06-03 00:07:04.788566907 +0000 UTC m=+0.017936056 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-03T00:07:05.007 INFO:journalctl@ceph.osd.3.smithi049.stdout:Jun 03 00:07:04 smithi049 podman[102728]: 2024-06-03 00:07:04.894845015 +0000 UTC m=+0.124214199 container create b4daf2a5cf897cf7b0b00004120bd7e2eab882207b3b9cf436ba2267deb1c1de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-03T00:07:05.007 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:04 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:04.721+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.302358+0000 front 2024-06-03T00:06:34.302400+0000 (oldest deadline 2024-06-03T00:07:03.103378+0000) 2024-06-03T00:07:05.100 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:04 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:04.682+0000 7faa2099f700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.200831+0000 front 2024-06-03T00:06:37.200604+0000 (oldest deadline 2024-06-03T00:07:00.001588+0000) 2024-06-03T00:07:05.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:04 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:04.811+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:05.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:04 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:04.797+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:05.433 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:05 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:05.087+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:05.433 INFO:journalctl@ceph.osd.3.smithi049.stdout:Jun 03 00:07:05 smithi049 podman[102728]: 2024-06-03 00:07:05.130904284 +0000 UTC m=+0.360273417 container init b4daf2a5cf897cf7b0b00004120bd7e2eab882207b3b9cf436ba2267deb1c1de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-06-03T00:07:05.434 INFO:journalctl@ceph.osd.3.smithi049.stdout:Jun 03 00:07:05 smithi049 podman[102728]: 2024-06-03 00:07:05.134297203 +0000 UTC m=+0.363666347 container start b4daf2a5cf897cf7b0b00004120bd7e2eab882207b3b9cf436ba2267deb1c1de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-3-deactivate, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc) 2024-06-03T00:07:05.434 INFO:journalctl@ceph.osd.3.smithi049.stdout:Jun 03 00:07:05 smithi049 podman[102728]: 2024-06-03 00:07:05.222507588 +0000 UTC m=+0.451876744 container attach b4daf2a5cf897cf7b0b00004120bd7e2eab882207b3b9cf436ba2267deb1c1de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-03T00:07:05.711 INFO:journalctl@ceph.osd.3.smithi049.stdout:Jun 03 00:07:05 smithi049 podman[102728]: 2024-06-03 00:07:05.434130607 +0000 UTC m=+0.663499755 container died b4daf2a5cf897cf7b0b00004120bd7e2eab882207b3b9cf436ba2267deb1c1de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-3-deactivate, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-06-03T00:07:05.941 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.3.service' 2024-06-03T00:07:05.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:05 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:05.633+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:05.983 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-03T00:07:05.984 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-06-03T00:07:05.984 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-06-03T00:07:05.984 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.4 2024-06-03T00:07:06.048 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:05 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:05.741+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.302358+0000 front 2024-06-03T00:06:34.302400+0000 (oldest deadline 2024-06-03T00:07:03.103378+0000) 2024-06-03T00:07:06.100 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:05 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:05.668+0000 7faa2099f700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.200831+0000 front 2024-06-03T00:06:37.200604+0000 (oldest deadline 2024-06-03T00:07:00.001588+0000) 2024-06-03T00:07:06.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:05 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:05.804+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:06.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:05 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:05.795+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:06.345 INFO:journalctl@ceph.osd.4.smithi057.stdout:Jun 03 00:07:06 smithi057 systemd[1]: Stopping Ceph osd.4 for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-03T00:07:06.460 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:06 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:06.047+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:06.701 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:06 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:06.588+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:06.702 INFO:journalctl@ceph.osd.4.smithi057.stdout:Jun 03 00:07:06 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-4[48004]: 2024-06-03T00:07:06.345+0000 7f5e107eb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-03T00:07:06.702 INFO:journalctl@ceph.osd.4.smithi057.stdout:Jun 03 00:07:06 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-4[48004]: 2024-06-03T00:07:06.345+0000 7f5e107eb700 -1 osd.4 93 *** Got signal Terminated *** 2024-06-03T00:07:06.702 INFO:journalctl@ceph.osd.4.smithi057.stdout:Jun 03 00:07:06 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-4[48004]: 2024-06-03T00:07:06.345+0000 7f5e107eb700 -1 osd.4 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-03T00:07:07.080 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:06 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:06.717+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.302358+0000 front 2024-06-03T00:06:34.302400+0000 (oldest deadline 2024-06-03T00:07:03.103378+0000) 2024-06-03T00:07:07.100 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:06 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:06.682+0000 7faa2099f700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.200831+0000 front 2024-06-03T00:06:37.200604+0000 (oldest deadline 2024-06-03T00:07:00.001588+0000) 2024-06-03T00:07:07.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:06 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:06.793+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:07.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:06 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:06.784+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:07.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:07 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:07.080+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:07.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:07 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:07.633+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:08.058 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:07 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:07.712+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.302358+0000 front 2024-06-03T00:06:34.302400+0000 (oldest deadline 2024-06-03T00:07:03.103378+0000) 2024-06-03T00:07:08.100 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:07 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:07.710+0000 7faa2099f700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.200831+0000 front 2024-06-03T00:06:37.200604+0000 (oldest deadline 2024-06-03T00:07:00.001588+0000) 2024-06-03T00:07:08.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:07 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:07.771+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:08.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:07 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:07.746+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:08.460 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:08 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:08.058+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:08.949 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:08 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:08.637+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:09.060 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:08 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:08.742+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.302358+0000 front 2024-06-03T00:06:34.302400+0000 (oldest deadline 2024-06-03T00:07:03.103378+0000) 2024-06-03T00:07:09.100 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:08 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:08.678+0000 7faa2099f700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.200831+0000 front 2024-06-03T00:06:37.200604+0000 (oldest deadline 2024-06-03T00:07:00.001588+0000) 2024-06-03T00:07:09.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:08 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:08.770+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:09.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:08 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:08.781+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:09.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:09 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:09.060+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:09.592 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:09 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:09.276+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.033802+0000 front 2024-06-03T00:06:44.033893+0000 (oldest deadline 2024-06-03T00:07:08.734061+0000) 2024-06-03T00:07:09.949 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:09 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:09.591+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:09.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:09 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:09.591+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:09.961 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:09 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:09.692+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.302358+0000 front 2024-06-03T00:06:34.302400+0000 (oldest deadline 2024-06-03T00:07:03.103378+0000) 2024-06-03T00:07:10.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:09 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:09.779+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:10.101 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:09 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:09.669+0000 7faa2099f700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.200831+0000 front 2024-06-03T00:06:37.200604+0000 (oldest deadline 2024-06-03T00:07:00.001588+0000) 2024-06-03T00:07:10.101 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:09 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:09.669+0000 7faa2099f700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.702881+0000 front 2024-06-03T00:06:44.702892+0000 (oldest deadline 2024-06-03T00:07:09.303525+0000) 2024-06-03T00:07:10.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:09 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:09.804+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:10.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:09 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:09.804+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:10.265 INFO:journalctl@ceph.osd.4.smithi057.stdout:Jun 03 00:07:09 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-4[48004]: 2024-06-03T00:07:09.960+0000 7f5e0d5e0700 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:43.854712+0000 front 2024-06-03T00:06:43.854769+0000 (oldest deadline 2024-06-03T00:07:09.655534+0000) 2024-06-03T00:07:10.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:10 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:10.050+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:10.561 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:10 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:10.264+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.033802+0000 front 2024-06-03T00:06:44.033893+0000 (oldest deadline 2024-06-03T00:07:08.734061+0000) 2024-06-03T00:07:10.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:10 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:10.561+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:10.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:10 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:10.561+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:11.002 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:10 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:10.626+0000 7faa2099f700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.200831+0000 front 2024-06-03T00:06:37.200604+0000 (oldest deadline 2024-06-03T00:07:00.001588+0000) 2024-06-03T00:07:11.003 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:10 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:10.626+0000 7faa2099f700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.702881+0000 front 2024-06-03T00:06:44.702892+0000 (oldest deadline 2024-06-03T00:07:09.303525+0000) 2024-06-03T00:07:11.003 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:10 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:10.774+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:11.003 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:10 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:10.774+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:11.003 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:10 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:10.826+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:11.006 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:10 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:10.727+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.302358+0000 front 2024-06-03T00:06:34.302400+0000 (oldest deadline 2024-06-03T00:07:03.103378+0000) 2024-06-03T00:07:11.006 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:10 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:10.727+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.004663+0000 front 2024-06-03T00:06:46.004938+0000 (oldest deadline 2024-06-03T00:07:10.104685+0000) 2024-06-03T00:07:11.450 INFO:journalctl@ceph.osd.4.smithi057.stdout:Jun 03 00:07:11 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-4[48004]: 2024-06-03T00:07:11.009+0000 7f5e0d5e0700 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:43.854712+0000 front 2024-06-03T00:06:43.854769+0000 (oldest deadline 2024-06-03T00:07:09.655534+0000) 2024-06-03T00:07:11.450 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:11 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:11.217+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.033802+0000 front 2024-06-03T00:06:44.033893+0000 (oldest deadline 2024-06-03T00:07:08.734061+0000) 2024-06-03T00:07:11.460 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:11 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:11.006+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:11.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:11 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:11.006+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:11.950 INFO:journalctl@ceph.osd.4.smithi057.stdout:Jun 03 00:07:11 smithi057 podman[70678]: 2024-06-03 00:07:11.67664146 +0000 UTC m=+5.495406612 container died 10dc8a3907a27f7d1dd26ddb9c1893fcd8e535766644a688858fb5d5b718d735 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=) 2024-06-03T00:07:11.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:11 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:11.603+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:11.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:11 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:11.603+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:12.012 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:11 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:11.758+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.302358+0000 front 2024-06-03T00:06:34.302400+0000 (oldest deadline 2024-06-03T00:07:03.103378+0000) 2024-06-03T00:07:12.012 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:11 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:11.758+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.004663+0000 front 2024-06-03T00:06:46.004938+0000 (oldest deadline 2024-06-03T00:07:10.104685+0000) 2024-06-03T00:07:12.100 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:11 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:11.810+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:12.100 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:11 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:11.810+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:12.101 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:11 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:11.659+0000 7faa2099f700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.200831+0000 front 2024-06-03T00:06:37.200604+0000 (oldest deadline 2024-06-03T00:07:00.001588+0000) 2024-06-03T00:07:12.101 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:11 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:11.659+0000 7faa2099f700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.702881+0000 front 2024-06-03T00:06:44.702892+0000 (oldest deadline 2024-06-03T00:07:09.303525+0000) 2024-06-03T00:07:12.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:11 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:11.827+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:12.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:11 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:11.827+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:12.312 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:12 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:12.178+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.033802+0000 front 2024-06-03T00:06:44.033893+0000 (oldest deadline 2024-06-03T00:07:08.734061+0000) 2024-06-03T00:07:12.313 INFO:journalctl@ceph.osd.4.smithi057.stdout:Jun 03 00:07:12 smithi057 podman[70678]: 2024-06-03 00:07:12.037011102 +0000 UTC m=+5.855776249 container cleanup 10dc8a3907a27f7d1dd26ddb9c1893fcd8e535766644a688858fb5d5b718d735 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-4, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-06-03T00:07:12.313 INFO:journalctl@ceph.osd.4.smithi057.stdout:Jun 03 00:07:12 smithi057 bash[70678]: ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-4 2024-06-03T00:07:12.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:12 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:12.012+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:12.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:12 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:12.012+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:12.641 INFO:journalctl@ceph.osd.4.smithi057.stdout:Jun 03 00:07:12 smithi057 podman[70695]: 2024-06-03 00:07:12.313403578 +0000 UTC m=+0.625420858 container remove 10dc8a3907a27f7d1dd26ddb9c1893fcd8e535766644a688858fb5d5b718d735 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5) 2024-06-03T00:07:12.908 INFO:journalctl@ceph.osd.4.smithi057.stdout:Jun 03 00:07:12 smithi057 podman[70781]: 2024-06-03 00:07:12.585346436 +0000 UTC m=+0.017970546 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-03T00:07:12.908 INFO:journalctl@ceph.osd.4.smithi057.stdout:Jun 03 00:07:12 smithi057 podman[70781]: 2024-06-03 00:07:12.697395836 +0000 UTC m=+0.130019940 container create 7940c483faba3039dcf96730a31b5f2b0974c8a58e23c20ec772b091f29da9b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-3d89acc) 2024-06-03T00:07:12.908 INFO:journalctl@ceph.osd.4.smithi057.stdout:Jun 03 00:07:12 smithi057 podman[70781]: 2024-06-03 00:07:12.908240322 +0000 UTC m=+0.340864425 container init 7940c483faba3039dcf96730a31b5f2b0974c8a58e23c20ec772b091f29da9b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-4-deactivate, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-06-03T00:07:12.908 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:12 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:12.640+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:12.908 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:12 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:12.640+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:13.100 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:12 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:12.770+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:13.100 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:12 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:12.770+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:13.101 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:12 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:12.659+0000 7faa2099f700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.200831+0000 front 2024-06-03T00:06:37.200604+0000 (oldest deadline 2024-06-03T00:07:00.001588+0000) 2024-06-03T00:07:13.101 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:12 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:12.659+0000 7faa2099f700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.702881+0000 front 2024-06-03T00:06:44.702892+0000 (oldest deadline 2024-06-03T00:07:09.303525+0000) 2024-06-03T00:07:13.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:12 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:12.862+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:13.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:12 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:12.862+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:13.200 INFO:journalctl@ceph.osd.4.smithi057.stdout:Jun 03 00:07:12 smithi057 podman[70781]: 2024-06-03 00:07:12.911711816 +0000 UTC m=+0.344335919 container start 7940c483faba3039dcf96730a31b5f2b0974c8a58e23c20ec772b091f29da9b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, ceph=True) 2024-06-03T00:07:13.200 INFO:journalctl@ceph.osd.4.smithi057.stdout:Jun 03 00:07:12 smithi057 podman[70781]: 2024-06-03 00:07:12.991380786 +0000 UTC m=+0.424004905 container attach 7940c483faba3039dcf96730a31b5f2b0974c8a58e23c20ec772b091f29da9b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, ceph=True) 2024-06-03T00:07:13.210 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:12 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:12.800+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.302358+0000 front 2024-06-03T00:06:34.302400+0000 (oldest deadline 2024-06-03T00:07:03.103378+0000) 2024-06-03T00:07:13.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:12 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:12.800+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.004663+0000 front 2024-06-03T00:06:46.004938+0000 (oldest deadline 2024-06-03T00:07:10.104685+0000) 2024-06-03T00:07:13.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:13 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:13.008+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:13.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:13 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:13.008+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:13.493 INFO:journalctl@ceph.osd.4.smithi057.stdout:Jun 03 00:07:13 smithi057 podman[70781]: 2024-06-03 00:07:13.216842017 +0000 UTC m=+0.649466127 container died 7940c483faba3039dcf96730a31b5f2b0974c8a58e23c20ec772b091f29da9b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0) 2024-06-03T00:07:13.493 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:13 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:13.222+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.033802+0000 front 2024-06-03T00:06:44.033893+0000 (oldest deadline 2024-06-03T00:07:08.734061+0000) 2024-06-03T00:07:13.777 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:13 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:13.596+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:13.778 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:13 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:13.596+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:13.799 DEBUG:teuthology.orchestra.run.smithi057:> sudo pkill -f 'journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.4.service' 2024-06-03T00:07:13.840 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-03T00:07:13.840 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-06-03T00:07:13.840 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-06-03T00:07:13.840 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.5 2024-06-03T00:07:13.888 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:13 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:13.818+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:13.888 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:13 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:13.818+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:13.888 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:13 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:13.634+0000 7faa2099f700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.200831+0000 front 2024-06-03T00:06:37.200604+0000 (oldest deadline 2024-06-03T00:07:00.001588+0000) 2024-06-03T00:07:13.888 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:13 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:13.634+0000 7faa2099f700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.702881+0000 front 2024-06-03T00:06:44.702892+0000 (oldest deadline 2024-06-03T00:07:09.303525+0000) 2024-06-03T00:07:13.889 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:13 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:13.804+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:13.889 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:13 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:13.804+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:14.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:13 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:13.779+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.302358+0000 front 2024-06-03T00:06:34.302400+0000 (oldest deadline 2024-06-03T00:07:03.103378+0000) 2024-06-03T00:07:14.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:13 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:13.779+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.004663+0000 front 2024-06-03T00:06:46.004938+0000 (oldest deadline 2024-06-03T00:07:10.104685+0000) 2024-06-03T00:07:14.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:14 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:14.014+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:14.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:14 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:14.014+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:14.350 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:13 smithi107 systemd[1]: Stopping Ceph osd.5 for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-03T00:07:14.351 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:14 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:14.126+0000 7faa23baa700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-03T00:07:14.351 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:14 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:14.126+0000 7faa23baa700 -1 osd.5 93 *** Got signal Terminated *** 2024-06-03T00:07:14.351 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:14 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:14.126+0000 7faa23baa700 -1 osd.5 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-03T00:07:14.604 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:14 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:14.249+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.033802+0000 front 2024-06-03T00:06:44.033893+0000 (oldest deadline 2024-06-03T00:07:08.734061+0000) 2024-06-03T00:07:14.850 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:14 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:14.597+0000 7faa2099f700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.200831+0000 front 2024-06-03T00:06:37.200604+0000 (oldest deadline 2024-06-03T00:07:00.001588+0000) 2024-06-03T00:07:14.851 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:14 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:14.597+0000 7faa2099f700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.702881+0000 front 2024-06-03T00:06:44.702892+0000 (oldest deadline 2024-06-03T00:07:09.303525+0000) 2024-06-03T00:07:14.851 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:14 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:14.777+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:14.851 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:14 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:14.777+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:14.851 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:14 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:14.813+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:14.851 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:14 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:14.813+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:14.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:14 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:14.603+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:14.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:14 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:14.603+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:15.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:14 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:14.770+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.302358+0000 front 2024-06-03T00:06:34.302400+0000 (oldest deadline 2024-06-03T00:07:03.103378+0000) 2024-06-03T00:07:15.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:14 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:14.770+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.004663+0000 front 2024-06-03T00:06:46.004938+0000 (oldest deadline 2024-06-03T00:07:10.104685+0000) 2024-06-03T00:07:15.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:14 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:14.965+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:15.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:14 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:14.965+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:15.560 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:15 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:15.292+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.033802+0000 front 2024-06-03T00:06:44.033893+0000 (oldest deadline 2024-06-03T00:07:08.734061+0000) 2024-06-03T00:07:15.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:15 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:15.559+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:15.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:15 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:15.559+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:16.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:15 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:15.798+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:16.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:15 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:15.798+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:16.101 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:15 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:15.614+0000 7faa2099f700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.200831+0000 front 2024-06-03T00:06:37.200604+0000 (oldest deadline 2024-06-03T00:07:00.001588+0000) 2024-06-03T00:07:16.101 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:15 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:15.614+0000 7faa2099f700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.702881+0000 front 2024-06-03T00:06:44.702892+0000 (oldest deadline 2024-06-03T00:07:09.303525+0000) 2024-06-03T00:07:16.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:15 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:15.799+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:16.102 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:15 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:15.799+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:16.210 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:15 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:15.817+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.302358+0000 front 2024-06-03T00:06:34.302400+0000 (oldest deadline 2024-06-03T00:07:03.103378+0000) 2024-06-03T00:07:16.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:15 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:15.817+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.004663+0000 front 2024-06-03T00:06:46.004938+0000 (oldest deadline 2024-06-03T00:07:10.104685+0000) 2024-06-03T00:07:16.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:15 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:15.925+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:16.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:15 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:15.925+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:16.604 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:16 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:16.329+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.033802+0000 front 2024-06-03T00:06:44.033893+0000 (oldest deadline 2024-06-03T00:07:08.734061+0000) 2024-06-03T00:07:16.850 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:16 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:16.833+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:16.850 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:16 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:16.833+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:16.851 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:16 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:16.589+0000 7faa2099f700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.200831+0000 front 2024-06-03T00:06:37.200604+0000 (oldest deadline 2024-06-03T00:07:00.001588+0000) 2024-06-03T00:07:16.851 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:16 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:16.589+0000 7faa2099f700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.702881+0000 front 2024-06-03T00:06:44.702892+0000 (oldest deadline 2024-06-03T00:07:09.303525+0000) 2024-06-03T00:07:16.851 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:16 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:16.836+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:16.851 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:16 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:16.836+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:16.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:16 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:16.604+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:16.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:16 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:16.604+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:17.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:16 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:16.771+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.302358+0000 front 2024-06-03T00:06:34.302400+0000 (oldest deadline 2024-06-03T00:07:03.103378+0000) 2024-06-03T00:07:17.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:16 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:16.771+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.004663+0000 front 2024-06-03T00:06:46.004938+0000 (oldest deadline 2024-06-03T00:07:10.104685+0000) 2024-06-03T00:07:17.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:16 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:16.771+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:50.605840+0000 front 2024-06-03T00:06:50.605746+0000 (oldest deadline 2024-06-03T00:07:15.905628+0000) 2024-06-03T00:07:17.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:16 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:16.944+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:17.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:16 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:16.944+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:17.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:16 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:16.944+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:17.598 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:17 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:17.289+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.033802+0000 front 2024-06-03T00:06:44.033893+0000 (oldest deadline 2024-06-03T00:07:08.734061+0000) 2024-06-03T00:07:17.867 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:17 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:17.605+0000 7faa2099f700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.200831+0000 front 2024-06-03T00:06:37.200604+0000 (oldest deadline 2024-06-03T00:07:00.001588+0000) 2024-06-03T00:07:17.867 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:17 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:17.605+0000 7faa2099f700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.702881+0000 front 2024-06-03T00:06:44.702892+0000 (oldest deadline 2024-06-03T00:07:09.303525+0000) 2024-06-03T00:07:17.867 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:17 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:17.605+0000 7faa2099f700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:51.004353+0000 front 2024-06-03T00:06:51.004375+0000 (oldest deadline 2024-06-03T00:07:16.805082+0000) 2024-06-03T00:07:17.867 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:17 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:17.848+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:17.867 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:17 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:17.848+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:17.867 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:17 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:17.848+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:17.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:17 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:17.597+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:17.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:17 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:17.597+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:17.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:17 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:17.597+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:18.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:17 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:17.782+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.302358+0000 front 2024-06-03T00:06:34.302400+0000 (oldest deadline 2024-06-03T00:07:03.103378+0000) 2024-06-03T00:07:18.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:17 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:17.782+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.004663+0000 front 2024-06-03T00:06:46.004938+0000 (oldest deadline 2024-06-03T00:07:10.104685+0000) 2024-06-03T00:07:18.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:17 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:17.782+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:50.605840+0000 front 2024-06-03T00:06:50.605746+0000 (oldest deadline 2024-06-03T00:07:15.905628+0000) 2024-06-03T00:07:18.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:17 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:17.985+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:18.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:17 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:17.985+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:18.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:17 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:17.985+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:18.350 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:17 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:17.866+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:18.350 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:17 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:17.866+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:18.639 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:18 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:18.268+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.033802+0000 front 2024-06-03T00:06:44.033893+0000 (oldest deadline 2024-06-03T00:07:08.734061+0000) 2024-06-03T00:07:18.639 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:18 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:18.268+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.536175+0000 front 2024-06-03T00:06:54.536070+0000 (oldest deadline 2024-06-03T00:07:17.436270+0000) 2024-06-03T00:07:18.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:18 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:18.639+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:18.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:18 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:18.639+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:18.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:18 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:18.639+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:19.100 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:18 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:18.614+0000 7faa2099f700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.200831+0000 front 2024-06-03T00:06:37.200604+0000 (oldest deadline 2024-06-03T00:07:00.001588+0000) 2024-06-03T00:07:19.100 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:18 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:18.614+0000 7faa2099f700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.702881+0000 front 2024-06-03T00:06:44.702892+0000 (oldest deadline 2024-06-03T00:07:09.303525+0000) 2024-06-03T00:07:19.100 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:18 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5[48911]: 2024-06-03T00:07:18.614+0000 7faa2099f700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:51.004353+0000 front 2024-06-03T00:06:51.004375+0000 (oldest deadline 2024-06-03T00:07:16.805082+0000) 2024-06-03T00:07:19.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:18 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:18.824+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:19.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:18 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:18.824+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:19.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:18 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:18.824+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:19.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:18 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:18.847+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:19.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:18 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:18.847+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:19.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:18 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:18.847+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.906076+0000 front 2024-06-03T00:06:52.905818+0000 (oldest deadline 2024-06-03T00:07:18.805971+0000) 2024-06-03T00:07:19.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:18 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:18.772+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.302358+0000 front 2024-06-03T00:06:34.302400+0000 (oldest deadline 2024-06-03T00:07:03.103378+0000) 2024-06-03T00:07:19.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:18 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:18.772+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.004663+0000 front 2024-06-03T00:06:46.004938+0000 (oldest deadline 2024-06-03T00:07:10.104685+0000) 2024-06-03T00:07:19.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:18 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:18.772+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:50.605840+0000 front 2024-06-03T00:06:50.605746+0000 (oldest deadline 2024-06-03T00:07:15.905628+0000) 2024-06-03T00:07:19.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:19 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:19.015+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:19.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:19 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:19.015+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:19.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:19 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:19.015+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:19.660 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:19 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:19.235+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.033802+0000 front 2024-06-03T00:06:44.033893+0000 (oldest deadline 2024-06-03T00:07:08.734061+0000) 2024-06-03T00:07:19.660 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:19 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:19.235+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.536175+0000 front 2024-06-03T00:06:54.536070+0000 (oldest deadline 2024-06-03T00:07:17.436270+0000) 2024-06-03T00:07:19.812 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:19 smithi107 podman[72153]: 2024-06-03 00:07:19.533629054 +0000 UTC m=+5.498118417 container died f15bcf59185cb39153bc5a2a603dbf053896d4c9b222102ce03a164dc335f953 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0) 2024-06-03T00:07:19.812 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:19 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:19.780+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:19.812 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:19 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:19.780+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:19.812 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:19 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:19.780+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:19.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:19 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:19.660+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:19.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:19 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:19.660+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:19.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:19 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:19.660+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:20.100 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:19 smithi107 podman[72153]: 2024-06-03 00:07:19.903412708 +0000 UTC m=+5.867902052 container cleanup f15bcf59185cb39153bc5a2a603dbf053896d4c9b222102ce03a164dc335f953 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-06-03T00:07:20.100 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:19 smithi107 bash[72153]: ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5 2024-06-03T00:07:20.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:19 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:19.875+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:20.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:19 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:19.875+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:20.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:19 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:19.875+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.906076+0000 front 2024-06-03T00:06:52.905818+0000 (oldest deadline 2024-06-03T00:07:18.805971+0000) 2024-06-03T00:07:20.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:20 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:20.026+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:20.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:20 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:20.026+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:20.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:20 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:20.026+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:20.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:19 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:19.810+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.302358+0000 front 2024-06-03T00:06:34.302400+0000 (oldest deadline 2024-06-03T00:07:03.103378+0000) 2024-06-03T00:07:20.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:19 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:19.810+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.004663+0000 front 2024-06-03T00:06:46.004938+0000 (oldest deadline 2024-06-03T00:07:10.104685+0000) 2024-06-03T00:07:20.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:19 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:19.810+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:50.605840+0000 front 2024-06-03T00:06:50.605746+0000 (oldest deadline 2024-06-03T00:07:15.905628+0000) 2024-06-03T00:07:20.469 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:20 smithi107 podman[72169]: 2024-06-03 00:07:20.138054119 +0000 UTC m=+0.601290636 container remove f15bcf59185cb39153bc5a2a603dbf053896d4c9b222102ce03a164dc335f953 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=) 2024-06-03T00:07:20.646 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:20 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:20.274+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.033802+0000 front 2024-06-03T00:06:44.033893+0000 (oldest deadline 2024-06-03T00:07:08.734061+0000) 2024-06-03T00:07:20.647 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:20 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:20.274+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.536175+0000 front 2024-06-03T00:06:54.536070+0000 (oldest deadline 2024-06-03T00:07:17.436270+0000) 2024-06-03T00:07:20.763 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:20 smithi107 podman[72261]: 2024-06-03 00:07:20.372747614 +0000 UTC m=+0.016911982 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-03T00:07:20.763 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:20 smithi107 podman[72261]: 2024-06-03 00:07:20.489034141 +0000 UTC m=+0.133198551 container create a59d8128c98ef9bd45aa3cc50e69258eebbf00b9d81770e09b6deeb9af9e8a33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5-deactivate, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-06-03T00:07:20.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:20 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:20.646+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:20.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:20 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:20.646+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:20.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:20 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:20.646+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:21.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:20 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:20.763+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:21.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:20 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:20.763+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:21.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:20 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:20.763+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:21.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:20 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:20.911+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:21.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:20 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:20.911+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:21.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:20 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:20.911+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.906076+0000 front 2024-06-03T00:06:52.905818+0000 (oldest deadline 2024-06-03T00:07:18.805971+0000) 2024-06-03T00:07:21.101 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:20 smithi107 podman[72261]: 2024-06-03 00:07:20.868173858 +0000 UTC m=+0.512338216 container init a59d8128c98ef9bd45aa3cc50e69258eebbf00b9d81770e09b6deeb9af9e8a33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-06-03T00:07:21.101 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:20 smithi107 podman[72261]: 2024-06-03 00:07:20.871205 +0000 UTC m=+0.515369360 container start a59d8128c98ef9bd45aa3cc50e69258eebbf00b9d81770e09b6deeb9af9e8a33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-06-03T00:07:21.101 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:20 smithi107 podman[72261]: 2024-06-03 00:07:20.957998658 +0000 UTC m=+0.602163034 container attach a59d8128c98ef9bd45aa3cc50e69258eebbf00b9d81770e09b6deeb9af9e8a33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5-deactivate, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240528, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-06-03T00:07:21.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:20 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:20.845+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.302358+0000 front 2024-06-03T00:06:34.302400+0000 (oldest deadline 2024-06-03T00:07:03.103378+0000) 2024-06-03T00:07:21.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:20 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:20.845+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.004663+0000 front 2024-06-03T00:06:46.004938+0000 (oldest deadline 2024-06-03T00:07:10.104685+0000) 2024-06-03T00:07:21.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:20 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:20.845+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:50.605840+0000 front 2024-06-03T00:06:50.605746+0000 (oldest deadline 2024-06-03T00:07:15.905628+0000) 2024-06-03T00:07:21.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:20 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:20.995+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:21.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:20 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:20.995+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:21.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:20 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:20.995+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:21.493 INFO:journalctl@ceph.osd.5.smithi107.stdout:Jun 03 00:07:21 smithi107 podman[72261]: 2024-06-03 00:07:21.158027786 +0000 UTC m=+0.802192156 container died a59d8128c98ef9bd45aa3cc50e69258eebbf00b9d81770e09b6deeb9af9e8a33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-03T00:07:21.684 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:21 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:21.284+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.033802+0000 front 2024-06-03T00:06:44.033893+0000 (oldest deadline 2024-06-03T00:07:08.734061+0000) 2024-06-03T00:07:21.684 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:21 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:21.284+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.536175+0000 front 2024-06-03T00:06:54.536070+0000 (oldest deadline 2024-06-03T00:07:17.436270+0000) 2024-06-03T00:07:21.803 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:21 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:21.729+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:21.803 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:21 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:21.729+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:21.803 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:21 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:21.729+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:21.829 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.5.service' 2024-06-03T00:07:21.868 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-03T00:07:21.869 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-06-03T00:07:21.869 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-06-03T00:07:21.869 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.6 2024-06-03T00:07:21.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:21 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:21.683+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:21.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:21 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:21.683+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:21.950 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:21 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:21.683+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:22.100 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:21 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:21.885+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:22.100 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:21 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:21.885+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:22.100 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:21 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:21.885+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.906076+0000 front 2024-06-03T00:06:52.905818+0000 (oldest deadline 2024-06-03T00:07:18.805971+0000) 2024-06-03T00:07:22.195 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:21 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:21.964+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:22.195 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:21 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:21.964+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:22.195 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:21 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:21.964+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:22.195 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:21 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:21.819+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.302358+0000 front 2024-06-03T00:06:34.302400+0000 (oldest deadline 2024-06-03T00:07:03.103378+0000) 2024-06-03T00:07:22.195 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:21 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:21.819+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.004663+0000 front 2024-06-03T00:06:46.004938+0000 (oldest deadline 2024-06-03T00:07:10.104685+0000) 2024-06-03T00:07:22.195 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:21 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:21.819+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:50.605840+0000 front 2024-06-03T00:06:50.605746+0000 (oldest deadline 2024-06-03T00:07:15.905628+0000) 2024-06-03T00:07:22.195 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:21 smithi049 systemd[1]: Stopping Ceph osd.6 for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-03T00:07:22.461 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:22 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:22.195+0000 7f530038a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-03T00:07:22.461 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:22 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:22.195+0000 7f530038a700 -1 osd.6 93 *** Got signal Terminated *** 2024-06-03T00:07:22.461 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:22 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:22.195+0000 7f530038a700 -1 osd.6 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-03T00:07:22.700 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:22 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:22.267+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.033802+0000 front 2024-06-03T00:06:44.033893+0000 (oldest deadline 2024-06-03T00:07:08.734061+0000) 2024-06-03T00:07:22.700 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:22 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:22.267+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.536175+0000 front 2024-06-03T00:06:54.536070+0000 (oldest deadline 2024-06-03T00:07:17.436270+0000) 2024-06-03T00:07:23.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:22 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:22.729+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:23.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:22 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:22.729+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:23.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:22 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:22.729+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:23.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:22 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:22.844+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:23.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:22 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:22.844+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:23.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:22 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:22.844+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.906076+0000 front 2024-06-03T00:06:52.905818+0000 (oldest deadline 2024-06-03T00:07:18.805971+0000) 2024-06-03T00:07:23.199 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:22 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:22.725+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:23.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:22 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:22.725+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:23.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:22 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:22.725+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:23.210 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:22 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:22.769+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.302358+0000 front 2024-06-03T00:06:34.302400+0000 (oldest deadline 2024-06-03T00:07:03.103378+0000) 2024-06-03T00:07:23.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:22 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:22.769+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.004663+0000 front 2024-06-03T00:06:46.004938+0000 (oldest deadline 2024-06-03T00:07:10.104685+0000) 2024-06-03T00:07:23.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:22 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:22.769+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:50.605840+0000 front 2024-06-03T00:06:50.605746+0000 (oldest deadline 2024-06-03T00:07:15.905628+0000) 2024-06-03T00:07:23.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:22 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:22.992+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:23.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:22 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:22.992+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:23.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:22 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:22.992+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:23.700 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:23 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:23.296+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.033802+0000 front 2024-06-03T00:06:44.033893+0000 (oldest deadline 2024-06-03T00:07:08.734061+0000) 2024-06-03T00:07:23.700 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:23 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:23.296+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.536175+0000 front 2024-06-03T00:06:54.536070+0000 (oldest deadline 2024-06-03T00:07:17.436270+0000) 2024-06-03T00:07:24.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:23 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:23.714+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:24.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:23 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:23.714+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:24.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:23 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:23.714+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:24.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:23 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:23.820+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:24.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:23 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:23.820+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:24.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:23 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:23.820+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.906076+0000 front 2024-06-03T00:06:52.905818+0000 (oldest deadline 2024-06-03T00:07:18.805971+0000) 2024-06-03T00:07:24.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:23 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:23.771+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:24.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:23 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:23.771+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:24.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:23 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:23.771+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:24.210 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:23 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:23.747+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.302358+0000 front 2024-06-03T00:06:34.302400+0000 (oldest deadline 2024-06-03T00:07:03.103378+0000) 2024-06-03T00:07:24.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:23 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:23.747+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.004663+0000 front 2024-06-03T00:06:46.004938+0000 (oldest deadline 2024-06-03T00:07:10.104685+0000) 2024-06-03T00:07:24.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:23 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:23.747+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:50.605840+0000 front 2024-06-03T00:06:50.605746+0000 (oldest deadline 2024-06-03T00:07:15.905628+0000) 2024-06-03T00:07:24.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:23 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:23.958+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:24.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:23 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:23.958+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:24.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:23 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:23.958+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:24.700 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:24 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:24.295+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.033802+0000 front 2024-06-03T00:06:44.033893+0000 (oldest deadline 2024-06-03T00:07:08.734061+0000) 2024-06-03T00:07:24.700 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:24 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:24.295+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.536175+0000 front 2024-06-03T00:06:54.536070+0000 (oldest deadline 2024-06-03T00:07:17.436270+0000) 2024-06-03T00:07:24.962 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:24 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:24.707+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.302358+0000 front 2024-06-03T00:06:34.302400+0000 (oldest deadline 2024-06-03T00:07:03.103378+0000) 2024-06-03T00:07:24.962 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:24 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:24.707+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.004663+0000 front 2024-06-03T00:06:46.004938+0000 (oldest deadline 2024-06-03T00:07:10.104685+0000) 2024-06-03T00:07:24.962 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:24 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:24.707+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:50.605840+0000 front 2024-06-03T00:06:50.605746+0000 (oldest deadline 2024-06-03T00:07:15.905628+0000) 2024-06-03T00:07:25.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:24 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:24.730+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:25.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:24 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:24.730+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:25.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:24 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:24.730+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:25.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:24 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:24.813+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:25.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:24 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:24.813+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:25.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:24 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:24.813+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.906076+0000 front 2024-06-03T00:06:52.905818+0000 (oldest deadline 2024-06-03T00:07:18.805971+0000) 2024-06-03T00:07:25.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:24 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:24.753+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:25.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:24 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:24.753+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:25.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:24 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:24.753+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:25.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:25 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:25.007+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:25.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:25 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:25.007+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:25.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:25 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:25.007+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:25.699 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:25 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:25.270+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.033802+0000 front 2024-06-03T00:06:44.033893+0000 (oldest deadline 2024-06-03T00:07:08.734061+0000) 2024-06-03T00:07:25.700 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:25 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:25.270+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.536175+0000 front 2024-06-03T00:06:54.536070+0000 (oldest deadline 2024-06-03T00:07:17.436270+0000) 2024-06-03T00:07:26.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:25 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:25.745+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:26.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:25 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:25.745+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:26.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:25 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:25.745+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:26.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:25 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:25.804+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:26.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:25 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:25.804+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:26.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:25 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:25.804+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.906076+0000 front 2024-06-03T00:06:52.905818+0000 (oldest deadline 2024-06-03T00:07:18.805971+0000) 2024-06-03T00:07:26.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:25 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:25.753+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:26.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:25 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:25.753+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:26.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:25 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:25.753+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:26.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:25 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:25.753+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:26.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:25 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:25.741+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.302358+0000 front 2024-06-03T00:06:34.302400+0000 (oldest deadline 2024-06-03T00:07:03.103378+0000) 2024-06-03T00:07:26.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:25 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:25.741+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.004663+0000 front 2024-06-03T00:06:46.004938+0000 (oldest deadline 2024-06-03T00:07:10.104685+0000) 2024-06-03T00:07:26.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:25 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:25.741+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:50.605840+0000 front 2024-06-03T00:06:50.605746+0000 (oldest deadline 2024-06-03T00:07:15.905628+0000) 2024-06-03T00:07:26.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:25 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:25.741+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.606612+0000 front 2024-06-03T00:07:00.606678+0000 (oldest deadline 2024-06-03T00:07:25.306705+0000) 2024-06-03T00:07:26.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:25 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:25.972+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:26.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:25 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:25.972+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:26.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:25 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:25.972+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:26.700 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:26 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:26.269+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.033802+0000 front 2024-06-03T00:06:44.033893+0000 (oldest deadline 2024-06-03T00:07:08.734061+0000) 2024-06-03T00:07:26.700 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:26 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:26.269+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.536175+0000 front 2024-06-03T00:06:54.536070+0000 (oldest deadline 2024-06-03T00:07:17.436270+0000) 2024-06-03T00:07:26.700 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:26 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:26.269+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:01.938826+0000 front 2024-06-03T00:07:01.938863+0000 (oldest deadline 2024-06-03T00:07:25.438674+0000) 2024-06-03T00:07:27.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:26 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:26.739+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:27.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:26 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:26.739+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:27.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:26 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:26.739+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:27.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:26 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:26.792+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:27.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:26 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:26.792+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:27.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:26 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:26.792+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.906076+0000 front 2024-06-03T00:06:52.905818+0000 (oldest deadline 2024-06-03T00:07:18.805971+0000) 2024-06-03T00:07:27.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:26 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:26.749+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:27.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:26 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:26.749+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:27.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:26 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:26.749+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:27.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:26 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:26.749+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:27.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:26 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:26.974+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:27.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:26 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:26.974+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:27.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:26 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:26.974+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:27.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:26 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:26.974+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:02.828834+0000 front 2024-06-03T00:07:02.828801+0000 (oldest deadline 2024-06-03T00:07:26.928828+0000) 2024-06-03T00:07:27.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:26 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:26.751+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.302358+0000 front 2024-06-03T00:06:34.302400+0000 (oldest deadline 2024-06-03T00:07:03.103378+0000) 2024-06-03T00:07:27.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:26 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:26.751+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.004663+0000 front 2024-06-03T00:06:46.004938+0000 (oldest deadline 2024-06-03T00:07:10.104685+0000) 2024-06-03T00:07:27.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:26 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:26.751+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:50.605840+0000 front 2024-06-03T00:06:50.605746+0000 (oldest deadline 2024-06-03T00:07:15.905628+0000) 2024-06-03T00:07:27.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:26 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6[57810]: 2024-06-03T00:07:26.751+0000 7f52f9177700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.606612+0000 front 2024-06-03T00:07:00.606678+0000 (oldest deadline 2024-06-03T00:07:25.306705+0000) 2024-06-03T00:07:27.700 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:27 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:27.310+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.033802+0000 front 2024-06-03T00:06:44.033893+0000 (oldest deadline 2024-06-03T00:07:08.734061+0000) 2024-06-03T00:07:27.700 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:27 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:27.310+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.536175+0000 front 2024-06-03T00:06:54.536070+0000 (oldest deadline 2024-06-03T00:07:17.436270+0000) 2024-06-03T00:07:27.700 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:27 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:27.311+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:01.938826+0000 front 2024-06-03T00:07:01.938863+0000 (oldest deadline 2024-06-03T00:07:25.438674+0000) 2024-06-03T00:07:27.961 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:27 smithi049 podman[102835]: 2024-06-03 00:07:27.70407012 +0000 UTC m=+5.627366633 container died 29802f25a6ba579a83f0809caff9803e21cdb590495e02364130c4bda773be09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-03T00:07:28.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:27 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:27.776+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:28.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:27 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:27.776+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:28.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:27 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:27.776+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:28.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:27 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:27.788+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:28.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:27 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:27.788+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:28.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:27 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:27.788+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.906076+0000 front 2024-06-03T00:06:52.905818+0000 (oldest deadline 2024-06-03T00:07:18.805971+0000) 2024-06-03T00:07:28.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:27 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:27.759+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:28.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:27 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:27.759+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:28.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:27 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:27.759+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:28.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:27 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:27.759+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:28.337 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:28 smithi049 podman[102835]: 2024-06-03 00:07:28.086484141 +0000 UTC m=+6.009780698 container cleanup 29802f25a6ba579a83f0809caff9803e21cdb590495e02364130c4bda773be09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-06-03T00:07:28.337 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:28 smithi049 bash[102835]: ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6 2024-06-03T00:07:28.337 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:27 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:27.985+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:28.337 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:27 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:27.985+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:28.337 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:27 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:27.985+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:28.338 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:27 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:27.985+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:02.828834+0000 front 2024-06-03T00:07:02.828801+0000 (oldest deadline 2024-06-03T00:07:26.928828+0000) 2024-06-03T00:07:28.654 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:28 smithi049 podman[102850]: 2024-06-03 00:07:28.337788782 +0000 UTC m=+0.627405925 container remove 29802f25a6ba579a83f0809caff9803e21cdb590495e02364130c4bda773be09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-06-03T00:07:28.699 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:28 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:28.291+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.033802+0000 front 2024-06-03T00:06:44.033893+0000 (oldest deadline 2024-06-03T00:07:08.734061+0000) 2024-06-03T00:07:28.700 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:28 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:28.291+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.536175+0000 front 2024-06-03T00:06:54.536070+0000 (oldest deadline 2024-06-03T00:07:17.436270+0000) 2024-06-03T00:07:28.700 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:28 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:28.291+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:01.938826+0000 front 2024-06-03T00:07:01.938863+0000 (oldest deadline 2024-06-03T00:07:25.438674+0000) 2024-06-03T00:07:28.948 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:28 smithi049 podman[102941]: 2024-06-03 00:07:28.655276883 +0000 UTC m=+0.110207428 container create 02cdc83be8d006ba535d00a37e1578d3f57a1b37e3f9a78e7cdc5d9108dc3b0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6-deactivate, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc) 2024-06-03T00:07:28.949 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:28 smithi049 podman[102941]: 2024-06-03 00:07:28.56301124 +0000 UTC m=+0.017941794 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-03T00:07:28.949 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:28 smithi049 podman[102941]: 2024-06-03 00:07:28.882398325 +0000 UTC m=+0.337328864 container init 02cdc83be8d006ba535d00a37e1578d3f57a1b37e3f9a78e7cdc5d9108dc3b0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-03T00:07:28.949 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:28 smithi049 podman[102941]: 2024-06-03 00:07:28.885856577 +0000 UTC m=+0.340787103 container start 02cdc83be8d006ba535d00a37e1578d3f57a1b37e3f9a78e7cdc5d9108dc3b0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc) 2024-06-03T00:07:29.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:28 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:28.732+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:29.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:28 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:28.732+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:29.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:28 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:28.732+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:29.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:28 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:28.815+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:29.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:28 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:28.815+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:29.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:28 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:28.815+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.906076+0000 front 2024-06-03T00:06:52.905818+0000 (oldest deadline 2024-06-03T00:07:18.805971+0000) 2024-06-03T00:07:29.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:28 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:28.750+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:29.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:28 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:28.750+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:29.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:28 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:28.750+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:29.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:28 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:28.750+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:29.210 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:28 smithi049 podman[102941]: 2024-06-03 00:07:28.973986449 +0000 UTC m=+0.428916988 container attach 02cdc83be8d006ba535d00a37e1578d3f57a1b37e3f9a78e7cdc5d9108dc3b0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6-deactivate, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-03T00:07:29.211 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:29 smithi049 podman[102941]: 2024-06-03 00:07:29.191092491 +0000 UTC m=+0.646023022 container died 02cdc83be8d006ba535d00a37e1578d3f57a1b37e3f9a78e7cdc5d9108dc3b0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-06-03T00:07:29.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:28 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:28.948+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:29.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:28 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:28.948+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:29.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:28 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:28.948+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:29.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:28 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:28.948+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:02.828834+0000 front 2024-06-03T00:07:02.828801+0000 (oldest deadline 2024-06-03T00:07:26.928828+0000) 2024-06-03T00:07:29.700 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:29 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:29.263+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.033802+0000 front 2024-06-03T00:06:44.033893+0000 (oldest deadline 2024-06-03T00:07:08.734061+0000) 2024-06-03T00:07:29.700 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:29 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:29.263+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.536175+0000 front 2024-06-03T00:06:54.536070+0000 (oldest deadline 2024-06-03T00:07:17.436270+0000) 2024-06-03T00:07:29.700 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:29 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:29.263+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:01.938826+0000 front 2024-06-03T00:07:01.938863+0000 (oldest deadline 2024-06-03T00:07:25.438674+0000) 2024-06-03T00:07:29.708 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.6.service' 2024-06-03T00:07:29.735 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:29 smithi049 podman[102968]: 2024-06-03 00:07:29.685704513 +0000 UTC m=+0.487560454 container remove 02cdc83be8d006ba535d00a37e1578d3f57a1b37e3f9a78e7cdc5d9108dc3b0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc) 2024-06-03T00:07:29.735 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:29 smithi049 systemd[1]: ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.6.service: Deactivated successfully. 2024-06-03T00:07:29.735 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:29 smithi049 systemd[1]: Stopped Ceph osd.6 for 890dd222-213a-11ef-bc9b-c7b262605968. 2024-06-03T00:07:29.735 INFO:journalctl@ceph.osd.6.smithi049.stdout:Jun 03 00:07:29 smithi049 systemd[1]: ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.6.service: Consumed 26.177s CPU time. 2024-06-03T00:07:29.748 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-03T00:07:29.748 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-06-03T00:07:29.749 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-06-03T00:07:29.749 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.7 2024-06-03T00:07:30.055 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:29 smithi057 systemd[1]: Stopping Ceph osd.7 for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-03T00:07:30.055 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:29 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:29.740+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:30.055 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:29 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:29.740+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:30.055 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:29 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:29.740+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:30.055 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:29 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:29.740+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:30.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:29 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:29.736+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:30.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:29 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:29.736+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:30.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:29 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:29.736+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:30.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:29 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:29.835+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:30.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:29 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:29.835+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:30.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:29 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:29.835+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.906076+0000 front 2024-06-03T00:06:52.905818+0000 (oldest deadline 2024-06-03T00:07:18.805971+0000) 2024-06-03T00:07:30.210 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:29 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:29.925+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:30.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:29 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:29.925+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:30.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:29 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:29.925+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:30.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:29 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:29.925+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:02.828834+0000 front 2024-06-03T00:07:02.828801+0000 (oldest deadline 2024-06-03T00:07:26.928828+0000) 2024-06-03T00:07:30.450 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:30 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:30.055+0000 7f730474a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-03T00:07:30.450 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:30 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:30.055+0000 7f730474a700 -1 osd.7 93 *** Got signal Terminated *** 2024-06-03T00:07:30.450 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:30 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:30.055+0000 7f730474a700 -1 osd.7 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-03T00:07:30.450 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:30 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:30.304+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.033802+0000 front 2024-06-03T00:06:44.033893+0000 (oldest deadline 2024-06-03T00:07:08.734061+0000) 2024-06-03T00:07:30.450 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:30 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:30.304+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.536175+0000 front 2024-06-03T00:06:54.536070+0000 (oldest deadline 2024-06-03T00:07:17.436270+0000) 2024-06-03T00:07:30.450 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:30 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:30.304+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:01.938826+0000 front 2024-06-03T00:07:01.938863+0000 (oldest deadline 2024-06-03T00:07:25.438674+0000) 2024-06-03T00:07:31.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:30 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:30.700+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:31.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:30 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:30.700+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:31.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:30 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:30.700+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:31.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:30 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:30.805+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:31.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:30 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:30.805+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:31.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:30 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:30.805+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.906076+0000 front 2024-06-03T00:06:52.905818+0000 (oldest deadline 2024-06-03T00:07:18.805971+0000) 2024-06-03T00:07:31.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:30 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:30.772+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:31.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:30 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:30.772+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:31.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:30 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:30.772+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:31.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:30 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:30.772+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:31.210 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:30 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:30.931+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:31.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:30 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:30.931+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:31.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:30 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:30.931+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:31.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:30 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:30.931+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:02.828834+0000 front 2024-06-03T00:07:02.828801+0000 (oldest deadline 2024-06-03T00:07:26.928828+0000) 2024-06-03T00:07:31.700 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:31 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:31.333+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.033802+0000 front 2024-06-03T00:06:44.033893+0000 (oldest deadline 2024-06-03T00:07:08.734061+0000) 2024-06-03T00:07:31.700 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:31 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:31.333+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.536175+0000 front 2024-06-03T00:06:54.536070+0000 (oldest deadline 2024-06-03T00:07:17.436270+0000) 2024-06-03T00:07:31.700 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:31 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:31.333+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:01.938826+0000 front 2024-06-03T00:07:01.938863+0000 (oldest deadline 2024-06-03T00:07:25.438674+0000) 2024-06-03T00:07:32.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:31 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:31.677+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:32.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:31 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:31.677+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:32.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:31 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:31.677+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:32.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:31 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:31.844+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:32.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:31 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:31.844+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:32.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:31 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:31.844+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.906076+0000 front 2024-06-03T00:06:52.905818+0000 (oldest deadline 2024-06-03T00:07:18.805971+0000) 2024-06-03T00:07:32.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:31 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:31.728+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:32.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:31 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:31.728+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:32.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:31 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:31.728+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:32.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:31 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:31.728+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:32.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:31 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:31.980+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:32.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:31 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:31.980+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:32.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:31 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:31.980+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:32.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:31 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:31.980+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:02.828834+0000 front 2024-06-03T00:07:02.828801+0000 (oldest deadline 2024-06-03T00:07:26.928828+0000) 2024-06-03T00:07:32.700 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:32 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:32.346+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.033802+0000 front 2024-06-03T00:06:44.033893+0000 (oldest deadline 2024-06-03T00:07:08.734061+0000) 2024-06-03T00:07:32.700 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:32 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:32.346+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.536175+0000 front 2024-06-03T00:06:54.536070+0000 (oldest deadline 2024-06-03T00:07:17.436270+0000) 2024-06-03T00:07:32.700 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:32 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:32.346+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:01.938826+0000 front 2024-06-03T00:07:01.938863+0000 (oldest deadline 2024-06-03T00:07:25.438674+0000) 2024-06-03T00:07:33.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:32 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:32.659+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:33.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:32 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:32.659+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:33.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:32 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:32.659+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:33.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:32 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:32.811+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:33.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:32 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:32.811+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:33.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:32 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:32.811+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.906076+0000 front 2024-06-03T00:06:52.905818+0000 (oldest deadline 2024-06-03T00:07:18.805971+0000) 2024-06-03T00:07:33.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:32 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:32.811+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:09.308277+0000 front 2024-06-03T00:07:09.308387+0000 (oldest deadline 2024-06-03T00:07:32.208269+0000) 2024-06-03T00:07:33.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:32 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:32.776+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:33.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:32 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:32.776+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:33.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:32 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:32.776+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:33.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:32 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:32.776+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:33.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:33 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:33.014+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:33.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:33 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:33.014+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:33.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:33 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:33.014+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:33.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:33 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:33.014+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:02.828834+0000 front 2024-06-03T00:07:02.828801+0000 (oldest deadline 2024-06-03T00:07:26.928828+0000) 2024-06-03T00:07:33.700 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:33 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:33.332+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.033802+0000 front 2024-06-03T00:06:44.033893+0000 (oldest deadline 2024-06-03T00:07:08.734061+0000) 2024-06-03T00:07:33.700 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:33 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:33.332+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.536175+0000 front 2024-06-03T00:06:54.536070+0000 (oldest deadline 2024-06-03T00:07:17.436270+0000) 2024-06-03T00:07:33.700 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:33 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:33.332+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:01.938826+0000 front 2024-06-03T00:07:01.938863+0000 (oldest deadline 2024-06-03T00:07:25.438674+0000) 2024-06-03T00:07:33.700 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:33 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:33.332+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.339634+0000 front 2024-06-03T00:07:08.339690+0000 (oldest deadline 2024-06-03T00:07:32.439790+0000) 2024-06-03T00:07:34.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:33 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:33.654+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:34.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:33 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:33.654+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:34.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:33 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:33.654+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:34.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:33 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:33.807+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:34.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:33 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:33.807+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:34.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:33 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:33.807+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.906076+0000 front 2024-06-03T00:06:52.905818+0000 (oldest deadline 2024-06-03T00:07:18.805971+0000) 2024-06-03T00:07:34.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:33 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:33.807+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:09.308277+0000 front 2024-06-03T00:07:09.308387+0000 (oldest deadline 2024-06-03T00:07:32.208269+0000) 2024-06-03T00:07:34.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:33 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:33.765+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:34.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:33 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:33.765+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:34.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:33 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:33.765+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:34.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:33 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:33.765+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:34.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:34 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:34.022+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:34.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:34 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:34.022+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:34.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:34 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:34.022+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:34.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:34 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:34.022+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:02.828834+0000 front 2024-06-03T00:07:02.828801+0000 (oldest deadline 2024-06-03T00:07:26.928828+0000) 2024-06-03T00:07:34.700 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:34 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:34.382+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.033802+0000 front 2024-06-03T00:06:44.033893+0000 (oldest deadline 2024-06-03T00:07:08.734061+0000) 2024-06-03T00:07:34.700 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:34 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:34.382+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.536175+0000 front 2024-06-03T00:06:54.536070+0000 (oldest deadline 2024-06-03T00:07:17.436270+0000) 2024-06-03T00:07:34.700 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:34 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:34.382+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:01.938826+0000 front 2024-06-03T00:07:01.938863+0000 (oldest deadline 2024-06-03T00:07:25.438674+0000) 2024-06-03T00:07:34.700 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:34 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7[54572]: 2024-06-03T00:07:34.382+0000 7f730153f700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.339634+0000 front 2024-06-03T00:07:08.339690+0000 (oldest deadline 2024-06-03T00:07:32.439790+0000) 2024-06-03T00:07:35.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:34 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:34.638+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:35.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:34 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:34.638+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:35.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:34 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:34.638+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:35.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:34 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:34.825+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:35.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:34 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:34.825+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:35.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:34 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:34.825+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.906076+0000 front 2024-06-03T00:06:52.905818+0000 (oldest deadline 2024-06-03T00:07:18.805971+0000) 2024-06-03T00:07:35.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:34 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:34.825+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:09.308277+0000 front 2024-06-03T00:07:09.308387+0000 (oldest deadline 2024-06-03T00:07:32.208269+0000) 2024-06-03T00:07:35.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:34 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:34.801+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:35.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:34 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:34.801+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:35.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:34 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:34.801+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:35.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:34 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:34.801+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:35.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:35 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:35.071+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:35.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:35 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:35.071+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:35.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:35 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:35.071+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:35.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:35 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:35.071+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:02.828834+0000 front 2024-06-03T00:07:02.828801+0000 (oldest deadline 2024-06-03T00:07:26.928828+0000) 2024-06-03T00:07:35.880 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:35 smithi057 podman[70887]: 2024-06-03 00:07:35.585686283 +0000 UTC m=+5.630382333 container died 55cc065f396d4274c063a7d7a7a9e0a3538f8b1c4d05f31dbe095a5deb968e5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux ) 2024-06-03T00:07:35.880 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:35 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:35.811+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:35.880 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:35 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:35.811+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:35.880 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:35 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:35.811+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:35.880 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:35 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:35.811+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:36.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:35 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:35.628+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:36.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:35 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:35.628+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:36.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:35 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:35.628+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:36.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:35 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:35.628+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.780034+0000 front 2024-06-03T00:07:08.780127+0000 (oldest deadline 2024-06-03T00:07:34.679834+0000) 2024-06-03T00:07:36.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:35 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:35.799+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:36.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:35 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:35.799+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:36.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:35 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:35.799+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.906076+0000 front 2024-06-03T00:06:52.905818+0000 (oldest deadline 2024-06-03T00:07:18.805971+0000) 2024-06-03T00:07:36.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:35 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:35.799+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:09.308277+0000 front 2024-06-03T00:07:09.308387+0000 (oldest deadline 2024-06-03T00:07:32.208269+0000) 2024-06-03T00:07:36.200 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:35 smithi057 podman[70887]: 2024-06-03 00:07:35.988388451 +0000 UTC m=+6.033084494 container cleanup 55cc065f396d4274c063a7d7a7a9e0a3538f8b1c4d05f31dbe095a5deb968e5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528) 2024-06-03T00:07:36.200 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:35 smithi057 bash[70887]: ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7 2024-06-03T00:07:36.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:36 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:36.088+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:36.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:36 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:36.088+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:36.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:36 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:36.088+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:36.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:36 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:36.088+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:02.828834+0000 front 2024-06-03T00:07:02.828801+0000 (oldest deadline 2024-06-03T00:07:26.928828+0000) 2024-06-03T00:07:36.553 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:36 smithi057 podman[70904]: 2024-06-03 00:07:36.206086972 +0000 UTC m=+0.612589050 container remove 55cc065f396d4274c063a7d7a7a9e0a3538f8b1c4d05f31dbe095a5deb968e5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2) 2024-06-03T00:07:36.838 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:36 smithi057 podman[70992]: 2024-06-03 00:07:36.457018258 +0000 UTC m=+0.017699993 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-03T00:07:36.838 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:36 smithi057 podman[70992]: 2024-06-03 00:07:36.565202905 +0000 UTC m=+0.125884661 container create 67cf445b7972b849493fbf7396871580b0511eb700f48230e4c98cbee7614bb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-06-03T00:07:36.838 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:36 smithi057 podman[70992]: 2024-06-03 00:07:36.767424335 +0000 UTC m=+0.328106044 container init 67cf445b7972b849493fbf7396871580b0511eb700f48230e4c98cbee7614bb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240528) 2024-06-03T00:07:36.838 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:36 smithi057 podman[70992]: 2024-06-03 00:07:36.770587876 +0000 UTC m=+0.331269590 container start 67cf445b7972b849493fbf7396871580b0511eb700f48230e4c98cbee7614bb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7-deactivate, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-06-03T00:07:37.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:36 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:36.669+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:37.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:36 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:36.669+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:37.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:36 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:36.669+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:37.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:36 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:36.669+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.780034+0000 front 2024-06-03T00:07:08.780127+0000 (oldest deadline 2024-06-03T00:07:34.679834+0000) 2024-06-03T00:07:37.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:36 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:36.798+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:37.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:36 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:36.798+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:37.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:36 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:36.798+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.906076+0000 front 2024-06-03T00:06:52.905818+0000 (oldest deadline 2024-06-03T00:07:18.805971+0000) 2024-06-03T00:07:37.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:36 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:36.798+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:09.308277+0000 front 2024-06-03T00:07:09.308387+0000 (oldest deadline 2024-06-03T00:07:32.208269+0000) 2024-06-03T00:07:37.200 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:36 smithi057 podman[70992]: 2024-06-03 00:07:36.842436445 +0000 UTC m=+0.403118182 container attach 67cf445b7972b849493fbf7396871580b0511eb700f48230e4c98cbee7614bb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-06-03T00:07:37.200 INFO:journalctl@ceph.osd.7.smithi057.stdout:Jun 03 00:07:37 smithi057 podman[70992]: 2024-06-03 00:07:37.06741607 +0000 UTC m=+0.628097792 container died 67cf445b7972b849493fbf7396871580b0511eb700f48230e4c98cbee7614bb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2) 2024-06-03T00:07:37.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:36 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:36.837+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:37.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:36 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:36.837+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:37.201 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:36 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:36.837+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:37.201 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:36 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:36.837+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:37.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:37 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:37.117+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:37.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:37 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:37.117+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:37.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:37 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:37.117+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:37.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:37 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:37.117+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:02.828834+0000 front 2024-06-03T00:07:02.828801+0000 (oldest deadline 2024-06-03T00:07:26.928828+0000) 2024-06-03T00:07:37.737 DEBUG:teuthology.orchestra.run.smithi057:> sudo pkill -f 'journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.7.service' 2024-06-03T00:07:37.775 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-03T00:07:37.775 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-06-03T00:07:37.775 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-06-03T00:07:37.775 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.8 2024-06-03T00:07:38.089 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:37 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:37.753+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:38.089 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:37 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:37.753+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:38.089 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:37 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:37.753+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.906076+0000 front 2024-06-03T00:06:52.905818+0000 (oldest deadline 2024-06-03T00:07:18.805971+0000) 2024-06-03T00:07:38.089 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:37 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:37.753+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:09.308277+0000 front 2024-06-03T00:07:09.308387+0000 (oldest deadline 2024-06-03T00:07:32.208269+0000) 2024-06-03T00:07:38.089 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:37 smithi107 systemd[1]: Stopping Ceph osd.8 for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-03T00:07:38.089 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:37 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:37.644+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:38.090 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:37 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:37.644+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:38.090 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:37 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:37.644+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:38.090 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:37 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:37.644+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.780034+0000 front 2024-06-03T00:07:08.780127+0000 (oldest deadline 2024-06-03T00:07:34.679834+0000) 2024-06-03T00:07:38.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:37 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:37.837+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:38.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:37 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:37.837+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:38.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:37 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:37.837+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:38.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:37 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:37.837+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:38.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:37 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:37.837+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:07.940777+0000 front 2024-06-03T00:07:07.940819+0000 (oldest deadline 2024-06-03T00:07:37.341485+0000) 2024-06-03T00:07:38.350 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:38 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:38.088+0000 7f6986862700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-03T00:07:38.351 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:38 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:38.088+0000 7f6986862700 -1 osd.8 93 *** Got signal Terminated *** 2024-06-03T00:07:38.351 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:38 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:38.088+0000 7f6986862700 -1 osd.8 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-03T00:07:38.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:38 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:38.151+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:38.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:38 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:38.151+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:38.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:38 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:38.151+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:38.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:38 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:38.151+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:02.828834+0000 front 2024-06-03T00:07:02.828801+0000 (oldest deadline 2024-06-03T00:07:26.928828+0000) 2024-06-03T00:07:39.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:38 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:38.795+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:39.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:38 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:38.795+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:39.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:38 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:38.795+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.906076+0000 front 2024-06-03T00:06:52.905818+0000 (oldest deadline 2024-06-03T00:07:18.805971+0000) 2024-06-03T00:07:39.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:38 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:38.795+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:09.308277+0000 front 2024-06-03T00:07:09.308387+0000 (oldest deadline 2024-06-03T00:07:32.208269+0000) 2024-06-03T00:07:39.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:38 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:38.640+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:39.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:38 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:38.640+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:39.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:38 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:38.640+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:39.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:38 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:38.640+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.780034+0000 front 2024-06-03T00:07:08.780127+0000 (oldest deadline 2024-06-03T00:07:34.679834+0000) 2024-06-03T00:07:39.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:38 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:38.819+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:39.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:38 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:38.819+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:39.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:38 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:38.819+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:39.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:38 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:38.819+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:39.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:38 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:38.819+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:07.940777+0000 front 2024-06-03T00:07:07.940819+0000 (oldest deadline 2024-06-03T00:07:37.341485+0000) 2024-06-03T00:07:39.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:39 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:39.172+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:39.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:39 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:39.172+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:39.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:39 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:39.172+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:39.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:39 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:39.172+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:02.828834+0000 front 2024-06-03T00:07:02.828801+0000 (oldest deadline 2024-06-03T00:07:26.928828+0000) 2024-06-03T00:07:40.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:39 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:39.602+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:40.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:39 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:39.602+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:40.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:39 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:39.602+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:40.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:39 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:39.602+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.780034+0000 front 2024-06-03T00:07:08.780127+0000 (oldest deadline 2024-06-03T00:07:34.679834+0000) 2024-06-03T00:07:40.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:39 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:39.838+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:40.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:39 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:39.838+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:40.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:39 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:39.838+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.906076+0000 front 2024-06-03T00:06:52.905818+0000 (oldest deadline 2024-06-03T00:07:18.805971+0000) 2024-06-03T00:07:40.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:39 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:39.838+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:09.308277+0000 front 2024-06-03T00:07:09.308387+0000 (oldest deadline 2024-06-03T00:07:32.208269+0000) 2024-06-03T00:07:40.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:39 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:39.780+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:40.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:39 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:39.780+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:40.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:39 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:39.780+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:40.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:39 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:39.780+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:40.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:39 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:39.780+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:07.940777+0000 front 2024-06-03T00:07:07.940819+0000 (oldest deadline 2024-06-03T00:07:37.341485+0000) 2024-06-03T00:07:40.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:40 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:40.160+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:40.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:40 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:40.160+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:40.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:40 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:40.160+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:40.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:40 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:40.160+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:02.828834+0000 front 2024-06-03T00:07:02.828801+0000 (oldest deadline 2024-06-03T00:07:26.928828+0000) 2024-06-03T00:07:41.002 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:40 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:40.869+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:41.002 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:40 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:40.869+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:41.002 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:40 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:40.869+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.906076+0000 front 2024-06-03T00:06:52.905818+0000 (oldest deadline 2024-06-03T00:07:18.805971+0000) 2024-06-03T00:07:41.002 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:40 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:40.869+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:09.308277+0000 front 2024-06-03T00:07:09.308387+0000 (oldest deadline 2024-06-03T00:07:32.208269+0000) 2024-06-03T00:07:41.002 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:40 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:40.639+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:41.002 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:40 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:40.639+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:41.003 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:40 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:40.639+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:41.003 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:40 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:40.640+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.780034+0000 front 2024-06-03T00:07:08.780127+0000 (oldest deadline 2024-06-03T00:07:34.679834+0000) 2024-06-03T00:07:41.003 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:40 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:40.640+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:14.680155+0000 front 2024-06-03T00:07:14.680233+0000 (oldest deadline 2024-06-03T00:07:39.980273+0000) 2024-06-03T00:07:41.101 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:40 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:40.825+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:41.101 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:40 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:40.825+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:41.102 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:40 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:40.825+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:41.102 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:40 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:40.825+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:41.102 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:40 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:40.825+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:07.940777+0000 front 2024-06-03T00:07:07.940819+0000 (oldest deadline 2024-06-03T00:07:37.341485+0000) 2024-06-03T00:07:41.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:41 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:41.149+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:41.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:41 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:41.149+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:41.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:41 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:41.149+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:41.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:41 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:41.149+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:02.828834+0000 front 2024-06-03T00:07:02.828801+0000 (oldest deadline 2024-06-03T00:07:26.928828+0000) 2024-06-03T00:07:42.017 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:41 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:41.874+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:42.017 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:41 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:41.874+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:42.017 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:41 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:41.874+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.906076+0000 front 2024-06-03T00:06:52.905818+0000 (oldest deadline 2024-06-03T00:07:18.805971+0000) 2024-06-03T00:07:42.017 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:41 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:41.874+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:09.308277+0000 front 2024-06-03T00:07:09.308387+0000 (oldest deadline 2024-06-03T00:07:32.208269+0000) 2024-06-03T00:07:42.018 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:41 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:41.874+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:16.309279+0000 front 2024-06-03T00:07:16.309355+0000 (oldest deadline 2024-06-03T00:07:41.609375+0000) 2024-06-03T00:07:42.018 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:41 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:41.660+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:42.018 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:41 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:41.660+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:42.018 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:41 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:41.660+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:42.018 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:41 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:41.660+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.780034+0000 front 2024-06-03T00:07:08.780127+0000 (oldest deadline 2024-06-03T00:07:34.679834+0000) 2024-06-03T00:07:42.018 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:41 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:41.660+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:14.680155+0000 front 2024-06-03T00:07:14.680233+0000 (oldest deadline 2024-06-03T00:07:39.980273+0000) 2024-06-03T00:07:42.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:41 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:41.869+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:42.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:41 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:41.869+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:42.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:41 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:41.869+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:42.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:41 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:41.869+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:42.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:41 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:41.869+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:07.940777+0000 front 2024-06-03T00:07:07.940819+0000 (oldest deadline 2024-06-03T00:07:37.341485+0000) 2024-06-03T00:07:42.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:42 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:42.137+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:42.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:42 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:42.137+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:42.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:42 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:42.137+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:42.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:42 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:42.137+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:02.828834+0000 front 2024-06-03T00:07:02.828801+0000 (oldest deadline 2024-06-03T00:07:26.928828+0000) 2024-06-03T00:07:43.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:42 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:42.666+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:43.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:42 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:42.666+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:43.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:42 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:42.666+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:43.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:42 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:42.666+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.780034+0000 front 2024-06-03T00:07:08.780127+0000 (oldest deadline 2024-06-03T00:07:34.679834+0000) 2024-06-03T00:07:43.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:42 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:42.666+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:14.680155+0000 front 2024-06-03T00:07:14.680233+0000 (oldest deadline 2024-06-03T00:07:39.980273+0000) 2024-06-03T00:07:43.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:42 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:42.843+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:38.403810+0000 front 2024-06-03T00:06:38.403750+0000 (oldest deadline 2024-06-03T00:07:02.503838+0000) 2024-06-03T00:07:43.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:42 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:42.843+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.705111+0000 front 2024-06-03T00:06:44.705131+0000 (oldest deadline 2024-06-03T00:07:08.805115+0000) 2024-06-03T00:07:43.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:42 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:42.844+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.906076+0000 front 2024-06-03T00:06:52.905818+0000 (oldest deadline 2024-06-03T00:07:18.805971+0000) 2024-06-03T00:07:43.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:42 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:42.844+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:09.308277+0000 front 2024-06-03T00:07:09.308387+0000 (oldest deadline 2024-06-03T00:07:32.208269+0000) 2024-06-03T00:07:43.101 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:42 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8[55878]: 2024-06-03T00:07:42.844+0000 7f6983657700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:16.309279+0000 front 2024-06-03T00:07:16.309355+0000 (oldest deadline 2024-06-03T00:07:41.609375+0000) 2024-06-03T00:07:43.199 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:42 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:42.907+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:43.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:42 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:42.907+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:43.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:42 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:42.907+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:43.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:42 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:42.907+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:43.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:42 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:42.907+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:07.940777+0000 front 2024-06-03T00:07:07.940819+0000 (oldest deadline 2024-06-03T00:07:37.341485+0000) 2024-06-03T00:07:43.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:43 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:43.108+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:43.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:43 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:43.108+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:43.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:43 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:43.108+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:43.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:43 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:43.108+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:02.828834+0000 front 2024-06-03T00:07:02.828801+0000 (oldest deadline 2024-06-03T00:07:26.928828+0000) 2024-06-03T00:07:43.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:43 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:43.108+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:17.530631+0000 front 2024-06-03T00:07:17.530642+0000 (oldest deadline 2024-06-03T00:07:42.830473+0000) 2024-06-03T00:07:43.822 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:43 smithi107 podman[72367]: 2024-06-03 00:07:43.505235571 +0000 UTC m=+5.541378317 container died d9c18b4fd0c19d277c9bbecc5df9c8f0425e90389a4a6602febfd2c99a35077d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8, RELEASE=squid-3d89acc, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-03T00:07:43.823 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:43 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:43.637+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:43.823 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:43 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:43.637+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:43.823 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:43 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:43.637+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:43.823 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:43 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:43.637+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.780034+0000 front 2024-06-03T00:07:08.780127+0000 (oldest deadline 2024-06-03T00:07:34.679834+0000) 2024-06-03T00:07:43.823 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:43 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:43.637+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:14.680155+0000 front 2024-06-03T00:07:14.680233+0000 (oldest deadline 2024-06-03T00:07:39.980273+0000) 2024-06-03T00:07:44.100 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:43 smithi107 podman[72367]: 2024-06-03 00:07:43.922506852 +0000 UTC m=+5.958649582 container cleanup d9c18b4fd0c19d277c9bbecc5df9c8f0425e90389a4a6602febfd2c99a35077d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-03T00:07:44.100 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:43 smithi107 bash[72367]: ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8 2024-06-03T00:07:44.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:43 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:43.936+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:44.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:43 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:43.936+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:44.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:43 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:43.936+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:44.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:43 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:43.936+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:44.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:43 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:43.936+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:07.940777+0000 front 2024-06-03T00:07:07.940819+0000 (oldest deadline 2024-06-03T00:07:37.341485+0000) 2024-06-03T00:07:44.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:43 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:43.936+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:19.042442+0000 front 2024-06-03T00:07:19.042600+0000 (oldest deadline 2024-06-03T00:07:43.742312+0000) 2024-06-03T00:07:44.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:44 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:44.107+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:44.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:44 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:44.107+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:44.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:44 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:44.107+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:44.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:44 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:44.107+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:02.828834+0000 front 2024-06-03T00:07:02.828801+0000 (oldest deadline 2024-06-03T00:07:26.928828+0000) 2024-06-03T00:07:44.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:44 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:44.107+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:17.530631+0000 front 2024-06-03T00:07:17.530642+0000 (oldest deadline 2024-06-03T00:07:42.830473+0000) 2024-06-03T00:07:44.574 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:44 smithi107 podman[72397]: 2024-06-03 00:07:44.14902142 +0000 UTC m=+0.636374321 container remove d9c18b4fd0c19d277c9bbecc5df9c8f0425e90389a4a6602febfd2c99a35077d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc) 2024-06-03T00:07:44.850 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:44 smithi107 podman[72485]: 2024-06-03 00:07:44.574818801 +0000 UTC m=+0.103300225 container create a400a965e24e537965dcc8998fa8e59b4f880a193ea8b8de5bb4d3a3913f31cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc) 2024-06-03T00:07:44.850 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:44 smithi107 podman[72485]: 2024-06-03 00:07:44.488476567 +0000 UTC m=+0.016958003 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-03T00:07:44.851 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:44 smithi107 podman[72485]: 2024-06-03 00:07:44.819714474 +0000 UTC m=+0.348195919 container init a400a965e24e537965dcc8998fa8e59b4f880a193ea8b8de5bb4d3a3913f31cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-03T00:07:44.851 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:44 smithi107 podman[72485]: 2024-06-03 00:07:44.822916186 +0000 UTC m=+0.351397621 container start a400a965e24e537965dcc8998fa8e59b4f880a193ea8b8de5bb4d3a3913f31cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, ceph=True, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-06-03T00:07:44.851 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:44.588+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:44.851 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:44.588+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:44.851 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:44.588+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:44.851 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:44.588+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.780034+0000 front 2024-06-03T00:07:08.780127+0000 (oldest deadline 2024-06-03T00:07:34.679834+0000) 2024-06-03T00:07:44.851 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:44.588+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:14.680155+0000 front 2024-06-03T00:07:14.680233+0000 (oldest deadline 2024-06-03T00:07:39.980273+0000) 2024-06-03T00:07:45.117 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:44 smithi107 podman[72485]: 2024-06-03 00:07:44.894085392 +0000 UTC m=+0.422566826 container attach a400a965e24e537965dcc8998fa8e59b4f880a193ea8b8de5bb4d3a3913f31cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-06-03T00:07:45.421 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:45 smithi107 podman[72485]: 2024-06-03 00:07:45.117936112 +0000 UTC m=+0.646417545 container died a400a965e24e537965dcc8998fa8e59b4f880a193ea8b8de5bb4d3a3913f31cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-03T00:07:45.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:44 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:44.978+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:45.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:44 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:44.978+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:45.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:44 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:44.978+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:45.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:44 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:44.978+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:45.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:44 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:44.978+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:07.940777+0000 front 2024-06-03T00:07:07.940819+0000 (oldest deadline 2024-06-03T00:07:37.341485+0000) 2024-06-03T00:07:45.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:44 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:44.978+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:19.042442+0000 front 2024-06-03T00:07:19.042600+0000 (oldest deadline 2024-06-03T00:07:43.742312+0000) 2024-06-03T00:07:45.460 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:45 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:45.098+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:45.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:45 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:45.098+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:45.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:45 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:45.098+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:45.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:45 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:45.098+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:02.828834+0000 front 2024-06-03T00:07:02.828801+0000 (oldest deadline 2024-06-03T00:07:26.928828+0000) 2024-06-03T00:07:45.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:45 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:45.098+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:17.530631+0000 front 2024-06-03T00:07:17.530642+0000 (oldest deadline 2024-06-03T00:07:42.830473+0000) 2024-06-03T00:07:45.675 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:45.597+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:45.675 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:45.597+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:45.675 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:45.597+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:45.675 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:45.597+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.780034+0000 front 2024-06-03T00:07:08.780127+0000 (oldest deadline 2024-06-03T00:07:34.679834+0000) 2024-06-03T00:07:45.675 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:45 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:45.597+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:14.680155+0000 front 2024-06-03T00:07:14.680233+0000 (oldest deadline 2024-06-03T00:07:39.980273+0000) 2024-06-03T00:07:45.675 INFO:journalctl@ceph.osd.8.smithi107.stdout:Jun 03 00:07:45 smithi107 podman[72510]: 2024-06-03 00:07:45.656446872 +0000 UTC m=+0.532344554 container remove a400a965e24e537965dcc8998fa8e59b4f880a193ea8b8de5bb4d3a3913f31cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-8-deactivate, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True) 2024-06-03T00:07:45.681 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.8.service' 2024-06-03T00:07:45.719 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-03T00:07:45.719 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-06-03T00:07:45.720 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-06-03T00:07:45.720 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.9 2024-06-03T00:07:46.020 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:45 smithi049 systemd[1]: Stopping Ceph osd.9 for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-03T00:07:46.021 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:46 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:46.019+0000 7ff19a3e5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-03T00:07:46.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:45 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:45.980+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:46.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:45 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:45.980+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:46.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:45 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:45.980+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:46.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:45 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:45.980+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:46.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:45 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:45.980+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:07.940777+0000 front 2024-06-03T00:07:07.940819+0000 (oldest deadline 2024-06-03T00:07:37.341485+0000) 2024-06-03T00:07:46.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:45 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:45.980+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:19.042442+0000 front 2024-06-03T00:07:19.042600+0000 (oldest deadline 2024-06-03T00:07:43.742312+0000) 2024-06-03T00:07:46.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:46 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:46.019+0000 7ff19a3e5700 -1 osd.9 93 *** Got signal Terminated *** 2024-06-03T00:07:46.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:46 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:46.019+0000 7ff19a3e5700 -1 osd.9 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-03T00:07:46.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:46 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:46.070+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:46.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:46 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:46.070+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:46.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:46 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:46.070+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:46.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:46 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:46.070+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:02.828834+0000 front 2024-06-03T00:07:02.828801+0000 (oldest deadline 2024-06-03T00:07:26.928828+0000) 2024-06-03T00:07:46.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:46 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:46.070+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:17.530631+0000 front 2024-06-03T00:07:17.530642+0000 (oldest deadline 2024-06-03T00:07:42.830473+0000) 2024-06-03T00:07:46.850 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:46.553+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:46.850 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:46.553+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:46.851 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:46.553+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:46.851 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:46.553+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.780034+0000 front 2024-06-03T00:07:08.780127+0000 (oldest deadline 2024-06-03T00:07:34.679834+0000) 2024-06-03T00:07:46.851 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:46 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:46.553+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:14.680155+0000 front 2024-06-03T00:07:14.680233+0000 (oldest deadline 2024-06-03T00:07:39.980273+0000) 2024-06-03T00:07:47.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:46 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:46.958+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:47.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:46 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:46.958+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:47.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:46 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:46.958+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:47.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:46 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:46.958+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:47.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:46 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:46.958+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:07.940777+0000 front 2024-06-03T00:07:07.940819+0000 (oldest deadline 2024-06-03T00:07:37.341485+0000) 2024-06-03T00:07:47.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:46 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:46.958+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:19.042442+0000 front 2024-06-03T00:07:19.042600+0000 (oldest deadline 2024-06-03T00:07:43.742312+0000) 2024-06-03T00:07:47.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:47 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:47.046+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:47.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:47 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:47.046+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:47.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:47 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:47.046+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:47.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:47 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:47.046+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:02.828834+0000 front 2024-06-03T00:07:02.828801+0000 (oldest deadline 2024-06-03T00:07:26.928828+0000) 2024-06-03T00:07:47.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:47 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:47.046+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:17.530631+0000 front 2024-06-03T00:07:17.530642+0000 (oldest deadline 2024-06-03T00:07:42.830473+0000) 2024-06-03T00:07:47.850 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:47 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:47.577+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:47.851 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:47 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:47.577+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:47.851 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:47 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:47.577+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:47.851 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:47 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:47.577+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.780034+0000 front 2024-06-03T00:07:08.780127+0000 (oldest deadline 2024-06-03T00:07:34.679834+0000) 2024-06-03T00:07:47.851 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:47 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:47.577+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:14.680155+0000 front 2024-06-03T00:07:14.680233+0000 (oldest deadline 2024-06-03T00:07:39.980273+0000) 2024-06-03T00:07:48.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:47 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:47.991+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:48.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:47 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:47.991+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:48.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:47 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:47.991+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:48.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:47 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:47.991+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:48.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:47 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:47.991+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:07.940777+0000 front 2024-06-03T00:07:07.940819+0000 (oldest deadline 2024-06-03T00:07:37.341485+0000) 2024-06-03T00:07:48.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:47 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:47.991+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:19.042442+0000 front 2024-06-03T00:07:19.042600+0000 (oldest deadline 2024-06-03T00:07:43.742312+0000) 2024-06-03T00:07:48.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:47 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:47.991+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-06-03T00:07:23.742990+0000 front 2024-06-03T00:07:23.742874+0000 (oldest deadline 2024-06-03T00:07:47.842810+0000) 2024-06-03T00:07:48.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:48 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:48.095+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:48.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:48 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:48.095+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:48.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:48 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:48.095+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:48.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:48 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:48.095+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:02.828834+0000 front 2024-06-03T00:07:02.828801+0000 (oldest deadline 2024-06-03T00:07:26.928828+0000) 2024-06-03T00:07:48.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:48 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:48.095+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:17.530631+0000 front 2024-06-03T00:07:17.530642+0000 (oldest deadline 2024-06-03T00:07:42.830473+0000) 2024-06-03T00:07:48.850 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:48 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:48.585+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:48.850 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:48 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:48.585+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:48.850 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:48 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:48.585+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:48.851 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:48 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:48.585+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.780034+0000 front 2024-06-03T00:07:08.780127+0000 (oldest deadline 2024-06-03T00:07:34.679834+0000) 2024-06-03T00:07:48.851 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:48 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:48.585+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:14.680155+0000 front 2024-06-03T00:07:14.680233+0000 (oldest deadline 2024-06-03T00:07:39.980273+0000) 2024-06-03T00:07:49.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:48 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:48.956+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:49.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:48 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:48.956+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:49.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:48 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:48.956+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:49.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:48 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:48.956+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:49.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:48 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:48.956+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:07.940777+0000 front 2024-06-03T00:07:07.940819+0000 (oldest deadline 2024-06-03T00:07:37.341485+0000) 2024-06-03T00:07:49.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:48 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:48.956+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:19.042442+0000 front 2024-06-03T00:07:19.042600+0000 (oldest deadline 2024-06-03T00:07:43.742312+0000) 2024-06-03T00:07:49.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:48 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:48.956+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-06-03T00:07:23.742990+0000 front 2024-06-03T00:07:23.742874+0000 (oldest deadline 2024-06-03T00:07:47.842810+0000) 2024-06-03T00:07:49.460 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:49 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:49.099+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:49.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:49 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:49.099+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:49.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:49 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:49.099+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:49.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:49 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:49.099+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:02.828834+0000 front 2024-06-03T00:07:02.828801+0000 (oldest deadline 2024-06-03T00:07:26.928828+0000) 2024-06-03T00:07:49.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:49 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:49.099+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:17.530631+0000 front 2024-06-03T00:07:17.530642+0000 (oldest deadline 2024-06-03T00:07:42.830473+0000) 2024-06-03T00:07:49.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:49 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:49.099+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-06-03T00:07:22.830788+0000 front 2024-06-03T00:07:22.830830+0000 (oldest deadline 2024-06-03T00:07:48.730905+0000) 2024-06-03T00:07:50.102 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:49 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:49.610+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:50.102 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:49 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:49.610+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:50.102 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:49 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:49.610+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:50.102 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:49 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:49.610+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.780034+0000 front 2024-06-03T00:07:08.780127+0000 (oldest deadline 2024-06-03T00:07:34.679834+0000) 2024-06-03T00:07:50.102 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:49 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:49.610+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:14.680155+0000 front 2024-06-03T00:07:14.680233+0000 (oldest deadline 2024-06-03T00:07:39.980273+0000) 2024-06-03T00:07:50.102 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:49 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:49.610+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-06-03T00:07:25.281582+0000 front 2024-06-03T00:07:25.281503+0000 (oldest deadline 2024-06-03T00:07:48.781419+0000) 2024-06-03T00:07:50.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:49 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:49.954+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:50.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:49 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:49.954+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:50.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:49 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:49.954+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:50.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:49 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:49.954+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:50.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:49 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:49.954+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:07.940777+0000 front 2024-06-03T00:07:07.940819+0000 (oldest deadline 2024-06-03T00:07:37.341485+0000) 2024-06-03T00:07:50.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:49 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:49.954+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:19.042442+0000 front 2024-06-03T00:07:19.042600+0000 (oldest deadline 2024-06-03T00:07:43.742312+0000) 2024-06-03T00:07:50.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:49 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:49.954+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-06-03T00:07:23.742990+0000 front 2024-06-03T00:07:23.742874+0000 (oldest deadline 2024-06-03T00:07:47.842810+0000) 2024-06-03T00:07:50.460 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:50 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:50.114+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:34.923865+0000 front 2024-06-03T00:06:34.923925+0000 (oldest deadline 2024-06-03T00:07:02.524783+0000) 2024-06-03T00:07:50.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:50 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:50.114+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:44.825826+0000 front 2024-06-03T00:06:44.825640+0000 (oldest deadline 2024-06-03T00:07:10.725673+0000) 2024-06-03T00:07:50.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:50 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:50.114+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:52.426930+0000 front 2024-06-03T00:06:52.426745+0000 (oldest deadline 2024-06-03T00:07:16.427413+0000) 2024-06-03T00:07:50.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:50 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:50.114+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:02.828834+0000 front 2024-06-03T00:07:02.828801+0000 (oldest deadline 2024-06-03T00:07:26.928828+0000) 2024-06-03T00:07:50.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:50 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:50.114+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:17.530631+0000 front 2024-06-03T00:07:17.530642+0000 (oldest deadline 2024-06-03T00:07:42.830473+0000) 2024-06-03T00:07:50.461 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:50 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9[64689]: 2024-06-03T00:07:50.114+0000 7ff1931d2700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-06-03T00:07:22.830788+0000 front 2024-06-03T00:07:22.830830+0000 (oldest deadline 2024-06-03T00:07:48.730905+0000) 2024-06-03T00:07:51.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:50 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:50.652+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:51.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:50 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:50.652+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:51.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:50 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:50.652+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:51.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:50 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:50.652+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.780034+0000 front 2024-06-03T00:07:08.780127+0000 (oldest deadline 2024-06-03T00:07:34.679834+0000) 2024-06-03T00:07:51.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:50 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:50.652+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:14.680155+0000 front 2024-06-03T00:07:14.680233+0000 (oldest deadline 2024-06-03T00:07:39.980273+0000) 2024-06-03T00:07:51.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:50 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:50.652+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-06-03T00:07:25.281582+0000 front 2024-06-03T00:07:25.281503+0000 (oldest deadline 2024-06-03T00:07:48.781419+0000) 2024-06-03T00:07:51.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:50 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:50.964+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:51.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:50 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:50.964+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:51.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:50 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:50.964+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:51.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:50 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:50.964+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:51.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:50 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:50.964+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:07.940777+0000 front 2024-06-03T00:07:07.940819+0000 (oldest deadline 2024-06-03T00:07:37.341485+0000) 2024-06-03T00:07:51.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:50 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:50.964+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:19.042442+0000 front 2024-06-03T00:07:19.042600+0000 (oldest deadline 2024-06-03T00:07:43.742312+0000) 2024-06-03T00:07:51.450 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:50 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:50.964+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-06-03T00:07:23.742990+0000 front 2024-06-03T00:07:23.742874+0000 (oldest deadline 2024-06-03T00:07:47.842810+0000) 2024-06-03T00:07:51.896 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:51 smithi049 podman[103046]: 2024-06-03 00:07:51.486147497 +0000 UTC m=+5.563514399 container died 2bcc89625e1ffc81f3a8284f2eaf001de012eccef6296cfd2735dba87e1c1601 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc) 2024-06-03T00:07:52.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:51 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:51.680+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:52.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:51 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:51.680+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:52.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:51 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:51.680+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:52.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:51 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:51.680+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.780034+0000 front 2024-06-03T00:07:08.780127+0000 (oldest deadline 2024-06-03T00:07:34.679834+0000) 2024-06-03T00:07:52.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:51 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:51.680+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:14.680155+0000 front 2024-06-03T00:07:14.680233+0000 (oldest deadline 2024-06-03T00:07:39.980273+0000) 2024-06-03T00:07:52.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:51 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:51.680+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-06-03T00:07:25.281582+0000 front 2024-06-03T00:07:25.281503+0000 (oldest deadline 2024-06-03T00:07:48.781419+0000) 2024-06-03T00:07:52.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:51 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:51.949+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:52.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:51 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:51.949+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:52.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:51 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:51.949+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:52.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:51 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:51.949+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:52.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:51 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:51.949+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:07.940777+0000 front 2024-06-03T00:07:07.940819+0000 (oldest deadline 2024-06-03T00:07:37.341485+0000) 2024-06-03T00:07:52.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:51 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:51.949+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:19.042442+0000 front 2024-06-03T00:07:19.042600+0000 (oldest deadline 2024-06-03T00:07:43.742312+0000) 2024-06-03T00:07:52.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:51 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:51.949+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-06-03T00:07:23.742990+0000 front 2024-06-03T00:07:23.742874+0000 (oldest deadline 2024-06-03T00:07:47.842810+0000) 2024-06-03T00:07:52.210 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:52 smithi049 podman[103046]: 2024-06-03 00:07:52.061954175 +0000 UTC m=+6.139321076 container cleanup 2bcc89625e1ffc81f3a8284f2eaf001de012eccef6296cfd2735dba87e1c1601 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-06-03T00:07:52.211 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:52 smithi049 bash[103046]: ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9 2024-06-03T00:07:52.696 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:52 smithi049 podman[103063]: 2024-06-03 00:07:52.321661127 +0000 UTC m=+0.824458503 container remove 2bcc89625e1ffc81f3a8284f2eaf001de012eccef6296cfd2735dba87e1c1601 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-06-03T00:07:52.960 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:52 smithi049 podman[103151]: 2024-06-03 00:07:52.600256736 +0000 UTC m=+0.017725114 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-03T00:07:52.961 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:52 smithi049 podman[103151]: 2024-06-03 00:07:52.805847457 +0000 UTC m=+0.223315808 container create cec49be12b0aacb321f870233eb358cbfa84ef52c0969ff4e2bbe31268168a60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9-deactivate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True) 2024-06-03T00:07:53.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:52 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:52.658+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:53.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:52 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:52.658+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:53.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:52 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:52.658+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:53.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:52 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:52.658+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.780034+0000 front 2024-06-03T00:07:08.780127+0000 (oldest deadline 2024-06-03T00:07:34.679834+0000) 2024-06-03T00:07:53.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:52 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:52.658+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:14.680155+0000 front 2024-06-03T00:07:14.680233+0000 (oldest deadline 2024-06-03T00:07:39.980273+0000) 2024-06-03T00:07:53.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:52 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:52.658+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-06-03T00:07:25.281582+0000 front 2024-06-03T00:07:25.281503+0000 (oldest deadline 2024-06-03T00:07:48.781419+0000) 2024-06-03T00:07:53.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:52 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:52.946+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:53.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:52 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:52.946+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:53.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:52 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:52.946+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:53.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:52 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:52.946+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:53.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:52 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:52.946+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:07.940777+0000 front 2024-06-03T00:07:07.940819+0000 (oldest deadline 2024-06-03T00:07:37.341485+0000) 2024-06-03T00:07:53.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:52 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:52.946+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:19.042442+0000 front 2024-06-03T00:07:19.042600+0000 (oldest deadline 2024-06-03T00:07:43.742312+0000) 2024-06-03T00:07:53.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:52 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:52.946+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-06-03T00:07:23.742990+0000 front 2024-06-03T00:07:23.742874+0000 (oldest deadline 2024-06-03T00:07:47.842810+0000) 2024-06-03T00:07:53.305 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:53 smithi049 podman[103151]: 2024-06-03 00:07:53.000300471 +0000 UTC m=+0.417768853 container init cec49be12b0aacb321f870233eb358cbfa84ef52c0969ff4e2bbe31268168a60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9-deactivate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD) 2024-06-03T00:07:53.305 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:53 smithi049 podman[103151]: 2024-06-03 00:07:53.00410036 +0000 UTC m=+0.421568727 container start cec49be12b0aacb321f870233eb358cbfa84ef52c0969ff4e2bbe31268168a60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9-deactivate, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-06-03T00:07:53.305 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:53 smithi049 podman[103151]: 2024-06-03 00:07:53.066589996 +0000 UTC m=+0.484058382 container attach cec49be12b0aacb321f870233eb358cbfa84ef52c0969ff4e2bbe31268168a60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc) 2024-06-03T00:07:53.594 INFO:journalctl@ceph.osd.9.smithi049.stdout:Jun 03 00:07:53 smithi049 podman[103151]: 2024-06-03 00:07:53.305745094 +0000 UTC m=+0.723213453 container died cec49be12b0aacb321f870233eb358cbfa84ef52c0969ff4e2bbe31268168a60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-03T00:07:53.916 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.9.service' 2024-06-03T00:07:53.957 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-03T00:07:53.957 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-06-03T00:07:53.958 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-06-03T00:07:53.958 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.10 2024-06-03T00:07:54.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:53 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:53.643+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:54.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:53 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:53.643+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:54.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:53 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:53.643+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:54.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:53 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:53.643+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.780034+0000 front 2024-06-03T00:07:08.780127+0000 (oldest deadline 2024-06-03T00:07:34.679834+0000) 2024-06-03T00:07:54.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:53 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:53.643+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:14.680155+0000 front 2024-06-03T00:07:14.680233+0000 (oldest deadline 2024-06-03T00:07:39.980273+0000) 2024-06-03T00:07:54.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:53 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:53.643+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-06-03T00:07:25.281582+0000 front 2024-06-03T00:07:25.281503+0000 (oldest deadline 2024-06-03T00:07:48.781419+0000) 2024-06-03T00:07:54.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:53 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:53.915+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:54.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:53 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:53.915+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:54.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:53 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:53.915+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:54.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:53 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:53.915+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:54.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:53 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:53.915+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:07.940777+0000 front 2024-06-03T00:07:07.940819+0000 (oldest deadline 2024-06-03T00:07:37.341485+0000) 2024-06-03T00:07:54.201 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:53 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:53.915+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:19.042442+0000 front 2024-06-03T00:07:19.042600+0000 (oldest deadline 2024-06-03T00:07:43.742312+0000) 2024-06-03T00:07:54.201 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:53 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:53.915+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-06-03T00:07:23.742990+0000 front 2024-06-03T00:07:23.742874+0000 (oldest deadline 2024-06-03T00:07:47.842810+0000) 2024-06-03T00:07:54.201 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:54 smithi057 systemd[1]: Stopping Ceph osd.10 for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-03T00:07:54.700 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:54 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:54.256+0000 7f289cb89700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-03T00:07:54.700 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:54 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:54.256+0000 7f289cb89700 -1 osd.10 93 *** Got signal Terminated *** 2024-06-03T00:07:54.700 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:54 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:54.256+0000 7f289cb89700 -1 osd.10 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-03T00:07:55.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:54 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:54.636+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:55.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:54 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:54.636+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:55.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:54 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:54.636+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:55.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:54 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:54.636+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.780034+0000 front 2024-06-03T00:07:08.780127+0000 (oldest deadline 2024-06-03T00:07:34.679834+0000) 2024-06-03T00:07:55.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:54 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:54.636+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:14.680155+0000 front 2024-06-03T00:07:14.680233+0000 (oldest deadline 2024-06-03T00:07:39.980273+0000) 2024-06-03T00:07:55.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:54 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:54.636+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-06-03T00:07:25.281582+0000 front 2024-06-03T00:07:25.281503+0000 (oldest deadline 2024-06-03T00:07:48.781419+0000) 2024-06-03T00:07:55.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:54 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:54.909+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:55.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:54 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:54.909+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:55.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:54 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:54.909+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:55.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:54 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:54.909+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:55.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:54 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:54.909+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:07.940777+0000 front 2024-06-03T00:07:07.940819+0000 (oldest deadline 2024-06-03T00:07:37.341485+0000) 2024-06-03T00:07:55.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:54 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:54.909+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:19.042442+0000 front 2024-06-03T00:07:19.042600+0000 (oldest deadline 2024-06-03T00:07:43.742312+0000) 2024-06-03T00:07:55.201 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:54 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:54.909+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-06-03T00:07:23.742990+0000 front 2024-06-03T00:07:23.742874+0000 (oldest deadline 2024-06-03T00:07:47.842810+0000) 2024-06-03T00:07:56.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:55 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:55.645+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:56.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:55 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:55.645+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:56.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:55 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:55.645+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:56.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:55 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:55.645+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.780034+0000 front 2024-06-03T00:07:08.780127+0000 (oldest deadline 2024-06-03T00:07:34.679834+0000) 2024-06-03T00:07:56.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:55 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:55.645+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:14.680155+0000 front 2024-06-03T00:07:14.680233+0000 (oldest deadline 2024-06-03T00:07:39.980273+0000) 2024-06-03T00:07:56.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:55 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:55.645+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-06-03T00:07:25.281582+0000 front 2024-06-03T00:07:25.281503+0000 (oldest deadline 2024-06-03T00:07:48.781419+0000) 2024-06-03T00:07:56.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:55 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:55.919+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:56.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:55 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:55.919+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:56.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:55 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:55.919+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:56.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:55 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:55.919+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:56.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:55 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:55.919+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:07.940777+0000 front 2024-06-03T00:07:07.940819+0000 (oldest deadline 2024-06-03T00:07:37.341485+0000) 2024-06-03T00:07:56.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:55 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:55.919+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:19.042442+0000 front 2024-06-03T00:07:19.042600+0000 (oldest deadline 2024-06-03T00:07:43.742312+0000) 2024-06-03T00:07:56.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:55 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:55.919+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-06-03T00:07:23.742990+0000 front 2024-06-03T00:07:23.742874+0000 (oldest deadline 2024-06-03T00:07:47.842810+0000) 2024-06-03T00:07:57.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:56 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:56.631+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:57.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:56 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:56.631+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:57.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:56 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:56.631+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:57.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:56 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:56.631+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.780034+0000 front 2024-06-03T00:07:08.780127+0000 (oldest deadline 2024-06-03T00:07:34.679834+0000) 2024-06-03T00:07:57.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:56 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:56.631+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:14.680155+0000 front 2024-06-03T00:07:14.680233+0000 (oldest deadline 2024-06-03T00:07:39.980273+0000) 2024-06-03T00:07:57.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:56 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:56.631+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-06-03T00:07:25.281582+0000 front 2024-06-03T00:07:25.281503+0000 (oldest deadline 2024-06-03T00:07:48.781419+0000) 2024-06-03T00:07:57.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:56 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:56.876+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:57.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:56 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:56.876+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:57.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:56 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:56.876+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:57.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:56 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:56.876+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:57.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:56 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:56.876+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:07.940777+0000 front 2024-06-03T00:07:07.940819+0000 (oldest deadline 2024-06-03T00:07:37.341485+0000) 2024-06-03T00:07:57.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:56 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:56.876+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:19.042442+0000 front 2024-06-03T00:07:19.042600+0000 (oldest deadline 2024-06-03T00:07:43.742312+0000) 2024-06-03T00:07:57.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:56 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:56.876+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-06-03T00:07:23.742990+0000 front 2024-06-03T00:07:23.742874+0000 (oldest deadline 2024-06-03T00:07:47.842810+0000) 2024-06-03T00:07:57.851 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:57 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:57.582+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:57.851 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:57 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:57.582+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:57.851 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:57 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:57.582+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:57.851 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:57 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:57.582+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.780034+0000 front 2024-06-03T00:07:08.780127+0000 (oldest deadline 2024-06-03T00:07:34.679834+0000) 2024-06-03T00:07:57.851 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:57 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:57.582+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:14.680155+0000 front 2024-06-03T00:07:14.680233+0000 (oldest deadline 2024-06-03T00:07:39.980273+0000) 2024-06-03T00:07:57.851 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:57 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:57.582+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-06-03T00:07:25.281582+0000 front 2024-06-03T00:07:25.281503+0000 (oldest deadline 2024-06-03T00:07:48.781419+0000) 2024-06-03T00:07:58.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:57 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:57.877+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:58.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:57 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:57.877+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:58.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:57 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:57.877+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:58.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:57 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:57.877+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:58.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:57 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:57.877+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:07.940777+0000 front 2024-06-03T00:07:07.940819+0000 (oldest deadline 2024-06-03T00:07:37.341485+0000) 2024-06-03T00:07:58.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:57 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:57.877+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:19.042442+0000 front 2024-06-03T00:07:19.042600+0000 (oldest deadline 2024-06-03T00:07:43.742312+0000) 2024-06-03T00:07:58.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:57 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:57.877+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-06-03T00:07:23.742990+0000 front 2024-06-03T00:07:23.742874+0000 (oldest deadline 2024-06-03T00:07:47.842810+0000) 2024-06-03T00:07:58.850 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:58 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:58.595+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:07:58.851 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:58 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:58.595+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:07:58.851 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:58 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:58.595+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:07:58.851 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:58 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:58.595+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.780034+0000 front 2024-06-03T00:07:08.780127+0000 (oldest deadline 2024-06-03T00:07:34.679834+0000) 2024-06-03T00:07:58.851 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:58 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:58.595+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:14.680155+0000 front 2024-06-03T00:07:14.680233+0000 (oldest deadline 2024-06-03T00:07:39.980273+0000) 2024-06-03T00:07:58.851 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:58 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:58.595+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-06-03T00:07:25.281582+0000 front 2024-06-03T00:07:25.281503+0000 (oldest deadline 2024-06-03T00:07:48.781419+0000) 2024-06-03T00:07:58.851 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:58 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:58.595+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6820 osd.7 since back 2024-06-03T00:07:32.182661+0000 front 2024-06-03T00:07:32.182716+0000 (oldest deadline 2024-06-03T00:07:58.082594+0000) 2024-06-03T00:07:59.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:58 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:58.878+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:37.934193+0000 front 2024-06-03T00:06:37.934296+0000 (oldest deadline 2024-06-03T00:07:04.334848+0000) 2024-06-03T00:07:59.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:58 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:58.878+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:46.536591+0000 front 2024-06-03T00:06:46.536616+0000 (oldest deadline 2024-06-03T00:07:08.836808+0000) 2024-06-03T00:07:59.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:58 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:58.878+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:54.638285+0000 front 2024-06-03T00:06:54.638249+0000 (oldest deadline 2024-06-03T00:07:17.538343+0000) 2024-06-03T00:07:59.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:58 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:58.878+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-06-03T00:07:00.439848+0000 front 2024-06-03T00:07:00.439585+0000 (oldest deadline 2024-06-03T00:07:25.139560+0000) 2024-06-03T00:07:59.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:58 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:58.878+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:07.940777+0000 front 2024-06-03T00:07:07.940819+0000 (oldest deadline 2024-06-03T00:07:37.341485+0000) 2024-06-03T00:07:59.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:58 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:58.878+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:19.042442+0000 front 2024-06-03T00:07:19.042600+0000 (oldest deadline 2024-06-03T00:07:43.742312+0000) 2024-06-03T00:07:59.200 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:58 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10[61321]: 2024-06-03T00:07:58.878+0000 7f289997e700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-06-03T00:07:23.742990+0000 front 2024-06-03T00:07:23.742874+0000 (oldest deadline 2024-06-03T00:07:47.842810+0000) 2024-06-03T00:07:59.975 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:07:59 smithi057 podman[71108]: 2024-06-03 00:07:59.712038065 +0000 UTC m=+5.550704216 container died 901387adb1d915bf55d97939e2d9ee4084add36d7bb6db2134d4d1874d3ac612 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True) 2024-06-03T00:08:00.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:59 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:59.626+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:08:00.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:59 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:59.626+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:08:00.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:59 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:59.626+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:08:00.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:59 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:59.626+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.780034+0000 front 2024-06-03T00:07:08.780127+0000 (oldest deadline 2024-06-03T00:07:34.679834+0000) 2024-06-03T00:08:00.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:59 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:59.626+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:14.680155+0000 front 2024-06-03T00:07:14.680233+0000 (oldest deadline 2024-06-03T00:07:39.980273+0000) 2024-06-03T00:08:00.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:59 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:59.626+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-06-03T00:07:25.281582+0000 front 2024-06-03T00:07:25.281503+0000 (oldest deadline 2024-06-03T00:07:48.781419+0000) 2024-06-03T00:08:00.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:07:59 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:07:59.626+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6820 osd.7 since back 2024-06-03T00:07:32.182661+0000 front 2024-06-03T00:07:32.182716+0000 (oldest deadline 2024-06-03T00:07:58.082594+0000) 2024-06-03T00:08:00.341 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:08:00 smithi057 podman[71108]: 2024-06-03 00:08:00.081705488 +0000 UTC m=+5.920371639 container cleanup 901387adb1d915bf55d97939e2d9ee4084add36d7bb6db2134d4d1874d3ac612 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-06-03T00:08:00.341 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:08:00 smithi057 bash[71108]: ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10 2024-06-03T00:08:00.700 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:08:00 smithi057 podman[71125]: 2024-06-03 00:08:00.34189917 +0000 UTC m=+0.626967296 container remove 901387adb1d915bf55d97939e2d9ee4084add36d7bb6db2134d4d1874d3ac612 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-03T00:08:00.970 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:08:00 smithi057 podman[71213]: 2024-06-03 00:08:00.615087967 +0000 UTC m=+0.017654625 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-03T00:08:00.970 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:08:00 smithi057 podman[71213]: 2024-06-03 00:08:00.717618353 +0000 UTC m=+0.120185009 container create a3b2cd7d78abc1b8a83037c332068453ee95e12b1208e1dd20b3b088a85d47f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10-deactivate, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-03T00:08:01.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:00 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:00.670+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:08:01.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:00 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:00.670+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:08:01.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:00 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:00.670+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:08:01.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:00 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:00.670+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.780034+0000 front 2024-06-03T00:07:08.780127+0000 (oldest deadline 2024-06-03T00:07:34.679834+0000) 2024-06-03T00:08:01.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:00 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:00.670+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:14.680155+0000 front 2024-06-03T00:07:14.680233+0000 (oldest deadline 2024-06-03T00:07:39.980273+0000) 2024-06-03T00:08:01.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:00 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:00.670+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-06-03T00:07:25.281582+0000 front 2024-06-03T00:07:25.281503+0000 (oldest deadline 2024-06-03T00:07:48.781419+0000) 2024-06-03T00:08:01.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:00 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:00.670+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6820 osd.7 since back 2024-06-03T00:07:32.182661+0000 front 2024-06-03T00:07:32.182716+0000 (oldest deadline 2024-06-03T00:07:58.082594+0000) 2024-06-03T00:08:01.364 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:08:01 smithi057 podman[71213]: 2024-06-03 00:08:01.062320118 +0000 UTC m=+0.464886768 container init a3b2cd7d78abc1b8a83037c332068453ee95e12b1208e1dd20b3b088a85d47f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10-deactivate, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, ceph=True) 2024-06-03T00:08:01.364 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:08:01 smithi057 podman[71213]: 2024-06-03 00:08:01.065551488 +0000 UTC m=+0.468118145 container start a3b2cd7d78abc1b8a83037c332068453ee95e12b1208e1dd20b3b088a85d47f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10-deactivate, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux ) 2024-06-03T00:08:01.364 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:08:01 smithi057 podman[71213]: 2024-06-03 00:08:01.146095203 +0000 UTC m=+0.548661868 container attach a3b2cd7d78abc1b8a83037c332068453ee95e12b1208e1dd20b3b088a85d47f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10-deactivate, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-06-03T00:08:01.648 INFO:journalctl@ceph.osd.10.smithi057.stdout:Jun 03 00:08:01 smithi057 podman[71213]: 2024-06-03 00:08:01.365596618 +0000 UTC m=+0.768163278 container died a3b2cd7d78abc1b8a83037c332068453ee95e12b1208e1dd20b3b088a85d47f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-10-deactivate, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528) 2024-06-03T00:08:01.948 DEBUG:teuthology.orchestra.run.smithi057:> sudo pkill -f 'journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.10.service' 2024-06-03T00:08:01.988 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-03T00:08:01.988 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-06-03T00:08:01.988 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-06-03T00:08:01.988 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.11 2024-06-03T00:08:02.014 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:01 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:01.715+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:08:02.014 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:01 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:01.715+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:08:02.014 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:01 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:01.715+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:08:02.014 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:01 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:01.715+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.780034+0000 front 2024-06-03T00:07:08.780127+0000 (oldest deadline 2024-06-03T00:07:34.679834+0000) 2024-06-03T00:08:02.015 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:01 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:01.715+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:14.680155+0000 front 2024-06-03T00:07:14.680233+0000 (oldest deadline 2024-06-03T00:07:39.980273+0000) 2024-06-03T00:08:02.015 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:01 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:01.715+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-06-03T00:07:25.281582+0000 front 2024-06-03T00:07:25.281503+0000 (oldest deadline 2024-06-03T00:07:48.781419+0000) 2024-06-03T00:08:02.015 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:01 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:01.715+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6820 osd.7 since back 2024-06-03T00:07:32.182661+0000 front 2024-06-03T00:07:32.182716+0000 (oldest deadline 2024-06-03T00:07:58.082594+0000) 2024-06-03T00:08:02.299 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:02 smithi107 systemd[1]: Stopping Ceph osd.11 for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-03T00:08:02.600 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:02 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:02.299+0000 7f8b21ee4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-03T00:08:02.600 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:02 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:02.299+0000 7f8b21ee4700 -1 osd.11 93 *** Got signal Terminated *** 2024-06-03T00:08:02.601 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:02 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:02.299+0000 7f8b21ee4700 -1 osd.11 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-03T00:08:03.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:02 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:02.666+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:08:03.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:02 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:02.666+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:08:03.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:02 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:02.666+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:08:03.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:02 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:02.666+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.780034+0000 front 2024-06-03T00:07:08.780127+0000 (oldest deadline 2024-06-03T00:07:34.679834+0000) 2024-06-03T00:08:03.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:02 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:02.666+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:14.680155+0000 front 2024-06-03T00:07:14.680233+0000 (oldest deadline 2024-06-03T00:07:39.980273+0000) 2024-06-03T00:08:03.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:02 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:02.666+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-06-03T00:07:25.281582+0000 front 2024-06-03T00:07:25.281503+0000 (oldest deadline 2024-06-03T00:07:48.781419+0000) 2024-06-03T00:08:03.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:02 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:02.666+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6820 osd.7 since back 2024-06-03T00:07:32.182661+0000 front 2024-06-03T00:07:32.182716+0000 (oldest deadline 2024-06-03T00:07:58.082594+0000) 2024-06-03T00:08:04.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:03 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:03.654+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:08:04.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:03 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:03.654+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:08:04.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:03 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:03.654+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:08:04.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:03 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:03.654+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.780034+0000 front 2024-06-03T00:07:08.780127+0000 (oldest deadline 2024-06-03T00:07:34.679834+0000) 2024-06-03T00:08:04.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:03 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:03.654+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:14.680155+0000 front 2024-06-03T00:07:14.680233+0000 (oldest deadline 2024-06-03T00:07:39.980273+0000) 2024-06-03T00:08:04.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:03 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:03.654+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-06-03T00:07:25.281582+0000 front 2024-06-03T00:07:25.281503+0000 (oldest deadline 2024-06-03T00:07:48.781419+0000) 2024-06-03T00:08:04.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:03 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:03.654+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6820 osd.7 since back 2024-06-03T00:07:32.182661+0000 front 2024-06-03T00:07:32.182716+0000 (oldest deadline 2024-06-03T00:07:58.082594+0000) 2024-06-03T00:08:05.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:04 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:04.644+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:08:05.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:04 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:04.644+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:08:05.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:04 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:04.644+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:08:05.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:04 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:04.644+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.780034+0000 front 2024-06-03T00:07:08.780127+0000 (oldest deadline 2024-06-03T00:07:34.679834+0000) 2024-06-03T00:08:05.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:04 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:04.644+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:14.680155+0000 front 2024-06-03T00:07:14.680233+0000 (oldest deadline 2024-06-03T00:07:39.980273+0000) 2024-06-03T00:08:05.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:04 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:04.644+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-06-03T00:07:25.281582+0000 front 2024-06-03T00:07:25.281503+0000 (oldest deadline 2024-06-03T00:07:48.781419+0000) 2024-06-03T00:08:05.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:04 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:04.644+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6820 osd.7 since back 2024-06-03T00:07:32.182661+0000 front 2024-06-03T00:07:32.182716+0000 (oldest deadline 2024-06-03T00:07:58.082594+0000) 2024-06-03T00:08:06.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:05 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:05.670+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:08:06.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:05 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:05.670+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:08:06.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:05 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:05.670+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:08:06.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:05 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:05.670+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.780034+0000 front 2024-06-03T00:07:08.780127+0000 (oldest deadline 2024-06-03T00:07:34.679834+0000) 2024-06-03T00:08:06.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:05 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:05.670+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:14.680155+0000 front 2024-06-03T00:07:14.680233+0000 (oldest deadline 2024-06-03T00:07:39.980273+0000) 2024-06-03T00:08:06.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:05 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:05.670+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-06-03T00:07:25.281582+0000 front 2024-06-03T00:07:25.281503+0000 (oldest deadline 2024-06-03T00:07:48.781419+0000) 2024-06-03T00:08:06.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:05 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:05.670+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6820 osd.7 since back 2024-06-03T00:07:32.182661+0000 front 2024-06-03T00:07:32.182716+0000 (oldest deadline 2024-06-03T00:07:58.082594+0000) 2024-06-03T00:08:07.100 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:06 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:06.647+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-06-03T00:06:36.476250+0000 front 2024-06-03T00:06:36.476279+0000 (oldest deadline 2024-06-03T00:07:02.376258+0000) 2024-06-03T00:08:07.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:06 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:06.647+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2024-06-03T00:06:47.077391+0000 front 2024-06-03T00:06:47.077552+0000 (oldest deadline 2024-06-03T00:07:11.177407+0000) 2024-06-03T00:08:07.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:06 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:06.647+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-06-03T00:06:53.478500+0000 front 2024-06-03T00:06:53.478551+0000 (oldest deadline 2024-06-03T00:07:16.978643+0000) 2024-06-03T00:08:07.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:06 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:06.647+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2024-06-03T00:07:08.780034+0000 front 2024-06-03T00:07:08.780127+0000 (oldest deadline 2024-06-03T00:07:34.679834+0000) 2024-06-03T00:08:07.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:06 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:06.647+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-06-03T00:07:14.680155+0000 front 2024-06-03T00:07:14.680233+0000 (oldest deadline 2024-06-03T00:07:39.980273+0000) 2024-06-03T00:08:07.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:06 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:06.647+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-06-03T00:07:25.281582+0000 front 2024-06-03T00:07:25.281503+0000 (oldest deadline 2024-06-03T00:07:48.781419+0000) 2024-06-03T00:08:07.101 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:06 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11[62495]: 2024-06-03T00:08:06.647+0000 7f8b1ecd9700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.57:6820 osd.7 since back 2024-06-03T00:07:32.182661+0000 front 2024-06-03T00:07:32.182716+0000 (oldest deadline 2024-06-03T00:07:58.082594+0000) 2024-06-03T00:08:08.017 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:07 smithi107 podman[72590]: 2024-06-03 00:08:07.754295132 +0000 UTC m=+5.572788527 container died 2f7dc8531e619f02b0b156ebc48d6ad3a5356470cdbb30b071e1df7a6421c166 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-06-03T00:08:08.274 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:08 smithi107 podman[72590]: 2024-06-03 00:08:08.090484274 +0000 UTC m=+5.908977687 container cleanup 2f7dc8531e619f02b0b156ebc48d6ad3a5356470cdbb30b071e1df7a6421c166 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-03T00:08:08.274 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:08 smithi107 bash[72590]: ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11 2024-06-03T00:08:08.600 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:08 smithi107 podman[72606]: 2024-06-03 00:08:08.274983187 +0000 UTC m=+0.518326270 container remove 2f7dc8531e619f02b0b156ebc48d6ad3a5356470cdbb30b071e1df7a6421c166 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528) 2024-06-03T00:08:08.939 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:08 smithi107 podman[72692]: 2024-06-03 00:08:08.589546944 +0000 UTC m=+0.016737656 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-03T00:08:08.939 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:08 smithi107 podman[72692]: 2024-06-03 00:08:08.692671042 +0000 UTC m=+0.119861739 container create 78ea37282af57e20a25c053488f64ccaefd1a91191168b7e9fa733245bee032d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=) 2024-06-03T00:08:08.940 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:08 smithi107 podman[72692]: 2024-06-03 00:08:08.937112833 +0000 UTC m=+0.364303534 container init 78ea37282af57e20a25c053488f64ccaefd1a91191168b7e9fa733245bee032d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11-deactivate, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=) 2024-06-03T00:08:08.940 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:08 smithi107 podman[72692]: 2024-06-03 00:08:08.940311807 +0000 UTC m=+0.367502510 container start 78ea37282af57e20a25c053488f64ccaefd1a91191168b7e9fa733245bee032d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11-deactivate, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-03T00:08:09.234 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:09 smithi107 podman[72692]: 2024-06-03 00:08:09.037077701 +0000 UTC m=+0.464268426 container attach 78ea37282af57e20a25c053488f64ccaefd1a91191168b7e9fa733245bee032d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11-deactivate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0) 2024-06-03T00:08:09.600 INFO:journalctl@ceph.osd.11.smithi107.stdout:Jun 03 00:08:09 smithi107 podman[72692]: 2024-06-03 00:08:09.235522582 +0000 UTC m=+0.662713290 container died 78ea37282af57e20a25c053488f64ccaefd1a91191168b7e9fa733245bee032d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240528) 2024-06-03T00:08:09.754 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@osd.11.service' 2024-06-03T00:08:09.831 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-03T00:08:09.832 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-06-03T00:08:09.832 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-06-03T00:08:09.832 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.a 2024-06-03T00:08:10.137 INFO:journalctl@ceph.mds.a.smithi049.stdout:Jun 03 00:08:09 smithi049 systemd[1]: Stopping Ceph mds.a for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-03T00:08:10.461 INFO:journalctl@ceph.mds.a.smithi049.stdout:Jun 03 00:08:10 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-a[71984]: 2024-06-03T00:08:10.137+0000 7fb64ed00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-03T00:08:10.461 INFO:journalctl@ceph.mds.a.smithi049.stdout:Jun 03 00:08:10 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-a[71984]: 2024-06-03T00:08:10.137+0000 7fb64ed00700 -1 mds.a *** got signal Terminated *** 2024-06-03T00:08:12.021 INFO:journalctl@ceph.mds.a.smithi049.stdout:Jun 03 00:08:11 smithi049 podman[103256]: 2024-06-03 00:08:11.737443239 +0000 UTC m=+1.696766129 container died 0dc3af67f43956d95107566364a929ae3f3b09f138743199dc5d0fac15804573 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-a, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-06-03T00:08:12.354 INFO:journalctl@ceph.mds.a.smithi049.stdout:Jun 03 00:08:12 smithi049 podman[103256]: 2024-06-03 00:08:12.178909062 +0000 UTC m=+2.138231951 container cleanup 0dc3af67f43956d95107566364a929ae3f3b09f138743199dc5d0fac15804573 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-a, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-03T00:08:12.355 INFO:journalctl@ceph.mds.a.smithi049.stdout:Jun 03 00:08:12 smithi049 bash[103256]: ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-a 2024-06-03T00:08:12.606 INFO:journalctl@ceph.mds.a.smithi049.stdout:Jun 03 00:08:12 smithi049 podman[103270]: 2024-06-03 00:08:12.355285028 +0000 UTC m=+0.615669943 container remove 0dc3af67f43956d95107566364a929ae3f3b09f138743199dc5d0fac15804573 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-a, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS) 2024-06-03T00:08:12.608 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.a.service' 2024-06-03T00:08:12.645 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-03T00:08:12.739 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-06-03T00:08:12.740 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-06-03T00:08:12.740 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.d 2024-06-03T00:08:12.961 INFO:journalctl@ceph.mds.d.smithi049.stdout:Jun 03 00:08:12 smithi049 systemd[1]: Stopping Ceph mds.d for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-03T00:08:13.461 INFO:journalctl@ceph.mds.d.smithi049.stdout:Jun 03 00:08:13 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-d[70750]: 2024-06-03T00:08:13.033+0000 7f2b5aa0a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-03T00:08:13.461 INFO:journalctl@ceph.mds.d.smithi049.stdout:Jun 03 00:08:13 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-d[70750]: 2024-06-03T00:08:13.033+0000 7f2b5aa0a700 -1 mds.d *** got signal Terminated *** 2024-06-03T00:08:15.308 INFO:journalctl@ceph.mds.d.smithi049.stdout:Jun 03 00:08:15 smithi049 podman[103378]: 2024-06-03 00:08:15.053501723 +0000 UTC m=+2.123662194 container died f2a6c972aeab8f66d73a2655574b32bca528fbed9f6d3f945e754dc822dcf4e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-d, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-03T00:08:15.575 INFO:journalctl@ceph.mds.d.smithi049.stdout:Jun 03 00:08:15 smithi049 podman[103378]: 2024-06-03 00:08:15.391237226 +0000 UTC m=+2.461397691 container cleanup f2a6c972aeab8f66d73a2655574b32bca528fbed9f6d3f945e754dc822dcf4e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-d, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528) 2024-06-03T00:08:15.575 INFO:journalctl@ceph.mds.d.smithi049.stdout:Jun 03 00:08:15 smithi049 bash[103378]: ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-d 2024-06-03T00:08:15.835 INFO:journalctl@ceph.mds.d.smithi049.stdout:Jun 03 00:08:15 smithi049 podman[103391]: 2024-06-03 00:08:15.575581731 +0000 UTC m=+0.522839498 container remove f2a6c972aeab8f66d73a2655574b32bca528fbed9f6d3f945e754dc822dcf4e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-d, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-03T00:08:15.839 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.d.service' 2024-06-03T00:08:15.873 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-03T00:08:15.873 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-06-03T00:08:15.873 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-06-03T00:08:15.873 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.g 2024-06-03T00:08:16.194 INFO:journalctl@ceph.mds.g.smithi049.stdout:Jun 03 00:08:15 smithi049 systemd[1]: Stopping Ceph mds.g for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-03T00:08:16.460 INFO:journalctl@ceph.mds.g.smithi049.stdout:Jun 03 00:08:16 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-g[71567]: 2024-06-03T00:08:16.193+0000 7f35423c1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-03T00:08:16.461 INFO:journalctl@ceph.mds.g.smithi049.stdout:Jun 03 00:08:16 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-g[71567]: 2024-06-03T00:08:16.193+0000 7f35423c1700 -1 mds.g *** got signal Terminated *** 2024-06-03T00:08:19.994 INFO:journalctl@ceph.mds.g.smithi049.stdout:Jun 03 00:08:19 smithi049 podman[103499]: 2024-06-03 00:08:19.724719642 +0000 UTC m=+3.628837645 container died c1a3cb848b3f0084e211862f34d1d0e69f59f2fe34084b28ee4c35c4468d75a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-g, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-06-03T00:08:20.362 INFO:journalctl@ceph.mds.g.smithi049.stdout:Jun 03 00:08:20 smithi049 podman[103499]: 2024-06-03 00:08:20.128088164 +0000 UTC m=+4.032206167 container cleanup c1a3cb848b3f0084e211862f34d1d0e69f59f2fe34084b28ee4c35c4468d75a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-g, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True) 2024-06-03T00:08:20.362 INFO:journalctl@ceph.mds.g.smithi049.stdout:Jun 03 00:08:20 smithi049 bash[103499]: ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-g 2024-06-03T00:08:20.518 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.g.service' 2024-06-03T00:08:20.552 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-03T00:08:20.552 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-06-03T00:08:20.552 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-06-03T00:08:20.552 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.j 2024-06-03T00:08:20.865 INFO:journalctl@ceph.mds.j.smithi049.stdout:Jun 03 00:08:20 smithi049 systemd[1]: Stopping Ceph mds.j for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-03T00:08:21.210 INFO:journalctl@ceph.mds.j.smithi049.stdout:Jun 03 00:08:20 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-j[70279]: 2024-06-03T00:08:20.864+0000 7f5add3fd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-03T00:08:21.211 INFO:journalctl@ceph.mds.j.smithi049.stdout:Jun 03 00:08:20 smithi049 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-j[70279]: 2024-06-03T00:08:20.864+0000 7f5add3fd700 -1 mds.j *** got signal Terminated *** 2024-06-03T00:08:23.210 INFO:journalctl@ceph.mds.j.smithi049.stdout:Jun 03 00:08:22 smithi049 podman[103623]: 2024-06-03 00:08:22.95583848 +0000 UTC m=+2.173172331 container died d6d1f578f6af536de0d53b0ba8b1e0598dbcd20c9addb7854003be2b18b69acb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-j, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-06-03T00:08:23.591 INFO:journalctl@ceph.mds.j.smithi049.stdout:Jun 03 00:08:23 smithi049 podman[103623]: 2024-06-03 00:08:23.39915779 +0000 UTC m=+2.616491706 container cleanup d6d1f578f6af536de0d53b0ba8b1e0598dbcd20c9addb7854003be2b18b69acb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-j, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-06-03T00:08:23.592 INFO:journalctl@ceph.mds.j.smithi049.stdout:Jun 03 00:08:23 smithi049 bash[103623]: ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-j 2024-06-03T00:08:23.830 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.j.service' 2024-06-03T00:08:23.852 INFO:journalctl@ceph.mds.j.smithi049.stdout:Jun 03 00:08:23 smithi049 podman[103635]: 2024-06-03 00:08:23.592006629 +0000 UTC m=+0.627343450 container remove d6d1f578f6af536de0d53b0ba8b1e0598dbcd20c9addb7854003be2b18b69acb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-j, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-03T00:08:23.852 INFO:journalctl@ceph.mds.j.smithi049.stdout:Jun 03 00:08:23 smithi049 systemd[1]: ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.j.service: Deactivated successfully. 2024-06-03T00:08:23.852 INFO:journalctl@ceph.mds.j.smithi049.stdout:Jun 03 00:08:23 smithi049 systemd[1]: Stopped Ceph mds.j for 890dd222-213a-11ef-bc9b-c7b262605968. 2024-06-03T00:08:23.852 INFO:journalctl@ceph.mds.j.smithi049.stdout:Jun 03 00:08:23 smithi049 systemd[1]: ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.j.service: Consumed 1.014s CPU time. 2024-06-03T00:08:23.863 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-03T00:08:23.863 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-06-03T00:08:23.863 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-06-03T00:08:23.863 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.b 2024-06-03T00:08:24.167 INFO:journalctl@ceph.mds.b.smithi057.stdout:Jun 03 00:08:23 smithi057 systemd[1]: Stopping Ceph mds.b for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-03T00:08:24.450 INFO:journalctl@ceph.mds.b.smithi057.stdout:Jun 03 00:08:24 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-b[66528]: 2024-06-03T00:08:24.166+0000 7f3556124700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-03T00:08:24.450 INFO:journalctl@ceph.mds.b.smithi057.stdout:Jun 03 00:08:24 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-b[66528]: 2024-06-03T00:08:24.166+0000 7f3556124700 -1 mds.b *** got signal Terminated *** 2024-06-03T00:08:28.126 INFO:journalctl@ceph.mds.b.smithi057.stdout:Jun 03 00:08:27 smithi057 podman[71318]: 2024-06-03 00:08:27.736957633 +0000 UTC m=+3.678270835 container died 46ad7000e829c8b0af1082628ee6465ff97c764c5183595b02966525981a43ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-06-03T00:08:28.450 INFO:journalctl@ceph.mds.b.smithi057.stdout:Jun 03 00:08:28 smithi057 podman[71318]: 2024-06-03 00:08:28.216801778 +0000 UTC m=+4.158114982 container cleanup 46ad7000e829c8b0af1082628ee6465ff97c764c5183595b02966525981a43ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-b, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-06-03T00:08:28.450 INFO:journalctl@ceph.mds.b.smithi057.stdout:Jun 03 00:08:28 smithi057 bash[71318]: ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-b 2024-06-03T00:08:28.607 DEBUG:teuthology.orchestra.run.smithi057:> sudo pkill -f 'journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.b.service' 2024-06-03T00:08:28.642 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-03T00:08:28.643 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-06-03T00:08:28.643 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-06-03T00:08:28.643 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.e 2024-06-03T00:08:28.996 INFO:journalctl@ceph.mds.e.smithi057.stdout:Jun 03 00:08:28 smithi057 systemd[1]: Stopping Ceph mds.e for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-03T00:08:29.450 INFO:journalctl@ceph.mds.e.smithi057.stdout:Jun 03 00:08:28 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-e[65920]: 2024-06-03T00:08:28.995+0000 7f203e0c6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-03T00:08:29.450 INFO:journalctl@ceph.mds.e.smithi057.stdout:Jun 03 00:08:28 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-e[65920]: 2024-06-03T00:08:28.995+0000 7f203e0c6700 -1 mds.e *** got signal Terminated *** 2024-06-03T00:08:32.029 INFO:journalctl@ceph.mds.e.smithi057.stdout:Jun 03 00:08:31 smithi057 podman[71451]: 2024-06-03 00:08:31.73530926 +0000 UTC m=+2.867306394 container died c4cca4ed0d32620e2d7fda884fef361cfcee135f8beb300bc25144f3e80202b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-e, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD) 2024-06-03T00:08:32.450 INFO:journalctl@ceph.mds.e.smithi057.stdout:Jun 03 00:08:32 smithi057 podman[71451]: 2024-06-03 00:08:32.253878469 +0000 UTC m=+3.385875602 container cleanup c4cca4ed0d32620e2d7fda884fef361cfcee135f8beb300bc25144f3e80202b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-e, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-06-03T00:08:32.450 INFO:journalctl@ceph.mds.e.smithi057.stdout:Jun 03 00:08:32 smithi057 bash[71451]: ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-e 2024-06-03T00:08:32.741 DEBUG:teuthology.orchestra.run.smithi057:> sudo pkill -f 'journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.e.service' 2024-06-03T00:08:32.762 INFO:journalctl@ceph.mds.e.smithi057.stdout:Jun 03 00:08:32 smithi057 podman[71463]: 2024-06-03 00:08:32.496666629 +0000 UTC m=+0.761978979 container remove c4cca4ed0d32620e2d7fda884fef361cfcee135f8beb300bc25144f3e80202b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-06-03T00:08:32.762 INFO:journalctl@ceph.mds.e.smithi057.stdout:Jun 03 00:08:32 smithi057 systemd[1]: ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.e.service: Deactivated successfully. 2024-06-03T00:08:32.762 INFO:journalctl@ceph.mds.e.smithi057.stdout:Jun 03 00:08:32 smithi057 systemd[1]: Stopped Ceph mds.e for 890dd222-213a-11ef-bc9b-c7b262605968. 2024-06-03T00:08:32.762 INFO:journalctl@ceph.mds.e.smithi057.stdout:Jun 03 00:08:32 smithi057 systemd[1]: ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.e.service: Consumed 7.309s CPU time. 2024-06-03T00:08:32.775 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-03T00:08:32.775 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-06-03T00:08:32.775 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-06-03T00:08:32.775 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.h 2024-06-03T00:08:33.106 INFO:journalctl@ceph.mds.h.smithi057.stdout:Jun 03 00:08:32 smithi057 systemd[1]: Stopping Ceph mds.h for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-03T00:08:33.450 INFO:journalctl@ceph.mds.h.smithi057.stdout:Jun 03 00:08:33 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-h[66222]: 2024-06-03T00:08:33.107+0000 7f967073d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-03T00:08:33.450 INFO:journalctl@ceph.mds.h.smithi057.stdout:Jun 03 00:08:33 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-h[66222]: 2024-06-03T00:08:33.107+0000 7f967073d700 -1 mds.h *** got signal Terminated *** 2024-06-03T00:08:35.950 INFO:journalctl@ceph.mds.h.smithi057.stdout:Jun 03 00:08:35 smithi057 podman[71572]: 2024-06-03 00:08:35.746875164 +0000 UTC m=+2.747351569 container died 7d3d672cb2be11e03b2d8c6710752a0ba3bccebc05eead13bee8ed319d0ed4f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-h, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-03T00:08:36.450 INFO:journalctl@ceph.mds.h.smithi057.stdout:Jun 03 00:08:36 smithi057 podman[71572]: 2024-06-03 00:08:36.231611624 +0000 UTC m=+3.232088034 container cleanup 7d3d672cb2be11e03b2d8c6710752a0ba3bccebc05eead13bee8ed319d0ed4f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-h, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2) 2024-06-03T00:08:36.450 INFO:journalctl@ceph.mds.h.smithi057.stdout:Jun 03 00:08:36 smithi057 bash[71572]: ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-h 2024-06-03T00:08:36.618 DEBUG:teuthology.orchestra.run.smithi057:> sudo pkill -f 'journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.h.service' 2024-06-03T00:08:36.650 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-03T00:08:36.650 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-06-03T00:08:36.651 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-06-03T00:08:36.651 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.k 2024-06-03T00:08:37.018 INFO:journalctl@ceph.mds.k.smithi057.stdout:Jun 03 00:08:36 smithi057 systemd[1]: Stopping Ceph mds.k for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-03T00:08:37.449 INFO:journalctl@ceph.mds.k.smithi057.stdout:Jun 03 00:08:37 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-k[65607]: 2024-06-03T00:08:37.018+0000 7fef739ac700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-03T00:08:37.450 INFO:journalctl@ceph.mds.k.smithi057.stdout:Jun 03 00:08:37 smithi057 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-k[65607]: 2024-06-03T00:08:37.018+0000 7fef739ac700 -1 mds.k *** got signal Terminated *** 2024-06-03T00:08:40.177 INFO:journalctl@ceph.mds.k.smithi057.stdout:Jun 03 00:08:39 smithi057 podman[71694]: 2024-06-03 00:08:39.747253211 +0000 UTC m=+2.865756345 container died 338578aa18a2e11746a7b656b2677c506496951ac9cd7ff7c65167dd7c9a99c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-k, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-06-03T00:08:40.450 INFO:journalctl@ceph.mds.k.smithi057.stdout:Jun 03 00:08:40 smithi057 podman[71694]: 2024-06-03 00:08:40.260517402 +0000 UTC m=+3.379020527 container cleanup 338578aa18a2e11746a7b656b2677c506496951ac9cd7ff7c65167dd7c9a99c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-k, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-06-03T00:08:40.450 INFO:journalctl@ceph.mds.k.smithi057.stdout:Jun 03 00:08:40 smithi057 bash[71694]: ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-k 2024-06-03T00:08:40.704 DEBUG:teuthology.orchestra.run.smithi057:> sudo pkill -f 'journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.k.service' 2024-06-03T00:08:40.736 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-03T00:08:40.737 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-06-03T00:08:40.737 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-06-03T00:08:40.737 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.c 2024-06-03T00:08:41.029 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:08:40 smithi107 systemd[1]: Stopping Ceph mds.c for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-03T00:08:41.286 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:08:41 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:08:41.029+0000 7f8550721700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-03T00:08:41.286 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:08:41 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c[67806]: 2024-06-03T00:08:41.029+0000 7f8550721700 -1 mds.c *** got signal Terminated *** 2024-06-03T00:08:44.013 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:08:43 smithi107 podman[72797]: 2024-06-03 00:08:43.742951363 +0000 UTC m=+2.816272861 container died abe418febea0607dfba402a1cce2f69b508407ada57863282f8eb2eea9600b6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc) 2024-06-03T00:08:44.350 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:08:44 smithi107 podman[72797]: 2024-06-03 00:08:44.112895505 +0000 UTC m=+3.186216997 container cleanup abe418febea0607dfba402a1cce2f69b508407ada57863282f8eb2eea9600b6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-06-03T00:08:44.350 INFO:journalctl@ceph.mds.c.smithi107.stdout:Jun 03 00:08:44 smithi107 bash[72797]: ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-c 2024-06-03T00:08:44.499 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.c.service' 2024-06-03T00:08:44.533 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-03T00:08:44.534 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-06-03T00:08:44.534 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-06-03T00:08:44.534 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.f 2024-06-03T00:08:44.850 INFO:journalctl@ceph.mds.f.smithi107.stdout:Jun 03 00:08:44 smithi107 systemd[1]: Stopping Ceph mds.f for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-03T00:08:45.350 INFO:journalctl@ceph.mds.f.smithi107.stdout:Jun 03 00:08:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-f[67503]: 2024-06-03T00:08:44.857+0000 7f91eeeea700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-03T00:08:45.350 INFO:journalctl@ceph.mds.f.smithi107.stdout:Jun 03 00:08:44 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-f[67503]: 2024-06-03T00:08:44.857+0000 7f91eeeea700 -1 mds.f *** got signal Terminated *** 2024-06-03T00:08:47.991 INFO:journalctl@ceph.mds.f.smithi107.stdout:Jun 03 00:08:47 smithi107 podman[72929]: 2024-06-03 00:08:47.735235145 +0000 UTC m=+2.984338098 container died 0faeb1d20c2f69552ffe3de10a8c6452b077b48a081f35623d7b580f82f84f3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-03T00:08:48.350 INFO:journalctl@ceph.mds.f.smithi107.stdout:Jun 03 00:08:48 smithi107 podman[72929]: 2024-06-03 00:08:48.09129161 +0000 UTC m=+3.340394556 container cleanup 0faeb1d20c2f69552ffe3de10a8c6452b077b48a081f35623d7b580f82f84f3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-f, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-03T00:08:48.350 INFO:journalctl@ceph.mds.f.smithi107.stdout:Jun 03 00:08:48 smithi107 bash[72929]: ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-f 2024-06-03T00:08:48.519 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.f.service' 2024-06-03T00:08:48.552 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-03T00:08:48.552 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-06-03T00:08:48.553 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-06-03T00:08:48.553 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.i 2024-06-03T00:08:48.850 INFO:journalctl@ceph.mds.i.smithi107.stdout:Jun 03 00:08:48 smithi107 systemd[1]: Stopping Ceph mds.i for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-03T00:08:49.350 INFO:journalctl@ceph.mds.i.smithi107.stdout:Jun 03 00:08:48 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-i[68110]: 2024-06-03T00:08:48.880+0000 7f077db5e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-03T00:08:49.350 INFO:journalctl@ceph.mds.i.smithi107.stdout:Jun 03 00:08:48 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-i[68110]: 2024-06-03T00:08:48.880+0000 7f077db5e700 -1 mds.i *** got signal Terminated *** 2024-06-03T00:08:52.078 INFO:journalctl@ceph.mds.i.smithi107.stdout:Jun 03 00:08:51 smithi107 podman[73052]: 2024-06-03 00:08:51.737268579 +0000 UTC m=+2.973412630 container died edb3cfd7fcf7bf2343b51581e319a7a9a5fac85d6552a4b491074bb92af82f68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-i, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-06-03T00:08:52.350 INFO:journalctl@ceph.mds.i.smithi107.stdout:Jun 03 00:08:52 smithi107 podman[73052]: 2024-06-03 00:08:52.153632395 +0000 UTC m=+3.389776443 container cleanup edb3cfd7fcf7bf2343b51581e319a7a9a5fac85d6552a4b491074bb92af82f68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-i, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-03T00:08:52.350 INFO:journalctl@ceph.mds.i.smithi107.stdout:Jun 03 00:08:52 smithi107 bash[73052]: ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-i 2024-06-03T00:08:52.617 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.i.service' 2024-06-03T00:08:52.639 INFO:journalctl@ceph.mds.i.smithi107.stdout:Jun 03 00:08:52 smithi107 podman[73064]: 2024-06-03 00:08:52.38846609 +0000 UTC m=+0.647035001 container remove edb3cfd7fcf7bf2343b51581e319a7a9a5fac85d6552a4b491074bb92af82f68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-i, GIT_CLEAN=True, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-06-03T00:08:52.639 INFO:journalctl@ceph.mds.i.smithi107.stdout:Jun 03 00:08:52 smithi107 systemd[1]: ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.i.service: Deactivated successfully. 2024-06-03T00:08:52.639 INFO:journalctl@ceph.mds.i.smithi107.stdout:Jun 03 00:08:52 smithi107 systemd[1]: Stopped Ceph mds.i for 890dd222-213a-11ef-bc9b-c7b262605968. 2024-06-03T00:08:52.639 INFO:journalctl@ceph.mds.i.smithi107.stdout:Jun 03 00:08:52 smithi107 systemd[1]: ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.i.service: Consumed 1min 12.119s CPU time. 2024-06-03T00:08:52.648 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-03T00:08:52.648 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-06-03T00:08:52.648 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-06-03T00:08:52.648 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.l 2024-06-03T00:08:53.065 INFO:journalctl@ceph.mds.l.smithi107.stdout:Jun 03 00:08:52 smithi107 systemd[1]: Stopping Ceph mds.l for 890dd222-213a-11ef-bc9b-c7b262605968... 2024-06-03T00:08:53.350 INFO:journalctl@ceph.mds.l.smithi107.stdout:Jun 03 00:08:53 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-l[67199]: 2024-06-03T00:08:53.065+0000 7f032c13e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-03T00:08:53.350 INFO:journalctl@ceph.mds.l.smithi107.stdout:Jun 03 00:08:53 smithi107 ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-l[67199]: 2024-06-03T00:08:53.065+0000 7f032c13e700 -1 mds.l *** got signal Terminated *** 2024-06-03T00:08:56.049 INFO:journalctl@ceph.mds.l.smithi107.stdout:Jun 03 00:08:55 smithi107 podman[73173]: 2024-06-03 00:08:55.738298354 +0000 UTC m=+2.870567074 container died 753a3080ef56f1034422d852d5bcf2fa4d77a12ccc7db227d0adb13abb37499b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-l, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True) 2024-06-03T00:08:56.341 INFO:journalctl@ceph.mds.l.smithi107.stdout:Jun 03 00:08:56 smithi107 podman[73173]: 2024-06-03 00:08:56.14911879 +0000 UTC m=+3.281387503 container cleanup 753a3080ef56f1034422d852d5bcf2fa4d77a12ccc7db227d0adb13abb37499b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, GIT_CLEAN=True) 2024-06-03T00:08:56.341 INFO:journalctl@ceph.mds.l.smithi107.stdout:Jun 03 00:08:56 smithi107 bash[73173]: ceph-890dd222-213a-11ef-bc9b-c7b262605968-mds-l 2024-06-03T00:08:56.472 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-890dd222-213a-11ef-bc9b-c7b262605968@mds.l.service' 2024-06-03T00:08:56.502 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-03T00:08:56.502 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-06-03T00:08:56.503 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 890dd222-213a-11ef-bc9b-c7b262605968 --force --keep-logs 2024-06-03T00:08:56.702 INFO:teuthology.orchestra.run.smithi049.stdout:Deleting cluster with fsid: 890dd222-213a-11ef-bc9b-c7b262605968 2024-06-03T00:08:59.172 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 890dd222-213a-11ef-bc9b-c7b262605968 --force --keep-logs 2024-06-03T00:08:59.373 INFO:teuthology.orchestra.run.smithi057.stdout:Deleting cluster with fsid: 890dd222-213a-11ef-bc9b-c7b262605968 2024-06-03T00:09:01.920 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 890dd222-213a-11ef-bc9b-c7b262605968 --force --keep-logs 2024-06-03T00:09:02.109 INFO:teuthology.orchestra.run.smithi107.stdout:Deleting cluster with fsid: 890dd222-213a-11ef-bc9b-c7b262605968 2024-06-03T00:09:04.454 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-03T00:09:04.487 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-03T00:09:04.519 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-03T00:09:04.544 INFO:tasks.cephadm:Archiving crash dumps... 2024-06-03T00:09:04.547 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738688/remote/smithi049/crash 2024-06-03T00:09:04.548 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/crash -- . 2024-06-03T00:09:04.576 INFO:teuthology.orchestra.run.smithi049.stderr:tar: /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/crash: Cannot open: No such file or directory 2024-06-03T00:09:04.576 INFO:teuthology.orchestra.run.smithi049.stderr:tar: Error is not recoverable: exiting now 2024-06-03T00:09:04.578 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738688/remote/smithi057/crash 2024-06-03T00:09:04.579 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/crash -- . 2024-06-03T00:09:04.623 INFO:teuthology.orchestra.run.smithi057.stderr:tar: /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/crash: Cannot open: No such file or directory 2024-06-03T00:09:04.623 INFO:teuthology.orchestra.run.smithi057.stderr:tar: Error is not recoverable: exiting now 2024-06-03T00:09:04.624 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738688/remote/smithi107/crash 2024-06-03T00:09:04.625 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/crash -- . 2024-06-03T00:09:04.668 INFO:teuthology.orchestra.run.smithi107.stderr:tar: /var/lib/ceph/890dd222-213a-11ef-bc9b-c7b262605968/crash: Cannot open: No such file or directory 2024-06-03T00:09:04.668 INFO:teuthology.orchestra.run.smithi107.stderr:tar: Error is not recoverable: exiting now 2024-06-03T00:09:04.669 INFO:tasks.cephadm:Checking cluster log for badness... 2024-06-03T00:09:04.670 DEBUG:teuthology.orchestra.run.smithi049:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-06-03T00:09:04.708 INFO:teuthology.orchestra.run.smithi049.stdout:2024-06-03T00:02:44.482193+0000 mds.c (mds.2) 2 : cluster [WRN] Scrub error on inode 0x10000001338 (/volumes/qa/sv_1/546bc165-0360-459b-9bed-da0736be50f8/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/definitions/signal_h) see mds.c log and `damage ls` output for details 2024-06-03T00:09:04.710 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-06-03T00:09:04.711 INFO:tasks.cephadm:Compressing logs... 2024-06-03T00:09:04.711 DEBUG:teuthology.orchestra.run.smithi049:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-03T00:09:04.753 DEBUG:teuthology.orchestra.run.smithi057:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-03T00:09:04.756 DEBUG:teuthology.orchestra.run.smithi107:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-03T00:09:04.779 INFO:teuthology.orchestra.run.smithi107.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph.log 2024-06-03T00:09:04.779 INFO:teuthology.orchestra.run.smithi107.stderr:: No such file or directory 2024-06-03T00:09:04.779 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.2.log 2024-06-03T00:09:04.779 INFO:teuthology.orchestra.run.smithi107.stderr:gzip/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph.log: -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.f.log 2024-06-03T00:09:04.779 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph.audit.log 2024-06-03T00:09:04.779 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.5.log 2024-06-03T00:09:04.781 INFO:teuthology.orchestra.run.smithi049.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph.log 2024-06-03T00:09:04.782 INFO:teuthology.orchestra.run.smithi049.stderr:: No such file or directory 2024-06-03T00:09:04.782 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph.audit.log 2024-06-03T00:09:04.782 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.g.log 2024-06-03T00:09:04.782 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.j.log 2024-06-03T00:09:04.783 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.c.log 2024-06-03T00:09:04.783 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mon.c.log 2024-06-03T00:09:04.783 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mgr.z.log 2024-06-03T00:09:04.783 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.i.log 2024-06-03T00:09:04.784 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mgr.z.log: 90.4% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph.audit.log.gz 2024-06-03T00:09:04.793 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.3.log 2024-06-03T00:09:04.793 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.0.log 2024-06-03T00:09:04.793 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.j.log: /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mgr.x.log 2024-06-03T00:09:04.793 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mon.a.log 2024-06-03T00:09:04.793 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.6.log 2024-06-03T00:09:04.793 INFO:teuthology.orchestra.run.smithi049.stderr: 90.2% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph.audit.log.gz 2024-06-03T00:09:04.793 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph.cephadm.log 2024-06-03T00:09:04.793 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.6.log: 94.7% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.j.log.gz 2024-06-03T00:09:04.793 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.a.log 2024-06-03T00:09:04.794 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph.cephadm.log: 82.7% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph.cephadm.log.gz 2024-06-03T00:09:04.794 INFO:teuthology.orchestra.run.smithi049.stderr: 92.0% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph.log.gz 2024-06-03T00:09:04.794 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-volume.log 2024-06-03T00:09:04.794 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.d.log 2024-06-03T00:09:04.797 INFO:teuthology.orchestra.run.smithi107.stderr: 92.1% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph.log.gz 2024-06-03T00:09:04.797 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph.cephadm.log 2024-06-03T00:09:04.797 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.11.log 2024-06-03T00:09:04.797 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph.cephadm.log: 82.2% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph.cephadm.log.gz 2024-06-03T00:09:04.797 INFO:teuthology.orchestra.run.smithi107.stderr: 92.7% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mgr.z.log.gz 2024-06-03T00:09:04.797 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.8.log 2024-06-03T00:09:04.797 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-volume.log 2024-06-03T00:09:04.797 INFO:teuthology.orchestra.run.smithi057.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph.log 2024-06-03T00:09:04.797 INFO:teuthology.orchestra.run.smithi057.stderr:: No such file or directory 2024-06-03T00:09:04.798 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph.audit.log 2024-06-03T00:09:04.798 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.7.log 2024-06-03T00:09:04.798 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.b.log 2024-06-03T00:09:04.798 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.4.log 2024-06-03T00:09:04.798 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.1.log 2024-06-03T00:09:04.798 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mgr.y.log 2024-06-03T00:09:04.798 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.h.log 2024-06-03T00:09:04.798 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.10.log 2024-06-03T00:09:04.798 INFO:teuthology.orchestra.run.smithi057.stderr: 90.4% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph.audit.log.gz 2024-06-03T00:09:04.798 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph.cephadm.log 2024-06-03T00:09:04.798 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.10.log: 92.1% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph.log.gz 2024-06-03T00:09:04.798 INFO:teuthology.orchestra.run.smithi057.stderr: 92.6% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mgr.y.log.gz 2024-06-03T00:09:04.798 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.e.log 2024-06-03T00:09:04.799 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-volume.log 2024-06-03T00:09:04.799 INFO:teuthology.orchestra.run.smithi057.stderr: 82.2%/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.e.log: -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph.cephadm.log.gz 2024-06-03T00:09:04.799 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mon.b.log 2024-06-03T00:09:04.800 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.9.log 2024-06-03T00:09:04.802 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.8.log: /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.l.log 2024-06-03T00:09:04.802 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.d.log: 91.1% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-volume.log.gz 2024-06-03T00:09:04.805 INFO:teuthology.orchestra.run.smithi049.stderr: 94.7% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.d.log.gz 2024-06-03T00:09:04.806 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-06-03T00:09:04.806 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-volume.log: 91.1% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-volume.log.gz 2024-06-03T00:09:04.807 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.k.log 2024-06-03T00:09:04.811 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-06-03T00:09:04.819 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-06-03T00:09:04.830 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.l.log: 91.1% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-volume.log.gz 2024-06-03T00:09:04.830 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/cephadm.log: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-06-03T00:09:04.837 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.9.log: /var/log/ceph/cephadm.log: 94.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-06-03T00:09:04.838 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.k.log: /var/log/ceph/cephadm.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-06-03T00:09:05.038 INFO:teuthology.orchestra.run.smithi049.stderr: 90.1% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mgr.x.log.gz 2024-06-03T00:09:05.121 INFO:teuthology.orchestra.run.smithi107.stderr: 91.8% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mon.c.log.gz 2024-06-03T00:09:05.148 INFO:teuthology.orchestra.run.smithi057.stderr: 91.9% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mon.b.log.gz 2024-06-03T00:09:05.632 INFO:teuthology.orchestra.run.smithi049.stderr: 95.4% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.g.log.gz 2024-06-03T00:09:05.684 INFO:teuthology.orchestra.run.smithi049.stderr: 95.0% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.a.log.gz 2024-06-03T00:09:05.769 INFO:teuthology.orchestra.run.smithi049.stderr: 90.5% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mon.a.log.gz 2024-06-03T00:09:05.929 INFO:teuthology.orchestra.run.smithi057.stderr: 95.2% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.k.log.gz 2024-06-03T00:09:06.005 INFO:teuthology.orchestra.run.smithi107.stderr: 95.0% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.l.log.gz 2024-06-03T00:09:06.580 INFO:teuthology.orchestra.run.smithi049.stderr: 93.7% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.9.log.gz 2024-06-03T00:09:06.921 INFO:teuthology.orchestra.run.smithi057.stderr: 93.6% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.4.log.gz 2024-06-03T00:09:07.163 INFO:teuthology.orchestra.run.smithi057.stderr: 93.7% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.10.log.gz 2024-06-03T00:09:07.169 INFO:teuthology.orchestra.run.smithi049.stderr: 93.6% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.6.log.gz 2024-06-03T00:09:07.305 INFO:teuthology.orchestra.run.smithi057.stderr: 95.0% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.e.log.gz 2024-06-03T00:09:07.330 INFO:teuthology.orchestra.run.smithi049.stderr: 93.7% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.0.log.gz 2024-06-03T00:09:07.674 INFO:teuthology.orchestra.run.smithi107.stderr: 93.6% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.11.log.gz 2024-06-03T00:09:07.692 INFO:teuthology.orchestra.run.smithi049.stderr: 93.7% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.3.log.gz 2024-06-03T00:09:07.694 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-06-03T00:09:07.694 INFO:teuthology.orchestra.run.smithi049.stderr:real 0m2.927s 2024-06-03T00:09:07.694 INFO:teuthology.orchestra.run.smithi049.stderr:user 0m12.235s 2024-06-03T00:09:07.694 INFO:teuthology.orchestra.run.smithi049.stderr:sys 0m0.414s 2024-06-03T00:09:07.748 INFO:teuthology.orchestra.run.smithi057.stderr: 93.7% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.1.log.gz 2024-06-03T00:09:07.793 INFO:teuthology.orchestra.run.smithi107.stderr: 93.7% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.8.log.gz 2024-06-03T00:09:07.928 INFO:teuthology.orchestra.run.smithi107.stderr: 93.8% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.5.log.gz 2024-06-03T00:09:08.147 INFO:teuthology.orchestra.run.smithi107.stderr: 93.8% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.2.log.gz 2024-06-03T00:09:08.590 INFO:teuthology.orchestra.run.smithi057.stderr: 93.8% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-osd.7.log.gz 2024-06-03T00:09:14.691 INFO:teuthology.orchestra.run.smithi057.stderr: 94.3% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.h.log.gz 2024-06-03T00:09:16.417 INFO:teuthology.orchestra.run.smithi107.stderr: 94.3% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.c.log.gz 2024-06-03T00:09:17.095 INFO:teuthology.orchestra.run.smithi057.stderr: 94.5% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.b.log.gz 2024-06-03T00:09:17.097 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-06-03T00:09:17.097 INFO:teuthology.orchestra.run.smithi057.stderr:real 0m12.327s 2024-06-03T00:09:17.097 INFO:teuthology.orchestra.run.smithi057.stderr:user 0m36.031s 2024-06-03T00:09:17.097 INFO:teuthology.orchestra.run.smithi057.stderr:sys 0m1.095s 2024-06-03T00:09:17.676 INFO:teuthology.orchestra.run.smithi107.stderr: 94.2% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.f.log.gz 2024-06-03T00:09:29.784 INFO:teuthology.orchestra.run.smithi107.stderr: 93.4% -- replaced with /var/log/ceph/890dd222-213a-11ef-bc9b-c7b262605968/ceph-mds.i.log.gz 2024-06-03T00:09:29.785 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-06-03T00:09:29.785 INFO:teuthology.orchestra.run.smithi107.stderr:real 0m25.016s 2024-06-03T00:09:29.785 INFO:teuthology.orchestra.run.smithi107.stderr:user 1m1.201s 2024-06-03T00:09:29.786 INFO:teuthology.orchestra.run.smithi107.stderr:sys 0m1.858s 2024-06-03T00:09:29.786 INFO:tasks.cephadm:Archiving logs... 2024-06-03T00:09:29.786 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738688/remote/smithi049/log 2024-06-03T00:09:29.787 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-03T00:09:31.322 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738688/remote/smithi057/log 2024-06-03T00:09:31.323 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-03T00:09:35.386 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738688/remote/smithi107/log 2024-06-03T00:09:35.387 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-03T00:09:43.015 INFO:tasks.cephadm:Removing cluster... 2024-06-03T00:09:43.015 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 890dd222-213a-11ef-bc9b-c7b262605968 --force 2024-06-03T00:09:43.216 INFO:teuthology.orchestra.run.smithi049.stdout:Deleting cluster with fsid: 890dd222-213a-11ef-bc9b-c7b262605968 2024-06-03T00:09:43.493 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 890dd222-213a-11ef-bc9b-c7b262605968 --force 2024-06-03T00:09:43.691 INFO:teuthology.orchestra.run.smithi057.stdout:Deleting cluster with fsid: 890dd222-213a-11ef-bc9b-c7b262605968 2024-06-03T00:09:43.998 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 890dd222-213a-11ef-bc9b-c7b262605968 --force 2024-06-03T00:09:44.189 INFO:teuthology.orchestra.run.smithi107.stdout:Deleting cluster with fsid: 890dd222-213a-11ef-bc9b-c7b262605968 2024-06-03T00:09:44.506 INFO:tasks.cephadm:Removing cephadm ... 2024-06-03T00:09:44.507 DEBUG:teuthology.orchestra.run.smithi049:> rm -rf /home/ubuntu/cephtest/cephadm 2024-06-03T00:09:44.527 DEBUG:teuthology.orchestra.run.smithi057:> rm -rf /home/ubuntu/cephtest/cephadm 2024-06-03T00:09:44.544 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf /home/ubuntu/cephtest/cephadm 2024-06-03T00:09:44.559 INFO:tasks.cephadm:Teardown complete 2024-06-03T00:09:44.560 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-06-03T00:09:44.571 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-06-03T00:09:44.571 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-03T00:09:44.574 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-03T00:09:44.587 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-03T00:09:44.674 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-06-03T00:09:44.684 INFO:teuthology.task.clock:Checking final clock skew... 2024-06-03T00:09:44.684 DEBUG:teuthology.orchestra.run.smithi049:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-03T00:09:44.687 DEBUG:teuthology.orchestra.run.smithi057:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-03T00:09:44.689 DEBUG:teuthology.orchestra.run.smithi107:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-03T00:09:44.702 INFO:teuthology.orchestra.run.smithi049.stderr:bash: line 1: ntpq: command not found 2024-06-03T00:09:44.702 INFO:teuthology.orchestra.run.smithi057.stderr:bash: line 1: ntpq: command not found 2024-06-03T00:09:44.703 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2024-06-03T00:09:44.706 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-03T00:09:44.706 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2024-06-03T00:09:44.707 INFO:teuthology.orchestra.run.smithi107.stdout:^* hv01.front.sepia.ceph.com 3 6 377 63 +163us[ +156us] +/- 48ms 2024-06-03T00:09:44.707 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 63 -851us[ -851us] +/- 49ms 2024-06-03T00:09:44.707 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 60 +604us[ +604us] +/- 70ms 2024-06-03T00:09:44.707 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-03T00:09:44.709 INFO:teuthology.orchestra.run.smithi049.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-03T00:09:44.709 INFO:teuthology.orchestra.run.smithi049.stdout:=============================================================================== 2024-06-03T00:09:44.709 INFO:teuthology.orchestra.run.smithi049.stdout:^* hv01.front.sepia.ceph.com 3 7 377 61 +216us[ +141us] +/- 48ms 2024-06-03T00:09:44.709 INFO:teuthology.orchestra.run.smithi049.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 63 -850us[ -925us] +/- 49ms 2024-06-03T00:09:44.709 INFO:teuthology.orchestra.run.smithi049.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 126 +659us[ +585us] +/- 69ms 2024-06-03T00:09:44.709 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-03T00:09:44.709 INFO:teuthology.orchestra.run.smithi057.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-03T00:09:44.709 INFO:teuthology.orchestra.run.smithi057.stdout:=============================================================================== 2024-06-03T00:09:44.709 INFO:teuthology.orchestra.run.smithi057.stdout:^* hv01.front.sepia.ceph.com 3 6 377 2 +241us[ +173us] +/- 49ms 2024-06-03T00:09:44.709 INFO:teuthology.orchestra.run.smithi057.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 62 -810us[ -878us] +/- 49ms 2024-06-03T00:09:44.709 INFO:teuthology.orchestra.run.smithi057.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 65 +659us[ +591us] +/- 70ms 2024-06-03T00:09:44.709 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-03T00:09:44.710 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-06-03T00:09:44.720 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-06-03T00:09:44.721 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-06-03T00:09:44.730 DEBUG:teuthology.orchestra.run.smithi049:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-03T00:09:44.837 DEBUG:teuthology.orchestra.run.smithi057:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-03T00:09:44.906 DEBUG:teuthology.orchestra.run.smithi107:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-03T00:09:44.971 DEBUG:teuthology.orchestra.run.smithi049:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-03T00:09:45.001 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-03T00:09:45.002 DEBUG:teuthology.orchestra.run.smithi057:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-03T00:09:45.030 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-03T00:09:45.031 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-03T00:09:45.056 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-03T00:09:45.057 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-06-03T00:09:45.070 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-06-03T00:09:45.080 INFO:teuthology.task.internal:Duration was 1706.058605 seconds 2024-06-03T00:09:45.080 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-06-03T00:09:45.090 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-06-03T00:09:45.091 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-03T00:09:45.093 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-03T00:09:45.096 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-03T00:09:45.133 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-03T00:09:45.134 INFO:teuthology.orchestra.run.smithi049.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-03T00:09:45.134 INFO:teuthology.orchestra.run.smithi057.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-03T00:09:45.512 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-06-03T00:09:45.512 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi049.front.sepia.ceph.com 2024-06-03T00:09:45.512 DEBUG:teuthology.orchestra.run.smithi049:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-03T00:09:45.576 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi057.front.sepia.ceph.com 2024-06-03T00:09:45.577 DEBUG:teuthology.orchestra.run.smithi057:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-03T00:09:45.601 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi107.front.sepia.ceph.com 2024-06-03T00:09:45.601 DEBUG:teuthology.orchestra.run.smithi107:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-03T00:09:45.620 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-06-03T00:09:45.620 DEBUG:teuthology.orchestra.run.smithi049:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-03T00:09:45.623 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-03T00:09:45.643 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-03T00:09:45.686 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-06-03T00:09:45.686 DEBUG:teuthology.orchestra.run.smithi049:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-03T00:09:45.690 DEBUG:teuthology.orchestra.run.smithi057:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-03T00:09:45.714 DEBUG:teuthology.orchestra.run.smithi107:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-03T00:09:46.639 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-06-03T00:09:46.652 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-06-03T00:09:46.652 DEBUG:teuthology.orchestra.run.smithi049:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-03T00:09:46.678 DEBUG:teuthology.orchestra.run.smithi057:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-03T00:09:46.706 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-03T00:09:46.731 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-06-03T00:09:46.743 DEBUG:teuthology.orchestra.run.smithi049:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-03T00:09:46.746 DEBUG:teuthology.orchestra.run.smithi057:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-03T00:09:46.749 DEBUG:teuthology.orchestra.run.smithi107:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-03T00:09:46.768 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = core 2024-06-03T00:09:46.772 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = core 2024-06-03T00:09:46.794 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = core 2024-06-03T00:09:46.816 DEBUG:teuthology.orchestra.run.smithi049:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-03T00:09:46.837 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-03T00:09:46.837 DEBUG:teuthology.orchestra.run.smithi057:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-03T00:09:46.856 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-03T00:09:46.856 DEBUG:teuthology.orchestra.run.smithi107:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-03T00:09:46.871 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-03T00:09:46.871 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-06-03T00:09:46.883 INFO:teuthology.task.internal:Transferring archived files... 2024-06-03T00:09:46.884 DEBUG:teuthology.misc:Transferring archived files from smithi049:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738688/remote/smithi049 2024-06-03T00:09:46.884 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-03T00:09:46.938 DEBUG:teuthology.misc:Transferring archived files from smithi057:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738688/remote/smithi057 2024-06-03T00:09:46.938 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-03T00:09:46.974 DEBUG:teuthology.misc:Transferring archived files from smithi107:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738688/remote/smithi107 2024-06-03T00:09:46.975 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-03T00:09:47.011 INFO:teuthology.task.internal:Removing archive directory... 2024-06-03T00:09:47.011 DEBUG:teuthology.orchestra.run.smithi049:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-03T00:09:47.013 DEBUG:teuthology.orchestra.run.smithi057:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-03T00:09:47.016 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-03T00:09:47.060 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-06-03T00:09:47.071 INFO:teuthology.task.internal:Not uploading archives. 2024-06-03T00:09:47.071 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-06-03T00:09:47.082 INFO:teuthology.task.internal:Tidying up after the test... 2024-06-03T00:09:47.082 DEBUG:teuthology.orchestra.run.smithi049:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-03T00:09:47.084 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-03T00:09:47.086 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-03T00:09:47.097 INFO:teuthology.orchestra.run.smithi049.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 3 00:09 /home/ubuntu/cephtest 2024-06-03T00:09:47.099 INFO:teuthology.orchestra.run.smithi057.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 3 00:09 /home/ubuntu/cephtest 2024-06-03T00:09:47.115 INFO:teuthology.orchestra.run.smithi107.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 3 00:09 /home/ubuntu/cephtest 2024-06-03T00:09:47.116 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-06-03T00:09:47.128 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-06-03T00:09:47.154 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/fsstress}} duration: 1706.0586051940918 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-06-03T00:09:47.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-03T00:09:47.235 INFO:teuthology.run:FAIL